fn_spacy_tokens_for_baseline: For we are taught both by the words of worthy men of old and by our experience that this is a most certain sign , and it has been found that even if she be urged and exhorted by solemn conjurations to shed tears , if she be a witch she will not be able to weep : although she will assume a tearful aspect and smear her cheeks and eyes with spittle to make it appear that she is weeping ; wherefore she must be closely watched by the attendants .

source_bert_toks: for we are taught both by the words of worthy men of old and by our experience that this is a most certain sign , and it has been found that even if she be urged and ex ##hort ##ed by solemn con ##ju ##rations to shed tears , if she be a witch she will not be able to weep : although she will assume a tear ##ful aspect and sm ##ear her cheeks and eyes with spit ##tle to make it appear that she is weeping ; where ##for ##e she must be closely watched by the attendants .

reference_raw: For we have been taught both by the words of good men of old and by our experience that this is a sure sign, and we have learned that even if she is called upon and exhilarated by solemn conjurations to shed tears, if she is a witch, she will not be able to cry: even if she takes a tearful look and smears her cheeks and eyes with spittles to make it look like she's crying; Watched closely by the attendants.

reference_spacy_tokens: For we have been taught both by the words of good men of old and by our experience that this is a sure sign , and we have learned that even if she is called upon and exhilarated by solemn conjurations to shed tears , if she is a witch , she will not be able to cry : even if she takes a tearful look and smears her cheeks and eyes with spittles to make it look like she 's crying ; Watched closely by the attendants .


fn_spacy_tokens_for_baseline: The crowd milled around chatting and exchanging tips , hawking and spitting , slurping tea and placing bets .

source_bert_toks: the crowd mill ##ed around chatting and exchanging tips , hawk ##ing and spitting , sl ##ur ##ping tea and placing bets .

reference_raw: The crowd milled around talking and exchanging tips, falconing and spitting, sipping tea and putting bets on it.

reference_spacy_tokens: The crowd milled around talking and exchanging tips , falconing and spitting , sipping tea and putting bets on it .


fn_spacy_tokens_for_baseline: Unfortunately , ' she added , with a quick look round as if she thought to check whether anyone might hear , ' Sir John 's partiality for Benedict extended also to his mother . '

source_bert_toks: unfortunately , ' she added , with a quick look round as if she thought to check whether anyone might hear , ' sir john ' s partial ##ity for benedict extended also to his mother . '

reference_raw: "Unfortunately," she added, glancing around as if to see if anyone could hear, "Sir John's affection for Benedict extends to his mother as well."

reference_spacy_tokens: " Unfortunately , " she added , glancing around as if to see if anyone could hear , " Sir John 's affection for Benedict extends to his mother as well . "


fn_spacy_tokens_for_baseline: The law of nullity covers not only cases where the purported marriage was void , but also those where the marriage , though initially valid , is voidable , and thus may be set aside .

source_bert_toks: the law of null ##ity covers not only cases where the purported marriage was void , but also those where the marriage , though initially valid , is void ##able , and thus may be set aside .

reference_raw: The nullity law applies not only to cases in which the alleged marriage is invalid, but also to cases in which the marriage, although initially valid, is void and can therefore be annulled.

reference_spacy_tokens: The nullity law applies not only to cases in which the alleged marriage is invalid , but also to cases in which the marriage , although initially valid , is void and can therefore be annulled .


fn_spacy_tokens_for_baseline: Polanski had received notices of similar disquiet over his films .

source_bert_toks: pol ##ans ##ki had received notices of similar di ##s ##qui ##et over his films .

reference_raw: Polanski received notices of similar uneasiness about his films.

reference_spacy_tokens: Polanski received notices of similar uneasiness about his films .


fn_spacy_tokens_for_baseline: We rarely saw its summit , lost as it would be in thick mist , but its mystery made it all the more attractive and seductive .

source_bert_toks: we rarely saw its summit , lost as it would be in thick mist , but its mystery made it all the more attractive and seductive .

reference_raw: Its peak was seldom seen, lost as it would have been in a thick fog, but its mystery made it all the more attractive and seductive.

reference_spacy_tokens: Its peak was seldom seen , lost as it would have been in a thick fog , but its mystery made it all the more attractive and seductive .


fn_spacy_tokens_for_baseline: Dora , Lady Westbourne , might not be enamoured of her husband , but she was not going to be pitied .

source_bert_toks: dora , lady west ##bourne , might not be en ##amo ##ured of her husband , but she was not going to be pit ##ied .

reference_raw: Dora, Lady Westbourne, might not be in love with her husband, but she would not be sorry.

reference_spacy_tokens: Dora , Lady Westbourne , might not be in love with her husband , but she would not be sorry .


fn_spacy_tokens_for_baseline: Willie turned quickly away and walked out of the door , his ears smarting .

source_bert_toks: willie turned quickly away and walked out of the door , his ears smart ##ing .

reference_raw: Willie turned quickly and walked out the door, his ears bright.

reference_spacy_tokens: Willie turned quickly and walked out the door , his ears bright .


fn_spacy_tokens_for_baseline: Comforting him , I rushed to hone the Poisons Bureau , grabbing the booklet at the same time .

source_bert_toks: comforting him , i rushed to hon ##e the poison ##s bureau , grabbing the booklet at the same time .

reference_raw: I cheered him up and hurried to hone the poisons office and picked up the brochure at the same time.

reference_spacy_tokens: I cheered him up and hurried to hone the poisons office and picked up the brochure at the same time .


fn_spacy_tokens_for_baseline: Words have different meanings in different contexts .

source_bert_toks: words have different meanings in different contexts .

reference_raw: Words have different senses in different contexts.

reference_spacy_tokens: Words have different senses in different contexts .


fn_spacy_tokens_for_baseline: Investment in an agency , branch or subsidiary will be expected to pay for itself by generating extra business .

source_bert_toks: investment in an agency , branch or subsidiary will be expected to pay for itself by generating extra business .

reference_raw: Investments in an agency, branch or subsidiary are expected to be paid for by the creation of additional activities.

reference_spacy_tokens: Investments in an agency , branch or subsidiary are expected to be paid for by the creation of additional activities .


fn_spacy_tokens_for_baseline: ' If we do n't sell , we can lease the cellars to the Italians as they wanted .

source_bert_toks: ' if we don ' t sell , we can lease the cellar ##s to the italians as they wanted .

reference_raw: If we don't sell, we can rent the cellars to the ltalians for what they want.

reference_spacy_tokens: If we do n't sell , we can rent the cellars to the ltalians for what they want .


fn_spacy_tokens_for_baseline: The rivers and streams of Central America have virtually no plant life , as the current is too strong for them to survive .

source_bert_toks: the rivers and streams of central america have virtually no plant life , as the current is too strong for them to survive .

reference_raw: Central American rivers and streams have virtually no plant life, because the current is too powerful to survive.

reference_spacy_tokens: Central American rivers and streams have virtually no plant life , because the current is too powerful to survive .


fn_spacy_tokens_for_baseline: But Christians think that God Himself has taught us how to speak of Him .

source_bert_toks: but christians think that god himself has taught us how to speak of him .

reference_raw: But they believe that God himself taught us how to talk about him.

reference_spacy_tokens: But they believe that God himself taught us how to talk about him .


fn_spacy_tokens_for_baseline: ' I ca n't think of two more depressing words then ' healthy eating ' -- together they conjure up images of grated carrot , naked lettuce and slices of vegetarian quiche .

source_bert_toks: ' i can ' t think of two more de ##pressing words then ' healthy eating ' - - together they con ##jure up images of gr ##ated carrot , naked let ##tu ##ce and slices of vegetarian qui ##che .

reference_raw: 'I can't think of two more depressing words than 'healthy food' - together they conjure up pictures of grated carrots, nude salads and slices of vegetarian quiche.

reference_spacy_tokens: ' I ca n't think of two more depressing words than ' healthy food ' - together they conjure up pictures of grated carrots , nude salads and slices of vegetarian quiche .


fn_spacy_tokens_for_baseline: The school has no uniform , and members of staff are addressed by pupils with their forenames , giving the school a remarkably relaxed but purposefully informal atmosphere .

source_bert_toks: the school has no uniform , and members of staff are addressed by pupils with their fore ##name ##s , giving the school a remarkably relaxed but purpose ##fully informal atmosphere .

reference_raw: The school is not uniformed, and the staff are addressed by the pupils with their surnames, which give the school a remarkably relaxed but deliberately informal atmosphere.

reference_spacy_tokens: The school is not uniformed , and the staff are addressed by the pupils with their surnames , which give the school a remarkably relaxed but deliberately informal atmosphere .


fn_spacy_tokens_for_baseline: Certainly Dr Darnell 's account of the trip to Wetherby 's room with clothes coincides neatly with Lee Horan 's recollections .

source_bert_toks: certainly dr dar ##nell ' s account of the trip to wet ##her ##by ' s room with clothes coincide ##s neatly with lee ho ##ran ' s rec ##oll ##ection ##s .

reference_raw: I'm sure Dr. Darnell's description of the trip to Wetherby's room with the clothes matches Lee Horan's memory.

reference_spacy_tokens: I 'm sure Dr. Darnell 's description of the trip to Wetherby 's room with the clothes matches Lee Horan 's memory .


fn_spacy_tokens_for_baseline: Her family heard she had been taken to the Regional Command Military camp in Legaspi City .

source_bert_toks: her family heard she had been taken to the regional command military camp in leg ##as ##pi city .

reference_raw: Her family's been told that she's been taken to a regional command military camp in Legaspi City.

reference_spacy_tokens: Her family 's been told that she 's been taken to a regional command military camp in Legaspi City .


fn_spacy_tokens_for_baseline: Hugh Gaitskell , a leader of the strongly pro - American faction , later summed up his impressions of the relationship .

source_bert_toks: hugh ga ##its ##kell , a leader of the strongly pro - american faction , later sum ##med up his impressions of the relationship .

reference_raw: Hugh Gaitskell, the leader of a highly pro-American faction, later summarised his feelings about the relationship.

reference_spacy_tokens: Hugh Gaitskell , the leader of a highly pro - American faction , later summarised his feelings about the relationship .


fn_spacy_tokens_for_baseline: Both by - elections had been made necessary by the deaths of the sitting Solidarity senators .

source_bert_toks: both by - elections had been made necessary by the deaths of the sitting solidarity senators .

reference_raw: The deaths of the sitting Solidarity Senators required both by-elections.

reference_spacy_tokens: The deaths of the sitting Solidarity Senators required both by - elections .


fn_spacy_tokens_for_baseline: We seized our weapons and ran to Kilgrimol , and out of the Treasure House came a band of warrior women , bearing Undry .

source_bert_toks: we seized our weapons and ran to ki ##l ##gr ##imo ##l , and out of the treasure house came a band of warrior women , bearing und ##ry .

reference_raw: We gathered up our weapons and ran to Kilgrimol, and a group of warriors, bearing Undry, emerged from the Treasure House.

reference_spacy_tokens: We gathered up our weapons and ran to Kilgrimol , and a group of warriors , bearing Undry , emerged from the Treasure House .


fn_spacy_tokens_for_baseline: Anybody who thought that Bath 's tight grip on the Pilkington Cup was over had better think again .

source_bert_toks: anybody who thought that bath ' s tight grip on the pi ##lk ##ington cup was over had better think again .

reference_raw: Anyone who thought Bath's tight grip on the Pilkington Cup was over should think again.

reference_spacy_tokens: Anyone who thought Bath 's tight grip on the Pilkington Cup was over should think again .


fn_spacy_tokens_for_baseline: We hope that by talking to the person who assessed your needs , you will reach an agreement about the way ahead .

source_bert_toks: we hope that by talking to the person who assessed your needs , you will reach an agreement about the way ahead .

reference_raw: We hope that if you talk to the person who assessed your needs, you'll come to an agreement on the way forward.

reference_spacy_tokens: We hope that if you talk to the person who assessed your needs , you 'll come to an agreement on the way forward .


fn_spacy_tokens_for_baseline: There is another source of light between these walls , a light which can not flicker and die like that from the misshapen lump of white wax dripping into the saucer on my table .

source_bert_toks: there is another source of light between these walls , a light which can not flicker and die like that from the miss ##ha ##pen lump of white wax dripping into the sauce ##r on my table .

reference_raw: There's another light source between these walls, a light that can't flicker and die like this from a patch of white wax dripping into a plate on my desk.

reference_spacy_tokens: There 's another light source between these walls , a light that ca n't flicker and die like this from a patch of white wax dripping into a plate on my desk .


fn_spacy_tokens_for_baseline: Two enormous tears welled out of Pickerage 's eyes and ran rapidly down his cheeks , followed by others .

source_bert_toks: two enormous tears well ##ed out of pick ##era ##ge ' s eyes and ran rapidly down his cheeks , followed by others .

reference_raw: Two huge tears flowed from Pickerage's eyes and hurried down his cheeks, followed by others.

reference_spacy_tokens: Two huge tears flowed from Pickerage 's eyes and hurried down his cheeks , followed by others .


fn_spacy_tokens_for_baseline: It was Garcia , then , who had an enterprise , and apparently a criminal enterprise , in hand that night in the course of which he met his death .

source_bert_toks: it was garcia , then , who had an enterprise , and apparently a criminal enterprise , in hand that night in the course of which he met his death .

reference_raw: So it was Garcia, who had a business, and apparently a criminal business, who had been in his hands that evening, during which he had met his death.

reference_spacy_tokens: So it was Garcia , who had a business , and apparently a criminal business , who had been in his hands that evening , during which he had met his death .


fn_spacy_tokens_for_baseline: Although ostensibly created entirely for defensive purposes , since government and Cuban military forces in Angola were reportedly equipped for and planning to use -- if not already using -- CW agents against the South African Defence Force ( SADF ) , from the outset the program also had offensive features and capabilities .

source_bert_toks: although ostensibly created entirely for defensive purposes , since government and cuban military forces in angola were reportedly equipped for and planning to use - - if not already using - - cw agents against the south african defence force ( sad ##f ) , from the outset the program also had offensive features and capabilities .

reference_raw: Although ostensibly designed entirely for defence purposes, since the government and Cuban military forces in Angola were supposedly equipped to use, if not already used, the weapons of war against the South African Defence Force (SADF), the program had offensive features and capabilities from the very beginning.

reference_spacy_tokens: Although ostensibly designed entirely for defence purposes , since the government and Cuban military forces in Angola were supposedly equipped to use , if not already used , the weapons of war against the South African Defence Force ( SADF ) , the program had offensive features and capabilities from the very beginning .


fn_spacy_tokens_for_baseline: ' No , much better recruit your energies , ' said Anthony , just as David returned carrying a jug of hot water and two slices of lemon on a plate .

source_bert_toks: ' no , much better recruit your energies , ' said anthony , just as david returned carrying a jug of hot water and two slices of lemon on a plate .

reference_raw: 'No, much better get your energy,' said Anthony, as David returned with a pitcher of hot water and two slices of lemon on his plate.

reference_spacy_tokens: ' No , much better get your energy , ' said Anthony , as David returned with a pitcher of hot water and two slices of lemon on his plate .


fn_spacy_tokens_for_baseline: However , his scrap with brother Joey enthralled the crowd and at the finish they came over the line almost together .

source_bert_toks: however , his scrap with brother joey en ##th ##ral ##led the crowd and at the finish they came over the line almost together .

reference_raw: But his piece of Brother Joey caught the crowd, and at the end they crossed the line almost together.

reference_spacy_tokens: But his piece of Brother Joey caught the crowd , and at the end they crossed the line almost together .


fn_spacy_tokens_for_baseline: The Supreme Court is studying whether growing marijuana for personal use is legal , after a regional court stupefied authorities last year by saying it is .

source_bert_toks: the supreme court is studying whether growing marijuana for personal use is legal , after a regional court stu ##pe ##fied authorities last year by saying it is .

reference_raw: The Supreme Court is examining whether the cultivation of marijuana for personal use is legal, after the regional court stunned the authorities last year by saying that it is.

reference_spacy_tokens: The Supreme Court is examining whether the cultivation of marijuana for personal use is legal , after the regional court stunned the authorities last year by saying that it is .


fn_spacy_tokens_for_baseline: All these nationalist aspirations found a focus in Aung San , who had distinguished himself in his university days as the leader of a well - organised strike of university students .

source_bert_toks: all these nationalist aspirations found a focus in au ##ng san , who had distinguished himself in his university days as the leader of a well - organised strike of university students .

reference_raw: All these nationalist aspirations found their focus in Aung San, who, during his university days, had distinguished himself as the leader of a well-organized attack on university pupils.

reference_spacy_tokens: All these nationalist aspirations found their focus in Aung San , who , during his university days , had distinguished himself as the leader of a well - organized attack on university pupils .


fn_spacy_tokens_for_baseline: Tamar found the side - saddle strange at first , but her previous experience stood her in good stead .

source_bert_toks: tam ##ar found the side - saddle strange at first , but her previous experience stood her in good ste ##ad .

reference_raw: At first, Tamar found the side saddle odd, but her past experience had put her in a good position.

reference_spacy_tokens: At first , Tamar found the side saddle odd , but her past experience had put her in a good position .


fn_spacy_tokens_for_baseline: She bent down quickly and retrieved the folder that , as she 'd sat down , she 'd laid on the floor by her chair .

source_bert_toks: she bent down quickly and retrieved the folder that , as she ' d sat down , she ' d laid on the floor by her chair .

reference_raw: Quickly she bent down and picked up the folder she had placed on the floor beside her chair when she sat down.

reference_spacy_tokens: Quickly she bent down and picked up the folder she had placed on the floor beside her chair when she sat down .


fn_spacy_tokens_for_baseline: People in this town starved , several buildings were bombed and crime soared because you had to steal to eat .

source_bert_toks: people in this town starved , several buildings were bombed and crime soared because you had to steal to eat .

reference_raw: People in this city were starving, a few buildings were bombed, and crime went up because you had to rob to eat.

reference_spacy_tokens: People in this city were starving , a few buildings were bombed , and crime went up because you had to rob to eat .


fn_spacy_tokens_for_baseline: He concentrated on the woman becoming displeasing in general , not in the particular sense of adultery .

source_bert_toks: he concentrated on the woman becoming di ##sp ##lea ##sing in general , not in the particular sense of adultery .

reference_raw: He concentrated on the woman's displeasure in general, not in a particular sense of adultery.

reference_spacy_tokens: He concentrated on the woman 's displeasure in general , not in a particular sense of adultery .


fn_spacy_tokens_for_baseline: yeah i mean uh to add dependents is is you know maybe another dollar or something it 's no big deal

source_bert_toks: yeah i mean uh to add dependent ##s is is you know maybe another dollar or something it ' s no big deal

reference_raw: Yeah, I mean, uh, addition of addicts is, you know, maybe another dollar or something, it's not a big deal.

reference_spacy_tokens: Yeah , I mean , uh , addition of addicts is , you know , maybe another dollar or something , it 's not a big deal .


fn_spacy_tokens_for_baseline: Armies of monks in blood - red robes hang around the place .

source_bert_toks: armies of monks in blood - red robes hang around the place .

reference_raw: There are soldiers of monks in blood-red robes.

reference_spacy_tokens: There are soldiers of monks in blood - red robes .


fn_spacy_tokens_for_baseline: Dwyer , however , disagrees : ' Sure we have experienced an extremely demanding schedule , particularly over the past year which took in the World Cup , but this provides terrific experience for the younger players . '

source_bert_toks: dwyer , however , disagree ##s : ' sure we have experienced an extremely demanding schedule , particularly over the past year which took in the world cup , but this provides terrific experience for the younger players . '

reference_raw: But Dwyer disagrees: 'I'm sure we've had a very difficult time, especially in the last year of the World Cup, but it's a wonderful experience for the younger players.'

reference_spacy_tokens: But Dwyer disagrees : ' I 'm sure we 've had a very difficult time , especially in the last year of the World Cup , but it 's a wonderful experience for the younger players . '


fn_spacy_tokens_for_baseline: Business secrets , which may include the offer price , where documents have not yet been sent out , are protected .

source_bert_toks: business secrets , which may include the offer price , where documents have not yet been sent out , are protected .

reference_raw: Business secrets, which may include the offer price, shall be protected if the documents have not yet been transmitted.

reference_spacy_tokens: Business secrets , which may include the offer price , shall be protected if the documents have not yet been transmitted .


fn_spacy_tokens_for_baseline: The woman , seeing the number 430 crumpled in my fist , pointed to the number above her window .

source_bert_toks: the woman , seeing the number 430 crumpled in my fist , pointed to the number above her window .

reference_raw: The woman, who had seen the number 430 crumpled in my fist, pointed to the number over the window.

reference_spacy_tokens: The woman , who had seen the number 430 crumpled in my fist , pointed to the number over the window .


fn_spacy_tokens_for_baseline: Catches are better on windy , moonless nights .

source_bert_toks: catches are better on windy , moon ##less nights .

reference_raw: Catches are better on windy nights without moons.

reference_spacy_tokens: Catches are better on windy nights without moons .


fn_spacy_tokens_for_baseline: We spend 90 per cent of our design meetings drinking coffee , gossiping and giggling .

source_bert_toks: we spend 90 per cent of our design meetings drinking coffee , gossip ##ing and giggling .

reference_raw: We spend 90 percent of our design meetings drinking coffee, talking and giggling.

reference_spacy_tokens: We spend 90 percent of our design meetings drinking coffee , talking and giggling .


fn_spacy_tokens_for_baseline: On duty of course he dispatched many infamous criminals , murderers such as Vincent Walker , Fenian Joe Brady and Charles peace .

source_bert_toks: on duty of course he dispatched many infamous criminals , murderers such as vincent walker , fen ##ian joe brady and charles peace .

reference_raw: On duty, of course, he sent out a lot of infamous criminals, killers like Vincent Walker, Fenian Joe Brady, and Charles Peace.

reference_spacy_tokens: On duty , of course , he sent out a lot of infamous criminals , killers like Vincent Walker , Fenian Joe Brady , and Charles Peace .


fn_spacy_tokens_for_baseline: The sergeant hobbled along the red carpet in his flip - flops and paused alongside a line of footpaths containing a bright purple solution and cubes of ice .

source_bert_toks: the sergeant ho ##bbled along the red carpet in his flip - flop ##s and paused alongside a line of foot ##path ##s containing a bright purple solution and cube ##s of ice .

reference_raw: The sergeant trudged along the red carpet in his flip-flips and stopped beside a row of footpaths with a bright purple solution and ice cubes.

reference_spacy_tokens: The sergeant trudged along the red carpet in his flip - flips and stopped beside a row of footpaths with a bright purple solution and ice cubes .


fn_spacy_tokens_for_baseline: Southey did not sleep well : Coleridge , evidently troubled by dreams even when his waking thoughts were optimistic , made a ' vile bedfellow ' .

source_bert_toks: south ##ey did not sleep well : cole ##ridge , evidently troubled by dreams even when his waking thoughts were optimistic , made a ' vile bed ##fell ##ow ' .

reference_raw: Southey didn't sleep well: Coleridge, who was obviously worried by his dreams, even though his waking thoughts were optimistic, made a 'vile bedfellow'.

reference_spacy_tokens: Southey did n't sleep well : Coleridge , who was obviously worried by his dreams , even though his waking thoughts were optimistic , made a ' vile bedfellow ' .


fn_spacy_tokens_for_baseline: Historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humored rivalry between the two areas .

source_bert_toks: historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humor ##ed rivalry between the two areas .

reference_raw: Historically and culturally, this distinction between the north and the south has been significant, and it is still today, with a great deal of popular competition between the two regions.

reference_spacy_tokens: Historically and culturally , this distinction between the north and the south has been significant , and it is still today , with a great deal of popular competition between the two regions .


fn_spacy_tokens_for_baseline: I knew I could count on friends and colleagues to support a campaign .

source_bert_toks: i knew i could count on friends and colleagues to support a campaign .

reference_raw: I knew I could rely on my friends and colleagues to back up the campaign.

reference_spacy_tokens: I knew I could rely on my friends and colleagues to back up the campaign .


fn_spacy_tokens_for_baseline: The only moment of danger was as she laid him in his cot again .

source_bert_toks: the only moment of danger was as she laid him in his cot again .

reference_raw: The only moment of danger was when she put him back in bed.

reference_spacy_tokens: The only moment of danger was when she put him back in bed .


fn_spacy_tokens_for_baseline: No two years are alike , and what succeeds this year may fail next : further , your early plans will be made without complete knowledge of all the factors , and modifications are bound to be necessary .

source_bert_toks: no two years are alike , and what succeeds this year may fail next : further , your early plans will be made without complete knowledge of all the factors , and modifications are bound to be necessary .

reference_raw: No two years are the same, and what succeeds this year may fail next: in addition, your initial plans will be made without full knowledge of all the factors, and changes will be necessary.

reference_spacy_tokens: No two years are the same , and what succeeds this year may fail next : in addition , your initial plans will be made without full knowledge of all the factors , and changes will be necessary .


fn_spacy_tokens_for_baseline: The program was revived later in the decade , when strategic interests began to drive the nuclear program .

source_bert_toks: the program was revived later in the decade , when strategic interests began to drive the nuclear program .

reference_raw: Later in the decade, when strategic interests began to drive the nuclear program, the program was resurrected.

reference_spacy_tokens: Later in the decade , when strategic interests began to drive the nuclear program , the program was resurrected .


fn_spacy_tokens_for_baseline: When sexual intercourse does take place , the partner is often chided for turning over or away , sometimes even in sleep .

source_bert_toks: when sexual intercourse does take place , the partner is often chi ##ded for turning over or away , sometimes even in sleep .

reference_raw: When sexual intercourse takes place, the partner is often scolded for turning over or turning away, sometimes even in his sleep.

reference_spacy_tokens: When sexual intercourse takes place , the partner is often scolded for turning over or turning away , sometimes even in his sleep .


fn_spacy_tokens_for_baseline: He ranged along his shelves , found the numbered item , a small fibre suitcase , and handed it over .

source_bert_toks: he ranged along his shelves , found the numbered item , a small fibre suitcase , and handed it over .

reference_raw: He ran along the shelves, found a numbered item, a small fiber trunk, and handed it to him.

reference_spacy_tokens: He ran along the shelves , found a numbered item , a small fiber trunk , and handed it to him .


fn_spacy_tokens_for_baseline: With the raft being swept away by the tide she could n't climb back on board and was struggling when the lifeboat crew reached her .

source_bert_toks: with the raft being swept away by the tide she couldn ' t climb back on board and was struggling when the lifeboat crew reached her .

reference_raw: When the raft was swept away by the tide, she could not get back aboard and was struggling when the crew of the lifeboats reached her.

reference_spacy_tokens: When the raft was swept away by the tide , she could not get back aboard and was struggling when the crew of the lifeboats reached her .


fn_spacy_tokens_for_baseline: It is hard to imagine that Leapor would sentimentalize the condition of celibacy , especially if she found herself mocked as an old maid .

source_bert_toks: it is hard to imagine that leap ##or would sentimental ##ize the condition of ce ##lib ##acy , especially if she found herself mocked as an old maid .

reference_raw: It's hard to imagine Leapor sentimentalizing the state of celibacy, especially when she finds herself laughing like an old maid.

reference_spacy_tokens: It 's hard to imagine Leapor sentimentalizing the state of celibacy , especially when she finds herself laughing like an old maid .


fn_spacy_tokens_for_baseline: And found to his annoyance that he was grinding his teeth .

source_bert_toks: and found to his annoyance that he was grinding his teeth .

reference_raw: And he found, to his displeasure, that he was grinding his teeth.

reference_spacy_tokens: And he found , to his displeasure , that he was grinding his teeth .


fn_spacy_tokens_for_baseline: But the young doctor was not in the least disconcerted .

source_bert_toks: but the young doctor was not in the least disco ##nce ##rted .

reference_raw: The young doctor, however, was not at all alarmed.

reference_spacy_tokens: The young doctor , however , was not at all alarmed .


fn_spacy_tokens_for_baseline: And because the dwindling supply is due to an Iranian blockade , the dispute is further tangling complicated dealings with a powerful neighbor .

source_bert_toks: and because the d ##wind ##ling supply is due to an iranian blockade , the dispute is further tang ##ling complicated dealings with a powerful neighbor .

reference_raw: And since the dwindling supply is caused by an Iranian blockage, the dispute further unravels complex dealings with a powerful neighbor.

reference_spacy_tokens: And since the dwindling supply is caused by an Iranian blockage , the dispute further unravels complex dealings with a powerful neighbor .


fn_spacy_tokens_for_baseline: In his desperation to escape , he fumbled the lever and the door jammed partly open .

source_bert_toks: in his desperation to escape , he fumbled the lever and the door jammed partly open .

reference_raw: Desperately trying to escape, he groped for the lever, and the door was half-open.

reference_spacy_tokens: Desperately trying to escape , he groped for the lever , and the door was half - open .


fn_spacy_tokens_for_baseline: However , a universal encoding has begun to appear : UCS ( ISO 10646 ) .

source_bert_toks: however , a universal encoding has begun to appear : uc ##s ( iso 106 ##46 ) .

reference_raw: However, the universal encoding was started: UCS (ISO 10646).

reference_spacy_tokens: However , the universal encoding was started : UCS ( ISO 10646 ) .


fn_spacy_tokens_for_baseline: However , I still have to say I do not approve of your climbing ladders . '

source_bert_toks: however , i still have to say i do not approve of your climbing ladder ##s . '

reference_raw: I must say, however, that I do not agree with your climbing ladders.'

reference_spacy_tokens: I must say , however , that I do not agree with your climbing ladders . '


fn_spacy_tokens_for_baseline: He crept over to the door and edged it open .

source_bert_toks: he crept over to the door and edged it open .

reference_raw: He crawled to the door and opened it.

reference_spacy_tokens: He crawled to the door and opened it .


fn_spacy_tokens_for_baseline: While Mr. S. went to deal with a request made by Mr. A. , the respondent entered the storeroom and helped himself to a key - cutting machine from stock .

source_bert_toks: while mr . s . went to deal with a request made by mr . a . , the respond ##ent entered the store ##room and helped himself to a key - cutting machine from stock .

reference_raw: While Mr. S. went to deal with Mr. A's request, the defendant entered the warehouse and helped himself to the stock-cutting machine.

reference_spacy_tokens: While Mr. S. went to deal with Mr. A 's request , the defendant entered the warehouse and helped himself to the stock - cutting machine .


fn_spacy_tokens_for_baseline: The illusory world of " Maya " revealed its meaning -- not only through the constantly shifting physical environment , but also through the all - night Wayang shadow - puppet dramas , where the shadow parade of gods and demons , creatures and people reflects the eternal dynamics between order and chaos .

source_bert_toks: the ill ##uso ##ry world of " maya " revealed its meaning - - not only through the constantly shifting physical environment , but also through the all - night way ##ang shadow - puppet dramas , where the shadow parade of gods and demons , creatures and people reflects the eternal dynamics between order and chaos .

reference_raw: The illusory world of "Maya" revealed its meaning - not only through the ever-changing physical environment, but also through the nightly dramas of Wayang's shadow puppets, where the shadow parade of gods and demons, creatures and humans reflects the ever-changing dynamisms between peace and chaos.

reference_spacy_tokens: The illusory world of " Maya " revealed its meaning - not only through the ever - changing physical environment , but also through the nightly dramas of Wayang 's shadow puppets , where the shadow parade of gods and demons , creatures and humans reflects the ever - changing dynamisms between peace and chaos .


fn_spacy_tokens_for_baseline: Do not come to an interview encumbered with a lot of clutter like parcels , scarves , large shopping bags , and shoulder bags , which make you look burdened down .

source_bert_toks: do not come to an interview en ##cum ##bered with a lot of cl ##utter like parcels , scar ##ves , large shopping bags , and shoulder bags , which make you look burden ##ed down .

reference_raw: Don't go to an interview encumbered by a lot of things like packages, scarves, big shopping sacks, and shoulder-bags that make you look burdened.

reference_spacy_tokens: Do n't go to an interview encumbered by a lot of things like packages , scarves , big shopping sacks , and shoulder - bags that make you look burdened .


fn_spacy_tokens_for_baseline: Calmly and methodically , Kirov climbed from the driving seat and skirted round to the back of the van , opening the rear door .

source_bert_toks: calmly and method ##ically , ki ##rov climbed from the driving seat and skirt ##ed round to the back of the van , opening the rear door .

reference_raw: Quietly and methodically, Kirov climbed out of the driver's seat and went around to the rear of the van and opened the back door.

reference_spacy_tokens: Quietly and methodically , Kirov climbed out of the driver 's seat and went around to the rear of the van and opened the back door .


fn_spacy_tokens_for_baseline: They thus created a class of semi - employed pensioners , which was the foundation of their social strength in the larger towns .

source_bert_toks: they thus created a class of semi - employed pension ##ers , which was the foundation of their social strength in the larger towns .

reference_raw: As a result, they created a group of semi-employed pensioners, which was the basis for their social power in larger cities.

reference_spacy_tokens: As a result , they created a group of semi - employed pensioners , which was the basis for their social power in larger cities .


fn_spacy_tokens_for_baseline: West Jerusalem , separated from the rest of the new Jewish nation , held out under siege for several months until Israeli forces secured a land corridor connecting the city to the coastal areas .

source_bert_toks: west jerusalem , separated from the rest of the new jewish nation , held out under siege for several months until israeli forces secured a land corridor connecting the city to the coastal areas .

reference_raw: West Jerusalem, segregated from the rest of the new Jewish nation, had been besieged for several months, until Israeli forces had secured a land corridor linking the city to coastal areas.

reference_spacy_tokens: West Jerusalem , segregated from the rest of the new Jewish nation , had been besieged for several months , until Israeli forces had secured a land corridor linking the city to coastal areas .


fn_spacy_tokens_for_baseline: Penny cast an unwelcoming frown in the direction of the steel grey November sky , and stepped carefully onto the pavement from the Earl 's Court mansion block in which she lived .

source_bert_toks: penny cast an un ##we ##lco ##ming frown in the direction of the steel grey november sky , and stepped carefully onto the pavement from the earl ' s court mansion block in which she lived .

reference_raw: Penny frowned unwelcomely in the direction of the steel-grey November sky, and stepped carefully onto the sidewalk of the Earl's court house where she lived.

reference_spacy_tokens: Penny frowned unwelcomely in the direction of the steel - grey November sky , and stepped carefully onto the sidewalk of the Earl 's court house where she lived .


fn_spacy_tokens_for_baseline: Within the reserve , signals rear above silver birch groves , drains crisscross , embankments loom , the pumping station emits strange noises , a converted railway hut serves as a field station and a disused marshalling yard sprouts rose bay willow - herb .

source_bert_toks: within the reserve , signals rear above silver birch groves , drains cr ##iss ##cross , embankment ##s lo ##om , the pumping station emi ##ts strange noises , a converted railway hut serves as a field station and a disused marshall ##ing yard sp ##rou ##ts rose bay willow - herb .

reference_raw: Within the reserve are signals rearing above the silver birch groves, drains of crosses, embankments looming, the pumping station emits strange noises, the converted railroad hut serves as a field station, and the unused marshalling yard sprouts rose bay willow-herb.

reference_spacy_tokens: Within the reserve are signals rearing above the silver birch groves , drains of crosses , embankments looming , the pumping station emits strange noises , the converted railroad hut serves as a field station , and the unused marshalling yard sprouts rose bay willow - herb .


fn_spacy_tokens_for_baseline: Hats off to Senate Budget Committee Chairman Pete Dominici , who is trying to put the brakes on the Republicans ' heedless zeal to pass a tax - cut bill in order to provoke a presidential veto they can then use in the 2000 campaign .

source_bert_toks: hats off to senate budget committee chairman pete dominic ##i , who is trying to put the brakes on the republicans ' hee ##dles ##s ze ##al to pass a tax - cut bill in order to provoke a presidential veto they can then use in the 2000 campaign .

reference_raw: Hats to the Senate Budget Committee Chairman Pete Dominici, who is trying to stop the Republicans' attentionless enthusiasm to pass a tax-cut bill to provoke a presidential veto that they can then use in the 2000 campaign.

reference_spacy_tokens: Hats to the Senate Budget Committee Chairman Pete Dominici , who is trying to stop the Republicans ' attentionless enthusiasm to pass a tax - cut bill to provoke a presidential veto that they can then use in the 2000 campaign .


fn_spacy_tokens_for_baseline: Marilyn Sommers noted that different clinical settings can profoundly influence how screening and intervention is delivered .

source_bert_toks: marilyn somme ##rs noted that different clinical settings can profoundly influence how screening and intervention is delivered .

reference_raw: Marilyn Sommers noted that various clinical settings may have a significant impact on the delivery of screening and intervention.

reference_spacy_tokens: Marilyn Sommers noted that various clinical settings may have a significant impact on the delivery of screening and intervention .


fn_spacy_tokens_for_baseline: A beautiful silver pendant .

source_bert_toks: a beautiful silver pendant .

reference_raw: Beautiful silver necklace.

reference_spacy_tokens: Beautiful silver necklace .


fn_spacy_tokens_for_baseline: The sharp , salty or insipid taste of shop - bought taramasalata is not a patch on the real thing .

source_bert_toks: the sharp , salty or ins ##ip ##id taste of shop - bought tara ##mas ##ala ##ta is not a patch on the real thing .

reference_raw: The sharp, salty or indistinct taste of shop-bought taramasalata is not a real thing.

reference_spacy_tokens: The sharp , salty or indistinct taste of shop - bought taramasalata is not a real thing .


fn_spacy_tokens_for_baseline: Hydraulic pressure built up slowly until the door wheezed open .

source_bert_toks: hydraulic pressure built up slowly until the door w ##hee ##zed open .

reference_raw: The hydraulic pressure rose slowly until the door blew open.

reference_spacy_tokens: The hydraulic pressure rose slowly until the door blew open .


fn_spacy_tokens_for_baseline: The Japanese were obviously being defeated but it was far from certain when this would finally be accomplished .

source_bert_toks: the japanese were obviously being defeated but it was far from certain when this would finally be accomplished .

reference_raw: The Japanese were obviously defeated, but it was far from sure when it would finally be done.

reference_spacy_tokens: The Japanese were obviously defeated , but it was far from sure when it would finally be done .


fn_spacy_tokens_for_baseline: He looked quite nonplussed .

source_bert_toks: he looked quite non ##pl ##uss ##ed .

reference_raw: He looked quite indifferent.

reference_spacy_tokens: He looked quite indifferent .


fn_spacy_tokens_for_baseline: Lily dropped a cube of sugar into her champagne and they clinked glasses , still laughing .

source_bert_toks: lily dropped a cube of sugar into her champagne and they cl ##ink ##ed glasses , still laughing .

reference_raw: Lily dropped a cup of sugar into the champagne, and they clinked their glasses, still laughing.

reference_spacy_tokens: Lily dropped a cup of sugar into the champagne , and they clinked their glasses , still laughing .


fn_spacy_tokens_for_baseline: I began by taking the cable - car and the chairlift beyond it , then wandered up the lower glacier to the hut .

source_bert_toks: i began by taking the cable - car and the chair ##lift beyond it , then wandered up the lower glacier to the hut .

reference_raw: I started by taking the cable car and the chairlift behind it, and then I walked up the lower iceberg to the hut.

reference_spacy_tokens: I started by taking the cable car and the chairlift behind it , and then I walked up the lower iceberg to the hut .


fn_spacy_tokens_for_baseline: An elderly churchgoer had her Bible stolen when a woman snatched her handbag in York 's Piccadilly on Sunday morning .

source_bert_toks: an elderly church ##go ##er had her bible stolen when a woman snatched her hand ##bag in york ' s pic ##ca ##dilly on sunday morning .

reference_raw: An old churchgoer stole her Bible when a woman stole her purse from York's Piccadilly on Sunday morning.

reference_spacy_tokens: An old churchgoer stole her Bible when a woman stole her purse from York 's Piccadilly on Sunday morning .


fn_spacy_tokens_for_baseline: Robert Stephenson , when John met him after the week 's delay , was amused at the story of the Triumph of Rhyll .

source_bert_toks: robert stephenson , when john met him after the week ' s delay , was amused at the story of the triumph of r ##hyl ##l .

reference_raw: When John had met him after a week's delay, Robert Stephenson had been entertained by the story of Rhyll's Triumph.

reference_spacy_tokens: When John had met him after a week 's delay , Robert Stephenson had been entertained by the story of Rhyll 's Triumph .


fn_spacy_tokens_for_baseline: My Super 's already got his knickers in a twist . '

source_bert_toks: my super ' s already got his kn ##ick ##ers in a twist . '

reference_raw: My super's already got his panties in a twist.'

reference_spacy_tokens: My super 's already got his panties in a twist . '


fn_spacy_tokens_for_baseline: ( She compromises then by further guard duties on the area directly around the nesting site -- keeping far enough away to avoid the male ) .

source_bert_toks: ( she compromise ##s then by further guard duties on the area directly around the nesting site - - keeping far enough away to avoid the male ) .

reference_raw: (In that case, it compromises with additional patrol duties in the area just outside the nesting site - keeping far enough away from the males).

reference_spacy_tokens: ( In that case , it compromises with additional patrol duties in the area just outside the nesting site - keeping far enough away from the males ) .


fn_spacy_tokens_for_baseline: The contempt of urban , middle - class educators for rural peasants was barely concealed : ' the psychological attitude of the Iranian villagers creates a great obstacle to rural reconstruction ' .

source_bert_toks: the contempt of urban , middle - class educators for rural peasants was barely concealed : ' the psychological attitude of the iranian villagers creates a great obstacle to rural reconstruction ' .

reference_raw: The scorn of urban, middle-class educators for rural peasants was barely concealed: "The psychological attitude of Iranian villagers is a major obstacle to rural reconstruction."

reference_spacy_tokens: The scorn of urban , middle - class educators for rural peasants was barely concealed : " The psychological attitude of Iranian villagers is a major obstacle to rural reconstruction . "


fn_spacy_tokens_for_baseline: Strip searching made me feel terrible -- I was dead embarrassed .

source_bert_toks: strip searching made me feel terrible - - i was dead embarrassed .

reference_raw: The strip search made me feel terrible - I was dead ashamed.

reference_spacy_tokens: The strip search made me feel terrible - I was dead ashamed .


fn_spacy_tokens_for_baseline: Meanwhile , the company is bragging that it 's having trouble dumbing down the Alpha chip to make it slow enough to sell against the 80486 .

source_bert_toks: meanwhile , the company is bragg ##ing that it ' s having trouble dumb ##ing down the alpha chip to make it slow enough to sell against the 80 ##48 ##6 .

reference_raw: In the meantime, the company boasts that it's having a hard time mutilating the alpha chip so it's slow enough to sell against the 80486.

reference_spacy_tokens: In the meantime , the company boasts that it 's having a hard time mutilating the alpha chip so it 's slow enough to sell against the 80486 .


fn_spacy_tokens_for_baseline: Within a few minutes of this treatment being given , he was able to button up his coat .

source_bert_toks: within a few minutes of this treatment being given , he was able to button up his coat .

reference_raw: Within minutes of the treatment, he was able to put on his coat.

reference_spacy_tokens: Within minutes of the treatment , he was able to put on his coat .


fn_spacy_tokens_for_baseline: The plantations would be open to foreign acquisition but overall foreign ownership would be limited to 30 or 40 per cent .

source_bert_toks: the plantations would be open to foreign acquisition but overall foreign ownership would be limited to 30 or 40 per cent .

reference_raw: Plantations would be free to acquire abroad, but the total foreign ownership would be limited to 30 % or 40 %.

reference_spacy_tokens: Plantations would be free to acquire abroad , but the total foreign ownership would be limited to 30 % or 40 % .


fn_spacy_tokens_for_baseline: Mint , in its variegated varieties , makes a colourful addition to flower borders as well as herb gardens .

source_bert_toks: mint , in its var ##ieg ##ated varieties , makes a colourful addition to flower borders as well as herb gardens .

reference_raw: The mint is a colourful addition to the borders of the flowers and herb gardens in its variegated species.

reference_spacy_tokens: The mint is a colourful addition to the borders of the flowers and herb gardens in its variegated species .


fn_spacy_tokens_for_baseline: These will multiply in future with the development of new technologies and new branches of science such as molecular biology .

source_bert_toks: these will multi ##ply in future with the development of new technologies and new branches of science such as molecular biology .

reference_raw: In the future, these will increase with the development of new technologies and new fields of science, such as molecular biology.

reference_spacy_tokens: In the future , these will increase with the development of new technologies and new fields of science , such as molecular biology .


fn_spacy_tokens_for_baseline: ' Lindsey ! ' he groaned , reaching out for her .

source_bert_toks: ' lindsey ! ' he groaned , reaching out for her .

reference_raw: "Lindsey!" he moaned, reaching for her.

reference_spacy_tokens: " Lindsey ! " he moaned , reaching for her .


fn_spacy_tokens_for_baseline: Mohamed Abu Talb will serve his sentence in a Swedish jail with three accomplices for a terrorism campaign carried out in 1985 and 1986 against American and Israeli targets in Copenhagen , Amsterdam and Stockholm .

source_bert_toks: mohamed abu tal ##b will serve his sentence in a swedish jail with three acc ##omp ##lices for a terrorism campaign carried out in 1985 and 1986 against american and israeli targets in copenhagen , amsterdam and stockholm .

reference_raw: Mohamed Abu Talb will serve his time in a Swedish prison with three accomplices in a terrorist campaign conducted in 1985 and 1986 against American and Israeli targets in Copenhagen, Amsterdam and Stockholm.

reference_spacy_tokens: Mohamed Abu Talb will serve his time in a Swedish prison with three accomplices in a terrorist campaign conducted in 1985 and 1986 against American and Israeli targets in Copenhagen , Amsterdam and Stockholm .


fn_spacy_tokens_for_baseline: ' Fernand has been badly traumatised , but he 's a gentle soul and would n't lay a finger on anyone , ' Melissa insisted .

source_bert_toks: ' fern ##and has been badly trauma ##tis ##ed , but he ' s a gentle soul and wouldn ' t lay a finger on anyone , ' melissa insisted .

reference_raw: "Fernand's been badly traumatized, but he's a gentle soul, and he wouldn't touch anyone," Melissa said.

reference_spacy_tokens: " Fernand 's been badly traumatized , but he 's a gentle soul , and he would n't touch anyone , " Melissa said .


fn_spacy_tokens_for_baseline: Jamie Shepherd drove the accelerator almost into the floor as the van spluttered past a milk cart .

source_bert_toks: jamie shepherd drove the accelerator almost into the floor as the van sp ##lu ##ttered past a milk cart .

reference_raw: Jamie Shepherd drove the accelerator almost to the floor as the van splashed past the milk cart.

reference_spacy_tokens: Jamie Shepherd drove the accelerator almost to the floor as the van splashed past the milk cart .


fn_spacy_tokens_for_baseline: Sometime in June 1987 , Iran concluded a follow - on arms agreement worth an estimated $ 500 million with the DPRK .

source_bert_toks: sometime in june 1987 , iran concluded a follow - on arms agreement worth an estimated $ 500 million with the d ##pr ##k .

reference_raw: At some point in June 1987, Iran entered into a subsequent arms deal with the DPRK for an estimated $500 million.

reference_spacy_tokens: At some point in June 1987 , Iran entered into a subsequent arms deal with the DPRK for an estimated $ 500 million .


fn_spacy_tokens_for_baseline: On the other hand , there is a fair chance that he might find a magic potion which will restore him to full strength and heal his wounds .

source_bert_toks: on the other hand , there is a fair chance that he might find a magic potion which will restore him to full strength and heal his wounds .

reference_raw: On the other hand, it is quite possible that he will find a magic potion that will bring him back to full power and heal his wounds.

reference_spacy_tokens: On the other hand , it is quite possible that he will find a magic potion that will bring him back to full power and heal his wounds .


fn_spacy_tokens_for_baseline: Their trial was slated for 23 November but it was postponed until 10 January 1949 because Geisler broke three ribs in a car crash and was unfit to appear .

source_bert_toks: their trial was slated for 23 november but it was postponed until 10 january 1949 because ge ##is ##ler broke three ribs in a car crash and was unfit to appear .

reference_raw: Their trial was postponed until November 23, but was postponed until January 10, 1949 because Geisler smashed three ribs in a car accident and was incapacitated.

reference_spacy_tokens: Their trial was postponed until November 23 , but was postponed until January 10 , 1949 because Geisler smashed three ribs in a car accident and was incapacitated .


fn_spacy_tokens_for_baseline: ' I ca n't pass up a wishing star , ' she chirped , bouncing out of the car .

source_bert_toks: ' i can ' t pass up a wishing star , ' she chi ##rp ##ed , bouncing out of the car .

reference_raw: "I can't miss a wishing star," she said, jumping out of the car.

reference_spacy_tokens: " I ca n't miss a wishing star , " she said , jumping out of the car .


fn_spacy_tokens_for_baseline: She sat on the edge of the bed and reminded Eileen what was at stake : the damnation of her soul .

source_bert_toks: she sat on the edge of the bed and reminded eileen what was at stake : the damn ##ation of her soul .

reference_raw: She sat on the edge of the bed, reminding Eileen what was at stake: damning her soul.

reference_spacy_tokens: She sat on the edge of the bed , reminding Eileen what was at stake : damning her soul .


fn_spacy_tokens_for_baseline: It was the excuse for her deep delaying gaze into the looking - glass .

source_bert_toks: it was the excuse for her deep delaying gaze into the looking - glass .

reference_raw: It was an excuse for her deep, lingering glance into the mirror.

reference_spacy_tokens: It was an excuse for her deep , lingering glance into the mirror .


fn_spacy_tokens_for_baseline: The large numbers of Muslims of South Asian descent plays a role in the amount of homegrown militants in this nation .

source_bert_toks: the large numbers of muslims of south asian descent plays a role in the amount of home ##gr ##own militants in this nation .

reference_raw: A large number of South Asian Muslims play a role in the number of domestic militias in this country.

reference_spacy_tokens: A large number of South Asian Muslims play a role in the number of domestic militias in this country .


fn_spacy_tokens_for_baseline: This has aroused the criticism of ' nationalist patriots ' , who see something shameful in the admittance of Coca - Cola to the Hermitage .

source_bert_toks: this has aroused the criticism of ' nationalist patriots ' , who see something shame ##ful in the admit ##tance of coca - cola to the hermitage .

reference_raw: This brought to the attention of "nationalist patriots" who saw something shameful about Coca-Cola's admission to the Hermitage.

reference_spacy_tokens: This brought to the attention of " nationalist patriots " who saw something shameful about Coca - Cola 's admission to the Hermitage .


fn_spacy_tokens_for_baseline: Give any large areas a squirt of zinc chromate primer but beware -- it is very toxic and carcinogenic .

source_bert_toks: give any large areas a sq ##ui ##rt of zinc ch ##rom ##ate prime ##r but be ##ware - - it is very toxic and car ##cino ##genic .

reference_raw: Give any large area a spray of zinc chromate primer, but be careful - it's very poisonous and carcinogenic.

reference_spacy_tokens: Give any large area a spray of zinc chromate primer , but be careful - it 's very poisonous and carcinogenic .


fn_spacy_tokens_for_baseline: His tussle in midfield with McKinlay was one of the highlights of an absorbing contest .

source_bert_toks: his tu ##ss ##le in midfield with mc ##kin ##lay was one of the highlights of an absorbing contest .

reference_raw: One of the highlights of the absorption contest was his tussle in the middle of the field with McKinlay.

reference_spacy_tokens: One of the highlights of the absorption contest was his tussle in the middle of the field with McKinlay .


fn_spacy_tokens_for_baseline: Yes , we all can remember one or two truly inspiring teachers from our school days .

source_bert_toks: yes , we all can remember one or two truly inspiring teachers from our school days .

reference_raw: Yes, we all remember one or two really inspirational teachers from our school days.

reference_spacy_tokens: Yes , we all remember one or two really inspirational teachers from our school days .


fn_spacy_tokens_for_baseline: At the back of the church knelt Mrs Duffy , the school caretaker , saying her beads .

source_bert_toks: at the back of the church knelt mrs duffy , the school caretaker , saying her beads .

reference_raw: At the back of the church, Mrs. Duffy, the schoolmaster, was on her knees and said her beads.

reference_spacy_tokens: At the back of the church , Mrs. Duffy , the schoolmaster , was on her knees and said her beads .


fn_spacy_tokens_for_baseline: The front of the machine sports some graceful curves , but it 's only when you take a peek round the back that you get some inkling that this one is different .

source_bert_toks: the front of the machine sports some graceful curves , but it ' s only when you take a peek round the back that you get some ink ##ling that this one is different .

reference_raw: There are some graceful curves on the front of the machine, but only if you look around the back do you know it's different.

reference_spacy_tokens: There are some graceful curves on the front of the machine , but only if you look around the back do you know it 's different .


fn_spacy_tokens_for_baseline: He spoke seldom , but he was never impatient with her , always kind , a companionable father figure .

source_bert_toks: he spoke seldom , but he was never impatient with her , always kind , a companion ##able father figure .

reference_raw: He spoke rarely, but he was never impatient with her, always kind, a friendly father figure.

reference_spacy_tokens: He spoke rarely , but he was never impatient with her , always kind , a friendly father figure .


fn_spacy_tokens_for_baseline: Thank you for your strong support .

source_bert_toks: thank you for your strong support .

reference_raw: Thank you for all the support you've given me.

reference_spacy_tokens: Thank you for all the support you 've given me .


fn_spacy_tokens_for_baseline: Mrs Duffy left at once , but Clare felt it would be more polite to linger for a while , rather than rush out after the couple , as if the wedding had been an annoying chore .

source_bert_toks: mrs duffy left at once , but clare felt it would be more polite to linger for a while , rather than rush out after the couple , as if the wedding had been an annoying cho ##re .

reference_raw: Mrs. Duffy left immediately, but Clare felt it would be more courteous to wait a while, rather than rush after the couple, as if the wedding had been a nuisance.

reference_spacy_tokens: Mrs. Duffy left immediately , but Clare felt it would be more courteous to wait a while , rather than rush after the couple , as if the wedding had been a nuisance .


fn_spacy_tokens_for_baseline: More than 11,000 rabbits have been killed in the 12 months since the Shetlands council introduced the scheme , which is estimated to have saved acres of grass , cabbages and turnips .

source_bert_toks: more than 11 , 000 rabbits have been killed in the 12 months since the shetland ##s council introduced the scheme , which is estimated to have saved acres of grass , cabbage ##s and turn ##ip ##s .

reference_raw: In the 12 months since the Shetlands Council introduced the scheme, more than 11,000 rabbits were killed, which is estimated to have saved hectares of grass, cabbages and turnips.

reference_spacy_tokens: In the 12 months since the Shetlands Council introduced the scheme , more than 11,000 rabbits were killed , which is estimated to have saved hectares of grass , cabbages and turnips .


fn_spacy_tokens_for_baseline: A photograph is no substitute for the original rug , and items that look superb in reproduction can be extremely disappointing when viewed in the flesh .

source_bert_toks: a photograph is no substitute for the original rug , and items that look superb in reproduction can be extremely disappointing when viewed in the flesh .

reference_raw: Photographs are no substitute for the original carpet, and objects that look great in reproduction can be extremely disappointing when viewed in the flesh.

reference_spacy_tokens: Photographs are no substitute for the original carpet , and objects that look great in reproduction can be extremely disappointing when viewed in the flesh .


fn_spacy_tokens_for_baseline: Once the door was closed , I remonstrated angrily but Benjamin just shook his head .

source_bert_toks: once the door was closed , i re ##mons ##tra ##ted angrily but benjamin just shook his head .

reference_raw: As soon as the door was closed, I protested angrily, but Benjamin shook his head.

reference_spacy_tokens: As soon as the door was closed , I protested angrily , but Benjamin shook his head .


fn_spacy_tokens_for_baseline: The thumping cadence of the engines and the gentle swaying of the boat took them past a tapestry of rural scenes , all brushed with sunlight .

source_bert_toks: the thumping cadence of the engines and the gentle swaying of the boat took them past a tapestry of rural scenes , all brushed with sunlight .

reference_raw: The thudding cadence of the engines and the gentle bobbing of the boat carried them past a tapestry of rural scenery, all covered with sunlight.

reference_spacy_tokens: The thudding cadence of the engines and the gentle bobbing of the boat carried them past a tapestry of rural scenery , all covered with sunlight .


fn_spacy_tokens_for_baseline: I AM walking over hot coals , supended over a deep pit at the bottom of which are a large number of vipers baring their fangs .

source_bert_toks: i am walking over hot coal ##s , su ##pen ##ded over a deep pit at the bottom of which are a large number of viper ##s bari ##ng their fangs .

reference_raw: I'm walking on hot coals, over a deep hole at the bottom of which a lot of vipers bare their teeth.

reference_spacy_tokens: I 'm walking on hot coals , over a deep hole at the bottom of which a lot of vipers bare their teeth .


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had an unsettling Zipper problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had an unsettling Zipper problem .


fn_spacy_tokens_for_baseline: She was constructing , in a priceless Chinese bowl , an elaborate arrangement of flowers .

source_bert_toks: she was constructing , in a price ##less chinese bowl , an elaborate arrangement of flowers .

reference_raw: She was building an elaborate set of flowers in a priceless Chinese bowl.

reference_spacy_tokens: She was building an elaborate set of flowers in a priceless Chinese bowl .


fn_spacy_tokens_for_baseline: I know that Russell lives in your basement and I am going to kill him .

source_bert_toks: i know that russell lives in your basement and i am going to kill him .

reference_raw: I know Russell lives in your cellar, and I'm gonna kill him.

reference_spacy_tokens: I know Russell lives in your cellar , and I 'm gon na kill him .


fn_spacy_tokens_for_baseline: I felt a strong feeling of nausea as I realised that I had put my hand through the chest of a dead British soldier that could have been lying in the ditch for several days .

source_bert_toks: i felt a strong feeling of nausea as i realised that i had put my hand through the chest of a dead british soldier that could have been lying in the ditch for several days .

reference_raw: When I realized that I had put my hand through the chest of a dead British soldier who might have been lying in a ditch for a few days, I felt very sick.

reference_spacy_tokens: When I realized that I had put my hand through the chest of a dead British soldier who might have been lying in a ditch for a few days , I felt very sick .


fn_spacy_tokens_for_baseline: ' This does not limit their participation or prevent them from nominating themselves in any slate , ' he said .

source_bert_toks: ' this does not limit their participation or prevent them from no ##minating themselves in any slate , ' he said .

reference_raw: "That doesn't restrict their participation or prevent them from nominating themselves in any slate," he said.

reference_spacy_tokens: " That does n't restrict their participation or prevent them from nominating themselves in any slate , " he said .


fn_spacy_tokens_for_baseline: Finally , after Pooley had made a suggestion so ludicrous as to bring the naturally short - tempered Irishman within a hairbreadth of killing him there and then , Omally put his foot down once and for all .

source_bert_toks: finally , after poole ##y had made a suggestion so lu ##dic ##rous as to bring the naturally short - tempered irish ##man within a hair ##bread ##th of killing him there and then , om ##ally put his foot down once and for all .

reference_raw: Finally, when Pooley made a proposal so absurd that he would bring a naturally short-tempered Irishman into the hair of killing him there, Omally put his foot down once and for all.

reference_spacy_tokens: Finally , when Pooley made a proposal so absurd that he would bring a naturally short - tempered Irishman into the hair of killing him there , Omally put his foot down once and for all .


fn_spacy_tokens_for_baseline: Shiite lawmaker Qassim Dawood , who is sympathetic to the Kurds , said the sides must reach a compromise , or risk jeopardizing security gains made in the last year .

source_bert_toks: shi ##ite law ##maker q ##ass ##im da ##wood , who is sympathetic to the ku ##rds , said the sides must reach a compromise , or risk je ##opa ##rdi ##zing security gains made in the last year .

reference_raw: Shiite lawman Qassim Dawood, who sympathizes with the Kurds, said that the parties had to come to a trade-off or risk jeopardizing the security gains they'd made over the past year.

reference_spacy_tokens: Shiite lawman Qassim Dawood , who sympathizes with the Kurds , said that the parties had to come to a trade - off or risk jeopardizing the security gains they 'd made over the past year .


fn_spacy_tokens_for_baseline: Ore was also carted down from a hopper at Top Level , the track crossing the beck directly below the waterfall then winding around to connect with the Levers Water -- Paddy End track .

source_bert_toks: ore was also cart ##ed down from a hopper at top level , the track crossing the beck directly below the waterfall then winding around to connect with the lever ##s water - - paddy end track .

reference_raw: Ore was also hauled from the top-level jumper, and the track crossed the beck just below the waterfall, then twisted around to connect to the Levers Water - the Paddy End track.

reference_spacy_tokens: Ore was also hauled from the top - level jumper , and the track crossed the beck just below the waterfall , then twisted around to connect to the Levers Water - the Paddy End track .


fn_spacy_tokens_for_baseline: The Secretary of duhFENSE may be introduced at the annual Army- Navy game , while the crowd is shouting to the players on the field , " DEE - fense , DEE -fense ! "

source_bert_toks: the secretary of du ##h ##fen ##se may be introduced at the annual army - navy game , while the crowd is shouting to the players on the field , " dee - fen ##se , dee - fen ##se ! "

reference_raw: DUHFENSE's secretary can be introduced to the annual military-Navy game, while the crowd shouts to the actors in the field, "DEE-Fense, DEE-Fense!"

reference_spacy_tokens: DUHFENSE 's secretary can be introduced to the annual military - Navy game , while the crowd shouts to the actors in the field , " DEE - Fense , DEE - Fense ! "


fn_spacy_tokens_for_baseline: And now he found himself wondering whether she knew or guessed about Amy .

source_bert_toks: and now he found himself wondering whether she knew or guessed about amy .

reference_raw: Now he found himself wondering if he knew or suspected Amy.

reference_spacy_tokens: Now he found himself wondering if he knew or suspected Amy .


fn_spacy_tokens_for_baseline: It has caused collection problems on a hitherto unprecedented scale , and more than £ 100 million worth of taxpayers ' money has been squandered on administering the wretched tax in Wales alone .

source_bert_toks: it has caused collection problems on a hit ##her ##to unprecedented scale , and more than £100 million worth of taxpayers ' money has been sq ##uan ##der ##ed on administering the wr ##etched tax in wales alone .

reference_raw: This has caused collection problems on an unprecedented scale, and over £100 million of taxpayers' money has been wasted on the administration of the poor tax in Wales alone.

reference_spacy_tokens: This has caused collection problems on an unprecedented scale , and over £ 100 million of taxpayers ' money has been wasted on the administration of the poor tax in Wales alone .


fn_spacy_tokens_for_baseline: Before the end of the war in 401 b.c . , many islands had already transferred their allegiance to the victors , who were led by Philip II of Macedon .

source_bert_toks: before the end of the war in 401 b . c . , many islands had already transferred their allegiance to the victor ##s , who were led by philip ii of mace ##don .

reference_raw: By the end of the war in 401 B.C., many islands had already surrendered their loyalty to the victors under Philip II of Macedon.

reference_spacy_tokens: By the end of the war in 401 B.C. , many islands had already surrendered their loyalty to the victors under Philip II of Macedon .


fn_spacy_tokens_for_baseline: She suddenly started screeching at Bruno , so abruptly that Maxim felt a jab in his spine and knew he 'd come very close to being shot .

source_bert_toks: she suddenly started sc ##ree ##ching at bruno , so abruptly that maxim felt a ja ##b in his spine and knew he ' d come very close to being shot .

reference_raw: Suddenly she began to scream at Bruno, so suddenly that Maxim felt a stab in his back and knew he was close to being shot.

reference_spacy_tokens: Suddenly she began to scream at Bruno , so suddenly that Maxim felt a stab in his back and knew he was close to being shot .


fn_spacy_tokens_for_baseline: For some reason it began in a thick snowstorm of large white flakes .

source_bert_toks: for some reason it began in a thick snow ##storm of large white fl ##akes .

reference_raw: For some reason, it began in a thick snowstorm of big white snowflakes.

reference_spacy_tokens: For some reason , it began in a thick snowstorm of big white snowflakes .


fn_spacy_tokens_for_baseline: Abberley in white shirt , city tie , black trousers .

source_bert_toks: ab ##ber ##ley in white shirt , city tie , black trousers .

reference_raw: Abberley in a white shirt, a city necktie, black pants.

reference_spacy_tokens: Abberley in a white shirt , a city necktie , black pants .


fn_spacy_tokens_for_baseline: Landlord Alan Thornton is calling for council chiefs to take action to remove pigeons which have left his property in Ellison Street , Hartlepool , coated in a thick layer of bird droppings .

source_bert_toks: landlord alan thornton is calling for council chiefs to take action to remove pigeons which have left his property in ellison street , hart ##le ##pool , coated in a thick layer of bird dropping ##s .

reference_raw: Landlord Alan Thornton calls on the heads of the council to take action to remove the pigeons that have left his estate in Ellison Street, Hartlepool, covered with a thick layer of bird droppings.

reference_spacy_tokens: Landlord Alan Thornton calls on the heads of the council to take action to remove the pigeons that have left his estate in Ellison Street , Hartlepool , covered with a thick layer of bird droppings .


fn_spacy_tokens_for_baseline: He cuts small fillets of lean meat the size of quails ' breasts .

source_bert_toks: he cuts small fill ##ets of lean meat the size of qu ##ail ##s ' breasts .

reference_raw: It cuts small fillets of lean flesh the size of a quail's bosom.

reference_spacy_tokens: It cuts small fillets of lean flesh the size of a quail 's bosom .


fn_spacy_tokens_for_baseline: He liked the offworlder well enough , but it was ridiculous for Zurachina even to consider the suggestion .

source_bert_toks: he liked the off ##world ##er well enough , but it was ridiculous for zur ##achi ##na even to consider the suggestion .

reference_raw: He liked the offworlder well enough, but it was absurd for Zurachina to even consider the idea.

reference_spacy_tokens: He liked the offworlder well enough , but it was absurd for Zurachina to even consider the idea .


fn_spacy_tokens_for_baseline: Despite the enormous amount of information we have already accumulated there remains a great deal to be learned and this is one of the special pleasures of animal - watching .

source_bert_toks: despite the enormous amount of information we have already accumulated there remains a great deal to be learned and this is one of the special pleasures of animal - watching .

reference_raw: Despite the vast amount of information we have gathered, much remains to be learned, and this is one of the special pleasures of watching animals.

reference_spacy_tokens: Despite the vast amount of information we have gathered , much remains to be learned , and this is one of the special pleasures of watching animals .


fn_spacy_tokens_for_baseline: But the most famous of such treatises about the Jews were written in the middle of the second century .

source_bert_toks: but the most famous of such treatise ##s about the jews were written in the middle of the second century .

reference_raw: But the most famous of these Jewish treaties was written in the middle of the second century.

reference_spacy_tokens: But the most famous of these Jewish treaties was written in the middle of the second century .


fn_spacy_tokens_for_baseline: ' You must n't be downcast , ' said Lydia .

source_bert_toks: ' you must ##n ' t be down ##cast , ' said lydia .

reference_raw: 'You must not be defeated,' said Lydia.

reference_spacy_tokens: ' You must not be defeated , ' said Lydia .


fn_spacy_tokens_for_baseline: It could point to plenty of ailments that the Spanish economic rejuvenation so far has failed to cure .

source_bert_toks: it could point to plenty of ai ##lm ##ents that the spanish economic re ##ju ##ven ##ation so far has failed to cure .

reference_raw: It could point to a number of diseases which have not yet been cured by the rejuvenation of the Spanish economy.

reference_spacy_tokens: It could point to a number of diseases which have not yet been cured by the rejuvenation of the Spanish economy .


fn_spacy_tokens_for_baseline: The corrected values are referred to as residuals .

source_bert_toks: the corrected values are referred to as residual ##s .

reference_raw: Residues are called residues.

reference_spacy_tokens: Residues are called residues .


fn_spacy_tokens_for_baseline: Two Civil Guards were wounded by a remote - control bomb on Aug. 2 between Pamplona and San Sebastian .

source_bert_toks: two civil guards were wounded by a remote - control bomb on aug . 2 between pam ##pl ##ona and san sebastian .

reference_raw: Two civilian guards were injured by a remote-control device on August 2 between Pamplona and San Sebastian.

reference_spacy_tokens: Two civilian guards were injured by a remote - control device on August 2 between Pamplona and San Sebastian .


fn_spacy_tokens_for_baseline: After a 1992 high of 181p the shares have been in near constant retreat , hitting a low of 83.5p before recovering to yesterday 's suspension price of 129p .

source_bert_toks: after a 1992 high of 181 ##p the shares have been in near constant retreat , hitting a low of 83 . 5 ##p before recovering to yesterday ' s suspension price of 129 ##p .

reference_raw: After a high of 181p in 1992, the stocks were almost continuously retreating, reaching a low of 83.5p before recovering to last night's suspension price of 129p.

reference_spacy_tokens: After a high of 181p in 1992 , the stocks were almost continuously retreating , reaching a low of 83.5p before recovering to last night 's suspension price of 129p .


fn_spacy_tokens_for_baseline: When he was quizzed Righton -- a leading consultant on children 's homes -said he had them for his ' personal gratification . '

source_bert_toks: when he was quiz ##zed right ##on - - a leading consultant on children ' s homes - said he had them for his ' personal gr ##ati ##fication . '

reference_raw: When he was questioned by Righton, the chief counsellor in the children's homes, he said he had them for his 'personal satisfaction'.

reference_spacy_tokens: When he was questioned by Righton , the chief counsellor in the children 's homes , he said he had them for his ' personal satisfaction ' .


fn_spacy_tokens_for_baseline: He took the rifle off his shoulder , aimed it , and shot once .

source_bert_toks: he took the rifle off his shoulder , aimed it , and shot once .

reference_raw: He took the rifle from his shoulder, aimed it, and fired once.

reference_spacy_tokens: He took the rifle from his shoulder , aimed it , and fired once .


fn_spacy_tokens_for_baseline: She facilitated the growth of her public through low - priced prints , donations of work to public galleries , and production of ' art ' posters .

source_bert_toks: she facilitated the growth of her public through low - priced prints , donations of work to public galleries , and production of ' art ' posters .

reference_raw: It facilitated the growth of its public through cheap prints, donations to public galleries, and the production of "art" posters.

reference_spacy_tokens: It facilitated the growth of its public through cheap prints , donations to public galleries , and the production of " art " posters .


fn_spacy_tokens_for_baseline: In The Love of Jeanne Ney , Pabst used real - life detail such as broken mirrors and iron basins .

source_bert_toks: in the love of jeanne ne ##y , pa ##bs ##t used real - life detail such as broken mirrors and iron basins .

reference_raw: In the love of Jeanne Ney, Pabst used the details of real life, such as broken mirrors and iron sinks.

reference_spacy_tokens: In the love of Jeanne Ney , Pabst used the details of real life , such as broken mirrors and iron sinks .


fn_spacy_tokens_for_baseline: It might be imagined by those who are not themselves Anglican that the habit of ' going to confession ' is limited only to markedly ' High ' churches , but this is not necessarily the case .

source_bert_toks: it might be imagined by those who are not themselves anglican that the habit of ' going to confession ' is limited only to markedly ' high ' churches , but this is not necessarily the case .

reference_raw: For those who are not themselves English, it may be assumed that the custom of "going to confess" is limited to markedly 'high' churches, but that is not necessarily the case.

reference_spacy_tokens: For those who are not themselves English , it may be assumed that the custom of " going to confess " is limited to markedly ' high ' churches , but that is not necessarily the case .


fn_spacy_tokens_for_baseline: I longed to call out to him to help me , but his name stuck in my throat .

source_bert_toks: i longed to call out to him to help me , but his name stuck in my throat .

reference_raw: I wanted to call him for help, but his name stuck in my throat.

reference_spacy_tokens: I wanted to call him for help , but his name stuck in my throat .


fn_spacy_tokens_for_baseline: I remember it as horrible , with a smell of cold cabbage seeming to come from the upholstery .

source_bert_toks: i remember it as horrible , with a smell of cold cabbage seeming to come from the up ##hol ##ster ##y .

reference_raw: I remember how awful it was, and the reek of cold cabbage seemed to come from the upholstery.

reference_spacy_tokens: I remember how awful it was , and the reek of cold cabbage seemed to come from the upholstery .


fn_spacy_tokens_for_baseline: They could hear the rustle of the wind tossing the highest branches and see the bright light of the sky opening out beyond .

source_bert_toks: they could hear the rust ##le of the wind tossing the highest branches and see the bright light of the sky opening out beyond .

reference_raw: They heard the sound of the wind blowing the highest branches and saw the bright light of the sky open behind them.

reference_spacy_tokens: They heard the sound of the wind blowing the highest branches and saw the bright light of the sky open behind them .


fn_spacy_tokens_for_baseline: The third section covers the practical implementation of policy including a chapter on the British state pension .

source_bert_toks: the third section covers the practical implementation of policy including a chapter on the british state pension .

reference_raw: The third part concerns the practical implementation of policies, including the British State Pensions Chapter.

reference_spacy_tokens: The third part concerns the practical implementation of policies , including the British State Pensions Chapter .


fn_spacy_tokens_for_baseline: The audience , but not Tepilit , understands by now her father 's situation in Paris , so her warnings are poignant .

source_bert_toks: the audience , but not te ##pi ##lit , understands by now her father ' s situation in paris , so her warnings are po ##ignant .

reference_raw: The audience, but not Tepilit, now understands the situation of her father in Paris, and so her warnings are insinuated.

reference_spacy_tokens: The audience , but not Tepilit , now understands the situation of her father in Paris , and so her warnings are insinuated .


fn_spacy_tokens_for_baseline: Coloured rugs covered most of the ancient dusty floor and the walls were of bare brick , but hung with decorations constructed from skulls , feathers and tapestry , which Apanage announced she had contrived herself .

source_bert_toks: coloured rug ##s covered most of the ancient dusty floor and the walls were of bare brick , but hung with decorations constructed from skulls , feathers and tapestry , which ap ##ana ##ge announced she had con ##tri ##ved herself .

reference_raw: Most of the old dusty floor was covered with colored carpets, and the walls were barren brick, but hung with ornaments made of skulls, feathers, and tapestry, which Apanage had told her she had invented.

reference_spacy_tokens: Most of the old dusty floor was covered with colored carpets , and the walls were barren brick , but hung with ornaments made of skulls , feathers , and tapestry , which Apanage had told her she had invented .


fn_spacy_tokens_for_baseline: but um to tell you the truth i 'm not real familiar with um

source_bert_toks: but um to tell you the truth i ' m not real familiar with um

reference_raw: but, um, to tell you the truth, I don't really know um

reference_spacy_tokens: but , um , to tell you the truth , I do n't really know um


fn_spacy_tokens_for_baseline: The main thrust of the SEA was to establish the SEM by 31 December 1992 .

source_bert_toks: the main thrust of the sea was to establish the se ##m by 31 december 1992 .

reference_raw: The major thrust of the SEA was the creation of the SEM by 31 December 1992.

reference_spacy_tokens: The major thrust of the SEA was the creation of the SEM by 31 December 1992 .


fn_spacy_tokens_for_baseline: Laugh she did , at any rate , and those convulsive movements succeeded where her more calculated efforts had failed .

source_bert_toks: laugh she did , at any rate , and those con ##vu ##ls ##ive movements succeeded where her more calculated efforts had failed .

reference_raw: At least she laughed, and the spasms were successful where her more calculated efforts had failed.

reference_spacy_tokens: At least she laughed , and the spasms were successful where her more calculated efforts had failed .


fn_spacy_tokens_for_baseline: This follows the discovery in December last year , at the end of a proving run from London to Glasgow , that some bolts on an axle had become loose .

source_bert_toks: this follows the discovery in december last year , at the end of a proving run from london to glasgow , that some bolts on an axle had become loose .

reference_raw: This is the result of the discovery in December of last year, at the end of a proving run from London to Glasgow, that some of the screws on the axle were loose.

reference_spacy_tokens: This is the result of the discovery in December of last year , at the end of a proving run from London to Glasgow , that some of the screws on the axle were loose .


fn_spacy_tokens_for_baseline: He rubbed clenched fists along his thighs , then open palms , and finally clasped his hands together .

source_bert_toks: he rubbed clenched fists along his thighs , then open palms , and finally clasped his hands together .

reference_raw: He rubbed his clenched fists across his legs, then opened his palms, then clasped his hands together.

reference_spacy_tokens: He rubbed his clenched fists across his legs , then opened his palms , then clasped his hands together .


fn_spacy_tokens_for_baseline: When they arrived at Hamilton Terrace it was impossible to predict whether they would behave with irresistible charm or throw the chairs across the room .

source_bert_toks: when they arrived at hamilton terrace it was impossible to predict whether they would behave with irresistible charm or throw the chairs across the room .

reference_raw: When they reached Hamilton Terrace, it was impossible to predict whether they were going to act with irresistible grace or toss chairs across the room.

reference_spacy_tokens: When they reached Hamilton Terrace , it was impossible to predict whether they were going to act with irresistible grace or toss chairs across the room .


fn_spacy_tokens_for_baseline: The roar of the patrol boat 's huge petrol engines thrummed in his ears and he glanced back over his shoulder .

source_bert_toks: the roar of the patrol boat ' s huge petrol engines thru ##mme ##d in his ears and he glanced back over his shoulder .

reference_raw: The bellow of the patrol boat's huge gas engines thumped in his ears, and he looked back over his shoulder.

reference_spacy_tokens: The bellow of the patrol boat 's huge gas engines thumped in his ears , and he looked back over his shoulder .


fn_spacy_tokens_for_baseline: There have been allegations that the Soviet Union developed a new class of nerve agent ( Novichok ) , estimated to be 5 - 10 times more toxic than VX .

source_bert_toks: there have been allegations that the soviet union developed a new class of nerve agent ( novi ##cho ##k ) , estimated to be 5 - 10 times more toxic than v ##x .

reference_raw: There are rumors that the Soviet Union has developed a new class of nerve agents (Novichok), which is estimated to be five to ten times more toxic than VX.

reference_spacy_tokens: There are rumors that the Soviet Union has developed a new class of nerve agents ( Novichok ) , which is estimated to be five to ten times more toxic than VX .


fn_spacy_tokens_for_baseline: The rumours started earlier this year , when B - boys began showing up at New York clubs and wowing the assemblage with their traditional towering tonsors .

source_bert_toks: the rumours started earlier this year , when b - boys began showing up at new york clubs and wow ##ing the ass ##em ##bla ##ge with their traditional towering tons ##ors .

reference_raw: Rumors began earlier this year, when the B-boys began to show up at the New York clubs and wrought the assembly with their traditional towering tonsors.

reference_spacy_tokens: Rumors began earlier this year , when the B - boys began to show up at the New York clubs and wrought the assembly with their traditional towering tonsors .


fn_spacy_tokens_for_baseline: Representatives from project partners BPX and Statoil , plus sole gas purchasers Alliance Gas , were present .

source_bert_toks: representatives from project partners bp ##x and stat ##oi ##l , plus sole gas purchase ##rs alliance gas , were present .

reference_raw: Representatives of the project partners BPX and Statoil, as well as the sole gas buyer Alliance Gas, were present.

reference_spacy_tokens: Representatives of the project partners BPX and Statoil , as well as the sole gas buyer Alliance Gas , were present .


fn_spacy_tokens_for_baseline: One is a development of porous asphalt already used extensively in Europe , and the other is called ' whispering concrete ' .

source_bert_toks: one is a development of por ##ous asphalt already used extensively in europe , and the other is called ' whispering concrete ' .

reference_raw: One is the evolution of porous asphalt, which has already been widely used in Europe, and the other is called Whispering Concrete.

reference_spacy_tokens: One is the evolution of porous asphalt , which has already been widely used in Europe , and the other is called Whispering Concrete .


fn_spacy_tokens_for_baseline: Any departure from the standard must be justified by the individual circumstances .

source_bert_toks: any departure from the standard must be justified by the individual circumstances .

reference_raw: Any deviation from the standard shall be warranted on a case-by-case basis.

reference_spacy_tokens: Any deviation from the standard shall be warranted on a case - by - case basis .


fn_spacy_tokens_for_baseline: The complexity and uncertainty of these trends is well summarised by the Jewkes in their study of the NHS :

source_bert_toks: the complexity and uncertainty of these trends is well sum ##mar ##ised by the jew ##kes in their study of the nhs :

reference_raw: In their NHS study, Jews summarize the complexity and uncertainty of these trends:

reference_spacy_tokens: In their NHS study , Jews summarize the complexity and uncertainty of these trends :


fn_spacy_tokens_for_baseline: Graffiti written by Russian soldiers can be seen in the caves of Antiparos .

source_bert_toks: graffiti written by russian soldiers can be seen in the caves of anti ##par ##os .

reference_raw: In the caves of Antiparos, you can see the graffiti written by Russia's soldiers.

reference_spacy_tokens: In the caves of Antiparos , you can see the graffiti written by Russia 's soldiers .


fn_spacy_tokens_for_baseline: These three cities form a single megalopolis occupying a sliver of coastline 20 miles ( 30 km ) wide .

source_bert_toks: these three cities form a single mega ##lo ##polis occupying a sl ##iver of coastline 20 miles ( 30 ##km ) wide .

reference_raw: These three cities form a single megalopolis, with a section of coastline 20 miles (30 km) across.

reference_spacy_tokens: These three cities form a single megalopolis , with a section of coastline 20 miles ( 30 km ) across .


fn_spacy_tokens_for_baseline: The trade surplus with the United States edged down about $ 33 million to $ 7.6 billion .

source_bert_toks: the trade surplus with the united states edged down about $ 33 million to $ 7 . 6 billion .

reference_raw: The trade surplus with the United States has dropped from $33 million to $7.6 million.

reference_spacy_tokens: The trade surplus with the United States has dropped from $ 33 million to $ 7.6 million .


fn_spacy_tokens_for_baseline: A large forest fire that started on Monday , June 9 is still out of control in the municipality of Froland in southern Norway .

source_bert_toks: a large forest fire that started on monday , june 9 is still out of control in the municipality of fr ##ola ##nd in southern norway .

reference_raw: The big forest fire, which began on Monday, June 9th, is still uncontrollable in the town of Froland in southern Norway.

reference_spacy_tokens: The big forest fire , which began on Monday , June 9th , is still uncontrollable in the town of Froland in southern Norway .


fn_spacy_tokens_for_baseline: Whenever a piece of paper gets screwed up and thrown away like that it 's always a vital clue . '

source_bert_toks: whenever a piece of paper gets screwed up and thrown away like that it ' s always a vital clue . '

reference_raw: Every time a piece of paper goes wrong and throws away like this, it's always a vital clue.'

reference_spacy_tokens: Every time a piece of paper goes wrong and throws away like this , it 's always a vital clue . '


fn_spacy_tokens_for_baseline: The Robemaker 's skin was covered with suppurating sores , great festering , oozing ulcers , leprous growths , cancerous chancres .

source_bert_toks: the robe ##maker ' s skin was covered with su ##pp ##ura ##ting sore ##s , great fest ##ering , o ##oz ##ing ul ##cer ##s , le ##pro ##us growth ##s , cancer ##ous chan ##cre ##s .

reference_raw: The Robemaker's skin was covered with suppurating pains, massive festrations, oozing ulcers, leprosy growths, cancerous chances.

reference_spacy_tokens: The Robemaker 's skin was covered with suppurating pains , massive festrations , oozing ulcers , leprosy growths , cancerous chances .