fn_spacy_tokens_for_baseline: During this final stage they appear as ants , which are really fairies in disguise .

source_bert_toks: during this final stage they appear as ants , which are really fairies in disguise .

reference_raw: During this last phase, they appear to be ants, which are really fairies in disguise.

reference_spacy_tokens: During this last phase , they appear to be ants , which are really fairies in disguise .


fn_spacy_tokens_for_baseline: Helen gave him a look of fury .

source_bert_toks: helen gave him a look of fury .

reference_raw: Helen glared at him angrily.

reference_spacy_tokens: Helen glared at him angrily .


fn_spacy_tokens_for_baseline: Ray Diamond , foreman of jury in Miami which cleared a man of rape .

source_bert_toks: ray diamond , foreman of jury in miami which cleared a man of rape .

reference_raw: Ray Diamond, foreman of the Miami jury who cleans up a man for rape.

reference_spacy_tokens: Ray Diamond , foreman of the Miami jury who cleans up a man for rape .


fn_spacy_tokens_for_baseline: And there is a sniper they call the Serb On The Hill , who has built a bunker in his back garden and has a nice line of sight straight down the street towards them .

source_bert_toks: and there is a sniper they call the serb on the hill , who has built a bunker in his back garden and has a nice line of sight straight down the street towards them .

reference_raw: And there's a sniper called the Serb on the Hill, who's built a bunkery in his backyard, and he's got a nice line of sight right down the street to them.

reference_spacy_tokens: And there 's a sniper called the Serb on the Hill , who 's built a bunkery in his backyard , and he 's got a nice line of sight right down the street to them .


fn_spacy_tokens_for_baseline: In January 1990 , during the civil disturbances in Baku , he chartered a plane and dramatically evacuated his wife and other members of his family to safety .

source_bert_toks: in january 1990 , during the civil disturbances in baku , he chartered a plane and dramatically evacuated his wife and other members of his family to safety .

reference_raw: In January 1990, during the civil disturbances in Baku, he rented a plane and dramatically evacuated his wife and other family members to safety.

reference_spacy_tokens: In January 1990 , during the civil disturbances in Baku , he rented a plane and dramatically evacuated his wife and other family members to safety .


fn_spacy_tokens_for_baseline: Mucosal pathology in gluten sensitivity seems to be dependent on T cel lmediated reactivity in genetically predisposed subjects .

source_bert_toks: mu ##cos ##al pathology in g ##lu ##ten sensitivity seems to be dependent on t ce ##l l ##media ##ted react ##ivity in genetically pre ##dis ##posed subjects .

reference_raw: Mucosal pathology in gluten susceptibility appears to depend on T-cel-mediated reactivity in patients with genetic predisposition.

reference_spacy_tokens: Mucosal pathology in gluten susceptibility appears to depend on T - cel - mediated reactivity in patients with genetic predisposition .


fn_spacy_tokens_for_baseline: Some say the idea originated in Greece or Turkey as a tourist stunt .

source_bert_toks: some say the idea originated in greece or turkey as a tourist stunt .

reference_raw: Some say the idea came from Greece or Turkey as a tourist trick.

reference_spacy_tokens: Some say the idea came from Greece or Turkey as a tourist trick .


fn_spacy_tokens_for_baseline: Rakovsky listened to the cool voice describing the intensive hypnosis and subliminal suggestion that would distort Bruckner 's mentality .

source_bert_toks: ra ##kovsky listened to the cool voice describing the intensive h ##yp ##nosis and sub ##lim ##inal suggestion that would di ##stor ##t br ##uck ##ner ' s mental ##ity .

reference_raw: Rakovsky listened to a cold voice that described intense hypnosis and subliminal suggestions that would distort Bruckner's mentality.

reference_spacy_tokens: Rakovsky listened to a cold voice that described intense hypnosis and subliminal suggestions that would distort Bruckner 's mentality .


fn_spacy_tokens_for_baseline: The Western District is one of Hong Kong 's oldest neighborhoods , and its narrow streets hold a collection of fascinating traditional shops and enterprises .

source_bert_toks: the western district is one of hong kong ' s oldest neighborhoods , and its narrow streets hold a collection of fascinating traditional shops and enterprises .

reference_raw: The western precinct is one of the oldest neighbourhoods in Hong Kong, and its narrow streets contain a collection of fascinating traditional shops and businesses.

reference_spacy_tokens: The western precinct is one of the oldest neighbourhoods in Hong Kong , and its narrow streets contain a collection of fascinating traditional shops and businesses .


fn_spacy_tokens_for_baseline: ' I 'll wager a pint o ' the best on her to win ! "

source_bert_toks: ' i ' ll wage ##r a pin ##t o ' the best on her to win ! "

reference_raw: "I'll bet her the best bet to win!"

reference_spacy_tokens: " I 'll bet her the best bet to win ! "


fn_spacy_tokens_for_baseline: I am sure you are all aware that Royston is an important cog in the Athletico jigsaw and his recurrent knee injury has played a large part in our poor results this season .

source_bert_toks: i am sure you are all aware that roy ##ston is an important co ##g in the athletic ##o ji ##gs ##aw and his rec ##urrent knee injury has played a large part in our poor results this season .

reference_raw: I'm sure you're all aware that Royston is an important cog in the Athletico puzzle, and his repeated knee injury has played a major role in our poor performance this season.

reference_spacy_tokens: I 'm sure you 're all aware that Royston is an important cog in the Athletico puzzle , and his repeated knee injury has played a major role in our poor performance this season .


fn_spacy_tokens_for_baseline: A typical jellyfish is a saucer fringed with stinging tentacles .

source_bert_toks: a typical jelly ##fish is a sauce ##r fringe ##d with stinging tentacles .

reference_raw: Typical jellyfish is a saucer edged with stabbing tentacles.

reference_spacy_tokens: Typical jellyfish is a saucer edged with stabbing tentacles .


fn_spacy_tokens_for_baseline: I consulted a lawyer at the Citizens Advice Bureau when I was in Norwich last Friday .

source_bert_toks: i consulted a lawyer at the citizens advice bureau when i was in norwich last friday .

reference_raw: When I was in Norwich last Friday, I consulted my attorney at the Citizens' Advice Bureau.

reference_spacy_tokens: When I was in Norwich last Friday , I consulted my attorney at the Citizens ' Advice Bureau .


fn_spacy_tokens_for_baseline: In 1975 , two nature lovers were boating on one of the bay 's rivers .

source_bert_toks: in 1975 , two nature lovers were boating on one of the bay ' s rivers .

reference_raw: In 1975, two natural lovers sailed on one of the rivers of the bay.

reference_spacy_tokens: In 1975 , two natural lovers sailed on one of the rivers of the bay .


fn_spacy_tokens_for_baseline: On the Beagle voyage , Darwin had discovered evidence for the ' law of succession of types ' by unearthing South American fossils related to the unique modern inhabitants of that continent .

source_bert_toks: on the bea ##gle voyage , darwin had discovered evidence for the ' law of succession of types ' by une ##arth ##ing south american fossils related to the unique modern inhabitants of that continent .

reference_raw: On the Beagle cruise, Darwin discovered evidence of the "law of succession of species" by unearthing South American fossils associated with the unique modern inhabitants of this continent.

reference_spacy_tokens: On the Beagle cruise , Darwin discovered evidence of the " law of succession of species " by unearthing South American fossils associated with the unique modern inhabitants of this continent .


fn_spacy_tokens_for_baseline: In the Civil Service , the higher levels of responsibility and reward have continued to elude women .

source_bert_toks: in the civil service , the higher levels of responsibility and reward have continued to el ##ude women .

reference_raw: Women continue to escape higher levels of responsibility and reward in the civil service.

reference_spacy_tokens: Women continue to escape higher levels of responsibility and reward in the civil service .


fn_spacy_tokens_for_baseline: At the same time , Brother , a cowled and hooded figure was seen in the tavern near the Tower , and the same person , probably Burghgesh , also seen in Woodforde . '

source_bert_toks: at the same time , brother , a cow ##led and hooded figure was seen in the tavern near the tower , and the same person , probably bu ##rgh ##ges ##h , also seen in wood ##ford ##e . '

reference_raw: At the same time, Brother, in the tavern near the Tower, a cloaked figure was seen, and the same person, probably Burghgesh, was also seen in Woodford.'

reference_spacy_tokens: At the same time , Brother , in the tavern near the Tower , a cloaked figure was seen , and the same person , probably Burghgesh , was also seen in Woodford . '


fn_spacy_tokens_for_baseline: Yet the opacity and lack of conviction of this paper has so disappointed directors that no vote will now take place .

source_bert_toks: yet the op ##ac ##ity and lack of conviction of this paper has so disappointed directors that no vote will now take place .

reference_raw: But the opacity and lack of conviction of this document have so failed the directors that there will be no vote now.

reference_spacy_tokens: But the opacity and lack of conviction of this document have so failed the directors that there will be no vote now .


fn_spacy_tokens_for_baseline: The blond man had nodded a greeting to her , and Carol had been aware of his appraising gaze .

source_bert_toks: the blond man had nodded a greeting to her , and carol had been aware of his app ##rai ##sing gaze .

reference_raw: The blond man greeted her, and Carol was aware of his appraising gaze.

reference_spacy_tokens: The blond man greeted her , and Carol was aware of his appraising gaze .


fn_spacy_tokens_for_baseline: Who 's killin ' us , robbin ' us of life and light ? "

source_bert_toks: who ' s kill ##in ' us , robb ##in ' us of life and light ? "

reference_raw: Who kills us, robs us of living and light?

reference_spacy_tokens: Who kills us , robs us of living and light ?


fn_spacy_tokens_for_baseline: She smiled and gestured that she could n't hear him .

source_bert_toks: she smiled and gestured that she couldn ' t hear him .

reference_raw: She smiled and pointed out that she could not hear him.

reference_spacy_tokens: She smiled and pointed out that she could not hear him .


fn_spacy_tokens_for_baseline: Because people are so angry , they 're frustrated with the system and their anger gets in the way and it frightens people .

source_bert_toks: because people are so angry , they ' re frustrated with the system and their anger gets in the way and it fright ##ens people .

reference_raw: Because people are so angry, they're frustrated by the system, and their anger gets in the way, and it scares people.

reference_spacy_tokens: Because people are so angry , they 're frustrated by the system , and their anger gets in the way , and it scares people .


fn_spacy_tokens_for_baseline: This is a consideration of principle rather than practical reality , since the relevant law is often obscure , and unlikely to be at the fingertips of the qualified lawyer let alone the layman .

source_bert_toks: this is a consideration of principle rather than practical reality , since the relevant law is often obscure , and unlikely to be at the fingertips of the qualified lawyer let alone the lay ##man .

reference_raw: This is a matter of principle rather than practical reality, since the law in question is often unclear and unlikely to be within the reach of a qualified lawyer, let alone a layman.

reference_spacy_tokens: This is a matter of principle rather than practical reality , since the law in question is often unclear and unlikely to be within the reach of a qualified lawyer , let alone a layman .


fn_spacy_tokens_for_baseline: It is often a good idea to write up your own notes of a disciplinary interview immediately afterwards .

source_bert_toks: it is often a good idea to write up your own notes of a disciplinary interview immediately afterwards .

reference_raw: Often it's a good idea to make your own notes about the disciplinary interview immediately afterwards.

reference_spacy_tokens: Often it 's a good idea to make your own notes about the disciplinary interview immediately afterwards .


fn_spacy_tokens_for_baseline: The protesters remembered the mid-1990s , the last time Shiite Bahrainis launched mass demonstrations against their government .

source_bert_toks: the protesters remembered the mid - 1990s , the last time shi ##ite bahrain ##is launched mass demonstrations against their government .

reference_raw: Protestants remembered the mid-1990s, when Shiite Bahrainis had last launched mass protests against their government.

reference_spacy_tokens: Protestants remembered the mid-1990s , when Shiite Bahrainis had last launched mass protests against their government .


fn_spacy_tokens_for_baseline: The next day the headlines gloated with the kind of effusive unction that only the English press can muster .

source_bert_toks: the next day the headlines g ##lo ##ated with the kind of e ##ff ##us ##ive un ##ction that only the english press can muster .

reference_raw: The next day, the headlines glowed with the kind of effusion that only the English press can handle.

reference_spacy_tokens: The next day , the headlines glowed with the kind of effusion that only the English press can handle .


fn_spacy_tokens_for_baseline: With sirens blaring and amber lights flashing , the squad cars slewed to a halt at the rear of a war - torn Cadillac .

source_bert_toks: with sirens b ##lar ##ing and amber lights flashing , the squad cars sl ##ew ##ed to a halt at the rear of a war - torn cadillac .

reference_raw: As the sirens flared and the amber lights flashed, the squad cars stopped at the back of the war-torn Cadillac.

reference_spacy_tokens: As the sirens flared and the amber lights flashed , the squad cars stopped at the back of the war - torn Cadillac .


fn_spacy_tokens_for_baseline: Northern Ireland was urged to go up market to attract affluent visitors according to a report by the Northern Ireland Economic Research Centre .

source_bert_toks: northern ireland was urged to go up market to attract affluent visitors according to a report by the northern ireland economic research centre .

reference_raw: According to the report of the Northern Ireland Economic Research Centre, Northern Ireland was encouraged to enter the market in order to attract wealthy visitors.

reference_spacy_tokens: According to the report of the Northern Ireland Economic Research Centre , Northern Ireland was encouraged to enter the market in order to attract wealthy visitors .


fn_spacy_tokens_for_baseline: Our MP Mr Ken Hind ( Conservative , West Lancs ) wrote to people in Scarisbrick saying that he has pushed the Department of Transport into accepting the need for a bypass between Ormskirk and Southport .

source_bert_toks: our mp mr ken hind ( conservative , west lan ##cs ) wrote to people in scar ##is ##brick saying that he has pushed the department of transport into accepting the need for a bypass between or ##ms ##kir ##k and southport .

reference_raw: Our representative, Mr. Ken Hind (West Lancs Conservative), wrote to people in Scarisbrick, saying that he'd pushed the Department of Transport to accept the need to pass between Ormskirk and Southport.

reference_spacy_tokens: Our representative , Mr. Ken Hind ( West Lancs Conservative ) , wrote to people in Scarisbrick , saying that he 'd pushed the Department of Transport to accept the need to pass between Ormskirk and Southport .


fn_spacy_tokens_for_baseline: Luis Vaz de Camoes ( 1524 - 1580 ) , the Portuguese national poet whose work immortalized that country 's golden age of discoveries , may have stayed in Macau .

source_bert_toks: luis va ##z de cam ##oes ( 152 ##4 - 1580 ) , the portuguese national poet whose work immortal ##ized that country ' s golden age of discoveries , may have stayed in macau .

reference_raw: Luis Vaz de Camoes (1524 - 1580), a Portuguese national poet whose work immortalized the golden age of discovery in that country, could remain in Macao.

reference_spacy_tokens: Luis Vaz de Camoes ( 1524 - 1580 ) , a Portuguese national poet whose work immortalized the golden age of discovery in that country , could remain in Macao .


fn_spacy_tokens_for_baseline: ( One suspects that Boiotia 's real misfortune in this respect was mere proximity to Athens . )

source_bert_toks: ( one suspects that bo ##iot ##ia ' s real mis ##fort ##une in this respect was mere proximity to athens . )

reference_raw: (One suspects that Boiotia's real unhappiness was close to Athens in that regard.)

reference_spacy_tokens: ( One suspects that Boiotia 's real unhappiness was close to Athens in that regard . )


fn_spacy_tokens_for_baseline: The cold eyes scrutinising her so impersonally were deep set beneath heavy black brows , and shadowed with fatigue .

source_bert_toks: the cold eyes sc ##rut ##ini ##sing her so imp ##erson ##ally were deep set beneath heavy black brows , and shadowed with fatigue .

reference_raw: The cold eyes that examined her so impersonally were deep beneath heavy black eyebrows, shadowed by weariness.

reference_spacy_tokens: The cold eyes that examined her so impersonally were deep beneath heavy black eyebrows , shadowed by weariness .


fn_spacy_tokens_for_baseline: Her relationship with her boyfriend had lasted six years , but she was unsure whether to move in with him .

source_bert_toks: her relationship with her boyfriend had lasted six years , but she was unsure whether to move in with him .

reference_raw: Her relationship with her boyfriend had lasted six years, but she wasn't sure if she wanted to move in with him.

reference_spacy_tokens: Her relationship with her boyfriend had lasted six years , but she was n't sure if she wanted to move in with him .


fn_spacy_tokens_for_baseline: A smaller set of baths dependent upon mineral springs may also have existed at Buxton .

source_bert_toks: a smaller set of baths dependent upon mineral springs may also have existed at bu ##xton .

reference_raw: In Buxton there may also be a smaller set of baths that depend on mineral sources.

reference_spacy_tokens: In Buxton there may also be a smaller set of baths that depend on mineral sources .


fn_spacy_tokens_for_baseline: I have to pay the bills .

source_bert_toks: i have to pay the bills .

reference_raw: I've got bills to make.

reference_spacy_tokens: I 've got bills to make .


fn_spacy_tokens_for_baseline: With a population of nearly eight million and a total area of just over 1,095 square km ( 423 square miles ) , housing is one of Hong Kong 's perennial nightmares .

source_bert_toks: with a population of nearly eight million and a total area of just over 1 , 09 ##5 square km ( 42 ##3 square miles ) , housing is one of hong kong ' s perennial nightmares .

reference_raw: With a population of almost eight million and a total area of just over 1,095 square miles (423 square miles), living is one of Hong Kong's permanent nightmares.

reference_spacy_tokens: With a population of almost eight million and a total area of just over 1,095 square miles ( 423 square miles ) , living is one of Hong Kong 's permanent nightmares .


fn_spacy_tokens_for_baseline: Already 70 per cent of the capital 's annual total of 13.5 million tons of waste goes to counties outside the city .

source_bert_toks: already 70 per cent of the capital ' s annual total of 13 . 5 million tons of waste goes to counties outside the city .

reference_raw: 70% of the capital's annual total of 13.5 million tonnes of waste already goes to districts outside the city.

reference_spacy_tokens: 70 % of the capital 's annual total of 13.5 million tonnes of waste already goes to districts outside the city .


fn_spacy_tokens_for_baseline: I used to have a special gimmick -- when I used to do my clog dance , I used to shout to the audience , ' Throw pennies , ' and that 's what they used to do .

source_bert_toks: i used to have a special gi ##mm ##ick - - when i used to do my cl ##og dance , i used to shout to the audience , ' throw penn ##ies , ' and that ' s what they used to do .

reference_raw: I had a special trick -- when I was doing a block dance, I yelled to the audience, "Throw pennies," and that's what they used to do.

reference_spacy_tokens: I had a special trick -- when I was doing a block dance , I yelled to the audience , " Throw pennies , " and that 's what they used to do .


fn_spacy_tokens_for_baseline: Being by nature fairly cautious and sometimes reluctant to adapt to change , I was at first somewhat bemused by an array of unfamiliar terms -- competence elements , HN units , performance criteria .

source_bert_toks: being by nature fairly cautious and sometimes reluctant to adapt to change , i was at first somewhat be ##mus ##ed by an array of unfamiliar terms - - competence elements , h ##n units , performance criteria .

reference_raw: Since I was, by nature, quite careful and sometimes reluctant to adapt to change, I was at first amused by a series of unknown concepts - competence elements, HN units, performance criteria.

reference_spacy_tokens: Since I was , by nature , quite careful and sometimes reluctant to adapt to change , I was at first amused by a series of unknown concepts - competence elements , HN units , performance criteria .


fn_spacy_tokens_for_baseline: Employment and training programmes will increase by 500,000 places next year , a rise of 50 per cent .

source_bert_toks: employment and training programmes will increase by 500 , 000 places next year , a rise of 50 per cent .

reference_raw: Employment and training programmes will grow by 500,000 jobs next year, up by 50%.

reference_spacy_tokens: Employment and training programmes will grow by 500,000 jobs next year , up by 50 % .


fn_spacy_tokens_for_baseline: A notable phenomenon is the merging of very small firms to spread the burden of compliance with increasing audit regulation .

source_bert_toks: a notable phenomenon is the merging of very small firms to spread the burden of compliance with increasing audit regulation .

reference_raw: A remarkable phenomenon is the merger of very small companies in order to spread the burden of complying with the increasing regulation of audits.

reference_spacy_tokens: A remarkable phenomenon is the merger of very small companies in order to spread the burden of complying with the increasing regulation of audits .


fn_spacy_tokens_for_baseline: Charlie secured the tarpaulin with a length of hairy string from his pocket .

source_bert_toks: charlie secured the tar ##pa ##ulin with a length of hairy string from his pocket .

reference_raw: Charlie pulled the tarpaulin out of his pocket with a long, hairy string.

reference_spacy_tokens: Charlie pulled the tarpaulin out of his pocket with a long , hairy string .


fn_spacy_tokens_for_baseline: A civilian with the grey wool skull cap of the Svan people , from the high glens of Georgia , jumped up to help .

source_bert_toks: a civilian with the grey wool skull cap of the sv ##an people , from the high glen ##s of georgia , jumped up to help .

reference_raw: A civilian in the gray woolen skullcap of the Svans from the high ravines of Georgia jumped to his aid.

reference_spacy_tokens: A civilian in the gray woolen skullcap of the Svans from the high ravines of Georgia jumped to his aid .


fn_spacy_tokens_for_baseline: The message seemed to be that women who are raped are at fault for not having successfully avoided it .

source_bert_toks: the message seemed to be that women who are raped are at fault for not having successfully avoided it .

reference_raw: It seemed that the message was that the women who had been raped were to blame for their failure to avoid it.

reference_spacy_tokens: It seemed that the message was that the women who had been raped were to blame for their failure to avoid it .


fn_spacy_tokens_for_baseline: The execution - style killings occurred at the Wat Promkunaram temple , the second - largest site of Buddhist worship in the country , built in 1988 in a remote location 20 miles west of Phoenix .

source_bert_toks: the execution - style killings occurred at the wat prom ##ku ##nar ##am temple , the second - largest site of buddhist worship in the country , built in 1988 in a remote location 20 miles west of phoenix .

reference_raw: The execution-style killings took place at the Wat Promkunaram Temple, the second-largest place of Buddhist worship in the country, built in 1988 in a remote location 20 miles to the east of Phoenix.

reference_spacy_tokens: The execution - style killings took place at the Wat Promkunaram Temple , the second - largest place of Buddhist worship in the country , built in 1988 in a remote location 20 miles to the east of Phoenix .


fn_spacy_tokens_for_baseline: His own wounds were healing quickly and the pain was almost gone .

source_bert_toks: his own wounds were healing quickly and the pain was almost gone .

reference_raw: His own wounds recovered quickly, and the pain was almost gone.

reference_spacy_tokens: His own wounds recovered quickly , and the pain was almost gone .


fn_spacy_tokens_for_baseline: Naturally curly hair is prone to dryness and can turn frizzy if it 's neglected .

source_bert_toks: naturally curly hair is prone to dry ##ness and can turn fr ##iz ##zy if it ' s neglected .

reference_raw: Of course, curly hair tends to dry and may become frizzy if neglected.

reference_spacy_tokens: Of course , curly hair tends to dry and may become frizzy if neglected .


fn_spacy_tokens_for_baseline: Mr. Kristol , an American Enterprise Institute fellow , co - edits The Public Interest and publishes The National Interest .

source_bert_toks: mr . kris ##to ##l , an american enterprise institute fellow , co - edit ##s the public interest and publishes the national interest .

reference_raw: Mr. Kristol, a fellow U.S. Enterprise Institute, co-edits the public interest and publishes the nation's interest.

reference_spacy_tokens: Mr. Kristol , a fellow U.S. Enterprise Institute , co - edits the public interest and publishes the nation 's interest .


fn_spacy_tokens_for_baseline: I think many people , particularly the families of those killed at Lockerbie , I think their anger and outrage at this release will be further intensified by what we have seen .

source_bert_toks: i think many people , particularly the families of those killed at locker ##bie , i think their anger and outrage at this release will be further intensified by what we have seen .

reference_raw: I think a lot of people, especially the families of those killed in Lockerbie, that their anger and indignation at this release will be intensified by what we've seen.

reference_spacy_tokens: I think a lot of people , especially the families of those killed in Lockerbie , that their anger and indignation at this release will be intensified by what we 've seen .


fn_spacy_tokens_for_baseline: Restaurants , bakeries , traditional - clothing boutiques and specialty shops can be found in both areas .

source_bert_toks: restaurants , baker ##ies , traditional - clothing boutique ##s and specialty shops can be found in both areas .

reference_raw: In both areas, restaurants, bakeries, traditional clothing shops and specialty shops can be found.

reference_spacy_tokens: In both areas , restaurants , bakeries , traditional clothing shops and specialty shops can be found .


fn_spacy_tokens_for_baseline: The scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeways is rampant .

source_bert_toks: the scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeway ##s is rampant .

reference_raw: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets, missing each other by inches, and speeding on highways is rampant.

reference_spacy_tokens: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets , missing each other by inches , and speeding on highways is rampant .


fn_spacy_tokens_for_baseline: I feel devastated and it is much worse for my poor mother . '

source_bert_toks: i feel devastated and it is much worse for my poor mother . '

reference_raw: I'm feeling ruined, and it's a lot worse for my poor mother.'

reference_spacy_tokens: I 'm feeling ruined , and it 's a lot worse for my poor mother . '


fn_spacy_tokens_for_baseline: Pets are very important therapy for old people and usually get on very well in a Home .

source_bert_toks: pets are very important therapy for old people and usually get on very well in a home .

reference_raw: Pets are very important treatments for old people, and they usually get along very well at home.

reference_spacy_tokens: Pets are very important treatments for old people , and they usually get along very well at home .


fn_spacy_tokens_for_baseline: By conceding on the timetable , O'Neill gifted the Republicans an important advantage , helping them by drastically curtailing the protracted and damaging interplay of pluralist forces that would have otherwise taken place over the budget .

source_bert_toks: by con ##ced ##ing on the timetable , o ' neill gifted the republicans an important advantage , helping them by drastically curt ##ailing the pro ##tracted and damaging inter ##play of plural ##ist forces that would have otherwise taken place over the budget .

reference_raw: By agreeing to the schedule, O'Neill gave the Republicans an important advantage and helped them by drastically reducing the protracted and damaging interaction between pluralist forces that would otherwise have occurred in the budget.

reference_spacy_tokens: By agreeing to the schedule , O'Neill gave the Republicans an important advantage and helped them by drastically reducing the protracted and damaging interaction between pluralist forces that would otherwise have occurred in the budget .


fn_spacy_tokens_for_baseline: Liu Binyan and Su Xiaokang were expelled from the official Chinese Writers ' Association for their ' anti - government activities abroad ' .

source_bert_toks: liu bin ##yan and su xiao ##kan ##g were expelled from the official chinese writers ' association for their ' anti - government activities abroad ' .

reference_raw: Liu Binyan and Su Xiaokang have been excluded from the official Chinese writers' association for their anti-government activities abroad.

reference_spacy_tokens: Liu Binyan and Su Xiaokang have been excluded from the official Chinese writers ' association for their anti - government activities abroad .


fn_spacy_tokens_for_baseline: Vet prize money is a long overdue development , likely to add a new measure of excitement to the sharp end of the field .

source_bert_toks: vet prize money is a long over ##due development , likely to add a new measure of excitement to the sharp end of the field .

reference_raw: Vet price money is a long-delayed development, which is likely to add a new amount of excitement to the sharp end of the field.

reference_spacy_tokens: Vet price money is a long - delayed development , which is likely to add a new amount of excitement to the sharp end of the field .


fn_spacy_tokens_for_baseline: In 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

source_bert_toks: in 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

reference_raw: In 1904, narrow, double-decker tracks ran along the waterfront, but land reclamation put them far inland.

reference_spacy_tokens: In 1904 , narrow , double - decker tracks ran along the waterfront , but land reclamation put them far inland .


fn_spacy_tokens_for_baseline: In repose Biff 's arm hung in mid - air ; he might have been recuperating in a wing of the Apothacarion with his limb in traction .

source_bert_toks: in rep ##ose bi ##ff ' s arm hung in mid - air ; he might have been rec ##up ##era ##ting in a wing of the ap ##oth ##aca ##rion with his limb in traction .

reference_raw: In reposition, Biff's arm hung in the air; he could have recovered in the wing of the Apothacarion with his limb in traction.

reference_spacy_tokens: In reposition , Biff 's arm hung in the air ; he could have recovered in the wing of the Apothacarion with his limb in traction .


fn_spacy_tokens_for_baseline: They have to cope with one or more project managers , and to take orders from their own department head .

source_bert_toks: they have to cope with one or more project managers , and to take orders from their own department head .

reference_raw: They must deal with one or more project managers and take orders from their own department director.

reference_spacy_tokens: They must deal with one or more project managers and take orders from their own department director .


fn_spacy_tokens_for_baseline: This means that Iran will place the Natanz facility , and any enriched uranium it produces , under IAEA inspection but that , as long as no nuclear materials are present , the IAEA would have no ability to examine locations in Iran where it believed nuclear weapons design research might be under way .

source_bert_toks: this means that iran will place the nat ##an ##z facility , and any enriched uranium it produces , under ia ##ea inspection but that , as long as no nuclear materials are present , the ia ##ea would have no ability to examine locations in iran where it believed nuclear weapons design research might be under way .

reference_raw: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA, but that until there is no nuclear material, the IAEA will not be able to investigate locations in Iran where it believes that research on the design of nuclear weapons may be ongoing.

reference_spacy_tokens: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA , but that until there is no nuclear material , the IAEA will not be able to investigate locations in Iran where it believes that research on the design of nuclear weapons may be ongoing .


fn_spacy_tokens_for_baseline: This wakes the patient up and breathing starts again , but if there are repeated attacks during the night this can produce severe fatigue and drowsiness during the following day .

source_bert_toks: this wakes the patient up and breathing starts again , but if there are repeated attacks during the night this can produce severe fatigue and dr ##ows ##iness during the following day .

reference_raw: This will wake the patient and start breathing again, but if repeated attacks occur during the night, this may cause serious fatigue and sleepiness in the following day.

reference_spacy_tokens: This will wake the patient and start breathing again , but if repeated attacks occur during the night , this may cause serious fatigue and sleepiness in the following day .


fn_spacy_tokens_for_baseline: The courts will not allow the taking of evidence abroad to develop into a ' roving enquiry ' , but in many jurisdictions it is not essential to name in advance all the witnesses to be examined .

source_bert_toks: the courts will not allow the taking of evidence abroad to develop into a ' ro ##ving en ##qui ##ry ' , but in many jurisdictions it is not essential to name in advance all the witnesses to be examined .

reference_raw: Courts will not allow the taking of evidence abroad to develop into a 'roving investigation' , but in many jurisdictions it is not necessary to name all witnesses to be heard in advance.

reference_spacy_tokens: Courts will not allow the taking of evidence abroad to develop into a ' roving investigation ' , but in many jurisdictions it is not necessary to name all witnesses to be heard in advance .


fn_spacy_tokens_for_baseline: Who is the masked avenger ?

source_bert_toks: who is the masked avenge ##r ?

reference_raw: Who's the masked revenger?

reference_spacy_tokens: Who 's the masked revenger ?


fn_spacy_tokens_for_baseline: The more important contribution of large firms in terms of investment or technical change was evident , but large and small firms alike shared in the remarkable growth of output .

source_bert_toks: the more important contribution of large firms in terms of investment or technical change was evident , but large and small firms alike shared in the remarkable growth of output .

reference_raw: The more important contribution of large companies in terms of investment or technical change has been evident, but large and small companies share a remarkable increase in production.

reference_spacy_tokens: The more important contribution of large companies in terms of investment or technical change has been evident , but large and small companies share a remarkable increase in production .


fn_spacy_tokens_for_baseline: Away from the defence debate Dr Mowlam also yesterday spoke of her despair at the growing homeless problem in her constituency .

source_bert_toks: away from the defence debate dr mo ##wl ##am also yesterday spoke of her despair at the growing homeless problem in her constituency .

reference_raw: Away from the defensive debate, Dr. Mowlam had also said yesterday that she was desperate for the growing homeless problem in her constituency.

reference_spacy_tokens: Away from the defensive debate , Dr. Mowlam had also said yesterday that she was desperate for the growing homeless problem in her constituency .


fn_spacy_tokens_for_baseline: ' I know there was speculation that my career was over , but at 29 I am sure I can play in the 1995 World Cup . '

source_bert_toks: ' i know there was speculation that my career was over , but at 29 i am sure i can play in the 1995 world cup . '

reference_raw: "I know I've been speculating that my career is over, but I can certainly play in the 1995 World Cup by the time I'm 29."

reference_spacy_tokens: " I know I 've been speculating that my career is over , but I can certainly play in the 1995 World Cup by the time I 'm 29 . "


fn_spacy_tokens_for_baseline: Christmas in the music business brings a retrospective look at the best and worst moments of the preceding year .

source_bert_toks: christmas in the music business brings a retrospective look at the best and worst moments of the preceding year .

reference_raw: Christmas in the music industry brings back the best and worst moments of the previous year.

reference_spacy_tokens: Christmas in the music industry brings back the best and worst moments of the previous year .


fn_spacy_tokens_for_baseline: Mrs Alderley looked quite crestfallen all of a sudden .

source_bert_toks: mrs al ##der ##ley looked quite crest ##fall ##en all of a sudden .

reference_raw: Ms. Alderley suddenly looked upright.

reference_spacy_tokens: Ms. Alderley suddenly looked upright .


fn_spacy_tokens_for_baseline: Finally , pupils who perceive that they are unlikely to be selected for anything which is valued may become disheartened and fail to fulfil their potential .

source_bert_toks: finally , pupils who perceive that they are unlikely to be selected for anything which is valued may become dish ##ear ##ten ##ed and fail to fu ##lf ##il their potential .

reference_raw: Finally, pupils who perceive that they are not likely to be chosen for something that is valuable can be dissented and fail to fulfil their potential.

reference_spacy_tokens: Finally , pupils who perceive that they are not likely to be chosen for something that is valuable can be dissented and fail to fulfil their potential .


fn_spacy_tokens_for_baseline: To be honest I 'm beginning to get fed up with being so useless and just wish that ' Failure ' was n't my middle name .

source_bert_toks: to be honest i ' m beginning to get fed up with being so useless and just wish that ' failure ' wasn ' t my middle name .

reference_raw: To tell you the truth, I'm starting to get tired of being so useless, and I just wish "failure" wasn't my first name.

reference_spacy_tokens: To tell you the truth , I 'm starting to get tired of being so useless , and I just wish " failure " was n't my first name .


fn_spacy_tokens_for_baseline: THE US is planning to ship bomb - grade uranium to Romania despite fears that it may be working on a nuclear weapons programme .

source_bert_toks: the us is planning to ship bomb - grade uranium to romania despite fears that it may be working on a nuclear weapons programme .

reference_raw: The US plans to send bomb-grade uranium to Romania, despite fears that it may be working on a nuclear-weapon program.

reference_spacy_tokens: The US plans to send bomb - grade uranium to Romania , despite fears that it may be working on a nuclear - weapon program .


fn_spacy_tokens_for_baseline: Successive state elections have seen the governing parties pummelled by a dismayed electorate .

source_bert_toks: successive state elections have seen the governing parties pu ##mmel ##led by a dismay ##ed electorate .

reference_raw: The successive elections of the state saw the governing parties pummeled by a horrified voter.

reference_spacy_tokens: The successive elections of the state saw the governing parties pummeled by a horrified voter .


fn_spacy_tokens_for_baseline: Remember as well that a hardwood frame is much more robust than a softwood equivalent .

source_bert_toks: remember as well that a hardwood frame is much more robust than a soft ##wood equivalent .

reference_raw: Remember, the hardwood frame is much stronger than the softwood equivalent.

reference_spacy_tokens: Remember , the hardwood frame is much stronger than the softwood equivalent .


fn_spacy_tokens_for_baseline: It was largely due to his efforts , backed up by our management , Secretary and Principals at HQ that the Treasury was finally persuaded to sanction the necessary £ 4,500,000 to finance the expansion programme .

source_bert_toks: it was largely due to his efforts , backed up by our management , secretary and principals at hq that the treasury was finally persuaded to san ##ction the necessary £ ##4 , 500 , 000 to finance the expansion programme .

reference_raw: Mostly because of his efforts, supported by our management, secretary and directors at headquarters, the Treasury has finally been persuaded to approve the necessary £4,500,000 to finance the expansion program.

reference_spacy_tokens: Mostly because of his efforts , supported by our management , secretary and directors at headquarters , the Treasury has finally been persuaded to approve the necessary £ 4,500,000 to finance the expansion program .


fn_spacy_tokens_for_baseline: I 'm so bored !

source_bert_toks: i ' m so bored !

reference_raw: I'm tired of this!

reference_spacy_tokens: I 'm tired of this !


fn_spacy_tokens_for_baseline: I was tied into a sleeping bag and hung upside down from a tree overnight .

source_bert_toks: i was tied into a sleeping bag and hung upside down from a tree overnight .

reference_raw: They put me in a sleeping bag and hung me upside down from a tree for the night.

reference_spacy_tokens: They put me in a sleeping bag and hung me upside down from a tree for the night .


fn_spacy_tokens_for_baseline: First , they were treating babies as adults , that is to say , by a direct attack on the origin of disease with no distraction being permitted to treat symptoms .

source_bert_toks: first , they were treating babies as adults , that is to say , by a direct attack on the origin of disease with no distraction being permitted to treat symptoms .

reference_raw: In the first place, the children were dealt with as adults, i.e. by a direct attack on the origin of the disease, without any distraction being allowed for the treatment of symptoms.

reference_spacy_tokens: In the first place , the children were dealt with as adults , i.e. by a direct attack on the origin of the disease , without any distraction being allowed for the treatment of symptoms .


fn_spacy_tokens_for_baseline: And it is a good thing that someone sensible should be doing so for the subject has got into the hands of theorists of the most tiresome sort .

source_bert_toks: and it is a good thing that someone sensible should be doing so for the subject has got into the hands of theorists of the most tires ##ome sort .

reference_raw: And it's a good thing someone reasonable should do it because the subject is in the hands of the most tedious theorists.

reference_spacy_tokens: And it 's a good thing someone reasonable should do it because the subject is in the hands of the most tedious theorists .


fn_spacy_tokens_for_baseline: My father overheard and , without consulting me or waiting to hear my reply , forbade him the house .

source_bert_toks: my father overheard and , without consulting me or waiting to hear my reply , forbade him the house .

reference_raw: My father heard me and, without consulting me or waiting for my answer, forbidded him to come home.

reference_spacy_tokens: My father heard me and , without consulting me or waiting for my answer , forbidded him to come home .


fn_spacy_tokens_for_baseline: He was backing away as he whined his protest .

source_bert_toks: he was backing away as he w ##hine ##d his protest .

reference_raw: When he moaned his protest, he backed away.

reference_spacy_tokens: When he moaned his protest , he backed away .


fn_spacy_tokens_for_baseline: Parmedes concurred with feeling .

source_bert_toks: par ##med ##es con ##cu ##rred with feeling .

reference_raw: Parmedes agrees with his feelings.

reference_spacy_tokens: Parmedes agrees with his feelings .


fn_spacy_tokens_for_baseline: Libya currently has only a primitive capability to refuel such aircraft in mid - air , although it could potentially strike at Israel .

source_bert_toks: libya currently has only a primitive capability to ref ##uel such aircraft in mid - air , although it could potentially strike at israel .

reference_raw: Libya currently has only a primitive capacity to refuel such aircraft in the air, even if it could potentially attack Israel.

reference_spacy_tokens: Libya currently has only a primitive capacity to refuel such aircraft in the air , even if it could potentially attack Israel .


fn_spacy_tokens_for_baseline: Our daily bread is concocted by chemists who do not sleep easy at night .

source_bert_toks: our daily bread is con ##co ##cted by chemist ##s who do not sleep easy at night .

reference_raw: Our daily bread is made up by chemists who don't sleep easily at night.

reference_spacy_tokens: Our daily bread is made up by chemists who do n't sleep easily at night .


fn_spacy_tokens_for_baseline: When she finally slept , tear - stained , he felt no relief , only an enormous exhaustion .

source_bert_toks: when she finally slept , tear - stained , he felt no relief , only an enormous exhaustion .

reference_raw: When she finally fell asleep, tear-stained, he felt no relief, only a great depletion.

reference_spacy_tokens: When she finally fell asleep , tear - stained , he felt no relief , only a great depletion .


fn_spacy_tokens_for_baseline: That 's your bed on the left and you can have the two bottom drawers of the chest . '

source_bert_toks: that ' s your bed on the left and you can have the two bottom drawers of the chest . '

reference_raw: That's your bed on the left, and you can have two lower chest drawers.'

reference_spacy_tokens: That 's your bed on the left , and you can have two lower chest drawers . '


fn_spacy_tokens_for_baseline: Sparks showered out of the ruptured system .

source_bert_toks: sparks showered out of the ru ##pt ##ured system .

reference_raw: Sparks sprayed from the ruptured system.

reference_spacy_tokens: Sparks sprayed from the ruptured system .


fn_spacy_tokens_for_baseline: Creed dumped his half - smoked cigarette into the toilet bowl and took off his sweatshirt .

source_bert_toks: creed dumped his half - smoked cigarette into the toilet bowl and took off his sweatshirt .

reference_raw: Creed dumped his smoked cigarette in the toilet bowl and took off his shirt.

reference_spacy_tokens: Creed dumped his smoked cigarette in the toilet bowl and took off his shirt .


fn_spacy_tokens_for_baseline: By 1920 , trade union membership reached its inter - war peak of about 8 million .

source_bert_toks: by 1920 , trade union membership reached its inter - war peak of about 8 million .

reference_raw: By 1920, members of the union reached an inter-war peak of about 8 million.

reference_spacy_tokens: By 1920 , members of the union reached an inter - war peak of about 8 million .


fn_spacy_tokens_for_baseline: There are many guided bus tours to sights outside the city , and some are accessible by city bus .

source_bert_toks: there are many guided bus tours to sights outside the city , and some are accessible by city bus .

reference_raw: There are many tours of the bus to the outskirts of the city, and some of them are available on the city bus.

reference_spacy_tokens: There are many tours of the bus to the outskirts of the city , and some of them are available on the city bus .


fn_spacy_tokens_for_baseline: Not bothering to conceal a smirk of satisfaction , he announced , ' We 're going to have to let the bugger go . '

source_bert_toks: not bothering to conceal a smirk of satisfaction , he announced , ' we ' re going to have to let the bug ##ger go . '

reference_raw: He didn't bother to hide a smile of satisfaction and said, "We'll have to let the bastard go."

reference_spacy_tokens: He did n't bother to hide a smile of satisfaction and said , " We 'll have to let the bastard go . "


fn_spacy_tokens_for_baseline: Many university professors were paid less than labourers in the eighteenth century ; if not clerics , they were forced , as were academics throughout the nineteenth century , to seek outside work to gain a living .

source_bert_toks: many university professors were paid less than labourers in the eighteenth century ; if not cleric ##s , they were forced , as were academics throughout the nineteenth century , to seek outside work to gain a living .

reference_raw: In the eighteenth century, many university teachers were paid less than workers; if not priests, they were forced, like academics in the nineteenth century, to seek outside work for a living.

reference_spacy_tokens: In the eighteenth century , many university teachers were paid less than workers ; if not priests , they were forced , like academics in the nineteenth century , to seek outside work for a living .


fn_spacy_tokens_for_baseline: Censored values included patients alive at the last data collection and patients lost to follow - up .

source_bert_toks: ce ##nsor ##ed values included patients alive at the last data collection and patients lost to follow - up .

reference_raw: The censored values included patients who were still alive at the last collection of data and patients who disappeared to follow-up.

reference_spacy_tokens: The censored values included patients who were still alive at the last collection of data and patients who disappeared to follow - up .


fn_spacy_tokens_for_baseline: Calumny was inevitable , though Shelley seems to have been chiefly interested in working the feelings of a lively adolescent up to febrile hysteria .

source_bert_toks: cal ##um ##ny was inevitable , though shelley seems to have been chiefly interested in working the feelings of a lively adolescent up to feb ##ril ##e hysteria .

reference_raw: Calumny was inevitable, though Shelley seemed most interested in working on the emotions of a living adolescence to feverish hysteria.

reference_spacy_tokens: Calumny was inevitable , though Shelley seemed most interested in working on the emotions of a living adolescence to feverish hysteria .


fn_spacy_tokens_for_baseline: All parties have agreed that they seek a non - nuclear Korean peninsula , but it remains unclear how this objective will be achieved .

source_bert_toks: all parties have agreed that they seek a non - nuclear korean peninsula , but it remains unclear how this objective will be achieved .

reference_raw: All parties accepted that they were looking for a non-nuclear Korean peninsula, but it is not clear how this objective would be achieved.

reference_spacy_tokens: All parties accepted that they were looking for a non - nuclear Korean peninsula , but it is not clear how this objective would be achieved .


fn_spacy_tokens_for_baseline: It is easy to see , then , that with a good brushing method you can clear up this condition and prevent gum disease .

source_bert_toks: it is easy to see , then , that with a good brushing method you can clear up this condition and prevent gum disease .

reference_raw: So it's easy to see that with a good brushing method, you can clean up this condition and prevent gum disease.

reference_spacy_tokens: So it 's easy to see that with a good brushing method , you can clean up this condition and prevent gum disease .


fn_spacy_tokens_for_baseline: I did not commence my research with these questions firmly in mind .

source_bert_toks: i did not commence my research with these questions firmly in mind .

reference_raw: I didn't start my research with those questions on my mind.

reference_spacy_tokens: I did n't start my research with those questions on my mind .


fn_spacy_tokens_for_baseline: ' It is not who governs , ' contends Hayek , ' but what government is entitled to do that seems to me the essential problem . '

source_bert_toks: ' it is not who govern ##s , ' contend ##s hay ##ek , ' but what government is entitled to do that seems to me the essential problem . '

reference_raw: 'It's not who rules,' says Hayek, 'but what government has the right to do seems to me to be a major problem.'

reference_spacy_tokens: ' It 's not who rules , ' says Hayek , ' but what government has the right to do seems to me to be a major problem . '


fn_spacy_tokens_for_baseline: Bonus payments would be handed out for pushing up voting levels .

source_bert_toks: bonus payments would be handed out for pushing up voting levels .

reference_raw: Bonus payments would be made to increase the level of voting.

reference_spacy_tokens: Bonus payments would be made to increase the level of voting .


fn_spacy_tokens_for_baseline: In other words , a degree of annexation which in earlier times the law would have treated as conclusive may now prove nothing .

source_bert_toks: in other words , a degree of annexation which in earlier times the law would have treated as con ##clusive may now prove nothing .

reference_raw: In other words, the degree of annexation that the law would have considered conclusive in the past can now prove nothing.

reference_spacy_tokens: In other words , the degree of annexation that the law would have considered conclusive in the past can now prove nothing .


fn_spacy_tokens_for_baseline: He awoke early after a disturbed sleep .

source_bert_toks: he awoke early after a disturbed sleep .

reference_raw: He woke early after a disturbed sleep.

reference_spacy_tokens: He woke early after a disturbed sleep .


fn_spacy_tokens_for_baseline: We spent hours mulling over maps and descriptions of countries .

source_bert_toks: we spent hours mu ##lling over maps and descriptions of countries .

reference_raw: We spent hours pondering maps and country descriptions.

reference_spacy_tokens: We spent hours pondering maps and country descriptions .


fn_spacy_tokens_for_baseline: The firm exports 85 per cent of its products and 40 per cent to customers manufacturing for Marks & Spencer .

source_bert_toks: the firm exports 85 per cent of its products and 40 per cent to customers manufacturing for marks & spencer .

reference_raw: The company sells 85 % of its products and 40 % of its products to Marks & Spencer's customers.

reference_spacy_tokens: The company sells 85 % of its products and 40 % of its products to Marks & Spencer 's customers .


fn_spacy_tokens_for_baseline: The telephone purred on the coffee table .

source_bert_toks: the telephone pu ##rred on the coffee table .

reference_raw: The phone buzzed on the coffee table.

reference_spacy_tokens: The phone buzzed on the coffee table .


fn_spacy_tokens_for_baseline: In Scotland , the ordinary degree has an honourable history and a recognized status , but it is still not honours ; and in the rest of the country , ordinary degrees are often perceived as second - rate qualifications .

source_bert_toks: in scotland , the ordinary degree has an honourable history and a recognized status , but it is still not honours ; and in the rest of the country , ordinary degrees are often perceived as second - rate qualifications .

reference_raw: In Scotland, a standard degree has an honorable history and a recognised status, but it is still not an honor; and in the rest of the country, ordinary diplomas are often perceived as second-class qualifications.

reference_spacy_tokens: In Scotland , a standard degree has an honorable history and a recognised status , but it is still not an honor ; and in the rest of the country , ordinary diplomas are often perceived as second - class qualifications .


fn_spacy_tokens_for_baseline: ' Probably that impudent squire of his , ' agreed Ellen , a scowl marring her usually placid features .

source_bert_toks: ' probably that imp ##ude ##nt squire of his , ' agreed ellen , a scowl mar ##ring her usually pl ##ac ##id features .

reference_raw: 'Probably his insolent squire,' said Ellen, frowning at her usually calm features.

reference_spacy_tokens: ' Probably his insolent squire , ' said Ellen , frowning at her usually calm features .


fn_spacy_tokens_for_baseline: Steven was always difficult , he bought every kitchen gadget and electrical device known to man , and he already had enough leather gloves , ties and scarves to restock Marks and Spencer .

source_bert_toks: steven was always difficult , he bought every kitchen ga ##dget and electrical device known to man , and he already had enough leather gloves , ties and scar ##ves to rest ##ock marks and spencer .

reference_raw: Steven had always been difficult, buying all the kitchen equipment and electrical equipment known to man, and he'd already had enough leather gloves, ties, and scarves to put Marks and Spencer back together.

reference_spacy_tokens: Steven had always been difficult , buying all the kitchen equipment and electrical equipment known to man , and he 'd already had enough leather gloves , ties , and scarves to put Marks and Spencer back together .


fn_spacy_tokens_for_baseline: You can take a tour of the port in one of the small sampans , propelled by hand by women drivers .

source_bert_toks: you can take a tour of the port in one of the small sam ##pan ##s , propelled by hand by women drivers .

reference_raw: In one of the little sampans, propelled by the women's drivers, you may take a tour of the harbor.

reference_spacy_tokens: In one of the little sampans , propelled by the women 's drivers , you may take a tour of the harbor .


fn_spacy_tokens_for_baseline: They inevitably knock on the door on the one evening of the month when you 're dolled up in your glad rags to go out on the town .

source_bert_toks: they inevitably knock on the door on the one evening of the month when you ' re doll ##ed up in your glad rags to go out on the town .

reference_raw: They inevitably knock on the door on the night of the month when you're dolled up in your happy clothes to go out into the city.

reference_spacy_tokens: They inevitably knock on the door on the night of the month when you 're dolled up in your happy clothes to go out into the city .


fn_spacy_tokens_for_baseline: He says : ' Was this flame kindled at the altar of the Lord ? ' and she answers : ' This flame was kindled at the holy fire . '

source_bert_toks: he says : ' was this flame kind ##led at the altar of the lord ? ' and she answers : ' this flame was kind ##led at the holy fire . '

reference_raw: He says, "Was the flame at the altar of God kinded?" and she says, "This flame has been kinded by the holy fire."

reference_spacy_tokens: He says , " Was the flame at the altar of God kinded ? " and she says , " This flame has been kinded by the holy fire . "


fn_spacy_tokens_for_baseline: Jerry splutters mild protestations .

source_bert_toks: jerry sp ##lu ##tters mild protest ##ations .

reference_raw: Jerry spits out mild protests.

reference_spacy_tokens: Jerry spits out mild protests .


fn_spacy_tokens_for_baseline: ' Well , I bicycled round Siena with a gun in the basket on my handlebars , underneath my exercise books and Petrarch 's sonnets .

source_bert_toks: ' well , i bicycle ##d round siena with a gun in the basket on my handle ##bar ##s , underneath my exercise books and petra ##rch ' s son ##nets .

reference_raw: 'Well, I wheeled around Siena with a gun in a basket on the handlebars, under the exercise books and Petrarch's sonnets.

reference_spacy_tokens: ' Well , I wheeled around Siena with a gun in a basket on the handlebars , under the exercise books and Petrarch 's sonnets .


fn_spacy_tokens_for_baseline: The Bill provides no support for the genuine refugee or assistance with the resettlement of refugees here .

source_bert_toks: the bill provides no support for the genuine refugee or assistance with the reset ##tlement of refugees here .

reference_raw: The Bill does not provide support for a real refugee or assistance in resettlement.

reference_spacy_tokens: The Bill does not provide support for a real refugee or assistance in resettlement .


fn_spacy_tokens_for_baseline: Mrs Blackham was buttering more buns .

source_bert_toks: mrs black ##ham was butter ##ing more bun ##s .

reference_raw: Mrs. Blackham boiled more buns.

reference_spacy_tokens: Mrs. Blackham boiled more buns .


fn_spacy_tokens_for_baseline: I demand that this man gets a major deal now .

source_bert_toks: i demand that this man gets a major deal now .

reference_raw: I'm asking this man to get a big deal right now.

reference_spacy_tokens: I 'm asking this man to get a big deal right now .


fn_spacy_tokens_for_baseline: Foreign nationals found guilty of serious crimes sometimes manage to escape deportation if they face a grim fate back home .

source_bert_toks: foreign nationals found guilty of serious crimes sometimes manage to escape deportation if they face a grim fate back home .

reference_raw: Foreign nationals found guilty of serious crimes sometimes manage to avoid being deported when faced with the grim fate of their homes.

reference_spacy_tokens: Foreign nationals found guilty of serious crimes sometimes manage to avoid being deported when faced with the grim fate of their homes .


fn_spacy_tokens_for_baseline: 's Shirley Hemphill ; the Star on the " sad , last days " of Ellen Corby of The Waltons ; or the Star on the " sad , tormented life " of the late Dana Plato .

source_bert_toks: ' s shirley hem ##phi ##ll ; the star on the " sad , last days " of ellen co ##rb ##y of the walton ##s ; or the star on the " sad , tormented life " of the late dana plato .

reference_raw: 's Shirley Hemphill; a star on Ellen Corby of the Waltons's "sad, last days"; or a star on the "sad, tortured life" of the deceased Dana Plato.

reference_spacy_tokens: 's Shirley Hemphill ; a star on Ellen Corby of the Waltons 's " sad , last days " ; or a star on the " sad , tortured life " of the deceased Dana Plato .


fn_spacy_tokens_for_baseline: Consider a series of studies that examined length of maternity leave in relation to employed mothers psychological well - being and parenting behaviors .

source_bert_toks: consider a series of studies that examined length of maternity leave in relation to employed mothers psychological well - being and parenting behaviors .

reference_raw: Consider a number of studies which looked at the length of maternity holidays in relation to the psychological well-being of employed mothers and the behaviour of parents.

reference_spacy_tokens: Consider a number of studies which looked at the length of maternity holidays in relation to the psychological well - being of employed mothers and the behaviour of parents .


fn_spacy_tokens_for_baseline: We feel this will be significant for us as we have not as yet really ' advertised ' the Centre because we felt we had no real permanence of venue .

source_bert_toks: we feel this will be significant for us as we have not as yet really ' advertised ' the centre because we felt we had no real per ##man ##ence of venue .

reference_raw: We feel that this is going to be important to us because we haven't really "advertised" the Centre yet, because we felt that we didn't have a real permanent location.

reference_spacy_tokens: We feel that this is going to be important to us because we have n't really " advertised " the Centre yet , because we felt that we did n't have a real permanent location .


fn_spacy_tokens_for_baseline: Among the earliest souvenirs to be hawked to the victorious Allied troops who marched into Beirut on 8 October 1917 was a horrific picture postcard , old copies of which can still be found in the antiquarian bookshop that sells the David Roberts lithographs on Makhoul Street .

source_bert_toks: among the earliest so ##uven ##irs to be hawke ##d to the victorious allied troops who marched into beirut on 8 october 1917 was a horrific picture post ##card , old copies of which can still be found in the anti ##qua ##rian books ##hop that sells the david roberts lit ##hog ##raph ##s on ma ##kh ##ou ##l street .

reference_raw: One of the first souvenirs to be hawked by the winning Allied soldiers who marched to Beirut on October 8, 1917 was a ghastly picture postcard, the old copies of which are still in the antiquarian bookstore that sells the lithographs of David Roberts on Makhoul Street.

reference_spacy_tokens: One of the first souvenirs to be hawked by the winning Allied soldiers who marched to Beirut on October 8 , 1917 was a ghastly picture postcard , the old copies of which are still in the antiquarian bookstore that sells the lithographs of David Roberts on Makhoul Street .


fn_spacy_tokens_for_baseline: Guildsmen versed in all the Mystery plays from the Creation of the World to Doomsday clamoured to travel with Garvey .

source_bert_toks: guild ##sm ##en verse ##d in all the mystery plays from the creation of the world to doom ##sd ##ay cl ##amo ##ured to travel with ga ##r ##vey .

reference_raw: In all the Mystery Games from the Creation of the World to Doomsday, the Guildsmen chanted to travel with Garvey.

reference_spacy_tokens: In all the Mystery Games from the Creation of the World to Doomsday , the Guildsmen chanted to travel with Garvey .


fn_spacy_tokens_for_baseline: Like Beckett 's trilogy , though in much lighter vein , At Swim - Two - Birds thus becomes a story about a man telling a story about storytelling .

source_bert_toks: like beckett ' s trilogy , though in much lighter vein , at swim - two - birds thus becomes a story about a man telling a story about storytelling .

reference_raw: Like Beckett's trilogy, though in a much lighter way, at Swim-Two-Birds, it becomes the story of a man who speaks the story of storytelling.

reference_spacy_tokens: Like Beckett 's trilogy , though in a much lighter way , at Swim - Two - Birds , it becomes the story of a man who speaks the story of storytelling .


fn_spacy_tokens_for_baseline: Thus relieving them of the terrible necessity of having to intervene directly .

source_bert_toks: thus re ##lie ##ving them of the terrible necessity of having to intervene directly .

reference_raw: Relieving them of the terrible need to intervene directly.

reference_spacy_tokens: Relieving them of the terrible need to intervene directly .


fn_spacy_tokens_for_baseline: He sat at the desk , his head hanging forward on his chest , taking quick drags on his cigarette .

source_bert_toks: he sat at the desk , his head hanging forward on his chest , taking quick drag ##s on his cigarette .

reference_raw: He sat at the table, his head bent over his chest, and took a quick pull on his cigarette.

reference_spacy_tokens: He sat at the table , his head bent over his chest , and took a quick pull on his cigarette .


fn_spacy_tokens_for_baseline: The Sainsbury 's Lifestyle range of textiles went from strength to strength as the new team of specialist buyers and technologists introduced more quality items such as children 's footwear and men 's knitwear .

source_bert_toks: the sai ##ns ##bury ' s lifestyle range of textiles went from strength to strength as the new team of specialist buyers and techno ##logists introduced more quality items such as children ' s foot ##wear and men ' s knit ##wear .

reference_raw: The range of textiles in Sainsbury went from strength to strength as a new team of specialist buyers and technicians introduced more quality items such as children's shoes and men's knits.

reference_spacy_tokens: The range of textiles in Sainsbury went from strength to strength as a new team of specialist buyers and technicians introduced more quality items such as children 's shoes and men 's knits .


fn_spacy_tokens_for_baseline: ' The river 's part of my manor , but of course it also belongs to the River Police .

source_bert_toks: ' the river ' s part of my manor , but of course it also belongs to the river police .

reference_raw: 'The river is part of my estate, but of course it's part of the River Police.

reference_spacy_tokens: ' The river is part of my estate , but of course it 's part of the River Police .


fn_spacy_tokens_for_baseline: Sinn Fein plans to host a reception for the US visitors before the afternoon talks .

source_bert_toks: sinn fein plans to host a reception for the us visitors before the afternoon talks .

reference_raw: Sinn Fein is planning to host a greeting for U.S. visitors before the afternoon talks.

reference_spacy_tokens: Sinn Fein is planning to host a greeting for U.S. visitors before the afternoon talks .


fn_spacy_tokens_for_baseline: Go for broke , and be undeterred in your search for the possible dream .

source_bert_toks: go for broke , and be und ##eter ##red in your search for the possible dream .

reference_raw: Go for a break, and don't be discouraged in your quest for a possible dream.

reference_spacy_tokens: Go for a break , and do n't be discouraged in your quest for a possible dream .


fn_spacy_tokens_for_baseline: This traffic was the object of UN toleration in spite of being theoretically in contravention of UN sanctions against Iraq .

source_bert_toks: this traffic was the object of un to ##ler ##ation in spite of being theoretically in contra ##vent ##ion of un sanctions against iraq .

reference_raw: This transport was the subject of UN tolerance, although it was theoretically contrary to UN sanctions against Iraq.

reference_spacy_tokens: This transport was the subject of UN tolerance , although it was theoretically contrary to UN sanctions against Iraq .


fn_spacy_tokens_for_baseline: A message from a local party leader was broadcast on Karl Marx Square , calling for dialogue with all groups .

source_bert_toks: a message from a local party leader was broadcast on karl marx square , calling for dialogue with all groups .

reference_raw: A message from the leader of the local party was sent to Karl Marx Square, calling for a debate with all the groups.

reference_spacy_tokens: A message from the leader of the local party was sent to Karl Marx Square , calling for a debate with all the groups .


fn_spacy_tokens_for_baseline: On 9 February , armed men stopped a bus outside Santiago , robbed the passengers , and then opened fire , killing six people .

source_bert_toks: on 9 february , armed men stopped a bus outside santiago , robbed the passengers , and then opened fire , killing six people .

reference_raw: On February 9th, armed men stopped a bus in front of Santiago, raided passengers, then opened fire and killed six people.

reference_spacy_tokens: On February 9th , armed men stopped a bus in front of Santiago , raided passengers , then opened fire and killed six people .


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite start-ups and some food aid, but the potential agreement still lacked the key element to verify that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite start - ups and some food aid , but the potential agreement still lacked the key element to verify that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: However , the other aspect is that if you go to a medical practice you may have four or five doctors to help you out .

source_bert_toks: however , the other aspect is that if you go to a medical practice you may have four or five doctors to help you out .

reference_raw: But the second aspect is that if you go to a doctor's office, you can get four or five doctors to help you.

reference_spacy_tokens: But the second aspect is that if you go to a doctor 's office , you can get four or five doctors to help you .


fn_spacy_tokens_for_baseline: Tavernier , born in Paris and schooled in Lyon , was introduced to literary interests early in his school life .

source_bert_toks: tavern ##ier , born in paris and school ##ed in lyon , was introduced to literary interests early in his school life .

reference_raw: Tavernier, born in Paris and educated in Lyon, was introduced to literary interests at the beginning of his college life.

reference_spacy_tokens: Tavernier , born in Paris and educated in Lyon , was introduced to literary interests at the beginning of his college life .


fn_spacy_tokens_for_baseline: Well maybe he did tweak it .

source_bert_toks: well maybe he did t ##we ##ak it .

reference_raw: Well, maybe he's softened it.

reference_spacy_tokens: Well , maybe he 's softened it .


fn_spacy_tokens_for_baseline: The oldest bell - ringing group in the country , the Ancient Society of College Youths , founded in 1637 , remains male - only , a fact that 's particularly galling to women because the group is the sole source of ringers for Britain 's most prestigious churches , St. Paul 's Cathedral and Westminster Abbey .

source_bert_toks: the oldest bell - ringing group in the country , the ancient society of college youths , founded in 163 ##7 , remains male - only , a fact that ' s particularly gall ##ing to women because the group is the sole source of ring ##ers for britain ' s most prestigious churches , st . paul ' s cathedral and westminster abbey .

reference_raw: The oldest ringing group in the country, the ancient College Youth Society, founded in 1637, remains male only, which is particularly galling to women, since it is the only source of ringers for the most prestigious churches in Britain, Saint Paul's cathedral and Westminster Abbey.

reference_spacy_tokens: The oldest ringing group in the country , the ancient College Youth Society , founded in 1637 , remains male only , which is particularly galling to women , since it is the only source of ringers for the most prestigious churches in Britain , Saint Paul 's cathedral and Westminster Abbey .


fn_spacy_tokens_for_baseline: However , the US is concerned with the indirect assistance Iran could receive and is concerned that it is probably covertly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

source_bert_toks: however , the us is concerned with the indirect assistance iran could receive and is concerned that it is probably covert ##ly seeking the construction of uranium conversion and enrichment facilities , other technical know - how , and technicians .

reference_raw: However, the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium transformation and enrichment facilities, other technical know-how and technicians.

reference_spacy_tokens: However , the US is concerned about the indirect assistance that Iran might receive and is concerned that it is likely to covertly seek to build uranium transformation and enrichment facilities , other technical know - how and technicians .


fn_spacy_tokens_for_baseline: Truck drivers hooted , children stared , and just about everyone laughed or waved .

source_bert_toks: truck drivers ho ##oted , children stared , and just about everyone laughed or waved .

reference_raw: The truck drivers roared, the children stared, and around them all laughed or waved.

reference_spacy_tokens: The truck drivers roared , the children stared , and around them all laughed or waved .


fn_spacy_tokens_for_baseline: I swear that he might have twisted it off had I understood what it would mean to Garcia .

source_bert_toks: i swear that he might have twisted it off had i understood what it would mean to garcia .

reference_raw: I swear he could've turned it off if I knew what it was for Garcia.

reference_spacy_tokens: I swear he could 've turned it off if I knew what it was for Garcia .


fn_spacy_tokens_for_baseline: Some began to hurl stones .

source_bert_toks: some began to hu ##rl stones .

reference_raw: Some began throwing stones.

reference_spacy_tokens: Some began throwing stones .


fn_spacy_tokens_for_baseline: Peel the avocados , cut them in half lengthways and remove the stones .

source_bert_toks: peel the av ##oca ##dos , cut them in half length ##ways and remove the stones .

reference_raw: Pierce the avocados, cut them in half, and remove the stones.

reference_spacy_tokens: Pierce the avocados , cut them in half , and remove the stones .


fn_spacy_tokens_for_baseline: Whatever the setting , the counsellor should stress that alcoholism is a curable condition , particularly when the social distress underlying the need for alcohol is openly discussed and the problems tackled .

source_bert_toks: whatever the setting , the counsel ##lor should stress that alcoholism is a cu ##rable condition , particularly when the social distress underlying the need for alcohol is openly discussed and the problems tackled .

reference_raw: Irrespective of the situation, the adviser should stress that alcoholism is a treatable condition, especially when the social difficulties underlying the need for alcohol are openly discussed and the problems addressed.

reference_spacy_tokens: Irrespective of the situation , the adviser should stress that alcoholism is a treatable condition , especially when the social difficulties underlying the need for alcohol are openly discussed and the problems addressed .


fn_spacy_tokens_for_baseline: Free access to holy sites for members of all religions was guaranteed by the armistice agreements .

source_bert_toks: free access to holy sites for members of all religions was guaranteed by the armistice agreements .

reference_raw: Freedom of access for members of all religions to sacred sites was guaranteed by the cease-fire agreements.

reference_spacy_tokens: Freedom of access for members of all religions to sacred sites was guaranteed by the cease - fire agreements .


fn_spacy_tokens_for_baseline: The stout man ran into the cottage and phoned for the police and then for other keepers to come to Smiling Meadow .

source_bert_toks: the stout man ran into the cottage and phone ##d for the police and then for other keepers to come to smiling meadow .

reference_raw: The big man ran into the cabin and called for the police, then for the other guards to come to Smiling Meadow.

reference_spacy_tokens: The big man ran into the cabin and called for the police , then for the other guards to come to Smiling Meadow .


fn_spacy_tokens_for_baseline: The result was that the Seayak went for an unscheduled underwater swim round campsite bay .

source_bert_toks: the result was that the sea ##ya ##k went for an un ##sche ##du ##led underwater swim round camps ##ite bay .

reference_raw: As a result, the Seayak made an unscheduled underwater voyage around the encampment bay.

reference_spacy_tokens: As a result , the Seayak made an unscheduled underwater voyage around the encampment bay .


fn_spacy_tokens_for_baseline: Although success rates as high as 90 % have been claimed by others for placing post - pyloric feeding tubes at the bedside [ 30 31 32 ] , most studies report a success rate of 15 - 30 % [ 33 34 35 36]. Success with bedside placement of small bowel feeding tubes is influenced by the technique and degree of expertise of the clinician .

source_bert_toks: although success rates as high as 90 % have been claimed by others for placing post - p ##yl ##oric feeding tubes at the bedside [ 30 31 32 ] , most studies report a success rate of 15 - 30 % [ 33 34 35 36 ] . success with bedside placement of small bow ##el feeding tubes is influenced by the technique and degree of expertise of the clinic ##ian .

reference_raw: While others have claimed a successful rate of up to 90% for posting - pyloric feed pipes on the side of the bed [30 31 32], most studies show a successful rate of 15-30% [33 34 35 36]. The successful placement of small bowel pipes is influenced by the technique and the degree of expertise of the clinician.

reference_spacy_tokens: While others have claimed a successful rate of up to 90 % for posting - pyloric feed pipes on the side of the bed [ 30 31 32 ] , most studies show a successful rate of 15 - 30 % [ 33 34 35 36]. The successful placement of small bowel pipes is influenced by the technique and the degree of expertise of the clinician .


fn_spacy_tokens_for_baseline: Paula_Zahn : Speeding up production of vaccines and buying the anti - viral drugs ( ( Tamoflu ) ) and ( ( Rolenzo ) ) which in some cases prevent flu infection .

source_bert_toks: paula _ za ##hn : speeding up production of vaccines and buying the anti - viral drugs ( ( tam ##of ##lu ) ) and ( ( role ##nzo ) ) which in some cases prevent flu infection .

reference_raw: Paula_Zahn: Accelerating the production of vaccines and the purchase of antiviral medicines (Tamoflu) and (Rolenzo) which in some cases prevent influenza infection.

reference_spacy_tokens: Paula_Zahn : Accelerating the production of vaccines and the purchase of antiviral medicines ( Tamoflu ) and ( Rolenzo ) which in some cases prevent influenza infection .


fn_spacy_tokens_for_baseline: DAINTYFIT is a major employer in the North West , employing more than 500 people at its Limavady site in the manufacturing of bras for Marks & Spencer .

source_bert_toks: dai ##nty ##fi ##t is a major employer in the north west , employing more than 500 people at its lima ##va ##dy site in the manufacturing of bra ##s for marks & spencer .

reference_raw: DAINTYFIT is the main employer in the Northwest and employs more than 500 people in the production of Marks & Spencer bras at its Limavady site.

reference_spacy_tokens: DAINTYFIT is the main employer in the Northwest and employs more than 500 people in the production of Marks & Spencer bras at its Limavady site .


fn_spacy_tokens_for_baseline: It was even hotter than she expected , and she gave an involuntary yelp .

source_bert_toks: it was even hotter than she expected , and she gave an involuntary ye ##lp .

reference_raw: It was even hotter than she had expected, and she screamed involuntarily.

reference_spacy_tokens: It was even hotter than she had expected , and she screamed involuntarily .


fn_spacy_tokens_for_baseline: I reminded her that , since she would be doing this under hypnosis , it was still possible to use the detachment technique if I thought she was becoming distressed in any way .

source_bert_toks: i reminded her that , since she would be doing this under h ##yp ##nosis , it was still possible to use the detachment technique if i thought she was becoming distressed in any way .

reference_raw: I reminded her that, since she was going to do it under hypnosis, she could still use the detachment technique if I thought she was getting upset.

reference_spacy_tokens: I reminded her that , since she was going to do it under hypnosis , she could still use the detachment technique if I thought she was getting upset .


fn_spacy_tokens_for_baseline: The answer was always no -- understandably enough , it seemed , in Leverrier 's case , because he was very reserved , ' too serious ' as one master put it , tapping his head .

source_bert_toks: the answer was always no - - understand ##ably enough , it seemed , in lever ##rier ' s case , because he was very reserved , ' too serious ' as one master put it , tapping his head .

reference_raw: The answer was always no - of course, in Leverrier's case, it seemed, for he was very restrained, "too serious," as one of the masters put it, and tapped his head.

reference_spacy_tokens: The answer was always no - of course , in Leverrier 's case , it seemed , for he was very restrained , " too serious , " as one of the masters put it , and tapped his head .


fn_spacy_tokens_for_baseline: Although copies of the sample test were leaked to the Belfast Telegraph immediately following its release , this newspaper in common with others can not print questions from it before June 14 .

source_bert_toks: although copies of the sample test were leaked to the belfast telegraph immediately following its release , this newspaper in common with others can not print questions from it before june 14 .

reference_raw: Although copies of the sample test were released to the Belfast Telegraph immediately after its publication, the newspaper, together with others, cannot print questions from it until June 14th.

reference_spacy_tokens: Although copies of the sample test were released to the Belfast Telegraph immediately after its publication , the newspaper , together with others , can not print questions from it until June 14th .


fn_spacy_tokens_for_baseline: Wynne - Jones , leaning on the arm of a younger man , surveyed the corpses , which had been laid on their side , knees slightly bent , hands covering their faces .

source_bert_toks: wynn ##e - jones , leaning on the arm of a younger man , surveyed the corpses , which had been laid on their side , knees slightly bent , hands covering their faces .

reference_raw: Wynne-Jones, leaning against the younger man's shoulder, looked at the bodies lying on their sides, knees slightly bent, hands covering their faces.

reference_spacy_tokens: Wynne - Jones , leaning against the younger man 's shoulder , looked at the bodies lying on their sides , knees slightly bent , hands covering their faces .


fn_spacy_tokens_for_baseline: On Jan. 30 the JNA once again enraged Croats by ordering the arrest of Croatia 's Defence Minister , Col.-Gen .

source_bert_toks: on jan . 30 the j ##na once again enraged croats by ordering the arrest of croatia ' s defence minister , col . - gen .

reference_raw: On January 30, the JNA once again enraged the Croats by ordering the capture of the Croatian Defense Minister, Colonel-Gen.

reference_spacy_tokens: On January 30 , the JNA once again enraged the Croats by ordering the capture of the Croatian Defense Minister , Colonel - Gen .


fn_spacy_tokens_for_baseline: Thus the author of A Remonstrance of Many Thousand Citizens , probably Richard Overton , reminded the House of Commons in 1646 that ' wee are your Principalls , and you our Agents- . wee possessed you with the same Power that was in our selves .

source_bert_toks: thus the author of a re ##mons ##tra ##nce of many thousand citizens , probably richard over ##ton , reminded the house of commons in 1646 that ' wee are your principal ##ls , and you our agents - . wee possessed you with the same power that was in our se ##lves .

reference_raw: So the author of the Remonstration of Many Thousand Citizens, perhaps Richard Overton, reminded the House of Commons in 1646, that we are your principals, and that you, our agents, possessed you with the same power as ours.

reference_spacy_tokens: So the author of the Remonstration of Many Thousand Citizens , perhaps Richard Overton , reminded the House of Commons in 1646 , that we are your principals , and that you , our agents , possessed you with the same power as ours .


fn_spacy_tokens_for_baseline: Certainly Christians believe that compassion and love are qualities that Jesus possessed .

source_bert_toks: certainly christians believe that compassion and love are qualities that jesus possessed .

reference_raw: I'm sure the Christians think that compassion and love are the qualities that Jesus had.

reference_spacy_tokens: I 'm sure the Christians think that compassion and love are the qualities that Jesus had .


fn_spacy_tokens_for_baseline: Chechen commander Shamil Basayev is said to have trained a force of up to 50 black widows for suicide attacks against Russian targets .

source_bert_toks: che ##chen commander sham ##il bas ##ay ##ev is said to have trained a force of up to 50 black widows for suicide attacks against russian targets .

reference_raw: Chechen commander Shamil Basayev is said to have trained up to 50 black widows to commit suicide on Russian targets.

reference_spacy_tokens: Chechen commander Shamil Basayev is said to have trained up to 50 black widows to commit suicide on Russian targets .


fn_spacy_tokens_for_baseline: The car joined the evening traffic as it swung south - east towards Moscow .

source_bert_toks: the car joined the evening traffic as it swung south - east towards moscow .

reference_raw: As it turned southeast toward Moscow, the car joined the evening traffic.

reference_spacy_tokens: As it turned southeast toward Moscow , the car joined the evening traffic .


fn_spacy_tokens_for_baseline: That evening brought a repentant young husband , flowers and wine , an evening to themselves .

source_bert_toks: that evening brought a rep ##ent ##ant young husband , flowers and wine , an evening to themselves .

reference_raw: That evening brought a penitent young husband, flowers and wine, an evening for himself.

reference_spacy_tokens: That evening brought a penitent young husband , flowers and wine , an evening for himself .


fn_spacy_tokens_for_baseline: Otherwise , they are made from similar grapes , matured in the same sort of oak barrels and aged for just as long before release .

source_bert_toks: otherwise , they are made from similar grapes , mature ##d in the same sort of oak barrels and aged for just as long before release .

reference_raw: Otherwise, they are made from similar grapes, matured in the same type of oak casks and aged just as long before they are released.

reference_spacy_tokens: Otherwise , they are made from similar grapes , matured in the same type of oak casks and aged just as long before they are released .


fn_spacy_tokens_for_baseline: Within three days the city was completely in Israeli hands , and in two weeks it was physically and administratively reunited .

source_bert_toks: within three days the city was completely in israeli hands , and in two weeks it was physically and administratively reunited .

reference_raw: Within three days, the city was fully in Israeli hands, and within a fortnight, it was physically and administratively reunited.

reference_spacy_tokens: Within three days , the city was fully in Israeli hands , and within a fortnight , it was physically and administratively reunited .


fn_spacy_tokens_for_baseline: With a snarl that changed her smiling face into a grimace of pure hatred she threw herself at him , the weapon slashing for his face .

source_bert_toks: with a snarl that changed her smiling face into a grimace of pure hatred she threw herself at him , the weapon slash ##ing for his face .

reference_raw: With a growl that turned her smiling face into a grin of pure hatred, she threw herself at him, the weapon slashing at his face.

reference_spacy_tokens: With a growl that turned her smiling face into a grin of pure hatred , she threw herself at him , the weapon slashing at his face .


fn_spacy_tokens_for_baseline: I wo n't hurt you , but if you come near the boat , I 'll shoot you through the head ! '

source_bert_toks: i won ' t hurt you , but if you come near the boat , i ' ll shoot you through the head ! '

reference_raw: I'm not going to harm you, but if you get close to the ship, I'm going to shoot you in the head!'

reference_spacy_tokens: I 'm not going to harm you , but if you get close to the ship , I 'm going to shoot you in the head ! '


fn_spacy_tokens_for_baseline: Meanwhile , Bosnian Muslims and Croats stopped fighting today in Mostar and will exchange prisoners taken in pitched battles that devastated the ancient city , Croat radio reported .

source_bert_toks: meanwhile , bosnian muslims and croats stopped fighting today in most ##ar and will exchange prisoners taken in pitched battles that devastated the ancient city , cr ##oat radio reported .

reference_raw: In the meantime, Bosnian Muslims and Croatians stopped fighting today in Mostar and will exchange prisoners captured in pitched battles that destroyed the ancient city, Croat radio reported.

reference_spacy_tokens: In the meantime , Bosnian Muslims and Croatians stopped fighting today in Mostar and will exchange prisoners captured in pitched battles that destroyed the ancient city , Croat radio reported .


fn_spacy_tokens_for_baseline: Shaun Campbell surveys the back of the grid for grand prix racing 's biggest failures .

source_bert_toks: shaun campbell surveys the back of the grid for grand prix racing ' s biggest failures .

reference_raw: Shaun Campbell is exploring the back of the grid for the biggest failures of Grand Prix Race.

reference_spacy_tokens: Shaun Campbell is exploring the back of the grid for the biggest failures of Grand Prix Race .


fn_spacy_tokens_for_baseline: Put simply , the retailer must decide whether he is going to opt for ' quality ' or ' quantity ' .

source_bert_toks: put simply , the retailer must decide whether he is going to opt for ' quality ' or ' quantity ' .

reference_raw: In short, the retailer has to decide whether to choose 'quality' or 'quantity'.

reference_spacy_tokens: In short , the retailer has to decide whether to choose ' quality ' or ' quantity ' .


fn_spacy_tokens_for_baseline: But this year , it has finally decided to flower profusely , forming brownish clouds which drift hazily over the bush .

source_bert_toks: but this year , it has finally decided to flower prof ##use ##ly , forming brownish clouds which drift ha ##zily over the bush .

reference_raw: This year, however, he finally decided to blossom profusely, creating a brown cloud that floats hazyly over the bush.

reference_spacy_tokens: This year , however , he finally decided to blossom profusely , creating a brown cloud that floats hazyly over the bush .


fn_spacy_tokens_for_baseline: Four civilians were killed and 15 wounded in four roadside explosions in the western Shiite neighborhood of Bayaa .

source_bert_toks: four civilians were killed and 15 wounded in four roadside explosions in the western shi ##ite neighborhood of bay ##aa .

reference_raw: Four civilians have been killed and 15 injured in four roadside blasts in the western Shiite district of Bayaa.

reference_spacy_tokens: Four civilians have been killed and 15 injured in four roadside blasts in the western Shiite district of Bayaa .


fn_spacy_tokens_for_baseline: He makes sure that Dave Wynters , Stan Parsons and Eileen Tucker are totally conversant with the revenue status , if possible on a daily rather than weekly basis .

source_bert_toks: he makes sure that dave w ##yn ##ters , stan parsons and eileen tucker are totally con ##vers ##ant with the revenue status , if possible on a daily rather than weekly basis .

reference_raw: He ensures that Dave Wynters, Stan Parsons, and Eileen Tucker are in complete conversation with the state of income, if possible every day instead of every week.

reference_spacy_tokens: He ensures that Dave Wynters , Stan Parsons , and Eileen Tucker are in complete conversation with the state of income , if possible every day instead of every week .


fn_spacy_tokens_for_baseline: Who hates big mouths like Stock , Aitken and Waterbucket ?

source_bert_toks: who hates big mouths like stock , ai ##t ##ken and water ##buck ##et ?

reference_raw: Who doesn't like big kisses like Stock, Aitken and Waterbucket?

reference_spacy_tokens: Who does n't like big kisses like Stock , Aitken and Waterbucket ?


fn_spacy_tokens_for_baseline: The words were scarcely out before one of his taller companions clamped a hand round the back of his neck and with a dusty , unshod foot kicked his buttocks , exposed through his torn shorts .

source_bert_toks: the words were scarcely out before one of his taller companions clamped a hand round the back of his neck and with a dusty , un ##sho ##d foot kicked his butt ##ocks , exposed through his torn shorts .

reference_raw: The words were barely out before one of his taller companions clasped a hand around the back of his neck and kicked his buttocks with a dusty, unshocked foot, exposed to his torn shorts.

reference_spacy_tokens: The words were barely out before one of his taller companions clasped a hand around the back of his neck and kicked his buttocks with a dusty , unshocked foot , exposed to his torn shorts .


fn_spacy_tokens_for_baseline: Thai food is no exception : quick to cook and easy to prepare , these spicy dishes make an inventive alternative to the Sunday roast .

source_bert_toks: thai food is no exception : quick to cook and easy to prepare , these spicy dishes make an in ##vent ##ive alternative to the sunday roast .

reference_raw: Thai food is no exception: it is quick to cook and easy to prepare, and these spiced dishes are an inventive alternative to a Sunday roast.

reference_spacy_tokens: Thai food is no exception : it is quick to cook and easy to prepare , and these spiced dishes are an inventive alternative to a Sunday roast .