fn_spacy_tokens_for_baseline: She loved organising things and being with young people , whether it was debating society , Saturday night socials , musical activities , sports , whatever .

source_bert_toks: she loved organising things and being with young people , whether it was debating society , saturday night social ##s , musical activities , sports , whatever .

reference_raw: She liked to organize things and be with young people, whether it was a debate, a Saturday night party, a musical event, a sport, whatever.

reference_spacy_tokens: She liked to organize things and be with young people , whether it was a debate , a Saturday night party , a musical event , a sport , whatever .


fn_spacy_tokens_for_baseline: ' See my room too ! ' she squealed .

source_bert_toks: ' see my room too ! ' she squealed .

reference_raw: 'Look at my room, too!' she screamed.

reference_spacy_tokens: ' Look at my room , too ! ' she screamed .


fn_spacy_tokens_for_baseline: The local authority appealed against the order made by the family proceedings court .

source_bert_toks: the local authority appealed against the order made by the family proceedings court .

reference_raw: The local authority brought an action against the order of the Family Court.

reference_spacy_tokens: The local authority brought an action against the order of the Family Court .


fn_spacy_tokens_for_baseline: Before it reached it , though , the road suddenly dipped down again and ran into a shallow hollow filled with sunshine .

source_bert_toks: before it reached it , though , the road suddenly dipped down again and ran into a shallow hollow filled with sunshine .

reference_raw: But before he could reach it, the road suddenly sank again and plunged into a shallow hollow full of sunlight.

reference_spacy_tokens: But before he could reach it , the road suddenly sank again and plunged into a shallow hollow full of sunlight .


fn_spacy_tokens_for_baseline: The wide main street , which the Berner Gate bounds and which forms a market place , has sixteenth - century arcaded sidewalks and houses , with seventeenth- and eighteenth - century facades .

source_bert_toks: the wide main street , which the bern ##er gate bounds and which forms a market place , has sixteenth - century arcade ##d sidewalks and houses , with seventeenth - and eighteenth - century facades .

reference_raw: The broad main street, bordered by the Berner Gate, which is a marketplace, has sixteenth-century walkways and houses with seventeenth and eighteenth-century facades.

reference_spacy_tokens: The broad main street , bordered by the Berner Gate , which is a marketplace , has sixteenth - century walkways and houses with seventeenth and eighteenth - century facades .


fn_spacy_tokens_for_baseline: Psepha was suddenly rising gracefully , the afternoon sunlight gleaming off wings that were still no more than a golden film .

source_bert_toks: ps ##ep ##ha was suddenly rising gracefully , the afternoon sunlight gleaming off wings that were still no more than a golden film .

reference_raw: Psepha suddenly rose gracefully, and the afternoon sun shone from the wings that were still nothing more than a golden film.

reference_spacy_tokens: Psepha suddenly rose gracefully , and the afternoon sun shone from the wings that were still nothing more than a golden film .


fn_spacy_tokens_for_baseline: Both guitars have necks that are properly set to line up with the top of the bridges , and which are set up to give the correct amount of neck relief .

source_bert_toks: both guitars have necks that are properly set to line up with the top of the bridges , and which are set up to give the correct amount of neck relief .

reference_raw: Both guitars have necks that are properly set to line up at the top of the bridges and are designed to provide the right amount of neck relief.

reference_spacy_tokens: Both guitars have necks that are properly set to line up at the top of the bridges and are designed to provide the right amount of neck relief .


fn_spacy_tokens_for_baseline: Bees have a reputation for foretelling the weather .

source_bert_toks: bees have a reputation for fore ##tell ##ing the weather .

reference_raw: The bees have a reputation for predicting the weather.

reference_spacy_tokens: The bees have a reputation for predicting the weather .


fn_spacy_tokens_for_baseline: According to witness reports , the home owners had a new water heater installed just last week , but it is not known if the fire was caused by the heater .

source_bert_toks: according to witness reports , the home owners had a new water heat ##er installed just last week , but it is not known if the fire was caused by the heat ##er .

reference_raw: According to witness reports, the homeowners installed a new water heater just last week, but it is unknown whether the fire was caused by a heater.

reference_spacy_tokens: According to witness reports , the homeowners installed a new water heater just last week , but it is unknown whether the fire was caused by a heater .


fn_spacy_tokens_for_baseline: They stopped alongside a bench at which a fat , cross - eyed girl was working .

source_bert_toks: they stopped alongside a bench at which a fat , cross - eyed girl was working .

reference_raw: They stopped beside the bench where the fat girl with the cross eyes worked.

reference_spacy_tokens: They stopped beside the bench where the fat girl with the cross eyes worked .


fn_spacy_tokens_for_baseline: ' The King of Heaven wishes to have no fellowship with lost and pagan so - called Kings ; for the eternal King reigns in Heaven , the lost pagan laments in Hell ' .

source_bert_toks: ' the king of heaven wishes to have no fellowship with lost and pagan so - called kings ; for the eternal king reigns in heaven , the lost pagan lame ##nts in hell ' .

reference_raw: 'The King of Heaven does not wish to have a friendship with the lost and pagan so-called kings; for the eternal king rules in heaven, the lost pagan laments of Hell.'

reference_spacy_tokens: ' The King of Heaven does not wish to have a friendship with the lost and pagan so - called kings ; for the eternal king rules in heaven , the lost pagan laments of Hell . '


fn_spacy_tokens_for_baseline: With just a few honourable exceptions , congressmen fawn over him whenever he comes to town .

source_bert_toks: with just a few honourable exceptions , congress ##men fa ##wn over him whenever he comes to town .

reference_raw: With only a few honorable exceptions, the congressmen would fawn over him every time he came into the city.

reference_spacy_tokens: With only a few honorable exceptions , the congressmen would fawn over him every time he came into the city .


fn_spacy_tokens_for_baseline: Although the islands saw little action , as the war went on they could see that Athens was slowly losing its power .

source_bert_toks: although the islands saw little action , as the war went on they could see that athens was slowly losing its power .

reference_raw: Though the islands had seen little action, as the war continued, they saw that Athens was slowly becoming powerless.

reference_spacy_tokens: Though the islands had seen little action , as the war continued , they saw that Athens was slowly becoming powerless .


fn_spacy_tokens_for_baseline: It is this suddenly increased level of necessary mental capacity , experience , knowledge and mental stamina that allows managers to add value to the work of their subordinates .

source_bert_toks: it is this suddenly increased level of necessary mental capacity , experience , knowledge and mental st ##amina that allows managers to add value to the work of their subordinate ##s .

reference_raw: This sudden increase in the level of mental capacity, experience, knowledge, and mental endurance allows managers to add value to the work of their subordinates.

reference_spacy_tokens: This sudden increase in the level of mental capacity , experience , knowledge , and mental endurance allows managers to add value to the work of their subordinates .


fn_spacy_tokens_for_baseline: But we 're not talking about the robots of the popular image , the machines which glide about putting cars together or spraying paints to order .

source_bert_toks: but we ' re not talking about the robots of the popular image , the machines which glide about putting cars together or spraying paints to order .

reference_raw: But we're not talking about the robots in the popular image, the machines that go around putting cars together or spraying paint to order.

reference_spacy_tokens: But we 're not talking about the robots in the popular image , the machines that go around putting cars together or spraying paint to order .


fn_spacy_tokens_for_baseline: With such equipment , jewellers would be able to replicate a series of similar designs from a single model .

source_bert_toks: with such equipment , jewel ##lers would be able to replicate a series of similar designs from a single model .

reference_raw: With this equipment, jewellers could reproduce a series of similar designs from the same model.

reference_spacy_tokens: With this equipment , jewellers could reproduce a series of similar designs from the same model .


fn_spacy_tokens_for_baseline: Young adults , like Mary T. , a jobless mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

source_bert_toks: young adults , like mary t . , a job ##less mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

reference_raw: A young adult, like Mary T., a three-year-old mother who was desperately trying to keep her children out of harm's way in a crime-ridden neighborhood.

reference_spacy_tokens: A young adult , like Mary T. , a three - year - old mother who was desperately trying to keep her children out of harm 's way in a crime - ridden neighborhood .


fn_spacy_tokens_for_baseline: The praying mantis has a single ear in the middle of its thorax which it uses for bat detection .

source_bert_toks: the praying man ##tis has a single ear in the middle of its thor ##ax which it uses for bat detection .

reference_raw: The praying mantis has one ear in the center of his chest that he uses to detect bats.

reference_spacy_tokens: The praying mantis has one ear in the center of his chest that he uses to detect bats .


fn_spacy_tokens_for_baseline: Past the smaller Loch Eilde Beag the track swings north to reach Luibeilt after around two miles of wild walking from the north - eastern end of the loch .

source_bert_toks: past the smaller loch e ##ilde bea ##g the track swings north to reach lu ##ibe ##il ##t after around two miles of wild walking from the north - eastern end of the loch .

reference_raw: After about two miles of walking wildly from the northeast end of the lake, the track swings north and reaches Luibeilt.

reference_spacy_tokens: After about two miles of walking wildly from the northeast end of the lake , the track swings north and reaches Luibeilt .


fn_spacy_tokens_for_baseline: All three men had been accused of manslaughter and arson after Rebbecca and Emma Harper died in the barn fire at Uckington near Cheltenham in Gloucestershire last year .

source_bert_toks: all three men had been accused of mans ##lau ##ght ##er and arson after re ##bbe ##cca and emma harper died in the barn fire at uc ##king ##ton near cheltenham in gloucestershire last year .

reference_raw: After Rebecca and Emma Harper died last year in a barn fire in Uckington near Cheltenham in Gloucestershire, all three men were charged with murder and arson.

reference_spacy_tokens: After Rebecca and Emma Harper died last year in a barn fire in Uckington near Cheltenham in Gloucestershire , all three men were charged with murder and arson .


fn_spacy_tokens_for_baseline: In recent weeks , the government has managed to get only one shipment of aid into the city .

source_bert_toks: in recent weeks , the government has managed to get only one shipment of aid into the city .

reference_raw: In the last few weeks, the government only managed to get one delivery of help into the city.

reference_spacy_tokens: In the last few weeks , the government only managed to get one delivery of help into the city .


fn_spacy_tokens_for_baseline: He coughed to clear his throat of the taste of the smoke .

source_bert_toks: he coughed to clear his throat of the taste of the smoke .

reference_raw: He cleared his throat to taste the smoke.

reference_spacy_tokens: He cleared his throat to taste the smoke .


fn_spacy_tokens_for_baseline: Iran responded by strenuously denying the charges , but also maintained that it reserved the right to possess nuclear weapons to counter Israel 's weaponry .

source_bert_toks: iran responded by st ##ren ##uously denying the charges , but also maintained that it reserved the right to possess nuclear weapons to counter israel ' s weaponry .

reference_raw: Iran responded by strenuously denying the charges, but also asserting that it reserved the right to own nuclear weapons against Israeli weapons.

reference_spacy_tokens: Iran responded by strenuously denying the charges , but also asserting that it reserved the right to own nuclear weapons against Israeli weapons .


fn_spacy_tokens_for_baseline: The sand sunk ; the wheat floated : and Imo could then skim a clean meal of wheat off the surface .

source_bert_toks: the sand sunk ; the wheat floated : and im ##o could then ski ##m a clean meal of wheat off the surface .

reference_raw: The sand was sinking; the wheat was floating; and then Imo was able to skip a clean meal of wheat from the surface.

reference_spacy_tokens: The sand was sinking ; the wheat was floating ; and then Imo was able to skip a clean meal of wheat from the surface .


fn_spacy_tokens_for_baseline: Armoured men with swords had clanked down the stairwells here ; now the steps were used by gunmen in grubby camouflage fatigues whose rifles lay propped against the walls of the round towers .

source_bert_toks: armoured men with swords had clan ##ked down the stairwell ##s here ; now the steps were used by gunmen in gr ##ub ##by camouflage fatigue ##s whose rifles lay propped against the walls of the round towers .

reference_raw: Armored men with swords clattered down the stairs here, and now the stairs were used by gunmen in grubby camouflage fatigues, their rifles propped against the walls of the round towers.

reference_spacy_tokens: Armored men with swords clattered down the stairs here , and now the stairs were used by gunmen in grubby camouflage fatigues , their rifles propped against the walls of the round towers .


fn_spacy_tokens_for_baseline: But leisure journeys weave all over the place .

source_bert_toks: but leisure journeys weave all over the place .

reference_raw: But free travel is everywhere.

reference_spacy_tokens: But free travel is everywhere .


fn_spacy_tokens_for_baseline: It might not be a bad idea to do that sooner , rather than later .

source_bert_toks: it might not be a bad idea to do that sooner , rather than later .

reference_raw: Maybe it's not too bad to do it sooner rather than later.

reference_spacy_tokens: Maybe it 's not too bad to do it sooner rather than later .


fn_spacy_tokens_for_baseline: I stopped yelling and started happily slurping my way through an icecream .

source_bert_toks: i stopped yelling and started happily sl ##ur ##ping my way through an ice ##cre ##am .

reference_raw: I stopped screaming and began to suck my way through the ice cream.

reference_spacy_tokens: I stopped screaming and began to suck my way through the ice cream .


fn_spacy_tokens_for_baseline: An even more interesting image out of Chinese history is the walled village of Kat Hing Wai , in the village of Kam Tin just outside the market town of Yuen Long .

source_bert_toks: an even more interesting image out of chinese history is the walled village of kat hi ##ng wai , in the village of kam tin just outside the market town of yue ##n long .

reference_raw: An even more interesting picture of Chinese history is the walled village of Kat Hing Wai, in the village of Kam Tin, near the market city of Yuen Long.

reference_spacy_tokens: An even more interesting picture of Chinese history is the walled village of Kat Hing Wai , in the village of Kam Tin , near the market city of Yuen Long .


fn_spacy_tokens_for_baseline: FAITHFUL readers know that four years ago we wagered a magnum of bubbly against the proposed restaurant in the former TSB premises in Stanhope having a Michelin star by 1990 .

source_bert_toks: faithful readers know that four years ago we wage ##red a magnum of bu ##bbly against the proposed restaurant in the former ts ##b premises in stan ##hope having a michel ##in star by 1990 .

reference_raw: FAITHFUL readers know that four years ago we bet a large sum of bubbles against the proposed restaurant in the former TSB premises in Stanhope, which had a Michelin star in 1990.

reference_spacy_tokens: FAITHFUL readers know that four years ago we bet a large sum of bubbles against the proposed restaurant in the former TSB premises in Stanhope , which had a Michelin star in 1990 .


fn_spacy_tokens_for_baseline: Gemini Productions will present J B Keane 's ' The Matchmaker ' at the end of September -- the Irish comedy about a man who helps those in search of the perfect partner .

source_bert_toks: gemini productions will present j b keane ' s ' the match ##maker ' at the end of september - - the irish comedy about a man who helps those in search of the perfect partner .

reference_raw: At the end of September, Gemini Productions will present JB Keane's "The Matchmaker", an Irish comic about a man who helps people find the perfect partner.

reference_spacy_tokens: At the end of September , Gemini Productions will present JB Keane 's " The Matchmaker " , an Irish comic about a man who helps people find the perfect partner .


fn_spacy_tokens_for_baseline: Under the WGMS the power of voters may appear to be restricted .

source_bert_toks: under the w ##gm ##s the power of voters may appear to be restricted .

reference_raw: In the context of the WGMS, it may appear that the competence of voters is limited.

reference_spacy_tokens: In the context of the WGMS , it may appear that the competence of voters is limited .


fn_spacy_tokens_for_baseline: ' Because I 'd shoot up drugs or have parties and get drunk and sleep with boys ?

source_bert_toks: ' because i ' d shoot up drugs or have parties and get drunk and sleep with boys ?

reference_raw: 'Cause I'm gonna blow up drugs or party and get drunk and sleep with guys?

reference_spacy_tokens: 'Cause I 'm gon na blow up drugs or party and get drunk and sleep with guys ?


fn_spacy_tokens_for_baseline: We took off our crowns and swords and cloth of gold and moved silent on the road to Elsinore .

source_bert_toks: we took off our crowns and swords and cloth of gold and moved silent on the road to el ##sin ##ore .

reference_raw: On the way to Elsinore, we removed our thrones, swords, and cloth of gold and walked in silence.

reference_spacy_tokens: On the way to Elsinore , we removed our thrones , swords , and cloth of gold and walked in silence .


fn_spacy_tokens_for_baseline: The remaining five had retained Dingle Foot , a leading barrister and Liberal MP , to advise them .

source_bert_toks: the remaining five had retained ding ##le foot , a leading barrister and liberal mp , to advise them .

reference_raw: The other five kept Dingle Foot, the leading lawyer and the liberal MP, to advise them.

reference_spacy_tokens: The other five kept Dingle Foot , the leading lawyer and the liberal MP , to advise them .


fn_spacy_tokens_for_baseline: What could have flustered the normally imperturbable Nan Ho ?

source_bert_toks: what could have flu ##stered the normally imp ##ert ##ur ##ba ##ble nan ho ?

reference_raw: What could shake the normally imperturbable Nan Ho?

reference_spacy_tokens: What could shake the normally imperturbable Nan Ho ?


fn_spacy_tokens_for_baseline: On Monday 10 October ' General ' Forster 's little army reached Morpeth and were joined by some well - off Scots , riding their own horses , from across the Border , swelling their numbers to 300 but , lacking arms , Forster was unable to accept the volunteers who flooded in offering to serve as infantry .

source_bert_toks: on monday 10 october ' general ' forster ' s little army reached mor ##pet ##h and were joined by some well - off scots , riding their own horses , from across the border , swelling their numbers to 300 but , lacking arms , forster was unable to accept the volunteers who flooded in offering to serve as infantry .

reference_raw: On Monday, October 10, 'General' Forster's small army reached Morpeth and was joined by a few well-off Scots, riding their own horses across the border, swelling their numbers to 300, but with no weapons, Forster could not accept the volunteers who had flown in offering to serve as infantry.

reference_spacy_tokens: On Monday , October 10 , ' General ' Forster 's small army reached Morpeth and was joined by a few well - off Scots , riding their own horses across the border , swelling their numbers to 300 , but with no weapons , Forster could not accept the volunteers who had flown in offering to serve as infantry .


fn_spacy_tokens_for_baseline: Dexter confided later that he used the opportunity to enrol in one for gays because he was sickened by the way his favourite night - club had changed .

source_bert_toks: dexter con ##fide ##d later that he used the opportunity to en ##rol in one for gay ##s because he was sick ##ened by the way his favourite night - club had changed .

reference_raw: Dexter later admitted to himself that he was taking advantage of the opportunity to sign up for one of the gays because he was sick of the way his favorite nightclub had changed.

reference_spacy_tokens: Dexter later admitted to himself that he was taking advantage of the opportunity to sign up for one of the gays because he was sick of the way his favorite nightclub had changed .


fn_spacy_tokens_for_baseline: Arabic - language networks broadcast footage of bloodied civilians , which mesmerized and outraged Iraqis .

source_bert_toks: arabic - language networks broadcast footage of blood ##ied civilians , which me ##sm ##eri ##zed and outraged iraqi ##s .

reference_raw: Arabic-language networks broadcast footage of bloody civilians who hypnotized and indignant Iraqis.

reference_spacy_tokens: Arabic - language networks broadcast footage of bloody civilians who hypnotized and indignant Iraqis .


fn_spacy_tokens_for_baseline: Sir Anthony hushed them and then rose , smiling his quiet and pleasant smile with one hand extended in salutation as a plump and dark - haired man came bouncingly to join them .

source_bert_toks: sir anthony hushed them and then rose , smiling his quiet and pleasant smile with one hand extended in sal ##utation as a plump and dark - haired man came bouncing ##ly to join them .

reference_raw: Sir Anthony silenced them, then stood up, smiling his quiet, pleasant smile with one hand outstretched in greeting as the plump, dark-haired man leapt to join them.

reference_spacy_tokens: Sir Anthony silenced them , then stood up , smiling his quiet , pleasant smile with one hand outstretched in greeting as the plump , dark - haired man leapt to join them .


fn_spacy_tokens_for_baseline: He quaffed the rest of his drink and sighed .

source_bert_toks: he qu ##af ##fed the rest of his drink and sighed .

reference_raw: He shook off the rest of his drink and sighed.

reference_spacy_tokens: He shook off the rest of his drink and sighed .


fn_spacy_tokens_for_baseline: He pulled up at the pumps and the attendant , a young black wearing green coveralls and cap bearing the petrol company 's logo , approached and leaned down to the open window .

source_bert_toks: he pulled up at the pumps and the attendant , a young black wearing green cover ##all ##s and cap bearing the petrol company ' s logo , approached and leaned down to the open window .

reference_raw: He stopped at the pumps and the attendant, a young black in green jumpsuits and a cap bearing the logo of a gas company, approached and leaned over to the open window.

reference_spacy_tokens: He stopped at the pumps and the attendant , a young black in green jumpsuits and a cap bearing the logo of a gas company , approached and leaned over to the open window .


fn_spacy_tokens_for_baseline: It was the first report of an improvement in Mandela 's condition since he was admitted to a hospital in Pretoria early Saturday after suffering a recurrence of a persistent lung ailment , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

source_bert_toks: it was the first report of an improvement in mandela ' s condition since he was admitted to a hospital in pretoria early saturday after suffering a rec ##ur ##rence of a persistent lung ai ##lm ##ent , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

reference_raw: It was the first report of an improvement in Mandela's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrent lung disease, a legacy of the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid.

reference_spacy_tokens: It was the first report of an improvement in Mandela 's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrent lung disease , a legacy of the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid .


fn_spacy_tokens_for_baseline: It is therefore far better to plant a single , carefully selected plant in the chosen spot than to build up a mishmash of clashing foliage .

source_bert_toks: it is therefore far better to plant a single , carefully selected plant in the chosen spot than to build up a mis ##hma ##sh of clash ##ing foliage .

reference_raw: Thus, it is much better to place a single, carefully selected crop at the selected site than to create a mash of clashing leaves.

reference_spacy_tokens: Thus , it is much better to place a single , carefully selected crop at the selected site than to create a mash of clashing leaves .


fn_spacy_tokens_for_baseline: ' Lightweight dinghies should n't be used unless they are tethered to the shore , ' said Peter Race .

source_bert_toks: ' lightweight ding ##hi ##es shouldn ' t be used unless they are te ##ther ##ed to the shore , ' said peter race .

reference_raw: 'Lightweight dinghies should not be used until they are tied to shore,' said Peter Race.

reference_spacy_tokens: ' Lightweight dinghies should not be used until they are tied to shore , ' said Peter Race .


fn_spacy_tokens_for_baseline: ' Do I detect a desire for retribution against me , sweet Gina ? '

source_bert_toks: ' do i detect a desire for retribution against me , sweet gina ? '

reference_raw: "Am I detecting a desire for vengeance against me, sweet Gina?"

reference_spacy_tokens: " Am I detecting a desire for vengeance against me , sweet Gina ? "


fn_spacy_tokens_for_baseline: The unhappy launching had neither deterred him nor dented his enthusiasm .

source_bert_toks: the unhappy launching had neither deter ##red him nor dent ##ed his enthusiasm .

reference_raw: The unfortunate launch did not dissuade him, nor dissipate his enthusiasm.

reference_spacy_tokens: The unfortunate launch did not dissuade him , nor dissipate his enthusiasm .


fn_spacy_tokens_for_baseline: Cindy 's half - hour of fashion chit - chat on MTV , titled House Of Style , features the covergirl with an assortment of gal pals -- Sandra Bernhard , Naomi , Linda et al .

source_bert_toks: cindy ' s half - hour of fashion chi ##t - chat on mtv , titled house of style , features the cover ##girl with an assortment of gal pal ##s - - sandra bernhard , naomi , linda et al .

reference_raw: Cindy's half-hour fashion chat on MTV, called House of Style, features a cover girl with a bunch of girlfriends--Sandra Bernhard, Naomi, Linda et al.

reference_spacy_tokens: Cindy 's half - hour fashion chat on MTV , called House of Style , features a cover girl with a bunch of girlfriends -- Sandra Bernhard , Naomi , Linda et al .


fn_spacy_tokens_for_baseline: Tavalouze said nothing but strode ahead of Lucien , his worn sandals slapping loudly against his feet and the marble flags of the corridor .

source_bert_toks: ta ##val ##ou ##ze said nothing but strode ahead of lucien , his worn sandals slapping loudly against his feet and the marble flags of the corridor .

reference_raw: Tavalouze said nothing but walked in front of Lucien, his worn sandals thumping loudly on his feet and the marble flags of the corridor.

reference_spacy_tokens: Tavalouze said nothing but walked in front of Lucien , his worn sandals thumping loudly on his feet and the marble flags of the corridor .


fn_spacy_tokens_for_baseline: I was standing in front of the tray of toffee - applies trying to make out which one was the biggest when Barbie came in with a jug to be filled with ginger - beer .

source_bert_toks: i was standing in front of the tray of to ##ffe ##e - applies trying to make out which one was the biggest when barbie came in with a jug to be filled with ginger - beer .

reference_raw: When Barbie came in with a pitcher full of ginger beer, I was standing in front of a plate of toffee apples, trying to figure out which one was the biggest.

reference_spacy_tokens: When Barbie came in with a pitcher full of ginger beer , I was standing in front of a plate of toffee apples , trying to figure out which one was the biggest .


fn_spacy_tokens_for_baseline: The writer once witnessed the eviction of a young reader from a London branch library .

source_bert_toks: the writer once witnessed the ev ##iction of a young reader from a london branch library .

reference_raw: A writer once witnessed a young reader evict from a London branch library.

reference_spacy_tokens: A writer once witnessed a young reader evict from a London branch library .


fn_spacy_tokens_for_baseline: But you could take it that the person would be overcome by a feeling of intense sleepiness within an hour .

source_bert_toks: but you could take it that the person would be overcome by a feeling of intense sleep ##iness within an hour .

reference_raw: But you can assume that a person will be overwhelmed by a feeling of intense somnolence within the hour.

reference_spacy_tokens: But you can assume that a person will be overwhelmed by a feeling of intense somnolence within the hour .


fn_spacy_tokens_for_baseline: The last few stars disappeared , extinguished by the splendour of the rising sun as shafts of golden light gilded the sea .

source_bert_toks: the last few stars disappeared , extinguished by the sp ##len ##dou ##r of the rising sun as shafts of golden light gilded the sea .

reference_raw: The last few stars vanished, extinguished by the splendor of the rising sun as shafts of golden light illuminated the sea.

reference_spacy_tokens: The last few stars vanished , extinguished by the splendor of the rising sun as shafts of golden light illuminated the sea .


fn_spacy_tokens_for_baseline: After a moment she laid the receiver down again , her surprise now turned to total bafflement .

source_bert_toks: after a moment she laid the receiver down again , her surprise now turned to total ba ##ffle ##ment .

reference_raw: After a while she put the phone back on the table, and her surprise was now a total confusion.

reference_spacy_tokens: After a while she put the phone back on the table , and her surprise was now a total confusion .


fn_spacy_tokens_for_baseline: She always had a sugar daddy .

source_bert_toks: she always had a sugar daddy .

reference_raw: She always had a sweet dad.

reference_spacy_tokens: She always had a sweet dad .


fn_spacy_tokens_for_baseline: It was not the Gruagach , but Caspar , who had come quietly along to their rooms when the giants were taking their midday snooze .

source_bert_toks: it was not the gr ##ua ##ga ##ch , but cas ##par , who had come quietly along to their rooms when the giants were taking their midday s ##no ##oz ##e .

reference_raw: It wasn't the Gruagach, it was Caspar, who came quietly to their rooms while the giants took their noon naps.

reference_spacy_tokens: It was n't the Gruagach , it was Caspar , who came quietly to their rooms while the giants took their noon naps .


fn_spacy_tokens_for_baseline: Before that date it is known that the original Indian population of the Georgia coast hunted , fished and gathered their food .

source_bert_toks: before that date it is known that the original indian population of the georgia coast hunted , fished and gathered their food .

reference_raw: Prior to that date, the original Indian population on the coast of Georgia is known to have fished, fished and collected food.

reference_spacy_tokens: Prior to that date , the original Indian population on the coast of Georgia is known to have fished , fished and collected food .


fn_spacy_tokens_for_baseline: Now Sainsbury 's can satisfy your child 's hunger for knowledge .

source_bert_toks: now sai ##ns ##bury ' s can satisfy your child ' s hunger for knowledge .

reference_raw: Now the Sainsburys can satisfy your child's desire for knowledge.

reference_spacy_tokens: Now the Sainsburys can satisfy your child 's desire for knowledge .


fn_spacy_tokens_for_baseline: If you ca n't get the money , you fake the bank note .

source_bert_toks: if you can ' t get the money , you fake the bank note .

reference_raw: If you don't get the money, you forge a bank note.

reference_spacy_tokens: If you do n't get the money , you forge a bank note .


fn_spacy_tokens_for_baseline: Good diction can still be heard occasionally , particularly on Radio 3 , so that no one who wishes to improve himself need lack exemplars ; yet many people are content to mumble and fumble their words .

source_bert_toks: good di ##ction can still be heard occasionally , particularly on radio 3 , so that no one who wishes to improve himself need lack ex ##em ##pl ##ars ; yet many people are content to mum ##ble and fumble their words .

reference_raw: Good diction can still be heard from time to time, especially on Radio 3, so that no one who wants to improve himself needs an example; but a lot of people are content to mumble and toss their words.

reference_spacy_tokens: Good diction can still be heard from time to time , especially on Radio 3 , so that no one who wants to improve himself needs an example ; but a lot of people are content to mumble and toss their words .


fn_spacy_tokens_for_baseline: I rest on the top of the wall , my hands shaking , my heart pumping hard .

source_bert_toks: i rest on the top of the wall , my hands shaking , my heart pumping hard .

reference_raw: I'm leaning against the wall, my hands trembling, my heart pounding.

reference_spacy_tokens: I 'm leaning against the wall , my hands trembling , my heart pounding .


fn_spacy_tokens_for_baseline: It injected a further DM24,000 million over two years into the eastern economy .

source_bert_toks: it injected a further d ##m ##24 , 000 million over two years into the eastern economy .

reference_raw: Over two years, it invested another DM24,000 million into the eastern economy.

reference_spacy_tokens: Over two years , it invested another DM24,000 million into the eastern economy .


fn_spacy_tokens_for_baseline: In sum , at both the federal and state government levels at least part of the seemingly irrational behavior voters display in the voting booth may have an exceedingly rational explanation .

source_bert_toks: in sum , at both the federal and state government levels at least part of the seemingly irrational behavior voters display in the voting booth may have an exceeding ##ly rational explanation .

reference_raw: To sum up, at least part of the seemingly irrational behavior of voters in the voting booth may have an extremely rational explanation at the level of both the federation and the state government.

reference_spacy_tokens: To sum up , at least part of the seemingly irrational behavior of voters in the voting booth may have an extremely rational explanation at the level of both the federation and the state government .


fn_spacy_tokens_for_baseline: To make one , a pie dish lined with shortcrust pastry is filled with sliced cooking apples sprinkled with demerara sugar and topped with slices of cheese .

source_bert_toks: to make one , a pie dish lined with short ##cr ##ust pastry is filled with sliced cooking apples sp ##rin ##kled with dem ##era ##ra sugar and topped with slices of cheese .

reference_raw: In order to make one, the pie dish lined with short-crust pastry is filled with sliced cooking apples sprayed with demerara sugar and covered with slices of cheese.

reference_spacy_tokens: In order to make one , the pie dish lined with short - crust pastry is filled with sliced cooking apples sprayed with demerara sugar and covered with slices of cheese .


fn_spacy_tokens_for_baseline: Nathan boomed and brayed so enthusiastically that his mother had to mop up a dribble of saliva that trickled out of the corner of his mouth .

source_bert_toks: nathan boomed and bray ##ed so enthusiastically that his mother had to mo ##p up a dr ##ib ##ble of saliva that trickle ##d out of the corner of his mouth .

reference_raw: Nathan thumped and braided so enthusiastically that his mother had to mop up a dribble of saliva that ran from the corner of his mouth.

reference_spacy_tokens: Nathan thumped and braided so enthusiastically that his mother had to mop up a dribble of saliva that ran from the corner of his mouth .


fn_spacy_tokens_for_baseline: Chris may be pessimistic about the future but , with one million sales every bi - monthly issue and 60,000 Fat Slags diaries already gone from the shelves , Viz does n't show any sign of losing popularity .

source_bert_toks: chris may be pe ##ssi ##mist ##ic about the future but , with one million sales every bi - monthly issue and 60 , 000 fat sl ##ags diaries already gone from the shelves , viz doesn ' t show any sign of losing popularity .

reference_raw: Chris may be pessimistic about the future, but with a million sales every two months and 60,000 Fat Slags journals already off the shelves, Viz shows no sign of losing popularity.

reference_spacy_tokens: Chris may be pessimistic about the future , but with a million sales every two months and 60,000 Fat Slags journals already off the shelves , Viz shows no sign of losing popularity .


fn_spacy_tokens_for_baseline: A food alert was issued by the Department of Health after salmonella was found in food products from Malaysia containing desiccated coconut .

source_bert_toks: a food alert was issued by the department of health after salmon ##ella was found in food products from malaysia containing des ##ic ##cated coconut .

reference_raw: The Ministry of Health issued a food warning following the detection of salmonella in food products containing dried coconut from Malaysia.

reference_spacy_tokens: The Ministry of Health issued a food warning following the detection of salmonella in food products containing dried coconut from Malaysia .


fn_spacy_tokens_for_baseline: A few blocks up Nathan Road is Kowloon Park ( open daily 6 am - midnight ) , elegantly laid out with fountains , promenades , and ornamental gardens ; be sure to go up the steps to see the Sculpture Walk .

source_bert_toks: a few blocks up nathan road is ko ##wl ##oon park ( open daily 6 am - midnight ) , elegant ##ly laid out with fountains , promenade ##s , and ornamental gardens ; be sure to go up the steps to see the sculpture walk .

reference_raw: Couple blocks from Nathan Road is Kowloon Park (open at 6:00 a.m. every day), neatly arranged with fountains, promenades, and ornamental gardens; make sure to go up the stairs and look at the Sculpture Walk.

reference_spacy_tokens: Couple blocks from Nathan Road is Kowloon Park ( open at 6:00 a.m. every day ) , neatly arranged with fountains , promenades , and ornamental gardens ; make sure to go up the stairs and look at the Sculpture Walk .


fn_spacy_tokens_for_baseline: However , under the CWC , all chemical weapons are banned , whether or not they are on the CWC schedules .

source_bert_toks: however , under the cw ##c , all chemical weapons are banned , whether or not they are on the cw ##c schedules .

reference_raw: However, under the Convention, all chemical weapons are prohibited, whether or not they are listed in the schedules of the Convention.

reference_spacy_tokens: However , under the Convention , all chemical weapons are prohibited , whether or not they are listed in the schedules of the Convention .


fn_spacy_tokens_for_baseline: ' The key ! ' roared Morse .

source_bert_toks: ' the key ! ' roared morse .

reference_raw: 'Key!' shouted Morse.

reference_spacy_tokens: ' Key ! ' shouted Morse .


fn_spacy_tokens_for_baseline: Against her yielding flesh she could feel his heart thundering like a man who had run a marathon .

source_bert_toks: against her yielding flesh she could feel his heart thunder ##ing like a man who had run a marathon .

reference_raw: She could feel his heart pounding against her yielding body like a man running a marathon.

reference_spacy_tokens: She could feel his heart pounding against her yielding body like a man running a marathon .


fn_spacy_tokens_for_baseline: This was her father 's invention and he was very proud of it .

source_bert_toks: this was her father ' s invention and he was very proud of it .

reference_raw: It was her father's idea, and he was proud of it.

reference_spacy_tokens: It was her father 's idea , and he was proud of it .


fn_spacy_tokens_for_baseline: Instead , he discovered the archipelago of Svalbard , whose fiords were teeming with whales and walrus .

source_bert_toks: instead , he discovered the archipelago of sv ##al ##bard , whose fi ##ord ##s were tee ##ming with whales and wal ##rus .

reference_raw: Instead, he found Svalbard's archipelago, its fiords swarming with whales and walrus.

reference_spacy_tokens: Instead , he found Svalbard 's archipelago , its fiords swarming with whales and walrus .


fn_spacy_tokens_for_baseline: Three minutes later she was snoring gently .

source_bert_toks: three minutes later she was s ##nor ##ing gently .

reference_raw: Three minutes later she sniffed softly.

reference_spacy_tokens: Three minutes later she sniffed softly .


fn_spacy_tokens_for_baseline: and they have reading to write which is uh they can write stories and and learn to write on computers so at least uh the school district that we 're in has you know computers that they begin on and i really feel like

source_bert_toks: and they have reading to write which is uh they can write stories and and learn to write on computers so at least uh the school district that we ' re in has you know computers that they begin on and i really feel like

reference_raw: and they're reading what's, uh, they can do stories and learn to type on computers, so at least the school district we're in, you know the computers they start on, and I really feel like,

reference_spacy_tokens: and they 're reading what 's , uh , they can do stories and learn to type on computers , so at least the school district we 're in , you know the computers they start on , and I really feel like ,


fn_spacy_tokens_for_baseline: Dreading to think what the stuff on her face might be , she clawed at it with trembling fingers , trying to interpret the strong odour in the turquoise air around her .

source_bert_toks: dread ##ing to think what the stuff on her face might be , she clawed at it with trembling fingers , trying to interpret the strong o ##dou ##r in the turquoise air around her .

reference_raw: She was afraid to think what the thing on her face might be, and she clutched at it with trembling fingers, trying to interpret the strong smell in the turquoise air around her.

reference_spacy_tokens: She was afraid to think what the thing on her face might be , and she clutched at it with trembling fingers , trying to interpret the strong smell in the turquoise air around her .


fn_spacy_tokens_for_baseline: FARMERS WEEKLY 's south - east barometer grower , Ashford - based Peter Maylam , has no winter barley , but was planning to desiccate oilseed rape this week .

source_bert_toks: farmers weekly ' s south - east bar ##ometer grow ##er , ashford - based peter may ##lam , has no winter barley , but was planning to des ##ic ##cate oils ##eed rape this week .

reference_raw: Farmers Weekly's south-east barometer grower, Peter Maylam, based in Ashford, has no winter barley, but is planning on drying out oilseed rape this week.

reference_spacy_tokens: Farmers Weekly 's south - east barometer grower , Peter Maylam , based in Ashford , has no winter barley , but is planning on drying out oilseed rape this week .


fn_spacy_tokens_for_baseline: He took careful aim with his second barrel at a smaller buffalo that had begun circling in dismay , and they heard the dull thud of his successful shot echo clearly across the plain .

source_bert_toks: he took careful aim with his second barrel at a smaller buffalo that had begun circling in dismay , and they heard the dull thud of his successful shot echo clearly across the plain .

reference_raw: With his second barrel, he carefully aimed at the smaller buffalo, which began to swirl in horror, and they could hear the dull thud of his successful shot echoing clearly across the plain.

reference_spacy_tokens: With his second barrel , he carefully aimed at the smaller buffalo , which began to swirl in horror , and they could hear the dull thud of his successful shot echoing clearly across the plain .


fn_spacy_tokens_for_baseline: Do n't use walls just for paintings -- they 're also ideal for collections like Elizabeth Jane 's dried flower circlets .

source_bert_toks: don ' t use walls just for paintings - - they ' re also ideal for collections like elizabeth jane ' s dried flower circle ##ts .

reference_raw: Do not use walls only for paintings - they are also ideal for collections such as the dried flower rings of Elizabeth Jane.

reference_spacy_tokens: Do not use walls only for paintings - they are also ideal for collections such as the dried flower rings of Elizabeth Jane .


fn_spacy_tokens_for_baseline: We need your support to continue getting people off of public assistance .

source_bert_toks: we need your support to continue getting people off of public assistance .

reference_raw: We need your help to keep getting people out of public help.

reference_spacy_tokens: We need your help to keep getting people out of public help .


fn_spacy_tokens_for_baseline: If you need statistics , jot them on a little piece of paper .

source_bert_toks: if you need statistics , jo ##t them on a little piece of paper .

reference_raw: If you need statistics, put them on a piece of paper.

reference_spacy_tokens: If you need statistics , put them on a piece of paper .


fn_spacy_tokens_for_baseline: But nobody was encumbered with the bounty of the countryside tied up with old newspaper and garden string .

source_bert_toks: but nobody was en ##cum ##bered with the bounty of the countryside tied up with old newspaper and garden string .

reference_raw: But no one was burdened with the reward of the country, bound by old newspapers and garden strings.

reference_spacy_tokens: But no one was burdened with the reward of the country , bound by old newspapers and garden strings .


fn_spacy_tokens_for_baseline: ' Great excitement was caused in Esher and the neighbouring district when it was learned late last night that an arrest had been effected in connection with the Oxshott murder .

source_bert_toks: ' great excitement was caused in es ##her and the neighbouring district when it was learned late last night that an arrest had been effect ##ed in connection with the ox ##shot ##t murder .

reference_raw: There was a lot of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder.

reference_spacy_tokens: There was a lot of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder .


fn_spacy_tokens_for_baseline: Both vessels moored alongside the main jetty in the Royal Navy dockyard , and Eden was there to greet his guests on what he hoped would be an historic visit .

source_bert_toks: both vessels moore ##d alongside the main jett ##y in the royal navy dockyard , and eden was there to greet his guests on what he hoped would be an historic visit .

reference_raw: The two ships docked beside the main dock in the Royal Navy, and Eden was there to greet his guests with what he hoped would be a historic visit.

reference_spacy_tokens: The two ships docked beside the main dock in the Royal Navy , and Eden was there to greet his guests with what he hoped would be a historic visit .


fn_spacy_tokens_for_baseline: Inevitably they would be in an arrestable state of undress .

source_bert_toks: inevitably they would be in an arrest ##able state of und ##ress .

reference_raw: They'd inevitably be in an arrestable state of clothing.

reference_spacy_tokens: They 'd inevitably be in an arrestable state of clothing .


fn_spacy_tokens_for_baseline: The cat sat up in the branches , and it yowled plaintively .

source_bert_toks: the cat sat up in the branches , and it yo ##wled plain ##tively .

reference_raw: The cat sat down in the branches and howled plaintively.

reference_spacy_tokens: The cat sat down in the branches and howled plaintively .


fn_spacy_tokens_for_baseline: The river thawed and barges of food began to reach the capital .

source_bert_toks: the river tha ##wed and barges of food began to reach the capital .

reference_raw: The river melted and the barges of food began to reach the capital.

reference_spacy_tokens: The river melted and the barges of food began to reach the capital .


fn_spacy_tokens_for_baseline: A friend has told him that the council might be prepared to take the children into voluntary care for a while so that Ahmed can convalesce properly .

source_bert_toks: a friend has told him that the council might be prepared to take the children into voluntary care for a while so that ahmed can con ##vale ##sc ##e properly .

reference_raw: A friend told him that the Council might be ready to take the children into voluntary care for a while, so Ahmed could convene properly.

reference_spacy_tokens: A friend told him that the Council might be ready to take the children into voluntary care for a while , so Ahmed could convene properly .


fn_spacy_tokens_for_baseline: The contest , organised by North Staffordshire Hospital Radio , took the top 16 players -- picked on points scored -- into four semi - final eliminators .

source_bert_toks: the contest , organised by north staffordshire hospital radio , took the top 16 players - - picked on points scored - - into four semi - final eli ##mina ##tors .

reference_raw: The competition, organized by North Staffordshire Hospital Radio, took the top 16 players - selected for scores - into four semi-final eliminators.

reference_spacy_tokens: The competition , organized by North Staffordshire Hospital Radio , took the top 16 players - selected for scores - into four semi - final eliminators .


fn_spacy_tokens_for_baseline: Among the ponds is one inhabited by turtles : Visitors toss in coins in the hope of bouncing one off a turtle 's head , a sure way of achieving good fortune .

source_bert_toks: among the ponds is one inhabited by turtles : visitors toss in coins in the hope of bouncing one off a turtle ' s head , a sure way of achieving good fortune .

reference_raw: There is one inhabited by tortoises among the ponds: Visitors throw coins in the hope of bouncing one off the head of a tortoise, a certain way of achieving happiness.

reference_spacy_tokens: There is one inhabited by tortoises among the ponds : Visitors throw coins in the hope of bouncing one off the head of a tortoise , a certain way of achieving happiness .


fn_spacy_tokens_for_baseline: Then she saw a thin trail of smoke rising from her sister 's clothing , and smelt the dry odour of smouldering cloth .

source_bert_toks: then she saw a thin trail of smoke rising from her sister ' s clothing , and sm ##elt the dry o ##dou ##r of sm ##ou ##lder ##ing cloth .

reference_raw: Then she saw a thin trail of smoke coming out of her sister's clothes and smelled the dry smell of smoldering cloth.

reference_spacy_tokens: Then she saw a thin trail of smoke coming out of her sister 's clothes and smelled the dry smell of smoldering cloth .


fn_spacy_tokens_for_baseline: Freidzon also attributes impressive functions of analysis and arbitration to the personal chancellories of Politburo members , which are thought to comprise individuals who are highly expert in their particular fields .

source_bert_toks: fr ##ei ##d ##zon also attributes impressive functions of analysis and arbitration to the personal chancellor ##ies of pol ##it ##buro members , which are thought to comprise individuals who are highly expert in their particular fields .

reference_raw: Freidzon also attributes impressive analytical and arbitrage functions to the personal chancellories of the members of the Politburo, which are considered to include individuals with a high level of expertise in their specific fields.

reference_spacy_tokens: Freidzon also attributes impressive analytical and arbitrage functions to the personal chancellories of the members of the Politburo , which are considered to include individuals with a high level of expertise in their specific fields .


fn_spacy_tokens_for_baseline: The fact that education ( though not schooling ) is obligatory up to the age of 16 forces one to try to justify and legitimate in curricular terms such a major act of social compulsion .

source_bert_toks: the fact that education ( though not schooling ) is obligatory up to the age of 16 forces one to try to justify and legitimate in cu ##rricular terms such a major act of social compulsion .

reference_raw: The fact that education (though not education) is compulsory until the age of 16 forces one to attempt to justify and legitimately justify such an important act of social compulsion.

reference_spacy_tokens: The fact that education ( though not education ) is compulsory until the age of 16 forces one to attempt to justify and legitimately justify such an important act of social compulsion .


fn_spacy_tokens_for_baseline: He smiled fondly at the girl as he spoke , and Paulette , who in truth was very pretty , blew him a kiss before lying back on the pillows .

source_bert_toks: he smiled fond ##ly at the girl as he spoke , and paul ##ette , who in truth was very pretty , blew him a kiss before lying back on the pillows .

reference_raw: As he spoke, he smiled fondly at the girl, and Paulette, who was actually very pretty, blew him a kiss before he lay back on the pillows.

reference_spacy_tokens: As he spoke , he smiled fondly at the girl , and Paulette , who was actually very pretty , blew him a kiss before he lay back on the pillows .


fn_spacy_tokens_for_baseline: Right , proceed with your ablutions , but mind your ankle . '

source_bert_toks: right , proceed with your ab ##lu ##tions , but mind your ankle . '

reference_raw: All right, continue with your bruises, but keep an eye on your ankles.'

reference_spacy_tokens: All right , continue with your bruises , but keep an eye on your ankles . '


fn_spacy_tokens_for_baseline: If you are in a pickle , do n't worry about it , because you can always phone Di up on the switchboard , or me , but I 'm usually not there .

source_bert_toks: if you are in a pick ##le , don ' t worry about it , because you can always phone di up on the switch ##board , or me , but i ' m usually not there .

reference_raw: If you're in trouble, don't worry, 'cause you can always call Di to the switchboard, or me, but I'm not usually there.

reference_spacy_tokens: If you 're in trouble , do n't worry , 'cause you can always call Di to the switchboard , or me , but I 'm not usually there .


fn_spacy_tokens_for_baseline: Take the charmed prince John F Kennedy , the Casanova of the Casa Blanca , whose paramours included a mafia moll .

source_bert_toks: take the charm ##ed prince john f kennedy , the casa ##nova of the casa blanca , whose para ##mour ##s included a mafia mo ##ll .

reference_raw: Take the enchanted Prince John F Kennedy, Casanova of Casa Blanca, whose paramours included a mob molt.

reference_spacy_tokens: Take the enchanted Prince John F Kennedy , Casanova of Casa Blanca , whose paramours included a mob molt .


fn_spacy_tokens_for_baseline: Ben dropped where he stood , his hand splashing into one of the pools .

source_bert_toks: ben dropped where he stood , his hand splash ##ing into one of the pools .

reference_raw: Ben dropped to where he was standing, his hand spilling into one of the pools.

reference_spacy_tokens: Ben dropped to where he was standing , his hand spilling into one of the pools .


fn_spacy_tokens_for_baseline: " You reach down from your exalted position , beyond their understanding , and put your - the things on the ends of your forelimbs .. "

source_bert_toks: " you reach down from your ex ##al ##ted position , beyond their understanding , and put your - the things on the ends of your fore ##lim ##bs . . "

reference_raw: "You reach out from your exalted position, beyond their comprehension, and you put your-things at the end of your front limbs . . ."

reference_spacy_tokens: " You reach out from your exalted position , beyond their comprehension , and you put your - things at the end of your front limbs . . . "


fn_spacy_tokens_for_baseline: The candles glimmered on the moon - blanched tree like Christmas candles .

source_bert_toks: the candles g ##lim ##mere ##d on the moon - blanche ##d tree like christmas candles .

reference_raw: The candles gleamed like Christmas candles on the moonlit tree.

reference_spacy_tokens: The candles gleamed like Christmas candles on the moonlit tree .


fn_spacy_tokens_for_baseline: Hunt modeled the design of this 250-room residence on the Chateau de Blois , whose style is not the severe Classicism of the Italian Renaissance favored by architects such as Charles McKim , but the more ornate and picturesque French Renaissance .

source_bert_toks: hunt modeled the design of this 250 - room residence on the chateau de b ##lo ##is , whose style is not the severe classic ##ism of the italian renaissance favored by architects such as charles mc ##kim , but the more ornate and picturesque french renaissance .

reference_raw: Hunt modelled the design of this 250-room residence in the Chateau de Blois, the style of which is not the strict classics of the Italian Renaissance favored by architects like Charles McKim, but rather the more ornate and imaginative French Renaissance.

reference_spacy_tokens: Hunt modelled the design of this 250-room residence in the Chateau de Blois , the style of which is not the strict classics of the Italian Renaissance favored by architects like Charles McKim , but rather the more ornate and imaginative French Renaissance .


fn_spacy_tokens_for_baseline: A curious feature of the scene is that the worshipping woman seems to be naked apart from an anklet and what may be a sacral knot tied round her neck .

source_bert_toks: a curious feature of the scene is that the worship ##ping woman seems to be naked apart from an ankle ##t and what may be a sac ##ral knot tied round her neck .

reference_raw: The strange thing about the scene is that the worshipper appears to be naked, apart from his ankle, and what could be a sacral knot tied around his neck.

reference_spacy_tokens: The strange thing about the scene is that the worshipper appears to be naked , apart from his ankle , and what could be a sacral knot tied around his neck .


fn_spacy_tokens_for_baseline: ' I ca n't stand metal now , ' gripes Sam , grimly .

source_bert_toks: ' i can ' t stand metal now , ' grip ##es sam , grimly .

reference_raw: 'I hate metal now,' says Sam grimly.

reference_spacy_tokens: ' I hate metal now , ' says Sam grimly .


fn_spacy_tokens_for_baseline: I 'm frightened now that it will unsettle me , bring back too many memories .

source_bert_toks: i ' m frightened now that it will un ##sett ##le me , bring back too many memories .

reference_raw: Now I'm afraid it'll upset me, bring back too many memories.

reference_spacy_tokens: Now I 'm afraid it 'll upset me , bring back too many memories .


fn_spacy_tokens_for_baseline: Mr Major fidgeted , and took an ever - so sneaky glance at his watch at 4:00pm to find to his dismay that only 30 minutes of the one hour , 53 minute - long drone had passed .

source_bert_toks: mr major fi ##dget ##ed , and took an ever - so sneak ##y glance at his watch at 4 : 00pm to find to his dismay that only 30 minutes of the one hour , 53 minute - long drone had passed .

reference_raw: Mr. Major stirred and glanced at his watch at four o'clock so furtively that he found, to his dismay, that only thirty minutes of an hour and fifty-three minutes of an hour had passed.

reference_spacy_tokens: Mr. Major stirred and glanced at his watch at four o'clock so furtively that he found , to his dismay , that only thirty minutes of an hour and fifty - three minutes of an hour had passed .


fn_spacy_tokens_for_baseline: On further reflection , I think this is exactly what he is saying , and its significance is immense .

source_bert_toks: on further reflection , i think this is exactly what he is saying , and its significance is immense .

reference_raw: On second thought, I think that's what he's saying, and it's very important.

reference_spacy_tokens: On second thought , I think that 's what he 's saying , and it 's very important .


fn_spacy_tokens_for_baseline: Why is n't he pontificating from the battlements about this .

source_bert_toks: why isn ' t he pont ##ific ##ating from the battle ##ments about this .

reference_raw: Why doesn't he talk about it from the walls?

reference_spacy_tokens: Why does n't he talk about it from the walls ?


fn_spacy_tokens_for_baseline: It was a formal French dinner - party : best china , a second maid to wait at table , three wines .

source_bert_toks: it was a formal french dinner - party : best china , a second maid to wait at table , three wines .

reference_raw: It was a formal French dinner party: the best porcelain, the second maid at the table, three wines.

reference_spacy_tokens: It was a formal French dinner party : the best porcelain , the second maid at the table , three wines .


fn_spacy_tokens_for_baseline: The Minister is being slightly disingenuous .

source_bert_toks: the minister is being slightly di ##sing ##en ##uous .

reference_raw: The Minister's being a little disincentive.

reference_spacy_tokens: The Minister 's being a little disincentive .


fn_spacy_tokens_for_baseline: Some 30 staff will move to the repository when it is completed in the summer of 1994 .

source_bert_toks: some 30 staff will move to the repository when it is completed in the summer of 1994 .

reference_raw: At the end of the summer of 1994, about 30 employees will move to the warehouse.

reference_spacy_tokens: At the end of the summer of 1994 , about 30 employees will move to the warehouse .


fn_spacy_tokens_for_baseline: More recently , South Africa began working more closely with the IAEA in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a South African businessman exposed connections to the A.Q. Khan network .

source_bert_toks: more recently , south africa began working more closely with the ia ##ea in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a south african businessman exposed connections to the a . q . khan network .

reference_raw: Recently, South Africa started to work more closely with the IAEA in 2004 to monitor the international smuggling of nuclear weapons materials, following an investigation into a South African businessman who exposed contact with the A.Q. Khan network.

reference_spacy_tokens: Recently , South Africa started to work more closely with the IAEA in 2004 to monitor the international smuggling of nuclear weapons materials , following an investigation into a South African businessman who exposed contact with the A.Q. Khan network .


fn_spacy_tokens_for_baseline: The link is a sticky red gum secreted by the mukula which coagulates quickly and is explicitly compared by the Ndembu to blood .

source_bert_toks: the link is a sticky red gum secret ##ed by the mu ##ku ##la which coa ##gul ##ates quickly and is explicitly compared by the n ##de ##mb ##u to blood .

reference_raw: The link is a sticky red gum secreted by the mukula, which clots rapidly and is explicitly compared with blood by the Ndembu.

reference_spacy_tokens: The link is a sticky red gum secreted by the mukula , which clots rapidly and is explicitly compared with blood by the Ndembu .


fn_spacy_tokens_for_baseline: They were not deceived .

source_bert_toks: they were not dec ##ei ##ved .

reference_raw: They weren't fooled.

reference_spacy_tokens: They were n't fooled .


fn_spacy_tokens_for_baseline: Under a sky shrouded by deep snow clouds , some boys threw snowballs at each other , shrieking with laughter as they hit their target .

source_bert_toks: under a sky sh ##roud ##ed by deep snow clouds , some boys threw snow ##balls at each other , shriek ##ing with laughter as they hit their target .

reference_raw: Under a cloud of deep snow, some of the boys threw snowballs at each other and screamed with laughter as they hit the target.

reference_spacy_tokens: Under a cloud of deep snow , some of the boys threw snowballs at each other and screamed with laughter as they hit the target .


fn_spacy_tokens_for_baseline: Look - out posts were placed on headlands of Euboia , and another on the island of Skiathos , off S , the south - east cape of Thessaly , with arrangements for signalling .

source_bert_toks: look - out posts were placed on head ##lands of eu ##bo ##ia , and another on the island of ski ##ath ##os , off s , the south - east cape of the ##ssa ##ly , with arrangements for signalling .

reference_raw: The patrol posts were located on the mainlands of Euboia, and another on the island of Skiathos, off S, in the southeast of Thessaly, with signaling arrangements.

reference_spacy_tokens: The patrol posts were located on the mainlands of Euboia , and another on the island of Skiathos , off S , in the southeast of Thessaly , with signaling arrangements .


fn_spacy_tokens_for_baseline: She leapt over the ditch opposite the Martins ' orchard wall and hurled herself into the undergrowth .

source_bert_toks: she leapt over the ditch opposite the martins ' orchard wall and hurled herself into the under ##growth .

reference_raw: She jumped across the ditch across from the orchard wall of the Martins and threw herself into the undergrowth.

reference_spacy_tokens: She jumped across the ditch across from the orchard wall of the Martins and threw herself into the undergrowth .


fn_spacy_tokens_for_baseline: When water is in short supply , the trunk works with a forefoot to dig a hole in a dried - out river bed until moisture is found .

source_bert_toks: when water is in short supply , the trunk works with a fore ##foot to dig a hole in a dried - out river bed until moisture is found .

reference_raw: When water is scarce, the trunk works with the front leg to dig a hole in the dry river bed until moisture is found.

reference_spacy_tokens: When water is scarce , the trunk works with the front leg to dig a hole in the dry river bed until moisture is found .


fn_spacy_tokens_for_baseline: How does it feel to be a maried woman then ?

source_bert_toks: how does it feel to be a marie ##d woman then ?

reference_raw: So what's it like being married?

reference_spacy_tokens: So what 's it like being married ?


fn_spacy_tokens_for_baseline: An architectural wonder , it is itself a beautiful piece of craftsmanship with its sculpture and carved stone balustrades .

source_bert_toks: an architectural wonder , it is itself a beautiful piece of craftsman ##ship with its sculpture and carved stone bal ##ust ##rade ##s .

reference_raw: It's an architectural miracle, it's a beautiful piece of art, with a statue and a carved stone balustrade.

reference_spacy_tokens: It 's an architectural miracle , it 's a beautiful piece of art , with a statue and a carved stone balustrade .


fn_spacy_tokens_for_baseline: If North Korea wishes to foster a viable chemical industry , a case could be made that its accession to the CWC would make long - term economic sense by giving it access to trade in treaty - controlled chemicals and technology .

source_bert_toks: if north korea wishes to foster a viable chemical industry , a case could be made that its accession to the cw ##c would make long - term economic sense by giving it access to trade in treaty - controlled chemicals and technology .

reference_raw: If North Korea wants to promote a viable chemical industry, it is possible that its accession to the Convention would make long-term economic sense by providing it with access to trade in contract-controlled chemicals and technologies.

reference_spacy_tokens: If North Korea wants to promote a viable chemical industry , it is possible that its accession to the Convention would make long - term economic sense by providing it with access to trade in contract - controlled chemicals and technologies .


fn_spacy_tokens_for_baseline: Now that he was committed to a course of action he felt exhilarated .

source_bert_toks: now that he was committed to a course of action he felt ex ##hila ##rated .

reference_raw: Now that he was committed to action, he felt excited.

reference_spacy_tokens: Now that he was committed to action , he felt excited .


fn_spacy_tokens_for_baseline: Canadian companies exported $ 33.7 billion worth of goods , up 2.7 % from January 's revised level , the largest monthly rate of growth since May 2000 .

source_bert_toks: canadian companies exported $ 33 . 7 billion worth of goods , up 2 . 7 % from january ' s revised level , the largest monthly rate of growth since may 2000 .

reference_raw: Canada's companies exported $33.7 billion worth of goods, up 2.7% from the revised January level, the highest monthly growth rate since May 2000.

reference_spacy_tokens: Canada 's companies exported $ 33.7 billion worth of goods , up 2.7 % from the revised January level , the highest monthly growth rate since May 2000 .


fn_spacy_tokens_for_baseline: Later on , however , the names of those who had graduated in the social sciences and especially sociology were greeted with hissing disparagement and barely concealed denigration .

source_bert_toks: later on , however , the names of those who had graduated in the social sciences and especially sociology were greeted with hissing di ##spar ##age ##ment and barely concealed den ##ig ##ration .

reference_raw: Later, however, the names of those who had graduated from social sciences, particularly sociology, were greeted with hissing disdain and barely concealed denigration.

reference_spacy_tokens: Later , however , the names of those who had graduated from social sciences , particularly sociology , were greeted with hissing disdain and barely concealed denigration .


fn_spacy_tokens_for_baseline: Secondly , he was disturbed by the fact that spiritual truths did n't stir his emotions or grip his imagination as much as he felt they should .

source_bert_toks: secondly , he was disturbed by the fact that spiritual truths didn ' t stir his emotions or grip his imagination as much as he felt they should .

reference_raw: Second, he was troubled by the fact that spiritual truths did not stir his emotions or hold his imagination in the way he felt they should.

reference_spacy_tokens: Second , he was troubled by the fact that spiritual truths did not stir his emotions or hold his imagination in the way he felt they should .


fn_spacy_tokens_for_baseline: She found herself envying the easy banter between her cousins and aunt , the argumentative informality of mealtimes , the laughter and bustle and hugs .

source_bert_toks: she found herself envy ##ing the easy ban ##ter between her cousins and aunt , the argument ##ative informal ##ity of meal ##time ##s , the laughter and bust ##le and hugs .

reference_raw: She found herself envious of the easy clanking between her cousins and her aunt, the argumentative informality of the meal, the laughter, the rush and the hugs.

reference_spacy_tokens: She found herself envious of the easy clanking between her cousins and her aunt , the argumentative informality of the meal , the laughter , the rush and the hugs .


fn_spacy_tokens_for_baseline: We were soon splashing about in the surf washing off weeks of dirt accumulated in the slit trenches .

source_bert_toks: we were soon splash ##ing about in the surf washing off weeks of dirt accumulated in the slit trenches .

reference_raw: Soon we were splashing around in the surf, scrubbing away the weeks of dirt accumulated in the creviced trenches.

reference_spacy_tokens: Soon we were splashing around in the surf , scrubbing away the weeks of dirt accumulated in the creviced trenches .


fn_spacy_tokens_for_baseline: They also graded each stool on a 6 point scale sensitive to intestinal transit time ( Table I ) .

source_bert_toks: they also graded each stool on a 6 point scale sensitive to int ##estinal transit time ( table i ) .

reference_raw: They also classified each stool on a 6-point scale that is sensitive to intestinal transit time (Table I).

reference_spacy_tokens: They also classified each stool on a 6-point scale that is sensitive to intestinal transit time ( Table I ) .


fn_spacy_tokens_for_baseline: The Rev Fred Nile , of the Uniting Church , leader of the religious - based Call to Australia Party , is against amendments planned by the State Government that would outlaw the vilification of homosexuals .

source_bert_toks: the rev fred nile , of the uniting church , leader of the religious - based call to australia party , is against amendments planned by the state government that would outlaw the vi ##li ##fication of homosexual ##s .

reference_raw: The Reverend Fred Nile of the United Church, the leader of the Religious Call to the Australia Party, opposes changes planned by the government to outlaw the vileness of homosexuals.

reference_spacy_tokens: The Reverend Fred Nile of the United Church , the leader of the Religious Call to the Australia Party , opposes changes planned by the government to outlaw the vileness of homosexuals .


fn_spacy_tokens_for_baseline: He was a short fair - haired man with gold epaulettes and the black flashes of the tank units .

source_bert_toks: he was a short fair - haired man with gold epa ##ule ##ttes and the black flashes of the tank units .

reference_raw: He was a small blond man with golden epaulettes and black flashes from tank units.

reference_spacy_tokens: He was a small blond man with golden epaulettes and black flashes from tank units .


fn_spacy_tokens_for_baseline: Hong Kong 's major venue for the performing arts , the building has been criticized for its fortress - like architecture and windowless facade .

source_bert_toks: hong kong ' s major venue for the performing arts , the building has been criticized for its fortress - like architecture and window ##less facade .

reference_raw: Hong Kong's main place for performing art, the building was criticized for its fortress, such as architecture and windowless fronts.

reference_spacy_tokens: Hong Kong 's main place for performing art , the building was criticized for its fortress , such as architecture and windowless fronts .


fn_spacy_tokens_for_baseline: Although Santa Barbara County Sheriff Bill Brown believes that " this fire was the result of carelessness , not criminal intent , " the county district attorney will still have to review the case .

source_bert_toks: although santa barbara county sheriff bill brown believes that " this fire was the result of careless ##ness , not criminal intent , " the county district attorney will still have to review the case .

reference_raw: Although Sheriff Bill Brown of Santa Barbara thinks that "the fire was the result of recklessness, not criminal intent," the district attorney will still have to examine the case.

reference_spacy_tokens: Although Sheriff Bill Brown of Santa Barbara thinks that " the fire was the result of recklessness , not criminal intent , " the district attorney will still have to examine the case .


fn_spacy_tokens_for_baseline: After giving the Brigadier a smart salute , he addresses me in his usual gruff manner , ' Piper , I want you to play your bagpipes as we disembark ' .

source_bert_toks: after giving the brigadier a smart salute , he addresses me in his usual gruff manner , ' piper , i want you to play your bag ##pipe ##s as we di ##se ##mba ##rk ' .

reference_raw: When he saluted the brigadier wisely, he said to me in his usual gruff manner, "Piper, I want you to play your pipes when we get out."

reference_spacy_tokens: When he saluted the brigadier wisely , he said to me in his usual gruff manner , " Piper , I want you to play your pipes when we get out . "


fn_spacy_tokens_for_baseline: Afterwards , when coffee was served together with delectable hand - made chocolates , Merrill tried again to bring herself down to earth .

source_bert_toks: afterwards , when coffee was served together with del ##ect ##able hand - made chocolate ##s , merrill tried again to bring herself down to earth .

reference_raw: Afterwards, when the coffee was served with selectable hand-made chocolates, Merrill tried again to bring herself to the ground.

reference_spacy_tokens: Afterwards , when the coffee was served with selectable hand - made chocolates , Merrill tried again to bring herself to the ground .


fn_spacy_tokens_for_baseline: We know that very early exposure to schooling improves performance in the first grade , but afterward the difference is quickly washed away .

source_bert_toks: we know that very early exposure to schooling improves performance in the first grade , but afterward the difference is quickly washed away .

reference_raw: We know that early exposure to education improves first-grade performance, but then the difference is quickly washed away.

reference_spacy_tokens: We know that early exposure to education improves first - grade performance , but then the difference is quickly washed away .


fn_spacy_tokens_for_baseline: AN elderly couple suffered a ' sad and lingering ' death after cowboy builders capped their chimney , preventing fumes from their coal - fired oven escaping , an inquest heard yesterday .

source_bert_toks: an elderly couple suffered a ' sad and lingering ' death after cowboy builders capped their chimney , preventing fu ##mes from their coal - fired oven escaping , an in ##quest heard yesterday .

reference_raw: The old couple had suffered a 'sad and lingering' death after the cowboy builders had knocked down the chimney and prevented the smoke from the coal-fired oven from escaping, an investigation had been heard yesterday.

reference_spacy_tokens: The old couple had suffered a ' sad and lingering ' death after the cowboy builders had knocked down the chimney and prevented the smoke from the coal - fired oven from escaping , an investigation had been heard yesterday .


fn_spacy_tokens_for_baseline: Lewis , he concluded , had seen the money rolling into the Southampton branch as Wilson 's efforts had brought negotiations with the employers in that port to a satisfactory conclusion .

source_bert_toks: lewis , he concluded , had seen the money rolling into the southampton branch as wilson ' s efforts had brought negotiations with the employers in that port to a satisfactory conclusion .

reference_raw: He concluded that Lewis had seen the money rush into the Southampton branch when Wilson's efforts had led the employers in the harbor to a satisfactory conclusion.

reference_spacy_tokens: He concluded that Lewis had seen the money rush into the Southampton branch when Wilson 's efforts had led the employers in the harbor to a satisfactory conclusion .


fn_spacy_tokens_for_baseline: He had been awaiting trial at the High Court on assault , robbery and firearms charges .

source_bert_toks: he had been awaiting trial at the high court on assault , robbery and firearms charges .

reference_raw: He was waiting to be tried in the High Court of Assault, Robbery, and Firearms.

reference_spacy_tokens: He was waiting to be tried in the High Court of Assault , Robbery , and Firearms .


fn_spacy_tokens_for_baseline: This meant a four - hour wait in Boaventura where we were observed by amused barefooted children , obviously unused to foreigners .

source_bert_toks: this meant a four - hour wait in bo ##ave ##nt ##ura where we were observed by amused barefoot ##ed children , obviously unused to foreigners .

reference_raw: That meant a four-hour wait in Boaventura, where we were watched by amused bare-footed children who were obviously not used to strangers.

reference_spacy_tokens: That meant a four - hour wait in Boaventura , where we were watched by amused bare - footed children who were obviously not used to strangers .


fn_spacy_tokens_for_baseline: Many Greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the United States and Australia .

source_bert_toks: many greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the united states and australia .

reference_raw: Many Greek islanders have chosen to leave rather than live in misery and terror, and many have created new homes in the United States and Australia.

reference_spacy_tokens: Many Greek islanders have chosen to leave rather than live in misery and terror , and many have created new homes in the United States and Australia .


fn_spacy_tokens_for_baseline: In late December 2002 , North Korean technicians broke seals and disabled cameras that had been installed by the IAEA in order to monitor the freeze .

source_bert_toks: in late december 2002 , north korean technicians broke seals and disabled cameras that had been installed by the ia ##ea in order to monitor the freeze .

reference_raw: At the end of December 2002, North Korean engineers broke the seals and disabled the cameras installed by the IAEA to monitor the freezing.

reference_spacy_tokens: At the end of December 2002 , North Korean engineers broke the seals and disabled the cameras installed by the IAEA to monitor the freezing .


fn_spacy_tokens_for_baseline: Daly is taking a leave of absence in the hope that the dispute will blow over .

source_bert_toks: daly is taking a leave of absence in the hope that the dispute will blow over .

reference_raw: Daly's taking a vacation in the hopes of overcoming the dispute.

reference_spacy_tokens: Daly 's taking a vacation in the hopes of overcoming the dispute .


fn_spacy_tokens_for_baseline: They are paged with the number of the next table that needs attention , instead of having to return each time to the serving hatch .

source_bert_toks: they are page ##d with the number of the next table that needs attention , instead of having to return each time to the serving hatch .

reference_raw: They're covered with the number of another table that needs attention, instead of always having to go back to the service hatch.

reference_spacy_tokens: They 're covered with the number of another table that needs attention , instead of always having to go back to the service hatch .


fn_spacy_tokens_for_baseline: They were a barbaric race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

source_bert_toks: they were a bar ##bari ##c race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

reference_raw: They were a barbarian race, and their care for the region brought about a dark period during which the written word was forgotten and art was lost.

reference_spacy_tokens: They were a barbarian race , and their care for the region brought about a dark period during which the written word was forgotten and art was lost .


fn_spacy_tokens_for_baseline: Brown sausages quickly in the oil , remove from pan , and saute the onions without browning .

source_bert_toks: brown sausage ##s quickly in the oil , remove from pan , and sa ##ute the onions without browning .

reference_raw: The brown sausages are fast in the oil, removed from the pelvis and saturated without browning.

reference_spacy_tokens: The brown sausages are fast in the oil , removed from the pelvis and saturated without browning .


fn_spacy_tokens_for_baseline: Laughing , he stepped under the shower , turning the dial to cold , gasping as the freezing water hit his warm flesh .

source_bert_toks: laughing , he stepped under the shower , turning the dial to cold , gasping as the freezing water hit his warm flesh .

reference_raw: He laughed and went under the shower, turning the dial to cold, gasping as the cold water hit his hot body.

reference_spacy_tokens: He laughed and went under the shower , turning the dial to cold , gasping as the cold water hit his hot body .


fn_spacy_tokens_for_baseline: Locals were told to evacuate , but Duane stayed put .

source_bert_toks: locals were told to evacuate , but duane stayed put .

reference_raw: The locals were told to leave, but Duane stayed where he was.

reference_spacy_tokens: The locals were told to leave , but Duane stayed where he was .


fn_spacy_tokens_for_baseline: The Chinese institutions have loaned one hundred works , including national treasures , most unpublished and virtually unknown outside China .

source_bert_toks: the chinese institutions have loaned one hundred works , including national treasures , most unpublished and virtually unknown outside china .

reference_raw: The Chinese authorities lent 100 works, including national treasures, most unpublished and virtually unknown outside China.

reference_spacy_tokens: The Chinese authorities lent 100 works , including national treasures , most unpublished and virtually unknown outside China .


fn_spacy_tokens_for_baseline: Haider Abu Bakr al Attas , hitherto the South Yemeni President , was named as Prime Minister on May 22 and his government was sworn in on May 27 .

source_bert_toks: hai ##der abu ba ##kr al at ##tas , hit ##her ##to the south yemen ##i president , was named as prime minister on may 22 and his government was sworn in on may 27 .

reference_raw: Haider Abu Bakr al Attas, the president of South Yemeni, was appointed Prime Minister on the 22nd of May, and his government was sworn in on the 27th of May.

reference_spacy_tokens: Haider Abu Bakr al Attas , the president of South Yemeni , was appointed Prime Minister on the 22nd of May , and his government was sworn in on the 27th of May.


fn_spacy_tokens_for_baseline: Although the exterior of the Oberland is very traditional with shuttered windows festooned with flowers and the interior decor is quite modern .

source_bert_toks: although the exterior of the obe ##rland is very traditional with shutter ##ed windows fest ##oon ##ed with flowers and the interior decor is quite modern .

reference_raw: Although the outside of the Oberland is very traditional, with shuttered windows full of flowers, and the interior decor is quite modern.

reference_spacy_tokens: Although the outside of the Oberland is very traditional , with shuttered windows full of flowers , and the interior decor is quite modern .


fn_spacy_tokens_for_baseline: For tonight though patchy cloud'll feed back across the region from the northeast .

source_bert_toks: for tonight though patch ##y cloud ' ll feed back across the region from the northeast .

reference_raw: Tonight, though patchy clouds will feed from the north-east across the region.

reference_spacy_tokens: Tonight , though patchy clouds will feed from the north - east across the region .


fn_spacy_tokens_for_baseline: Under security rules in place at the time , the only consequence of Atta 's selection by CAPPS was that his checked bags were held off the plane until it was confirmed that he had boarded the aircraft .

source_bert_toks: under security rules in place at the time , the only consequence of at ##ta ' s selection by cap ##ps was that his checked bags were held off the plane until it was confirmed that he had boarded the aircraft .

reference_raw: According to the security rules in force at the time, the only consequence of Atta's choice by the CAPPS was to keep his checked luggage off the plane until it was confirmed that he had boarded the plane.

reference_spacy_tokens: According to the security rules in force at the time , the only consequence of Atta 's choice by the CAPPS was to keep his checked luggage off the plane until it was confirmed that he had boarded the plane .


fn_spacy_tokens_for_baseline: When I recounted this to Jean - Claude , he said that innocent peasants regarded frequent bathing as some sort of health precaution , associated with the depravity of the city .

source_bert_toks: when i recounted this to jean - claude , he said that innocent peasants regarded frequent bathing as some sort of health pre ##ca ##ution , associated with the de ##pr ##avi ##ty of the city .

reference_raw: When I told Jean-Claude about it, he told me that innocent peasants considered frequent bathing as a medical precaution associated with the perversion of the city.

reference_spacy_tokens: When I told Jean - Claude about it , he told me that innocent peasants considered frequent bathing as a medical precaution associated with the perversion of the city .


fn_spacy_tokens_for_baseline: Behind her back Katherine , who was almost mesmerized as well as scared by Beatrice , nicknamed her ' Biggy B. ' .

source_bert_toks: behind her back katherine , who was almost me ##sm ##eri ##zed as well as scared by beatrice , nicknamed her ' big ##gy b . ' .

reference_raw: Behind her, Katherine, who was almost hypnotized and frightened by Beatrice, called her "Big B."

reference_spacy_tokens: Behind her , Katherine , who was almost hypnotized and frightened by Beatrice , called her " Big B. "


fn_spacy_tokens_for_baseline: You do n't have to have curtains ; blinds are a good alternative or if the room has a marvellous view you might want to do without any form of window dressing .

source_bert_toks: you don ' t have to have curtains ; blinds are a good alternative or if the room has a marvel ##lous view you might want to do without any form of window dressing .

reference_raw: You don't need curtains; blinds are a good alternative, or if there's a wonderful view in the room, you might want to do it without some kind of window dressing.

reference_spacy_tokens: You do n't need curtains ; blinds are a good alternative , or if there 's a wonderful view in the room , you might want to do it without some kind of window dressing .


fn_spacy_tokens_for_baseline: And the remote possibility of that happy event is enough to make every trip to the mat to pick up the post a potential thrill , despite the near statistical certainty of disappointment .

source_bert_toks: and the remote possibility of that happy event is enough to make every trip to the mat to pick up the post a potential thrill , despite the near statistical certainty of disappointment .

reference_raw: And the remote possibility of such a happy event is enough to make every trip to the mat to pick up a post a potential excitement, despite the near-statistical surety of disappointment.

reference_spacy_tokens: And the remote possibility of such a happy event is enough to make every trip to the mat to pick up a post a potential excitement , despite the near - statistical surety of disappointment .


fn_spacy_tokens_for_baseline: He thinks everyone is corrupt , everyone tries to get money and keep it .

source_bert_toks: he thinks everyone is corrupt , everyone tries to get money and keep it .

reference_raw: They think everybody's dirty, they're all trying to get the money and keep it.

reference_spacy_tokens: They think everybody 's dirty , they 're all trying to get the money and keep it .


fn_spacy_tokens_for_baseline: ' Responding , ' he answered , with a heart - stopping smile .

source_bert_toks: ' responding , ' he answered , with a heart - stopping smile .

reference_raw: "I'm responding," he said, smiling heartily.

reference_spacy_tokens: " I 'm responding , " he said , smiling heartily .


fn_spacy_tokens_for_baseline: Guinness Flight ( 071 - 522 2109 ) pioneered the concept of managed currency funds in the early 1980s and offers both distributor and roll - up versions .

source_bert_toks: guinness flight ( 07 ##1 - 52 ##2 210 ##9 ) pioneered the concept of managed currency funds in the early 1980s and offers both distributor and roll - up versions .

reference_raw: At the beginning of the 1980s, Guinness Flight (071-522 2109) pierced the concept of managed monetary funds and offered both distribution and roll-up versions.

reference_spacy_tokens: At the beginning of the 1980s , Guinness Flight ( 071 - 522 2109 ) pierced the concept of managed monetary funds and offered both distribution and roll - up versions .


fn_spacy_tokens_for_baseline: At once he made for the hill .

source_bert_toks: at once he made for the hill .

reference_raw: He went up the hill immediately.

reference_spacy_tokens: He went up the hill immediately .


fn_spacy_tokens_for_baseline: One calculation , offered by opponents of Darwin 's theory , is based on the improbability of an object as complex as a living organism arising by chance .

source_bert_toks: one calculation , offered by opponents of darwin ' s theory , is based on the imp ##ro ##ba ##bility of an object as complex as a living organism arising by chance .

reference_raw: One of the calculations offered by the opponents of Darwin's theory is based on the implausibility of an object as complex as a living organism created by chance.

reference_spacy_tokens: One of the calculations offered by the opponents of Darwin 's theory is based on the implausibility of an object as complex as a living organism created by chance .


fn_spacy_tokens_for_baseline: And some analysts have forecast that the airline might even go into the red for the first time since it was listed .

source_bert_toks: and some analysts have forecast that the airline might even go into the red for the first time since it was listed .

reference_raw: And some analysts predict that the airline could go to red for the first time since it was on the list.

reference_spacy_tokens: And some analysts predict that the airline could go to red for the first time since it was on the list .


fn_spacy_tokens_for_baseline: No man likes to have his driving criticised . '

source_bert_toks: no man likes to have his driving criticised . '

reference_raw: No man likes to be criticized for driving.'

reference_spacy_tokens: No man likes to be criticized for driving . '


fn_spacy_tokens_for_baseline: The risk is that the shares may fall in value leaving the securities house with a huge loss .

source_bert_toks: the risk is that the shares may fall in value leaving the securities house with a huge loss .

reference_raw: There is a risk that the shares will drop in value, leaving the stock house with a huge loss.

reference_spacy_tokens: There is a risk that the shares will drop in value , leaving the stock house with a huge loss .


fn_spacy_tokens_for_baseline: Belief in God can be eroded from two opposite directions -- from the effort to prove God 's existence on the one hand , and from the denial of any evidence for God 's existence on the other .

source_bert_toks: belief in god can be eroded from two opposite directions - - from the effort to prove god ' s existence on the one hand , and from the denial of any evidence for god ' s existence on the other .

reference_raw: Belief in God can be eroded from two opposite directions, on the one hand, from trying to prove the existence of God, and, on the other hand, from denying any proof of God's existence.

reference_spacy_tokens: Belief in God can be eroded from two opposite directions , on the one hand , from trying to prove the existence of God , and , on the other hand , from denying any proof of God 's existence .


fn_spacy_tokens_for_baseline: Having been left by her husband in his urge for voyages abroad , Erendis retreats to the centre of Numenor , away from the sea , where she hears only the bleating of sheep .

source_bert_toks: having been left by her husband in his urge for voyages abroad , er ##end ##is retreat ##s to the centre of nu ##men ##or , away from the sea , where she hears only the b ##lea ##ting of sheep .

reference_raw: Leaving her husband's desire to go abroad, Erendis retreats to the center of Numenor, away from the sea, where she hears only the bleating of sheep.

reference_spacy_tokens: Leaving her husband 's desire to go abroad , Erendis retreats to the center of Numenor , away from the sea , where she hears only the bleating of sheep .


fn_spacy_tokens_for_baseline: In some ways , life must seem to be a very cruel joke to millions of people on this earth .

source_bert_toks: in some ways , life must seem to be a very cruel joke to millions of people on this earth .

reference_raw: In some ways, life must seem like a very harsh joke to millions of people in the world.

reference_spacy_tokens: In some ways , life must seem like a very harsh joke to millions of people in the world .


fn_spacy_tokens_for_baseline: He unfolded it carefully , took a stub of pencil from his ammunition pouch , and marked a cross where he had seen the enemy cavalry .

source_bert_toks: he unfolded it carefully , took a stu ##b of pencil from his ammunition pouch , and marked a cross where he had seen the enemy cavalry .

reference_raw: Carefully he unfolded it, removed a stub of pencil from his ammo bag, and marked the cross where he had seen the enemy cavalry.

reference_spacy_tokens: Carefully he unfolded it , removed a stub of pencil from his ammo bag , and marked the cross where he had seen the enemy cavalry .