fn_spacy_tokens_for_baseline: If she was trying to impress Luke with her willingness to play by his rules , acting like a jealous child over what was undoubtedly a business phone call was hardly the way to begin .

source_bert_toks: if she was trying to impress luke with her willingness to play by his rules , acting like a jealous child over what was undoubtedly a business phone call was hardly the way to begin .

reference_raw: If she was trying to make an impression on Luke with her willingness to play by his rules, she was acting like a jealous child over what was no doubt a business call wasn't the way to start.

reference_spacy_tokens: If she was trying to make an impression on Luke with her willingness to play by his rules , she was acting like a jealous child over what was no doubt a business call was n't the way to start .


fn_spacy_tokens_for_baseline: On the weekend beginning 29 April , students of water power will be able to learn how to put a project together .

source_bert_toks: on the weekend beginning 29 april , students of water power will be able to learn how to put a project together .

reference_raw: A week early on April 29th, students with water power will be able to learn how to put together a project.

reference_spacy_tokens: A week early on April 29th , students with water power will be able to learn how to put together a project .


fn_spacy_tokens_for_baseline: Or we may say we do not want treatment which ' just keeps us alive without any hope of a cure ' .

source_bert_toks: or we may say we do not want treatment which ' just keeps us alive without any hope of a cure ' .

reference_raw: Or we can say we don't want a cure that "just keeps us going without hope of a cure."

reference_spacy_tokens: Or we can say we do n't want a cure that " just keeps us going without hope of a cure . "


fn_spacy_tokens_for_baseline: One early study of connected handwriting ( Mermelstein and Eden , 1964 ) segmented the input script into upstrokes and downstrokes by segmenting at points of minimum velocity .

source_bert_toks: one early study of connected handwriting ( mer ##mel ##stein and eden , 1964 ) segment ##ed the input script into ups ##tro ##kes and downs ##tro ##kes by segment ##ing at points of minimum velocity .

reference_raw: One first study of linked manuscripts (Mermelstein and Eden, 1964) divided the input script into upstrokes and downstrokes by dividing it at minimum speed points.

reference_spacy_tokens: One first study of linked manuscripts ( Mermelstein and Eden , 1964 ) divided the input script into upstrokes and downstrokes by dividing it at minimum speed points .


fn_spacy_tokens_for_baseline: ' Guide dogs are trained not to pick up such morsels because they may eat something unpleasant or possibly even dangerous .

source_bert_toks: ' guide dogs are trained not to pick up such morse ##ls because they may eat something unpleasant or possibly even dangerous .

reference_raw: The guide dogs are trained not to pick up these bites because they can eat something uncomfortable or even dangerous.

reference_spacy_tokens: The guide dogs are trained not to pick up these bites because they can eat something uncomfortable or even dangerous .


fn_spacy_tokens_for_baseline: It 's known that guys with guns patrol his land , but so what ?

source_bert_toks: it ' s known that guys with guns patrol his land , but so what ?

reference_raw: We know men with guns patrol his country, but what?

reference_spacy_tokens: We know men with guns patrol his country , but what ?


fn_spacy_tokens_for_baseline: Sir Richard Attenborough , chairman of Channel 4 , said it was ' utterly improper that any government should have direct control over the appointment of who will run Channel 4 ' .

source_bert_toks: sir richard at ##ten ##borough , chairman of channel 4 , said it was ' utterly improper that any government should have direct control over the appointment of who will run channel 4 ' .

reference_raw: Sir Richard Attenborough, Chairman of Channel 4, said that it was entirely inappropriate for any government to have direct control over who would be running Channel 4.

reference_spacy_tokens: Sir Richard Attenborough , Chairman of Channel 4 , said that it was entirely inappropriate for any government to have direct control over who would be running Channel 4 .


fn_spacy_tokens_for_baseline: It takes time , effort and money to produce top quality fruit and this is reflected in the price .

source_bert_toks: it takes time , effort and money to produce top quality fruit and this is reflected in the price .

reference_raw: It takes time, effort and money to produce the best-quality products, which is reflected in the price.

reference_spacy_tokens: It takes time , effort and money to produce the best - quality products , which is reflected in the price .


fn_spacy_tokens_for_baseline: The first thing they 'd do if they captured one would be to hack off the two forefingers of each hand , the very ones our archers used to pull a long bow .

source_bert_toks: the first thing they ' d do if they captured one would be to hack off the two fore ##finger ##s of each hand , the very ones our archers used to pull a long bow .

reference_raw: The first thing they would do if they caught one of them was to cut off the two forefingers of each hand, the same ones our archers used to draw the longbow.

reference_spacy_tokens: The first thing they would do if they caught one of them was to cut off the two forefingers of each hand , the same ones our archers used to draw the longbow .


fn_spacy_tokens_for_baseline: Listed here , it all seems transparently bogus or at least deeply suspicious .

source_bert_toks: listed here , it all seems transparent ##ly bog ##us or at least deeply suspicious .

reference_raw: On the list here, everything seems to be transparently false, or at least deeply suspect.

reference_spacy_tokens: On the list here , everything seems to be transparently false , or at least deeply suspect .


fn_spacy_tokens_for_baseline: It was located in a small row of old houses which had survived the war but had little else to say for themselves , being architecturally dull and pressed in on all sides by towering new office blocks and shopping developments .

source_bert_toks: it was located in a small row of old houses which had survived the war but had little else to say for themselves , being architectural ##ly dull and pressed in on all sides by towering new office blocks and shopping developments .

reference_raw: It was in a small line of old houses that had lived through the war, but had nothing to say for themselves; it was architecturally boring, and it was pushed on all sides by towering new office blocks and shopping developments.

reference_spacy_tokens: It was in a small line of old houses that had lived through the war , but had nothing to say for themselves ; it was architecturally boring , and it was pushed on all sides by towering new office blocks and shopping developments .


fn_spacy_tokens_for_baseline: The mourners were relatives of 14-month - old Vedrana Glavas and two - year - old Roki Sulejmanovic , killed when snipers ambushed a bus - load of children fleeing from the civil war last Saturday .

source_bert_toks: the mo ##urne ##rs were relatives of 14 - month - old ve ##dran ##a g ##lav ##as and two - year - old ro ##ki sul ##ej ##man ##ovic , killed when sniper ##s ambushed a bus - load of children fleeing from the civil war last saturday .

reference_raw: The mourners were related to a 14-month-old Vedrana Glavas and a 2-year-old Roki Sulejmanovich who was killed last Saturday when snipers raided a busload of children fleeing the Civil War.

reference_spacy_tokens: The mourners were related to a 14-month - old Vedrana Glavas and a 2-year - old Roki Sulejmanovich who was killed last Saturday when snipers raided a busload of children fleeing the Civil War .


fn_spacy_tokens_for_baseline: ' Because I sinned against them both all those years ago .

source_bert_toks: ' because i sinn ##ed against them both all those years ago .

reference_raw: 'Cause all those years ago, I've committed a crime against both of them.

reference_spacy_tokens: 'Cause all those years ago , I 've committed a crime against both of them .


fn_spacy_tokens_for_baseline: ' Our security staff will be dressed in blazers and slacks .

source_bert_toks: ' our security staff will be dressed in blazers and slacks .

reference_raw: Our security personnel will be dressed in jackets and pants.

reference_spacy_tokens: Our security personnel will be dressed in jackets and pants .


fn_spacy_tokens_for_baseline: Van Gelder had n't made any mistakes about her , Talbot thought , except that he 'd missed out on the wide green eyes and a rather bewitching smile .

source_bert_toks: van gel ##der hadn ' t made any mistakes about her , talbot thought , except that he ' d missed out on the wide green eyes and a rather be ##wi ##tch ##ing smile .

reference_raw: Van Gelder had made no mistake about her, Talbot thought, but he had missed his wide green eyes and a rather charming smile.

reference_spacy_tokens: Van Gelder had made no mistake about her , Talbot thought , but he had missed his wide green eyes and a rather charming smile .


fn_spacy_tokens_for_baseline: Elaine 's elbow was resting on the edge of hers and her hand was supporting her head .

source_bert_toks: elaine ' s elbow was resting on the edge of hers and her hand was supporting her head .

reference_raw: Elaine's arm rested on the edge of hers, her hand supporting her head.

reference_spacy_tokens: Elaine 's arm rested on the edge of hers , her hand supporting her head .


fn_spacy_tokens_for_baseline: ' You judge yourself too harshly , fraulein .

source_bert_toks: ' you judge yourself too harshly , fra ##ule ##in .

reference_raw: 'You're too hard on yourself, Fraulein.

reference_spacy_tokens: ' You 're too hard on yourself , Fraulein .


fn_spacy_tokens_for_baseline: The lobby was tiled in blue and gave access to a stairway leading to a mezzanine built in U - formation around Studio ' A ' .

source_bert_toks: the lobby was tiled in blue and gave access to a stairway leading to a me ##zza ##nine built in u - formation around studio ' a ' .

reference_raw: The hall was tiled in blue, giving access to a stairway leading to a mezzanine built in U-formation around Studio 'A'.

reference_spacy_tokens: The hall was tiled in blue , giving access to a stairway leading to a mezzanine built in U - formation around Studio ' A ' .


fn_spacy_tokens_for_baseline: That he did not depart of his own free will is abundantly evidenced by the fact that he left behind all his belongings and expressed the intention of being back within the period of four hours .

source_bert_toks: that he did not depart of his own free will is abundant ##ly evidenced by the fact that he left behind all his belongings and expressed the intention of being back within the period of four hours .

reference_raw: The fact that he did not leave of his own free will is abundantly illustrated by the fact that he left all his belongings behind and expressed his intention to return within four hours.

reference_spacy_tokens: The fact that he did not leave of his own free will is abundantly illustrated by the fact that he left all his belongings behind and expressed his intention to return within four hours .


fn_spacy_tokens_for_baseline: As for why she consistently gets to appear on television : She 's fuckable , in that weird Sarah Palin way that makes me recoil in horror and wonder what the fuck is wrong with anyone who would touch those women with their worst enemy 's cock .

source_bert_toks: as for why she consistently gets to appear on television : she ' s fuck ##able , in that weird sarah pali ##n way that makes me recoil in horror and wonder what the fuck is wrong with anyone who would touch those women with their worst enemy ' s cock .

reference_raw: As for why he's constantly showing up on TV: he's fucking, in that weird Sarah Palin way that makes me fall back in terror and wonder what the hell's wrong with anyone who's gonna touch those women with their worst enemy's dick.

reference_spacy_tokens: As for why he 's constantly showing up on TV : he 's fucking , in that weird Sarah Palin way that makes me fall back in terror and wonder what the hell 's wrong with anyone who 's gon na touch those women with their worst enemy 's dick .


fn_spacy_tokens_for_baseline: Modern neighborhoods , hospitals , schools , and the Hebrew University were built in West Jerusalem , the new Jewish enclave .

source_bert_toks: modern neighborhoods , hospitals , schools , and the hebrew university were built in west jerusalem , the new jewish enclave .

reference_raw: In West Jerusalem, a new Jewish enclave, modern neighbourhoods, hospitals, colleges, and the University of Hebrew were built.

reference_spacy_tokens: In West Jerusalem , a new Jewish enclave , modern neighbourhoods , hospitals , colleges , and the University of Hebrew were built .


fn_spacy_tokens_for_baseline: Jane pulled on her trousers and tied the drawstring .

source_bert_toks: jane pulled on her trousers and tied the draws ##tri ##ng .

reference_raw: Jane pulled on her pants and tied the drawer.

reference_spacy_tokens: Jane pulled on her pants and tied the drawer .


fn_spacy_tokens_for_baseline: British movements in that direction were verified , and on 9 September Bulow ordered the Second Army to withdraw .

source_bert_toks: british movements in that direction were verified , and on 9 september bu ##low ordered the second army to withdraw .

reference_raw: British movements in this direction were confirmed, and on September 9, Bulow ordered the Second Army to withdraw.

reference_spacy_tokens: British movements in this direction were confirmed , and on September 9 , Bulow ordered the Second Army to withdraw .


fn_spacy_tokens_for_baseline: The boy laughed again , a laugh that was like the growl of a wild animal , then disappeared among the bushes .

source_bert_toks: the boy laughed again , a laugh that was like the growl of a wild animal , then disappeared among the bushes .

reference_raw: The boy laughed again, a laugh like the snarl of a wild animal, and vanished into the bushes.

reference_spacy_tokens: The boy laughed again , a laugh like the snarl of a wild animal , and vanished into the bushes .


fn_spacy_tokens_for_baseline: A feeling of relief suffused her , a little of the burden she had assumed rolled off her shoulders .

source_bert_toks: a feeling of relief su ##ff ##used her , a little of the burden she had assumed rolled off her shoulders .

reference_raw: A sense of relief suffocated her, and some of the burden she had assumed rolled from her shoulders.

reference_spacy_tokens: A sense of relief suffocated her , and some of the burden she had assumed rolled from her shoulders .


fn_spacy_tokens_for_baseline: There is frequently a temptation never to tear oneself away from the hotel .

source_bert_toks: there is frequently a temptation never to tear oneself away from the hotel .

reference_raw: Often, there's a temptation never to pull yourself out of a motel.

reference_spacy_tokens: Often , there 's a temptation never to pull yourself out of a motel .


fn_spacy_tokens_for_baseline: One very simple but effective idea is to hang the picture from a picture rail , or higher point , from a length of cord , rather than wire .

source_bert_toks: one very simple but effective idea is to hang the picture from a picture rail , or higher point , from a length of cord , rather than wire .

reference_raw: One very simple but effective idea is to put a picture on a picture rail, or a higher point, from a length of rope, rather than a wire.

reference_spacy_tokens: One very simple but effective idea is to put a picture on a picture rail , or a higher point , from a length of rope , rather than a wire .


fn_spacy_tokens_for_baseline: ' If it comes to that , ' Sir Bruce rumbled , ' I 've no clear idea why I 'm here myself .

source_bert_toks: ' if it comes to that , ' sir bruce rumbled , ' i ' ve no clear idea why i ' m here myself .

reference_raw: 'In that case,' said Sir Bruce, 'I don't know why I'm here myself.

reference_spacy_tokens: ' In that case , ' said Sir Bruce , ' I do n't know why I 'm here myself .


fn_spacy_tokens_for_baseline: So she crammed six big fellers into her front room , sat them down with rum and blankets , and the whole bunch snuggled up like they were queueing all night to buy tickets for the Test Match .

source_bert_toks: so she cr ##ammed six big fell ##ers into her front room , sat them down with rum and blankets , and the whole bunch snuggled up like they were queue ##ing all night to buy tickets for the test match .

reference_raw: So she stuffed six big guys into the front room, sat them down with rum and blankets, and the whole group snuggled around like they'd been in line all night to buy tickets for the Test Match.

reference_spacy_tokens: So she stuffed six big guys into the front room , sat them down with rum and blankets , and the whole group snuggled around like they 'd been in line all night to buy tickets for the Test Match .


fn_spacy_tokens_for_baseline: Six blocks away a 52-year - old doorman who tried to protect himself with an ice pick was killed by a teenager with an automatic handgun .

source_bert_toks: six blocks away a 52 - year - old door ##man who tried to protect himself with an ice pick was killed by a teenager with an automatic handgun .

reference_raw: Six blocks away, a 52-year-old doorman who tried to protect himself with an ice pick was killed by a teenager with an automatic gun.

reference_spacy_tokens: Six blocks away , a 52-year - old doorman who tried to protect himself with an ice pick was killed by a teenager with an automatic gun .


fn_spacy_tokens_for_baseline: He has also continued to play in international matches for Zimbabwe .

source_bert_toks: he has also continued to play in international matches for zimbabwe .

reference_raw: He also continued to participate in international matches with Zimbabwe.

reference_spacy_tokens: He also continued to participate in international matches with Zimbabwe .


fn_spacy_tokens_for_baseline: After skulking around for half an hour I spotted a kestrel in a tree nearby .

source_bert_toks: after sk ##ul ##king around for half an hour i spotted a ke ##strel in a tree nearby .

reference_raw: After sneaking around for half an hour, I saw a kestrel in a nearby tree.

reference_spacy_tokens: After sneaking around for half an hour , I saw a kestrel in a nearby tree .


fn_spacy_tokens_for_baseline: Macau 's historic center , with its colonial architecture , has a distinctly Mediterranean flavor .

source_bert_toks: macau ' s historic center , with its colonial architecture , has a distinctly mediterranean flavor .

reference_raw: The historical center of Macau, with its colonial architecture, has a distinct Mediterranean flavor.

reference_spacy_tokens: The historical center of Macau , with its colonial architecture , has a distinct Mediterranean flavor .


fn_spacy_tokens_for_baseline: Unlike Levi 's , Guess has made its way in the world by subcontracting out production work , violating minimum - wage and maximum - hour laws , and suing everyone in sight .

source_bert_toks: unlike levi ' s , guess has made its way in the world by sub ##con ##tra ##cting out production work , violating minimum - wage and maximum - hour laws , and sui ##ng everyone in sight .

reference_raw: Unlike Levi's, Guess made his way around the world by sub-contracting production, violating minimum wage and maximum hour law, and suing anyone in view.

reference_spacy_tokens: Unlike Levi 's , Guess made his way around the world by sub - contracting production , violating minimum wage and maximum hour law , and suing anyone in view .


fn_spacy_tokens_for_baseline: Before Curtis 's bleared but exultant vision , the big green Cadillac swerved completely out of control at the end of a hundred yard , rubber - shredding skid , when the front nearside tyre blew out .

source_bert_toks: before curtis ' s b ##lea ##red but ex ##ult ##ant vision , the big green cadillac sw ##erved completely out of control at the end of a hundred yard , rubber - sh ##red ##ding ski ##d , when the front near ##side tyre blew out .

reference_raw: Before Curtis's bleary but exultant vision, the large green Cadillac, at the end of a hundred yards, swung out of control as the front near the tire exploded.

reference_spacy_tokens: Before Curtis 's bleary but exultant vision , the large green Cadillac , at the end of a hundred yards , swung out of control as the front near the tire exploded .


fn_spacy_tokens_for_baseline: GEORGE FOREMAN is ready to carry on fighting after his defeat by Tommy Morrison in Las Vegas on Monday night .

source_bert_toks: george foreman is ready to carry on fighting after his defeat by tommy morrison in las vegas on monday night .

reference_raw: George Foreman is ready to fight after Tommy Morrison beat him in Las Vegas on Monday night.

reference_spacy_tokens: George Foreman is ready to fight after Tommy Morrison beat him in Las Vegas on Monday night .


fn_spacy_tokens_for_baseline: That was on Saturday , 25th April .

source_bert_toks: that was on saturday , 25th april .

reference_raw: It was October 25th, Saturday.

reference_spacy_tokens: It was October 25th , Saturday .


fn_spacy_tokens_for_baseline: It is no accident that the ingenuous and unpretentious Lady Clavering should have left to professionals the task of deciding what is , and what is not , good taste .

source_bert_toks: it is no accident that the ing ##en ##uous and un ##pre ##ten ##tious lady cl ##aver ##ing should have left to professionals the task of deciding what is , and what is not , good taste .

reference_raw: It is no accident that the ingenious and unpretentious Lady Clavering should leave it to the professionals to decide what is and what is not good taste.

reference_spacy_tokens: It is no accident that the ingenious and unpretentious Lady Clavering should leave it to the professionals to decide what is and what is not good taste .


fn_spacy_tokens_for_baseline: Holy Dying was written under the impact of the death of Lady Carbery as well as that of Taylor 's own wife -- ' The bundles of cypress which were intended to dress her closet but now come to dress her hearse ' .

source_bert_toks: holy dying was written under the impact of the death of lady car ##bery as well as that of taylor ' s own wife - - ' the bundles of cypress which were intended to dress her closet but now come to dress her hears ##e ' .

reference_raw: The Holy Dying had been written under the influence of Lady Carbery's death and Taylor's wife's - 'Backs of cypress to dress her wardrobe but now to dress her hearse.'

reference_spacy_tokens: The Holy Dying had been written under the influence of Lady Carbery 's death and Taylor 's wife 's - ' Backs of cypress to dress her wardrobe but now to dress her hearse . '


fn_spacy_tokens_for_baseline: Many people might prefer Bartok 's First Violin Concerto , the obvious and most suitable coupling , but Norbert Moret 's Violin Concerto of 1988 , written for Mutter , receives a quite astounding performance .

source_bert_toks: many people might prefer bart ##ok ' s first violin concerto , the obvious and most suitable coupling , but nor ##bert more ##t ' s violin concerto of 1988 , written for mutter , receives a quite as ##tou ##nding performance .

reference_raw: Many people would have preferred Bartok's first Violin concert, the obvious and most appropriate combination, but Norbert Moret's 1988 Violin Concerto, written for Mutter, received a shocking performance.

reference_spacy_tokens: Many people would have preferred Bartok 's first Violin concert , the obvious and most appropriate combination , but Norbert Moret 's 1988 Violin Concerto , written for Mutter , received a shocking performance .


fn_spacy_tokens_for_baseline: The US also received the right to govern an area of land called the Panama Canal Zone on both sides of the canal .

source_bert_toks: the us also received the right to govern an area of land called the panama canal zone on both sides of the canal .

reference_raw: The US has also been given the right to rule the Panama Canal Zone on both sides of the canal.

reference_spacy_tokens: The US has also been given the right to rule the Panama Canal Zone on both sides of the canal .


fn_spacy_tokens_for_baseline: Mervyn Jones , in an article in The New Statesman in October 1969 , commented on how the short novel he wrote during four months in 1965 became a Hollywood movie outside his control .

source_bert_toks: mer ##vyn jones , in an article in the new statesman in october 1969 , commented on how the short novel he wrote during four months in 1965 became a hollywood movie outside his control .

reference_raw: In an article in the New Statesman of October 1969, Mervyn Jones remarked on how the short novel he had written during the four months of 1965 had become a Hollywood film out of his control.

reference_spacy_tokens: In an article in the New Statesman of October 1969 , Mervyn Jones remarked on how the short novel he had written during the four months of 1965 had become a Hollywood film out of his control .


fn_spacy_tokens_for_baseline: The 28p and 33p stamps show the chronometer 's timekeeping element , the 24p stamp illustrates its decorated enamel dial and the 39p stamp shows the pierced and engraved back of the movement .

source_bert_toks: the 28 ##p and 33 ##p stamps show the ch ##ron ##ometer ' s time ##keeping element , the 24 ##p stamp illustrates its decorated enamel dial and the 39 ##p stamp shows the pierced and engraved back of the movement .

reference_raw: The 28p and 33p stamps show the time-keeping element of the chronometer, the 24p stamp illustrates the decorative dial of the enamel, and the 39p stamp shows the punctured and engraved back of the movement.

reference_spacy_tokens: The 28p and 33p stamps show the time - keeping element of the chronometer , the 24p stamp illustrates the decorative dial of the enamel , and the 39p stamp shows the punctured and engraved back of the movement .


fn_spacy_tokens_for_baseline: Cover them with a bucket or large flower pot , or place a dinner plate on a crown of foliage .

source_bert_toks: cover them with a bucket or large flower pot , or place a dinner plate on a crown of foliage .

reference_raw: Cover them with a bucket or a large flowerpot or place a plate of dinner on the crown of leaves.

reference_spacy_tokens: Cover them with a bucket or a large flowerpot or place a plate of dinner on the crown of leaves .


fn_spacy_tokens_for_baseline: Overseas groups and individuals from such places as Hong Kong , Norway , Malaysia , Kenya and the USA have also written in or called during our silver anniversary year .

source_bert_toks: overseas groups and individuals from such places as hong kong , norway , malaysia , kenya and the usa have also written in or called during our silver anniversary year .

reference_raw: Overseas groups and people from places like Hong Kong, Norway, Malaysia, Kenya and the United States also wrote or called during our silver anniversary.

reference_spacy_tokens: Overseas groups and people from places like Hong Kong , Norway , Malaysia , Kenya and the United States also wrote or called during our silver anniversary .


fn_spacy_tokens_for_baseline: But even the milkman 's timing ca n't compare with those supremos who have perfected the art of appearing at the door at the most irritating time possible -- the Jehovah Witnesses .

source_bert_toks: but even the milk ##man ' s timing can ' t compare with those su ##pre ##mos who have perfect ##ed the art of appearing at the door at the most irritating time possible - - the je ##ho ##vah witnesses .

reference_raw: But even the milkman's timing is no match for those supremos who have perfected the art of appearing at the door in the most irritating time possible - the Jehovah Witnesses.

reference_spacy_tokens: But even the milkman 's timing is no match for those supremos who have perfected the art of appearing at the door in the most irritating time possible - the Jehovah Witnesses .


fn_spacy_tokens_for_baseline: Thirty minutes of fast driving , involving quite a few near collisions in the fog shrouded streets , had finally brought Curtis 's quarry and his unwilling chauffeur clear of the city .

source_bert_toks: thirty minutes of fast driving , involving quite a few near collisions in the fog sh ##roud ##ed streets , had finally brought curtis ' s quarry and his unwilling cha ##uf ##fe ##ur clear of the city .

reference_raw: Thirty minutes of fast driving, with quite a few close encounters in the misty streets, had finally brought Curtis's prey and his involuntary driver out of town.

reference_spacy_tokens: Thirty minutes of fast driving , with quite a few close encounters in the misty streets , had finally brought Curtis 's prey and his involuntary driver out of town .


fn_spacy_tokens_for_baseline: She bent down , undid the zipper , and felt carefully inside the layers of clothing before kicking the bag to one side .

source_bert_toks: she bent down , und ##id the zipper , and felt carefully inside the layers of clothing before kicking the bag to one side .

reference_raw: She bent down, unzipped the zipper, and felt carefully in the layers of her dress before she kicked the bag aside.

reference_spacy_tokens: She bent down , unzipped the zipper , and felt carefully in the layers of her dress before she kicked the bag aside .


fn_spacy_tokens_for_baseline: Various members of his family have resided there from time to time .

source_bert_toks: various members of his family have resided there from time to time .

reference_raw: There were several members of his family who lived there from time to time.

reference_spacy_tokens: There were several members of his family who lived there from time to time .


fn_spacy_tokens_for_baseline: The formal shouts of challenge and reply were made between the guards on the watchtowers and the approaching horsemen , and a moment later there were hooves clattering in the yard .

source_bert_toks: the formal shouts of challenge and reply were made between the guards on the watch ##tower ##s and the approaching horsemen , and a moment later there were hooves cl ##atter ##ing in the yard .

reference_raw: There was a formal cry of challenge and response between the guards on the watchtowers and the approaching riders, and a moment later hoofs rattled in the courtyard.

reference_spacy_tokens: There was a formal cry of challenge and response between the guards on the watchtowers and the approaching riders , and a moment later hoofs rattled in the courtyard .


fn_spacy_tokens_for_baseline: One of the apes that lived among the rooftops of the city scampered down and picked up the peel , then raced back up to his vantage point beside the eaves .

source_bert_toks: one of the apes that lived among the rooftop ##s of the city sc ##amp ##ered down and picked up the peel , then raced back up to his vantage point beside the ea ##ves .

reference_raw: One of the apes who lived among the city's rooftops ran down, picked up the skin, and ran back to his vantage point beside the eaves.

reference_spacy_tokens: One of the apes who lived among the city 's rooftops ran down , picked up the skin , and ran back to his vantage point beside the eaves .


fn_spacy_tokens_for_baseline: I 've read accounts of that incident in which I was supposed to have smashed everything up in his room .

source_bert_toks: i ' ve read accounts of that incident in which i was supposed to have smashed everything up in his room .

reference_raw: I read the story of the incident where I was supposed to smash everything in his room.

reference_spacy_tokens: I read the story of the incident where I was supposed to smash everything in his room .


fn_spacy_tokens_for_baseline: He wrote me a touching letter of thanks .

source_bert_toks: he wrote me a touching letter of thanks .

reference_raw: He wrote me a pathetic thank-you letter.

reference_spacy_tokens: He wrote me a pathetic thank - you letter .


fn_spacy_tokens_for_baseline: Gently fry the banana pieces .

source_bert_toks: gently fry the banana pieces .

reference_raw: Fry the banana bits gently.

reference_spacy_tokens: Fry the banana bits gently .


fn_spacy_tokens_for_baseline: I 'm no good at football , and I have n't had a steady job since last March , ' he said glumly .

source_bert_toks: i ' m no good at football , and i haven ' t had a steady job since last march , ' he said g ##lum ##ly .

reference_raw: I'm not much of a football player, and I haven't had a steady job since last March," he said glumly.

reference_spacy_tokens: I 'm not much of a football player , and I have n't had a steady job since last March , " he said glumly .


fn_spacy_tokens_for_baseline: 3 percent of its shareholders exercised their rights .

reference_raw: Three per cent of its shareholders availed themselves of their rights.

reference_spacy_tokens: Three per cent of its shareholders availed themselves of their rights .


fn_spacy_tokens_for_baseline: Wherever possible he uses machinery to help speed up the process but this is limited to a band - saw , a lathe and a thick strip of metal known as a bending iron .

source_bert_toks: wherever possible he uses machinery to help speed up the process but this is limited to a band - saw , a la ##the and a thick strip of metal known as a bending iron .

reference_raw: Wherever possible, it uses machines to speed up the process, but this is limited to a band saw, a lathe and a thick band of metal known as bending iron.

reference_spacy_tokens: Wherever possible , it uses machines to speed up the process , but this is limited to a band saw , a lathe and a thick band of metal known as bending iron .


fn_spacy_tokens_for_baseline: Fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the South .

source_bert_toks: fifth , the theory may provide at least a partial reason for why ticket splitting has been particularly pronounced in the south .

reference_raw: Fifth, the theory can give at least a partial reason why the distribution of tickets is particularly pronounced in the South.

reference_spacy_tokens: Fifth , the theory can give at least a partial reason why the distribution of tickets is particularly pronounced in the South .


fn_spacy_tokens_for_baseline: The area was called A - Ma Gau ( " Bay of A - Ma ") , and in this way , Macau got its name .

source_bert_toks: the area was called a - ma ga ##u ( " bay of a - ma " ) , and in this way , macau got its name .

reference_raw: Its name was A-Ma Gau ("Bay of A-Ma"), and that's how Macau got its name.

reference_spacy_tokens: Its name was A - Ma Gau ( " Bay of A - Ma " ) , and that 's how Macau got its name .


fn_spacy_tokens_for_baseline: She had been furious when she saw my mask was wet .

source_bert_toks: she had been furious when she saw my mask was wet .

reference_raw: She was angry when she saw that my mask was wet.

reference_spacy_tokens: She was angry when she saw that my mask was wet .


fn_spacy_tokens_for_baseline: There were huge boots , great sweeps of trouser , a mountain range of jacket and , far above , the distant gleam of electric light on a bald head .

source_bert_toks: there were huge boots , great sweeps of tr ##ouse ##r , a mountain range of jacket and , far above , the distant gleam of electric light on a bald head .

reference_raw: There were huge boots, huge sweeps of trousers, a mountain range of jackets, and a distant flash of electric light on his bald head.

reference_spacy_tokens: There were huge boots , huge sweeps of trousers , a mountain range of jackets , and a distant flash of electric light on his bald head .


fn_spacy_tokens_for_baseline: One of the most worrying aspects of the CIA 's morality is the special brand of patriotism it bestows upon itself .

source_bert_toks: one of the most worrying aspects of the cia ' s morality is the special brand of patriot ##ism it best ##ows upon itself .

reference_raw: One of the most disturbing aspects of CIA morality is the special brand of patriotism that it gives itself.

reference_spacy_tokens: One of the most disturbing aspects of CIA morality is the special brand of patriotism that it gives itself .


fn_spacy_tokens_for_baseline: The road descends to valley level in lovely birch woods and reaches a junction where the old road for Tomdoun and Kinlochhourn turns off .

source_bert_toks: the road descends to valley level in lovely birch woods and reaches a junction where the old road for tom ##dou ##n and kin ##lo ##ch ##ho ##urn turns off .

reference_raw: The road goes down to the level of the valley in the beautiful birch forests and reaches the junction where the old road for Tomdoun and Kinlochhoun turns off.

reference_spacy_tokens: The road goes down to the level of the valley in the beautiful birch forests and reaches the junction where the old road for Tomdoun and Kinlochhoun turns off .


fn_spacy_tokens_for_baseline: Wholemeal bread , wholegrain cereals , porridge oats , crispbreads , brown rice , wholemeal pasta , cornmeal , untoasted sugar - free muesli

source_bert_toks: whole ##me ##al bread , whole ##gra ##in cereal ##s , por ##ridge o ##ats , crisp ##bread ##s , brown rice , whole ##me ##al pasta , corn ##me ##al , unto ##ast ##ed sugar - free mu ##es ##li

reference_raw: Wholemeal bread, whole grains, oats, crisp bread, brown rice, wholemeal pasta, cornmeal, untoasted sugar-free muesli

reference_spacy_tokens: Wholemeal bread , whole grains , oats , crisp bread , brown rice , wholemeal pasta , cornmeal , untoasted sugar - free muesli


fn_spacy_tokens_for_baseline: Lisa slept like a stone in the big double bed -- far comfier than her own bed at home -- and awoke to find Emily already up and dressed , pulling on her green rubber wellies .

source_bert_toks: lisa slept like a stone in the big double bed - - far com ##fi ##er than her own bed at home - - and awoke to find emily already up and dressed , pulling on her green rubber well ##ies .

reference_raw: Lisa slept like a stone in a large double bed - much more comfortable than her own bed at home - and woke up to find Emily, already awake and dressed, tugging on her green rubber wells.

reference_spacy_tokens: Lisa slept like a stone in a large double bed - much more comfortable than her own bed at home - and woke up to find Emily , already awake and dressed , tugging on her green rubber wells .


fn_spacy_tokens_for_baseline: To be horrified -- surely the purpose of the horror movie -- we had to be content with films about psychopathic killers who lurked in bushes or deserted mansions .

source_bert_toks: to be horrified - - surely the purpose of the horror movie - - we had to be content with films about psycho ##pathic killers who lu ##rked in bushes or deserted mansions .

reference_raw: In order to be appalled - surely the purpose of the horror film - we had to be content with movies of psychopathic murderers lurking in the bushes or abandoned mansions.

reference_spacy_tokens: In order to be appalled - surely the purpose of the horror film - we had to be content with movies of psychopathic murderers lurking in the bushes or abandoned mansions .


fn_spacy_tokens_for_baseline: I doubt that parasites or other organisms are at fault .

source_bert_toks: i doubt that parasites or other organisms are at fault .

reference_raw: I don't think parasites or other organisms are responsible.

reference_spacy_tokens: I do n't think parasites or other organisms are responsible .


fn_spacy_tokens_for_baseline: Delivery can be adjusted by turning the nozzle head , fitted on a screw thread , to give a fine jet with a range of 2 metres or more or a fine mist comparable with aerosol sprays .

source_bert_toks: delivery can be adjusted by turning the no ##zzle head , fitted on a screw thread , to give a fine jet with a range of 2 metres or more or a fine mist comparable with aero ##sol spray ##s .

reference_raw: The delivery may be modified by turning the nozzle head, mounted on a screw thread, to provide a fine nozzle of 2 metres or more or a fine fog comparable to aerosol sprays.

reference_spacy_tokens: The delivery may be modified by turning the nozzle head , mounted on a screw thread , to provide a fine nozzle of 2 metres or more or a fine fog comparable to aerosol sprays .


fn_spacy_tokens_for_baseline: QN : Does Iran have the means to use biological weapons ?

source_bert_toks: q ##n : does iran have the means to use biological weapons ?

reference_raw: QN: Is Iran equipped with bio-weapons?

reference_spacy_tokens: QN : Is Iran equipped with bio - weapons ?


fn_spacy_tokens_for_baseline: She wore a t - shirt with the name of an American university printed on it , and denim shorts cut ragged round her plump thighs .

source_bert_toks: she wore a t - shirt with the name of an american university printed on it , and denim shorts cut ragged round her plump thighs .

reference_raw: She was wearing a shirt with the name of a U.S. University printed on it, and denim shorts cut raggedly around her plump thighs.

reference_spacy_tokens: She was wearing a shirt with the name of a U.S. University printed on it , and denim shorts cut raggedly around her plump thighs .


fn_spacy_tokens_for_baseline: The Ford lurched and rattled as the tyres struck compacted earth and rock and sent small stones spinning , striking the underside of the van like pistol shots .

source_bert_toks: the ford lurched and rattled as the tyres struck compact ##ed earth and rock and sent small stones spinning , striking the underside of the van like pistol shots .

reference_raw: The Ford lurched and rattled as the tires hit the ground and rock, sending small stones spinning, hitting the bottom of the van like gunfire.

reference_spacy_tokens: The Ford lurched and rattled as the tires hit the ground and rock , sending small stones spinning , hitting the bottom of the van like gunfire .


fn_spacy_tokens_for_baseline: The Trunchbull sensed what the child was thinking and she did n't like it .

source_bert_toks: the tr ##un ##ch ##bu ##ll sensed what the child was thinking and she didn ' t like it .

reference_raw: The Trunchbull felt what the child was thinking, and did not like it.

reference_spacy_tokens: The Trunchbull felt what the child was thinking , and did not like it .


fn_spacy_tokens_for_baseline: Curtis 's hand was reaching into his coat for his own gun , when he paused and made a rapid assessment of the situation .

source_bert_toks: curtis ' s hand was reaching into his coat for his own gun , when he paused and made a rapid assessment of the situation .

reference_raw: Curtis reached into his coat for his gun when he stopped and quickly assessed the situation.

reference_spacy_tokens: Curtis reached into his coat for his gun when he stopped and quickly assessed the situation .


fn_spacy_tokens_for_baseline: Inside they discovered 178 kilos of cannabis resin with a street value of half a million pounds .

source_bert_toks: inside they discovered 178 ki ##los of cannabis resin with a street value of half a million pounds .

reference_raw: Inside, they found a hundred and fifty pounds of cannabis resin with a street value of half a million pounds.

reference_spacy_tokens: Inside , they found a hundred and fifty pounds of cannabis resin with a street value of half a million pounds .


fn_spacy_tokens_for_baseline: California wildfire forces evacuation of thousands

source_bert_toks: california wild ##fire forces evacuation of thousands

reference_raw: Evacuating thousands of California Fire Forces


fn_spacy_tokens_for_baseline: Waiting and more waiting , thought Claudel as he finished breakfast .

source_bert_toks: waiting and more waiting , thought claude ##l as he finished breakfast .

reference_raw: He waited and waited, Claudel thought as he completed his breakfast.

reference_spacy_tokens: He waited and waited , Claudel thought as he completed his breakfast .


fn_spacy_tokens_for_baseline: I also have its organisation flow up to 1969 when many OTO lodge members were arrested and sentenced for child abuse in California .

source_bert_toks: i also have its organisation flow up to 1969 when many ot ##o lodge members were arrested and sentenced for child abuse in california .

reference_raw: I also have its organization until 1969, when a number of OTO tenants were arrested and convicted of child-abuse in California.

reference_spacy_tokens: I also have its organization until 1969 , when a number of OTO tenants were arrested and convicted of child - abuse in California .


fn_spacy_tokens_for_baseline: He then used skills honed in half a lifetime as a successful actor to feign shock and sorrow , said Mr Calvert - Smith .

source_bert_toks: he then used skills hon ##ed in half a lifetime as a successful actor to fei ##gn shock and sorrow , said mr calvert - smith .

reference_raw: Then, as a successful actor, he used skill-honed skills for half his life to pretend shock and grief, said Mr. Calvert-Smith.

reference_spacy_tokens: Then , as a successful actor , he used skill - honed skills for half his life to pretend shock and grief , said Mr. Calvert - Smith .


fn_spacy_tokens_for_baseline: Iran 's plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

source_bert_toks: iran ' s plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

reference_raw: Iran's plans to build a civil nuclear power programme have raised serious concerns about its plan to develop nuclear weapons.

reference_spacy_tokens: Iran 's plans to build a civil nuclear power programme have raised serious concerns about its plan to develop nuclear weapons .


fn_spacy_tokens_for_baseline: The heads of the spears are usually slightly lozenge - sectioned , as a result of beating out the edges , and the socket , normally split on one side , was riveted to the top of the shaft .

source_bert_toks: the heads of the spears are usually slightly lo ##zen ##ge - section ##ed , as a result of beating out the edges , and the socket , normally split on one side , was ri ##vet ##ed to the top of the shaft .

reference_raw: The spearheads are usually slightly decapitated as a result of beating the edges, and the socket, normally divided on one side, has been rived to the top of the shaft.

reference_spacy_tokens: The spearheads are usually slightly decapitated as a result of beating the edges , and the socket , normally divided on one side , has been rived to the top of the shaft .


fn_spacy_tokens_for_baseline: ' You really do n't mind , do you ? ' queried Lindsey .

source_bert_toks: ' you really don ' t mind , do you ? ' que ##ried lindsey .

reference_raw: 'It's really okay with you, isn't it?' said Lindsey.

reference_spacy_tokens: ' It 's really okay with you , is n't it ? ' said Lindsey .


fn_spacy_tokens_for_baseline: Glengoyne Vintage 1967 is an unpeated single malt whisky matured in oak for almost 25 years .

source_bert_toks: glen ##go ##yne vintage 1967 is an un ##pe ##ated single mal ##t whisky mature ##d in oak for almost 25 years .

reference_raw: Glengoyne Vintage 1967 is a single malt whisky grown in oak for nearly 25 years.

reference_spacy_tokens: Glengoyne Vintage 1967 is a single malt whisky grown in oak for nearly 25 years .


fn_spacy_tokens_for_baseline: Hostility -- ' I suppose you think that we 're all alcoholics or addicts of some kind and that we all ought to give up everything we enjoy ' .

source_bert_toks: hostility - - ' i suppose you think that we ' re all alcoholic ##s or addict ##s of some kind and that we all ought to give up everything we enjoy ' .

reference_raw: I suppose you think we're all drunks or addicts, and we should all give up everything we like.'

reference_spacy_tokens: I suppose you think we 're all drunks or addicts , and we should all give up everything we like . '


fn_spacy_tokens_for_baseline: Everything was glossy , filmed with silver .

source_bert_toks: everything was glossy , filmed with silver .

reference_raw: Everything was shiny, covered in silver.

reference_spacy_tokens: Everything was shiny , covered in silver .


fn_spacy_tokens_for_baseline: These gardens used to belong to the governor 's mountain lodge , but the building was demolished by the Japanese during the occupation of Hong Kong .

source_bert_toks: these gardens used to belong to the governor ' s mountain lodge , but the building was demolished by the japanese during the occupation of hong kong .

reference_raw: These gardens were once part of the Governor's mountain hut, but the building was destroyed by the Japanese during Hong Kong's occupation.

reference_spacy_tokens: These gardens were once part of the Governor 's mountain hut , but the building was destroyed by the Japanese during Hong Kong 's occupation .


fn_spacy_tokens_for_baseline: The sight of her in the old tatty jumpers she slept in always brought him back to reality .

source_bert_toks: the sight of her in the old ta ##tty jumper ##s she slept in always brought him back to reality .

reference_raw: The sight of her in the old tattooed sweaters she had slept in always brought him back to reality.

reference_spacy_tokens: The sight of her in the old tattooed sweaters she had slept in always brought him back to reality .


fn_spacy_tokens_for_baseline: The long - standing links between urban workers and their furusato in the countryside were exploited to the full as refugees from urban areas sought help from their country relatives .

source_bert_toks: the long - standing links between urban workers and their fur ##usa ##to in the countryside were exploited to the full as refugees from urban areas sought help from their country relatives .

reference_raw: Long-term connections between urban workers and their furusato in the countryside have been fully exploited as refugees from urban areas have sought the assistance of their country's kin.

reference_spacy_tokens: Long - term connections between urban workers and their furusato in the countryside have been fully exploited as refugees from urban areas have sought the assistance of their country 's kin .


fn_spacy_tokens_for_baseline: Carbon dioxide from the atmosphere made the water slightly acidic so it corroded the limestone , and where the water had to get through peaty soil before it hit the rock the acidity was stronger .

source_bert_toks: carbon dioxide from the atmosphere made the water slightly acidic so it co ##rro ##ded the limestone , and where the water had to get through peat ##y soil before it hit the rock the acid ##ity was stronger .

reference_raw: The carbon dioxide from the atmosphere made the water a little acidic, so it corrosived the limestone, and where the water had to pass through the peaty soil before it hit the rock, the acidity was stronger.

reference_spacy_tokens: The carbon dioxide from the atmosphere made the water a little acidic , so it corrosived the limestone , and where the water had to pass through the peaty soil before it hit the rock , the acidity was stronger .


fn_spacy_tokens_for_baseline: The small sign beside it proudly stated ' Direct Dial Telephone ' .

source_bert_toks: the small sign beside it proudly stated ' direct dial telephone ' .

reference_raw: A small sign next to him proudly marked 'Direct dial phone'.

reference_spacy_tokens: A small sign next to him proudly marked ' Direct dial phone ' .


fn_spacy_tokens_for_baseline: Then he turned on his answering - machine and flinched at the call from Nick .

source_bert_toks: then he turned on his answering - machine and flinched at the call from nick .

reference_raw: Then he turned on his answering machine and winced at Nick's summons.

reference_spacy_tokens: Then he turned on his answering machine and winced at Nick 's summons .


fn_spacy_tokens_for_baseline: She would walk through the house , dressed to go out , relishing the silence , the order , the shine of polished wood in the sun .

source_bert_toks: she would walk through the house , dressed to go out , re ##lish ##ing the silence , the order , the shine of polished wood in the sun .

reference_raw: She walked through the house, dressed to go out, enjoying the silence, the order, the gleam of polished wood in the sun.

reference_spacy_tokens: She walked through the house , dressed to go out , enjoying the silence , the order , the gleam of polished wood in the sun .


fn_spacy_tokens_for_baseline: With effort , vast at first , diminishing by slow degrees , she suppressed her body 's compulsions .

source_bert_toks: with effort , vast at first , dim ##ini ##shing by slow degrees , she suppressed her body ' s compulsion ##s .

reference_raw: With an effort, huge at first, slowly shrinking, she suppressed the urges of her body.

reference_spacy_tokens: With an effort , huge at first , slowly shrinking , she suppressed the urges of her body .


fn_spacy_tokens_for_baseline: She told us that , in general , putting the Pakistanis on the terrorist list would eliminate any influence the United States had over them .

source_bert_toks: she told us that , in general , putting the pakistani ##s on the terrorist list would eliminate any influence the united states had over them .

reference_raw: She said that, in general, putting Pakistanis on the terrorist list would eliminate any effect the United States has on them.

reference_spacy_tokens: She said that , in general , putting Pakistanis on the terrorist list would eliminate any effect the United States has on them .


fn_spacy_tokens_for_baseline: Some light rain or sleet on Friday in the north and east , otherwise mostly dry .

source_bert_toks: some light rain or sl ##eet on friday in the north and east , otherwise mostly dry .

reference_raw: A little bit of rain or snow on Friday in the north and east, but most of the time it's dry.

reference_spacy_tokens: A little bit of rain or snow on Friday in the north and east , but most of the time it 's dry .


fn_spacy_tokens_for_baseline: Lady Henrietta knew what was right : everything about her was right , from her tightly bound dark hair to her dark - blue satin slippers .

source_bert_toks: lady henrietta knew what was right : everything about her was right , from her tightly bound dark hair to her dark - blue satin slip ##pers .

reference_raw: Lady Henrietta knew what was right: everything about her was right, from her tight, dark hair to her dark blue satin shoes.

reference_spacy_tokens: Lady Henrietta knew what was right : everything about her was right , from her tight , dark hair to her dark blue satin shoes .


fn_spacy_tokens_for_baseline: The Hearthware was dressed in a plain hide jerkin ; most of their armour had been lost in the flight north and was at the bottom of the river by now .

source_bert_toks: the hearth ##ware was dressed in a plain hide jerk ##in ; most of their armour had been lost in the flight north and was at the bottom of the river by now .

reference_raw: The Hearthwart was dressed in a simple leather jacket; most of their armor had been lost in the flight north and was already at the bottom of the river.

reference_spacy_tokens: The Hearthwart was dressed in a simple leather jacket ; most of their armor had been lost in the flight north and was already at the bottom of the river .


fn_spacy_tokens_for_baseline: Two men stumbled along ahead of the wheels treading out a safe path across the seething grass .

source_bert_toks: two men stumbled along ahead of the wheels tread ##ing out a safe path across the see ##thing grass .

reference_raw: Two men stumbled in front of the wheels, striding down a safe path through the wet grass.

reference_spacy_tokens: Two men stumbled in front of the wheels , striding down a safe path through the wet grass .


fn_spacy_tokens_for_baseline: Last year the president was killed by rebels whom the Americans did not try to stop .

source_bert_toks: last year the president was killed by rebels whom the americans did not try to stop .

reference_raw: Last year, the president was murdered by rebels the Americans didn't try to stop.

reference_spacy_tokens: Last year , the president was murdered by rebels the Americans did n't try to stop .


fn_spacy_tokens_for_baseline: Residents and former residents of a Lincoln Place mobile home park that is being demolished to make way for a city - owned community center are demanding that the government compensate them for lost trailers and relocation costs .

source_bert_toks: residents and former residents of a lincoln place mobile home park that is being demolished to make way for a city - owned community center are demanding that the government compensate them for lost trailers and relocation costs .

reference_raw: Residents and former residents of the Lincoln Place mobile home park, which is being destroyed to make way for the city centre, demand compensation from the government for lost trailers and relocation costs.

reference_spacy_tokens: Residents and former residents of the Lincoln Place mobile home park , which is being destroyed to make way for the city centre , demand compensation from the government for lost trailers and relocation costs .


fn_spacy_tokens_for_baseline: The bone is also more extensively broken by the diurnal species during feeding , and it is less broken by owls .

source_bert_toks: the bone is also more extensively broken by the di ##urn ##al species during feeding , and it is less broken by owls .

reference_raw: The bone is also more extensively fractured during feeding by the diurnal species and is less fractured by the owls.

reference_spacy_tokens: The bone is also more extensively fractured during feeding by the diurnal species and is less fractured by the owls .


fn_spacy_tokens_for_baseline: Subsequently , two members of this team complained about their leader to a director : ' He 's slowing us down , ' they moaned .

source_bert_toks: subsequently , two members of this team complained about their leader to a director : ' he ' s slowing us down , ' they moaned .

reference_raw: Then two members of the team complained to the director about their leader: "He's slowing us down," they groaned.

reference_spacy_tokens: Then two members of the team complained to the director about their leader : " He 's slowing us down , " they groaned .


fn_spacy_tokens_for_baseline: The presumption of innocence has not been toppled ; rather , it has been corroded by a series of laws on alcohol and tobacco , football hooliganism , drugs , videos and even badgers .

source_bert_toks: the pre ##sum ##ption of innocence has not been toppled ; rather , it has been co ##rro ##ded by a series of laws on alcohol and tobacco , football ho ##oli ##gan ##ism , drugs , videos and even badger ##s .

reference_raw: On the contrary, it was confirmed by a series of laws on alcohol and tobacco, football hooliganism, drugs, videos, and even badgers.

reference_spacy_tokens: On the contrary , it was confirmed by a series of laws on alcohol and tobacco , football hooliganism , drugs , videos , and even badgers .


fn_spacy_tokens_for_baseline: Fran did n't want to look at him , did n't want to turn her head and see the anger in those dark eyes , but there was no escaping the powerful force that drew her .

source_bert_toks: fran didn ' t want to look at him , didn ' t want to turn her head and see the anger in those dark eyes , but there was no escaping the powerful force that drew her .

reference_raw: Fran did not want to look at him, did not want to turn her head and see the anger in those dark eyes, but she could not escape the power that had drawn her.

reference_spacy_tokens: Fran did not want to look at him , did not want to turn her head and see the anger in those dark eyes , but she could not escape the power that had drawn her .


fn_spacy_tokens_for_baseline: By the sixth and early seventh century civilisation in Europe had declined to its lowest point .

source_bert_toks: by the sixth and early seventh century civil ##isation in europe had declined to its lowest point .

reference_raw: By the 6th and early 7th century, civilization in Europe had fallen to its lowest point.

reference_spacy_tokens: By the 6th and early 7th century , civilization in Europe had fallen to its lowest point .


fn_spacy_tokens_for_baseline: The growth of private home - ownership and car - ownership , reduction in the number of voters dependent on council housing , expansion of self - employment ( up from 1.9 million to 3 million between 1979 and 1989 ) and of employment in the private sector , and a fall in the public - sector employment , may also work against the party .

source_bert_toks: the growth of private home - ownership and car - ownership , reduction in the number of voters dependent on council housing , expansion of self - employment ( up from 1 . 9 million to 3 million between 1979 and 1989 ) and of employment in the private sector , and a fall in the public - sector employment , may also work against the party .

reference_raw: The party may also be affected by the increase in private home ownership and car ownership, the reduction in the number of voters dependent on board housing, the expansion of self-employment (from 1.9 million to 3 million between 1979 and 1989) and the number of private-sector employees, and the decline in public-sector work.

reference_spacy_tokens: The party may also be affected by the increase in private home ownership and car ownership , the reduction in the number of voters dependent on board housing , the expansion of self - employment ( from 1.9 million to 3 million between 1979 and 1989 ) and the number of private - sector employees , and the decline in public - sector work .


fn_spacy_tokens_for_baseline: QUASI 's findings may be consistent with the existence of gaps in the carbohydrate groups thought to mask the silent face from gp120 from immune surveillance .

source_bert_toks: quasi ' s findings may be consistent with the existence of gaps in the car ##bo ##hy ##dra ##te groups thought to mask the silent face from gp ##12 ##0 from immune surveillance .

reference_raw: The findings of QUASI may be consistent with the existence of gaps in the carbohydrate groups that are considered to mask the silent facial expression from GP120 from immune surveillance.

reference_spacy_tokens: The findings of QUASI may be consistent with the existence of gaps in the carbohydrate groups that are considered to mask the silent facial expression from GP120 from immune surveillance .


fn_spacy_tokens_for_baseline: It was plain that the two great detectives were discomfited by each other 's presence .

source_bert_toks: it was plain that the two great detectives were disco ##m ##fi ##ted by each other ' s presence .

reference_raw: It was clear that the two great detectives were not satisfied with each other's presence.

reference_spacy_tokens: It was clear that the two great detectives were not satisfied with each other 's presence .


fn_spacy_tokens_for_baseline: On the other hand , they are less likely to be apprehended or detained by the police for drug and/or non - drug offences .

source_bert_toks: on the other hand , they are less likely to be app ##re ##hend ##ed or detained by the police for drug and / or non - drug offences .

reference_raw: On the other hand, they are less likely to be arrested or detained by the police for drug and/or drug offences.

reference_spacy_tokens: On the other hand , they are less likely to be arrested or detained by the police for drug and/or drug offences .


fn_spacy_tokens_for_baseline: ' You poor thing , ' said Moynihan , promptly jogging off in the direction of Hove .

source_bert_toks: ' you poor thing , ' said mo ##yn ##ih ##an , promptly jogging off in the direction of hove .

reference_raw: 'You poor thing,' Moynihan said, running quickly toward Hove.

reference_spacy_tokens: ' You poor thing , ' Moynihan said , running quickly toward Hove .


fn_spacy_tokens_for_baseline: ' I have exhorted my wife to the point where I am at a loss for patient words , ' he protested .

source_bert_toks: ' i have ex ##hort ##ed my wife to the point where i am at a loss for patient words , ' he protested .

reference_raw: "I've exhilarated my wife to the point where I'm embarrassed by patient words," he protested.

reference_spacy_tokens: " I 've exhilarated my wife to the point where I 'm embarrassed by patient words , " he protested .


fn_spacy_tokens_for_baseline: They were smoking cigars , hawking and spitting and shaking hands with friends or associates .

source_bert_toks: they were smoking cigar ##s , hawk ##ing and spitting and shaking hands with friends or associates .

reference_raw: They smoked cigars, falconed, spat, and shook hands with friends or companions.

reference_spacy_tokens: They smoked cigars , falconed , spat , and shook hands with friends or companions .


fn_spacy_tokens_for_baseline: James 's partiality for elegant variation ( 69 ) is well illustrated in the passage , particularly in the way he varies the manner of referring to the three characters .

source_bert_toks: james ' s partial ##ity for elegant variation ( 69 ) is well illustrated in the passage , particularly in the way he varies the manner of referring to the three characters .

reference_raw: The fact that James is partial to elegant variations (69) is well illustrated in the passage, especially in the way in which he differs in the way in which he refers to the three characters.

reference_spacy_tokens: The fact that James is partial to elegant variations ( 69 ) is well illustrated in the passage , especially in the way in which he differs in the way in which he refers to the three characters .


fn_spacy_tokens_for_baseline: Then he tottered to the home , polybag empty of crusts .

source_bert_toks: then he to ##ttered to the home , poly ##bag empty of crust ##s .

reference_raw: Then he trotted into the house, a polybag empty of crusts.

reference_spacy_tokens: Then he trotted into the house , a polybag empty of crusts .


fn_spacy_tokens_for_baseline: Mr. Page then petitioned the visitor for a declaration that his purported dismissal was ultra vires and of no effect .

source_bert_toks: mr . page then petitioned the visitor for a declaration that his purported dismissal was ultra vi ##res and of no effect .

reference_raw: Mr. Page then asked the visitor to declare that his alleged dismissal was ultra vires and had no effect.

reference_spacy_tokens: Mr. Page then asked the visitor to declare that his alleged dismissal was ultra vires and had no effect .


fn_spacy_tokens_for_baseline: The film , directed by Guilty By Suspicion director Irwin Winkler , is released here at the end of January ' 93 .

source_bert_toks: the film , directed by guilty by suspicion director irwin winkler , is released here at the end of january ' 93 .

reference_raw: The film, led by Guilty By Suspect Director Irwin Winkler, was released here in late January 1993.

reference_spacy_tokens: The film , led by Guilty By Suspect Director Irwin Winkler , was released here in late January 1993 .


fn_spacy_tokens_for_baseline: Li Shai Tung looked across at him , smiling ; but behind the smile -- beyond it , in some darker , less accessible place -- lay a deep disquiet .

source_bert_toks: li sha ##i tung looked across at him , smiling ; but behind the smile - - beyond it , in some darker , less accessible place - - lay a deep di ##s ##qui ##et .

reference_raw: Li Shai Tung looked at him and smiled; but behind the smile, behind it, in a darker, less accessible place, lay a deep uneasiness.

reference_spacy_tokens: Li Shai Tung looked at him and smiled ; but behind the smile , behind it , in a darker , less accessible place , lay a deep uneasiness .


fn_spacy_tokens_for_baseline: At the end of the book of Deuteronomy Moses climbs up to the summit of Mount Nebo ' which is opposite Jericho ' ( Deut .

source_bert_toks: at the end of the book of de ##uter ##ono ##my moses climbs up to the summit of mount ne ##bo ' which is opposite jericho ' ( de ##ut .

reference_raw: At the end of the book of Deuteronomy Moses climbs to the top of Nebo Mountain, which is across from Jericho.

reference_spacy_tokens: At the end of the book of Deuteronomy Moses climbs to the top of Nebo Mountain , which is across from Jericho .


fn_spacy_tokens_for_baseline: ' And what if I simply walk out , and to hell with the consequences ? '

source_bert_toks: ' and what if i simply walk out , and to hell with the consequences ? '

reference_raw: "What if I just leave, and the hell with the consequences?"

reference_spacy_tokens: " What if I just leave , and the hell with the consequences ? "


fn_spacy_tokens_for_baseline: It is socialisation that transforms ageing into something that is to be feared , and leads us to believe that older people are to be pitied .

source_bert_toks: it is social ##isation that transforms age ##ing into something that is to be feared , and leads us to believe that older people are to be pit ##ied .

reference_raw: It is socialization that transforms ageing into something to be feared and leads us to believe that older people should be regretted.

reference_spacy_tokens: It is socialization that transforms ageing into something to be feared and leads us to believe that older people should be regretted .


fn_spacy_tokens_for_baseline: Most assembly work is still too complex to be done by the present generation of relatively senseless machines .

source_bert_toks: most assembly work is still too complex to be done by the present generation of relatively sense ##less machines .

reference_raw: Most of the assembly work is still too complex for the current production of relatively pointless machines.

reference_spacy_tokens: Most of the assembly work is still too complex for the current production of relatively pointless machines .


fn_spacy_tokens_for_baseline: There was silence , and his eyes smarted .

source_bert_toks: there was silence , and his eyes smart ##ed .

reference_raw: There was silence, and his eyes brightened.

reference_spacy_tokens: There was silence , and his eyes brightened .


fn_spacy_tokens_for_baseline: The Iranian government maintained its neutrality on the Gulf crisis [ see p. 37696 ] , reacting cautiously to news of the allied attack on Iraq on Jan. 16 .

source_bert_toks: the iranian government maintained its neutrality on the gulf crisis [ see p . 37 ##6 ##9 ##6 ] , reacting cautiously to news of the allied attack on iraq on jan . 16 .

reference_raw: The Government of Iran continued to be neutral in the context of the Gulf crisis [see p. 37696] and reacted carefully to the news of the Allied attack on Iraq on January 16.

reference_spacy_tokens: The Government of Iran continued to be neutral in the context of the Gulf crisis [ see p. 37696 ] and reacted carefully to the news of the Allied attack on Iraq on January 16 .


fn_spacy_tokens_for_baseline: Murray grabbed him under the ribs and they reached the bottom of the stairs .

source_bert_toks: murray grabbed him under the ribs and they reached the bottom of the stairs .

reference_raw: Murray caught him by the ribs and they reached the foot of the stairs.

reference_spacy_tokens: Murray caught him by the ribs and they reached the foot of the stairs .


fn_spacy_tokens_for_baseline: Elizabeth 's face lit up , as she told him of Martha 's excitement over the clothes sent by Tamar .

source_bert_toks: elizabeth ' s face lit up , as she told him of martha ' s excitement over the clothes sent by tam ##ar .

reference_raw: Elizabeth's face lit up as she told him of Martha's enthusiasm for the clothing Tamar had sent.

reference_spacy_tokens: Elizabeth 's face lit up as she told him of Martha 's enthusiasm for the clothing Tamar had sent .


fn_spacy_tokens_for_baseline: Many of the words used in palaeography have broad meanings in normal English usage , or may be used in more than one way .

source_bert_toks: many of the words used in pal ##ae ##ography have broad meanings in normal english usage , or may be used in more than one way .

reference_raw: Many of the words used in palaeography are widely used in the normal use of English or can be used in more than one way.

reference_spacy_tokens: Many of the words used in palaeography are widely used in the normal use of English or can be used in more than one way .


fn_spacy_tokens_for_baseline: Subject headings lists are normally generated for a particular purpose .

source_bert_toks: subject heading ##s lists are normally generated for a particular purpose .

reference_raw: Lists of items are usually produced for a specific purpose.

reference_spacy_tokens: Lists of items are usually produced for a specific purpose .


fn_spacy_tokens_for_baseline: The reason we leased the Buckfastleigh Branch to the S.R.D.T. was made clear in the press release at the time , of which we enclose a copy .

source_bert_toks: the reason we leased the buck ##fast ##leigh branch to the s . r . d . t . was made clear in the press release at the time , of which we en ##cl ##ose a copy .

reference_raw: The reason why we rented the Buckfastleigh branch to S.R.D.T. was explained in a press release at the time, including a copy.

reference_spacy_tokens: The reason why we rented the Buckfastleigh branch to S.R.D.T. was explained in a press release at the time , including a copy .


fn_spacy_tokens_for_baseline: While several Iranian leaders felt that developing a CW program would counteract the Iraqi threat and prove to be a strong deterrent , others within the clerical Islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - Islamic .

source_bert_toks: while several iranian leaders felt that developing a cw program would counter ##act the iraqi threat and prove to be a strong deter ##rent , others within the clerical islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - islamic .

reference_raw: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove to be a powerful deterrent, others in the Islamic clerical regime publicly condemned any use of chemicals for moral reasons and called them un-Islamic.

reference_spacy_tokens: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove to be a powerful deterrent , others in the Islamic clerical regime publicly condemned any use of chemicals for moral reasons and called them un - Islamic .


fn_spacy_tokens_for_baseline: The king ate several more lettuces but he got no better .

source_bert_toks: the king ate several more let ##tu ##ces but he got no better .

reference_raw: The King ate a few more salads, but he didn't get any better.

reference_spacy_tokens: The King ate a few more salads , but he did n't get any better .


fn_spacy_tokens_for_baseline: He spelled out his forename .

source_bert_toks: he spelled out his fore ##name .

reference_raw: He wrote his first name.

reference_spacy_tokens: He wrote his first name .


fn_spacy_tokens_for_baseline: She had an embarrassed recollection of having burst into tears , of demanding to know how long the affair with Henrietta had been going on .

source_bert_toks: she had an embarrassed rec ##oll ##ection of having burst into tears , of demanding to know how long the affair with henrietta had been going on .

reference_raw: She remembered, embarrassed, that she had burst into tears, that she wanted to know how long the affair with Henrietta had lasted.

reference_spacy_tokens: She remembered , embarrassed , that she had burst into tears , that she wanted to know how long the affair with Henrietta had lasted .


fn_spacy_tokens_for_baseline: Well , you 've heard the story of how your mother got soaked on the third tee in a downpour .

source_bert_toks: well , you ' ve heard the story of how your mother got soaked on the third tee in a down ##pour .

reference_raw: You know the story about your mother getting soaked on the third tee in the rain.

reference_spacy_tokens: You know the story about your mother getting soaked on the third tee in the rain .


fn_spacy_tokens_for_baseline: Speaking more generally , I suppose that I could sum up the Prime Minister 's speech -- without rancour -- as timid , devoid of national purpose and lacking in inspiration .

source_bert_toks: speaking more generally , i suppose that i could sum up the prime minister ' s speech - - without ran ##co ##ur - - as tim ##id , devoid of national purpose and lacking in inspiration .

reference_raw: In more general terms, I think I can summarise the Prime Minister's speech - without rancour - as timid, devoid of national purpose and lack of inspiration.

reference_spacy_tokens: In more general terms , I think I can summarise the Prime Minister 's speech - without rancour - as timid , devoid of national purpose and lack of inspiration .


fn_spacy_tokens_for_baseline: In southern Greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

source_bert_toks: in southern greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

reference_raw: Today, in southern Greece, huge forest fires continue to ignite as they destroy homes and cause serious damage to the region.

reference_spacy_tokens: Today , in southern Greece , huge forest fires continue to ignite as they destroy homes and cause serious damage to the region .


fn_spacy_tokens_for_baseline: A necessary evil for patients like Christine Tweddle .

source_bert_toks: a necessary evil for patients like christine t ##wed ##dle .

reference_raw: Evident evil for patients like Christine Tweddle.

reference_spacy_tokens: Evident evil for patients like Christine Tweddle .


fn_spacy_tokens_for_baseline: A thermos of soup , cups , a plate of sandwiches waited on an ugly silver tray in the hall ; a domestic attention marking the end of the party .

source_bert_toks: a the ##rm ##os of soup , cups , a plate of sandwiches waited on an ugly silver tray in the hall ; a domestic attention marking the end of the party .

reference_raw: On the ugly silver tray in the hall was a therm of soup, cups, and a plate of sandwiches; a homely attention marked the end of the party.

reference_spacy_tokens: On the ugly silver tray in the hall was a therm of soup , cups , and a plate of sandwiches ; a homely attention marked the end of the party .


fn_spacy_tokens_for_baseline: Like most of the other 6,000 churches in Britain with sets of bells , St. Michael once had its own " band " of ringers , who would herald every Sunday morning and evening service .

source_bert_toks: like most of the other 6 , 000 churches in britain with sets of bells , st . michael once had its own " band " of ring ##ers , who would herald every sunday morning and evening service .

reference_raw: Like most 6,000 churches in Britain with bells, St. Michael had his own ringer group, who would herald every Sunday morning and evening service.

reference_spacy_tokens: Like most 6,000 churches in Britain with bells , St. Michael had his own ringer group , who would herald every Sunday morning and evening service .


fn_spacy_tokens_for_baseline: True , the disease would sooner or later reach Norway after travelling up through Finland , but the Norwegian government had decided to stall it as long as possible .

source_bert_toks: true , the disease would sooner or later reach norway after travelling up through finland , but the norwegian government had decided to stall it as long as possible .

reference_raw: It is true that the disease will arrive in Norway sooner or later after its journey through Finland, but the Norwegian Government has decided to delay it as long as possible.

reference_spacy_tokens: It is true that the disease will arrive in Norway sooner or later after its journey through Finland , but the Norwegian Government has decided to delay it as long as possible .


fn_spacy_tokens_for_baseline: The ' Shivering Mountain ' derives its name from being a distinctly unstable lump of land , given to landslips .

source_bert_toks: the ' shivering mountain ' derives its name from being a distinctly unstable lump of land , given to lands ##lip ##s .

reference_raw: The Shivering Mountain derives its name from the fact that it is a distinctly unstable piece of land given to landslips.

reference_spacy_tokens: The Shivering Mountain derives its name from the fact that it is a distinctly unstable piece of land given to landslips .


fn_spacy_tokens_for_baseline: I remember a tear running down my cheek and me trying to smile it away .

source_bert_toks: i remember a tear running down my cheek and me trying to smile it away .

reference_raw: I remember a tear streaming down my face and trying to smile it away.

reference_spacy_tokens: I remember a tear streaming down my face and trying to smile it away .


fn_spacy_tokens_for_baseline: Following are excerpts from the electronic traffic that night .

source_bert_toks: following are excerpts from the electronic traffic that night .

reference_raw: There are traces of electronic traffic that evening.

reference_spacy_tokens: There are traces of electronic traffic that evening .


fn_spacy_tokens_for_baseline: He wanted to throw off his jacket , kick off his boots , sit under the tree at the back of the house and drink a jug of cool buttermilk .

source_bert_toks: he wanted to throw off his jacket , kick off his boots , sit under the tree at the back of the house and drink a jug of cool butter ##mi ##lk .

reference_raw: He wanted to throw off his jacket, kick off his shoes, sit in the back of the house under a tree and drink a pitcher of cold buttermilk.

reference_spacy_tokens: He wanted to throw off his jacket , kick off his shoes , sit in the back of the house under a tree and drink a pitcher of cold buttermilk .


fn_spacy_tokens_for_baseline: One day we sat there enthralled by Hiroshima Mon Amour .

source_bert_toks: one day we sat there en ##th ##ral ##led by hiroshima mon amour .

reference_raw: We sat there one day, fascinated by Hiroshima Mon Amour.

reference_spacy_tokens: We sat there one day , fascinated by Hiroshima Mon Amour .


fn_spacy_tokens_for_baseline: Attempts to illustrate their size tend to stupefy rather than enlighten .

source_bert_toks: attempts to illustrate their size tend to stu ##pe ##fy rather than en ##light ##en .

reference_raw: Attempts to illustrate their size tend to be stupendous rather than enlightened.

reference_spacy_tokens: Attempts to illustrate their size tend to be stupendous rather than enlightened .


fn_spacy_tokens_for_baseline: Associated Press reported on Nov. 29 that only 100 people had accepted the amnesty offer , while 150 more people had been arrested the previous week , adding to thousands of FIS supporters detained without trial .

source_bert_toks: associated press reported on nov . 29 that only 100 people had accepted the amnesty offer , while 150 more people had been arrested the previous week , adding to thousands of fis supporters detained without trial .

reference_raw: On November 29, Associated Press reported that only 100 people accepted the offer of amnesty, while 150 other people were arrested last week, adding to thousands of FIS supporters who had been detained without trial.

reference_spacy_tokens: On November 29 , Associated Press reported that only 100 people accepted the offer of amnesty , while 150 other people were arrested last week , adding to thousands of FIS supporters who had been detained without trial .


fn_spacy_tokens_for_baseline: Although the woods look impressively exotic and expensive , it has not been necessary to pilfer the last few acres of an equatorial hardwood rainforest in order to achieve the attractive grain patterns on these basses , hence the ( ultimately ) rather reasonable prices .

source_bert_toks: although the woods look impressive ##ly exotic and expensive , it has not been necessary to pi ##lf ##er the last few acres of an equatorial hardwood rainforest in order to achieve the attractive grain patterns on these bass ##es , hence the ( ultimately ) rather reasonable prices .

reference_raw: Although the forests are impressively exotic and expensive, there is no need to pick up the last few acres of equatorial hardwood rainforest in order to achieve attractive grain patterns on these basses and, therefore, a relatively reasonable price.

reference_spacy_tokens: Although the forests are impressively exotic and expensive , there is no need to pick up the last few acres of equatorial hardwood rainforest in order to achieve attractive grain patterns on these basses and , therefore , a relatively reasonable price .


fn_spacy_tokens_for_baseline: It seemed to Charles , waiting his turn at the public telephone box on the corner by his billet , that they were never going to be able to meet again .

source_bert_toks: it seemed to charles , waiting his turn at the public telephone box on the corner by his bill ##et , that they were never going to be able to meet again .

reference_raw: It seemed to Charles, waiting for his turn at the public phone booth on the corner beside his billet, that they would never see each other again.

reference_spacy_tokens: It seemed to Charles , waiting for his turn at the public phone booth on the corner beside his billet , that they would never see each other again .


fn_spacy_tokens_for_baseline: No , he 'd been stealing .

source_bert_toks: no , he ' d been stealing .

reference_raw: No, he was a thief.

reference_spacy_tokens: No , he was a thief .


fn_spacy_tokens_for_baseline: It was not a displeasing sensation .

source_bert_toks: it was not a di ##sp ##lea ##sing sensation .

reference_raw: It wasn't a displeasure.

reference_spacy_tokens: It was n't a displeasure .


fn_spacy_tokens_for_baseline: This adds a random error of 10 % to each point and an additional absolute noise with a mean error of 0.05 millimoles / liter .

source_bert_toks: this adds a random error of 10 % to each point and an additional absolute noise with a mean error of 0 . 05 mill ##imo ##les / liter .

reference_raw: This results in a random error of 10% per point and an additional absolute noise with an average error of 0.05 millimols per litre.

reference_spacy_tokens: This results in a random error of 10 % per point and an additional absolute noise with an average error of 0.05 millimols per litre .


fn_spacy_tokens_for_baseline: He slipped out as a small army of servants carried by all sorts of carts and carriages scurried up to the Pavilion with emergency rations organised by Maman , with Papa 's enthusiastic support .

source_bert_toks: he slipped out as a small army of servants carried by all sorts of carts and carriages sc ##ur ##ried up to the pavilion with emergency rations organised by mama ##n , with papa ' s enthusiastic support .

reference_raw: He slipped out as a small armada of servants, carried by various wagons and carriages, rushed to the Pavilion with emergency rations organized by Maman, and with his father's enthusiastic support.

reference_spacy_tokens: He slipped out as a small armada of servants , carried by various wagons and carriages , rushed to the Pavilion with emergency rations organized by Maman , and with his father 's enthusiastic support .


fn_spacy_tokens_for_baseline: I think you 'll look terrific in those hotpants , so let me buy them for you ? '

source_bert_toks: i think you ' ll look terrific in those hot ##pants , so let me buy them for you ? '

reference_raw: I think you're going to look great in your pants, so can I buy them for you?'

reference_spacy_tokens: I think you 're going to look great in your pants , so can I buy them for you ? '


fn_spacy_tokens_for_baseline: QN : Did the Clinton administration agree to send $ 1 billion a year to end the DPRK 's missile sales ?

source_bert_toks: q ##n : did the clinton administration agree to send $ 1 billion a year to end the d ##pr ##k ' s missile sales ?

reference_raw: QN: Has the Clinton administration agreed to transfer $1 billion a year to end the sale of DPRK's rockets?

reference_spacy_tokens: QN : Has the Clinton administration agreed to transfer $ 1 billion a year to end the sale of DPRK 's rockets ?


fn_spacy_tokens_for_baseline: We are far enough above the ground .

source_bert_toks: we are far enough above the ground .

reference_raw: We're far enough off the ground.

reference_spacy_tokens: We 're far enough off the ground .


fn_spacy_tokens_for_baseline: If one looks at the sky on a clear , moonless night , the brightest objects one sees are likely to be the planets Venus , Mars , Jupiter , and Saturn .

source_bert_toks: if one looks at the sky on a clear , moon ##less night , the brightest objects one sees are likely to be the planets venus , mars , jupiter , and saturn .

reference_raw: When you look up at the sky on a clear, lunar night, the brightest objects you can see are the planets Venus, Mars, Jupiter, and Saturn.

reference_spacy_tokens: When you look up at the sky on a clear , lunar night , the brightest objects you can see are the planets Venus , Mars , Jupiter , and Saturn .


fn_spacy_tokens_for_baseline: I remember not being able to stand outside a phone kiosk any longer and dragging out a man who was obviously gossiping therein .

source_bert_toks: i remember not being able to stand outside a phone ki ##os ##k any longer and dragging out a man who was obviously gossip ##ing there ##in .

reference_raw: I remember that I could no longer stand in front of the phone kiosk and pull out a man who was obviously talking about it.

reference_spacy_tokens: I remember that I could no longer stand in front of the phone kiosk and pull out a man who was obviously talking about it .


fn_spacy_tokens_for_baseline: An extreme form of the second is the Spanish fighting bull which undergoes considerable pain before being despatched by the matador , even if this is skilfully done , and often it is n't .

source_bert_toks: an extreme form of the second is the spanish fighting bull which undergoes considerable pain before being des ##pa ##tched by the mata ##dor , even if this is ski ##lf ##ull ##y done , and often it isn ' t .

reference_raw: The extremity of the second is a Spanish fighting bull, who suffers a great deal of pain before the matador sends it out, even if it's skillfully done, and often it's not.

reference_spacy_tokens: The extremity of the second is a Spanish fighting bull , who suffers a great deal of pain before the matador sends it out , even if it 's skillfully done , and often it 's not .


fn_spacy_tokens_for_baseline: High heels would have elevated it to borderline evening wear but she had n't brought heels with her so she decided on gold leather flip - flops .

source_bert_toks: high heels would have elevated it to border ##line evening wear but she hadn ' t brought heels with her so she decided on gold leather flip - flop ##s .

reference_raw: High heels would have raised her to a borderline evening's wear, but she didn't bring heels with her, so she decided on the golden leather flip-offs.

reference_spacy_tokens: High heels would have raised her to a borderline evening 's wear , but she did n't bring heels with her , so she decided on the golden leather flip - offs .


fn_spacy_tokens_for_baseline: It was a question that troubled Saint Augustine : ' Whence is evil ?

source_bert_toks: it was a question that troubled saint augustine : ' when ##ce is evil ?

reference_raw: It was the question that bothered Saint Augustine: "Where is evil?

reference_spacy_tokens: It was the question that bothered Saint Augustine : " Where is evil ?


fn_spacy_tokens_for_baseline: But the ideas and mystique that have always made this an extraordinarily special place rise above the ebbing and flowing concerns of present - day Jerusalem as it continues to tug at the world 's attention into the new millennium .

source_bert_toks: but the ideas and my ##sti ##que that have always made this an extra ##ord ##ina ##rily special place rise above the e ##bbing and flowing concerns of present - day jerusalem as it continues to tug at the world ' s attention into the new millennium .

reference_raw: But the thoughts and mystiques that ever made it a special place rise above the ebbing and flowing fears of the present - the day of Jerusalem, as it continues to draw the world's attention to the new millennia.

reference_spacy_tokens: But the thoughts and mystiques that ever made it a special place rise above the ebbing and flowing fears of the present - the day of Jerusalem , as it continues to draw the world 's attention to the new millennia .


fn_spacy_tokens_for_baseline: I no longer count on the Serbian opposition .

source_bert_toks: i no longer count on the serbian opposition .

reference_raw: I don't rely on Serbian opposition anymore.

reference_spacy_tokens: I do n't rely on Serbian opposition anymore .


fn_spacy_tokens_for_baseline: ' The play suffered not from wrong direction , but from wrong production , ' he maintains and firmly lays the fault at the door of the H. M. Tennent organization .

source_bert_toks: ' the play suffered not from wrong direction , but from wrong production , ' he maintains and firmly lays the fault at the door of the h . m . ten ##nent organization .

reference_raw: "The game didn't suffer from the wrong direction, but from the wrong production," he says, and firmly puts the fault on the doorstep of the H.M. Tennent organization.

reference_spacy_tokens: " The game did n't suffer from the wrong direction , but from the wrong production , " he says , and firmly puts the fault on the doorstep of the H.M. Tennent organization .


fn_spacy_tokens_for_baseline: He was bound to have a sumptuous place .

source_bert_toks: he was bound to have a sum ##pt ##uous place .

reference_raw: He must have had a succinct place.

reference_spacy_tokens: He must have had a succinct place .


fn_spacy_tokens_for_baseline: The 1979 revolution ended all nuclear efforts until 1984 , when Iran revived the nuclear power program and reportedly began covert procurement for a nuclear weapon program .

source_bert_toks: the 1979 revolution ended all nuclear efforts until 1984 , when iran revived the nuclear power program and reportedly began covert procurement for a nuclear weapon program .

reference_raw: The Revolution of 1979 ended all nuclear efforts until 1984, when Iran re-established a nuclear power program and allegedly launched a covert procurement of a nuclear weapon program.

reference_spacy_tokens: The Revolution of 1979 ended all nuclear efforts until 1984 , when Iran re - established a nuclear power program and allegedly launched a covert procurement of a nuclear weapon program .


fn_spacy_tokens_for_baseline: Gransden and Eykyn chide us for mentioning kanamycin , which has been superseded in Britain by newer drugs .

source_bert_toks: gran ##sden and e ##yk ##yn chi ##de us for mentioning kan ##amy ##cin , which has been superseded in britain by newer drugs .

reference_raw: Gransden and Eykyn mocked us for mentioning kanamycin, which was replaced in the UK by newer drugs.

reference_spacy_tokens: Gransden and Eykyn mocked us for mentioning kanamycin , which was replaced in the UK by newer drugs .


fn_spacy_tokens_for_baseline: Mungo took his scuffed cardboard suitcase off the rack made of knotted cord , wondering whether to say goodbye to his fellow traveller .

source_bert_toks: mu ##ngo took his sc ##uf ##fed cardboard suitcase off the rack made of knotted cord , wondering whether to say goodbye to his fellow traveller .

reference_raw: Mungo removed his scuffed cardboard trunk from a rack made of knotted cord and wondered if he should say good-bye to his fellow traveler.

reference_spacy_tokens: Mungo removed his scuffed cardboard trunk from a rack made of knotted cord and wondered if he should say good - bye to his fellow traveler .


fn_spacy_tokens_for_baseline: Contribution levels will also transfer from the dinner and/or Golf Tournament to the ARMPAC " contributor sponsorship program .

source_bert_toks: contribution levels will also transfer from the dinner and / or golf tournament to the arm ##pac " contributor sponsorship program .

reference_raw: The amount of contributions will also be transferred from the dinner and/or golf tournament to the ARMPAC "contributor sponsorship programme.

reference_spacy_tokens: The amount of contributions will also be transferred from the dinner and/or golf tournament to the ARMPAC " contributor sponsorship programme .


fn_spacy_tokens_for_baseline: We sail from a shallow , sandy beach in the sheltered head of the gulf , just south of Cannigione .

source_bert_toks: we sail from a shallow , sandy beach in the sheltered head of the gulf , just south of can ##nig ##ion ##e .

reference_raw: We're sailing from a shallow, sandy shore in the sheltered head of the abyss just south of Cannigione.

reference_spacy_tokens: We 're sailing from a shallow , sandy shore in the sheltered head of the abyss just south of Cannigione .


fn_spacy_tokens_for_baseline: At dawn that day I had climbed to the hilltop beyond Applegarth , and had felt against my skin that indefinable difference that heralds a change of wind .

source_bert_toks: at dawn that day i had climbed to the hilltop beyond apple ##gart ##h , and had felt against my skin that ind ##ef ##ina ##ble difference that herald ##s a change of wind .

reference_raw: That day, at dawn, I reached the top of the hill behind Applegarth, feeling the indefinable difference against my skin that heralds the change in the wind.

reference_spacy_tokens: That day , at dawn , I reached the top of the hill behind Applegarth , feeling the indefinable difference against my skin that heralds the change in the wind .


fn_spacy_tokens_for_baseline: It mocks by its obscenity .

source_bert_toks: it mock ##s by its ob ##sc ##enity .

reference_raw: He laughs at his obscenity.

reference_spacy_tokens: He laughs at his obscenity .


fn_spacy_tokens_for_baseline: Liz suppressed her annoyance before it could take hold .

source_bert_toks: liz suppressed her annoyance before it could take hold .

reference_raw: Liz suppressed her anger before it could take hold of her.

reference_spacy_tokens: Liz suppressed her anger before it could take hold of her .