fn_spacy_tokens_for_baseline: Nor , as these raiders paddled towards an enemy shore , was there more than a canvas skin on its wooden frame between them and a hostile reception .

source_bert_toks: nor , as these raiders paddle ##d towards an enemy shore , was there more than a canvas skin on its wooden frame between them and a hostile reception .

reference_raw: Nor was there more than the canvas skin on the wooden frame between them and the enemy's reception, as the raiders padded toward the enemy shore.

reference_spacy_tokens: Nor was there more than the canvas skin on the wooden frame between them and the enemy 's reception , as the raiders padded toward the enemy shore .


fn_spacy_tokens_for_baseline: THE past couple of years has seen an explosion in the number of computing books on the shelves of even the most humble book shop .

source_bert_toks: the past couple of years has seen an explosion in the number of computing books on the shelves of even the most humble book shop .

reference_raw: In the last few years, the number of computer books on the shelves of even the most modest bookshop has exploded.

reference_spacy_tokens: In the last few years , the number of computer books on the shelves of even the most modest bookshop has exploded .


fn_spacy_tokens_for_baseline: It would have been easy for anyone to reach in and yank a club out of the bag . '

source_bert_toks: it would have been easy for anyone to reach in and yank a club out of the bag . '

reference_raw: It'd be easy for anyone to reach in and pull the club out of the bag.'

reference_spacy_tokens: It 'd be easy for anyone to reach in and pull the club out of the bag . '


fn_spacy_tokens_for_baseline: ' I never heard of such a dreadful thing !

source_bert_toks: ' i never heard of such a dreadful thing !

reference_raw: 'I've never heard of anything so terrible!

reference_spacy_tokens: ' I 've never heard of anything so terrible !


fn_spacy_tokens_for_baseline: The offences involved stealing a purse from an 82-year - old holiday maker on a bus in Southport and a wallet from an man aged 84 on a bus in Moreton , Wirral .

source_bert_toks: the offences involved stealing a purse from an 82 - year - old holiday maker on a bus in southport and a wallet from an man aged 84 on a bus in more ##ton , wi ##rral .

reference_raw: The crimes involved the theft of a wallet from an 82-year-old holiday maker on a bus in Southport and a wallet from an 84-year-old man on a bus in Moreton, Wirral.

reference_spacy_tokens: The crimes involved the theft of a wallet from an 82-year - old holiday maker on a bus in Southport and a wallet from an 84-year - old man on a bus in Moreton , Wirral .


fn_spacy_tokens_for_baseline: The nature of the underground drainage can give rise to international problems when streams cross under frontiers .

source_bert_toks: the nature of the underground drainage can give rise to international problems when streams cross under frontiers .

reference_raw: The nature of the subterranean drainage can cause international problems when streams pass under the border.

reference_spacy_tokens: The nature of the subterranean drainage can cause international problems when streams pass under the border .


fn_spacy_tokens_for_baseline: January 19 and 26 saw a combined total of 300,000 anti - war activists march in Washington and an equal number take to the streets of San Francisco .

source_bert_toks: january 19 and 26 saw a combined total of 300 , 000 anti - war activists march in washington and an equal number take to the streets of san francisco .

reference_raw: On January 19th and 26th, a total of 300,000 anti-war activists went to Washington, and the same number went to the streets of San Francisco.

reference_spacy_tokens: On January 19th and 26th , a total of 300,000 anti - war activists went to Washington , and the same number went to the streets of San Francisco .


fn_spacy_tokens_for_baseline: In Virginia , callers to the statewide toll free number now are not only routed to an intake worker in the program serving their area , but can hear informative recordings on relevant legal topics twenty - four hours a day , in English and Spanish .

source_bert_toks: in virginia , caller ##s to the statewide toll free number now are not only routed to an intake worker in the program serving their area , but can hear inform ##ative recordings on relevant legal topics twenty - four hours a day , in english and spanish .

reference_raw: In Virginia, callers with a national toll-free number are now not only routed to the intake worker in the programme for their territory, but are also able to listen, in English and Spanish, to informative recordings of relevant legal issues 24 hours a day.

reference_spacy_tokens: In Virginia , callers with a national toll - free number are now not only routed to the intake worker in the programme for their territory , but are also able to listen , in English and Spanish , to informative recordings of relevant legal issues 24 hours a day .


fn_spacy_tokens_for_baseline: ' James MacDiarmid will be expecting us , so we will let him stew a bit .

source_bert_toks: ' james mac ##dia ##rmi ##d will be expecting us , so we will let him stew a bit .

reference_raw: James MacDiarmid is waiting for us, so we're gonna let him stew a little.

reference_spacy_tokens: James MacDiarmid is waiting for us , so we 're gon na let him stew a little .


fn_spacy_tokens_for_baseline: Short of declaring Iran in violation of the NPT , the IAEA Director - General Mohamed ElBaradei stated , " Iran has failed to meet its obligations under its Safeguards Agreement " and criticized Iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

source_bert_toks: short of declaring iran in violation of the np ##t , the ia ##ea director - general mohamed el ##bara ##de ##i stated , " iran has failed to meet its obligations under its safeguard ##s agreement " and criticized iran for not being transparent with the construction of its nuclear - related facilities and import of nuclear material .

reference_raw: Shortly before declaring Iran to be in breach of the NPT, the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said, "Iran has failed to fulfil its obligations under the Safeguards Agreement" and complained that Iran was not transparent about the construction of its nuclear-related equipment and the import of nuclear material.

reference_spacy_tokens: Shortly before declaring Iran to be in breach of the NPT , the Director of the International Atomic Energy Agency - General Mohamed ElBaradei said , " Iran has failed to fulfil its obligations under the Safeguards Agreement " and complained that Iran was not transparent about the construction of its nuclear - related equipment and the import of nuclear material .


fn_spacy_tokens_for_baseline: Once air temperatures have fallen well below freezing point , frozen spray accumulates along the shore .

source_bert_toks: once air temperatures have fallen well below freezing point , frozen spray accumulate ##s along the shore .

reference_raw: As the temperature of the air drops far below the freezing point, frozen spray accumulates along the coast.

reference_spacy_tokens: As the temperature of the air drops far below the freezing point , frozen spray accumulates along the coast .


fn_spacy_tokens_for_baseline: Maria was momentarily gripped by an odd , angry despair in response to his denial that he was having an affair with Cavell .

source_bert_toks: maria was momentarily gripped by an odd , angry despair in response to his denial that he was having an affair with cave ##ll .

reference_raw: For a moment Maria felt a strange, angry despair in response to his refusal to have an affair with Cavell.

reference_spacy_tokens: For a moment Maria felt a strange , angry despair in response to his refusal to have an affair with Cavell .


fn_spacy_tokens_for_baseline: The temporal lobes of the brain , lying at the sides beneath the temples , and those regions deep within the brain at this point , control our sexual urge and , hence , stimulability and performance .

source_bert_toks: the temporal lobes of the brain , lying at the sides beneath the temples , and those regions deep within the brain at this point , control our sexual urge and , hence , st ##im ##ula ##bility and performance .

reference_raw: The temporal lobes of the brain, which lie on the sides of the temples, and those areas deep in the brain at the moment, control our sexual impulses, and thus our stimulation and performance.

reference_spacy_tokens: The temporal lobes of the brain , which lie on the sides of the temples , and those areas deep in the brain at the moment , control our sexual impulses , and thus our stimulation and performance .


fn_spacy_tokens_for_baseline: I am sure that to conceal from a child the fact that he is adopted is both foolish and cruel .

source_bert_toks: i am sure that to conceal from a child the fact that he is adopted is both foolish and cruel .

reference_raw: I'm sure it's both foolish and brutal to hide from a child that he's adopted.

reference_spacy_tokens: I 'm sure it 's both foolish and brutal to hide from a child that he 's adopted .


fn_spacy_tokens_for_baseline: He stoked the fire so that it flared , then reached behind him for a pouch of thin leather which contained charred bones .

source_bert_toks: he stoke ##d the fire so that it flared , then reached behind him for a pouch of thin leather which contained charred bones .

reference_raw: He stoked the fire until it flared, then reached behind him for a bag of thin skin that contained charred bones.

reference_spacy_tokens: He stoked the fire until it flared , then reached behind him for a bag of thin skin that contained charred bones .


fn_spacy_tokens_for_baseline: ' His men pursued them into the forest to the east , but then they lost them .

source_bert_toks: ' his men pursued them into the forest to the east , but then they lost them .

reference_raw: His men chased them into the woods to the east, then lost them.

reference_spacy_tokens: His men chased them into the woods to the east , then lost them .


fn_spacy_tokens_for_baseline: As at Tyburn , hanging was accomplished by making the felon mount a ladder , the noose about his neck .

source_bert_toks: as at ty ##burn , hanging was accomplished by making the fe ##lon mount a ladder , the no ##ose about his neck .

reference_raw: Like Tyburn, hanging was done by forcing the criminal to mount a ladder with a noose around his neck.

reference_spacy_tokens: Like Tyburn , hanging was done by forcing the criminal to mount a ladder with a noose around his neck .


fn_spacy_tokens_for_baseline: In his new poem , the Complaint , it is autumn .

source_bert_toks: in his new poem , the complaint , it is autumn .

reference_raw: In his new poem, the Complaint, it's fall.

reference_spacy_tokens: In his new poem , the Complaint , it 's fall .


fn_spacy_tokens_for_baseline: Under Roman - Dutch law , which gradually came to be enforced in the Low Country , all children were allowed a share in the inheritance .

source_bert_toks: under roman - dutch law , which gradually came to be enforced in the low country , all children were allowed a share in the inheritance .

reference_raw: According to Roman-Dutch law, which gradually became enforceable in the Low Country, all children were allowed to share the inheritance.

reference_spacy_tokens: According to Roman - Dutch law , which gradually became enforceable in the Low Country , all children were allowed to share the inheritance .


fn_spacy_tokens_for_baseline: Reference selling involves the use of satisfied customers in order to convince the buyer of the effectiveness of the salesman 's product .

source_bert_toks: reference selling involves the use of satisfied customers in order to convince the buyer of the effectiveness of the salesman ' s product .

reference_raw: Reference sales include the use of contented customers to convince the buyer of the efficiency of the seller's product.

reference_spacy_tokens: Reference sales include the use of contented customers to convince the buyer of the efficiency of the seller 's product .


fn_spacy_tokens_for_baseline: They may adopt clothes and hairstyles that belong to one group of contemporaries or another , and change their political or religious views several times .

source_bert_toks: they may adopt clothes and hairs ##tyle ##s that belong to one group of contemporaries or another , and change their political or religious views several times .

reference_raw: They can accept clothing and hair styles belonging to a group of contemporaries and change their political or religious opinions on several occasions.

reference_spacy_tokens: They can accept clothing and hair styles belonging to a group of contemporaries and change their political or religious opinions on several occasions .


fn_spacy_tokens_for_baseline: 4- Inside parking lot should be strictly designated to the location 's cars in order to protect them from sabotage .

source_bert_toks: 4 - inside parking lot should be strictly designated to the location ' s cars in order to protect them from sabotage .

reference_raw: 4-Indoor parking should be strictly reserved for local vehicles to protect them from sabotage.

reference_spacy_tokens: 4-Indoor parking should be strictly reserved for local vehicles to protect them from sabotage .


fn_spacy_tokens_for_baseline: All rifle barrels are different from each other in minute respects , and when firing a bullet each barrel leaves miniscule scratches called ' lands ' on the discharged slug .

source_bert_toks: all rifle barrels are different from each other in minute respects , and when firing a bullet each barrel leaves mini ##scu ##le scratches called ' lands ' on the discharged slug .

reference_raw: All rifle barrels differ from one another in minute respects, and when a bullet is fired, each barrel leaves tiny scratches called "lands" on the bullet discharged.

reference_spacy_tokens: All rifle barrels differ from one another in minute respects , and when a bullet is fired , each barrel leaves tiny scratches called " lands " on the bullet discharged .


fn_spacy_tokens_for_baseline: The jewellery , consisting of a small aquamarine and pearl pendant on a gold chain , and a gold bracelet with a turquoise clasp , was obviously real .

source_bert_toks: the jewellery , consisting of a small aqua ##marine and pearl pendant on a gold chain , and a gold bracelet with a turquoise clasp , was obviously real .

reference_raw: The jewellery, consisting of a small aquamarine and a pearl necklace on a gold chain, and a gold bracelet with a turquoise clip, was obviously real.

reference_spacy_tokens: The jewellery , consisting of a small aquamarine and a pearl necklace on a gold chain , and a gold bracelet with a turquoise clip , was obviously real .


fn_spacy_tokens_for_baseline: Bite into a shiny , red apple and taste insipid sponge .

source_bert_toks: bite into a shiny , red apple and taste ins ##ip ##id sponge .

reference_raw: Bit into a shiny red apple with a tasteful sponge.

reference_spacy_tokens: Bit into a shiny red apple with a tasteful sponge .


fn_spacy_tokens_for_baseline: When she had chosen the least remarkable and staggered downstairs in a pair of high - heeled purple boots the others got their revenge by wheezing about the room in hysterics once more .

source_bert_toks: when she had chosen the least remarkable and staggered downstairs in a pair of high - heel ##ed purple boots the others got their revenge by w ##hee ##zing about the room in h ##yst ##eric ##s once more .

reference_raw: When she picked out the least remarkable and stumbled down the stairs in a pair of high-heeled purple shoes, the others got their revenge by whistling around the room again in hysteria.

reference_spacy_tokens: When she picked out the least remarkable and stumbled down the stairs in a pair of high - heeled purple shoes , the others got their revenge by whistling around the room again in hysteria .


fn_spacy_tokens_for_baseline: But the greatest threat hanging over the inhabitants of Cubatoa is in the hills that overlook their polluted plain .

source_bert_toks: but the greatest threat hanging over the inhabitants of cuba ##to ##a is in the hills that overlook their poll ##uted plain .

reference_raw: But the biggest threat that hangs over the people of Cubatoa is in the hills that overlook their polluted flatlands.

reference_spacy_tokens: But the biggest threat that hangs over the people of Cubatoa is in the hills that overlook their polluted flatlands .


fn_spacy_tokens_for_baseline: Bull 's absence would be a big disappointment for Wolves as his fellow striker , Andy Mutch , is almost certain to be sidelined for the third game in a row with a groin injury .

source_bert_toks: bull ' s absence would be a big disappointment for wolves as his fellow striker , andy mu ##tch , is almost certain to be side ##lined for the third game in a row with a groin injury .

reference_raw: Bull's absence would have been a great disappointment to the Wolves, since his fellow striker, Andy Mutch, would almost certainly have been sidelined for the third game in a row with a groin injury.

reference_spacy_tokens: Bull 's absence would have been a great disappointment to the Wolves , since his fellow striker , Andy Mutch , would almost certainly have been sidelined for the third game in a row with a groin injury .


fn_spacy_tokens_for_baseline: Fabia felt it might be a touch cruel to laugh at him again but , feeling certain he would run a mile if she took him seriously , she was a little nonplussed about how to answer him .

source_bert_toks: fa ##bia felt it might be a touch cruel to laugh at him again but , feeling certain he would run a mile if she took him seriously , she was a little non ##pl ##uss ##ed about how to answer him .

reference_raw: Fabia felt that it might be a little cruel to laugh at him again, but she felt sure that he would run a mile if she took him seriously, and she didn't care how to answer him.

reference_spacy_tokens: Fabia felt that it might be a little cruel to laugh at him again , but she felt sure that he would run a mile if she took him seriously , and she did n't care how to answer him .


fn_spacy_tokens_for_baseline: Finally , add extra sparkle by serving up the Christmas spirit with bobbing snowmen and fir tree - shaped ice cubes -- they 'll certainly break the ice at parties !

source_bert_toks: finally , add extra sparkle by serving up the christmas spirit with bob ##bing snow ##men and fir tree - shaped ice cube ##s - - they ' ll certainly break the ice at parties !

reference_raw: In the end, add extra sparks by serving the Christmas spirit with bobbing snowmen and fir-shaped ice blocks - they'll definitely break the ice at parties!

reference_spacy_tokens: In the end , add extra sparks by serving the Christmas spirit with bobbing snowmen and fir - shaped ice blocks - they 'll definitely break the ice at parties !


fn_spacy_tokens_for_baseline: The valleys were cut deeply by glaciers .

source_bert_toks: the valleys were cut deeply by glaciers .

reference_raw: The valleys were cut deep by icebergs.

reference_spacy_tokens: The valleys were cut deep by icebergs .


fn_spacy_tokens_for_baseline: He let only a moment go by before filling a teaspoon full of caviar and feeding it to her .

source_bert_toks: he let only a moment go by before filling a tea ##sp ##oon full of ca ##via ##r and feeding it to her .

reference_raw: He let it pass for a moment before he filled a spoonful of caviar and fed it to her.

reference_spacy_tokens: He let it pass for a moment before he filled a spoonful of caviar and fed it to her .


fn_spacy_tokens_for_baseline: The festival 's pretty awful , so we 're entertaining each other . '

source_bert_toks: the festival ' s pretty awful , so we ' re entertaining each other . '

reference_raw: The festival's pretty bad, so we're having fun.'

reference_spacy_tokens: The festival 's pretty bad , so we 're having fun . '


fn_spacy_tokens_for_baseline: Her high volume hulls and exceptional load carrying capabilities , offer no compromise on performance , with fast tacking and unmatched windward ability .

source_bert_toks: her high volume hull ##s and exceptional load carrying capabilities , offer no compromise on performance , with fast tack ##ing and un ##mat ##ched wind ##ward ability .

reference_raw: Its high-volume hulls and exceptional load-bearing capabilities do not offer a compromise on performance, with fast-tacking and unattached windward ability.

reference_spacy_tokens: Its high - volume hulls and exceptional load - bearing capabilities do not offer a compromise on performance , with fast - tacking and unattached windward ability .


fn_spacy_tokens_for_baseline: QN : Did Vaughn use a gun to kill the four hostages ?

source_bert_toks: q ##n : did vaughn use a gun to kill the four hostages ?

reference_raw: Did Vaughn kill four hostages with a weapon?

reference_spacy_tokens: Did Vaughn kill four hostages with a weapon ?


fn_spacy_tokens_for_baseline: Its basic message , the Palestinian authority is corrupt , it fails to deliver , Hamas is not corrupt .

source_bert_toks: its basic message , the palestinian authority is corrupt , it fails to deliver , hamas is not corrupt .

reference_raw: His basic message is that the Palestinian government is corrupt, that it fails to deliver, that Hamas is not corrupt.

reference_spacy_tokens: His basic message is that the Palestinian government is corrupt , that it fails to deliver , that Hamas is not corrupt .


fn_spacy_tokens_for_baseline: She shrieked that he was to take his hands off her .

source_bert_toks: she shrieked that he was to take his hands off her .

reference_raw: She screamed at him to get his hands off her.

reference_spacy_tokens: She screamed at him to get his hands off her .


fn_spacy_tokens_for_baseline: Last week , for example we were looking at the mind boggling distances that we encounter when we journey across the universe .

source_bert_toks: last week , for example we were looking at the mind bog ##gling distances that we encounter when we journey across the universe .

reference_raw: Last week, for example, we looked at the mind-twitching distances we encounter when we travel across space.

reference_spacy_tokens: Last week , for example , we looked at the mind - twitching distances we encounter when we travel across space .


fn_spacy_tokens_for_baseline: With the removal of this requirement the offence will extend to ordinary stealing by taking property from another 's possession .

source_bert_toks: with the removal of this requirement the offence will extend to ordinary stealing by taking property from another ' s possession .

reference_raw: By removing this requirement, the offence will be extended to ordinary theft by taking possession of property from another person's possession.

reference_spacy_tokens: By removing this requirement , the offence will be extended to ordinary theft by taking possession of property from another person 's possession .


fn_spacy_tokens_for_baseline: Young adults , like Mary T. , a jobless mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

source_bert_toks: young adults , like mary t . , a job ##less mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

reference_raw: Young adults, like Mary T., a three-year-old unemployed mother, desperately trying to get her children out of trouble in a crime-ridden neighborhood.

reference_spacy_tokens: Young adults , like Mary T. , a three - year - old unemployed mother , desperately trying to get her children out of trouble in a crime - ridden neighborhood .


fn_spacy_tokens_for_baseline: I am in hopes that your sister Hattie will come to ease your convalescence at the Rectory . '

source_bert_toks: i am in hopes that your sister hat ##tie will come to ease your con ##vale ##sc ##ence at the rectory . '

reference_raw: I hope your sister Hattie will come to ease your recovery in the Rectory.'

reference_spacy_tokens: I hope your sister Hattie will come to ease your recovery in the Rectory . '


fn_spacy_tokens_for_baseline: A similar pattern this year would mean that American troop reductions occurring around that time would be painted as a Taliban victory .

source_bert_toks: a similar pattern this year would mean that american troop reductions occurring around that time would be painted as a taliban victory .

reference_raw: A similar pattern this year would mean that the reduction in US troops that took place around the same time would be depicted as a Taliban victory.

reference_spacy_tokens: A similar pattern this year would mean that the reduction in US troops that took place around the same time would be depicted as a Taliban victory .


fn_spacy_tokens_for_baseline: Why am telling you all this because now my life in danger and well know that your stranger which you can help me out ! ! !

source_bert_toks: why am telling you all this because now my life in danger and well know that your stranger which you can help me out ! ! !

reference_raw: Why I'm telling you all this, because now my life is in danger, and I know you're a stranger who can be of assistance to me!!

reference_spacy_tokens: Why I 'm telling you all this , because now my life is in danger , and I know you 're a stranger who can be of assistance to me ! !


fn_spacy_tokens_for_baseline: ' Are you interested in recruiting the services of a man merely for the purpose of impregnation ? '

source_bert_toks: ' are you interested in recruiting the services of a man merely for the purpose of imp ##re ##gna ##tion ? '

reference_raw: "Do you wish to recruit a man's services for the sole purpose of impregnation?"

reference_spacy_tokens: " Do you wish to recruit a man 's services for the sole purpose of impregnation ? "


fn_spacy_tokens_for_baseline: He took a huge gulp of cognac , raised his finger to order another round , and settled his bulk as comfortably as he could into his chair before resuming the conversation .

source_bert_toks: he took a huge gulp of co ##gna ##c , raised his finger to order another round , and settled his bulk as comfortably as he could into his chair before res ##uming the conversation .

reference_raw: He took a large swallow of cognac, lifted his hand to order another round, and settled his bulk as comfortably as he could in his chair before resuming the conversation.

reference_spacy_tokens: He took a large swallow of cognac , lifted his hand to order another round , and settled his bulk as comfortably as he could in his chair before resuming the conversation .


fn_spacy_tokens_for_baseline: ' Yes , ' she answered feebly before giving herself time to think .

source_bert_toks: ' yes , ' she answered fee ##bly before giving herself time to think .

reference_raw: "Yes," she said weakly before she had time to think.

reference_spacy_tokens: " Yes , " she said weakly before she had time to think .


fn_spacy_tokens_for_baseline: The cap stayed glued on .

source_bert_toks: the cap stayed glued on .

reference_raw: The cap was stuck to it.

reference_spacy_tokens: The cap was stuck to it .


fn_spacy_tokens_for_baseline: A thief snatched a handbag containing £ 560 from a woman as she was about to get into her car in Firthmoor Crescent , while clothing was stolen from a line in Egglestone View .

source_bert_toks: a thief snatched a hand ##bag containing £5 ##60 from a woman as she was about to get into her car in firth ##moor crescent , while clothing was stolen from a line in egg ##les ##tone view .

reference_raw: A thief stole a purse containing 560 pounds from a woman who was about to get into a car in Firthmoor Crescent, while clothes were stolen from the Egglestone View line.

reference_spacy_tokens: A thief stole a purse containing 560 pounds from a woman who was about to get into a car in Firthmoor Crescent , while clothes were stolen from the Egglestone View line .


fn_spacy_tokens_for_baseline: SHERWOOD , who make sexy lace bras and knickers , is showing a fuller figure .

source_bert_toks: sherwood , who make sexy lace bra ##s and kn ##ick ##ers , is showing a fuller figure .

reference_raw: SHERWOOD, who makes sexy lace bras and panties, shows a fuller figure.

reference_spacy_tokens: SHERWOOD , who makes sexy lace bras and panties , shows a fuller figure .


fn_spacy_tokens_for_baseline: Robert Goldblatt , a US marine biologist , spent a month observing on a Japanese drift - net vessel fishing for skipjack tuna in the seas around Yap , in the federated States of Micronesia .

source_bert_toks: robert gold ##bla ##tt , a us marine biologist , spent a month observing on a japanese drift - net vessel fishing for skip ##jack tuna in the seas around ya ##p , in the fed ##erated states of micro ##nesia .

reference_raw: Robert Goldblatt, a U.S. marine biologist, spent a month watching a Japanese driftnet vessel fishing for skipjack tuna in the seas of Japan in the Federal States of Micronesia.

reference_spacy_tokens: Robert Goldblatt , a U.S. marine biologist , spent a month watching a Japanese driftnet vessel fishing for skipjack tuna in the seas of Japan in the Federal States of Micronesia .


fn_spacy_tokens_for_baseline: Still , Chatterbox does n't really think a ritual sacrifice will address the basic underlying problem : When media outlets strike secret business deals with other businesses , readers are unable to evaluate whether these deals might be compromising news coverage .

source_bert_toks: still , chatter ##box doesn ' t really think a ritual sacrifice will address the basic underlying problem : when media outlets strike secret business deals with other businesses , readers are unable to evaluate whether these deals might be com ##promising news coverage .

reference_raw: But Chatterbox does not really believe that ritual sacrifice will solve the underlying problem: when media outlets attack secret business with other businesses, readers cannot assess whether these deals may compromise news coverage.

reference_spacy_tokens: But Chatterbox does not really believe that ritual sacrifice will solve the underlying problem : when media outlets attack secret business with other businesses , readers can not assess whether these deals may compromise news coverage .


fn_spacy_tokens_for_baseline: But from the travelling community , there 's open contempt for the police operation and a prediction ; they 'll be back .

source_bert_toks: but from the travelling community , there ' s open contempt for the police operation and a prediction ; they ' ll be back .

reference_raw: But there is open disdain for police action and prediction from the travelling community; they will return.

reference_spacy_tokens: But there is open disdain for police action and prediction from the travelling community ; they will return .


fn_spacy_tokens_for_baseline: In London , Mr Howard pledged the programme would give priority to areas where there is a history of dissatisfaction .

source_bert_toks: in london , mr howard pledged the programme would give priority to areas where there is a history of dissatisfaction .

reference_raw: In London, Mr. Howard promised that the program would give priority to areas with a history of dissatisfaction.

reference_spacy_tokens: In London , Mr. Howard promised that the program would give priority to areas with a history of dissatisfaction .


fn_spacy_tokens_for_baseline: The deceased 's solicitor , Eustace Tolby , attested that Newley was on the verge of instituting divorce proceedings against his wife .

source_bert_toks: the deceased ' s solicitor , eu ##sta ##ce to ##lby , attested that new ##ley was on the verge of institut ##ing divorce proceedings against his wife .

reference_raw: The deceased's lawyer, Eustace Tolby, confirmed that Newley was about to initiate divorce proceedings against his wife.

reference_spacy_tokens: The deceased 's lawyer , Eustace Tolby , confirmed that Newley was about to initiate divorce proceedings against his wife .


fn_spacy_tokens_for_baseline: ' Does my Mum borrow money off you ? "

source_bert_toks: ' does my mum borrow money off you ? "

reference_raw: "Is my mom lending money to you?"

reference_spacy_tokens: " Is my mom lending money to you ? "


fn_spacy_tokens_for_baseline: For though here on earth she seems to live eternally , it is but the shadow of her beauty that men see -- each as he desires it .

source_bert_toks: for though here on earth she seems to live eternal ##ly , it is but the shadow of her beauty that men see - - each as he desires it .

reference_raw: For though in this world it seems to live forever, it is only the shadow of her beauty that men see - each as he desires.

reference_spacy_tokens: For though in this world it seems to live forever , it is only the shadow of her beauty that men see - each as he desires .


fn_spacy_tokens_for_baseline: His eyes were hooded , attentive to the slightest nuance of response .

source_bert_toks: his eyes were hooded , at ##ten ##tive to the slightest nu ##ance of response .

reference_raw: His eyes were hooded, alert to the slightest hint of reaction.

reference_spacy_tokens: His eyes were hooded , alert to the slightest hint of reaction .


fn_spacy_tokens_for_baseline: At Bluff he designed a charming two - storey half - timbered building with a wide cantilevered canopy .

source_bert_toks: at bluff he designed a charming two - storey half - timber ##ed building with a wide can ##tile ##vered canopy .

reference_raw: In Bluff, he constructed a charming two-story, half-timbered building with a wide cantile roof.

reference_spacy_tokens: In Bluff , he constructed a charming two - story , half - timbered building with a wide cantile roof .


fn_spacy_tokens_for_baseline: But 20 years after the bird cruises , the Washington Post Magazine dug up the controversial alignment between the Defense Department and the Smithsonian Institution . ( The Times - Standard ; 26Jun06 ; John Driscoll , Eureka Times Standard ) ( Link )

source_bert_toks: but 20 years after the bird cruises , the washington post magazine dug up the controversial alignment between the defense department and the smithsonian institution . ( the times - standard ; 26 ##jun ##0 ##6 ; john dr ##is ##coll , eureka times standard ) ( link )

reference_raw: But 20 years after the bird cruise, the Washington Post magazine dug up a controversial alignment between the Ministry of Defence and the Smithsonian Institute. (Times-standard; 26 June; John Driscoll, Eureka Times Standard)

reference_spacy_tokens: But 20 years after the bird cruise , the Washington Post magazine dug up a controversial alignment between the Ministry of Defence and the Smithsonian Institute . ( Times - standard ; 26 June ; John Driscoll , Eureka Times Standard )


fn_spacy_tokens_for_baseline: The lord James had undertaken that the Sultan in Cairo should not contravene any article of the pact , and his emir Tzani - bey al - Ablak had been asked to give his word to that effect .

source_bert_toks: the lord james had undertaken that the sultan in cairo should not contra ##ven ##e any article of the pact , and his emir t ##zan ##i - bey al - ab ##lak had been asked to give his word to that effect .

reference_raw: Lord James had promised that the Sultan in Cairo would not violate any of the articles of the pact, and his emir Tzani-bey al-Ablak had been asked to give his word.

reference_spacy_tokens: Lord James had promised that the Sultan in Cairo would not violate any of the articles of the pact , and his emir Tzani - bey al - Ablak had been asked to give his word .


fn_spacy_tokens_for_baseline: By contrast Krystyna Ziach 's three photographically - based installations delight primarily through their formal qualities .

source_bert_toks: by contrast k ##rys ##tyn ##a z ##iac ##h ' s three photographic ##ally - based installations delight primarily through their formal qualities .

reference_raw: On the other hand, the three photographic facilities of Krystyna Ziach enjoy mainly their formal qualities.

reference_spacy_tokens: On the other hand , the three photographic facilities of Krystyna Ziach enjoy mainly their formal qualities .


fn_spacy_tokens_for_baseline: Game warden ' most likely murderer of Julie Ward '

source_bert_toks: game warden ' most likely murderer of julie ward '

reference_raw: The Game Warden "Probably Julie Ward's Killer"

reference_spacy_tokens: The Game Warden " Probably Julie Ward 's Killer "


fn_spacy_tokens_for_baseline: No power , minimal phones , and a mess of mayonnaise , wine , and everything else all over the floors of the big old general store and the People 's Co - op .

source_bert_toks: no power , minimal phones , and a mess of mayo ##nna ##ise , wine , and everything else all over the floors of the big old general store and the people ' s co - op .

reference_raw: There's no power, minimal phones, and a mess of mayonnaise, wine, and everything else on the floors of the great old General Store and the People's Coop.

reference_spacy_tokens: There 's no power , minimal phones , and a mess of mayonnaise , wine , and everything else on the floors of the great old General Store and the People 's Coop .


fn_spacy_tokens_for_baseline: He could almost feel hot , fetid breath warming his skin .

source_bert_toks: he could almost feel hot , fe ##ti ##d breath warming his skin .

reference_raw: He could almost feel the hot, fetid breath heating his skin.

reference_spacy_tokens: He could almost feel the hot , fetid breath heating his skin .


fn_spacy_tokens_for_baseline: There are gas masks , ration books , lots of soldiers , sailors and airmen and hordes of pretty girls , plus some ladies dressed just as I remember my own mother and Auntie Ethel !

source_bert_toks: there are gas masks , ratio ##n books , lots of soldiers , sailors and airmen and horde ##s of pretty girls , plus some ladies dressed just as i remember my own mother and aunt ##ie ethel !

reference_raw: There's gas masks, ration books, a lot of soldiers, sailors, airmen, and a bunch of pretty girls, and a couple of ladies dressed just like I remember my mother and Aunt Ethel!

reference_spacy_tokens: There 's gas masks , ration books , a lot of soldiers , sailors , airmen , and a bunch of pretty girls , and a couple of ladies dressed just like I remember my mother and Aunt Ethel !


fn_spacy_tokens_for_baseline: With difficulty , John hauled my terrified brother to safety .

source_bert_toks: with difficulty , john hauled my terrified brother to safety .

reference_raw: With difficulty, John dragged my frightened brother to safety.

reference_spacy_tokens: With difficulty , John dragged my frightened brother to safety .


fn_spacy_tokens_for_baseline: On Friday , the store is staging a grand re - opening to celebrate the complete refurbishment , which offers customers a brighter , more spacious shopping environment , yet with the same friendly service they have come to expect .

source_bert_toks: on friday , the store is staging a grand re - opening to celebrate the complete refurbishment , which offers customers a brighter , more spacious shopping environment , yet with the same friendly service they have come to expect .

reference_raw: On Friday, the shop is staging a grand reopening to celebrate a complete renovation that offers customers a brighter, more spacious shopping environment, but with the same kind of favorable service they've come to expect.

reference_spacy_tokens: On Friday , the shop is staging a grand reopening to celebrate a complete renovation that offers customers a brighter , more spacious shopping environment , but with the same kind of favorable service they 've come to expect .


fn_spacy_tokens_for_baseline: I was a bit embarrassed about that .

source_bert_toks: i was a bit embarrassed about that .

reference_raw: I was a little ashamed of it.

reference_spacy_tokens: I was a little ashamed of it .


fn_spacy_tokens_for_baseline: ' I f - f - f - found them , ' Killion bragged , ' in a b - b - b - brothel . '

source_bert_toks: ' i f - f - f - found them , ' kill ##ion bragg ##ed , ' in a b - b - b - brothel . '

reference_raw: 'I found them,' said Killion, 'in a b-b-b-b-b-b-b-b-b-b-brothel.'

reference_spacy_tokens: ' I found them , ' said Killion , ' in a b - b - b - b - b - b - b - b - b - b - brothel . '


fn_spacy_tokens_for_baseline: Miss Ellis stood up and began to button her coat .

source_bert_toks: miss ellis stood up and began to button her coat .

reference_raw: Miss Ellis got to her feet and started putting on her coat.

reference_spacy_tokens: Miss Ellis got to her feet and started putting on her coat .


fn_spacy_tokens_for_baseline: The first acquisitions of booty from Greece itself came from the campaigns of Lucius Quinctius Flamininus against Philip V of Macedon in 198 - 197 BC .

source_bert_toks: the first acquisitions of boot ##y from greece itself came from the campaigns of lucius qui ##nc ##tius fl ##ami ##nin ##us against philip v of mace ##don in 198 - 197 bc .

reference_raw: The first purchases of loot from Greece itself came from the campaigns of Lucius Quinctius Flamininus against Philip V of Macedon in 198-197 BC.

reference_spacy_tokens: The first purchases of loot from Greece itself came from the campaigns of Lucius Quinctius Flamininus against Philip V of Macedon in 198 - 197 BC .


fn_spacy_tokens_for_baseline: Another eighty yards had to be traversed -- to Charlie it felt more like a mile -- before the captain eventually found a tiny gap which he was able to crawl through .

source_bert_toks: another eighty yards had to be traversed - - to charlie it felt more like a mile - - before the captain eventually found a tiny gap which he was able to crawl through .

reference_raw: He had to walk another eighty yards - to Charlie it was more like a mile - before the captain finally found a small gap he could climb through.

reference_spacy_tokens: He had to walk another eighty yards - to Charlie it was more like a mile - before the captain finally found a small gap he could climb through .


fn_spacy_tokens_for_baseline: A fire was burning in a black grate which had an oven to the side of it ; a large black kettle was sizzling on the hob .

source_bert_toks: a fire was burning in a black gr ##ate which had an oven to the side of it ; a large black kettle was si ##zzling on the ho ##b .

reference_raw: There was a fire in a black grate with an oven on its side; a large black pot hissed on the hob.

reference_spacy_tokens: There was a fire in a black grate with an oven on its side ; a large black pot hissed on the hob .


fn_spacy_tokens_for_baseline: The river was in splendid panoramic form , curving gently away upstream and down , followed by the high ridge of the eastern desert .

source_bert_toks: the river was in splendid pan ##ora ##mic form , curving gently away upstream and down , followed by the high ridge of the eastern desert .

reference_raw: The river was beautifully panoramic, curving gently upstream and down, followed by a high crest of the eastern desert.

reference_spacy_tokens: The river was beautifully panoramic , curving gently upstream and down , followed by a high crest of the eastern desert .


fn_spacy_tokens_for_baseline: ' Would you like to go to the dance at the Regency ? ' lie asked .

source_bert_toks: ' would you like to go to the dance at the regency ? ' lie asked .

reference_raw: "Would you like to go to the Regency's prom?" lie asked.

reference_spacy_tokens: " Would you like to go to the Regency 's prom ? " lie asked .


fn_spacy_tokens_for_baseline: How would he act if he knew that his career was to be made into fiction , to serve as an object lesson , and a name of opprobrium , to the generations that followed him ?

source_bert_toks: how would he act if he knew that his career was to be made into fiction , to serve as an object lesson , and a name of op ##pro ##bri ##um , to the generations that followed him ?

reference_raw: What would he do if he knew that his career was to be made into fiction, to serve as an object lesson and an opprobrium name for the generations that followed him?

reference_spacy_tokens: What would he do if he knew that his career was to be made into fiction , to serve as an object lesson and an opprobrium name for the generations that followed him ?


fn_spacy_tokens_for_baseline: Strangely , the sun also shone , though it turned a dusty red , blotted out by the dark wings of vultures .

source_bert_toks: strangely , the sun also shone , though it turned a dusty red , b ##lot ##ted out by the dark wings of vulture ##s .

reference_raw: Oddly, the sun was also shining, though it was dusty red, stained with the dark wings of the vultures.

reference_spacy_tokens: Oddly , the sun was also shining , though it was dusty red , stained with the dark wings of the vultures .


fn_spacy_tokens_for_baseline: A quarter of the income of these small farms comes from pigs and poultry , both of which multiply easily and can be intensively fed in small areas .

source_bert_toks: a quarter of the income of these small farms comes from pigs and poultry , both of which multi ##ply easily and can be intensive ##ly fed in small areas .

reference_raw: A quarter of the income from these small farms comes from pigs and poultry, both of which are easily reproduced and can be fed intensively in small areas.

reference_spacy_tokens: A quarter of the income from these small farms comes from pigs and poultry , both of which are easily reproduced and can be fed intensively in small areas .


fn_spacy_tokens_for_baseline: There followed a long period of peace and prosperity known as the Pax Romana .

source_bert_toks: there followed a long period of peace and prosperity known as the pa ##x roman ##a .

reference_raw: There was a lengthy period of peace and prosperity known as Pax Romana.

reference_spacy_tokens: There was a lengthy period of peace and prosperity known as Pax Romana .


fn_spacy_tokens_for_baseline: She howled in simulated anguish , and groaned her lament .

source_bert_toks: she howled in simulated anguish , and groaned her lame ##nt .

reference_raw: She howled in simulated anguish and moaned.

reference_spacy_tokens: She howled in simulated anguish and moaned .


fn_spacy_tokens_for_baseline: She says ; There was about 18 inches between the car and the wall , his face was covered in blood and he was severely traumatised .

source_bert_toks: she says ; there was about 18 inches between the car and the wall , his face was covered in blood and he was severely trauma ##tis ##ed .

reference_raw: He says, there's about 18 inches between the car and the wall, his face is covered in blood, and he's been severely traumatized.

reference_spacy_tokens: He says , there 's about 18 inches between the car and the wall , his face is covered in blood , and he 's been severely traumatized .


fn_spacy_tokens_for_baseline: Where previously they would on occasion lose direction and splutter to a halt , now their relentless barrage seamlessly moves from one epic song to another .

source_bert_toks: where previously they would on occasion lose direction and sp ##lu ##tter to a halt , now their relentless barrage seam ##lessly moves from one epic song to another .

reference_raw: Where they had lost direction from time to time and sputtered to a stop, now their relentless barrage moved smoothly from one epic song to the next.

reference_spacy_tokens: Where they had lost direction from time to time and sputtered to a stop , now their relentless barrage moved smoothly from one epic song to the next .


fn_spacy_tokens_for_baseline: Quarter figs , top them with some cinnamon - spiced ricotta and drizzle with clear honey .

source_bert_toks: quarter fig ##s , top them with some cinnamon - spice ##d rico ##tta and dr ##iz ##zle with clear honey .

reference_raw: Quarter figs, top them with a ricotta speckled with cinnamon, and a drizzle with a clear meal.

reference_spacy_tokens: Quarter figs , top them with a ricotta speckled with cinnamon , and a drizzle with a clear meal .


fn_spacy_tokens_for_baseline: Anatoly made no notes , but memorised every word Jean - Pierre said .

source_bert_toks: ana ##to ##ly made no notes , but memo ##rise ##d every word jean - pierre said .

reference_raw: Anatoly made no notes, but memorized every word Jean-Pierre said.

reference_spacy_tokens: Anatoly made no notes , but memorized every word Jean - Pierre said .


fn_spacy_tokens_for_baseline: The breadth of its coverage of foreign news is unrivalled , but most of its readers are in greater New York .

source_bert_toks: the breadth of its coverage of foreign news is un ##ri ##val ##led , but most of its readers are in greater new york .

reference_raw: The extent of its coverage of foreign news is unimaginable, but most of its readers are in larger New York.

reference_spacy_tokens: The extent of its coverage of foreign news is unimaginable , but most of its readers are in larger New York .


fn_spacy_tokens_for_baseline: Their answers are both forthright and fascinating as they reveal their most private thoughts .

source_bert_toks: their answers are both forth ##right and fascinating as they reveal their most private thoughts .

reference_raw: Their answers are both direct and fascinating as they reveal their most private thoughts.

reference_spacy_tokens: Their answers are both direct and fascinating as they reveal their most private thoughts .


fn_spacy_tokens_for_baseline: After they had gone , he said , he could n't remember whether they 'd said goodbye ; whether they had wrapped their arms around their children for a last loving embrace .

source_bert_toks: after they had gone , he said , he couldn ' t remember whether they ' d said goodbye ; whether they had wrapped their arms around their children for a last loving embrace .

reference_raw: When they left, he said, he didn't know if they'd said good-bye; if they'd wrapped their arms around their children for one last loving hug.

reference_spacy_tokens: When they left , he said , he did n't know if they 'd said good - bye ; if they 'd wrapped their arms around their children for one last loving hug .


fn_spacy_tokens_for_baseline: He gibbered and choked over an appeal for mercy .

source_bert_toks: he gi ##bber ##ed and choked over an appeal for mercy .

reference_raw: He babbled and suffocated with an appeal for mercy.

reference_spacy_tokens: He babbled and suffocated with an appeal for mercy .


fn_spacy_tokens_for_baseline: The agreement to develop Vines for SCO was made public at last year 's SCO Forum .

source_bert_toks: the agreement to develop vines for sc ##o was made public at last year ' s sc ##o forum .

reference_raw: The contract for the development of the vines for the SCO was published at the SCO Forum last year.

reference_spacy_tokens: The contract for the development of the vines for the SCO was published at the SCO Forum last year .


fn_spacy_tokens_for_baseline: When Margaret Hughes arrived at court in Leominster she knew there was a chance she 'd be sent to prison .

source_bert_toks: when margaret hughes arrived at court in leo ##minster she knew there was a chance she ' d be sent to prison .

reference_raw: When Margaret Hughes reached the courthouse in Leominster, she knew she might be sent to jail.

reference_spacy_tokens: When Margaret Hughes reached the courthouse in Leominster , she knew she might be sent to jail .


fn_spacy_tokens_for_baseline: In the return match in 1902 , Fitzsimmons was beaten in eight rounds after breaking his right hand trying to knock Jeffries out .

source_bert_toks: in the return match in 1902 , fitz ##si ##mmon ##s was beaten in eight rounds after breaking his right hand trying to knock jeff ##ries out .

reference_raw: In 1902, Fitzsimmons was beaten in eight rounds after he smashed his right hand and tried to knock Jeffries out.

reference_spacy_tokens: In 1902 , Fitzsimmons was beaten in eight rounds after he smashed his right hand and tried to knock Jeffries out .


fn_spacy_tokens_for_baseline: The symbolic damnation of Saddam - Hitler may then reveal a great deal about the fears and anxieties , and maybe even the guilt , of this post - historical world .

source_bert_toks: the symbolic damn ##ation of saddam - hitler may then reveal a great deal about the fears and an ##xie ##ties , and maybe even the guilt , of this post - historical world .

reference_raw: Saddam-Hitler's symbolic curse could then reveal a great deal about the fears and fears, and perhaps even guilt, of this post-historic world.

reference_spacy_tokens: Saddam - Hitler 's symbolic curse could then reveal a great deal about the fears and fears , and perhaps even guilt , of this post - historic world .


fn_spacy_tokens_for_baseline: He dropped his gaze from her face to his empty bowl .

source_bert_toks: he dropped his gaze from her face to his empty bowl .

reference_raw: He looked from her face to his empty bowl.

reference_spacy_tokens: He looked from her face to his empty bowl .


fn_spacy_tokens_for_baseline: Inspector Baynes visited us at Baker Street with a printed description of the dark face of the secretary , and of the masterful features , the magnetic black eyes , and the tufted brows of his master .

source_bert_toks: inspector bay ##nes visited us at baker street with a printed description of the dark face of the secretary , and of the master ##ful features , the magnetic black eyes , and the tu ##fted brows of his master .

reference_raw: Inspector Baynes came to us on Baker Street with a printed description of his secretary's dark face, his master's master's master's master's master's dark features, his magnetic black gaze, and his master's tufted eyebrows.

reference_spacy_tokens: Inspector Baynes came to us on Baker Street with a printed description of his secretary 's dark face , his master 's master 's master 's master 's master 's dark features , his magnetic black gaze , and his master 's tufted eyebrows .


fn_spacy_tokens_for_baseline: After a period of months , water finds its way into even the innermost air spaces , and the pumice becomes waterlogged and finally sinks .

source_bert_toks: after a period of months , water finds its way into even the inner ##most air spaces , and the pu ##mic ##e becomes water ##log ##ged and finally sinks .

reference_raw: After a few months, the water finds its way into the innermost spaces of the air, and the pumice becomes water-logged and finally sinks.

reference_spacy_tokens: After a few months , the water finds its way into the innermost spaces of the air , and the pumice becomes water - logged and finally sinks .


fn_spacy_tokens_for_baseline: Morse looked dubious : ' If only we knew when Kemp was murdered !

source_bert_toks: morse looked dubious : ' if only we knew when kemp was murdered !

reference_raw: Morse looked doubtful: 'I wish we knew when Kemp was killed!

reference_spacy_tokens: Morse looked doubtful : ' I wish we knew when Kemp was killed !


fn_spacy_tokens_for_baseline: Santa Ana winds with gusts up to 70 mph exacerbated the Montecito fire , which destroyed over 100 buildings and damaged many others , including Westmont College .

source_bert_toks: santa ana winds with gust ##s up to 70 mph ex ##ace ##rba ##ted the monte ##cit ##o fire , which destroyed over 100 buildings and damaged many others , including west ##mont college .

reference_raw: Santa Ana winds with gusts of up to 70 miles an hour aggravated the Montecito fire, which destroyed over 100 buildings and destroyed many other buildings, including Westmont College.

reference_spacy_tokens: Santa Ana winds with gusts of up to 70 miles an hour aggravated the Montecito fire , which destroyed over 100 buildings and destroyed many other buildings , including Westmont College .


fn_spacy_tokens_for_baseline: " Did you hear what I said ?

source_bert_toks: " did you hear what i said ?

reference_raw: "Do you know what I'm saying?"

reference_spacy_tokens: " Do you know what I 'm saying ? "


fn_spacy_tokens_for_baseline: Beneath his glass lay a sheet of paper , sopping up wine .

source_bert_toks: beneath his glass lay a sheet of paper , so ##pping up wine .

reference_raw: There was a sheet of paper under his glass, soaking the wine.

reference_spacy_tokens: There was a sheet of paper under his glass , soaking the wine .


fn_spacy_tokens_for_baseline: ' Would you like to pick your own nose , Sir , ' I asked one serious looking shopper .

source_bert_toks: ' would you like to pick your own nose , sir , ' i asked one serious looking shop ##per .

reference_raw: "You'd like to pick your own nostrils, sir," I said to one of the serious-looking shoppers.

reference_spacy_tokens: " You 'd like to pick your own nostrils , sir , " I said to one of the serious - looking shoppers .


fn_spacy_tokens_for_baseline: With just a handful of followers he rode to Chinon , the castle of his ancestors , and stayed there , ill and exhausted , while Richard and Philip overran Maine and Touraine .

source_bert_toks: with just a handful of followers he rode to chin ##on , the castle of his ancestors , and stayed there , ill and exhausted , while richard and philip over ##ran maine and tour ##aine .

reference_raw: With only a few followers, he rode to Chinon, the castle of his ancestors, and remained there, sick and exhausted, while Richard and Philip crossed Maine and Touraine.

reference_spacy_tokens: With only a few followers , he rode to Chinon , the castle of his ancestors , and remained there , sick and exhausted , while Richard and Philip crossed Maine and Touraine .


fn_spacy_tokens_for_baseline: Beat the eggs in a bowl and then add potatoes , onion , flour , salt and pepper .

source_bert_toks: beat the eggs in a bowl and then add potatoes , onion , flour , salt and pepper .

reference_raw: I'll beat them in a bowl and then I'll add potatoes, onions, flour, salt, and pepper.

reference_spacy_tokens: I 'll beat them in a bowl and then I 'll add potatoes , onions , flour , salt , and pepper .


fn_spacy_tokens_for_baseline: The e - commerce free zone is situated in north Dubai , near the industrial free zone in Jebel Ali , the top regional and tenth international leading area in container transit .

source_bert_toks: the e - commerce free zone is situated in north dubai , near the industrial free zone in je ##bel ali , the top regional and tenth international leading area in container transit .

reference_raw: The e-commerce free zone is located in Northern Dubai, close to the industrial free zone of Jebel Ali, the highest regional and tenth international lead zone in container transit.

reference_spacy_tokens: The e - commerce free zone is located in Northern Dubai , close to the industrial free zone of Jebel Ali , the highest regional and tenth international lead zone in container transit .


fn_spacy_tokens_for_baseline: The others are dozing while I chatter , attempting to cure their somnambulism with my words .

source_bert_toks: the others are do ##zing while i chatter , attempting to cure their so ##m ##nam ##bu ##lism with my words .

reference_raw: The others doze while I chat, trying to heal their somnambulism with my words.

reference_spacy_tokens: The others doze while I chat , trying to heal their somnambulism with my words .


fn_spacy_tokens_for_baseline: Mandeville and Southgate slouched on their horses , both dressed in leather quilted jackets , their feet encased in long riding boots .

source_bert_toks: man ##dev ##ille and south ##gate sl ##ou ##ched on their horses , both dressed in leather quilt ##ed jackets , their feet en ##cased in long riding boots .

reference_raw: Mandeville and Southgate were squatting on their horses, both dressed in leather jackets, their legs wrapped in long riding boots.

reference_spacy_tokens: Mandeville and Southgate were squatting on their horses , both dressed in leather jackets , their legs wrapped in long riding boots .


fn_spacy_tokens_for_baseline: She prowled among the desks and glowered at the action boards as if they were a bunch of football hooligans .

source_bert_toks: she pro ##wled among the desk ##s and glow ##ered at the action boards as if they were a bunch of football ho ##oli ##gan ##s .

reference_raw: She crawled between the tables, glaring at the action boards as if they were a bunch of soccer hooligans.

reference_spacy_tokens: She crawled between the tables , glaring at the action boards as if they were a bunch of soccer hooligans .


fn_spacy_tokens_for_baseline: Add a bit of orange peel , it you like , and a crushed dried and seeded chilli gives a nice flavour .

source_bert_toks: add a bit of orange peel , it you like , and a crushed dried and seeded chill ##i gives a nice flavour .

reference_raw: Add a little orange peel, that's what you like, and the powdered and seeded chilli gives you a good taste.

reference_spacy_tokens: Add a little orange peel , that 's what you like , and the powdered and seeded chilli gives you a good taste .


fn_spacy_tokens_for_baseline: She 's expanding her Lebensraum and she has to .

source_bert_toks: she ' s expanding her le ##ben ##sr ##au ##m and she has to .

reference_raw: He's spreading his Lebensraum, and he's got to.

reference_spacy_tokens: He 's spreading his Lebensraum , and he 's got to .


fn_spacy_tokens_for_baseline: ' If he is , ' remarked Rose , as the van was driven along the narrow roadway to the Allyes de la Liberty , ' I 'll eat your straw hat , Auguste . '

source_bert_toks: ' if he is , ' remarked rose , as the van was driven along the narrow roadway to the ally ##es de la liberty , ' i ' ll eat your straw hat , auguste . '

reference_raw: 'If so,' said Rose, as the van was driven down the narrow road to the Allies de la Liberty, 'I'm going to eat your straw hat, August.'

reference_spacy_tokens: ' If so , ' said Rose , as the van was driven down the narrow road to the Allies de la Liberty , ' I 'm going to eat your straw hat , August . '


fn_spacy_tokens_for_baseline: She smeared a little of the pink cream on the bottom of Lily 's lip .

source_bert_toks: she smeared a little of the pink cream on the bottom of lily ' s lip .

reference_raw: She stained the bottom of Lily's lip with some pink cream.

reference_spacy_tokens: She stained the bottom of Lily 's lip with some pink cream .


fn_spacy_tokens_for_baseline: In 1994 , during heightened tensions over North Korea 's nuclear weapons program , the DPRK threatened to turn Seoul into a " sea of fire . "

source_bert_toks: in 1994 , during heightened tensions over north korea ' s nuclear weapons program , the d ##pr ##k threatened to turn seoul into a " sea of fire . "

reference_raw: In 1994, during a heightened tension over North Korea's nuclear-weapons program, the DPRK threatened to turn Seoul into a sea of fire.

reference_spacy_tokens: In 1994 , during a heightened tension over North Korea 's nuclear - weapons program , the DPRK threatened to turn Seoul into a sea of fire .


fn_spacy_tokens_for_baseline: By the end of 1986 , Iran had launched an additional eight missiles , bringing its total of Scud- Bs fired against Iraq to approximately 22 .

source_bert_toks: by the end of 1986 , iran had launched an additional eight missiles , bringing its total of sc ##ud - bs fired against iraq to approximately 22 .

reference_raw: By the end of 1986, Iran had launched eight more missiles, bringing the number of Scud-Bs fired against Iraq to about 22.

reference_spacy_tokens: By the end of 1986 , Iran had launched eight more missiles , bringing the number of Scud - Bs fired against Iraq to about 22 .


fn_spacy_tokens_for_baseline: Earth 's warmth , like Venus 's , also came from its interior , as heat - producing radioactive minerals decayed at the mantle , reaching nearly 5000 ° C at the molten centre .

source_bert_toks: earth ' s warmth , like venus ' s , also came from its interior , as heat - producing radioactive minerals decay ##ed at the mantle , reaching nearly 5000 ##° ##c at the molten centre .

reference_raw: Earth's heat, like Venus's, also came from within, as heat-producing radioactive minerals dissolved in the hull, reaching almost 5,000 degrees Celsius in the melted center.

reference_spacy_tokens: Earth 's heat , like Venus 's , also came from within , as heat - producing radioactive minerals dissolved in the hull , reaching almost 5,000 degrees Celsius in the melted center .


fn_spacy_tokens_for_baseline: Here and there , a miniature Halfpenny Bridge of stone curved over the winding brook .

source_bert_toks: here and there , a miniature half ##pen ##ny bridge of stone curved over the winding brook .

reference_raw: Here and there a miniature half-penny bridge of stone curved over a winding stream.

reference_spacy_tokens: Here and there a miniature half - penny bridge of stone curved over a winding stream .


fn_spacy_tokens_for_baseline: ' I suspect , ' she said , shifting a little to recover firmer standing , ' that should be Professor Hambro ?

source_bert_toks: ' i suspect , ' she said , shifting a little to recover firm ##er standing , ' that should be professor ham ##bro ?

reference_raw: 'I suppose,' she said, shifting slightly to regain her footing, 'that's Professor Hambro?

reference_spacy_tokens: ' I suppose , ' she said , shifting slightly to regain her footing , ' that 's Professor Hambro ?


fn_spacy_tokens_for_baseline: Witchcraft thus can not be easily applied to circumvent or violate customary norms of behaviour .

source_bert_toks: witchcraft thus can not be easily applied to ci ##rc ##um ##vent or violate customary norms of behaviour .

reference_raw: Therefore, witchcraft cannot easily be used in order to circumvent or violate the usual standards of conduct.

reference_spacy_tokens: Therefore , witchcraft can not easily be used in order to circumvent or violate the usual standards of conduct .


fn_spacy_tokens_for_baseline: Turning , she searched the crowds for a glimpse of him .

source_bert_toks: turning , she searched the crowds for a glimpse of him .

reference_raw: She turned and scanned the crowd to see him.

reference_spacy_tokens: She turned and scanned the crowd to see him .


fn_spacy_tokens_for_baseline: Nomenclature for the description of the different NF1transcripts

source_bert_toks: nomenclature for the description of the different n ##f ##1 ##tra ##ns ##cript ##s

reference_raw: Classification of various NF1transcripts


fn_spacy_tokens_for_baseline: That way he could have his cake and eat it too .

source_bert_toks: that way he could have his cake and eat it too .

reference_raw: Then he can have his pie and eat it.

reference_spacy_tokens: Then he can have his pie and eat it .


fn_spacy_tokens_for_baseline: ' When you 've got it full up to the top , splash a bit of Paraffin on the top and put the match to it .

source_bert_toks: ' when you ' ve got it full up to the top , splash a bit of para ##ffin on the top and put the match to it .

reference_raw: 'When it's full up, spray a little Paraffin on top and put a match on it.

reference_spacy_tokens: ' When it 's full up , spray a little Paraffin on top and put a match on it .


fn_spacy_tokens_for_baseline: Though much smaller than Hong Kong Island , Kowloon has almost twice the population .

source_bert_toks: though much smaller than hong kong island , ko ##wl ##oon has almost twice the population .

reference_raw: Although much smaller than the island of Hong Kong, Kowloon has nearly twice the population.

reference_spacy_tokens: Although much smaller than the island of Hong Kong , Kowloon has nearly twice the population .


fn_spacy_tokens_for_baseline: I know the smell of our usual adhesive is n't exactly pleasant , but this one 's diabolical . '

source_bert_toks: i know the smell of our usual ad ##hesive isn ' t exactly pleasant , but this one ' s dia ##bolic ##al . '

reference_raw: I know it's not very nice to smell our usual glue, but this is evil.'

reference_spacy_tokens: I know it 's not very nice to smell our usual glue , but this is evil . '


fn_spacy_tokens_for_baseline: The Director was the only one who was called by anything but his given name .

source_bert_toks: the director was the only one who was called by anything but his given name .

reference_raw: The director was the only one called by a name other than his own.

reference_spacy_tokens: The director was the only one called by a name other than his own .


fn_spacy_tokens_for_baseline: The periodic nine hour reviews continue throughout the 96 hour period .

source_bert_toks: the periodic nine hour reviews continue throughout the 96 hour period .

reference_raw: Regular nine-hour reviews shall continue throughout the 96-hour period.

reference_spacy_tokens: Regular nine - hour reviews shall continue throughout the 96-hour period .


fn_spacy_tokens_for_baseline: The universities attract students from all over the world , and this influx helps to make Dublin a busy , buzzing international city .

source_bert_toks: the universities attract students from all over the world , and this influx helps to make dublin a busy , buzzing international city .

reference_raw: Universities draw students from all over the world, and this influx helps make Dublin a busy, buzzing international city.

reference_spacy_tokens: Universities draw students from all over the world , and this influx helps make Dublin a busy , buzzing international city .


fn_spacy_tokens_for_baseline: Karlinsky stroked his beard and smiled .

source_bert_toks: karl ##insky stroked his beard and smiled .

reference_raw: Karlinsky stroked his whiskers and smiled.

reference_spacy_tokens: Karlinsky stroked his whiskers and smiled .


fn_spacy_tokens_for_baseline: Typical of many letters was one which Milton received from the provost of one of the royal burghs in 1740 , reporting that one of the councillors was wavering in his political loyalty .

source_bert_toks: typical of many letters was one which milton received from the provost of one of the royal bu ##rgh ##s in 1740 , reporting that one of the councillors was wave ##ring in his political loyalty .

reference_raw: It was typical of many letters that Milton received from the provost of one of the King's Burghs in 1740, and reported that one of the councillors hesitated in his political loyalty.

reference_spacy_tokens: It was typical of many letters that Milton received from the provost of one of the King 's Burghs in 1740 , and reported that one of the councillors hesitated in his political loyalty .


fn_spacy_tokens_for_baseline: Mike Vater sprays us with champagne , urged on by a joyful Adele .

source_bert_toks: mike va ##ter spray ##s us with champagne , urged on by a joy ##ful adele .

reference_raw: Mike Vater sprays us with champagne, encouraged by the happy Adele.

reference_spacy_tokens: Mike Vater sprays us with champagne , encouraged by the happy Adele .


fn_spacy_tokens_for_baseline: Before starting the walk we could n't resist a peek at the 12th century Norman Cathedral , the oldest in Wales .

source_bert_toks: before starting the walk we couldn ' t resist a peek at the 12th century norman cathedral , the oldest in wales .

reference_raw: We couldn't resist looking at the 12th-century Norman Cathedral, the oldest in Wales, before we started walking.

reference_spacy_tokens: We could n't resist looking at the 12th - century Norman Cathedral , the oldest in Wales , before we started walking .


fn_spacy_tokens_for_baseline: Helen put her arm round his waist , and for a moment they were silent and companionable .

source_bert_toks: helen put her arm round his waist , and for a moment they were silent and companion ##able .

reference_raw: Helen put her arm around his waist, and for a moment they were quiet and friendly.

reference_spacy_tokens: Helen put her arm around his waist , and for a moment they were quiet and friendly .


fn_spacy_tokens_for_baseline: While the strong V - I motion from measures 90 - 91 does carry a tonal implication of dominant - tonic , such cadential bass motion does not imply anything about structural function in this context .

source_bert_toks: while the strong v - i motion from measures 90 - 91 does carry a ton ##al implication of dominant - tonic , such caden ##tial bass motion does not imply anything about structural function in this context .

reference_raw: Although the powerful V-I movement of measures 90-91 has a tonal effect on dominant tonics, such a cadential bass movement does not imply any structural function in this context.

reference_spacy_tokens: Although the powerful V - I movement of measures 90 - 91 has a tonal effect on dominant tonics , such a cadential bass movement does not imply any structural function in this context .


fn_spacy_tokens_for_baseline: All she 'd done was to make a bit of polite conversation !

source_bert_toks: all she ' d done was to make a bit of polite conversation !

reference_raw: All she did was have a little decent conversation!

reference_spacy_tokens: All she did was have a little decent conversation !


fn_spacy_tokens_for_baseline: An unlikely encounter - a drug squad officer chatting amicably with the owner of five acres of cannabis .

source_bert_toks: an unlikely encounter - a drug squad officer chatting ami ##ca ##bly with the owner of five acres of cannabis .

reference_raw: Improbable encounter-a drug squad officer chatting friendlyly with a five-acre cannabis owner.

reference_spacy_tokens: Improbable encounter - a drug squad officer chatting friendlyly with a five - acre cannabis owner .


fn_spacy_tokens_for_baseline: Guinness , a superb bitter - sweet beer , is naturally conditioned in crown - capped bottles ; all other forms are filtered and pasteurised ( as is the bottled version sold in Scotland ) .

source_bert_toks: guinness , a superb bitter - sweet beer , is naturally conditioned in crown - capped bottles ; all other forms are filtered and paste ##uri ##sed ( as is the bottled version sold in scotland ) .

reference_raw: Guinness, an excellent bitter-sweet beer, is naturally conditioned in crowned bottles; all other forms are filtered and pasteurised (as is the bottled version sold in Scotland).

reference_spacy_tokens: Guinness , an excellent bitter - sweet beer , is naturally conditioned in crowned bottles ; all other forms are filtered and pasteurised ( as is the bottled version sold in Scotland ) .


fn_spacy_tokens_for_baseline: The countryside is deserted but for groups of distant yurts which resemble pickable mushrooms .

source_bert_toks: the countryside is deserted but for groups of distant yu ##rts which resemble pick ##able mushrooms .

reference_raw: The landscape is deserted, but for a group of distant yurts that look like pickable mushrooms.

reference_spacy_tokens: The landscape is deserted , but for a group of distant yurts that look like pickable mushrooms .


fn_spacy_tokens_for_baseline: At that moment the babble of voices in the bar ceased , and a hush descended .

source_bert_toks: at that moment the ba ##bble of voices in the bar ceased , and a hush descended .

reference_raw: At that moment the chatter of voices in the bar stopped, and a silence fell.

reference_spacy_tokens: At that moment the chatter of voices in the bar stopped , and a silence fell .


fn_spacy_tokens_for_baseline: Mary , Queen of Scots , turned on her majestic heel and stalked off stage , her head held high .

source_bert_toks: mary , queen of scots , turned on her majestic heel and stalked off stage , her head held high .

reference_raw: Mary, the queen of Scotland, turned on her magnificent heel and walked off the stage, her head held high.

reference_spacy_tokens: Mary , the queen of Scotland , turned on her magnificent heel and walked off the stage , her head held high .


fn_spacy_tokens_for_baseline: Nothing was left but a clearing in the forest and a flock of doves who rose up into the air , wheeled round , and flew off .

source_bert_toks: nothing was left but a clearing in the forest and a flock of dove ##s who rose up into the air , wheeled round , and flew off .

reference_raw: There was nothing left but a clearing in the woods and a flock of doves that flew up into the air, turned, and flew away.

reference_spacy_tokens: There was nothing left but a clearing in the woods and a flock of doves that flew up into the air , turned , and flew away .


fn_spacy_tokens_for_baseline: QN : Does Trump support W 's decision to go to war ?

source_bert_toks: q ##n : does trump support w ' s decision to go to war ?

reference_raw: QN: Does Trump back W's decision to go to war?

reference_spacy_tokens: QN : Does Trump back W 's decision to go to war ?


fn_spacy_tokens_for_baseline: Philip Unwin recalled : ' The clatter of these milk churns was inseparable from railway stations , suggestive of cheerful bustle by day but strangely mournful in the small hours of a night journey .

source_bert_toks: philip un ##win recalled : ' the cl ##atter of these milk chu ##rn ##s was ins ##ep ##arable from railway stations , suggest ##ive of cheerful bust ##le by day but strangely mo ##urn ##ful in the small hours of a night journey .

reference_raw: Philip Unwin said, "The sound of those milky churns was inseparable from the railway stations, a sign of a joyous rush during the day, but strangely mournful in the small hours of the night's journey.

reference_spacy_tokens: Philip Unwin said , " The sound of those milky churns was inseparable from the railway stations , a sign of a joyous rush during the day , but strangely mournful in the small hours of the night 's journey .


fn_spacy_tokens_for_baseline: But while AT&T may be lunging into the Nineties , the corporate giant has not altogether abandoned the fashions of the previous decade .

source_bert_toks: but while at & t may be lung ##ing into the nine ##ties , the corporate giant has not altogether abandoned the fashion ##s of the previous decade .

reference_raw: But while AT&T may have launched into the nineties, the corporate giant has not completely abandoned the fashions of the past decade.

reference_spacy_tokens: But while AT&T may have launched into the nineties , the corporate giant has not completely abandoned the fashions of the past decade .


fn_spacy_tokens_for_baseline: Iran has traditionally felt insecure among its neighbors , first vis - a - vis Iraq , whom it considered its most immediate physical and ideological threat , and now that the Hussein regime is gone , the growing presence and influence of the United States .

source_bert_toks: iran has traditionally felt ins ##ecure among its neighbors , first vis - a - vis iraq , whom it considered its most immediate physical and ideological threat , and now that the hussein regime is gone , the growing presence and influence of the united states .

reference_raw: Iran has traditionally felt insecure among its neighbours, initially vis-à-vis Iraq, which it considers to be the most immediate physical and ideological threat, and now that the Hussein regime is gone, the growing presence and influence of the United States.

reference_spacy_tokens: Iran has traditionally felt insecure among its neighbours , initially vis - a - vis Iraq , which it considers to be the most immediate physical and ideological threat , and now that the Hussein regime is gone , the growing presence and influence of the United States .


fn_spacy_tokens_for_baseline: It appeared that Riverside would be £ 3.1 million overspent on mental health services if the formula were to be rigorously adhered to .

source_bert_toks: it appeared that riverside would be £3 . 1 million overs ##pen ##t on mental health services if the formula were to be rigorous ##ly adhere ##d to .

reference_raw: If the formula was strictly followed, Riverside seemed to have overspent £3.1 million on mental health services.

reference_spacy_tokens: If the formula was strictly followed , Riverside seemed to have overspent £ 3.1 million on mental health services .


fn_spacy_tokens_for_baseline: AN elite corps of transatlantic guardians of the English language has thrown in the towel .

source_bert_toks: an elite corps of transatlantic guardians of the english language has thrown in the towel .

reference_raw: An elite group of transatlantic guardians in English threw in a towel.

reference_spacy_tokens: An elite group of transatlantic guardians in English threw in a towel .


fn_spacy_tokens_for_baseline: Despite the enthusiasm which greeted the revolutions in the East , some people will probably complain about greedy foreigners hogging our hard - earned cash .

source_bert_toks: despite the enthusiasm which greeted the revolutions in the east , some people will probably complain about greedy foreigners hog ##ging our hard - earned cash .

reference_raw: Despite the enthusiasm that greeted the revolutions in the east, some people are likely to complain that greedy aliens are hogging our hard-earned money.

reference_spacy_tokens: Despite the enthusiasm that greeted the revolutions in the east , some people are likely to complain that greedy aliens are hogging our hard - earned money .


fn_spacy_tokens_for_baseline: The man she had spellbound stayed behind ; her enchantments had been pitted against an energetic opponent , who exulted when she left , cursing her as she trudged away pushing a small cart with her possessions .

source_bert_toks: the man she had spell ##bound stayed behind ; her en ##chan ##tment ##s had been pitted against an energetic opponent , who ex ##ult ##ed when she left , cursing her as she tr ##udged away pushing a small cart with her possessions .

reference_raw: The man she had enchanted remained behind; her spells were cast against the energetic adversary, who exulted as she left, cursing her as she trudged away, pushing a small wagon with her possessions.

reference_spacy_tokens: The man she had enchanted remained behind ; her spells were cast against the energetic adversary , who exulted as she left , cursing her as she trudged away , pushing a small wagon with her possessions .


fn_spacy_tokens_for_baseline: Disagreement over a course of policy action led to several contradictory published reports whether or not Iran decided to pursue a CW program .

source_bert_toks: disagreement over a course of policy action led to several contradictory published reports whether or not iran decided to pursue a cw program .

reference_raw: The disagreement over the course of political action has led to a number of contradictory publications as to whether or not Iran has decided to continue the CW program.

reference_spacy_tokens: The disagreement over the course of political action has led to a number of contradictory publications as to whether or not Iran has decided to continue the CW program .


fn_spacy_tokens_for_baseline: Just as young children will cry and remonstrate or say ' do n't leave me ' , so the adult may use just the same words or convey by their behaviour that this is their worry .

source_bert_toks: just as young children will cry and re ##mons ##tra ##te or say ' don ' t leave me ' , so the adult may use just the same words or convey by their behaviour that this is their worry .

reference_raw: Like young children crying and protesting or saying, "Don't leave me," so adults can use the same words or express by their behavior that it's their concern.

reference_spacy_tokens: Like young children crying and protesting or saying , " Do n't leave me , " so adults can use the same words or express by their behavior that it 's their concern .


fn_spacy_tokens_for_baseline: It was September , when the days take a long time to wake up and the green of the trees is brushed with gold .

source_bert_toks: it was september , when the days take a long time to wake up and the green of the trees is brushed with gold .

reference_raw: It was September, when it took a long time to wake up and the green trees were covered with gold.

reference_spacy_tokens: It was September , when it took a long time to wake up and the green trees were covered with gold .


fn_spacy_tokens_for_baseline: The fangs are hollow and are linked to a venom gland .

source_bert_toks: the fangs are hollow and are linked to a venom gland .

reference_raw: The teeth are hollow and connected to the poisonous gland.

reference_spacy_tokens: The teeth are hollow and connected to the poisonous gland .


fn_spacy_tokens_for_baseline: The disturbing question brought the scene in Matilda 's chamber flashing into Isabel 's mind , and the odd looks exchanged between the Empress and her men .

source_bert_toks: the disturbing question brought the scene in matilda ' s chamber flashing into isabel ' s mind , and the odd looks exchanged between the empress and her men .

reference_raw: The unsettling question made the scene in Matilda's room flash into Isabel's mind, and strange glances exchanged between the Empress and her men.

reference_spacy_tokens: The unsettling question made the scene in Matilda 's room flash into Isabel 's mind , and strange glances exchanged between the Empress and her men .


fn_spacy_tokens_for_baseline: Skilled in the art of clock - making , he constructed , in his eightieth year , a detailed and intricate orrery to replace one which displeased him by the ticking of its wheels .

source_bert_toks: skilled in the art of clock - making , he constructed , in his eight ##ie ##th year , a detailed and intricate orr ##ery to replace one which di ##sp ##lea ##sed him by the ticking of its wheels .

reference_raw: He was skilled in the art of clock-making, and in his eightieth year he had built a detailed and complex orrery to replace one that made him uncomfortable with the ticking of his wheels.

reference_spacy_tokens: He was skilled in the art of clock - making , and in his eightieth year he had built a detailed and complex orrery to replace one that made him uncomfortable with the ticking of his wheels .


fn_spacy_tokens_for_baseline: Judge Verney , the grandson of the Great Central Mr. Verney fame travelled on the train and made a speech at Aylesbury prior to cutting a ceremonial cake at the Station .

source_bert_toks: judge ve ##rney , the grandson of the great central mr . ve ##rney fame travelled on the train and made a speech at a ##yles ##bury prior to cutting a ceremonial cake at the station .

reference_raw: Judge Verney, grandchild of the Great Central, Mr. Verney Glory, travelled on a train and made a speech at Aylesbury before cutting a ceremonial cake at the station.

reference_spacy_tokens: Judge Verney , grandchild of the Great Central , Mr. Verney Glory , travelled on a train and made a speech at Aylesbury before cutting a ceremonial cake at the station .


fn_spacy_tokens_for_baseline: ' We recognise you from your portrait , ' said Melissa .

source_bert_toks: ' we recognise you from your portrait , ' said melissa .

reference_raw: "We recognize you from your portrait," Melissa said.

reference_spacy_tokens: " We recognize you from your portrait , " Melissa said .


fn_spacy_tokens_for_baseline: In the spring of 2003 , US intelligence detected activities around the Radiochemisty Laboratory , a reprocessing facility in Yo ( ngbyo ( n - kun , that indicate North Korea was probably reprocessing the 8,000 spent fuel rods that had been in a temporary storage pond .

source_bert_toks: in the spring of 2003 , us intelligence detected activities around the radio ##chemist ##y laboratory , a rep ##ro ##ces ##sing facility in yo ( ng ##by ##o ( n - kun , that indicate north korea was probably rep ##ro ##ces ##sing the 8 , 000 spent fuel rods that had been in a temporary storage pond .

reference_raw: In the spring of 2003, U.S. Intelligence discovered activities around the Radiochemisty Laboratory, a reprocessing facility in Yo (n-kun, which suggests that North Korea was likely to reprocessing 8,000 spent fuel rods in a temporary storage tank.

reference_spacy_tokens: In the spring of 2003 , U.S. Intelligence discovered activities around the Radiochemisty Laboratory , a reprocessing facility in Yo ( n - kun , which suggests that North Korea was likely to reprocessing 8,000 spent fuel rods in a temporary storage tank .


fn_spacy_tokens_for_baseline: Immediately a little beam of light shot out of the barrel of the gun , aimed at the target .

source_bert_toks: immediately a little beam of light shot out of the barrel of the gun , aimed at the target .

reference_raw: Instantly, a small beam of light shot from the barrel of the gun and pointed at the target.

reference_spacy_tokens: Instantly , a small beam of light shot from the barrel of the gun and pointed at the target .


fn_spacy_tokens_for_baseline: To test the monitor , hold up a plain sheet of paper next to the screen .

source_bert_toks: to test the monitor , hold up a plain sheet of paper next to the screen .

reference_raw: To test the monitor, hold a simple sheet of paper beside the screen.

reference_spacy_tokens: To test the monitor , hold a simple sheet of paper beside the screen .


fn_spacy_tokens_for_baseline: The breeze carried her exclamation to the man who strode towards her .

source_bert_toks: the breeze carried her ex ##cl ##ama ##tion to the man who strode towards her .

reference_raw: The wind carried her screams to the man who walked toward her.

reference_spacy_tokens: The wind carried her screams to the man who walked toward her .


fn_spacy_tokens_for_baseline: QN : Is Israel and Palestinian authority negotiating ?

source_bert_toks: q ##n : is israel and palestinian authority negotiating ?

reference_raw: QN: Is Israel and the Palestinian Authority in negotiations?

reference_spacy_tokens: QN : Is Israel and the Palestinian Authority in negotiations ?


fn_spacy_tokens_for_baseline: All things being equal we could probably turn one of these things around , which is basically preparing all the literature , briefing the systems people and getting it all printed up and everything in about six weeks .

source_bert_toks: all things being equal we could probably turn one of these things around , which is basically preparing all the literature , briefing the systems people and getting it all printed up and everything in about six weeks .

reference_raw: All things being equal, we might be able to turn one of these things around, which basically prepares all the literature, informs the system people and gets it all out and everything in about six weeks.

reference_spacy_tokens: All things being equal , we might be able to turn one of these things around , which basically prepares all the literature , informs the system people and gets it all out and everything in about six weeks .


fn_spacy_tokens_for_baseline: The skins who sided with the punks were a new breed , who wished to be seen as more anarchical and more shocking than the punks .

source_bert_toks: the skins who sided with the punk ##s were a new breed , who wished to be seen as more ana ##rch ##ical and more shocking than the punk ##s .

reference_raw: The skins that flanked the punks were a new breed who wanted to be considered more anarchic and shocking than punks.

reference_spacy_tokens: The skins that flanked the punks were a new breed who wanted to be considered more anarchic and shocking than punks .


fn_spacy_tokens_for_baseline: I was peeved to see Robert Kilroy - Silk credited with inventing the egg trick in a recent colour supp . profile .

source_bert_toks: i was pee ##ved to see robert ki ##lr ##oy - silk credited with in ##venting the egg trick in a recent colour su ##pp . profile .

reference_raw: I was peeked to see that Robert Kilroy-Silk had been credited with the invention of an egg trick in a recent colored supple profile.

reference_spacy_tokens: I was peeked to see that Robert Kilroy - Silk had been credited with the invention of an egg trick in a recent colored supple profile .


fn_spacy_tokens_for_baseline: Of course , such unprecedented confidence from this column no doubt presages a 150-run defeat by Zimbabwe but hopes remain high .

source_bert_toks: of course , such unprecedented confidence from this column no doubt pre ##sa ##ges a 150 - run defeat by zimbabwe but hopes remain high .

reference_raw: Of course, this unprecedented trust in this column undoubtedly presupposes Zimbabwe's 150-run defeat, but hopes remain high.

reference_spacy_tokens: Of course , this unprecedented trust in this column undoubtedly presupposes Zimbabwe 's 150-run defeat , but hopes remain high .


fn_spacy_tokens_for_baseline: They stabled their horses and did not enter the tavern but passed into a pleasant garden beyond .

source_bert_toks: they stable ##d their horses and did not enter the tavern but passed into a pleasant garden beyond .

reference_raw: They stabilized their horses and did not enter the inn, but went into the pleasant garden behind them.

reference_spacy_tokens: They stabilized their horses and did not enter the inn , but went into the pleasant garden behind them .


fn_spacy_tokens_for_baseline: A neighbour sent for us to take shelter in a basement further along the street , and I was dragged along Arthur Street .

source_bert_toks: a neighbour sent for us to take shelter in a basement further along the street , and i was dragged along arthur street .

reference_raw: Neighbor sent for us to hide in the cellar further down the street, and I was dragged along Arthur Street.

reference_spacy_tokens: Neighbor sent for us to hide in the cellar further down the street , and I was dragged along Arthur Street .


fn_spacy_tokens_for_baseline: He was still feeling the nausea , especially after smoking .

source_bert_toks: he was still feeling the nausea , especially after smoking .

reference_raw: He still felt sick, especially after he smoked.

reference_spacy_tokens: He still felt sick , especially after he smoked .


fn_spacy_tokens_for_baseline: Instead , the administration has limited the addition to 47,000 , which would bring the authorized Afghan force to a total of 352,000 .

source_bert_toks: instead , the administration has limited the addition to 47 , 000 , which would bring the authorized afghan force to a total of 352 , 000 .

reference_raw: Instead, the government has reduced the addition to 47,000, bringing the authorised Afghan troops to a total of 352,000.

reference_spacy_tokens: Instead , the government has reduced the addition to 47,000 , bringing the authorised Afghan troops to a total of 352,000 .


fn_spacy_tokens_for_baseline: Now , I can hold my liquor as well as the next man , so it is ludicrous to suggest that when I reversed the club van into the tea hut I was under the influence .

source_bert_toks: now , i can hold my liquor as well as the next man , so it is lu ##dic ##rous to suggest that when i reversed the club van into the tea hut i was under the influence .

reference_raw: I can hold my liquor as well as another man, so it's ridiculous to assume that when I turned the club van into a tea hut, I was under the influence.

reference_spacy_tokens: I can hold my liquor as well as another man , so it 's ridiculous to assume that when I turned the club van into a tea hut , I was under the influence .


fn_spacy_tokens_for_baseline: Similarly , the Kurds proposed a compromise so Allawi could head the stalled National Council for Higher Policies .

source_bert_toks: similarly , the ku ##rds proposed a compromise so alla ##wi could head the stalled national council for higher policies .

reference_raw: Similarly, the Kurds have proposed a trade-off so that Allawi can lead a stalled National Council for Higher Policies.

reference_spacy_tokens: Similarly , the Kurds have proposed a trade - off so that Allawi can lead a stalled National Council for Higher Policies .


fn_spacy_tokens_for_baseline: Orphan Drug designation is awarded to compounds that offer potential therapeutic value in the treatment of rare diseases , defined as those affecting fewer than 200,000 Americans .

source_bert_toks: orphan drug designation is awarded to compounds that offer potential therapeutic value in the treatment of rare diseases , defined as those affecting fewer than 200 , 000 americans .

reference_raw: The designation of orphan drugs is given to compounds that offer a potential therapeutic value for the treatment of rare diseases, defined as those affecting less than 200,000 people in America.

reference_spacy_tokens: The designation of orphan drugs is given to compounds that offer a potential therapeutic value for the treatment of rare diseases , defined as those affecting less than 200,000 people in America .


fn_spacy_tokens_for_baseline: The danger is that prospective purchasers will postpone spending money until they have finished upgrading to Windows .

source_bert_toks: the danger is that prospective purchase ##rs will post ##pone spending money until they have finished upgrading to windows .

reference_raw: There is a risk that potential buyers will delay spending money until they finish upgrading to Windows.

reference_spacy_tokens: There is a risk that potential buyers will delay spending money until they finish upgrading to Windows .


fn_spacy_tokens_for_baseline: ' I checked the files , because that rung a bell somewhere .

source_bert_toks: ' i checked the files , because that run ##g a bell somewhere .

reference_raw: 'I checked the files, 'cause it's ringing somewhere.

reference_spacy_tokens: ' I checked the files , 'cause it 's ringing somewhere .


fn_spacy_tokens_for_baseline: She found that the city 's most beautiful Roman temple , dedicated to the goddess Aphrodite , stood on the site of the crucifixion .

source_bert_toks: she found that the city ' s most beautiful roman temple , dedicated to the goddess ap ##hr ##od ##ite , stood on the site of the cr ##uc ##if ##ix ##ion .

reference_raw: She found that the most beautiful Roman temple in the city, dedicated to the goddess Aphrodite, was in the place of the crucifixion.

reference_spacy_tokens: She found that the most beautiful Roman temple in the city , dedicated to the goddess Aphrodite , was in the place of the crucifixion .


fn_spacy_tokens_for_baseline: Elinor was wearing an Empire - line gown in the hope of seeing Napoleon .

source_bert_toks: eli ##nor was wearing an empire - line gown in the hope of seeing napoleon .

reference_raw: Elinor wore an empire-line dress, hoping to see Napoleon.

reference_spacy_tokens: Elinor wore an empire - line dress , hoping to see Napoleon .


fn_spacy_tokens_for_baseline: As we tried to attach fresh wallpaper to the wall , we found that the damp had so undermined the structure that the wall fell down .

source_bert_toks: as we tried to attach fresh wall ##paper to the wall , we found that the damp had so undermine ##d the structure that the wall fell down .

reference_raw: When we tried to put a new wallpaper on the wall, we found that the wetness was so subduing the structure that the wall collapsed.

reference_spacy_tokens: When we tried to put a new wallpaper on the wall , we found that the wetness was so subduing the structure that the wall collapsed .