fn_spacy_tokens_for_baseline: The charred and severed remains of Miss Ward , 28 , were found a year ago in the Masai Mara game reserve in Kenya , in an out - of - the - way spot , six miles from her abandoned vehicle .

source_bert_toks: the charred and severed remains of miss ward , 28 , were found a year ago in the mas ##ai mara game reserve in kenya , in an out - of - the - way spot , six miles from her abandoned vehicle .

reference_raw: A year ago, the charred and severed remains of Miss Ward, 28, were found at the Masai Mara Game Reserve in Kenya, in a remote location, six miles from her abandoned car.

reference_spacy_tokens: A year ago , the charred and severed remains of Miss Ward , 28 , were found at the Masai Mara Game Reserve in Kenya , in a remote location , six miles from her abandoned car .


fn_spacy_tokens_for_baseline: Unless of course the chaps in the secure wing of Rampton Psychiatric Hospital have at least decided that the old boy is an outstanding danger to modern life and pumped him full of Largactil .

source_bert_toks: unless of course the cha ##ps in the secure wing of ramp ##ton psychiatric hospital have at least decided that the old boy is an outstanding danger to modern life and pumped him full of la ##rga ##ct ##il .

reference_raw: Unless, of course, the chaps in the safe wing of Rampton Psychiatric Hospital at least decided that the old man was a great threat to modern life and filled him with Largactil.

reference_spacy_tokens: Unless , of course , the chaps in the safe wing of Rampton Psychiatric Hospital at least decided that the old man was a great threat to modern life and filled him with Largactil .


fn_spacy_tokens_for_baseline: The sole of the boot is strong enough to attach articulated crampons .

source_bert_toks: the sole of the boot is strong enough to attach articulated cr ##amp ##ons .

reference_raw: The bottom of the shoe is strong enough to attach articulated convulsions.

reference_spacy_tokens: The bottom of the shoe is strong enough to attach articulated convulsions .


fn_spacy_tokens_for_baseline: I believe women ought to be ordained to the priesthood .

source_bert_toks: i believe women ought to be ordained to the priesthood .

reference_raw: I think women should be ordered into the priesthood.

reference_spacy_tokens: I think women should be ordered into the priesthood .


fn_spacy_tokens_for_baseline: It was a favourite prisoners ' jeer at the guards , though unfair in view of the relative safety of the prisoners ' position .

source_bert_toks: it was a favourite prisoners ' je ##er at the guards , though unfair in view of the relative safety of the prisoners ' position .

reference_raw: It was a popular prison joke for the guards, though unjust given the relative safety of the prisoner's position.

reference_spacy_tokens: It was a popular prison joke for the guards , though unjust given the relative safety of the prisoner 's position .


fn_spacy_tokens_for_baseline: When it is off she revives , laughs again , looks relaxed .

source_bert_toks: when it is off she revive ##s , laughs again , looks relaxed .

reference_raw: When she's gone, she wakes up, she laughs again, she looks relaxed.

reference_spacy_tokens: When she 's gone , she wakes up , she laughs again , she looks relaxed .


fn_spacy_tokens_for_baseline: ' Splendid , ' he wheezed , ' I -- PUFF ! -- made it just in -- HUFF , PUFF ! -- time .

source_bert_toks: ' splendid , ' he w ##hee ##zed , ' i - - puff ! - - made it just in - - huff , puff ! - - time .

reference_raw: 'Great,' he gasped, 'I - PUFF! - made it in - HUFF, PUFF! - time.

reference_spacy_tokens: ' Great , ' he gasped , ' I - PUFF ! - made it in - HUFF , PUFF ! - time .


fn_spacy_tokens_for_baseline: ' I find by the time I get to the last houses on Christmas Eve , rum custard has congealed into a nasty skin , ' he said .

source_bert_toks: ' i find by the time i get to the last houses on christmas eve , rum cu ##star ##d has cong ##eal ##ed into a nasty skin , ' he said .

reference_raw: "I found that by the time I got to the last house on Christmas Eve, the rum puddle had turned ugly," he said.

reference_spacy_tokens: " I found that by the time I got to the last house on Christmas Eve , the rum puddle had turned ugly , " he said .


fn_spacy_tokens_for_baseline: This was the ritualistic time for the slaying of a leader , as Julius Caesar found out to his peril .

source_bert_toks: this was the ritual ##istic time for the sl ##ay ##ing of a leader , as julius caesar found out to his per ##il .

reference_raw: This was the ritual time to kill the leader, as Julius Caesar had learned from his danger.

reference_spacy_tokens: This was the ritual time to kill the leader , as Julius Caesar had learned from his danger .


fn_spacy_tokens_for_baseline: In all of these instances the animal 's blood was daubed on the altar , the fat burned , and the meat of the carcass divided between the sacrificing priest and the offerer for consumption .

source_bert_toks: in all of these instances the animal ' s blood was da ##ub ##ed on the altar , the fat burned , and the meat of the car ##cas ##s divided between the sac ##ri ##fi ##cing priest and the offer ##er for consumption .

reference_raw: In all these cases, the blood of the animal had been smeared on the altar, the fat had been burned, and the flesh of the carcase had been divided between the sacrificed priest and the offerer for consumption.

reference_spacy_tokens: In all these cases , the blood of the animal had been smeared on the altar , the fat had been burned , and the flesh of the carcase had been divided between the sacrificed priest and the offerer for consumption .


fn_spacy_tokens_for_baseline: He used to wear a Halloween mask to hide his birthmark when he played with his wee friends .

source_bert_toks: he used to wear a halloween mask to hide his birth ##mark when he played with his wee friends .

reference_raw: When he was playing with his wee friends, he wore a Halloween mask to hide his mole.

reference_spacy_tokens: When he was playing with his wee friends , he wore a Halloween mask to hide his mole .


fn_spacy_tokens_for_baseline: ' Did you have a tolerable journey ?

source_bert_toks: ' did you have a to ##ler ##able journey ?

reference_raw: 'Have you had a bearable trip?

reference_spacy_tokens: ' Have you had a bearable trip ?


fn_spacy_tokens_for_baseline: Marubeni was to make a definite decision on whether it would carry the Axil workstation products depending on reaction at the show .

source_bert_toks: maru ##ben ##i was to make a definite decision on whether it would carry the ax ##il works ##tation products depending on reaction at the show .

reference_raw: Marubeni was to decide whether to bring the products of the Axil workstation, depending on the reaction on the show.

reference_spacy_tokens: Marubeni was to decide whether to bring the products of the Axil workstation , depending on the reaction on the show .


fn_spacy_tokens_for_baseline: Kegs in the pub cellar , the one on the left connected for serving .

source_bert_toks: ke ##gs in the pub cellar , the one on the left connected for serving .

reference_raw: The barrels in the basement of the inn, the one on the left attached to the service.

reference_spacy_tokens: The barrels in the basement of the inn , the one on the left attached to the service .


fn_spacy_tokens_for_baseline: Alpert has won a dozen Emmys for three decades of documentaries in foreign locales and the mean streets of urban America .

source_bert_toks: al ##per ##t has won a dozen emmy ##s for three decades of documentaries in foreign local ##es and the mean streets of urban america .

reference_raw: For three decades, Alpert has won a dozen Emmys in foreign locations and the mean streets of urban America.

reference_spacy_tokens: For three decades , Alpert has won a dozen Emmys in foreign locations and the mean streets of urban America .


fn_spacy_tokens_for_baseline: It was only when his embrace became more adventurous , his hands more demanding as he became aroused , that she realised where they were heading and she finally found the strength to pull away from him .

source_bert_toks: it was only when his embrace became more adventurous , his hands more demanding as he became aroused , that she realised where they were heading and she finally found the strength to pull away from him .

reference_raw: Only when his embrace became more adventurous, his hands more demanding as he grew more excited, did she realize where they were going, and finally she found the strength to pull away from him.

reference_spacy_tokens: Only when his embrace became more adventurous , his hands more demanding as he grew more excited , did she realize where they were going , and finally she found the strength to pull away from him .


fn_spacy_tokens_for_baseline: A party of schoolchildren are shushed by their teacher before they enter what is more a sanctum than a room in a museum .

source_bert_toks: a party of school ##child ##ren are shu ##shed by their teacher before they enter what is more a san ##ctum than a room in a museum .

reference_raw: A group of schoolchildren is silenced by their teacher before entering what is more a sanctuary than a museum room.

reference_spacy_tokens: A group of schoolchildren is silenced by their teacher before entering what is more a sanctuary than a museum room .


fn_spacy_tokens_for_baseline: He bought wonderful gifts for his family from Harrods in London .

source_bert_toks: he bought wonderful gifts for his family from ha ##rro ##ds in london .

reference_raw: From Harrods in London, he bought a beautiful present for his family.

reference_spacy_tokens: From Harrods in London , he bought a beautiful present for his family .


fn_spacy_tokens_for_baseline: It was an enraging affectation , worthy of an Oxford undergraduate , especially as Charlie might do it in the middle of a conversation , as he had done recently at a college gig : the Union President was talking to him when Charlie 's hands reached into his side pocket , the book was extracted and opened , and the man 's eyes popped in disbelief as Charlie imbibed a beakerful of the warm South .

source_bert_toks: it was an en ##rag ##ing affect ##ation , worthy of an oxford undergraduate , especially as charlie might do it in the middle of a conversation , as he had done recently at a college gig : the union president was talking to him when charlie ' s hands reached into his side pocket , the book was extracted and opened , and the man ' s eyes popped in disbelief as charlie im ##bib ##ed a beak ##er ##ful of the warm south .

reference_raw: It was an outrageous effect worthy of an Oxford student, especially since Charlie could have done it in the middle of a conversation, as he had recently done at a college concert: the President of the Union was talking to him when Charlie reached into his side pocket, the book was pulled out and opened, and his eyes popped incredulously as Charlie imbed the beaker of the warm South.

reference_spacy_tokens: It was an outrageous effect worthy of an Oxford student , especially since Charlie could have done it in the middle of a conversation , as he had recently done at a college concert : the President of the Union was talking to him when Charlie reached into his side pocket , the book was pulled out and opened , and his eyes popped incredulously as Charlie imbed the beaker of the warm South .


fn_spacy_tokens_for_baseline: Bake for 12 - 15 minutes until barely golden .

source_bert_toks: ba ##ke for 12 - 15 minutes until barely golden .

reference_raw: It's a 12-15-minute roast until it's barely gold.

reference_spacy_tokens: It 's a 12 - 15-minute roast until it 's barely gold .


fn_spacy_tokens_for_baseline: The lid was anchored to the sides by screws through the sides .

source_bert_toks: the lid was anchored to the sides by screw ##s through the sides .

reference_raw: The lid was fastened to the sides by screws on the sides.

reference_spacy_tokens: The lid was fastened to the sides by screws on the sides .


fn_spacy_tokens_for_baseline: Then she slipped out of her robe , revealing a black lace teddy , before stepping into her dress .

source_bert_toks: then she slipped out of her robe , revealing a black lace teddy , before stepping into her dress .

reference_raw: Then she slipped out of her robe, revealing a black lace bear, and stepped into her dress.

reference_spacy_tokens: Then she slipped out of her robe , revealing a black lace bear , and stepped into her dress .


fn_spacy_tokens_for_baseline: Well , you have to be terribly diplomatic .

source_bert_toks: well , you have to be terribly diplomatic .

reference_raw: Well, you must be awfully diplomacy.

reference_spacy_tokens: Well , you must be awfully diplomacy .


fn_spacy_tokens_for_baseline: To test his theory he looked at the processes responsible for producing monstrosities , because these provided the closest observable parallel to the saltative transmutations demanded by his theory .

source_bert_toks: to test his theory he looked at the processes responsible for producing mons ##tro ##sities , because these provided the closest ob ##ser ##vable parallel to the salt ##ative trans ##mut ##ations demanded by his theory .

reference_raw: To try his theory, he looked at the processes responsible for the creation of monsters, for they provided the closest observable parallel to the salt transmutations required by his theory.

reference_spacy_tokens: To try his theory , he looked at the processes responsible for the creation of monsters , for they provided the closest observable parallel to the salt transmutations required by his theory .


fn_spacy_tokens_for_baseline: In addition , it can locate prey by smell alone , scenting blood from well over half a kilometre away .

source_bert_toks: in addition , it can locate prey by smell alone , scent ##ing blood from well over half a kilometre away .

reference_raw: Besides, he can find the prey by smelling on his own, smelling the blood from far more than half a kilometer away.

reference_spacy_tokens: Besides , he can find the prey by smelling on his own , smelling the blood from far more than half a kilometer away .


fn_spacy_tokens_for_baseline: Watching Silas , the answer evaded her because his face remained expressionless , so she pushed the question away from her and got on with the job .

source_bert_toks: watching silas , the answer evade ##d her because his face remained expression ##less , so she pushed the question away from her and got on with the job .

reference_raw: As she watched Silas, the answer avoided her, for his face remained expressionless, she pushed the question away from her and resumed her work.

reference_spacy_tokens: As she watched Silas , the answer avoided her , for his face remained expressionless , she pushed the question away from her and resumed her work .


fn_spacy_tokens_for_baseline: The convention was adopted by the UN General Assembly in April last year on Russia 's initiative .

source_bert_toks: the convention was adopted by the un general assembly in april last year on russia ' s initiative .

reference_raw: On the initiative of Russia, the Conference was adopted by the United Nations General Assembly last April.

reference_spacy_tokens: On the initiative of Russia , the Conference was adopted by the United Nations General Assembly last April .


fn_spacy_tokens_for_baseline: Initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

source_bert_toks: initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

reference_raw: Initial calls said there were a lot of beasts in the house, and firemen were working fast to save all the cats and dogs.

reference_spacy_tokens: Initial calls said there were a lot of beasts in the house , and firemen were working fast to save all the cats and dogs .


fn_spacy_tokens_for_baseline: Mackerras 's account was compassionate but redblooded , direct but full of charm .

source_bert_toks: mack ##er ##ras ' s account was compassionate but red ##blood ##ed , direct but full of charm .

reference_raw: Mackerras' account was sympathetic, but red-blooded, direct, but full of charm.

reference_spacy_tokens: Mackerras ' account was sympathetic , but red - blooded , direct , but full of charm .


fn_spacy_tokens_for_baseline: The guy 's guilty .

source_bert_toks: the guy ' s guilty .

reference_raw: It's the guy's fault.

reference_spacy_tokens: It 's the guy 's fault .


fn_spacy_tokens_for_baseline: Abruptly , he knelt in front of her , pulling her forward into his arms again , his mouth falling to plunder the swollen redness of the lips she offered so helplessly .

source_bert_toks: abruptly , he knelt in front of her , pulling her forward into his arms again , his mouth falling to pl ##under the swollen red ##ness of the lips she offered so helplessly .

reference_raw: Suddenly he dropped to his knees in front of her and pulled her back into his arms, his mouth dropping to plunder the swollen redness of the lips she had so helplessly offered.

reference_spacy_tokens: Suddenly he dropped to his knees in front of her and pulled her back into his arms , his mouth dropping to plunder the swollen redness of the lips she had so helplessly offered .


fn_spacy_tokens_for_baseline: In the sacred grove your white mosque glimmered mystically and the creepers were bowed down with flowers . '

source_bert_toks: in the sacred grove your white mosque g ##lim ##mere ##d mystical ##ly and the creep ##ers were bowed down with flowers . '

reference_raw: Your white mosque gleamed mysteriously in the sacred grove, and the creepers were bowed down with flowers.'

reference_spacy_tokens: Your white mosque gleamed mysteriously in the sacred grove , and the creepers were bowed down with flowers . '


fn_spacy_tokens_for_baseline: She barked back , the door slid open wide enough for me to enter and I found myself in a roomful of dames all with rigor mortis of the third - finger - of - the - left - hand .

source_bert_toks: she barked back , the door slid open wide enough for me to enter and i found myself in a room ##ful of dame ##s all with rig ##or mort ##is of the third - finger - of - the - left - hand .

reference_raw: She barked back, the door opened wide enough for me to enter, and I found myself in a room full of ladies, all with the stiff mortis of the third finger of the left hand.

reference_spacy_tokens: She barked back , the door opened wide enough for me to enter , and I found myself in a room full of ladies , all with the stiff mortis of the third finger of the left hand .


fn_spacy_tokens_for_baseline: A few years ago a minute fossil only about 2 mm long was recovered from limestones of Ordovician age , and christened Janospira .

source_bert_toks: a few years ago a minute fossil only about 2 mm long was recovered from limestone ##s of or ##do ##vic ##ian age , and christ ##ened jan ##os ##pi ##ra .

reference_raw: A few years ago, only about two millimetres of fossils were found in limestones of Ordovician age and baptized Janospira.

reference_spacy_tokens: A few years ago , only about two millimetres of fossils were found in limestones of Ordovician age and baptized Janospira .


fn_spacy_tokens_for_baseline: He cinched his towel around his hips , then bent and scooped up the jewellery as if it were junk .

source_bert_toks: he ci ##nched his towel around his hips , then bent and scooped up the jewellery as if it were junk .

reference_raw: He wrapped the towel around his hips, then bent down and picked up the jewelry as if it were junk.

reference_spacy_tokens: He wrapped the towel around his hips , then bent down and picked up the jewelry as if it were junk .


fn_spacy_tokens_for_baseline: The two countries decided to advance cooperation in the areas of bioterrorism , aviation security , biometrics , cyber - security and terrorism , WMD - terrorism , terrorist finance and money laundering and violent extremism , a release issued by the Embassy of India said .

source_bert_toks: the two countries decided to advance cooperation in the areas of bio ##ter ##ror ##ism , aviation security , bio ##metric ##s , cyber - security and terrorism , w ##md - terrorism , terrorist finance and money laundering and violent ex ##tre ##mism , a release issued by the embassy of india said .

reference_raw: Both countries decided to advance their cooperation in the fields of bio-terrorism, aviation security, biometrics, cyber-security and terrorism, weapons of mass destruction - terrorism, terrorist financing, money laundering and violent extremism, a release issued by the Indian Embassy.

reference_spacy_tokens: Both countries decided to advance their cooperation in the fields of bio - terrorism , aviation security , biometrics , cyber - security and terrorism , weapons of mass destruction - terrorism , terrorist financing , money laundering and violent extremism , a release issued by the Indian Embassy .


fn_spacy_tokens_for_baseline: Albin 's work has been spurred by the large number of road accident victims admitted to the hospital at the Health Science Center , many of whom have been drinking .

source_bert_toks: al ##bin ' s work has been spurred by the large number of road accident victims admitted to the hospital at the health science center , many of whom have been drinking .

reference_raw: Albin's work was stimulated by a large number of accident victims admitted to the hospital at the Medical Science Center, many of whom drank.

reference_spacy_tokens: Albin 's work was stimulated by a large number of accident victims admitted to the hospital at the Medical Science Center , many of whom drank .


fn_spacy_tokens_for_baseline: gal that won

source_bert_toks: gal that won

reference_raw: the girl who prevailed

reference_spacy_tokens: the girl who prevailed


fn_spacy_tokens_for_baseline: In a number of ways they are an elite group who have reached the pinnacle of academic achievement by securing one of the scarce places in one of the 1,054 institutions of higher education .

source_bert_toks: in a number of ways they are an elite group who have reached the pinnacle of academic achievement by securing one of the scarce places in one of the 1 , 05 ##4 institutions of higher education .

reference_raw: In many ways, they are an elite group that has reached the point of academic success by securing one of the rare places in one of the 1,054 higher education establishments.

reference_spacy_tokens: In many ways , they are an elite group that has reached the point of academic success by securing one of the rare places in one of the 1,054 higher education establishments .


fn_spacy_tokens_for_baseline: A woman in a three - story apartment was able to walk out the window of the third floor onto street level after the quake .

source_bert_toks: a woman in a three - story apartment was able to walk out the window of the third floor onto street level after the quake .

reference_raw: A woman in a three-story apartment could walk from a third-floor window to street level after an earthquake.

reference_spacy_tokens: A woman in a three - story apartment could walk from a third - floor window to street level after an earthquake .


fn_spacy_tokens_for_baseline: She crouched in the middle of the carpet , hands clasped around her knees , each breath having to fight for its existence against the competition of a thundering heartbeat .

source_bert_toks: she crouched in the middle of the carpet , hands clasped around her knees , each breath having to fight for its existence against the competition of a thunder ##ing heartbeat .

reference_raw: She squatted in the middle of the carpet, her hands clasped around her knees, and every breath she had to fight for her life against the competition of a thundering heartbeat.

reference_spacy_tokens: She squatted in the middle of the carpet , her hands clasped around her knees , and every breath she had to fight for her life against the competition of a thundering heartbeat .


fn_spacy_tokens_for_baseline: 140,000 miles of hedgerow , 95 % of traditional hay meadows , 40 % of natural woodlands and 60 % of wild heathland have all been destroyed .

source_bert_toks: 140 , 000 miles of hedge ##row , 95 % of traditional hay meadows , 40 % of natural woodlands and 60 % of wild heath ##land have all been destroyed .

reference_raw: 140,000 miles of hedges, 95% of traditional hay meadows, 40% of natural forests and 60% of wild pastures were destroyed.

reference_spacy_tokens: 140,000 miles of hedges , 95 % of traditional hay meadows , 40 % of natural forests and 60 % of wild pastures were destroyed .


fn_spacy_tokens_for_baseline: We must consider what leads young men -- it is predominantly young men -- to see crime as a better outlet for their abilities and energies than lawful activity .

source_bert_toks: we must consider what leads young men - - it is predominantly young men - - to see crime as a better outlet for their abilities and energies than lawful activity .

reference_raw: We must consider what leads young men - especially young men - to see crime as a better outlet for their abilities and energy than legitimate activities.

reference_spacy_tokens: We must consider what leads young men - especially young men - to see crime as a better outlet for their abilities and energy than legitimate activities .


fn_spacy_tokens_for_baseline: In The Outsiders , the gang , their friends and rivals spend their time mugging and jumping people , stealing and robbing from shops .

source_bert_toks: in the outsiders , the gang , their friends and rivals spend their time mug ##ging and jumping people , stealing and robb ##ing from shops .

reference_raw: Outsiders, gangs, friends and rivals spend their time ambushing and hopping people, stealing and robbing shops.

reference_spacy_tokens: Outsiders , gangs , friends and rivals spend their time ambushing and hopping people , stealing and robbing shops .


fn_spacy_tokens_for_baseline: In some areas he could plant his land with windmills .

source_bert_toks: in some areas he could plant his land with windmill ##s .

reference_raw: In some areas, he might have put windmills on his land.

reference_spacy_tokens: In some areas , he might have put windmills on his land .


fn_spacy_tokens_for_baseline: Older kids , like Tracy and Kerry , left homeless after a recent murder - suicide in Indianapolis claimed Mom and Dad .

source_bert_toks: older kids , like tracy and kerry , left homeless after a recent murder - suicide in indianapolis claimed mom and dad .

reference_raw: Older children, like Tracy and Kerry, abandoned their homes after a recent murder-suicide in Indianapolis claimed to be Mom and Dad.

reference_spacy_tokens: Older children , like Tracy and Kerry , abandoned their homes after a recent murder - suicide in Indianapolis claimed to be Mom and Dad .


fn_spacy_tokens_for_baseline: During its existence Coast scientists tested or developed a wide range of harmful BW agents , including Bacillus anthracis , botulinum toxin , Vibrio cholerae , Clostridium perfringens , plague bacteria , and salmonella bacteria .

source_bert_toks: during its existence coast scientists tested or developed a wide range of harmful b ##w agents , including ba ##ci ##llus ant ##hra ##cis , bot ##ulin ##um toxin , vi ##bri ##o cholera ##e , cl ##ost ##rid ##ium per ##fr ##ingen ##s , plague bacteria , and salmon ##ella bacteria .

reference_raw: During its life, coastal scientists have tested or developed a wide range of harmful BW agents, including Bacillus anthracis, botulinum toxin, Vibrio cholerae, Clostridium perfringens, infectious bacteria and salmonella.

reference_spacy_tokens: During its life , coastal scientists have tested or developed a wide range of harmful BW agents , including Bacillus anthracis , botulinum toxin , Vibrio cholerae , Clostridium perfringens , infectious bacteria and salmonella .


fn_spacy_tokens_for_baseline: She could hear Feargal treading softly down behind her , could imagine the stupid grin on his face , and , with a last determined effort , she humped her suitcase to the front door .

source_bert_toks: she could hear fear ##gal tread ##ing softly down behind her , could imagine the stupid grin on his face , and , with a last determined effort , she hum ##ped her suitcase to the front door .

reference_raw: She heard Feargal tread softly behind her, imagined the stupid smile on his face, and, with one last determined effort, she hurled her suitcase to the front door.

reference_spacy_tokens: She heard Feargal tread softly behind her , imagined the stupid smile on his face , and , with one last determined effort , she hurled her suitcase to the front door .


fn_spacy_tokens_for_baseline: The central square of the historic city center is Largo do Senado .

source_bert_toks: the central square of the historic city center is la ##rgo do sen ##ado .

reference_raw: Largo do Senado is the center of the historical city centre.

reference_spacy_tokens: Largo do Senado is the center of the historical city centre .


fn_spacy_tokens_for_baseline: ' And you oughta check if anything 's gone missing .

source_bert_toks: ' and you ought ##a check if anything ' s gone missing .

reference_raw: 'And you should see if something's missing.

reference_spacy_tokens: ' And you should see if something 's missing .


fn_spacy_tokens_for_baseline: Each year we endeavour to be represented in helping in one of their fund - raising ventures .

source_bert_toks: each year we endeavour to be represented in helping in one of their fund - raising ventures .

reference_raw: Every year we try to be represented in one of their fundraising companies.

reference_spacy_tokens: Every year we try to be represented in one of their fundraising companies .


fn_spacy_tokens_for_baseline: The spearmen are well equipped with hauberks of fine scale armour , tall helms , shields and seven - foot Elf war - spears .

source_bert_toks: the spear ##men are well equipped with ha ##uber ##ks of fine scale armour , tall helm ##s , shields and seven - foot elf war - spears .

reference_raw: The spearmen are well equipped with hauberks of fine scale armor, high helmets, shields, and seven-foot Elven warspears.

reference_spacy_tokens: The spearmen are well equipped with hauberks of fine scale armor , high helmets , shields , and seven - foot Elven warspears .


fn_spacy_tokens_for_baseline: The publishers in Monterrey command no battalions , but they agreed to express their outrage with editorials in today 's editions .

source_bert_toks: the publishers in monterrey command no battalions , but they agreed to express their outrage with editorial ##s in today ' s editions .

reference_raw: The publishers in Monterrey don't command any banners, but they've decided to express their indignation with the editorials in today's edition.

reference_spacy_tokens: The publishers in Monterrey do n't command any banners , but they 've decided to express their indignation with the editorials in today 's edition .


fn_spacy_tokens_for_baseline: Bending double , he ducked beneath the window and was moving towards the door . when a long man - shaped shadow moved across the bar of light thrown out onto the paved pathway .

source_bert_toks: bending double , he ducked beneath the window and was moving towards the door . when a long man - shaped shadow moved across the bar of light thrown out onto the paved pathway .

reference_raw: He double-crossed, crouched under the window, and headed for the door . . . when a long man-shaped shadow moved through a bar of light thrown down the paved path.

reference_spacy_tokens: He double - crossed , crouched under the window , and headed for the door . . . when a long man - shaped shadow moved through a bar of light thrown down the paved path .


fn_spacy_tokens_for_baseline: Amethyst and emerald festooned the dome , topazes too , and sapphires , and emeralds , with an architrave of solid pearl .

source_bert_toks: am ##eth ##yst and emerald fest ##oon ##ed the dome , top ##az ##es too , and sapphire ##s , and emerald ##s , with an arch ##it ##rave of solid pearl .

reference_raw: Amethyst and emerald feasted on the dome, topazes, sapphires, and emeralds, with an architrave of solid pearls.

reference_spacy_tokens: Amethyst and emerald feasted on the dome , topazes , sapphires , and emeralds , with an architrave of solid pearls .


fn_spacy_tokens_for_baseline: The Rapture ' Instead of doing heroin , ' someone tells born - again Christian Sharon ( Mimi Rogers ) in Michael Tolkin 's directorial debut , ' you 're doing God . '

source_bert_toks: the rap ##ture ' instead of doing heroin , ' someone tells born - again christian sharon ( mimi rogers ) in michael to ##lk ##in ' s directorial debut , ' you ' re doing god . '

reference_raw: "Instead of making heroin," someone says to born-again Christian Sharon (Mimi Rogers) in the directorial debut of Michael Tolkin, "you make God."

reference_spacy_tokens: " Instead of making heroin , " someone says to born - again Christian Sharon ( Mimi Rogers ) in the directorial debut of Michael Tolkin , " you make God . "


fn_spacy_tokens_for_baseline: On May 5 - 6 thousands of his supporters congregated around him .

source_bert_toks: on may 5 - 6 thousands of his supporters cong ##re ##gated around him .

reference_raw: On May 5-6,000 of his followers gathered around him.

reference_spacy_tokens: On May 5 - 6,000 of his followers gathered around him .


fn_spacy_tokens_for_baseline: I was famished , having had no food or sleep for thirty hours .

source_bert_toks: i was fa ##mis ##hed , having had no food or sleep for thirty hours .

reference_raw: I was hungry because I hadn't eaten or slept in thirty hours.

reference_spacy_tokens: I was hungry because I had n't eaten or slept in thirty hours .


fn_spacy_tokens_for_baseline: In reality , the risk is really rather slight , though even this can be eliminated by taking more trouble to rinse off all the detergent from the cat 's dishes .

source_bert_toks: in reality , the risk is really rather slight , though even this can be eliminated by taking more trouble to ri ##nse off all the deter ##gent from the cat ' s dishes .

reference_raw: In fact, the risk is very small, although even this can be eliminated by making it more difficult to flush all the detergent out of the cat's dishes.

reference_spacy_tokens: In fact , the risk is very small , although even this can be eliminated by making it more difficult to flush all the detergent out of the cat 's dishes .


fn_spacy_tokens_for_baseline: A.Q. Khan of Pakistan sold plans for a nuclear bomb to Iran .

source_bert_toks: a . q . khan of pakistan sold plans for a nuclear bomb to iran .

reference_raw: A.Q. Khan from Pakistan sold Iran plans for a nuclear bomb.

reference_spacy_tokens: A.Q. Khan from Pakistan sold Iran plans for a nuclear bomb .


fn_spacy_tokens_for_baseline: Dog - tired , Lily had gone to bed a good hour before .

source_bert_toks: dog - tired , lily had gone to bed a good hour before .

reference_raw: Lily got tired and went to bed about an hour ago.

reference_spacy_tokens: Lily got tired and went to bed about an hour ago .


fn_spacy_tokens_for_baseline: The climate here can best be described as " changeable " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city 's magic .

source_bert_toks: the climate here can best be described as " change ##able " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city ' s magic .

reference_raw: The climate here is best described as "changeable", but the sudden transition from light to darkness, sun to shower, is part of the city's magic.

reference_spacy_tokens: The climate here is best described as " changeable " , but the sudden transition from light to darkness , sun to shower , is part of the city 's magic .


fn_spacy_tokens_for_baseline: Looking back , it seems a marvel that the houses surrounding the Greencroft were never set on fire -- the residents must have suffered very anxious hours , but for the rest of us the sight of so many fires all blazing away was one never forgotten .

source_bert_toks: looking back , it seems a marvel that the houses surrounding the green ##croft were never set on fire - - the residents must have suffered very anxious hours , but for the rest of us the sight of so many fires all blazing away was one never forgotten .

reference_raw: Looking back, it seems a miracle that the houses around Greencroft were never set on fire - the inhabitants must have been very anxious, but for the rest of us, the sight of so many fires was never forgotten.

reference_spacy_tokens: Looking back , it seems a miracle that the houses around Greencroft were never set on fire - the inhabitants must have been very anxious , but for the rest of us , the sight of so many fires was never forgotten .


fn_spacy_tokens_for_baseline: It 's not a sum you 'd throw away ; but you 'd be happy if it bought a new handbag , a train fare to London or a tankful of petrol .

source_bert_toks: it ' s not a sum you ' d throw away ; but you ' d be happy if it bought a new hand ##bag , a train fare to london or a tank ##ful of petrol .

reference_raw: It's not a sum you'd throw away, but you'd be happy to buy a new purse, a train ticket to London, or a tank full of gasoline.

reference_spacy_tokens: It 's not a sum you 'd throw away , but you 'd be happy to buy a new purse , a train ticket to London , or a tank full of gasoline .


fn_spacy_tokens_for_baseline: At Clapham Junction , he alighted from the train and crossed by the footbridge to the platform from which to catch a train back .

source_bert_toks: at clap ##ham junction , he ali ##ght ##ed from the train and crossed by the foot ##bridge to the platform from which to catch a train back .

reference_raw: He got off the train at Clapham Junction and crossed the bridge to the platform where he could catch the train back.

reference_spacy_tokens: He got off the train at Clapham Junction and crossed the bridge to the platform where he could catch the train back .


fn_spacy_tokens_for_baseline: Carey swung the rod out for a cast , and Ellwood tore it from his grip , then stepped back and lashed at the priest , holding the rod two - handed , bellowing with outrage .

source_bert_toks: carey swung the rod out for a cast , and el ##l ##wood tore it from his grip , then stepped back and lashed at the priest , holding the rod two - handed , bell ##owing with outrage .

reference_raw: Carey swung the stick to the cast, and Ellwood tore it out of his grasp, then backed away, swinging at the priest, holding the stick with two hands and screaming indignantly.

reference_spacy_tokens: Carey swung the stick to the cast , and Ellwood tore it out of his grasp , then backed away , swinging at the priest , holding the stick with two hands and screaming indignantly .


fn_spacy_tokens_for_baseline: The Bill sought to prohibit employment discrimination against qualified disabled persons on the ground of their disability .

source_bert_toks: the bill sought to prohibit employment discrimination against qualified disabled persons on the ground of their disability .

reference_raw: The Bill sought to prevent discrimination in employment against qualified persons with disabilities on the grounds of their disability.

reference_spacy_tokens: The Bill sought to prevent discrimination in employment against qualified persons with disabilities on the grounds of their disability .


fn_spacy_tokens_for_baseline: Peace maven Yossi Beilin and former Health Minister Ephraim Sneh are also running .

source_bert_toks: peace ma ##ven yo ##ssi bei ##lin and former health minister ep ##hra ##im s ##ne ##h are also running .

reference_raw: Peacemaker Yossi Beilin and former Minister of Health Ephraim Sneh are also on the run.

reference_spacy_tokens: Peacemaker Yossi Beilin and former Minister of Health Ephraim Sneh are also on the run .


fn_spacy_tokens_for_baseline: Wipe the wood with a cloth moistened with white spirit to remove any traces of grease or dust .

source_bert_toks: wipe the wood with a cloth moist ##ened with white spirit to remove any traces of grease or dust .

reference_raw: Wipe the wood with a cloth wet with white alcohol to remove any traces of fat or dust.

reference_spacy_tokens: Wipe the wood with a cloth wet with white alcohol to remove any traces of fat or dust .


fn_spacy_tokens_for_baseline: One moment the sun was on her face , the next raindrops the size of golf balls were pelting down on her , drenching her as thoroughly as a bathroom shower .

source_bert_toks: one moment the sun was on her face , the next rain ##drop ##s the size of golf balls were pe ##lt ##ing down on her , dr ##en ##ching her as thoroughly as a bathroom shower .

reference_raw: One minute the sun was on her face, and the next droplets the size of golf balls fell on her, soaking her as thoroughly as a shower in a bathroom.

reference_spacy_tokens: One minute the sun was on her face , and the next droplets the size of golf balls fell on her , soaking her as thoroughly as a shower in a bathroom .


fn_spacy_tokens_for_baseline: The pony , irritated by her slow pace , tossed its head , tore the reins from her grasp , knocked her over and trotted away with a malicious whinny and a triumphant shake of its mane .

source_bert_toks: the pony , irritated by her slow pace , tossed its head , tore the reins from her grasp , knocked her over and tr ##otted away with a malicious w ##hin ##ny and a triumphant shake of its mane .

reference_raw: The pony, irritated by her slow pace, threw back her head, tore the reins from her grasp, knocked her over, and trotted away with a malicious whine and a triumphant shake of her mane.

reference_spacy_tokens: The pony , irritated by her slow pace , threw back her head , tore the reins from her grasp , knocked her over , and trotted away with a malicious whine and a triumphant shake of her mane .


fn_spacy_tokens_for_baseline: Recombinant Oct-11 protein binds specifically to an octamer sequence in vitro .

source_bert_toks: rec ##om ##bina ##nt oct - 11 protein binds specifically to an oct ##ame ##r sequence in vitro .

reference_raw: In vitro, recombinant Oct-11 protein attaches specifically to the octamer sequence.

reference_spacy_tokens: In vitro , recombinant Oct-11 protein attaches specifically to the octamer sequence .


fn_spacy_tokens_for_baseline: Nick Cave assumed his persona in a dead - end relationship song .

source_bert_toks: nick cave assumed his persona in a dead - end relationship song .

reference_raw: Nick Cave took over his personality in a blind relationship song.

reference_spacy_tokens: Nick Cave took over his personality in a blind relationship song .


fn_spacy_tokens_for_baseline: ' And how was Mrs Parkin ? ' asked Dexter , while Blanche took a packet of chocolate digestives from her filing cabinet and arrayed them on a plate .

source_bert_toks: ' and how was mrs park ##in ? ' asked dexter , while blanche took a packet of chocolate digest ##ives from her filing cabinet and array ##ed them on a plate .

reference_raw: 'How was Mrs Parkin?' asked Dexter, as Blanche removed a packet of chocolate digestives from the file cabinet and placed them on the plate.

reference_spacy_tokens: ' How was Mrs Parkin ? ' asked Dexter , as Blanche removed a packet of chocolate digestives from the file cabinet and placed them on the plate .


fn_spacy_tokens_for_baseline: Part of the fortress has been converted and is now used as a luxury inn .

source_bert_toks: part of the fortress has been converted and is now used as a luxury inn .

reference_raw: Part of the fort has been rebuilt and is now used as a luxury inn.

reference_spacy_tokens: Part of the fort has been rebuilt and is now used as a luxury inn .


fn_spacy_tokens_for_baseline: And the old Dublin is with us , too -- the irreverent city of wit and charm and that peculiar magic possessed by Ireland and the Irish .

source_bert_toks: and the old dublin is with us , too - - the ir ##re ##vere ##nt city of wit and charm and that peculiar magic possessed by ireland and the irish .

reference_raw: The old Dublin is with us, too - an irrespectable city of wit and magic, and a strange magic possessed by Ireland and the Irish.

reference_spacy_tokens: The old Dublin is with us , too - an irrespectable city of wit and magic , and a strange magic possessed by Ireland and the Irish .


fn_spacy_tokens_for_baseline: As big as a cathedral it stood , in red Midland brick and warm Oxford limestone , with the noon sun full upon it .

source_bert_toks: as big as a cathedral it stood , in red midland brick and warm oxford limestone , with the noon sun full upon it .

reference_raw: It was the size of a cathedral, in red Midland brick and hot Oxford limestone, full of noon sun.

reference_spacy_tokens: It was the size of a cathedral , in red Midland brick and hot Oxford limestone , full of noon sun .


fn_spacy_tokens_for_baseline: In a cage near Creggan an eagle shook its feathers ; somewhere talons rasped briefly on metal and were still .

source_bert_toks: in a cage near cr ##eg ##gan an eagle shook its feathers ; somewhere talon ##s rasped briefly on metal and were still .

reference_raw: The eagle shook its feathers in the cage near Creggan; somewhere the claws rustled briefly on the metal and were still.

reference_spacy_tokens: The eagle shook its feathers in the cage near Creggan ; somewhere the claws rustled briefly on the metal and were still .


fn_spacy_tokens_for_baseline: The terms can be used to denote functions in the organisation .

source_bert_toks: the terms can be used to denote functions in the organisation .

reference_raw: Terms may be used to designate functions in an organisation.

reference_spacy_tokens: Terms may be used to designate functions in an organisation .


fn_spacy_tokens_for_baseline: They should have telescopes in order to constantly control the areas around them .

source_bert_toks: they should have telescopes in order to constantly control the areas around them .

reference_raw: They should have telescopes to keep an eye on the area around them.

reference_spacy_tokens: They should have telescopes to keep an eye on the area around them .


fn_spacy_tokens_for_baseline: I really thought we 'd blown it when I saw him cracking up .

source_bert_toks: i really thought we ' d blown it when i saw him cracking up .

reference_raw: I really thought we screwed up when I saw him break up.

reference_spacy_tokens: I really thought we screwed up when I saw him break up .


fn_spacy_tokens_for_baseline: There is a total of 12,800 Buddha statues here , plus the remains of the monastery 's founder embalmed in gold leaf .

source_bert_toks: there is a total of 12 , 800 buddha statues here , plus the remains of the monastery ' s founder em ##bal ##med in gold leaf .

reference_raw: There are 12,800 statues of Buddha, plus the remnants of the founder of the convent embalmed with gold leaves.

reference_spacy_tokens: There are 12,800 statues of Buddha , plus the remnants of the founder of the convent embalmed with gold leaves .


fn_spacy_tokens_for_baseline: It would , however , be too simple to portray antislavery after the late 1830s as purely a scene of contending sects more concerned with maintaining their own kinds of purity than achieving anything practical .

source_bert_toks: it would , however , be too simple to portray anti ##sl ##aver ##y after the late 1830s as purely a scene of contend ##ing sect ##s more concerned with maintaining their own kinds of purity than achieving anything practical .

reference_raw: But it would be too easy to describe anti-slavery after the end of the 1830s as a pure scene of contending sects more interested in maintaining their own kind of purity than in achieving anything practical.

reference_spacy_tokens: But it would be too easy to describe anti - slavery after the end of the 1830s as a pure scene of contending sects more interested in maintaining their own kind of purity than in achieving anything practical .


fn_spacy_tokens_for_baseline: She walked ahead of me on the narrow path ; she had slender legs and pretty ankles .

source_bert_toks: she walked ahead of me on the narrow path ; she had slender legs and pretty ankles .

reference_raw: She walked down the narrow path ahead of me; her legs were slim and beautiful.

reference_spacy_tokens: She walked down the narrow path ahead of me ; her legs were slim and beautiful .


fn_spacy_tokens_for_baseline: Scientists believe remains dug up in a Siberian forest could be those of the last Russian Tsar and his family who were butchered by rebel guards after the 1917 communist revolution .

source_bert_toks: scientists believe remains dug up in a siberian forest could be those of the last russian tsar and his family who were butcher ##ed by rebel guards after the 1917 communist revolution .

reference_raw: Scientists believe that the remains dug up in the Siberian forest may be the ones of the last Russian Tsar and his family slaughtered by the rebel guards after the Communist Revolution of 1917.

reference_spacy_tokens: Scientists believe that the remains dug up in the Siberian forest may be the ones of the last Russian Tsar and his family slaughtered by the rebel guards after the Communist Revolution of 1917 .


fn_spacy_tokens_for_baseline: In the mountains and hills of the interior , the temperature drops with altitude and with the clouds that wrap around the highest peaks .

source_bert_toks: in the mountains and hills of the interior , the temperature drops with altitude and with the clouds that wrap around the highest peaks .

reference_raw: In the mountains and hills of the interior, the heat drops with height and clouds that surround the highest peaks.

reference_spacy_tokens: In the mountains and hills of the interior , the heat drops with height and clouds that surround the highest peaks .


fn_spacy_tokens_for_baseline: A group of men in silks and satins joined the party , greeting Katarina as ' Contessa ' .

source_bert_toks: a group of men in silk ##s and satin ##s joined the party , greeting kata ##rina as ' con ##tes ##sa ' .

reference_raw: A group of silk-and-satin men joined the group, greeting Katarina as a 'Contessa'.

reference_spacy_tokens: A group of silk - and - satin men joined the group , greeting Katarina as a ' Contessa ' .


fn_spacy_tokens_for_baseline: The gunman managed to unbuckle his safety belt and struggled to push open the passenger door .

source_bert_toks: the gun ##man managed to un ##buck ##le his safety belt and struggled to push open the passenger door .

reference_raw: The shooter managed to unfasten his seatbelt and tried to open the passenger door.

reference_spacy_tokens: The shooter managed to unfasten his seatbelt and tried to open the passenger door .


fn_spacy_tokens_for_baseline: He was just shifting this succulent morsel in his mouth before grinding her bones , when he heard an extraordinary sound ; he heard a gurgle of laughter .

source_bert_toks: he was just shifting this su ##cc ##ulent morse ##l in his mouth before grinding her bones , when he heard an extraordinary sound ; he heard a gu ##rg ##le of laughter .

reference_raw: He was just moving the juicy bite into his mouth before grinding her bones, when he heard a strange sound; he heard a gurgle of laughter.

reference_spacy_tokens: He was just moving the juicy bite into his mouth before grinding her bones , when he heard a strange sound ; he heard a gurgle of laughter .


fn_spacy_tokens_for_baseline: I was a player in a drama written and cast by Jean - Claude , who had not rehearsed me for it .

source_bert_toks: i was a player in a drama written and cast by jean - claude , who had not re ##hear ##sed me for it .

reference_raw: I played drama written and cast by Jean-Claude, who didn't test me for it.

reference_spacy_tokens: I played drama written and cast by Jean - Claude , who did n't test me for it .


fn_spacy_tokens_for_baseline: He also encounters his arch enemy Professor Moriarty in a mystery which involves a kidnapped child and returning stolen gold to the world exchange , thereby preventing an economic crisis and a world war .

source_bert_toks: he also encounters his arch enemy professor mori ##arty in a mystery which involves a kidnapped child and returning stolen gold to the world exchange , thereby preventing an economic crisis and a world war .

reference_raw: He also encounters his arch-enemy Professor Moriarty in a mystery involving the abduction of a child and the return of stolen gold to the world market, thus preventing the economic crisis and the war in the world.

reference_spacy_tokens: He also encounters his arch - enemy Professor Moriarty in a mystery involving the abduction of a child and the return of stolen gold to the world market , thus preventing the economic crisis and the war in the world .


fn_spacy_tokens_for_baseline: ' I felt mortified , but cushioned by the drink . '

source_bert_toks: ' i felt mort ##ified , but cushion ##ed by the drink . '

reference_raw: "I felt humiliated, but covered with a drink."

reference_spacy_tokens: " I felt humiliated , but covered with a drink . "


fn_spacy_tokens_for_baseline: When they finally prised the boy 's boots off , the smell that came into the ward made the nurse retch into the stone sink beside them .

source_bert_toks: when they finally pri ##sed the boy ' s boots off , the smell that came into the ward made the nurse re ##tch into the stone sink beside them .

reference_raw: When they finally got the boy's shoes off, the smell in the ward caused the nurse to fall back into the stone sink next to them.

reference_spacy_tokens: When they finally got the boy 's shoes off , the smell in the ward caused the nurse to fall back into the stone sink next to them .


fn_spacy_tokens_for_baseline: Meanwhile , the music 's sound and technology was providing the sonic space and public rituals for hip - hop -- as electrifying a pop form as I 've ever heard .

source_bert_toks: meanwhile , the music ' s sound and technology was providing the sonic space and public rituals for hip - hop - - as elect ##ri ##fying a pop form as i ' ve ever heard .

reference_raw: In the meantime, music noise and technology provided a sonic space and public ritual for hip-hop -- as electrifying pop-form as I had ever heard.

reference_spacy_tokens: In the meantime , music noise and technology provided a sonic space and public ritual for hip - hop -- as electrifying pop - form as I had ever heard .


fn_spacy_tokens_for_baseline: Bocelli grew up among the vineyards and olive groves of his estate in Lajatico , a community in rural Tuscany near Pisa .

source_bert_toks: bo ##cel ##li grew up among the vineyards and olive groves of his estate in la ##ja ##tic ##o , a community in rural tuscany near pisa .

reference_raw: Bocelli grew up among the vineyards and olive groves of his estate in Lajatico, a village in the country of Tuscany near Pisa.

reference_spacy_tokens: Bocelli grew up among the vineyards and olive groves of his estate in Lajatico , a village in the country of Tuscany near Pisa .


fn_spacy_tokens_for_baseline: Holmes laid his hand upon the inspector 's shoulder .

source_bert_toks: holmes laid his hand upon the inspector ' s shoulder .

reference_raw: Holmes put his hand on the inspector's arm.

reference_spacy_tokens: Holmes put his hand on the inspector 's arm .


fn_spacy_tokens_for_baseline: But it is far from clear that they would undercut Obama by refusing an administration request for funds to pay for the conflict .

source_bert_toks: but it is far from clear that they would under ##cut obama by refusing an administration request for funds to pay for the conflict .

reference_raw: But it is far from clear that they would undermine Obama by rejecting the government's request for funding to pay for the conflict.

reference_spacy_tokens: But it is far from clear that they would undermine Obama by rejecting the government 's request for funding to pay for the conflict .


fn_spacy_tokens_for_baseline: His hands were tightly bound together with what felt like bootlaces .

source_bert_toks: his hands were tightly bound together with what felt like boot ##lace ##s .

reference_raw: His hands were tightly bound to what looked like laces.

reference_spacy_tokens: His hands were tightly bound to what looked like laces .


fn_spacy_tokens_for_baseline: Eventually , and after considerable discomfiture for the District committee and Pateman , Miss Green accepted the de facto position in both counties .

source_bert_toks: eventually , and after considerable disco ##m ##fi ##ture for the district committee and pat ##eman , miss green accepted the de facto position in both counties .

reference_raw: Finally, and after considerable inconvenience to the District Commission and Pateman, Miss Green took a de facto position in both counties.

reference_spacy_tokens: Finally , and after considerable inconvenience to the District Commission and Pateman , Miss Green took a de facto position in both counties .


fn_spacy_tokens_for_baseline: But this new alloy is being oxidised -- and flaking off -- much faster than the old alloy ; the chemistry of the mixtures is still poorly understood .

source_bert_toks: but this new alloy is being ox ##idi ##sed - - and fl ##aking off - - much faster than the old alloy ; the chemistry of the mixture ##s is still poorly understood .

reference_raw: But this new alloy is oxidized - and flaked - much faster than the old alloy; the chemical composition of the mixture is still poorly understood.

reference_spacy_tokens: But this new alloy is oxidized - and flaked - much faster than the old alloy ; the chemical composition of the mixture is still poorly understood .


fn_spacy_tokens_for_baseline: This busy , modern European city sits on a thousand years of history -- history is present everywhere , from elegant Merrion Square to the bullet holes on the General Post Office .

source_bert_toks: this busy , modern european city sits on a thousand years of history - - history is present everywhere , from elegant mer ##rion square to the bullet holes on the general post office .

reference_raw: This busy, modern European city sits on 1,000 years of history - history is everywhere, from the elegant Merrion Square to the bullet holes in the General Post Office.

reference_spacy_tokens: This busy , modern European city sits on 1,000 years of history - history is everywhere , from the elegant Merrion Square to the bullet holes in the General Post Office .


fn_spacy_tokens_for_baseline: Bears have suffered five successive defeats , including a 47 - 43 home defeat by Peterborough last week .

source_bert_toks: bears have suffered five successive defeats , including a 47 - 43 home defeat by peterborough last week .

reference_raw: The bears suffered five consecutive defeats, including Peterborough's 47-43 domestic defeat last week.

reference_spacy_tokens: The bears suffered five consecutive defeats , including Peterborough 's 47 - 43 domestic defeat last week .


fn_spacy_tokens_for_baseline: Born of Dilga , the Earth Mother , they fashioned the first genitals from the magic fungus for the hitherto sexless and infertile humans who had aimlessly wandered the earth .

source_bert_toks: born of dil ##ga , the earth mother , they fashioned the first gen ##ital ##s from the magic fungus for the hit ##her ##to sex ##less and in ##fer ##tile humans who had aim ##lessly wandered the earth .

reference_raw: Born of Dilga, Earth Mother, they made the first genitals of a magical sponge for sexless, infertile people who had wandered aimlessly around the world.

reference_spacy_tokens: Born of Dilga , Earth Mother , they made the first genitals of a magical sponge for sexless , infertile people who had wandered aimlessly around the world .


fn_spacy_tokens_for_baseline: Another bogus defector was code - named Fedora , possibly in reality Viktor Lessiovski , who used his work at the United Nations as a cover .

source_bert_toks: another bog ##us defect ##or was code - named fed ##ora , possibly in reality viktor less ##io ##vs ##ki , who used his work at the united nations as a cover .

reference_raw: Another fake defector was code named Fedora, probably Victor Lessiovski, who used his UN job as a cover.

reference_spacy_tokens: Another fake defector was code named Fedora , probably Victor Lessiovski , who used his UN job as a cover .


fn_spacy_tokens_for_baseline: To make the most of fragrant flowers such as these sweetly scented golden and white freesias and white lilies , display them by massing the flowers closely together in side - by - side containers .

source_bert_toks: to make the most of fra ##grant flowers such as these sweetly scented golden and white free ##sia ##s and white lil ##ies , display them by mass ##ing the flowers closely together in side - by - side containers .

reference_raw: In order to make the most of the scented flowers, such as those sweet-smelling gold and white lilies and white lilies, show them by massing them closely together in side-by-side containers.

reference_spacy_tokens: In order to make the most of the scented flowers , such as those sweet - smelling gold and white lilies and white lilies , show them by massing them closely together in side - by - side containers .


fn_spacy_tokens_for_baseline: The dual attacks on intelligence officials coincided with a deadly day for Western troops in Afghanistan .

source_bert_toks: the dual attacks on intelligence officials coincided with a deadly day for western troops in afghanistan .

reference_raw: The double attack on intelligence officials was the same as the death of Western troops in Afghanistan.

reference_spacy_tokens: The double attack on intelligence officials was the same as the death of Western troops in Afghanistan .


fn_spacy_tokens_for_baseline: Many soldiers , still manning their guns , were bespattered with the bowels , blood and brains of their stricken comrades .

source_bert_toks: many soldiers , still manning their guns , were be ##sp ##atter ##ed with the bow ##els , blood and brains of their stricken comrades .

reference_raw: Many of the soldiers, still manning their weapons, were stained with the guts, blood, and brains of their stricken comrades.

reference_spacy_tokens: Many of the soldiers , still manning their weapons , were stained with the guts , blood , and brains of their stricken comrades .


fn_spacy_tokens_for_baseline: And in its $ 1.7 billion purchase of Stauffer , another American chemicals firm , in 1987 it did a passable impersonation of Hanson , paying for most of the bid with $ 1.15 billion of asset sales .

source_bert_toks: and in its $ 1 . 7 billion purchase of st ##au ##ffer , another american chemicals firm , in 1987 it did a pass ##able imp ##erson ##ation of hanson , paying for most of the bid with $ 1 . 15 billion of asset sales .

reference_raw: And in 1987, in its $1.7 billion purchase of Stauffer, another American chemical company, it made a passable imitation of Hanson, paying for most of the bid with $1.15 billion of asset sales.

reference_spacy_tokens: And in 1987 , in its $ 1.7 billion purchase of Stauffer , another American chemical company , it made a passable imitation of Hanson , paying for most of the bid with $ 1.15 billion of asset sales .


fn_spacy_tokens_for_baseline: In a leaflet entitled What is the West Ham Municipal Alliance ?

source_bert_toks: in a leaf ##let entitled what is the west ham municipal alliance ?

reference_raw: In a leaflet called What is the West Ham community alliance?

reference_spacy_tokens: In a leaflet called What is the West Ham community alliance ?


fn_spacy_tokens_for_baseline: A dissident intellectual passing out leaflets at a factory gate reminds him of a nervous child offering a sugar lump to a large horse .

source_bert_toks: a di ##ssi ##dent intellectual passing out leaflets at a factory gate reminds him of a nervous child offering a sugar lump to a large horse .

reference_raw: The dissident intellectual handing out flyers at the factory gate reminds him of a nervous child offering a lump of sugar to a big horse.

reference_spacy_tokens: The dissident intellectual handing out flyers at the factory gate reminds him of a nervous child offering a lump of sugar to a big horse .


fn_spacy_tokens_for_baseline: ' Will you think me extremely uncivil if I say that I do n't believe you ? '

source_bert_toks: ' will you think me extremely un ##ci ##vil if i say that i don ' t believe you ? '

reference_raw: "Do you think I'm extremely civil when I say I don't trust you?"

reference_spacy_tokens: " Do you think I 'm extremely civil when I say I do n't trust you ? "


fn_spacy_tokens_for_baseline: Oh ! if you do n't get Nutty soon I 'll gouge his eyes out with a swizzle stick , cut off his conjugals , marinate him in oil and vinegar and barbecue him in the forum .

source_bert_toks: oh ! if you don ' t get nut ##ty soon i ' ll go ##uge his eyes out with a sw ##iz ##zle stick , cut off his con ##ju ##gal ##s , marina ##te him in oil and vinegar and barbecue him in the forum .

reference_raw: If you don't get Nutty soon, I'm gonna gouge his eyes with a swizzle stick, cut off his conjugals, marine him with oil and vinegar, and barbecue him in the forum.

reference_spacy_tokens: If you do n't get Nutty soon , I 'm gon na gouge his eyes with a swizzle stick , cut off his conjugals , marine him with oil and vinegar , and barbecue him in the forum .


fn_spacy_tokens_for_baseline: There are no indications that the sides are close to reaching a deal on the posts , and in fact talks appear stalled and any goodwill has evaporated as both camps dig in and refuse to compromise .

source_bert_toks: there are no indications that the sides are close to reaching a deal on the posts , and in fact talks appear stalled and any goodwill has eva ##por ##ated as both camps dig in and refuse to compromise .

reference_raw: There's no indication that the parties are close to reaching a job deal, and in fact, the talks seem to have stalled, and any goodwill has evaporated as the two camps dig in and refuse to jeopardize it.

reference_spacy_tokens: There 's no indication that the parties are close to reaching a job deal , and in fact , the talks seem to have stalled , and any goodwill has evaporated as the two camps dig in and refuse to jeopardize it .


fn_spacy_tokens_for_baseline: She is sympathetic about the royal marriage split .

source_bert_toks: she is sympathetic about the royal marriage split .

reference_raw: She sympathizes with the separation of royal marriages.

reference_spacy_tokens: She sympathizes with the separation of royal marriages .


fn_spacy_tokens_for_baseline: The plash of flowing water is authentically audible throughout this scene .

source_bert_toks: the pl ##ash of flowing water is authentic ##ally audible throughout this scene .

reference_raw: The splash of running water is authentically audible throughout the scene.

reference_spacy_tokens: The splash of running water is authentically audible throughout the scene .


fn_spacy_tokens_for_baseline: Over fifteen thousand have been seriously wounded .

source_bert_toks: over fifteen thousand have been seriously wounded .

reference_raw: More than 15,000 were seriously injured.

reference_spacy_tokens: More than 15,000 were seriously injured .


fn_spacy_tokens_for_baseline: Unfortunately , people in this latter group have decreased their consumption by 10 per cent , thus widening an important dietary difference between the social groups .

source_bert_toks: unfortunately , people in this latter group have decreased their consumption by 10 per cent , thus widening an important dietary difference between the social groups .

reference_raw: Unfortunately, people in the latter group have reduced their consumption by 10%, thus widening the significant dietary gap between the social groups.

reference_spacy_tokens: Unfortunately , people in the latter group have reduced their consumption by 10 % , thus widening the significant dietary gap between the social groups .


fn_spacy_tokens_for_baseline: This lack of LSC action on the alien representation issue occurred in the face of vigorous LSC audits and scrutiny of the recipient 's practices .

source_bert_toks: this lack of l ##sc action on the alien representation issue occurred in the face of vigorous l ##sc audit ##s and scrutiny of the recipient ' s practices .

reference_raw: This lack of LSC action in the field of foreign representation has taken place in the context of intensive LSC audits and control of the beneficiary's practices.

reference_spacy_tokens: This lack of LSC action in the field of foreign representation has taken place in the context of intensive LSC audits and control of the beneficiary 's practices .


fn_spacy_tokens_for_baseline: The flu is hitting the United States .

source_bert_toks: the flu is hitting the united states .

reference_raw: The flu strikes the United States.

reference_spacy_tokens: The flu strikes the United States .


fn_spacy_tokens_for_baseline: This need was accentuated by the extension of the Institute 's training scheme to non - practising organisations and into the European Community .

source_bert_toks: this need was accent ##uated by the extension of the institute ' s training scheme to non - pr ##act ##ising organisations and into the european community .

reference_raw: This need has been highlighted by the extension of the Institute's training programme to non-professional organisations and to the European Community.

reference_spacy_tokens: This need has been highlighted by the extension of the Institute 's training programme to non - professional organisations and to the European Community .


fn_spacy_tokens_for_baseline: " The Iranians are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the IAEA to monitor the entire uranium enrichment process , " the diplomat said .

source_bert_toks: " the iranian ##s are now willing to accept the installation of cameras only outside the cascade halls , which will not enable the ia ##ea to monitor the entire uranium enrichment process , " the diplomat said .

reference_raw: "The Iranians are now willing to allow cameras to be installed outside the cascade halls, so the IAEA will not be able to monitor the entire enrichment process of uranium," the diplomat said.

reference_spacy_tokens: " The Iranians are now willing to allow cameras to be installed outside the cascade halls , so the IAEA will not be able to monitor the entire enrichment process of uranium , " the diplomat said .


fn_spacy_tokens_for_baseline: Macdonell began his career as an author in 1927 by writing detective stories , sometimes under the pseudonyms of Neil Gordon or John Cameron .

source_bert_toks: mac ##don ##ell began his career as an author in 1927 by writing detective stories , sometimes under the pseudonym ##s of neil gordon or john cameron .

reference_raw: In 1927, Macdonell began his career as a writer by writing detective stories, sometimes under the alias of Neil Gordon or John Cameron.

reference_spacy_tokens: In 1927 , Macdonell began his career as a writer by writing detective stories , sometimes under the alias of Neil Gordon or John Cameron .


fn_spacy_tokens_for_baseline: But even so the soft clang rang sharply in the silence and echoed around him as he made his way down the nave .

source_bert_toks: but even so the soft clan ##g rang sharply in the silence and echoed around him as he made his way down the nave .

reference_raw: Yet there was a sharp ringing in the silence, echoing around him as he made his way down the nave.

reference_spacy_tokens: Yet there was a sharp ringing in the silence , echoing around him as he made his way down the nave .


fn_spacy_tokens_for_baseline: Your gift to Goodwill will help us do even more this year because your gift will be used to directly support our work .

source_bert_toks: your gift to goodwill will help us do even more this year because your gift will be used to directly support our work .

reference_raw: Your gift to Goodwill will help us do even more this year, since your gift will be used to directly support our work.

reference_spacy_tokens: Your gift to Goodwill will help us do even more this year , since your gift will be used to directly support our work .


fn_spacy_tokens_for_baseline: Professor Winston said : ' I 'm thrilled to see them all here .

source_bert_toks: professor winston said : ' i ' m thrilled to see them all here .

reference_raw: "I'm excited to see them all here," said Professor Winston.

reference_spacy_tokens: " I 'm excited to see them all here , " said Professor Winston .


fn_spacy_tokens_for_baseline: Consistently , approximately 60 per cent of the population aged 65 + rate their health as good , 30 per cent as fair and 10 per cent as poor ( Victor 1987 ) .

source_bert_toks: consistently , approximately 60 per cent of the population aged 65 + rate their health as good , 30 per cent as fair and 10 per cent as poor ( victor 1987 ) .

reference_raw: At the same time, around 60 % of the population aged 65 + rate their health as good, 30 % as good and 10 % as poor (Victor 1987).

reference_spacy_tokens: At the same time , around 60 % of the population aged 65 + rate their health as good , 30 % as good and 10 % as poor ( Victor 1987 ) .


fn_spacy_tokens_for_baseline: Two speeches straddled the domestic political scene this week , each of them an affirmation of the survival of the British ancien regime and of the continuing relevance of archaic institutions of the UK state .

source_bert_toks: two speeches st ##rad ##dled the domestic political scene this week , each of them an af ##firm ##ation of the survival of the british an ##cie ##n regime and of the continuing relevance of archaic institutions of the uk state .

reference_raw: This week, two speeches straddled the national political scene, each confirming the survival of the British ancient regime and the continuing importance of the British government's archaic institutions.

reference_spacy_tokens: This week , two speeches straddled the national political scene , each confirming the survival of the British ancient regime and the continuing importance of the British government 's archaic institutions .


fn_spacy_tokens_for_baseline: ' There 's a lot of smart sensors that take away the ( guesswork ) of the soldiers , ' said Bruce Baldwin , the U.S. Army Chemical School 's lead trainer for new systems . " ( The Olympian Online , 20Apr06 , Christian Hill ) ( Link )

source_bert_toks: ' there ' s a lot of smart sensors that take away the ( guess ##work ) of the soldiers , ' said bruce baldwin , the u . s . army chemical school ' s lead trainer for new systems . " ( the olympian online , 20 ##ap ##r ##0 ##6 , christian hill ) ( link )

reference_raw: 'There are many intelligent sensors that take away the (guesswork) of the troops,' said Bruce Baldwin, the head coach of the American Army Chemical School for New Systems.' (Olympian Online, 20 April 2006, Christian Hill)

reference_spacy_tokens: ' There are many intelligent sensors that take away the ( guesswork ) of the troops , ' said Bruce Baldwin , the head coach of the American Army Chemical School for New Systems . ' ( Olympian Online , 20 April 2006 , Christian Hill )


fn_spacy_tokens_for_baseline: Fishermen would repair to the woods to cut hazel and withies to make or mend their pots , then set out in their small boats to their chosen ' grounds ' to drop the pots .

source_bert_toks: fishermen would repair to the woods to cut hazel and with ##ies to make or men ##d their pots , then set out in their small boats to their chosen ' grounds ' to drop the pots .

reference_raw: The fishermen would fix the forests to cut the hazel and withyes to make or fix the pots, and then they would go out in their small boats to their chosen "grounds" and drop the pots.

reference_spacy_tokens: The fishermen would fix the forests to cut the hazel and withyes to make or fix the pots , and then they would go out in their small boats to their chosen " grounds " and drop the pots .


fn_spacy_tokens_for_baseline: Instead , be prepared for a barrage of questions about your life , offers to supply anything you need , a host of jokes at your expense , and some serious flirting if you 're single .

source_bert_toks: instead , be prepared for a barrage of questions about your life , offers to supply anything you need , a host of jokes at your expense , and some serious flirting if you ' re single .

reference_raw: Instead, get ready to barrage questions about your life, offer to deliver whatever you need, a lot of jokes at your expense, and a lot of serious flirting when you're free.

reference_spacy_tokens: Instead , get ready to barrage questions about your life , offer to deliver whatever you need , a lot of jokes at your expense , and a lot of serious flirting when you 're free .


fn_spacy_tokens_for_baseline: The guilty plea means the trial now will focus on the sentence , which could total 15 years .

source_bert_toks: the guilty plea means the trial now will focus on the sentence , which could total 15 years .

reference_raw: A guilty confession means that the trial will now focus on a sentence that could take a total of 15 years.

reference_spacy_tokens: A guilty confession means that the trial will now focus on a sentence that could take a total of 15 years .


fn_spacy_tokens_for_baseline: Here the shareholder could argue that the insider dealing was either a mala fide abuse of position or a misappropriation of the company 's assets , neither of which are ratifiable .

source_bert_toks: here the shareholder could argue that the insider dealing was either a mala fide abuse of position or a mis ##app ##ropriation of the company ' s assets , neither of which are rat ##if ##iable .

reference_raw: In the present case, the shareholder may claim that the insider transaction is either a mala fide abuse or a misuse of the assets of the company, none of which can be rated.

reference_spacy_tokens: In the present case , the shareholder may claim that the insider transaction is either a mala fide abuse or a misuse of the assets of the company , none of which can be rated .


fn_spacy_tokens_for_baseline: ' I 've got scads of friends , ' Sebastian replied .

source_bert_toks: ' i ' ve got sc ##ads of friends , ' sebastian replied .

reference_raw: 'I have many friends,' said Sebastian.

reference_spacy_tokens: ' I have many friends , ' said Sebastian .


fn_spacy_tokens_for_baseline: He said it correctly suspecting that the Conservatives were about to be pitched back into opposition by Lord Aberdeen 's coalition of Peelites , Whigs and Liberals .

source_bert_toks: he said it correctly suspect ##ing that the conservatives were about to be pitched back into opposition by lord aberdeen ' s coalition of peel ##ites , whig ##s and liberals .

reference_raw: He said he was right to suspect that the Conservatives would soon be put back in opposition by Lord Aberdeen's coalition of Peelites, Whigs and Liberals.

reference_spacy_tokens: He said he was right to suspect that the Conservatives would soon be put back in opposition by Lord Aberdeen 's coalition of Peelites , Whigs and Liberals .


fn_spacy_tokens_for_baseline: You generally need to remove the thick spine before finely shredding the leaf .

source_bert_toks: you generally need to remove the thick spine before finely sh ##red ##ding the leaf .

reference_raw: In general, you have to remove the thick backbone before gently crushing the leaves.

reference_spacy_tokens: In general , you have to remove the thick backbone before gently crushing the leaves .


fn_spacy_tokens_for_baseline: She leaned her head in her hands .

source_bert_toks: she leaned her head in her hands .

reference_raw: She put her head in her hands.

reference_spacy_tokens: She put her head in her hands .


fn_spacy_tokens_for_baseline: In the first finale of Die Zauberflote Mozart revised the staccato signs .

source_bert_toks: in the first finale of die za ##uber ##fl ##ote mozart revised the st ##ac ##cat ##o signs .

reference_raw: Die Zauberflote Mozart's first final review of the staccato signs.

reference_spacy_tokens: Die Zauberflote Mozart 's first final review of the staccato signs .


fn_spacy_tokens_for_baseline: The second cell ( 82c ) contains a moaning , naked Orc chained down on a bed of nails which rip the boil - infested flesh on his back .

source_bert_toks: the second cell ( 82 ##c ) contains a moaning , naked or ##c chained down on a bed of nails which rip the boil - in ##fest ##ed flesh on his back .

reference_raw: The second cell (82c) contains a groaning, naked goblin chained to a bed of nails that tears the boil-infested flesh from the back.

reference_spacy_tokens: The second cell ( 82c ) contains a groaning , naked goblin chained to a bed of nails that tears the boil - infested flesh from the back .


fn_spacy_tokens_for_baseline: Chilling the cotyledonary petiole to 0.5 ° C extends the time for spontaneous recovery to about 25 minutes .

source_bert_toks: chilling the cot ##yle ##don ##ary pet ##iol ##e to 0 . 5 ##° ##c extends the time for spontaneous recovery to about 25 minutes .

reference_raw: The cooling of the cotyledonary petiole to 0.5°C extends the spontaneous recovery time to approximately 25 minutes.

reference_spacy_tokens: The cooling of the cotyledonary petiole to 0.5 ° C extends the spontaneous recovery time to approximately 25 minutes .


fn_spacy_tokens_for_baseline: Although nuclear weapons were never used in Korea , American political leaders and military commanders threatened to use nuclear weapons to end the Korean War on terms favorable to the United States .

source_bert_toks: although nuclear weapons were never used in korea , american political leaders and military commanders threatened to use nuclear weapons to end the korean war on terms favorable to the united states .

reference_raw: Although nuclear weapons have never been used in Korea, American political leaders and war leaders have threatened to use nuclear weapons to end the Korean war under conditions favourable to the United States.

reference_spacy_tokens: Although nuclear weapons have never been used in Korea , American political leaders and war leaders have threatened to use nuclear weapons to end the Korean war under conditions favourable to the United States .


fn_spacy_tokens_for_baseline: Robina ( sixteen , beautiful , distracted ) silently munches cornflakes .

source_bert_toks: robin ##a ( sixteen , beautiful , distracted ) silently mu ##nche ##s corn ##fl ##akes .

reference_raw: Robina (sixteen, beautiful, distracted) quietly chews cornflakes.

reference_spacy_tokens: Robina ( sixteen , beautiful , distracted ) quietly chews cornflakes .


fn_spacy_tokens_for_baseline: Unable to replicate the agricultural techniques of the Anasazi , the Paiutes were destined to a semi - nomadic lifestyle until European settlers arrived , changing the nature of existence in the valley forever .

source_bert_toks: unable to replicate the agricultural techniques of the ana ##sa ##zi , the pa ##iu ##tes were destined to a semi - nomadic lifestyle until european settlers arrived , changing the nature of existence in the valley forever .

reference_raw: The Paiutes, unable to replicate the farming methods of the Anasazi, were destined for a semi-nomadic lifestyle until European settlers arrived and changed the nature of life in the valley forever.

reference_spacy_tokens: The Paiutes , unable to replicate the farming methods of the Anasazi , were destined for a semi - nomadic lifestyle until European settlers arrived and changed the nature of life in the valley forever .


fn_spacy_tokens_for_baseline: Her knee grazed against the bark , but her tights remained miraculously intact .

source_bert_toks: her knee grazed against the bark , but her tight ##s remained miraculous ##ly intact .

reference_raw: Her knee scratched against the bark, but her stockings were miraculously untouched.

reference_spacy_tokens: Her knee scratched against the bark , but her stockings were miraculously untouched .


fn_spacy_tokens_for_baseline: Those members of staff who have reservations about the value of a genuine partnership with parents can best be convinced by the successes of many small actions .

source_bert_toks: those members of staff who have reservations about the value of a genuine partnership with parents can best be convinced by the successes of many small actions .

reference_raw: Staff with reservations about the value of a genuine partnership with parents can best be persuaded by the success of many small actions.

reference_spacy_tokens: Staff with reservations about the value of a genuine partnership with parents can best be persuaded by the success of many small actions .


fn_spacy_tokens_for_baseline: Its restored lobby is Hong Kong 's most elegant gathering place ; afternoon tea here is a visitors ' ritual .

source_bert_toks: its restored lobby is hong kong ' s most elegant gathering place ; afternoon tea here is a visitors ' ritual .

reference_raw: Its restored lobby is the finest gathering place in Hong Kong; afternoon tea is a visitor's ritual.

reference_spacy_tokens: Its restored lobby is the finest gathering place in Hong Kong ; afternoon tea is a visitor 's ritual .


fn_spacy_tokens_for_baseline: Nowhere is the threat of nuclear war or nuclear terrorism , or the need to safeguard nuclear weapons more important than in South Asia , the home to Al Qaida , who seeks nuclear weapons , Dorgan said describing it as an area where relations among regional nuclear powers - China , India , Pakistan - have historically been tense . ( DailyIndia.com ; 25Jun06 ; Arun Kumar , Indo - Asian News Service ) ( Link )

source_bert_toks: nowhere is the threat of nuclear war or nuclear terrorism , or the need to safeguard nuclear weapons more important than in south asia , the home to al q ##aid ##a , who seeks nuclear weapons , do ##rgan said describing it as an area where relations among regional nuclear powers - china , india , pakistan - have historically been tense . ( daily ##ind ##ia . com ; 25 ##jun ##0 ##6 ; arun kumar , indo - asian news service ) ( link )

reference_raw: Nowhere is the threat of nuclear war or nuclear terrorism or the need to protect nuclear weapons more important than in South Asia, home to Al Qaeda, seeking nuclear weapons, Dorgan described it as an area in which relations between regional nuclear powers - China, India, Pakistan - have historically been tense (DailyIndia.com, 25 June 2006; Arun Kumar, Indo - Asian News Service)

reference_spacy_tokens: Nowhere is the threat of nuclear war or nuclear terrorism or the need to protect nuclear weapons more important than in South Asia , home to Al Qaeda , seeking nuclear weapons , Dorgan described it as an area in which relations between regional nuclear powers - China , India , Pakistan - have historically been tense ( DailyIndia.com , 25 June 2006 ; Arun Kumar , Indo - Asian News Service )


fn_spacy_tokens_for_baseline: Dustin played Jason Fister , a bumbling undercover Treasury agent sent to Italy to locate gangster Madigan 's ill - gotten millions , thereby becoming embroiled in a series of slapstick mishaps .

source_bert_toks: dustin played jason fist ##er , a bum ##bling undercover treasury agent sent to italy to locate gangster mad ##igan ' s ill - gotten millions , thereby becoming em ##bro ##iled in a series of slap ##stick mis ##ha ##ps .

reference_raw: Dustin played Jason Fister, a blundering undercover finance agent sent to Italy to find gangster Madigan's ill-gotten millions, and he became embroiled in a series of slapstick accidents.

reference_spacy_tokens: Dustin played Jason Fister , a blundering undercover finance agent sent to Italy to find gangster Madigan 's ill - gotten millions , and he became embroiled in a series of slapstick accidents .


fn_spacy_tokens_for_baseline: These observations ruled out that the identity of the last amino acid was the main determinant of readthrough level .

source_bert_toks: these observations ruled out that the identity of the last amino acid was the main deter ##mina ##nt of read ##th ##rou ##gh level .

reference_raw: Those observations exclude the fact that the main determinant of the reading level is the identity of the last amino acid.

reference_spacy_tokens: Those observations exclude the fact that the main determinant of the reading level is the identity of the last amino acid .


fn_spacy_tokens_for_baseline: He was drawn to such slow , mournful music and he carried it with him everywhere .

source_bert_toks: he was drawn to such slow , mo ##urn ##ful music and he carried it with him everywhere .

reference_raw: He was drawn to such slow, grieving music and carried it everywhere.

reference_spacy_tokens: He was drawn to such slow , grieving music and carried it everywhere .


fn_spacy_tokens_for_baseline: These animals , introduced by pirates and whalers between the sixteenth and nineteenth centuries , denude the vegetation and compete with the giant tortoise ( Geochelone elephantopus ) .

source_bert_toks: these animals , introduced by pirates and whale ##rs between the sixteenth and nineteenth centuries , den ##ude the vegetation and compete with the giant tor ##to ##ise ( geo ##chel ##one elephant ##opus ) .

reference_raw: These animals, introduced between the sixteenth and nineteenth centuries by pirates and whalers, deny vegetation and compete with a giant turtle (Geochelone elephantopus).

reference_spacy_tokens: These animals , introduced between the sixteenth and nineteenth centuries by pirates and whalers , deny vegetation and compete with a giant turtle ( Geochelone elephantopus ) .


fn_spacy_tokens_for_baseline: If a piece of ordinary glass is heated over a gas flame , it softens easily , and eventually the heated part will gather itself into a drop and fall to the ground .

source_bert_toks: if a piece of ordinary glass is heated over a gas flame , it soft ##ens easily , and eventually the heated part will gather itself into a drop and fall to the ground .

reference_raw: When a piece of ordinary glass is heated above a gas flame, it becomes softer, and in the end, the heated part of the glass gathers in a drop and falls to the ground.

reference_spacy_tokens: When a piece of ordinary glass is heated above a gas flame , it becomes softer , and in the end , the heated part of the glass gathers in a drop and falls to the ground .


fn_spacy_tokens_for_baseline: The attackers were environmental terrorists upset about a new industry coming to town .

source_bert_toks: the attackers were environmental terrorists upset about a new industry coming to town .

reference_raw: The assailants were environmental terrorists who were pissed off about a new industry coming into the city.

reference_spacy_tokens: The assailants were environmental terrorists who were pissed off about a new industry coming into the city .


fn_spacy_tokens_for_baseline: Bristol Crown Court heard that Jason Levy from Cheltenham set fire to a house in the town after breaking in , while Chloe Robinson was asleep upstairs with her parents .

source_bert_toks: bristol crown court heard that jason levy from cheltenham set fire to a house in the town after breaking in , while chloe robinson was asleep upstairs with her parents .

reference_raw: Bristol Crown Court has heard that Jason Levy of Cheltenham burned down a house in the city after the break-in, while Chloe Robinson and her parents slept upstairs.

reference_spacy_tokens: Bristol Crown Court has heard that Jason Levy of Cheltenham burned down a house in the city after the break - in , while Chloe Robinson and her parents slept upstairs .


fn_spacy_tokens_for_baseline: Food must be bagged and boxed , and taken to the patient , for nothing nutritious will be otherwise provided .

source_bert_toks: food must be bag ##ged and boxed , and taken to the patient , for nothing nut ##rit ##ious will be otherwise provided .

reference_raw: The food must be packed and packaged and taken to the patient, since no nutrients will be provided otherwise.

reference_spacy_tokens: The food must be packed and packaged and taken to the patient , since no nutrients will be provided otherwise .


fn_spacy_tokens_for_baseline: " May the Lord bless you and keep you . " and he reeled off the whole benediction , still clinging to my hand .

source_bert_toks: " may the lord bless you and keep you . " and he reel ##ed off the whole benedict ##ion , still clinging to my hand .

reference_raw: "May God bless you and keep you," and he reeled from the blessing, still clinging to my hand.

reference_spacy_tokens: " May God bless you and keep you , " and he reeled from the blessing , still clinging to my hand .


fn_spacy_tokens_for_baseline: Joe Burns was lying about finding the gates and the back door open .

source_bert_toks: joe burns was lying about finding the gates and the back door open .

reference_raw: Joe Burns lay on the ground that he had found the gate and the back door open.

reference_spacy_tokens: Joe Burns lay on the ground that he had found the gate and the back door open .


fn_spacy_tokens_for_baseline: Swing that incense , wear that cope ,

source_bert_toks: swing that incense , wear that cope ,

reference_raw: Swing the incense, wear the handle,

reference_spacy_tokens: Swing the incense , wear the handle ,


fn_spacy_tokens_for_baseline: Egyptian archaeologists have uncovered a new pyramid at Giza , several feet to the southeast of the Great Pyramid of Cheops .

source_bert_toks: egyptian archaeologists have uncovered a new pyramid at gi ##za , several feet to the southeast of the great pyramid of che ##ops .

reference_raw: Egyptian archaeologists discovered a new pyramid in Giza, a few feet south-east of the Great Pyramid of Cheops.

reference_spacy_tokens: Egyptian archaeologists discovered a new pyramid in Giza , a few feet south - east of the Great Pyramid of Cheops .


fn_spacy_tokens_for_baseline: She stared at Lucenzo in consternation , sitting erect in the chair , unnerved by a terrible idea that had come into her head .

source_bert_toks: she stared at luce ##nzo in con ##ster ##nation , sitting erect in the chair , un ##ner ##ved by a terrible idea that had come into her head .

reference_raw: She stared at Lucenzo, startled, as she sat upright in her chair, unsettled by the terrible thought that had come to her mind.

reference_spacy_tokens: She stared at Lucenzo , startled , as she sat upright in her chair , unsettled by the terrible thought that had come to her mind .


fn_spacy_tokens_for_baseline: Doreen 's lip curled sneeringly as she uttered the word .

source_bert_toks: do ##reen ' s lip curled s ##neer ##ingly as she uttered the word .

reference_raw: Doreen's lip curled in a grimace as she spoke the word.

reference_spacy_tokens: Doreen 's lip curled in a grimace as she spoke the word .


fn_spacy_tokens_for_baseline: And he 's unrepentant about the oddity of empty frames in a fine - art museum .

source_bert_toks: and he ' s un ##re ##pen ##tan ##t about the odd ##ity of empty frames in a fine - art museum .

reference_raw: And he doesn't regret the strangeness of empty frames in a fine art museum.

reference_spacy_tokens: And he does n't regret the strangeness of empty frames in a fine art museum .


fn_spacy_tokens_for_baseline: When it did , the Las Vegas Valley ( which at the time had a non - native population of less than 30 ) would change as well .

source_bert_toks: when it did , the las vegas valley ( which at the time had a non - native population of less than 30 ) would change as well .

reference_raw: When this happened, the Valley of Las Vegas (which at the time had an unnatural population of less than 30) would also be altered.

reference_spacy_tokens: When this happened , the Valley of Las Vegas ( which at the time had an unnatural population of less than 30 ) would also be altered .


fn_spacy_tokens_for_baseline: Whilst doing so he managed to chomp his way through several broken biscuits .

source_bert_toks: whilst doing so he managed to cho ##mp his way through several broken biscuits .

reference_raw: While doing so, he managed to cut through a few broken cookies.

reference_spacy_tokens: While doing so , he managed to cut through a few broken cookies .


fn_spacy_tokens_for_baseline: I played with the dumpy stem of the brandy glass , smirking at Ashley through the candle flame .

source_bert_toks: i played with the dump ##y stem of the brandy glass , smirk ##ing at ashley through the candle flame .

reference_raw: I toyed with the dumpy stem of the brandy glass and smiled at Ashley through the candlelight.

reference_spacy_tokens: I toyed with the dumpy stem of the brandy glass and smiled at Ashley through the candlelight .


fn_spacy_tokens_for_baseline: That murder is indictable under our laws , just like that murder on the cruise ship , Achille Lauro .

source_bert_toks: that murder is ind ##ic ##table under our laws , just like that murder on the cruise ship , ac ##hill ##e lau ##ro .

reference_raw: The murder is impeachable by our law, as is the murder on the Achille Lauro cruise ship.

reference_spacy_tokens: The murder is impeachable by our law , as is the murder on the Achille Lauro cruise ship .


fn_spacy_tokens_for_baseline: So stow it . '

source_bert_toks: so st ##ow it . '

reference_raw: "Stow it, then."

reference_spacy_tokens: " Stow it , then . "


fn_spacy_tokens_for_baseline: A force was gaining strength in the east to threaten their new bases .

source_bert_toks: a force was gaining strength in the east to threaten their new bases .

reference_raw: In the east, a force was gaining power to threaten their new outposts.

reference_spacy_tokens: In the east , a force was gaining power to threaten their new outposts .


fn_spacy_tokens_for_baseline: NOW that the Queen has agreed to pay tax can we concentrate on scuttling the creaky old royal yacht , running the royal train into the buffers and grounding the Queen 's flight ?

source_bert_toks: now that the queen has agreed to pay tax can we concentrate on sc ##ut ##tling the cr ##eak ##y old royal yacht , running the royal train into the buffer ##s and ground ##ing the queen ' s flight ?

reference_raw: Now that the queen has agreed to pay taxes, can we focus on scuttling the creaky old royal yacht, driving the royal train into the buffers and landing the queen's flight?

reference_spacy_tokens: Now that the queen has agreed to pay taxes , can we focus on scuttling the creaky old royal yacht , driving the royal train into the buffers and landing the queen 's flight ?