fn_spacy_tokens_for_baseline: This , in fact , is becoming a general rule , according to Ms Van Housen : ' As long as you want to communicate internationally there are ways to do it .

source_bert_toks: this , in fact , is becoming a general rule , according to ms van house ##n : ' as long as you want to communicate internationally there are ways to do it .

reference_raw: In fact, according to Mrs. Van Housen, this becomes a general rule: 'If you wish to communicate internationally, there are ways to do so.

reference_spacy_tokens: In fact , according to Mrs. Van Housen , this becomes a general rule : ' If you wish to communicate internationally , there are ways to do so .


fn_spacy_tokens_for_baseline: Macau 's most memorable monument is the Baroque facade of the ruins of Sao Paulo , the only remains of a beautiful 17th - century Jesuit church .

source_bert_toks: macau ' s most memorable monument is the baroque facade of the ruins of sao paulo , the only remains of a beautiful 17th - century jesuit church .

reference_raw: The most memorable monument to Macau is the Baroque facade of the ruins of Sao Paulo, the one remnant of the beautiful 17th-century Jesuit Church.

reference_spacy_tokens: The most memorable monument to Macau is the Baroque facade of the ruins of Sao Paulo , the one remnant of the beautiful 17th - century Jesuit Church .


fn_spacy_tokens_for_baseline: Hong Kong 's major venue for the performing arts , the building has been criticized for its fortress - like architecture and windowless facade .

source_bert_toks: hong kong ' s major venue for the performing arts , the building has been criticized for its fortress - like architecture and window ##less facade .

reference_raw: Hong Kong's main place for performing art, the building was criticized for its stronghold, such as architecture and windowless facades.

reference_spacy_tokens: Hong Kong 's main place for performing art , the building was criticized for its stronghold , such as architecture and windowless facades .


fn_spacy_tokens_for_baseline: Is it not clear that the multiplicity of often overlapping self - regulating authorities are not adequately protecting the national interest ?

source_bert_toks: is it not clear that the multi ##plicity of often overlapping self - regulating authorities are not adequately protecting the national interest ?

reference_raw: Is it not clear that the multiplication of often overlapping self-regulatory bodies does not adequately protect national interests?

reference_spacy_tokens: Is it not clear that the multiplication of often overlapping self - regulatory bodies does not adequately protect national interests ?


fn_spacy_tokens_for_baseline: Then he caught hold of the girl , roughly , by her plait , and dragged her round in front of him .

source_bert_toks: then he caught hold of the girl , roughly , by her pl ##ai ##t , and dragged her round in front of him .

reference_raw: Then he grabbed the girl roughly by her plate and pulled her around in front of him.

reference_spacy_tokens: Then he grabbed the girl roughly by her plate and pulled her around in front of him .


fn_spacy_tokens_for_baseline: It is extremely important that the client must learn that avoidance of difficult situations is never an appropriate solution for their anxiety .

source_bert_toks: it is extremely important that the client must learn that avoidance of difficult situations is never an appropriate solution for their anxiety .

reference_raw: It is very important for clients to learn that avoiding difficult situations is never an appropriate solution to their anxiety.

reference_spacy_tokens: It is very important for clients to learn that avoiding difficult situations is never an appropriate solution to their anxiety .


fn_spacy_tokens_for_baseline: He 'd have to invent a new mode to reproduce what he 'd seen .

source_bert_toks: he ' d have to in ##vent a new mode to reproduce what he ' d seen .

reference_raw: He would have to invent a new way to replicate what he had seen.

reference_spacy_tokens: He would have to invent a new way to replicate what he had seen .


fn_spacy_tokens_for_baseline: The tyre warehouse burned down on bonfire night last year but hundreds of tyres were left buried under rubble on the site .

source_bert_toks: the tyre warehouse burned down on bonfire night last year but hundreds of tyres were left buried under rubble on the site .

reference_raw: The tire store burned down last year on a fire last year, but hundreds of tires were left buried in the rubble at the scene.

reference_spacy_tokens: The tire store burned down last year on a fire last year , but hundreds of tires were left buried in the rubble at the scene .


fn_spacy_tokens_for_baseline: SOUTH AFRICA : Dr Jonathan Gluckman , South Africa 's leading independent forensic pathologist , has received death threats following his publication of 26 July of forensic evidence that the police has murdered scores of people in custody .

source_bert_toks: south africa : dr jonathan g ##lu ##ckman , south africa ' s leading independent forensic path ##ologist , has received death threats following his publication of 26 july of forensic evidence that the police has murdered scores of people in custody .

reference_raw: Dr. Jonathan Gluckman, the leading independent forensic pathologist in South Africa, received death threats following the publication on 26 July of forensic evidence that the police killed dozens of people in custody.

reference_spacy_tokens: Dr. Jonathan Gluckman , the leading independent forensic pathologist in South Africa , received death threats following the publication on 26 July of forensic evidence that the police killed dozens of people in custody .


fn_spacy_tokens_for_baseline: The giant Sheffield rally looks great on TV .

source_bert_toks: the giant sheffield rally looks great on tv .

reference_raw: The big Sheffield rally looks great on TV.

reference_spacy_tokens: The big Sheffield rally looks great on TV .


fn_spacy_tokens_for_baseline: ' We were also stopped and interrogated by a para - military vigilante force who again wanted to know who we were and what were doing . '

source_bert_toks: ' we were also stopped and inter ##rogated by a para - military vi ##gil ##ante force who again wanted to know who we were and what were doing . '

reference_raw: "We were also stopped and questioned by a paramilitary guard who once again wanted to know who we were and what we were doing."

reference_spacy_tokens: " We were also stopped and questioned by a paramilitary guard who once again wanted to know who we were and what we were doing . "


fn_spacy_tokens_for_baseline: A former pool had silted up and was turning into a miniature reed marsh .

source_bert_toks: a former pool had si ##lt ##ed up and was turning into a miniature reed marsh .

reference_raw: The former pool clouded and became a miniature reed swamp.

reference_spacy_tokens: The former pool clouded and became a miniature reed swamp .


fn_spacy_tokens_for_baseline: Exercise that requires a limited sort of movement , such as walking or jogging , may be excellent for stamina but is not useful for suppleness .

source_bert_toks: exercise that requires a limited sort of movement , such as walking or jogging , may be excellent for st ##amina but is not useful for su ##pp ##lene ##ss .

reference_raw: Exercises requiring a limited type of movement, such as walking or running, may be perfect for stamina, but not useful for suppleness.

reference_spacy_tokens: Exercises requiring a limited type of movement , such as walking or running , may be perfect for stamina , but not useful for suppleness .


fn_spacy_tokens_for_baseline: Male crickets make a noise by rubbing their wings together .

source_bert_toks: male cricket ##s make a noise by rubbing their wings together .

reference_raw: The male crickets make a sound by rubbing their wings together.

reference_spacy_tokens: The male crickets make a sound by rubbing their wings together .


fn_spacy_tokens_for_baseline: If your cupboards are full to bursting , put up a handy shelf .

source_bert_toks: if your cupboard ##s are full to bursting , put up a handy shelf .

reference_raw: If your closets are filled with cracks, put up a handy shelf.

reference_spacy_tokens: If your closets are filled with cracks , put up a handy shelf .


fn_spacy_tokens_for_baseline: He feels in the drawer of his bedside table and brings out the tickets .

source_bert_toks: he feels in the drawer of his bedside table and brings out the tickets .

reference_raw: Feeling in the drawer of his nightstand, he pulls out the tickets.

reference_spacy_tokens: Feeling in the drawer of his nightstand , he pulls out the tickets .


fn_spacy_tokens_for_baseline: The " mysteries " are those depicted in a vast fresco of a young woman 's initiation into the cult of Dionysius of Greek origin .

source_bert_toks: the " mysteries " are those depicted in a vast fresco of a young woman ' s initiation into the cult of dion ##ys ##ius of greek origin .

reference_raw: The "mysteries" are the ones depicted in the great fresco of a young woman's induction into the cult of Dionysius from Greece.

reference_spacy_tokens: The " mysteries " are the ones depicted in the great fresco of a young woman 's induction into the cult of Dionysius from Greece .


fn_spacy_tokens_for_baseline: Despite assertions to the contrary , it is an indication that in reality Morocco had changed its status and become dependent .

source_bert_toks: despite assertion ##s to the contrary , it is an indication that in reality morocco had changed its status and become dependent .

reference_raw: Contrary to what is claimed to the contrary, it is an indication that Morocco has in fact changed its status and become dependent.

reference_spacy_tokens: Contrary to what is claimed to the contrary , it is an indication that Morocco has in fact changed its status and become dependent .


fn_spacy_tokens_for_baseline: Finally , in 1557 , they were all consolidated in Macau .

source_bert_toks: finally , in 155 ##7 , they were all consolidated in macau .

reference_raw: In the end, in 1557, all of them were reconsolidated in Macao.

reference_spacy_tokens: In the end , in 1557 , all of them were reconsolidated in Macao .


fn_spacy_tokens_for_baseline: Because teaching a man to fish will keep him fed for his entire life .

source_bert_toks: because teaching a man to fish will keep him fed for his entire life .

reference_raw: Because teaching a man to fish will feed him for the rest of his life.

reference_spacy_tokens: Because teaching a man to fish will feed him for the rest of his life .


fn_spacy_tokens_for_baseline: She had eyes only for him ; as they twirled around , they were joking together , and were clearly very much in love .

source_bert_toks: she had eyes only for him ; as they t ##wi ##rled around , they were joking together , and were clearly very much in love .

reference_raw: She had eyes only for him; when they turned, they were making fun of each other, and apparently very much in love with each other.

reference_spacy_tokens: She had eyes only for him ; when they turned , they were making fun of each other , and apparently very much in love with each other .


fn_spacy_tokens_for_baseline: Sodium Heparin , preventing coagulation of blood , aiding infusion of cryoprotectants , 20 % Mannitol , preventing cell swelling , due to hypoxia , ischaemia and injury .

source_bert_toks: sodium he ##par ##in , preventing coa ##gul ##ation of blood , aiding in ##fusion of cry ##op ##rot ##ect ##ants , 20 % mann ##ito ##l , preventing cell swelling , due to h ##yp ##ox ##ia , is ##cha ##emia and injury .

reference_raw: Sodium heparin prevents blood clotting, helps to infuse cryoprotectants, 20 % mannitol, prevents cell oedema due to hypoxia, ischemia and injury.

reference_spacy_tokens: Sodium heparin prevents blood clotting , helps to infuse cryoprotectants , 20 % mannitol , prevents cell oedema due to hypoxia , ischemia and injury .


fn_spacy_tokens_for_baseline: It brought a smile to his face because he recognised the lie though no word had been spoken and he trailed his lips across her burning cheek before catching her mouth lightly with his own .

source_bert_toks: it brought a smile to his face because he recognised the lie though no word had been spoken and he trailed his lips across her burning cheek before catching her mouth lightly with his own .

reference_raw: It brought a smile to his face, for he recognized the lie, though he had not spoken a word, and he traced his lips to her burning face before he caught her mouth lightly with his own.

reference_spacy_tokens: It brought a smile to his face , for he recognized the lie , though he had not spoken a word , and he traced his lips to her burning face before he caught her mouth lightly with his own .


fn_spacy_tokens_for_baseline: And Adimov seemed to look for admiration from Holly when he told his story .

source_bert_toks: and adi ##mo ##v seemed to look for admiration from holly when he told his story .

reference_raw: And when he told his story, Adimov seemed to be looking for adoration from Holly.

reference_spacy_tokens: And when he told his story , Adimov seemed to be looking for adoration from Holly .


fn_spacy_tokens_for_baseline: The fire has spread extensively and it is estimated that approximately 2,500 acres of forest have been damaged .

source_bert_toks: the fire has spread extensively and it is estimated that approximately 2 , 500 acres of forest have been damaged .

reference_raw: The fire has spread extensively and approximately 2,500 acres of forest have been damaged.

reference_spacy_tokens: The fire has spread extensively and approximately 2,500 acres of forest have been damaged .


fn_spacy_tokens_for_baseline: He was wearing a pair of crumpled pyjama trousers , tied at the waist with a white cord .

source_bert_toks: he was wearing a pair of crumpled p ##y ##ja ##ma trousers , tied at the waist with a white cord .

reference_raw: He wore a pair of crumpled pajama pants, tied to his waist with a white line.

reference_spacy_tokens: He wore a pair of crumpled pajama pants , tied to his waist with a white line .


fn_spacy_tokens_for_baseline: The United States is concerned that if Iran stockpiled enriched uranium , it might , in the future , withdraw from the NPT ( as North Korea has ) and then build nuclear weapons rapidly , perhaps even in a matter of months .

source_bert_toks: the united states is concerned that if iran stock ##pile ##d enriched uranium , it might , in the future , withdraw from the np ##t ( as north korea has ) and then build nuclear weapons rapidly , perhaps even in a matter of months .

reference_raw: The US fears that if Iran stores enriched uranium, it may in the future withdraw from the nuclear power plant (as North Korea does) and then build nuclear weapons quickly, perhaps even within a few months.

reference_spacy_tokens: The US fears that if Iran stores enriched uranium , it may in the future withdraw from the nuclear power plant ( as North Korea does ) and then build nuclear weapons quickly , perhaps even within a few months .


fn_spacy_tokens_for_baseline: She settled on a plain pleated skirt in burgundy wool , a cream blouse and a lightweight cashmere sweater .

source_bert_toks: she settled on a plain plea ##ted skirt in burgundy wool , a cream blouse and a lightweight cash ##mere sweater .

reference_raw: She sat down on a simple pleated skirt in burgundy wool, a cream shirt, and a light cashmere sweater.

reference_spacy_tokens: She sat down on a simple pleated skirt in burgundy wool , a cream shirt , and a light cashmere sweater .


fn_spacy_tokens_for_baseline: There was a trace of exasperation in his voice as he said : ' I 've told my promoter Dan Duva that I want to fight all those contenders that the people want me to fight .

source_bert_toks: there was a trace of ex ##as ##peration in his voice as he said : ' i ' ve told my promoter dan du ##va that i want to fight all those contenders that the people want me to fight .

reference_raw: There was a hint of irritation in his voice as he said, "I told my promoter, Dan Duva, that I wanted to fight all the contenders the people wanted me to fight.

reference_spacy_tokens: There was a hint of irritation in his voice as he said , " I told my promoter , Dan Duva , that I wanted to fight all the contenders the people wanted me to fight .


fn_spacy_tokens_for_baseline: Ruth gazed about her in awe .

source_bert_toks: ruth gazed about her in awe .

reference_raw: Ruth looked around in awe.

reference_spacy_tokens: Ruth looked around in awe .


fn_spacy_tokens_for_baseline: Once again , start with the largest flowers and place one at the top and one at the bottom of the design , and then two staggered in the middle .

source_bert_toks: once again , start with the largest flowers and place one at the top and one at the bottom of the design , and then two staggered in the middle .

reference_raw: Start again with the biggest flowers, put one at the top and one at the bottom of the design, and then two staggered in the middle.

reference_spacy_tokens: Start again with the biggest flowers , put one at the top and one at the bottom of the design , and then two staggered in the middle .


fn_spacy_tokens_for_baseline: Archie had sidled adroitly past her .

source_bert_toks: archie had sid ##led ad ##roi ##tly past her .

reference_raw: Archie swerved around her.

reference_spacy_tokens: Archie swerved around her .


fn_spacy_tokens_for_baseline: The old Soviet armed forces should be split up between the new states , not consolidated under the flag of St Andrew .

source_bert_toks: the old soviet armed forces should be split up between the new states , not consolidated under the flag of st andrew .

reference_raw: The old Soviet Armed Forces should be divided among the new states, not consolidated under St. Andrew's flag.

reference_spacy_tokens: The old Soviet Armed Forces should be divided among the new states , not consolidated under St. Andrew 's flag .


fn_spacy_tokens_for_baseline: Guided parties are taken into the cave on payment of an admission charge , the interior being illuminated by electricity that reveals waterfalls and many named formations .

source_bert_toks: guided parties are taken into the cave on payment of an admission charge , the interior being illuminated by electricity that reveals waterfalls and many named formations .

reference_raw: The guides are taken to the cave to pay the entrance fee, and the interior is illuminated by electricity that reveals the falls and many named formations.

reference_spacy_tokens: The guides are taken to the cave to pay the entrance fee , and the interior is illuminated by electricity that reveals the falls and many named formations .


fn_spacy_tokens_for_baseline: It 's funny how quickly you forget what it 's like out here . "

source_bert_toks: it ' s funny how quickly you forget what it ' s like out here . "

reference_raw: It's funny how fast you can't remember what it's like here.

reference_spacy_tokens: It 's funny how fast you ca n't remember what it 's like here .


fn_spacy_tokens_for_baseline: ' How dare you think you can just barge into my property !

source_bert_toks: ' how dare you think you can just barge into my property !

reference_raw: 'How dare you think you're going to break into my property!

reference_spacy_tokens: ' How dare you think you 're going to break into my property !


fn_spacy_tokens_for_baseline: The ' men ' of the branch were belittling the game saying how simple it was , and there was no great feat in winning it .

source_bert_toks: the ' men ' of the branch were bel ##itt ##ling the game saying how simple it was , and there was no great feat in winning it .

reference_raw: The "men" of the branch beat the game, saying how easy it was, and it wasn't a big deal to win.

reference_spacy_tokens: The " men " of the branch beat the game , saying how easy it was , and it was n't a big deal to win .


fn_spacy_tokens_for_baseline: If the goods had already perished at the time the contract was made , then section 6 is the appropriate section .

source_bert_toks: if the goods had already perished at the time the contract was made , then section 6 is the appropriate section .

reference_raw: If the goods were already dead at the time of conclusion of the contract, the relevant section shall be Section 6.

reference_spacy_tokens: If the goods were already dead at the time of conclusion of the contract , the relevant section shall be Section 6 .


fn_spacy_tokens_for_baseline: The Professor poured a scotch from the crystal decanter and seating himself in a fireside chair did his very best to explain .

source_bert_toks: the professor poured a scotch from the crystal dec ##ante ##r and seating himself in a fires ##ide chair did his very best to explain .

reference_raw: The Professor poured himself a scotch from the crystal casing and sat down in the fire chair, doing everything he could to explain.

reference_spacy_tokens: The Professor poured himself a scotch from the crystal casing and sat down in the fire chair , doing everything he could to explain .


fn_spacy_tokens_for_baseline: I , on the other hand , had backache and climbed it as though a cattle prod were taped to my spine .

source_bert_toks: i , on the other hand , had back ##ache and climbed it as though a cattle pro ##d were taped to my spine .

reference_raw: My back hurt, on the other hand, and I climbed it as if a cattle prod had been glued to my back.

reference_spacy_tokens: My back hurt , on the other hand , and I climbed it as if a cattle prod had been glued to my back .


fn_spacy_tokens_for_baseline: Schneider draped a sheet about his shoulders and reached for a pair of scissors .

source_bert_toks: schneider draped a sheet about his shoulders and reached for a pair of scissors .

reference_raw: Schneider wrapped the blanket around his shoulders and reached for the scissors.

reference_spacy_tokens: Schneider wrapped the blanket around his shoulders and reached for the scissors .


fn_spacy_tokens_for_baseline: And similarly we can imagine constant electric and magnetic fields .

source_bert_toks: and similarly we can imagine constant electric and magnetic fields .

reference_raw: And just like that, we can think of a constant electric and magnetic field.

reference_spacy_tokens: And just like that , we can think of a constant electric and magnetic field .


fn_spacy_tokens_for_baseline: The lighted dial of her watch said one - twenty .

source_bert_toks: the lighted dial of her watch said one - twenty .

reference_raw: Her watch's illuminated dial said one-twenty.

reference_spacy_tokens: Her watch 's illuminated dial said one - twenty .


fn_spacy_tokens_for_baseline: Marjorie was astonished at how attached Bill became to Lizzie , as if Lizzie was the daughter they 'd longed for .

source_bert_toks: marjorie was astonished at how attached bill became to lizzie , as if lizzie was the daughter they ' d longed for .

reference_raw: Marjorie wondered how close Bill had become to Lizzie, as if Lizzie were the daughter they wanted.

reference_spacy_tokens: Marjorie wondered how close Bill had become to Lizzie , as if Lizzie were the daughter they wanted .


fn_spacy_tokens_for_baseline: The rain had stopped and the air was filled with the sweet smell of freshly washed earth .

source_bert_toks: the rain had stopped and the air was filled with the sweet smell of freshly washed earth .

reference_raw: The rain had stopped, and the air was filled with the sweet scent of freshly washed earth.

reference_spacy_tokens: The rain had stopped , and the air was filled with the sweet scent of freshly washed earth .


fn_spacy_tokens_for_baseline: Whether it 's to reward ourselves for an achievement , or to lift our spirits , many women find little can compete with the rustle of tissue paper and the thrill of slipping into a pristine new outfit .

source_bert_toks: whether it ' s to reward ourselves for an achievement , or to lift our spirits , many women find little can compete with the rust ##le of tissue paper and the thrill of slipping into a pristine new outfit .

reference_raw: Whether to reward ourselves for success or to cheer us up, many women find that little can compete with the scraping of tissue paper and the thrill of slipping into a pristine new suit.

reference_spacy_tokens: Whether to reward ourselves for success or to cheer us up , many women find that little can compete with the scraping of tissue paper and the thrill of slipping into a pristine new suit .


fn_spacy_tokens_for_baseline: I love rugby and if I had the opportunity I would pull on my boots and play tomorrow .

source_bert_toks: i love rugby and if i had the opportunity i would pull on my boots and play tomorrow .

reference_raw: I love rugby, and if I had the chance, I'd put on my shoes and play tomorrow.

reference_spacy_tokens: I love rugby , and if I had the chance , I 'd put on my shoes and play tomorrow .


fn_spacy_tokens_for_baseline: Firebomb killer is jailed for life

source_bert_toks: fire ##bo ##mb killer is jailed for life

reference_raw: A firebomb murderer is in prison for the rest of his life.

reference_spacy_tokens: A firebomb murderer is in prison for the rest of his life .


fn_spacy_tokens_for_baseline: Her military prowess should not have been doubted .

source_bert_toks: her military prowess should not have been doubted .

reference_raw: Her military skills should not be questioned.

reference_spacy_tokens: Her military skills should not be questioned .


fn_spacy_tokens_for_baseline: Fig12 Your feet should be adjusted to this position immediately before you set off .

source_bert_toks: fig ##12 your feet should be adjusted to this position immediately before you set off .

reference_raw: Fig12 You should adapt your legs to this position immediately before you start.

reference_spacy_tokens: Fig12 You should adapt your legs to this position immediately before you start .


fn_spacy_tokens_for_baseline: Such spectacular animals have obviously attracted much attention , and one might suppose that the problem of how they lived would have been satisfactorily solved long ago .

source_bert_toks: such spectacular animals have obviously attracted much attention , and one might suppose that the problem of how they lived would have been sat ##is ##fa ##ctor ##ily solved long ago .

reference_raw: Such magnificent animals seemed to attract a great deal of attention, and one might assume that the problem of how they lived would have been satisfactorily resolved long ago.

reference_spacy_tokens: Such magnificent animals seemed to attract a great deal of attention , and one might assume that the problem of how they lived would have been satisfactorily resolved long ago .


fn_spacy_tokens_for_baseline: To have to wait a while for something is not the worst problem in the world .

source_bert_toks: to have to wait a while for something is not the worst problem in the world .

reference_raw: Having to wait for something isn't the world's worst problem.

reference_spacy_tokens: Having to wait for something is n't the world 's worst problem .


fn_spacy_tokens_for_baseline: In England an associated group was later to help form the Socialist League .

source_bert_toks: in england an associated group was later to help form the socialist league .

reference_raw: In England, a group of affiliates later helped to form the Socialist League.

reference_spacy_tokens: In England , a group of affiliates later helped to form the Socialist League .


fn_spacy_tokens_for_baseline: More detailed instructions will be found taped on the walls over the appliances concerned .

source_bert_toks: more detailed instructions will be found taped on the walls over the appliances concerned .

reference_raw: More detailed instructions can be found on the walls above the appliances in question.

reference_spacy_tokens: More detailed instructions can be found on the walls above the appliances in question .


fn_spacy_tokens_for_baseline: QN : Did the Fed have lower interest rates three years ago ?

source_bert_toks: q ##n : did the fed have lower interest rates three years ago ?

reference_raw: QN: Did the Fed have a low interest rate three years ago?

reference_spacy_tokens: QN : Did the Fed have a low interest rate three years ago ?


fn_spacy_tokens_for_baseline: Heavy snow in January and February kept other possible buyers away , and by the time the crocuses and daffodils were decking the rest of the Thrush Green gardens , Tullivers was looking at its worst .

source_bert_toks: heavy snow in january and february kept other possible buyers away , and by the time the cr ##oc ##uses and da ##ff ##od ##ils were deck ##ing the rest of the thru ##sh green gardens , tu ##lli ##vers was looking at its worst .

reference_raw: The heavy snows of January and February had kept other potential buyers away, and by the time the crocuses and daffodils had boarded the rest of the green gardens of Thrush, Tullivers had seen the worst of them.

reference_spacy_tokens: The heavy snows of January and February had kept other potential buyers away , and by the time the crocuses and daffodils had boarded the rest of the green gardens of Thrush , Tullivers had seen the worst of them .


fn_spacy_tokens_for_baseline: Herkimer Housebound did indeed serve a fine cup of nettle tea -- poured into walnut shells with a splash of parsley milk , and a bit of meadowsweet to eat .

source_bert_toks: her ##kim ##er house ##bound did indeed serve a fine cup of net ##tle tea - - poured into walnut shells with a splash of par ##sley milk , and a bit of meadows ##wee ##t to eat .

reference_raw: Herkimer Housebound did indeed serve a fine cup of nettle tea, poured into walnut shells with a spray of parsley milk, and some meadowsweet to eat.

reference_spacy_tokens: Herkimer Housebound did indeed serve a fine cup of nettle tea , poured into walnut shells with a spray of parsley milk , and some meadowsweet to eat .


fn_spacy_tokens_for_baseline: Third - quarter results included net realized capital gains of $ 48 million , which included $ 27 million from the sale of Federated Investors in August and a $ 15 million tax credit .

source_bert_toks: third - quarter results included net realized capital gains of $ 48 million , which included $ 27 million from the sale of fed ##erated investors in august and a $ 15 million tax credit .

reference_raw: The third-quarter results included net realised capital gains of $48 million, including $27 million from the purchase of federal investors in August and a tax credit of $15 million.

reference_spacy_tokens: The third - quarter results included net realised capital gains of $ 48 million , including $ 27 million from the purchase of federal investors in August and a tax credit of $ 15 million .


fn_spacy_tokens_for_baseline: A playroom and bathroom painted by Berlin artist Frena Gould is officially opened today by consultant gynaecologist Ann Ryall in the maternity outpatients department at North Tees General Hospital , Stockton .

source_bert_toks: a play ##room and bathroom painted by berlin artist fr ##ena gould is officially opened today by consultant g ##yna ##ec ##ologist ann ry ##all in the maternity out ##patient ##s department at north tee ##s general hospital , stockton .

reference_raw: The play room and bathroom painted by the Berlin artist, Frena Gould, is now officially opened by consultant gynaecologist Ann Ryall from the maternity ward at North Tees General Hospital in Stockton.

reference_spacy_tokens: The play room and bathroom painted by the Berlin artist , Frena Gould , is now officially opened by consultant gynaecologist Ann Ryall from the maternity ward at North Tees General Hospital in Stockton .


fn_spacy_tokens_for_baseline: Dave Sprott the dentist had suggested a barrel of draught Guinness .

source_bert_toks: dave sp ##rot ##t the dentist had suggested a barrel of draught guinness .

reference_raw: The dentist, Dave Sprott, suggested a drum of guinness.

reference_spacy_tokens: The dentist , Dave Sprott , suggested a drum of guinness .


fn_spacy_tokens_for_baseline: Most shops are open seven days a week .

source_bert_toks: most shops are open seven days a week .

reference_raw: Most of the stores are open seven days a day.

reference_spacy_tokens: Most of the stores are open seven days a day .


fn_spacy_tokens_for_baseline: Monitoring motor activity in newborn babies , Dr McGuiness found boys to be significantly more active , spending less time asleep and performing more facial grimaces than girls .

source_bert_toks: monitoring motor activity in newborn babies , dr mc ##gui ##ness found boys to be significantly more active , spending less time asleep and performing more facial grimace ##s than girls .

reference_raw: Dr. McGuiness monitored the motor activity of newborns and found that the boys were much more active, spending less time sleeping and making more face-to-face grins than the girls.

reference_spacy_tokens: Dr. McGuiness monitored the motor activity of newborns and found that the boys were much more active , spending less time sleeping and making more face - to - face grins than the girls .


fn_spacy_tokens_for_baseline: Experience told him that a woman 's natural instinct was to defend herself rather than to hurt the attacker .

source_bert_toks: experience told him that a woman ' s natural instinct was to defend herself rather than to hurt the attacker .

reference_raw: Experience told him that a woman's natural instinct was to defend herself, not to harm an assailant.

reference_spacy_tokens: Experience told him that a woman 's natural instinct was to defend herself , not to harm an assailant .


fn_spacy_tokens_for_baseline: An explosion injured six workers and devastated a petrochemical plant at its Stanlow oil refinery , near Ellesmere Port , leaking solvent into the Mersey .

source_bert_toks: an explosion injured six workers and devastated a pet ##ro ##chemical plant at its stan ##low oil refinery , near elle ##sm ##ere port , leaking solvent into the mer ##sey .

reference_raw: The explosion injured six workers and destroyed a petrochemical plant in a Stanlow oil refinery near the Port of Ellesmere, leaking solvents into the Mersey.

reference_spacy_tokens: The explosion injured six workers and destroyed a petrochemical plant in a Stanlow oil refinery near the Port of Ellesmere , leaking solvents into the Mersey .


fn_spacy_tokens_for_baseline: After university , he became a free - lance journalist in London , writing articles for most of the leading literary magazines .

source_bert_toks: after university , he became a free - lance journalist in london , writing articles for most of the leading literary magazines .

reference_raw: After college, he became a freelance journalist in London and wrote stories for most of the leading literary magazines.

reference_spacy_tokens: After college , he became a freelance journalist in London and wrote stories for most of the leading literary magazines .


fn_spacy_tokens_for_baseline: A farmer has every right to rant and rave about such clowns .

source_bert_toks: a farmer has every right to ran ##t and rave about such clown ##s .

reference_raw: A farmer has every right to run and rabble about clowns like that.

reference_spacy_tokens: A farmer has every right to run and rabble about clowns like that .


fn_spacy_tokens_for_baseline: In April 1996 , the U.S. announced that it had not ruled out using conventional weapons to stop Libya from completing what Washington claimed was a chemical weapons plant in Tarunah , near Tripoli .

source_bert_toks: in april 1996 , the u . s . announced that it had not ruled out using conventional weapons to stop libya from completing what washington claimed was a chemical weapons plant in tar ##una ##h , near tripoli .

reference_raw: In April 1996, the United States reported that it had not ruled out the use of conventional weapons to prevent Libya from completing what Washington claimed to be a chemical weaponry plant in Taruna, near Tripoli.

reference_spacy_tokens: In April 1996 , the United States reported that it had not ruled out the use of conventional weapons to prevent Libya from completing what Washington claimed to be a chemical weaponry plant in Taruna , near Tripoli .


fn_spacy_tokens_for_baseline: The railroad needed a way station , and Las Vegas was the place .

source_bert_toks: the railroad needed a way station , and las vegas was the place .

reference_raw: The railway had to have a road station, and it was Las Vegas.

reference_spacy_tokens: The railway had to have a road station , and it was Las Vegas .


fn_spacy_tokens_for_baseline: In the 1960s , Ferndale resident Jack Alderson commanded a group of light tugs that made trips to the islands that last week were declared a monument , as well as other remote atolls in the region .

source_bert_toks: in the 1960s , fern ##dale resident jack al ##ders ##on commanded a group of light tugs that made trips to the islands that last week were declared a monument , as well as other remote atoll ##s in the region .

reference_raw: In the 1960s, the resident of Ferndale, Jack Alderson, commanded a group of light tugs that made trips to the islands that had been declared monumental in the past week, as well as tolls in the region.

reference_spacy_tokens: In the 1960s , the resident of Ferndale , Jack Alderson , commanded a group of light tugs that made trips to the islands that had been declared monumental in the past week , as well as tolls in the region .


fn_spacy_tokens_for_baseline: Characteristics of CBW Terrorists

source_bert_toks: characteristics of cb ##w terrorists

reference_raw: CBW Terrorism Properties

reference_spacy_tokens: CBW Terrorism Properties


fn_spacy_tokens_for_baseline: The old man went on his way , and I put my bag on a supermarket trolley and wheeled it off to look for Mr Coary .

source_bert_toks: the old man went on his way , and i put my bag on a supermarket trolley and wheeled it off to look for mr coa ##ry .

reference_raw: The old man was on his way, and I put my backpack on the supermarket cart and turned it around to find Mr. Coary.

reference_spacy_tokens: The old man was on his way , and I put my backpack on the supermarket cart and turned it around to find Mr. Coary .


fn_spacy_tokens_for_baseline: He skirted the house to the rear , but guards were also there .

source_bert_toks: he skirt ##ed the house to the rear , but guards were also there .

reference_raw: He went around the back of the house, but the guards were there, too.

reference_spacy_tokens: He went around the back of the house , but the guards were there , too .


fn_spacy_tokens_for_baseline: Some sports also build strength .

source_bert_toks: some sports also build strength .

reference_raw: Some sports also build power.

reference_spacy_tokens: Some sports also build power .


fn_spacy_tokens_for_baseline: If you use continuous stationery , please remove sprocket margins and separate the sheets clearly into individual documents for each employee .

source_bert_toks: if you use continuous station ##ery , please remove sp ##rock ##et margins and separate the sheets clearly into individual documents for each employee .

reference_raw: If you use a continuous stationery, remove the sprocket margins and clearly divide the sheets into individual documents for each employee.

reference_spacy_tokens: If you use a continuous stationery , remove the sprocket margins and clearly divide the sheets into individual documents for each employee .


fn_spacy_tokens_for_baseline: Black diagonals crisscross .

source_bert_toks: black diagonal ##s cr ##iss ##cross .

reference_raw: The black diagonals cross.

reference_spacy_tokens: The black diagonals cross .


fn_spacy_tokens_for_baseline: ' About 10 people were killed in Thursday night 's bombing on an uninhabited ridge line , ' he said .

source_bert_toks: ' about 10 people were killed in thursday night ' s bombing on an uninhabited ridge line , ' he said .

reference_raw: "About ten people were killed in the attack on an uninhabited ridge line on Thursday night," he said.

reference_spacy_tokens: " About ten people were killed in the attack on an uninhabited ridge line on Thursday night , " he said .


fn_spacy_tokens_for_baseline: Toss the potatoes in the butter , spoon into a warmed serving dish and garnish with more sprigs of basil .

source_bert_toks: toss the potatoes in the butter , spoon into a warmed serving dish and ga ##rn ##ish with more sp ##ri ##gs of basil .

reference_raw: Throw the potatoes into butter, spoon into a hot serving bowl, and paint with more basil sprigs.

reference_spacy_tokens: Throw the potatoes into butter , spoon into a hot serving bowl , and paint with more basil sprigs .


fn_spacy_tokens_for_baseline: The Russian railway lines expanded greatly from 660 miles in 1850 to 40,194 , principally because of the construction of the Trans - Siberian Railway .

source_bert_toks: the russian railway lines expanded greatly from 660 miles in 1850 to 40 , 194 , principally because of the construction of the trans - siberian railway .

reference_raw: Russian railway lines increased significantly from 660 miles in 1850 to 40,194, mainly due to the construction of the trans-Siberian railway.

reference_spacy_tokens: Russian railway lines increased significantly from 660 miles in 1850 to 40,194 , mainly due to the construction of the trans - Siberian railway .


fn_spacy_tokens_for_baseline: Iran purchased atropine autoinjectors for antidotes to nerve gas from a Dutch company .

source_bert_toks: iran purchased at ##rop ##ine auto ##in ##ject ##ors for anti ##dote ##s to nerve gas from a dutch company .

reference_raw: Iran bought atropine autoinjectors from a Netherlands company for anti-nervous gas antibodies.

reference_spacy_tokens: Iran bought atropine autoinjectors from a Netherlands company for anti - nervous gas antibodies .


fn_spacy_tokens_for_baseline: Her teeth sank into the hand at her mouth and the man yelped , staggering away .

source_bert_toks: her teeth sank into the hand at her mouth and the man ye ##lp ##ed , staggering away .

reference_raw: Her teeth sank into her hand at her mouth, and the man screamed, staggering away.

reference_spacy_tokens: Her teeth sank into her hand at her mouth , and the man screamed , staggering away .


fn_spacy_tokens_for_baseline: I was so high on adrenalin that for all I knew I was talking utter rubbish .

source_bert_toks: i was so high on ad ##ren ##ali ##n that for all i knew i was talking utter rubbish .

reference_raw: I was so hot on adrenalin, I knew I was talking total nonsense.

reference_spacy_tokens: I was so hot on adrenalin , I knew I was talking total nonsense .


fn_spacy_tokens_for_baseline: As far as the Shiite ulama were concerned any Shah ruling before the return of the hidden Imam does so unlawfully , unless he has ben licensed by the chief priests , the ayatollahs .

source_bert_toks: as far as the shi ##ite ul ##ama were concerned any shah ruling before the return of the hidden imam does so unlawful ##ly , unless he has ben licensed by the chief priests , the a ##yat ##oll ##ah ##s .

reference_raw: As for the Shiite ulama, any Shah ruling before the return of the hidden Ima does so illegally, unless it is licensed by the chief priests, the ayatollahs.

reference_spacy_tokens: As for the Shiite ulama , any Shah ruling before the return of the hidden I m a does so illegally , unless it is licensed by the chief priests , the ayatollahs .


fn_spacy_tokens_for_baseline: BRIAN Thomas Jackson , of Danek Motors in Darlington , last week admitted three charges under the Trades Descriptions Act .

source_bert_toks: brian thomas jackson , of dane ##k motors in darlington , last week admitted three charges under the trades descriptions act .

reference_raw: Last week, Brian Thomas Jackson of Danek Motors in Darlington admitted three indictments under the Trade Descriptions Act.

reference_spacy_tokens: Last week , Brian Thomas Jackson of Danek Motors in Darlington admitted three indictments under the Trade Descriptions Act .


fn_spacy_tokens_for_baseline: Willie knelt down on the newspapers and began to dry him .

source_bert_toks: willie knelt down on the newspapers and began to dry him .

reference_raw: Willie dropped to his knees on the paper and began drying it.

reference_spacy_tokens: Willie dropped to his knees on the paper and began drying it .


fn_spacy_tokens_for_baseline: Be careful with leftovers -- refrigerate or freeze them quickly .

source_bert_toks: be careful with left ##overs - - ref ##ri ##ger ##ate or freeze them quickly .

reference_raw: Be careful with the remains - cool them or freeze them quickly.

reference_spacy_tokens: Be careful with the remains - cool them or freeze them quickly .


fn_spacy_tokens_for_baseline: In the first of our new series on small gardens , Rosie Atkins has been to visit a delightful family courtyard garden

source_bert_toks: in the first of our new series on small gardens , rosie atkins has been to visit a delightful family courtyard garden

reference_raw: In the first of our new series of little gardens, Rosie Atkins visited the lovely family garden.

reference_spacy_tokens: In the first of our new series of little gardens , Rosie Atkins visited the lovely family garden .


fn_spacy_tokens_for_baseline: " First you make a mystery out of a fairly ordinary - although for you - tragic - event , and , believe me , I do sympathise with you over that .

source_bert_toks: " first you make a mystery out of a fairly ordinary - although for you - tragic - event , and , believe me , i do sy ##mp ##athi ##se with you over that .

reference_raw: "First you make a secret out of a rather ordinary - though tragic - event for you, and believe me, I sympathize with you for it."

reference_spacy_tokens: " First you make a secret out of a rather ordinary - though tragic - event for you , and believe me , I sympathize with you for it . "


fn_spacy_tokens_for_baseline: There was no rebuke or caution of any kind .

source_bert_toks: there was no re ##bu ##ke or caution of any kind .

reference_raw: There was no reproach or caution.

reference_spacy_tokens: There was no reproach or caution .


fn_spacy_tokens_for_baseline: The next rough ride came when the youngsters grilled Lord Kearton , Sir Andrew Huxley and William Shelton , a junior minister at the Department of Education and science .

source_bert_toks: the next rough ride came when the young ##sters grille ##d lord ke ##art ##on , sir andrew hu ##xley and william shelton , a junior minister at the department of education and science .

reference_raw: The next rough ride came when the youngsters barbecued Lord Kearton, Sir Andrew Huxley, and William Shelton, junior minister of the Ministry of Education and Science.

reference_spacy_tokens: The next rough ride came when the youngsters barbecued Lord Kearton , Sir Andrew Huxley , and William Shelton , junior minister of the Ministry of Education and Science .


fn_spacy_tokens_for_baseline: ' The significance of having directly elected officials is largely that now they will go to the BAF armed with a mandate to pursue objectives , policies etc .

source_bert_toks: ' the significance of having directly elected officials is largely that now they will go to the ba ##f armed with a mandate to pursue objectives , policies etc .

reference_raw: The importance of directly elected officials is to a large extent that they will now go to the BAF armed with a mandate to pursue objectives, policies, etc.

reference_spacy_tokens: The importance of directly elected officials is to a large extent that they will now go to the BAF armed with a mandate to pursue objectives , policies , etc .


fn_spacy_tokens_for_baseline: If the defining mission of the Vietnam War was the jungle foot patrol , the defining mission of Iraq is the vehicle patrol .

source_bert_toks: if the defining mission of the vietnam war was the jungle foot patrol , the defining mission of iraq is the vehicle patrol .

reference_raw: If the defining mission of the Vietnam War was a jungle foot-watcher, Iraq's defining mission is a car-watcher.

reference_spacy_tokens: If the defining mission of the Vietnam War was a jungle foot - watcher , Iraq 's defining mission is a car - watcher .


fn_spacy_tokens_for_baseline: There was no W , since it was not reckoned a proper letter in its own right , but only a double U , which is how we pronounce it .

source_bert_toks: there was no w , since it was not reckon ##ed a proper letter in its own right , but only a double u , which is how we pro ##no ##unce it .

reference_raw: There was no W, because it wasn't supposed to be a proper letter of its own, it was just a double U, and that's how we say it.

reference_spacy_tokens: There was no W , because it was n't supposed to be a proper letter of its own , it was just a double U , and that 's how we say it .


fn_spacy_tokens_for_baseline: The bourgeois women consider it flash to appear too attractive : they scorn make - up , their haircuts are severe , and their clothes tend to be dark green or beige .

source_bert_toks: the bourgeois women consider it flash to appear too attractive : they sc ##orn make - up , their hair ##cut ##s are severe , and their clothes tend to be dark green or beige .

reference_raw: Bourgeois women think it flashes are too attractive: they despise make-up, they have severe haircuts, and their clothing tends to be dark green or beige.

reference_spacy_tokens: Bourgeois women think it flashes are too attractive : they despise make - up , they have severe haircuts , and their clothing tends to be dark green or beige .


fn_spacy_tokens_for_baseline: All the young medics worked tirelessly in the blister bunker .

source_bert_toks: all the young med ##ics worked tire ##lessly in the b ##list ##er bunker .

reference_raw: All the young medics were busy in the blister bunker.

reference_spacy_tokens: All the young medics were busy in the blister bunker .


fn_spacy_tokens_for_baseline: I consoled myself by drinking a lot of warm red Martini .

source_bert_toks: i console ##d myself by drinking a lot of warm red martini .

reference_raw: I comforted myself by drinking a lot of hot red martinis.

reference_spacy_tokens: I comforted myself by drinking a lot of hot red martinis .


fn_spacy_tokens_for_baseline: Several people celebrating a wedding have also been trapped by the fire but are not injured and authorities say they are in no danger from the blaze .

source_bert_toks: several people celebrating a wedding have also been trapped by the fire but are not injured and authorities say they are in no danger from the blaze .

reference_raw: Some of the people who celebrated the wedding were trapped in the fire, but they weren't hurt, and the authorities said they weren't threatened by the fire.

reference_spacy_tokens: Some of the people who celebrated the wedding were trapped in the fire , but they were n't hurt , and the authorities said they were n't threatened by the fire .


fn_spacy_tokens_for_baseline: But , Gov. Donald Carcieri , Providence Mayor David Cicilline and others told Chairwoman Susan Collins of Maine and Rhode Island Sen. Lincoln Chafee , they need more federal money , they need it to come faster when disaster strikes and they need a steady stream they know they can rely on from year to year .

source_bert_toks: but , gov . donald car ##cier ##i , providence mayor david ci ##ci ##llin ##e and others told chair ##woman susan collins of maine and rhode island sen . lincoln cha ##fe ##e , they need more federal money , they need it to come faster when disaster strikes and they need a steady stream they know they can rely on from year to year .

reference_raw: But, Gov. Donald Carcieri, Providence Mayor David Cicilline and others told President Susan Collins of Maine and Rhode Island Sen. Lincoln Chafee that they need more federal money, that they need to be quicker when disaster strikes, and that they need a steady stream that they know to depend on every year.

reference_spacy_tokens: But , Gov. Donald Carcieri , Providence Mayor David Cicilline and others told President Susan Collins of Maine and Rhode Island Sen. Lincoln Chafee that they need more federal money , that they need to be quicker when disaster strikes , and that they need a steady stream that they know to depend on every year .


fn_spacy_tokens_for_baseline: You can also take a ferry to Macau to find an entirely different kind of city , a unique blend of Chinese and Iberian culture .

source_bert_toks: you can also take a ferry to macau to find an entirely different kind of city , a unique blend of chinese and iberian culture .

reference_raw: You can also take the ferry to Macao to find another city, a unique mixture of Chinese and Iberian cultures.

reference_spacy_tokens: You can also take the ferry to Macao to find another city , a unique mixture of Chinese and Iberian cultures .


fn_spacy_tokens_for_baseline: She fondled the jet pendant .

source_bert_toks: she fond ##led the jet pendant .

reference_raw: She liked the jet necklace.

reference_spacy_tokens: She liked the jet necklace .


fn_spacy_tokens_for_baseline: Tea is very insipid after good coffee .

source_bert_toks: tea is very ins ##ip ##id after good coffee .

reference_raw: The tea is very insidious after a good cup of coffee.

reference_spacy_tokens: The tea is very insidious after a good cup of coffee .


fn_spacy_tokens_for_baseline: I stopped but he did n't and I wheezed after him .

source_bert_toks: i stopped but he didn ' t and i w ##hee ##zed after him .

reference_raw: I stopped, but he didn't do it, and I whistled after him.

reference_spacy_tokens: I stopped , but he did n't do it , and I whistled after him .


fn_spacy_tokens_for_baseline: These findings agree with a previous study of diabetic neuropathy where constipation was the most common gastrointestinal symptom .

source_bert_toks: these findings agree with a previous study of dia ##bet ##ic ne ##uro ##pathy where con ##sti ##pati ##on was the most common gas ##tro ##int ##estinal sy ##mpt ##om .

reference_raw: These findings are consistent with a previous study of diabetic neuropathy, where constipation is the most common gastrointestinal symptom.

reference_spacy_tokens: These findings are consistent with a previous study of diabetic neuropathy , where constipation is the most common gastrointestinal symptom .


fn_spacy_tokens_for_baseline: Dozens of Pakistanis , Indians and Turks huddle in groups on the pavement , stamping their feet against the cold .

source_bert_toks: dozens of pakistani ##s , indians and turks hu ##ddle in groups on the pavement , stamp ##ing their feet against the cold .

reference_raw: Dozens of Pakistanis, Indians, and Turks huddled together on the sidewalk, stomping their feet against the cold.

reference_spacy_tokens: Dozens of Pakistanis , Indians , and Turks huddled together on the sidewalk , stomping their feet against the cold .


fn_spacy_tokens_for_baseline: A cold nose nuzzled his knee , and he reached under the table with a scrap of venison for Fife -- or Drum , he was not sure which .

source_bert_toks: a cold nose nu ##zzled his knee , and he reached under the table with a scrap of ve ##nis ##on for fife - - or drum , he was not sure which .

reference_raw: A cold nose nuzzled his knee, and he reached under the table with a piece of venison for Fife-or Drum, he wasn't sure which.

reference_spacy_tokens: A cold nose nuzzled his knee , and he reached under the table with a piece of venison for Fife - or Drum , he was n't sure which .


fn_spacy_tokens_for_baseline: Technology transfer and long - term assistance in the development of Iranian ballistic missiles and artillery rockets .

source_bert_toks: technology transfer and long - term assistance in the development of iranian ballistic missiles and artillery rockets .

reference_raw: Technology transfer and long-term support for the development of Iranian ballistic missiles and artillery missiles.

reference_spacy_tokens: Technology transfer and long - term support for the development of Iranian ballistic missiles and artillery missiles .


fn_spacy_tokens_for_baseline: Having already been severely admonished by his father , the young man despaired of finding any sympathy or understanding from his immediate family , always , however , with the exception of his mother .

source_bert_toks: having already been severely ad ##mon ##ished by his father , the young man despair ##ed of finding any sympathy or understanding from his immediate family , always , however , with the exception of his mother .

reference_raw: The young man, who had already been severely warned by his father, was desperate to find any sympathy or understanding from his immediate family, but always with the exception of his mother.

reference_spacy_tokens: The young man , who had already been severely warned by his father , was desperate to find any sympathy or understanding from his immediate family , but always with the exception of his mother .


fn_spacy_tokens_for_baseline: The UN Charter would have to be amended to provide for a special security council which would not , presumably , include the rights of veto held by the five permanent members of the existing security council .

source_bert_toks: the un charter would have to be amended to provide for a special security council which would not , presumably , include the rights of veto held by the five permanent members of the existing security council .

reference_raw: The Charter of the United Nations would need to be amended in order to provide for a special Security Council which would probably not include the rights of veto held by the five Permanent Council of the existing Security Council.

reference_spacy_tokens: The Charter of the United Nations would need to be amended in order to provide for a special Security Council which would probably not include the rights of veto held by the five Permanent Council of the existing Security Council .


fn_spacy_tokens_for_baseline: This tactic was repeated on the following Monday and Tuesday and a delegation sent to meet the Mayor .

source_bert_toks: this tactic was repeated on the following monday and tuesday and a delegation sent to meet the mayor .

reference_raw: This tactic was repeated the next Monday and Tuesday, and a delegation was sent to meet with the mayor.

reference_spacy_tokens: This tactic was repeated the next Monday and Tuesday , and a delegation was sent to meet with the mayor .


fn_spacy_tokens_for_baseline: While she was doing so , she was company for little Sandy , who was just six months old and still in his pram , the image of his daddy , Bruce Mackenzie .

source_bert_toks: while she was doing so , she was company for little sandy , who was just six months old and still in his pr ##am , the image of his daddy , bruce mackenzie .

reference_raw: She was the company of little Sandy, who was only six months old and still in his stroller, the image of his father, Bruce MacKenzie.

reference_spacy_tokens: She was the company of little Sandy , who was only six months old and still in his stroller , the image of his father , Bruce MacKenzie .


fn_spacy_tokens_for_baseline: He strode between the warehouses , into the alley he 'd emerged from .

source_bert_toks: he strode between the warehouses , into the alley he ' d emerged from .

reference_raw: He walked among the warehouses and into the alley from which he had come.

reference_spacy_tokens: He walked among the warehouses and into the alley from which he had come .


fn_spacy_tokens_for_baseline: The abrupt change of subject disconcerted Celia .

source_bert_toks: the abrupt change of subject disco ##nce ##rted celia .

reference_raw: Celia was disturbed by the sudden change in subject.

reference_spacy_tokens: Celia was disturbed by the sudden change in subject .


fn_spacy_tokens_for_baseline: This uncertainty is magnified when dealing with a disease like dementia where the onset may be highly insidious .

source_bert_toks: this uncertainty is mag ##nified when dealing with a disease like dementia where the onset may be highly ins ##idi ##ous .

reference_raw: This uncertainty is increased when dealing with a disease such as dementia, where an onset can be very insidious.

reference_spacy_tokens: This uncertainty is increased when dealing with a disease such as dementia , where an onset can be very insidious .


fn_spacy_tokens_for_baseline: THE role of Harry Thomason , Friend of Bill and TV producer , in the Case of the White House Travel Office ( see above ) has given new edge to a month - long spat between Washington and Hollywood .

source_bert_toks: the role of harry thomas ##on , friend of bill and tv producer , in the case of the white house travel office ( see above ) has given new edge to a month - long spat between washington and hollywood .

reference_raw: The role of Harry Thomason, friend of Bill and television producer in the White House Travel Office case (see above) gave a new advantage to a month-long spit between Washington and Hollywood.

reference_spacy_tokens: The role of Harry Thomason , friend of Bill and television producer in the White House Travel Office case ( see above ) gave a new advantage to a month - long spit between Washington and Hollywood .


fn_spacy_tokens_for_baseline: Our shuttering had been fabricated in the workshop , complete with risers reinforced with some 75 ? 50 mm timber , but we could have made it up on site .

source_bert_toks: our shutter ##ing had been fabricated in the workshop , complete with rise ##rs reinforced with some 75 ? 50 mm timber , but we could have made it up on site .

reference_raw: Our shutter was made up in a workshop, full of roses reinforced with about 75 mm wood, but we could make it on the spot.

reference_spacy_tokens: Our shutter was made up in a workshop , full of roses reinforced with about 75 mm wood , but we could make it on the spot .


fn_spacy_tokens_for_baseline: The exceptionally poor health of the Aboriginal community has elicited cross party support for action .

source_bert_toks: the exceptionally poor health of the aboriginal community has eli ##cite ##d cross party support for action .

reference_raw: Extraordinarily poor health in the indigenous community has prompted cross-party support for action.

reference_spacy_tokens: Extraordinarily poor health in the indigenous community has prompted cross - party support for action .


fn_spacy_tokens_for_baseline: ' On your oath to Christ , ' Athelstan whispered , ' tell me the truth . '

source_bert_toks: ' on your oath to christ , ' at ##hel ##stan whispered , ' tell me the truth . '

reference_raw: 'You swear to Christ,' whispered Athelstan, 'tell me the truth.'

reference_spacy_tokens: ' You swear to Christ , ' whispered Athelstan , ' tell me the truth . '


fn_spacy_tokens_for_baseline: While not every article would interest every reader , or be comprehensible to him or her , they were usually written in an expansive style so as to be accessible .

source_bert_toks: while not every article would interest every reader , or be com ##pre ##hen ##sible to him or her , they were usually written in an expansive style so as to be accessible .

reference_raw: Although not every article would have been intriguing to each reader or understanding, it was usually written in an extensive fashion, so that it could be accessed.

reference_spacy_tokens: Although not every article would have been intriguing to each reader or understanding , it was usually written in an extensive fashion , so that it could be accessed .


fn_spacy_tokens_for_baseline: She had enough work for several more days and then after that , she would need to tramp around the streets seeking new customers .

source_bert_toks: she had enough work for several more days and then after that , she would need to tram ##p around the streets seeking new customers .

reference_raw: She'd been busy for a few more days, and then she'd have to wander the streets looking for new customers.

reference_spacy_tokens: She 'd been busy for a few more days , and then she 'd have to wander the streets looking for new customers .


fn_spacy_tokens_for_baseline: As the mourners left , Lydia heard a low laugh and sat up on her rug , thinking suspiciously of her ears .

source_bert_toks: as the mo ##urne ##rs left , lydia heard a low laugh and sat up on her rug , thinking suspiciously of her ears .

reference_raw: Lydia heard a soft laugh as the mourners departed, and settled down on the carpet, thinking suspiciously about her ears.

reference_spacy_tokens: Lydia heard a soft laugh as the mourners departed , and settled down on the carpet , thinking suspiciously about her ears .


fn_spacy_tokens_for_baseline: She occupied a tiny apartment hidden away beneath Betty 's house , and she had a habit of materializing unexpectedly as if she 'd sprung up through a trapdoor .

source_bert_toks: she occupied a tiny apartment hidden away beneath betty ' s house , and she had a habit of material ##izing unexpectedly as if she ' d sprung up through a trap ##door .

reference_raw: She took up a small apartment hidden under Betty's house, and it was her habit to materialize unexpectedly, as if she had sprung through a trapdoor.

reference_spacy_tokens: She took up a small apartment hidden under Betty 's house , and it was her habit to materialize unexpectedly , as if she had sprung through a trapdoor .


fn_spacy_tokens_for_baseline: It is anticipated that this company will dovetail well with the division 's existing areas of expertise in the oil field sector , allowing the development of new international markets .

source_bert_toks: it is anticipated that this company will dove ##tail well with the division ' s existing areas of expertise in the oil field sector , allowing the development of new international markets .

reference_raw: The company is expected to do well with the division's existing field of expertise in the oil sector, allowing the development of new international markets.

reference_spacy_tokens: The company is expected to do well with the division 's existing field of expertise in the oil sector , allowing the development of new international markets .


fn_spacy_tokens_for_baseline: The High Court in Edinburgh was told that McDonald was under the influence of drugs when he entered the bank and vaulted a counter .

source_bert_toks: the high court in edinburgh was told that mcdonald was under the influence of drugs when he entered the bank and vaulted a counter .

reference_raw: The High Court in Edinburgh was informed that McDonald was drugged when he entered the bank and arched the counter.

reference_spacy_tokens: The High Court in Edinburgh was informed that McDonald was drugged when he entered the bank and arched the counter .


fn_spacy_tokens_for_baseline: The windows rattled , the walls shook , and the rain pounded on the roof .

source_bert_toks: the windows rattled , the walls shook , and the rain pounded on the roof .

reference_raw: Windows clattered, walls trembled, rain pounded on the roof.

reference_spacy_tokens: Windows clattered , walls trembled , rain pounded on the roof .


fn_spacy_tokens_for_baseline: White splashes of paint on the bottles indicated which way up they should be binned after delivery from the wine merchant .

source_bert_toks: white splash ##es of paint on the bottles indicated which way up they should be bin ##ned after delivery from the wine merchant .

reference_raw: White stains of paint on the bottles indicate which way they are to be bound after delivery from the wine merchant.

reference_spacy_tokens: White stains of paint on the bottles indicate which way they are to be bound after delivery from the wine merchant .


fn_spacy_tokens_for_baseline: We all have a couple of dozen tutees -- surely you 're not planning to interrogate every one of Puddephat 's ? '

source_bert_toks: we all have a couple of dozen tu ##tees - - surely you ' re not planning to inter ##rogate every one of pu ##dd ##ep ##hat ' s ? '

reference_raw: We've all got a few dozen tutes -- surely you don't plan on questioning every one of Puddephat's?'

reference_spacy_tokens: We 've all got a few dozen tutes -- surely you do n't plan on questioning every one of Puddephat 's ? '


fn_spacy_tokens_for_baseline: ' I initially made contact with Ilona because I wanted to be a porn star as well as an art star .

source_bert_toks: ' i initially made contact with il ##ona because i wanted to be a porn star as well as an art star .

reference_raw: I first got in touch with Ilona because I wanted to be a porn star and an art star.

reference_spacy_tokens: I first got in touch with Ilona because I wanted to be a porn star and an art star .


fn_spacy_tokens_for_baseline: No.4 COPP was to survey a beach on the north - west coast , and Neville McHarg with Lieutenant Sinclair paddled shorewards from HMS Safari .

source_bert_toks: no . 4 cop ##p was to survey a beach on the north - west coast , and neville mc ##har ##g with lieutenant sinclair paddle ##d shore ##ward ##s from hms safari .

reference_raw: No.4 COPP was to explore the Northwest Coast beach, and Neville McHarg and Lieutenant Sinclair padded the coast of HMS Safari.

reference_spacy_tokens: No.4 COPP was to explore the Northwest Coast beach , and Neville McHarg and Lieutenant Sinclair padded the coast of HMS Safari .


fn_spacy_tokens_for_baseline: But the quantitative explosion in the feral dog population in Italy has been accompanied by a qualitative change .

source_bert_toks: but the quantitative explosion in the feral dog population in italy has been accompanied by a qu ##ali ##tative change .

reference_raw: However, the quantitative outburst in the wild dog population in Italy was accompanied by a qualitative change.

reference_spacy_tokens: However , the quantitative outburst in the wild dog population in Italy was accompanied by a qualitative change .


fn_spacy_tokens_for_baseline: Henry pulled open the door , yanked off the three top sheets and scuttled back to his car .

source_bert_toks: henry pulled open the door , yanked off the three top sheets and sc ##ut ##tled back to his car .

reference_raw: Henry opened the door, pulled off the top three sheets, and hurried back to his car.

reference_spacy_tokens: Henry opened the door , pulled off the top three sheets , and hurried back to his car .


fn_spacy_tokens_for_baseline: Leaving aside Washington , which does hide a truly dreadful crime and poverty problem beneath its glittering facade , the craziest and most complicated example of American life is undoubtedly New York .

source_bert_toks: leaving aside washington , which does hide a truly dreadful crime and poverty problem beneath its glittering facade , the cr ##azi ##est and most complicated example of american life is undoubtedly new york .

reference_raw: Aside from Washington, which hides a truly terrible crime and poverty problem under its glittering facade, New York is no doubt the craziest and most complex example of American life.

reference_spacy_tokens: Aside from Washington , which hides a truly terrible crime and poverty problem under its glittering facade , New York is no doubt the craziest and most complex example of American life .


fn_spacy_tokens_for_baseline: The doorway leading down is narrow and jammed with kids .

source_bert_toks: the doorway leading down is narrow and jammed with kids .

reference_raw: The door leading down is narrow and full of children.

reference_spacy_tokens: The door leading down is narrow and full of children .


fn_spacy_tokens_for_baseline: A woman in a three - story apartment was able to walk out the window of the third floor onto street level after the quake .

source_bert_toks: a woman in a three - story apartment was able to walk out the window of the third floor onto street level after the quake .

reference_raw: After the earthquake, a woman in a three-story apartment could walk from a third-floor glass to a street level.

reference_spacy_tokens: After the earthquake , a woman in a three - story apartment could walk from a third - floor glass to a street level .


fn_spacy_tokens_for_baseline: He battered me -- and when I say battered , I mean battered .

source_bert_toks: he battered me - - and when i say battered , i mean battered .

reference_raw: He beat me - and when I say bruised, I mean bruised.

reference_spacy_tokens: He beat me - and when I say bruised , I mean bruised .


fn_spacy_tokens_for_baseline: The other man backed into the shadows of the doorway .

source_bert_toks: the other man backed into the shadows of the doorway .

reference_raw: The second man retreated into the shadows of the door.

reference_spacy_tokens: The second man retreated into the shadows of the door .


fn_spacy_tokens_for_baseline: Urine advertised as free of detectable drugs is on offer by mail - order to anxious test takers , who could try to substitute it for their own .

source_bert_toks: urine advertised as free of detect ##able drugs is on offer by mail - order to anxious test take ##rs , who could try to substitute it for their own .

reference_raw: Urine advertised as free of detectable drugs is offered by mail order to anxious test-takers who might try to replace it.

reference_spacy_tokens: Urine advertised as free of detectable drugs is offered by mail order to anxious test - takers who might try to replace it .


fn_spacy_tokens_for_baseline: He finished up as one of Britain 's greatest and most original architects .

source_bert_toks: he finished up as one of britain ' s greatest and most original architects .

reference_raw: He ended up being one of the best and most original architects in Britain.

reference_spacy_tokens: He ended up being one of the best and most original architects in Britain .


fn_spacy_tokens_for_baseline: Some of the scenery is very Scottish - looking with clumps of birch and hawthorn by the roadside and a scatter of tiny farming villages .

source_bert_toks: some of the scenery is very scottish - looking with cl ##ump ##s of birch and hawthorn by the roadside and a sc ##atter of tiny farming villages .

reference_raw: Some of the scenery looks very Scottish, with a bunch of birch and hawthorn on the side of the road and a scatter of small farm villages.

reference_spacy_tokens: Some of the scenery looks very Scottish , with a bunch of birch and hawthorn on the side of the road and a scatter of small farm villages .


fn_spacy_tokens_for_baseline: We climbed the low hills northwest of the loch and lay in the long grass under the pines and the birch , looking out over the small glen to the forested hill on the far side where the old railway tunnel was .

source_bert_toks: we climbed the low hills northwest of the loch and lay in the long grass under the pines and the birch , looking out over the small glen to the forested hill on the far side where the old railway tunnel was .

reference_raw: We climbed the low hills north-west of the loch and lay in the long grass beneath the pines and birch, looking out over the small ravine toward the forested hill on the other side of the old railroad tunnel.

reference_spacy_tokens: We climbed the low hills north - west of the loch and lay in the long grass beneath the pines and birch , looking out over the small ravine toward the forested hill on the other side of the old railroad tunnel .


fn_spacy_tokens_for_baseline: The court astonished everybody by deciding that it could not rule on the legality or otherwise of something that had not happened yet .

source_bert_toks: the court astonished everybody by deciding that it could not rule on the legal ##ity or otherwise of something that had not happened yet .

reference_raw: The court surprised everyone by deciding that he could not rule on the legality or otherwise of something that had not yet happened.

reference_spacy_tokens: The court surprised everyone by deciding that he could not rule on the legality or otherwise of something that had not yet happened .


fn_spacy_tokens_for_baseline: She untied the knots and removed the saliva sodden strip of cushion covering from his mouth .

source_bert_toks: she un ##tie ##d the knots and removed the saliva so ##dden strip of cushion covering from his mouth .

reference_raw: She untied the knots and removed a strip of saliva wet cushion from his mouth.

reference_spacy_tokens: She untied the knots and removed a strip of saliva wet cushion from his mouth .


fn_spacy_tokens_for_baseline: Oy , someone save me from my fascination with 8 minute dating .

source_bert_toks: o ##y , someone save me from my fascination with 8 minute dating .

reference_raw: Oy, somebody rescued me from my eight-minute fascination with dating.

reference_spacy_tokens: Oy , somebody rescued me from my eight - minute fascination with dating .


fn_spacy_tokens_for_baseline: The strongest opposition is likely to come from supporters of nuclear power , which was cut sharply in the Clinton budget .

source_bert_toks: the strongest opposition is likely to come from supporters of nuclear power , which was cut sharply in the clinton budget .

reference_raw: The strongest opposition is likely to come from fans of nuclear power that have been cut sharply in Clinton's budget.

reference_spacy_tokens: The strongest opposition is likely to come from fans of nuclear power that have been cut sharply in Clinton 's budget .


fn_spacy_tokens_for_baseline: Others I 'd just throw on a cotton frock and a pair of sandals to go out shopping . '

source_bert_toks: others i ' d just throw on a cotton fr ##ock and a pair of sandals to go out shopping . '

reference_raw: Others, I'd just put on a cotton dress and a pair of sandals to go shopping.'

reference_spacy_tokens: Others , I 'd just put on a cotton dress and a pair of sandals to go shopping . '


fn_spacy_tokens_for_baseline: He shopped in the centre of town before driving out to Hahnwald -- some good veal , fresh vegetables , a bottle of real French claret .

source_bert_toks: he shop ##ped in the centre of town before driving out to hahn ##wald - - some good ve ##al , fresh vegetables , a bottle of real french clare ##t .

reference_raw: Before he drove to Hahnwald, he bought some good veal, fresh vegetables, and a bottle of real French claret.

reference_spacy_tokens: Before he drove to Hahnwald , he bought some good veal , fresh vegetables , and a bottle of real French claret .


fn_spacy_tokens_for_baseline: Cheung Chau becomes the center of Hong Kong life once a year , usually in May , during the Bun Festival , a folklore extravaganza ( see page 89 ) .

source_bert_toks: cheung cha ##u becomes the center of hong kong life once a year , usually in may , during the bun festival , a folklore extra ##va ##gan ##za ( see page 89 ) .

reference_raw: Cheung Chau becomes the centre of Hong Kong's life once a year, usually in May, during the Bun Fest, a folklore extravaganza (see page 89).

reference_spacy_tokens: Cheung Chau becomes the centre of Hong Kong 's life once a year , usually in May , during the Bun Fest , a folklore extravaganza ( see page 89 ) .


fn_spacy_tokens_for_baseline: the POISONER woos the QUEEN with gifts .

source_bert_toks: the poison ##er woo ##s the queen with gifts .

reference_raw: POISONER greets the QUEEN with gifts.

reference_spacy_tokens: POISONER greets the QUEEN with gifts .


fn_spacy_tokens_for_baseline: THE Princess of Wales spoke of her first - hand experience of family break - up yesterday .

source_bert_toks: the princess of wales spoke of her first - hand experience of family break - up yesterday .

reference_raw: The Princess of Wales was talking about her first-hand experience of breaking up the family last night.

reference_spacy_tokens: The Princess of Wales was talking about her first - hand experience of breaking up the family last night .


fn_spacy_tokens_for_baseline: The presentation of the 1991/92 budget had been postponed from February 1991 under Congress ( I ) pressure because of the approaching general election [ see p. 38006].

source_bert_toks: the presentation of the 1991 / 92 budget had been postponed from february 1991 under congress ( i ) pressure because of the approaching general election [ see p . 380 ##0 ##6 ] .

reference_raw: As a result of the upcoming general elections, the presentation of the 1991/92 budget was deferred from February 1991 under pressure from Congress (I) (see p. 38006).

reference_spacy_tokens: As a result of the upcoming general elections , the presentation of the 1991/92 budget was deferred from February 1991 under pressure from Congress ( I ) ( see p. 38006 ) .


fn_spacy_tokens_for_baseline: ' That was why it rang a bell !

source_bert_toks: ' that was why it rang a bell !

reference_raw: 'That's why it rang!

reference_spacy_tokens: ' That 's why it rang !


fn_spacy_tokens_for_baseline: David , 35 , and Thorunn , 34 , who shone in an off - the - shoulder full length wedding gown with ivory matching headband , hosted a reception after the Winchester Cathedral ceremony before going on honeymoon .

source_bert_toks: david , 35 , and thor ##un ##n , 34 , who shone in an off - the - shoulder full length wedding gown with ivory matching head ##band , hosted a reception after the winchester cathedral ceremony before going on honeymoon .

reference_raw: David, 35, and Thorunn, 34 years old, wearing a full-length wedding dress with an ivory matching headband, held a reception after the Winchester Cathedral ceremony before going on the honeymoon.

reference_spacy_tokens: David , 35 , and Thorunn , 34 years old , wearing a full - length wedding dress with an ivory matching headband , held a reception after the Winchester Cathedral ceremony before going on the honeymoon .


fn_spacy_tokens_for_baseline: They attach themselves with their mouthparts and then release a digestive enzyme secretion which eats into the skin .

source_bert_toks: they attach themselves with their mouth ##parts and then release a digest ##ive enzyme secret ##ion which eats into the skin .

reference_raw: They bind to the mouth and then release the digestive enzyme secretion that eats into the skin.

reference_spacy_tokens: They bind to the mouth and then release the digestive enzyme secretion that eats into the skin .


fn_spacy_tokens_for_baseline: You will then be allowed to vote by post or proxy if your application reaches the registration officer before noon on the sixth day before polling day ( not counting the days mentioned above ) .

source_bert_toks: you will then be allowed to vote by post or proxy if your application reaches the registration officer before noon on the sixth day before polling day ( not counting the days mentioned above ) .

reference_raw: You will then be able to vote by post or by proxy if your application reaches the Registry Officer by midday on the sixth day before the polling day (excluding the days mentioned above).

reference_spacy_tokens: You will then be able to vote by post or by proxy if your application reaches the Registry Officer by midday on the sixth day before the polling day ( excluding the days mentioned above ) .


fn_spacy_tokens_for_baseline: Occasionally the Lord Chancellor will publicly reprimand a judge , as happened in 1978 when Mr Justice Melford - Stevenson was rebuked for describing an Act of Parliament as a ' buggers ' charter ' .

source_bert_toks: occasionally the lord chancellor will publicly rep ##rim ##and a judge , as happened in 1978 when mr justice mel ##ford - stevenson was re ##bu ##ked for describing an act of parliament as a ' bug ##gers ' charter ' .

reference_raw: From time to time, the Lord Chancellor would publicly reprimand the judge, as was the case in 1978 when Judge Melford-Stevenson was accused of describing the Act of Parliament as a Bugger Charter.

reference_spacy_tokens: From time to time , the Lord Chancellor would publicly reprimand the judge , as was the case in 1978 when Judge Melford - Stevenson was accused of describing the Act of Parliament as a Bugger Charter .


fn_spacy_tokens_for_baseline: Lord Scarman was a judge in the Court of Appeal when he gave and published the Hamlyn lectures in 1974 , which were controversial , as was the Dimbleby lecture given by Lord Denning in 1980 .

source_bert_toks: lord scar ##man was a judge in the court of appeal when he gave and published the ham ##lyn lectures in 1974 , which were controversial , as was the dim ##ble ##by lecture given by lord den ##ning in 1980 .

reference_raw: Lord Scarman was a judge at the Court of Appeal when he gave and published a 1974 Hamlyn class, which was controversial, as was Lord Denning's 1980 Dimbleby class.

reference_spacy_tokens: Lord Scarman was a judge at the Court of Appeal when he gave and published a 1974 Hamlyn class , which was controversial , as was Lord Denning 's 1980 Dimbleby class .


fn_spacy_tokens_for_baseline: One of them constructed the astounding rock - hewn churches at Lalibela .

source_bert_toks: one of them constructed the as ##tou ##nding rock - he ##wn churches at lal ##ibe ##la .

reference_raw: One of them built a stupendous stone-hewn temple in Lalibela.

reference_spacy_tokens: One of them built a stupendous stone - hewn temple in Lalibela .


fn_spacy_tokens_for_baseline: The tone of her voice has risen , she pushes the hair off her face with one worried hand while gesticulating with the other .

source_bert_toks: the tone of her voice has risen , she pushes the hair off her face with one worried hand while ge ##stic ##ulating with the other .

reference_raw: Her voice rose, and she brushed her hair away from her face with one worried hand as she gestured with the other.

reference_spacy_tokens: Her voice rose , and she brushed her hair away from her face with one worried hand as she gestured with the other .


fn_spacy_tokens_for_baseline: The basin was spattered with bright , fresh blood .

source_bert_toks: the basin was spat ##tered with bright , fresh blood .

reference_raw: The bowl was splattered with bright, fresh blood.

reference_spacy_tokens: The bowl was splattered with bright , fresh blood .


fn_spacy_tokens_for_baseline: She whisked out , chuckling .

source_bert_toks: she w ##his ##ked out , chuck ##ling .

reference_raw: She whisked out and laughed.

reference_spacy_tokens: She whisked out and laughed .


fn_spacy_tokens_for_baseline: The cavalryman , who was called Lord John Rossendale , was staring at the sumptuous decorations in the supper room where the long tables were draped in white linen and thickly set with silver and fine china .

source_bert_toks: the cavalry ##man , who was called lord john ross ##end ##ale , was staring at the sum ##pt ##uous decorations in the supper room where the long tables were draped in white linen and thick ##ly set with silver and fine china .

reference_raw: The cavalryman, known as Lord John Rossendale, stared at the sumptuous decorations in the dining room, where the long tables were covered with white linen and thick with silver and fine porcelain.

reference_spacy_tokens: The cavalryman , known as Lord John Rossendale , stared at the sumptuous decorations in the dining room , where the long tables were covered with white linen and thick with silver and fine porcelain .


fn_spacy_tokens_for_baseline: ' The signatures on those cheques to her were hers and she had done it to finance her drinking habit . '

source_bert_toks: ' the signatures on those che ##ques to her were hers and she had done it to finance her drinking habit . '

reference_raw: "The signatures on the checks for her were hers, and she did it to finance her drinking addiction."

reference_spacy_tokens: " The signatures on the checks for her were hers , and she did it to finance her drinking addiction . "


fn_spacy_tokens_for_baseline: It must have been distasteful for a man whose principles were always of the very highest .

source_bert_toks: it must have been di ##sta ##ste ##ful for a man whose principles were always of the very highest .

reference_raw: It must have been disgusting for a man whose principles were always the highest.

reference_spacy_tokens: It must have been disgusting for a man whose principles were always the highest .


fn_spacy_tokens_for_baseline: This year , that concern can be put into words by everyone who takes part .

source_bert_toks: this year , that concern can be put into words by everyone who takes part .

reference_raw: This year, this concern can be expressed by anyone who participates in it.

reference_spacy_tokens: This year , this concern can be expressed by anyone who participates in it .


fn_spacy_tokens_for_baseline: Their aim was to partition the set of pictures by the shapes of the engines and wagons .

source_bert_toks: their aim was to partition the set of pictures by the shapes of the engines and wagons .

reference_raw: Their goal was to divide the set of images into the shapes of the motors and wagons.

reference_spacy_tokens: Their goal was to divide the set of images into the shapes of the motors and wagons .


fn_spacy_tokens_for_baseline: Teasing a son or daughter about size or appearance is especially unkind at this stage .

source_bert_toks: teasing a son or daughter about size or appearance is especially un ##kind at this stage .

reference_raw: Teasing a son or daughter about the size or appearance of a child is particularly unpleasant at this stage.

reference_spacy_tokens: Teasing a son or daughter about the size or appearance of a child is particularly unpleasant at this stage .


fn_spacy_tokens_for_baseline: That project will then be abandoned in favour of some other quickly completable component elsewhere , so that even relatively minor works can take years to finish .

source_bert_toks: that project will then be abandoned in favour of some other quickly com ##ple ##table component elsewhere , so that even relatively minor works can take years to finish .

reference_raw: The project will then be phased out in favour of another fast-completing component elsewhere, so that even relatively small works may take years to complete.

reference_spacy_tokens: The project will then be phased out in favour of another fast - completing component elsewhere , so that even relatively small works may take years to complete .


fn_spacy_tokens_for_baseline: But a Vietnam with a difference , for the whites , armed to the teeth and economically mighty , will fight as the South Vietnamese and the Americans never did .

source_bert_toks: but a vietnam with a difference , for the whites , armed to the teeth and economically mighty , will fight as the south vietnamese and the americans never did .

reference_raw: But a Vietnam with a difference, because the whites, armed to the teeth and economically powerful, would fight like the South Vietnamese and the Americans had never done.

reference_spacy_tokens: But a Vietnam with a difference , because the whites , armed to the teeth and economically powerful , would fight like the South Vietnamese and the Americans had never done .


fn_spacy_tokens_for_baseline: 13:33 ) which causes the whole mixture to rise , or like salt rubbed into the meat to preserve and flavour it ( Luke 14:34 ) .

source_bert_toks: 13 : 33 ) which causes the whole mixture to rise , or like salt rubbed into the meat to preserve and flavour it ( luke 14 : 34 ) .

reference_raw: 13:33) which causes the whole mixture to rise, or the salt to be added to the meat in order to preserve and flavour it (Luke 14:34).

reference_spacy_tokens: 13:33 ) which causes the whole mixture to rise , or the salt to be added to the meat in order to preserve and flavour it ( Luke 14:34 ) .


fn_spacy_tokens_for_baseline: Bring to a simmer , cover and cook for 2 - 3 minutes until just tender , but not collapsing .

source_bert_toks: bring to a sim ##mer , cover and cook for 2 - 3 minutes until just tender , but not collapsing .

reference_raw: Bring to the simmer, hide and cook for two or three minutes, until it's tender, but it doesn't collapse.

reference_spacy_tokens: Bring to the simmer , hide and cook for two or three minutes , until it 's tender , but it does n't collapse .


fn_spacy_tokens_for_baseline: There will be a daylong jamboree , treasure hunt and barbecue on the Saturday .

source_bert_toks: there will be a day ##long jam ##bor ##ee , treasure hunt and barbecue on the saturday .

reference_raw: Saturday will be a day-long jambore, a treasure hunt, and a grill.

reference_spacy_tokens: Saturday will be a day - long jambore , a treasure hunt , and a grill .


fn_spacy_tokens_for_baseline: Like ants over their nest they swarmed , black and confused .

source_bert_toks: like ants over their nest they swarm ##ed , black and confused .

reference_raw: Like ants above their nest, they were crawling, black and bewildered.

reference_spacy_tokens: Like ants above their nest , they were crawling , black and bewildered .


fn_spacy_tokens_for_baseline: Many , however , were less pessimistic about the malevolent desire of powerful vested interests to obstruct the progress of democracy and genuine peace .

source_bert_toks: many , however , were less pe ##ssi ##mist ##ic about the male ##vo ##lent desire of powerful vested interests to ob ##st ##ru ##ct the progress of democracy and genuine peace .

reference_raw: But many were less pessimistic about the malicious desire of powerful vested interests to hinder the progress of democracy and true peace.

reference_spacy_tokens: But many were less pessimistic about the malicious desire of powerful vested interests to hinder the progress of democracy and true peace .


fn_spacy_tokens_for_baseline: The new pop stars -- self - conscious frauds , tackily glamorous like Boy George -- fed a revival of old - fashioned pop gossip , a staple now of the Sun and the Mirror .

source_bert_toks: the new pop stars - - self - conscious fraud ##s , tack ##ily g ##lam ##orous like boy george - - fed a revival of old - fashioned pop gossip , a staple now of the sun and the mirror .

reference_raw: New pop stars - self-conscious deceits, tacky charms like Boy George - fed the revival of old pop rumors, now a staple of the Sun and the Mirror.

reference_spacy_tokens: New pop stars - self - conscious deceits , tacky charms like Boy George - fed the revival of old pop rumors , now a staple of the Sun and the Mirror .


fn_spacy_tokens_for_baseline: Peter and Nick were sitting on the sofa sharing a bottle of whisky with Sara 's backgammon board between them .

source_bert_toks: peter and nick were sitting on the sofa sharing a bottle of whisky with sara ' s back ##gam ##mon board between them .

reference_raw: Peter and Nick sat on the couch, sharing a glass of whiskey with Sara's backgammon board.

reference_spacy_tokens: Peter and Nick sat on the couch , sharing a glass of whiskey with Sara 's backgammon board .


fn_spacy_tokens_for_baseline: The scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeways is rampant .

source_bert_toks: the scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeway ##s is rampant .

reference_raw: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets, missing each other by inches, and speeding on highways is rampant.

reference_spacy_tokens: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets , missing each other by inches , and speeding on highways is rampant .


fn_spacy_tokens_for_baseline: The Ottoman Empire was weakening , however , and in 1821 , the peoples of the Greek mainland achieved nationhood for the first time .

source_bert_toks: the ottoman empire was weakening , however , and in 1821 , the peoples of the greek mainland achieved nation ##hood for the first time .

reference_raw: But the Ottoman Empire was weakening, and for the first time in 1821 the nations of Greece reached nationhood.

reference_spacy_tokens: But the Ottoman Empire was weakening , and for the first time in 1821 the nations of Greece reached nationhood .


fn_spacy_tokens_for_baseline: Coaching from our safety boats , and daily chats on theory , help the more experienced .

source_bert_toks: coaching from our safety boats , and daily chat ##s on theory , help the more experienced .

reference_raw: The coaching of our security ships and the day-to-day talk of theory help the more experienced.

reference_spacy_tokens: The coaching of our security ships and the day - to - day talk of theory help the more experienced .


fn_spacy_tokens_for_baseline: Alex grinned mightily , so proud of her he seemed about to explode .

source_bert_toks: alex grinned might ##ily , so proud of her he seemed about to explode .

reference_raw: Alex gave a big smile, so proud of it that it looked like he was about to explode.

reference_spacy_tokens: Alex gave a big smile , so proud of it that it looked like he was about to explode .


fn_spacy_tokens_for_baseline: The car screeched to a halt in the middle of the road .

source_bert_toks: the car sc ##ree ##ched to a halt in the middle of the road .

reference_raw: The car screamed to a stop in the middle of the road.

reference_spacy_tokens: The car screamed to a stop in the middle of the road .


fn_spacy_tokens_for_baseline: The most famous tale of all is that of the ' prisoner of St Pierre ' , a murderer who was incarcerated in the town jail at the time of the disaster .

source_bert_toks: the most famous tale of all is that of the ' prisoner of st pierre ' , a murderer who was incarcerated in the town jail at the time of the disaster .

reference_raw: The most famous story of all is the "Prisoner of St. Pierre," the killer who was imprisoned in the city prison at the time of the catastrophe.

reference_spacy_tokens: The most famous story of all is the " Prisoner of St. Pierre , " the killer who was imprisoned in the city prison at the time of the catastrophe .


fn_spacy_tokens_for_baseline: Alec Clegg once wrote a fable .

source_bert_toks: alec cl ##eg ##g once wrote a fable .

reference_raw: Alec Clegg once made a story.

reference_spacy_tokens: Alec Clegg once made a story .


fn_spacy_tokens_for_baseline: The skinny man walked over to me and stuck out his hand .

source_bert_toks: the skinny man walked over to me and stuck out his hand .

reference_raw: The thin man came to me and held out his hand.

reference_spacy_tokens: The thin man came to me and held out his hand .


fn_spacy_tokens_for_baseline: Her hair is tied back from her face and held by a long white lacy ribbon , but tumbles down loose behind .

source_bert_toks: her hair is tied back from her face and held by a long white lacy ribbon , but tumble ##s down loose behind .

reference_raw: Her hair is tied back from her face and held by a long white lace tape, but it falls loose behind her.

reference_spacy_tokens: Her hair is tied back from her face and held by a long white lace tape , but it falls loose behind her .