fn_spacy_tokens_for_baseline: Yet she was itching to move to the metropolis and bombarded her parents with subtle and not so subtle requests .

source_bert_toks: yet she was it ##ching to move to the metropolis and bomb ##arded her parents with subtle and not so subtle requests .

reference_raw: But it was itching to move to the capital, and she bombarded her parents with gentle, less subtle requests.

reference_spacy_tokens: But it was itching to move to the capital , and she bombarded her parents with gentle , less subtle requests .


fn_spacy_tokens_for_baseline: She reached out and stroked the cat 's rump , her plump , tapering fingers sinking into the fur .

source_bert_toks: she reached out and stroked the cat ' s rum ##p , her plump , tape ##ring fingers sinking into the fur .

reference_raw: She reached out and stroked the cat's rum, her plump, tapering fingers sinking into the fur.

reference_spacy_tokens: She reached out and stroked the cat 's rum , her plump , tapering fingers sinking into the fur .


fn_spacy_tokens_for_baseline: ' And is that how you show your resentment , by stripping off naked in front of me and rippling your sexy body invitingly ? '

source_bert_toks: ' and is that how you show your resentment , by stripping off naked in front of me and rip ##pling your sexy body inviting ##ly ? '

reference_raw: "And that's how you show your displeasure by stripping naked in front of me and ripping your sexy body invitingly?"

reference_spacy_tokens: " And that 's how you show your displeasure by stripping naked in front of me and ripping your sexy body invitingly ? "


fn_spacy_tokens_for_baseline: He shrugged off his British Warm greatcoat and Steiner took in the badges of rank and red tabs of a staff officer .

source_bert_toks: he shrugged off his british warm great ##coat and steiner took in the badges of rank and red tab ##s of a staff officer .

reference_raw: He shrugged off his British Warm Coat, and Steiner took on his staff officer's badges of rank and red cards.

reference_spacy_tokens: He shrugged off his British Warm Coat , and Steiner took on his staff officer 's badges of rank and red cards .


fn_spacy_tokens_for_baseline: Some dealers tried to convey the false impression that the two markets were in cahoots .

source_bert_toks: some dealers tried to convey the false impression that the two markets were in ca ##hoot ##s .

reference_raw: Some of the dealers tried to give the false impression that both markets were in chaos.

reference_spacy_tokens: Some of the dealers tried to give the false impression that both markets were in chaos .


fn_spacy_tokens_for_baseline: He is a famous writer , so I also tear up his manuscripts and books .

source_bert_toks: he is a famous writer , so i also tear up his manuscripts and books .

reference_raw: He's a famous writer, so I'm ripping out his manuscripts and books.

reference_spacy_tokens: He 's a famous writer , so I 'm ripping out his manuscripts and books .


fn_spacy_tokens_for_baseline: However , a movement was growing on the Greek peninsula against Ottoman rule and for an independent Greek state .

source_bert_toks: however , a movement was growing on the greek peninsula against ottoman rule and for an independent greek state .

reference_raw: On the Greek peninsula, however, there was a growing movement against the Ottoman government and the independent Greek state.

reference_spacy_tokens: On the Greek peninsula , however , there was a growing movement against the Ottoman government and the independent Greek state .


fn_spacy_tokens_for_baseline: A new mole around an existing one can also mean trouble .

source_bert_toks: a new mole around an existing one can also mean trouble .

reference_raw: A new spy around an existing one can also be a problem.

reference_spacy_tokens: A new spy around an existing one can also be a problem .


fn_spacy_tokens_for_baseline: They puke with great accuracy and surprising range .

source_bert_toks: they pu ##ke with great accuracy and surprising range .

reference_raw: They vomit with great precision and surprising range.

reference_spacy_tokens: They vomit with great precision and surprising range .


fn_spacy_tokens_for_baseline: The consecration of his new basilica on the anniversary of Assandun and the erection of a church on the battlefield could also have owed something to Danish interest .

source_bert_toks: the consecration of his new basilica on the anniversary of ass ##and ##un and the erection of a church on the battlefield could also have owed something to danish interest .

reference_raw: The sanctification of his new basilica for Assandun's anniversary and the erection of a church on the battlefield might also be due to Danish interest.

reference_spacy_tokens: The sanctification of his new basilica for Assandun 's anniversary and the erection of a church on the battlefield might also be due to Danish interest .


fn_spacy_tokens_for_baseline: ' David takes after him .

source_bert_toks: ' david takes after him .

reference_raw: David's taking care of him.

reference_spacy_tokens: David 's taking care of him .


fn_spacy_tokens_for_baseline: One perplexing feature of this conclusion is that since the late nineteenth century far fewer children with right hemisphere lesions are aphasic .

source_bert_toks: one per ##plex ##ing feature of this conclusion is that since the late nineteenth century far fewer children with right hemisphere lesions are ap ##has ##ic .

reference_raw: One of the confusing features of this conclusion is that much fewer children with right hemisphere lesions have been aphasic since the end of the nineteenth century.

reference_spacy_tokens: One of the confusing features of this conclusion is that much fewer children with right hemisphere lesions have been aphasic since the end of the nineteenth century .


fn_spacy_tokens_for_baseline: This does not mean that , as a survival technique , individual species can not vary their body size to suit circumstances .

source_bert_toks: this does not mean that , as a survival technique , individual species can not vary their body size to suit circumstances .

reference_raw: This does not mean that, as a method of survival, the individual species cannot change the size of the body to suit the circumstances.

reference_spacy_tokens: This does not mean that , as a method of survival , the individual species can not change the size of the body to suit the circumstances .


fn_spacy_tokens_for_baseline: The scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeways is rampant .

source_bert_toks: the scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeway ##s is rampant .

reference_raw: Scary traffic is an actual experience - cars of all kinds of jockeys for positioning on crowded streets, missing each other by inches, and speeding on highways is rampant.

reference_spacy_tokens: Scary traffic is an actual experience - cars of all kinds of jockeys for positioning on crowded streets , missing each other by inches , and speeding on highways is rampant .


fn_spacy_tokens_for_baseline: This innovation has reinforced my belief that a constant news service is needed even at times of no national crisis .

source_bert_toks: this innovation has reinforced my belief that a constant news service is needed even at times of no national crisis .

reference_raw: This innovation has strengthened my belief that there is a need for a permanent news service even in a time when there is no national crisis.

reference_spacy_tokens: This innovation has strengthened my belief that there is a need for a permanent news service even in a time when there is no national crisis .


fn_spacy_tokens_for_baseline: perhaps it had been stunned by a penalty kick from a crack centre - forward .

reference_raw: Maybe he was stunned by the punitive kick from the fissure center forward.

reference_spacy_tokens: Maybe he was stunned by the punitive kick from the fissure center forward .


fn_spacy_tokens_for_baseline: Her former in - laws , the Marquess and Marchioness of Ailsa , concerned about their grandchildren , won a court order to keep the girls in their temporary care .

source_bert_toks: her former in - laws , the marquess and march ##ion ##ess of ai ##ls ##a , concerned about their grandchildren , won a court order to keep the girls in their temporary care .

reference_raw: Her former relatives, the Marquis and Marchioness of Ailsa, worried about their grandchildren, had won a court order to keep the girls in temporary care.

reference_spacy_tokens: Her former relatives , the Marquis and Marchioness of Ailsa , worried about their grandchildren , had won a court order to keep the girls in temporary care .


fn_spacy_tokens_for_baseline: Certainly , the Colombian press is much in need of that .

source_bert_toks: certainly , the colombian press is much in need of that .

reference_raw: I'm sure the Colombian press has a lot to do.

reference_spacy_tokens: I 'm sure the Colombian press has a lot to do .


fn_spacy_tokens_for_baseline: Guerrilla fighters set off bombs in central Kabul and fired toward the U. S. Embassy from atop a nearby building under renovation , the local Afghan television channel Tolo reported .

source_bert_toks: guerrilla fighters set off bombs in central kabul and fired toward the u . s . embassy from atop a nearby building under renovation , the local afghan television channel to ##lo reported .

reference_raw: Guerrilla fighters detonated bombs in central Kabul and fired at the U.S. embassy from a nearby building under renovation, the local Afghan TV channel Tolo reported.

reference_spacy_tokens: Guerrilla fighters detonated bombs in central Kabul and fired at the U.S. embassy from a nearby building under renovation , the local Afghan TV channel Tolo reported .


fn_spacy_tokens_for_baseline: In fact , Diana 's indignation at Raine simmered for years until finally it boiled over in 1989 at the church rehearsal for her brother 's wedding to Victoria Lockwood , a successful model .

source_bert_toks: in fact , diana ' s ind ##ign ##ation at rain ##e sim ##mere ##d for years until finally it boiled over in 1989 at the church rehearsal for her brother ' s wedding to victoria lock ##wood , a successful model .

reference_raw: In fact, Diana's indignation at Raine lasted for years, until finally, in 1989, at the church rehearsal for her brother's wedding to Victoria Lockwood, a successful model.

reference_spacy_tokens: In fact , Diana 's indignation at Raine lasted for years , until finally , in 1989 , at the church rehearsal for her brother 's wedding to Victoria Lockwood , a successful model .


fn_spacy_tokens_for_baseline: Well , I was bored by the whole of presentation as far as television was concerned because I think television is bound to be superficial .

source_bert_toks: well , i was bored by the whole of presentation as far as television was concerned because i think television is bound to be superficial .

reference_raw: Well, when it comes to TV, I'm tired of all the presentations, because I think TV's gonna be shallow.

reference_spacy_tokens: Well , when it comes to TV , I 'm tired of all the presentations , because I think TV 's gon na be shallow .


fn_spacy_tokens_for_baseline: The tree frogs whistled -- three urgent calls on a rising scale , one to another , again and again .

source_bert_toks: the tree frogs whistled - - three urgent calls on a rising scale , one to another , again and again .

reference_raw: Tree frogs squealed - three urgent calls on a rising scale, one to the other, over and over again.

reference_spacy_tokens: Tree frogs squealed - three urgent calls on a rising scale , one to the other , over and over again .


fn_spacy_tokens_for_baseline: A pub landlord in Oxford has been charged with allowing his customers to smoke cannabis on his premises .

source_bert_toks: a pub landlord in oxford has been charged with allowing his customers to smoke cannabis on his premises .

reference_raw: The innkeeper at Oxford was accused of allowing his customers to smoke hemp on his premises.

reference_spacy_tokens: The innkeeper at Oxford was accused of allowing his customers to smoke hemp on his premises .


fn_spacy_tokens_for_baseline: Is the Minister aware that the cracker he pulls this Christmas will probably have been packaged by a home worker , as will the Christmas cards and gift tags ?

source_bert_toks: is the minister aware that the crack ##er he pulls this christmas will probably have been packaged by a home worker , as will the christmas cards and gift tags ?

reference_raw: Does the Minister know that the cracker he's pulling this Christmas is likely to be packed by a homeworker, like Christmas cards and gift tags?

reference_spacy_tokens: Does the Minister know that the cracker he 's pulling this Christmas is likely to be packed by a homeworker , like Christmas cards and gift tags ?


fn_spacy_tokens_for_baseline: Irina had been brisk when she called with the news and told him to telephone Rakovsky at his hotel .

source_bert_toks: irina had been brisk when she called with the news and told him to telephone ra ##kovsky at his hotel .

reference_raw: Irina was quick when she phoned him with the news and told him to phone Rakovsky at the hotel.

reference_spacy_tokens: Irina was quick when she phoned him with the news and told him to phone Rakovsky at the hotel .


fn_spacy_tokens_for_baseline: Jos was wearing yellow leather gauntlets which looked totally out of place in such a decrepit vehicle .

source_bert_toks: jo ##s was wearing yellow leather gaunt ##lets which looked totally out of place in such a dec ##re ##pit vehicle .

reference_raw: Jos wore yellow leather gloves that looked completely out of place in such a miserable car.

reference_spacy_tokens: Jos wore yellow leather gloves that looked completely out of place in such a miserable car .


fn_spacy_tokens_for_baseline: ' Donkeys , Janet ! ' trilled Gwendolen at his side .

source_bert_toks: ' donkey ##s , janet ! ' tri ##lled gwen ##do ##len at his side .

reference_raw: 'Donkeys, Janet!' said Gwendolen beside him.

reference_spacy_tokens: ' Donkeys , Janet ! ' said Gwendolen beside him .


fn_spacy_tokens_for_baseline: He 'd scatter some of the grain he 'd nicked , and fetch down the wire and cutters , and his books .

source_bert_toks: he ' d sc ##atter some of the grain he ' d nick ##ed , and fetch down the wire and cutter ##s , and his books .

reference_raw: He sprinkled some of the grain he had nicked, and brought down the wires, the cutters, and his books.

reference_spacy_tokens: He sprinkled some of the grain he had nicked , and brought down the wires , the cutters , and his books .


fn_spacy_tokens_for_baseline: They force the reader to slow down , to dwell or brood on what is happening .

source_bert_toks: they force the reader to slow down , to dwell or brood on what is happening .

reference_raw: They make the reader slow down, dwell or think about what's going on.

reference_spacy_tokens: They make the reader slow down , dwell or think about what 's going on .


fn_spacy_tokens_for_baseline: As I watched them Stapleton rose and left the room , while Sir Henry filled his glass again and leaned back in his chair , puffing at his cigar .

source_bert_toks: as i watched them staple ##ton rose and left the room , while sir henry filled his glass again and leaned back in his chair , puff ##ing at his cigar .

reference_raw: As I watched, Stapleton got up and left the room, and Sir Henry refilled his glass and leaned back in his chair, puffing on his cigar.

reference_spacy_tokens: As I watched , Stapleton got up and left the room , and Sir Henry refilled his glass and leaned back in his chair , puffing on his cigar .


fn_spacy_tokens_for_baseline: Local fire departments put the current death toll at at least 37 , nine of which were children .

source_bert_toks: local fire departments put the current death toll at at least 37 , nine of which were children .

reference_raw: The local fire department put at least 37 tolls on the actual death toll, nine of which were children.

reference_spacy_tokens: The local fire department put at least 37 tolls on the actual death toll , nine of which were children .


fn_spacy_tokens_for_baseline: The partially clothed body of Carol Clark was found more than a week ago .

source_bert_toks: the partially clothed body of carol clark was found more than a week ago .

reference_raw: Carol Clark's partially dressed body was found over a week ago.

reference_spacy_tokens: Carol Clark 's partially dressed body was found over a week ago .


fn_spacy_tokens_for_baseline: When preparing his food , you should think in terms of providing a ' finger buffet ' with foods you might normally eat with a knife and fork .

source_bert_toks: when preparing his food , you should think in terms of providing a ' finger buffet ' with foods you might normally eat with a knife and fork .

reference_raw: In the preparation of his meal, you should think about providing a "finger buffet" with food that you would normally eat with a knife and a fork.

reference_spacy_tokens: In the preparation of his meal , you should think about providing a " finger buffet " with food that you would normally eat with a knife and a fork .


fn_spacy_tokens_for_baseline: In 1890 it passed by marriage to Herbert Robertson of Strathloch , the Scottish barony to which his grandson Lawrence lays claim .

source_bert_toks: in 1890 it passed by marriage to herbert robertson of st ##rath ##lo ##ch , the scottish barony to which his grandson lawrence lays claim .

reference_raw: In 1890, he married Herbert Robertson of Strathloch, a Scottish baron whose grandson Lawrence claims to be.

reference_spacy_tokens: In 1890 , he married Herbert Robertson of Strathloch , a Scottish baron whose grandson Lawrence claims to be .


fn_spacy_tokens_for_baseline: Animal welfare had been the subject of discussions with several leading UK retailers and the Danish industry had offered assurances about the way in which animals are produced and reared there .

source_bert_toks: animal welfare had been the subject of discussions with several leading uk retailers and the danish industry had offered assurance ##s about the way in which animals are produced and reared there .

reference_raw: Animal welfare has been discussed with several leading retailers in the United Kingdom and the Danish industry has offered guarantees on how animals are produced and reared there.

reference_spacy_tokens: Animal welfare has been discussed with several leading retailers in the United Kingdom and the Danish industry has offered guarantees on how animals are produced and reared there .


fn_spacy_tokens_for_baseline: With a feeling of doom I hurried after the squat figure back into the yard where another lad stood by the side of a beautiful chestnut filly .

source_bert_toks: with a feeling of doom i hurried after the squat figure back into the yard where another lad stood by the side of a beautiful chestnut filly .

reference_raw: With a sense of doom, I hurried after the sturdy figure into the backyard, where another boy was standing at the side of a beautiful chestnut filly.

reference_spacy_tokens: With a sense of doom , I hurried after the sturdy figure into the backyard , where another boy was standing at the side of a beautiful chestnut filly .


fn_spacy_tokens_for_baseline: Twice Henderson has lashed at folk with his dog - whip , and only his long purse and heavy compensation have kept him out of the courts .

source_bert_toks: twice henderson has lashed at folk with his dog - whip , and only his long purse and heavy compensation have kept him out of the courts .

reference_raw: Henderson had hit people twice with his dog whip, and only his long purse and heavy compensation had kept him out of the courtroom.

reference_spacy_tokens: Henderson had hit people twice with his dog whip , and only his long purse and heavy compensation had kept him out of the courtroom .


fn_spacy_tokens_for_baseline: ' Come along , Rory , ' he said softly , and the unexpected sound of her pet name on his lips sent a strange shiver along her spine .

source_bert_toks: ' come along , rory , ' he said softly , and the unexpected sound of her pet name on his lips sent a strange shiver along her spine .

reference_raw: 'Come with me, Rory,' he said quietly, and the unexpected sound of her pet-name on his lips gave her a strange shiver.

reference_spacy_tokens: ' Come with me , Rory , ' he said quietly , and the unexpected sound of her pet - name on his lips gave her a strange shiver .


fn_spacy_tokens_for_baseline: ' Take 1 pint of very thick cream , and put it into a fine damask cloth , previously dipped in strong salt water , and tie up .

source_bert_toks: ' take 1 pin ##t of very thick cream , and put it into a fine dam ##ask cloth , previously dipped in strong salt water , and tie up .

reference_raw: 'Take one litre of very thick cream and place it in a fine damask cloth, previously soaked in strong salt water, and tie it up.

reference_spacy_tokens: ' Take one litre of very thick cream and place it in a fine damask cloth , previously soaked in strong salt water , and tie it up .


fn_spacy_tokens_for_baseline: In the long - run , this money illusion will disappear as workers come to realise that price inflation is depriving them of their perceived increase - in real income .

source_bert_toks: in the long - run , this money illusion will disappear as workers come to realise that price inflation is de ##pr ##iving them of their perceived increase - in real income .

reference_raw: In the long run, the illusion of money will disappear as workers realize that price inflation is costing them a perceived increase in real income.

reference_spacy_tokens: In the long run , the illusion of money will disappear as workers realize that price inflation is costing them a perceived increase in real income .


fn_spacy_tokens_for_baseline: From the next railway station , the modern campus of the Chinese University of Hong Kong is visible .

source_bert_toks: from the next railway station , the modern campus of the chinese university of hong kong is visible .

reference_raw: From the next station you can see the modern campus of the Hong Kong University of China.

reference_spacy_tokens: From the next station you can see the modern campus of the Hong Kong University of China .


fn_spacy_tokens_for_baseline: With 20 years experience in the retail business , she has come across all sorts of shoplifters , from down and outs to light - fingered public schoolgirls , and despises them all .

source_bert_toks: with 20 years experience in the retail business , she has come across all sorts of shop ##lift ##ers , from down and outs to light - fingered public school ##girl ##s , and des ##pis ##es them all .

reference_raw: With 20 years of retail experience, she's come across all sorts of shoplifters, from downstairs to outside, to light-fed public schoolgirls, and she despises them all.

reference_spacy_tokens: With 20 years of retail experience , she 's come across all sorts of shoplifters , from downstairs to outside , to light - fed public schoolgirls , and she despises them all .


fn_spacy_tokens_for_baseline: Such help to industry shrinks the tax base .

source_bert_toks: such help to industry shrink ##s the tax base .

reference_raw: This help for industry reduces the tax base.

reference_spacy_tokens: This help for industry reduces the tax base .


fn_spacy_tokens_for_baseline: As we swung past the farm , the farmer , no doubt attracted by the sound of bagpipes , was standing at the entrance to his farm , a bewildered look on his face .

source_bert_toks: as we swung past the farm , the farmer , no doubt attracted by the sound of bag ##pipe ##s , was standing at the entrance to his farm , a bewildered look on his face .

reference_raw: As we turned around the farmhouse, the farmer, no doubt drawn to the sound of the pipes, stood in the doorway of his farm with a puzzled expression on his face.

reference_spacy_tokens: As we turned around the farmhouse , the farmer , no doubt drawn to the sound of the pipes , stood in the doorway of his farm with a puzzled expression on his face .


fn_spacy_tokens_for_baseline: Eventually , in 1826 , Blake left the business , which continued under James Mann and his sons until 1846 , when James Mann died .

source_bert_toks: eventually , in 1826 , blake left the business , which continued under james mann and his sons until 1846 , when james mann died .

reference_raw: Finally, in 1826, Blake abandoned the business that continued under James Mann and his sons until the death of James Mann in 1846.

reference_spacy_tokens: Finally , in 1826 , Blake abandoned the business that continued under James Mann and his sons until the death of James Mann in 1846 .


fn_spacy_tokens_for_baseline: Mr. Barco has refused U.S. troops or advisers but has accepted U.S. military aid .

source_bert_toks: mr . bar ##co has refused u . s . troops or advisers but has accepted u . s . military aid .

reference_raw: Mr. Barco refused U.S. soldiers or advisers, but accepted U.S. military assistance.

reference_spacy_tokens: Mr. Barco refused U.S. soldiers or advisers , but accepted U.S. military assistance .


fn_spacy_tokens_for_baseline: Why else -- when there are plenty of environment - friendly products now available -- do supermarkets still stock non - green items ?

source_bert_toks: why else - - when there are plenty of environment - friendly products now available - - do supermarkets still stock non - green items ?

reference_raw: Why else, if there are a lot of environmentally friendly products now available, do supermarkets still store non-green items?

reference_spacy_tokens: Why else , if there are a lot of environmentally friendly products now available , do supermarkets still store non - green items ?


fn_spacy_tokens_for_baseline: Anthim is a high - affinity monoclonal antibody that targets the protective antigen component of anthrax , blocking the bacteria 's ability to form deadly toxins .

source_bert_toks: ant ##him is a high - affinity mono ##cl ##onal antibody that targets the protective antigen component of ant ##hra ##x , blocking the bacteria ' s ability to form deadly toxin ##s .

reference_raw: Anthim is a high-affinity monoclonal antibody that focuses on the protective antigen component of anthrax and blocks the ability of the bacteria to produce lethal toxins.

reference_spacy_tokens: Anthim is a high - affinity monoclonal antibody that focuses on the protective antigen component of anthrax and blocks the ability of the bacteria to produce lethal toxins .


fn_spacy_tokens_for_baseline: He tweaked the boy 's ear and Oliver looked at him with love .

source_bert_toks: he t ##we ##ake ##d the boy ' s ear and oliver looked at him with love .

reference_raw: He twitched the boy's ear, and Oliver gave him a lovely look.

reference_spacy_tokens: He twitched the boy 's ear , and Oliver gave him a lovely look .


fn_spacy_tokens_for_baseline: After all , it is everyone 's children who stand to suffer from theories which , to take only one example , disdain the teaching of history in factual terms .

source_bert_toks: after all , it is everyone ' s children who stand to suffer from theories which , to take only one example , disdain the teaching of history in factual terms .

reference_raw: After all, it is the children of all who suffer from theories that, to take one example, despise the teaching of history in fact.

reference_spacy_tokens: After all , it is the children of all who suffer from theories that , to take one example , despise the teaching of history in fact .


fn_spacy_tokens_for_baseline: The Londoner found himself staring into the expressionless face of the tall and broad , blond - haired , blue - eyed bouncer .

source_bert_toks: the london ##er found himself staring into the expression ##less face of the tall and broad , blond - haired , blue - eyed bounce ##r .

reference_raw: The Londoner found himself staring into the expressionless face of a tall, broad, blond-haired bouncer with blue eyes.

reference_spacy_tokens: The Londoner found himself staring into the expressionless face of a tall , broad , blond - haired bouncer with blue eyes .


fn_spacy_tokens_for_baseline: He knew this man , not by name or reputation , but by smelling the rotten evil about him .

source_bert_toks: he knew this man , not by name or reputation , but by smelling the rotten evil about him .

reference_raw: He knew the man, not by name or reputation, but by the sense of rotten evil around him.

reference_spacy_tokens: He knew the man , not by name or reputation , but by the sense of rotten evil around him .


fn_spacy_tokens_for_baseline: The dependence of what we see on the state of our minds or brains is not so sensitive as to make communication , and science , impossible .

source_bert_toks: the dependence of what we see on the state of our minds or brains is not so sensitive as to make communication , and science , impossible .

reference_raw: The dependency of what we see on the state of our minds and minds is not so sensitive as to render communication and science impossible.

reference_spacy_tokens: The dependency of what we see on the state of our minds and minds is not so sensitive as to render communication and science impossible .


fn_spacy_tokens_for_baseline: Hot sand , ash and rock tumbled three miles down deep gullies towards villages and farms on the lower slopes .

source_bert_toks: hot sand , ash and rock tumbled three miles down deep gu ##llie ##s towards villages and farms on the lower slopes .

reference_raw: Hot sand, ash and rock rolled three miles down the deep ravines to the villages and farms on the lower slopes.

reference_spacy_tokens: Hot sand , ash and rock rolled three miles down the deep ravines to the villages and farms on the lower slopes .


fn_spacy_tokens_for_baseline: The death - bed thus prefigured the decisive struggle for possession of the soul , which would take place on Judgement Day and which had been so vividly depicted in mediaeval murals and missals .

source_bert_toks: the death - bed thus pre ##fi ##gur ##ed the decisive struggle for possession of the soul , which would take place on judgement day and which had been so vivid ##ly depicted in media ##eva ##l murals and miss ##als .

reference_raw: The deathbed thus presupposed a decisive struggle for possession of the soul, which would take place on Judgment Day, and which was so vividly depicted in medieval murals and missals.

reference_spacy_tokens: The deathbed thus presupposed a decisive struggle for possession of the soul , which would take place on Judgment Day , and which was so vividly depicted in medieval murals and missals .


fn_spacy_tokens_for_baseline: 4 She completes the block with her outer forearm , in a walking stance .

source_bert_toks: 4 she completes the block with her outer forearm , in a walking stance .

reference_raw: 4 He completes the block with his outer arm in a walking position.

reference_spacy_tokens: 4 He completes the block with his outer arm in a walking position .


fn_spacy_tokens_for_baseline: Arguments over using the ' Jarman index ' to assess demand for services and the method of payment have obscured the principle underlying the payments .

source_bert_toks: arguments over using the ' jar ##man index ' to assess demand for services and the method of payment have obscured the principle underlying the payments .

reference_raw: The allegations about the use of the Jarman Index to assess the demand for services and the payment method have obscured the principle on which payments are based.

reference_spacy_tokens: The allegations about the use of the Jarman Index to assess the demand for services and the payment method have obscured the principle on which payments are based .


fn_spacy_tokens_for_baseline: It is extremely costly in time and money since such interviewing can easily take two hours or more , and the data produced are not easy to code and analyse .

source_bert_toks: it is extremely costly in time and money since such interviewing can easily take two hours or more , and the data produced are not easy to code and anal ##yse .

reference_raw: It is very expensive in time and money, as such interviews can easily take two hours or more, and it is not easy to encode and analyze the data generated.

reference_spacy_tokens: It is very expensive in time and money , as such interviews can easily take two hours or more , and it is not easy to encode and analyze the data generated .


fn_spacy_tokens_for_baseline: I may not sympathize with the bombing .

source_bert_toks: i may not sy ##mp ##athi ##ze with the bombing .

reference_raw: I don't have to sympathise with the bombing.

reference_spacy_tokens: I do n't have to sympathise with the bombing .


fn_spacy_tokens_for_baseline: Some people , he explained , still wrongly believed that bodies were removed from coffins before being cremated and that ashes were eventually taken from a communal pile .

source_bert_toks: some people , he explained , still wrongly believed that bodies were removed from coffin ##s before being cremated and that ashes were eventually taken from a communal pile .

reference_raw: Some people, he explained, still believed wrongly that the bodies had been removed from the caskets before they had been cremated and that the ashes had finally been removed from the common heap.

reference_spacy_tokens: Some people , he explained , still believed wrongly that the bodies had been removed from the caskets before they had been cremated and that the ashes had finally been removed from the common heap .


fn_spacy_tokens_for_baseline: But they flatly refused to relinquish their grip on power .

source_bert_toks: but they flatly refused to re ##lin ##qui ##sh their grip on power .

reference_raw: But they simply refused to give up their grip on power.

reference_spacy_tokens: But they simply refused to give up their grip on power .


fn_spacy_tokens_for_baseline: Let Clan Diarmaid rue the day they ever raised hand against Clan Gillian ! '

source_bert_toks: let clan dia ##rma ##id rue the day they ever raised hand against clan gillian ! '

reference_raw: May the Diarmaid clan mourn the day they ever raised a hand against the Gillian clan!'

reference_spacy_tokens: May the Diarmaid clan mourn the day they ever raised a hand against the Gillian clan ! '


fn_spacy_tokens_for_baseline: FRESH mint makes a piquant summer sauce which you can have even in the winter .

source_bert_toks: fresh mint makes a pi ##qua ##nt summer sauce which you can have even in the winter .

reference_raw: Fresh mint makes a spicy summer sauce that you can have in winter.

reference_spacy_tokens: Fresh mint makes a spicy summer sauce that you can have in winter .


fn_spacy_tokens_for_baseline: The problem occurs with some of his followers , who turn the technique from one of limited use with some people into a total dogmatic world view , ignoring Freud 's own strictures against such tendencies .

source_bert_toks: the problem occurs with some of his followers , who turn the technique from one of limited use with some people into a total dog ##matic world view , ignoring freud ' s own strict ##ures against such tendencies .

reference_raw: The problem is with some of his followers, who turn the technology from a limited use to some people into a total dogmatic view of the world, ignoring Freud's own restraints against such tendencies.

reference_spacy_tokens: The problem is with some of his followers , who turn the technology from a limited use to some people into a total dogmatic view of the world , ignoring Freud 's own restraints against such tendencies .


fn_spacy_tokens_for_baseline: He says all the trouble in this land is caused by two per cent of bastards who should have been drowned at birth .

source_bert_toks: he says all the trouble in this land is caused by two per cent of bastards who should have been drowned at birth .

reference_raw: He says that all the trouble in this country is caused by two percent of the bastards who were supposed to be sunk when they were born.

reference_spacy_tokens: He says that all the trouble in this country is caused by two percent of the bastards who were supposed to be sunk when they were born .


fn_spacy_tokens_for_baseline: The immense build - up made it impossible to find a decent anchor and , having stamped out a rather unstable stance , I had to settle for a couple of drive - ins in a clod of frozen turf .

source_bert_toks: the immense build - up made it impossible to find a decent anchor and , having stamped out a rather unstable stance , i had to settle for a couple of drive - ins in a cl ##od of frozen turf .

reference_raw: The massive build-up made it impossible to find a decent anchor, and after stamping out a rather unstable position, I had to settle for a few drive-ins in a block of frozen grass.

reference_spacy_tokens: The massive build - up made it impossible to find a decent anchor , and after stamping out a rather unstable position , I had to settle for a few drive - ins in a block of frozen grass .


fn_spacy_tokens_for_baseline: Athelstan drew his cowl over his head and pulled his sleeves down .

source_bert_toks: at ##hel ##stan drew his cow ##l over his head and pulled his sleeves down .

reference_raw: Athelstan pulled his hood over his head and pulled down his sleeves.

reference_spacy_tokens: Athelstan pulled his hood over his head and pulled down his sleeves .


fn_spacy_tokens_for_baseline: The request would only be considered if it had been submitted in a timely manner as indicated , except in special cases .

source_bert_toks: the request would only be considered if it had been submitted in a timely manner as indicated , except in special cases .

reference_raw: The application will only be considered if it has been submitted in due time, as indicated, except in specific circumstances.

reference_spacy_tokens: The application will only be considered if it has been submitted in due time , as indicated , except in specific circumstances .


fn_spacy_tokens_for_baseline: The World Council of Churches has published a Dictionary of the Ecumenical Movement , which includes more than 600 entries written by leading figures from every Christian confession and all parts of the world .

source_bert_toks: the world council of churches has published a dictionary of the ecumenical movement , which includes more than 600 entries written by leading figures from every christian confession and all parts of the world .

reference_raw: The World Council of Churches has published the Dictionary of the Ecumenical Movement, which contains over 600 entries written by leading figures from all Christian admissions and all parts of the world.

reference_spacy_tokens: The World Council of Churches has published the Dictionary of the Ecumenical Movement , which contains over 600 entries written by leading figures from all Christian admissions and all parts of the world .


fn_spacy_tokens_for_baseline: Examples of this include the separation of production and assembly in the motor industry and the location of low - technology , labour - intensive manufacturing processes in regions where labour is cheap and non - unionized ( and frequently female ) .

source_bert_toks: examples of this include the separation of production and assembly in the motor industry and the location of low - technology , labour - intensive manufacturing processes in regions where labour is cheap and non - union ##ized ( and frequently female ) .

reference_raw: Examples of this include the separation of production and installation in the motor sector and the location of low-tech, labour-intensive production processes in regions where labour is cheap and non-unionised (and often women).

reference_spacy_tokens: Examples of this include the separation of production and installation in the motor sector and the location of low - tech , labour - intensive production processes in regions where labour is cheap and non - unionised ( and often women ) .


fn_spacy_tokens_for_baseline: ' How lucky we are to be in a band and not having to get up every morning to do a crappy job .

source_bert_toks: ' how lucky we are to be in a band and not having to get up every morning to do a crap ##py job .

reference_raw: 'We're lucky we're in the band and we don't have to get up every morning to do shitty work.

reference_spacy_tokens: ' We 're lucky we 're in the band and we do n't have to get up every morning to do shitty work .


fn_spacy_tokens_for_baseline: Until the Jan. 30 election , the local councils had been staffed by U. S. appointees , who lacked significant authority and struggled to gain the public 's confidence .

source_bert_toks: until the jan . 30 election , the local councils had been staffed by u . s . appoint ##ees , who lacked significant authority and struggled to gain the public ' s confidence .

reference_raw: Until the election of January 30, the local councils were commissioned by U.S. nominees who lacked significant authority and tried to gain public trust.

reference_spacy_tokens: Until the election of January 30 , the local councils were commissioned by U.S. nominees who lacked significant authority and tried to gain public trust .


fn_spacy_tokens_for_baseline: He began to relate the story of Paul 's throwing himself from the window , the coming of the doctor , the taking away of Paul to an asylum .

source_bert_toks: he began to relate the story of paul ' s throwing himself from the window , the coming of the doctor , the taking away of paul to an asylum .

reference_raw: He began to tell the story of Paul throwing himself out the window, the arrival of the doctor, the removal of Paul to the asylum.

reference_spacy_tokens: He began to tell the story of Paul throwing himself out the window , the arrival of the doctor , the removal of Paul to the asylum .


fn_spacy_tokens_for_baseline: Many roadblocks remain and progress is likely to be painful and slow .

source_bert_toks: many road ##block ##s remain and progress is likely to be painful and slow .

reference_raw: There are still many roadblocks and the process is likely to be painful and slow.

reference_spacy_tokens: There are still many roadblocks and the process is likely to be painful and slow .


fn_spacy_tokens_for_baseline: Whilst in general each supported the other , there were clashes from time to time , both sides accusing the other of reprehensible acts .

source_bert_toks: whilst in general each supported the other , there were clashes from time to time , both sides accusing the other of rep ##re ##hen ##sible acts .

reference_raw: While the two generally supported each other, there were occasional conflicts, and both sides blamed each other for reproachful acts.

reference_spacy_tokens: While the two generally supported each other , there were occasional conflicts , and both sides blamed each other for reproachful acts .


fn_spacy_tokens_for_baseline: The Venetians fortified their main towns -- Naxos Town and Antiparos Town are wonderful examples of this -- creating labyrinths of narrow alleys and cul - de - sacs that were designed to confuse and to demoralize invaders .

source_bert_toks: the venetian ##s fortified their main towns - - na ##x ##os town and anti ##par ##os town are wonderful examples of this - - creating labyrinth ##s of narrow alley ##s and cu ##l - de - sac ##s that were designed to confuse and to demo ##ral ##ize invaders .

reference_raw: The Venetians fortified their major cities - the city of Naxos and the city of Antiparos is a great example - creating a maze of narrow alleys and dead ends designed to confuse and demoralize the invaders.

reference_spacy_tokens: The Venetians fortified their major cities - the city of Naxos and the city of Antiparos is a great example - creating a maze of narrow alleys and dead ends designed to confuse and demoralize the invaders .


fn_spacy_tokens_for_baseline: Profits edged up £ 59,000 to £ 2.12 m before tax .

source_bert_toks: profits edged up £5 ##9 , 000 to £2 . 12 ##m before tax .

reference_raw: The profits increased from £59,000 to £2.12 million before tax.

reference_spacy_tokens: The profits increased from £ 59,000 to £ 2.12 million before tax .


fn_spacy_tokens_for_baseline: Ralph looked at his reflection in the mirror at the back of the bar and gently patted his toupee .

source_bert_toks: ralph looked at his reflection in the mirror at the back of the bar and gently patted his to ##up ##ee .

reference_raw: Ralph looked at his reflection in the mirror at the back of the bar and patted the tope gently.

reference_spacy_tokens: Ralph looked at his reflection in the mirror at the back of the bar and patted the tope gently .


fn_spacy_tokens_for_baseline: On this rested a dozen twinkling champagne saucers and a Georgian silver wine cooler containing a chilled and vintage bottle of Pol Roger .

source_bert_toks: on this rested a dozen twin ##kling champagne sauce ##rs and a georgian silver wine cooler containing a chilled and vintage bottle of pol roger .

reference_raw: On it was a dozen sparkling champagne plates and a Georgian silver wine refrigerator containing a chilled bottle of Pol Roger.

reference_spacy_tokens: On it was a dozen sparkling champagne plates and a Georgian silver wine refrigerator containing a chilled bottle of Pol Roger .


fn_spacy_tokens_for_baseline: ' Trying to scare Ukraine is impudent and fruitless , ' he declared .

source_bert_toks: ' trying to scare ukraine is imp ##ude ##nt and fruit ##less , ' he declared .

reference_raw: 'Trying to frighten Ukraine is insolent and fruitless,' he said.

reference_spacy_tokens: ' Trying to frighten Ukraine is insolent and fruitless , ' he said .


fn_spacy_tokens_for_baseline: Ward was angling across the slope above to cut him off .

source_bert_toks: ward was ang ##ling across the slope above to cut him off .

reference_raw: Ward was squirming over the slope to cut him off.

reference_spacy_tokens: Ward was squirming over the slope to cut him off .


fn_spacy_tokens_for_baseline: MILLIONS of TV viewers around the world witnessed Mr Mellor as he tried to humiliate an Israeli army colonel who arrested a Palestinian boy .

source_bert_toks: millions of tv viewers around the world witnessed mr mel ##lor as he tried to hum ##ilia ##te an israeli army colonel who arrested a palestinian boy .

reference_raw: MILLIONS of television viewers around the world witnessed Mr. Mellor trying to embarrass an Israeli military colonel who had arrested a Palestinian boy.

reference_spacy_tokens: MILLIONS of television viewers around the world witnessed Mr. Mellor trying to embarrass an Israeli military colonel who had arrested a Palestinian boy .


fn_spacy_tokens_for_baseline: A few blocks up Nathan Road is Kowloon Park ( open daily 6 am - midnight ) , elegantly laid out with fountains , promenades , and ornamental gardens ; be sure to go up the steps to see the Sculpture Walk .

source_bert_toks: a few blocks up nathan road is ko ##wl ##oon park ( open daily 6 am - midnight ) , elegant ##ly laid out with fountains , promenade ##s , and ornamental gardens ; be sure to go up the steps to see the sculpture walk .

reference_raw: Couple blocks from Nathan Road is Kowloon Park (open at 6:00 a.m. every day), neatly arranged with fountains, promenades, and ornamental gardens; make sure to go up the stairs and look at the Sculpture Walk.

reference_spacy_tokens: Couple blocks from Nathan Road is Kowloon Park ( open at 6:00 a.m. every day ) , neatly arranged with fountains , promenades , and ornamental gardens ; make sure to go up the stairs and look at the Sculpture Walk .


fn_spacy_tokens_for_baseline: On the manufacturing side the Dalek started life as a chalk line drawn on the factory floor around the portly frame of Bill Roberts seated on a stool .

source_bert_toks: on the manufacturing side the dale ##k started life as a chalk line drawn on the factory floor around the port ##ly frame of bill roberts seated on a stool .

reference_raw: On the manufacturing side, the Dalek began to live like a chalk line drawn on the floor of the factory around the window frame of Bill Roberts sitting on a chair.

reference_spacy_tokens: On the manufacturing side , the Dalek began to live like a chalk line drawn on the floor of the factory around the window frame of Bill Roberts sitting on a chair .


fn_spacy_tokens_for_baseline: After coffee ( pink hairslide Maureen made it , green hairslide Linda cleared it away ) , Christina was prevailed upon to deliver a brief account of the progress of her work to date .

source_bert_toks: after coffee ( pink hairs ##lide maureen made it , green hairs ##lide linda cleared it away ) , christina was prevailed upon to deliver a brief account of the progress of her work to date .

reference_raw: After coffee (the pink hair slide that Maureen had made, the green hair slide that Linda had cleaned up), Christine had been given the opportunity to give a brief account of the progress of her work so far.

reference_spacy_tokens: After coffee ( the pink hair slide that Maureen had made , the green hair slide that Linda had cleaned up ) , Christine had been given the opportunity to give a brief account of the progress of her work so far .


fn_spacy_tokens_for_baseline: When sister Lou finally tied the knot , she did it in style ; the full church wedding .

source_bert_toks: when sister lou finally tied the knot , she did it in style ; the full church wedding .

reference_raw: When Sister Lou finally tied the node, she did it in style; the whole church wedding.

reference_spacy_tokens: When Sister Lou finally tied the node , she did it in style ; the whole church wedding .


fn_spacy_tokens_for_baseline: Individuals in interacting either harmonize or conflict , and there is no reason to suppose that any enlargement of awareness would either reconcile all conflict or expose all harmony as illusory .

source_bert_toks: individuals in interacting either harmon ##ize or conflict , and there is no reason to suppose that any en ##lar ##gement of awareness would either reconcile all conflict or expose all harmony as ill ##uso ##ry .

reference_raw: Individuals interact either in harmony or in conflict, and there is no reason to believe that any increase in awareness would either reconcile all conflicts or expose all harmony as illusory.

reference_spacy_tokens: Individuals interact either in harmony or in conflict , and there is no reason to believe that any increase in awareness would either reconcile all conflicts or expose all harmony as illusory .


fn_spacy_tokens_for_baseline: The SRI has allegedly taken in Iraqi scientists prior to the recent Gulf War .

source_bert_toks: the sri has allegedly taken in iraqi scientists prior to the recent gulf war .

reference_raw: The SRI was supposedly recruited by Iraqi scientists before the recent Gulf War.

reference_spacy_tokens: The SRI was supposedly recruited by Iraqi scientists before the recent Gulf War .


fn_spacy_tokens_for_baseline: ' Your man , they tell me , adorned you with jewels and fine gowns .

source_bert_toks: ' your man , they tell me , adorned you with jewels and fine gown ##s .

reference_raw: 'Your husband, I'm told, decorated you with jewels and fine clothes.

reference_spacy_tokens: ' Your husband , I 'm told , decorated you with jewels and fine clothes .


fn_spacy_tokens_for_baseline: It aims to mimic the brain 's ability to access information quickly and intuitively by forming associative links between subjects .

source_bert_toks: it aims to mimic the brain ' s ability to access information quickly and intuitive ##ly by forming ass ##oc ##ia ##tive links between subjects .

reference_raw: The aim is to imitate the ability of the brain to access information quickly and intuitively by creating an associative link between the subjects.

reference_spacy_tokens: The aim is to imitate the ability of the brain to access information quickly and intuitively by creating an associative link between the subjects .


fn_spacy_tokens_for_baseline: Dear little folk , tiny , with thin high - pitched voices , they sup on toadstools and ' fairy butter ' , the latter being a yellow fungus found in the roots of old trees .

source_bert_toks: dear little folk , tiny , with thin high - pitched voices , they su ##p on toad ##sto ##ols and ' fairy butter ' , the latter being a yellow fungus found in the roots of old trees .

reference_raw: Dear little people, small, with thin, high-pitched voices, succumb to toadstools and "fairy butter", which are yellow fungus found in the roots of old trees.

reference_spacy_tokens: Dear little people , small , with thin , high - pitched voices , succumb to toadstools and " fairy butter " , which are yellow fungus found in the roots of old trees .


fn_spacy_tokens_for_baseline: Most of China 's few active dissidents have been sentenced to jail or labor camp terms , gone into exile abroad or been harassed into silence .

source_bert_toks: most of china ' s few active di ##ssi ##dents have been sentenced to jail or labor camp terms , gone into exile abroad or been harassed into silence .

reference_raw: Most of China's few active dissidents were sentenced to prison or work camp conditions, exiled abroad, or abused in silence.

reference_spacy_tokens: Most of China 's few active dissidents were sentenced to prison or work camp conditions , exiled abroad , or abused in silence .


fn_spacy_tokens_for_baseline: He had spoken to Paul Guillaume , an ambitious and knowledgeable young dealer , about Modigliani and went to some trouble to arrange an introduction .

source_bert_toks: he had spoken to paul guillaume , an ambitious and knowledge ##able young dealer , about mod ##ig ##lian ##i and went to some trouble to arrange an introduction .

reference_raw: He had spoken of Modigliani with Paul Guillaume, an ambitious and well-known young drug dealer, and had gone to a great deal of trouble to arrange an introduction.

reference_spacy_tokens: He had spoken of Modigliani with Paul Guillaume , an ambitious and well - known young drug dealer , and had gone to a great deal of trouble to arrange an introduction .


fn_spacy_tokens_for_baseline: Mrs Hollidaye adjusted her hat - pin , gathered up the flowers and took Dot 's hand firmly in hers .

source_bert_toks: mrs ho ##lli ##day ##e adjusted her hat - pin , gathered up the flowers and took dot ' s hand firmly in hers .

reference_raw: Mrs. Hollidaye adjusted her hatpin, picked up the flowers, and took Dot's hand firmly in hers.

reference_spacy_tokens: Mrs. Hollidaye adjusted her hatpin , picked up the flowers , and took Dot 's hand firmly in hers .


fn_spacy_tokens_for_baseline: Man is a fairly disgraceful species .

source_bert_toks: man is a fairly disgrace ##ful species .

reference_raw: Man is a rather shameful species.

reference_spacy_tokens: Man is a rather shameful species .


fn_spacy_tokens_for_baseline: Down each arm , from shoulder to sleeve , gleamed those bloody little bells which tinkled every time he moved .

source_bert_toks: down each arm , from shoulder to sleeve , gleamed those bloody little bells which tin ##kled every time he moved .

reference_raw: Down each arm, shoulder to sleeve, gleamed the bloody bells that rang every time he moved.

reference_spacy_tokens: Down each arm , shoulder to sleeve , gleamed the bloody bells that rang every time he moved .


fn_spacy_tokens_for_baseline: The most obvious definition for labouring poets is that it includes all those whose support normally depended on manual work , either their own or that of their families .

source_bert_toks: the most obvious definition for labour ##ing poets is that it includes all those whose support normally depended on manual work , either their own or that of their families .

reference_raw: The clearest concept for working poets is that it includes all those whose support usually depended on manual work, either for themselves or for their families.

reference_spacy_tokens: The clearest concept for working poets is that it includes all those whose support usually depended on manual work , either for themselves or for their families .


fn_spacy_tokens_for_baseline: Around and among them lounged villainous men with pocked faces and broken teeth .

source_bert_toks: around and among them lounge ##d villain ##ous men with po ##cked faces and broken teeth .

reference_raw: Around them and among them were men of scoundrels with pocked faces and broken teeth.

reference_spacy_tokens: Around them and among them were men of scoundrels with pocked faces and broken teeth .


fn_spacy_tokens_for_baseline: However , the IUPAC system relies more heavily on the use of trivial names .

source_bert_toks: however , the i ##up ##ac system relies more heavily on the use of trivial names .

reference_raw: The IUPAC system, however, relies more heavily on the use of banal names.

reference_spacy_tokens: The IUPAC system , however , relies more heavily on the use of banal names .


fn_spacy_tokens_for_baseline: Disciplinary measures are not part of the package -- they will be dealt with separately .

source_bert_toks: disciplinary measures are not part of the package - - they will be dealt with separately .

reference_raw: Discipline measures are not part of the package; they will be dealt with separately.

reference_spacy_tokens: Discipline measures are not part of the package ; they will be dealt with separately .


fn_spacy_tokens_for_baseline: Damn the child for making her so curt with Jane !

source_bert_toks: damn the child for making her so curt with jane !

reference_raw: Damn the baby for making her bow down with Jane!

reference_spacy_tokens: Damn the baby for making her bow down with Jane !


fn_spacy_tokens_for_baseline: AFTER the uplifting win at Shrewsbury the gallant Quakers move out of the bottom four in Division Three and up to chairman Dick Corden 's stated target of fifth bottom .

source_bert_toks: after the up ##lifting win at shrewsbury the gallant quakers move out of the bottom four in division three and up to chairman dick cord ##en ' s stated target of fifth bottom .

reference_raw: After the escalating victory in Shrewsbury, the gallant Quakers move from the bottom four of Division Three to President Dick Corden's declared fifth-bottom target.

reference_spacy_tokens: After the escalating victory in Shrewsbury , the gallant Quakers move from the bottom four of Division Three to President Dick Corden 's declared fifth - bottom target .


fn_spacy_tokens_for_baseline: Needing something light and refreshing to slake a newly parched mouth and throat , she squirted soda from a siphon into a tall glass and added a cluster of ice cubes .

source_bert_toks: needing something light and refreshing to sl ##ake a newly parc ##hed mouth and throat , she sq ##ui ##rted soda from a sip ##hon into a tall glass and added a cluster of ice cube ##s .

reference_raw: She needed something light and fresh to slake her freshly parched mouth and throat, poured soda from the siphon into a tall glass, and added a cluster of ice cubes.

reference_spacy_tokens: She needed something light and fresh to slake her freshly parched mouth and throat , poured soda from the siphon into a tall glass , and added a cluster of ice cubes .


fn_spacy_tokens_for_baseline: Indeed , now she came to think about it , she felt quite thirsty .

source_bert_toks: indeed , now she came to think about it , she felt quite thirsty .

reference_raw: In fact, now that she'd thought about it, she'd felt quite agitated.

reference_spacy_tokens: In fact , now that she 'd thought about it , she 'd felt quite agitated .


fn_spacy_tokens_for_baseline: Samelson ( 1978 ) has documented the growth of interest by social scientists in the topic of ' prejudice ' .

source_bert_toks: same ##lson ( 1978 ) has documented the growth of interest by social scientists in the topic of ' prejudice ' .

reference_raw: Samelson (1978) illustrated the growing interest of social scientists in the "prejudice" theme.

reference_spacy_tokens: Samelson ( 1978 ) illustrated the growing interest of social scientists in the " prejudice " theme .


fn_spacy_tokens_for_baseline: You can try to work out whether it is autobiography or murder mystery and how it works within these genre classifications .

source_bert_toks: you can try to work out whether it is autobiography or murder mystery and how it works within these genre classifications .

reference_raw: You can try to figure out if it's an autobiography or a murder secret, and how it works in these genre classifications.

reference_spacy_tokens: You can try to figure out if it 's an autobiography or a murder secret , and how it works in these genre classifications .


fn_spacy_tokens_for_baseline: Loosened by the heavy rainstorm of the previous day , armchair - sized boulders fell nearly 3,000 feet and crashed into the path , releasing an intense , sulphurous odour .

source_bert_toks: loosened by the heavy rains ##torm of the previous day , armchair - sized boulders fell nearly 3 , 000 feet and crashed into the path , releasing an intense , sul ##ph ##uro ##us o ##dou ##r .

reference_raw: Loosed by the heavy storm of the previous day, chair-sized boulders fell nearly 3,000 feet and crashed into the road, releasing a strong, sulfurous smell.

reference_spacy_tokens: Loosed by the heavy storm of the previous day , chair - sized boulders fell nearly 3,000 feet and crashed into the road , releasing a strong , sulfurous smell .


fn_spacy_tokens_for_baseline: In those days magic in its raw state had been widely available , and had been eagerly utilised by the First Men in their war against the Gods .

source_bert_toks: in those days magic in its raw state had been widely available , and had been eagerly ut ##ilised by the first men in their war against the gods .

reference_raw: In those days, magic in its primitive state was widely available, and the First Men were eager to use it in their war against the gods.

reference_spacy_tokens: In those days , magic in its primitive state was widely available , and the First Men were eager to use it in their war against the gods .


fn_spacy_tokens_for_baseline: Striding away from the house , Carolyn stubbed her toe badly on a brick end and had to sit down to nurse it .

source_bert_toks: st ##riding away from the house , carolyn stu ##bbed her toe badly on a brick end and had to sit down to nurse it .

reference_raw: Carolyn stepped out of the house, jabbed her thumb hard on the brick end, and had to sit down and take care of it.

reference_spacy_tokens: Carolyn stepped out of the house , jabbed her thumb hard on the brick end , and had to sit down and take care of it .


fn_spacy_tokens_for_baseline: Barbarossa 's common soldiers were almost certainly still wearing Norman - style hauberks as late as the Third Crusade .

source_bert_toks: bar ##bar ##ossa ' s common soldiers were almost certainly still wearing norman - style ha ##uber ##ks as late as the third crusade .

reference_raw: Barbarossa's ordinary soldiers were almost certainly wearing a Norman-style hauberk as late as the Third Crusade.

reference_spacy_tokens: Barbarossa 's ordinary soldiers were almost certainly wearing a Norman - style hauberk as late as the Third Crusade .


fn_spacy_tokens_for_baseline: Moreover , some of the riots were incited by local High Church clergy and gentry .

source_bert_toks: moreover , some of the riots were inc ##ited by local high church clergy and gentry .

reference_raw: In addition, some of the riots were provoked by the clergy and gentry of the local High Church.

reference_spacy_tokens: In addition , some of the riots were provoked by the clergy and gentry of the local High Church .


fn_spacy_tokens_for_baseline: ' I win whip you now , ' said he .

source_bert_toks: ' i win whip you now , ' said he .

reference_raw: "Now I'm going to beat you," he said.

reference_spacy_tokens: " Now I 'm going to beat you , " he said .


fn_spacy_tokens_for_baseline: Elizabeth made him come to the farmhouse .

source_bert_toks: elizabeth made him come to the farmhouse .

reference_raw: Elizabeth forced him to come to the farm.

reference_spacy_tokens: Elizabeth forced him to come to the farm .


fn_spacy_tokens_for_baseline: ' Can we explore with him as far as there ! ' they said , pointing their young talons at a clump of dog's - mercury .

source_bert_toks: ' can we explore with him as far as there ! ' they said , pointing their young talon ##s at a cl ##ump of dog ' s - mercury .

reference_raw: 'We can examine it all the way down there!' they said, pointing their young claws at the cluster of dog mercury.

reference_spacy_tokens: ' We can examine it all the way down there ! ' they said , pointing their young claws at the cluster of dog mercury .


fn_spacy_tokens_for_baseline: These ' shaman forests ' were scattered over dry grassland .

source_bert_toks: these ' shaman forests ' were scattered over dry grassland .

reference_raw: These 'shaman forests' were scattered across the dry grass.

reference_spacy_tokens: These ' shaman forests ' were scattered across the dry grass .


fn_spacy_tokens_for_baseline: S. Ambassador to the Ottoman Empire Henry Morganthau protested the bloodletting , he received a telling response from Mehmed Talaat , the interior minister in charge of the anti - Armenian campaign .

source_bert_toks: s . ambassador to the ottoman empire henry morgan ##tha ##u protested the blood ##lett ##ing , he received a telling response from me ##hm ##ed tal ##aa ##t , the interior minister in charge of the anti - armenian campaign .

reference_raw: S. Ambassador to the Ottoman Empire Henry Morganthau objected to bloodletting, and received an eloquent reply from Mehmed Talaat, the Minister of the Interior, who was responsible for the anti-Armenian campaign.

reference_spacy_tokens: S. Ambassador to the Ottoman Empire Henry Morganthau objected to bloodletting , and received an eloquent reply from Mehmed Talaat , the Minister of the Interior , who was responsible for the anti - Armenian campaign .


fn_spacy_tokens_for_baseline: What irked her more than anything else was that Spittals was probably right .

source_bert_toks: what ir ##ked her more than anything else was that spit ##tal ##s was probably right .

reference_raw: More than anything else, what irritated her was that Spittals was probably right.

reference_spacy_tokens: More than anything else , what irritated her was that Spittals was probably right .


fn_spacy_tokens_for_baseline: When he struggled out he espied a happy couple engaged in skinny - dipping in the shelter of an overhanging sycamore and went on his way muttering something like ' without the benefit of suitable drawers ' .

source_bert_toks: when he struggled out he es ##pie ##d a happy couple engaged in skinny - dipping in the shelter of an over ##hang ##ing sy ##cam ##ore and went on his way muttering something like ' without the benefit of suitable drawers ' .

reference_raw: As he struggled to his feet, he spied a happy couple engaged in a skinny dip in the shelter of an overhanging sycamore and continued to mutter something like "without the use of suitable drawers."

reference_spacy_tokens: As he struggled to his feet , he spied a happy couple engaged in a skinny dip in the shelter of an overhanging sycamore and continued to mutter something like " without the use of suitable drawers . "


fn_spacy_tokens_for_baseline: It was n't an amused smile , but it was one that sent her away at a brisk and confident walk towards the house , and with a gratifying sense of being respected and appreciated .

source_bert_toks: it wasn ' t an amused smile , but it was one that sent her away at a brisk and confident walk towards the house , and with a gr ##ati ##fying sense of being respected and appreciated .

reference_raw: It was not an amused smile, but it was the one who sent her away with a quick, confident walk to the house and a grateful sense of respect and appreciation.

reference_spacy_tokens: It was not an amused smile , but it was the one who sent her away with a quick , confident walk to the house and a grateful sense of respect and appreciation .


fn_spacy_tokens_for_baseline: I sat in the cafe as the rain showed no sign of letting up and drew up a short list of people I had met with whom I could air my perplexity .

source_bert_toks: i sat in the cafe as the rain showed no sign of letting up and drew up a short list of people i had met with whom i could air my per ##plex ##ity .

reference_raw: I sat down in the coffee shop while the rain showed no sign that I was going to let go, and drew up a short list of people I'd met who could air my confusion.

reference_spacy_tokens: I sat down in the coffee shop while the rain showed no sign that I was going to let go , and drew up a short list of people I 'd met who could air my confusion .


fn_spacy_tokens_for_baseline: He was eloquent , confident , black - haired , brown - eyed , all that my mother was not .

source_bert_toks: he was el ##o ##quent , confident , black - haired , brown - eyed , all that my mother was not .

reference_raw: He was eloquent, confident, dark-haired, brown-eyed, everything my mother wasn't.

reference_spacy_tokens: He was eloquent , confident , dark - haired , brown - eyed , everything my mother was n't .


fn_spacy_tokens_for_baseline: Velcro , the touch fastener so beloved of outdoor skiing types and their like , is at the centre of a bitter spat between its board and disgruntled shareholders over that vexed question of shareholder value .

source_bert_toks: ve ##lc ##ro , the touch fast ##ener so beloved of outdoor skiing types and their like , is at the centre of a bitter spat between its board and di ##sg ##run ##tled shareholders over that ve ##xed question of shareholder value .

reference_raw: Velcro, the touch fastener so beloved of the outdoor skiing type and the like, is in the midst of a bitter spit between the board of directors and dissatisfied shareholders about this vexed question of shareholder value.

reference_spacy_tokens: Velcro , the touch fastener so beloved of the outdoor skiing type and the like , is in the midst of a bitter spit between the board of directors and dissatisfied shareholders about this vexed question of shareholder value .


fn_spacy_tokens_for_baseline: That wedding between Liz and Owen had proved to be a watershed in all their lives .

source_bert_toks: that wedding between liz and owen had proved to be a watershed in all their lives .

reference_raw: The marriage between Liz and Owen turned out to be a watershed all their lives.

reference_spacy_tokens: The marriage between Liz and Owen turned out to be a watershed all their lives .


fn_spacy_tokens_for_baseline: It stood for a moment , masked face questing , saw us and knew that it had been seen , scurried up the steps and away .

source_bert_toks: it stood for a moment , masked face quest ##ing , saw us and knew that it had been seen , sc ##ur ##ried up the steps and away .

reference_raw: He stood for a moment, his disguised face searching, seeing us, knowing we had seen him, scurrying up the stairs and away.

reference_spacy_tokens: He stood for a moment , his disguised face searching , seeing us , knowing we had seen him , scurrying up the stairs and away .


fn_spacy_tokens_for_baseline: IN YOUR March 18 Viewpoint you cast doubt on the genuineness of the conversion of Anna Moore and Bobby Corry , who have received life sentences for their involvement in terrorist murders .

source_bert_toks: in your march 18 viewpoint you cast doubt on the genuine ##ness of the conversion of anna moore and bobby co ##rry , who have received life sentences for their involvement in terrorist murders .

reference_raw: In March 18, you questioned the reality of the conversion of Anna Moore and Bobby Corry, who were sentenced to life for their involvement in terrorist assassinations.

reference_spacy_tokens: In March 18 , you questioned the reality of the conversion of Anna Moore and Bobby Corry , who were sentenced to life for their involvement in terrorist assassinations .


fn_spacy_tokens_for_baseline: The fact that the bride and groom are usually wedded long before they are bedded is considered the height of wisdom .

source_bert_toks: the fact that the bride and groom are usually wed ##ded long before they are bed ##ded is considered the height of wisdom .

reference_raw: The fact that the bride and groom are usually married long before they go to bed is considered to be the height of wisdom.

reference_spacy_tokens: The fact that the bride and groom are usually married long before they go to bed is considered to be the height of wisdom .


fn_spacy_tokens_for_baseline: The harried men tried to keep order but finally gave up and let us take over .

source_bert_toks: the ha ##rrie ##d men tried to keep order but finally gave up and let us take over .

reference_raw: The haggards tried to keep order, but at last they gave up and let us take over.

reference_spacy_tokens: The haggards tried to keep order , but at last they gave up and let us take over .


fn_spacy_tokens_for_baseline: I saw All in Bristol and , despite a small crowd ( most of whom had come to see the support bands ) and an incompetent sound engineer , they were powerful and intense .

source_bert_toks: i saw all in bristol and , despite a small crowd ( most of whom had come to see the support bands ) and an inc ##omp ##ete ##nt sound engineer , they were powerful and intense .

reference_raw: I could see All in Bristol, and despite the small crowd (most of them came to the support groups) and the incompetence of the sound engineer, they were strong and intense.

reference_spacy_tokens: I could see All in Bristol , and despite the small crowd ( most of them came to the support groups ) and the incompetence of the sound engineer , they were strong and intense .


fn_spacy_tokens_for_baseline: Her problem now is that her body has adapted to her starvation regime by slowing down her metabolism .

source_bert_toks: her problem now is that her body has adapted to her starvation regime by slowing down her metabolism .

reference_raw: Her problem now is that her body has adapted to her hunger regime by slowing down her metabolism.

reference_spacy_tokens: Her problem now is that her body has adapted to her hunger regime by slowing down her metabolism .


fn_spacy_tokens_for_baseline: Nevertheless there are difficulties here which must be confronted if both multicultural and antiracist attempts at the development of alternative curricula and popular cultural forms are to avoid oversimplification and naivety .

source_bert_toks: nevertheless there are difficulties here which must be confronted if both multicultural and anti ##rac ##ist attempts at the development of alternative cu ##rri ##cula and popular cultural forms are to avoid overs ##im ##pl ##ification and naive ##ty .

reference_raw: However, there are difficulties that must be faced if multicultural and anti-racist attempts to develop alternative curricula and popular cultural forms are to avoid oversimplification and naivety.

reference_spacy_tokens: However , there are difficulties that must be faced if multicultural and anti - racist attempts to develop alternative curricula and popular cultural forms are to avoid oversimplification and naivety .


fn_spacy_tokens_for_baseline: And the victims you know the family of these people that have been murdered they just have to have it dragged on for years and years before they ever get any resolution .

source_bert_toks: and the victims you know the family of these people that have been murdered they just have to have it dragged on for years and years before they ever get any resolution .

reference_raw: And the sacrifices you know, the families of those people who were murdered, they just have to drag it out for years and years before they get a resolution.

reference_spacy_tokens: And the sacrifices you know , the families of those people who were murdered , they just have to drag it out for years and years before they get a resolution .


fn_spacy_tokens_for_baseline: The goats were tethered on a patch of grassy ground close to one of the gates .

source_bert_toks: the goats were te ##ther ##ed on a patch of grassy ground close to one of the gates .

reference_raw: The goats were tied to a patch of grassy ground near one of the gates.

reference_spacy_tokens: The goats were tied to a patch of grassy ground near one of the gates .


fn_spacy_tokens_for_baseline: You can work through the open learning material whether or not you are enrolled on the programme .

source_bert_toks: you can work through the open learning material whether or not you are enrolled on the programme .

reference_raw: You can work with open learning material whether you are included in the program or not.

reference_spacy_tokens: You can work with open learning material whether you are included in the program or not .


fn_spacy_tokens_for_baseline: Spittals tugged at the knees of his trousers and began to rub his palms together again , this time more slowly , as if he were rolling a rod of plasticine between them .

source_bert_toks: spit ##tal ##s tugged at the knees of his trousers and began to rub his palms together again , this time more slowly , as if he were rolling a rod of plastic ##ine between them .

reference_raw: Spittals pulled at the knees of his pants and began to rub his hands together again, this time slower, as if he were rolling a stick of plasticine between them.

reference_spacy_tokens: Spittals pulled at the knees of his pants and began to rub his hands together again , this time slower , as if he were rolling a stick of plasticine between them .


fn_spacy_tokens_for_baseline: About half a million Americans live in some 176000 adobe houses , 97 per cent of which are in the four contiguous states of New Mexico , Arizona , Texas and California .

source_bert_toks: about half a million americans live in some 1760 ##00 adobe houses , 97 per cent of which are in the four contiguous states of new mexico , arizona , texas and california .

reference_raw: About half a million Americans live in some 176000 homes, 97 percent of which are located in the four neighbouring states of New Mexico, Arizona, Texas, and California.

reference_spacy_tokens: About half a million Americans live in some 176000 homes , 97 percent of which are located in the four neighbouring states of New Mexico , Arizona , Texas , and California .


fn_spacy_tokens_for_baseline: Mind you , ' she added with a cough of concern , ' the breakdown has brought us closer together than ever .

source_bert_toks: mind you , ' she added with a cough of concern , ' the breakdown has brought us closer together than ever .

reference_raw: Keep an eye on you," she added with a chuckle of concern, "the collapse has brought us closer to each other than ever.

reference_spacy_tokens: Keep an eye on you , " she added with a chuckle of concern , " the collapse has brought us closer to each other than ever .


fn_spacy_tokens_for_baseline: With a disconsolate sigh she stood up , slipped off the towelling robe and threw it over a chair .

source_bert_toks: with a disco ##ns ##olate sigh she stood up , slipped off the towel ##ling robe and threw it over a chair .

reference_raw: With a sigh of displeasure, she rose, slipped off her robe, and tossed it over a chair.

reference_spacy_tokens: With a sigh of displeasure , she rose , slipped off her robe , and tossed it over a chair .


fn_spacy_tokens_for_baseline: Hewitt was co - opted as the replacement for former vice - chairman John Mairs , who recently resigned along with chairman Bert Megarrell .

source_bert_toks: hewitt was co - opted as the replacement for former vice - chairman john mai ##rs , who recently resigned along with chairman bert mega ##rrell .

reference_raw: Hewitt was co-opted to replace former Vice-President John Mairs, who recently resigned with President Bert Megarrell.

reference_spacy_tokens: Hewitt was co - opted to replace former Vice - President John Mairs , who recently resigned with President Bert Megarrell .


fn_spacy_tokens_for_baseline: One mocked the promises of security and stability made by the new prime minister , Ibrahim Jafari , leader of the Islamic Dawa Party , a Shiite group .

source_bert_toks: one mocked the promises of security and stability made by the new prime minister , ibrahim ja ##far ##i , leader of the islamic da ##wa party , a shi ##ite group .

reference_raw: One laughed at the promises of security and stability made by the new Prime Minister, Ibrahim Jafari, leader of the Islamic Dawa Party, a Shiite group.

reference_spacy_tokens: One laughed at the promises of security and stability made by the new Prime Minister , Ibrahim Jafari , leader of the Islamic Dawa Party , a Shiite group .


fn_spacy_tokens_for_baseline: They welcome the chance to belong , to become self - sufficient , to regain their self - esteem and confidence .

source_bert_toks: they welcome the chance to belong , to become self - sufficient , to regain their self - esteem and confidence .

reference_raw: They welcome the opportunity to belong, to become self-sufficient, to regain self-esteem and self-confidence.

reference_spacy_tokens: They welcome the opportunity to belong , to become self - sufficient , to regain self - esteem and self - confidence .


fn_spacy_tokens_for_baseline: Both models are fully compliant with the IBM PC / AT bus architecture which allows inter - operability with many PC specifications .

source_bert_toks: both models are fully compliant with the ibm pc / at bus architecture which allows inter - opera ##bility with many pc specifications .

reference_raw: Both models are fully in line with the IBM PC/AT bus architecture, which allows interoperability with a number of PC specifications.

reference_spacy_tokens: Both models are fully in line with the IBM PC / AT bus architecture , which allows interoperability with a number of PC specifications .


fn_spacy_tokens_for_baseline: Shanker crippled New York City 's school system in the late 1960s with strikes against school decentralization .

source_bert_toks: shan ##ker crippled new york city ' s school system in the late 1960s with strikes against school decent ##ral ##ization .

reference_raw: In the late 1960s, Shanker crippled the school system of New York by attacking school decentralization.

reference_spacy_tokens: In the late 1960s , Shanker crippled the school system of New York by attacking school decentralization .


fn_spacy_tokens_for_baseline: ' All you have to do is stand back and fire your crossbow at those green - skinned devils .

source_bert_toks: ' all you have to do is stand back and fire your crossbow at those green - skinned devils .

reference_raw: All you have to do is stand back and shoot the green-skinned devils with your bow.

reference_spacy_tokens: All you have to do is stand back and shoot the green - skinned devils with your bow .


fn_spacy_tokens_for_baseline: Her gown was almost wet through and water dripped from her long hair to the floor .

source_bert_toks: her gown was almost wet through and water dripped from her long hair to the floor .

reference_raw: Her dress was almost wet and her long hair ran down to the floor.

reference_spacy_tokens: Her dress was almost wet and her long hair ran down to the floor .


fn_spacy_tokens_for_baseline: If he runs the country as well as he ran the campaign we 'll be alright . '

source_bert_toks: if he runs the country as well as he ran the campaign we ' ll be alright . '

reference_raw: If he's in charge of the country as well as he's campaigning, we'll be fine.'

reference_spacy_tokens: If he 's in charge of the country as well as he 's campaigning , we 'll be fine . '


fn_spacy_tokens_for_baseline: He had been so absent - minded of late , so preoccupied with his work , his writing , the morality of being an expert witness .

source_bert_toks: he had been so absent - minded of late , so preoccupied with his work , his writing , the morality of being an expert witness .

reference_raw: He'd been so distracted late, so busy with his work, his writing, the morality of being an expert witness.

reference_spacy_tokens: He 'd been so distracted late , so busy with his work , his writing , the morality of being an expert witness .


fn_spacy_tokens_for_baseline: It can be particularly difficult for family members to accept their own powerlessness in getting others to accept the message that they carry .

source_bert_toks: it can be particularly difficult for family members to accept their own powerless ##ness in getting others to accept the message that they carry .

reference_raw: Family members may find it particularly difficult to accept their own helplessness by forcing others to accept the message they carry.

reference_spacy_tokens: Family members may find it particularly difficult to accept their own helplessness by forcing others to accept the message they carry .


fn_spacy_tokens_for_baseline: I ca n't see that little managerial fumble looking too good to that bunch of number - crunchers Upstairs .

source_bert_toks: i can ' t see that little managerial fumble looking too good to that bunch of number - crunch ##ers upstairs .

reference_raw: I don't see that little managerial screw-up that looks so good on that bunch of number-crunchers Upstairs.

reference_spacy_tokens: I do n't see that little managerial screw - up that looks so good on that bunch of number - crunchers Upstairs .


fn_spacy_tokens_for_baseline: RAWALPINDI , Pakistan President Pervez Musharraf survived the second attempt on his life in 11 days Thursday when two suicide attackers exploded vehicle bombs as his convoy passed , killing at least 14 people .

source_bert_toks: raw ##al ##pin ##di , pakistan president per ##vez mu ##sha ##rra ##f survived the second attempt on his life in 11 days thursday when two suicide attackers exploded vehicle bombs as his convoy passed , killing at least 14 people .

reference_raw: RAWALPINDI, Pakistan's president, Pervez Musharraf, survived the second attempt on his life on Thursday, when two suicide bombers detonated car bombs as his convoy passed, killing at least 14 people.

reference_spacy_tokens: RAWALPINDI , Pakistan 's president , Pervez Musharraf , survived the second attempt on his life on Thursday , when two suicide bombers detonated car bombs as his convoy passed , killing at least 14 people .


fn_spacy_tokens_for_baseline: In November 2000 , as part of a $ 600 million agreement , Libya allegedly acquired the first shipment of a total of 50 North Korean Nodong ballistic missiles , including launch capabilities .

source_bert_toks: in november 2000 , as part of a $ 600 million agreement , libya allegedly acquired the first shipment of a total of 50 north korean nod ##ong ballistic missiles , including launch capabilities .

reference_raw: In November 2000, Libya allegedly acquired the first shipment of 50 North Korean Nodong ballistic missiles, including launch capabilities, under a $600 million contract.

reference_spacy_tokens: In November 2000 , Libya allegedly acquired the first shipment of 50 North Korean Nodong ballistic missiles , including launch capabilities , under a $ 600 million contract .


fn_spacy_tokens_for_baseline: The Army may train law enforcement officials and lend them equipment for use in drug raids .

source_bert_toks: the army may train law enforcement officials and lend them equipment for use in drug raids .

reference_raw: The military can train law enforcement officers and loan them equipment to be used in drug raids.

reference_spacy_tokens: The military can train law enforcement officers and loan them equipment to be used in drug raids .


fn_spacy_tokens_for_baseline: is wondering how the hell she 's going to write a 10-page paper on text messaging ...

source_bert_toks: is wondering how the hell she ' s going to write a 10 - page paper on text messaging . . .

reference_raw: he's wondering how the hell he'll write a 10-page piece of text messages...

reference_spacy_tokens: he 's wondering how the hell he 'll write a 10-page piece of text messages ...


fn_spacy_tokens_for_baseline: The new Conservative government can not profess terrible shock at discovering the truth , blame the last tenants and administer some swift , foul - tasting medicine like devaluation .

source_bert_toks: the new conservative government can not prof ##ess terrible shock at discovering the truth , blame the last tenants and administer some swift , foul - tasting medicine like dev ##al ##uation .

reference_raw: The new conservative government cannot prove a terrible shock when it discovers the truth, blames the last tenants, and administers a quick, foul-tasting drug, such as devaluation.

reference_spacy_tokens: The new conservative government can not prove a terrible shock when it discovers the truth , blames the last tenants , and administers a quick , foul - tasting drug , such as devaluation .


fn_spacy_tokens_for_baseline: This follows a charge of shoplifting of an amount of meat from an Ayr superstore . '

source_bert_toks: this follows a charge of shop ##lifting of an amount of meat from an a ##yr super ##stor ##e . '

reference_raw: That follows the charge of stealing a lot of meat from the Ayr superstore.'

reference_spacy_tokens: That follows the charge of stealing a lot of meat from the Ayr superstore . '


fn_spacy_tokens_for_baseline: Together , the three hunched in the safe zone .

source_bert_toks: together , the three hunched in the safe zone .

reference_raw: The three of them huddled together in a safe zone.

reference_spacy_tokens: The three of them huddled together in a safe zone .


fn_spacy_tokens_for_baseline: Tom sprawled in the armchair , in an open , smock - like shirt , smoking .

source_bert_toks: tom sprawled in the armchair , in an open , sm ##ock - like shirt , smoking .

reference_raw: Tom lay back in his chair, wearing an open, smoky shirt, and smoked.

reference_spacy_tokens: Tom lay back in his chair , wearing an open , smoky shirt , and smoked .


fn_spacy_tokens_for_baseline: You must check that the tablet is actually consumed , rather than simply being left in the bottom of the bowl .

source_bert_toks: you must check that the tablet is actually consumed , rather than simply being left in the bottom of the bowl .

reference_raw: You need to make sure that the tablet is actually swallowed and not simply left at the bottom of the bowl.

reference_spacy_tokens: You need to make sure that the tablet is actually swallowed and not simply left at the bottom of the bowl .


fn_spacy_tokens_for_baseline: Her head - dress was old - fashioned , two veils of pleated lawn falling down either side of her heart - shaped face and fastened under the chin by a bejewelled gorget .

source_bert_toks: her head - dress was old - fashioned , two veil ##s of plea ##ted lawn falling down either side of her heart - shaped face and fastened under the chin by a be ##je ##well ##ed gorge ##t .

reference_raw: Her headdress was old-fashioned, and two veils of pleated grass fell on either side of her heart-shaped face, and she was fastened under her chin by a jeweled gorge.

reference_spacy_tokens: Her headdress was old - fashioned , and two veils of pleated grass fell on either side of her heart - shaped face , and she was fastened under her chin by a jeweled gorge .


fn_spacy_tokens_for_baseline: The lamps , at a total cost of £ 4,000 , were installed by Grampian Regional Council after talks with local police .

source_bert_toks: the lamps , at a total cost of £ ##4 , 000 , were installed by gram ##pia ##n regional council after talks with local police .

reference_raw: The lamps, for a total cost of £4,000, were set up by the Grampian Regional Council after interviews with the local police.

reference_spacy_tokens: The lamps , for a total cost of £ 4,000 , were set up by the Grampian Regional Council after interviews with the local police .


fn_spacy_tokens_for_baseline: Two main factories located in the cities of Kanggye and Sakchu are reportedly tasked with the final preparation , filling , and distribution of CW agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

source_bert_toks: two main factories located in the cities of kang ##gy ##e and sa ##k ##chu are reportedly tasked with the final preparation , filling , and distribution of cw agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

reference_raw: Two major plants located in Kanggye and Sakchu are said to be responsible for the final preparation, filling and distribution of CW agents in artillery shells of 80 mm or more, as well as 240 mm in artillery rockets.

reference_spacy_tokens: Two major plants located in Kanggye and Sakchu are said to be responsible for the final preparation , filling and distribution of CW agents in artillery shells of 80 mm or more , as well as 240 mm in artillery rockets .


fn_spacy_tokens_for_baseline: President Elias Hrawi , Prime Minister Umar Karami and the president of the National Assembly , Hussain al - Hussaini , visited Damascus on Oct. 17 to attend the first session of the Lebanese - Syrian Supreme Council .

source_bert_toks: president elias hr ##aw ##i , prime minister umar kara ##mi and the president of the national assembly , hussain al - hussain ##i , visited damascus on oct . 17 to attend the first session of the lebanese - syrian supreme council .

reference_raw: President Elias Hrawi, President Umar Karami and President of the National Assembly, Hussain al-Hussaini, visited Damascus on October 17 to attend the first meeting of the Lebanese-Syrian Supreme Council.

reference_spacy_tokens: President Elias Hrawi , President Umar Karami and President of the National Assembly , Hussain al - Hussaini , visited Damascus on October 17 to attend the first meeting of the Lebanese - Syrian Supreme Council .


fn_spacy_tokens_for_baseline: It is estimated that Russia has between 735 and 1,365 metric tons ( t ) of weapons grade - equivalent highly enriched uranium ( HEU ) and between 106 and 156 t of military - use plutonium .

source_bert_toks: it is estimated that russia has between 73 ##5 and 1 , 365 metric tons ( t ) of weapons grade - equivalent highly enriched uranium ( he ##u ) and between 106 and 156 t of military - use pluto ##nium .

reference_raw: Russia is estimated to have between 735 and 1,365 tonnes (t) of weapons grade - equivalent high enriched uranium (HEU) and between 106 and 156 tonnes of military - using plutonium.

reference_spacy_tokens: Russia is estimated to have between 735 and 1,365 tonnes ( t ) of weapons grade - equivalent high enriched uranium ( HEU ) and between 106 and 156 tonnes of military - using plutonium .


fn_spacy_tokens_for_baseline: This westernmost part of the Soviet Union used to draw little attention , except from spies .

source_bert_toks: this western ##most part of the soviet union used to draw little attention , except from spies .

reference_raw: The Westmost part of the Soviet Union used to attract little attention except spies.

reference_spacy_tokens: The Westmost part of the Soviet Union used to attract little attention except spies .


fn_spacy_tokens_for_baseline: Whitlock noticed the holster affixed to the guard 's belt , then glanced down at the leashed Doberman sitting obediently beside him .

source_bert_toks: w ##hit ##lock noticed the holster af ##fixed to the guard ' s belt , then glanced down at the leash ##ed do ##berman sitting obe ##die ##ntly beside him .

reference_raw: Whitlock noticed the case on the guard's belt and looked down at the leashed Doberman, who sat obediently beside him.

reference_spacy_tokens: Whitlock noticed the case on the guard 's belt and looked down at the leashed Doberman , who sat obediently beside him .


fn_spacy_tokens_for_baseline: Lydia was evasive , not having a good answer ready .

source_bert_toks: lydia was eva ##sive , not having a good answer ready .

reference_raw: Lydia was avoiding, and she didn't have a good answer.

reference_spacy_tokens: Lydia was avoiding , and she did n't have a good answer .


fn_spacy_tokens_for_baseline: When the final numbers are tallied , sales of new cars and light trucks in the United States in 1990 will almost certainly have fallen by about 500,000 , to 14 m vehicles .

source_bert_toks: when the final numbers are tall ##ied , sales of new cars and light trucks in the united states in 1990 will almost certainly have fallen by about 500 , 000 , to 14 m vehicles .

reference_raw: With the final figures high, sales of new cars and light trucks in the United States in 1990 will almost certainly fall by about 500,000 to 14 million vehicles.

reference_spacy_tokens: With the final figures high , sales of new cars and light trucks in the United States in 1990 will almost certainly fall by about 500,000 to 14 million vehicles .


fn_spacy_tokens_for_baseline: While Anna picked flowers , Ruth observed every detail of the dress and deportment of the people in the square , for she hoped one day to emulate them .

source_bert_toks: while anna picked flowers , ruth observed every detail of the dress and de ##port ##ment of the people in the square , for she hoped one day to em ##ulate them .

reference_raw: While Anna was picking flowers, Ruth watched every detail of the dress and deportation of the people in the plaza, hoping that one day she would imitate them.

reference_spacy_tokens: While Anna was picking flowers , Ruth watched every detail of the dress and deportation of the people in the plaza , hoping that one day she would imitate them .


fn_spacy_tokens_for_baseline: Whether desirable or not , this is a child - care program , not an educational program .

source_bert_toks: whether desirable or not , this is a child - care program , not an educational program .

reference_raw: Desired or not, it's a child-care program, not an education program.

reference_spacy_tokens: Desired or not , it 's a child - care program , not an education program .


fn_spacy_tokens_for_baseline: And she finally ends by saying , ' All I can look forward to now is the toneless drone of the master 's voice and the pendulum swing of his leg over the desk . '

source_bert_toks: and she finally ends by saying , ' all i can look forward to now is the tone ##less drone of the master ' s voice and the pendulum swing of his leg over the desk . '

reference_raw: And at last she said, "All I can look forward to is the toneless hum of the master's voice and the pendulum swing of his foot across the table."

reference_spacy_tokens: And at last she said , " All I can look forward to is the toneless hum of the master 's voice and the pendulum swing of his foot across the table . "