fn_spacy_tokens_for_baseline: Several suicide car bombings have targeted British troops and Iraqi security forces , including two recent attempts to kill a local police chief .

source_bert_toks: several suicide car bombings have targeted british troops and iraqi security forces , including two recent attempts to kill a local police chief .

reference_raw: Several suicide car bombings focused on British soldiers and Iraqi security, including two recent attempts to assassinate a local police chief.

reference_spacy_tokens: Several suicide car bombings focused on British soldiers and Iraqi security , including two recent attempts to assassinate a local police chief .


fn_spacy_tokens_for_baseline: He slurped as noisily as a ravenous dog , mopping up what was left with hard crusts of bread which Father Peter shoved before him on a wooden platter .

source_bert_toks: he sl ##ur ##ped as no ##isi ##ly as a raven ##ous dog , mo ##pping up what was left with hard crust ##s of bread which father peter shoved before him on a wooden platt ##er .

reference_raw: He sipped as loudly as a hungry dog and wiped what was left of him with the hard crusts of bread that Father Peter had pushed in front of him on a wooden tray.

reference_spacy_tokens: He sipped as loudly as a hungry dog and wiped what was left of him with the hard crusts of bread that Father Peter had pushed in front of him on a wooden tray .


fn_spacy_tokens_for_baseline: He fastened his cloak round his shoulders .

source_bert_toks: he fastened his cloak round his shoulders .

reference_raw: He put his cloak around his shoulders.

reference_spacy_tokens: He put his cloak around his shoulders .


fn_spacy_tokens_for_baseline: It has been conjectured that the archers and many of the foot - soldiers who fought at Hastings and feature in the Bayeux Tapestry were fighting in return for pay .

source_bert_toks: it has been conjecture ##d that the archers and many of the foot - soldiers who fought at hastings and feature in the bay ##eux tapestry were fighting in return for pay .

reference_raw: It is assumed that the archers and many of the foot soldiers who fought at Hastings and were part of the Bayeux Tapestry fought in exchange for pay.

reference_spacy_tokens: It is assumed that the archers and many of the foot soldiers who fought at Hastings and were part of the Bayeux Tapestry fought in exchange for pay .


fn_spacy_tokens_for_baseline: But generally it was plain to him that the cause was his familiar and wringing insufficiency .

source_bert_toks: but generally it was plain to him that the cause was his familiar and wr ##inging ins ##uf ##fi ##ciency .

reference_raw: But in general, it was clear to him that the cause was his familiar, wringing incompetence.

reference_spacy_tokens: But in general , it was clear to him that the cause was his familiar , wringing incompetence .


fn_spacy_tokens_for_baseline: " I have been looking forward to her visit for weeks and was very excited when I met her . "

source_bert_toks: " i have been looking forward to her visit for weeks and was very excited when i met her . "

reference_raw: "I've been looking forward to seeing her for weeks, and I was thrilled to see her."

reference_spacy_tokens: " I 've been looking forward to seeing her for weeks , and I was thrilled to see her . "


fn_spacy_tokens_for_baseline: Firstly , as we have earlier shown , old people are not valued in the same way as children ; their suffering does not pull at the public heart - strings so strongly .

source_bert_toks: firstly , as we have earlier shown , old people are not valued in the same way as children ; their suffering does not pull at the public heart - strings so strongly .

reference_raw: First of all, as we have shown above, old people are not appreciated in the same way as children; their suffering is not so strong in the public's heart.

reference_spacy_tokens: First of all , as we have shown above , old people are not appreciated in the same way as children ; their suffering is not so strong in the public 's heart .


fn_spacy_tokens_for_baseline: Place the waterlily leaves around the top of the pond cake , securing on with small pieces of fondant .

source_bert_toks: place the water ##li ##ly leaves around the top of the pond cake , securing on with small pieces of fond ##ant .

reference_raw: Place the water leaves around the top of the pond cake and attach them with little bits of fondant.

reference_spacy_tokens: Place the water leaves around the top of the pond cake and attach them with little bits of fondant .


fn_spacy_tokens_for_baseline: Margaret 's Anita is a trained patisserie chef , who comes in for three days a week to delight people with her delicious home - baked brown bread and scrumptious deserts .

source_bert_toks: margaret ' s anita is a trained pat ##isse ##rie chef , who comes in for three days a week to delight people with her delicious home - baked brown bread and sc ##rum ##pt ##ious deserts .

reference_raw: Margaret's Anita is a well-trained patisserie cook who comes here three days a week to please people with her delicious homemade brown bread and scruffy deserts.

reference_spacy_tokens: Margaret 's Anita is a well - trained patisserie cook who comes here three days a week to please people with her delicious homemade brown bread and scruffy deserts .


fn_spacy_tokens_for_baseline: People in passing cars would turn , amazed , to see this hurrying driven woman , white - faced , hair flying , open - mouthed , panting , arms clenched across her front .

source_bert_toks: people in passing cars would turn , amazed , to see this hurrying driven woman , white - faced , hair flying , open - mouthed , panting , arms clenched across her front .

reference_raw: The people in the passing cars would turn in surprise to see the hurrying woman with the white face, the hair flying, the mouth open, the panting, the arms clasped over her head.

reference_spacy_tokens: The people in the passing cars would turn in surprise to see the hurrying woman with the white face , the hair flying , the mouth open , the panting , the arms clasped over her head .


fn_spacy_tokens_for_baseline: Amid the build - up to the great birthday extravaganza , North Korea watchers have gone on the alert for signs of the president handing over power to Kim Jong Il .

source_bert_toks: amid the build - up to the great birthday extra ##va ##gan ##za , north korea watch ##ers have gone on the alert for signs of the president handing over power to kim jong il .

reference_raw: In the midst of the build-up of the big extravaganza on birthdays, the North Korean observers were on alert for a signal that the President was handing over power to Kim Jong II.

reference_spacy_tokens: In the midst of the build - up of the big extravaganza on birthdays , the North Korean observers were on alert for a signal that the President was handing over power to Kim Jong II .


fn_spacy_tokens_for_baseline: The decision comes as British troops protecting aid convoys face growing dangers in the inter - ethnic war .

source_bert_toks: the decision comes as british troops protecting aid convoys face growing dangers in the inter - ethnic war .

reference_raw: The decision will come as British troops guarding aid convoys face increasing dangers in the inter-ethnic war.

reference_spacy_tokens: The decision will come as British troops guarding aid convoys face increasing dangers in the inter - ethnic war .


fn_spacy_tokens_for_baseline: Where I worked in the university , if a woman came in covered in bruises , no one would say anything , although we all knew what had happened .

source_bert_toks: where i worked in the university , if a woman came in covered in bruises , no one would say anything , although we all knew what had happened .

reference_raw: Where I used to work in college, when a woman came in with bruises, no one would say anything, even though we all knew what had happened.

reference_spacy_tokens: Where I used to work in college , when a woman came in with bruises , no one would say anything , even though we all knew what had happened .


fn_spacy_tokens_for_baseline: He wore a luridly decorated black tracksuit and a broad smile .

source_bert_toks: he wore a lu ##rid ##ly decorated black tracks ##uit and a broad smile .

reference_raw: He was wearing a lurid black track suit and a wide smile.

reference_spacy_tokens: He was wearing a lurid black track suit and a wide smile .


fn_spacy_tokens_for_baseline: Toast the brioche hearts or circles until they are golden brown on both sides .

source_bert_toks: toast the br ##io ##che hearts or circles until they are golden brown on both sides .

reference_raw: Drink the hearts or rings of the brioche until they are golden-brown on either side.

reference_spacy_tokens: Drink the hearts or rings of the brioche until they are golden - brown on either side .


fn_spacy_tokens_for_baseline: He pulled deeply on the cigarette and blew the smoke into Tommy 's face .

source_bert_toks: he pulled deeply on the cigarette and blew the smoke into tommy ' s face .

reference_raw: He took a deep breath of his cigarette and blew it into Tommy's face.

reference_spacy_tokens: He took a deep breath of his cigarette and blew it into Tommy 's face .


fn_spacy_tokens_for_baseline: In charge of the bar a man of scarlet face and furious character roared and insulted in an orgy of camp bonhomie .

source_bert_toks: in charge of the bar a man of scarlet face and furious character roared and insulted in an org ##y of camp bon ##hom ##ie .

reference_raw: In command of the bar, a man with a scarlet face and a ferocious figure roared and bellowed in a camp bonhomie orgy.

reference_spacy_tokens: In command of the bar , a man with a scarlet face and a ferocious figure roared and bellowed in a camp bonhomie orgy .


fn_spacy_tokens_for_baseline: Primaflora had confronted jealous women before ; angry women ; threatening women ; but none with the power of this one .

source_bert_toks: prima ##fl ##ora had confronted jealous women before ; angry women ; threatening women ; but none with the power of this one .

reference_raw: Primaflora had faced jealous women before; angry women; menacing women; but none with the power of this one.

reference_spacy_tokens: Primaflora had faced jealous women before ; angry women ; menacing women ; but none with the power of this one .


fn_spacy_tokens_for_baseline: Let us assume you wish to evacuate the nightclub immediately but put the rest of the hotel on standby as there is a good chance of getting the fire extinguished .

source_bert_toks: let us assume you wish to evacuate the nightclub immediately but put the rest of the hotel on stand ##by as there is a good chance of getting the fire extinguished .

reference_raw: Let's assume that you want to leave the club immediately, but put the rest of the hotel on standby because there's a good chance that the fire will be extinguished.

reference_spacy_tokens: Let 's assume that you want to leave the club immediately , but put the rest of the hotel on standby because there 's a good chance that the fire will be extinguished .


fn_spacy_tokens_for_baseline: She rarely got upset with either of her daughters , but she certainly was now .

source_bert_toks: she rarely got upset with either of her daughters , but she certainly was now .

reference_raw: She seldom got mad at any of her daughters, but she certainly did now.

reference_spacy_tokens: She seldom got mad at any of her daughters , but she certainly did now .


fn_spacy_tokens_for_baseline: Other defensive material purchased by Iran includes respirators from Spain , protective gear from South Korea , and atropine autoinjectors from the Netherlands .

source_bert_toks: other defensive material purchased by iran includes res ##pi ##rator ##s from spain , protective gear from south korea , and at ##rop ##ine auto ##in ##ject ##ors from the netherlands .

reference_raw: Other defense materials purchased by Iran include respirators from Spain, protective equipment from South Korea and auto-injectors from the Netherlands.

reference_spacy_tokens: Other defense materials purchased by Iran include respirators from Spain , protective equipment from South Korea and auto - injectors from the Netherlands .


fn_spacy_tokens_for_baseline: Lightly armed Taliban guerrillas in Afghanistan have bloodied U. S. forces for a decade , but the Libyan rebels have n't dispatched small teams to harass the enemy behind the lines .

source_bert_toks: lightly armed taliban guerrillas in afghanistan have blood ##ied u . s . forces for a decade , but the libyan rebels haven ' t dispatched small teams to hara ##ss the enemy behind the lines .

reference_raw: The slightly armed Taliban guerillas in Afghanistan have been bloody with American troops for ten years, but the Libyan rebels have not sent small teams to harass the enemy behind the line.

reference_spacy_tokens: The slightly armed Taliban guerillas in Afghanistan have been bloody with American troops for ten years , but the Libyan rebels have not sent small teams to harass the enemy behind the line .


fn_spacy_tokens_for_baseline: You can try your luck at pari mutuel betting on jai - alai at pari mutuel , greyhound - racing at the Canidrome ( one of the largest in the world ) , and harness - racing on Taipa .

source_bert_toks: you can try your luck at par ##i mu ##tu ##el betting on jai - ala ##i at par ##i mu ##tu ##el , greyhound - racing at the can ##id ##rom ##e ( one of the largest in the world ) , and harness - racing on tai ##pa .

reference_raw: You can test your luck in Paris Mutuel betting on jai-alai in Paris Mutuel, Greyhound - race in Canidrome (one of the world's largest) and harness - race in Taipa.

reference_spacy_tokens: You can test your luck in Paris Mutuel betting on jai - alai in Paris Mutuel , Greyhound - race in Canidrome ( one of the world 's largest ) and harness - race in Taipa .


fn_spacy_tokens_for_baseline: The IAEA called on Iran to " be proactive in taking all necessary steps on an urgent basis to resolve all outstanding issues " , including those related to contamination by low - enriched uranium ( LEU ) and HEU , as well as the limited production of polonium - 210 and plutonium .

source_bert_toks: the ia ##ea called on iran to " be pro ##active in taking all necessary steps on an urgent basis to resolve all outstanding issues " , including those related to contamination by low - enriched uranium ( le ##u ) and he ##u , as well as the limited production of polo ##nium - 210 and pluto ##nium .

reference_raw: The International Atomic Energy Agency (IAEA) has urged Iran to "actively take all necessary steps to address all outstanding issues" , including those related to low-enriched uranium (LEU) and HEU contamination, as well as limited production of polonium - 210 and plutonium.

reference_spacy_tokens: The International Atomic Energy Agency ( IAEA ) has urged Iran to " actively take all necessary steps to address all outstanding issues " , including those related to low - enriched uranium ( LEU ) and HEU contamination , as well as limited production of polonium - 210 and plutonium .


fn_spacy_tokens_for_baseline: Says he 's had to tie the guy up , gag him and lock him in the coal cellar to keep him quiet .

source_bert_toks: says he ' s had to tie the guy up , gag him and lock him in the coal cellar to keep him quiet .

reference_raw: He said he had to tie him up, gag him, and lock him in a coal basement to keep him quiet.

reference_spacy_tokens: He said he had to tie him up , gag him , and lock him in a coal basement to keep him quiet .


fn_spacy_tokens_for_baseline: He was taken to see General Rush Patterson , the US 7th Army 's intelligence chief who , without any fuss , took Gehlen to see General Eisenhower .

source_bert_toks: he was taken to see general rush patterson , the us 7th army ' s intelligence chief who , without any fuss , took ge ##hl ##en to see general eisenhower .

reference_raw: They took him to General Rush Patterson, the head of intelligence in the United States 7th Army, who, without a fuss, took Gehlen to see General Eisenhower.

reference_spacy_tokens: They took him to General Rush Patterson , the head of intelligence in the United States 7th Army , who , without a fuss , took Gehlen to see General Eisenhower .


fn_spacy_tokens_for_baseline: Because it transpired that Galileo had not mentioned the 1616 prohibition when applying for his license , Urban felt betrayed on several counts .

source_bert_toks: because it trans ##pired that galileo had not mentioned the 161 ##6 prohibition when applying for his license , urban felt betrayed on several counts .

reference_raw: Since it turned out that Galileo did not mention the 1616 ban when applying for a licence, Urban felt betrayed on several occasions.

reference_spacy_tokens: Since it turned out that Galileo did not mention the 1616 ban when applying for a licence , Urban felt betrayed on several occasions .


fn_spacy_tokens_for_baseline: But before he could answer there was a soft slap of footsteps round the colonnade .

source_bert_toks: but before he could answer there was a soft slap of footsteps round the colon ##nad ##e .

reference_raw: Before he could reply, however, there was a soft patter of footfalls around the colonnade.

reference_spacy_tokens: Before he could reply , however , there was a soft patter of footfalls around the colonnade .


fn_spacy_tokens_for_baseline: Accounting texts are silent on this issue .

source_bert_toks: accounting texts are silent on this issue .

reference_raw: The accounting texts do not address this issue.

reference_spacy_tokens: The accounting texts do not address this issue .


fn_spacy_tokens_for_baseline: Sylvester Stallone is cast to type as a 20s Mafioso leader who finds his deathbed promise to his father uncommonly hard to keep .

source_bert_toks: sylvester stall ##one is cast to type as a 20s ma ##fi ##oso leader who finds his death ##bed promise to his father uncommon ##ly hard to keep .

reference_raw: Sylvester Stallone is cast to write as a 20-year-old Mafioso leader who finds his deathbed vows to his father extremely difficult to keep.

reference_spacy_tokens: Sylvester Stallone is cast to write as a 20-year - old Mafioso leader who finds his deathbed vows to his father extremely difficult to keep .


fn_spacy_tokens_for_baseline: It is believed that some vines can live as long as five hundred years although such a plant would yield a negligible crop of grapes .

source_bert_toks: it is believed that some vines can live as long as five hundred years although such a plant would yield a ne ##gli ##gible crop of grapes .

reference_raw: It is believed that some vines may live for up to 500 years, even if such a plant produces a negligible harvest of grapes.

reference_spacy_tokens: It is believed that some vines may live for up to 500 years , even if such a plant produces a negligible harvest of grapes .


fn_spacy_tokens_for_baseline: Open sources reported that the Russian Minister of Atomic Energy confirmed that discussions over supplying Syria with a power plant and a desalination plant were taking place .

source_bert_toks: open sources reported that the russian minister of atomic energy confirmed that discussions over supplying syria with a power plant and a des ##ali ##nation plant were taking place .

reference_raw: Open sources have reported that the Russian Minister for Atomic Energy has acknowledged that discussions are taking place on the supply of the power plant and the desalination plant to Syria.

reference_spacy_tokens: Open sources have reported that the Russian Minister for Atomic Energy has acknowledged that discussions are taking place on the supply of the power plant and the desalination plant to Syria .


fn_spacy_tokens_for_baseline: His restriction of liberty and her impending removal to Portsmouth and the Wrens looked like making their relationship another casualty of war .

source_bert_toks: his restriction of liberty and her impending removal to portsmouth and the wren ##s looked like making their relationship another casualty of war .

reference_raw: His restriction of freedom and her imminent deportation to Portsmouth and the Wrens seemed to make their relationship another victim of war.

reference_spacy_tokens: His restriction of freedom and her imminent deportation to Portsmouth and the Wrens seemed to make their relationship another victim of war .


fn_spacy_tokens_for_baseline: In the warren of lanes and alleys , barefoot traders sit cross - legged in tiny shops crammed with strange goods .

source_bert_toks: in the warren of lanes and alley ##s , barefoot traders sit cross - legged in tiny shops cr ##ammed with strange goods .

reference_raw: In the corridors of streets and alleys, bare-foot merchants sit cross-legged in small shops filled with strange merchandise.

reference_spacy_tokens: In the corridors of streets and alleys , bare - foot merchants sit cross - legged in small shops filled with strange merchandise .


fn_spacy_tokens_for_baseline: Meanwhile , however , he is shacked up with a girlfriend he calls the Monkey , who fulfills his sexual fantasies but leaves him living in fear of tabloid scandal .

source_bert_toks: meanwhile , however , he is shack ##ed up with a girlfriend he calls the monkey , who fulfill ##s his sexual fantasies but leaves him living in fear of tabloid scandal .

reference_raw: But in the meantime, he's shacked up with a friend he calls a monkey, who fulfills his sexual fantasies, but keeps him alive in fear of a tabloid scandal.

reference_spacy_tokens: But in the meantime , he 's shacked up with a friend he calls a monkey , who fulfills his sexual fantasies , but keeps him alive in fear of a tabloid scandal .


fn_spacy_tokens_for_baseline: When he walked into a crowded bar he always found he had at least half the bar to himself .

source_bert_toks: when he walked into a crowded bar he always found he had at least half the bar to himself .

reference_raw: He'd always found that he'd had at least half the bar to himself when he walked into an overcrowded bar.

reference_spacy_tokens: He 'd always found that he 'd had at least half the bar to himself when he walked into an overcrowded bar .


fn_spacy_tokens_for_baseline: He is still guilty because he has violated God 's law .

source_bert_toks: he is still guilty because he has violated god ' s law .

reference_raw: He's still guilty of breaking the law of God.

reference_spacy_tokens: He 's still guilty of breaking the law of God .


fn_spacy_tokens_for_baseline: Twin self supporting light guides can be used to light from an almost infinite variety of angles , and ring lights are available as are focusing lenses .

source_bert_toks: twin self supporting light guides can be used to light from an almost infinite variety of angles , and ring lights are available as are focusing lenses .

reference_raw: The twin self-supporting light guides can be used for lighting from an almost infinite range of angles, and ring lights are available, as are the focus lenses.

reference_spacy_tokens: The twin self - supporting light guides can be used for lighting from an almost infinite range of angles , and ring lights are available , as are the focus lenses .


fn_spacy_tokens_for_baseline: Having set up a certain attitude and a certain power , you must check , by scanning your flight instruments , that the desired performance is being achieved , and also that it is being maintained .

source_bert_toks: having set up a certain attitude and a certain power , you must check , by scanning your flight instruments , that the desired performance is being achieved , and also that it is being maintained .

reference_raw: When you set a certain attitude and power, you need to check, by scanning your flight equipment, that the required performance has been achieved and that it has been maintained.

reference_spacy_tokens: When you set a certain attitude and power , you need to check , by scanning your flight equipment , that the required performance has been achieved and that it has been maintained .


fn_spacy_tokens_for_baseline: The speed of the turning wheel exhilarated him , flying through the wind and darkness with the whole town spread out , illuminated , at his feet .

source_bert_toks: the speed of the turning wheel ex ##hila ##rated him , flying through the wind and darkness with the whole town spread out , illuminated , at his feet .

reference_raw: The speed of the rotating wheel cheered him, and he flew through the wind and darkness with the whole city, illuminated at his feet.

reference_spacy_tokens: The speed of the rotating wheel cheered him , and he flew through the wind and darkness with the whole city , illuminated at his feet .


fn_spacy_tokens_for_baseline: Pages and serving women hastened through it , each of them bearing an item of outdoor clothing .

source_bert_toks: pages and serving women haste ##ned through it , each of them bearing an item of outdoor clothing .

reference_raw: Pages and serving women hurried through it, each carrying an item of outdoor clothing.

reference_spacy_tokens: Pages and serving women hurried through it , each carrying an item of outdoor clothing .


fn_spacy_tokens_for_baseline: DOCTORS are turning to spiritual healers to help cure patients .

source_bert_toks: doctors are turning to spiritual healer ##s to help cure patients .

reference_raw: The DOCTORS are turning to spiritual surgeons to help treat patients.

reference_spacy_tokens: The DOCTORS are turning to spiritual surgeons to help treat patients .


fn_spacy_tokens_for_baseline: He was pacing about the room , pulling at his collar , and eventually he asked Mimi , ' Do they let you into Sardi 's without a tie ? '

source_bert_toks: he was pacing about the room , pulling at his collar , and eventually he asked mimi , ' do they let you into sar ##di ' s without a tie ? '

reference_raw: He paced around the room, tugged at his collar, and finally asked Mimi, "Are you allowed into Sardi's without a tie?"

reference_spacy_tokens: He paced around the room , tugged at his collar , and finally asked Mimi , " Are you allowed into Sardi 's without a tie ? "


fn_spacy_tokens_for_baseline: This means that 1 would buy $ 1.90 by directly exchanging sterling for dollars .

source_bert_toks: this means that 1 would buy $ 1 . 90 by directly exchanging sterling for dollars .

reference_raw: That means 1 would buy $1.90 by replacing sterling directly for dollars.

reference_spacy_tokens: That means 1 would buy $ 1.90 by replacing sterling directly for dollars .


fn_spacy_tokens_for_baseline: Julia was about to descend to the kitchen when the bell pealed again .

source_bert_toks: julia was about to descend to the kitchen when the bell pea ##led again .

reference_raw: Julia was about to descend into the kitchen when the bell rang again.

reference_spacy_tokens: Julia was about to descend into the kitchen when the bell rang again .


fn_spacy_tokens_for_baseline: His progress is assessed on his ability to respond promptly and without feeling to whatever is asked .

source_bert_toks: his progress is assessed on his ability to respond promptly and without feeling to whatever is asked .

reference_raw: His progress is judged on his ability to react quickly and without feeling to what he is asked to do.

reference_spacy_tokens: His progress is judged on his ability to react quickly and without feeling to what he is asked to do .


fn_spacy_tokens_for_baseline: He thought of himself as a bungler .

source_bert_toks: he thought of himself as a bun ##gler .

reference_raw: He thought of himself as a bummer.

reference_spacy_tokens: He thought of himself as a bummer .


fn_spacy_tokens_for_baseline: I 've in fact printed out a short extract from my new book erm which illustrates this , albeit using a computer program , and you can take a copy of that away with you .

source_bert_toks: i ' ve in fact printed out a short extract from my new book er ##m which illustrates this , albeit using a computer program , and you can take a copy of that away with you .

reference_raw: In fact, I've written a short extract from my new book erm that illustrates it, even with a computer program, and you can take a copy with you.

reference_spacy_tokens: In fact , I 've written a short extract from my new book erm that illustrates it , even with a computer program , and you can take a copy with you .


fn_spacy_tokens_for_baseline: Lunda , who had held the office for under 11 months , said he was stepping down ' to allow the head of state to set up an enlarged transitional government ' .

source_bert_toks: lund ##a , who had held the office for under 11 months , said he was stepping down ' to allow the head of state to set up an enlarged transitional government ' .

reference_raw: Lunda, who had been in office for less than 11 months, said he was resigning to allow the head of state to establish an extended transitional government.

reference_spacy_tokens: Lunda , who had been in office for less than 11 months , said he was resigning to allow the head of state to establish an extended transitional government .


fn_spacy_tokens_for_baseline: Perdita and Trace had detested each other on sight and , together with Randy , Trace spent a lot of time when they were n't screwing , winding Perdita up .

source_bert_toks: per ##dit ##a and trace had det ##ested each other on sight and , together with randy , trace spent a lot of time when they weren ' t screwing , winding per ##dit ##a up .

reference_raw: Perdita and Trace hated each other at first sight, and together with Randy, Trace spent a lot of time not messing with Perdita.

reference_spacy_tokens: Perdita and Trace hated each other at first sight , and together with Randy , Trace spent a lot of time not messing with Perdita .


fn_spacy_tokens_for_baseline: When the truck had dumped me and my kit - bag at the Guard Room and I had a chance to look around me , I spied in the middle distance a cluster of substantial looking buildings .

source_bert_toks: when the truck had dumped me and my kit - bag at the guard room and i had a chance to look around me , i sp ##ied in the middle distance a cluster of substantial looking buildings .

reference_raw: When the truck dumped me and my bag in the guard room, and I had a chance to look around, I spied a bunch of large-looking buildings in the middle.

reference_spacy_tokens: When the truck dumped me and my bag in the guard room , and I had a chance to look around , I spied a bunch of large - looking buildings in the middle .


fn_spacy_tokens_for_baseline: Joanna 's startled face jolted Isabel into the realisation that it was she who had spoken , not the reeve .

source_bert_toks: joanna ' s startled face jolted isabel into the real ##isation that it was she who had spoken , not the reeve .

reference_raw: Joanna's startled face made Isabel realize that she was the one who spoke, not the reeve.

reference_spacy_tokens: Joanna 's startled face made Isabel realize that she was the one who spoke , not the reeve .


fn_spacy_tokens_for_baseline: However they did not eat significantly more chocolate or feel greater cravings than eaters who made no secret of their habit .

source_bert_toks: however they did not eat significantly more chocolate or feel greater craving ##s than eater ##s who made no secret of their habit .

reference_raw: But they didn't eat much more barbecue, and they didn't feel more eager than the eaters who didn't hide their habits.

reference_spacy_tokens: But they did n't eat much more barbecue , and they did n't feel more eager than the eaters who did n't hide their habits .


fn_spacy_tokens_for_baseline: The Vietnamese government had been wary of accepting non - volunteers , fearing international ( and principally United States ) condemnation .

source_bert_toks: the vietnamese government had been wary of accepting non - volunteers , fearing international ( and principally united states ) condemnation .

reference_raw: The Vietnamese government was wary of accepting non-volunteers, fearing international (and mainly US) convictions.

reference_spacy_tokens: The Vietnamese government was wary of accepting non - volunteers , fearing international ( and mainly US ) convictions .


fn_spacy_tokens_for_baseline: Sheldukher levelled his laser pistol at Bernice .

source_bert_toks: she ##ld ##uk ##her level ##led his laser pistol at bern ##ice .

reference_raw: Sheldukher aimed the laser gun at Bernice.

reference_spacy_tokens: Sheldukher aimed the laser gun at Bernice .


fn_spacy_tokens_for_baseline: The receiver may explain this harsh treatment by claiming that to go beyond meeting the minimum legal position would jeopardise his whole strategy .

source_bert_toks: the receiver may explain this harsh treatment by claiming that to go beyond meeting the minimum legal position would je ##opa ##rdi ##se his whole strategy .

reference_raw: The receiver can provide explanations for this harsh treatment by claiming that going beyond the minimum legal situation would endanger his entire strategy.

reference_spacy_tokens: The receiver can provide explanations for this harsh treatment by claiming that going beyond the minimum legal situation would endanger his entire strategy .


fn_spacy_tokens_for_baseline: Tread on one of these others and a jet of water squirts up your leg .

source_bert_toks: tread on one of these others and a jet of water sq ##ui ##rts up your leg .

reference_raw: Tread on one of the others, and a stream of water sprays into your leg.

reference_spacy_tokens: Tread on one of the others , and a stream of water sprays into your leg .


fn_spacy_tokens_for_baseline: The cost in the first stage of this unique project is estimated at 200 million dollars .

source_bert_toks: the cost in the first stage of this unique project is estimated at 200 million dollars .

reference_raw: Prices are estimated at $200 million in the first phase of this unique project.

reference_spacy_tokens: Prices are estimated at $ 200 million in the first phase of this unique project .


fn_spacy_tokens_for_baseline: Large clouds of smoke were continuing to pour out of the building , casting a thick pall of smoke over the city skyline .

source_bert_toks: large clouds of smoke were continuing to pour out of the building , casting a thick pal ##l of smoke over the city skyline .

reference_raw: Large clouds of smoke continued to pour from the building, casting a thick cloud of smoke across the city's skyline.

reference_spacy_tokens: Large clouds of smoke continued to pour from the building , casting a thick cloud of smoke across the city 's skyline .


fn_spacy_tokens_for_baseline: ' Christ , you even crawl in your sleep . '

source_bert_toks: ' christ , you even crawl in your sleep . '

reference_raw: "Oh, my God, you're even crawling in your bed."

reference_spacy_tokens: " Oh , my God , you 're even crawling in your bed . "


fn_spacy_tokens_for_baseline: Resolved not to waste further time on account of this childish affair , I contemplated departure via the french windows .

source_bert_toks: resolved not to waste further time on account of this childish affair , i contemplated departure via the french windows .

reference_raw: I decided not to waste any more time on this childish matter, and thought about leaving through French windows.

reference_spacy_tokens: I decided not to waste any more time on this childish matter , and thought about leaving through French windows .


fn_spacy_tokens_for_baseline: They joined up with local environmentalists who were extending a pond at the Victoria Nursing Home , Barton Street .

source_bert_toks: they joined up with local environmental ##ists who were extending a pond at the victoria nursing home , barton street .

reference_raw: They joined the local environmentalists who were expanding the pool at the Victoria Nursing Home on Barton Street.

reference_spacy_tokens: They joined the local environmentalists who were expanding the pool at the Victoria Nursing Home on Barton Street .


fn_spacy_tokens_for_baseline: If you are poor of course , even in Britain , you may care passionately about organic farming , but you probably wo n't be able to afford the vegetables .

source_bert_toks: if you are poor of course , even in britain , you may care passionate ##ly about organic farming , but you probably won ' t be able to afford the vegetables .

reference_raw: If you are poor, of course, even in Britain, you may be passionate about organic agriculture, but you may not be able to afford vegetables.

reference_spacy_tokens: If you are poor , of course , even in Britain , you may be passionate about organic agriculture , but you may not be able to afford vegetables .


fn_spacy_tokens_for_baseline: It was a pity one could not invade without giving advance warnings and following the rules : it would be a pushover .

source_bert_toks: it was a pity one could not invade without giving advance warnings and following the rules : it would be a push ##over .

reference_raw: It was a shame you couldn't attack without giving advance warnings and obeying the rules: it was a pushover.

reference_spacy_tokens: It was a shame you could n't attack without giving advance warnings and obeying the rules : it was a pushover .


fn_spacy_tokens_for_baseline: I was in the avenues , on the third floor of an old building , and except for my heart ( Beat , BEAT ! ) I 'm OK .

source_bert_toks: i was in the avenues , on the third floor of an old building , and except for my heart ( beat , beat ! ) i ' m ok .

reference_raw: I was on the street, on the third level of an old building, and with the exception of my heart (Beat, Beat!) I'm fine.

reference_spacy_tokens: I was on the street , on the third level of an old building , and with the exception of my heart ( Beat , Beat ! ) I 'm fine .


fn_spacy_tokens_for_baseline: Five top players shocked their province by upping sticks and setting sail for Japan .

source_bert_toks: five top players shocked their province by up ##ping sticks and setting sail for japan .

reference_raw: The five best players shook their province with sticks and sailed to Japan.

reference_spacy_tokens: The five best players shook their province with sticks and sailed to Japan .


fn_spacy_tokens_for_baseline: Additionally , I am sending traditional background materials on the Museum and the two latest issues of our Previews Magazine detailing upcoming events , exhibitions , and educational programs .

source_bert_toks: additionally , i am sending traditional background materials on the museum and the two latest issues of our preview ##s magazine detailing upcoming events , exhibitions , and educational programs .

reference_raw: In addition, I'm sending traditional background material to the museum and the two latest editions of our Preview Magazine detailing the upcoming activities, exhibitions, and educational programmes.

reference_spacy_tokens: In addition , I 'm sending traditional background material to the museum and the two latest editions of our Preview Magazine detailing the upcoming activities , exhibitions , and educational programmes .


fn_spacy_tokens_for_baseline: We 've got this rehearsal for this school concert crap .

source_bert_toks: we ' ve got this rehearsal for this school concert crap .

reference_raw: We have a test for this school concert shit.

reference_spacy_tokens: We have a test for this school concert shit .


fn_spacy_tokens_for_baseline: Republican Senator John Cornyn , who leads the India Caucus in the US Senate along with Democratic Senator Hillary Clinton , Friday took the floor to answer Byron Dorgan , a critic of the deal who has vowed to do all to delay if not stop it .

source_bert_toks: republican senator john corn ##yn , who leads the india caucus in the us senate along with democratic senator hillary clinton , friday took the floor to answer byron do ##rgan , a critic of the deal who has vowed to do all to delay if not stop it .

reference_raw: The Republican Senator John Cornyn, who led the Indian Caucus in the United States Senate, together with Democratic Senator Hillary Clinton, took the floor on Friday to answer Byron Dorgan, a critic of the treaty, who swore to do everything he could to hold back if he didn't.

reference_spacy_tokens: The Republican Senator John Cornyn , who led the Indian Caucus in the United States Senate , together with Democratic Senator Hillary Clinton , took the floor on Friday to answer Byron Dorgan , a critic of the treaty , who swore to do everything he could to hold back if he did n't .


fn_spacy_tokens_for_baseline: Several highly publicized clashes between federal authorities and local armed groups have occurred over the past decade , including the confrontation between Randy Weaver and federal marshals at Ruby Ridge , Idaho , on August 21 - 22 , 1992 , during which Weaver 's son and wife were killed ; and the disastrous siege by federal agents of the Branch Davidian compound in Waco , Texas , in April 1993 .

source_bert_toks: several highly publicized clashes between federal authorities and local armed groups have occurred over the past decade , including the confrontation between randy weaver and federal marshal ##s at ruby ridge , idaho , on august 21 - 22 , 1992 , during which weaver ' s son and wife were killed ; and the disastrous siege by federal agents of the branch david ##ian compound in wa ##co , texas , in april 1993 .

reference_raw: Over the last decade, a number of highly publicized confrontations between federal authorities and local armed groups have taken place, including the confrontation between Randy Weaver and the federal marshals at Ruby Ridge, Idaho, on August 21-22, 1992, during which Weaver's boy and wife were killed, and the catastrophic siege of the Branch Davidian compound in Waco, Texas in April 1993.

reference_spacy_tokens: Over the last decade , a number of highly publicized confrontations between federal authorities and local armed groups have taken place , including the confrontation between Randy Weaver and the federal marshals at Ruby Ridge , Idaho , on August 21 - 22 , 1992 , during which Weaver 's boy and wife were killed , and the catastrophic siege of the Branch Davidian compound in Waco , Texas in April 1993 .


fn_spacy_tokens_for_baseline: Local fire departments put the current death toll at at least 37 , nine of which were children .

source_bert_toks: local fire departments put the current death toll at at least 37 , nine of which were children .

reference_raw: The local fire department put the current death toll at least 37, nine of which were kids.

reference_spacy_tokens: The local fire department put the current death toll at least 37 , nine of which were kids .


fn_spacy_tokens_for_baseline: There the presence of the past startled her , not altogether pleasantly .

source_bert_toks: there the presence of the past startled her , not altogether pleasantly .

reference_raw: The presence of the past frightened her, not quite pleasantly.

reference_spacy_tokens: The presence of the past frightened her , not quite pleasantly .


fn_spacy_tokens_for_baseline: She wore jeans and a black leather jacket .

source_bert_toks: she wore jeans and a black leather jacket .

reference_raw: She was wearing jeans and a dark leather jacket.

reference_spacy_tokens: She was wearing jeans and a dark leather jacket .


fn_spacy_tokens_for_baseline: He had knocked over the water jug when he got up from the table .

source_bert_toks: he had knocked over the water jug when he got up from the table .

reference_raw: When he got out of the table, he knocked over a water mug.

reference_spacy_tokens: When he got out of the table , he knocked over a water mug .


fn_spacy_tokens_for_baseline: The state and localities , Chafee said , sometimes get mandated to use federal homeland security funds for decontamination or preparation for bioterrorism , when the money might be better spent putting together a communications systems that would let first responders such as police , fire and rescue from different communities communicate with each other more easily . " ( Pawtucket Times , 21Apr06 , Jim Baron ) ( Link )

source_bert_toks: the state and localities , cha ##fe ##e said , sometimes get mandated to use federal homeland security funds for deco ##nta ##mina ##tion or preparation for bio ##ter ##ror ##ism , when the money might be better spent putting together a communications systems that would let first respond ##ers such as police , fire and rescue from different communities communicate with each other more easily . " ( paw ##tucket times , 21 ##ap ##r ##0 ##6 , jim baron ) ( link )

reference_raw: The state and localities, Chafee said, are sometimes given a mandate to use federal national security funds to decontaminate or prepare for bioterrorism, when money could be better spent putting together a communication device that would make it easier for the first responders, such as police, fire and rescue from various communities to communicate with one another." (Pawtucket Times, 21 April 2006, Jim Baron)

reference_spacy_tokens: The state and localities , Chafee said , are sometimes given a mandate to use federal national security funds to decontaminate or prepare for bioterrorism , when money could be better spent putting together a communication device that would make it easier for the first responders , such as police , fire and rescue from various communities to communicate with one another . " ( Pawtucket Times , 21 April 2006 , Jim Baron )


fn_spacy_tokens_for_baseline: Only 343 cases were diagnosed and reported in 1991 ( provisional data ) in men aged 15 years or over , fewer than in any of the preceding 10 years .

source_bert_toks: only 343 cases were diagnosed and reported in 1991 ( provisional data ) in men aged 15 years or over , fewer than in any of the preceding 10 years .

reference_raw: In 1991, only 343 cases (provisional data) were diagnosed and reported in men over 15 years of age, less than in the previous 10 years.

reference_spacy_tokens: In 1991 , only 343 cases ( provisional data ) were diagnosed and reported in men over 15 years of age , less than in the previous 10 years .


fn_spacy_tokens_for_baseline: Elizabeth Kell , wife of a Unitarian minister in Southampton , and Mrs Hampson of Plymouth were both extensively concerned with work among the poor .

source_bert_toks: elizabeth ke ##ll , wife of a unitarian minister in southampton , and mrs hampson of plymouth were both extensively concerned with work among the poor .

reference_raw: Elizabeth Kell, the wife of the U.S. Secretary of Southampton, and Ms. Hampson of Plymouth, were both very interested in the work of the poor.

reference_spacy_tokens: Elizabeth Kell , the wife of the U.S. Secretary of Southampton , and Ms. Hampson of Plymouth , were both very interested in the work of the poor .


fn_spacy_tokens_for_baseline: Wholesaler - jobber enterprises of the time , such as Field , Leiter and Company in Chicago ( which later became Marshall Field and Company ) , required both a purchasing organization and an extensive traveling sales force to sell to the scattered general stores in smaller cities and country towns .

source_bert_toks: wholesale ##r - job ##ber enterprises of the time , such as field , lei ##ter and company in chicago ( which later became marshall field and company ) , required both a purchasing organization and an extensive traveling sales force to sell to the scattered general stores in smaller cities and country towns .

reference_raw: Wholesaler - labour-intensive businesses of the time, such as Field, Leiter and Company in Chicago (which later became Marshall Field and Company), required both a purchasing organisation and a large travel agency to sell to scattered general shops in small towns and villages.

reference_spacy_tokens: Wholesaler - labour - intensive businesses of the time , such as Field , Leiter and Company in Chicago ( which later became Marshall Field and Company ) , required both a purchasing organisation and a large travel agency to sell to scattered general shops in small towns and villages .


fn_spacy_tokens_for_baseline: Iran was seeking fuel - fabrication technology due to previous supply problems with the safeguarded low enriched uranium fuel shipped from Argentina ( under a previous contract ) for a research reactor supplied by the US in 1967 .

source_bert_toks: iran was seeking fuel - fabrication technology due to previous supply problems with the safeguard ##ed low enriched uranium fuel shipped from argentina ( under a previous contract ) for a research reactor supplied by the us in 1967 .

reference_raw: Iran sought fuel - fabrication technology as a result of previous supply problems with secure, low-enriched uranium fuel delivered from Argentina (under a previous contract) to a research reactor supplied by the United States in 1967.

reference_spacy_tokens: Iran sought fuel - fabrication technology as a result of previous supply problems with secure , low - enriched uranium fuel delivered from Argentina ( under a previous contract ) to a research reactor supplied by the United States in 1967 .


fn_spacy_tokens_for_baseline: Some of the keynames ( like Beep ) can only be set to one of two values , so Beep = yes means that Windows will beep every time there 's an error .

source_bert_toks: some of the key ##name ##s ( like bee ##p ) can only be set to one of two values , so bee ##p = yes means that windows will bee ##p every time there ' s an error .

reference_raw: You can only set some keynames (e.g. "Beep") to one of two values, so "Beep = yes" means "Windows" will pierce each time an error occurs.

reference_spacy_tokens: You can only set some keynames ( e.g. " Beep " ) to one of two values , so " Beep = yes " means " Windows " will pierce each time an error occurs .


fn_spacy_tokens_for_baseline: Perhaps this simply underlines another of Rupert Hall 's points .

source_bert_toks: perhaps this simply under ##lines another of rupert hall ' s points .

reference_raw: Maybe it's just another one of Rupert Hall's points.

reference_spacy_tokens: Maybe it 's just another one of Rupert Hall 's points .


fn_spacy_tokens_for_baseline: There are three donation boxes at the back of the church , just at the top of the steps .

source_bert_toks: there are three donation boxes at the back of the church , just at the top of the steps .

reference_raw: In the back of the church, right on the top of the stairs, there are three gift boxes.

reference_spacy_tokens: In the back of the church , right on the top of the stairs , there are three gift boxes .


fn_spacy_tokens_for_baseline: The Facts Of Life * The 2 most common elements in the universe are hydrogen and stupidity .

source_bert_toks: the facts of life * the 2 most common elements in the universe are hydrogen and stupidity .

reference_raw: The fact of life * The two most frequent elements in the universe are hydrogen and stupidity.

reference_spacy_tokens: The fact of life * The two most frequent elements in the universe are hydrogen and stupidity .


fn_spacy_tokens_for_baseline: Dig deep enough into Cud 's sordid past and you discover many horrible things .

source_bert_toks: dig deep enough into cu ##d ' s so ##rdi ##d past and you discover many horrible things .

reference_raw: You dig deep enough into Cud's terrible history, and you discover a lot of terrible things.

reference_spacy_tokens: You dig deep enough into Cud 's terrible history , and you discover a lot of terrible things .


fn_spacy_tokens_for_baseline: Earlier in the day 's debate , Viscount Whitelaw , former Tory Deputy Prime Minister under Margaret Thatcher , accused treaty opponents of ' taking a narrow - minded view . '

source_bert_toks: earlier in the day ' s debate , viscount white ##law , former tory deputy prime minister under margaret thatcher , accused treaty opponents of ' taking a narrow - minded view . '

reference_raw: Earlier in the day's debate, Viscount Whitelaw, former Deputy Prime Minister of Tory under Margaret Thatcher, accused the treaty adversaries of 'taking a narrow view.'

reference_spacy_tokens: Earlier in the day 's debate , Viscount Whitelaw , former Deputy Prime Minister of Tory under Margaret Thatcher , accused the treaty adversaries of ' taking a narrow view . '


fn_spacy_tokens_for_baseline: In April 2003 , Egyptian customs officials intercepted 22 tons of aluminum tubing from Germany that would likely have been used for a pilot cascade of about 100 - 200 gas centrifuges , which indicates North Korea is probably not yet ready to begin operation of a large - scale plant .

source_bert_toks: in april 2003 , egyptian customs officials intercepted 22 tons of aluminum tub ##ing from germany that would likely have been used for a pilot cascade of about 100 - 200 gas cent ##ri ##fu ##ges , which indicates north korea is probably not yet ready to begin operation of a large - scale plant .

reference_raw: In April 2003, Egyptian customs officials intercepted 22 tonnes of aluminium pipes from Germany, which would probably be used in a pilot cascade of about 100 to 200 gas centrifuges, indicating that North Korea is probably not ready to start operating a large-scale facility.

reference_spacy_tokens: In April 2003 , Egyptian customs officials intercepted 22 tonnes of aluminium pipes from Germany , which would probably be used in a pilot cascade of about 100 to 200 gas centrifuges , indicating that North Korea is probably not ready to start operating a large - scale facility .


fn_spacy_tokens_for_baseline: He had rejoiced in its glossy purplish midsummer beauty which had sheltered the gentle ring - doves that cooed among its branches .

source_bert_toks: he had re ##jo ##ice ##d in its glossy pu ##rp ##lish midsummer beauty which had sheltered the gentle ring - dove ##s that co ##oed among its branches .

reference_raw: He rejoiced in the gleaming purple midsummer beauty that protected the delicate ring-doves that lay between its branches.

reference_spacy_tokens: He rejoiced in the gleaming purple midsummer beauty that protected the delicate ring - doves that lay between its branches .


fn_spacy_tokens_for_baseline: On Nov. 5 it was reported that Israel 's Supreme Court had rejected a petition by Mordechai Vananu to be allowed to clarify events surrounding his detention .

source_bert_toks: on nov . 5 it was reported that israel ' s supreme court had rejected a petition by mor ##de ##chai van ##anu to be allowed to clarify events surrounding his detention .

reference_raw: On November 5, it was reported that the Supreme Court of Israel rejected Mordechai Vanan's request for clarification of the events surrounding his detention.

reference_spacy_tokens: On November 5 , it was reported that the Supreme Court of Israel rejected Mordechai Vanan 's request for clarification of the events surrounding his detention .


fn_spacy_tokens_for_baseline: To these savoury Thai ingredients I would add just one other -- mali or jasmine essence -- to use in rice puddings , in custards or simply in whipped cream for raspberries or strawberries .

source_bert_toks: to these sa ##vo ##ury thai ingredients i would add just one other - - mali or jasmine essence - - to use in rice pudding ##s , in cu ##star ##ds or simply in whipped cream for ras ##p ##berries or straw ##berries .

reference_raw: For these delicious Thai ingredients, I'd only add one more - mali or jasmine essence - to be used in rice puddings, custards, or simply cream for raspberries or strawberries.

reference_spacy_tokens: For these delicious Thai ingredients , I 'd only add one more - mali or jasmine essence - to be used in rice puddings , custards , or simply cream for raspberries or strawberries .


fn_spacy_tokens_for_baseline: In the year 1170 , Sancie , the widow of Count Gaston V of Brn , was sentenced to trial by water here , having given birth to a child rather too long after her husband 's death .

source_bert_toks: in the year 117 ##0 , san ##cie , the widow of count gaston v of br ##n , was sentenced to trial by water here , having given birth to a child rather too long after her husband ' s death .

reference_raw: In 1170, Sancie, the wife of Count Gaston V of Brn, was sentenced to a water trial here because she gave birth to a child very long after her husband's death.

reference_spacy_tokens: In 1170 , Sancie , the wife of Count Gaston V of Brn , was sentenced to a water trial here because she gave birth to a child very long after her husband 's death .


fn_spacy_tokens_for_baseline: If she were to climb up the hillock and semaphore with her flags the signals would be clearly outlined against the sky .

source_bert_toks: if she were to climb up the hill ##ock and se ##ma ##ph ##ore with her flags the signals would be clearly outlined against the sky .

reference_raw: If she climbed up the hill and semaphore with her flags, the signals would be clearly visible in the sky.

reference_spacy_tokens: If she climbed up the hill and semaphore with her flags , the signals would be clearly visible in the sky .


fn_spacy_tokens_for_baseline: The element in the south gallery is sixty inches high , the element in the north gallery is sixty - eight inches high .

source_bert_toks: the element in the south gallery is sixty inches high , the element in the north gallery is sixty - eight inches high .

reference_raw: The element in the south gallery is sixty inches tall, and the element in the north gallery is sixty-eight inches tall.

reference_spacy_tokens: The element in the south gallery is sixty inches tall , and the element in the north gallery is sixty - eight inches tall .


fn_spacy_tokens_for_baseline: The young actress whose steamy love scenes in a major new drama look set to shock television viewers says she may quit showbusiness if parts dry up .

source_bert_toks: the young actress whose steam ##y love scenes in a major new drama look set to shock television viewers says she may quit show ##bus ##iness if parts dry up .

reference_raw: A young actress whose steamy love scenes in a big new drama are set to shock TV viewers says she can stop showing business if the parts dry out.

reference_spacy_tokens: A young actress whose steamy love scenes in a big new drama are set to shock TV viewers says she can stop showing business if the parts dry out .


fn_spacy_tokens_for_baseline: She padded barefoot down the old wooden stairs to the kitchen to boil the kettle for coffee , intending to start stripping yet another wall of its many generations of wallpaper .

source_bert_toks: she padded barefoot down the old wooden stairs to the kitchen to boil the kettle for coffee , intending to start stripping yet another wall of its many generations of wall ##paper .

reference_raw: She walked barefoot down the old wooden steps to the kitchen to make a pot of coffee, intending to start stripping off the next wall of her many generations of wallpaper.

reference_spacy_tokens: She walked barefoot down the old wooden steps to the kitchen to make a pot of coffee , intending to start stripping off the next wall of her many generations of wallpaper .


fn_spacy_tokens_for_baseline: An agreement is to be signed in late 10/92 .

source_bert_toks: an agreement is to be signed in late 10 / 92 .

reference_raw: The Agreement will be signed at the end of 10/92.

reference_spacy_tokens: The Agreement will be signed at the end of 10/92 .


fn_spacy_tokens_for_baseline: The older style of semiotic analysis is replaced by the post - structuralist tradition in which the subject is constructed in terms of a larger discourse , and analysis is devoted to topics such as narrative structure and deconstruction .

source_bert_toks: the older style of semi ##otic analysis is replaced by the post - structural ##ist tradition in which the subject is constructed in terms of a larger discourse , and analysis is devoted to topics such as narrative structure and deco ##nst ##ru ##ction .

reference_raw: The older style of semiotic analysis is superseded by the post-structuralist tradition, where the subject is built on a larger scale, and the analysis is dedicated to topics such as narrative structure and deconstruction.

reference_spacy_tokens: The older style of semiotic analysis is superseded by the post - structuralist tradition , where the subject is built on a larger scale , and the analysis is dedicated to topics such as narrative structure and deconstruction .


fn_spacy_tokens_for_baseline: Queen of Night incense smokelessly exuded a heady perfume into the air .

source_bert_toks: queen of night incense smoke ##lessly ex ##uded a head ##y perfume into the air .

reference_raw: The night-incense queen smoked a heady perfume in the air.

reference_spacy_tokens: The night - incense queen smoked a heady perfume in the air .


fn_spacy_tokens_for_baseline: The Chelsea defender suffered serious ligament damage in his right knee after a sickening first half clash with Liverpool 's Aston Villa - bound striker .

source_bert_toks: the chelsea defender suffered serious ligament damage in his right knee after a sick ##ening first half clash with liverpool ' s aston villa - bound striker .

reference_raw: Chelsea's defender suffered severe ligament damage to his right knee after a nasty first-half collision with Liverpool's Aston Villa striker.

reference_spacy_tokens: Chelsea 's defender suffered severe ligament damage to his right knee after a nasty first - half collision with Liverpool 's Aston Villa striker .


fn_spacy_tokens_for_baseline: They are paid vast amounts of cash , to wear a little sticky label on their shirts ; even getting a hair cut is big money .

source_bert_toks: they are paid vast amounts of cash , to wear a little sticky label on their shirts ; even getting a hair cut is big money .

reference_raw: They're paid a lot of money to wear a sticky sticker on their shirts; even getting a haircut is a lot of money.

reference_spacy_tokens: They 're paid a lot of money to wear a sticky sticker on their shirts ; even getting a haircut is a lot of money .


fn_spacy_tokens_for_baseline: In discussing CBW terrorism , it is important to distinguish between terrorist attacks involving chemical and biological warfare agents , which differ in several ways :

source_bert_toks: in discussing cb ##w terrorism , it is important to distinguish between terrorist attacks involving chemical and biological warfare agents , which differ in several ways :

reference_raw: In the discussion of CBW terrorism, it is important to distinguish between terrorist attacks involving chemical and biological warfare agents, which differ in a number of ways:

reference_spacy_tokens: In the discussion of CBW terrorism , it is important to distinguish between terrorist attacks involving chemical and biological warfare agents , which differ in a number of ways :


fn_spacy_tokens_for_baseline: Even the extremities of her limbs were tingling pleasurably , a subdued kind of electricity running through her entire body .

source_bert_toks: even the ex ##tre ##mit ##ies of her limbs were tingling pleas ##ura ##bly , a subdued kind of electricity running through her entire body .

reference_raw: Even the limbs of her limbs tinkled pleasantly, a subdued kind of electricity running through her body.

reference_spacy_tokens: Even the limbs of her limbs tinkled pleasantly , a subdued kind of electricity running through her body .


fn_spacy_tokens_for_baseline: When he fetched me from hospital after my baby died , we drove home in the dark .

source_bert_toks: when he fetch ##ed me from hospital after my baby died , we drove home in the dark .

reference_raw: When he brought me out of the hospital after my baby died, we drove home in the dark.

reference_spacy_tokens: When he brought me out of the hospital after my baby died , we drove home in the dark .


fn_spacy_tokens_for_baseline: From there , we could see the queen on her terrace

source_bert_toks: from there , we could see the queen on her terrace

reference_raw: From there, we could see her on the terrace.

reference_spacy_tokens: From there , we could see her on the terrace .


fn_spacy_tokens_for_baseline: ' Great excitement was caused in Esher and the neighbouring district when it was learned late last night that an arrest had been effected in connection with the Oxshott murder .

source_bert_toks: ' great excitement was caused in es ##her and the neighbouring district when it was learned late last night that an arrest had been effect ##ed in connection with the ox ##shot ##t murder .

reference_raw: 'There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder.

reference_spacy_tokens: ' There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder .


fn_spacy_tokens_for_baseline: The courts continue to equivocate as to whether the traditional approach should be maintained .

source_bert_toks: the courts continue to e ##qui ##vo ##cate as to whether the traditional approach should be maintained .

reference_raw: The courts continue to question whether the traditional approach should be maintained.

reference_spacy_tokens: The courts continue to question whether the traditional approach should be maintained .


fn_spacy_tokens_for_baseline: These parents may have been disturbed or overwrought , but this does not necessarily mean that they were mistaken about their child 's illness .

source_bert_toks: these parents may have been disturbed or over ##wr ##ough ##t , but this does not necessarily mean that they were mistaken about their child ' s illness .

reference_raw: These parents may be disturbed or overworked, but that does not necessarily mean that they were wrong about the illness of their child.

reference_spacy_tokens: These parents may be disturbed or overworked , but that does not necessarily mean that they were wrong about the illness of their child .


fn_spacy_tokens_for_baseline: It was only a matter of moments before one man twitched his nose at some unfamiliar scent , and turned to see what it was .

source_bert_toks: it was only a matter of moments before one man twitched his nose at some unfamiliar scent , and turned to see what it was .

reference_raw: It was only a matter of seconds before one of the men jerked his nose at an unfamiliar scent and turned to see what it was.

reference_spacy_tokens: It was only a matter of seconds before one of the men jerked his nose at an unfamiliar scent and turned to see what it was .


fn_spacy_tokens_for_baseline: He was thin , dark and sallow , with prominent brown eyes , and he could have passed anywhere as a Lebanese or a Palestinian .

source_bert_toks: he was thin , dark and sal ##low , with prominent brown eyes , and he could have passed anywhere as a lebanese or a palestinian .

reference_raw: He was slender, dark and sallow, with bright brown eyes, and he could walk anywhere like a Lebanese or a Palestinian.

reference_spacy_tokens: He was slender , dark and sallow , with bright brown eyes , and he could walk anywhere like a Lebanese or a Palestinian .


fn_spacy_tokens_for_baseline: It 's tough to avoid the singer getting the lion 's share of mugshots .

source_bert_toks: it ' s tough to avoid the singer getting the lion ' s share of mug ##shot ##s .

reference_raw: It's hard to avoid a singer getting a lion's share of mugshots.

reference_spacy_tokens: It 's hard to avoid a singer getting a lion 's share of mugshots .


fn_spacy_tokens_for_baseline: Her research on Artemesia continued and having her idea for this play excepted by Soho Poly 's Blueprint young writers programme gave her the chance to take the play into its performance phase by Workstage

source_bert_toks: her research on arte ##mes ##ia continued and having her idea for this play except ##ed by soho poly ' s blue ##print young writers programme gave her the chance to take the play into its performance phase by works ##tage

reference_raw: Her research on Artemesia continued, and the fact that she had an idea for this game, with the exception of Soho Poly's blueprint program for young writers, gave her the opportunity to take the game to work stage.

reference_spacy_tokens: Her research on Artemesia continued , and the fact that she had an idea for this game , with the exception of Soho Poly 's blueprint program for young writers , gave her the opportunity to take the game to work stage .


fn_spacy_tokens_for_baseline: " The flames must have been 80 ft ( 25 meters ) in the air , and the road caught fire --- it was flaming up through the concrete , a mass of flames , " hr said .

source_bert_toks: " the flames must have been 80 ##ft ( 25 meters ) in the air , and the road caught fire - - - it was flaming up through the concrete , a mass of flames , " hr said .

reference_raw: "The fire must have been 80 ft (25 meters) in the air, and the road was on fire - it burned through the concrete, a mass of fire," h said.

reference_spacy_tokens: " The fire must have been 80 ft ( 25 meters ) in the air , and the road was on fire - it burned through the concrete , a mass of fire , " h said .


fn_spacy_tokens_for_baseline: ' Hard day at the office , dear ? ' chuckled Robinson as Porter crossed to the sink and began splashing his face with water .

source_bert_toks: ' hard day at the office , dear ? ' chuckled robinson as porter crossed to the sink and began splash ##ing his face with water .

reference_raw: 'Hard day in the office, dear?' said Robinson, as Porter went to the sink and began to splash water on his face.

reference_spacy_tokens: ' Hard day in the office , dear ? ' said Robinson , as Porter went to the sink and began to splash water on his face .


fn_spacy_tokens_for_baseline: In return , the Turks violently put down every insurrection , including the massacre on Chios , when 22,000 people were slaughtered .

source_bert_toks: in return , the turks violently put down every insurrection , including the massacre on chi ##os , when 22 , 000 people were slaughtered .

reference_raw: In return, all the rebels, including the massacre on Chios, were brutally overthrown by the Turkish, when 22,000 people were killed.

reference_spacy_tokens: In return , all the rebels , including the massacre on Chios , were brutally overthrown by the Turkish , when 22,000 people were killed .


fn_spacy_tokens_for_baseline: Not content to blame us for our appalling living conditions and poverty , officials and experts seemed determined to persecute us as well .

source_bert_toks: not content to blame us for our app ##all ##ing living conditions and poverty , officials and experts seemed determined to per ##se ##cute us as well .

reference_raw: Not satisfied with blaming us for our terrible living conditions and poverty, officials and experts seemed determined to pursue us, too.

reference_spacy_tokens: Not satisfied with blaming us for our terrible living conditions and poverty , officials and experts seemed determined to pursue us , too .


fn_spacy_tokens_for_baseline: " He puffed blue smoke towards the ceiling , . we 'll skip lunch at La Motte Farm .

source_bert_toks: " he puff ##ed blue smoke towards the ceiling , . we ' ll skip lunch at la mo ##tte farm .

reference_raw: "He blew blue smoke up to the ceiling, and we're gonna skip lunch at La Motte Farm.

reference_spacy_tokens: " He blew blue smoke up to the ceiling , and we 're gon na skip lunch at La Motte Farm .


fn_spacy_tokens_for_baseline: Many analysts now believe the talks are dead , and in early May 2005 there were reports that Washington and Tokyo were preparing to refer the issue to the UN Security Council .

source_bert_toks: many analysts now believe the talks are dead , and in early may 2005 there were reports that washington and tokyo were preparing to refer the issue to the un security council .

reference_raw: Many analysts now believe that the talks are dead, and at the beginning of May 2005 there were reports that Washington and Tokyo were preparing to refer the matter to the United Nations Security Council.

reference_spacy_tokens: Many analysts now believe that the talks are dead , and at the beginning of May 2005 there were reports that Washington and Tokyo were preparing to refer the matter to the United Nations Security Council .


fn_spacy_tokens_for_baseline: If covert activities had in fact been taking place at this location , these inspections would have significantly jeopardized such efforts .

source_bert_toks: if covert activities had in fact been taking place at this location , these inspections would have significantly je ##opa ##rdi ##zed such efforts .

reference_raw: If secret activities were actually carried out on that site, those inspections would significantly jeopardise those efforts.

reference_spacy_tokens: If secret activities were actually carried out on that site , those inspections would significantly jeopardise those efforts .


fn_spacy_tokens_for_baseline: Everyone got on with the business at hand , preoccupied with the problems of food shortages , lack of funds and compliance with the rules of the Islamic order .

source_bert_toks: everyone got on with the business at hand , preoccupied with the problems of food shortages , lack of funds and compliance with the rules of the islamic order .

reference_raw: They were all busy with the problems of food shortages, lack of resources, and respect for the rules of the Islamic Order.

reference_spacy_tokens: They were all busy with the problems of food shortages , lack of resources , and respect for the rules of the Islamic Order .


fn_spacy_tokens_for_baseline: Barrow disappeared from the doorway and returned a moment later with a length of curtain rope .

source_bert_toks: barrow disappeared from the doorway and returned a moment later with a length of curtain rope .

reference_raw: Barrow disappeared from the doorway and came back a moment later with a string of curtains.

reference_spacy_tokens: Barrow disappeared from the doorway and came back a moment later with a string of curtains .


fn_spacy_tokens_for_baseline: In that community it is not considered a grave fault to ' invent ' , whenever ' a lie is necessary ' .

source_bert_toks: in that community it is not considered a grave fault to ' in ##vent ' , whenever ' a lie is necessary ' .

reference_raw: In this community, "invention" is not considered a serious mistake when it is necessary to lie.

reference_spacy_tokens: In this community , " invention " is not considered a serious mistake when it is necessary to lie .


fn_spacy_tokens_for_baseline: Well , it does n't look too bad , but I 'll have to ground you till you heal up a bit .

source_bert_toks: well , it doesn ' t look too bad , but i ' ll have to ground you till you heal up a bit .

reference_raw: Well, it doesn't look bad, but I'm gonna have to ground you until you get a little better.

reference_spacy_tokens: Well , it does n't look bad , but I 'm gon na have to ground you until you get a little better .


fn_spacy_tokens_for_baseline: The figures have been converted at $ 0.0090497 to the Japanese yen .

source_bert_toks: the figures have been converted at $ 0 . 00 ##90 ##49 ##7 to the japanese yen .

reference_raw: The figures were transferred to Japanese yen for $0.0090497.

reference_spacy_tokens: The figures were transferred to Japanese yen for $ 0.0090497 .


fn_spacy_tokens_for_baseline: She must have galloped through marsh and mire for an hour .

source_bert_toks: she must have gallo ##ped through marsh and mir ##e for an hour .

reference_raw: She had to gallop through the swamp and the mud for an hour.

reference_spacy_tokens: She had to gallop through the swamp and the mud for an hour .


fn_spacy_tokens_for_baseline: His knowledge of airships was at a premium , and his reputation had been enhanced by his patented invention of a carburettor that could burn hydrogen which was otherwise wasted on airship operations .

source_bert_toks: his knowledge of airship ##s was at a premium , and his reputation had been enhanced by his patented invention of a car ##bu ##ret ##tor that could burn hydrogen which was otherwise wasted on airship operations .

reference_raw: His knowledge of airships was rewarding, and his reputation was enhanced by the patented design of a carburetor that could burn hydrogen that would otherwise have been wasted in airship operations.

reference_spacy_tokens: His knowledge of airships was rewarding , and his reputation was enhanced by the patented design of a carburetor that could burn hydrogen that would otherwise have been wasted in airship operations .


fn_spacy_tokens_for_baseline: He grunts and groans with the effort .

source_bert_toks: he grunt ##s and groans with the effort .

reference_raw: With an effort, he growls and moans.

reference_spacy_tokens: With an effort , he growls and moans .


fn_spacy_tokens_for_baseline: It was a supper to celebrate the christening of their new baby .

source_bert_toks: it was a supper to celebrate the christ ##ening of their new baby .

reference_raw: It was dinner to celebrate the baptism of their new child.

reference_spacy_tokens: It was dinner to celebrate the baptism of their new child .


fn_spacy_tokens_for_baseline: He managed a very weak and soporific smile .

source_bert_toks: he managed a very weak and so ##por ##ific smile .

reference_raw: He managed a very weak, sophisticated smile.

reference_spacy_tokens: He managed a very weak , sophisticated smile .


fn_spacy_tokens_for_baseline: Then he slapped Killion hard on the face and took a pace back and kicked him in the groin .

source_bert_toks: then he slapped kill ##ion hard on the face and took a pace back and kicked him in the groin .

reference_raw: Then he slapped Killion hard in the face, took a step back, and punched him in the groin.

reference_spacy_tokens: Then he slapped Killion hard in the face , took a step back , and punched him in the groin .


fn_spacy_tokens_for_baseline: The new puppy is very timid with strangers but now she is old enough to go out for walks , we have found she is growling at other dogs .

source_bert_toks: the new puppy is very tim ##id with strangers but now she is old enough to go out for walks , we have found she is growling at other dogs .

reference_raw: The new puppy is very shy of strangers, but now she's old enough to go for a walk, and we find that she's snarling at other dogs.

reference_spacy_tokens: The new puppy is very shy of strangers , but now she 's old enough to go for a walk , and we find that she 's snarling at other dogs .


fn_spacy_tokens_for_baseline: They could hear the squealing roars of their pursuers over the tumult of their mounts ' hoofs .

source_bert_toks: they could hear the sq ##ue ##aling roar ##s of their pursue ##rs over the tu ##mu ##lt of their mounts ' ho ##of ##s .

reference_raw: Above the rumbling of their horses' hooves, they heard the squealing roar of their chasers.

reference_spacy_tokens: Above the rumbling of their horses ' hooves , they heard the squealing roar of their chasers .


fn_spacy_tokens_for_baseline: Such velocities would occur if gas moved on elliptical streamlines .

source_bert_toks: such ve ##lo ##cit ##ies would occur if gas moved on elliptical stream ##lines .

reference_raw: Such speeds would happen if the gas moved on elliptical streamlines.

reference_spacy_tokens: Such speeds would happen if the gas moved on elliptical streamlines .


fn_spacy_tokens_for_baseline: Apart from carrying enough controlled substances in his G - string to keep Spain happy for a year , Tanit has the divine attribute of being everywhere at once .

source_bert_toks: apart from carrying enough controlled substances in his g - string to keep spain happy for a year , tan ##it has the divine attribute of being everywhere at once .

reference_raw: In addition to carrying enough controlled substances in his G string to keep Spain happy for a year, Tanit has the divine trait of being everywhere at once.

reference_spacy_tokens: In addition to carrying enough controlled substances in his G string to keep Spain happy for a year , Tanit has the divine trait of being everywhere at once .


fn_spacy_tokens_for_baseline: Midway through the next morning a footman and a supercilious lady 's maid arrived to collect her few belongings , so that the last traces of her life with them had gone .

source_bert_toks: midway through the next morning a foot ##man and a super ##ci ##lio ##us lady ' s maid arrived to collect her few belongings , so that the last traces of her life with them had gone .

reference_raw: Midway through the next morning, a footman and a supercilious maid came to pick up a few things, leaving the last traces of her life with them.

reference_spacy_tokens: Midway through the next morning , a footman and a supercilious maid came to pick up a few things , leaving the last traces of her life with them .


fn_spacy_tokens_for_baseline: PINCH TEST : This involves picking up a fold of skin ( on the horse 's neck ) between your forefinger and thumb , lifting it away from the neck , and then releasing it .

source_bert_toks: pinch test : this involves picking up a fold of skin ( on the horse ' s neck ) between your fore ##finger and thumb , lifting it away from the neck , and then releasing it .

reference_raw: PINCH TEST: This includes lifting a fold of skin (on the neck of the horse) between the forefinger and the toe, lifting it from the neck and then releasing it.

reference_spacy_tokens: PINCH TEST : This includes lifting a fold of skin ( on the neck of the horse ) between the forefinger and the toe , lifting it from the neck and then releasing it .


fn_spacy_tokens_for_baseline: " Ringers , she added , are " filled with the solemn intoxication that comes of intricate ritual faultlessly performed .

source_bert_toks: " ring ##ers , she added , are " filled with the solemn into ##xi ##cation that comes of intricate ritual fault ##lessly performed .

reference_raw: "The rings, she added, are full of ceremonial intoxication, which comes from complex rituals performed flawlessly."

reference_spacy_tokens: " The rings , she added , are full of ceremonial intoxication , which comes from complex rituals performed flawlessly . "


fn_spacy_tokens_for_baseline: They sidestepped my anxious questions .

source_bert_toks: they sides ##te ##pped my anxious questions .

reference_raw: They sided with my anxious questions.

reference_spacy_tokens: They sided with my anxious questions .


fn_spacy_tokens_for_baseline: Katy and Jamie got ready very quickly and Mum gave each of them two wee spoons .

source_bert_toks: katy and jamie got ready very quickly and mum gave each of them two wee spoon ##s .

reference_raw: Katy and Jamie were ready very quickly, and Mom handed each of them two spoons of wee.

reference_spacy_tokens: Katy and Jamie were ready very quickly , and Mom handed each of them two spoons of wee .


fn_spacy_tokens_for_baseline: " The problem is the ineptness and incompetence of many of our law enforcers . "

source_bert_toks: " the problem is the in ##ept ##ness and inc ##omp ##ete ##nce of many of our law enforce ##rs . "

reference_raw: "The problem is the incompetence and incompetence of many of our law enforcement officers."

reference_spacy_tokens: " The problem is the incompetence and incompetence of many of our law enforcement officers . "


fn_spacy_tokens_for_baseline: Oil demand will grow by less than 10 % and make up about one - third of consumption in the year 2000 .

source_bert_toks: oil demand will grow by less than 10 % and make up about one - third of consumption in the year 2000 .

reference_raw: The demand for oil will increase by less than 10 % and account for around one third of consumption in 2000.

reference_spacy_tokens: The demand for oil will increase by less than 10 % and account for around one third of consumption in 2000 .


fn_spacy_tokens_for_baseline: ' Some bastard will pay for this ! ' he hissed , the glint of madness in his eyes .

source_bert_toks: ' some bastard will pay for this ! ' he hissed , the glint of madness in his eyes .

reference_raw: "Some bastard is going to pay for it!" he hissed, his eyes gleaming with madness.

reference_spacy_tokens: " Some bastard is going to pay for it ! " he hissed , his eyes gleaming with madness .


fn_spacy_tokens_for_baseline: He 'd come straight from work , and he wore his best bespoke Burton 's suit , a yellow waistcoat with a watch on a chain ( a present from Mum ) , and a striped tie in pink and blue with a knot as fat as a bar of soap .

source_bert_toks: he ' d come straight from work , and he wore his best be ##sp ##oke burton ' s suit , a yellow waist ##coat with a watch on a chain ( a present from mum ) , and a striped tie in pink and blue with a knot as fat as a bar of soap .

reference_raw: He came straight from work, wearing Burton's best bespoke suit, a yellow vest with a watch on a chain (a gift from his mother) and a striped tie in pink and blue with a knot as thick as a bar of soap.

reference_spacy_tokens: He came straight from work , wearing Burton 's best bespoke suit , a yellow vest with a watch on a chain ( a gift from his mother ) and a striped tie in pink and blue with a knot as thick as a bar of soap .


fn_spacy_tokens_for_baseline: It makes even more precise the ability to spot a sick baby .

source_bert_toks: it makes even more precise the ability to spot a sick baby .

reference_raw: That makes it even more accurate to see an ill child.

reference_spacy_tokens: That makes it even more accurate to see an ill child .


fn_spacy_tokens_for_baseline: In the church a carved stone shrine was erected to contain the saint 's relics .

source_bert_toks: in the church a carved stone shrine was erected to contain the saint ' s relics .

reference_raw: In the church, a carved stone sanctum was built to contain the relics of the saint.

reference_spacy_tokens: In the church , a carved stone sanctum was built to contain the relics of the saint .


fn_spacy_tokens_for_baseline: A third approach might be a regional effort on the part of Arab states to pressure Iran to abandon sensitive technology and questionable activities in favor of a weapons - free zone in the Middle East .

source_bert_toks: a third approach might be a regional effort on the part of arab states to pressure iran to abandon sensitive technology and questionable activities in favor of a weapons - free zone in the middle east .

reference_raw: A third approach could be a regional effort by Arab countries to pressure Iran to abandon sensitive technologies and controversial activities in favour of a weapons-free zone in the Middle East.

reference_spacy_tokens: A third approach could be a regional effort by Arab countries to pressure Iran to abandon sensitive technologies and controversial activities in favour of a weapons - free zone in the Middle East .


fn_spacy_tokens_for_baseline: So when sophisticated bombs detonated by long - range cordless phones began blowing up under U. S. and Afghan military vehicles on mountain tracks , investigators knew they had to search elsewhere for the masterminds .

source_bert_toks: so when sophisticated bombs detonated by long - range cord ##less phones began blowing up under u . s . and afghan military vehicles on mountain tracks , investigators knew they had to search elsewhere for the master ##mind ##s .

reference_raw: So when sophisticated bombs detonated by long-range cordless phones began to explode under U.S. and Afghan military vehicles on mountain tracks, investigators knew they had to look elsewhere for geniuses.

reference_spacy_tokens: So when sophisticated bombs detonated by long - range cordless phones began to explode under U.S. and Afghan military vehicles on mountain tracks , investigators knew they had to look elsewhere for geniuses .


fn_spacy_tokens_for_baseline: For tonight and tomorrow night we bring together with New York 's Bill Mays Trio two superb American horn players .

source_bert_toks: for tonight and tomorrow night we bring together with new york ' s bill may ##s trio two superb american horn players .

reference_raw: Today and tomorrow night, we're bringing two great American horn players to New York's Bill Mays Trio.

reference_spacy_tokens: Today and tomorrow night , we 're bringing two great American horn players to New York 's Bill Mays Trio .


fn_spacy_tokens_for_baseline: Arson probe after three die at home

source_bert_toks: arson probe after three die at home

reference_raw: After three deaths in the house, arson drone

reference_spacy_tokens: After three deaths in the house , arson drone


fn_spacy_tokens_for_baseline: He would not confirm whether authorities were searching for another assailant .

source_bert_toks: he would not confirm whether authorities were searching for another ass ##ail ##ant .

reference_raw: He wouldn't confirm if the authorities were looking for another attacker.

reference_spacy_tokens: He would n't confirm if the authorities were looking for another attacker .


fn_spacy_tokens_for_baseline: A shed and its contents were destroyed in a fire in Church Lane , Eston , Middlesbrough , yesterday .

source_bert_toks: a shed and its contents were destroyed in a fire in church lane , est ##on , middlesbrough , yesterday .

reference_raw: The hut and its contents were destroyed yesterday in a fire in Church Lane, Eston, Middlesbrough.

reference_spacy_tokens: The hut and its contents were destroyed yesterday in a fire in Church Lane , Eston , Middlesbrough .


fn_spacy_tokens_for_baseline: The bank , Britain 's sixth biggest , will breach its agreement with staff if it makes workers compulsorily redundant , said BIFU .

source_bert_toks: the bank , britain ' s sixth biggest , will breach its agreement with staff if it makes workers com ##pu ##ls ##ori ##ly redundant , said bi ##fu .

reference_raw: The bank, the sixth largest in the UK, violates its agreement with the employees by compulsorily dismissing workers, said BIFU.

reference_spacy_tokens: The bank , the sixth largest in the UK , violates its agreement with the employees by compulsorily dismissing workers , said BIFU .


fn_spacy_tokens_for_baseline: Once the colour has solidified in the palette you can treat it as normal ' pan ' watercolour : the colour can be lifted off by applying a wet brush .

source_bert_toks: once the colour has solid ##ified in the palette you can treat it as normal ' pan ' water ##col ##our : the colour can be lifted off by applying a wet brush .

reference_raw: Once the colour is solid in the palette, you can treat it as a normal 'pan' water colour: the colour can be removed with a wet brush.

reference_spacy_tokens: Once the colour is solid in the palette , you can treat it as a normal ' pan ' water colour : the colour can be removed with a wet brush .


fn_spacy_tokens_for_baseline: This has become something of a cause celebre in rock press folklore , but in truth the NME had been in worse scrapes before and no doubt has many more ahead .

source_bert_toks: this has become something of a cause ce ##le ##bre in rock press folklore , but in truth the nme had been in worse scrape ##s before and no doubt has many more ahead .

reference_raw: It had become something of a cause for celebrity in the rock press folklore, but in fact, the NME had been in worse scratches before, and there was no doubt much more to go.

reference_spacy_tokens: It had become something of a cause for celebrity in the rock press folklore , but in fact , the NME had been in worse scratches before , and there was no doubt much more to go .


fn_spacy_tokens_for_baseline: I used to ride one of Hans Andersen 's less successful descendants .

source_bert_toks: i used to ride one of hans andersen ' s less successful descendants .

reference_raw: I was riding one of Hans Andersen's less successful offspring.

reference_spacy_tokens: I was riding one of Hans Andersen 's less successful offspring .


fn_spacy_tokens_for_baseline: INVESTORS are convinced that the Bank of Japan will soon be forced to lower interest rates sharply .

source_bert_toks: investors are convinced that the bank of japan will soon be forced to lower interest rates sharply .

reference_raw: INVESTORS believes that the Bank of Japan will soon be forced to cut interest rates sharply.

reference_spacy_tokens: INVESTORS believes that the Bank of Japan will soon be forced to cut interest rates sharply .


fn_spacy_tokens_for_baseline: President Clinton and Blair will stand together on arresting the terrorists suspected of blowing up Pan Am flight 103 over Scotland .

source_bert_toks: president clinton and blair will stand together on arresting the terrorists suspected of blowing up pan am flight 103 over scotland .

reference_raw: President Clinton and Blair will stand together for the capture of terrorists suspected of blowing up Pan Am Flight 103 over Scotland.

reference_spacy_tokens: President Clinton and Blair will stand together for the capture of terrorists suspected of blowing up Pan Am Flight 103 over Scotland .


fn_spacy_tokens_for_baseline: She says children can get it from a very tiny age and if you think of a child starting its every day , not even able to move its own limbs freely .

source_bert_toks: she says children can get it from a very tiny age and if you think of a child starting its every day , not even able to move its own limbs freely .

reference_raw: He says kids can get it from a very small age, and when you think about a kid starting it every day, he can't even move his legs.

reference_spacy_tokens: He says kids can get it from a very small age , and when you think about a kid starting it every day , he ca n't even move his legs .


fn_spacy_tokens_for_baseline: A scientist who had the temerity to ask at Philadelphia for one was severely reproved .

source_bert_toks: a scientist who had the te ##mer ##ity to ask at philadelphia for one was severely rep ##roved .

reference_raw: A scientist who had the temerity to ask for one in Philadelphia had been severely reproached.

reference_spacy_tokens: A scientist who had the temerity to ask for one in Philadelphia had been severely reproached .


fn_spacy_tokens_for_baseline: She gave a cackle .

source_bert_toks: she gave a ca ##ckle .

reference_raw: She chuckled.

reference_spacy_tokens: She chuckled .


fn_spacy_tokens_for_baseline: She was the daughter of an old friend of his , who had married a Welsh lady and settled in Caernarvon .

source_bert_toks: she was the daughter of an old friend of his , who had married a welsh lady and settled in ca ##ern ##ar ##von .

reference_raw: She was his old friend's daughter, who married a Welsh woman and settled in Caernarvon.

reference_spacy_tokens: She was his old friend 's daughter , who married a Welsh woman and settled in Caernarvon .


fn_spacy_tokens_for_baseline: All empires are unscrupulous .

source_bert_toks: all empires are un ##sc ##rup ##ulous .

reference_raw: All empires are ruthless.

reference_spacy_tokens: All empires are ruthless .


fn_spacy_tokens_for_baseline: It was mentioned earlier that one must distinguish between economic efficiency and cost - cutting .

source_bert_toks: it was mentioned earlier that one must distinguish between economic efficiency and cost - cutting .

reference_raw: It has already been stated that a distinction must be drawn between economic efficiency and cost reduction.

reference_spacy_tokens: It has already been stated that a distinction must be drawn between economic efficiency and cost reduction .


fn_spacy_tokens_for_baseline: The general feeling was of mildly pleasurable excitement .

source_bert_toks: the general feeling was of mildly pleas ##urable excitement .

reference_raw: The general feeling was mildly pleasant.

reference_spacy_tokens: The general feeling was mildly pleasant .


fn_spacy_tokens_for_baseline: More than 25,000 people live here , mostly by fishing , but there are also ex - pats , attracted by its laid - back Mediterranean ambience .

source_bert_toks: more than 25 , 000 people live here , mostly by fishing , but there are also ex - pat ##s , attracted by its laid - back mediterranean am ##bie ##nce .

reference_raw: There are over 25,000 people living here, mostly fishing, but there are ex-pats who are drawn to the poor Mediterranean ambience.

reference_spacy_tokens: There are over 25,000 people living here , mostly fishing , but there are ex - pats who are drawn to the poor Mediterranean ambience .


fn_spacy_tokens_for_baseline: G. M. Young suggested that he wavered before coming to his courageous decision not to resign at once .

source_bert_toks: g . m . young suggested that he wave ##red before coming to his courageous decision not to resign at once .

reference_raw: G.M. Young suggested that he hesitated before making a bold decision not to resign immediately.

reference_spacy_tokens: G.M. Young suggested that he hesitated before making a bold decision not to resign immediately .


fn_spacy_tokens_for_baseline: Then , in the eighties , there was the overthrow of the military , and the joyful return to democracy .

source_bert_toks: then , in the eighties , there was the overthrow of the military , and the joy ##ful return to democracy .

reference_raw: Then, in the '80s, an army was overthrown and a happy return to democracy.

reference_spacy_tokens: Then , in the ' 80s , an army was overthrown and a happy return to democracy .


fn_spacy_tokens_for_baseline: Many doctors and their patients reject conventional anticancer chemotherapy for disseminated colorectal cancer in favour of unproved alternatives because of uncertainty about therapeutic gain and concern about toxic effects .

source_bert_toks: many doctors and their patients reject conventional anti ##can ##cer chemotherapy for di ##sse ##minated color ##ect ##al cancer in favour of un ##pro ##ved alternatives because of uncertainty about therapeutic gain and concern about toxic effects .

reference_raw: Many doctors and patients reject conventional cancer chemotherapy for disseminated colorectal cancer in favour of unproven alternatives due to concerns about therapeutic benefit and toxic effects.

reference_spacy_tokens: Many doctors and patients reject conventional cancer chemotherapy for disseminated colorectal cancer in favour of unproven alternatives due to concerns about therapeutic benefit and toxic effects .


fn_spacy_tokens_for_baseline: Even one of those items would have put a heavy stress on a new , fragile relationship .

source_bert_toks: even one of those items would have put a heavy stress on a new , fragile relationship .

reference_raw: Even one of these things would put a lot of pressure on a new, frail relationship.

reference_spacy_tokens: Even one of these things would put a lot of pressure on a new , frail relationship .


fn_spacy_tokens_for_baseline: There was a sentry in a steel helmet at the door .

source_bert_toks: there was a sent ##ry in a steel helmet at the door .

reference_raw: A guard in a steel helm stood in the doorway.

reference_spacy_tokens: A guard in a steel helm stood in the doorway .