fn_spacy_tokens_for_baseline: Even though they were poor they still had their pride .

source_bert_toks: even though they were poor they still had their pride .

reference_raw: Even if they were poor, they were still proud.

reference_spacy_tokens: Even if they were poor , they were still proud .


fn_spacy_tokens_for_baseline: It was pleasant to take a hot drink up to her room and have it beside her as she sat in her silent room reading in the empty house in the afternoons .

source_bert_toks: it was pleasant to take a hot drink up to her room and have it beside her as she sat in her silent room reading in the empty house in the afternoons .

reference_raw: It was nice to have a hot drink in her room and have it next to her while she sat in her quiet room and read in the empty house in the afternoon.

reference_spacy_tokens: It was nice to have a hot drink in her room and have it next to her while she sat in her quiet room and read in the empty house in the afternoon .


fn_spacy_tokens_for_baseline: When they reached their favourite bathing spot in the burn below the house they began the slow decent of the steep bank .

source_bert_toks: when they reached their favourite bathing spot in the burn below the house they began the slow decent of the steep bank .

reference_raw: When they reached their favorite place of bathing in the fire beneath the house, they began the slow decency of the steep bank.

reference_spacy_tokens: When they reached their favorite place of bathing in the fire beneath the house , they began the slow decency of the steep bank .


fn_spacy_tokens_for_baseline: ' Thanks , ' he muttered , still wary of his rescuer 's reaction .

source_bert_toks: ' thanks , ' he muttered , still wary of his rescue ##r ' s reaction .

reference_raw: "Thank you," he murmured, still wary of the rescuer's reaction.

reference_spacy_tokens: " Thank you , " he murmured , still wary of the rescuer 's reaction .


fn_spacy_tokens_for_baseline: Certainly no generalisation can be made except that the successful diffusion of the knowledge of soil conserving practices is often one essential change that is required -- even although the knowledge may be possessed by some cultivators already .

source_bert_toks: certainly no general ##isation can be made except that the successful diffusion of the knowledge of soil con ##ser ##ving practices is often one essential change that is required - - even although the knowledge may be possessed by some cult ##iva ##tors already .

reference_raw: Of course, there is no generalisation other than the fact that a successful dissemination of knowledge of soil conservation practices is often one of the necessary changes - even though it may already be available to some growers.

reference_spacy_tokens: Of course , there is no generalisation other than the fact that a successful dissemination of knowledge of soil conservation practices is often one of the necessary changes - even though it may already be available to some growers .


fn_spacy_tokens_for_baseline: The completely captivating moment when all worldly concerns evaporate .

source_bert_toks: the completely capt ##ivating moment when all world ##ly concerns eva ##por ##ate .

reference_raw: It's a perfectly fascinating moment when all of the world's concerns evaporate.

reference_spacy_tokens: It 's a perfectly fascinating moment when all of the world 's concerns evaporate .


fn_spacy_tokens_for_baseline: As the Pack watched , the plane circled lower in wide sweeps .

source_bert_toks: as the pack watched , the plane circled lower in wide sweeps .

reference_raw: As the pack watched, the plane went down in broad sweeps.

reference_spacy_tokens: As the pack watched , the plane went down in broad sweeps .


fn_spacy_tokens_for_baseline: Azhag 's career of carnage began when he was chieftain of a small Orc tribe from the Troll country .

source_bert_toks: az ##ha ##g ' s career of carnage began when he was chieftain of a small or ##c tribe from the troll country .

reference_raw: Azhag's career in bloodshed began when he was chief of a small tribe of goblins from the land of the Trolls.

reference_spacy_tokens: Azhag 's career in bloodshed began when he was chief of a small tribe of goblins from the land of the Trolls .


fn_spacy_tokens_for_baseline: They smiled as I hammed up my exhaustion , then carried on effortlessly climbing .

source_bert_toks: they smiled as i ham ##med up my exhaustion , then carried on effortlessly climbing .

reference_raw: They smiled as I fought my fatigue and continued to climb effortlessly.

reference_spacy_tokens: They smiled as I fought my fatigue and continued to climb effortlessly .


fn_spacy_tokens_for_baseline: She began to pout , drawing her bottom lip over those small protruding teeth .

source_bert_toks: she began to po ##ut , drawing her bottom lip over those small protruding teeth .

reference_raw: She began to pout, drawing her lower lip over the tiny protruding teeth.

reference_spacy_tokens: She began to pout , drawing her lower lip over the tiny protruding teeth .


fn_spacy_tokens_for_baseline: Secondly , I 'd make the land around the barn blend and unify with the surrounding area ; it would merge with and reinforce the horizon beyond -- harmonise rather than stick out like a sore thumb . '

source_bert_toks: secondly , i ' d make the land around the barn blend and un ##ify with the surrounding area ; it would merge with and reinforce the horizon beyond - - harmon ##ise rather than stick out like a sore thumb . '

reference_raw: Second, I would force the land around the barn to blend in and unite with the surrounding area; it would merge and strengthen the horizon beyond-harmonize rather than stick out like a sore thumb.'

reference_spacy_tokens: Second , I would force the land around the barn to blend in and unite with the surrounding area ; it would merge and strengthen the horizon beyond - harmonize rather than stick out like a sore thumb . '


fn_spacy_tokens_for_baseline: Money showered through the yellow air .

source_bert_toks: money showered through the yellow air .

reference_raw: The money was in the yellow air.

reference_spacy_tokens: The money was in the yellow air .


fn_spacy_tokens_for_baseline: He was n't the least bit fashionable , but he certainly had style , the way he shuffled around in sneakers and sweatshirts , hair pointing in all directions , corduroy trousers rumpled and baggy .

source_bert_toks: he wasn ' t the least bit fashionable , but he certainly had style , the way he shuffled around in sneakers and sweatshirt ##s , hair pointing in all directions , cord ##uro ##y trousers rum ##pled and bag ##gy .

reference_raw: He was not at all fashionable, but he certainly had style, the way he shuffled around in his sneakers and sweaters, his hair pointed in every direction, his corduroy pants rumpled and his baggy.

reference_spacy_tokens: He was not at all fashionable , but he certainly had style , the way he shuffled around in his sneakers and sweaters , his hair pointed in every direction , his corduroy pants rumpled and his baggy .


fn_spacy_tokens_for_baseline: Russert offered the clip as an omen of the " curse " that would strike John Kennedy 30 years later .

source_bert_toks: russ ##ert offered the clip as an om ##en of the " curse " that would strike john kennedy 30 years later .

reference_raw: Russert offered the clip as a sign of a curse that would hit John Kennedy 30 years later.

reference_spacy_tokens: Russert offered the clip as a sign of a curse that would hit John Kennedy 30 years later .


fn_spacy_tokens_for_baseline: The same power has been used to control potentially unruly crowds going to football matches , and to turn back would - be picketing miners at some distance from the scene where they wished to express their displeasure .

source_bert_toks: the same power has been used to control potentially un ##ru ##ly crowds going to football matches , and to turn back would - be picket ##ing miners at some distance from the scene where they wished to express their displeasure .

reference_raw: The same power was used to control potentially unruly crowds going to football games, and to turn back the would-be miners at a distance from the scene where they wanted to express their dissatisfaction.

reference_spacy_tokens: The same power was used to control potentially unruly crowds going to football games , and to turn back the would - be miners at a distance from the scene where they wanted to express their dissatisfaction .


fn_spacy_tokens_for_baseline: For many of you , giving a talk may be a nerve - wracking experience and yet you talk to people quite naturally every day of your life .

source_bert_toks: for many of you , giving a talk may be a nerve - wr ##ack ##ing experience and yet you talk to people quite naturally every day of your life .

reference_raw: For many of you, talking can be a nervous experience, but you talk to people quite naturally every day of your life.

reference_spacy_tokens: For many of you , talking can be a nervous experience , but you talk to people quite naturally every day of your life .


fn_spacy_tokens_for_baseline: Analysis of GAG release throughout these experiments suggested that , within the range of sensitivity provided by our dimethylmethylene blue assay , GAG release patterns were unaffected by removal from incubation at 37 ° C to room temperature for 3 - 6 hours of imaging each week ( because all the plugs were out of the incubator for the imaging session ) .

source_bert_toks: analysis of gag release throughout these experiments suggested that , within the range of sensitivity provided by our dime ##thy ##lm ##eth ##yle ##ne blue ass ##ay , gag release patterns were unaffected by removal from inc ##uba ##tion at 37 ##° ##c to room temperature for 3 - 6 hours of imaging each week ( because all the plug ##s were out of the inc ##uba ##tor for the imaging session ) .

reference_raw: The analysis of the release of the GAG during these experiments indicated that within the range of sensitivity provided by our dimethylene blue test, the release patterns of the GAG were not affected by the removal from incubation at 37°C to room temperature for 3-6 hours of imaging each week (since all plugs had been removed from the incubator for the imaging session).

reference_spacy_tokens: The analysis of the release of the GAG during these experiments indicated that within the range of sensitivity provided by our dimethylene blue test , the release patterns of the GAG were not affected by the removal from incubation at 37 ° C to room temperature for 3 - 6 hours of imaging each week ( since all plugs had been removed from the incubator for the imaging session ) .


fn_spacy_tokens_for_baseline: ' I think I understand . '

source_bert_toks: ' i think i understand . '

reference_raw: "I think I get it."

reference_spacy_tokens: " I think I get it . "


fn_spacy_tokens_for_baseline: Would you recommend cladding an exterior wall below a bay window with tiles ?

source_bert_toks: would you recommend clad ##ding an exterior wall below a bay window with tiles ?

reference_raw: Would you recommend that the outer wall be covered with tiles under the bay window?

reference_spacy_tokens: Would you recommend that the outer wall be covered with tiles under the bay window ?


fn_spacy_tokens_for_baseline: He growled something about my septic technique . '

source_bert_toks: he growled something about my sept ##ic technique . '

reference_raw: He snarled at my septic technique.'

reference_spacy_tokens: He snarled at my septic technique . '


fn_spacy_tokens_for_baseline: She struck him hard across the left cheek with the flat of her hand .

source_bert_toks: she struck him hard across the left cheek with the flat of her hand .

reference_raw: The flat of her hand hit him hard on the left cheek.

reference_spacy_tokens: The flat of her hand hit him hard on the left cheek .


fn_spacy_tokens_for_baseline: She stopped next to him but he ignored her and kept on walking .

source_bert_toks: she stopped next to him but he ignored her and kept on walking .

reference_raw: She paused beside him, but he ignored her and walked on.

reference_spacy_tokens: She paused beside him , but he ignored her and walked on .


fn_spacy_tokens_for_baseline: THE debate about how BBC Television covers the arts enters a new phase tonight when BBC2 launches a new show deliberately intended as a rival to The Late Show and its laid - back coterie of cultural commentators .

source_bert_toks: the debate about how bbc television covers the arts enters a new phase tonight when bbc ##2 launches a new show deliberately intended as a rival to the late show and its laid - back cote ##rie of cultural commentators .

reference_raw: The debate on how BBC TV covers the arts is entering a new phase today when the BBC2 launches a new show deliberately intended to compete with the Late Show and its laid-back cotery of cultural commentators.

reference_spacy_tokens: The debate on how BBC TV covers the arts is entering a new phase today when the BBC2 launches a new show deliberately intended to compete with the Late Show and its laid - back cotery of cultural commentators .


fn_spacy_tokens_for_baseline: Once more she saw the attractive man she had noticed in the High Street , and her colour rose as she recalled how she had hoped to meet him some day .

source_bert_toks: once more she saw the attractive man she had noticed in the high street , and her colour rose as she recalled how she had hoped to meet him some day .

reference_raw: She saw again the attractive man she had seen on the High Street, and her color rose as she remembered how she had hoped to meet him one day.

reference_spacy_tokens: She saw again the attractive man she had seen on the High Street , and her color rose as she remembered how she had hoped to meet him one day .


fn_spacy_tokens_for_baseline: The tormenting life of the desert was over for him and his family .

source_bert_toks: the torment ##ing life of the desert was over for him and his family .

reference_raw: For him and his family, the tortured life in the desert was over.

reference_spacy_tokens: For him and his family , the tortured life in the desert was over .


fn_spacy_tokens_for_baseline: After five years of easy credit , the Fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

source_bert_toks: after five years of easy credit , the fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

reference_raw: After five years of easy credit, the Fed has reversed its course, leaving no doubt that it is committed to fighting inflation in an economy that has finally begun to gain momentum.

reference_spacy_tokens: After five years of easy credit , the Fed has reversed its course , leaving no doubt that it is committed to fighting inflation in an economy that has finally begun to gain momentum .


fn_spacy_tokens_for_baseline: Swallowing convulsively , she rubbed vigorously at her face and hair with a large bath towel until her skin burned .

source_bert_toks: swallowing con ##vu ##ls ##ively , she rubbed vigorously at her face and hair with a large bath towel until her skin burned .

reference_raw: She swallowed convulsively and rubbed her face and hair vigorously with a large bath towel until her skin was on fire.

reference_spacy_tokens: She swallowed convulsively and rubbed her face and hair vigorously with a large bath towel until her skin was on fire .


fn_spacy_tokens_for_baseline: Although the size variation puts them in slightly different markets , they are practical family cars that are easy to drive and fun , too .

source_bert_toks: although the size variation puts them in slightly different markets , they are practical family cars that are easy to drive and fun , too .

reference_raw: Although the difference in size puts them on slightly different markets, they are also practical family cars that are easy to drive and enjoy.

reference_spacy_tokens: Although the difference in size puts them on slightly different markets , they are also practical family cars that are easy to drive and enjoy .


fn_spacy_tokens_for_baseline: I felt a migraine coming on as the old girl began to wail and Zylpha screamed a torrent of abuse .

source_bert_toks: i felt a mig ##raine coming on as the old girl began to wai ##l and z ##yl ##pha screamed a torre ##nt of abuse .

reference_raw: As the old girl began to moan, I could feel a migraine coming, and Zylpha cried out a torrent of abuse.

reference_spacy_tokens: As the old girl began to moan , I could feel a migraine coming , and Zylpha cried out a torrent of abuse .


fn_spacy_tokens_for_baseline: Pottz was confident of taking the world title , but less sure about the Triple Crown .

source_bert_toks: pot ##tz was confident of taking the world title , but less sure about the triple crown .

reference_raw: Pottz was sure he would take the title of the world, but not so sure of the Triple Crown.

reference_spacy_tokens: Pottz was sure he would take the title of the world , but not so sure of the Triple Crown .


fn_spacy_tokens_for_baseline: Now it was time for our first venture out ; luckily the yard was situated amidst very quiet roads , and my husband John had been loaned a schoolmaster called Paddy to act as escort .

source_bert_toks: now it was time for our first venture out ; luckily the yard was situated amidst very quiet roads , and my husband john had been loaned a school ##master called paddy to act as escort .

reference_raw: Now it was time for our first venture out; fortunately the courtyard was in the middle of a very quiet road, and my husband John had been lent to a teacher named Paddy as an escort.

reference_spacy_tokens: Now it was time for our first venture out ; fortunately the courtyard was in the middle of a very quiet road , and my husband John had been lent to a teacher named Paddy as an escort .


fn_spacy_tokens_for_baseline: She woke when the machine bumped something .

source_bert_toks: she woke when the machine bumped something .

reference_raw: She awoke when the machine hit something.

reference_spacy_tokens: She awoke when the machine hit something .


fn_spacy_tokens_for_baseline: They have drifted into a perpetual nap ,

source_bert_toks: they have drifted into a perpetual nap ,

reference_raw: They fell into an eternal sleep,

reference_spacy_tokens: They fell into an eternal sleep ,


fn_spacy_tokens_for_baseline: I can only commend myself to God , repenting my sins .

source_bert_toks: i can only com ##men ##d myself to god , rep ##enting my sins .

reference_raw: All I can do is commend myself to God and regret my sins.

reference_spacy_tokens: All I can do is commend myself to God and regret my sins .


fn_spacy_tokens_for_baseline: ' You were perfectly safe , ' Troy told her .

source_bert_toks: ' you were perfectly safe , ' troy told her .

reference_raw: 'You've been perfectly secure,' Troy said.

reference_spacy_tokens: ' You 've been perfectly secure , ' Troy said .


fn_spacy_tokens_for_baseline: ' The potential for farm accommodation round the country is huge , ' she says .

source_bert_toks: ' the potential for farm accommodation round the country is huge , ' she says .

reference_raw: "The potential for farm accommodation around the country is enormous," he says.

reference_spacy_tokens: " The potential for farm accommodation around the country is enormous , " he says .


fn_spacy_tokens_for_baseline: King Priam 's widow Hecuba and other women await their fate from the victorious Greeks .

source_bert_toks: king pri ##am ' s widow he ##cu ##ba and other women await their fate from the victorious greeks .

reference_raw: The widow of King Priam Hecuba and the other women await their fate from the triumphant Greeks.

reference_spacy_tokens: The widow of King Priam Hecuba and the other women await their fate from the triumphant Greeks .


fn_spacy_tokens_for_baseline: Athens Prefect Yannis Sgouras told state NET TV that strong winds helped strengthen the fires , and caused extra difficulties for the firefighters trying to put out the blaze .

source_bert_toks: athens prefect yan ##nis sg ##our ##as told state net tv that strong winds helped strengthen the fires , and caused extra difficulties for the firefighters trying to put out the blaze .

reference_raw: Athens Prefect Yannis Sgouras has informed the state of NET TV that strong winds have helped to strengthen the fires, causing additional problems for firefighters who are trying to put out the fire.

reference_spacy_tokens: Athens Prefect Yannis Sgouras has informed the state of NET TV that strong winds have helped to strengthen the fires , causing additional problems for firefighters who are trying to put out the fire .


fn_spacy_tokens_for_baseline: Thus it acts as an exact metaphor for the necessity of a broad perspective in addressing any ecological question .

source_bert_toks: thus it acts as an exact metaphor for the necessity of a broad perspective in addressing any ecological question .

reference_raw: It thus acts as a precise metaphor for the need for a broad perspective to address any environmental issue.

reference_spacy_tokens: It thus acts as a precise metaphor for the need for a broad perspective to address any environmental issue .


fn_spacy_tokens_for_baseline: He takes a drag on his cigarette and taps the ash between his legs , hearing a faint hiss as it hits the water .

source_bert_toks: he takes a drag on his cigarette and taps the ash between his legs , hearing a faint hiss as it hits the water .

reference_raw: He draws a cigarette, taps the ash between his legs, hears a faint hiss as it hits the water.

reference_spacy_tokens: He draws a cigarette , taps the ash between his legs , hears a faint hiss as it hits the water .


fn_spacy_tokens_for_baseline: Once you 're back on your feet , I want a straight back , polished footwear and buttons done up .

source_bert_toks: once you ' re back on your feet , i want a straight back , polished foot ##wear and buttons done up .

reference_raw: When you get back on your feet, I want you to go straight back, polish your shoes and buttons.

reference_spacy_tokens: When you get back on your feet , I want you to go straight back , polish your shoes and buttons .


fn_spacy_tokens_for_baseline: I do n't think she 'd ever set foot on a farm before , did n't know a Swaledale sheep from a Shorthorn cow .

source_bert_toks: i don ' t think she ' d ever set foot on a farm before , didn ' t know a sw ##ale ##dale sheep from a short ##horn cow .

reference_raw: I don't think she's ever set foot on a farm before, and she's never met a Swaledale sheep from a Shorthorn cow.

reference_spacy_tokens: I do n't think she 's ever set foot on a farm before , and she 's never met a Swaledale sheep from a Shorthorn cow .


fn_spacy_tokens_for_baseline: For that reason you would have had to be silenced once Graham was in custody .

source_bert_toks: for that reason you would have had to be silenced once graham was in custody .

reference_raw: That's why you'd have to be silenced after Graham's arrest.

reference_spacy_tokens: That 's why you 'd have to be silenced after Graham 's arrest .


fn_spacy_tokens_for_baseline: The squalls were screeching now over their heads , rain curtains hurtling after each other seaward across the low swampland .

source_bert_toks: the sq ##ual ##ls were sc ##ree ##ching now over their heads , rain curtains hurt ##ling after each other sea ##ward across the low swamp ##land .

reference_raw: The screams were now screeching above their heads, and the rain curtains were running at sea across the low marshlands.

reference_spacy_tokens: The screams were now screeching above their heads , and the rain curtains were running at sea across the low marshlands .


fn_spacy_tokens_for_baseline: Now , if she were seated in her old place , wedged between the window and Penini , with his mother opposite encircled in her husband 's arms , or , if the men rode alongside or travelled on the outside of the carriage , sitting with her mistress while Pen and Flush lay on the other seat -- now she would feel stifled , trapped , longing to get out .

source_bert_toks: now , if she were seated in her old place , wedge ##d between the window and pen ##ini , with his mother opposite encircled in her husband ' s arms , or , if the men rode alongside or travelled on the outside of the carriage , sitting with her mistress while pen and flush lay on the other seat - - now she would feel stifled , trapped , longing to get out .

reference_raw: Now, if she were sitting in her old place, wedged between the window and Penini, with her mother opposite her husband in the arms of her husband, or if the men were riding beside her, or traveling on the outer side of the carriage, sitting with her mistress, while Pen and Flush were lying in the other seat, she would feel stifled, trapped, longing to get out.

reference_spacy_tokens: Now , if she were sitting in her old place , wedged between the window and Penini , with her mother opposite her husband in the arms of her husband , or if the men were riding beside her , or traveling on the outer side of the carriage , sitting with her mistress , while Pen and Flush were lying in the other seat , she would feel stifled , trapped , longing to get out .


fn_spacy_tokens_for_baseline: The strategy which had proved so successful in the sphere of science and technology encountered serious problems when applied to complex social systems .

source_bert_toks: the strategy which had proved so successful in the sphere of science and technology encountered serious problems when applied to complex social systems .

reference_raw: A strategy that has proved to be so successful in the field of science and technology has encountered major challenges when it is applied to complex social systems.

reference_spacy_tokens: A strategy that has proved to be so successful in the field of science and technology has encountered major challenges when it is applied to complex social systems .


fn_spacy_tokens_for_baseline: He should really start thinking about double - checking a few things .

source_bert_toks: he should really start thinking about double - checking a few things .

reference_raw: He really ought to start thinking about going through a couple of things.

reference_spacy_tokens: He really ought to start thinking about going through a couple of things .


fn_spacy_tokens_for_baseline: Since the construction of the New Macau - Taipa Bridge has allowed easy access to the airport , the population has grown to more than 30,000 , with industrial development , new apartment blocks , and luxury resort hotels .

source_bert_toks: since the construction of the new macau - tai ##pa bridge has allowed easy access to the airport , the population has grown to more than 30 , 000 , with industrial development , new apartment blocks , and luxury resort hotels .

reference_raw: Since the construction of the new Macao - Taipa Bridge has allowed easy access to the airport, the population has grown to over 30,000, with industrial development, new apartment blocks and luxury resort hotels.

reference_spacy_tokens: Since the construction of the new Macao - Taipa Bridge has allowed easy access to the airport , the population has grown to over 30,000 , with industrial development , new apartment blocks and luxury resort hotels .


fn_spacy_tokens_for_baseline: Their interaction will not be constrained by these roles .

source_bert_toks: their interaction will not be constrained by these roles .

reference_raw: Their interactions will not be limited by these roles.

reference_spacy_tokens: Their interactions will not be limited by these roles .


fn_spacy_tokens_for_baseline: But the vast experience , stability and guidance to young colleagues that Hastings can impart has to be of particular import to Scotland 's 1993 efforts .

source_bert_toks: but the vast experience , stability and guidance to young colleagues that hastings can imp ##art has to be of particular import to scotland ' s 1993 efforts .

reference_raw: However, the extensive experience, stability and guidance of young colleagues that Hastings can impart must be of particular importance to the efforts of Scotland in 1993.

reference_spacy_tokens: However , the extensive experience , stability and guidance of young colleagues that Hastings can impart must be of particular importance to the efforts of Scotland in 1993 .


fn_spacy_tokens_for_baseline: Often the burial site is destroyed , or there is a differential representation of habitats .

source_bert_toks: often the burial site is destroyed , or there is a differential representation of habitats .

reference_raw: The burial ground is often destroyed, or there is a different representation of the habitats.

reference_spacy_tokens: The burial ground is often destroyed , or there is a different representation of the habitats .


fn_spacy_tokens_for_baseline: It had been , I realized , an extremely long and tiring day .

source_bert_toks: it had been , i realized , an extremely long and ti ##ring day .

reference_raw: It was, I realized, a very long and exhausting day.

reference_spacy_tokens: It was , I realized , a very long and exhausting day .


fn_spacy_tokens_for_baseline: It is made worse because the Opposition understandably wants to take advantage of a Prime Minister who seems dangerously , if not fatally , wounded .

source_bert_toks: it is made worse because the opposition understand ##ably wants to take advantage of a prime minister who seems dangerously , if not fatally , wounded .

reference_raw: This is exacerbated by the fact that the opposing party understandably wants to use a prime minister who appears to be dangerously, if not fatally, injured.

reference_spacy_tokens: This is exacerbated by the fact that the opposing party understandably wants to use a prime minister who appears to be dangerously , if not fatally , injured .


fn_spacy_tokens_for_baseline: Last week , when the Lewinsky story was only a few hours old , Stephanopoulos popped up on Good Morning America to demonstrate his concern .

source_bert_toks: last week , when the lew ##insky story was only a few hours old , stephan ##op ##oulos popped up on good morning america to demonstrate his concern .

reference_raw: Last week, when Lewinsky's story was only a few hours old, Stephanopoulos came to Good Morning America to show his interest.

reference_spacy_tokens: Last week , when Lewinsky 's story was only a few hours old , Stephanopoulos came to Good Morning America to show his interest .


fn_spacy_tokens_for_baseline: He was hungry and conscious of the delicious greasy bundle in his bag , but he believed fish and chips were usually heated up in the oven anyway , so they would n't spoil .

source_bert_toks: he was hungry and conscious of the delicious greasy bundle in his bag , but he believed fish and chips were usually heated up in the oven anyway , so they wouldn ' t spoil .

reference_raw: He was hungry and aware of the delicious greasy bundle in his bag, but he believed that fish and chips were usually heated in the oven anyway, so they didn't go bad.

reference_spacy_tokens: He was hungry and aware of the delicious greasy bundle in his bag , but he believed that fish and chips were usually heated in the oven anyway , so they did n't go bad .


fn_spacy_tokens_for_baseline: The most astonishing item , however , is a piece of peasant work .

source_bert_toks: the most astonishing item , however , is a piece of peasant work .

reference_raw: But the most amazing thing is the work of the peasants.

reference_spacy_tokens: But the most amazing thing is the work of the peasants .


fn_spacy_tokens_for_baseline: Carrie does n't seem to feel the cold herself and floats around in her filmy smocks without a shiver .

source_bert_toks: carrie doesn ' t seem to feel the cold herself and floats around in her film ##y sm ##ocks without a shiver .

reference_raw: Carrie doesn't seem to feel the cold on her own, and she floats around in her filmy smokes without a shudder.

reference_spacy_tokens: Carrie does n't seem to feel the cold on her own , and she floats around in her filmy smokes without a shudder .


fn_spacy_tokens_for_baseline: A Mr. and Mrs. Martin were subsequently appointed as master and matron , and their daughter Selina was given the post of schoolmistress .

source_bert_toks: a mr . and mrs . martin were subsequently appointed as master and mat ##ron , and their daughter se ##lina was given the post of school ##mist ##ress .

reference_raw: Mr. and Mrs. Martin were subsequently appointed master and matron, and their daughter Selina was given the post of teacher.

reference_spacy_tokens: Mr. and Mrs. Martin were subsequently appointed master and matron , and their daughter Selina was given the post of teacher .


fn_spacy_tokens_for_baseline: The next group of words ( some prepositions and other function words ) occur in their strong forms when they are final in a sentence ; examples of this are given .

source_bert_toks: the next group of words ( some prep ##osition ##s and other function words ) occur in their strong forms when they are final in a sentence ; examples of this are given .

reference_raw: Another group of words (some prepositions and other functional words) appears in their strong form when the sentence is definitive; examples of this are given.

reference_spacy_tokens: Another group of words ( some prepositions and other functional words ) appears in their strong form when the sentence is definitive ; examples of this are given .


fn_spacy_tokens_for_baseline: He had on a leather trilby and a single breasted leather coat with a tie belt .

source_bert_toks: he had on a leather tri ##lby and a single breast ##ed leather coat with a tie belt .

reference_raw: He was wearing a leather trilby and a single leather jacket with a tie-belt.

reference_spacy_tokens: He was wearing a leather trilby and a single leather jacket with a tie - belt .


fn_spacy_tokens_for_baseline: She resumed her vague look and her dusting .

source_bert_toks: she resumed her vague look and her dustin ##g .

reference_raw: She continued to stare indifferently and dust.

reference_spacy_tokens: She continued to stare indifferently and dust .


fn_spacy_tokens_for_baseline: Sen. Juan Ponce Enrile , another presidential candidate at the forum , said a Senate inquiry has cleared Ramos of involvement in the land scandal .

source_bert_toks: sen . juan ponce en ##ril ##e , another presidential candidate at the forum , said a senate inquiry has cleared ramos of involvement in the land scandal .

reference_raw: Sen. Juan Ponce Enrile, another candidate for president at the forum, said that the Senate investigation had ruled out Ramos' involvement in the country scandal.

reference_spacy_tokens: Sen. Juan Ponce Enrile , another candidate for president at the forum , said that the Senate investigation had ruled out Ramos ' involvement in the country scandal .


fn_spacy_tokens_for_baseline: The Fuhrer has had a bunker constructed below the Chancellery .

source_bert_toks: the fu ##hrer has had a bunker constructed below the chancel ##ler ##y .

reference_raw: The Führer built a bunkery under the Chancellery.

reference_spacy_tokens: The Fuhrer built a bunkery under the Chancellery .


fn_spacy_tokens_for_baseline: ' Everything points to escape by sea , ' he told me wistfully , in response to my questions .

source_bert_toks: ' everything points to escape by sea , ' he told me wi ##st ##fully , in response to my questions .

reference_raw: "All points to escape by sea," he said wistfully, answering my questions.

reference_spacy_tokens: " All points to escape by sea , " he said wistfully , answering my questions .


fn_spacy_tokens_for_baseline: Nursing a hunch that Kembel , avoided by all other space traffic , might be the Dalek 's base , Cory chartered Lowery 's vessel for this exploratory trip .

source_bert_toks: nursing a hu ##nch that ke ##mbe ##l , avoided by all other space traffic , might be the dale ##k ' s base , cory chartered lower ##y ' s vessel for this ex ##pl ##ora ##tory trip .

reference_raw: Cory, sensing that Kembel, avoided by all other space traffic, might be the Dalek's base, had chartered Lowery's ship for this exploratory voyage.

reference_spacy_tokens: Cory , sensing that Kembel , avoided by all other space traffic , might be the Dalek 's base , had chartered Lowery 's ship for this exploratory voyage .


fn_spacy_tokens_for_baseline: The Elton Committee recommended avoidance of the punishment of whole groups , and this is consistent with the view of a judge in one recent case , who said that ' Punishment should not be indiscriminate .

source_bert_toks: the elton committee recommended avoidance of the punishment of whole groups , and this is consistent with the view of a judge in one recent case , who said that ' punishment should not be ind ##is ##cr ##imi ##nate .

reference_raw: The Elton Committee recommended that penalties be avoided for entire groups, which is in line with the opinion of a judge in a recent case who said that penalties should not be indiscriminate.

reference_spacy_tokens: The Elton Committee recommended that penalties be avoided for entire groups , which is in line with the opinion of a judge in a recent case who said that penalties should not be indiscriminate .


fn_spacy_tokens_for_baseline: Subsequent IAEA inspections in Iran revealed a wealth of new information related to the development and scale of Iran 's nuclear program .

source_bert_toks: subsequent ia ##ea inspections in iran revealed a wealth of new information related to the development and scale of iran ' s nuclear program .

reference_raw: Subsequent inspections by the IAEA in Iran revealed a wealth of fresh information on the development and scale of the Iranian nuclear programme.

reference_spacy_tokens: Subsequent inspections by the IAEA in Iran revealed a wealth of fresh information on the development and scale of the Iranian nuclear programme .


fn_spacy_tokens_for_baseline: Cheers Ted has ruined my career

source_bert_toks: cheers ted has ruined my career

reference_raw: Cheers Ted destroyed my career.

reference_spacy_tokens: Cheers Ted destroyed my career .


fn_spacy_tokens_for_baseline: The amounts of material so far available have been insufficient for full chemical characterisation but we have tentatively identified them as corresponding to G34 and G17 extended through the C - terminus to include the C - terminal fragment of progastrin .

source_bert_toks: the amounts of material so far available have been insufficient for full chemical character ##isation but we have tentatively identified them as corresponding to g ##34 and g ##17 extended through the c - terminus to include the c - terminal fragment of pro ##gas ##tri ##n .

reference_raw: The amount of material available so far has not been sufficient to fully characterise the chemical, but we have tentatively identified it as corresponding to G34 and G17, which have been extended over the C terminus to include the C-terminal fraction of progastrin.

reference_spacy_tokens: The amount of material available so far has not been sufficient to fully characterise the chemical , but we have tentatively identified it as corresponding to G34 and G17 , which have been extended over the C terminus to include the C - terminal fraction of progastrin .


fn_spacy_tokens_for_baseline: His laugh cut through her recriminations .

source_bert_toks: his laugh cut through her rec ##rim ##inations .

reference_raw: His laughter cut through her accusations.

reference_spacy_tokens: His laughter cut through her accusations .


fn_spacy_tokens_for_baseline: Major groups do not simply obliterate other major groups by competition ; rather do they radiate into the adaptive zones after the previous dominant group has become extinct .

source_bert_toks: major groups do not simply ob ##lite ##rate other major groups by competition ; rather do they ra ##dia ##te into the adaptive zones after the previous dominant group has become extinct .

reference_raw: Major groups do not simply eliminate other large groups through competition; rather, they radiate into adaptive zones after the extinction of the former dominant group.

reference_spacy_tokens: Major groups do not simply eliminate other large groups through competition ; rather , they radiate into adaptive zones after the extinction of the former dominant group .


fn_spacy_tokens_for_baseline: Lawton was struggling to get out of his pack the receiver that would pick up the radio signals from the miniature transceiver Forster said was attached to his slayer .

source_bert_toks: law ##ton was struggling to get out of his pack the receiver that would pick up the radio signals from the miniature trans ##ce ##iver forster said was attached to his slayer .

reference_raw: Lawton was trying to get a receiver from his pack to pick up the radio signals from the miniature transmitter that Forster had said was attached to his killer.

reference_spacy_tokens: Lawton was trying to get a receiver from his pack to pick up the radio signals from the miniature transmitter that Forster had said was attached to his killer .


fn_spacy_tokens_for_baseline: Still , the test was a success , and I am not displeased that a French area was chosen as the site .

source_bert_toks: still , the test was a success , and i am not di ##sp ##lea ##sed that a french area was chosen as the site .

reference_raw: But the test was successful, and I'm not disappointed that the French area was chosen as the site.

reference_spacy_tokens: But the test was successful , and I 'm not disappointed that the French area was chosen as the site .


fn_spacy_tokens_for_baseline: The amount remaining after deducting all mandatory and discretionary exceptions is known as the Aggregated School Budget ( ASB ) .

source_bert_toks: the amount remaining after de ##du ##cting all mandatory and discretion ##ary exceptions is known as the aggregate ##d school budget ( as ##b ) .

reference_raw: The outstanding amount after deduction of all mandatory and discretionary exceptions is known as the Aggregated School Budget (ASB).

reference_spacy_tokens: The outstanding amount after deduction of all mandatory and discretionary exceptions is known as the Aggregated School Budget ( ASB ) .


fn_spacy_tokens_for_baseline: Born Aug. 12 , 1907 , Torga adopted his pen name in 1934 as a tribute to his hometown and his favorite writers , as well as a thin veil from government censors .

source_bert_toks: born aug . 12 , 1907 , tor ##ga adopted his pen name in 1934 as a tribute to his hometown and his favorite writers , as well as a thin veil from government ce ##nsor ##s .

reference_raw: Born August 12, 1907, Torga adopted his penname in 1934 as a tribute to his hometown and favorite writers, as well as a thin veil of government censors.

reference_spacy_tokens: Born August 12 , 1907 , Torga adopted his penname in 1934 as a tribute to his hometown and favorite writers , as well as a thin veil of government censors .


fn_spacy_tokens_for_baseline: All he seems to do is make sure that players do n't misbehave and if they do , he is there to reprimand them .

source_bert_toks: all he seems to do is make sure that players don ' t mis ##be ##ha ##ve and if they do , he is there to rep ##rim ##and them .

reference_raw: Looks like he's just making sure the players don't act wrong, and if he does, he's there to rebuke them.

reference_spacy_tokens: Looks like he 's just making sure the players do n't act wrong , and if he does , he 's there to rebuke them .


fn_spacy_tokens_for_baseline: Tom unpacked the haversack and wandered round the room putting the groceries away on shelves and into small cupboards .

source_bert_toks: tom un ##pack ##ed the have ##rsa ##ck and wandered round the room putting the groceries away on shelves and into small cupboard ##s .

reference_raw: Tom unpacked his pack and wandered around the room, putting the groceries on the shelves and in the little closets.

reference_spacy_tokens: Tom unpacked his pack and wandered around the room , putting the groceries on the shelves and in the little closets .


fn_spacy_tokens_for_baseline: Such parents allow children to regulate their own activities as much as possible ; avoid the exercise of control and do not encourage their children to obey externally defined standards .

source_bert_toks: such parents allow children to regulate their own activities as much as possible ; avoid the exercise of control and do not encourage their children to obey externally defined standards .

reference_raw: These parents allow children to regulate their activities as much as possible; avoid exercising control and do not encourage their children to comply with externally defined standards.

reference_spacy_tokens: These parents allow children to regulate their activities as much as possible ; avoid exercising control and do not encourage their children to comply with externally defined standards .


fn_spacy_tokens_for_baseline: The patients were reminded that improvements with hypnosis can take time , and that with practice more improvement can be expected .

source_bert_toks: the patients were reminded that improvements with h ##yp ##nosis can take time , and that with practice more improvement can be expected .

reference_raw: Patients were reminded that improvements with hypnosis could take a while, and that more improvements could be expected with practice.

reference_spacy_tokens: Patients were reminded that improvements with hypnosis could take a while , and that more improvements could be expected with practice .


fn_spacy_tokens_for_baseline: The modern 120 - passenger cars make the journey in around eight minutes .

source_bert_toks: the modern 120 - passenger cars make the journey in around eight minutes .

reference_raw: Modern 120 - passenger cars leave in about eight minutes.

reference_spacy_tokens: Modern 120 - passenger cars leave in about eight minutes .


fn_spacy_tokens_for_baseline: We can be more precise than this by referring to Goldthorpe et al . 's work .

source_bert_toks: we can be more precise than this by referring to gold ##thorpe et al . ' s work .

reference_raw: We can be more specific by referring to Goldthorpe et al.'s work.

reference_spacy_tokens: We can be more specific by referring to Goldthorpe et al . 's work .


fn_spacy_tokens_for_baseline: He had suddenly aged , his skin stretched like old parchment across his cheeks , his eyes red and tired .

source_bert_toks: he had suddenly aged , his skin stretched like old parchment across his cheeks , his eyes red and tired .

reference_raw: He suddenly grew old, his skin stretched across his cheeks like old parchment, his eyes red and tired.

reference_spacy_tokens: He suddenly grew old , his skin stretched across his cheeks like old parchment , his eyes red and tired .


fn_spacy_tokens_for_baseline: News of the changed disposal plans came in an internal University memo leaked to The Guardian newspaper .

source_bert_toks: news of the changed disposal plans came in an internal university memo leaked to the guardian newspaper .

reference_raw: News of a modified disposal plan came from the University's internal memo released to the Guardian newspaper.

reference_spacy_tokens: News of a modified disposal plan came from the University 's internal memo released to the Guardian newspaper .


fn_spacy_tokens_for_baseline: He yawned widely .

source_bert_toks: he yawned widely .

reference_raw: He gaped widely.

reference_spacy_tokens: He gaped widely .


fn_spacy_tokens_for_baseline: Erika stood up , too , and gave a rueful shrug .

source_bert_toks: erika stood up , too , and gave a rue ##ful shrug .

reference_raw: Erica got to her feet, too, and shrugged sadly.

reference_spacy_tokens: Erica got to her feet , too , and shrugged sadly .


fn_spacy_tokens_for_baseline: The information will be of great help in preparing my remarks to the conference which will take place in Oxford in April .

source_bert_toks: the information will be of great help in preparing my remarks to the conference which will take place in oxford in april .

reference_raw: This information will help me prepare my comments for the conference that will be held in Oxford in April.

reference_spacy_tokens: This information will help me prepare my comments for the conference that will be held in Oxford in April .


fn_spacy_tokens_for_baseline: The number density of energetic ions and electrons is so high that were you or I to cross the belt we would receive 500 times the lethal dose of such particles .

source_bert_toks: the number density of energetic ions and electrons is so high that were you or i to cross the belt we would receive 500 times the lethal dose of such particles .

reference_raw: The density of energy ions and electrons is so high that if you or I crossed the belt, we'd get 500 times the deadly dose of these particles.

reference_spacy_tokens: The density of energy ions and electrons is so high that if you or I crossed the belt , we 'd get 500 times the deadly dose of these particles .


fn_spacy_tokens_for_baseline: The audience grew restless and inattentive .

source_bert_toks: the audience grew restless and ina ##tten ##tive .

reference_raw: The audience grew restless and indifferent.

reference_spacy_tokens: The audience grew restless and indifferent .


fn_spacy_tokens_for_baseline: He was one of Clinton 's principal enablers , to use a word employed by Maureen Dowd in today 's New York Times .

source_bert_toks: he was one of clinton ' s principal enable ##rs , to use a word employed by maureen dow ##d in today ' s new york times .

reference_raw: He was one of Clinton's main authors, using the word that Maureen Dowd used in the New York Times today.

reference_spacy_tokens: He was one of Clinton 's main authors , using the word that Maureen Dowd used in the New York Times today .


fn_spacy_tokens_for_baseline: He bellowed at the Sikhs to retreat and as they stumbled back under a cross - fire from the other side of the hall , two of them fell dead and another mortally wounded .

source_bert_toks: he bellowed at the sikhs to retreat and as they stumbled back under a cross - fire from the other side of the hall , two of them fell dead and another mortally wounded .

reference_raw: He shouted to the Sikhs to retreat, and as they stumbled under the crossfire from the far end of the hall, two fell dead, and another was mortally wounded.

reference_spacy_tokens: He shouted to the Sikhs to retreat , and as they stumbled under the crossfire from the far end of the hall , two fell dead , and another was mortally wounded .


fn_spacy_tokens_for_baseline: He resented that and was determined that she should receive some mail at their address , under their married name .

source_bert_toks: he resented that and was determined that she should receive some mail at their address , under their married name .

reference_raw: He resented it and decided to send some mail to their address under their marriage name.

reference_spacy_tokens: He resented it and decided to send some mail to their address under their marriage name .


fn_spacy_tokens_for_baseline: Only eight weeks into the job , Mr Gerstner is still concocting a rescue plan .

source_bert_toks: only eight weeks into the job , mr ge ##rst ##ner is still con ##co ##cting a rescue plan .

reference_raw: Only eight weeks to work, Mr. Gerstner's still working on a rescue plan.

reference_spacy_tokens: Only eight weeks to work , Mr. Gerstner 's still working on a rescue plan .


fn_spacy_tokens_for_baseline: We deride our democracy and itch to find ways of improving it , such as proportional representation or abolishing the House of Lords .

source_bert_toks: we der ##ide our democracy and it ##ch to find ways of improving it , such as proportional representation or ab ##olis ##hing the house of lords .

reference_raw: We mock our democracy and itch to find ways to improve it, such as proportional representation or the abolition of the House of Lords.

reference_spacy_tokens: We mock our democracy and itch to find ways to improve it , such as proportional representation or the abolition of the House of Lords .


fn_spacy_tokens_for_baseline: Leo demanded as he wrenched back to stare down into her almost terror - stricken face .

source_bert_toks: leo demanded as he wrenched back to stare down into her almost terror - stricken face .

reference_raw: Leo asked, jerking back and looking down at her almost frightened face.

reference_spacy_tokens: Leo asked , jerking back and looking down at her almost frightened face .


fn_spacy_tokens_for_baseline: Constantinople was taken by Crusader forces in 1204 , and they stripped the city of many of its finest treasures -- which now grace the public buildings of Venice -- although a large consignment of books and manuscripts was transferred to the monastery at Patmos before the city fell .

source_bert_toks: constantinople was taken by crusader forces in 120 ##4 , and they stripped the city of many of its finest treasures - - which now grace the public buildings of venice - - although a large con ##si ##gn ##ment of books and manuscripts was transferred to the monastery at pat ##mos before the city fell .

reference_raw: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city.

reference_spacy_tokens: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a large shipment of books and manuscripts had been transferred to the convent in Patmos before the collapse of the city .


fn_spacy_tokens_for_baseline: Thereafter Sutton was overshadowed by his ambitious , avaricious , and energetic second son , who was to amass a fortune by publicizing and exploiting the Suttonian method of inoculation .

source_bert_toks: thereafter sutton was overshadowed by his ambitious , ava ##ric ##ious , and energetic second son , who was to ama ##ss a fortune by public ##izing and exploit ##ing the sutton ##ian method of in ##oc ##ulation .

reference_raw: Then Sutton was overshadowed by his ambitious, avaricious, and energetic second son, who was supposed to accumulate a fortune by publishing and using Sutton's inoculation method.

reference_spacy_tokens: Then Sutton was overshadowed by his ambitious , avaricious , and energetic second son , who was supposed to accumulate a fortune by publishing and using Sutton 's inoculation method .


fn_spacy_tokens_for_baseline: Roadside bombs and insurgent ambushes are common , threatening Afghan farmers and workers , as well as U. S. and Canadian forces .

source_bert_toks: roadside bombs and ins ##urgent ambush ##es are common , threatening afghan farmers and workers , as well as u . s . and canadian forces .

reference_raw: Roadside bombings and insurgent raids are common, threatening Afghan farmers and workers, as well as American and Canadian forces.

reference_spacy_tokens: Roadside bombings and insurgent raids are common , threatening Afghan farmers and workers , as well as American and Canadian forces .


fn_spacy_tokens_for_baseline: Because of the new legitimacy Las Vegas acquired from Hughes ' investments , established companies such as Hilton Hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal skimming of profits was rampant .

source_bert_toks: because of the new legitimacy las vegas acquired from hughes ' investments , established companies such as hilton hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal ski ##mming of profits was rampant .

reference_raw: Due to the new legitimacy that Las Vegas has acquired from Hughes' investments, established companies like Hilton Hotels have bought into gambling, and their influence has helped to draw a line in the desert sand between legitimate activities and mafia casinos, where illegal profit skimming is rampant.

reference_spacy_tokens: Due to the new legitimacy that Las Vegas has acquired from Hughes ' investments , established companies like Hilton Hotels have bought into gambling , and their influence has helped to draw a line in the desert sand between legitimate activities and mafia casinos , where illegal profit skimming is rampant .


fn_spacy_tokens_for_baseline: ' Stand in front of a mirror and rehearse them , ' he instructed .

source_bert_toks: ' stand in front of a mirror and re ##hear ##se them , ' he instructed .

reference_raw: "Stand in front of the mirror and practice," he said.

reference_spacy_tokens: " Stand in front of the mirror and practice , " he said .


fn_spacy_tokens_for_baseline: I thought I detected a faint smile on his lips , but I did not smile back because my heart was in a turmoil .

source_bert_toks: i thought i detected a faint smile on his lips , but i did not smile back because my heart was in a turmoil .

reference_raw: I thought I saw a faint smile on his lips, but I didn't smile back, for my heart was in turmoil.

reference_spacy_tokens: I thought I saw a faint smile on his lips , but I did n't smile back , for my heart was in turmoil .


fn_spacy_tokens_for_baseline: An orange circle of light , the beam from his torch , darted round the tent walls , there was the jingle of keys and I felt them cold in my hand .

source_bert_toks: an orange circle of light , the beam from his torch , darted round the tent walls , there was the jingle of keys and i felt them cold in my hand .

reference_raw: A ring of orange light, a beam from his torch, darted around the walls of the tent, and there was a jingle of keys, and I could feel them cold in my hand.

reference_spacy_tokens: A ring of orange light , a beam from his torch , darted around the walls of the tent , and there was a jingle of keys , and I could feel them cold in my hand .


fn_spacy_tokens_for_baseline: She can lie on her back like an inverted cockroach while waggling her legs in the air .

source_bert_toks: she can lie on her back like an inverted cock ##ro ##ach while wa ##gg ##ling her legs in the air .

reference_raw: He can lie on his back like a cockroach swinging his legs in the air.

reference_spacy_tokens: He can lie on his back like a cockroach swinging his legs in the air .


fn_spacy_tokens_for_baseline: Two hundred years ago , those people who drank substantial quantities of cider often suffered a strange disability dubbed the Devonshire colic .

source_bert_toks: two hundred years ago , those people who drank substantial quantities of cid ##er often suffered a strange disability dubbed the devon ##shire coli ##c .

reference_raw: Two hundred years ago, people who drank a lot of cider often had a special disability called the Devonshire colic.

reference_spacy_tokens: Two hundred years ago , people who drank a lot of cider often had a special disability called the Devonshire colic .


fn_spacy_tokens_for_baseline: ' Too bloody right , ' says Perry , ' te ' likes of yourself will lift everything tat ai n't nailed down .

source_bert_toks: ' too bloody right , ' says perry , ' te ' likes of yourself will lift everything ta ##t ain ' t nailed down .

reference_raw: 'You're too damn right,' says Perry, 'te likes you picks up everything tattoos aren't nailed to the ground.

reference_spacy_tokens: ' You 're too damn right , ' says Perry , ' te likes you picks up everything tattoos are n't nailed to the ground .


fn_spacy_tokens_for_baseline: Today , all three facilities undertake projects requiring advanced microbiology and genetic engineering equipment and expertise that could be applied toward the production of biological weapons .

source_bert_toks: today , all three facilities undertake projects requiring advanced micro ##biology and genetic engineering equipment and expertise that could be applied toward the production of biological weapons .

reference_raw: All three facilities are currently carrying out projects requiring sophisticated microbiological and genetic engineering equipment and expertise that can be used to produce biological weapons.

reference_spacy_tokens: All three facilities are currently carrying out projects requiring sophisticated microbiological and genetic engineering equipment and expertise that can be used to produce biological weapons .


fn_spacy_tokens_for_baseline: Slice the onions fairly fine .

source_bert_toks: slice the onions fairly fine .

reference_raw: Cut the onions pretty well.

reference_spacy_tokens: Cut the onions pretty well .


fn_spacy_tokens_for_baseline: It is true that each one of these components rests atop a pyramid of explanations at lower levels .

source_bert_toks: it is true that each one of these components rests atop a pyramid of explanations at lower levels .

reference_raw: It is true that each of these components lies at the top of the pyramid of explanations at the lower level.

reference_spacy_tokens: It is true that each of these components lies at the top of the pyramid of explanations at the lower level .


fn_spacy_tokens_for_baseline: Since the dawning of history , people have been fascinated , intoxicated and mystified by the powers of aromatic plants .

source_bert_toks: since the dawn ##ing of history , people have been fascinated , into ##xi ##cated and my ##sti ##fied by the powers of aromatic plants .

reference_raw: Since the dawn of history, people have been intrigued, drunk and mystified by the power of aromatic plants.

reference_spacy_tokens: Since the dawn of history , people have been intrigued , drunk and mystified by the power of aromatic plants .


fn_spacy_tokens_for_baseline: CRCs will identify priorities and seek out people to help in the revision of those priority areas .

source_bert_toks: cr ##cs will identify priorities and seek out people to help in the revision of those priority areas .

reference_raw: The CRCs will set priorities and seek people to assist in reviewing these priority areas.

reference_spacy_tokens: The CRCs will set priorities and seek people to assist in reviewing these priority areas .


fn_spacy_tokens_for_baseline: Some examples : part way through the process , the PTFE ' cake ' is now bagged up to stop contamination getting in .

source_bert_toks: some examples : part way through the process , the pt ##fe ' cake ' is now bag ##ged up to stop contamination getting in .

reference_raw: Some examples: part of the process is now packed with PTFE 'cake' to prevent contamination.

reference_spacy_tokens: Some examples : part of the process is now packed with PTFE ' cake ' to prevent contamination .


fn_spacy_tokens_for_baseline: The smith and his sister , equally brawny , set their apprentice sweating at the bellows of the forge , to repair weapons , ship 's fittings , armour .

source_bert_toks: the smith and his sister , equally bra ##wny , set their apprentice sweating at the bell ##ows of the forge , to repair weapons , ship ' s fitting ##s , armour .

reference_raw: The smith and his sister, equally brawn, laid their apprentice sweating at the bellows of the forge, repairing weapons, ship's equipment, and armor.

reference_spacy_tokens: The smith and his sister , equally brawn , laid their apprentice sweating at the bellows of the forge , repairing weapons , ship 's equipment , and armor .


fn_spacy_tokens_for_baseline: This created a pattern seen today throughout the Aegean of a small port ( skala ) which serves an inland settlement or chora , making it easier to protect the island from attack .

source_bert_toks: this created a pattern seen today throughout the aegean of a small port ( ska ##la ) which serves an inland settlement or cho ##ra , making it easier to protect the island from attack .

reference_raw: This created a pattern seen today throughout the Aegean of a small port (skala) serving an inland settlement or chora, which facilitates the protection of the island from attack.

reference_spacy_tokens: This created a pattern seen today throughout the Aegean of a small port ( skala ) serving an inland settlement or chora , which facilitates the protection of the island from attack .


fn_spacy_tokens_for_baseline: The caviare glistened between Himmler 's teeth .

source_bert_toks: the ca ##via ##re g ##list ##ened between him ##mler ' s teeth .

reference_raw: The caviare gleamed between Himmler's teeth.

reference_spacy_tokens: The caviare gleamed between Himmler 's teeth .


fn_spacy_tokens_for_baseline: Customers were becoming much more discerning -- interested not just in price , but quality of products .

source_bert_toks: customers were becoming much more disc ##ern ##ing - - interested not just in price , but quality of products .

reference_raw: The customers became much more recognizable - interested not only in the price, but also in the quality of the products.

reference_spacy_tokens: The customers became much more recognizable - interested not only in the price , but also in the quality of the products .


fn_spacy_tokens_for_baseline: A reduction in shared bathrooms and kitchens reduces the contact between individuals and families .

source_bert_toks: a reduction in shared bathrooms and kitchens reduces the contact between individuals and families .

reference_raw: Reducing common bathrooms and kitchens reduces contact between individuals and families.

reference_spacy_tokens: Reducing common bathrooms and kitchens reduces contact between individuals and families .


fn_spacy_tokens_for_baseline: Such monetarist policies meant that employment and interest rates were left to find their own levels in the market place .

source_bert_toks: such mon ##eta ##rist policies meant that employment and interest rates were left to find their own levels in the market place .

reference_raw: Such a monetary policy meant that jobs and interest rates were left to find their own level in the marketplace.

reference_spacy_tokens: Such a monetary policy meant that jobs and interest rates were left to find their own level in the marketplace .


fn_spacy_tokens_for_baseline: It was as if she had vanished off the face of the earth , ' Anthony Palmer , for the prosecution , said .

source_bert_toks: it was as if she had vanished off the face of the earth , ' anthony palmer , for the prosecution , said .

reference_raw: "It's like she's gone from Earth," Anthony Palmer said to the prosecution.

reference_spacy_tokens: " It 's like she 's gone from Earth , " Anthony Palmer said to the prosecution .


fn_spacy_tokens_for_baseline: Her remark that she could always have stayed home and made cookies has discomfited Republicans , not least Barbara Bush .

source_bert_toks: her remark that she could always have stayed home and made cookies has disco ##m ##fi ##ted republicans , not least barbara bush .

reference_raw: Her remark that she could always stay home and make cookies made the Republicans unhappy, not least Barbara Bush.

reference_spacy_tokens: Her remark that she could always stay home and make cookies made the Republicans unhappy , not least Barbara Bush .


fn_spacy_tokens_for_baseline: They proceeded to apprehend Willis and a fellow partygoer and dragged them screaming and kicking to the squad car .

source_bert_toks: they proceeded to app ##re ##hend willis and a fellow party ##go ##er and dragged them screaming and kicking to the squad car .

reference_raw: They continued to arrest Willis and his partner, dragging them screaming and kicking into the squad car.

reference_spacy_tokens: They continued to arrest Willis and his partner , dragging them screaming and kicking into the squad car .


fn_spacy_tokens_for_baseline: Watching the other girl jog into the distance , Lindsey hesitated fractionally before deciding that she might as well go for a swim anyway .

source_bert_toks: watching the other girl jo ##g into the distance , lindsey hesitated fraction ##ally before deciding that she might as well go for a swim anyway .

reference_raw: Lindsey watched the other girl run into the distance and hesitated for a moment, then decided she could go for a swim anyway.

reference_spacy_tokens: Lindsey watched the other girl run into the distance and hesitated for a moment , then decided she could go for a swim anyway .


fn_spacy_tokens_for_baseline: Paul Lexington exhorted him to do his best .

source_bert_toks: paul lexington ex ##hort ##ed him to do his best .

reference_raw: Paul Lexington blackmailed him into doing what he could.

reference_spacy_tokens: Paul Lexington blackmailed him into doing what he could .


fn_spacy_tokens_for_baseline: But it was nice to see all these old geezers with huge noses treating him as if he was a man .

source_bert_toks: but it was nice to see all these old gee ##zers with huge noses treating him as if he was a man .

reference_raw: But it was nice to see all those old gooses with big noses treating him like a man.

reference_spacy_tokens: But it was nice to see all those old gooses with big noses treating him like a man .


fn_spacy_tokens_for_baseline: The dog , its eyes full of concern , pressed its nose into the palm of her hand , making reassuring , snuffling noises .

source_bert_toks: the dog , its eyes full of concern , pressed its nose into the palm of her hand , making reassuring , s ##nu ##ff ##ling noises .

reference_raw: The dog, eyes full of concern, pressed its nose into the palm of her hand and made soothing, snuffling sounds.

reference_spacy_tokens: The dog , eyes full of concern , pressed its nose into the palm of her hand and made soothing , snuffling sounds .


fn_spacy_tokens_for_baseline: The projection is technically difficult to study , and the locus and cellular mechanisms of mossy fibre LTP remain controversial .

source_bert_toks: the projection is technically difficult to study , and the locus and cellular mechanisms of moss ##y fibre lt ##p remain controversial .

reference_raw: The projection is technically hard to study and the locus and cellular mechanisms of the LTP mossy fibre remain controversial.

reference_spacy_tokens: The projection is technically hard to study and the locus and cellular mechanisms of the LTP mossy fibre remain controversial .


fn_spacy_tokens_for_baseline: I began to loosen my armour .

source_bert_toks: i began to loosen my armour .

reference_raw: I started to loosen my armor.

reference_spacy_tokens: I started to loosen my armor .


fn_spacy_tokens_for_baseline: As he yanked one out for himself , something clattered loudly to the floor .

source_bert_toks: as he yanked one out for himself , something cl ##atter ##ed loudly to the floor .

reference_raw: Something rattled loudly on the floor as he yanked one for himself.

reference_spacy_tokens: Something rattled loudly on the floor as he yanked one for himself .


fn_spacy_tokens_for_baseline: According to biblical tradition , although David bought the land for the Temple and carefully assembled its building materials , he was deemed unworthy of constructing the Temple because he was a man of war with blood on his hands .

source_bert_toks: according to biblical tradition , although david bought the land for the temple and carefully assembled its building materials , he was deemed un ##worthy of constructing the temple because he was a man of war with blood on his hands .

reference_raw: According to biblical tradition, even though David bought the land for the temple and carefully assembled the building materials, he was considered unworthy of building the temple because he was a man of war with blood on his hands.

reference_spacy_tokens: According to biblical tradition , even though David bought the land for the temple and carefully assembled the building materials , he was considered unworthy of building the temple because he was a man of war with blood on his hands .


fn_spacy_tokens_for_baseline: I decided not to fly at him .

source_bert_toks: i decided not to fly at him .

reference_raw: I decided not to go after him.

reference_spacy_tokens: I decided not to go after him .


fn_spacy_tokens_for_baseline: The monks , unused to such curious behaviour , gossiped with relish about the strange eccentricities of this English clerk .

source_bert_toks: the monks , unused to such curious behaviour , gossip ##ed with re ##lish about the strange eccentric ##ities of this english clerk .

reference_raw: Unaccustomed to such strange behavior, the monks gossiped with delight about the strange eccentricities of the English official.

reference_spacy_tokens: Unaccustomed to such strange behavior , the monks gossiped with delight about the strange eccentricities of the English official .


fn_spacy_tokens_for_baseline: The tough military response on both days appeared to signal a new Israeli strategy to confront escalating guerrilla attacks by Hezbollah .

source_bert_toks: the tough military response on both days appeared to signal a new israeli strategy to confront es ##cala ##ting guerrilla attacks by hezbollah .

reference_raw: The hard military reaction on both days seemed to signal a new Israeli strategy to confront the escalating Hezbollah guerrilla attacks.

reference_spacy_tokens: The hard military reaction on both days seemed to signal a new Israeli strategy to confront the escalating Hezbollah guerrilla attacks .


fn_spacy_tokens_for_baseline: It was ridiculous to miss such a beautiful exciting time of day for a mark on a clock .

source_bert_toks: it was ridiculous to miss such a beautiful exciting time of day for a mark on a clock .

reference_raw: It was ludicrous to miss such a wonderful time of day for a sign on the clock.

reference_spacy_tokens: It was ludicrous to miss such a wonderful time of day for a sign on the clock .


fn_spacy_tokens_for_baseline: She pressed up against me , her fingers tickling my codpiece though I knew she was after my purse .

source_bert_toks: she pressed up against me , her fingers tick ##ling my cod ##piece though i knew she was after my purse .

reference_raw: She pressed against me, her fingers twitching my codpiece, though I knew she was after my purse.

reference_spacy_tokens: She pressed against me , her fingers twitching my codpiece , though I knew she was after my purse .


fn_spacy_tokens_for_baseline: She never noticed if Alexandra was fully dressed or had stumbled straight from sleep in her night clothes but would welcome her always with the sweetest of smiles and a gentle reproof for leaving her alone .

source_bert_toks: she never noticed if alexandra was fully dressed or had stumbled straight from sleep in her night clothes but would welcome her always with the sweet ##est of smiles and a gentle rep ##ro ##of for leaving her alone .

reference_raw: She had never noticed whether Alexandra was fully dressed or had stumbled out of bed in her nightgown, but she would always welcome her with the sweetest of smiles and the gentlest rebuttal of leaving her alone.

reference_spacy_tokens: She had never noticed whether Alexandra was fully dressed or had stumbled out of bed in her nightgown , but she would always welcome her with the sweetest of smiles and the gentlest rebuttal of leaving her alone .


fn_spacy_tokens_for_baseline: For over a century any non - Spaniards who entered the area claimed by Spain were likely to be called pirates .

source_bert_toks: for over a century any non - spaniards who entered the area claimed by spain were likely to be called pirates .

reference_raw: For more than a century, all non-Spaniards who entered the area requested by Spain would probably have been called pirates.

reference_spacy_tokens: For more than a century , all non - Spaniards who entered the area requested by Spain would probably have been called pirates .


fn_spacy_tokens_for_baseline: The sea soughed on the shore .

source_bert_toks: the sea so ##ugh ##ed on the shore .

reference_raw: The sea was sobbing on the shore.

reference_spacy_tokens: The sea was sobbing on the shore .


fn_spacy_tokens_for_baseline: I pointed to the great Tor .

source_bert_toks: i pointed to the great tor .

reference_raw: I gestured at the great Toro.

reference_spacy_tokens: I gestured at the great Toro .


fn_spacy_tokens_for_baseline: I am struck by small objects and my nostrils fill with the stink of rot .

source_bert_toks: i am struck by small objects and my nostrils fill with the stink of rot .

reference_raw: Small objects hit me, and the smell of rot fills my nostrils.

reference_spacy_tokens: Small objects hit me , and the smell of rot fills my nostrils .


fn_spacy_tokens_for_baseline: Like buggery , which generally involves penile penetration of the anus , rape is regarded with extreme gravity and carries a maximum penalty of life imprisonment .

source_bert_toks: like bug ##ger ##y , which generally involves pen ##ile penetration of the an ##us , rape is regarded with extreme gravity and carries a maximum penalty of life imprisonment .

reference_raw: As in the case of buggery, which usually involves penile penetration of the anus, it is considered to be extremely serious and carries the maximum sentence of life imprisonment.

reference_spacy_tokens: As in the case of buggery , which usually involves penile penetration of the anus , it is considered to be extremely serious and carries the maximum sentence of life imprisonment .


fn_spacy_tokens_for_baseline: Vietnam handed over the remains of another six MIAs on Nov. 4 , bringing the total number of servicemen 's remains handed over to date to more than 450 .

source_bert_toks: vietnam handed over the remains of another six mia ##s on nov . 4 , bringing the total number of servicemen ' s remains handed over to date to more than 450 .

reference_raw: On November 4, Vietnam passed on the remains of six more MIAs, bringing the total number of servants' remains passed on to more than 450.

reference_spacy_tokens: On November 4 , Vietnam passed on the remains of six more MIAs , bringing the total number of servants ' remains passed on to more than 450 .


fn_spacy_tokens_for_baseline: There was a strange feel about the place as though somebody or something was watching .

source_bert_toks: there was a strange feel about the place as though somebody or something was watching .

reference_raw: There was a strange sensation in this place, as if someone or something were watching.

reference_spacy_tokens: There was a strange sensation in this place , as if someone or something were watching .


fn_spacy_tokens_for_baseline: I was only smacked once , a fiery look from my Mother being sufficient deterrent for most mischief .

source_bert_toks: i was only smacked once , a fiery look from my mother being sufficient deter ##rent for most mischief .

reference_raw: I've only been slapped once, and my mother's fiery look is enough of a deterrent to most mischief.

reference_spacy_tokens: I 've only been slapped once , and my mother 's fiery look is enough of a deterrent to most mischief .


fn_spacy_tokens_for_baseline: From far off where the Zoo lay the howl of a lone wolf wound up into the night .

source_bert_toks: from far off where the zoo lay the howl of a lone wolf wound up into the night .

reference_raw: From far away, where the zoo lay, the wail of a lone wolf ended up in the night.

reference_spacy_tokens: From far away , where the zoo lay , the wail of a lone wolf ended up in the night .


fn_spacy_tokens_for_baseline: The doctor had fixed it in place in the car , as we waited for the luggage to be stowed .

source_bert_toks: the doctor had fixed it in place in the car , as we waited for the luggage to be st ##owed .

reference_raw: While we waited for the luggage to be stored, the doctor fixed it in the car.

reference_spacy_tokens: While we waited for the luggage to be stored , the doctor fixed it in the car .


fn_spacy_tokens_for_baseline: For example , the management of a retail chain specialising in inexpensive furniture might well decide that the goal of quality is not its first priority .

source_bert_toks: for example , the management of a retail chain specialising in inexpensive furniture might well decide that the goal of quality is not its first priority .

reference_raw: For example, the management of a retail chain specialising in cheap furniture may well decide that quality is not a first priority.

reference_spacy_tokens: For example , the management of a retail chain specialising in cheap furniture may well decide that quality is not a first priority .


fn_spacy_tokens_for_baseline: Chinese fables spoke of the abyss that lay in the waters to the east .

source_bert_toks: chinese fable ##s spoke of the abyss that lay in the waters to the east .

reference_raw: The Chinese legends spoke of a chasm that lay in the waters to the east.

reference_spacy_tokens: The Chinese legends spoke of a chasm that lay in the waters to the east .


fn_spacy_tokens_for_baseline: From Victoria Peak , Hong Kong 's highest point , or from skyscrapers and hotels , they are especially exciting at night when the lights are on .

source_bert_toks: from victoria peak , hong kong ' s highest point , or from skyscraper ##s and hotels , they are especially exciting at night when the lights are on .

reference_raw: From Victoria Peak, the tallest point in Hong Kong, or from skyscrapers and hotels, it's particularly exciting at night when the lights are on.

reference_spacy_tokens: From Victoria Peak , the tallest point in Hong Kong , or from skyscrapers and hotels , it 's particularly exciting at night when the lights are on .


fn_spacy_tokens_for_baseline: Ingmar 's big bushy eyebrows quivered with indignation like two chilly black mice .

source_bert_toks: ing ##mar ' s big bush ##y eyebrows quiver ##ed with ind ##ign ##ation like two chilly black mice .

reference_raw: Ingmar's large, bushy eyebrows twitched indignantly like two cold black mice.

reference_spacy_tokens: Ingmar 's large , bushy eyebrows twitched indignantly like two cold black mice .


fn_spacy_tokens_for_baseline: He wore a white T - shirt with multi - coloured writing , denim jeans and scruffy white trainers .

source_bert_toks: he wore a white t - shirt with multi - coloured writing , denim jeans and sc ##ruff ##y white trainers .

reference_raw: He was dressed in a white shirt with multicolored writing, jeans, and scrawny white coaches.

reference_spacy_tokens: He was dressed in a white shirt with multicolored writing , jeans , and scrawny white coaches .


fn_spacy_tokens_for_baseline: Firemen fought a small fire in a first floor room of a house in Gerard Street , Spennymoor , just after 7 pm last night .

source_bert_toks: fire ##men fought a small fire in a first floor room of a house in gerard street , sp ##en ##ny ##moor , just after 7 pm last night .

reference_raw: The firefighters were battling a small fire in the first-floor room of the house on Gerard Street, Spennymoor, just after seven o'clock last night.

reference_spacy_tokens: The firefighters were battling a small fire in the first - floor room of the house on Gerard Street , Spennymoor , just after seven o'clock last night .


fn_spacy_tokens_for_baseline: Then the examining magistrate changed his mind , released Mr Laroche and charged Mrs Villemin with killing her own son .

source_bert_toks: then the examining magistrate changed his mind , released mr la ##ro ##che and charged mrs ville ##min with killing her own son .

reference_raw: Then the examiner changed his mind, dismissed Mr. Laroche and accused Mrs. Villemin of the murder of her own son.

reference_spacy_tokens: Then the examiner changed his mind , dismissed Mr. Laroche and accused Mrs. Villemin of the murder of her own son .


fn_spacy_tokens_for_baseline: Wadland told Northampton Crown Court : ' I am well aware I 've done a lot of hurt and damage .

source_bert_toks: wa ##dl ##and told northampton crown court : ' i am well aware i ' ve done a lot of hurt and damage .

reference_raw: Wadland said to Northampton Crown Court, "I know I've done so much damage and damage.

reference_spacy_tokens: Wadland said to Northampton Crown Court , " I know I 've done so much damage and damage .


fn_spacy_tokens_for_baseline: It was also very cramped -- more of a coal hole than a cellar -- and there was only just room for both of them to crouch under the trap door and wait .

source_bert_toks: it was also very cramped - - more of a coal hole than a cellar - - and there was only just room for both of them to crouch under the trap door and wait .

reference_raw: It was also very cramped-more like a coal hole than a basement-and there was only room for the two of them to duck under the trapdoor and wait.

reference_spacy_tokens: It was also very cramped - more like a coal hole than a basement - and there was only room for the two of them to duck under the trapdoor and wait .


fn_spacy_tokens_for_baseline: There 's one single - breasted raincoat which has been in every collection for almost 20 seasons .

source_bert_toks: there ' s one single - breast ##ed rain ##coat which has been in every collection for almost 20 seasons .

reference_raw: There's a single-breasted coat that's been in each collection for nearly 20 seasons.

reference_spacy_tokens: There 's a single - breasted coat that 's been in each collection for nearly 20 seasons .


fn_spacy_tokens_for_baseline: Dressing up as a 50 's teenager is encouraged but by no means compulsory and any man dusting off his dad 's winkle pickers gets an award for merit !

source_bert_toks: dressing up as a 50 ' s teenager is encouraged but by no means compulsory and any man dustin ##g off his dad ' s wink ##le pick ##ers gets an award for merit !

reference_raw: Dressing up like a 50-year-old is encouraged, but it's not mandatory, and any man who dusts off his father's winkle pickers receives a prize for merit!

reference_spacy_tokens: Dressing up like a 50-year - old is encouraged , but it 's not mandatory , and any man who dusts off his father 's winkle pickers receives a prize for merit !


fn_spacy_tokens_for_baseline: So they flew , until they reached the shores of a lake .

source_bert_toks: so they flew , until they reached the shores of a lake .

reference_raw: So they flew until they reached the shores of the pool.

reference_spacy_tokens: So they flew until they reached the shores of the pool .


fn_spacy_tokens_for_baseline: Such a violation would have occurred if Iran introduced nuclear material into the facility to test it , without informing the IAEA .

source_bert_toks: such a violation would have occurred if iran introduced nuclear material into the facility to test it , without informing the ia ##ea .

reference_raw: Such a breach would occur if Iran introduced nuclear material into the facility for testing without informing the IAEA.

reference_spacy_tokens: Such a breach would occur if Iran introduced nuclear material into the facility for testing without informing the IAEA .


fn_spacy_tokens_for_baseline: I was utterly devastated by my father 's death .

source_bert_toks: i was utterly devastated by my father ' s death .

reference_raw: My father's death destroyed me.

reference_spacy_tokens: My father 's death destroyed me .


fn_spacy_tokens_for_baseline: I sheathe the gun and walk over to Darius , and place my fist gently on his chest .

source_bert_toks: i sheath ##e the gun and walk over to darius , and place my fist gently on his chest .

reference_raw: I put the gun away and went to Darius and laid my fist gently on his chest.

reference_spacy_tokens: I put the gun away and went to Darius and laid my fist gently on his chest .


fn_spacy_tokens_for_baseline: ' We must assist these children and I am told there are already 30 children on the waiting list for assessment . '

source_bert_toks: ' we must assist these children and i am told there are already 30 children on the waiting list for assessment . '

reference_raw: "We've got to help these kids, and I'm told there's already thirty kids on the waiting list for evaluation."

reference_spacy_tokens: " We 've got to help these kids , and I 'm told there 's already thirty kids on the waiting list for evaluation . "


fn_spacy_tokens_for_baseline: Another thing she disapproved of was his passionate interest in the other sex .

source_bert_toks: another thing she di ##sa ##pp ##roved of was his passionate interest in the other sex .

reference_raw: The other thing she didn't approve of was his passionate interest in the other sex.

reference_spacy_tokens: The other thing she did n't approve of was his passionate interest in the other sex .


fn_spacy_tokens_for_baseline: Tom Horrocks dropped his head , hands at his knees , groaning and smiling up at them .

source_bert_toks: tom ho ##rro ##cks dropped his head , hands at his knees , groaning and smiling up at them .

reference_raw: Tom Horrocks lowered his head, hands on his knees, moaning and grinning.

reference_spacy_tokens: Tom Horrocks lowered his head , hands on his knees , moaning and grinning .


fn_spacy_tokens_for_baseline: In order to conciliate the Ukrainian peasants , the agrarian policy of the Party should not be implemented .

source_bert_toks: in order to con ##ci ##lia ##te the ukrainian peasants , the agrarian policy of the party should not be implemented .

reference_raw: The agricultural policy of the Party should not be implemented in order to reconcile the Ukrainian farmers.

reference_spacy_tokens: The agricultural policy of the Party should not be implemented in order to reconcile the Ukrainian farmers .


fn_spacy_tokens_for_baseline: Otters are very shy animals and for their peace of mind require an undisturbed stretch of riverbank , preferably several miles in length .

source_bert_toks: otter ##s are very shy animals and for their peace of mind require an und ##ist ##urbed stretch of river ##bank , prefer ##ably several miles in length .

reference_raw: Otters are very shy animals, and for their peace of mind they need an undisturbed section of the riverbank, preferably a few miles long.

reference_spacy_tokens: Otters are very shy animals , and for their peace of mind they need an undisturbed section of the riverbank , preferably a few miles long .


fn_spacy_tokens_for_baseline: Following yesterday 's revival in fortunes , the London share market was in a despondent mood as the Treasury deflated hopes of early interest rate cuts .

source_bert_toks: following yesterday ' s revival in fortunes , the london share market was in a des ##pon ##dent mood as the treasury def ##lated hopes of early interest rate cuts .

reference_raw: After yesterday's recovery, the London stock market was in a desperate mood as the Treasury deflated hopes for early interest rate cuts.

reference_spacy_tokens: After yesterday 's recovery , the London stock market was in a desperate mood as the Treasury deflated hopes for early interest rate cuts .


fn_spacy_tokens_for_baseline: The rebels seemed stunned by the sudden counterattack by pro - Kadafi forces .

source_bert_toks: the rebels seemed stunned by the sudden counterattack by pro - ka ##da ##fi forces .

reference_raw: The rebels seemed stunned by the sudden counter-attack of pro-Kadafi troops.

reference_spacy_tokens: The rebels seemed stunned by the sudden counter - attack of pro - Kadafi troops .


fn_spacy_tokens_for_baseline: Suddenly he rose from his chair , gave a quick look round the office , then went across to the window , where he stood looking down into the courtyard .

source_bert_toks: suddenly he rose from his chair , gave a quick look round the office , then went across to the window , where he stood looking down into the courtyard .

reference_raw: Suddenly he got out of his chair, glanced around the office, and crossed to the window, where he stood staring out into the courtyard.

reference_spacy_tokens: Suddenly he got out of his chair , glanced around the office , and crossed to the window , where he stood staring out into the courtyard .


fn_spacy_tokens_for_baseline: He puts a scarf around his head to try to sleep .

source_bert_toks: he puts a scarf around his head to try to sleep .

reference_raw: He puts a shawl around his head and tries to sleep.

reference_spacy_tokens: He puts a shawl around his head and tries to sleep .


fn_spacy_tokens_for_baseline: Photographers were asked to pay fifty pounds a head to take pictures of the troubled businessman , who 's facing theft and fraud charges .

source_bert_toks: photographers were asked to pay fifty pounds a head to take pictures of the troubled businessman , who ' s facing theft and fraud charges .

reference_raw: The photographers have been asked to pay fifty pounds a head to photograph a troubled businessman facing a robbery and fraud charge.

reference_spacy_tokens: The photographers have been asked to pay fifty pounds a head to photograph a troubled businessman facing a robbery and fraud charge .


fn_spacy_tokens_for_baseline: Dubai , UAE : International Paint ( Gulf ) has secured a contract in Iran worth more than US$ 1.5 million to refurbish an oil refinery and supply depots .

source_bert_toks: dubai , uae : international paint ( gulf ) has secured a contract in iran worth more than us $ 1 . 5 million to ref ##ur ##bis ##h an oil refinery and supply depot ##s .

reference_raw: Dubai, UAE: International Paint (Gulf) has secured in Iran a contract of over USD 1.5 million for the renovation of the oil refinery and supply warehouses.

reference_spacy_tokens: Dubai , UAE : International Paint ( Gulf ) has secured in Iran a contract of over USD 1.5 million for the renovation of the oil refinery and supply warehouses .


fn_spacy_tokens_for_baseline: The lack of a universally accepted definition of terrorism has allowed political leaders to manipulate the term for propaganda purposes .

source_bert_toks: the lack of a universally accepted definition of terrorism has allowed political leaders to manipulate the term for propaganda purposes .

reference_raw: The absence of a universally accepted definition of terrorism allowed political leaders to manipulate the concept for propaganda purposes.

reference_spacy_tokens: The absence of a universally accepted definition of terrorism allowed political leaders to manipulate the concept for propaganda purposes .


fn_spacy_tokens_for_baseline: The department organises occasional conferences , e.g. current annual conference on Medieval and Renaissance Cities .

source_bert_toks: the department organise ##s occasional conferences , e . g . current annual conference on medieval and renaissance cities .

reference_raw: Occasional conferences, such as the current annual conference on medieval and renaissance cities, are held by the department.

reference_spacy_tokens: Occasional conferences , such as the current annual conference on medieval and renaissance cities , are held by the department .


fn_spacy_tokens_for_baseline: 4:02 a.m. SHIBUMI : Power is back on , and UCSF { medical center } seems to have quieted down for the night ( they were doing triage out in the parking lot from the sound and lights of it ) .

source_bert_toks: 4 : 02 a . m . shi ##bu ##mi : power is back on , and uc ##sf { medical center } seems to have quiet ##ed down for the night ( they were doing tri ##age out in the parking lot from the sound and lights of it ) .

reference_raw: 4:02 A.M. SHIBUMI: The power is back on, and the UCSF {medical center} appears to have calmed down for the night (they've been doing triage in the parking lot by the sound and lights of the car).

reference_spacy_tokens: 4:02 A.M. SHIBUMI : The power is back on , and the UCSF { medical center } appears to have calmed down for the night ( they 've been doing triage in the parking lot by the sound and lights of the car ) .


fn_spacy_tokens_for_baseline: Last week , they were responsible for A Wanted Man ( BBC 2 ) , a powerful trilogy of plays by Malcom McKay about the police interrogation , trial and attempted rehabiliation of a murderer .

source_bert_toks: last week , they were responsible for a wanted man ( bbc 2 ) , a powerful trilogy of plays by mal ##com mckay about the police interrogation , trial and attempted rehab ##ilia ##tion of a murderer .

reference_raw: Last week, they were responsible for the Wanted Man (BBC 2), a powerful threesome of Malcolm McKay's plays in police interrogation, trial, and attempted rehabilitation of the killer.

reference_spacy_tokens: Last week , they were responsible for the Wanted Man ( BBC 2 ) , a powerful threesome of Malcolm McKay 's plays in police interrogation , trial , and attempted rehabilitation of the killer .


fn_spacy_tokens_for_baseline: There were two black lines of metal there , two rails slanting up out of the hangar and disappearing in the darkness

source_bert_toks: there were two black lines of metal there , two rails slant ##ing up out of the hangar and disappearing in the darkness

reference_raw: There were two black lines of metal, two rails sliding from the hangar and disappearing into the darkness.

reference_spacy_tokens: There were two black lines of metal , two rails sliding from the hangar and disappearing into the darkness .


fn_spacy_tokens_for_baseline: Most guilt can be understood as hidden resentment .

source_bert_toks: most guilt can be understood as hidden resentment .

reference_raw: Most of the guilt can be seen as a hidden grudge.

reference_spacy_tokens: Most of the guilt can be seen as a hidden grudge .


fn_spacy_tokens_for_baseline: Additionally , Iran admitted to having imported from China 1.8 tons of nuclear material ( UF6 , UF4 and UO2 ) used to manufacture uranium metal , which is essential in weapons production .

source_bert_toks: additionally , iran admitted to having imported from china 1 . 8 tons of nuclear material ( u ##f ##6 , u ##f ##4 and u ##o ##2 ) used to manufacture uranium metal , which is essential in weapons production .

reference_raw: In addition, Iran admitted that it imported 1.8 tonnes of nuclear material (UF6, UF4 and UO2) from China used for the production of uranium metal, which is crucial for the production of weapons.

reference_spacy_tokens: In addition , Iran admitted that it imported 1.8 tonnes of nuclear material ( UF6 , UF4 and UO2 ) from China used for the production of uranium metal , which is crucial for the production of weapons .


fn_spacy_tokens_for_baseline: Surely I am to know of what I am accused , besides wrenching your brother - in - law from his wife ? '

source_bert_toks: surely i am to know of what i am accused , besides wren ##ching your brother - in - law from his wife ? '

reference_raw: I'm sure I'm supposed to know what I'm accused of, except to take your brother-in-law away from his wife?'

reference_spacy_tokens: I 'm sure I 'm supposed to know what I 'm accused of , except to take your brother - in - law away from his wife ? '