fn_spacy_tokens_for_baseline: ' I could go upstairs this minute and drape myself in gold chains and beautiful bracelets . '

source_bert_toks: ' i could go upstairs this minute and dr ##ape myself in gold chains and beautiful bracelet ##s . '

reference_raw: "Now I can go up and hang myself in gold chains and beautiful bracelets."

reference_spacy_tokens: " Now I can go up and hang myself in gold chains and beautiful bracelets . "


fn_spacy_tokens_for_baseline: There is rich irony in President Bush 's complaint yesterday of sexual harassment against the wife of an American soldier .

source_bert_toks: there is rich irony in president bush ' s complaint yesterday of sexual harassment against the wife of an american soldier .

reference_raw: There's a lot of irony in President Bush's complaint yesterday that he was sexually harassed by an American soldier's wife.

reference_spacy_tokens: There 's a lot of irony in President Bush 's complaint yesterday that he was sexually harassed by an American soldier 's wife .


fn_spacy_tokens_for_baseline: These feelings were baffling and bewitching .

source_bert_toks: these feelings were ba ##ff ##ling and be ##wi ##tch ##ing .

reference_raw: These feelings were confusing and charming.

reference_spacy_tokens: These feelings were confusing and charming .


fn_spacy_tokens_for_baseline: Each borough is allowed a squad of 10 players , two of whom must be female , and these females must be involved in every game of the round robin competition sponsored by Littlewoods / Reebok .

source_bert_toks: each borough is allowed a squad of 10 players , two of whom must be female , and these females must be involved in every game of the round robin competition sponsored by little ##woods / re ##eb ##ok .

reference_raw: Each borough has a team of 10 players, two of whom have to be female, and these women have to participate in all the round Robin competitions sponsored by Littlewoods/Reebok.

reference_spacy_tokens: Each borough has a team of 10 players , two of whom have to be female , and these women have to participate in all the round Robin competitions sponsored by Littlewoods / Reebok .


fn_spacy_tokens_for_baseline: This is important because many devices for measuring low flow speeds in turn require calibration .

source_bert_toks: this is important because many devices for measuring low flow speeds in turn require cal ##ib ##ration .

reference_raw: This is important because many devices for measuring low-flow speeds need to be calibrated.

reference_spacy_tokens: This is important because many devices for measuring low - flow speeds need to be calibrated .


fn_spacy_tokens_for_baseline: They drank , and ate salt peanuts , and ordered more beer .

source_bert_toks: they drank , and ate salt peanuts , and ordered more beer .

reference_raw: They drank, ate salt nuts, and ordered more beer.

reference_spacy_tokens: They drank , ate salt nuts , and ordered more beer .


fn_spacy_tokens_for_baseline: As you get off , the 52 - story Jardine House with porthole - shaped windows catches the eye .

source_bert_toks: as you get off , the 52 - story jar ##dine house with port ##hole - shaped windows catches the eye .

reference_raw: When you get out, the 52 - the story of Jardine House with the window - the shaped windows catch your eye.

reference_spacy_tokens: When you get out , the 52 - the story of Jardine House with the window - the shaped windows catch your eye .


fn_spacy_tokens_for_baseline: When he came to , he was disorientated , staring blankly at a man sitting with his back to him .

source_bert_toks: when he came to , he was di ##sor ##ient ##ated , staring blankly at a man sitting with his back to him .

reference_raw: When he awoke, he was disoriented, staring blankly at the man sitting with his back to him.

reference_spacy_tokens: When he awoke , he was disoriented , staring blankly at the man sitting with his back to him .


fn_spacy_tokens_for_baseline: The depression is one myth ; the sluggishness of privatisation another .

source_bert_toks: the depression is one myth ; the slug ##gis ##hn ##ess of pri ##vati ##sation another .

reference_raw: Depression is one myth; the slowness of privatisation is another.

reference_spacy_tokens: Depression is one myth ; the slowness of privatisation is another .


fn_spacy_tokens_for_baseline: From Patterdale walk to Grisedale Tarn at the head of the Grisedale valley , along a broad trackway which becomes a bridleway ( 5 miles ) .

source_bert_toks: from pat ##ter ##dale walk to gr ##ised ##ale tar ##n at the head of the gr ##ised ##ale valley , along a broad track ##way which becomes a br ##id ##le ##way ( 5 miles ) .

reference_raw: From Patterdale, at the head of the Grisedale Valley, walks to Grisedale Tarne, along a wide path that becomes a bridge (5 miles).

reference_spacy_tokens: From Patterdale , at the head of the Grisedale Valley , walks to Grisedale Tarne , along a wide path that becomes a bridge ( 5 miles ) .


fn_spacy_tokens_for_baseline: In addition the late appearance of the peptide in some of the morbidly obese subjects could be associated with perturbation of appetite control in these subjects .

source_bert_toks: in addition the late appearance of the peptide in some of the mor ##bid ##ly obe ##se subjects could be associated with per ##tur ##bation of appetite control in these subjects .

reference_raw: In addition, the delayed appearance of peptide in some patients with morbid obesity may be associated with the perturbation of appetite control in these patients.

reference_spacy_tokens: In addition , the delayed appearance of peptide in some patients with morbid obesity may be associated with the perturbation of appetite control in these patients .


fn_spacy_tokens_for_baseline: My parents called me Glen after the bandleader who took one too many cross - channel flights Swing was the music they 'd grown up with and courted to .

source_bert_toks: my parents called me glen after the band ##leader who took one too many cross - channel flights swing was the music they ' d grown up with and court ##ed to .

reference_raw: My parents called me Glen after a bandleader who took too many cross-channel flights Swing was the music they grew up with and admired.

reference_spacy_tokens: My parents called me Glen after a bandleader who took too many cross - channel flights Swing was the music they grew up with and admired .


fn_spacy_tokens_for_baseline: He 'll be ridiculed , he 'll be mocked , he 'll be scourged , you know something reserved for the people who were really being taught a lesson .

source_bert_toks: he ' ll be rid ##ic ##uled , he ' ll be mocked , he ' ll be sc ##our ##ged , you know something reserved for the people who were really being taught a lesson .

reference_raw: He's mocked, he's mocked, he's scoured, you know, something reserved for people who actually learned a lesson.

reference_spacy_tokens: He 's mocked , he 's mocked , he 's scoured , you know , something reserved for people who actually learned a lesson .


fn_spacy_tokens_for_baseline: Garway 's learning and his frugality were widely admired , and he seems to have demanded of the government the same standards .

source_bert_toks: ga ##r ##way ' s learning and his fr ##uga ##lity were widely admired , and he seems to have demanded of the government the same standards .

reference_raw: Garway's education and his brutality were widely admired, and he seemed to demand the same standards from the government.

reference_spacy_tokens: Garway 's education and his brutality were widely admired , and he seemed to demand the same standards from the government .


fn_spacy_tokens_for_baseline: Breed are the kind of band who will begin to write a tormented love song and watch it develop into a bloody massacre .

source_bert_toks: breed are the kind of band who will begin to write a tormented love song and watch it develop into a bloody massacre .

reference_raw: Breeds are the kind of group that starts writing a tortured love song and watches it turn into a bloody carnage.

reference_spacy_tokens: Breeds are the kind of group that starts writing a tortured love song and watches it turn into a bloody carnage .


fn_spacy_tokens_for_baseline: The mines have long been closed but a relic survives in a blacksmith 's forge behind the crumbled walls .

source_bert_toks: the mines have long been closed but a relic survives in a blacksmith ' s forge behind the cr ##umble ##d walls .

reference_raw: The mines have been closed for a long time, but the relic survives in the smith's forge behind the shattered walls.

reference_spacy_tokens: The mines have been closed for a long time , but the relic survives in the smith 's forge behind the shattered walls .


fn_spacy_tokens_for_baseline: The natural gas will be liquefied and then exported to the United States and Europe .

source_bert_toks: the natural gas will be li ##que ##fied and then exported to the united states and europe .

reference_raw: Natural gas will be liquidated and then exported to the United States and Europe.

reference_spacy_tokens: Natural gas will be liquidated and then exported to the United States and Europe .


fn_spacy_tokens_for_baseline: In about a.d . 30 he and his followers went for Passover to Jerusalem , which was in unrest at this time , dissatisfied with Roman domination .

source_bert_toks: in about a . d . 30 he and his followers went for pass ##over to jerusalem , which was in unrest at this time , dissatisfied with roman domination .

reference_raw: About thirty years later, he and his followers went to Jerusalem for Passover, which was in turmoil and dissatisfactory with the rule of Rome.

reference_spacy_tokens: About thirty years later , he and his followers went to Jerusalem for Passover , which was in turmoil and dissatisfactory with the rule of Rome .


fn_spacy_tokens_for_baseline: Nenna was ashamed , but she could n't make amends , not now .

source_bert_toks: ne ##nna was ashamed , but she couldn ' t make amend ##s , not now .

reference_raw: Nenna was ashamed of herself, but she could not make up for it, not now.

reference_spacy_tokens: Nenna was ashamed of herself , but she could not make up for it , not now .


fn_spacy_tokens_for_baseline: Roped perilously to the ice face , the German pair drowsed through the night .

source_bert_toks: rope ##d per ##ilo ##usly to the ice face , the german pair dr ##ows ##ed through the night .

reference_raw: The German couple roted dangerously to the ice face and slept through the night.

reference_spacy_tokens: The German couple roted dangerously to the ice face and slept through the night .


fn_spacy_tokens_for_baseline: But he quieted her with gentle lips , untangled their limbs and they stood up , pressed into each other .

source_bert_toks: but he quiet ##ed her with gentle lips , un ##tangled their limbs and they stood up , pressed into each other .

reference_raw: But he softened her with his lips, untangled their limbs, and they rose and pressed together.

reference_spacy_tokens: But he softened her with his lips , untangled their limbs , and they rose and pressed together .


fn_spacy_tokens_for_baseline: I found a boxful around the back .

source_bert_toks: i found a box ##ful around the back .

reference_raw: I found a box in the back.

reference_spacy_tokens: I found a box in the back .


fn_spacy_tokens_for_baseline: McConkey had started the day celebrating his retirement as headmaster of Gransha Primary School .

source_bert_toks: mcc ##on ##key had started the day celebrating his retirement as headmaster of gran ##sha primary school .

reference_raw: McConkey began the day he was retired as headmaster of Gransha's primary school.

reference_spacy_tokens: McConkey began the day he was retired as headmaster of Gransha 's primary school .


fn_spacy_tokens_for_baseline: the evidence strongly indicates that employers are not especially concerned with the educational attainment of young workers in those sectors of the labour market in which such individuals tend to seek employment .

source_bert_toks: the evidence strongly indicates that employers are not especially concerned with the educational attain ##ment of young workers in those sectors of the labour market in which such individuals tend to seek employment .

reference_raw: The evidence strongly suggests that employers are not particularly concerned with the educational attainment of young workers in those sectors of the labour market where they tend to seek employment.

reference_spacy_tokens: The evidence strongly suggests that employers are not particularly concerned with the educational attainment of young workers in those sectors of the labour market where they tend to seek employment .


fn_spacy_tokens_for_baseline: But lacking the means to enforce its decision , the United Nations was powerless to halt the fighting that erupted as the British withdrew their troops in 1948 .

source_bert_toks: but lacking the means to enforce its decision , the united nations was powerless to halt the fighting that erupted as the british withdrew their troops in 1948 .

reference_raw: The UN, however, lacked the resources to enforce its decision, was unable to stop the battle that had erupted when the British withdrew their troops in 1948.

reference_spacy_tokens: The UN , however , lacked the resources to enforce its decision , was unable to stop the battle that had erupted when the British withdrew their troops in 1948 .


fn_spacy_tokens_for_baseline: Yet it sounds an oddly unrealistic assumption , especially for a theory proudly named Realism !

source_bert_toks: yet it sounds an oddly un ##real ##istic assumption , especially for a theory proudly named realism !

reference_raw: But that sounds strangely unrealistic, especially for a theory proudly called Realism!

reference_spacy_tokens: But that sounds strangely unrealistic , especially for a theory proudly called Realism !


fn_spacy_tokens_for_baseline: European pistes are becoming more and more overcrowded and there is a move away from the endless queues for the ski - lifts .

source_bert_toks: european pi ##ste ##s are becoming more and more over ##crow ##ded and there is a move away from the endless queue ##s for the ski - lifts .

reference_raw: European pists are becoming more and more crowded, moving away from the endless line of ski lifts.

reference_spacy_tokens: European pists are becoming more and more crowded , moving away from the endless line of ski lifts .


fn_spacy_tokens_for_baseline: I tried to reason with her that he should know about the baby but she refused to call back or write to him .

source_bert_toks: i tried to reason with her that he should know about the baby but she refused to call back or write to him .

reference_raw: I tried to convince her to tell him about the baby, but she refused to call him back or text him.

reference_spacy_tokens: I tried to convince her to tell him about the baby , but she refused to call him back or text him .


fn_spacy_tokens_for_baseline: One was a stout , red - faced woman with a straw bonnet and blue ribbons .

source_bert_toks: one was a stout , red - faced woman with a straw bonnet and blue ribbons .

reference_raw: One of them was a stout, red-faced woman with a straw hat and blue ribbons.

reference_spacy_tokens: One of them was a stout , red - faced woman with a straw hat and blue ribbons .


fn_spacy_tokens_for_baseline: Sha Tin is the site of the Monastery of 10,000 Buddhas , which looks down on a burgeoning town .

source_bert_toks: sha tin is the site of the monastery of 10 , 000 buddha ##s , which looks down on a bu ##rgeon ##ing town .

reference_raw: Sha Tin is a place of 10,000 Buddhas' temple that looks down on a burgeoning city.

reference_spacy_tokens: Sha Tin is a place of 10,000 Buddhas ' temple that looks down on a burgeoning city .


fn_spacy_tokens_for_baseline: It was to be the fastest All - weather lifeboat in the RNLI fleet , with a design speed of 25 knots .

source_bert_toks: it was to be the fastest all - weather lifeboat in the rn ##li fleet , with a design speed of 25 knots .

reference_raw: It was supposed to be the quickest all-weather lifeboat in the RNLI fleet, with a design speed of 25 knots.

reference_spacy_tokens: It was supposed to be the quickest all - weather lifeboat in the RNLI fleet , with a design speed of 25 knots .


fn_spacy_tokens_for_baseline: But Justice Department officials were mum on what was said , even initially refusing to confirm that the review was taking place Wednesday .

source_bert_toks: but justice department officials were mum on what was said , even initially refusing to confirm that the review was taking place wednesday .

reference_raw: But the Justice Department officials were the mothers of what was said, even at first refusing to confirm that the review was being held on Wednesday.

reference_spacy_tokens: But the Justice Department officials were the mothers of what was said , even at first refusing to confirm that the review was being held on Wednesday .


fn_spacy_tokens_for_baseline: A short bus ride away is Cheung Sha Beach , 3 km ( 2 miles ) long , and popular for its white sand and excellent facilities .

source_bert_toks: a short bus ride away is cheung sha beach , 3 km ( 2 miles ) long , and popular for its white sand and excellent facilities .

reference_raw: Cheung Sha Beach is a short bus trip, three kilometers (two miles) long and popular for its white sand and excellent equipment.

reference_spacy_tokens: Cheung Sha Beach is a short bus trip , three kilometers ( two miles ) long and popular for its white sand and excellent equipment .


fn_spacy_tokens_for_baseline: Large holes in pipes were visible , as well as burn marks left when the leaking sodium combusted on contact with air .

source_bert_toks: large holes in pipes were visible , as well as burn marks left when the leaking sodium comb ##ust ##ed on contact with air .

reference_raw: There were large holes in the pipes, and there were burn marks left when the leaking sodium burst into contact with the air.

reference_spacy_tokens: There were large holes in the pipes , and there were burn marks left when the leaking sodium burst into contact with the air .


fn_spacy_tokens_for_baseline: Early this year , U. S. intelligence agents issued an alert that Abu Musab Zarqawi , whose network is believed to extend far beyond Iraq , had dispatched teams of battle - hardened operatives to European capitals .

source_bert_toks: early this year , u . s . intelligence agents issued an alert that abu musa ##b za ##r ##qa ##wi , whose network is believed to extend far beyond iraq , had dispatched teams of battle - hardened operatives to european capitals .

reference_raw: At the beginning of this year, U.S. intelligence agents announced that Abu Musab Zarqawi, whose network is believed to extend far beyond Iraq, had sent a team of battle-hardened agents to the European capitals.

reference_spacy_tokens: At the beginning of this year , U.S. intelligence agents announced that Abu Musab Zarqawi , whose network is believed to extend far beyond Iraq , had sent a team of battle - hardened agents to the European capitals .


fn_spacy_tokens_for_baseline: In addition to the basic schedule of topics which was covered with everyone I developed special questions and rescheduled parts of interviews to fit the immediate circumstances of the person being interviewed .

source_bert_toks: in addition to the basic schedule of topics which was covered with everyone i developed special questions and res ##ched ##uled parts of interviews to fit the immediate circumstances of the person being interviewed .

reference_raw: In addition to the basic list of topics covered by everyone, I developed specific questions and changed the parts of the interviews in order to meet the immediate circumstances of the person being questioned.

reference_spacy_tokens: In addition to the basic list of topics covered by everyone , I developed specific questions and changed the parts of the interviews in order to meet the immediate circumstances of the person being questioned .


fn_spacy_tokens_for_baseline: Such dichotomous standpoints are , however , somewhat misleading since both groups are involved in policy formulation .

source_bert_toks: such di ##cho ##tom ##ous stand ##points are , however , somewhat misleading since both groups are involved in policy formulation .

reference_raw: However, such dichotomous points of view are somewhat misleading, since both groups are involved in policy-making.

reference_spacy_tokens: However , such dichotomous points of view are somewhat misleading , since both groups are involved in policy - making .


fn_spacy_tokens_for_baseline: The traditional line item approach to budgeting , is , in this respect , expedient since it can easily accommodate a myriad of views as to what the objectives should be .

source_bert_toks: the traditional line item approach to budget ##ing , is , in this respect , ex ##ped ##ient since it can easily accommodate a myriad of views as to what the objectives should be .

reference_raw: In this context, the traditional line-line approach to budgeting is appropriate, as it can easily accommodate a multitude of views on what objectives should be.

reference_spacy_tokens: In this context , the traditional line - line approach to budgeting is appropriate , as it can easily accommodate a multitude of views on what objectives should be .


fn_spacy_tokens_for_baseline: encouraging all parents to see the dangers of condoned truancy by describing pupil time off school in easily understood and immediate terms , for example in terms of work missed ( eg 20 English lessons and 20 maths lessons ) rather than as a poor attendance rate ( eg 60 % ) .

source_bert_toks: encouraging all parents to see the dangers of condo ##ned tr ##uan ##cy by describing pupil time off school in easily understood and immediate terms , for example in terms of work missed ( e ##g 20 english lessons and 20 math ##s lessons ) rather than as a poor attendance rate ( e ##g 60 % ) .

reference_raw: encouraging all parents to understand the dangers of condoning truancy by describing school leave in an easily understandable and immediate manner, e.g. in terms of missed work (e.g. 20 English and 20 mathematical lessons) rather than in terms of low attendance rates (e.g. 60%).

reference_spacy_tokens: encouraging all parents to understand the dangers of condoning truancy by describing school leave in an easily understandable and immediate manner , e.g. in terms of missed work ( e.g. 20 English and 20 mathematical lessons ) rather than in terms of low attendance rates ( e.g. 60 % ) .


fn_spacy_tokens_for_baseline: Their longtime leader is on the run , his compound ransacked , his once - ubiquitous image now employed on doormats .

source_bert_toks: their longtime leader is on the run , his compound ran ##sack ##ed , his once - ubiquitous image now employed on door ##mat ##s .

reference_raw: Their long-time leader is on the loose, and his compound is gone, and his once-ubiquitous image is now used on the doormats.

reference_spacy_tokens: Their long - time leader is on the loose , and his compound is gone , and his once - ubiquitous image is now used on the doormats .


fn_spacy_tokens_for_baseline: At first , especially when she divulged that she was recovering from a nervous breakdown , I assumed that she merely desired a consoling chat with her sister 's old tutor . '

source_bert_toks: at first , especially when she di ##vu ##lge ##d that she was recovering from a nervous breakdown , i assumed that she merely desired a con ##sol ##ing chat with her sister ' s old tutor . '

reference_raw: At first, especially when she told me she was recovering from a nervous breakdown, I assumed she just wanted to talk to her sister's old teacher.'

reference_spacy_tokens: At first , especially when she told me she was recovering from a nervous breakdown , I assumed she just wanted to talk to her sister 's old teacher . '


fn_spacy_tokens_for_baseline: Dampen the cake drum with water .

source_bert_toks: damp ##en the cake drum with water .

reference_raw: Wet the cake drum with water.

reference_spacy_tokens: Wet the cake drum with water .


fn_spacy_tokens_for_baseline: The French king is well guarded and he covets that ring more than honour itself .

source_bert_toks: the french king is well guarded and he cove ##ts that ring more than honour itself .

reference_raw: The King of France is well guarded and desires that ring more than honor itself.

reference_spacy_tokens: The King of France is well guarded and desires that ring more than honor itself .


fn_spacy_tokens_for_baseline: Just beyond the station , Elmers End bus garage was built and opened , also in 1929 .

source_bert_toks: just beyond the station , elmer ##s end bus garage was built and opened , also in 1929 .

reference_raw: On the other side of the station, the Elmers End bus house was built and opened, also in 1929.

reference_spacy_tokens: On the other side of the station , the Elmers End bus house was built and opened , also in 1929 .


fn_spacy_tokens_for_baseline: This resulted in Morrissey being pelted with a pound of sausages at a future gig .

source_bert_toks: this resulted in morris ##sey being pe ##lt ##ed with a pound of sausage ##s at a future gig .

reference_raw: As a result, Morrissey was peeled with a pound of sausages for the next concert.

reference_spacy_tokens: As a result , Morrissey was peeled with a pound of sausages for the next concert .


fn_spacy_tokens_for_baseline: She began to mince them into a fragrant green hill on the board in front of her .

source_bert_toks: she began to min ##ce them into a fra ##grant green hill on the board in front of her .

reference_raw: She began to force them into the scented green hill on the board in front of her.

reference_spacy_tokens: She began to force them into the scented green hill on the board in front of her .


fn_spacy_tokens_for_baseline: At the end of the first public showing of her new collections Lisa was obliged by the uproar of cheering from the crowd to step out on stage and take a bow .

source_bert_toks: at the end of the first public showing of her new collections lisa was obliged by the up ##ro ##ar of cheering from the crowd to step out on stage and take a bow .

reference_raw: At the end of the first public demonstration of her new lines, Lisa was forced to stand on the stage and bow to the cheers of the crowd.

reference_spacy_tokens: At the end of the first public demonstration of her new lines , Lisa was forced to stand on the stage and bow to the cheers of the crowd .


fn_spacy_tokens_for_baseline: Bardsley untied his apron and hung up the tea cloth that , appropriately enough in this flat , was a large linen facsimile of a pound note .

source_bert_toks: bard ##sley un ##tie ##d his apron and hung up the tea cloth that , appropriately enough in this flat , was a large linen fa ##cs ##imi ##le of a pound note .

reference_raw: Bardsley unbuckled his apron and hung up a tea-cloth which, in this apartment, was a large linen fax with a pound note.

reference_spacy_tokens: Bardsley unbuckled his apron and hung up a tea - cloth which , in this apartment , was a large linen fax with a pound note .


fn_spacy_tokens_for_baseline: Come with us to enjoy Mount Usher whose lilies , poppies and peonies gladdened the heart of William Robinson .

source_bert_toks: come with us to enjoy mount usher whose lil ##ies , pop ##pies and pe ##oni ##es glad ##dened the heart of william robinson .

reference_raw: Come with us to enjoy Mount Usher, whose lilies, poppies, and peonies delighted William Robinson's heart.

reference_spacy_tokens: Come with us to enjoy Mount Usher , whose lilies , poppies , and peonies delighted William Robinson 's heart .


fn_spacy_tokens_for_baseline: Data can also be pasted into word processing documents .

source_bert_toks: data can also be paste ##d into word processing documents .

reference_raw: The data may also be inserted in word-processing documents.

reference_spacy_tokens: The data may also be inserted in word - processing documents .


fn_spacy_tokens_for_baseline: Yet by far the most moving part of the whole day was the reaction of the crowds which lined the streets .

source_bert_toks: yet by far the most moving part of the whole day was the reaction of the crowds which lined the streets .

reference_raw: But by far the most moving part of the day was the reaction of the crowds in the streets.

reference_spacy_tokens: But by far the most moving part of the day was the reaction of the crowds in the streets .


fn_spacy_tokens_for_baseline: During festivals , the square springs to life with excitement and color .

source_bert_toks: during festivals , the square springs to life with excitement and color .

reference_raw: During the festivals, the square comes alive with excitement and color.

reference_spacy_tokens: During the festivals , the square comes alive with excitement and color .


fn_spacy_tokens_for_baseline: There are more moving images at Middleton , in south - east Leeds , where the world 's first commercial railway was opened to carry truckloads of coal from Middleton Colliery to the city 's mills .

source_bert_toks: there are more moving images at middleton , in south - east leeds , where the world ' s first commercial railway was opened to carry truck ##load ##s of coal from middleton colliery to the city ' s mills .

reference_raw: There are other moving pictures in Middleton, Southeast Leeds, where the first commercial railroad in the world was opened to transport coal trucks from Middleton Colliery to the mills of the city.

reference_spacy_tokens: There are other moving pictures in Middleton , Southeast Leeds , where the first commercial railroad in the world was opened to transport coal trucks from Middleton Colliery to the mills of the city .


fn_spacy_tokens_for_baseline: The lining is calf leather and there is a comfortable insole of shaped close cell foam .

source_bert_toks: the lining is calf leather and there is a comfortable ins ##ole of shaped close cell foam .

reference_raw: The lining is the skin of the calves, and there is a comfortable insulation of the shaped close-cell foam.

reference_spacy_tokens: The lining is the skin of the calves , and there is a comfortable insulation of the shaped close - cell foam .


fn_spacy_tokens_for_baseline: " The General Assembly should set aside money for a new state health lab , millions of doses of antiviral drugs and a fund to help meet basic needs after a disaster , a legislative panel recommended Thursday .

source_bert_toks: " the general assembly should set aside money for a new state health lab , millions of doses of anti ##vira ##l drugs and a fund to help meet basic needs after a disaster , a legislative panel recommended thursday .

reference_raw: "The General Assembly should set aside money for a new state health laboratory, millions of doses of antiviral drugs, and a fund to help meet basic needs in the event of a disaster, which was recommended by the Legislative Council on Thursday.

reference_spacy_tokens: " The General Assembly should set aside money for a new state health laboratory , millions of doses of antiviral drugs , and a fund to help meet basic needs in the event of a disaster , which was recommended by the Legislative Council on Thursday .


fn_spacy_tokens_for_baseline: They went back into the anteroom , but the door through to the theatre remained open .

source_bert_toks: they went back into the ant ##ero ##om , but the door through to the theatre remained open .

reference_raw: They returned to the front room, but the theater door remained open.

reference_spacy_tokens: They returned to the front room , but the theater door remained open .


fn_spacy_tokens_for_baseline: Most patients do not regularly wear compression hosiery .

source_bert_toks: most patients do not regularly wear compression ho ##sier ##y .

reference_raw: Most patients do not wear compression hosiers on a regular basis.

reference_spacy_tokens: Most patients do not wear compression hosiers on a regular basis .


fn_spacy_tokens_for_baseline: Negotiations between Israel and the Palestinian authority have finally resumed .

source_bert_toks: negotiations between israel and the palestinian authority have finally resumed .

reference_raw: Finally, negotiations between Israel and the Palestinian Authority continued.

reference_spacy_tokens: Finally , negotiations between Israel and the Palestinian Authority continued .


fn_spacy_tokens_for_baseline: She was more rueful than ever , so that Charles stopped dancing and if he did n't quite haul her off the dance floor , he was rather brusque .

source_bert_toks: she was more rue ##ful than ever , so that charles stopped dancing and if he didn ' t quite haul her off the dance floor , he was rather br ##us ##que .

reference_raw: She was sadder than ever, so Charles stopped dancing, and if he hadn't quite pulled her off the dance floor, he was quite brusque.

reference_spacy_tokens: She was sadder than ever , so Charles stopped dancing , and if he had n't quite pulled her off the dance floor , he was quite brusque .


fn_spacy_tokens_for_baseline: She fell down at school today and grazed her knees , but she did n't bat an eyelid . '

source_bert_toks: she fell down at school today and grazed her knees , but she didn ' t bat an eye ##lid . '

reference_raw: She fell in school today and scratched her knees, but didn't hit her eyelid.'

reference_spacy_tokens: She fell in school today and scratched her knees , but did n't hit her eyelid . '


fn_spacy_tokens_for_baseline: IAEA inspectors did not found either , though they did find imported equipment and technology at a number of previously secret nuclear facilities in and around Tripoli .

source_bert_toks: ia ##ea inspectors did not found either , though they did find imported equipment and technology at a number of previously secret nuclear facilities in and around tripoli .

reference_raw: The IAEA inspectors did not find either, but they found imported equipment and technology in a number of pre-secret nuclear installations in and around Tripoli.

reference_spacy_tokens: The IAEA inspectors did not find either , but they found imported equipment and technology in a number of pre - secret nuclear installations in and around Tripoli .


fn_spacy_tokens_for_baseline: They filed into the temple , a stream of garish colour and silly hats and bare white flesh .

source_bert_toks: they filed into the temple , a stream of ga ##rish colour and silly hats and bare white flesh .

reference_raw: They entered the temple, a stream of bright colors and stupid hats and bare white meat.

reference_spacy_tokens: They entered the temple , a stream of bright colors and stupid hats and bare white meat .


fn_spacy_tokens_for_baseline: He stopped again by the pavilion and , with his eyes fixed on Gabriel and a demented grin on his pock - marked face , rent the golden cloth from bottom to top .

source_bert_toks: he stopped again by the pavilion and , with his eyes fixed on gabriel and a dem ##ented grin on his po ##ck - marked face , rent the golden cloth from bottom to top .

reference_raw: He stopped at the pavilion again and, with his eyes fixed on Gabriel and a demented smile on his pock-marked face, borrowed the golden cloth from the bottom to the top.

reference_spacy_tokens: He stopped at the pavilion again and , with his eyes fixed on Gabriel and a demented smile on his pock - marked face , borrowed the golden cloth from the bottom to the top .


fn_spacy_tokens_for_baseline: In the first instance she arranges the marriage of Elgiva to the sensitive and naive king .

source_bert_toks: in the first instance she arrange ##s the marriage of el ##gi ##va to the sensitive and naive king .

reference_raw: In the first place, he arranges for Elgiva to be married to a sensitive and naive king.

reference_spacy_tokens: In the first place , he arranges for Elgiva to be married to a sensitive and naive king .


fn_spacy_tokens_for_baseline: I could tell by numerous subtle signs , which might have been lost upon anyone but myself , that Holmes was on a hot scent .

source_bert_toks: i could tell by numerous subtle signs , which might have been lost upon anyone but myself , that holmes was on a hot scent .

reference_raw: From a number of subtle signs, which could have been lost to anyone but me, I could see that Holmes was hot.

reference_spacy_tokens: From a number of subtle signs , which could have been lost to anyone but me , I could see that Holmes was hot .


fn_spacy_tokens_for_baseline: Dyring the championship year , Dorigo and Whyte proved excellent at anticipating the long ball , nipping in , and knocking it back .

source_bert_toks: d ##yr ##ing the championship year , do ##ri ##go and why ##te proved excellent at anticipating the long ball , ni ##pping in , and knocking it back .

reference_raw: During the championship year, Dorigo and Whyte proved to be perfect at anticipating a long ball, nipping in and knocking it back.

reference_spacy_tokens: During the championship year , Dorigo and Whyte proved to be perfect at anticipating a long ball , nipping in and knocking it back .


fn_spacy_tokens_for_baseline: Additionally , the insufficiency of the existing electrical infrastructure and dwindling oil revenues contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements .

source_bert_toks: additionally , the ins ##uf ##fi ##ciency of the existing electrical infrastructure and d ##wind ##ling oil revenues contributed to the withdrawal of foreign suppliers from iran and the abandonment of nuclear power agreements .

reference_raw: In addition, the lack of existing electricity infrastructure and the decline in the revenue from diesel fuel contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements.

reference_spacy_tokens: In addition , the lack of existing electricity infrastructure and the decline in the revenue from diesel fuel contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements .


fn_spacy_tokens_for_baseline: ' Yes , the old man battered me when I was a kid , ' Frank said , and laughed again .

source_bert_toks: ' yes , the old man battered me when i was a kid , ' frank said , and laughed again .

reference_raw: 'Yes, the old man beat me when I was little,' Frank said, laughing again.

reference_spacy_tokens: ' Yes , the old man beat me when I was little , ' Frank said , laughing again .


fn_spacy_tokens_for_baseline: ' A shore station , I should n't wonder , ' Lucinda hazarded .

source_bert_toks: ' a shore station , i shouldn ' t wonder , ' lucinda hazard ##ed .

reference_raw: 'I shouldn't be surprised at the shore station,' said Lucinda.

reference_spacy_tokens: ' I should n't be surprised at the shore station , ' said Lucinda .


fn_spacy_tokens_for_baseline: Many roadblocks remain and progress is likely to be painful and slow .

source_bert_toks: many road ##block ##s remain and progress is likely to be painful and slow .

reference_raw: Many roadblocks remain and progress will probably be painful and slow.

reference_spacy_tokens: Many roadblocks remain and progress will probably be painful and slow .


fn_spacy_tokens_for_baseline: Eventually , the shelter received word that the alleged hijacker 5 miles away had been a medevac helicopter .

source_bert_toks: eventually , the shelter received word that the alleged hi ##jack ##er 5 miles away had been a med ##eva ##c helicopter .

reference_raw: Finally, the shelter received word that the supposed hijacker was a medevac helicopter five miles away.

reference_spacy_tokens: Finally , the shelter received word that the supposed hijacker was a medevac helicopter five miles away .


fn_spacy_tokens_for_baseline: A GANG of 10 men bludgeoned a mother - of - three to death with pickaxe handles and baseball bats after she was warned to stop throwing wild parties .

source_bert_toks: a gang of 10 men blu ##dge ##oned a mother - of - three to death with pick ##ax ##e handles and baseball bats after she was warned to stop throwing wild parties .

reference_raw: A group of ten men beat a mother of three to death with pickaxe handles and baseball bats after being warned not to throw wild parties.

reference_spacy_tokens: A group of ten men beat a mother of three to death with pickaxe handles and baseball bats after being warned not to throw wild parties .


fn_spacy_tokens_for_baseline: ' A ketch called Masquerade , presently marooned on Straker 's Cay . '

source_bert_toks: ' a ke ##tch called mas ##que ##rade , presently maroon ##ed on st ##rak ##er ' s ca ##y . '

reference_raw: 'A ketch called the Masquerade, soon marooned in Straker's Bay.'

reference_spacy_tokens: ' A ketch called the Masquerade , soon marooned in Straker 's Bay . '


fn_spacy_tokens_for_baseline: No wonder he belted her one now and again .

source_bert_toks: no wonder he belt ##ed her one now and again .

reference_raw: It's no wonder he taped it to her from time to time.

reference_spacy_tokens: It 's no wonder he taped it to her from time to time .


fn_spacy_tokens_for_baseline: It was as good as a ballet to watch Finn eat but Francie mopped gravy with bread and chewed bones from his fingers .

source_bert_toks: it was as good as a ballet to watch finn eat but fran ##cie mo ##pped gr ##av ##y with bread and chewed bones from his fingers .

reference_raw: Watching Finn eat was as good as a ballet, but France wiped the sauce with bread and bit the bones off his fingers.

reference_spacy_tokens: Watching Finn eat was as good as a ballet , but France wiped the sauce with bread and bit the bones off his fingers .


fn_spacy_tokens_for_baseline: In 1985 , its rooms in the Ancien Palais d'Expositions , which had been provided by the city , were damaged by a hailstorm and the Centre was evacuated .

source_bert_toks: in 1985 , its rooms in the an ##cie ##n palais d ' exposition ##s , which had been provided by the city , were damaged by a hail ##storm and the centre was evacuated .

reference_raw: In 1985, the city's rooms at the Ancien Palais d'Expositions were damaged by a storm and the Centre was evacuated.

reference_spacy_tokens: In 1985 , the city 's rooms at the Ancien Palais d'Expositions were damaged by a storm and the Centre was evacuated .


fn_spacy_tokens_for_baseline: They hibernate during the dry season by burrowing deep into the damp sand .

source_bert_toks: they hi ##ber ##nate during the dry season by burr ##owing deep into the damp sand .

reference_raw: During the dry season, they hibernate by burying themselves deep in the wet sand.

reference_spacy_tokens: During the dry season , they hibernate by burying themselves deep in the wet sand .


fn_spacy_tokens_for_baseline: The feast proceeded in dainty silence until a bare fish skeleton the size of a heavy bolter lay on the platter before each celebrant , and their stone steins stood empty .

source_bert_toks: the feast proceeded in dai ##nty silence until a bare fish skeleton the size of a heavy bolt ##er lay on the platt ##er before each ce ##le ##bra ##nt , and their stone stein ##s stood empty .

reference_raw: The banquet continued in dainty silence until a naked fish skeleton, the size of a heavy screwdriver, lay on the plate in front of each of the celebrants, and their stone stews were empty.

reference_spacy_tokens: The banquet continued in dainty silence until a naked fish skeleton , the size of a heavy screwdriver , lay on the plate in front of each of the celebrants , and their stone stews were empty .


fn_spacy_tokens_for_baseline: Twin rooms have a sea view and balcony adorned with flowers and plants .

source_bert_toks: twin rooms have a sea view and balcony adorned with flowers and plants .

reference_raw: The twin rooms have a view of the sea and a balcony decorated with flowers and plants.

reference_spacy_tokens: The twin rooms have a view of the sea and a balcony decorated with flowers and plants .


fn_spacy_tokens_for_baseline: He was becoming agitated .

source_bert_toks: he was becoming agitated .

reference_raw: He was starting to get upset.

reference_spacy_tokens: He was starting to get upset .


fn_spacy_tokens_for_baseline: Priests wishing to concelebrate please bring alb and white stole .

source_bert_toks: priests wishing to con ##cel ##eb ##rate please bring al ##b and white stole .

reference_raw: Priests who want to celebrate, please bring alb and white theft.

reference_spacy_tokens: Priests who want to celebrate , please bring alb and white theft .


fn_spacy_tokens_for_baseline: He then returned to Newcastle as medical registrar to work with Professor F. J. Nattrass and became interested in neurology , acquiring the MD ( Durham ) and MRCP ( 1940 ) .

source_bert_toks: he then returned to newcastle as medical registrar to work with professor f . j . nat ##tra ##ss and became interested in ne ##uro ##logy , acquiring the md ( durham ) and mr ##cp ( 1940 ) .

reference_raw: Then he went back to Newcastle as a medical registrar to work with Professor F.J. Nattrass, and became interested in neurological, acquired MD (Durham) and MRCP (1940).

reference_spacy_tokens: Then he went back to Newcastle as a medical registrar to work with Professor F.J. Nattrass , and became interested in neurological , acquired MD ( Durham ) and MRCP ( 1940 ) .


fn_spacy_tokens_for_baseline: Joseph looked out through the windows and saw three small Annamese children dressed in traditional silk tunics like their parents walking on the lawns below the terrace in the company of a plainly garbed Annamese servant .

source_bert_toks: joseph looked out through the windows and saw three small anna ##mes ##e children dressed in traditional silk tunic ##s like their parents walking on the lawn ##s below the terrace in the company of a plainly ga ##rb ##ed anna ##mes ##e servant .

reference_raw: Joseph looked out the window and saw three little Annamese children, dressed in traditional silk tunics, as if their parents were walking on the lawns beneath the terrace in the company of a plainly dressed Annamese servant.

reference_spacy_tokens: Joseph looked out the window and saw three little Annamese children , dressed in traditional silk tunics , as if their parents were walking on the lawns beneath the terrace in the company of a plainly dressed Annamese servant .


fn_spacy_tokens_for_baseline: The boy was by now so full of cake he was like a sackful of wet cement and you could n't have hurt him with a sledge - hammer .

source_bert_toks: the boy was by now so full of cake he was like a sack ##ful of wet cement and you couldn ' t have hurt him with a sl ##edge - hammer .

reference_raw: The boy was already so full of cake that he looked like a bag full of wet concrete that you couldn't hurt him with a hammer.

reference_spacy_tokens: The boy was already so full of cake that he looked like a bag full of wet concrete that you could n't hurt him with a hammer .


fn_spacy_tokens_for_baseline: The MacBrides separated after two years .

source_bert_toks: the mac ##bri ##des separated after two years .

reference_raw: After two years, the MacBrides split up.

reference_spacy_tokens: After two years , the MacBrides split up .


fn_spacy_tokens_for_baseline: Marks paid dlrs 5,000 to an undercover FBI agent he met on a remote bayou near Baton Rouge , La. , in 1985 for what he thought was 37 pounds of plastic explosives .

source_bert_toks: marks paid dl ##rs 5 , 000 to an undercover fbi agent he met on a remote bayou near baton rouge , la . , in 1985 for what he thought was 37 pounds of plastic explosives .

reference_raw: Marks paid $5,000 to an undercover FBI agent he met in a remote bay near Baton Rouge, La., in 1985 for what he thought was 37 pounds of plastic explosives.

reference_spacy_tokens: Marks paid $ 5,000 to an undercover FBI agent he met in a remote bay near Baton Rouge , La. , in 1985 for what he thought was 37 pounds of plastic explosives .


fn_spacy_tokens_for_baseline: He was handcuffed to the North Shore .

source_bert_toks: he was hand ##cu ##ffed to the north shore .

reference_raw: He was chained to the North Shore.

reference_spacy_tokens: He was chained to the North Shore .


fn_spacy_tokens_for_baseline: Collective security , which had been understood as an alternative to the diplomacy discredited by the catastrophe of 1914 , became increasingly difficult to distinguish from the traditional pursuit of a balance of power in Europe .

source_bert_toks: collective security , which had been understood as an alternative to the diplomacy disc ##red ##ited by the catastrophe of 1914 , became increasingly difficult to distinguish from the traditional pursuit of a balance of power in europe .

reference_raw: Collective security, which was seen as an alternative to diplomacy discredited by the 1914 disaster, became increasingly difficult to distinguish from the traditional pursuit of a balance of power in Europe.

reference_spacy_tokens: Collective security , which was seen as an alternative to diplomacy discredited by the 1914 disaster , became increasingly difficult to distinguish from the traditional pursuit of a balance of power in Europe .


fn_spacy_tokens_for_baseline: Plumping up the pillows , she set them against the padded headrest and left , closing the door behind her .

source_bert_toks: plump ##ing up the pillows , she set them against the padded head ##rest and left , closing the door behind her .

reference_raw: She plucked up the cushions, put them on the padded headrest, and left, closing the door behind her.

reference_spacy_tokens: She plucked up the cushions , put them on the padded headrest , and left , closing the door behind her .


fn_spacy_tokens_for_baseline: Excuses based on weather conditions , visibility and the condition of the road surface etc . are generally poor defences , unless the driver takes immediate evasive action .

source_bert_toks: excuses based on weather conditions , visibility and the condition of the road surface etc . are generally poor defences , unless the driver takes immediate eva ##sive action .

reference_raw: In general, excuses based on weather conditions, visibility and road surface conditions, etc. are poor defenses, unless the driver takes immediate action to avoid them.

reference_spacy_tokens: In general , excuses based on weather conditions , visibility and road surface conditions , etc . are poor defenses , unless the driver takes immediate action to avoid them .


fn_spacy_tokens_for_baseline: He should have seen the face of his right hon . Friend the Member for Finchley when he evaded answering a question about the word ' federal ' .

source_bert_toks: he should have seen the face of his right hon . friend the member for finch ##ley when he evade ##d answering a question about the word ' federal ' .

reference_raw: He should have seen the face of his right sweetheart, a friend of Finchley's, when he avoided answering a question about the word "Federals."

reference_spacy_tokens: He should have seen the face of his right sweetheart , a friend of Finchley 's , when he avoided answering a question about the word " Federals . "


fn_spacy_tokens_for_baseline: His reasons are unclear , though he did say that three out of the recently rescued ' Bangkok Six ' orang - utans ( all weak and traumatised babies ) had died at the Tanjung Puting centre .

source_bert_toks: his reasons are unclear , though he did say that three out of the recently rescued ' bangkok six ' or ##ang - uta ##ns ( all weak and trauma ##tis ##ed babies ) had died at the tan ##jun ##g putin ##g centre .

reference_raw: His reasons are unclear, although he said that three of the recently rescued "Bangkok Six" orang-utans (all weak and traumatized children) died in the Tanjung Puting Center.

reference_spacy_tokens: His reasons are unclear , although he said that three of the recently rescued " Bangkok Six " orang - utans ( all weak and traumatized children ) died in the Tanjung Puting Center .


fn_spacy_tokens_for_baseline: Some men insisted that it was not possible to make your first jump without voiding your bowels .

source_bert_toks: some men insisted that it was not possible to make your first jump without void ##ing your bow ##els .

reference_raw: Some men insisted you couldn't make the first jump without emptying your guts.

reference_spacy_tokens: Some men insisted you could n't make the first jump without emptying your guts .


fn_spacy_tokens_for_baseline: The floor area will be some 4 x 3 feet ( 1.25 x 1 metre ) and the hutch will be sited outside , not inside any other building .

source_bert_toks: the floor area will be some 4 x 3 feet ( 1 . 25 x 1 metre ) and the hut ##ch will be sited outside , not inside any other building .

reference_raw: The floor space will be approximately 4 x 3 feet (1.25 x 1 metre) and the hut will be located outside, not in any other building.

reference_spacy_tokens: The floor space will be approximately 4 x 3 feet ( 1.25 x 1 metre ) and the hut will be located outside , not in any other building .


fn_spacy_tokens_for_baseline: Her mother and brother had departed to the kitchen from where Wexford could hear their muted whisperings and the funereally careful clink of cups .

source_bert_toks: her mother and brother had departed to the kitchen from where wexford could hear their muted whispering ##s and the fun ##ere ##ally careful cl ##ink of cups .

reference_raw: Her mother and brother left for the kitchen, where Wexford could hear their muffled whispers and the funerally careful click of cups.

reference_spacy_tokens: Her mother and brother left for the kitchen , where Wexford could hear their muffled whispers and the funerally careful click of cups .


fn_spacy_tokens_for_baseline: Later , she wore an extravagant Russian - style creation for the church blessing .

source_bert_toks: later , she wore an extravagant russian - style creation for the church blessing .

reference_raw: Later, she was wearing an extravagant Russian-style thing for a church bliss.

reference_spacy_tokens: Later , she was wearing an extravagant Russian - style thing for a church bliss .


fn_spacy_tokens_for_baseline: You can take a ferryboat through the harbor , past the ingenious Plover Cove reservoir , a water catchment area appropriated by damming and draining a broad inlet from the sea .

source_bert_toks: you can take a ferry ##boat through the harbor , past the ing ##eni ##ous pl ##over cove reservoir , a water catchment area appropriated by dam ##ming and draining a broad inlet from the sea .

reference_raw: You can take a ferry ship through the port, past the ingenious pool of Plover Cove, a river basin suitable for damming and draining a wide inlet from the sea.

reference_spacy_tokens: You can take a ferry ship through the port , past the ingenious pool of Plover Cove , a river basin suitable for damming and draining a wide inlet from the sea .


fn_spacy_tokens_for_baseline: There 's something pseudo about him . '

source_bert_toks: there ' s something pseudo about him . '

reference_raw: There's something phony about it.'

reference_spacy_tokens: There 's something phony about it . '


fn_spacy_tokens_for_baseline: Unfortunately Harry could never understand Dona and Karenin in truing to help the situation made Anna even more dissatisfied with her life .

source_bert_toks: unfortunately harry could never understand dona and karen ##in in tr ##uing to help the situation made anna even more dissatisfied with her life .

reference_raw: Unfortunately, Harry had never understood Dona and Karenin's truce to help her make Anna even more unhappy with her life.

reference_spacy_tokens: Unfortunately , Harry had never understood Dona and Karenin 's truce to help her make Anna even more unhappy with her life .


fn_spacy_tokens_for_baseline: It is OK , though , to hitch a napkin round your neck , even if the last time your wore one was when your nanny tied it for you .

source_bert_toks: it is ok , though , to hitch a napkin round your neck , even if the last time your wore one was when your nanny tied it for you .

reference_raw: But it's okay to put a napkin around your neck, even if the last time you wore it was when your babysitter tied it up for you.

reference_spacy_tokens: But it 's okay to put a napkin around your neck , even if the last time you wore it was when your babysitter tied it up for you .


fn_spacy_tokens_for_baseline: Connor 's voice was gleeful .

source_bert_toks: connor ' s voice was glee ##ful .

reference_raw: Connor's voice was cheerful.

reference_spacy_tokens: Connor 's voice was cheerful .


fn_spacy_tokens_for_baseline: In 1866 he became a Roman Catholic convert , was received into the Church by his model , John Henry Newman [ q.v . ] , and confirmed by Archbishop Henry Manning [ q.v.].

source_bert_toks: in 1866 he became a roman catholic convert , was received into the church by his model , john henry newman [ q . v . ] , and confirmed by archbishop henry manning [ q . v . ] .

reference_raw: In 1866, he became a Roman Catholic converter, was accepted into the church by his model John Henry Newman [q.v.] and endorsed by Archbishop Henry Manning [q.v.].

reference_spacy_tokens: In 1866 , he became a Roman Catholic converter , was accepted into the church by his model John Henry Newman [ q.v . ] and endorsed by Archbishop Henry Manning [ q.v.].


fn_spacy_tokens_for_baseline: The union abstained on the NEC proposals .

source_bert_toks: the union abs ##tained on the nec proposals .

reference_raw: The Union withdrew from the NEC proposals.

reference_spacy_tokens: The Union withdrew from the NEC proposals .


fn_spacy_tokens_for_baseline: The excited chatter hushed as Charles in his capacity of presenter of the affair , came before the curtain .

source_bert_toks: the excited chatter hushed as charles in his capacity of presenter of the affair , came before the curtain .

reference_raw: The excited chatter subsided as Charles, acting as the presenter of the affair, approached the curtain.

reference_spacy_tokens: The excited chatter subsided as Charles , acting as the presenter of the affair , approached the curtain .


fn_spacy_tokens_for_baseline: Most visitors to the Costa del Sol do not plan daytime activities more energetic than lazing on the beach , and save their energy for nightlife .

source_bert_toks: most visitors to the costa del sol do not plan daytime activities more energetic than la ##zing on the beach , and save their energy for night ##life .

reference_raw: Most visitors to Costa del Sol don't schedule daytime activities that are more energy-intensive than lazing on the beach, and save their energy for the night.

reference_spacy_tokens: Most visitors to Costa del Sol do n't schedule daytime activities that are more energy - intensive than lazing on the beach , and save their energy for the night .


fn_spacy_tokens_for_baseline: Even Assistant U.S. Attorney Robert Khuzami has called Salem a liar who fibbed about stupid things , and in opening statements the prosecutor warned jurors they 'd hear a lot of things about the witness they would n't like .

source_bert_toks: even assistant u . s . attorney robert k ##hu ##zam ##i has called salem a liar who fi ##bbed about stupid things , and in opening statements the prosecutor warned ju ##ror ##s they ' d hear a lot of things about the witness they wouldn ' t like .

reference_raw: Even U.S. Attorney Robert Khuzami called Salem a liar who was fiddling with stupid things, and when he made his statement, the D.A. warned the judges that he would hear a lot about a witness they didn't want to hear.

reference_spacy_tokens: Even U.S. Attorney Robert Khuzami called Salem a liar who was fiddling with stupid things , and when he made his statement , the D.A. warned the judges that he would hear a lot about a witness they did n't want to hear .


fn_spacy_tokens_for_baseline: Above : Sun and rockpools in Wildboar Clough :

source_bert_toks: above : sun and rock ##pool ##s in wild ##bo ##ar cl ##ough :

reference_raw: Above: Sun and coils of the Wildboar cloud:

reference_spacy_tokens: Above : Sun and coils of the Wildboar cloud :


fn_spacy_tokens_for_baseline: The provincial police chief in Helmand , Abdul Rahman Jan , whom U. S. forces suspect of providing security for narcotics shipments , kept his job .

source_bert_toks: the provincial police chief in helm ##and , abdul rahman jan , whom u . s . forces suspect of providing security for narcotics shipments , kept his job .

reference_raw: The head of the provincial police in Helmand, Abdul Rahman Jan, suspected by U.S. forces to provide security for narcotics transports, continued to work.

reference_spacy_tokens: The head of the provincial police in Helmand , Abdul Rahman Jan , suspected by U.S. forces to provide security for narcotics transports , continued to work .


fn_spacy_tokens_for_baseline: He went , knowing that the fishermen were being sent back to Berwick with a boatload of provisions , and even some powder and ball , from Dunbar , with offers of more .

source_bert_toks: he went , knowing that the fishermen were being sent back to berwick with a boat ##load of provisions , and even some powder and ball , from dunbar , with offers of more .

reference_raw: He left, knowing that the fishermen were being sent back to Berwick with a load of supplies and even some powder and ball from Dunbar, offering more.

reference_spacy_tokens: He left , knowing that the fishermen were being sent back to Berwick with a load of supplies and even some powder and ball from Dunbar , offering more .


fn_spacy_tokens_for_baseline: She grabbed her chain leather jacket and ran , knock - kneed , towards the door .

source_bert_toks: she grabbed her chain leather jacket and ran , knock - knee ##d , towards the door .

reference_raw: She took hold of her chain leather jacket and ran, knocking, to the door.

reference_spacy_tokens: She took hold of her chain leather jacket and ran , knocking , to the door .


fn_spacy_tokens_for_baseline: It was only thanks to the scene made by Gilly that his admission about their visit to Puddephat 's rooms had gone unnoticed .

source_bert_toks: it was only thanks to the scene made by gill ##y that his admission about their visit to pu ##dd ##ep ##hat ' s rooms had gone unnoticed .

reference_raw: Only because of Gilly's scene had he admitted his visit to Puddephat's rooms unnoticed.

reference_spacy_tokens: Only because of Gilly 's scene had he admitted his visit to Puddephat 's rooms unnoticed .


fn_spacy_tokens_for_baseline: ' So next time you snack on your favourite chocolate bar or bowl of peanuts , remember -- if enjoyed in moderation , they can be good - tasting and might even inhibit cavities , ' it said .

source_bert_toks: ' so next time you snack on your favourite chocolate bar or bowl of peanuts , remember - - if enjoyed in mode ##ration , they can be good - tasting and might even inhibit ca ##vi ##ties , ' it said .

reference_raw: 'So the next time you eat your favorite chocolate bar or a bowl of peanuts, remember - if you like it in moderation, it can taste good and even inhibit the cavities,' he said.

reference_spacy_tokens: ' So the next time you eat your favorite chocolate bar or a bowl of peanuts , remember - if you like it in moderation , it can taste good and even inhibit the cavities , ' he said .


fn_spacy_tokens_for_baseline: Iran has a stockpile of these weapons , including artillery shells and bombs , which could be used in another conflict in the region .

source_bert_toks: iran has a stock ##pile of these weapons , including artillery shells and bombs , which could be used in another conflict in the region .

reference_raw: Iran has a stockpile of these weapons, including artillery shells and bombs, that could be used in any other dispute in the region.

reference_spacy_tokens: Iran has a stockpile of these weapons , including artillery shells and bombs , that could be used in any other dispute in the region .


fn_spacy_tokens_for_baseline: Much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

source_bert_toks: much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

reference_raw: Of course, a great deal of it can't be used by the standards of the best newspapers, because it's mostly rumors that we repeat, though it can certainly make up some very good stories.

reference_spacy_tokens: Of course , a great deal of it ca n't be used by the standards of the best newspapers , because it 's mostly rumors that we repeat , though it can certainly make up some very good stories .


fn_spacy_tokens_for_baseline: So far only five percent of the 350 acre fire is contained , with over 400 firefighters battling the blaze .

source_bert_toks: so far only five percent of the 350 acre fire is contained , with over 400 firefighters battling the blaze .

reference_raw: Up to now, only five percent of the 350-acre fire is contained, and more than 400 firemen are fighting the fire.

reference_spacy_tokens: Up to now , only five percent of the 350-acre fire is contained , and more than 400 firemen are fighting the fire .


fn_spacy_tokens_for_baseline: Ruth sat silent on the stern thwart as the Drowned Forest receded and the boat went out over the glittering water , into emptiness .

source_bert_toks: ruth sat silent on the stern th ##wart as the drowned forest rec ##eded and the boat went out over the glittering water , into emptiness .

reference_raw: Ruth sat in silence on the stern thwart as the Drown Forest receded and the ship sailed across the shimmering water and into the void.

reference_spacy_tokens: Ruth sat in silence on the stern thwart as the Drown Forest receded and the ship sailed across the shimmering water and into the void .


fn_spacy_tokens_for_baseline: Forced to flee the Nazis in 1937 -- leaving behind the 20,000 bibliography volumes -- the older Breslauer resettled his family in London but was killed shortly after in an air - raid .

source_bert_toks: forced to flee the nazis in 1937 - - leaving behind the 20 , 000 bibliography volumes - - the older br ##es ##lau ##er reset ##tled his family in london but was killed shortly after in an air - raid .

reference_raw: He was forced to escape the Nazis in 1937, leaving 20,000 bibliographic volumes behind, and the older Breslauer resettled his family in London, but was killed shortly after that in an air raid.

reference_spacy_tokens: He was forced to escape the Nazis in 1937 , leaving 20,000 bibliographic volumes behind , and the older Breslauer resettled his family in London , but was killed shortly after that in an air raid .


fn_spacy_tokens_for_baseline: The Incident happened in the 1930s when a Hartlepool couple were jailed for attacking a shop owner who 'd remonstrated with them for drinking out of the vinegar bottle .

source_bert_toks: the incident happened in the 1930s when a hart ##le ##pool couple were jailed for attacking a shop owner who ' d re ##mons ##tra ##ted with them for drinking out of the vinegar bottle .

reference_raw: The incident occurred in the 1930s, when a Hartlepool pair was arrested for assaulting a shop owner who protested against them for drinking from a bottle of vinegar.

reference_spacy_tokens: The incident occurred in the 1930s , when a Hartlepool pair was arrested for assaulting a shop owner who protested against them for drinking from a bottle of vinegar .


fn_spacy_tokens_for_baseline: Stewart was thirsting for action , his colour high .

source_bert_toks: stewart was thirst ##ing for action , his colour high .

reference_raw: Stewart was thirsty for action, his color high.

reference_spacy_tokens: Stewart was thirsty for action , his color high .


fn_spacy_tokens_for_baseline: ' Do you need Alexandre and his taxi to drive you out to that godforsaken place ? '

source_bert_toks: ' do you need alexandre and his taxi to drive you out to that god ##for ##sa ##ken place ? '

reference_raw: "You need Alexandre and his cab to take you to that damn place?"

reference_spacy_tokens: " You need Alexandre and his cab to take you to that damn place ? "


fn_spacy_tokens_for_baseline: 27 deaths have been confirmed in Peloponnese , one of the hardest hit areas .

source_bert_toks: 27 deaths have been confirmed in pe ##lo ##pon ##nese , one of the hardest hit areas .

reference_raw: Twenty-seven deaths have been confirmed in Peloponnese, one of the most affected areas.

reference_spacy_tokens: Twenty - seven deaths have been confirmed in Peloponnese , one of the most affected areas .


fn_spacy_tokens_for_baseline: In the Janacek second string quartet Intimate Letters that followed they really cracked the idiom , playing with a perceptive feel for the uniquely arhythmic phrasing that echoes that of the Czech language .

source_bert_toks: in the jana ##cek second string quartet intimate letters that followed they really cracked the id ##iom , playing with a per ##ceptive feel for the uniquely ar ##hy ##th ##mic ph ##ras ##ing that echoes that of the czech language .

reference_raw: In Janacek's second string quartet of intimacy letters that followed, they actually broke the idiom and played with a perceptive sense of the uniquely arhythmic sentence that echoes the Czech language.

reference_spacy_tokens: In Janacek 's second string quartet of intimacy letters that followed , they actually broke the idiom and played with a perceptive sense of the uniquely arhythmic sentence that echoes the Czech language .


fn_spacy_tokens_for_baseline: Beyond them , beyond this enclosure , the lush countryside meanders to its low horizon .

source_bert_toks: beyond them , beyond this enclosure , the lush countryside mean ##ders to its low horizon .

reference_raw: Behind them, behind this enclosure, the luxurious landscape means its low horizon.

reference_spacy_tokens: Behind them , behind this enclosure , the luxurious landscape means its low horizon .


fn_spacy_tokens_for_baseline: In 1982 he started his band Kino , who have grown into the powerful guitar quartet with a distinctive style ; nice pop melodies and hooky chord changes , monotonous vocals and punk drive .

source_bert_toks: in 1982 he started his band kin ##o , who have grown into the powerful guitar quartet with a distinctive style ; nice pop melodies and hook ##y chord changes , mono ##ton ##ous vocals and punk drive .

reference_raw: In 1982, he started his band, Kino, who grew up to be a strong guitar quartette with a distinctive style; nice pop tunes and hooky chords, monotonous voices and punk drives.

reference_spacy_tokens: In 1982 , he started his band , Kino , who grew up to be a strong guitar quartette with a distinctive style ; nice pop tunes and hooky chords , monotonous voices and punk drives .


fn_spacy_tokens_for_baseline: If a voluntary timetable can not be agreed then the Government can ' guillotine ' proceedings .

source_bert_toks: if a voluntary timetable can not be agreed then the government can ' gui ##llo ##tine ' proceedings .

reference_raw: If it is not possible to agree on a voluntary schedule, the government can't proceed with the guillotine.

reference_spacy_tokens: If it is not possible to agree on a voluntary schedule , the government ca n't proceed with the guillotine .


fn_spacy_tokens_for_baseline: And although she felt she was being torn apart inside , at the same time the older woman 's brutal candour was welcome , because it finally answered so many unhappy questions .

source_bert_toks: and although she felt she was being torn apart inside , at the same time the older woman ' s brutal can ##dou ##r was welcome , because it finally answered so many unhappy questions .

reference_raw: And though she felt that she was being torn apart inside, the old woman's brutal honesty was welcome, for she had finally answered so many unfortunate questions.

reference_spacy_tokens: And though she felt that she was being torn apart inside , the old woman 's brutal honesty was welcome , for she had finally answered so many unfortunate questions .


fn_spacy_tokens_for_baseline: The cupboard doors had all been deeply hacked and scored with a knife , every crisp bag had been burst , every stick of rock shattered and splintered : it was a very thorough job .

source_bert_toks: the cupboard doors had all been deeply hacked and scored with a knife , every crisp bag had been burst , every stick of rock shattered and splinter ##ed : it was a very thorough job .

reference_raw: All the doors to the closet were deeply hacked and scored with a knife, all the crisp sacks were broken, all the sticks of rock shattered and shattered: it was a very thorough job.

reference_spacy_tokens: All the doors to the closet were deeply hacked and scored with a knife , all the crisp sacks were broken , all the sticks of rock shattered and shattered : it was a very thorough job .


fn_spacy_tokens_for_baseline: But it was the scene of my first heartbreak .

source_bert_toks: but it was the scene of my first heartbreak .

reference_raw: But that was the scene of my first break in the heart.

reference_spacy_tokens: But that was the scene of my first break in the heart .


fn_spacy_tokens_for_baseline: Richmann 's scowl deepened , but he restrained himself from snapping an answer back at the General .

source_bert_toks: rich ##mann ' s scowl deepened , but he restrained himself from snapping an answer back at the general .

reference_raw: Richmann's frown deepened, but he held back his reply to the general.

reference_spacy_tokens: Richmann 's frown deepened , but he held back his reply to the general .


fn_spacy_tokens_for_baseline: The purpose of this paper is to put forward a case for developing the online catalogue 's potential as an interactive retrieval tool for the library user .

source_bert_toks: the purpose of this paper is to put forward a case for developing the online catalogue ' s potential as an interactive retrieval tool for the library user .

reference_raw: The purpose of this document is to present an example of the development of the potential of the online catalogue as an interactive search tool for the user of the library.

reference_spacy_tokens: The purpose of this document is to present an example of the development of the potential of the online catalogue as an interactive search tool for the user of the library .


fn_spacy_tokens_for_baseline: But at the same time , we are in the preparatory phase for a pullout . "

source_bert_toks: but at the same time , we are in the preparatory phase for a pull ##out . "

reference_raw: But at the same time, we're in the prep phase.

reference_spacy_tokens: But at the same time , we 're in the prep phase .


fn_spacy_tokens_for_baseline: ( Oh , excuse me a minute , my little chaplain is jumping up and down , splattering the parchment with ink .

source_bert_toks: ( oh , excuse me a minute , my little chaplain is jumping up and down , sp ##lat ##tering the parchment with ink .

reference_raw: (Ah, if you'll excuse me for a moment, my little chaplain is bouncing up and down, spraying the parchment with ink.

reference_spacy_tokens: ( Ah , if you 'll excuse me for a moment , my little chaplain is bouncing up and down , spraying the parchment with ink .


fn_spacy_tokens_for_baseline: Swiftly they overran the island , driving their dark kinsfolk into the sea .

source_bert_toks: swiftly they over ##ran the island , driving their dark kin ##sf ##ol ##k into the sea .

reference_raw: They quickly crossed the island and drove their dark relatives into the sea.

reference_spacy_tokens: They quickly crossed the island and drove their dark relatives into the sea .


fn_spacy_tokens_for_baseline: Add dried fruits like sultanas , dried dates , figs , apricots , and also chopped nuts .

source_bert_toks: add dried fruits like sultan ##as , dried dates , fig ##s , apr ##ico ##ts , and also chopped nuts .

reference_raw: Add dried fruits such as sultana, dried data, figs, apricots, as well as sliced nuts.

reference_spacy_tokens: Add dried fruits such as sultana , dried data , figs , apricots , as well as sliced nuts .


fn_spacy_tokens_for_baseline: Salt does not break down or decompose in the pond -- it is diluted by partial water changes .

source_bert_toks: salt does not break down or deco ##mp ##ose in the pond - - it is dil ##uted by partial water changes .

reference_raw: The salt does not break down or decay in the pond - it is diluted by partial changes in water.

reference_spacy_tokens: The salt does not break down or decay in the pond - it is diluted by partial changes in water .


fn_spacy_tokens_for_baseline: Mention of the press 's glee at the humiliation of the investigators behind this summer 's high - profile surveillance project Operation Blackbird , who were fooled by an obvious hoax , brings out Tarr 's own nascent conspiracy theory .

source_bert_toks: mention of the press ' s glee at the humiliation of the investigators behind this summer ' s high - profile surveillance project operation black ##bird , who were fooled by an obvious hoax , brings out tar ##r ' s own nas ##cent conspiracy theory .

reference_raw: The mention of the press's exultation at the humiliation of the investigators behind this summer's high-profile surveillance project, Operation Blackbird, who has been deceived by obvious fraud, draws Tarr's own nascent conspiracy theory.

reference_spacy_tokens: The mention of the press 's exultation at the humiliation of the investigators behind this summer 's high - profile surveillance project , Operation Blackbird , who has been deceived by obvious fraud , draws Tarr 's own nascent conspiracy theory .


fn_spacy_tokens_for_baseline: The form of a verb and sentence stating a thing as a fact , not as a conception , wish or command of a speaker : Apples grow on trees .

source_bert_toks: the form of a verb and sentence stating a thing as a fact , not as a conception , wish or command of a speaker : apples grow on trees .

reference_raw: The form of a verb and a sentence that says something as a fact, not as a concept, wish, or command of a speaker: apples rise on trees.

reference_spacy_tokens: The form of a verb and a sentence that says something as a fact , not as a concept , wish , or command of a speaker : apples rise on trees .


fn_spacy_tokens_for_baseline: In the meantime , I 've cabled for an X - ray report on the fellow 's chest .

source_bert_toks: in the meantime , i ' ve cable ##d for an x - ray report on the fellow ' s chest .

reference_raw: Meanwhile, I've wired for an X-ray report on this guy's chest.

reference_spacy_tokens: Meanwhile , I 've wired for an X - ray report on this guy 's chest .


fn_spacy_tokens_for_baseline: On Sunday , rebel commanders said , Kadafi 's forces were able to take advantage of the sandstorms providing presumed cover from NATO airstrikes to move within striking distance of Ajdabiya .

source_bert_toks: on sunday , rebel commanders said , ka ##da ##fi ' s forces were able to take advantage of the sands ##torm ##s providing presumed cover from nato airs ##tri ##kes to move within striking distance of aj ##da ##bi ##ya .

reference_raw: On Sunday, the rebel commanders said, Kadafi's forces were able to use the sandstorms that provided assumed cover from NATO air strikes to move within striking distance of Ajdabiya.

reference_spacy_tokens: On Sunday , the rebel commanders said , Kadafi 's forces were able to use the sandstorms that provided assumed cover from NATO air strikes to move within striking distance of Ajdabiya .


fn_spacy_tokens_for_baseline: Quality and style exude from every corner .

source_bert_toks: quality and style ex ##ude from every corner .

reference_raw: The quality and style come out of every corner.

reference_spacy_tokens: The quality and style come out of every corner .


fn_spacy_tokens_for_baseline: The Smalls reef is now a designated site which can only be explored by diving teams working alongside the Museum of Wales .

source_bert_toks: the small ##s reef is now a designated site which can only be explored by diving teams working alongside the museum of wales .

reference_raw: The Smalls Cliff is now a designated site that can only be explored by diving teams working alongside the Museum of Wales.

reference_spacy_tokens: The Smalls Cliff is now a designated site that can only be explored by diving teams working alongside the Museum of Wales .


fn_spacy_tokens_for_baseline: But the sodium fluoride episode points to a serious problem faced by North Korea , namely the lack of domestically - manufactured chemical precursors .

source_bert_toks: but the sodium flu ##ori ##de episode points to a serious problem faced by north korea , namely the lack of domestically - manufactured chemical precursor ##s .

reference_raw: However, the episode of sodium fluoride points to a serious problem facing North Korea, namely the absence of domestically produced chemical precursors.

reference_spacy_tokens: However , the episode of sodium fluoride points to a serious problem facing North Korea , namely the absence of domestically produced chemical precursors .


fn_spacy_tokens_for_baseline: However , on sunny Saturdays and Sundays you may have to brave a crowd lining up at the lower terminal .

source_bert_toks: however , on sunny saturdays and sundays you may have to brave a crowd lining up at the lower terminal .

reference_raw: However, on sunny Sundays and Sundays, you may have to brave the crowd that lines up at the bottom of the terminal.

reference_spacy_tokens: However , on sunny Sundays and Sundays , you may have to brave the crowd that lines up at the bottom of the terminal .


fn_spacy_tokens_for_baseline: His blue gaze slanted over her assessingly .

source_bert_toks: his blue gaze slant ##ed over her assessing ##ly .

reference_raw: His blue eyes narrowed over her appreciatively.

reference_spacy_tokens: His blue eyes narrowed over her appreciatively .


fn_spacy_tokens_for_baseline: It teemed down , so back came a soaked Charlie and 1265-X.

source_bert_toks: it tee ##med down , so back came a soaked charlie and 126 ##5 - x .

reference_raw: It was rushing down, so the wet Charlie and 1265-X came back.

reference_spacy_tokens: It was rushing down , so the wet Charlie and 1265-X came back .


fn_spacy_tokens_for_baseline: They stood aside to make way for a blind Indian youth in a parka who was confidently striding down the way with his cane held out before him .

source_bert_toks: they stood aside to make way for a blind indian youth in a park ##a who was confidently st ##riding down the way with his cane held out before him .

reference_raw: They stood to one side to make way for the blind Indian young man in his jacket, who was confidently walking down the road with his staff outstretched in front of him.

reference_spacy_tokens: They stood to one side to make way for the blind Indian young man in his jacket , who was confidently walking down the road with his staff outstretched in front of him .


fn_spacy_tokens_for_baseline: This laboratory is especially active in the area of polymeric materials with the objective of modifying the physical , chemical , biological , and mechanical properties of polymeric materials to render them biocompatible .

source_bert_toks: this laboratory is especially active in the area of polymer ##ic materials with the objective of modifying the physical , chemical , biological , and mechanical properties of polymer ##ic materials to render them bio ##com ##pati ##ble .

reference_raw: The laboratory is particularly active in the field of polymeric materials in order to modify the physical, chemical, biological and mechanical properties of polymeric materials in order to make them biocompatible.

reference_spacy_tokens: The laboratory is particularly active in the field of polymeric materials in order to modify the physical , chemical , biological and mechanical properties of polymeric materials in order to make them biocompatible .


fn_spacy_tokens_for_baseline: So there is a way of escape , a cessation of desire , an achievement of ineffable peace and blessedness .

source_bert_toks: so there is a way of escape , a ce ##ssa ##tion of desire , an achievement of in ##ef ##fa ##ble peace and blessed ##ness .

reference_raw: So there's a way to escape, to stop longing, to achieve inexorable peace and bliss.

reference_spacy_tokens: So there 's a way to escape , to stop longing , to achieve inexorable peace and bliss .


fn_spacy_tokens_for_baseline: 10,000 people were evacuated out of one town , Agios Stefanos , located 23 kilometres from downtown Athens , after the flames headed for the area .

source_bert_toks: 10 , 000 people were evacuated out of one town , ag ##ios stefano ##s , located 23 kilometres from downtown athens , after the flames headed for the area .

reference_raw: Ten thousand people had been evacuated from one city, Agios Stefanos, 23 kilometers from the centre of Athens, after the fires had reached the area.

reference_spacy_tokens: Ten thousand people had been evacuated from one city , Agios Stefanos , 23 kilometers from the centre of Athens , after the fires had reached the area .


fn_spacy_tokens_for_baseline: Anna had been suddenly struck as she pushed open Pricewell 's double glass doors , by the ' Vacancy ' notice pasted to the inside of it .

source_bert_toks: anna had been suddenly struck as she pushed open price ##well ' s double glass doors , by the ' vacancy ' notice paste ##d to the inside of it .

reference_raw: When she opened Pricewell's double glass door, Anna was suddenly struck by the 'Vacancy' notice inserted into it.

reference_spacy_tokens: When she opened Pricewell 's double glass door , Anna was suddenly struck by the ' Vacancy ' notice inserted into it .


fn_spacy_tokens_for_baseline: Further , the streets serve as drying grounds in fine weather ; lines are stretched across from house to house , and hung with wet clothing .

source_bert_toks: further , the streets serve as drying grounds in fine weather ; lines are stretched across from house to house , and hung with wet clothing .

reference_raw: In addition, the streets serve as drying grounds in fine weather; the lines are stretched from house to house, and the clothes are wet.

reference_spacy_tokens: In addition , the streets serve as drying grounds in fine weather ; the lines are stretched from house to house , and the clothes are wet .


fn_spacy_tokens_for_baseline: Jinkwa was stirred by the General 's words .

source_bert_toks: jin ##k ##wa was stirred by the general ' s words .

reference_raw: The General's words moved Jinkwa.

reference_spacy_tokens: The General 's words moved Jinkwa .


fn_spacy_tokens_for_baseline: Second , she contended that her husband misrepresented to her the effect of the legal charge .

source_bert_toks: second , she contend ##ed that her husband mis ##re ##pres ##ented to her the effect of the legal charge .

reference_raw: Secondly, she claimed that her husband had given her an incorrect representation of the effects of the legal charge.

reference_spacy_tokens: Secondly , she claimed that her husband had given her an incorrect representation of the effects of the legal charge .


fn_spacy_tokens_for_baseline: If the cell was sealed off and no gases escaped then all of the power would go into heating the electrolyte .

source_bert_toks: if the cell was sealed off and no gases escaped then all of the power would go into heating the electro ##ly ##te .

reference_raw: If the cell shuts down and no gases leak out, all the energy goes to heating the electrolyte.

reference_spacy_tokens: If the cell shuts down and no gases leak out , all the energy goes to heating the electrolyte .


fn_spacy_tokens_for_baseline: My husband was a native New Yorker , and I could never get him to leave the Big Apple even for a holiday .

source_bert_toks: my husband was a native new yorker , and i could never get him to leave the big apple even for a holiday .

reference_raw: My husband was a native of New York, and I couldn't get him to leave the Big Apple for the holidays.

reference_spacy_tokens: My husband was a native of New York , and I could n't get him to leave the Big Apple for the holidays .


fn_spacy_tokens_for_baseline: Sandy shot a 71 , though , and that left him tied for the lead with David Graham , who we played with , of course , for the third round .

source_bert_toks: sandy shot a 71 , though , and that left him tied for the lead with david graham , who we played with , of course , for the third round .

reference_raw: But Sandy shot 71, which left him in the lead with David Graham, who, of course, we played with in the third round.

reference_spacy_tokens: But Sandy shot 71 , which left him in the lead with David Graham , who , of course , we played with in the third round .


fn_spacy_tokens_for_baseline: Nearly simultaneous protests erupted across the country .

source_bert_toks: nearly simultaneous protests erupted across the country .

reference_raw: There were almost parallel protests all over the country.

reference_spacy_tokens: There were almost parallel protests all over the country .


fn_spacy_tokens_for_baseline: Although highly sexed and eager to make the acquaintance of nubile young ladies , Neville 's gaunt , stooping figure , with its slightly effeminate affectations , had attracted the attention of quite the wrong sort of person .

source_bert_toks: although highly sex ##ed and eager to make the acquaintance of nu ##bil ##e young ladies , neville ' s gaunt , st ##ooping figure , with its slightly e ##ffe ##minate affect ##ations , had attracted the attention of quite the wrong sort of person .

reference_raw: Though highly sexed and eager to meet nubile young women, Neville's thin, stooping figure, with its slightly feminine affections, drew the attention of a very bad sort of person.

reference_spacy_tokens: Though highly sexed and eager to meet nubile young women , Neville 's thin , stooping figure , with its slightly feminine affections , drew the attention of a very bad sort of person .


fn_spacy_tokens_for_baseline: He looked so crestfallen that Old Bulldog did n't know what to do for a minute .

source_bert_toks: he looked so crest ##fall ##en that old bulldog didn ' t know what to do for a minute .

reference_raw: He looked so familiar that for a moment old Bulldog didn't know what to do.

reference_spacy_tokens: He looked so familiar that for a moment old Bulldog did n't know what to do .


fn_spacy_tokens_for_baseline: Others suffer reprimands while the Cowes Organising Committee themselves face a structure review .

source_bert_toks: others suffer rep ##rim ##ands while the cow ##es organising committee themselves face a structure review .

reference_raw: Others suffer rebukes, while the Cowes Organising Committee itself is subject to a structural review.

reference_spacy_tokens: Others suffer rebukes , while the Cowes Organising Committee itself is subject to a structural review .


fn_spacy_tokens_for_baseline: They ate and drank , sitting tucked into long grass that screened them from the river ; they could hear the flow of it , and the occasional plop of a fish .

source_bert_toks: they ate and drank , sitting tucked into long grass that screened them from the river ; they could hear the flow of it , and the occasional pl ##op of a fish .

reference_raw: They ate and drank and sat in the long grass that screened them from the river; they heard the flow of it and the occasional thump of a fish.

reference_spacy_tokens: They ate and drank and sat in the long grass that screened them from the river ; they heard the flow of it and the occasional thump of a fish .


fn_spacy_tokens_for_baseline: The sale 's priciest lot , another Renoir , ' Portrait of Jean Renoir ' , sold within estimates at $ 2.31 million ( £ 1.26 million ) to a South American collector .

source_bert_toks: the sale ' s pri ##cies ##t lot , another reno ##ir , ' portrait of jean reno ##ir ' , sold within estimates at $ 2 . 31 million ( £1 . 26 million ) to a south american collector .

reference_raw: The most expensive lot of the sale, another Renoir, the Portrait of Jean Renoir, sold to a South American collector at an estimated price of $2.31 million (1.26 million).

reference_spacy_tokens: The most expensive lot of the sale , another Renoir , the Portrait of Jean Renoir , sold to a South American collector at an estimated price of $ 2.31 million ( 1.26 million ) .


fn_spacy_tokens_for_baseline: On the other hand , aphids can infect raspberries with incurable virus diseases , and blackcurrant reversion is spread by big - bud mites .

source_bert_toks: on the other hand , ap ##hid ##s can in ##fect ras ##p ##berries with inc ##urable virus diseases , and black ##cu ##rran ##t rev ##ers ##ion is spread by big - bud mit ##es .

reference_raw: Aphids, on the other hand, can infect raspberries with uncurable viral diseases, and blackcurrant reversion is spread through large-bud mites.

reference_spacy_tokens: Aphids , on the other hand , can infect raspberries with uncurable viral diseases , and blackcurrant reversion is spread through large - bud mites .


fn_spacy_tokens_for_baseline: Whether you choose to dine in one of the Macanese , Chinese , traditional Portuguese , or international - style restaurants , you will be treated to a hearty meal at a good price .

source_bert_toks: whether you choose to din ##e in one of the mac ##ane ##se , chinese , traditional portuguese , or international - style restaurants , you will be treated to a heart ##y meal at a good price .

reference_raw: Whether you decide to eat in one of the Macanese, Chinese, traditional Portuguese, or international-style restaurants, you will be treated as a hearty meal for a good price.

reference_spacy_tokens: Whether you decide to eat in one of the Macanese , Chinese , traditional Portuguese , or international - style restaurants , you will be treated as a hearty meal for a good price .


fn_spacy_tokens_for_baseline: Eugene is n't drinking today and appears a shade queasy .

source_bert_toks: eugene isn ' t drinking today and appears a shade que ##as ##y .

reference_raw: Eugene's not drinking today, and it looks a little shady.

reference_spacy_tokens: Eugene 's not drinking today , and it looks a little shady .


fn_spacy_tokens_for_baseline: And there are a lot of people who face these challenges every day of their lives .

source_bert_toks: and there are a lot of people who face these challenges every day of their lives .

reference_raw: And there's a lot of people who are facing these problems every day of their lives.

reference_spacy_tokens: And there 's a lot of people who are facing these problems every day of their lives .


fn_spacy_tokens_for_baseline: The bed - posts are made of fused bones -- hundreds of them -- and the frame of fused ribs and skulls .

source_bert_toks: the bed - posts are made of fused bones - - hundreds of them - - and the frame of fused ribs and skulls .

reference_raw: The bedposts are made of melted bones-hundreds of them-and a frame of melted ribs and skulls.

reference_spacy_tokens: The bedposts are made of melted bones - hundreds of them - and a frame of melted ribs and skulls .


fn_spacy_tokens_for_baseline: He felt faint and nauseous .

source_bert_toks: he felt faint and na ##use ##ous .

reference_raw: He felt weak and sick.

reference_spacy_tokens: He felt weak and sick .


fn_spacy_tokens_for_baseline: The river also irrigates the carefully tended surrounding farmlands , creating a beautifully lush , subtropical scene .

source_bert_toks: the river also ir ##ri ##gate ##s the carefully tended surrounding farmland ##s , creating a beautifully lush , subtropical scene .

reference_raw: The river also irrigates the carefully tended farmlands and creates a beautifully luxurious subtropical scene.

reference_spacy_tokens: The river also irrigates the carefully tended farmlands and creates a beautifully luxurious subtropical scene .


fn_spacy_tokens_for_baseline: He said that it would he possible for the companies working in the electronic trade sector to make Dubai their headquarters , and to establish offices here and provide employment and own machinery in the zone opened to companies fully owned by the foreigners .

source_bert_toks: he said that it would he possible for the companies working in the electronic trade sector to make dubai their headquarters , and to establish offices here and provide employment and own machinery in the zone opened to companies fully owned by the foreigners .

reference_raw: He said that it would be possible for companies operating in the electronic commerce sector to establish their headquarters in Dubai and to establish offices there and provide employment and own machinery in the area open to companies wholly owned by foreigners.

reference_spacy_tokens: He said that it would be possible for companies operating in the electronic commerce sector to establish their headquarters in Dubai and to establish offices there and provide employment and own machinery in the area open to companies wholly owned by foreigners .


fn_spacy_tokens_for_baseline: This is the true stuff not a fictitious one !

source_bert_toks: this is the true stuff not a fictitious one !

reference_raw: This is the real thing, not the fiction!

reference_spacy_tokens: This is the real thing , not the fiction !


fn_spacy_tokens_for_baseline: Pakeezah Begum took the plastic stamp , wetted it on the ink - pad and firmly stamped the return - by date on the leaf at the front .

source_bert_toks: pak ##ee ##za ##h beg ##um took the plastic stamp , wet ##ted it on the ink - pad and firmly stamped the return - by date on the leaf at the front .

reference_raw: Pakeezah Begum picked up the plastic stamp, moistened it on the ink pad, and stamped it firmly on the sheet at the front.

reference_spacy_tokens: Pakeezah Begum picked up the plastic stamp , moistened it on the ink pad , and stamped it firmly on the sheet at the front .


fn_spacy_tokens_for_baseline: With an abstracted look , she removed her sweater and brassiere .

source_bert_toks: with an abstract ##ed look , she removed her sweater and brass ##iere .

reference_raw: She took off her sweater and bra with an abstract look.

reference_spacy_tokens: She took off her sweater and bra with an abstract look .


fn_spacy_tokens_for_baseline: Not for the first time , Reg Butler tried to analyse what was wrong with his son and the way he ran the business .

source_bert_toks: not for the first time , reg butler tried to anal ##yse what was wrong with his son and the way he ran the business .

reference_raw: Not for the first time, Reg Butler tried to analyze what had happened to his son and how he had run the business.

reference_spacy_tokens: Not for the first time , Reg Butler tried to analyze what had happened to his son and how he had run the business .