fn_spacy_tokens_for_baseline: Brushwood is being harvested from woodlands in the Ipswich area by Bill Foreman and other coppice workers to help stabilise the river bed of the Great Ouse in Cambridgeshire .

source_bert_toks: brush ##wood is being harvested from woodlands in the ipswich area by bill foreman and other cop ##pic ##e workers to help stab ##ilis ##e the river bed of the great ou ##se in cambridgeshire .

reference_raw: In order to help stabilise the Great Ouse's riverbed in Cambridgeshire, Brushwood is taken from the forests of the Ipswich region by Bill Foreman and other police officers.

reference_spacy_tokens: In order to help stabilise the Great Ouse 's riverbed in Cambridgeshire , Brushwood is taken from the forests of the Ipswich region by Bill Foreman and other police officers .


fn_spacy_tokens_for_baseline: " We regret , " squawked the public address system , " the delay on the 9:40am flight to Benbecula . because we have left the aircraft seats in Glasgow . "

source_bert_toks: " we regret , " sq ##ua ##wk ##ed the public address system , " the delay on the 9 : 40 ##am flight to ben ##be ##cula . because we have left the aircraft seats in glasgow . "

reference_raw: "We regret," the public address system screeched, "the delay on the 9:40 flight to Benbecula . . . because we've left Glasgow's seats."

reference_spacy_tokens: " We regret , " the public address system screeched , " the delay on the 9:40 flight to Benbecula . . . because we 've left Glasgow 's seats . "


fn_spacy_tokens_for_baseline: Ideas about immorality and what constitutes dishonourable conduct change over time , but the views of judges change more slowly than most .

source_bert_toks: ideas about im ##moral ##ity and what constitutes dish ##ono ##urable conduct change over time , but the views of judges change more slowly than most .

reference_raw: Ideas about immorality and what constitutes dishonorable behavior change over time, but judges' opinions change more slowly than most.

reference_spacy_tokens: Ideas about immorality and what constitutes dishonorable behavior change over time , but judges ' opinions change more slowly than most .


fn_spacy_tokens_for_baseline: Fast scenarios may also be called up and reprojected in relation to the ongoing situation , so that the probable outcome of a current dilemma may be assessed .

source_bert_toks: fast scenarios may also be called up and rep ##ro ##jected in relation to the ongoing situation , so that the probable outcome of a current dilemma may be assessed .

reference_raw: In view of the current situation, rapid scenarios can also be called up and reprojected in order to assess the likely outcome of the current dilemma.

reference_spacy_tokens: In view of the current situation , rapid scenarios can also be called up and reprojected in order to assess the likely outcome of the current dilemma .


fn_spacy_tokens_for_baseline: The new insistence that a text 's mediation in history is important has changed this perspective .

source_bert_toks: the new insistence that a text ' s mediation in history is important has changed this perspective .

reference_raw: The new emphasis on the importance of textual mediation in the past has changed this perspective.

reference_spacy_tokens: The new emphasis on the importance of textual mediation in the past has changed this perspective .


fn_spacy_tokens_for_baseline: In Moscow , visitors are supposed to pass through a metal detector , but one survivor of Monday 's attack said he saw no one being required to do so .

source_bert_toks: in moscow , visitors are supposed to pass through a metal detector , but one survivor of monday ' s attack said he saw no one being required to do so .

reference_raw: Visitors were supposed to pass through a metal detector in Moscow, but one of the survivors of Monday's attack said he didn't see any need for it.

reference_spacy_tokens: Visitors were supposed to pass through a metal detector in Moscow , but one of the survivors of Monday 's attack said he did n't see any need for it .


fn_spacy_tokens_for_baseline: In an attempt to counteract despondency , to reclaim the green world for itself , not solely as a balm for my despair , I arranged with Barry 's help an interview with David Ricalde .

source_bert_toks: in an attempt to counter ##act des ##pon ##den ##cy , to reclaim the green world for itself , not solely as a bal ##m for my despair , i arranged with barry ' s help an interview with david rica ##lde .

reference_raw: In an attempt to counteract despair, to reclaim the green world for myself, not just as a balm for my despair, I've arranged with Barry for an interview with David Ricalde.

reference_spacy_tokens: In an attempt to counteract despair , to reclaim the green world for myself , not just as a balm for my despair , I 've arranged with Barry for an interview with David Ricalde .


fn_spacy_tokens_for_baseline: These divergent views on the demand for money lead to very different policy conclusions .

source_bert_toks: these diver ##gent views on the demand for money lead to very different policy conclusions .

reference_raw: These divergent views on the demand for money lead to very different policy outcomes.

reference_spacy_tokens: These divergent views on the demand for money lead to very different policy outcomes .


fn_spacy_tokens_for_baseline: John Knox preached the reformed faith in Leith .

source_bert_toks: john knox preached the reformed faith in leith .

reference_raw: John Knox proclaimed a reformed faith in Leith.

reference_spacy_tokens: John Knox proclaimed a reformed faith in Leith .


fn_spacy_tokens_for_baseline: ' Remember when America 's economy collapsed , back in forty - six ? '

source_bert_toks: ' remember when america ' s economy collapsed , back in forty - six ? '

reference_raw: "Do you remember when American economics collapsed in forty-six?"

reference_spacy_tokens: " Do you remember when American economics collapsed in forty - six ? "


fn_spacy_tokens_for_baseline: While watching TV , Buck sees a show in which a poodle is made to wear a wig , false eyelashes and panties .

source_bert_toks: while watching tv , buck sees a show in which a po ##odle is made to wear a wig , false eyelashes and panties .

reference_raw: As Buck watches TV, he sees a show where a poodle is made to wear a wig, a fake eyelash, and a pair of pants.

reference_spacy_tokens: As Buck watches TV , he sees a show where a poodle is made to wear a wig , a fake eyelash , and a pair of pants .


fn_spacy_tokens_for_baseline: There must be an independent person to whom children can complain .

source_bert_toks: there must be an independent person to whom children can complain .

reference_raw: There's got to be an independent person who can make a complaint to children.

reference_spacy_tokens: There 's got to be an independent person who can make a complaint to children .


fn_spacy_tokens_for_baseline: A few years ago the cousin of a Sumatran friend of ours was killed by a singularly persistent elephant .

source_bert_toks: a few years ago the cousin of a sumatra ##n friend of ours was killed by a singular ##ly persistent elephant .

reference_raw: A few years ago, our Sumatran friend's nephew was killed by a very persistent elephant.

reference_spacy_tokens: A few years ago , our Sumatran friend 's nephew was killed by a very persistent elephant .


fn_spacy_tokens_for_baseline: They took him and killed him .

source_bert_toks: they took him and killed him .

reference_raw: He was kidnapped and killed.

reference_spacy_tokens: He was kidnapped and killed .


fn_spacy_tokens_for_baseline: April dipped her fingers into a paper cup of cider and flicked it at him before skipping away uphill .

source_bert_toks: april dipped her fingers into a paper cup of cid ##er and flicked it at him before skipping away up ##hill .

reference_raw: April dipped her fingers into a paper cup of cider and flicked it at him before she jumped up the hill.

reference_spacy_tokens: April dipped her fingers into a paper cup of cider and flicked it at him before she jumped up the hill .


fn_spacy_tokens_for_baseline: She shot her cuff and checked her wrist monitor .

source_bert_toks: she shot her cuff and checked her wrist monitor .

reference_raw: She shot the handcuff and looked at the wrist monitor.

reference_spacy_tokens: She shot the handcuff and looked at the wrist monitor .


fn_spacy_tokens_for_baseline: The Commission might , after considering cost and other relevant evidence , establish a range of permissible rates for particular subclasses , with the Postal Service and individual mailers free thereafter to negotiate rates within this range ; or

source_bert_toks: the commission might , after considering cost and other relevant evidence , establish a range of per ##missible rates for particular sub ##class ##es , with the postal service and individual mail ##ers free thereafter to negotiate rates within this range ; or

reference_raw: After considering costs and other relevant evidence, the Commission may set a range of permissible tariffs for certain subclasses, with the postal service and individual mailers free to negotiate tariffs within that range; or

reference_spacy_tokens: After considering costs and other relevant evidence , the Commission may set a range of permissible tariffs for certain subclasses , with the postal service and individual mailers free to negotiate tariffs within that range ; or


fn_spacy_tokens_for_baseline: Rather , it constitutes what publishers call a " package , " that is , it contains a fair amount of lexicographic material but little or nothing that is original .

source_bert_toks: rather , it constitutes what publishers call a " package , " that is , it contains a fair amount of lexi ##co ##graphic material but little or nothing that is original .

reference_raw: Rather, it is what publishers call a package, i.e. it contains quite a lot of lexicographic material, but little or nothing original.

reference_spacy_tokens: Rather , it is what publishers call a package , i.e. it contains quite a lot of lexicographic material , but little or nothing original .


fn_spacy_tokens_for_baseline: This can create a conflict of interest which needs careful management .

source_bert_toks: this can create a conflict of interest which needs careful management .

reference_raw: This may lead to a conflict of interest that needs careful management.

reference_spacy_tokens: This may lead to a conflict of interest that needs careful management .


fn_spacy_tokens_for_baseline: Gun battles between rival gangs of inmates had left 18 prisoners dead following an unsuccessful assassination attempt on Olivero Chavez Araujo , a self - styled drug baron serving an eight - year sentence for drug trafficking .

source_bert_toks: gun battles between rival gangs of inmates had left 18 prisoners dead following an unsuccessful assassination attempt on oliver ##o chavez ara ##uj ##o , a self - styled drug baron serving an eight - year sentence for drug trafficking .

reference_raw: Gunfights between rival gangs of prisoners left 18 prisoners dead after a failed attempt to assassinate Oliver Chavez Araujo, a self-styled drug baron serving eight years for drug trafficking.

reference_spacy_tokens: Gunfights between rival gangs of prisoners left 18 prisoners dead after a failed attempt to assassinate Oliver Chavez Araujo , a self - styled drug baron serving eight years for drug trafficking .


fn_spacy_tokens_for_baseline: ' You gon na let her get away with that ? ' howled Rose .

source_bert_toks: ' you go ##n na let her get away with that ? ' howled rose .

reference_raw: 'Are you going to let her get away with it?' said Rose.

reference_spacy_tokens: ' Are you going to let her get away with it ? ' said Rose .


fn_spacy_tokens_for_baseline: ' I think everyone is very pleased they 've changed their minds , ' said England 's most - capped player , Rory Underwood .

source_bert_toks: ' i think everyone is very pleased they ' ve changed their minds , ' said england ' s most - capped player , rory underwood .

reference_raw: 'I think they're all very happy to change their minds,' said Rory Underwood, England's most capped player.

reference_spacy_tokens: ' I think they 're all very happy to change their minds , ' said Rory Underwood , England 's most capped player .


fn_spacy_tokens_for_baseline: Their importance , like that of cytomegalovirus , lies in their propensity for causing serious perinatal infection .

source_bert_toks: their importance , like that of cy ##tom ##ega ##lov ##irus , lies in their prop ##ens ##ity for causing serious per ##ina ##tal infection .

reference_raw: Their importance, as with cytomegaloviruses, lies in their tendency to cause severe perinatal infection.

reference_spacy_tokens: Their importance , as with cytomegaloviruses , lies in their tendency to cause severe perinatal infection .


fn_spacy_tokens_for_baseline: An extra man , says Boswell , had joined their little party , ' Evan Campbell , servant to Mr Murchison , factor to the Laird of Macleod in Glenelg ran along with us today .

source_bert_toks: an extra man , says bo ##swell , had joined their little party , ' evan campbell , servant to mr mu ##rch ##ison , factor to the laird of macleod in glen ##el ##g ran along with us today .

reference_raw: An extra man, says Boswell, joined their little party, "Evan Campbell, butler of Mr. Murchison, factor of Macleod's Laird in Glenelg, ran with us today.

reference_spacy_tokens: An extra man , says Boswell , joined their little party , " Evan Campbell , butler of Mr. Murchison , factor of Macleod 's Laird in Glenelg , ran with us today .


fn_spacy_tokens_for_baseline: IAEA Director General Hans Blix says he has no cause for concern regarding Iran 's attempts to acquire nuclear technology ( 6906 ) .

source_bert_toks: ia ##ea director general hans b ##li ##x says he has no cause for concern regarding iran ' s attempts to acquire nuclear technology ( 690 ##6 ) .

reference_raw: The Director-General of the IAEA Hans Blix states that he has no reason to fear Iran's efforts to acquire nuclear technology (6906).

reference_spacy_tokens: The Director - General of the IAEA Hans Blix states that he has no reason to fear Iran 's efforts to acquire nuclear technology ( 6906 ) .


fn_spacy_tokens_for_baseline: Emil told me to collect the champagne glasses , pour the water and put a pot of breadsticks on each table .

source_bert_toks: emil told me to collect the champagne glasses , pour the water and put a pot of bread ##stick ##s on each table .

reference_raw: Emil told me to pick up a glass of champagne, pour water, and put a can of bread on each table.

reference_spacy_tokens: Emil told me to pick up a glass of champagne , pour water , and put a can of bread on each table .


fn_spacy_tokens_for_baseline: THE furious wrangling over Labour 's controversial party broadcast on the health service yesterday plunged into a flurry of claim and counter claim .

source_bert_toks: the furious wr ##ang ##ling over labour ' s controversial party broadcast on the health service yesterday plunged into a flu ##rry of claim and counter claim .

reference_raw: Frenzied squirming about Labor's controversial party broadcast to the health service yesterday plunged into a flurry of claims and counterclaims.

reference_spacy_tokens: Frenzied squirming about Labor 's controversial party broadcast to the health service yesterday plunged into a flurry of claims and counterclaims .


fn_spacy_tokens_for_baseline: As long ago as the late 1970s , the US Library of Congress was implementing a pilot plan to archive many thousands of historic documents within a networked database using analogue videodiscs to store the document images .

source_bert_toks: as long ago as the late 1970s , the us library of congress was implementing a pilot plan to archive many thousands of historic documents within a network ##ed database using analogue video ##dis ##cs to store the document images .

reference_raw: Until the end of the 1970s, the U.S. Library of Congress carried out a pilot plan for the storage of many thousands of historical documents in a networked database using analogue video disks for the storage of document images.

reference_spacy_tokens: Until the end of the 1970s , the U.S. Library of Congress carried out a pilot plan for the storage of many thousands of historical documents in a networked database using analogue video disks for the storage of document images .


fn_spacy_tokens_for_baseline: We used this embryological concept to define a set of embryonic structure names that depict a'path ' describing the development of each organ .

source_bert_toks: we used this embryo ##logical concept to define a set of embryo ##nic structure names that depict a ' path ' describing the development of each organ .

reference_raw: We used this embryological concept to define a series of embryonic structures that depict a'path "describing the development of each organ.

reference_spacy_tokens: We used this embryological concept to define a series of embryonic structures that depict a'path " describing the development of each organ .


fn_spacy_tokens_for_baseline: The most common and deadly form has already spread in birds from South Asia to Europe .

source_bert_toks: the most common and deadly form has already spread in birds from south asia to europe .

reference_raw: Birds from South Asia to Europe have become the most common and deadly species.

reference_spacy_tokens: Birds from South Asia to Europe have become the most common and deadly species .


fn_spacy_tokens_for_baseline: ' Mitch is ordered back home , ' he informed her at once .

source_bert_toks: ' mitch is ordered back home , ' he informed her at once .

reference_raw: "Mitch's been told to go home," he said immediately.

reference_spacy_tokens: " Mitch 's been told to go home , " he said immediately .


fn_spacy_tokens_for_baseline: He threw down his goose quill and grasped the clerk 's hands , pumping them up and down vigorously .

source_bert_toks: he threw down his goose qui ##ll and grasped the clerk ' s hands , pumping them up and down vigorously .

reference_raw: He dropped the goose quill and grabbed the clerk's hands, pumping them up and down.

reference_spacy_tokens: He dropped the goose quill and grabbed the clerk 's hands , pumping them up and down .


fn_spacy_tokens_for_baseline: Dipping her two hands in the neck of Cissie 's night - shift , Beth drew out the long brown locks , spreading them over the collar and fanning the hair out as it was not altogether dry .

source_bert_toks: dipping her two hands in the neck of cis ##sie ' s night - shift , beth drew out the long brown locks , spreading them over the collar and fan ##ning the hair out as it was not altogether dry .

reference_raw: She dipped both hands into the neck of Cissie's night shift, pulled out the long brown locks, stretched them over her collar, and fanned her hair out because it wasn't completely dry.

reference_spacy_tokens: She dipped both hands into the neck of Cissie 's night shift , pulled out the long brown locks , stretched them over her collar , and fanned her hair out because it was n't completely dry .


fn_spacy_tokens_for_baseline: The device , called a Mubtakker -- Arabic for " invention " -- has been at the center of a media firestorm since it was written about in an excerpt from a book extract published by Time magazine last week .

source_bert_toks: the device , called a mu ##bt ##ak ##ker - - arabic for " invention " - - has been at the center of a media fires ##torm since it was written about in an excerpt from a book extract published by time magazine last week .

reference_raw: This device, called the Mubtakker, Arabic for "invention", was in the middle of a media firestorm because it was written in a book extract published last week by Time magazine.

reference_spacy_tokens: This device , called the Mubtakker , Arabic for " invention " , was in the middle of a media firestorm because it was written in a book extract published last week by Time magazine .


fn_spacy_tokens_for_baseline: I do n't know how she put up with it but she said she felt obligated .

source_bert_toks: i don ' t know how she put up with it but she said she felt ob ##liga ##ted .

reference_raw: I don't know how she put up with it, but she said she felt obliged to do it.

reference_spacy_tokens: I do n't know how she put up with it , but she said she felt obliged to do it .


fn_spacy_tokens_for_baseline: A youth throwing away a crisp packet was fined more than £ 1,000 , but uncontrollable young people in care seemed immune to the judicial process .

source_bert_toks: a youth throwing away a crisp packet was fined more than £1 , 000 , but un ##con ##tro ##lla ##ble young people in care seemed immune to the judicial process .

reference_raw: The young man who threw away the crisp package had been punished for over a thousand pounds, but the uncontrollable young men in care seemed immune to the trial.

reference_spacy_tokens: The young man who threw away the crisp package had been punished for over a thousand pounds , but the uncontrollable young men in care seemed immune to the trial .


fn_spacy_tokens_for_baseline: Two large fires in the New South Wales Blue Mountains , West of Sydney are burning out of control in difficult fire fighting conditions .

source_bert_toks: two large fires in the new south wales blue mountains , west of sydney are burning out of control in difficult fire fighting conditions .

reference_raw: In the Blue Mountains of New South Wales, west of Sydney, two big flames burn out of control under difficult conditions of combat.

reference_spacy_tokens: In the Blue Mountains of New South Wales , west of Sydney , two big flames burn out of control under difficult conditions of combat .


fn_spacy_tokens_for_baseline: Shocked and disbelieving , she slowly opened the piece of paper with hands that shook uncontrollably , and it took her a moment to realise what it was .

source_bert_toks: shocked and di ##sb ##eli ##eving , she slowly opened the piece of paper with hands that shook un ##con ##tro ##lla ##bly , and it took her a moment to realise what it was .

reference_raw: Shocked and incredulous, she slowly opened the paper with her hands, trembling uncontrollably, and it took her a moment to realize what it was.

reference_spacy_tokens: Shocked and incredulous , she slowly opened the paper with her hands , trembling uncontrollably , and it took her a moment to realize what it was .


fn_spacy_tokens_for_baseline: Reducing the number of U. S. troops in South Korea , or at least their visibility , could also serve to remove a major irritant .

source_bert_toks: reducing the number of u . s . troops in south korea , or at least their visibility , could also serve to remove a major ir ##ritan ##t .

reference_raw: Reducing the number of U.S. soldiers in South Korea, or at least their visibility, could also help to eliminate a major irritation.

reference_spacy_tokens: Reducing the number of U.S. soldiers in South Korea , or at least their visibility , could also help to eliminate a major irritation .


fn_spacy_tokens_for_baseline: They scalped old men and women , beheaded others , slit throats , cut out tongues , sliced off ears , and hacked off limbs .

source_bert_toks: they scalp ##ed old men and women , beheaded others , slit throat ##s , cut out tongues , sliced off ears , and hacked off limbs .

reference_raw: They scalped old men and women, executed others, slit their throats, cut out their tongues, cut off their ears, and cut off their limbs.

reference_spacy_tokens: They scalped old men and women , executed others , slit their throats , cut out their tongues , cut off their ears , and cut off their limbs .


fn_spacy_tokens_for_baseline: The IAEA 's ability to directly monitor activities at the Yo ( ngbyo ( n nuclear complex was completely lost in late December 2002 when North Korea expelled IAEA inspectors who had been monitoring the freeze .

source_bert_toks: the ia ##ea ' s ability to directly monitor activities at the yo ( ng ##by ##o ( n nuclear complex was completely lost in late december 2002 when north korea expelled ia ##ea inspectors who had been monitoring the freeze .

reference_raw: The ability of the IAEA to directly monitor the activities of the YO (NN nuclear complex was completely lost at the end of December 2002 when North Korea excluded the IAEA inspectors who were monitoring the freeze.

reference_spacy_tokens: The ability of the IAEA to directly monitor the activities of the YO ( NN nuclear complex was completely lost at the end of December 2002 when North Korea excluded the IAEA inspectors who were monitoring the freeze .


fn_spacy_tokens_for_baseline: At any gathering of the faithful , he will stay up until the small hours debating ideas with all and sundry , pulling people with different backgrounds into the same conversation .

source_bert_toks: at any gathering of the faithful , he will stay up until the small hours debating ideas with all and sun ##dry , pulling people with different backgrounds into the same conversation .

reference_raw: At any congregation of the faithful, he would remain awake for a few hours, discussing ideas with everyone and sundry, drawing people from different backgrounds into the same conversation.

reference_spacy_tokens: At any congregation of the faithful , he would remain awake for a few hours , discussing ideas with everyone and sundry , drawing people from different backgrounds into the same conversation .


fn_spacy_tokens_for_baseline: If quantification is risky , it does at least seem that the two - class , middle/ working conception is quite deeply rooted in popular ideology .

source_bert_toks: if quan ##ti ##fication is risky , it does at least seem that the two - class , middle / working conception is quite deeply rooted in popular ideology .

reference_raw: If quantification is risky, at least two-class, middle/working concepts appear to be deeply rooted in popular ideology.

reference_spacy_tokens: If quantification is risky , at least two - class , middle / working concepts appear to be deeply rooted in popular ideology .


fn_spacy_tokens_for_baseline: Other sections moved to release blockaded army bases in Croatia and to mobilize bases in Bosnia - Hercegovina , where the movement of the armed column sparked off local clashes in protest .

source_bert_toks: other sections moved to release blockade ##d army bases in croatia and to mob ##ili ##ze bases in bosnia - her ##ce ##go ##vina , where the movement of the armed column sparked off local clashes in protest .

reference_raw: Other sections moved to release blocked military bases in Croatia and to mobilize bases in Bosnia and Herzegovina, where the movement of the armed forces sparked a local conflict in protest.

reference_spacy_tokens: Other sections moved to release blocked military bases in Croatia and to mobilize bases in Bosnia and Herzegovina , where the movement of the armed forces sparked a local conflict in protest .


fn_spacy_tokens_for_baseline: During the Cold War , and afterwards , the Soviet Union had the world 's largest arsenal of chemical weapons , including artillery shells , bombs , and missiles that contained choking agents ( phosgene ) , nerve agents ( sarin , soman , and VX ) , and blister agents ( mustard , lewisite , and mustard - lewisite mixture ) .

source_bert_toks: during the cold war , and afterwards , the soviet union had the world ' s largest arsenal of chemical weapons , including artillery shells , bombs , and missiles that contained choking agents ( ph ##os ##gen ##e ) , nerve agents ( sar ##in , so ##man , and v ##x ) , and b ##list ##er agents ( mustard , lewis ##ite , and mustard - lewis ##ite mixture ) .

reference_raw: During the Cold War, and thereafter, the Soviet Union had the largest arsenal of chemical weapons in the world, including artillery shells, bombs, and missiles containing stifling agents (phosgenes), nerve agents (sarin, soman, and VX) and blisters (mustard, lewisite, and mustard).

reference_spacy_tokens: During the Cold War , and thereafter , the Soviet Union had the largest arsenal of chemical weapons in the world , including artillery shells , bombs , and missiles containing stifling agents ( phosgenes ) , nerve agents ( sarin , soman , and VX ) and blisters ( mustard , lewisite , and mustard ) .


fn_spacy_tokens_for_baseline: From somewhere far away , she could make out the screaming whine of an emergency vehicle in a hurry .

source_bert_toks: from somewhere far away , she could make out the screaming w ##hine of an emergency vehicle in a hurry .

reference_raw: From somewhere far away, she could make out the screams of an emergency vehicle.

reference_spacy_tokens: From somewhere far away , she could make out the screams of an emergency vehicle .


fn_spacy_tokens_for_baseline: To the first pleasure this was a cataclysm .

source_bert_toks: to the first pleasure this was a cat ##ac ##ly ##sm .

reference_raw: For the first time, it was a disaster.

reference_spacy_tokens: For the first time , it was a disaster .


fn_spacy_tokens_for_baseline: I led Karen up a narrow companion - way marked ' Crew Only ' to a constricted quarterdeck partially screened by the lifeboats hanging from their cradles .

source_bert_toks: i led karen up a narrow companion - way marked ' crew only ' to a con ##st ##ricted quarter ##deck partially screened by the lifeboat ##s hanging from their cradle ##s .

reference_raw: I led Karen up the narrow companionway marked "Crew Only" to the narrow quarterdeck, partly covered by lifeboats hanging from their cradles.

reference_spacy_tokens: I led Karen up the narrow companionway marked " Crew Only " to the narrow quarterdeck , partly covered by lifeboats hanging from their cradles .


fn_spacy_tokens_for_baseline: The final objective is to extinguish the fire , and this should occur within eight to ten minutes of ignition .

source_bert_toks: the final objective is to ex ##ting ##uis ##h the fire , and this should occur within eight to ten minutes of ignition .

reference_raw: The ultimate goal is to put out the fire, which should take place within eight to ten minutes of ignition.

reference_spacy_tokens: The ultimate goal is to put out the fire , which should take place within eight to ten minutes of ignition .


fn_spacy_tokens_for_baseline: His fine , dark hair was drawn back tightly from his forehead , secured at the nape in a tiny porcelain bowl of purest white .

source_bert_toks: his fine , dark hair was drawn back tightly from his forehead , secured at the nape in a tiny porcelain bowl of pure ##st white .

reference_raw: His fine dark hair was pulled back from his forehead, fastened to the back of his neck in a small porcelain bowl of purest white.

reference_spacy_tokens: His fine dark hair was pulled back from his forehead , fastened to the back of his neck in a small porcelain bowl of purest white .


fn_spacy_tokens_for_baseline: The expectation is so subtle that it can be transmitted even when the experimenter conveys his instructions by means of a tape recording .

source_bert_toks: the expectation is so subtle that it can be transmitted even when the experiment ##er convey ##s his instructions by means of a tape recording .

reference_raw: Expectations are so subtle that they can be transmitted even if the experimenter transmits his instructions through a tape recorder.

reference_spacy_tokens: Expectations are so subtle that they can be transmitted even if the experimenter transmits his instructions through a tape recorder .


fn_spacy_tokens_for_baseline: I shall not repeat what I said to the Government of India , but it is perfectly fair to say that it was well taken .

source_bert_toks: i shall not repeat what i said to the government of india , but it is perfectly fair to say that it was well taken .

reference_raw: I'm not going to repeat what I said to the Indian government, but I'd say it was well taken.

reference_spacy_tokens: I 'm not going to repeat what I said to the Indian government , but I 'd say it was well taken .


fn_spacy_tokens_for_baseline: When the rooftop vanished behind a yellow bluff of gorse , you followed your nose .

source_bert_toks: when the rooftop vanished behind a yellow bluff of go ##rse , you followed your nose .

reference_raw: When the roof disappeared behind a yellow gorse cliff, you followed your nose.

reference_spacy_tokens: When the roof disappeared behind a yellow gorse cliff , you followed your nose .


fn_spacy_tokens_for_baseline: ( That was the number listed when I received my copy ; it might have increased . )

source_bert_toks: ( that was the number listed when i received my copy ; it might have increased . )

reference_raw: (This was the figure on the list when I got the copy; it could have increased.)

reference_spacy_tokens: ( This was the figure on the list when I got the copy ; it could have increased . )


fn_spacy_tokens_for_baseline: Simon shuffled awkwardly towards them , lifting his manacled hands to push his hair back .

source_bert_toks: simon shuffled awkwardly towards them , lifting his mana ##cle ##d hands to push his hair back .

reference_raw: Simon shuffled awkwardly toward them and held up his handcuffed hands to brush his hair back.

reference_spacy_tokens: Simon shuffled awkwardly toward them and held up his handcuffed hands to brush his hair back .


fn_spacy_tokens_for_baseline: The headmistress , who had always ridiculed her for being bad at games , now referred to her as ' our best pupil ' and gave her a set of Shakespeare , duly inscribed .

source_bert_toks: the head ##mist ##ress , who had always rid ##ic ##uled her for being bad at games , now referred to her as ' our best pupil ' and gave her a set of shakespeare , duly inscribed .

reference_raw: The director, who had always mocked her for being bad at games, now called her "our best student" and gave her a set of Shakespeares, duly written.

reference_spacy_tokens: The director , who had always mocked her for being bad at games , now called her " our best student " and gave her a set of Shakespeares , duly written .


fn_spacy_tokens_for_baseline: A group of Dutch tourists swarmed out of a restaurant behind Rain and Oliver and the pedlar lost ground .

source_bert_toks: a group of dutch tourists swarm ##ed out of a restaurant behind rain and oliver and the pe ##dl ##ar lost ground .

reference_raw: A group of Dutch tourists emerged from the restaurant beyond Rain, and Oliver and the pedlar had lost ground.

reference_spacy_tokens: A group of Dutch tourists emerged from the restaurant beyond Rain , and Oliver and the pedlar had lost ground .


fn_spacy_tokens_for_baseline: And without more ado the two officers fastened their clips about their ankles , wheeled out with velocipedes and were on their way .

source_bert_toks: and without more ad ##o the two officers fastened their clips about their ankles , wheeled out with ve ##lo ##ci ##ped ##es and were on their way .

reference_raw: And without further ado, the two officers strapped the clips around their ankles, wheeled out in velocipedes, and were on their way.

reference_spacy_tokens: And without further ado , the two officers strapped the clips around their ankles , wheeled out in velocipedes , and were on their way .


fn_spacy_tokens_for_baseline: His fat , red face wreathed itself in smiles and his small eyes glittered as he greeted my companion .

source_bert_toks: his fat , red face wreath ##ed itself in smiles and his small eyes glitter ##ed as he greeted my companion .

reference_raw: His fat, flushed face wreathed with smiles, and his small eyes glittered as he greeted my companion.

reference_spacy_tokens: His fat , flushed face wreathed with smiles , and his small eyes glittered as he greeted my companion .


fn_spacy_tokens_for_baseline: Nicol has strained neck muscles and , although a member of Kenny Dalglish 's squad for today 's match against QPR in London , he is unlikely to play .

source_bert_toks: nico ##l has strained neck muscles and , although a member of kenny dal ##gli ##sh ' s squad for today ' s match against q ##pr in london , he is unlikely to play .

reference_raw: Nicol's neck muscles are tight, and although he's a member of Kenny Dalglish's team for today's match against the QPR in London, he's unlikely to play.

reference_spacy_tokens: Nicol 's neck muscles are tight , and although he 's a member of Kenny Dalglish 's team for today 's match against the QPR in London , he 's unlikely to play .


fn_spacy_tokens_for_baseline: The objecting bray of working donkeys .

source_bert_toks: the object ##ing bray of working donkey ##s .

reference_raw: Objections about working donkeys.

reference_spacy_tokens: Objections about working donkeys .


fn_spacy_tokens_for_baseline: His two attackers threatened to cut off the former Manchester United and Chelsea midfielder 's private parts during the vicious revenge attack in a country lane .

source_bert_toks: his two attackers threatened to cut off the former manchester united and chelsea midfielder ' s private parts during the vicious revenge attack in a country lane .

reference_raw: His two assailants threatened to break off the private parts of the former Manchester United and Chelsea Midfielder during a vicious retaliation attack on the country lane.

reference_spacy_tokens: His two assailants threatened to break off the private parts of the former Manchester United and Chelsea Midfielder during a vicious retaliation attack on the country lane .


fn_spacy_tokens_for_baseline: Their mentor was brilliant at his job .

source_bert_toks: their mentor was brilliant at his job .

reference_raw: Their teacher was great at his work.

reference_spacy_tokens: Their teacher was great at his work .


fn_spacy_tokens_for_baseline: No one from his tribe opened his mouth , instead they got more scared and weaker .

source_bert_toks: no one from his tribe opened his mouth , instead they got more scared and weaker .

reference_raw: No one in his tribe mouthed, but instead they became more frightened and weaker.

reference_spacy_tokens: No one in his tribe mouthed , but instead they became more frightened and weaker .


fn_spacy_tokens_for_baseline: ONE of the most important wage claims in the pay round was submitted yesterday when leaders of Ford 's 33,000 manual workers called for a double figure increase .

source_bert_toks: one of the most important wage claims in the pay round was submitted yesterday when leaders of ford ' s 33 , 000 manual workers called for a double figure increase .

reference_raw: One of the most important wage claims in the payroll round was presented yesterday when the leaders of Ford's 33,000 hand-held workers called for a double raise.

reference_spacy_tokens: One of the most important wage claims in the payroll round was presented yesterday when the leaders of Ford 's 33,000 hand - held workers called for a double raise .


fn_spacy_tokens_for_baseline: This opinion enraged Chang .

source_bert_toks: this opinion enraged chang .

reference_raw: Chang was furious at that opinion.

reference_spacy_tokens: Chang was furious at that opinion .


fn_spacy_tokens_for_baseline: Welsh sheep farming needs a properly structured finished stock - marketing organisation , says Food from Britain .

source_bert_toks: welsh sheep farming needs a properly structured finished stock - marketing organisation , says food from britain .

reference_raw: Welsh sheep farmers need a well-structured end-marketing organisation, according to the United Kingdom Foodstuff.

reference_spacy_tokens: Welsh sheep farmers need a well - structured end - marketing organisation , according to the United Kingdom Foodstuff .


fn_spacy_tokens_for_baseline: In the case of changes proposed by a member of the Computer Group , the procedures to be followed vary according to the stage of development at which the change is identified .

source_bert_toks: in the case of changes proposed by a member of the computer group , the procedures to be followed vary according to the stage of development at which the change is identified .

reference_raw: In the case of changes proposed by a member of a computer group, the procedures to be applied vary depending on the stage of development at which the change is identified.

reference_spacy_tokens: In the case of changes proposed by a member of a computer group , the procedures to be applied vary depending on the stage of development at which the change is identified .


fn_spacy_tokens_for_baseline: Paula_Zahn : Questions about the facts or what were presented as facts that led the United States into the war in Iraq spilled into open warfare today on the Senate floor .

source_bert_toks: paula _ za ##hn : questions about the facts or what were presented as facts that led the united states into the war in iraq spilled into open warfare today on the senate floor .

reference_raw: Paula_Zahn: Questions about the facts or what were presented as facts that led the United States to the war in Iraq poured into open warfare at the Senate level today.

reference_spacy_tokens: Paula_Zahn : Questions about the facts or what were presented as facts that led the United States to the war in Iraq poured into open warfare at the Senate level today .


fn_spacy_tokens_for_baseline: Have you shocked them in the village ?

source_bert_toks: have you shocked them in the village ?

reference_raw: Did you surprise them in the village?

reference_spacy_tokens: Did you surprise them in the village ?


fn_spacy_tokens_for_baseline: ' Are you staying for the dress rehearsal tomorrow ? '

source_bert_toks: ' are you staying for the dress rehearsal tomorrow ? '

reference_raw: "Will you stay for the dress test tomorrow?"

reference_spacy_tokens: " Will you stay for the dress test tomorrow ? "


fn_spacy_tokens_for_baseline: The phones ringing on each floor must have awakened Anna , for she could hear bare feet padding overhead .

source_bert_toks: the phones ringing on each floor must have awakened anna , for she could hear bare feet pad ##ding overhead .

reference_raw: The phones ringing on each floor must have woken Anna, for she could hear her bare feet pounding over her head.

reference_spacy_tokens: The phones ringing on each floor must have woken Anna , for she could hear her bare feet pounding over her head .


fn_spacy_tokens_for_baseline: Outside the phone box , she shivered in the breeze .

source_bert_toks: outside the phone box , she shivered in the breeze .

reference_raw: She shuddered in the wind outside the phone booth.

reference_spacy_tokens: She shuddered in the wind outside the phone booth .


fn_spacy_tokens_for_baseline: Is not the mugger a person who knows only the language of violence through which to express his desperation ?

source_bert_toks: is not the mug ##ger a person who knows only the language of violence through which to express his desperation ?

reference_raw: Isn't a thief a man who knows only the language of violence to express his despair?

reference_spacy_tokens: Is n't a thief a man who knows only the language of violence to express his despair ?


fn_spacy_tokens_for_baseline: Large sums of money were often involved .

source_bert_toks: large sums of money were often involved .

reference_raw: There was a lot of money involved.

reference_spacy_tokens: There was a lot of money involved .


fn_spacy_tokens_for_baseline: He always upset me .

source_bert_toks: he always upset me .

reference_raw: He's always pissed me off.

reference_spacy_tokens: He 's always pissed me off .


fn_spacy_tokens_for_baseline: So advanced was his method , that the apparatus for distillation has altered very little in 900 years .

source_bert_toks: so advanced was his method , that the apparatus for di ##sti ##llation has altered very little in 900 years .

reference_raw: His method was so advanced that the distillation equipment had changed very little in 900 years.

reference_spacy_tokens: His method was so advanced that the distillation equipment had changed very little in 900 years .


fn_spacy_tokens_for_baseline: For a long time Mait did n't answer , until a low chuckle gradually worked its way from his throat .

source_bert_toks: for a long time mai ##t didn ' t answer , until a low chuckle gradually worked its way from his throat .

reference_raw: Mait did not reply for a long time, until a low laugh began to work its way out of his throat.

reference_spacy_tokens: Mait did not reply for a long time , until a low laugh began to work its way out of his throat .


fn_spacy_tokens_for_baseline: He was about to give the order to advance when news reached him that his wife and five - year - old son had been abducted by three masked men outside their apartment in New York .

source_bert_toks: he was about to give the order to advance when news reached him that his wife and five - year - old son had been abducted by three masked men outside their apartment in new york .

reference_raw: He was about to give the order for progress when word reached him that his wife and five-year-old son had been kidnapped by three masked men in front of their apartment in New York City.

reference_spacy_tokens: He was about to give the order for progress when word reached him that his wife and five - year - old son had been kidnapped by three masked men in front of their apartment in New York City .


fn_spacy_tokens_for_baseline: Barbarian invasion or civil war could also bring vast unpopularity on the Christians , cast as scapegoats .

source_bert_toks: barbarian invasion or civil war could also bring vast unpopular ##ity on the christians , cast as sc ##ape ##go ##ats .

reference_raw: Barbarian invasions or civil wars can also cause great unpopularity to Christians who are cast as scapegoats.

reference_spacy_tokens: Barbarian invasions or civil wars can also cause great unpopularity to Christians who are cast as scapegoats .


fn_spacy_tokens_for_baseline: So who better than Tommy Lee Jones , the Academy Award - winning enigma who roomed with Al Gore at Harvard University while making the All - Ivy League football team as an offensive lineman .

source_bert_toks: so who better than tommy lee jones , the academy award - winning enigma who room ##ed with al gore at harvard university while making the all - ivy league football team as an offensive lineman .

reference_raw: So who better than Tommy Lee Jones, the Academy Award Winning Enigma who went to Harvard University with Al Gore and made the All-Ivy League football team an offensive lineman.

reference_spacy_tokens: So who better than Tommy Lee Jones , the Academy Award Winning Enigma who went to Harvard University with Al Gore and made the All - Ivy League football team an offensive lineman .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key question is how the US implementation of ballistic missile defense (formerly known as theater and national missile defense) will affect the pace and extent of Chinese strategic modernisation.

reference_spacy_tokens: The key question is how the US implementation of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and extent of Chinese strategic modernisation .


fn_spacy_tokens_for_baseline: The free delivery by Germany of military spare parts to Hungary was confirmed by Germany 's Defence Ministry on Nov. 21 .

source_bert_toks: the free delivery by germany of military spare parts to hungary was confirmed by germany ' s defence ministry on nov . 21 .

reference_raw: The free supply of military spare parts by Germany to Hungary was confirmed by the German Ministry of Defence on November 21.

reference_spacy_tokens: The free supply of military spare parts by Germany to Hungary was confirmed by the German Ministry of Defence on November 21 .


fn_spacy_tokens_for_baseline: We then had to drive the machine back and unload the rented van .

source_bert_toks: we then had to drive the machine back and un ##load the rented van .

reference_raw: Then we had to take the machine back and drop the rented van.

reference_spacy_tokens: Then we had to take the machine back and drop the rented van .


fn_spacy_tokens_for_baseline: She held up her face to the pale sunshine , sniffing ecstatically at the salt air .

source_bert_toks: she held up her face to the pale sunshine , sniffing ec ##static ##ally at the salt air .

reference_raw: She raised her face to the pale sunlight and smelled the salt air ecstatically.

reference_spacy_tokens: She raised her face to the pale sunlight and smelled the salt air ecstatically .


fn_spacy_tokens_for_baseline: We are interested in receiving a report of what took place when the Leader of the Oppositon went to Barrow and had a chat with the work force .

source_bert_toks: we are interested in receiving a report of what took place when the leader of the op ##po ##sit ##on went to barrow and had a chat with the work force .

reference_raw: We'd like to hear about what happened when the leader of the opposition went to Barrow and talked to the team.

reference_spacy_tokens: We 'd like to hear about what happened when the leader of the opposition went to Barrow and talked to the team .


fn_spacy_tokens_for_baseline: He paced close to his car .

source_bert_toks: he paced close to his car .

reference_raw: He walked close to the car.

reference_spacy_tokens: He walked close to the car .


fn_spacy_tokens_for_baseline: Two firefighters were injured while fighting the fire and were transported to Erie County Medical Center , " said Division Fire Chief Thomas Ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

source_bert_toks: two firefighters were injured while fighting the fire and were transported to erie county medical center , " said division fire chief thomas ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

reference_raw: Two firemen were injured in a firefight and transported to the Erie County Medical Center," said Division Fire Chief Thomas Ashe, who also said that sections of the kitchen wall in the back of the house had to be torn apart to prevent the fire from spreading through the walls.

reference_spacy_tokens: Two firemen were injured in a firefight and transported to the Erie County Medical Center , " said Division Fire Chief Thomas Ashe , who also said that sections of the kitchen wall in the back of the house had to be torn apart to prevent the fire from spreading through the walls .


fn_spacy_tokens_for_baseline: Ironically , Mrs Neil Lyndon has now revealed she was abandoned by her husband last year and only managed to receive child support for their six - year - old son by obtaining a court order .

source_bert_toks: ironically , mrs neil lyndon has now revealed she was abandoned by her husband last year and only managed to receive child support for their six - year - old son by obtaining a court order .

reference_raw: The irony is that Mrs. Neil Lyndon now reveals that her husband left her last year and only managed to obtain child support for her six-year-old boy by obtaining a court order.

reference_spacy_tokens: The irony is that Mrs. Neil Lyndon now reveals that her husband left her last year and only managed to obtain child support for her six - year - old boy by obtaining a court order .


fn_spacy_tokens_for_baseline: These simple changes to her father 's response enable this mildly handicapped child to acquire the socially necessary ability to wait in a definite and positive manner .

source_bert_toks: these simple changes to her father ' s response enable this mildly handicapped child to acquire the socially necessary ability to wait in a definite and positive manner .

reference_raw: These simple changes in her father's reaction make it possible for this slightly handicapped kid to acquire the socially necessary waiting capacity in a definite and positive way.

reference_spacy_tokens: These simple changes in her father 's reaction make it possible for this slightly handicapped kid to acquire the socially necessary waiting capacity in a definite and positive way .


fn_spacy_tokens_for_baseline: Phillario , however , is startled by the sight of Mira :

source_bert_toks: phil ##lar ##io , however , is startled by the sight of mira :

reference_raw: But the sight of Mira surprises Phillario:

reference_spacy_tokens: But the sight of Mira surprises Phillario :


fn_spacy_tokens_for_baseline: Clouds were creeping up over the edges of the trees and the river 's surface was turning black .

source_bert_toks: clouds were creeping up over the edges of the trees and the river ' s surface was turning black .

reference_raw: Clouds crept over the edges of the trees, and the surface of the river darkened.

reference_spacy_tokens: Clouds crept over the edges of the trees , and the surface of the river darkened .


fn_spacy_tokens_for_baseline: Sometimes the comparisons between the performance of this country and the performance of other countries amazes me .

source_bert_toks: sometimes the comparisons between the performance of this country and the performance of other countries ama ##zes me .

reference_raw: Sometimes I'm surprised at the comparison between the performance of this country and the performance of other countries.

reference_spacy_tokens: Sometimes I 'm surprised at the comparison between the performance of this country and the performance of other countries .


fn_spacy_tokens_for_baseline: In a recent study of twenty - five degree courses in five institutions Molloy and Carroll ( 1992 ) reported slightly lower completion rates for what they defined as ' non - standard " entry ( NSE ) students when compared with those with standard entry ( SEs ) .

source_bert_toks: in a recent study of twenty - five degree courses in five institutions mo ##llo ##y and carroll ( 1992 ) reported slightly lower completion rates for what they defined as ' non - standard " entry ( ns ##e ) students when compared with those with standard entry ( se ##s ) .

reference_raw: In a recent survey of 25-degree courses in five institutions, Molloy and Carroll (1992) reported a slightly lower rate of completion for what they defined as non-standard entry (NSE) students compared to standard entry (SE) students.

reference_spacy_tokens: In a recent survey of 25-degree courses in five institutions , Molloy and Carroll ( 1992 ) reported a slightly lower rate of completion for what they defined as non - standard entry ( NSE ) students compared to standard entry ( SE ) students .


fn_spacy_tokens_for_baseline: But the Muslims , though they despise Syrian rule in Lebanon , need Syria 's presence to ensure that real political reform takes place .

source_bert_toks: but the muslims , though they des ##pis ##e syrian rule in lebanon , need syria ' s presence to ensure that real political reform takes place .

reference_raw: But Muslims, despite their contempt for Syrian rule in Lebanon, need the presence of Syria to ensure real political reform.

reference_spacy_tokens: But Muslims , despite their contempt for Syrian rule in Lebanon , need the presence of Syria to ensure real political reform .


fn_spacy_tokens_for_baseline: Then it was time for a rousing chorus of happy birthday from the boys of Belmont Abbey school , where Father Francis once taught Latin , French and Mathematics .

source_bert_toks: then it was time for a ro ##using chorus of happy birthday from the boys of belmont abbey school , where father francis once taught latin , french and mathematics .

reference_raw: Then it was time for a wake-up chorus of happy birthdays from the Belmont Abbey boys, where Father Francis had once taught Latin, French, and Mathematics.

reference_spacy_tokens: Then it was time for a wake - up chorus of happy birthdays from the Belmont Abbey boys , where Father Francis had once taught Latin , French , and Mathematics .


fn_spacy_tokens_for_baseline: Close to collapse , he staggered downhill towards the river , to the drink he had craved since noon .

source_bert_toks: close to collapse , he staggered downhill towards the river , to the drink he had craved since noon .

reference_raw: On the verge of collapse, he stumbled down the hill to the river, to the drink he had longed for since midday.

reference_spacy_tokens: On the verge of collapse , he stumbled down the hill to the river , to the drink he had longed for since midday .


fn_spacy_tokens_for_baseline: Aethelbald was rebuked by Boniface for his failure to take a lawful wife and more especially for his violation of nuns and virgins .

source_bert_toks: ae ##the ##lb ##ald was re ##bu ##ked by bon ##iface for his failure to take a lawful wife and more especially for his violation of nuns and virgin ##s .

reference_raw: Boniface reproached Aethelbald for not marrying his lawful wedded wife, and in particular for violating nuns and virgins.

reference_spacy_tokens: Boniface reproached Aethelbald for not marrying his lawful wedded wife , and in particular for violating nuns and virgins .


fn_spacy_tokens_for_baseline: There were lectures on quite advanced medical care , on intelligence - gathering , signalling and demolitions .

source_bert_toks: there were lectures on quite advanced medical care , on intelligence - gathering , signalling and demolition ##s .

reference_raw: There were talks about advanced medical care, intelligence gathering, signalling, and demolition.

reference_spacy_tokens: There were talks about advanced medical care , intelligence gathering , signalling , and demolition .


fn_spacy_tokens_for_baseline: The oldest bell - ringing group in the country , the Ancient Society of College Youths , founded in 1637 , remains male - only , a fact that 's particularly galling to women because the group is the sole source of ringers for Britain 's most prestigious churches , St. Paul 's Cathedral and Westminster Abbey .

source_bert_toks: the oldest bell - ringing group in the country , the ancient society of college youths , founded in 163 ##7 , remains male - only , a fact that ' s particularly gall ##ing to women because the group is the sole source of ring ##ers for britain ' s most prestigious churches , st . paul ' s cathedral and westminster abbey .

reference_raw: The oldest ringing group in the country, the ancient College Youth Society, founded in 1637, remains male-only, which is particularly galling to women, since it is the only source of ringers for the most prestigious in Britain, Saint Paul's cathedral and Westminster Abbey.

reference_spacy_tokens: The oldest ringing group in the country , the ancient College Youth Society , founded in 1637 , remains male - only , which is particularly galling to women , since it is the only source of ringers for the most prestigious in Britain , Saint Paul 's cathedral and Westminster Abbey .


fn_spacy_tokens_for_baseline: Riven saw Bragad gesticulating at Bicker , who sipped wine reflectively .

source_bert_toks: ri ##ven saw bra ##ga ##d ge ##stic ##ulating at bi ##cker , who sipped wine reflective ##ly .

reference_raw: Riven saw Bragad gesturing to Bicker, who was sipping his wine thoughtfully.

reference_spacy_tokens: Riven saw Bragad gesturing to Bicker , who was sipping his wine thoughtfully .


fn_spacy_tokens_for_baseline: He returned my letter spattered with his own blood , and a reply .

source_bert_toks: he returned my letter spat ##tered with his own blood , and a reply .

reference_raw: He returned the letter, splattered with his own blood, and the answer.

reference_spacy_tokens: He returned the letter , splattered with his own blood , and the answer .


fn_spacy_tokens_for_baseline: Mining in the Coniston fells , and elsewhere , continued after the turn of the century and probably , as more veins were found and the mining expanded and output increased , increased in profitability .

source_bert_toks: mining in the con ##isto ##n fell ##s , and elsewhere , continued after the turn of the century and probably , as more veins were found and the mining expanded and output increased , increased in profit ##ability .

reference_raw: Mining in the Coniston has been decreasing and elsewhere since the turn of the century, and it is likely that, as more veins have been found and mining has increased and production has increased, profitability has increased.

reference_spacy_tokens: Mining in the Coniston has been decreasing and elsewhere since the turn of the century , and it is likely that , as more veins have been found and mining has increased and production has increased , profitability has increased .


fn_spacy_tokens_for_baseline: Drinks were essential in the humid atmosphere .

source_bert_toks: drinks were essential in the humid atmosphere .

reference_raw: Drinking was essential in a wet atmosphere.

reference_spacy_tokens: Drinking was essential in a wet atmosphere .


fn_spacy_tokens_for_baseline: A former army captain , Jane Turpin , used a fake CV to get a top secretarial job at Europarks where she photocopied documents and sent regular reports about the company and its personnel to Layton via Hewitt .

source_bert_toks: a former army captain , jane tu ##rp ##in , used a fake cv to get a top secret ##aria ##l job at europa ##rks where she photo ##co ##pie ##d documents and sent regular reports about the company and its personnel to layton via hewitt .

reference_raw: One of the former military captains, Jane Turpin, used a fake CV to get a top secretary job in Europarks, where she copied documents and sent regular reports of the company and its staff to Layton through Hewitt.

reference_spacy_tokens: One of the former military captains , Jane Turpin , used a fake CV to get a top secretary job in Europarks , where she copied documents and sent regular reports of the company and its staff to Layton through Hewitt .


fn_spacy_tokens_for_baseline: Priscus was a native of the region around Chartres in Gaul and both may have been employed in the construction of the great bath and temple complex .

source_bert_toks: pri ##scu ##s was a native of the region around chart ##res in gaul and both may have been employed in the construction of the great bath and temple complex .

reference_raw: Priscus was a native of the region around Chartres in Gaul, and both could be used to build a large bath and temple complex.

reference_spacy_tokens: Priscus was a native of the region around Chartres in Gaul , and both could be used to build a large bath and temple complex .


fn_spacy_tokens_for_baseline: The jury heard how a social worker was horrifically knifed to death on a late - night train .

source_bert_toks: the jury heard how a social worker was horrific ##ally knife ##d to death on a late - night train .

reference_raw: The jury heard a social worker being horribly stabbed to death on a night train.

reference_spacy_tokens: The jury heard a social worker being horribly stabbed to death on a night train .


fn_spacy_tokens_for_baseline: Using the SCI databases produced by the Institute for Scientific Information ( ISI ) , as well as data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia ( RICYT ) , we examined the differences in the number and proportion of scientific publications between the developed world and the developing world from 1990 until 2000 , focusing on the Americas as a case study .

source_bert_toks: using the sci databases produced by the institute for scientific information ( is ##i ) , as well as data compiled by the red ib ##ero ##americana de ind ##ica ##dor ##es de ci ##encia y te ##c ##no ##log ##ia ( ric ##yt ) , we examined the differences in the number and proportion of scientific publications between the developed world and the developing world from 1990 until 2000 , focusing on the americas as a case study .

reference_raw: Using the SCI databases produced by the Institute for Scientific Information (ISI) and the data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia (RICYT), we examined the variations in the number and proportion of scientific publications between the developed world and the developing world from 1990 to 2000, focusing on the United States as a case study.

reference_spacy_tokens: Using the SCI databases produced by the Institute for Scientific Information ( ISI ) and the data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia ( RICYT ) , we examined the variations in the number and proportion of scientific publications between the developed world and the developing world from 1990 to 2000 , focusing on the United States as a case study .


fn_spacy_tokens_for_baseline: She 'd obviously hit her head during the impact because there was a small trickle of blood on her forehead .

source_bert_toks: she ' d obviously hit her head during the impact because there was a small trickle of blood on her forehead .

reference_raw: Apparently, she had hit her head in the crash, because she had a small drop of blood on her forehead.

reference_spacy_tokens: Apparently , she had hit her head in the crash , because she had a small drop of blood on her forehead .


fn_spacy_tokens_for_baseline: Then he started towards the plinth with a cry of alarm , and the gibbon , sensing a threat , leaped two feet into the air and disappeared inside the vase .

source_bert_toks: then he started towards the pl ##int ##h with a cry of alarm , and the gi ##bbon , sensing a threat , leaped two feet into the air and disappeared inside the vase .

reference_raw: Then, with a cry of alarm, he headed for the plinth, and the gibbon, sensing the threat, jumped two feet into the air and disappeared into the vase.

reference_spacy_tokens: Then , with a cry of alarm , he headed for the plinth , and the gibbon , sensing the threat , jumped two feet into the air and disappeared into the vase .


fn_spacy_tokens_for_baseline: With an abrupt gesture , the dark , bony , black - clad hands came up and the hood was thrust back .

source_bert_toks: with an abrupt gesture , the dark , bony , black - clad hands came up and the hood was thrust back .

reference_raw: His dark, bony, black-robed hands came up with a sudden gesture, and he pushed the hood back.

reference_spacy_tokens: His dark , bony , black - robed hands came up with a sudden gesture , and he pushed the hood back .


fn_spacy_tokens_for_baseline: The folding legs are swung out for action and the control valve ( at the end of 12 in flexible tubing is screwed onto the gas cartridge .

source_bert_toks: the folding legs are swung out for action and the control valve ( at the end of 12 ##in flexible tub ##ing is screwed onto the gas cartridge .

reference_raw: The folding legs are pulled out for action and the control valve (at the end of the 12in flexible tube is attached to the gas casing.

reference_spacy_tokens: The folding legs are pulled out for action and the control valve ( at the end of the 12 in flexible tube is attached to the gas casing .


fn_spacy_tokens_for_baseline: The unfortunate animal in question is incarcerated in a closed box which also contains a radioactive atom with a 50 - 50 chance of decaying in the next hour , emitting a y - ray in the process .

source_bert_toks: the unfortunate animal in question is incarcerated in a closed box which also contains a radioactive atom with a 50 - 50 chance of decay ##ing in the next hour , emi ##tting a y - ray in the process .

reference_raw: The unlucky animal in question is trapped in a sealed box, which also contains a radioactive atom with a 50-50 chance of decay within the next hour and emitting a y-ray.

reference_spacy_tokens: The unlucky animal in question is trapped in a sealed box , which also contains a radioactive atom with a 50 - 50 chance of decay within the next hour and emitting a y - ray .


fn_spacy_tokens_for_baseline: So I wrote the epilogue in Christian 's book , bringing his account up to date .

source_bert_toks: so i wrote the epilogue in christian ' s book , bringing his account up to date .

reference_raw: So I put an epilogue in Christian's book and updated his account.

reference_spacy_tokens: So I put an epilogue in Christian 's book and updated his account .


fn_spacy_tokens_for_baseline: That the former are more likely to be relatively more powerful , wealthy , and privileged than the latter could be one of nature 's accidents .

source_bert_toks: that the former are more likely to be relatively more powerful , wealthy , and privileged than the latter could be one of nature ' s accidents .

reference_raw: That the first is more likely to be relatively strong, rich, and favoured than the second is one of nature's accidents.

reference_spacy_tokens: That the first is more likely to be relatively strong , rich , and favoured than the second is one of nature 's accidents .


fn_spacy_tokens_for_baseline: I watched him till the door opened and a skinny woman let him in .

source_bert_toks: i watched him till the door opened and a skinny woman let him in .

reference_raw: I watched him until the door opened and a thin woman let him in.

reference_spacy_tokens: I watched him until the door opened and a thin woman let him in .


fn_spacy_tokens_for_baseline: I 've suggested that as a first pass the charset should only be settable in the system config file , and that the charset always be coerced to US - ASCII unless the text contains 8-bit characters and/or has " funny " control characters such as ESC or SI / SO .

source_bert_toks: i ' ve suggested that as a first pass the char ##set should only be set ##table in the system con ##fi ##g file , and that the char ##set always be coe ##rce ##d to us - as ##ci ##i unless the text contains 8 - bit characters and / or has " funny " control characters such as es ##c or si / so .

reference_raw: I suggested that the charset should be set only in the system configuration file as a first pass, and that the charset should always be forced to US - ASCII if the text does not contain 8-bit characters and/or if it does not contain "funny" characters, such as ESC or SI/SO.

reference_spacy_tokens: I suggested that the charset should be set only in the system configuration file as a first pass , and that the charset should always be forced to US - ASCII if the text does not contain 8-bit characters and/or if it does not contain " funny " characters , such as ESC or SI / SO .


fn_spacy_tokens_for_baseline: Swiftly , she pulled the hat box from under the bed , and lifted out her straw hat with the red satin ribbons .

source_bert_toks: swiftly , she pulled the hat box from under the bed , and lifted out her straw hat with the red satin ribbons .

reference_raw: She quickly removed a box of hats from under the bed and pulled out a straw hat with red satin bands.

reference_spacy_tokens: She quickly removed a box of hats from under the bed and pulled out a straw hat with red satin bands .


fn_spacy_tokens_for_baseline: Rostov walked out of the Kremlin , past the KGB guards with their blue - ribboned caps , and along the river .

source_bert_toks: ro ##stov walked out of the k ##rem ##lin , past the kgb guards with their blue - ribbon ##ed caps , and along the river .

reference_raw: Rostov left the Kremlin, passed the KGB guards in their blue-ribbed hats, and walked down the river.

reference_spacy_tokens: Rostov left the Kremlin , passed the KGB guards in their blue - ribbed hats , and walked down the river .


fn_spacy_tokens_for_baseline: I decided to go the house a few gardens away where a few pitiful meows brings some food from the woman .

source_bert_toks: i decided to go the house a few gardens away where a few pit ##iful me ##ows brings some food from the woman .

reference_raw: I decided to go to the house a few gardens away, where a few poor meows brought her food.

reference_spacy_tokens: I decided to go to the house a few gardens away , where a few poor meows brought her food .


fn_spacy_tokens_for_baseline: The Prince mopped his brow , his hands sweaty inside his gloves , as he faced the bowling for the new over .

source_bert_toks: the prince mo ##pped his brow , his hands sweaty inside his gloves , as he faced the bowling for the new over .

reference_raw: The prince wiped his forehead, his hands sweating in his gloves, and turned to the bowling for a new one.

reference_spacy_tokens: The prince wiped his forehead , his hands sweating in his gloves , and turned to the bowling for a new one .


fn_spacy_tokens_for_baseline: For the rest of his duty period he walked around in a daze .

source_bert_toks: for the rest of his duty period he walked around in a daze .

reference_raw: He wandered around in a daze for the rest of his service.

reference_spacy_tokens: He wandered around in a daze for the rest of his service .


fn_spacy_tokens_for_baseline: Nevertheless , it continues to upgrade and expand its chemical warfare production infrastructure and munitions arsenal .

source_bert_toks: nevertheless , it continues to upgrade and expand its chemical warfare production infrastructure and munitions arsenal .

reference_raw: However, it further modernises and expands its CW manufacturing infrastructure and ammunition arsenal.

reference_spacy_tokens: However , it further modernises and expands its CW manufacturing infrastructure and ammunition arsenal .


fn_spacy_tokens_for_baseline: President Vladimir Putin Monday introduced a new convention on the fight against nuclear terrorism and several other documents for ratification by the lower house of Russia 's parliament .

source_bert_toks: president vladimir putin monday introduced a new convention on the fight against nuclear terrorism and several other documents for ratification by the lower house of russia ' s parliament .

reference_raw: President Vladimir Putin Monday introduced a new Convention against Nuclear Terrorism and several other instruments to be ratified by the lower House of Russian Parliament.

reference_spacy_tokens: President Vladimir Putin Monday introduced a new Convention against Nuclear Terrorism and several other instruments to be ratified by the lower House of Russian Parliament .


fn_spacy_tokens_for_baseline: True , the low magnifications of ordinary binoculars mean that the scope is limited , but with open clusters , at least , binoculars are very suitable .

source_bert_toks: true , the low mag ##ni ##fication ##s of ordinary binoculars mean that the scope is limited , but with open clusters , at least , binoculars are very suitable .

reference_raw: True, the low scale of normal telescopes means that the scope is limited, but at least with open clusters, telescopes are very appropriate.

reference_spacy_tokens: True , the low scale of normal telescopes means that the scope is limited , but at least with open clusters , telescopes are very appropriate .


fn_spacy_tokens_for_baseline: Sunday evening being no exception , its open - air cafes were crowded .

source_bert_toks: sunday evening being no exception , its open - air cafes were crowded .

reference_raw: Sunday night was no exception, and his open coffee shops were full.

reference_spacy_tokens: Sunday night was no exception , and his open coffee shops were full .


fn_spacy_tokens_for_baseline: Reunification has revealed that Soviet uranium mining in the small town of Schlema , in eastern Germany , has left a legacy of environmental disaster , radioactive pollution and chronic health problems .

source_bert_toks: reunification has revealed that soviet uranium mining in the small town of sc ##hl ##ema , in eastern germany , has left a legacy of environmental disaster , radioactive pollution and chronic health problems .

reference_raw: Reunification revealed that the mining of Soviet uranium in the small town of Schlema, East Germany, left behind a legacy of environmental disasters, radioactive pollution and long-term health problems.

reference_spacy_tokens: Reunification revealed that the mining of Soviet uranium in the small town of Schlema , East Germany , left behind a legacy of environmental disasters , radioactive pollution and long - term health problems .


fn_spacy_tokens_for_baseline: Consequently , eggs kept at 0 - 4 ° C were transferred to 16 ° C on day 98 for hatching .

source_bert_toks: consequently , eggs kept at 0 - 4 ##° ##c were transferred to 16 ##° ##c on day 98 for hatch ##ing .

reference_raw: As a result, eggs kept at 0-4°C were moved to 16°C on day 98 for hatching.

reference_spacy_tokens: As a result , eggs kept at 0 - 4 ° C were moved to 16 ° C on day 98 for hatching .


fn_spacy_tokens_for_baseline: ' Dietmar dropped a bottle of wine on the floor and it splashed everywhere .

source_bert_toks: ' diet ##mar dropped a bottle of wine on the floor and it splashed everywhere .

reference_raw: Dietmar dropped a bottle of wine on the floor and sprayed it all over the place.

reference_spacy_tokens: Dietmar dropped a bottle of wine on the floor and sprayed it all over the place .


fn_spacy_tokens_for_baseline: On 19 December 2003 , Libyan leader Col . Muammar Qadhafi publicly confirmed his commitment to disclose and dismantle WMD programs in his country following a nine - month period of negotiations with US and UK authorities .

source_bert_toks: on 19 december 2003 , libyan leader col . mu ##am ##mar q ##ad ##ha ##fi publicly confirmed his commitment to disclose and di ##sman ##tle w ##md programs in his country following a nine - month period of negotiations with us and uk authorities .

reference_raw: On 19 December 2003, Libyan leader Colonel Muammar Qadhafi publicly reaffirmed his commitment to the publication and destruction of weapons of mass destruction programmes in his country after a nine-month period of negotiations with the authorities of the United States and the United Kingdom.

reference_spacy_tokens: On 19 December 2003 , Libyan leader Colonel Muammar Qadhafi publicly reaffirmed his commitment to the publication and destruction of weapons of mass destruction programmes in his country after a nine - month period of negotiations with the authorities of the United States and the United Kingdom .


fn_spacy_tokens_for_baseline: Iran currently possesses the capability to employ ballistic missiles and/or long - range artillery rockets against its regional neighbors , Israel and US forces deployed in the region .

source_bert_toks: iran currently possesses the capability to employ ballistic missiles and / or long - range artillery rockets against its regional neighbors , israel and us forces deployed in the region .

reference_raw: Iran currently has the capacity to use ballistic missiles and/or long-range artillery missiles against its regional neighbours, Israel and the US forces deployed in the area.

reference_spacy_tokens: Iran currently has the capacity to use ballistic missiles and/or long - range artillery missiles against its regional neighbours , Israel and the US forces deployed in the area .


fn_spacy_tokens_for_baseline: She was tall , big - boned and well - covered , with grey hair as coarse as a horse 's tail straying from her mob - cap .

source_bert_toks: she was tall , big - bone ##d and well - covered , with grey hair as coarse as a horse ' s tail stray ##ing from her mob - cap .

reference_raw: She was high, high-boned and well-covered, and her gray hair was as coarse as the tail of a horse had strayed from the mafia cap.

reference_spacy_tokens: She was high , high - boned and well - covered , and her gray hair was as coarse as the tail of a horse had strayed from the mafia cap .


fn_spacy_tokens_for_baseline: We made good progress , but a combination of better health promotion , screening and treatment should deliver say , a twenty five per cent reduction by the end of the century .

source_bert_toks: we made good progress , but a combination of better health promotion , screening and treatment should deliver say , a twenty five per cent reduction by the end of the century .

reference_raw: We've made good progress, but a combination of better health promotion, screening and treatment should bring about a twenty-five percent drop by the end of the century.

reference_spacy_tokens: We 've made good progress , but a combination of better health promotion , screening and treatment should bring about a twenty - five percent drop by the end of the century .


fn_spacy_tokens_for_baseline: Personnel associated with Coast have characterized it as the most sophisticated program of its type outside of the former Soviet Union , but international CBW experts generally consider it to have been considerably less advanced from a scientific standpoint .

source_bert_toks: personnel associated with coast have characterized it as the most sophisticated program of its type outside of the former soviet union , but international cb ##w experts generally consider it to have been considerably less advanced from a scientific stand ##point .

reference_raw: Coast-related personnel have described it as the most sophisticated program of its kind outside the former Soviet Union, but international CBW experts generally consider it to be significantly less advanced from a scientific point of view.

reference_spacy_tokens: Coast - related personnel have described it as the most sophisticated program of its kind outside the former Soviet Union , but international CBW experts generally consider it to be significantly less advanced from a scientific point of view .


fn_spacy_tokens_for_baseline: Second , if the key assumption is valid , Democrats should have lower attendance rates on roll - call votes than Republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

source_bert_toks: second , if the key assumption is valid , democrats should have lower attendance rates on roll - call votes than republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

reference_raw: Secondly, if the key assumption is valid, Democrats should have a lower rate of participation in roll-call votes than the Republicans do, to the extent that such votes reflect national policy-making and that participation in such votes takes place before the legislature could otherwise devote itself to the search for local benefits.

reference_spacy_tokens: Secondly , if the key assumption is valid , Democrats should have a lower rate of participation in roll - call votes than the Republicans do , to the extent that such votes reflect national policy - making and that participation in such votes takes place before the legislature could otherwise devote itself to the search for local benefits .


fn_spacy_tokens_for_baseline: Privacy was not a word in our vocabulary , and postcards and diaries were mercilessly read aloud as we trekked through the jungle of North Borneo .

source_bert_toks: privacy was not a word in our vocabulary , and post ##cards and diaries were mer ##ci ##lessly read aloud as we trek ##ked through the jungle of north borneo .

reference_raw: Privacy was not a word in our dictionary, and the postcards and journals were mercilessly read aloud as we walked through the jungles of North Borneo.

reference_spacy_tokens: Privacy was not a word in our dictionary , and the postcards and journals were mercilessly read aloud as we walked through the jungles of North Borneo .


fn_spacy_tokens_for_baseline: She felt quite proud of her composure as she escorted him through the shop , relieved , for once , to see it empty .

source_bert_toks: she felt quite proud of her composure as she escorted him through the shop , relieved , for once , to see it empty .

reference_raw: As she walked him through the store, she was quite proud of her composure, and for the first time she was relieved to see it empty.

reference_spacy_tokens: As she walked him through the store , she was quite proud of her composure , and for the first time she was relieved to see it empty .


fn_spacy_tokens_for_baseline: We have had some welcome summer days in the last fortnight .

source_bert_toks: we have had some welcome summer days in the last fort ##night .

reference_raw: We've had a few welcome summer days in the last two weeks.

reference_spacy_tokens: We 've had a few welcome summer days in the last two weeks .


fn_spacy_tokens_for_baseline: He will assess the effect of the proposed change on that sub - system , the interfaces with other sub - systems and information held in files on the computer , and the amount of work involved in undertaking the change .

source_bert_toks: he will assess the effect of the proposed change on that sub - system , the interfaces with other sub - systems and information held in files on the computer , and the amount of work involved in undertaking the change .

reference_raw: It shall evaluate the impact of the proposed change on the subsystem, the interfaces with other subsystems and information contained in the files on the computer, and the amount of work involved in the implementation of the change.

reference_spacy_tokens: It shall evaluate the impact of the proposed change on the subsystem , the interfaces with other subsystems and information contained in the files on the computer , and the amount of work involved in the implementation of the change .


fn_spacy_tokens_for_baseline: As machines were introduced to record activity , these support data were printed out onto paper , were signed , dated and cross referenced by the scientist and became attached to the book 's pages .

source_bert_toks: as machines were introduced to record activity , these support data were printed out onto paper , were signed , dated and cross referenced by the scientist and became attached to the book ' s pages .

reference_raw: As the machines were introduced to record activities, these supporting data were published on paper, signed, dated and cross-referenced by the scientist, and attached to the pages of the book.

reference_spacy_tokens: As the machines were introduced to record activities , these supporting data were published on paper , signed , dated and cross - referenced by the scientist , and attached to the pages of the book .


fn_spacy_tokens_for_baseline: These new , relatively small , selective colleges are to be set up by private sponsors , with government grants to provide a free education with a technological emphasis for 11 - 16-year - olds .

source_bert_toks: these new , relatively small , selective colleges are to be set up by private sponsors , with government grants to provide a free education with a technological emphasis for 11 - 16 - year - olds .

reference_raw: These new, relatively small, selective schools will be created by private sponsors and government grants will provide free education with a technological focus for 11-16-year-olds.

reference_spacy_tokens: These new , relatively small , selective schools will be created by private sponsors and government grants will provide free education with a technological focus for 11 - 16-year - olds .


fn_spacy_tokens_for_baseline: Lord Mayor , people with disabilities detest being patronised .

source_bert_toks: lord mayor , people with disabilities det ##est being patron ##ised .

reference_raw: Lord Mayor, people with disabilities hate to be patronized.

reference_spacy_tokens: Lord Mayor , people with disabilities hate to be patronized .


fn_spacy_tokens_for_baseline: They fire clusters of fungal spores , and each attack has a 10 % chance of also liberating Red Mould into the area , so that characters are subjected to two attacks .

source_bert_toks: they fire clusters of fungal spores , and each attack has a 10 % chance of also li ##ber ##ating red mo ##uld into the area , so that characters are subjected to two attacks .

reference_raw: They're firing a bunch of fungal spores, and every attack has a 10% chance of freeing the Red Mould into the area, so the figures are exposed to two attacks.

reference_spacy_tokens: They 're firing a bunch of fungal spores , and every attack has a 10 % chance of freeing the Red Mould into the area , so the figures are exposed to two attacks .


fn_spacy_tokens_for_baseline: NICOSIA , Cyprus Iran charged Monday that U. S. helicopters attacked Iranian troops in support of an Iraqi offensive that reportedly has recaptured the Faw Peninsula in southern Iraq .

source_bert_toks: nico ##sia , cyprus iran charged monday that u . s . helicopters attacked iranian troops in support of an iraqi offensive that reportedly has recaptured the fa ##w peninsula in southern iraq .

reference_raw: NICOSIA, Cyprus Iran accused on Monday of US helicopters attacking Iranian troops in support of an Iraqi attack that allegedly recaptured the Faw Peninsula in South Iraq.

reference_spacy_tokens: NICOSIA , Cyprus Iran accused on Monday of US helicopters attacking Iranian troops in support of an Iraqi attack that allegedly recaptured the Faw Peninsula in South Iraq .


fn_spacy_tokens_for_baseline: It could point to plenty of ailments that the Spanish economic rejuvenation so far has failed to cure .

source_bert_toks: it could point to plenty of ai ##lm ##ents that the spanish economic re ##ju ##ven ##ation so far has failed to cure .

reference_raw: It could point to a number of diseases that the Spanish economic rejuvenation has not yet healed.

reference_spacy_tokens: It could point to a number of diseases that the Spanish economic rejuvenation has not yet healed .


fn_spacy_tokens_for_baseline: He succeeded in isolating the essential germ - killing element , and created sulfanilamide , the first modern drug to work directly upon the cause of infection .

source_bert_toks: he succeeded in iso ##lating the essential ge ##rm - killing element , and created sul ##fan ##ila ##mide , the first modern drug to work directly upon the cause of infection .

reference_raw: He managed to isolate the essential element of bacterial killing, creating sulfanilamide, the first modern drug that works directly on the cause of infection.

reference_spacy_tokens: He managed to isolate the essential element of bacterial killing , creating sulfanilamide , the first modern drug that works directly on the cause of infection .


fn_spacy_tokens_for_baseline: For the sequence -- one of the most dramatic in the film which will be screened later this month -- some of the actors had tiny explosive charges strapped to their chests .

source_bert_toks: for the sequence - - one of the most dramatic in the film which will be screened later this month - - some of the actors had tiny explosive charges strapped to their chests .

reference_raw: For the series-one of the most dramatic films to be screened later this month-some of the actors had small explosive charges strapped to their chests.

reference_spacy_tokens: For the series - one of the most dramatic films to be screened later this month - some of the actors had small explosive charges strapped to their chests .


fn_spacy_tokens_for_baseline: Its destroyer , she says , was an unholy alliance of nationalists bent on creating a racially homogeneous Serbian state and ex - communists longing to stay in power .

source_bert_toks: its destroyer , she says , was an un ##hol ##y alliance of nationalists bent on creating a racial ##ly homogeneous serbian state and ex - communists longing to stay in power .

reference_raw: He claims that his destroyer was an unholy union of nationalists bent on creating a racially homogenous Serbian state and former communists who wanted to stay in power.

reference_spacy_tokens: He claims that his destroyer was an unholy union of nationalists bent on creating a racially homogenous Serbian state and former communists who wanted to stay in power .


fn_spacy_tokens_for_baseline: A BUNGLING bandit botched three hold - ups in an hour - and ended up £ 200 worse off than when he started .

source_bert_toks: a bun ##gling bandit bot ##ched three hold - ups in an hour - and ended up £2 ##00 worse off than when he started .

reference_raw: The Bungling Bandit screwed up three stops in an hour-and ended up with two hundred pounds worse off than he had started.

reference_spacy_tokens: The Bungling Bandit screwed up three stops in an hour - and ended up with two hundred pounds worse off than he had started .


fn_spacy_tokens_for_baseline: It was a long time before Lucy dried her eyes .

source_bert_toks: it was a long time before lucy dried her eyes .

reference_raw: It took Lucy a long time to wipe her eyes.

reference_spacy_tokens: It took Lucy a long time to wipe her eyes .


fn_spacy_tokens_for_baseline: House blaze : Fire crews were called out to tackle a blaze at a house in The Greenway , Middleton St George yesterday .

source_bert_toks: house blaze : fire crews were called out to tackle a blaze at a house in the green ##way , middleton st george yesterday .

reference_raw: House fire: Fire crews were called yesterday to fight the fire in a house in Greenway, Middleton St. George.

reference_spacy_tokens: House fire : Fire crews were called yesterday to fight the fire in a house in Greenway , Middleton St. George .


fn_spacy_tokens_for_baseline: He nodded slowly at Shag .

source_bert_toks: he nodded slowly at sha ##g .

reference_raw: He shook his head slowly at Shag.

reference_spacy_tokens: He shook his head slowly at Shag .


fn_spacy_tokens_for_baseline: Her mother , Valerie Cass , was busying herself , packing things into a small overnight case .

source_bert_toks: her mother , valerie cass , was busy ##ing herself , packing things into a small overnight case .

reference_raw: Her mother, Valerie Cass, was busy wrapping things up in a little overnight briefcase.

reference_spacy_tokens: Her mother , Valerie Cass , was busy wrapping things up in a little overnight briefcase .


fn_spacy_tokens_for_baseline: ' You do n't need a skilled knitter to spin seamless stockings , that 's what this is all about .

source_bert_toks: ' you don ' t need a skilled knit ##ter to spin seam ##less stockings , that ' s what this is all about .

reference_raw: 'You don't need an experienced knitter to spin a pair of tights, that's what it's all about.

reference_spacy_tokens: ' You do n't need an experienced knitter to spin a pair of tights , that 's what it 's all about .


fn_spacy_tokens_for_baseline: The makers of Until The End Of The World own up that it was actually shot in Bolton with some clever filters and a broken Nintendo

source_bert_toks: the makers of until the end of the world own up that it was actually shot in bolton with some clever filters and a broken nintendo

reference_raw: The creators of the Up to the End of the World admit that he was actually shot in Bolton with some smart filters and a smashed Nintendo.

reference_spacy_tokens: The creators of the Up to the End of the World admit that he was actually shot in Bolton with some smart filters and a smashed Nintendo .


fn_spacy_tokens_for_baseline: These cells respond quite vigorously when medium and high spatial frequency stimuli are used , but are less responsive when low spatial frequency stimuli are employed .

source_bert_toks: these cells respond quite vigorously when medium and high spatial frequency stimuli are used , but are less responsive when low spatial frequency stimuli are employed .

reference_raw: These cells react quite vigorously when using medium and high-space frequency stimuli, but are less responsive when using low-space frequency stimuli.

reference_spacy_tokens: These cells react quite vigorously when using medium and high - space frequency stimuli , but are less responsive when using low - space frequency stimuli .


fn_spacy_tokens_for_baseline: The CPO affirmed that all major planning applications for Howdendyke had been advertised in the local press , and that ' even neighbour notification may have taken place . '

source_bert_toks: the cp ##o affirmed that all major planning applications for how ##den ##dy ##ke had been advertised in the local press , and that ' even neighbour notification may have taken place . '

reference_raw: The CPO confirmed that all major planning applications for Howdendyke had been advertised in the local press and that 'even neighbourly notifications could have taken place.'

reference_spacy_tokens: The CPO confirmed that all major planning applications for Howdendyke had been advertised in the local press and that ' even neighbourly notifications could have taken place . '


fn_spacy_tokens_for_baseline: Evidence can be defined as information which establishes or disproves a fact or a point in question .

source_bert_toks: evidence can be defined as information which establishes or di ##sp ##rove ##s a fact or a point in question .

reference_raw: Evidence may be defined as information which establishes or rebuts a fact or a point.

reference_spacy_tokens: Evidence may be defined as information which establishes or rebuts a fact or a point .


fn_spacy_tokens_for_baseline: Jackson , the estate agent , met Barratt on one of his visits having brought with him Michael Knott who was now desirous of talking business with John Taylor when he was next up .

source_bert_toks: jackson , the estate agent , met barr ##att on one of his visits having brought with him michael knot ##t who was now des ##iro ##us of talking business with john taylor when he was next up .

reference_raw: Jackson, the realtor, had met Barratt on one of his visits, who had brought Michael Knott with him, who wanted to talk business with John Taylor when he was next.

reference_spacy_tokens: Jackson , the realtor , had met Barratt on one of his visits , who had brought Michael Knott with him , who wanted to talk business with John Taylor when he was next .


fn_spacy_tokens_for_baseline: A more elegant , but equally traditional sauce for pork or game is made by thickening a red wine sauce with mustard and blood .

source_bert_toks: a more elegant , but equally traditional sauce for pork or game is made by thick ##ening a red wine sauce with mustard and blood .

reference_raw: A more elegant, but equally traditional, pork or game sauce is made by the addition of a red wine sauce with mustard and blood.

reference_spacy_tokens: A more elegant , but equally traditional , pork or game sauce is made by the addition of a red wine sauce with mustard and blood .


fn_spacy_tokens_for_baseline: ' Then she cut her arm , ' said Jennifer .

source_bert_toks: ' then she cut her arm , ' said jennifer .

reference_raw: 'She slashed her arm then,' Jennifer said.

reference_spacy_tokens: ' She slashed her arm then , ' Jennifer said .