fn_spacy_tokens_for_baseline: He promised a modern state for his people , but as the situation became volatile , civil strife broke out in Turkish cities , and those considered Greek were victims of threats and violence .

source_bert_toks: he promised a modern state for his people , but as the situation became volatile , civil strife broke out in turkish cities , and those considered greek were victims of threats and violence .

reference_raw: He promised his people a modern state, but as the situation became unstable, civil strife began in Turkish cities, and those who thought Greece was the victim of threats and violence.

reference_spacy_tokens: He promised his people a modern state , but as the situation became unstable , civil strife began in Turkish cities , and those who thought Greece was the victim of threats and violence .


fn_spacy_tokens_for_baseline: MIP-1 specific augmentation of adhesion to VCAM-1 was not observed with a control glycoprotein ( CD45 ; data not shown ) .

source_bert_toks: mi ##p - 1 specific aug ##ment ##ation of ad ##hesion to vc ##am - 1 was not observed with a control g ##ly ##co ##pro ##tein ( cd ##45 ; data not shown ) .

reference_raw: Specific increase in MIP-1 adhesion to VCAM-1 was not observed with glycoprotein control (CD45; no data were shown).

reference_spacy_tokens: Specific increase in MIP-1 adhesion to VCAM-1 was not observed with glycoprotein control ( CD45 ; no data were shown ) .


fn_spacy_tokens_for_baseline: In its day , the Times bombing was equivalent to the 2001 destruction of the World Trade Center .

source_bert_toks: in its day , the times bombing was equivalent to the 2001 destruction of the world trade center .

reference_raw: At that time, the Times bombing was the same as the World Trade Center destroyed in 2001.

reference_spacy_tokens: At that time , the Times bombing was the same as the World Trade Center destroyed in 2001 .


fn_spacy_tokens_for_baseline: He ca n't complain about people not liking him when he 's so horrible to them .

source_bert_toks: he can ' t complain about people not liking him when he ' s so horrible to them .

reference_raw: He can't complain that people don't like him when he treats them so badly.

reference_spacy_tokens: He ca n't complain that people do n't like him when he treats them so badly .


fn_spacy_tokens_for_baseline: Older kids , like Tracy and Kerry , left homeless after a recent murder - suicide in Indianapolis claimed Mom and Dad .

source_bert_toks: older kids , like tracy and kerry , left homeless after a recent murder - suicide in indianapolis claimed mom and dad .

reference_raw: Older children, such as Tracy and Kerry, left homeless after a recent murder-suicide in Indianapolis claimed to be Mom and Dad.

reference_spacy_tokens: Older children , such as Tracy and Kerry , left homeless after a recent murder - suicide in Indianapolis claimed to be Mom and Dad .


fn_spacy_tokens_for_baseline: Billy had just shuffled from one foot to the other and blushed as all dutiful sons should do .

source_bert_toks: billy had just shuffled from one foot to the other and blushed as all du ##ti ##ful sons should do .

reference_raw: Billy moved from one foot to the other, blushing as any dutiful son should.

reference_spacy_tokens: Billy moved from one foot to the other , blushing as any dutiful son should .


fn_spacy_tokens_for_baseline: The lexicon was much more complete , being derived from the LDOCE dictionary ( for details see Carroll and Grover ( 1989 ) ) .

source_bert_toks: the lexi ##con was much more complete , being derived from the ld ##oc ##e dictionary ( for details see carroll and grover ( 1989 ) ) .

reference_raw: The lexicon was much more comprehensive because it was derived from the LDOCE dictionary (see Carroll and Grover (1989) for details).

reference_spacy_tokens: The lexicon was much more comprehensive because it was derived from the LDOCE dictionary ( see Carroll and Grover ( 1989 ) for details ) .


fn_spacy_tokens_for_baseline: Perhaps encouraged by Varro , Caesar went to conquer Gaul with Posidonius in his satchel .

source_bert_toks: perhaps encouraged by var ##ro , caesar went to conquer gaul with po ##si ##don ##ius in his sat ##chel .

reference_raw: Perhaps supported by Varro, Caesar went to take Gaul with Posidonius in his bag.

reference_spacy_tokens: Perhaps supported by Varro , Caesar went to take Gaul with Posidonius in his bag .


fn_spacy_tokens_for_baseline: The Kazakh - brokered agreement had called for a ceasefire along the border between the two former Soviet republics .

source_bert_toks: the kazakh - broker ##ed agreement had called for a ceasefire along the border between the two former soviet republics .

reference_raw: The Kazakh-broken treaty called for a ceasefire along the frontier between the two former Soviet republics.

reference_spacy_tokens: The Kazakh - broken treaty called for a ceasefire along the frontier between the two former Soviet republics .


fn_spacy_tokens_for_baseline: It is a mystic power not of the world of material facts , a divine gift in compensation for our ephemeral life .

source_bert_toks: it is a mystic power not of the world of material facts , a divine gift in compensation for our ep ##hem ##eral life .

reference_raw: It's a mystic force, not a world of material facts, a divine gift to compensate for our fleeting life.

reference_spacy_tokens: It 's a mystic force , not a world of material facts , a divine gift to compensate for our fleeting life .


fn_spacy_tokens_for_baseline: Traces of the old town can still be found around the port , though it is difficult to locate anything but British or German bars and restaurants along the crowded beachfront .

source_bert_toks: traces of the old town can still be found around the port , though it is difficult to locate anything but british or german bars and restaurants along the crowded beach ##front .

reference_raw: There are still signs of the old city around the port, although it is difficult to find anything other than British or German bars and restaurants along a crowded beachfront.

reference_spacy_tokens: There are still signs of the old city around the port , although it is difficult to find anything other than British or German bars and restaurants along a crowded beachfront .


fn_spacy_tokens_for_baseline: From the monastery , hikers enjoy the two - hour cross - country trek down to Silvermine Bay , but the authorities have warned walkers to be on the lookout for snakes , which can be plentiful in the Lantau hinterland , especially in summer .

source_bert_toks: from the monastery , hike ##rs enjoy the two - hour cross - country trek down to silver ##mine bay , but the authorities have warned walkers to be on the lookout for snakes , which can be pl ##ent ##iful in the lan ##ta ##u hint ##erland , especially in summer .

reference_raw: From the convent, tourists enjoy a two-hour cross-country trip to Silvermine Bay, but the authorities warned the pedestrians to look out for snakes, which could be abundant in the Land of Lantau, especially in the summer.

reference_spacy_tokens: From the convent , tourists enjoy a two - hour cross - country trip to Silvermine Bay , but the authorities warned the pedestrians to look out for snakes , which could be abundant in the Land of Lantau , especially in the summer .


fn_spacy_tokens_for_baseline: At the beginning of 1975 , Ford sought a tax cut of $ 16 billion from congress , but once again the portents for approval were not good .

source_bert_toks: at the beginning of 1975 , ford sought a tax cut of $ 16 billion from congress , but once again the porte ##nts for approval were not good .

reference_raw: In early 1975, Ford asked Congress for a $16 billion tax cut, but once again, the favors for approval were not good.

reference_spacy_tokens: In early 1975 , Ford asked Congress for a $ 16 billion tax cut , but once again , the favors for approval were not good .


fn_spacy_tokens_for_baseline: She helped the younger woman to the kitchen , put her on a chair and looked round for the kettle .

source_bert_toks: she helped the younger woman to the kitchen , put her on a chair and looked round for the kettle .

reference_raw: She helped the younger woman into the kitchen, put her in a chair, and glanced around for a pot.

reference_spacy_tokens: She helped the younger woman into the kitchen , put her in a chair , and glanced around for a pot .


fn_spacy_tokens_for_baseline: They can take one of the following forms : 1- Steel pipes : Insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2- Barrels : They are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3- Ditches : They are better than road bumps because they are harder to see .

source_bert_toks: they can take one of the following forms : 1 - steel pipes : insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2 - barrels : they are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3 - ditch ##es : they are better than road bumps because they are harder to see .

reference_raw: They may take one of the following forms: 1-Steel pipes: insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre, then fill them with cement 2-Barrels: they are filled with cement and are located around the building, especially at the entrance to prevent vehicles from crashing into it 3-Ditches: they are better than road bumps because they are more difficult to see.

reference_spacy_tokens: They may take one of the following forms : 1-Steel pipes : insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre , then fill them with cement 2-Barrels : they are filled with cement and are located around the building , especially at the entrance to prevent vehicles from crashing into it 3-Ditches : they are better than road bumps because they are more difficult to see .


fn_spacy_tokens_for_baseline: ' I must n't keep rattling on like this ! '

source_bert_toks: ' i must ##n ' t keep rattling on like this ! '

reference_raw: "I can't keep talking like that!"

reference_spacy_tokens: " I ca n't keep talking like that ! "


fn_spacy_tokens_for_baseline: All that remains now of the sixteen dwellings Seller burned are a few tumbled stones , scattered over the green hillside .

source_bert_toks: all that remains now of the sixteen dwellings seller burned are a few tumbled stones , scattered over the green hillside .

reference_raw: All that remained of the sixteen houses that Seller had burned were a few broken stones scattered over a green slope.

reference_spacy_tokens: All that remained of the sixteen houses that Seller had burned were a few broken stones scattered over a green slope .


fn_spacy_tokens_for_baseline: He had opened a bottle of wine , and Alyssia sipped cautiously from the glass , not wanting to lose control again because she was tipsy .

source_bert_toks: he had opened a bottle of wine , and al ##ys ##sia sipped cautiously from the glass , not wanting to lose control again because she was tips ##y .

reference_raw: He opened a bottle of wine, and Alyssia drank carefully, not wanting to lose control again because she was drunk.

reference_spacy_tokens: He opened a bottle of wine , and Alyssia drank carefully , not wanting to lose control again because she was drunk .


fn_spacy_tokens_for_baseline: He was painfully aware of the proximity of her body as she leant over the desk .

source_bert_toks: he was painfully aware of the proximity of her body as she lean ##t over the desk .

reference_raw: As she leaned over the table, he was painfully aware of the nearness of her body.

reference_spacy_tokens: As she leaned over the table , he was painfully aware of the nearness of her body .


fn_spacy_tokens_for_baseline: But the BBC feared a probe by the Broadcast Standards Commission .

source_bert_toks: but the bbc feared a probe by the broadcast standards commission .

reference_raw: But the BBC was afraid of a drone from the Broadcast Standards Commission.

reference_spacy_tokens: But the BBC was afraid of a drone from the Broadcast Standards Commission .


fn_spacy_tokens_for_baseline: Pakistan 's government has denied involvement in the embassy attack , but Afghan officials have cited damning evidence , including repeated cellphone calls made by the assailants to handlers in Pakistan .

source_bert_toks: pakistan ' s government has denied involvement in the embassy attack , but afghan officials have cited damn ##ing evidence , including repeated cell ##phone calls made by the ass ##ail ##ants to handler ##s in pakistan .

reference_raw: The Pakistani government refused to participate in the embassy attack, but Afghan officials cited damning evidence, including repeated phone calls from attackers to handlers in Pakistan.

reference_spacy_tokens: The Pakistani government refused to participate in the embassy attack , but Afghan officials cited damning evidence , including repeated phone calls from attackers to handlers in Pakistan .


fn_spacy_tokens_for_baseline: DERBY ROAD Motive Power Depot was the last of a series of locomotive sheds built in Southport by the various pregrouping railways .

source_bert_toks: derby road motive power depot was the last of a series of locomotive sheds built in southport by the various pre ##group ##ing railways .

reference_raw: DERBY ROAD Motive Power Depot was the last of a series of locomotive shacks built in Southport by various pre-assembled railways.

reference_spacy_tokens: DERBY ROAD Motive Power Depot was the last of a series of locomotive shacks built in Southport by various pre - assembled railways .


fn_spacy_tokens_for_baseline: At first instance , the District Court found ( and the Court of Appeals agreed ) that Winans had knowingly breached a duty of confidentiality by misappropriating prepublication information regarding the timing and contents of the Heard columns .

source_bert_toks: at first instance , the district court found ( and the court of appeals agreed ) that win ##ans had knowing ##ly breached a duty of confidential ##ity by mis ##app ##rop ##ria ##ting prep ##ub ##lica ##tion information regarding the timing and contents of the heard columns .

reference_raw: At first instance, the District Court found (and the Court of Appeal agreed) that Winans had knowingly infringed the obligation of confidentiality by misappropriating pre-publication information on the timing and content of the Heard columns.

reference_spacy_tokens: At first instance , the District Court found ( and the Court of Appeal agreed ) that Winans had knowingly infringed the obligation of confidentiality by misappropriating pre - publication information on the timing and content of the Heard columns .


fn_spacy_tokens_for_baseline: These will rapidly solidify to form small beads of glass , a type of solid with a disorderly molecular arrangement .

source_bert_toks: these will rapidly solid ##ify to form small beads of glass , a type of solid with a disorder ##ly molecular arrangement .

reference_raw: They harden quickly to form small beads of glass, a kind of solid with a disorderly molecular structure.

reference_spacy_tokens: They harden quickly to form small beads of glass , a kind of solid with a disorderly molecular structure .


fn_spacy_tokens_for_baseline: My first experience with boys was not a great success but it was n't the last , and later I found myself in worse scrapes than on that first occasion .

source_bert_toks: my first experience with boys was not a great success but it wasn ' t the last , and later i found myself in worse scrape ##s than on that first occasion .

reference_raw: My first experience with boys wasn't much of a success, but it wasn't the last one, and then I found myself in worse scratches than the first time.

reference_spacy_tokens: My first experience with boys was n't much of a success , but it was n't the last one , and then I found myself in worse scratches than the first time .


fn_spacy_tokens_for_baseline: The Chiefs of Staff , however , supported the American plea .

source_bert_toks: the chiefs of staff , however , supported the american plea .

reference_raw: But the chiefs of staff supported the American request.

reference_spacy_tokens: But the chiefs of staff supported the American request .


fn_spacy_tokens_for_baseline: He was hard and warm , and the faint musky tang of his aftershave teased her nostrils , evoking memories she would far rather had lain dormant .

source_bert_toks: he was hard and warm , and the faint mu ##sky tang of his after ##sha ##ve teased her nostrils , ev ##oki ##ng memories she would far rather had lai ##n dormant .

reference_raw: It was hard and warm, and the faint musky tang of his aftershave teased her nostrils, evocating memories she would have preferred to lie dormant.

reference_spacy_tokens: It was hard and warm , and the faint musky tang of his aftershave teased her nostrils , evocating memories she would have preferred to lie dormant .


fn_spacy_tokens_for_baseline: We faked the unit 's video to show us ' in ' .

source_bert_toks: we fake ##d the unit ' s video to show us ' in ' .

reference_raw: We falsified the unit's video to show up.

reference_spacy_tokens: We falsified the unit 's video to show up .


fn_spacy_tokens_for_baseline: The show does look pretty shitty at the moment .

source_bert_toks: the show does look pretty shitty at the moment .

reference_raw: The show looks pretty fucked up right now.

reference_spacy_tokens: The show looks pretty fucked up right now .


fn_spacy_tokens_for_baseline: " I started pretty slow and she started off hitting incredible shots , " Graf said .

source_bert_toks: " i started pretty slow and she started off hitting incredible shots , " graf said .

reference_raw: "I began very slowly, and she began to shoot incredulously," said Graf.

reference_spacy_tokens: " I began very slowly , and she began to shoot incredulously , " said Graf .


fn_spacy_tokens_for_baseline: Hugo himself was lithe , elegant and charming with a slight edge of fascinating middle - European foreignness that came from his Bulgarian father .

source_bert_toks: hugo himself was lit ##he , elegant and charming with a slight edge of fascinating middle - european foreign ##ness that came from his bulgarian father .

reference_raw: Hugo himself was light, elegant and charming, with a slight hint of fascinating middle-European alienity from his Bulgarian father.

reference_spacy_tokens: Hugo himself was light , elegant and charming , with a slight hint of fascinating middle - European alienity from his Bulgarian father .


fn_spacy_tokens_for_baseline: As for commemorative musical events , some promoters jumped the gun by a year ; others have been so keen not to be upstaged that January has already seen dozens of concerts .

source_bert_toks: as for commemorative musical events , some promoters jumped the gun by a year ; others have been so keen not to be ups ##tage ##d that january has already seen dozens of concerts .

reference_raw: As far as commemorative musical events are concerned, some of the promoters jumped the gun by a year; others were so eager not to be upstaged that they had seen scores of concerts in January.

reference_spacy_tokens: As far as commemorative musical events are concerned , some of the promoters jumped the gun by a year ; others were so eager not to be upstaged that they had seen scores of concerts in January .


fn_spacy_tokens_for_baseline: Tears trickled from the corners of her eyes , and she knuckled them away fiercely .

source_bert_toks: tears trickle ##d from the corners of her eyes , and she kn ##uck ##led them away fiercely .

reference_raw: Tears ran from the corners of her eyes, and she jerked them away wildly.

reference_spacy_tokens: Tears ran from the corners of her eyes , and she jerked them away wildly .


fn_spacy_tokens_for_baseline: The master who performed the pairing - up ceremony wore a parody of clerical vestments and pronounced the couple ' properly paired - up ' .

source_bert_toks: the master who performed the pairing - up ceremony wore a parody of clerical vest ##ments and pronounced the couple ' properly paired - up ' .

reference_raw: The master who had performed the pairing ceremony wore a parody of clerical vests and pronounced the pair "properly paired".

reference_spacy_tokens: The master who had performed the pairing ceremony wore a parody of clerical vests and pronounced the pair " properly paired " .


fn_spacy_tokens_for_baseline: They figure lightning ca n't strike twice . '

source_bert_toks: they figure lightning can ' t strike twice . '

reference_raw: They don't think lightning strikes twice.'

reference_spacy_tokens: They do n't think lightning strikes twice . '


fn_spacy_tokens_for_baseline: The entire plot had worked even better than he had dared to hope .

source_bert_toks: the entire plot had worked even better than he had dared to hope .

reference_raw: The whole plan worked even better than he could have hoped.

reference_spacy_tokens: The whole plan worked even better than he could have hoped .


fn_spacy_tokens_for_baseline: She coldly snubbed the Duke and Duchess of Windsor for years , and it was revealed recently that she failed to visit two cousins who had been committed to mental institutions .

source_bert_toks: she coldly s ##nu ##bbed the duke and duchess of windsor for years , and it was revealed recently that she failed to visit two cousins who had been committed to mental institutions .

reference_raw: The duke and duchess of Windsor had been snubbed coldly for years, and it had recently been discovered that she had not visited two cousins who were devoted to mental institutions.

reference_spacy_tokens: The duke and duchess of Windsor had been snubbed coldly for years , and it had recently been discovered that she had not visited two cousins who were devoted to mental institutions .


fn_spacy_tokens_for_baseline: This is correct as a statement of fact , but not as an analysis of the logic behind their success .

source_bert_toks: this is correct as a statement of fact , but not as an analysis of the logic behind their success .

reference_raw: This is true as a statement of fact, but not as an analysis of the logic behind their success.

reference_spacy_tokens: This is true as a statement of fact , but not as an analysis of the logic behind their success .


fn_spacy_tokens_for_baseline: The temperature at which water droplets begin to condense is called the dew - point -- literally , the temperature below which dew will form .

source_bert_toks: the temperature at which water droplets begin to conde ##nse is called the dew - point - - literally , the temperature below which dew will form .

reference_raw: The temperature at which the droplets begin to condensate is called a dew point -- literally, the temperature below which the dew will form.

reference_spacy_tokens: The temperature at which the droplets begin to condensate is called a dew point -- literally , the temperature below which the dew will form .


fn_spacy_tokens_for_baseline: Though there is no concrete evidence that Iran is currently developing CW , there have been several instances where CW precursors were purchased from foreign sources in the past .

source_bert_toks: though there is no concrete evidence that iran is currently developing cw , there have been several instances where cw precursor ##s were purchased from foreign sources in the past .

reference_raw: Although there is no concrete evidence that Iran is currently developing CW, there have been a number of cases in the past where CW precursors have been purchased from foreign sources.

reference_spacy_tokens: Although there is no concrete evidence that Iran is currently developing CW , there have been a number of cases in the past where CW precursors have been purchased from foreign sources .


fn_spacy_tokens_for_baseline: Annual emissions of sulphur from the mines are thought to amount to 700,000 tonnes , together with large quantities of metals such as nickel , copper and zinc .

source_bert_toks: annual emissions of sul ##ph ##ur from the mines are thought to amount to 700 , 000 tonnes , together with large quantities of metals such as nickel , copper and zinc .

reference_raw: It is assumed that the annual emissions of sulphur from the mines are 700,000 tonnes, together with large quantities of metals such as nickel, copper and zinc.

reference_spacy_tokens: It is assumed that the annual emissions of sulphur from the mines are 700,000 tonnes , together with large quantities of metals such as nickel , copper and zinc .


fn_spacy_tokens_for_baseline: Yet to those on the inside , the University is a warm and vibrant community that derives much benefit from drawing upon groups from a wide variety of backgrounds .

source_bert_toks: yet to those on the inside , the university is a warm and vibrant community that derives much benefit from drawing upon groups from a wide variety of backgrounds .

reference_raw: But for those inside, the university is a warm and dynamic community that benefits greatly from drawing on groups from a wide range of backgrounds.

reference_spacy_tokens: But for those inside , the university is a warm and dynamic community that benefits greatly from drawing on groups from a wide range of backgrounds .


fn_spacy_tokens_for_baseline: ' USAID ensures that all of its contractors , including RTI and Aecom , abide by all current U. S. and Iraqi laws and regulations , ' embassy spokesman David Ranz said .

source_bert_toks: ' usa ##id ensures that all of its contractors , including rt ##i and ae ##com , ab ##ide by all current u . s . and iraqi laws and regulations , ' embassy spokesman david ran ##z said .

reference_raw: 'USAID ensures that all its suppliers, including RTI and Aecom, comply with the existing laws and regulations of the United States and Iraq,' embassy spokesman David Ranz said.

reference_spacy_tokens: ' USAID ensures that all its suppliers , including RTI and Aecom , comply with the existing laws and regulations of the United States and Iraq , ' embassy spokesman David Ranz said .


fn_spacy_tokens_for_baseline: This is the embryonic Iraqi SWAT team in action , rousing families from their sleep and rounding up men for questioning about the deadly insurgency in towns such as Jabella , south of Baghdad .

source_bert_toks: this is the embryo ##nic iraqi swat team in action , ro ##using families from their sleep and rounding up men for questioning about the deadly insurgency in towns such as ja ##bella , south of baghdad .

reference_raw: It's an embryonic Iraqi SWAT team in action that wakes families from their sleep and gathers men for questioning the deadly rebellion in cities like Jabella, south of Baghdad.

reference_spacy_tokens: It 's an embryonic Iraqi SWAT team in action that wakes families from their sleep and gathers men for questioning the deadly rebellion in cities like Jabella , south of Baghdad .


fn_spacy_tokens_for_baseline: ' In France they have a Minister For Rock who goes round and investigates the need for venues and rehearsal space , ' says Salli .

source_bert_toks: ' in france they have a minister for rock who goes round and investigates the need for venues and rehearsal space , ' says sal ##li .

reference_raw: "There's a rock minister in France who's going around exploring the need for a place and a place to test," Salli says.

reference_spacy_tokens: " There 's a rock minister in France who 's going around exploring the need for a place and a place to test , " Salli says .


fn_spacy_tokens_for_baseline: not since we 'd been married , but , erm , and erm , it was in the March was n't it , just before we announced our engagement .

source_bert_toks: not since we ' d been married , but , er ##m , and er ##m , it was in the march wasn ' t it , just before we announced our engagement .

reference_raw: Not since we were married, but, uh, and, uh, it was March, wasn't it, just before we announced that we were engaged.

reference_spacy_tokens: Not since we were married , but , uh , and , uh , it was March , was n't it , just before we announced that we were engaged .


fn_spacy_tokens_for_baseline: The residence of the Nicaraguan ambassador had been ransacked by US troops on Dec. 29 , prompting an apology from US President George Bush .

source_bert_toks: the residence of the nicaragua ##n ambassador had been ran ##sack ##ed by us troops on dec . 29 , prompting an apology from us president george bush .

reference_raw: The residence of the Nicaraguan ambassador was raided by U.S. troops on December 29, prompting an apology from US President George Bush.

reference_spacy_tokens: The residence of the Nicaraguan ambassador was raided by U.S. troops on December 29 , prompting an apology from US President George Bush .


fn_spacy_tokens_for_baseline: The Kennel Club 's Bill Edmond added : ' 225 Rottweilers were shown at Crufts last year without a snarl or a growl from any of them . '

source_bert_toks: the ken ##nel club ' s bill edmond added : ' 225 rot ##t ##weiler ##s were shown at cr ##uf ##ts last year without a snarl or a growl from any of them . '

reference_raw: Bill Edmond of the Kennel Club added: '225 Rottweilers showed up at the Crufts last year without a growl or a growl from any of them.'

reference_spacy_tokens: Bill Edmond of the Kennel Club added : ' 225 Rottweilers showed up at the Crufts last year without a growl or a growl from any of them . '


fn_spacy_tokens_for_baseline: The FDA 's US Orphan Drug Act is intended to assist and encourage companies to develop safe and effective therapies for the treatment of rare diseases and disorders .

source_bert_toks: the fda ' s us orphan drug act is intended to assist and encourage companies to develop safe and effective the ##ra ##pies for the treatment of rare diseases and disorders .

reference_raw: The U.S. Orphan Drug Act of the FDA aims to help and support companies to develop safe and efficient therapies for the treatment of rare diseases and disorders.

reference_spacy_tokens: The U.S. Orphan Drug Act of the FDA aims to help and support companies to develop safe and efficient therapies for the treatment of rare diseases and disorders .


fn_spacy_tokens_for_baseline: yeah well see um i 'm i 'm a cool person they call they and they i think that 's relates to the same thing as the winter

source_bert_toks: yeah well see um i ' m i ' m a cool person they call they and they i think that ' s relates to the same thing as the winter

reference_raw: Yeah, well see, um I'm a great person called, and I think it has something to do with the same thing as winter.

reference_spacy_tokens: Yeah , well see , um I 'm a great person called , and I think it has something to do with the same thing as winter .


fn_spacy_tokens_for_baseline: Among humans , at this present time in our history , we have largely lost our ability to perceive directly the subtle aspects of our physical world .

source_bert_toks: among humans , at this present time in our history , we have largely lost our ability to perceive directly the subtle aspects of our physical world .

reference_raw: Among humans, at this time in our history, we have largely lost our ability to see the delicate aspects of our physical world directly.

reference_spacy_tokens: Among humans , at this time in our history , we have largely lost our ability to see the delicate aspects of our physical world directly .


fn_spacy_tokens_for_baseline: " Magnificent ruin , " quoted Mr Augustus Snodgrass , " Samuel Pipkin proclaimed .

source_bert_toks: " magnificent ruin , " quoted mr augustus s ##no ##d ##grass , " samuel pip ##kin proclaimed .

reference_raw: "The Great Devastation," said Mr. Augustus Snodgrass," said Samuel Pipkin.

reference_spacy_tokens: " The Great Devastation , " said Mr. Augustus Snodgrass , " said Samuel Pipkin .


fn_spacy_tokens_for_baseline: He was exasperated , but not cast down .

source_bert_toks: he was exasperated , but not cast down .

reference_raw: He was irritated, but he wasn't thrown down.

reference_spacy_tokens: He was irritated , but he was n't thrown down .


fn_spacy_tokens_for_baseline: We may have been poor and ignorant in Glasgow but ratting on our friends was something we left to the narks , the narks and the prosperous classes .

source_bert_toks: we may have been poor and ignorant in glasgow but rat ##ting on our friends was something we left to the na ##rks , the na ##rks and the prosperous classes .

reference_raw: We may have been poor and ignorant in Glasgow, but it was something we left to the narks, the narks, and the thriving class.

reference_spacy_tokens: We may have been poor and ignorant in Glasgow , but it was something we left to the narks , the narks , and the thriving class .


fn_spacy_tokens_for_baseline: We have attended closely to how children learn to speak .

source_bert_toks: we have attended closely to how children learn to speak .

reference_raw: We've been careful how children learn to talk.

reference_spacy_tokens: We 've been careful how children learn to talk .


fn_spacy_tokens_for_baseline: A cloud occludes the mountain 's foot

source_bert_toks: a cloud o ##cc ##lu ##des the mountain ' s foot

reference_raw: The mountain's leg is surrounded by a cloud

reference_spacy_tokens: The mountain 's leg is surrounded by a cloud


fn_spacy_tokens_for_baseline: ' I 'd dearly like to know what were supposed to be achieving , that 's all , ' Lambert bitched .

source_bert_toks: ' i ' d dear ##ly like to know what were supposed to be achieving , that ' s all , ' lambert bitch ##ed .

reference_raw: 'I wish I knew what was to be achieved, that's all,' said Lambert.

reference_spacy_tokens: ' I wish I knew what was to be achieved , that 's all , ' said Lambert .


fn_spacy_tokens_for_baseline: Annie spent her weekends reading , going to church and having tea with other young women in like circumstances .

source_bert_toks: annie spent her weekends reading , going to church and having tea with other young women in like circumstances .

reference_raw: Annie spent the weekends reading, going to church and having tea with other young women in similar circumstances.

reference_spacy_tokens: Annie spent the weekends reading , going to church and having tea with other young women in similar circumstances .


fn_spacy_tokens_for_baseline: We have to come to some kind of deal with the trade unions in this complex interim period .

source_bert_toks: we have to come to some kind of deal with the trade unions in this complex interim period .

reference_raw: In this difficult transition period, we must come to some sort of agreement with the unions.

reference_spacy_tokens: In this difficult transition period , we must come to some sort of agreement with the unions .


fn_spacy_tokens_for_baseline: From a forward fighting stance , the student swings his rear leg forward and upward until the knee comes to shoulder height .

source_bert_toks: from a forward fighting stance , the student swings his rear leg forward and upward until the knee comes to shoulder height .

reference_raw: The student swings his back leg forward and up from the forward fighting position until his knee rises to shoulder height.

reference_spacy_tokens: The student swings his back leg forward and up from the forward fighting position until his knee rises to shoulder height .


fn_spacy_tokens_for_baseline: She prayed the guttering would hold her weight as she slowly hauled herself up until she could sit astride the peak of the roof .

source_bert_toks: she prayed the gut ##tering would hold her weight as she slowly hauled herself up until she could sit astrid ##e the peak of the roof .

reference_raw: She prayed that the gutter would hold her weight as she slowly pulled herself to her feet until she could sit astride the top of the roof.

reference_spacy_tokens: She prayed that the gutter would hold her weight as she slowly pulled herself to her feet until she could sit astride the top of the roof .


fn_spacy_tokens_for_baseline: He in turn had friends among the indoor servants who unite in their fear and dislike of their master .

source_bert_toks: he in turn had friends among the indoor servants who unite in their fear and dislike of their master .

reference_raw: In turn, he had friends among the servants at home, uniting in their fear and displeasure of their master.

reference_spacy_tokens: In turn , he had friends among the servants at home , uniting in their fear and displeasure of their master .


fn_spacy_tokens_for_baseline: And yet , I never , to the best of my knowledge , cut my toenails .

source_bert_toks: and yet , i never , to the best of my knowledge , cut my toe ##nail ##s .

reference_raw: And yet, as far as I know, I've never cut my nails.

reference_spacy_tokens: And yet , as far as I know , I 've never cut my nails .


fn_spacy_tokens_for_baseline: He teaches history and coaches rugger : his two great passions . '

source_bert_toks: he teaches history and coaches rug ##ger : his two great passions . '

reference_raw: He teaches the past and coaches the rugger: his two great passions.'

reference_spacy_tokens: He teaches the past and coaches the rugger : his two great passions . '


fn_spacy_tokens_for_baseline: If we moor a tiny toy boat at some fixed point in the pond , the boat will bob up and down rhythmically as the waves pass under it .

source_bert_toks: if we moor a tiny toy boat at some fixed point in the pond , the boat will bob up and down rhythmic ##ally as the waves pass under it .

reference_raw: If we anchor a small toy boat at some fixed point in the pond, it'll bounce back and forth rhythmically as the waves pass beneath it.

reference_spacy_tokens: If we anchor a small toy boat at some fixed point in the pond , it 'll bounce back and forth rhythmically as the waves pass beneath it .


fn_spacy_tokens_for_baseline: With the introduction of Community Charge all charge payers will pay their annual bill by ten monthly instalments commencing 15th April unless they opt for either annual or half - yearly payments .

source_bert_toks: with the introduction of community charge all charge pay ##ers will pay their annual bill by ten monthly ins ##tal ##ments commencing 15th april unless they opt for either annual or half - yearly payments .

reference_raw: With the introduction of a Community fee, all fee-payers shall pay their annual bill by 10 monthly instalments starting on 15 April, unless they decide to make either annual or semi-annual payments.

reference_spacy_tokens: With the introduction of a Community fee , all fee - payers shall pay their annual bill by 10 monthly instalments starting on 15 April , unless they decide to make either annual or semi - annual payments .


fn_spacy_tokens_for_baseline: At 11.15pm another student was mugged by a single attacker who punched him twice before making off with in cash .

source_bert_toks: at 11 . 15 ##pm another student was mug ##ged by a single attacker who punched him twice before making off with in cash .

reference_raw: At 11:15, another student was ambushed by a single assailant who hit him twice before making money.

reference_spacy_tokens: At 11:15 , another student was ambushed by a single assailant who hit him twice before making money .


fn_spacy_tokens_for_baseline: More than 6 ft tall with short hair and in his forties , Spiro is said to have reminded Waite of Sean Connery in his James Bond days .

source_bert_toks: more than 6 ft tall with short hair and in his fort ##ies , sp ##iro is said to have reminded wait ##e of sean conner ##y in his james bond days .

reference_raw: More than six feet tall, short-haired, and in his forties, Spiro was said to remember Sean Connery in his James Bond days.

reference_spacy_tokens: More than six feet tall , short - haired , and in his forties , Spiro was said to remember Sean Connery in his James Bond days .


fn_spacy_tokens_for_baseline: That is the way the system works .

source_bert_toks: that is the way the system works .

reference_raw: That's how the system operates.

reference_spacy_tokens: That 's how the system operates .


fn_spacy_tokens_for_baseline: If she had repelled all boarders it was only because none of them had ever been quite persuasive enough .

source_bert_toks: if she had rep ##elled all board ##ers it was only because none of them had ever been quite per ##su ##asi ##ve enough .

reference_raw: If she repulsed all the boarders, it was only because none of them had ever been quite convincing.

reference_spacy_tokens: If she repulsed all the boarders , it was only because none of them had ever been quite convincing .


fn_spacy_tokens_for_baseline: Kazakhstani President Nazarbayev , however , has declared Kazakhstan 's commitment to the nonproliferation of BW and associated technologies .

source_bert_toks: kazakhstan ##i president na ##zar ##bay ##ev , however , has declared kazakhstan ' s commitment to the non ##pro ##life ##ration of b ##w and associated technologies .

reference_raw: However, Kazakhstan's President Nazarbayev has made a declaration that Kazakhstan is committed to the non-proliferation of BW and related technologies.

reference_spacy_tokens: However , Kazakhstan 's President Nazarbayev has made a declaration that Kazakhstan is committed to the non - proliferation of BW and related technologies .


fn_spacy_tokens_for_baseline: MPs seek inquiry as third Gartnavel man dies

source_bert_toks: mps seek inquiry as third ga ##rt ##na ##vel man dies

reference_raw: Members are looking for an investigation when the third Gartnavel man dies.

reference_spacy_tokens: Members are looking for an investigation when the third Gartnavel man dies .


fn_spacy_tokens_for_baseline: Social workers as well as lecturers in education contribute to the course input .

source_bert_toks: social workers as well as lecturer ##s in education contribute to the course input .

reference_raw: The contribution of social workers and lecturers in the field of education is to the contribution of the course.

reference_spacy_tokens: The contribution of social workers and lecturers in the field of education is to the contribution of the course .


fn_spacy_tokens_for_baseline: How this will affect the various programs is presently unclear .

source_bert_toks: how this will affect the various programs is presently unclear .

reference_raw: It is currently unclear how this will have an impact on the different programmes.

reference_spacy_tokens: It is currently unclear how this will have an impact on the different programmes .


fn_spacy_tokens_for_baseline: There were 30 Pakistanis and five Iranians working on the overpass at the time of the shooting , said Mohammed .

source_bert_toks: there were 30 pakistani ##s and five iranian ##s working on the over ##pass at the time of the shooting , said mohammed .

reference_raw: At the time of the shooting, Mohammed said, there were 30 Pakistanis and five Iranians working on the crossing.

reference_spacy_tokens: At the time of the shooting , Mohammed said , there were 30 Pakistanis and five Iranians working on the crossing .


fn_spacy_tokens_for_baseline: As I passed the ladies I noticed that the beer crates stashed in front of the Fire Exit had been moved aside .

source_bert_toks: as i passed the ladies i noticed that the beer crates st ##ash ##ed in front of the fire exit had been moved aside .

reference_raw: As I passed the ladies, I noticed that the beer boxes hidden outside the firehouse had been moved to the side.

reference_spacy_tokens: As I passed the ladies , I noticed that the beer boxes hidden outside the firehouse had been moved to the side .


fn_spacy_tokens_for_baseline: I know I 'm too thin , I do n't like what I look like and I 've been told if I lose any more weight I 'll have to give up work and be admitted to hospital .

source_bert_toks: i know i ' m too thin , i don ' t like what i look like and i ' ve been told if i lose any more weight i ' ll have to give up work and be admitted to hospital .

reference_raw: I know I'm too skinny, I don't like the way I look, and I've been told that if I lose any more weight, I'm gonna have to give up my job and get admitted to the hospital.

reference_spacy_tokens: I know I 'm too skinny , I do n't like the way I look , and I 've been told that if I lose any more weight , I 'm gon na have to give up my job and get admitted to the hospital .


fn_spacy_tokens_for_baseline: Karamanlis said , " This is a day of national mourning ... I wish to express my deep grief over the lost lives ... We are fighting against heavy odds , on many fronts and under particularly tough conditions . "

source_bert_toks: kara ##man ##lis said , " this is a day of national mourning . . . i wish to express my deep grief over the lost lives . . . we are fighting against heavy odds , on many fronts and under particularly tough conditions . "

reference_raw: Karamanlis said, "This is a nation's day of mourning... and I want to express my deep sorrow for the loss of our lives... we fight against great odds, on many fronts, and in particularly difficult circumstances."

reference_spacy_tokens: Karamanlis said , " This is a nation 's day of mourning ... and I want to express my deep sorrow for the loss of our lives ... we fight against great odds , on many fronts , and in particularly difficult circumstances . "


fn_spacy_tokens_for_baseline: No wonder Peter lacked confidence and spent all his time merely trying to be amusing in the face of Marc 's uncompromising thirst for excellence !

source_bert_toks: no wonder peter lacked confidence and spent all his time merely trying to be amusing in the face of marc ' s un ##com ##promising thirst for excellence !

reference_raw: No wonder Peter lacked confidence and spent all his time trying to entertain himself in the face of Mark's uncompromising desire for perfection!

reference_spacy_tokens: No wonder Peter lacked confidence and spent all his time trying to entertain himself in the face of Mark 's uncompromising desire for perfection !


fn_spacy_tokens_for_baseline: And this was his chance to find out whether Emily had been to the shed before coming home .

source_bert_toks: and this was his chance to find out whether emily had been to the shed before coming home .

reference_raw: And this was his opportunity to find out if Emily was in the shed before she came home.

reference_spacy_tokens: And this was his opportunity to find out if Emily was in the shed before she came home .


fn_spacy_tokens_for_baseline: Even as he watched , he saw lights flaming in the Dale in answer -- and he saw Dunan and his men rush the longhouses with the moon glittering on their swords .

source_bert_toks: even as he watched , he saw lights flaming in the dale in answer - - and he saw dun ##an and his men rush the long ##houses with the moon glittering on their swords .

reference_raw: Even as he watched, he could see the lights burning in the Dale in response-and he could see Dunan and his men rushing into the longhouses, the moon gleaming on their swords.

reference_spacy_tokens: Even as he watched , he could see the lights burning in the Dale in response - and he could see Dunan and his men rushing into the longhouses , the moon gleaming on their swords .


fn_spacy_tokens_for_baseline: Adam chuckled to himself as the four - seater Piper Arrow flew at two thousand feet across German airspace .

source_bert_toks: adam chuckled to himself as the four - seater piper arrow flew at two thousand feet across german airspace .

reference_raw: Adam laughed to himself as the four-seater Piper Arrow flew across German airspace at two thousand feet.

reference_spacy_tokens: Adam laughed to himself as the four - seater Piper Arrow flew across German airspace at two thousand feet .


fn_spacy_tokens_for_baseline: He added that the Iraqi opposition and the Iraqi Kurds had agreed to maintain the territorial integrity of Iraq .

source_bert_toks: he added that the iraqi opposition and the iraqi ku ##rds had agreed to maintain the territorial integrity of iraq .

reference_raw: He added that the Iraqi resistance and the Iraqi Kurds had agreed to maintain Iraq's territorial integrity.

reference_spacy_tokens: He added that the Iraqi resistance and the Iraqi Kurds had agreed to maintain Iraq 's territorial integrity .


fn_spacy_tokens_for_baseline: Iran 's plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

source_bert_toks: iran ' s plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

reference_raw: Iran's plans to build a civil nuclear power programme have raised a great deal of fear about its intention to develop nuclear weapons.

reference_spacy_tokens: Iran 's plans to build a civil nuclear power programme have raised a great deal of fear about its intention to develop nuclear weapons .


fn_spacy_tokens_for_baseline: The fruit spoils within a week and few will eat durian more than three days after they fall .

source_bert_toks: the fruit spoil ##s within a week and few will eat du ##rian more than three days after they fall .

reference_raw: In a week's time, the fruit will fall, and few will eat durian for more than three days.

reference_spacy_tokens: In a week 's time , the fruit will fall , and few will eat durian for more than three days .


fn_spacy_tokens_for_baseline: ' What an astonishing city this is ! ' he shouts at her , over the noise of the hooting beneath .

source_bert_toks: ' what an astonishing city this is ! ' he shouts at her , over the noise of the ho ##oting beneath .

reference_raw: "What a wonderful city!" he shouts at her, over the sound of the hooting below.

reference_spacy_tokens: " What a wonderful city ! " he shouts at her , over the sound of the hooting below .


fn_spacy_tokens_for_baseline: This is the world explored by one of her two schoolmistresses .

source_bert_toks: this is the world explored by one of her two school ##mist ##resses .

reference_raw: It's a world explored by one of her two schoolgirls.

reference_spacy_tokens: It 's a world explored by one of her two schoolgirls .


fn_spacy_tokens_for_baseline: If I got ta wait for him , I might as well wait for you too , might n't I ? '

source_bert_toks: if i gotta wait for him , i might as well wait for you too , might ##n ' t i ? '

reference_raw: If I have to wait for him, I can wait for you, right?'

reference_spacy_tokens: If I have to wait for him , I can wait for you , right ? '


fn_spacy_tokens_for_baseline: He thereby differentiates procedures designed to improve professional practice from those concerned with enhancing status .

source_bert_toks: he thereby differentiate ##s procedures designed to improve professional practice from those concerned with enhancing status .

reference_raw: It thus distinguishes procedures aimed at improving professional experience from those involved in improving status.

reference_spacy_tokens: It thus distinguishes procedures aimed at improving professional experience from those involved in improving status .


fn_spacy_tokens_for_baseline: MARCO VAN BASTEN scored four times as unbeaten AC Milan routed Napoli 5 - 1 to stay two points clear at the top of Italy 's Serie A. Italy

source_bert_toks: marco van bas ##ten scored four times as unbeaten ac milan routed napoli 5 - 1 to stay two points clear at the top of italy ' s serie a . italy

reference_raw: MARCO VAN BASTEN scored four times as unbeaten AC Milan redirected Napoli 5-1, leaving two points clear at the top of the Italian series A.

reference_spacy_tokens: MARCO VAN BASTEN scored four times as unbeaten AC Milan redirected Napoli 5 - 1 , leaving two points clear at the top of the Italian series A.


fn_spacy_tokens_for_baseline: He groaned and drew her closer , one hand around her waist , while the other separated her blouse from the waistband of her skirt .

source_bert_toks: he groaned and drew her closer , one hand around her waist , while the other separated her blouse from the waistband of her skirt .

reference_raw: He moaned and drew her close, one arm around her waist, the other separating her blouse from the belt of her skirt.

reference_spacy_tokens: He moaned and drew her close , one arm around her waist , the other separating her blouse from the belt of her skirt .


fn_spacy_tokens_for_baseline: A popular legend tells of Arion , a lyric poet and musician , who was returning to Greece from Italy , laden with riches he had won at music competitions .

source_bert_toks: a popular legend tells of ari ##on , a lyric poet and musician , who was returning to greece from italy , laden with riches he had won at music competitions .

reference_raw: The popular legend tells of Arion, a lyric poet and musician who returned from Italy to Greece, loaded with the wealth he had won at the music contests.

reference_spacy_tokens: The popular legend tells of Arion , a lyric poet and musician who returned from Italy to Greece , loaded with the wealth he had won at the music contests .


fn_spacy_tokens_for_baseline: Have events been organised to raise awareness among all staff of the recruitment problem ahead ?

source_bert_toks: have events been organised to raise awareness among all staff of the recruitment problem ahead ?

reference_raw: Have events been organised in order to raise the profile of the recruitment problem in the future for all staff?

reference_spacy_tokens: Have events been organised in order to raise the profile of the recruitment problem in the future for all staff ?


fn_spacy_tokens_for_baseline: Even James married a Jew 's stepdaughter .

source_bert_toks: even james married a jew ' s step ##da ##ught ##er .

reference_raw: Even James married the half-daughter of a Jew.

reference_spacy_tokens: Even James married the half - daughter of a Jew .


fn_spacy_tokens_for_baseline: Companies that set up their regional headquarters in Singapore are only taxed 10 % on income from approved services , including trading in foreign exchange and offshore investments .

source_bert_toks: companies that set up their regional headquarters in singapore are only tax ##ed 10 % on income from approved services , including trading in foreign exchange and offshore investments .

reference_raw: Companies which have established their regional head office in Singapore are taxed only 10% of the revenue from authorised services, including foreign-exchange and foreign-exchange investment.

reference_spacy_tokens: Companies which have established their regional head office in Singapore are taxed only 10 % of the revenue from authorised services , including foreign - exchange and foreign - exchange investment .


fn_spacy_tokens_for_baseline: Older retired people , they say , buy less food , spend less money on clothes , are not interested in modern electronics and take fewer holidays .

source_bert_toks: older retired people , they say , buy less food , spend less money on clothes , are not interested in modern electronics and take fewer holidays .

reference_raw: Older retired people, they say, buy less food, spend less money on clothes, don't care about the latest electronics, and take less vacations.

reference_spacy_tokens: Older retired people , they say , buy less food , spend less money on clothes , do n't care about the latest electronics , and take less vacations .


fn_spacy_tokens_for_baseline: He was accused of illegal possession of firearms and of embezzlement of public funds .

source_bert_toks: he was accused of illegal possession of firearms and of em ##be ##zzle ##ment of public funds .

reference_raw: He's been charged with illegal possession of firearms and embezzling public funds.

reference_spacy_tokens: He 's been charged with illegal possession of firearms and embezzling public funds .


fn_spacy_tokens_for_baseline: It was a very distressing time for him .

source_bert_toks: it was a very distress ##ing time for him .

reference_raw: It was a very stressful time for him.

reference_spacy_tokens: It was a very stressful time for him .


fn_spacy_tokens_for_baseline: She went low , slid on her belly , then was up , jumping high , higher than she had ever leaped before , her body curled into a tight ball .

source_bert_toks: she went low , slid on her belly , then was up , jumping high , higher than she had ever leaped before , her body curled into a tight ball .

reference_raw: She dropped low, slid down on her stomach, then rose, leaping high, higher than she had ever jumped, her body twisting into a tight ball.

reference_spacy_tokens: She dropped low , slid down on her stomach , then rose , leaping high , higher than she had ever jumped , her body twisting into a tight ball .


fn_spacy_tokens_for_baseline: I heard the crash of a body against the door , and angry snarling .

source_bert_toks: i heard the crash of a body against the door , and angry snarl ##ing .

reference_raw: I heard a body thump against the door and an angry growl.

reference_spacy_tokens: I heard a body thump against the door and an angry growl .


fn_spacy_tokens_for_baseline: Women sat under carved wooden verandahs preparing vegetables , fish and chicken .

source_bert_toks: women sat under carved wooden verandah ##s preparing vegetables , fish and chicken .

reference_raw: The women were sitting under carved wooden porches, preparing greens, fish, and chicken.

reference_spacy_tokens: The women were sitting under carved wooden porches , preparing greens , fish , and chicken .


fn_spacy_tokens_for_baseline: This will contain only your last name , initials and address .

source_bert_toks: this will contain only your last name , initials and address .

reference_raw: Only your surname, initials, and address will be included here.

reference_spacy_tokens: Only your surname , initials , and address will be included here .


fn_spacy_tokens_for_baseline: He also said that his visit will mainly focus on the humanitarian situation of Iraq , which has been under crippling U.N. sanctions since its 1990 invasion of Kuwait , the primacord of the 1991 Gulf War .

source_bert_toks: he also said that his visit will mainly focus on the humanitarian situation of iraq , which has been under cr ##ip ##pling u . n . sanctions since its 1990 invasion of kuwait , the prima ##cor ##d of the 1991 gulf war .

reference_raw: He also said that his mission would focus mainly on the humanitarian situation in Iraq, which has been crippled by UN sanctions since the 1990 invasion of Kuwait, the primecord of the Gulf War of 1991.

reference_spacy_tokens: He also said that his mission would focus mainly on the humanitarian situation in Iraq , which has been crippled by UN sanctions since the 1990 invasion of Kuwait , the primecord of the Gulf War of 1991 .


fn_spacy_tokens_for_baseline: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear weapon state in 1991 , and International Atomic Energy Agency ( IAEA ) inspectors subsequently verified the completeness of its nuclear dismantlement .

source_bert_toks: south africa acc ##eded to the treaty on the non - proliferation of nuclear weapons ( np ##t ) as a non - nuclear weapon state in 1991 , and international atomic energy agency ( ia ##ea ) inspectors subsequently verified the complete ##ness of its nuclear di ##sman ##tlement .

reference_raw: South Africa acceded to the Treaty on the Non-Proliferation of Nuclear Weapons (NPT) as a non-nuclear state in 1991 and the International Atomic Energy Agency (IAEA) inspectors later verified the completeness of their nuclear dismantling.

reference_spacy_tokens: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear state in 1991 and the International Atomic Energy Agency ( IAEA ) inspectors later verified the completeness of their nuclear dismantling .


fn_spacy_tokens_for_baseline: With a little effort she managed to be reasonably amiable throughout supper , even refraining from a caustic retort when he complimented her cooking .

source_bert_toks: with a little effort she managed to be reasonably ami ##able throughout supper , even refrain ##ing from a ca ##ust ##ic re ##tort when he complimented her cooking .

reference_raw: With a little effort, she managed to be reasonably friendly during dinner, and even refrained from a caustic retort when he complimented her on her cooking.

reference_spacy_tokens: With a little effort , she managed to be reasonably friendly during dinner , and even refrained from a caustic retort when he complimented her on her cooking .


fn_spacy_tokens_for_baseline: Her latest ally , Soviet Russia , was reeling under Hitler 's onslaught and it was widely expected she could not last out the year .

source_bert_toks: her latest ally , soviet russia , was reeling under hitler ' s onslaught and it was widely expected she could not last out the year .

reference_raw: Her last ally, Soviet Russia, had fallen under Hitler's attack, and it was widely expected that she would not last a year.

reference_spacy_tokens: Her last ally , Soviet Russia , had fallen under Hitler 's attack , and it was widely expected that she would not last a year .


fn_spacy_tokens_for_baseline: Hours later Paige was roused from a deep sleep by a hand on her shoulder .

source_bert_toks: hours later paige was rouse ##d from a deep sleep by a hand on her shoulder .

reference_raw: A few hours later, Paige was awakened from a deep sleep with a hand on her shoulder.

reference_spacy_tokens: A few hours later , Paige was awakened from a deep sleep with a hand on her shoulder .


fn_spacy_tokens_for_baseline: They are looking only at aggregates and pig iron and other goods which can be trundled around the railways for many weeks and do not need to reach their destination at any particular time .

source_bert_toks: they are looking only at aggregate ##s and pig iron and other goods which can be tr ##und ##led around the railways for many weeks and do not need to reach their destination at any particular time .

reference_raw: They only look at aggregates, pig iron and other goods that can be traversed by rail for many weeks and may not reach their destination at any given time.

reference_spacy_tokens: They only look at aggregates , pig iron and other goods that can be traversed by rail for many weeks and may not reach their destination at any given time .


fn_spacy_tokens_for_baseline: With steely reserve and remarkable grace under pressure and long odds , Clinton survived charges of adultery and draft evasion and even an evasive answer on whether he ever tried marijuana .

source_bert_toks: with steel ##y reserve and remarkable grace under pressure and long odds , clinton survived charges of adultery and draft eva ##sion and even an eva ##sive answer on whether he ever tried marijuana .

reference_raw: With a steely reserve and a remarkable grace under pressure and a long chance, Clinton has survived the allegations of adultery and fraud, and even an evasive answer as to whether or not he's ever tried cannabis.

reference_spacy_tokens: With a steely reserve and a remarkable grace under pressure and a long chance , Clinton has survived the allegations of adultery and fraud , and even an evasive answer as to whether or not he 's ever tried cannabis .


fn_spacy_tokens_for_baseline: Reprisals against Kadafi 's security forces and senior officials in his inner circle are probably inevitable , a senior NATO officer warned , noting that ' the security forces probably do n't have much of a future .

source_bert_toks: rep ##ris ##als against ka ##da ##fi ' s security forces and senior officials in his inner circle are probably inevitable , a senior nato officer warned , noting that ' the security forces probably don ' t have much of a future .

reference_raw: Retaliation against Kadafi's security forces and senior officials in his inner circle is probably inevitable, a senior NATO officer pointed out, noting that the security forces probably have little future.

reference_spacy_tokens: Retaliation against Kadafi 's security forces and senior officials in his inner circle is probably inevitable , a senior NATO officer pointed out , noting that the security forces probably have little future .


fn_spacy_tokens_for_baseline: While outlining big plans , Chan is equally enthusiastic about rectifying small situations that have long nettled residents .

source_bert_toks: while out ##lining big plans , chan is equally enthusiastic about rec ##tify ##ing small situations that have long net ##tled residents .

reference_raw: While outlining major plans, Chan is equally enthusiastic about rectifying small situations that have long netted residents.

reference_spacy_tokens: While outlining major plans , Chan is equally enthusiastic about rectifying small situations that have long netted residents .


fn_spacy_tokens_for_baseline: They are unaware of his compulsive gambling , psychopathic persona and unorthodox sexual proclivities .

source_bert_toks: they are unaware of his com ##pu ##ls ##ive gambling , psycho ##pathic persona and uno ##rth ##od ##ox sexual pro ##cl ##iv ##ities .

reference_raw: They're not aware of his compulsion to gamble, his psychopathic personality, and his unorthodox sexual proclivities.

reference_spacy_tokens: They 're not aware of his compulsion to gamble , his psychopathic personality , and his unorthodox sexual proclivities .


fn_spacy_tokens_for_baseline: This party had the nerve to announce his shameful embarrassments to all the world !

source_bert_toks: this party had the nerve to announce his shame ##ful embarrassment ##s to all the world !

reference_raw: This party had the audacity to announce its disgrace to the world!

reference_spacy_tokens: This party had the audacity to announce its disgrace to the world !


fn_spacy_tokens_for_baseline: Many a raucous snigger has been sniggered from the pure - minded use of a word that suggests unmentionable parts of the human body .

source_bert_toks: many a ra ##uc ##ous s ##nig ##ger has been s ##nig ##ger ##ed from the pure - minded use of a word that suggests un ##ment ##ion ##able parts of the human body .

reference_raw: Many of the raucous sniggers were sniggled by the pure-minded use of the word indicating the unmistakable parts of the human body.

reference_spacy_tokens: Many of the raucous sniggers were sniggled by the pure - minded use of the word indicating the unmistakable parts of the human body .


fn_spacy_tokens_for_baseline: Therefore , it is highly desirable that there should be reliable and efficient culture systems to support the normal development of embryos over relatively long periods .

source_bert_toks: therefore , it is highly desirable that there should be reliable and efficient culture systems to support the normal development of embryo ##s over relatively long periods .

reference_raw: It is therefore highly desirable that reliable and efficient culture systems are in place to support the normal evolution of embryos over a relatively long period of time.

reference_spacy_tokens: It is therefore highly desirable that reliable and efficient culture systems are in place to support the normal evolution of embryos over a relatively long period of time .


fn_spacy_tokens_for_baseline: In effect this definition excludes the payment of the benefit under the policy during any payment in lieu period as the contract of employment is still in force .

source_bert_toks: in effect this definition exclude ##s the payment of the benefit under the policy during any payment in lieu period as the contract of employment is still in force .

reference_raw: In effect, this definition precludes the payment of the insurance benefit during any payment in lieu of time, since the employment contract is still in force.

reference_spacy_tokens: In effect , this definition precludes the payment of the insurance benefit during any payment in lieu of time , since the employment contract is still in force .


fn_spacy_tokens_for_baseline: But she was tiny , with a wrinkled face and steely grey eyes .

source_bert_toks: but she was tiny , with a wrinkled face and steel ##y grey eyes .

reference_raw: But she was small, with a wrinkled face and steely gray eyes.

reference_spacy_tokens: But she was small , with a wrinkled face and steely gray eyes .


fn_spacy_tokens_for_baseline: Muataz said that on Sunday he had joined about 200 other lawyers in a protest outside the main courthouse in Tripoli , which was dispersed .

source_bert_toks: mu ##ata ##z said that on sunday he had joined about 200 other lawyers in a protest outside the main courthouse in tripoli , which was dispersed .

reference_raw: Muataz said he joined about two hundred other lawyers on Sunday at a protest outside the main courthouse in Tripoli, which was scattered.

reference_spacy_tokens: Muataz said he joined about two hundred other lawyers on Sunday at a protest outside the main courthouse in Tripoli , which was scattered .


fn_spacy_tokens_for_baseline: i was just wondering how you get your heart rate up or does pumping iron do that

reference_raw: I was just wondering how you're getting your heartbeat up or pumping iron is doing it.

reference_spacy_tokens: I was just wondering how you 're getting your heartbeat up or pumping iron is doing it .


fn_spacy_tokens_for_baseline: These admirable sentiments are certainly not those of a nihilist .

source_bert_toks: these ad ##mir ##able sentiments are certainly not those of a ni ##hil ##ist .

reference_raw: I'm sure these wonderful feelings are not the nihilist's.

reference_spacy_tokens: I 'm sure these wonderful feelings are not the nihilist 's .


fn_spacy_tokens_for_baseline: One writer of our time might have induced Mrs Woolf to modify her words .

source_bert_toks: one writer of our time might have induced mrs woolf to modify her words .

reference_raw: One of the writers of our time may have prompted Mrs. Woolf to change her words.

reference_spacy_tokens: One of the writers of our time may have prompted Mrs. Woolf to change her words .


fn_spacy_tokens_for_baseline: The question can be solved either by using differentiation ( more accurate ) or by tabulation ( approximate ) .

source_bert_toks: the question can be solved either by using differentiation ( more accurate ) or by tab ##ulation ( approximate ) .

reference_raw: This question can be resolved either by distinguishing (more precisely) or by tabulating (approximately).

reference_spacy_tokens: This question can be resolved either by distinguishing ( more precisely ) or by tabulating ( approximately ) .


fn_spacy_tokens_for_baseline: Today should be interesting as people realize how hard life is going to be here for a while .

source_bert_toks: today should be interesting as people realize how hard life is going to be here for a while .

reference_raw: Today's supposed to be interesting, because people realize how hard life is going to be for some time.

reference_spacy_tokens: Today 's supposed to be interesting , because people realize how hard life is going to be for some time .


fn_spacy_tokens_for_baseline: Personnel associated with Coast have characterized it as the most sophisticated program of its type outside of the former Soviet Union , but international CBW experts generally consider it to have been considerably less advanced from a scientific standpoint .

source_bert_toks: personnel associated with coast have characterized it as the most sophisticated program of its type outside of the former soviet union , but international cb ##w experts generally consider it to have been considerably less advanced from a scientific stand ##point .

reference_raw: Coast-related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union, but international CBW experts generally consider it to be significantly less advanced from a scientific point of view.

reference_spacy_tokens: Coast - related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union , but international CBW experts generally consider it to be significantly less advanced from a scientific point of view .


fn_spacy_tokens_for_baseline: Dot was shown to her bed where a notice was taped with pink sticking plaster to the end rail .

source_bert_toks: dot was shown to her bed where a notice was taped with pink sticking plaster to the end rail .

reference_raw: She showed Dot to the bed, where the notice was glued to the end rail with pink plaster.

reference_spacy_tokens: She showed Dot to the bed , where the notice was glued to the end rail with pink plaster .


fn_spacy_tokens_for_baseline: In America recalcitrant administrators who implement the regulation of industry with excessive enthusiasm are noticed , and quickly purchased for private sector employment if they are exceptionally meritorious .

source_bert_toks: in america rec ##al ##cit ##rant administrators who implement the regulation of industry with excessive enthusiasm are noticed , and quickly purchased for private sector employment if they are exceptionally meritorious .

reference_raw: In America, recalcitrant administrators who implement industrial regulation with excessive enthusiasm are noted and quickly bought for private-sector employment if they are exceptionally meritful.

reference_spacy_tokens: In America , recalcitrant administrators who implement industrial regulation with excessive enthusiasm are noted and quickly bought for private - sector employment if they are exceptionally meritful .


fn_spacy_tokens_for_baseline: It was intensely moving : all the more so in Zurich as the back wall of the theatre was lowered to reveal the morning sun glittering on the lake .

source_bert_toks: it was intensely moving : all the more so in zurich as the back wall of the theatre was lowered to reveal the morning sun glittering on the lake .

reference_raw: The movement was intense: all the more so in Zurich, when the rear wall of the theater was lowered to reveal the morning sun gleaming on the lake.

reference_spacy_tokens: The movement was intense : all the more so in Zurich , when the rear wall of the theater was lowered to reveal the morning sun gleaming on the lake .


fn_spacy_tokens_for_baseline: She was both friendly and intelligent with none of the vanity so often associated with beautiful women .

source_bert_toks: she was both friendly and intelligent with none of the vanity so often associated with beautiful women .

reference_raw: She was both friendly and smart, with no vanity so often associated with beautiful women.

reference_spacy_tokens: She was both friendly and smart , with no vanity so often associated with beautiful women .


fn_spacy_tokens_for_baseline: If you buy a 500 W oven , you 'll need to lengthen the cooking time by about 30 per cent .

source_bert_toks: if you buy a 500 w oven , you ' ll need to length ##en the cooking time by about 30 per cent .

reference_raw: If you buy a 500-W oven, you're going to have to extend your cooking time by about 30 percent.

reference_spacy_tokens: If you buy a 500-W oven , you 're going to have to extend your cooking time by about 30 percent .


fn_spacy_tokens_for_baseline: Vagabonds huddle in the gaps between empty buildings , the fine stucco boasted by their Dutch merchant builders lying like pebbles on the pavements .

source_bert_toks: va ##ga ##bon ##ds hu ##ddle in the gaps between empty buildings , the fine stucco boasted by their dutch merchant builders lying like pebbles on the pavement ##s .

reference_raw: The Vagabonds were clustered in the gaps between the empty buildings, and the fine stucco was boasted by their Dutch merchant builders, who lay like pebbles on the sidewalks.

reference_spacy_tokens: The Vagabonds were clustered in the gaps between the empty buildings , and the fine stucco was boasted by their Dutch merchant builders , who lay like pebbles on the sidewalks .


fn_spacy_tokens_for_baseline: Laudable though the aim might be , the results have been much criticised .

source_bert_toks: lau ##dable though the aim might be , the results have been much criticised .

reference_raw: Although the goal may be commendable, the results were much criticized.

reference_spacy_tokens: Although the goal may be commendable , the results were much criticized .


fn_spacy_tokens_for_baseline: He began to hum a tune , dissociating himself , rolling a cigarette with easy movements .

source_bert_toks: he began to hum a tune , di ##sso ##cia ##ting himself , rolling a cigarette with easy movements .

reference_raw: He began buzzing a melody, dissociating himself, rolling a cigarette easily.

reference_spacy_tokens: He began buzzing a melody , dissociating himself , rolling a cigarette easily .


fn_spacy_tokens_for_baseline: This single incident caused more than 3,000 deaths .

source_bert_toks: this single incident caused more than 3 , 000 deaths .

reference_raw: This one incident caused over 3,000 deaths.

reference_spacy_tokens: This one incident caused over 3,000 deaths .


fn_spacy_tokens_for_baseline: My casual opponents include a biographer , an entrepreneur , a political analyst , a tennis pro , a handyman , a philosopher and a hustler .

source_bert_toks: my casual opponents include a biographer , an entrepreneur , a political analyst , a tennis pro , a handy ##man , a philosopher and a hu ##stle ##r .

reference_raw: My casual adversaries include a biographer, a businessman, a political analyst, a tennis professional, a handyman, a philosopher, and a hustler.

reference_spacy_tokens: My casual adversaries include a biographer , a businessman , a political analyst , a tennis professional , a handyman , a philosopher , and a hustler .


fn_spacy_tokens_for_baseline: The handle of crudely carved oak was about eighteen inches long and might , he thought , have once been part of a heavy walking stick .

source_bert_toks: the handle of crude ##ly carved oak was about eighteen inches long and might , he thought , have once been part of a heavy walking stick .

reference_raw: The handle of crudely carved oak was about eighteen inches in length and might once have been part of a heavy walking stick, he thought.

reference_spacy_tokens: The handle of crudely carved oak was about eighteen inches in length and might once have been part of a heavy walking stick , he thought .


fn_spacy_tokens_for_baseline: The Open Software Foundation has halted work on its ground - breaking shrink - wrapped software solution , ANDF , the Architecture Neutral Distribution Format , reassigning its engineering resources elsewhere .

source_bert_toks: the open software foundation has halted work on its ground - breaking shrink - wrapped software solution , and ##f , the architecture neutral distribution format , re ##ass ##ign ##ing its engineering resources elsewhere .

reference_raw: The Open Software Foundation has stopped working on its ground-breaking, shrink-wrapped software solution, ANF, the architectural neutral distribution format, and has reassigned its technical resources elsewhere.

reference_spacy_tokens: The Open Software Foundation has stopped working on its ground - breaking , shrink - wrapped software solution , ANF , the architectural neutral distribution format , and has reassigned its technical resources elsewhere .


fn_spacy_tokens_for_baseline: This is the myth in a nutshell and its presence is invoked in the exhibition simply by the reminder that the paintings were executed with the nude model directly in front of the artist .

source_bert_toks: this is the myth in a nuts ##hell and its presence is invoked in the exhibition simply by the reminder that the paintings were executed with the nude model directly in front of the artist .

reference_raw: This is a myth in short, and its presence is invoked in the exhibition simply by reminding the artist that the paintings were carried out with a naked model directly in front of the artist.

reference_spacy_tokens: This is a myth in short , and its presence is invoked in the exhibition simply by reminding the artist that the paintings were carried out with a naked model directly in front of the artist .


fn_spacy_tokens_for_baseline: There were bitter quarrels between Valerie and me .

source_bert_toks: there were bitter quarrel ##s between valerie and me .

reference_raw: Valerie and I had a bitter fight.

reference_spacy_tokens: Valerie and I had a bitter fight .


fn_spacy_tokens_for_baseline: When the civil war commenced in March 1264 , Peter was in command of the Montfortians in Northampton and was captured when the town fell to the king on 5 April .

source_bert_toks: when the civil war commenced in march 126 ##4 , peter was in command of the mont ##fort ##ians in northampton and was captured when the town fell to the king on 5 april .

reference_raw: When the civil war began in March 1264, Peter was in charge of the Montfortians in Northampton and was captured when the city collapsed on April 5th.

reference_spacy_tokens: When the civil war began in March 1264 , Peter was in charge of the Montfortians in Northampton and was captured when the city collapsed on April 5th .


fn_spacy_tokens_for_baseline: One store boss said : ' The place is buzzing .

source_bert_toks: one store boss said : ' the place is buzzing .

reference_raw: One of the shop bosses said, "This place hums.

reference_spacy_tokens: One of the shop bosses said , " This place hums .


fn_spacy_tokens_for_baseline: In his native Australia , he was the country 's most wanted man , photographed with American mafia bosses and hitmen .

source_bert_toks: in his native australia , he was the country ' s most wanted man , photographed with american mafia bosses and hit ##men .

reference_raw: In his native Australia, he was the most sought-after man in the country, photographed by American mob bosses and assassins.

reference_spacy_tokens: In his native Australia , he was the most sought - after man in the country , photographed by American mob bosses and assassins .


fn_spacy_tokens_for_baseline: ' Later , ' Renwick said and went into the bathroom , pulling off his raincoat and hat , hung them up where they could drip themselves slightly dry .

source_bert_toks: ' later , ' ren ##wick said and went into the bathroom , pulling off his rain ##coat and hat , hung them up where they could drip themselves slightly dry .

reference_raw: 'Later,' Renwick said, and went to the bathroom, took off his raincoat and hat, and hung them up so they could get a little dry.

reference_spacy_tokens: ' Later , ' Renwick said , and went to the bathroom , took off his raincoat and hat , and hung them up so they could get a little dry .


fn_spacy_tokens_for_baseline: Alexei heard a single splash as a loosened rope fell into the water , and then there came the creak of settling timbers .

source_bert_toks: alexei heard a single splash as a loosened rope fell into the water , and then there came the cr ##eak of settling timbers .

reference_raw: Alexei heard one splash as the loose rope fell into the water, and then there was the scraping of settling wood.

reference_spacy_tokens: Alexei heard one splash as the loose rope fell into the water , and then there was the scraping of settling wood .


fn_spacy_tokens_for_baseline: Fire crews had been attempting to contain the fire before the onset of difficult conditions today .

source_bert_toks: fire crews had been attempting to contain the fire before the onset of difficult conditions today .

reference_raw: The fire-fighters were trying to contain the fire before the onset of difficult conditions today.

reference_spacy_tokens: The fire - fighters were trying to contain the fire before the onset of difficult conditions today .


fn_spacy_tokens_for_baseline: Conditions in Evin have been so appalling that three women prisoners committed suicide in December .

source_bert_toks: conditions in ev ##in have been so app ##all ##ing that three women prisoners committed suicide in december .

reference_raw: The conditions in Evin were so terrible that three female prisoners committed suicide in December.

reference_spacy_tokens: The conditions in Evin were so terrible that three female prisoners committed suicide in December .


fn_spacy_tokens_for_baseline: The purpose of education is to encourage young men and women to realize their full academic potential .

source_bert_toks: the purpose of education is to encourage young men and women to realize their full academic potential .

reference_raw: The aim of training is to encourage young men and women to realise their full academic potential.

reference_spacy_tokens: The aim of training is to encourage young men and women to realise their full academic potential .


fn_spacy_tokens_for_baseline: The youngest of the trio was severely , even ominously garbed in chainmail over serviceable brown woollen leggings and tunic .

source_bert_toks: the youngest of the trio was severely , even ominous ##ly ga ##rb ##ed in chain ##mail over service ##able brown wool ##len leg ##ging ##s and tunic .

reference_raw: The youngest of the three was heavily, even ominously, clad in chain mail over the serviceable brown woollen trousers and tunics.

reference_spacy_tokens: The youngest of the three was heavily , even ominously , clad in chain mail over the serviceable brown woollen trousers and tunics .


fn_spacy_tokens_for_baseline: Men who had been asleep and were woken up by the noise did not appear to resent it but sat up on one elbow and stared .

source_bert_toks: men who had been asleep and were woken up by the noise did not appear to res ##ent it but sat up on one elbow and stared .

reference_raw: The men who slept and were awakened by the sound did not seem to resent it, but sat down on one elbow and stared.

reference_spacy_tokens: The men who slept and were awakened by the sound did not seem to resent it , but sat down on one elbow and stared .


fn_spacy_tokens_for_baseline: A miniature oak four - poster bed is £ 30 and a solid silver canteen of cutlery is £ 44 .

source_bert_toks: a miniature oak four - poster bed is £3 ##0 and a solid silver canteen of cutler ##y is £ ##44 .

reference_raw: A miniature oak four-posted bed is £30 and a solid silver bottle of silverware is £44.

reference_spacy_tokens: A miniature oak four - posted bed is £ 30 and a solid silver bottle of silverware is £ 44 .


fn_spacy_tokens_for_baseline: In many regions , industry is permitted to connect up to the domestic sewage system to discharge its toxic waste .

source_bert_toks: in many regions , industry is permitted to connect up to the domestic sewage system to discharge its toxic waste .

reference_raw: In many regions, industry is allowed to connect to the national sewage system and release its toxic waste.

reference_spacy_tokens: In many regions , industry is allowed to connect to the national sewage system and release its toxic waste .


fn_spacy_tokens_for_baseline: This features the most hackneyed sections of the soundtrack of Casablanca .

source_bert_toks: this features the most hackney ##ed sections of the soundtrack of casablanca .

reference_raw: This features the most hacked sections of Casablanca's audio track.

reference_spacy_tokens: This features the most hacked sections of Casablanca 's audio track .


fn_spacy_tokens_for_baseline: But , as well as being shrewd , their Saddam is amoral , paranoid and utterly devoid of convictions .

source_bert_toks: but , as well as being sh ##rew ##d , their saddam is amor ##al , paranoid and utterly devoid of convictions .

reference_raw: But, like their cunning, their Saddam is amoral, paranoid, and completely unconvincing.

reference_spacy_tokens: But , like their cunning , their Saddam is amoral , paranoid , and completely unconvincing .


fn_spacy_tokens_for_baseline: This lasted only four years , and from 1845 he worked and experimented on his own .

source_bert_toks: this lasted only four years , and from 1845 he worked and experimented on his own .

reference_raw: It's only been four years, and since 1845, he's been working and experimental on his own.

reference_spacy_tokens: It 's only been four years , and since 1845 , he 's been working and experimental on his own .


fn_spacy_tokens_for_baseline: Of course I like them ; if I did n't I 'd be utterly miserable .

source_bert_toks: of course i like them ; if i didn ' t i ' d be utterly miserable .

reference_raw: Of course I like them; if I didn't, I'd be very unhappy.

reference_spacy_tokens: Of course I like them ; if I did n't , I 'd be very unhappy .


fn_spacy_tokens_for_baseline: Trained and experienced counsellors are the people the emerging survivor most urgently needs .

source_bert_toks: trained and experienced counsel ##lor ##s are the people the emerging survivor most urgently needs .

reference_raw: Trained and skilled advisors are the people most urgently needed by the emerging survivors.

reference_spacy_tokens: Trained and skilled advisors are the people most urgently needed by the emerging survivors .


fn_spacy_tokens_for_baseline: Or will it be none of them because the Internet allows and encourages a plethora of strong companies and a complex interconnection of businesses where none are allowed to dominate ?

source_bert_toks: or will it be none of them because the internet allows and encourages a pl ##eth ##ora of strong companies and a complex inter ##con ##ne ##ction of businesses where none are allowed to dominate ?

reference_raw: Or will it not be one of them, because the Internet allows and encourages a multitude of powerful companies and complex business connections where no one can control them?

reference_spacy_tokens: Or will it not be one of them , because the Internet allows and encourages a multitude of powerful companies and complex business connections where no one can control them ?


fn_spacy_tokens_for_baseline: And I had a slight mishap , the simplest thing in the world , really , when I was using a shovel in the calf house .

source_bert_toks: and i had a slight mis ##ha ##p , the simplest thing in the world , really , when i was using a shovel in the calf house .

reference_raw: And I had a little accident, the easiest thing in the world, really, when I used a shovel in a calf house.

reference_spacy_tokens: And I had a little accident , the easiest thing in the world , really , when I used a shovel in a calf house .


fn_spacy_tokens_for_baseline: ' And I guess that a player like me is loved by one half of the fans and hated by the other half .

source_bert_toks: ' and i guess that a player like me is loved by one half of the fans and hated by the other half .

reference_raw: 'And I think half the fans love a player like me, and the other half loathes him.

reference_spacy_tokens: ' And I think half the fans love a player like me , and the other half loathes him .


fn_spacy_tokens_for_baseline: ' Great excitement was caused in Esher and the neighbouring district when it was learned late last night that an arrest had been effected in connection with the Oxshott murder .

source_bert_toks: ' great excitement was caused in es ##her and the neighbouring district when it was learned late last night that an arrest had been effect ##ed in connection with the ox ##shot ##t murder .

reference_raw: 'There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott assassination.

reference_spacy_tokens: ' There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott assassination .


fn_spacy_tokens_for_baseline: Mayne 's prowess as an officer of rare quality was recognized by the almost unprecedented award of four DSOs .

source_bert_toks: may ##ne ' s prowess as an officer of rare quality was recognized by the almost unprecedented award of four dso ##s .

reference_raw: The almost unprecedented award of four DSOs recognised Mayne's skill as an officer of rare quality.

reference_spacy_tokens: The almost unprecedented award of four DSOs recognised Mayne 's skill as an officer of rare quality .


fn_spacy_tokens_for_baseline: Did saints ever bat their eyelids and look sleepily self - satisfied as cats ?

source_bert_toks: did saints ever bat their eyelids and look sleep ##ily self - satisfied as cats ?

reference_raw: Did saints ever hit their eyelids and look sleepily self-satisfied like cats?

reference_spacy_tokens: Did saints ever hit their eyelids and look sleepily self - satisfied like cats ?


fn_spacy_tokens_for_baseline: It was a gloomy , high - ceilinged room at the back of the house , with a straw litter in one corner , which served apparently as a bed for the cook .

source_bert_toks: it was a gloom ##y , high - ceiling ##ed room at the back of the house , with a straw litter in one corner , which served apparently as a bed for the cook .

reference_raw: At the rear of the house was a dark, high-ceilinged room with a straw litter in one corner that seemed to serve as a cook's bed.

reference_spacy_tokens: At the rear of the house was a dark , high - ceilinged room with a straw litter in one corner that seemed to serve as a cook 's bed .


fn_spacy_tokens_for_baseline: Yellow is more stimulating , so use it to brighten up a cold room

source_bert_toks: yellow is more stimulating , so use it to bright ##en up a cold room

reference_raw: Yellow's more inspiring, so use it to brighten the cool room.

reference_spacy_tokens: Yellow 's more inspiring , so use it to brighten the cool room .


fn_spacy_tokens_for_baseline: Their sins deny them rest and they will continue their nefarious behaviour beyond the grave unless formally exorcised .

source_bert_toks: their sins deny them rest and they will continue their ne ##far ##ious behaviour beyond the grave unless formally ex ##or ##cise ##d .

reference_raw: Their sins deny them rest, and they will continue their reckless behavior beyond the grave unless formally exorcised.

reference_spacy_tokens: Their sins deny them rest , and they will continue their reckless behavior beyond the grave unless formally exorcised .


fn_spacy_tokens_for_baseline: The Act limits the possession of crossbows to those over the age of 17 .

source_bert_toks: the act limits the possession of crossbow ##s to those over the age of 17 .

reference_raw: The law restricts the holding of crossbows to those over 17 years of age.

reference_spacy_tokens: The law restricts the holding of crossbows to those over 17 years of age .


fn_spacy_tokens_for_baseline: Everyone knew that Diana and Charles had decided to stay married for the sake of their children , but were leading separate lives .

source_bert_toks: everyone knew that diana and charles had decided to stay married for the sake of their children , but were leading separate lives .

reference_raw: Everyone knew that Diana and Charles had decided to stay together for the sake of their children, but they led separate lives.

reference_spacy_tokens: Everyone knew that Diana and Charles had decided to stay together for the sake of their children , but they led separate lives .


fn_spacy_tokens_for_baseline: For a moment , she said nothing , but sat watching him pour out a mug of beer ; then she said bitterly , ' You 're an ungrateful devil .

source_bert_toks: for a moment , she said nothing , but sat watching him pour out a mug of beer ; then she said bitterly , ' you ' re an un ##grate ##ful devil .

reference_raw: She said nothing for a moment, but sat and watched him pour out a cup of beer, then said bitterly, "You are an ungrateful devil.

reference_spacy_tokens: She said nothing for a moment , but sat and watched him pour out a cup of beer , then said bitterly , " You are an ungrateful devil .


fn_spacy_tokens_for_baseline: She was wearing a dirty old pair of jeans and blue canvas sneakers .

source_bert_toks: she was wearing a dirty old pair of jeans and blue canvas sneakers .

reference_raw: She wore dirty old jeans and blue canvas tennis shoes.

reference_spacy_tokens: She wore dirty old jeans and blue canvas tennis shoes .


fn_spacy_tokens_for_baseline: He marched to the door , followed by Horowitz who put his soft trilby back on his head , pulling the brim down .

source_bert_toks: he marched to the door , followed by ho ##row ##itz who put his soft tri ##lby back on his head , pulling the br ##im down .

reference_raw: He marched to the door, followed by Horowitz, who put the soft trilby back on his head and pulled the edge down.

reference_spacy_tokens: He marched to the door , followed by Horowitz , who put the soft trilby back on his head and pulled the edge down .


fn_spacy_tokens_for_baseline: These reports are termed speculative by a nuclear industry journal ( 7198 ) .

source_bert_toks: these reports are termed speculative by a nuclear industry journal ( 71 ##9 ##8 ) .

reference_raw: These reports are referred to as speculatives in the Nuclear Industry Magazine (7198).

reference_spacy_tokens: These reports are referred to as speculatives in the Nuclear Industry Magazine ( 7198 ) .


fn_spacy_tokens_for_baseline: All groups underwent abdominal ultrasound scan to determine the presence of gall stones and exclude liver metastases in the cancer group , as well as biochemical tests to assess hepatic and renal function .

source_bert_toks: all groups underwent abdominal ultrasound scan to determine the presence of gall stones and exclude liver meta ##sta ##ses in the cancer group , as well as bio ##chemical tests to assess he ##pati ##c and renal function .

reference_raw: All groups were subject to abdominal ultrasound scans to determine the presence of gallstones and exclude liver metastases in the cancer group, as well as biochemical tests to evaluate liver and kidney function.

reference_spacy_tokens: All groups were subject to abdominal ultrasound scans to determine the presence of gallstones and exclude liver metastases in the cancer group , as well as biochemical tests to evaluate liver and kidney function .


fn_spacy_tokens_for_baseline: The first of these statements was such an insult to my intelligence that I wanted to punch Mr Kinnock on the nose , and the second so downright outrageous that I wanted to do something worse .

source_bert_toks: the first of these statements was such an insult to my intelligence that i wanted to punch mr kin ##nock on the nose , and the second so down ##right outrageous that i wanted to do something worse .

reference_raw: The first was so offensive to my intelligence that I wanted to punch Mr. Kinnock in the nose, and the second was so downright outrageous that I wanted to do something worse.

reference_spacy_tokens: The first was so offensive to my intelligence that I wanted to punch Mr. Kinnock in the nose , and the second was so downright outrageous that I wanted to do something worse .