fn_spacy_tokens_for_baseline: You 'll also notice that gambling is a passion , whether it be cards , mahjong , the lottery , or the horses .

source_bert_toks: you ' ll also notice that gambling is a passion , whether it be cards , ma ##h ##jong , the lottery , or the horses .

reference_raw: You can also see that gambling is a passion, whether it's a card, a mahjong, a lottery, or a horse.

reference_spacy_tokens: You can also see that gambling is a passion , whether it 's a card , a mahjong , a lottery , or a horse .


fn_spacy_tokens_for_baseline: Her responses to all questions by the parents were criticised by them as ' text - book jargon ' .

source_bert_toks: her responses to all questions by the parents were criticised by them as ' text - book jar ##gon ' .

reference_raw: They criticized her answers to all questions from her parents as 'textbook jargon'.

reference_spacy_tokens: They criticized her answers to all questions from her parents as ' textbook jargon ' .


fn_spacy_tokens_for_baseline: ' I also have a hunch that Raymond Burns will make an impact .

source_bert_toks: ' i also have a hu ##nch that raymond burns will make an impact .

reference_raw: 'I also have a feeling Raymond Burns is going to have an impact.

reference_spacy_tokens: ' I also have a feeling Raymond Burns is going to have an impact .


fn_spacy_tokens_for_baseline: District courts had the power to inflict punishment of up to one year in prison , fifty lashes , a fine of one hundred pounds , or any two of the above .

source_bert_toks: district courts had the power to in ##flict punishment of up to one year in prison , fifty lashes , a fine of one hundred pounds , or any two of the above .

reference_raw: The District Courts had the power to impose a sentence of up to a year in prison, fifty lashes, a fine of a hundred pounds, or any of the two above.

reference_spacy_tokens: The District Courts had the power to impose a sentence of up to a year in prison , fifty lashes , a fine of a hundred pounds , or any of the two above .


fn_spacy_tokens_for_baseline: Russian scientists familiar with Moscow 's chemical warfare development program have been publicizing information on a new generation of agents , sometimes referred to as " Novichoks . "

source_bert_toks: russian scientists familiar with moscow ' s chemical warfare development program have been public ##izing information on a new generation of agents , sometimes referred to as " novi ##cho ##ks . "

reference_raw: Russian scientists, familiar with Moscow's CWD program, published information about the next generation of agents, sometimes referred to as "Novichoks."

reference_spacy_tokens: Russian scientists , familiar with Moscow 's CWD program , published information about the next generation of agents , sometimes referred to as " Novichoks . "


fn_spacy_tokens_for_baseline: Many golfers give themselves no chance of playing well because they ruin the swing with a poor takeaway .

source_bert_toks: many golfer ##s give themselves no chance of playing well because they ruin the swing with a poor take ##away .

reference_raw: A lot of golfers don't give themselves a chance to play well because they destroy a swing with a poor takeaway.

reference_spacy_tokens: A lot of golfers do n't give themselves a chance to play well because they destroy a swing with a poor takeaway .


fn_spacy_tokens_for_baseline: The synthesis and purification of all oligonucleotides and their characterisation by enzymatic digestion was performed as previously reported ( 3 ) .

source_bert_toks: the synthesis and purification of all ol ##igo ##nu ##cle ##otide ##s and their character ##isation by en ##zy ##matic digest ##ion was performed as previously reported ( 3 ) .

reference_raw: All oligonucleotides have been synthesised and purified and characterised by enzymatic digestion, as previously reported (3).

reference_spacy_tokens: All oligonucleotides have been synthesised and purified and characterised by enzymatic digestion , as previously reported ( 3 ) .


fn_spacy_tokens_for_baseline: Balcon echoed Korda with his pledge that Ealing Studios would ' grasp with both hands the opportunity of putting every phase of the war on to the screen . '

source_bert_toks: bal ##con echoed ko ##rda with his pledge that ea ##ling studios would ' grasp with both hands the opportunity of putting every phase of the war on to the screen . '

reference_raw: Balcon echoed Korda with a promise that Ealing Studios would "grasp with both hands the opportunity to put all phases of the war on the screen."

reference_spacy_tokens: Balcon echoed Korda with a promise that Ealing Studios would " grasp with both hands the opportunity to put all phases of the war on the screen . "


fn_spacy_tokens_for_baseline: ' After their disappearance , all the records of their influence speak only of effects on the minds of their followers .

source_bert_toks: ' after their disappearance , all the records of their influence speak only of effects on the minds of their followers .

reference_raw: When they disappear, all the records of their influence speak only of the effects on the minds of their followers.

reference_spacy_tokens: When they disappear , all the records of their influence speak only of the effects on the minds of their followers .


fn_spacy_tokens_for_baseline: The best that can be said is that to appeal to such a wide diversity of patrons he clearly possessed some very rare talent indeed .

source_bert_toks: the best that can be said is that to appeal to such a wide diversity of patrons he clearly possessed some very rare talent indeed .

reference_raw: The best I can say is that to appeal to such a wide variety of patrons, he obviously had some very rare talent.

reference_spacy_tokens: The best I can say is that to appeal to such a wide variety of patrons , he obviously had some very rare talent .


fn_spacy_tokens_for_baseline: When he 's not telling us his name he 's yelling ' yo ' and other inane rappisms in a suitably sneering tone .

source_bert_toks: when he ' s not telling us his name he ' s yelling ' yo ' and other ina ##ne rap ##pis ##ms in a suit ##ably s ##neer ##ing tone .

reference_raw: When he doesn't tell us his name, he shouts "yo" and other unnatural rappisms in an appropriately mocking tone.

reference_spacy_tokens: When he does n't tell us his name , he shouts " yo " and other unnatural rappisms in an appropriately mocking tone .


fn_spacy_tokens_for_baseline: Herbert 's piece radiates confidence in its control of language and its message .

source_bert_toks: herbert ' s piece ra ##dia ##tes confidence in its control of language and its message .

reference_raw: Herbert's piece exudes confidence in his control of the language and the message.

reference_spacy_tokens: Herbert 's piece exudes confidence in his control of the language and the message .


fn_spacy_tokens_for_baseline: Like Murad before him , Dara was seized , manacled and sent to Delhi in a closed howdah .

source_bert_toks: like mu ##rad before him , dar ##a was seized , mana ##cle ##d and sent to delhi in a closed how ##dah .

reference_raw: Like Murad before him, Dara was seized, handcuffed, and sent to Delhi in a closed howdah.

reference_spacy_tokens: Like Murad before him , Dara was seized , handcuffed , and sent to Delhi in a closed howdah .


fn_spacy_tokens_for_baseline: I was sitting on the top of the bank , above the holes , the lighter of the Flame - thrower burning weakly in the sunlight , when , just over the minute , the first tunnel blew .

source_bert_toks: i was sitting on the top of the bank , above the holes , the lighter of the flame - throw ##er burning weakly in the sunlight , when , just over the minute , the first tunnel blew .

reference_raw: I was sitting at the top of the bank, above the holes, the lighter of the flamethrower burning faintly in the sunlight, when the first tunnel blew just a minute later.

reference_spacy_tokens: I was sitting at the top of the bank , above the holes , the lighter of the flamethrower burning faintly in the sunlight , when the first tunnel blew just a minute later .


fn_spacy_tokens_for_baseline: Sen. John McCain ( R - Ariz . ) , a fervent supporter of increasing aid to rebel leaders , said that killing Kadafi could be legitimate ' if you view Kadafi himself as part of the command and control .

source_bert_toks: sen . john mccain ( r - ari ##z . ) , a fe ##r ##vent supporter of increasing aid to rebel leaders , said that killing ka ##da ##fi could be legitimate ' if you view ka ##da ##fi himself as part of the command and control .

reference_raw: Sen. John McCain (R-Ariz.), a fervent supporter of increasing aid to rebel leaders, said that killing Kadafi might be legitimate if you view Kadafi as a member of command and control.

reference_spacy_tokens: Sen. John McCain ( R - Ariz . ) , a fervent supporter of increasing aid to rebel leaders , said that killing Kadafi might be legitimate if you view Kadafi as a member of command and control .


fn_spacy_tokens_for_baseline: T-2 and other trichothecene mycotoxins are suspected components of " yellow rain , " which was allegedly used in battle by Communist regimes in Southeast Asia during the 1970s and early 1980s .

source_bert_toks: t - 2 and other tri ##cho ##the ##cene my ##cot ##ox ##ins are suspected components of " yellow rain , " which was allegedly used in battle by communist regimes in southeast asia during the 1970s and early 1980s .

reference_raw: T-2 and other trichothecene mycotoxins are suspected ingredients of yellow rain, allegedly used in combat by the communist regimes in Southeast Asia in the 1970s and early 1980s.

reference_spacy_tokens: T-2 and other trichothecene mycotoxins are suspected ingredients of yellow rain , allegedly used in combat by the communist regimes in Southeast Asia in the 1970s and early 1980s .


fn_spacy_tokens_for_baseline: A ribbon of fresh clear water meandering through beautiful unspoilt countryside , providing sport for the local anglers along its willow lined banks .

source_bert_toks: a ribbon of fresh clear water mean ##der ##ing through beautiful un ##sp ##oi ##lt countryside , providing sport for the local angle ##rs along its willow lined banks .

reference_raw: A strip of fresh, clean water meanders through beautiful, unspoiled landscapes, providing sport to local anglers along their willow-lined shores.

reference_spacy_tokens: A strip of fresh , clean water meanders through beautiful , unspoiled landscapes , providing sport to local anglers along their willow - lined shores .


fn_spacy_tokens_for_baseline: The initial reports claimed that local fisherman had killed the dolphins in order to protect their fishing grounds and for dolphin meat , which was divided up amongst Fukue islanders in the East China Sea off Nagasaki .

source_bert_toks: the initial reports claimed that local fisherman had killed the dolphins in order to protect their fishing grounds and for dolphin meat , which was divided up amongst fu ##ku ##e islanders in the east china sea off nagasaki .

reference_raw: Initial reports indicate that local fishermen killed dolphins to protect their fishing grounds and dolphin meat, which was distributed among Fukue islanders in the East China Sea of Nagasaki.

reference_spacy_tokens: Initial reports indicate that local fishermen killed dolphins to protect their fishing grounds and dolphin meat , which was distributed among Fukue islanders in the East China Sea of Nagasaki .


fn_spacy_tokens_for_baseline: Yet his subjects had a right of resistance , of rebellion against him , if he failed to rule them justly and to give them due protection .

source_bert_toks: yet his subjects had a right of resistance , of rebellion against him , if he failed to rule them just ##ly and to give them due protection .

reference_raw: But his subjects had the right to oppose him, to rebel against him, if he could not rule them properly and provide them with adequate protection.

reference_spacy_tokens: But his subjects had the right to oppose him , to rebel against him , if he could not rule them properly and provide them with adequate protection .


fn_spacy_tokens_for_baseline: SUSAN Christie , the soldier imprisoned last year for killing the wife of her army officer lover , will be bridesmaid at a prison wedding next Thursday for a convicted terrorist who killed 17 people -- 11 of them soldiers .

source_bert_toks: susan christie , the soldier imprisoned last year for killing the wife of her army officer lover , will be bride ##sma ##id at a prison wedding next thursday for a convicted terrorist who killed 17 people - - 11 of them soldiers .

reference_raw: Susan Christie, a soldier arrested last year for the murder of the wife of a military officer's lover, will be the bridesmaid at a prison wedding next Thursday for a convicted terrorist who killed 17 people, 11 of them soldiers.

reference_spacy_tokens: Susan Christie , a soldier arrested last year for the murder of the wife of a military officer 's lover , will be the bridesmaid at a prison wedding next Thursday for a convicted terrorist who killed 17 people , 11 of them soldiers .


fn_spacy_tokens_for_baseline: Ironically , we heard through the grapevine that the Soviet government had made its own translation of the OECD report for circulation within a narrow circle of officials in the State Committee for Science and Technology !

source_bert_toks: ironically , we heard through the grape ##vine that the soviet government had made its own translation of the o ##ec ##d report for circulation within a narrow circle of officials in the state committee for science and technology !

reference_raw: Ironically, we've heard through the grapevine that the Soviet government has translated the OECD's report for circulation into a narrow group of officials on the State Committee for Science and Technology!

reference_spacy_tokens: Ironically , we 've heard through the grapevine that the Soviet government has translated the OECD 's report for circulation into a narrow group of officials on the State Committee for Science and Technology !


fn_spacy_tokens_for_baseline: A barricade of flagstones prised up from the floor had been erected for a final stand and the Collector , snatching a moment to look back towards it , was dismayed to see that the other party was already behind it , thus leaving himself and his men exposed on the flank .

source_bert_toks: a barr ##ica ##de of flags ##tones pri ##sed up from the floor had been erected for a final stand and the collector , snatch ##ing a moment to look back towards it , was dismay ##ed to see that the other party was already behind it , thus leaving himself and his men exposed on the flank .

reference_raw: The barricade of tiles protruding from the floor had been erected for the last time, and the Collector, who had taken a moment to look back at him, was dismayed to see that the other party was already behind him, leaving himself and his men unprotected on the side.

reference_spacy_tokens: The barricade of tiles protruding from the floor had been erected for the last time , and the Collector , who had taken a moment to look back at him , was dismayed to see that the other party was already behind him , leaving himself and his men unprotected on the side .


fn_spacy_tokens_for_baseline: Despite the crowds and exterior complex of manager 's house , souvenir shop , ticket office and litter baskets , White Scar Cave is an enthralling experience .

source_bert_toks: despite the crowds and exterior complex of manager ' s house , so ##uven ##ir shop , ticket office and litter baskets , white scar cave is an en ##th ##ral ##ling experience .

reference_raw: Despite the crowds and the outdoor complex of the manager's house, the souvenir shop, the ticket office, and the litter baskets, the White Scar Cave is a fascinating experience.

reference_spacy_tokens: Despite the crowds and the outdoor complex of the manager 's house , the souvenir shop , the ticket office , and the litter baskets , the White Scar Cave is a fascinating experience .


fn_spacy_tokens_for_baseline: Queen Victoria and George V presided a dozen times over the formation of minority or coalition governments .

source_bert_toks: queen victoria and george v presided a dozen times over the formation of minority or coalition governments .

reference_raw: Queen Victoria and George V chaired the formation of minority or coalition governments a dozen times.

reference_spacy_tokens: Queen Victoria and George V chaired the formation of minority or coalition governments a dozen times .


fn_spacy_tokens_for_baseline: L In November Bill Clinton won the US Presidential race , supported by wife Hillary and despite claims of draft dodging and womanising .

source_bert_toks: l in november bill clinton won the us presidential race , supported by wife hillary and despite claims of draft dod ##ging and woman ##ising .

reference_raw: L In November, Bill Clinton won the U.S. presidential race, supported by his wife, Hillary, and in spite of the allegations that he proposed dodging and womanizing.

reference_spacy_tokens: L In November , Bill Clinton won the U.S. presidential race , supported by his wife , Hillary , and in spite of the allegations that he proposed dodging and womanizing .


fn_spacy_tokens_for_baseline: In his speech he went out of his way to welcome the establishment of the Faculty , and the part it would play in encouraging and enhancing proficiency and knowledge of tax not only within the profession , but in business , industry and commerce , and among the general public the profession serves .

source_bert_toks: in his speech he went out of his way to welcome the establishment of the faculty , and the part it would play in encouraging and enhancing proficiency and knowledge of tax not only within the profession , but in business , industry and commerce , and among the general public the profession serves .

reference_raw: In his speech, he went out of his way to welcome the establishment of a faculty, and the role it plays in promoting and enhancing skills and knowledge of taxation not only in the profession, but also in business, industry and trade, and in the general public that the profession serves.

reference_spacy_tokens: In his speech , he went out of his way to welcome the establishment of a faculty , and the role it plays in promoting and enhancing skills and knowledge of taxation not only in the profession , but also in business , industry and trade , and in the general public that the profession serves .


fn_spacy_tokens_for_baseline: Matilda looked right back into the flashing eyes of this infuriated female giant and said with total calmness , ' I have not moved away from my desk , Miss Trunchbull , since the lesson began .

source_bert_toks: matilda looked right back into the flashing eyes of this in ##fur ##iated female giant and said with total calm ##ness , ' i have not moved away from my desk , miss tr ##un ##ch ##bu ##ll , since the lesson began .

reference_raw: Matilda looked directly into the flickering eyes of the angry female giant and said calmly, "I haven't moved from the table, Miss Trunchbull, since the lesson began.

reference_spacy_tokens: Matilda looked directly into the flickering eyes of the angry female giant and said calmly , " I have n't moved from the table , Miss Trunchbull , since the lesson began .


fn_spacy_tokens_for_baseline: When I glanced back as I opened the gate , they were standing still , in a discomfited little group : they had not meant , I suppose , to hurt the child .

source_bert_toks: when i glanced back as i opened the gate , they were standing still , in a disco ##m ##fi ##ted little group : they had not meant , i suppose , to hurt the child .

reference_raw: When I looked back, when I opened the gate, they stood motionless, in a small group of displeasures: they probably didn't want to hurt the child.

reference_spacy_tokens: When I looked back , when I opened the gate , they stood motionless , in a small group of displeasures : they probably did n't want to hurt the child .


fn_spacy_tokens_for_baseline: ' Your mother does n't operate her career for your amusement , Princess , ' her father admonished , pinching Tina 's cheek .

source_bert_toks: ' your mother doesn ' t operate her career for your amusement , princess , ' her father ad ##mon ##ished , pinch ##ing tina ' s cheek .

reference_raw: 'Your mother does not operate her career for your amusement, Princess,' said her father, pinching Tina's cheek.

reference_spacy_tokens: ' Your mother does not operate her career for your amusement , Princess , ' said her father , pinching Tina 's cheek .


fn_spacy_tokens_for_baseline: For recently the random eruptions and scattered pustules that had decked my chin and brows for the past year had begun to mass , forming formidably ugly scarps and weeping lesions .

source_bert_toks: for recently the random eruptions and scattered pu ##st ##ules that had deck ##ed my chin and brows for the past year had begun to mass , forming form ##ida ##bly ugly scar ##ps and weeping lesions .

reference_raw: Recently, the random eruptions and sprinkled pustules that had covered my chin and eyebrows over the last year had begun to mass, creating hideous scars and sobbing lesions.

reference_spacy_tokens: Recently , the random eruptions and sprinkled pustules that had covered my chin and eyebrows over the last year had begun to mass , creating hideous scars and sobbing lesions .


fn_spacy_tokens_for_baseline: It adds a bold splash of colour to all kinds of snacks , and turns everyday items into original - looking and great - tasting treats .

source_bert_toks: it adds a bold splash of colour to all kinds of snacks , and turns everyday items into original - looking and great - tasting treats .

reference_raw: It adds a bold spray of color to all sorts of snacks and turns everyday objects into original-looking and delicious treats.

reference_spacy_tokens: It adds a bold spray of color to all sorts of snacks and turns everyday objects into original - looking and delicious treats .


fn_spacy_tokens_for_baseline: Apple has declared that Mac OS X version 10.4 " Tiger " will go on sale Friday , 29 April 2005 , beginning at 6:00 p.m. during special events at Apple 's retail stores and Apple Authorized Resellers .

source_bert_toks: apple has declared that mac os x version 10 . 4 " tiger " will go on sale friday , 29 april 2005 , beginning at 6 : 00 p . m . during special events at apple ' s retail stores and apple authorized res ##eller ##s .

reference_raw: Apple announced that the Mac OS X version 10.4 "Tiger" would be sold on Friday, 29 April 2005, starting at 6:00 a.m. during special events in the Apple Retails and Apple Authorised Resellers.

reference_spacy_tokens: Apple announced that the Mac OS X version 10.4 " Tiger " would be sold on Friday , 29 April 2005 , starting at 6:00 a.m. during special events in the Apple Retails and Apple Authorised Resellers .


fn_spacy_tokens_for_baseline: The road tops a hill and commences a long descent to a built - up area that , even when seen at a distance , is obviously a place of greater importance than any yet seen on the journey .

source_bert_toks: the road tops a hill and commence ##s a long descent to a built - up area that , even when seen at a distance , is obviously a place of greater importance than any yet seen on the journey .

reference_raw: The road rises up a hill and begins a long way down into a built-up area, which, even if seen from a distance, is clearly a more important place than ever seen on the road.

reference_spacy_tokens: The road rises up a hill and begins a long way down into a built - up area , which , even if seen from a distance , is clearly a more important place than ever seen on the road .


fn_spacy_tokens_for_baseline: A small batch of uniforms in the new colour was issued .

source_bert_toks: a small batch of uniforms in the new colour was issued .

reference_raw: A small number of new-coloured uniforms had been issued.

reference_spacy_tokens: A small number of new - coloured uniforms had been issued .


fn_spacy_tokens_for_baseline: Barry had been forced from office in 1990 , and had served six months in prison , after being secretly videotaped in the act of smoking crack cocaine .

source_bert_toks: barry had been forced from office in 1990 , and had served six months in prison , after being secretly video ##ta ##ped in the act of smoking crack cocaine .

reference_raw: Barry was forced out of office in 1990 and served six months in prison after being secretly recorded in the act of smoking coke.

reference_spacy_tokens: Barry was forced out of office in 1990 and served six months in prison after being secretly recorded in the act of smoking coke .


fn_spacy_tokens_for_baseline: In The Archaeology of knowledge Foucault corrects this by addressing the difficulties of making knowledges intelligible as a part of their institutional , social and political practices .

source_bert_toks: in the archaeology of knowledge f ##ou ##ca ##ult correct ##s this by addressing the difficulties of making knowledge ##s intel ##li ##gible as a part of their institutional , social and political practices .

reference_raw: In the archaeology of knowledge Foucault corrects this by addressing the difficulty of making knowledge understandable as part of their institutional, social and political processes.

reference_spacy_tokens: In the archaeology of knowledge Foucault corrects this by addressing the difficulty of making knowledge understandable as part of their institutional , social and political processes .


fn_spacy_tokens_for_baseline: The air was filled with the scent of beech nuts and rotted leaves .

source_bert_toks: the air was filled with the scent of beech nuts and rot ##ted leaves .

reference_raw: The smell of beech nuts and rotten leaves filled the air.

reference_spacy_tokens: The smell of beech nuts and rotten leaves filled the air .


fn_spacy_tokens_for_baseline: Pronounced ' an extreme leftist ' , his energy enchanted Diaghilev , who commissioned a ballet from him .

source_bert_toks: pronounced ' an extreme leftist ' , his energy enchanted dia ##ghi ##lev , who commissioned a ballet from him .

reference_raw: He said "extreme leftist," and his energy charmed Diaghilev, who ordered a ballet from him.

reference_spacy_tokens: He said " extreme leftist , " and his energy charmed Diaghilev , who ordered a ballet from him .


fn_spacy_tokens_for_baseline: A not dissimilar design was used by the Highland Railway in Scotland .

source_bert_toks: a not di ##ssi ##mi ##lar design was used by the highland railway in scotland .

reference_raw: The Highland Railroad in Scotland used a non-similar design.

reference_spacy_tokens: The Highland Railroad in Scotland used a non - similar design .


fn_spacy_tokens_for_baseline: The apartheid government also undertook a chemical and biological weapons ( CBW ) defense program , which reportedly also included offensive research and use of CBW agents against opponents of that government .

source_bert_toks: the apartheid government also undertook a chemical and biological weapons ( cb ##w ) defense program , which reportedly also included offensive research and use of cb ##w agents against opponents of that government .

reference_raw: The apartheid government has also carried out a chemical and biological weapons defence programme (CBW), which allegedly includes offensive research and exploitation of CBW agents against the government's opponents.

reference_spacy_tokens: The apartheid government has also carried out a chemical and biological weapons defence programme ( CBW ) , which allegedly includes offensive research and exploitation of CBW agents against the government 's opponents .


fn_spacy_tokens_for_baseline: Only two months later , the Korean Workers ' Party Central Committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

source_bert_toks: only two months later , the korean workers ' party central committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

reference_raw: Only two months later, the Central Committee of the Korean Workers Party adopted policies to strengthen the military and implement export-replacement programs to reduce dependency on arms exports.

reference_spacy_tokens: Only two months later , the Central Committee of the Korean Workers Party adopted policies to strengthen the military and implement export - replacement programs to reduce dependency on arms exports .


fn_spacy_tokens_for_baseline: ' Our difficulties are not over , ' he remarked , shaking his head .

source_bert_toks: ' our difficulties are not over , ' he remarked , shaking his head .

reference_raw: "We're not done with our troubles," he said, shaking his head.

reference_spacy_tokens: " We 're not done with our troubles , " he said , shaking his head .


fn_spacy_tokens_for_baseline: Tundra streams flow in meandering channels through tundra vegetation , draining the peaty soils , picking up humic acids and acquiring a low pH as they go .

source_bert_toks: tun ##dra streams flow in mean ##der ##ing channels through tun ##dra vegetation , draining the peat ##y soils , picking up hum ##ic acids and acquiring a low ph as they go .

reference_raw: Tundra currents flow through meandering channels through tundra vegetation, draining peaty soils, collecting humic acids and gaining a low pH.

reference_spacy_tokens: Tundra currents flow through meandering channels through tundra vegetation , draining peaty soils , collecting humic acids and gaining a low pH.


fn_spacy_tokens_for_baseline: No doubt he will wish to have the money orders forwarded to some post - office box in West Ealing . '

source_bert_toks: no doubt he will wish to have the money orders forward ##ed to some post - office box in west ea ##ling . '

reference_raw: There's no doubt he'll want the money orders sent to a post office in West Ealing.'

reference_spacy_tokens: There 's no doubt he 'll want the money orders sent to a post office in West Ealing . '


fn_spacy_tokens_for_baseline: She uses lightener to keep her hair looking so fabulous and natural looking .

source_bert_toks: she uses light ##ener to keep her hair looking so fabulous and natural looking .

reference_raw: He uses the lighter to make his hair look so beautiful and natural.

reference_spacy_tokens: He uses the lighter to make his hair look so beautiful and natural .


fn_spacy_tokens_for_baseline: Reports indicate that North Korea has some 12 CW facilities where raw chemicals , precursors , and actual agents are produced and / or stored , and six major storage depots for CW ordnance .

source_bert_toks: reports indicate that north korea has some 12 cw facilities where raw chemicals , precursor ##s , and actual agents are produced and / or stored , and six major storage depot ##s for cw ordnance .

reference_raw: According to the reports, North Korea has approximately 12 facilities for the production and/or storage of raw chemicals, predecessors and real agents, as well as six major warehouses for the production and/or storage of CW.

reference_spacy_tokens: According to the reports , North Korea has approximately 12 facilities for the production and/or storage of raw chemicals , predecessors and real agents , as well as six major warehouses for the production and/or storage of CW .


fn_spacy_tokens_for_baseline: The young free - tailed bats must also eventually leave their nursery .

source_bert_toks: the young free - tailed bats must also eventually leave their nursery .

reference_raw: In the end, young free-tailed bats have to leave their kindergarten.

reference_spacy_tokens: In the end , young free - tailed bats have to leave their kindergarten .


fn_spacy_tokens_for_baseline: Misuse of the data from earlier studies usually involves removing all the qualifications and careful language of the original study , thus misrepresenting and in some cases falsifying the data .

source_bert_toks: mis ##use of the data from earlier studies usually involves removing all the qualifications and careful language of the original study , thus mis ##re ##pres ##enting and in some cases fa ##ls ##ifying the data .

reference_raw: Misuse of data from previous studies usually involves the removal of all qualifications and careful language of the original study, thus distorting and, in some cases, forging data.

reference_spacy_tokens: Misuse of data from previous studies usually involves the removal of all qualifications and careful language of the original study , thus distorting and , in some cases , forging data .


fn_spacy_tokens_for_baseline: It was coincidence that the year 1918 witnessed the retirement of the BDDA 's first President and the death of its founder .

source_bert_toks: it was coincidence that the year 1918 witnessed the retirement of the b ##dda ' s first president and the death of its founder .

reference_raw: It was by chance that 1918 witnessed the retirement of the first president of the BDDA and the death of its founder.

reference_spacy_tokens: It was by chance that 1918 witnessed the retirement of the first president of the BDDA and the death of its founder .


fn_spacy_tokens_for_baseline: ' We can change our location , we can come and go , we can leave behind land mines that will kill them .

source_bert_toks: ' we can change our location , we can come and go , we can leave behind land mines that will kill them .

reference_raw: 'We can change our position, come and go, leave land mines to kill them.

reference_spacy_tokens: ' We can change our position , come and go , leave land mines to kill them .


fn_spacy_tokens_for_baseline: It has striped wings and lives on the bark of trees .

source_bert_toks: it has striped wings and lives on the bark of trees .

reference_raw: He's striped his flanks and he lives on the bark of a tree.

reference_spacy_tokens: He 's striped his flanks and he lives on the bark of a tree .


fn_spacy_tokens_for_baseline: The following year he chalked up his fifth win , even though his horse broke a bridle strap and bolted just before the start .

source_bert_toks: the following year he chalk ##ed up his fifth win , even though his horse broke a br ##id ##le strap and bolted just before the start .

reference_raw: He chalked up his fifth victory the following year, though his horse broke the bridle strap and ran just before it began.

reference_spacy_tokens: He chalked up his fifth victory the following year , though his horse broke the bridle strap and ran just before it began .


fn_spacy_tokens_for_baseline: They have to articulate in a manner in which others will understand .

source_bert_toks: they have to art ##iculate in a manner in which others will understand .

reference_raw: They must express themselves in a way that others will understand.

reference_spacy_tokens: They must express themselves in a way that others will understand .


fn_spacy_tokens_for_baseline: ' Charles ! , she croaked at last .

source_bert_toks: ' charles ! , she cr ##oa ##ked at last .

reference_raw: 'Charles!' she finally groaned.

reference_spacy_tokens: ' Charles ! ' she finally groaned .


fn_spacy_tokens_for_baseline: Whenever I believed I had come up with something , I probed it for every sort of oversight , tested it through from all angles .

source_bert_toks: whenever i believed i had come up with something , i probe ##d it for every sort of oversight , tested it through from all angles .

reference_raw: Whenever I thought I'd come up with something, I examined it for all sorts of surveillance, tested it from every angle.

reference_spacy_tokens: Whenever I thought I 'd come up with something , I examined it for all sorts of surveillance , tested it from every angle .


fn_spacy_tokens_for_baseline: Voices came from the battlements , and a twinkle of steel .

source_bert_toks: voices came from the battle ##ments , and a twinkle of steel .

reference_raw: There were voices from the walls, and there was a flicker of steel.

reference_spacy_tokens: There were voices from the walls , and there was a flicker of steel .


fn_spacy_tokens_for_baseline: It was this legacy of coercive intent along with centuries of suspicion toward central administration which , perhaps , encouraged resistance to attempts to introduce a census in Britain until the beginning of the nineteenth century .

source_bert_toks: it was this legacy of coe ##rc ##ive intent along with centuries of suspicion toward central administration which , perhaps , encouraged resistance to attempts to introduce a census in britain until the beginning of the nineteenth century .

reference_raw: It was this legacy of coercive intention, along with centuries of suspiciousness toward central government, that might have encouraged resistance to attempts to establish a census in Britain until the early nineteenth century.

reference_spacy_tokens: It was this legacy of coercive intention , along with centuries of suspiciousness toward central government , that might have encouraged resistance to attempts to establish a census in Britain until the early nineteenth century .


fn_spacy_tokens_for_baseline: So I think that the sexual politics in the film is very difficult to pigeonhole .

source_bert_toks: so i think that the sexual politics in the film is very difficult to pigeon ##hole .

reference_raw: So I think sex policy in this movie is very hard for pigeons.

reference_spacy_tokens: So I think sex policy in this movie is very hard for pigeons .


fn_spacy_tokens_for_baseline: Hamnett became irate and , alleging breach of contract and damage to her image , threatened to sue him for a £ 500,000 .

source_bert_toks: ham ##nett became ira ##te and , alleging breach of contract and damage to her image , threatened to sue him for a £5 ##00 , 000 .

reference_raw: Hamnett became angry and threatened to sue him for £500,000, claiming breach of contract and damage to her reputation.

reference_spacy_tokens: Hamnett became angry and threatened to sue him for £ 500,000 , claiming breach of contract and damage to her reputation .


fn_spacy_tokens_for_baseline: When they came nearer he did a little dancing step and curtsied low .

source_bert_toks: when they came nearer he did a little dancing step and curt ##sie ##d low .

reference_raw: As they approached, he took a small dance step and bowed low.

reference_spacy_tokens: As they approached , he took a small dance step and bowed low .


fn_spacy_tokens_for_baseline: ' It is not the time for vaulting that five - bar gate , ' he says .

source_bert_toks: ' it is not the time for vault ##ing that five - bar gate , ' he says .

reference_raw: "This isn't the time to arch the five-bar gate," he says.

reference_spacy_tokens: " This is n't the time to arch the five - bar gate , " he says .


fn_spacy_tokens_for_baseline: As I stood there clutching my ' Janet and John ' , I could hear the typewriter clanking and rattling in the distance .

source_bert_toks: as i stood there clutching my ' janet and john ' , i could hear the type ##writer clan ##king and rattling in the distance .

reference_raw: As I stood there, clutching my 'Janet and John', I heard the typewriter clanking and clanking in the distance.

reference_spacy_tokens: As I stood there , clutching my ' Janet and John ' , I heard the typewriter clanking and clanking in the distance .


fn_spacy_tokens_for_baseline: ' My two - year - old son would have to live with my partner 's parents if we both died , ' says Ruth , who was brought up in foster homes and has no contact with her own parents .

source_bert_toks: ' my two - year - old son would have to live with my partner ' s parents if we both died , ' says ruth , who was brought up in foster homes and has no contact with her own parents .

reference_raw: 'My two-year-old son would have to live with the parents of my partner if we both died,' said Ruth, who had been raised in foster homes and had no connection with her parents.

reference_spacy_tokens: ' My two - year - old son would have to live with the parents of my partner if we both died , ' said Ruth , who had been raised in foster homes and had no connection with her parents .


fn_spacy_tokens_for_baseline: He was standing by his desk pouring a mug of coffee from a Thermos jug .

source_bert_toks: he was standing by his desk pouring a mug of coffee from a the ##rm ##os jug .

reference_raw: He stood at the table, pouring coffee from a thermos mug.

reference_spacy_tokens: He stood at the table , pouring coffee from a thermos mug .


fn_spacy_tokens_for_baseline: Biological Possesses expertise and infrastructure to support biological warfare program .

source_bert_toks: biological possesses expertise and infrastructure to support biological warfare program .

reference_raw: Biologic Possesses expertise and infrastructure to support the Biological War Program.

reference_spacy_tokens: Biologic Possesses expertise and infrastructure to support the Biological War Program .


fn_spacy_tokens_for_baseline: A new satellite launched by India is expected to provide additional information on the country 's natural resources .

source_bert_toks: a new satellite launched by india is expected to provide additional information on the country ' s natural resources .

reference_raw: Further information on the country's natural resources is expected to be provided by the new satellite initiated by India.

reference_spacy_tokens: Further information on the country 's natural resources is expected to be provided by the new satellite initiated by India .


fn_spacy_tokens_for_baseline: Mr Stone argues that they have repelled both foreigners and foreign ideas ; that liberalism was junked before it was given a chance to work , socialism implanted without a bourgeoisie , communism introduced without a proletariat .

source_bert_toks: mr stone argues that they have rep ##elled both foreigners and foreign ideas ; that liberalism was junk ##ed before it was given a chance to work , socialism implant ##ed without a bourgeois ##ie , communism introduced without a pro ##let ##aria ##t .

reference_raw: Mr Stone claims that both foreigners and foreign ideas have been repulsed; that liberalism was abandoned before it had the chance to work, that socialism had been transplanted without bourgeoisy, and that communism had been introduced without proletariat.

reference_spacy_tokens: Mr Stone claims that both foreigners and foreign ideas have been repulsed ; that liberalism was abandoned before it had the chance to work , that socialism had been transplanted without bourgeoisy , and that communism had been introduced without proletariat .


fn_spacy_tokens_for_baseline: And the most distinctive languages are often the most vulnerable -- those of native peoples .

source_bert_toks: and the most distinctive languages are often the most vulnerable - - those of native peoples .

reference_raw: And the most distinctive languages are often the most vulnerable - the ones of the indigenous peoples.

reference_spacy_tokens: And the most distinctive languages are often the most vulnerable - the ones of the indigenous peoples .


fn_spacy_tokens_for_baseline: Why had he not excised this passage ?

source_bert_toks: why had he not ex ##cise ##d this passage ?

reference_raw: Why didn't he extinguish this passage?

reference_spacy_tokens: Why did n't he extinguish this passage ?


fn_spacy_tokens_for_baseline: Sir Neill Cooper - Key , Lord Rothermere 's son - in - law , procured the safe Conservative seat of Hastings because , as a young army officer in 1945 he happened to be drinking in the bar of the Berkeley Hotel .

source_bert_toks: sir neill cooper - key , lord roth ##er ##mere ' s son - in - law , pro ##cured the safe conservative seat of hastings because , as a young army officer in 1945 he happened to be drinking in the bar of the berkeley hotel .

reference_raw: Sir Neill Cooper-Key, son-in-law of Lord Rothermere, bought a safe conservative seat in Hastings because, as a young military officer in 1945, he accidentally drank in a bar at the Berkeley Hotel.

reference_spacy_tokens: Sir Neill Cooper - Key , son - in - law of Lord Rothermere , bought a safe conservative seat in Hastings because , as a young military officer in 1945 , he accidentally drank in a bar at the Berkeley Hotel .


fn_spacy_tokens_for_baseline: A nerve jiggled at the corner of Meredith 's mouth because she was beginning to piece small bits of information together and was coming up with a heap of worries .

source_bert_toks: a nerve ji ##ggle ##d at the corner of meredith ' s mouth because she was beginning to piece small bits of information together and was coming up with a heap of worries .

reference_raw: A nerve twitched at the corner of Meredith's mouth as she began to piece together little bits of information and began to come up with a lot of worry.

reference_spacy_tokens: A nerve twitched at the corner of Meredith 's mouth as she began to piece together little bits of information and began to come up with a lot of worry .


fn_spacy_tokens_for_baseline: Connors led him away from the others .

source_bert_toks: connor ##s led him away from the others .

reference_raw: Connors took him away from the others.

reference_spacy_tokens: Connors took him away from the others .


fn_spacy_tokens_for_baseline: She stitched satin ribbon under the bust , bows at the hips and tied a silk cravate .

source_bert_toks: she stitch ##ed satin ribbon under the bust , bows at the hips and tied a silk cr ##ava ##te .

reference_raw: Under the bust she stitched satin ribbons, bows at her hips, and bound a silk cravate.

reference_spacy_tokens: Under the bust she stitched satin ribbons , bows at her hips , and bound a silk cravate .


fn_spacy_tokens_for_baseline: Please , Your Excellency , I beg of you , give me your permission to enter the convent as soon as I 'm sixteen .

source_bert_toks: please , your excel ##len ##cy , i beg of you , give me your permission to enter the convent as soon as i ' m sixteen .

reference_raw: Please, Your Excellency, please give me permission to enter the monastery when I'm 16.

reference_spacy_tokens: Please , Your Excellency , please give me permission to enter the monastery when I 'm 16 .


fn_spacy_tokens_for_baseline: As it happens , the four countries cited , Colombia , Cuba , Panama and Nicaragua , are not only where the press is under greatest attack but also are linked by the drug trade and left - wing politics .

source_bert_toks: as it happens , the four countries cited , colombia , cuba , panama and nicaragua , are not only where the press is under greatest attack but also are linked by the drug trade and left - wing politics .

reference_raw: As it happens, the four countries listed, Colombia, Cuba, Panama and Nicaragua, are not only when the press is under the greatest attack, but also linked to drug trafficking and left-wing policies.

reference_spacy_tokens: As it happens , the four countries listed , Colombia , Cuba , Panama and Nicaragua , are not only when the press is under the greatest attack , but also linked to drug trafficking and left - wing policies .


fn_spacy_tokens_for_baseline: A bearish , messianic figure with mutton - chop whiskers , frequently clad in cowboy boots and ' bolo ' tie , Asimov was stoically resigned to his own eccentricity .

source_bert_toks: a bear ##ish , mess ##iani ##c figure with mu ##tton - chop w ##his ##kers , frequently clad in cowboy boots and ' bo ##lo ' tie , as ##imov was st ##oic ##ally resigned to his own eccentric ##ity .

reference_raw: Asimov was stoically resigned to his own eccentricity, a bearish, messianic figure with a mutton-chop beard, often dressed in cowboy boots and a bolo tie.

reference_spacy_tokens: Asimov was stoically resigned to his own eccentricity , a bearish , messianic figure with a mutton - chop beard , often dressed in cowboy boots and a bolo tie .


fn_spacy_tokens_for_baseline: In southern Greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

source_bert_toks: in southern greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

reference_raw: Today, in southern Greece, huge forest fires are still burning after the destruction of homes and causing serious damage to the region.

reference_spacy_tokens: Today , in southern Greece , huge forest fires are still burning after the destruction of homes and causing serious damage to the region .


fn_spacy_tokens_for_baseline: In addition to making an order for the child 's attendance the court may order any person who is in a position to do so to bring the child to court ( s95(5 ) ) .

source_bert_toks: in addition to making an order for the child ' s attendance the court may order any person who is in a position to do so to bring the child to court ( s ##9 ##5 ( 5 ) ) .

reference_raw: In addition to ordering the presence of the child, the court may order any person in a position to bring the child to court (S95(5)).

reference_spacy_tokens: In addition to ordering the presence of the child , the court may order any person in a position to bring the child to court ( S95(5 ) ) .


fn_spacy_tokens_for_baseline: Quickly Robert inserted the needle into the thigh muscle , and in about a minute , the small body went limp .

source_bert_toks: quickly robert inserted the needle into the thigh muscle , and in about a minute , the small body went limp .

reference_raw: Robert quickly slipped the needle into his thigh muscles, and in about a minute the small body limped.

reference_spacy_tokens: Robert quickly slipped the needle into his thigh muscles , and in about a minute the small body limped .


fn_spacy_tokens_for_baseline: All that was left of his genial friend lay cold before him on the trestles .

source_bert_toks: all that was left of his gen ##ial friend lay cold before him on the tres ##tle ##s .

reference_raw: All that remained of his genius friend lay cold in front of him.

reference_spacy_tokens: All that remained of his genius friend lay cold in front of him .


fn_spacy_tokens_for_baseline: After nine weeks the Germans suppressed the uprising , punishing the city by virtually destroying it .

source_bert_toks: after nine weeks the germans suppressed the uprising , punish ##ing the city by virtually destroying it .

reference_raw: After nine weeks, the Germans suppressed the uprising and sanctioned the city by practically destroying it.

reference_spacy_tokens: After nine weeks , the Germans suppressed the uprising and sanctioned the city by practically destroying it .


fn_spacy_tokens_for_baseline: ' I would think no jewel thief worth her salt would send a man directly to the hiding spot -- no matter how high above the ground she was floating . '

source_bert_toks: ' i would think no jewel thief worth her salt would send a man directly to the hiding spot - - no matter how high above the ground she was floating . '

reference_raw: "I would have thought that no jewel robber worth her salt would have sent a man straight to his hiding place, no matter how high he floated above the ground."

reference_spacy_tokens: " I would have thought that no jewel robber worth her salt would have sent a man straight to his hiding place , no matter how high he floated above the ground . "


fn_spacy_tokens_for_baseline: The wind that blew tin cans along the streets of the dormitory suburb where I was growing up was the same wind that howled round peak and scar and wrested piccolo tunes from the reed patches below the drystone walls .

source_bert_toks: the wind that blew tin cans along the streets of the dormitory suburb where i was growing up was the same wind that howled round peak and scar and wr ##ested piccolo tunes from the reed patches below the dry ##stone walls .

reference_raw: The wind that blew tin cans along the streets of the dormitory suburb where I grew up was the same wind that wailed around the peaks and scars and wreathed piccolo tunes from the reed patches beneath the dry stone walls.

reference_spacy_tokens: The wind that blew tin cans along the streets of the dormitory suburb where I grew up was the same wind that wailed around the peaks and scars and wreathed piccolo tunes from the reed patches beneath the dry stone walls .


fn_spacy_tokens_for_baseline: Cellulite is the particularly ugly type of fat found around the hips , thighs and upper arms .

source_bert_toks: cell ##uli ##te is the particularly ugly type of fat found around the hips , thighs and upper arms .

reference_raw: Cellulite is a particularly ugly type of fat found in the hips, thighs and upper arms.

reference_spacy_tokens: Cellulite is a particularly ugly type of fat found in the hips , thighs and upper arms .


fn_spacy_tokens_for_baseline: With the additional troops , the U. S. Army says it can patrol every neighborhood in Dora , sometimes several times a day .

source_bert_toks: with the additional troops , the u . s . army says it can patrol every neighborhood in dora , sometimes several times a day .

reference_raw: With other units, the U.S. Army says it can watch every quarter of Dora, sometimes a few times a day.

reference_spacy_tokens: With other units , the U.S. Army says it can watch every quarter of Dora , sometimes a few times a day .


fn_spacy_tokens_for_baseline: The FAO began keeping fisheries records in 1950 .

source_bert_toks: the fa ##o began keeping fisheries records in 1950 .

reference_raw: In 1950, the FAO started keeping the fishing logs.

reference_spacy_tokens: In 1950 , the FAO started keeping the fishing logs .


fn_spacy_tokens_for_baseline: Anyway , I have n't been left stranded .

source_bert_toks: anyway , i haven ' t been left stranded .

reference_raw: In any case, they didn't leave me stuck.

reference_spacy_tokens: In any case , they did n't leave me stuck .


fn_spacy_tokens_for_baseline: He d been thieving again , of course , but it was no big deal really .

source_bert_toks: he d been th ##ieving again , of course , but it was no big deal really .

reference_raw: He was stealing again, of course, but it was nothing.

reference_spacy_tokens: He was stealing again , of course , but it was nothing .


fn_spacy_tokens_for_baseline: There is a parallel question on how they think the situation will develop in the next twelve months .

source_bert_toks: there is a parallel question on how they think the situation will develop in the next twelve months .

reference_raw: At the same time, there is a question of how they think the situation will evolve in the next 12 months.

reference_spacy_tokens: At the same time , there is a question of how they think the situation will evolve in the next 12 months .


fn_spacy_tokens_for_baseline: It comes as no surprise to . science , ' she said with a disapproving emphasis upon the final word .

source_bert_toks: it comes as no surprise to . science , ' she said with a di ##sa ##pp ##roving emphasis upon the final word .

reference_raw: "Science doesn't come as a surprise," she said with a disagreeable emphasis on the last word.

reference_spacy_tokens: " Science does n't come as a surprise , " she said with a disagreeable emphasis on the last word .


fn_spacy_tokens_for_baseline: 2- Kiosks should be placed at key important locations where 24-hour security watch is required .

source_bert_toks: 2 - ki ##os ##ks should be placed at key important locations where 24 - hour security watch is required .

reference_raw: 2-Kiosks should be placed in key important locations where a 24-hour security guard is needed.

reference_spacy_tokens: 2-Kiosks should be placed in key important locations where a 24-hour security guard is needed .


fn_spacy_tokens_for_baseline: The Professor 's grey eyes twinkled , and the manuscript was handed back .

source_bert_toks: the professor ' s grey eyes twinkle ##d , and the manuscript was handed back .

reference_raw: The Professor's gray eyes flickered and he handed the manuscript back.

reference_spacy_tokens: The Professor 's gray eyes flickered and he handed the manuscript back .


fn_spacy_tokens_for_baseline: a ) No sense of proportionality .

source_bert_toks: a ) no sense of proportional ##ity .

reference_raw: (a) A lack of proportionality.

reference_spacy_tokens: ( a ) A lack of proportionality .


fn_spacy_tokens_for_baseline: Even the towplanes are taxied to a nearby picketing point and tied down properly between each flight .

source_bert_toks: even the tow ##planes are taxi ##ed to a nearby picket ##ing point and tied down properly between each flight .

reference_raw: Even the towplanes are cabbed to a nearby patrol station, and they are properly tied between each flight.

reference_spacy_tokens: Even the towplanes are cabbed to a nearby patrol station , and they are properly tied between each flight .


fn_spacy_tokens_for_baseline: Ianthe reflected for a moment on this depressing picture of the bed - sitting - room world , with no churchgoing to give meaning to the day , though presumably Mrs Gammon might go sometimes .

source_bert_toks: ian ##the reflected for a moment on this de ##pressing picture of the bed - sitting - room world , with no church ##going to give meaning to the day , though presumably mrs ga ##mmon might go sometimes .

reference_raw: Ianthe thought for a moment of this oppressive picture of the world of the bed-sitting room, where no church would make sense of the day, though perhaps Mrs. Gammon would come.

reference_spacy_tokens: Ianthe thought for a moment of this oppressive picture of the world of the bed - sitting room , where no church would make sense of the day , though perhaps Mrs. Gammon would come .


fn_spacy_tokens_for_baseline: ' Come on then , let 's hang up your coat and go from there , ' Natasha proposed .

source_bert_toks: ' come on then , let ' s hang up your coat and go from there , ' natasha proposed .

reference_raw: 'Let's hang up your coat and get out of here,' Natasha suggested.

reference_spacy_tokens: ' Let 's hang up your coat and get out of here , ' Natasha suggested .


fn_spacy_tokens_for_baseline: Waldrop , the former editor of the Washington Times - Herald , which was folded into the Washington Post in 1954 , died two years ago at age 92 .

source_bert_toks: wal ##drop , the former editor of the washington times - herald , which was folded into the washington post in 1954 , died two years ago at age 92 .

reference_raw: Waldrop, former editor of the Washington Times Herald, who was placed in the Washington Post in 1954, died two years ago at the age of 92.

reference_spacy_tokens: Waldrop , former editor of the Washington Times Herald , who was placed in the Washington Post in 1954 , died two years ago at the age of 92 .


fn_spacy_tokens_for_baseline: That has begun shipping to members , and SAG optimistically expects products complying to the specification to be around by the end of year .

source_bert_toks: that has begun shipping to members , and sa ##g optimistic ##ally expects products comply ##ing to the specification to be around by the end of year .

reference_raw: This has started transporting to members, and SAG optimistically expects that products meeting the specification will be around the end of the year.

reference_spacy_tokens: This has started transporting to members , and SAG optimistically expects that products meeting the specification will be around the end of the year .


fn_spacy_tokens_for_baseline: The envy in his voice was almost pathetic .

source_bert_toks: the envy in his voice was almost pathetic .

reference_raw: Enviousness was almost pathetic in his voice.

reference_spacy_tokens: Enviousness was almost pathetic in his voice .


fn_spacy_tokens_for_baseline: From Lutzelfluh the road heads north - east to reach Sumiswald ( in 8 km , 5 miles ) on its broad sunny terrace .

source_bert_toks: from lu ##tze ##lf ##lu ##h the road heads north - east to reach sum ##is ##wald ( in 8 km , 5 miles ) on its broad sunny terrace .

reference_raw: From Lutzelfluh, the road heads northeast to Sumiswald (in 8 km, 5 miles) on its wide sunlit terrace.

reference_spacy_tokens: From Lutzelfluh , the road heads northeast to Sumiswald ( in 8 km , 5 miles ) on its wide sunlit terrace .


fn_spacy_tokens_for_baseline: He felt very sorry he had offended her so much by telling her he had seen her when she thought she was alone .

source_bert_toks: he felt very sorry he had offended her so much by telling her he had seen her when she thought she was alone .

reference_raw: He was very sorry that he had insulted her so much when he told her that he had seen her when she thought she was alone.

reference_spacy_tokens: He was very sorry that he had insulted her so much when he told her that he had seen her when she thought she was alone .


fn_spacy_tokens_for_baseline: Water diffusing from internal tissues towards the outer layers of skin will not be sufficient to replace that which evaporates from the surface .

source_bert_toks: water di ##ff ##using from internal tissues towards the outer layers of skin will not be sufficient to replace that which eva ##por ##ates from the surface .

reference_raw: The dispersion of water from the internal tissues to the external layers of the skin will not be sufficient to replace the evaporation from the surface.

reference_spacy_tokens: The dispersion of water from the internal tissues to the external layers of the skin will not be sufficient to replace the evaporation from the surface .


fn_spacy_tokens_for_baseline: The latest attacks jangled European nerves already frayed by warnings of possible terrorist attacks during the holiday season .

source_bert_toks: the latest attacks jang ##led european nerves already fray ##ed by warnings of possible terrorist attacks during the holiday season .

reference_raw: The latest attacks jangled Europe's nerves in the wake of a possible terrorist attack during the holiday season.

reference_spacy_tokens: The latest attacks jangled Europe 's nerves in the wake of a possible terrorist attack during the holiday season .


fn_spacy_tokens_for_baseline: The network will be funded by donations from benefactors of the Cerullo organisation in Europe and also from donations worldwide

source_bert_toks: the network will be funded by donations from benefactor ##s of the ce ##ru ##llo organisation in europe and also from donations worldwide

reference_raw: The network will be financed by gifts from benefactors of Cerullo in Europe, as well as from gifts from around the world.

reference_spacy_tokens: The network will be financed by gifts from benefactors of Cerullo in Europe , as well as from gifts from around the world .


fn_spacy_tokens_for_baseline: ' There appears to be a lacuna between finishing his cure at Monte Regia and coming to St Ermyntrude 's . '

source_bert_toks: ' there appears to be a lac ##una between finishing his cure at monte reg ##ia and coming to st er ##my ##nt ##rud ##e ' s . '

reference_raw: 'There seems to be a gap between the completion of the treatment in Monte Regia and the arrival at St. Ermyntrude's.'

reference_spacy_tokens: ' There seems to be a gap between the completion of the treatment in Monte Regia and the arrival at St. Ermyntrude 's . '


fn_spacy_tokens_for_baseline: It was not until 1829 that Rafael Rivera , a Mexican scout , found a spring -fed valley and dubbed it Las Vegas -- a Spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

source_bert_toks: it was not until 1829 that rafael rivera , a mexican scout , found a spring - fed valley and dubbed it las vegas - - a spanish name that leaves many modern visitors wondering exactly where " the meadows " really lay .

reference_raw: Only in 1829 did Rafael Rivera, a Mexican explorer, find a spring-fed valley and call it Las Vegas-a Spanish name that leaves many modern visitors wondering exactly where "the meadows" really lie.

reference_spacy_tokens: Only in 1829 did Rafael Rivera , a Mexican explorer , find a spring - fed valley and call it Las Vegas - a Spanish name that leaves many modern visitors wondering exactly where " the meadows " really lie .


fn_spacy_tokens_for_baseline: In a thrilling climactic scene during a howling blizzard in the mountains , he and Umegawa do kill themselves .

source_bert_toks: in a thrilling cl ##ima ##ctic scene during a howling blizzard in the mountains , he and um ##ega ##wa do kill themselves .

reference_raw: In an exciting climate scene during a howling storm in the mountains, he and Umegawa kill each other.

reference_spacy_tokens: In an exciting climate scene during a howling storm in the mountains , he and Umegawa kill each other .


fn_spacy_tokens_for_baseline: His own knowledge of dissection also paid dividends , allowing him to concoct remedies against rheumatism made from the fat of his hanged victims .

source_bert_toks: his own knowledge of di ##sse ##ction also paid divide ##nds , allowing him to con ##co ##ct re ##med ##ies against r ##he ##uma ##tism made from the fat of his hanged victims .

reference_raw: His own knowledge of dissection also paid dividends, allowing him to devise a cure for rheumatism caused by the fat of his hanged victims.

reference_spacy_tokens: His own knowledge of dissection also paid dividends , allowing him to devise a cure for rheumatism caused by the fat of his hanged victims .


fn_spacy_tokens_for_baseline: Had he known what advice was reaching the tsar in St Petersburg , his anxiety would have been greater still .

source_bert_toks: had he known what advice was reaching the tsar in st petersburg , his anxiety would have been greater still .

reference_raw: If he had known what advice had been given to him in St. Petersburg, he would have been more anxious.

reference_spacy_tokens: If he had known what advice had been given to him in St. Petersburg , he would have been more anxious .


fn_spacy_tokens_for_baseline: And this is why any new owner is strongly advised to have at least a safety inspection of the system carried out immediately on moving in .

source_bert_toks: and this is why any new owner is strongly advised to have at least a safety inspection of the system carried out immediately on moving in .

reference_raw: Therefore, it is strongly recommended that any new owner should have at least a security check on the system immediately upon arrival.

reference_spacy_tokens: Therefore , it is strongly recommended that any new owner should have at least a security check on the system immediately upon arrival .


fn_spacy_tokens_for_baseline: ' That 's the calm sea , ' he pointed out the inlet that ran to Ballysadare as they came along the narrow twisting road into Strandhill .

source_bert_toks: ' that ' s the calm sea , ' he pointed out the inlet that ran to ball ##ys ##ada ##re as they came along the narrow twisting road into strand ##hill .

reference_raw: 'This is a calm sea,' he said, pointing to the entrance that led to Ballysadare as they walked down the narrow winding road to Strandhill.

reference_spacy_tokens: ' This is a calm sea , ' he said , pointing to the entrance that led to Ballysadare as they walked down the narrow winding road to Strandhill .


fn_spacy_tokens_for_baseline: The two women dismounted from the taxi as soon as possible .

source_bert_toks: the two women dismounted from the taxi as soon as possible .

reference_raw: The two women got out of the cab as soon as they could.

reference_spacy_tokens: The two women got out of the cab as soon as they could .


fn_spacy_tokens_for_baseline: The waiter swaggered away .

source_bert_toks: the waiter sw ##agger ##ed away .

reference_raw: The waiter shuffled away.

reference_spacy_tokens: The waiter shuffled away .


fn_spacy_tokens_for_baseline: These gardens used to belong to the governor 's mountain lodge , but the building was demolished by the Japanese during the occupation of Hong Kong .

source_bert_toks: these gardens used to belong to the governor ' s mountain lodge , but the building was demolished by the japanese during the occupation of hong kong .

reference_raw: These gardens were once part of the government's mountain hut, but the building was destroyed by the Japanese during Hong Kong's occupation.

reference_spacy_tokens: These gardens were once part of the government 's mountain hut , but the building was destroyed by the Japanese during Hong Kong 's occupation .


fn_spacy_tokens_for_baseline: Pierre Marie - Joseph Nizan was undoubtedly the pivotal influence in Paul - Yves 's formative years .

source_bert_toks: pierre marie - joseph ni ##zan was undoubtedly the pivotal influence in paul - yves ' s format ##ive years .

reference_raw: Pierre Marie-Joseph Nizan was no doubt the key influence in the formative years of Paul-Yves.

reference_spacy_tokens: Pierre Marie - Joseph Nizan was no doubt the key influence in the formative years of Paul - Yves .


fn_spacy_tokens_for_baseline: No doubt computers will be utilized to manage and track the inevitable masses of information and to provide comparative fitness testing data on what could be a pool of more than 100 players in the three categories .

source_bert_toks: no doubt computers will be utilized to manage and track the inevitable masses of information and to provide comparative fitness testing data on what could be a pool of more than 100 players in the three categories .

reference_raw: Computers will undoubtedly be used to manage and monitor the inevitable amount of information and to provide comparative fitness test data on what could be a pool of more than 100 players in the three categories.

reference_spacy_tokens: Computers will undoubtedly be used to manage and monitor the inevitable amount of information and to provide comparative fitness test data on what could be a pool of more than 100 players in the three categories .


fn_spacy_tokens_for_baseline: Louise 's mother was shocked and felt guiltily conscious of failing to take proper care of her brother 's daughter , but was glad to have the restless girl off her hands .

source_bert_toks: louise ' s mother was shocked and felt guilt ##ily conscious of failing to take proper care of her brother ' s daughter , but was glad to have the restless girl off her hands .

reference_raw: Louise's mother was shocked, guiltily aware that she hadn't taken good care of her brother's daughter, but she was glad that the restless girl was out of her hands.

reference_spacy_tokens: Louise 's mother was shocked , guiltily aware that she had n't taken good care of her brother 's daughter , but she was glad that the restless girl was out of her hands .


fn_spacy_tokens_for_baseline: It had been hoped that an emphatic victory in New South Wales would lay the groundwork for a conservative victory at the next federal election , due by March 1993 .

source_bert_toks: it had been hoped that an em ##pha ##tic victory in new south wales would lay the ground ##work for a conservative victory at the next federal election , due by march 1993 .

reference_raw: It was hoped that a strong victory in New South Wales would lay the foundations for a conservative victory in the next federal election to be held in March 1993.

reference_spacy_tokens: It was hoped that a strong victory in New South Wales would lay the foundations for a conservative victory in the next federal election to be held in March 1993 .


fn_spacy_tokens_for_baseline: A BBC accounts clerk took her life after being suspected of theft at work , a Plymouth inquest heard .

source_bert_toks: a bbc accounts clerk took her life after being suspected of theft at work , a plymouth in ##quest heard .

reference_raw: The BBC accountant took her life after she was suspected of stealing at work, and the Plymouth investigation was heard.

reference_spacy_tokens: The BBC accountant took her life after she was suspected of stealing at work , and the Plymouth investigation was heard .


fn_spacy_tokens_for_baseline: Reports on Aug. 2 said that hundreds of people were killed after an explosion at an arms depot in Kabul thought to have been triggered by rockets fired by mujaheddin .

source_bert_toks: reports on aug . 2 said that hundreds of people were killed after an explosion at an arms depot in kabul thought to have been triggered by rockets fired by mu ##jah ##edd ##in .

reference_raw: According to the reports of August 2, hundreds of people were killed after an explosion in a weapons warehouse in Kabul, which was believed to have been triggered by missiles fired by Mujaheddin.

reference_spacy_tokens: According to the reports of August 2 , hundreds of people were killed after an explosion in a weapons warehouse in Kabul , which was believed to have been triggered by missiles fired by Mujaheddin .


fn_spacy_tokens_for_baseline: LOCKJAW is actually another term for the extremely serious condition of Tetanus , and so I think what you are describing is recurrent dislocation of the tempero - mandibular joints , which link the jaw to the skull .

source_bert_toks: lock ##ja ##w is actually another term for the extremely serious condition of te ##tan ##us , and so i think what you are describing is rec ##urrent di ##sl ##ocation of the temper ##o - man ##di ##bular joints , which link the jaw to the skull .

reference_raw: LOCKJAW is actually another word for Tetanus' extremely severe condition, so I think what you're describing is a recurrent dislocation of the tempero-mandible joints that connect the jaw to the skull.

reference_spacy_tokens: LOCKJAW is actually another word for Tetanus ' extremely severe condition , so I think what you 're describing is a recurrent dislocation of the tempero - mandible joints that connect the jaw to the skull .


fn_spacy_tokens_for_baseline: When I was a first year student at university ( rocks had cooled , but we did n't have the wheel yet ) , the drinking age in Ontario was 19 , but it was 18 in NY state , so we organized booze cruises over Alexandria Bay to get hammered .

source_bert_toks: when i was a first year student at university ( rocks had cooled , but we didn ' t have the wheel yet ) , the drinking age in ontario was 19 , but it was 18 in ny state , so we organized boo ##ze cruises over alexandria bay to get hammered .

reference_raw: When I was a first-year student in college (the rocks had cooled down, but we hadn't had a wheel yet), Ontario's drinking age was 19, but it was 18 in New York, so we arranged a booze cruise across Alexandria Bay to get hammered.

reference_spacy_tokens: When I was a first - year student in college ( the rocks had cooled down , but we had n't had a wheel yet ) , Ontario 's drinking age was 19 , but it was 18 in New York , so we arranged a booze cruise across Alexandria Bay to get hammered .


fn_spacy_tokens_for_baseline: Whatever you desire , start thinking and acting as though it were already true -- in whatever small ways are possible .

source_bert_toks: whatever you desire , start thinking and acting as though it were already true - - in whatever small ways are possible .

reference_raw: Whatever you want, start thinking and act like it's already true - in any small way possible.

reference_spacy_tokens: Whatever you want , start thinking and act like it 's already true - in any small way possible .


fn_spacy_tokens_for_baseline: Unfortunately , the research revealed a high tendency for them to recruit the wrong people .

source_bert_toks: unfortunately , the research revealed a high tendency for them to recruit the wrong people .

reference_raw: Unfortunately, research has shown a high trend towards recruiting the wrong people.

reference_spacy_tokens: Unfortunately , research has shown a high trend towards recruiting the wrong people .


fn_spacy_tokens_for_baseline: Holliman decided that they had to take cover , so they scuttled into a patch of scrub and camouflaged themselves with nets .

source_bert_toks: ho ##lli ##man decided that they had to take cover , so they sc ##ut ##tled into a patch of scrub and camouflage ##d themselves with nets .

reference_raw: Holliman decided they had to hide, so they ran into a patch of scrub and covered themselves with nets.

reference_spacy_tokens: Holliman decided they had to hide , so they ran into a patch of scrub and covered themselves with nets .


fn_spacy_tokens_for_baseline: During the presentation , two briefcases were crammed full with used dealing books containing clients ' names and addresses , and with leads that had been left carelessly lying around on desks .

source_bert_toks: during the presentation , two briefcase ##s were cr ##ammed full with used dealing books containing clients ' names and addresses , and with leads that had been left careless ##ly lying around on desk ##s .

reference_raw: During the presentation, two suitcases were stuffed with used books containing the names and addresses of clients, and with clues that were left carelessly on the tables.

reference_spacy_tokens: During the presentation , two suitcases were stuffed with used books containing the names and addresses of clients , and with clues that were left carelessly on the tables .


fn_spacy_tokens_for_baseline: In their ensemble , these practices and privileges afford the defence sector a considerable degree of protection from the vagaries of the economic system .

source_bert_toks: in their ensemble , these practices and privileges afford the defence sector a considerable degree of protection from the va ##gar ##ies of the economic system .

reference_raw: These practices and privileges provide the defence sector with a high level of protection against the vagaries of the economic system.

reference_spacy_tokens: These practices and privileges provide the defence sector with a high level of protection against the vagaries of the economic system .


fn_spacy_tokens_for_baseline: We saw a few small birds flitting away from the roadside , but for the moment these had to remain unidentified ' little brown jobs ' .

source_bert_toks: we saw a few small birds fl ##itt ##ing away from the roadside , but for the moment these had to remain unidentified ' little brown jobs ' .

reference_raw: We could see a few little birds flying off the side of the road, but for the moment they had to remain unidentified "little brown jobs."

reference_spacy_tokens: We could see a few little birds flying off the side of the road , but for the moment they had to remain unidentified " little brown jobs . "


fn_spacy_tokens_for_baseline: Pain perception is traditionally an area of psychological expertise and the principal aim of this project is to initiate a significant sociological contribution to the study of pain perception , building on the post - holder 's doctoral research .

source_bert_toks: pain perception is traditionally an area of psychological expertise and the principal aim of this project is to initiate a significant sociological contribution to the study of pain perception , building on the post - holder ' s doctoral research .

reference_raw: Pain perception is traditionally an area of psychological expertise and the main objective of the project is to make a significant sociological contribution to the study of pain perception based on post-holder doctoral research.

reference_spacy_tokens: Pain perception is traditionally an area of psychological expertise and the main objective of the project is to make a significant sociological contribution to the study of pain perception based on post - holder doctoral research .


fn_spacy_tokens_for_baseline: It has received international recognition and a long and impressive list of visitors -- including the Prime Minister -- have lauded its achievements .

source_bert_toks: it has received international recognition and a long and impressive list of visitors - - including the prime minister - - have lauded its achievements .

reference_raw: He received international recognition and a long and impressive list of visitors - including the prime minister - praised his achievements.

reference_spacy_tokens: He received international recognition and a long and impressive list of visitors - including the prime minister - praised his achievements .


fn_spacy_tokens_for_baseline: Like a distracted mother duck I shepherded my brood of brightly - anoraked ducklings .

source_bert_toks: like a distracted mother duck i shepherd ##ed my brood of brightly - an ##ora ##ked duck ##lings .

reference_raw: Like a distracted mother duck, I shepherded my thoughts of brightly anoraked ducklings.

reference_spacy_tokens: Like a distracted mother duck , I shepherded my thoughts of brightly anoraked ducklings .


fn_spacy_tokens_for_baseline: Small children who see grandparents frequently are likely to be distressed and puzzled by their death .

source_bert_toks: small children who see grandparents frequently are likely to be distressed and puzzled by their death .

reference_raw: Small children who often see their grandparents are probably troubled and confused by their deaths.

reference_spacy_tokens: Small children who often see their grandparents are probably troubled and confused by their deaths .


fn_spacy_tokens_for_baseline: One insider said last week : ' The sheer anger of people has taken everybody by surprise .

source_bert_toks: one insider said last week : ' the sheer anger of people has taken everybody by surprise .

reference_raw: One of the insiders said last week, "The sheer fury of the people surprised everyone.

reference_spacy_tokens: One of the insiders said last week , " The sheer fury of the people surprised everyone .


fn_spacy_tokens_for_baseline: The refectory stays open for staff , visitors and conference work and they cater for many special functions throughout the campus .

source_bert_toks: the ref ##ect ##ory stays open for staff , visitors and conference work and they cater for many special functions throughout the campus .

reference_raw: It remains open to staff, visitors and conferences, and caters for a number of special functions throughout the school.

reference_spacy_tokens: It remains open to staff , visitors and conferences , and caters for a number of special functions throughout the school .


fn_spacy_tokens_for_baseline: The Ugandan government has announced plans to encourage the production of videos in rural areas throughout the country to counteract the importation of ' morally retrogressive films ' .

source_bert_toks: the uganda ##n government has announced plans to encourage the production of videos in rural areas throughout the country to counter ##act the import ##ation of ' morally retro ##gre ##ssi ##ve films ' .

reference_raw: The Ugandan government announced plans to support the production of videos in rural areas across the country in order to counter the import of 'morally retrogressive films'.

reference_spacy_tokens: The Ugandan government announced plans to support the production of videos in rural areas across the country in order to counter the import of ' morally retrogressive films ' .


fn_spacy_tokens_for_baseline: He was positive he had n't seen her locally anyway .

source_bert_toks: he was positive he hadn ' t seen her locally anyway .

reference_raw: He was sure he didn't see her locally anyway.

reference_spacy_tokens: He was sure he did n't see her locally anyway .


fn_spacy_tokens_for_baseline: Once I had created the spray shape that I wanted , I tied the red ribbon that had accompanied the bouquet into a small flat bow , to minimise its lumpiness , and added it to the design .

source_bert_toks: once i had created the spray shape that i wanted , i tied the red ribbon that had accompanied the bouquet into a small flat bow , to mini ##mise its lump ##iness , and added it to the design .

reference_raw: As soon as I created the spray shape I wanted, I tied the red tape that accompanied the bouquet into a small flat bow to minimize its lumpiness and added it to the design.

reference_spacy_tokens: As soon as I created the spray shape I wanted , I tied the red tape that accompanied the bouquet into a small flat bow to minimize its lumpiness and added it to the design .


fn_spacy_tokens_for_baseline: ' I kipped down in the broom cupboard .

source_bert_toks: ' i ki ##pped down in the broom cupboard .

reference_raw: I dropped into the broom closet.

reference_spacy_tokens: I dropped into the broom closet .


fn_spacy_tokens_for_baseline: This is particularly , but by no means exclusively , the case in polymeric materials where great problems still exist in the proper description in terms of the microstructure .

source_bert_toks: this is particularly , but by no means exclusively , the case in polymer ##ic materials where great problems still exist in the proper description in terms of the micro ##st ##ru ##cture .

reference_raw: This is the case, in particular, but not exclusively, for polymeric materials, where there are still major problems with the proper description of the microstructure.

reference_spacy_tokens: This is the case , in particular , but not exclusively , for polymeric materials , where there are still major problems with the proper description of the microstructure .


fn_spacy_tokens_for_baseline: Winston Benjamin had already claimed the prize scalp of Gooch for eight by the time Agnew peeled off his sweater .

source_bert_toks: winston benjamin had already claimed the prize scalp of goo ##ch for eight by the time ag ##ne ##w peeled off his sweater .

reference_raw: By the time Agnew removed his sweater, Winston Benjamin had already claimed Gooch's prize scalp for eight.

reference_spacy_tokens: By the time Agnew removed his sweater , Winston Benjamin had already claimed Gooch 's prize scalp for eight .


fn_spacy_tokens_for_baseline: The scene that followed was one of the most dramatic in the history of warfare and destined to live , like the defence of Derry , in Irish Protestant annals .

source_bert_toks: the scene that followed was one of the most dramatic in the history of warfare and destined to live , like the defence of derry , in irish protestant annals .

reference_raw: What followed was one of the most dramatic in the history of war and intended to live in Irish Protestant Annals, like Derry's defense.

reference_spacy_tokens: What followed was one of the most dramatic in the history of war and intended to live in Irish Protestant Annals , like Derry 's defense .


fn_spacy_tokens_for_baseline: Yesterday the estranged couple arrived in separate cars to join princes William and Harry at Ludgrove School , in Wokingham , Berkshire , for a Christmas carol concert .

source_bert_toks: yesterday the estranged couple arrived in separate cars to join princes william and harry at lu ##d ##grove school , in wo ##king ##ham , berkshire , for a christmas carol concert .

reference_raw: The alien couple arrived yesterday in separate cars to join Princes William and Harry at the Ludgrove School in Wokingham, Berkshire, for a Christmas Carol concert.

reference_spacy_tokens: The alien couple arrived yesterday in separate cars to join Princes William and Harry at the Ludgrove School in Wokingham , Berkshire , for a Christmas Carol concert .


fn_spacy_tokens_for_baseline: Gradually , TNCs appear to have seen the benefits of ( or in some countries accepted the inevitability of ) employing host - country managers and technicians to run their plants .

source_bert_toks: gradually , tn ##cs appear to have seen the benefits of ( or in some countries accepted the in ##ev ##ita ##bility of ) employing host - country managers and technicians to run their plants .

reference_raw: Gradually, the TNCs seem to understand the benefits of (or in some countries accept the inevitability of) employing host country managers and technicians to operate their facilities.

reference_spacy_tokens: Gradually , the TNCs seem to understand the benefits of ( or in some countries accept the inevitability of ) employing host country managers and technicians to operate their facilities .


fn_spacy_tokens_for_baseline: Nick was some way along the line , at the bend where the track curved round the mountain and Carrie saw him put his hands over his ears as the train blew its whistle .

source_bert_toks: nick was some way along the line , at the bend where the track curved round the mountain and carrie saw him put his hands over his ears as the train blew its whistle .

reference_raw: Nick was somewhere along the line, at the bend where the track curved around the mountain, and Carrie could see that he put his hands over his head as the train whistled.

reference_spacy_tokens: Nick was somewhere along the line , at the bend where the track curved around the mountain , and Carrie could see that he put his hands over his head as the train whistled .


fn_spacy_tokens_for_baseline: By the time they transported him to the dressing station the fever had started to recede .

source_bert_toks: by the time they transported him to the dressing station the fever had started to rec ##ede .

reference_raw: By the time he was taken to the locker room, the fever had begun to subside.

reference_spacy_tokens: By the time he was taken to the locker room , the fever had begun to subside .


fn_spacy_tokens_for_baseline: Sherry learned through our Future Works class that she could rise out of the mire of the welfare system and support her family .

source_bert_toks: sherry learned through our future works class that she could rise out of the mir ##e of the welfare system and support her family .

reference_raw: Through our Future Works class, Sherry found out that she could rise from the mire of the social security system and support her family.

reference_spacy_tokens: Through our Future Works class , Sherry found out that she could rise from the mire of the social security system and support her family .


fn_spacy_tokens_for_baseline: Key data sources for DPRK include defector testimony , which may be unreliable given possibility of deliberate disinformation by double agents and defectors exaggerating what they know , and unclassified estimates by US intelligence agencies , which may have certain biases based on national interest , worst - case expectations , domestic politics , etc . Also , most estimates do not rely on original texts in Korean , which may introduce some errors due to translation issues .

source_bert_toks: key data sources for d ##pr ##k include defect ##or testimony , which may be unreliable given possibility of deliberate di ##sin ##form ##ation by double agents and defect ##ors ex ##agger ##ating what they know , and un ##class ##ified estimates by us intelligence agencies , which may have certain bias ##es based on national interest , worst - case expectations , domestic politics , etc . also , most estimates do not rely on original texts in korean , which may introduce some errors due to translation issues .

reference_raw: The main data resources for the DPRK include defector testimony, which may be unreliable due to the possibility of intentional disinformation by double agents and defectors exaggerating what they know, and unclassified estimates by U.S. intelligence agencies, which may have some prejudices based on national interest, worst case expectations, domestic policy, etc.

reference_spacy_tokens: The main data resources for the DPRK include defector testimony , which may be unreliable due to the possibility of intentional disinformation by double agents and defectors exaggerating what they know , and unclassified estimates by U.S. intelligence agencies , which may have some prejudices based on national interest , worst case expectations , domestic policy , etc .


fn_spacy_tokens_for_baseline: You 'll find herb and medicine shops , incense shops , chop makers ' shops ( makers of Chinese seals ) , and more .

source_bert_toks: you ' ll find herb and medicine shops , incense shops , chop makers ' shops ( makers of chinese seals ) , and more .

reference_raw: You will find herbs and drugstores, incense shops, chop shops (makers of Chinese seals) and more.

reference_spacy_tokens: You will find herbs and drugstores , incense shops , chop shops ( makers of Chinese seals ) and more .


fn_spacy_tokens_for_baseline: Back once more , Vincent moved to another village , Cuesmes , where he lodged in a house divided in two .

source_bert_toks: back once more , vincent moved to another village , cues ##mes , where he lodged in a house divided in two .

reference_raw: Vincent moved back to the next village, Cuesmes, where he lived in a house divided into two.

reference_spacy_tokens: Vincent moved back to the next village , Cuesmes , where he lived in a house divided into two .


fn_spacy_tokens_for_baseline: Then you have to select your weapons and use them with caution -- go in with a gung - ho spirit and you could find you 've missed most of your targets and run out of ammo .

source_bert_toks: then you have to select your weapons and use them with caution - - go in with a gun ##g - ho spirit and you could find you ' ve missed most of your targets and run out of am ##mo .

reference_raw: Then you must select your weapons and use them carefully - go in with a gung-ho spirit and find that you have missed most of your targets and run out of ammunition.

reference_spacy_tokens: Then you must select your weapons and use them carefully - go in with a gung - ho spirit and find that you have missed most of your targets and run out of ammunition .


fn_spacy_tokens_for_baseline: ' It was all very unnerving , ' muses Mark .

source_bert_toks: ' it was all very un ##ner ##ving , ' muse ##s mark .

reference_raw: 'It was all very disturbing,' Mark mused.

reference_spacy_tokens: ' It was all very disturbing , ' Mark mused .


fn_spacy_tokens_for_baseline: It used to be an access track , but a replacement road now runs inland , improving the place immensely .

source_bert_toks: it used to be an access track , but a replacement road now runs inland , improving the place immensely .

reference_raw: It used to be an access route, but now the alternative road runs inland and improves it immensely.

reference_spacy_tokens: It used to be an access route , but now the alternative road runs inland and improves it immensely .


fn_spacy_tokens_for_baseline: He was either out and had n't switched on the answering machine or he was tormenting her by ignoring the telephone .

source_bert_toks: he was either out and hadn ' t switched on the answering machine or he was torment ##ing her by ignoring the telephone .

reference_raw: Either he was out and didn't turn on the answering machine, or he tortured her by ignoring the phone.

reference_spacy_tokens: Either he was out and did n't turn on the answering machine , or he tortured her by ignoring the phone .


fn_spacy_tokens_for_baseline: Cranmer was among the members of the Council who took refuge with her in the Tower and then capitulated to Mary .

source_bert_toks: cr ##an ##mer was among the members of the council who took refuge with her in the tower and then cap ##it ##ulated to mary .

reference_raw: Cranmer was one of the Council members who had taken refuge with her in the Tower and then surrendered to Mary.

reference_spacy_tokens: Cranmer was one of the Council members who had taken refuge with her in the Tower and then surrendered to Mary .


fn_spacy_tokens_for_baseline: My heart chilled and I gnawed at my lip to hide my disappointment .

source_bert_toks: my heart chilled and i g ##na ##wed at my lip to hide my disappointment .

reference_raw: My heart was cold and I bit my lip to hide my disappointment.

reference_spacy_tokens: My heart was cold and I bit my lip to hide my disappointment .


fn_spacy_tokens_for_baseline: ' Why are farmers so timid in this respect ? ' asks Professor James .

source_bert_toks: ' why are farmers so tim ##id in this respect ? ' asks professor james .

reference_raw: 'Why are farmers so shy about this?' says Professor James.

reference_spacy_tokens: ' Why are farmers so shy about this ? ' says Professor James .


fn_spacy_tokens_for_baseline: No doubt when the subsidy commissioners came on the scene they were prevailed on to restore assessments to approximately the levels of 1515 .

source_bert_toks: no doubt when the subsidy commissioners came on the scene they were prevailed on to restore assessments to approximately the levels of 151 ##5 .

reference_raw: There was no doubt that, when the subsidy commissioners arrived at the scene, they had won the task of restoring the evaluation to about 1515.

reference_spacy_tokens: There was no doubt that , when the subsidy commissioners arrived at the scene , they had won the task of restoring the evaluation to about 1515 .


fn_spacy_tokens_for_baseline: Fighters burst out of the nearby refugee camp and ambushed army troops who had been called in to help .

source_bert_toks: fighters burst out of the nearby refugee camp and ambushed army troops who had been called in to help .

reference_raw: Fighters stormed out of the nearby refugee camp, attacking military units called for help.

reference_spacy_tokens: Fighters stormed out of the nearby refugee camp , attacking military units called for help .


fn_spacy_tokens_for_baseline: In other words , he double - checks the contents of a fish finger or a sausage .

source_bert_toks: in other words , he double - checks the contents of a fish finger or a sausage .

reference_raw: In other words, it checks the contents of a fish finger or sausage.

reference_spacy_tokens: In other words , it checks the contents of a fish finger or sausage .


fn_spacy_tokens_for_baseline: Guangzhou , with a population of more than 5 million , straddles the Pearl River - China 's fifth longest - which links the city to the South China Sea .

source_bert_toks: guangzhou , with a population of more than 5 million , st ##rad ##dles the pearl river - china ' s fifth longest - which links the city to the south china sea .

reference_raw: Guangzhou, with a population of over five million, straddles the Pearl River - China's fifth largest - linking the city to the South China Sea.

reference_spacy_tokens: Guangzhou , with a population of over five million , straddles the Pearl River - China 's fifth largest - linking the city to the South China Sea .


fn_spacy_tokens_for_baseline: In the early decades of the century , evangelicals had been constrained by the fear of revolution .

source_bert_toks: in the early decades of the century , evangelical ##s had been constrained by the fear of revolution .

reference_raw: In the early decades of the century, evangelicals were limited by the fear of revolution.

reference_spacy_tokens: In the early decades of the century , evangelicals were limited by the fear of revolution .


fn_spacy_tokens_for_baseline: In any event , this point can not possibly justify departing from the clear import of the language of the statute .

source_bert_toks: in any event , this point can not possibly justify departing from the clear import of the language of the statute .

reference_raw: In any event, that point cannot justify a departure from the clear importation of the language of the Statute.

reference_spacy_tokens: In any event , that point can not justify a departure from the clear importation of the language of the Statute .