fn_spacy_tokens_for_baseline: They generally present a greater barrier to takeovers in EC member states than technical barriers , in particular in Spain , Italy and France .

source_bert_toks: they generally present a greater barrier to takeover ##s in ec member states than technical barriers , in particular in spain , italy and france .

reference_raw: In general, they represent more barriers to entry in the EC Member States than technical barriers, especially in Spain, Italy and France.

reference_spacy_tokens: In general , they represent more barriers to entry in the EC Member States than technical barriers , especially in Spain , Italy and France .


fn_spacy_tokens_for_baseline: In response to this , the Socialist prime minister has simply cited his free - market accomplishments .

source_bert_toks: in response to this , the socialist prime minister has simply cited his free - market accomplishments .

reference_raw: In response, the Socialist Prime Minister simply cited his achievements in the free market.

reference_spacy_tokens: In response , the Socialist Prime Minister simply cited his achievements in the free market .


fn_spacy_tokens_for_baseline: TRANSPORT Secretary John MacGregor has come under fresh pressure to reject any plans for a new motorway linking mid - Essex with the M25 .

source_bert_toks: transport secretary john mac ##gre ##gor has come under fresh pressure to reject any plans for a new motorway linking mid - essex with the m2 ##5 .

reference_raw: TRANSPORT Secretary John MacGregor is under fresh pressure to reject any plans for a new highway connecting the mid-Essex to the M25.

reference_spacy_tokens: TRANSPORT Secretary John MacGregor is under fresh pressure to reject any plans for a new highway connecting the mid - Essex to the M25 .


fn_spacy_tokens_for_baseline: A short ancient gentleman with a droopy moustache was running towards them .

source_bert_toks: a short ancient gentleman with a dr ##oop ##y mo ##ust ##ache was running towards them .

reference_raw: A short old man with a droopy mustache ran toward them.

reference_spacy_tokens: A short old man with a droopy mustache ran toward them .


fn_spacy_tokens_for_baseline: Mr Govind said the finance minister had announced that 100 % equity would be allowed on some developments if they utilised advanced technology and were in the country 's interest .

source_bert_toks: mr gov ##ind said the finance minister had announced that 100 % equity would be allowed on some developments if they ut ##ilised advanced technology and were in the country ' s interest .

reference_raw: Mr. Govind said that the Minister of Finance announced that 100% capital would be allowed for certain developments if they used advanced technology and were in the interest of the country.

reference_spacy_tokens: Mr. Govind said that the Minister of Finance announced that 100 % capital would be allowed for certain developments if they used advanced technology and were in the interest of the country .


fn_spacy_tokens_for_baseline: She gave a husky exhalation of breath , and a second later he had bent his head to press his hot mouth against the swell of her breasts .

source_bert_toks: she gave a husky ex ##hala ##tion of breath , and a second later he had bent his head to press his hot mouth against the swell of her breasts .

reference_raw: She exhaled hoarsely, and a second later he bent his head to press his hot mouth against the swell of her breasts.

reference_spacy_tokens: She exhaled hoarsely , and a second later he bent his head to press his hot mouth against the swell of her breasts .


fn_spacy_tokens_for_baseline: Serge was no longer as indulgent with her .

source_bert_toks: serge was no longer as ind ##ul ##gent with her .

reference_raw: Serge wasn't so fond of her anymore.

reference_spacy_tokens: Serge was n't so fond of her anymore .


fn_spacy_tokens_for_baseline: We decided to take a group of young people from this area over to Backnong in Germany , Chelmsford 's twin town .

source_bert_toks: we decided to take a group of young people from this area over to back ##non ##g in germany , che ##lm ##sford ' s twin town .

reference_raw: We've decided to move a group of young people from here to Backnong, Germany, the twin city of Chelmsford.

reference_spacy_tokens: We 've decided to move a group of young people from here to Backnong , Germany , the twin city of Chelmsford .


fn_spacy_tokens_for_baseline: British pigs produce about seven million gallons of liquid muck a day , posing a big disposal problem for farmers and a water quality headache .

source_bert_toks: british pigs produce about seven million gallons of liquid mu ##ck a day , posing a big disposal problem for farmers and a water quality headache .

reference_raw: British pigs produce about seven million litres of liquid muck a day, which poses a major problem of disposal for farmers and a headache of water quality.

reference_spacy_tokens: British pigs produce about seven million litres of liquid muck a day , which poses a major problem of disposal for farmers and a headache of water quality .


fn_spacy_tokens_for_baseline: He sighed regretfully as he picked his way slowly through the tattered refugees camped here and there on the floor , wondering what had become of his Louis XVI table .

source_bert_toks: he sighed regret ##fully as he picked his way slowly through the ta ##ttered refugees camped here and there on the floor , wondering what had become of his louis xvi table .

reference_raw: He sighed regretfully as he slowly made his way through the ragged refugees encamped here and there on the floor, wondering what had happened to his Louis XVI desk.

reference_spacy_tokens: He sighed regretfully as he slowly made his way through the ragged refugees encamped here and there on the floor , wondering what had happened to his Louis XVI desk .


fn_spacy_tokens_for_baseline: Mrs Alderley frowned in perplexity .

source_bert_toks: mrs al ##der ##ley frowned in per ##plex ##ity .

reference_raw: Mrs. Alderley frowned, puzzled.

reference_spacy_tokens: Mrs. Alderley frowned , puzzled .


fn_spacy_tokens_for_baseline: He told an audience at Stockholm 's stock exchange : ' The abandonment of the project enables all concerned to replan accordingly .

source_bert_toks: he told an audience at stockholm ' s stock exchange : ' the abandonment of the project enables all concerned to rep ##lan accordingly .

reference_raw: At the Stockholm Stock Exchange, he said to the audience, "The termination of the project will allow everyone involved to plan accordingly.

reference_spacy_tokens: At the Stockholm Stock Exchange , he said to the audience , " The termination of the project will allow everyone involved to plan accordingly .


fn_spacy_tokens_for_baseline: A black - haired woman with a long , sad face was inside .

source_bert_toks: a black - haired woman with a long , sad face was inside .

reference_raw: Inside was a dark-haired woman with a long, sad face.

reference_spacy_tokens: Inside was a dark - haired woman with a long , sad face .


fn_spacy_tokens_for_baseline: THE role of Harry Thomason , Friend of Bill and TV producer , in the Case of the White House Travel Office ( see above ) has given new edge to a month - long spat between Washington and Hollywood .

source_bert_toks: the role of harry thomas ##on , friend of bill and tv producer , in the case of the white house travel office ( see above ) has given new edge to a month - long spat between washington and hollywood .

reference_raw: The role of Harry Thomason, friend of Bill and television producer in the White House Travel Office case (see above) gave a new advantage to a month-long spit between Washington and Hollywood.

reference_spacy_tokens: The role of Harry Thomason , friend of Bill and television producer in the White House Travel Office case ( see above ) gave a new advantage to a month - long spit between Washington and Hollywood .


fn_spacy_tokens_for_baseline: Choose from warm rose gold , classic rich yellow , or the more unusual white .

source_bert_toks: choose from warm rose gold , classic rich yellow , or the more unusual white .

reference_raw: Choose from hot pink gold, classic rich yellow, or more unusual white.

reference_spacy_tokens: Choose from hot pink gold , classic rich yellow , or more unusual white .


fn_spacy_tokens_for_baseline: And then with a desperate movement he drew back from her grasp , his breath rasping in his chest .

source_bert_toks: and then with a desperate movement he drew back from her grasp , his breath ras ##ping in his chest .

reference_raw: Then, with a desperate movement, he pulled away from her, his breath crackling in his chest.

reference_spacy_tokens: Then , with a desperate movement , he pulled away from her , his breath crackling in his chest .


fn_spacy_tokens_for_baseline: There are numerous words for the hunting activity , mainly dependent upon the object of the hunt or the tools employed , but none corresponds to words denoting violent acts .

source_bert_toks: there are numerous words for the hunting activity , mainly dependent upon the object of the hunt or the tools employed , but none corresponds to words den ##oting violent acts .

reference_raw: There are many words for hunting, which depend mainly on the subject of the hunt or the instruments used, but none of them correspond to words that indicate violence.

reference_spacy_tokens: There are many words for hunting , which depend mainly on the subject of the hunt or the instruments used , but none of them correspond to words that indicate violence .


fn_spacy_tokens_for_baseline: The constantly crowded and busy Grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the Irish crafts and souvenirs you expect .

source_bert_toks: the constantly crowded and busy grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the irish crafts and so ##uven ##irs you expect .

reference_raw: The ever-crowded and busy Grafton Street is the most visible shopping center, but there are shops everywhere that carry an international range of goods, as well as the Irish crafts and souvenirs you expect.

reference_spacy_tokens: The ever - crowded and busy Grafton Street is the most visible shopping center , but there are shops everywhere that carry an international range of goods , as well as the Irish crafts and souvenirs you expect .


fn_spacy_tokens_for_baseline: Her elbows had been lashed together and she hung from the ceiling like a snared sparrow .

source_bert_toks: her elbows had been lashed together and she hung from the ceiling like a s ##nare ##d sparrow .

reference_raw: Her elbows were tied together, and she hung from the ceiling like a snared sparrow.

reference_spacy_tokens: Her elbows were tied together , and she hung from the ceiling like a snared sparrow .


fn_spacy_tokens_for_baseline: ' I blew it . '

source_bert_toks: ' i blew it . '

reference_raw: "I screwed up."

reference_spacy_tokens: " I screwed up . "


fn_spacy_tokens_for_baseline: He was petrified of the clippers at first .

source_bert_toks: he was pet ##rified of the clip ##pers at first .

reference_raw: At first he was frozen from scissors.

reference_spacy_tokens: At first he was frozen from scissors .


fn_spacy_tokens_for_baseline: Until the 1940s , its beaches teemed with wildlife .

source_bert_toks: until the 1940s , its beaches tee ##med with wildlife .

reference_raw: Until the 1940s, its beaches were full of wildlife.

reference_spacy_tokens: Until the 1940s , its beaches were full of wildlife .


fn_spacy_tokens_for_baseline: Her nudity provided a carte blanche that hours of queuing at the press tent could never have done .

source_bert_toks: her nu ##dity provided a cart ##e blanche that hours of que ##uing at the press tent could never have done .

reference_raw: Her nakedness gave her a blanche of carts that hours of waiting in a press tent would never do.

reference_spacy_tokens: Her nakedness gave her a blanche of carts that hours of waiting in a press tent would never do .


fn_spacy_tokens_for_baseline: ' I think he plucks his eyebrows too , ' she said firmly .

source_bert_toks: ' i think he pl ##uck ##s his eyebrows too , ' she said firmly .

reference_raw: 'I think she's pulling her eyebrows, too,' she said firmly.

reference_spacy_tokens: ' I think she 's pulling her eyebrows , too , ' she said firmly .


fn_spacy_tokens_for_baseline: For elaborate structures stick rocks together with silicone sealant , but let it cure completely before putting it into your tank water .

source_bert_toks: for elaborate structures stick rocks together with silicon ##e seal ##ant , but let it cure completely before putting it into your tank water .

reference_raw: For complex structures, stick stones together with a silicone sealant, but let it heal completely before you put it in the water of the tank.

reference_spacy_tokens: For complex structures , stick stones together with a silicone sealant , but let it heal completely before you put it in the water of the tank .


fn_spacy_tokens_for_baseline: Both these experiments and the studies on the effects of hunger and thirst on dreaming demonstrate the unpredictability of dreaming , explicable only in terms of semantics .

source_bert_toks: both these experiments and the studies on the effects of hunger and thirst on dreaming demonstrate the un ##pre ##dict ##ability of dreaming , ex ##pl ##ica ##ble only in terms of semantics .

reference_raw: Both these experiments and studies on the effects of hunger and thirsty on dreams show that dreams are unpredictable, which can only be explained by semantics.

reference_spacy_tokens: Both these experiments and studies on the effects of hunger and thirsty on dreams show that dreams are unpredictable , which can only be explained by semantics .


fn_spacy_tokens_for_baseline: Ixora stared up , her body in darkness , her emerald eyes flashing wildly in a single sidelong strip of daylight .

source_bert_toks: ix ##ora stared up , her body in darkness , her emerald eyes flashing wildly in a single side ##long strip of daylight .

reference_raw: Ixora looked up, her body in the dark, her emerald eyes gleaming wildly in one side of the day.

reference_spacy_tokens: Ixora looked up , her body in the dark , her emerald eyes gleaming wildly in one side of the day .


fn_spacy_tokens_for_baseline: A NAME like Pauline Gascoyne inevitably conjures an image of a bimbo Gazza in a GTi , to whom a diesel car would be about as socially acceptable as dandruff .

source_bert_toks: a name like pauline gas ##co ##yne inevitably con ##jure ##s an image of a bi ##mbo ga ##zza in a gt ##i , to whom a diesel car would be about as socially acceptable as dan ##dr ##uf ##f .

reference_raw: A name like Pauline Gascoyne inevitably creates a picture of a bimbo Gazza in a GTI, to which a diesel car is about as socially acceptable as a dandruff.

reference_spacy_tokens: A name like Pauline Gascoyne inevitably creates a picture of a bimbo Gazza in a GTI , to which a diesel car is about as socially acceptable as a dandruff .


fn_spacy_tokens_for_baseline: The table was piled with half - eaten dishes and dirty plates , the debris of last night 's dinner .

source_bert_toks: the table was piled with half - eaten dishes and dirty plates , the debris of last night ' s dinner .

reference_raw: The table was littered with half-eaten dishes and dirty plates, and the ruins of yesterday's supper.

reference_spacy_tokens: The table was littered with half - eaten dishes and dirty plates , and the ruins of yesterday 's supper .


fn_spacy_tokens_for_baseline: It celebrates the founding of Guangzhou , when five spirits rode their goats down from the celestial realm to present the inhabitants of the city with their very first grains of rice .

source_bert_toks: it celebrates the founding of guangzhou , when five spirits rode their goats down from the celestial realm to present the inhabitants of the city with their very first grains of rice .

reference_raw: It celebrates the founding of Guangzhou, when five spirits rode their goats from the Celestial Empire to present their first grain of rice to the people of the city.

reference_spacy_tokens: It celebrates the founding of Guangzhou , when five spirits rode their goats from the Celestial Empire to present their first grain of rice to the people of the city .


fn_spacy_tokens_for_baseline: She could feel nothing , as if her entire body were mummified in thick wads of flavourless chewing gum .

source_bert_toks: she could feel nothing , as if her entire body were mum ##mi ##fied in thick wa ##ds of flavour ##less chewing gum .

reference_raw: She felt nothing, as if her whole body had been mummified in thick wads of tasteless chewing gum.

reference_spacy_tokens: She felt nothing , as if her whole body had been mummified in thick wads of tasteless chewing gum .


fn_spacy_tokens_for_baseline: It was suggested , but never proved , that the deceased gentleman may have had valuables in the house , and that their abstraction was the motive of the crime .

source_bert_toks: it was suggested , but never proved , that the deceased gentleman may have had valuable ##s in the house , and that their abstraction was the motive of the crime .

reference_raw: It was suggested, but never proved, that the deceased gentleman might have valuables in the house, and that their abstraction was the cause of the crime.

reference_spacy_tokens: It was suggested , but never proved , that the deceased gentleman might have valuables in the house , and that their abstraction was the cause of the crime .


fn_spacy_tokens_for_baseline: The main highway makes a circuit of the New Territories , beginning with the new town of Tsuen Wan , situated in an area of heavy industry just west of Kowloon .

source_bert_toks: the main highway makes a circuit of the new territories , beginning with the new town of ts ##uen wan , situated in an area of heavy industry just west of ko ##wl ##oon .

reference_raw: The main road runs around the new territories, starting with the new city of Tsuen Wan, which is located in a heavy industrial area just west of Kowloon.

reference_spacy_tokens: The main road runs around the new territories , starting with the new city of Tsuen Wan , which is located in a heavy industrial area just west of Kowloon .


fn_spacy_tokens_for_baseline: De Montfort 's men had to march up the northern scarp , but they still seem to have taken the royal forces , camped down in the priory grounds , by surprise .

source_bert_toks: de mont ##fort ' s men had to march up the northern scar ##p , but they still seem to have taken the royal forces , camped down in the priory grounds , by surprise .

reference_raw: De Montfort's men must have marched up the northern scarf, but it still seems they've captured the royal forces and encamped in the prey grounds.

reference_spacy_tokens: De Montfort 's men must have marched up the northern scarf , but it still seems they 've captured the royal forces and encamped in the prey grounds .


fn_spacy_tokens_for_baseline: ' I feel so horny I think I 'll faint . '

source_bert_toks: ' i feel so horn ##y i think i ' ll faint . '

reference_raw: "I'm so horned, I think I'm going to pass out."

reference_spacy_tokens: " I 'm so horned , I think I 'm going to pass out . "


fn_spacy_tokens_for_baseline: So far , hypertext , and EP generally , have revealed all the same intriguing but infuriating problems encountered in the wider arena of computer science .

source_bert_toks: so far , hyper ##text , and ep generally , have revealed all the same intriguing but in ##fur ##iating problems encountered in the wider arena of computer science .

reference_raw: So far, hypertext and the European Parliament in general have revealed all the same interesting but irritating problems encountered in the wider arena of computer science.

reference_spacy_tokens: So far , hypertext and the European Parliament in general have revealed all the same interesting but irritating problems encountered in the wider arena of computer science .


fn_spacy_tokens_for_baseline: The top three mosquito hits were then folded and scored as before .

source_bert_toks: the top three mosquito hits were then folded and scored as before .

reference_raw: The top three mosquito hits were then stacked and scored as before.

reference_spacy_tokens: The top three mosquito hits were then stacked and scored as before .


fn_spacy_tokens_for_baseline: Democrats forced the Senate into a rare closed door session .

source_bert_toks: democrats forced the senate into a rare closed door session .

reference_raw: The Democrats forced the Senate into a rare, shut-door session.

reference_spacy_tokens: The Democrats forced the Senate into a rare , shut - door session .


fn_spacy_tokens_for_baseline: Although Iran began developing its nuclear program in the 1950s , it was slow to progress until late in the 1960s , when the US - supplied 5 MW thermal research reactor ( TRR ) went online at the Tehran Nuclear Research Center ( TNRC ) .

source_bert_toks: although iran began developing its nuclear program in the 1950s , it was slow to progress until late in the 1960s , when the us - supplied 5 mw thermal research reactor ( tr ##r ) went online at the tehran nuclear research center ( tn ##rc ) .

reference_raw: Although Iran started developing its nuclear programme in the 1950s, it was slow to advance until the end of the 1960s, when the US - supplied 5 MW thermal research reactors (TRRs) to the Tehran Nuclear Research Center (TNRC).

reference_spacy_tokens: Although Iran started developing its nuclear programme in the 1950s , it was slow to advance until the end of the 1960s , when the US - supplied 5 MW thermal research reactors ( TRRs ) to the Tehran Nuclear Research Center ( TNRC ) .


fn_spacy_tokens_for_baseline: ' We made it , ' and he slapped the gloved hand twice against the steering wheel .

source_bert_toks: ' we made it , ' and he slapped the glove ##d hand twice against the steering wheel .

reference_raw: "We did it," and he hit the steering wheel twice with his gloved hand.

reference_spacy_tokens: " We did it , " and he hit the steering wheel twice with his gloved hand .


fn_spacy_tokens_for_baseline: Even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

source_bert_toks: even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

reference_raw: Even at the best of times, it rarely worked, and at the moment, the electricity was cut off during the daytime.

reference_spacy_tokens: Even at the best of times , it rarely worked , and at the moment , the electricity was cut off during the daytime .


fn_spacy_tokens_for_baseline: That facility went critical in 1996 and become fully operational in 1998 .

source_bert_toks: that facility went critical in 1996 and become fully operational in 1998 .

reference_raw: This facility became critical in 1996 and became fully functional in 1998.

reference_spacy_tokens: This facility became critical in 1996 and became fully functional in 1998 .


fn_spacy_tokens_for_baseline: So far only five percent of the 350 acre fire is contained , with over 400 firefighters battling the blaze .

source_bert_toks: so far only five percent of the 350 acre fire is contained , with over 400 firefighters battling the blaze .

reference_raw: So far, only 5% of the 350-acre fire is contained, and more than 400 firemen are fighting the fire.

reference_spacy_tokens: So far , only 5 % of the 350-acre fire is contained , and more than 400 firemen are fighting the fire .


fn_spacy_tokens_for_baseline: He whistled now and tinkled an imaginary drum , before offering me three teeth of golden maize .

source_bert_toks: he whistled now and tin ##kled an imaginary drum , before offering me three teeth of golden maize .

reference_raw: Now he whistled and rang an imaginary drum, then offered me three teeth of gold corn.

reference_spacy_tokens: Now he whistled and rang an imaginary drum , then offered me three teeth of gold corn .


fn_spacy_tokens_for_baseline: A very popular day - trip from Guangzhou goes to Foshan , a city of nearly 300,000 people , renowned for its handicrafts for more than a thousand years .

source_bert_toks: a very popular day - trip from guangzhou goes to f ##osh ##an , a city of nearly 300 , 000 people , renowned for its hand ##ic ##raf ##ts for more than a thousand years .

reference_raw: It's a very popular day - a trip from Guangzhou to Foshan, a city of almost 300,000 people, famous for its crafts for over a thousand years.

reference_spacy_tokens: It 's a very popular day - a trip from Guangzhou to Foshan , a city of almost 300,000 people , famous for its crafts for over a thousand years .


fn_spacy_tokens_for_baseline: The IAEA has not been able to verify the completeness and correctness of North Korea 's initial declaration submitted in 1992 , and the Agency can not verify whether fissile material has been diverted to military use .

source_bert_toks: the ia ##ea has not been able to verify the complete ##ness and correct ##ness of north korea ' s initial declaration submitted in 1992 , and the agency cannot verify whether fis ##sil ##e material has been diverted to military use .

reference_raw: The IAEA was not in a position to verify the completeness and accuracy of the original North Korea declaration submitted in 1992 and the Agency was not in a position to verify whether the fissile material had been diverted to military use.

reference_spacy_tokens: The IAEA was not in a position to verify the completeness and accuracy of the original North Korea declaration submitted in 1992 and the Agency was not in a position to verify whether the fissile material had been diverted to military use .


fn_spacy_tokens_for_baseline: No conclusions yet , U.S. officials say , but a working theory , plastic explosive .

source_bert_toks: no conclusions yet , u . s . officials say , but a working theory , plastic explosive .

reference_raw: We don't have any conclusions yet, American officials say, but it's a working theory, a plastic explosion.

reference_spacy_tokens: We do n't have any conclusions yet , American officials say , but it 's a working theory , a plastic explosion .


fn_spacy_tokens_for_baseline: Yiddish is especially versatile in describing those poor souls who inhabit the world of the ineffectual , and each is assigned a distinct place in the gallery of pathetic types : schmo , schmendrik , schnook , schmegegge , schlep , schlub , schmuck , putz , klutz , kvetch , and nudnik .

source_bert_toks: yiddish is especially versatile in describing those poor souls who inhabit the world of the in ##ef ##fect ##ual , and each is assigned a distinct place in the gallery of pathetic types : sc ##hm ##o , sc ##hm ##end ##rik , sc ##hn ##ook , sc ##hm ##ege ##gg ##e , sc ##hl ##ep , sc ##hl ##ub , sc ##hm ##uck , put ##z , k ##lu ##tz , kv ##et ##ch , and nu ##d ##nik .

reference_raw: Yiddish is particularly universal in its description of the miserable souls that inhabit the world of the ineffectual, and each is assigned a different place in the gallery of pathetic species: Schmo, Schmendrik, Schmegge, Schmegge, Schlep, Schmuck, Putz, Klutz, Kvetch and Nudnik.

reference_spacy_tokens: Yiddish is particularly universal in its description of the miserable souls that inhabit the world of the ineffectual , and each is assigned a different place in the gallery of pathetic species : Schmo , Schmendrik , Schmegge , Schmegge , Schlep , Schmuck , Putz , Klutz , Kvetch and Nudnik .


fn_spacy_tokens_for_baseline: " What you would get , in all probability , is a big bang , a big splash , but very little gas , " Milton Leitenberg , of the University of Maryland , told United Press International .

source_bert_toks: " what you would get , in all probability , is a big bang , a big splash , but very little gas , " milton lei ##tenberg , of the university of maryland , told united press international .

reference_raw: "What you'd probably get is a big boom, a big splash, but very little gas," Milton Leitenberg, Maryland University, told United Press International.

reference_spacy_tokens: " What you 'd probably get is a big boom , a big splash , but very little gas , " Milton Leitenberg , Maryland University , told United Press International .


fn_spacy_tokens_for_baseline: Another imaginative gesture was the gift of 6 pairs of sturdy , warm mittens , for those who had to work with rusty iron trestles or out in the cold .

source_bert_toks: another imaginative gesture was the gift of 6 pairs of sturdy , warm mit ##tens , for those who had to work with rusty iron tres ##tle ##s or out in the cold .

reference_raw: Another imaginary gesture was the gift of six pairs of sturdy, warm gloves for those who had to work with rusty iron trestles or out in the cold.

reference_spacy_tokens: Another imaginary gesture was the gift of six pairs of sturdy , warm gloves for those who had to work with rusty iron trestles or out in the cold .


fn_spacy_tokens_for_baseline: For an authentic feel of old Portugal , slip into the cool entrance hall of theimpressive Leal Senado ( " Loyal Senate " building ) , a fine example of colonial architecture .

source_bert_toks: for an authentic feel of old portugal , slip into the cool entrance hall of the ##im ##pressive lea ##l sen ##ado ( " loyal senate " building ) , a fine example of colonial architecture .

reference_raw: For the real sense of old Portugal, slide into the cool entrance hall of the impressive Leal Senado (the Loyal Senate "building"), a good example of colonial architecture.

reference_spacy_tokens: For the real sense of old Portugal , slide into the cool entrance hall of the impressive Leal Senado ( the Loyal Senate " building " ) , a good example of colonial architecture .


fn_spacy_tokens_for_baseline: There was also electrical power , though some loose cables sizzled as they whipped about in the rain .

source_bert_toks: there was also electrical power , though some loose cables si ##zzled as they whipped about in the rain .

reference_raw: There was electricity, too, though some of the loose cables hissed as they whipped around in the rain.

reference_spacy_tokens: There was electricity , too , though some of the loose cables hissed as they whipped around in the rain .


fn_spacy_tokens_for_baseline: We 've found ways for people with disabilities to enter the workforce .

source_bert_toks: we ' ve found ways for people with disabilities to enter the workforce .

reference_raw: We've found a way for people with disabilities to join the labour force.

reference_spacy_tokens: We 've found a way for people with disabilities to join the labour force .


fn_spacy_tokens_for_baseline: He made a last desperate attempt to sway them back to him .

source_bert_toks: he made a last desperate attempt to sway them back to him .

reference_raw: He made one last desperate attempt to bring them back to him.

reference_spacy_tokens: He made one last desperate attempt to bring them back to him .


fn_spacy_tokens_for_baseline: Goldsmith talks with some conviction , but she is the first to admit that she is a phoney .

source_bert_toks: goldsmith talks with some conviction , but she is the first to admit that she is a phone ##y .

reference_raw: Goldsmith talks with conviction, but he's the first to admit he's a fake.

reference_spacy_tokens: Goldsmith talks with conviction , but he 's the first to admit he 's a fake .


fn_spacy_tokens_for_baseline: By the time Eline came home at dinner time , Nina had prepared a meal of bread and cheese .

source_bert_toks: by the time eli ##ne came home at dinner time , nina had prepared a meal of bread and cheese .

reference_raw: By the time Eline got home at dinner, Nina was ready to eat bread and cheese.

reference_spacy_tokens: By the time Eline got home at dinner , Nina was ready to eat bread and cheese .


fn_spacy_tokens_for_baseline: THE Conservative Party in Europe last night took the final decisive step towards uniting itself with its distant continental cousins , the Christian Democrats .

source_bert_toks: the conservative party in europe last night took the final decisive step towards uniting itself with its distant continental cousins , the christian democrats .

reference_raw: Last night, the Conservative Party in Europe took the last decisive step to reunite with its distant continental cousins, the Christian Democrats.

reference_spacy_tokens: Last night , the Conservative Party in Europe took the last decisive step to reunite with its distant continental cousins , the Christian Democrats .


fn_spacy_tokens_for_baseline: ' Pearson , ' the Sunday Times reported , ' is thought to have given an assurance that it will not plunder the surplus .

source_bert_toks: ' pearson , ' the sunday times reported , ' is thought to have given an assurance that it will not pl ##under the surplus .

reference_raw: "Pearson," said the Sunday Times, "is believed to have assured him that he would not plunder the surplus.

reference_spacy_tokens: " Pearson , " said the Sunday Times , " is believed to have assured him that he would not plunder the surplus .


fn_spacy_tokens_for_baseline: A door opened further along the passage and to Devlin 's astonishment , Hitler emerged followed by a broad , rather squat man in a nondescript uniform .

source_bert_toks: a door opened further along the passage and to devlin ' s astonishment , hitler emerged followed by a broad , rather squat man in a non ##des ##cript uniform .

reference_raw: The door opened further along the corridor, and to Devlin's surprise, Hitler appeared, followed by a large, rather crouched man in a nondescript uniform.

reference_spacy_tokens: The door opened further along the corridor , and to Devlin 's surprise , Hitler appeared , followed by a large , rather crouched man in a nondescript uniform .


fn_spacy_tokens_for_baseline: He duelled briefly with the Triplane , lost it , and came round in a wide , searching turn .

source_bert_toks: he duel ##led briefly with the trip ##lane , lost it , and came round in a wide , searching turn .

reference_raw: He fought the Triplane briefly, lost it, and turned around in a wide, searching turn.

reference_spacy_tokens: He fought the Triplane briefly , lost it , and turned around in a wide , searching turn .


fn_spacy_tokens_for_baseline: The Romans ruled a pagan empire , but the Aegean had an important influence on the early development of Christianity .

source_bert_toks: the romans ruled a pagan empire , but the aegean had an important influence on the early development of christianity .

reference_raw: The Romans ruled the heathen empire, but the Aegeans had a significant influence on the early development of Christianity.

reference_spacy_tokens: The Romans ruled the heathen empire , but the Aegeans had a significant influence on the early development of Christianity .


fn_spacy_tokens_for_baseline: My results are always very much at your service if you care to apply to me for them .

source_bert_toks: my results are always very much at your service if you care to apply to me for them .

reference_raw: My results are always at your service if you'd like to apply for them.

reference_spacy_tokens: My results are always at your service if you 'd like to apply for them .


fn_spacy_tokens_for_baseline: For the finale of creme brulee --- the chef must quickly brown and harden a layer of sugar on top - she used a blowtorch that refused to light at first .

source_bert_toks: for the finale of cr ##eme br ##ule ##e - - - the chef must quickly brown and harden a layer of sugar on top - she used a blow ##tor ##ch that refused to light at first .

reference_raw: In the finale of Creme Brulee - the cook had to make a quick tan and harden a layer of sugar on the top - she used a blowtorch which, at first, refused to light.

reference_spacy_tokens: In the finale of Creme Brulee - the cook had to make a quick tan and harden a layer of sugar on the top - she used a blowtorch which , at first , refused to light .


fn_spacy_tokens_for_baseline: They were joined by a swarm of spies of all conceivable nationalities , and Macau won a name for international intrigue .

source_bert_toks: they were joined by a swarm of spies of all con ##ce ##iva ##ble nationalities , and macau won a name for international int ##rigue .

reference_raw: A swarm of scouts of every conceivable nationality joined them, and Macau won the name of international intrigue.

reference_spacy_tokens: A swarm of scouts of every conceivable nationality joined them , and Macau won the name of international intrigue .


fn_spacy_tokens_for_baseline: The parishioners of St. Michael and All Angels stop to chat at the church door , as members here always have .

source_bert_toks: the parish ##ion ##ers of st . michael and all angels stop to chat at the church door , as members here always have .

reference_raw: The priests of St. Michael and all the angels stop to talk at the church door, as they always do here.

reference_spacy_tokens: The priests of St. Michael and all the angels stop to talk at the church door , as they always do here .


fn_spacy_tokens_for_baseline: The above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

source_bert_toks: the above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

reference_raw: The above-mentioned protection procedures are for observation purposes only, whereas patrols check fences, barriers and towers and report regularly on their observations.

reference_spacy_tokens: The above - mentioned protection procedures are for observation purposes only , whereas patrols check fences , barriers and towers and report regularly on their observations .


fn_spacy_tokens_for_baseline: Turn off Nathan and walk down Kansu Street to find the Jade Market ( open 10 am - 3 pm ; see page 80 ) , with more than 100 stalls spread out in a large tent , just before you reach the overpass .

source_bert_toks: turn off nathan and walk down kan ##su street to find the jade market ( open 10 am - 3 pm ; see page 80 ) , with more than 100 stalls spread out in a large tent , just before you reach the over ##pass .

reference_raw: Shut down Nathan and go down Kansu Street to find the Jade Market (open 10 a.m. - 3 p.m.; see page 80) with over 100 stalls spread out in a large tent just before you reach the overpass.

reference_spacy_tokens: Shut down Nathan and go down Kansu Street to find the Jade Market ( open 10 a.m. - 3 p.m. ; see page 80 ) with over 100 stalls spread out in a large tent just before you reach the overpass .


fn_spacy_tokens_for_baseline: But the southwest 's growing need for water , combined with Las Vegas 's fortuitous proximity to the Colorado River , would give Las Vegas a second chance to achieve prosperity .

source_bert_toks: but the southwest ' s growing need for water , combined with las vegas ' s fort ##uit ##ous proximity to the colorado river , would give las vegas a second chance to achieve prosperity .

reference_raw: But the growing need for water from the southwest, combined with the fortunate proximity of Las Vegas to the Colorado River, would give Las Vegas a second chance to achieve prosperity.

reference_spacy_tokens: But the growing need for water from the southwest , combined with the fortunate proximity of Las Vegas to the Colorado River , would give Las Vegas a second chance to achieve prosperity .


fn_spacy_tokens_for_baseline: I looked at the splintered stick Bobbie had used to hit Jules and slowly recognised it for what it was : the broken leg of a camera tripod .

source_bert_toks: i looked at the splinter ##ed stick bobbie had used to hit jules and slowly recognised it for what it was : the broken leg of a camera trip ##od .

reference_raw: I looked at the splintered stick Bobbie had used to hit Jules, and slowly recognized it for what it was: the broken foot of the camera tripod.

reference_spacy_tokens: I looked at the splintered stick Bobbie had used to hit Jules , and slowly recognized it for what it was : the broken foot of the camera tripod .


fn_spacy_tokens_for_baseline: The left also is critical of the style of the Socialist government -- a remarkable parallel to the situation in Britain .

source_bert_toks: the left also is critical of the style of the socialist government - - a remarkable parallel to the situation in britain .

reference_raw: The left also criticizes the style of socialist government - a remarkable parallel to the situation in Britain.

reference_spacy_tokens: The left also criticizes the style of socialist government - a remarkable parallel to the situation in Britain .


fn_spacy_tokens_for_baseline: Additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

source_bert_toks: additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

reference_raw: The additional pressure from the coming miners pushed the missionary's predicament beyond recovery.

reference_spacy_tokens: The additional pressure from the coming miners pushed the missionary 's predicament beyond recovery .


fn_spacy_tokens_for_baseline: If these are analogous with the vessels proposed for mining manganese nodules , the capital costs of each operation are likely to run toward $ 1000 million .

source_bert_toks: if these are analogous with the vessels proposed for mining manga ##nese nod ##ules , the capital costs of each operation are likely to run toward $ 1000 million .

reference_raw: If they are similar to the vessels proposed for the production of manganese nodules, the capital cost of each operation is likely to reach $1000 million.

reference_spacy_tokens: If they are similar to the vessels proposed for the production of manganese nodules , the capital cost of each operation is likely to reach $ 1000 million .


fn_spacy_tokens_for_baseline: Glue a Christmassy shape or picture to the front of the hat .

source_bert_toks: glue a christmas ##sy shape or picture to the front of the hat .

reference_raw: Put a Christmas shape or a picture on the front of your hat.

reference_spacy_tokens: Put a Christmas shape or a picture on the front of your hat .


fn_spacy_tokens_for_baseline: Perhaps What 's Brewing could feature an up - to - date list of local beer guides every other month , alternating with the painfully unfunny P.A. Newton column ? -- DAVE WHITE , Wigan .

source_bert_toks: perhaps what ' s brewing could feature an up - to - date list of local beer guides every other month , alternating with the painfully un ##fu ##nn ##y p . a . newton column ? - - dave white , wigan .

reference_raw: Maybe What's Brewing could have an up-to-date list of local beer guides every other month, alternately with a painfully funny P.A. Newton column? - DAVE WHITE, WIGAN.

reference_spacy_tokens: Maybe What 's Brewing could have an up - to - date list of local beer guides every other month , alternately with a painfully funny P.A. Newton column ? - DAVE WHITE , WIGAN .


fn_spacy_tokens_for_baseline: In addition , Iran has made a concerted effort to lure back scientists and technical experts who fled the country at the time of the Islamic revolution .

source_bert_toks: in addition , iran has made a concert ##ed effort to lure back scientists and technical experts who fled the country at the time of the islamic revolution .

reference_raw: Moreover, Iran has coordinated its efforts to attract scientists and technical experts who fled the country at the time of the Islamic Revolution.

reference_spacy_tokens: Moreover , Iran has coordinated its efforts to attract scientists and technical experts who fled the country at the time of the Islamic Revolution .


fn_spacy_tokens_for_baseline: The long shift in fine dark brown wool worn with a heavy necklace of silver and amber hid her angularity and emphasized the strength and regularity of the strong features .

source_bert_toks: the long shift in fine dark brown wool worn with a heavy necklace of silver and amber hid her angular ##ity and emphasized the strength and regular ##ity of the strong features .

reference_raw: The long change in fine, dark-brown wool, worn with a heavy necklace of silver and amber, concealed her angularity and emphasized the strength and regularity of her strong features.

reference_spacy_tokens: The long change in fine , dark - brown wool , worn with a heavy necklace of silver and amber , concealed her angularity and emphasized the strength and regularity of her strong features .


fn_spacy_tokens_for_baseline: Towards the of his days , when he could no longer walk , he was wheeled in a chair into his garden .

source_bert_toks: towards the of his days , when he could no longer walk , he was wheeled in a chair into his garden .

reference_raw: Towards his time, when he could no longer walk, he was turned into his garden in a chair.

reference_spacy_tokens: Towards his time , when he could no longer walk , he was turned into his garden in a chair .


fn_spacy_tokens_for_baseline: The burgundy skirt was smeared with grime and buttons were missing from her gaping blouse .

source_bert_toks: the burgundy skirt was smeared with grim ##e and buttons were missing from her gaping blouse .

reference_raw: The burgundy skirt was stained with grime, and the buttons were missing from the gaping blouse.

reference_spacy_tokens: The burgundy skirt was stained with grime , and the buttons were missing from the gaping blouse .


fn_spacy_tokens_for_baseline: It was the first report of an improvement in Mandela 's condition since he was admitted to a hospital in Pretoria early Saturday after suffering a recurrence of a persistent lung ailment , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

source_bert_toks: it was the first report of an improvement in mandela ' s condition since he was admitted to a hospital in pretoria early saturday after suffering a rec ##ur ##rence of a persistent lung ai ##lm ##ent , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

reference_raw: It was the first report of an improvement in Mandela's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease, a legacy of tuberculosis he had suffered during his 27 years incarcerated for opposition to apartheid.

reference_spacy_tokens: It was the first report of an improvement in Mandela 's condition since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease , a legacy of tuberculosis he had suffered during his 27 years incarcerated for opposition to apartheid .


fn_spacy_tokens_for_baseline: Ed_Henry : What 's really going on is Democrats feel emboldened by the indictment of Vice President Cheney 's former chief of staff believing this is their chance to issue a broader indictment of the Bush administration .

source_bert_toks: ed _ henry : what ' s really going on is democrats feel em ##bold ##ened by the indictment of vice president cheney ' s former chief of staff believing this is their chance to issue a broader indictment of the bush administration .

reference_raw: Ed_Henry: What is really happening is that the democrats feel emboldened by the accusations made by Vice President Cheney's former chief of staff believe that this is their chance to make a wider accusation against the Bush administration.

reference_spacy_tokens: Ed_Henry : What is really happening is that the democrats feel emboldened by the accusations made by Vice President Cheney 's former chief of staff believe that this is their chance to make a wider accusation against the Bush administration .


fn_spacy_tokens_for_baseline: whether democracy is a help or a hindrance in the pursuit of economic growth .

source_bert_toks: whether democracy is a help or a hind ##rance in the pursuit of economic growth .

reference_raw: whether democracy is a help or a barrier to economic growth.

reference_spacy_tokens: whether democracy is a help or a barrier to economic growth .


fn_spacy_tokens_for_baseline: If covert activities had in fact been taking place at this location , these inspections would have significantly jeopardized such efforts .

source_bert_toks: if covert activities had in fact been taking place at this location , these inspections would have significantly je ##opa ##rdi ##zed such efforts .

reference_raw: If secret activities were actually carried out on that site, those inspections would significantly jeopardise those efforts.

reference_spacy_tokens: If secret activities were actually carried out on that site , those inspections would significantly jeopardise those efforts .


fn_spacy_tokens_for_baseline: ' He kissed me on the cheek and I waved him off at the door and watched TV before going to bed .

source_bert_toks: ' he kissed me on the cheek and i waved him off at the door and watched tv before going to bed .

reference_raw: He pecked me on the cheek, and I waved him to the door and watched TV before I went to bed.

reference_spacy_tokens: He pecked me on the cheek , and I waved him to the door and watched TV before I went to bed .


fn_spacy_tokens_for_baseline: In the early 1950s , North Korea began establishing the institutional base to train the human resources for its nuclear development program .

source_bert_toks: in the early 1950s , north korea began establishing the institutional base to train the human resources for its nuclear development program .

reference_raw: At the beginning of the 1950s, North Korea began to set up an institution base to train human resources for its nuclear development programme.

reference_spacy_tokens: At the beginning of the 1950s , North Korea began to set up an institution base to train human resources for its nuclear development programme .


fn_spacy_tokens_for_baseline: The IAEA 's ability to directly monitor activities at the Yo ( ngbyo ( n nuclear complex was completely lost in late December 2002 when North Korea expelled IAEA inspectors who had been monitoring the freeze .

source_bert_toks: the ia ##ea ' s ability to directly monitor activities at the yo ( ng ##by ##o ( n nuclear complex was completely lost in late december 2002 when north korea expelled ia ##ea inspectors who had been monitoring the freeze .

reference_raw: The ability of the IAEA to directly monitor the activities of the YO (NN nuclear complex was completely lost at the end of December 2002 when North Korea expelled the IAEA inspectors who were monitoring the frost.

reference_spacy_tokens: The ability of the IAEA to directly monitor the activities of the YO ( NN nuclear complex was completely lost at the end of December 2002 when North Korea expelled the IAEA inspectors who were monitoring the frost .


fn_spacy_tokens_for_baseline: Robert Merkel , a former U.S. attorney handling drug indictments in Florida , does n't think for a minute that Castro 's much publicized trials of high officials engaged in the drug trade mean he has broken off with the Medellin drug cartel .

source_bert_toks: robert mer ##kel , a former u . s . attorney handling drug indictment ##s in florida , doesn ' t think for a minute that castro ' s much publicized trials of high officials engaged in the drug trade mean he has broken off with the med ##elli ##n drug cartel .

reference_raw: Robert Merkel, an ex-U.S. attorney dealing with drug charges in Florida, does not think for a moment that Castro's many publicized trials of high-level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel.

reference_spacy_tokens: Robert Merkel , an ex - U.S. attorney dealing with drug charges in Florida , does not think for a moment that Castro 's many publicized trials of high - level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel .


fn_spacy_tokens_for_baseline: One interesting finding of this exercise was that for each age group the age of the healthy person approximated to the individual 's broad cohort group .

source_bert_toks: one interesting finding of this exercise was that for each age group the age of the healthy person approximate ##d to the individual ' s broad co ##hort group .

reference_raw: One of the interesting findings of this exercise was that, for each age group, the age of the normal person was approximated to that of the wide cohort group of the individual.

reference_spacy_tokens: One of the interesting findings of this exercise was that , for each age group , the age of the normal person was approximated to that of the wide cohort group of the individual .


fn_spacy_tokens_for_baseline: I warn over the radio they 'll be carrying shooters under their suedes .

source_bert_toks: i warn over the radio they ' ll be carrying shooters under their sued ##es .

reference_raw: I'm warning them on the radio that they're going to have gunmen under their suits.

reference_spacy_tokens: I 'm warning them on the radio that they 're going to have gunmen under their suits .


fn_spacy_tokens_for_baseline: He kept listening for sounds that would tell him Blackbeard and his henchman were in the vicinity .

source_bert_toks: he kept listening for sounds that would tell him black ##be ##ard and his hen ##chman were in the vicinity .

reference_raw: He kept hearing the noises that would tell him that Blackbeard and his henchman were nearby.

reference_spacy_tokens: He kept hearing the noises that would tell him that Blackbeard and his henchman were nearby .


fn_spacy_tokens_for_baseline: My healthiness , or sturdiness , as it was more commonly called , was another important aspect of my being the eldest child .

source_bert_toks: my health ##iness , or stu ##rdi ##ness , as it was more commonly called , was another important aspect of my being the eldest child .

reference_raw: Another important aspect of my being the oldest child was my health, or my sturdy, as it was more often called.

reference_spacy_tokens: Another important aspect of my being the oldest child was my health , or my sturdy , as it was more often called .


fn_spacy_tokens_for_baseline: Nanolab says it ca n't stay profitable if the demand for nanotubes decreases .

source_bert_toks: nano ##lab says it can ' t stay profitable if the demand for nano ##tub ##es decreases .

reference_raw: Nanolab says that if the demand for nanotubes decreases, it can't be profitable.

reference_spacy_tokens: Nanolab says that if the demand for nanotubes decreases , it ca n't be profitable .


fn_spacy_tokens_for_baseline: ' Come in and slobber over our fat ugly bimbos , ' bawled a fat ugly young man in jeans and a windbreaker , standing in the middle of a yellow - lit foyer .

source_bert_toks: ' come in and sl ##ob ##ber over our fat ugly bi ##mbo ##s , ' ba ##wled a fat ugly young man in jeans and a wind ##breaker , standing in the middle of a yellow - lit foyer .

reference_raw: 'Come in and slobber over our fat, ugly bimbos,' said the fat, ugly young man in jeans and a wind-breaker, standing in the center of the yellow-lit hall.

reference_spacy_tokens: ' Come in and slobber over our fat , ugly bimbos , ' said the fat , ugly young man in jeans and a wind - breaker , standing in the center of the yellow - lit hall .


fn_spacy_tokens_for_baseline: They pushed her into the carriage .

source_bert_toks: they pushed her into the carriage .

reference_raw: She was pushed into the coach.

reference_spacy_tokens: She was pushed into the coach .


fn_spacy_tokens_for_baseline: He was likely in a pickle , what with Uncle Dan being ill and just one maid left to do the lot .

source_bert_toks: he was likely in a pick ##le , what with uncle dan being ill and just one maid left to do the lot .

reference_raw: He was probably in trouble, what if Uncle Dan was sick and there was only one maid left for the lot.

reference_spacy_tokens: He was probably in trouble , what if Uncle Dan was sick and there was only one maid left for the lot .


fn_spacy_tokens_for_baseline: About everything he writes hangs a faint savour of calculation .

source_bert_toks: about everything he writes hangs a faint sa ##vo ##ur of calculation .

reference_raw: There's a faint sense of computation about everything he writes.

reference_spacy_tokens: There 's a faint sense of computation about everything he writes .


fn_spacy_tokens_for_baseline: When their changes are completed , and after they have worked up a sweat , ringers often skip off to the local pub , leaving worship for others below .

source_bert_toks: when their changes are completed , and after they have worked up a sweat , ring ##ers often skip off to the local pub , leaving worship for others below .

reference_raw: When they've finished their changes, and when they've done their work, the ringers often jump to the local inn and leave the worship to the others below.

reference_spacy_tokens: When they 've finished their changes , and when they 've done their work , the ringers often jump to the local inn and leave the worship to the others below .


fn_spacy_tokens_for_baseline: Custom - made garments by skillful Hong Kong tailors are still much in demand and cost less than elsewhere for comparable garments .

source_bert_toks: custom - made garments by skill ##ful hong kong tailor ##s are still much in demand and cost less than elsewhere for comparable garments .

reference_raw: Custom-made clothing by skilled Hong Kong tailors is still much in need and cost less for comparable clothing than elsewhere.

reference_spacy_tokens: Custom - made clothing by skilled Hong Kong tailors is still much in need and cost less for comparable clothing than elsewhere .


fn_spacy_tokens_for_baseline: Heavy fighting had scattered the desert with damaged tanks , twisted wrecks that once were jeeps and burned - out trucks stuck head - first in deep sand drifts .

source_bert_toks: heavy fighting had scattered the desert with damaged tanks , twisted wreck ##s that once were jeep ##s and burned - out trucks stuck head - first in deep sand drift ##s .

reference_raw: Heavy battles littered the desert with damaged tanks, twisted wreckage that had once been jeeps and burnt-out trucks stuck headfirst in deep sand drifts.

reference_spacy_tokens: Heavy battles littered the desert with damaged tanks , twisted wreckage that had once been jeeps and burnt - out trucks stuck headfirst in deep sand drifts .


fn_spacy_tokens_for_baseline: Thunder grumbled somewhere in the sky again and rain hissed at the windows .

source_bert_toks: thunder grumbled somewhere in the sky again and rain hissed at the windows .

reference_raw: The thunder grumbled again in the sky, and the rain sizzled through the windows.

reference_spacy_tokens: The thunder grumbled again in the sky , and the rain sizzled through the windows .


fn_spacy_tokens_for_baseline: The crowded Kowloon peninsula and the booming New Territories on the mainland call for some serious sightseeing ; but we begin across Victoria Harbor on Hong Kong Island , where the city was first founded and which remains the center of government , business , and commerce .

source_bert_toks: the crowded ko ##wl ##oon peninsula and the booming new territories on the mainland call for some serious sights ##ee ##ing ; but we begin across victoria harbor on hong kong island , where the city was first founded and which remains the center of government , business , and commerce .

reference_raw: The crowded Kowloon peninsula and the booming New Territories on the mainland require some serious sightseeing; but we start across Victoria Harbor on Hong Kong Island, where the city was first established and remains the center of government, trade, and trade.

reference_spacy_tokens: The crowded Kowloon peninsula and the booming New Territories on the mainland require some serious sightseeing ; but we start across Victoria Harbor on Hong Kong Island , where the city was first established and remains the center of government , trade , and trade .


fn_spacy_tokens_for_baseline: She ran from him , nightmare panic making her breathing and heartbeat echo down the long tree - lined path until she saw the moon shining through a stained - glass window of the garden of Eden .

source_bert_toks: she ran from him , nightmare panic making her breathing and heartbeat echo down the long tree - lined path until she saw the moon shining through a stained - glass window of the garden of eden .

reference_raw: She ran away from him, a nightmare panic that caused her to breathe and pulse to echo down the long tree-lined path until she could see the moon gleaming through the stained glass window of the Garden of Eden.

reference_spacy_tokens: She ran away from him , a nightmare panic that caused her to breathe and pulse to echo down the long tree - lined path until she could see the moon gleaming through the stained glass window of the Garden of Eden .


fn_spacy_tokens_for_baseline: And corruption is condoned by powerful grandees in government and business .

source_bert_toks: and corruption is condo ##ned by powerful grande ##es in government and business .

reference_raw: And corruption is acquitted by powerful nobles in government and business.

reference_spacy_tokens: And corruption is acquitted by powerful nobles in government and business .


fn_spacy_tokens_for_baseline: They jeered police , gave banned Hitler salutes and chanted : ' Foreign pigs -- we 'll get you all . '

source_bert_toks: they je ##ered police , gave banned hitler salute ##s and chant ##ed : ' foreign pigs - - we ' ll get you all . '

reference_raw: They laughed at the police, saluted the forbidden Hitler, and sang, "Foreign Pigs - we'll get all of you."

reference_spacy_tokens: They laughed at the police , saluted the forbidden Hitler , and sang , " Foreign Pigs - we 'll get all of you . "


fn_spacy_tokens_for_baseline: We could see right through your crafty but loose Propaganda .

source_bert_toks: we could see right through your craft ##y but loose propaganda .

reference_raw: We could see through your cunning but loose propaganda.

reference_spacy_tokens: We could see through your cunning but loose propaganda .


fn_spacy_tokens_for_baseline: In 1934 he published another successful satirical novel , How Like an Angel , and a totally different book , Napoleon and his Marshals .

source_bert_toks: in 1934 he published another successful satirical novel , how like an angel , and a totally different book , napoleon and his marshal ##s .

reference_raw: In 1934, he published another successful satirical book, How Like Angel, and another book, Napoleon and his marshals.

reference_spacy_tokens: In 1934 , he published another successful satirical book , How Like Angel , and another book , Napoleon and his marshals .


fn_spacy_tokens_for_baseline: A very strong leading ' rogue ' character played with great guile by Clive Owen emerged out of a solid plot supported by the matchless acting skills of Leslie Phillips .

source_bert_toks: a very strong leading ' rogue ' character played with great gui ##le by clive owen emerged out of a solid plot supported by the match ##less acting skills of leslie phillips .

reference_raw: A very strong lead character, played by Clive Owen with great guile, emerged from a solid plot supported by Leslie Phillips's unmatched acting skills.

reference_spacy_tokens: A very strong lead character , played by Clive Owen with great guile , emerged from a solid plot supported by Leslie Phillips 's unmatched acting skills .


fn_spacy_tokens_for_baseline: And the old Dublin is with us , too -- the irreverent city of wit and charm and that peculiar magic possessed by Ireland and the Irish .

source_bert_toks: and the old dublin is with us , too - - the ir ##re ##vere ##nt city of wit and charm and that peculiar magic possessed by ireland and the irish .

reference_raw: The old Dublin is with us, too - an irrespectable city of ingenuity and charm, and a strange magic possessed by Ireland and the Irish.

reference_spacy_tokens: The old Dublin is with us , too - an irrespectable city of ingenuity and charm , and a strange magic possessed by Ireland and the Irish .


fn_spacy_tokens_for_baseline: A plutonium - based bomb program requires capabilities to mine and mill uranium , process it into reactor fuel , transform the isotopic content of the fuel by " burning " it in a reactor , extract plutonium from the spent fuel , form the plutonium into the core of a fission - implosion weapon , and develop and test high explosives used to initiate fission .

source_bert_toks: a pluto ##nium - based bomb program requires capabilities to mine and mill uranium , process it into reactor fuel , transform the iso ##top ##ic content of the fuel by " burning " it in a reactor , extract pluto ##nium from the spent fuel , form the pluto ##nium into the core of a fission - imp ##los ##ion weapon , and develop and test high explosives used to initiate fission .

reference_raw: The Plutonium-based bomb program requires the ability to mine and grind uranium, process it into reactor fuel, convert the isotopic content of the fuel by "burning" it in the reactor, extract the plutonium from the spent fuel, create the plutonium into the core of the fission-implosion weapon, and develop and test the high explosives used to trigger the fission.

reference_spacy_tokens: The Plutonium - based bomb program requires the ability to mine and grind uranium , process it into reactor fuel , convert the isotopic content of the fuel by " burning " it in the reactor , extract the plutonium from the spent fuel , create the plutonium into the core of the fission - implosion weapon , and develop and test the high explosives used to trigger the fission .


fn_spacy_tokens_for_baseline: By the early 1970s , North Korean engineers were using indigenous technology to expand the IRT- 2000 research reactor and Pyongyang began to acquire plutonium reprocessing technology from the Soviet Union .

source_bert_toks: by the early 1970s , north korean engineers were using indigenous technology to expand the ir ##t - 2000 research reactor and p ##yon ##gy ##ang began to acquire pluto ##nium rep ##ro ##ces ##sing technology from the soviet union .

reference_raw: In the early 1970s, North Korean technicians used native technology to expand the IRT-2000 research reactor, and Pyongyang began to acquire plutonium reprocessing technology from the Soviet Union.

reference_spacy_tokens: In the early 1970s , North Korean technicians used native technology to expand the IRT-2000 research reactor , and Pyongyang began to acquire plutonium reprocessing technology from the Soviet Union .


fn_spacy_tokens_for_baseline: There was some kind of festa that day , for the narrow streets and the Corillo were dense with merry throngs of students and the tuna was playing in the Plaza Mayor .

source_bert_toks: there was some kind of fest ##a that day , for the narrow streets and the co ##rill ##o were dense with merry th ##rong ##s of students and the tuna was playing in the plaza mayor .

reference_raw: There was a celebration that day, for the narrow streets and the Corillo were crowded with merry crowds of students, and the tuna played at the Plaza Mayor.

reference_spacy_tokens: There was a celebration that day , for the narrow streets and the Corillo were crowded with merry crowds of students , and the tuna played at the Plaza Mayor .


fn_spacy_tokens_for_baseline: Afghanistan chopper downing raises concerns over U. S.

source_bert_toks: afghanistan chopper downing raises concerns over u . s .

reference_raw: The fall of Afghan helicopters raises concerns about the United States.

reference_spacy_tokens: The fall of Afghan helicopters raises concerns about the United States .


fn_spacy_tokens_for_baseline: After a while I left the family room and wandered through the great central hall and on into the far side of the house , into Perkin 's workroom .

source_bert_toks: after a while i left the family room and wandered through the great central hall and on into the far side of the house , into per ##kin ' s work ##room .

reference_raw: After a while I left the living room and walked down the great central hall to the other side of the house, to Perkin's office.

reference_spacy_tokens: After a while I left the living room and walked down the great central hall to the other side of the house , to Perkin 's office .


fn_spacy_tokens_for_baseline: The nuclear , biological and chemical reconnaissance vehicle is the ninth variant .

source_bert_toks: the nuclear , biological and chemical reconnaissance vehicle is the ninth variant .

reference_raw: The ninth option is a nuclear, biological, and chemical research car.

reference_spacy_tokens: The ninth option is a nuclear , biological , and chemical research car .


fn_spacy_tokens_for_baseline: She poured a glass of Perrier water for herself and asked if he would like to smoke some pot .

source_bert_toks: she poured a glass of per ##rier water for herself and asked if he would like to smoke some pot .

reference_raw: She poured herself a glass of Perrier water and asked him if he wanted to smoke a little weed.

reference_spacy_tokens: She poured herself a glass of Perrier water and asked him if he wanted to smoke a little weed .


fn_spacy_tokens_for_baseline: Riven felt a thrill of fear in his stomach , like ice poured liquid into the bottom of his lungs ; and then it was all he could do to steer his terrified horse in Murtach 's wake , and stay aboard as it swerved past rocks and bushes , and leapt hollows with the thunder of the other horses like a storm in his ears , and the rain a freezing hail in his face that blinded him .

source_bert_toks: ri ##ven felt a thrill of fear in his stomach , like ice poured liquid into the bottom of his lungs ; and then it was all he could do to steer his terrified horse in mu ##rta ##ch ' s wake , and stay aboard as it sw ##erved past rocks and bushes , and leapt hollow ##s with the thunder of the other horses like a storm in his ears , and the rain a freezing hail in his face that blinded him .

reference_raw: Riven felt a surge of fear in his stomach, like ice pouring liquid into his lungs; and then all he could do was steer his frightened horse in Murtach's wake, and stay on deck while he swerved around the rocks and bushes, leaping into the hollows with the thunder of the other horses, like a storm in his ears, and the rain in his face blinded him.

reference_spacy_tokens: Riven felt a surge of fear in his stomach , like ice pouring liquid into his lungs ; and then all he could do was steer his frightened horse in Murtach 's wake , and stay on deck while he swerved around the rocks and bushes , leaping into the hollows with the thunder of the other horses , like a storm in his ears , and the rain in his face blinded him .


fn_spacy_tokens_for_baseline: I threw the core of the apple over the creek ; it plopped into the mud on the far bank with a satisfying slurp .

source_bert_toks: i threw the core of the apple over the creek ; it pl ##opped into the mud on the far bank with a satisfying sl ##ur ##p .

reference_raw: I threw the apple's core over the stream; it splashed into the mud on the far bank with a satisfactory slurp.

reference_spacy_tokens: I threw the apple 's core over the stream ; it splashed into the mud on the far bank with a satisfactory slurp .


fn_spacy_tokens_for_baseline: The main point is that prose varies a great deal in the amount of aesthetic interest which attaches to linguistic form .

source_bert_toks: the main point is that prose varies a great deal in the amount of aesthetic interest which attache ##s to linguistic form .

reference_raw: The main point is that the prose varies greatly in the amount of aesthetic interest associated with the language form.

reference_spacy_tokens: The main point is that the prose varies greatly in the amount of aesthetic interest associated with the language form .


fn_spacy_tokens_for_baseline: She sounded a little low - spirited .

source_bert_toks: she sounded a little low - spirited .

reference_raw: Her voice was a little low-pitched.

reference_spacy_tokens: Her voice was a little low - pitched .


fn_spacy_tokens_for_baseline: The center contains a concert hall with acclaimed acoustics , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

source_bert_toks: the center contains a concert hall with acclaimed acoustic ##s , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

reference_raw: The centre comprises a concert hall with famous acoustics, theatres, library, exhibition gallery, shops, restaurants, and rods.

reference_spacy_tokens: The centre comprises a concert hall with famous acoustics , theatres , library , exhibition gallery , shops , restaurants , and rods .


fn_spacy_tokens_for_baseline: They revealed that they fired more than 200 rounds at the hijacked car , killing the three men inside , who were wearing boilersuits and balaclava helmets .

source_bert_toks: they revealed that they fired more than 200 rounds at the hi ##jack ##ed car , killing the three men inside , who were wearing boilers ##uit ##s and bala ##cl ##ava helmets .

reference_raw: They found out they fired over 200 rounds at the stolen car and killed three men inside wearing boilersuits and balaclava helmets.

reference_spacy_tokens: They found out they fired over 200 rounds at the stolen car and killed three men inside wearing boilersuits and balaclava helmets .


fn_spacy_tokens_for_baseline: well as you say when you 're taking children to the doctor and adults too it does make a difference our children are matured out of the home and uh our needs are much different than they were

source_bert_toks: well as you say when you ' re taking children to the doctor and adults too it does make a difference our children are mature ##d out of the home and uh our needs are much different than they were

reference_raw: well, like you said, when you take kids to a doctor and adults, it makes a difference that our kids are grown up from home and, uh, our needs are a lot different than they used to be.

reference_spacy_tokens: well , like you said , when you take kids to a doctor and adults , it makes a difference that our kids are grown up from home and , uh , our needs are a lot different than they used to be .


fn_spacy_tokens_for_baseline: In recent years Beijing has intended to strengthen its ties with Tehran given the growing importance of the oil - rich Persian Gulf , as China 's reliance on Middle East / Persian Gulf oil increases .

source_bert_toks: in recent years beijing has intended to strengthen its ties with tehran given the growing importance of the oil - rich persian gulf , as china ' s reliance on middle east / persian gulf oil increases .

reference_raw: In recent years, Beijing intends to strengthen its relations with Tehran, given the growing importance of the oil-rich Gulf, as China's dependence on Middle East/Persian Gulf oil grows.

reference_spacy_tokens: In recent years , Beijing intends to strengthen its relations with Tehran , given the growing importance of the oil - rich Gulf , as China 's dependence on Middle East / Persian Gulf oil grows .


fn_spacy_tokens_for_baseline: On 11 January 2007 , China successfully carried out a test of a direct ascent anti - satellite ( ASAT ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the Earth 's surface .

source_bert_toks: on 11 january 2007 , china successfully carried out a test of a direct ascent anti - satellite ( asa ##t ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the earth ' s surface .

reference_raw: On 11 January 2007, China successfully tested a direct-accession anti-sat (ASAT) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth.

reference_spacy_tokens: On 11 January 2007 , China successfully tested a direct - accession anti - sat ( ASAT ) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth .


fn_spacy_tokens_for_baseline: One is a cab - driver , whose hat , head and shoulders rise from the cab - stand at the right of the picture , between the globes of two gas lamps .

source_bert_toks: one is a cab - driver , whose hat , head and shoulders rise from the cab - stand at the right of the picture , between the globe ##s of two gas lamps .

reference_raw: One of them is a taxi driver, whose hat, head and shoulders rise from a taxi stand to the left of the picture, between the spheres of two gas lamps.

reference_spacy_tokens: One of them is a taxi driver , whose hat , head and shoulders rise from a taxi stand to the left of the picture , between the spheres of two gas lamps .


fn_spacy_tokens_for_baseline: Victoria napped in her cage beside the blossoming geranium .

source_bert_toks: victoria nap ##ped in her cage beside the blossom ##ing ge ##rani ##um .

reference_raw: Victoria dozed in her cage next to the flowering geranium.

reference_spacy_tokens: Victoria dozed in her cage next to the flowering geranium .


fn_spacy_tokens_for_baseline: According to what has been previously mentioned , than AL - QAEDA secures the pledge of its followers , which includes commitment to its policies and objectives preceded by the commander 's ( Amir ) pledge .

source_bert_toks: according to what has been previously mentioned , than al - qaeda secure ##s the pledge of its followers , which includes commitment to its policies and objectives preceded by the commander ' s ( amir ) pledge .

reference_raw: According to the above, AL-QAEDA secures the pledge of its supporters, including the commitment to its politics and objectives preceded by the commander's promise (Amir).

reference_spacy_tokens: According to the above , AL - QAEDA secures the pledge of its supporters , including the commitment to its politics and objectives preceded by the commander 's promise ( Amir ) .


fn_spacy_tokens_for_baseline: ' Why , I wonder , do you suppose that I should know anything of your sister 's abductor ? '

source_bert_toks: ' why , i wonder , do you suppose that i should know anything of your sister ' s abd ##uc ##tor ? '

reference_raw: "Why do you think I should know about your sister's kidnapper?"

reference_spacy_tokens: " Why do you think I should know about your sister 's kidnapper ? "


fn_spacy_tokens_for_baseline: It lovingly documents Glover 's chief obsessions -- the army , working - class men and his lover Ralph .

source_bert_toks: it loving ##ly documents glover ' s chief obsession ##s - - the army , working - class men and his lover ralph .

reference_raw: He's lovingly documenting Glover's chief obsessions - military, working class, and his mistress, Ralph.

reference_spacy_tokens: He 's lovingly documenting Glover 's chief obsessions - military , working class , and his mistress , Ralph .


fn_spacy_tokens_for_baseline: ' Another ransom letter , ' Hannah was saying to Bob Southwell , passing him the plastic folder .

source_bert_toks: ' another ransom letter , ' hannah was saying to bob south ##well , passing him the plastic folder .

reference_raw: "Another ransom letter," Hannah said to Bob Southwell, handing him a plastic file.

reference_spacy_tokens: " Another ransom letter , " Hannah said to Bob Southwell , handing him a plastic file .


fn_spacy_tokens_for_baseline: Within minutes of being tossed out , the soaking fabrics became stiff boards .

source_bert_toks: within minutes of being tossed out , the soaking fabrics became stiff boards .

reference_raw: Within minutes of being thrown out, the wet cloths became rigid boards.

reference_spacy_tokens: Within minutes of being thrown out , the wet cloths became rigid boards .


fn_spacy_tokens_for_baseline: It was enough to warrant an investigation of related compounds and a closer exploration of how they worked .

source_bert_toks: it was enough to warrant an investigation of related compounds and a closer exploration of how they worked .

reference_raw: It was enough to justify an investigation of the related compounds and a closer investigation of how they worked.

reference_spacy_tokens: It was enough to justify an investigation of the related compounds and a closer investigation of how they worked .


fn_spacy_tokens_for_baseline: The unlikely duo will swap songs with Madonna , 34 , singing classics like New York , New York and Frank , 76 , crooning Like A Virgin .

source_bert_toks: the unlikely duo will swap songs with madonna , 34 , singing classics like new york , new york and frank , 76 , cr ##oon ##ing like a virgin .

reference_raw: The unlikely duo will exchange songs with Madonna, 34 years old, singing classics like New York, New York, and Frank, 76 years old, crooning like a virgin.

reference_spacy_tokens: The unlikely duo will exchange songs with Madonna , 34 years old , singing classics like New York , New York , and Frank , 76 years old , crooning like a virgin .


fn_spacy_tokens_for_baseline: You just repeat it like a machine , ' crowed Julian .

source_bert_toks: you just repeat it like a machine , ' crowe ##d julian .

reference_raw: Just say it like a machine,' said Julian.

reference_spacy_tokens: Just say it like a machine , ' said Julian .


fn_spacy_tokens_for_baseline: ' Now , Mrs Figgis - Hewett , I gather that you had a disagreement with Sir Thomas .

source_bert_toks: ' now , mrs fig ##gis - he ##we ##tt , i gather that you had a disagreement with sir thomas .

reference_raw: 'Now, Mrs. Figgis-Hewett, I understand you and Sir Thomas disagreed.

reference_spacy_tokens: ' Now , Mrs. Figgis - Hewett , I understand you and Sir Thomas disagreed .


fn_spacy_tokens_for_baseline: While the swiss roll is cooking , dust a large sheet of greaseproof paper with plenty of caster sugar .

source_bert_toks: while the swiss roll is cooking , dust a large sheet of grease ##proof paper with plenty of caste ##r sugar .

reference_raw: While the Swiss roll cooks, powder a large sheet of greasy paper with a lot of caster sugar.

reference_spacy_tokens: While the Swiss roll cooks , powder a large sheet of greasy paper with a lot of caster sugar .


fn_spacy_tokens_for_baseline: Using deconstruct.pl , we extracted local regions from the main assembly and reassembled the associated traces and their mate pairs at high stringency using phrap .

source_bert_toks: using deco ##nst ##ru ##ct . pl , we extracted local regions from the main assembly and re ##asse ##mbled the associated traces and their mate pairs at high string ##ency using ph ##ra ##p .

reference_raw: Using deconstruct.p., we extracted the local areas from the main assembly and reassembled the associated footprints and their mates with high stringency using phrap.

reference_spacy_tokens: Using deconstruct.p . , we extracted the local areas from the main assembly and reassembled the associated footprints and their mates with high stringency using phrap .


fn_spacy_tokens_for_baseline: Chinese missile exports have been a problem for more than a decade .

source_bert_toks: chinese missile exports have been a problem for more than a decade .

reference_raw: Chinese missile exports have been a problem for over ten years.

reference_spacy_tokens: Chinese missile exports have been a problem for over ten years .


fn_spacy_tokens_for_baseline: For instance , the Iranian Research Organization for Science and Technology claims it researches Fusarium spp . to fight agricultural ailments in sunflower , tomato , and tobacco fields .

source_bert_toks: for instance , the iranian research organization for science and technology claims it researches fu ##sari ##um spp . to fight agricultural ai ##lm ##ents in sun ##flower , tomato , and tobacco fields .

reference_raw: For example, the Iranian Research Organisation for Science and Technology claims that it is researching Fusarium spp. to combat agricultural diseases in sunflower, tomato and tobacco fields.

reference_spacy_tokens: For example , the Iranian Research Organisation for Science and Technology claims that it is researching Fusarium spp . to combat agricultural diseases in sunflower , tomato and tobacco fields .


fn_spacy_tokens_for_baseline: ' Finished at last , ' she sighed , peering into the empty dish .

source_bert_toks: ' finished at last , ' she sighed , peering into the empty dish .

reference_raw: 'I'm finally done,' she sighed, looking into the empty bowl.

reference_spacy_tokens: ' I 'm finally done , ' she sighed , looking into the empty bowl .


fn_spacy_tokens_for_baseline: The vet usually shaves part of the foreleg and cleanses the skin with surgical spirit before the injection , while a nurse helps the owner to hold the dog .

source_bert_toks: the vet usually shave ##s part of the fore ##leg and clean ##ses the skin with surgical spirit before the injection , while a nurse helps the owner to hold the dog .

reference_raw: The veterinarian usually shaves part of the front leg and cleans the skin with surgical alcohol before the injection, while the nurse helps the owner to hold the dog.

reference_spacy_tokens: The veterinarian usually shaves part of the front leg and cleans the skin with surgical alcohol before the injection , while the nurse helps the owner to hold the dog .


fn_spacy_tokens_for_baseline: Last week , when the Lewinsky story was only a few hours old , Stephanopoulos popped up on Good Morning America to demonstrate his concern .

source_bert_toks: last week , when the lew ##insky story was only a few hours old , stephan ##op ##oulos popped up on good morning america to demonstrate his concern .

reference_raw: Last week, when Lewinsky's story was only a couple of hours old, Stephanopoulos came to Good Morning America to show his interest.

reference_spacy_tokens: Last week , when Lewinsky 's story was only a couple of hours old , Stephanopoulos came to Good Morning America to show his interest .


fn_spacy_tokens_for_baseline: Conservative israelis are skeptical .

source_bert_toks: conservative israelis are skeptical .

reference_raw: The conservative Israelis are sceptical.

reference_spacy_tokens: The conservative Israelis are sceptical .


fn_spacy_tokens_for_baseline: It depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black moustache and ruggedly handsome features .

source_bert_toks: it depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black mo ##ust ##ache and rugged ##ly handsome features .

reference_raw: It was simply a huge face, more than a meter wide: the face of a man of about forty-five, with a heavy black mustache and roughly beautiful features.

reference_spacy_tokens: It was simply a huge face , more than a meter wide : the face of a man of about forty - five , with a heavy black mustache and roughly beautiful features .


fn_spacy_tokens_for_baseline: The thornier aspects continue to intrigue international legal experts .

source_bert_toks: the thorn ##ier aspects continue to int ##rigue international legal experts .

reference_raw: International legal experts continue to be fascinated by thornier aspects.

reference_spacy_tokens: International legal experts continue to be fascinated by thornier aspects .


fn_spacy_tokens_for_baseline: Why should he hesitate to crush her ?

source_bert_toks: why should he hesitate to crush her ?

reference_raw: Why would he hesitate to smash it?

reference_spacy_tokens: Why would he hesitate to smash it ?


fn_spacy_tokens_for_baseline: Sadly John 's agent informed me , that ' Noakesy ' was living on a houseboat in Spain without a telephone .

source_bert_toks: sadly john ' s agent informed me , that ' no ##akes ##y ' was living on a house ##boat in spain without a telephone .

reference_raw: Unfortunately, John's agent told me "Noakesy" lived on a boat in Spain without a phone.

reference_spacy_tokens: Unfortunately , John 's agent told me " Noakesy " lived on a boat in Spain without a phone .


fn_spacy_tokens_for_baseline: These totals could quickly be increased should Iran make the decision to either purchase additional systems from the DPRK or accelerate Shehab-3 production .

source_bert_toks: these totals could quickly be increased should iran make the decision to either purchase additional systems from the d ##pr ##k or accelerate she ##hab - 3 production .

reference_raw: If Iran decides to buy additional systems from the DPRK or accelerate the production of Shehab-3, these totals could increase rapidly.

reference_spacy_tokens: If Iran decides to buy additional systems from the DPRK or accelerate the production of Shehab-3 , these totals could increase rapidly .


fn_spacy_tokens_for_baseline: Sun Microsystems Inc will be increasing its incursion into the IBM Corp installed commercial base with Emphasys Software putting its Cross/36 migration tool on Sparc machines running both Solaris 1.1 and 2.1 .

source_bert_toks: sun micro ##systems inc will be increasing its inc ##urs ##ion into the ibm corp installed commercial base with em ##pha ##sy ##s software putting its cross / 36 migration tool on spa ##rc machines running both solar ##is 1 . 1 and 2 . 1 .

reference_raw: Sun Microsystems Inc. will increase its entry into the IBM Corp commercial base installed by Emphasys Software, which will place its Cross/36 migration tool on Sparc machines running both Solaris 1.1 and 2.1.

reference_spacy_tokens: Sun Microsystems Inc. will increase its entry into the IBM Corp commercial base installed by Emphasys Software , which will place its Cross/36 migration tool on Sparc machines running both Solaris 1.1 and 2.1 .


fn_spacy_tokens_for_baseline: Whores would sometimes don men 's apparel , leading to Charles I to issue an order forbidding it , because it now made whores more difficult to detect , but this was generally ignored by the soldiery .

source_bert_toks: whore ##s would sometimes don men ' s apparel , leading to charles i to issue an order forbid ##ding it , because it now made whore ##s more difficult to detect , but this was generally ignored by the soldier ##y .

reference_raw: The whores sometimes donned men's clothing, which led Charles I to issue an order forbidding it, for it now made it more difficult to detect whores, but that was generally ignored by the military.

reference_spacy_tokens: The whores sometimes donned men 's clothing , which led Charles I to issue an order forbidding it , for it now made it more difficult to detect whores , but that was generally ignored by the military .


fn_spacy_tokens_for_baseline: Scottish Television produced two special programmes to mark the Council 's 60th anniversary which were broadcast in May.

source_bert_toks: scottish television produced two special programmes to mark the council ' s 60th anniversary which were broadcast in may .

reference_raw: Scotland Television has drawn up two special programmes to mark the 60th anniversary of the Council, which were broadcast in May.

reference_spacy_tokens: Scotland Television has drawn up two special programmes to mark the 60th anniversary of the Council , which were broadcast in May.


fn_spacy_tokens_for_baseline: Heart filled with pathos , I slipped through one of the windows , and stepped gingerly around the saplings and splintered tiles , afraid I might crash into the cellar .

source_bert_toks: heart filled with path ##os , i slipped through one of the windows , and stepped gingerly around the sap ##lings and splinter ##ed tiles , afraid i might crash into the cellar .

reference_raw: My heart was full of pathos, and I slipped through one of the windows and walked gingerly past the trees and splintered tiles, fearing that I might fall into the cellar.

reference_spacy_tokens: My heart was full of pathos , and I slipped through one of the windows and walked gingerly past the trees and splintered tiles , fearing that I might fall into the cellar .


fn_spacy_tokens_for_baseline: The IAEA has not been able to verify the completeness and correctness of North Korea 's initial declaration submitted in 1992 , and the Agency can not verify whether fissile material has been diverted to military use .

source_bert_toks: the ia ##ea has not been able to verify the complete ##ness and correct ##ness of north korea ' s initial declaration submitted in 1992 , and the agency cannot verify whether fis ##sil ##e material has been diverted to military use .

reference_raw: The IAEA was not in a position to verify the completeness and accuracy of the original North Korea declaration submitted in 1992 and the Agency was not in a position to verify whether the fissile material had been transferred to military use.

reference_spacy_tokens: The IAEA was not in a position to verify the completeness and accuracy of the original North Korea declaration submitted in 1992 and the Agency was not in a position to verify whether the fissile material had been transferred to military use .


fn_spacy_tokens_for_baseline: These scientists report that these compounds , some of which are binaries , were designed to circumvent the CWC and to defeat Western detection and protection measures .

source_bert_toks: these scientists report that these compounds , some of which are bin ##aries , were designed to ci ##rc ##um ##vent the cw ##c and to defeat western detection and protection measures .

reference_raw: According to these scientists, these compounds, some of which are binaries, were designed to circumvent the Convention and defeat Western detection and security measures.

reference_spacy_tokens: According to these scientists , these compounds , some of which are binaries , were designed to circumvent the Convention and defeat Western detection and security measures .


fn_spacy_tokens_for_baseline: Minute shards of glass slashed across Rohmer 's ecstatic face .

source_bert_toks: minute shards of glass slashed across ro ##hm ##er ' s ec ##static face .

reference_raw: Minute pieces of glass cut across Rohmer's ecstasy face.

reference_spacy_tokens: Minute pieces of glass cut across Rohmer 's ecstasy face .


fn_spacy_tokens_for_baseline: A chap in Belgium explained it all to me .

source_bert_toks: a cha ##p in belgium explained it all to me .

reference_raw: The guy in Belgium explained everything to me.

reference_spacy_tokens: The guy in Belgium explained everything to me .


fn_spacy_tokens_for_baseline: Seeing her master , Hermia ground to a halt and whinnied with pleasure .

source_bert_toks: seeing her master , her ##mia ground to a halt and w ##hin ##nie ##d with pleasure .

reference_raw: When Hermia saw her master, she stopped and moaned with joy.

reference_spacy_tokens: When Hermia saw her master , she stopped and moaned with joy .


fn_spacy_tokens_for_baseline: Despite its initial failings , Siegel 's Flamingo survived him , as did mob infiltration of casinos .

source_bert_toks: despite its initial failing ##s , siegel ' s flaming ##o survived him , as did mob in ##filtration of casinos .

reference_raw: Despite his initial failures, Siegel's Flamingo had survived him, as had the mob infiltrated the casinos.

reference_spacy_tokens: Despite his initial failures , Siegel 's Flamingo had survived him , as had the mob infiltrated the casinos .


fn_spacy_tokens_for_baseline: If this were a list of localities where an industrial plant unleashed disaster on the folks next door , that would be bad enough .

source_bert_toks: if this were a list of localities where an industrial plant unleashed disaster on the folks next door , that would be bad enough .

reference_raw: If it were a list of locations where an industrial plant unleashed a catastrophe on people next door, it would be bad enough.

reference_spacy_tokens: If it were a list of locations where an industrial plant unleashed a catastrophe on people next door , it would be bad enough .


fn_spacy_tokens_for_baseline: These beliefs so dominate our educational establishment , our media , our politicians , and even our parents that it seems almost blasphemous to challenge them .

source_bert_toks: these beliefs so dominate our educational establishment , our media , our politicians , and even our parents that it seems almost b ##las ##ph ##em ##ous to challenge them .

reference_raw: These beliefs are so overpowering our educational establishment, our media, our politicians, and even our parents that it seems almost blasphemous to challenge them.

reference_spacy_tokens: These beliefs are so overpowering our educational establishment , our media , our politicians , and even our parents that it seems almost blasphemous to challenge them .


fn_spacy_tokens_for_baseline: Bodie came on the radio , confirming that Mayli Koulo had located Lin Foh 's whereabouts .

source_bert_toks: bo ##die came on the radio , confirming that may ##li ko ##ulo had located lin f ##oh ' s whereabouts .

reference_raw: Bodie radioed and confirmed that Mayli Koulo had found Lin Foh's whereabouts.

reference_spacy_tokens: Bodie radioed and confirmed that Mayli Koulo had found Lin Foh 's whereabouts .


fn_spacy_tokens_for_baseline: If fecundity continued to evade her , the question of responsibility was bound to come up sooner or later .

source_bert_toks: if fe ##cu ##ndi ##ty continued to evade her , the question of responsibility was bound to come up sooner or later .

reference_raw: If he kept avoiding her, the question of responsibility would come sooner or later.

reference_spacy_tokens: If he kept avoiding her , the question of responsibility would come sooner or later .


fn_spacy_tokens_for_baseline: Putin submits nuclear terrorism convention for ratification

source_bert_toks: putin submit ##s nuclear terrorism convention for ratification

reference_raw: Putin presents the Nuclear Terrorism Treaty for ratification


fn_spacy_tokens_for_baseline: Firefighters rescue nearly a dozen animals in Buffalo , New York house fire

source_bert_toks: firefighters rescue nearly a dozen animals in buffalo , new york house fire

reference_raw: The firemen rescued almost a dozen beasts in Buffalo, the fire of the New York house.

reference_spacy_tokens: The firemen rescued almost a dozen beasts in Buffalo , the fire of the New York house .