fn_spacy_tokens_for_baseline: " Four secret transfers of 63 kilograms of highly enriched uranium from a research laboratory in Uzbekistan to a secure Russian reprocessing facility were completed April 19 by the U.S. Department of Energy 's National Nuclear Security Administration ( NNSA ) .

source_bert_toks: " four secret transfers of 63 kilograms of highly enriched uranium from a research laboratory in uzbekistan to a secure russian rep ##ro ##ces ##sing facility were completed april 19 by the u . s . department of energy ' s national nuclear security administration ( n ##ns ##a ) .

reference_raw: "Four secret transfers of 63 kilograms of highly enriched uranium from a research laboratory in Uzbekistan to a safe Russian reprocessing facility were completed by the National Nuclear Safety Office of the United States of America on April 19th."

reference_spacy_tokens: " Four secret transfers of 63 kilograms of highly enriched uranium from a research laboratory in Uzbekistan to a safe Russian reprocessing facility were completed by the National Nuclear Safety Office of the United States of America on April 19th . "


fn_spacy_tokens_for_baseline: Among the ponds is one inhabited by turtles : Visitors toss in coins in the hope of bouncing one off a turtle 's head , a sure way of achieving good fortune .

source_bert_toks: among the ponds is one inhabited by turtles : visitors toss in coins in the hope of bouncing one off a turtle ' s head , a sure way of achieving good fortune .

reference_raw: There's one inhabited by tortoises among the ponds: Visitors throw in coins to bounce one off the head of a tortoise, a sure way to achieve happiness.

reference_spacy_tokens: There 's one inhabited by tortoises among the ponds : Visitors throw in coins to bounce one off the head of a tortoise , a sure way to achieve happiness .


fn_spacy_tokens_for_baseline: They said if we did n't consent for him to claim for the two of us , they 'd summons me and him for aiding and abetting .

source_bert_toks: they said if we didn ' t consent for him to claim for the two of us , they ' d summons me and him for aiding and abe ##tting .

reference_raw: They said if we didn't agree to let him claim for both of us, they'd call me and him in for aid and abettance.

reference_spacy_tokens: They said if we did n't agree to let him claim for both of us , they 'd call me and him in for aid and abettance .


fn_spacy_tokens_for_baseline: I 'm proud of their efforts to work safely as they safely destroy the chemical munitions that Anniston Chemical Activity stores .

source_bert_toks: i ' m proud of their efforts to work safely as they safely destroy the chemical munitions that ann ##isto ##n chemical activity stores .

reference_raw: I am proud of their efforts to work safely when they safely destroy the chemical ammunition that Anniston Chemical Activity stores.

reference_spacy_tokens: I am proud of their efforts to work safely when they safely destroy the chemical ammunition that Anniston Chemical Activity stores .


fn_spacy_tokens_for_baseline: Stores do not open until 10 am or later , but shopping goes on into the evening , up to 9:30 pm .

source_bert_toks: stores do not open until 10 am or later , but shopping goes on into the evening , up to 9 : 30 pm .

reference_raw: The shops will not be opened until 10 in the morning or later, but the shopping will continue until 9:30 in the evening.

reference_spacy_tokens: The shops will not be opened until 10 in the morning or later , but the shopping will continue until 9:30 in the evening .


fn_spacy_tokens_for_baseline: On Wednesday mornings , the City streets would be strewn with manure , quickly gathered by keen gardeners armed with buckets and shovels .

source_bert_toks: on wednesday mornings , the city streets would be strewn with man ##ure , quickly gathered by keen gardener ##s armed with bucket ##s and shovel ##s .

reference_raw: On Wednesday mornings, the streets of the city would be littered with manure, quickly gathered by sharp gardeners armed with buckets and shovels.

reference_spacy_tokens: On Wednesday mornings , the streets of the city would be littered with manure , quickly gathered by sharp gardeners armed with buckets and shovels .


fn_spacy_tokens_for_baseline: There are no better instruments than discharged servants with a grievance , and I was lucky enough to find one .

source_bert_toks: there are no better instruments than discharged servants with a gr ##ie ##vance , and i was lucky enough to find one .

reference_raw: There's no better tools than dismissing servants with complaints, and I've been lucky enough to find one.

reference_spacy_tokens: There 's no better tools than dismissing servants with complaints , and I 've been lucky enough to find one .


fn_spacy_tokens_for_baseline: Unlocking the door , he walked through the darkened workroom and slowly .

source_bert_toks: unlock ##ing the door , he walked through the darkened work ##room and slowly .

reference_raw: He unlocked the door and walked slowly through the darkened office.

reference_spacy_tokens: He unlocked the door and walked slowly through the darkened office .


fn_spacy_tokens_for_baseline: A weather - stained postcard pinned beneath the bell announced that it was not working , so Maltravers used the knocker .

source_bert_toks: a weather - stained post ##card pinned beneath the bell announced that it was not working , so mal ##tra ##vers used the knock ##er .

reference_raw: A weather-stained postcard stuck under the bell said it didn't work, so Maltravers used a knocker.

reference_spacy_tokens: A weather - stained postcard stuck under the bell said it did n't work , so Maltravers used a knocker .


fn_spacy_tokens_for_baseline: A 1970 presidential decree banning the movement was apparently prompted by the mass abstention by Jehovah 's Witnesses from voting in a presidential election .

source_bert_toks: a 1970 presidential decree banning the movement was apparently prompted by the mass abs ##ten ##tion by je ##ho ##vah ' s witnesses from voting in a presidential election .

reference_raw: The 1970 presidential decree banning the movement was apparently prompted by the mass abstinence of Jehovah's Witnesses from voting in the presidential election.

reference_spacy_tokens: The 1970 presidential decree banning the movement was apparently prompted by the mass abstinence of Jehovah 's Witnesses from voting in the presidential election .


fn_spacy_tokens_for_baseline: ' I know some are n't well off , but a hundred years ago they starved on the streets . '

source_bert_toks: ' i know some aren ' t well off , but a hundred years ago they starved on the streets . '

reference_raw: "I know some of them aren't well, but they were hungry in the streets a hundred years ago."

reference_spacy_tokens: " I know some of them are n't well , but they were hungry in the streets a hundred years ago . "


fn_spacy_tokens_for_baseline: In June he replaced an enlightened Minister of Education with an admiral who had conducted the Russian mission to Japan during the Crimean War and was identified in the public mind with oriental despotism .

source_bert_toks: in june he replaced an en ##light ##ened minister of education with an admiral who had conducted the russian mission to japan during the crimean war and was identified in the public mind with oriental des ##pot ##ism .

reference_raw: In June, he replaced the illuminated Minister of Education with an admiral who had carried out a Russian mission to Japan during the Crimean War and was identified by Oriental despotism in the public mind.

reference_spacy_tokens: In June , he replaced the illuminated Minister of Education with an admiral who had carried out a Russian mission to Japan during the Crimean War and was identified by Oriental despotism in the public mind .


fn_spacy_tokens_for_baseline: Far above in the belfry , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

source_bert_toks: far above in the bel ##fr ##y , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

reference_raw: Far above in the bells, huge bronze bells, mounted on bicycles, swing madly at 360 degrees, starting and ending, surprisingly, in an upturned or mouth-up position.

reference_spacy_tokens: Far above in the bells , huge bronze bells , mounted on bicycles , swing madly at 360 degrees , starting and ending , surprisingly , in an upturned or mouth - up position .


fn_spacy_tokens_for_baseline: Surprises spring up on all sides : new industrial complexes alongside sleepy farming villages , skyscraper towns blooming in the middle of nowhere , Hakka women in their traditional flat straw hats with hanging black curtains , water buffalo , and flashes of azalea everywhere .

source_bert_toks: surprises spring up on all sides : new industrial complexes alongside sleepy farming villages , skyscraper towns bloom ##ing in the middle of nowhere , ha ##kka women in their traditional flat straw hats with hanging black curtains , water buffalo , and flashes of az ##ale ##a everywhere .

reference_raw: There are surprises on all sides: new industrial complexes along with sleepy agricultural villages, skyscraper cities blooming in the middle of nowhere, Hakka women in traditional flat straw hats with black curtains, water buffalo, and azalea flickers.

reference_spacy_tokens: There are surprises on all sides : new industrial complexes along with sleepy agricultural villages , skyscraper cities blooming in the middle of nowhere , Hakka women in traditional flat straw hats with black curtains , water buffalo , and azalea flickers .


fn_spacy_tokens_for_baseline: With a promising new job at a plastic injection molding manufacturer , his legal troubles in check and a safe place to live , Jerry can get on with the business of building a life for himself and contributing to his community .

source_bert_toks: with a promising new job at a plastic injection mold ##ing manufacturer , his legal troubles in check and a safe place to live , jerry can get on with the business of building a life for himself and contributing to his community .

reference_raw: With an upcoming new job at a plastic injection molder, legal problems in control, and a safe place to live, Jerry can continue to build his own life and contribute to his community.

reference_spacy_tokens: With an upcoming new job at a plastic injection molder , legal problems in control , and a safe place to live , Jerry can continue to build his own life and contribute to his community .


fn_spacy_tokens_for_baseline: She made the shallow end and stood up , plastering her hair back with her hands .

source_bert_toks: she made the shallow end and stood up , plaster ##ing her hair back with her hands .

reference_raw: She reached the shallow end and got to her feet and put her hands back on her hair.

reference_spacy_tokens: She reached the shallow end and got to her feet and put her hands back on her hair .


fn_spacy_tokens_for_baseline: For a short time , at least 100 hikers were trapped in the mountains and a boy scout camp was also threatened by the blaze .

source_bert_toks: for a short time , at least 100 hike ##rs were trapped in the mountains and a boy scout camp was also threatened by the blaze .

reference_raw: At least a hundred tourists had been trapped in the mountains for a short time, and the fire had also threatened the boy scout camp.

reference_spacy_tokens: At least a hundred tourists had been trapped in the mountains for a short time , and the fire had also threatened the boy scout camp .


fn_spacy_tokens_for_baseline: " Waffenruhe " translates as truce , armistice , an uneasy , provisional peace .

source_bert_toks: " wa ##ffen ##ru ##he " translates as truce , armistice , an uneasy , provisional peace .

reference_raw: "Waffenruhe" is a truce, a truce, a restless, temporary peace.

reference_spacy_tokens: " Waffenruhe " is a truce , a truce , a restless , temporary peace .


fn_spacy_tokens_for_baseline: The last visitor was then- U.S. Rep. Bill Richardson of New Mexico , who went to help a pair of U.S. oilmen in diplomatic trouble .

source_bert_toks: the last visitor was then - u . s . rep . bill richardson of new mexico , who went to help a pair of u . s . oil ##men in diplomatic trouble .

reference_raw: The last guest was U.S. Deputy Bill Richardson of New Mexico, who went to help two American oilmen with diplomatic problems.

reference_spacy_tokens: The last guest was U.S. Deputy Bill Richardson of New Mexico , who went to help two American oilmen with diplomatic problems .


fn_spacy_tokens_for_baseline: But because of the opaque nature of the security forces and the jails they run , it is difficult to determine whether that is true .

source_bert_toks: but because of the opaque nature of the security forces and the jail ##s they run , it is difficult to determine whether that is true .

reference_raw: But due to the opacity of the security forces and the prisons they run, it's hard to tell if that's true.

reference_spacy_tokens: But due to the opacity of the security forces and the prisons they run , it 's hard to tell if that 's true .


fn_spacy_tokens_for_baseline: Consider spraying your carpets with stain - retardant which coats the fibres and makes them more resistant to dirt and spills .

source_bert_toks: consider spraying your carpets with stain - re ##tar ##dant which coats the fibre ##s and makes them more resistant to dirt and spill ##s .

reference_raw: Consider sprinkling the carpets with a stained retardant that coats the fibres and makes them more resistant to dirt and spills.

reference_spacy_tokens: Consider sprinkling the carpets with a stained retardant that coats the fibres and makes them more resistant to dirt and spills .


fn_spacy_tokens_for_baseline: The Masai are pretty tolerant in these matters in my experience .

source_bert_toks: the mas ##ai are pretty tolerant in these matters in my experience .

reference_raw: In my experience, the Masai are quite tolerable in these matters.

reference_spacy_tokens: In my experience , the Masai are quite tolerable in these matters .


fn_spacy_tokens_for_baseline: Springing from behind fat fluted columns , they seized two skaters and snapped their necks .

source_bert_toks: spring ##ing from behind fat flute ##d columns , they seized two skaters and snapped their necks .

reference_raw: They jumped out from behind the thick, fluttered pillars, grabbed two skaters and broke their necks.

reference_spacy_tokens: They jumped out from behind the thick , fluttered pillars , grabbed two skaters and broke their necks .


fn_spacy_tokens_for_baseline: The remains of her whiteface make - up came off with the clotted badges of blood .

source_bert_toks: the remains of her white ##face make - up came off with the cl ##otted badges of blood .

reference_raw: The remains of her white-faced makeup came out with clotted blood badges.

reference_spacy_tokens: The remains of her white - faced makeup came out with clotted blood badges .


fn_spacy_tokens_for_baseline: Thinking it possible that London 's streets would contain martyrs cudgelled to death , he wondered if that might be no bad thing .

source_bert_toks: thinking it possible that london ' s streets would contain martyrs cu ##dge ##lled to death , he wondered if that might be no bad thing .

reference_raw: He thought it possible that the streets of London might contain martyrs stuck to death, and wondered if it wasn't a bad thing.

reference_spacy_tokens: He thought it possible that the streets of London might contain martyrs stuck to death , and wondered if it was n't a bad thing .


fn_spacy_tokens_for_baseline: Yet in Salon this week is a column by Joe Conason , one of those reporters frequently accused of fronting for Clinton by folks on the right .

source_bert_toks: yet in salon this week is a column by joe con ##as ##on , one of those reporters frequently accused of front ##ing for clinton by folks on the right .

reference_raw: But there's a Joe Conason column in the salon this week, one of the reporters often accuses people on the right of facing Clinton.

reference_spacy_tokens: But there 's a Joe Conason column in the salon this week , one of the reporters often accuses people on the right of facing Clinton .


fn_spacy_tokens_for_baseline: -- Students should move up the educational ladder as their academic potential allows .

source_bert_toks: - - students should move up the educational ladder as their academic potential allows .

reference_raw: - Students should move up the educational ladder to the extent that their academic potential allows.

reference_spacy_tokens: - Students should move up the educational ladder to the extent that their academic potential allows .


fn_spacy_tokens_for_baseline: Surely the person against whom the criminal enterprise was directed .

source_bert_toks: surely the person against whom the criminal enterprise was directed .

reference_raw: I'm sure it's the person against whom the criminal enterprise was directed.

reference_spacy_tokens: I 'm sure it 's the person against whom the criminal enterprise was directed .


fn_spacy_tokens_for_baseline: Iran 's entanglement with CW stems from the legacy of the Iran - Iraq War .

source_bert_toks: iran ' s en ##tangle ##ment with cw stems from the legacy of the iran - iraq war .

reference_raw: The involvement of Iran in the CW stems from the legacy of the Iran-Iraq War.

reference_spacy_tokens: The involvement of Iran in the CW stems from the legacy of the Iran - Iraq War .


fn_spacy_tokens_for_baseline: As keyboard player for the prolific Joey Negro , Andrew ' Dog ' Livingstone often finds himself woken up by the radio alarm clock blasting out his latest piano riff .

source_bert_toks: as keyboard player for the prolific joey negro , andrew ' dog ' livingstone often finds himself woken up by the radio alarm clock blasting out his latest piano riff .

reference_raw: As a keyboard player for the prosperous Joey Negro, Andrew 'Dog' Livingstone often wakes up when the radio alarm clock blows out his latest piano riff.

reference_spacy_tokens: As a keyboard player for the prosperous Joey Negro , Andrew ' Dog ' Livingstone often wakes up when the radio alarm clock blows out his latest piano riff .


fn_spacy_tokens_for_baseline: As Shiona paused to wave back , Jake 's window buzzed open and suddenly he was leaning out slightly towards her .

source_bert_toks: as shi ##ona paused to wave back , jake ' s window buzzed open and suddenly he was leaning out slightly towards her .

reference_raw: When Shiona stopped to wave back, Jake's window blew open, and suddenly he leaned slightly toward her.

reference_spacy_tokens: When Shiona stopped to wave back , Jake 's window blew open , and suddenly he leaned slightly toward her .


fn_spacy_tokens_for_baseline: Just the car to have on an island full of lots of narrow , high - hedged twisty roads and a 60-miles - per - hour speed limit .

source_bert_toks: just the car to have on an island full of lots of narrow , high - hedge ##d twist ##y roads and a 60 - miles - per - hour speed limit .

reference_raw: Just a car on an island full of narrow, curved roads and a speed limit of 60 miles an hour.

reference_spacy_tokens: Just a car on an island full of narrow , curved roads and a speed limit of 60 miles an hour .


fn_spacy_tokens_for_baseline: Fellahin bending over their sickles cut swathes through fields of wheat .

source_bert_toks: fell ##ah ##in bending over their sick ##les cut swat ##hes through fields of wheat .

reference_raw: Fellahin bends over their sickles, slashing through the fields of wheat.

reference_spacy_tokens: Fellahin bends over their sickles , slashing through the fields of wheat .


fn_spacy_tokens_for_baseline: SHOT AT during an armed hold - up , THREATENED by a violent drug gang and BEATEN UP at a party in posh Beverly Hills .

source_bert_toks: shot at during an armed hold - up , threatened by a violent drug gang and beaten up at a party in po ##sh beverly hills .

reference_raw: SHOT AT during an armed robbery, THREATENED by a violent drug gang and BEATEN UP at a party in fancy Beverly Hills.

reference_spacy_tokens: SHOT AT during an armed robbery , THREATENED by a violent drug gang and BEATEN UP at a party in fancy Beverly Hills .


fn_spacy_tokens_for_baseline: Dublin theater is legendary , and no visitor should miss seeing a performance at the Abbey Theatre or Gate Theatre .

source_bert_toks: dublin theater is legendary , and no visitor should miss seeing a performance at the abbey theatre or gate theatre .

reference_raw: The Dublin Theater is legendary, and no visitor should miss a show at the Abbey Theatre or the Gate Theatre.

reference_spacy_tokens: The Dublin Theater is legendary , and no visitor should miss a show at the Abbey Theatre or the Gate Theatre .


fn_spacy_tokens_for_baseline: In the latest quarter , Aetna had a $ 23 million loss on its auto / homeowners line , compared with earnings of $ 33 million last year .

source_bert_toks: in the latest quarter , ae ##t ##na had a $ 23 million loss on its auto / home ##own ##ers line , compared with earnings of $ 33 million last year .

reference_raw: In the last quarter, Aetna had a $23 million loss on its auto/homeowner line, compared to a $33 million profit last year.

reference_spacy_tokens: In the last quarter , Aetna had a $ 23 million loss on its auto / homeowner line , compared to a $ 33 million profit last year .


fn_spacy_tokens_for_baseline: Standing at the depot at Main and Fremont streets , railroad officials auctioned 1200 lots they had subdivided from forty square blocks of desert scrub .

source_bert_toks: standing at the depot at main and fremont streets , railroad officials auction ##ed 1200 lots they had subdivided from forty square blocks of desert scrub .

reference_raw: Standing in a warehouse on the streets of Main and Fremont, railroad officials auctioned 1,200 lots they had divided from forty square blocks of desert shrubbery.

reference_spacy_tokens: Standing in a warehouse on the streets of Main and Fremont , railroad officials auctioned 1,200 lots they had divided from forty square blocks of desert shrubbery .


fn_spacy_tokens_for_baseline: In their December , 1995 review of the nation 's best charities , U.S. News and World Report called Goodwill one of the five " Standout Good Guys . "

source_bert_toks: in their december , 1995 review of the nation ' s best charities , u . s . news and world report called goodwill one of the five " stand ##out good guys . "

reference_raw: During their December 1995 review of the nation's finest charities, the American News and World Report called Goodwill one of the five "Standout Good Men."

reference_spacy_tokens: During their December 1995 review of the nation 's finest charities , the American News and World Report called Goodwill one of the five " Standout Good Men . "


fn_spacy_tokens_for_baseline: Whether the holiday is a gathering of opera buffs in Glyndebourne or a trek of vampire fans to Transylvanian castles , it is great fun because everyone has the same interest at heart .

source_bert_toks: whether the holiday is a gathering of opera buff ##s in g ##lyn ##de ##bourne or a trek of vampire fans to transylvania ##n castles , it is great fun because everyone has the same interest at heart .

reference_raw: Whether it's a Glyndebourne Opera Cup or a trip of vampire fans to Transylvanian Castles, it's a lot of fun, because everybody's got the same interest at heart.

reference_spacy_tokens: Whether it 's a Glyndebourne Opera Cup or a trip of vampire fans to Transylvanian Castles , it 's a lot of fun , because everybody 's got the same interest at heart .


fn_spacy_tokens_for_baseline: He admitted escaping from prison along with three charges of armed robbery and one of attempted robbery .

source_bert_toks: he admitted escaping from prison along with three charges of armed robbery and one of attempted robbery .

reference_raw: He confessed to getting out of prison, along with three counts of armed theft and one attempted burglary.

reference_spacy_tokens: He confessed to getting out of prison , along with three counts of armed theft and one attempted burglary .


fn_spacy_tokens_for_baseline: An outstretched fist could eclipse the sun that burned them by day .

source_bert_toks: an outstretched fist could eclipse the sun that burned them by day .

reference_raw: An outstretched fist could obscure the sun that burned them in the daytime.

reference_spacy_tokens: An outstretched fist could obscure the sun that burned them in the daytime .


fn_spacy_tokens_for_baseline: TOP model Claudia Schiffer has slammed gossip alleging she posed for a series of kinky snaps .

source_bert_toks: top model claudia sc ##hiff ##er has slammed gossip alleging she posed for a series of kin ##ky snaps .

reference_raw: TOP model Claudia Schiffer hit the rumors that she was posing for a series of kinky snaps.

reference_spacy_tokens: TOP model Claudia Schiffer hit the rumors that she was posing for a series of kinky snaps .


fn_spacy_tokens_for_baseline: A hot bath , sex , a warm drink and alcohol also figured prominently as aids to somnolence .

source_bert_toks: a hot bath , sex , a warm drink and alcohol also figured prominently as aids to so ##m ##no ##lence .

reference_raw: Hot baths, sex, hot drinks, and alcohol also made it clear that they were helping to sleep.

reference_spacy_tokens: Hot baths , sex , hot drinks , and alcohol also made it clear that they were helping to sleep .


fn_spacy_tokens_for_baseline: They protested that the teacher 's disgusting and abominable information had undermined the sacredness of the home and the mothers ' authority .

source_bert_toks: they protested that the teacher ' s disgusting and ab ##omi ##nable information had undermine ##d the sacred ##ness of the home and the mothers ' authority .

reference_raw: They protested that the teacher's repulsive and repulsive information undermined the sanctity of the house and the authority of the mothers.

reference_spacy_tokens: They protested that the teacher 's repulsive and repulsive information undermined the sanctity of the house and the authority of the mothers .


fn_spacy_tokens_for_baseline: He looked at her with detestation , and so did April .

source_bert_toks: he looked at her with det ##est ##ation , and so did april .

reference_raw: He looked at her with disgust, and so did April.

reference_spacy_tokens: He looked at her with disgust , and so did April .


fn_spacy_tokens_for_baseline: Recent business projections for Las Vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

source_bert_toks: recent business projections for las vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

reference_raw: The latest business forecasts for Las Vegas foresee challenges; tourism incomes need to increase significantly in order to maintain what has already been built, while actual data show that visitation is stable or declining.

reference_spacy_tokens: The latest business forecasts for Las Vegas foresee challenges ; tourism incomes need to increase significantly in order to maintain what has already been built , while actual data show that visitation is stable or declining .


fn_spacy_tokens_for_baseline: Do not confuse yourself .

source_bert_toks: do not confuse yourself .

reference_raw: Don't fool yourself.

reference_spacy_tokens: Do n't fool yourself .


fn_spacy_tokens_for_baseline: ' Dunne dreams ' became common colloquial usage for dreams foreshadowing future experiences .

source_bert_toks: ' dunne dreams ' became common col ##lo ##qui ##al usage for dreams fore ##sha ##do ##wing future experiences .

reference_raw: "Dunne Dreams" has become a common colloquial use of dreams that predict future experiences.

reference_spacy_tokens: " Dunne Dreams " has become a common colloquial use of dreams that predict future experiences .


fn_spacy_tokens_for_baseline: ' Bernard 's a widower in his early fifties and he 's a rector , not a monk .

source_bert_toks: ' bernard ' s a widow ##er in his early fifties and he ' s a rector , not a monk .

reference_raw: Bernard is a widowed man in his fifties, and he is a rector, not a monk.

reference_spacy_tokens: Bernard is a widowed man in his fifties , and he is a rector , not a monk .


fn_spacy_tokens_for_baseline: At first , we were unfazed .

source_bert_toks: at first , we were un ##fa ##zed .

reference_raw: We weren't impressed at first.

reference_spacy_tokens: We were n't impressed at first .


fn_spacy_tokens_for_baseline: Under the old law of larceny he may not have been guilty of attempted larceny .

source_bert_toks: under the old law of la ##rce ##ny he may not have been guilty of attempted la ##rce ##ny .

reference_raw: Under the old law of theft, he may not be guilty of attempted robbery.

reference_spacy_tokens: Under the old law of theft , he may not be guilty of attempted robbery .


fn_spacy_tokens_for_baseline: The decision had already been made just a few minutes after Mattie had left his office and seconds after he had managed to reach the newspaper 's owner on the phone .

source_bert_toks: the decision had already been made just a few minutes after matt ##ie had left his office and seconds after he had managed to reach the newspaper ' s owner on the phone .

reference_raw: The decision had been made only minutes after Mattie had left the office and seconds after he had made the phone call to the owner of the newspaper.

reference_spacy_tokens: The decision had been made only minutes after Mattie had left the office and seconds after he had made the phone call to the owner of the newspaper .


fn_spacy_tokens_for_baseline: The car was surrounded by a circle of robed figures : we seemed to be in the middle of some whirling ballet .

source_bert_toks: the car was surrounded by a circle of robe ##d figures : we seemed to be in the middle of some w ##hir ##ling ballet .

reference_raw: The car was surrounded by a circle of cloaked figures: we seemed to be in the middle of a whirling ballet.

reference_spacy_tokens: The car was surrounded by a circle of cloaked figures : we seemed to be in the middle of a whirling ballet .


fn_spacy_tokens_for_baseline: A conglomerate of disparate races and ridden with bureaucracy , Austria - Hungary , since the time of Napoleon , had , in the main , a history of military ineptitude .

source_bert_toks: a conglomerate of di ##spar ##ate races and ridden with bureaucracy , austria - hungary , since the time of napoleon , had , in the main , a history of military in ##ept ##itude .

reference_raw: Since Napoleon's time, the conglomerate of different races and ridden with bureaucracy, Austria-Hungary, had a history of military incompetence.

reference_spacy_tokens: Since Napoleon 's time , the conglomerate of different races and ridden with bureaucracy , Austria - Hungary , had a history of military incompetence .


fn_spacy_tokens_for_baseline: Two years ago , the Rev. Jeremy Hummerstone , vicar of Great Torrington , Devon , got so fed up with ringers who did n't attend service he sacked the entire band ; the ringers promptly set up a picket line in protest .

source_bert_toks: two years ago , the rev . jeremy hum ##mers ##tone , vicar of great tor ##rington , devon , got so fed up with ring ##ers who didn ' t attend service he sacked the entire band ; the ring ##ers promptly set up a picket line in protest .

reference_raw: Two years ago, Reverend Jeremy Hummerstone, the vicar of Great Torrington, Devon, was so tired of the ringers who did not attend the service that he sacked the band; the ringers immediately set up a patrol line to protest.

reference_spacy_tokens: Two years ago , Reverend Jeremy Hummerstone , the vicar of Great Torrington , Devon , was so tired of the ringers who did not attend the service that he sacked the band ; the ringers immediately set up a patrol line to protest .


fn_spacy_tokens_for_baseline: QN : Are there any continuing impediments to progress in the negotiations between Israel and the Palestinian authority ?

source_bert_toks: q ##n : are there any continuing imp ##ed ##ime ##nts to progress in the negotiations between israel and the palestinian authority ?

reference_raw: QN: Are there still obstacles to the progress of negotiations between Israel and the Palestinian Authority?

reference_spacy_tokens: QN : Are there still obstacles to the progress of negotiations between Israel and the Palestinian Authority ?


fn_spacy_tokens_for_baseline: In outrage , the Jews began a second revolt against Rome , led by Simon bar Kochba .

source_bert_toks: in outrage , the jews began a second revolt against rome , led by simon bar koch ##ba .

reference_raw: In outrage, the Jews began a second rebellion against Rome, led by Simon Bar Kochba.

reference_spacy_tokens: In outrage , the Jews began a second rebellion against Rome , led by Simon Bar Kochba .


fn_spacy_tokens_for_baseline: Morrissey could n't understand why people ( men in particular ) were terribly afraid of emotionalism .

source_bert_toks: morris ##sey couldn ' t understand why people ( men in particular ) were terribly afraid of emotional ##ism .

reference_raw: Morrissey could not understand why people (especially men) feared emotionalism.

reference_spacy_tokens: Morrissey could not understand why people ( especially men ) feared emotionalism .


fn_spacy_tokens_for_baseline: Face red , chest puffed with indignation , young John would yelp : ' I assure you quite categorically that I never touched the ball .

source_bert_toks: face red , chest puff ##ed with ind ##ign ##ation , young john would ye ##lp : ' i assure you quite cat ##egorical ##ly that i never touched the ball .

reference_raw: Face red, chest swollen with outrage, young John cried, "I assure you quite categorically I didn't touch the ball.

reference_spacy_tokens: Face red , chest swollen with outrage , young John cried , " I assure you quite categorically I did n't touch the ball .


fn_spacy_tokens_for_baseline: On the other hand , Libya has declined to join the Chemical Weapons Convention , which was opened for signature in January 1993 and entered into force on April 29 , 1997 QN : Has Libya ratified the Chemical Weapons Convention ?

source_bert_toks: on the other hand , libya has declined to join the chemical weapons convention , which was opened for signature in january 1993 and entered into force on april 29 , 1997 q ##n : has libya ratified the chemical weapons convention ?

reference_raw: On the other hand, Libya refused to accede to the Chemical Weapons Convention, which was opened for signature in January 1993 and came into effect on April 29, 1997 QN: Has Libya ratified the Chemical Weapons Convention?

reference_spacy_tokens: On the other hand , Libya refused to accede to the Chemical Weapons Convention , which was opened for signature in January 1993 and came into effect on April 29 , 1997 QN : Has Libya ratified the Chemical Weapons Convention ?


fn_spacy_tokens_for_baseline: Many Koreans were affronted at the liberation of August 1945 being followed by the continued presence of Japanese and of the odious methods they had employed to suppress dissent .

source_bert_toks: many koreans were af ##front ##ed at the liberation of august 1945 being followed by the continued presence of japanese and of the odi ##ous methods they had employed to suppress dissent .

reference_raw: Many Koreans were offended that the liberation of August 1945 was followed by the continued presence of Japan and the odious methods used to suppress dissent.

reference_spacy_tokens: Many Koreans were offended that the liberation of August 1945 was followed by the continued presence of Japan and the odious methods used to suppress dissent .


fn_spacy_tokens_for_baseline: " Right now , we 're lucky if after five years we keep one new ringer out of 10 , " he adds .

source_bert_toks: " right now , we ' re lucky if after five years we keep one new ring ##er out of 10 , " he adds .

reference_raw: "We're lucky to have one new ringer in ten after five years," he says.

reference_spacy_tokens: " We 're lucky to have one new ringer in ten after five years , " he says .


fn_spacy_tokens_for_baseline: This wistful elegy to the post - Bomb small - town America , The Last Picture Show was probably the first film that pined nostalgically for a generation 's lost innocence , soundtracking Hank Williams ' lonesome holler to great effect .

source_bert_toks: this wi ##st ##ful el ##eg ##y to the post - bomb small - town america , the last picture show was probably the first film that pine ##d nos ##tal ##gical ##ly for a generation ' s lost innocence , soundtrack ##ing hank williams ' lone ##some ho ##ller to great effect .

reference_raw: This wistful elegance of the post-Bomb small-town America, The Last Picture Show was probably the first film to pinpoint the lost innocence of a generation, and soundtrack Hank Williams's lonely holler to great effect.

reference_spacy_tokens: This wistful elegance of the post - Bomb small - town America , The Last Picture Show was probably the first film to pinpoint the lost innocence of a generation , and soundtrack Hank Williams 's lonely holler to great effect .


fn_spacy_tokens_for_baseline: NEW YORK ( AP ) --- Actress Elizabeth Taylor popped pills like candy to cope with a marathon of affairs and marriages , according to a new unauthorized biography .

source_bert_toks: new york ( ap ) - - - actress elizabeth taylor popped pills like candy to cope with a marathon of affairs and marriages , according to a new unauthorized biography .

reference_raw: New York (AP) - Actress Elizabeth Taylor took pills like sweets to deal with a marathon of affairs and marriage, according to a new unauthorized biography.

reference_spacy_tokens: New York ( AP ) - Actress Elizabeth Taylor took pills like sweets to deal with a marathon of affairs and marriage , according to a new unauthorized biography .


fn_spacy_tokens_for_baseline: Pottery finds can be interpreted to support either the imposition of an elite culture from Turkmenia or a late development of the Indus civilization .

source_bert_toks: pottery finds can be interpreted to support either the imp ##osition of an elite culture from turk ##men ##ia or a late development of the indus civilization .

reference_raw: The Pottery findings can be interpreted as supporting either the introduction of an elite culture from Turkmenia or the late evolution of the Indus civilization.

reference_spacy_tokens: The Pottery findings can be interpreted as supporting either the introduction of an elite culture from Turkmenia or the late evolution of the Indus civilization .


fn_spacy_tokens_for_baseline: In 1969 , he achieved his lifelong ambition of a daily Trotskyist newspaper , The Workers Press , and transformed his group into the Workers Revolutionary Party .

source_bert_toks: in 1969 , he achieved his lifelong ambition of a daily tr ##ots ##ky ##ist newspaper , the workers press , and transformed his group into the workers revolutionary party .

reference_raw: In 1969, he reached the lifelong aspirations of the day-to-day Trotskyist newspaper, the Workers Press, and turned his group into the Workers Revolutionary Party.

reference_spacy_tokens: In 1969 , he reached the lifelong aspirations of the day - to - day Trotskyist newspaper , the Workers Press , and turned his group into the Workers Revolutionary Party .


fn_spacy_tokens_for_baseline: There were also repeated statements from Iranian diplomats that they would help on the hostage issue as things improved .

source_bert_toks: there were also repeated statements from iranian diplomats that they would help on the hostage issue as things improved .

reference_raw: Iran's diplomats have also repeatedly said that they will help with the hostage situation as the situation improves.

reference_spacy_tokens: Iran 's diplomats have also repeatedly said that they will help with the hostage situation as the situation improves .


fn_spacy_tokens_for_baseline: But the old Monique remains forever unclad , sprawled on a tiled floor , in the Matisse painting , Pink Nude .

source_bert_toks: but the old monique remains forever un ##cl ##ad , sprawled on a tiled floor , in the mat ##isse painting , pink nude .

reference_raw: But the old Monique remains undressed forever, sprawled on the tiled floor of the Matisse painting, Pink Nude.

reference_spacy_tokens: But the old Monique remains undressed forever , sprawled on the tiled floor of the Matisse painting , Pink Nude .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multinational companies and investments in the European Union mean that they have a lot of opportunities at home.

reference_spacy_tokens: And young graduates do n't leave now - multinational companies and investments in the European Union mean that they have a lot of opportunities at home .


fn_spacy_tokens_for_baseline: His position will be incomparably less grand than that of the last Viceroy of India , and his achievement is almost certain to be less satisfactory .

source_bert_toks: his position will be inc ##omp ##ara ##bly less grand than that of the last viceroy of india , and his achievement is almost certain to be less satisfactory .

reference_raw: His position will be incomparably less grand than that of the last Vice-Roy of India, and his success will almost certainly be less satisfying.

reference_spacy_tokens: His position will be incomparably less grand than that of the last Vice - Roy of India , and his success will almost certainly be less satisfying .


reference_raw: Two years ago, Reverend Jeremy Hummerstone, the vicar of Great Torrington, Devon, was so fed up with ringers who did not attend the service that he fired the whole group; the ringers immediately set up a patrol line to protest.

reference_spacy_tokens: Two years ago , Reverend Jeremy Hummerstone , the vicar of Great Torrington , Devon , was so fed up with ringers who did not attend the service that he fired the whole group ; the ringers immediately set up a patrol line to protest .


fn_spacy_tokens_for_baseline: The main highway makes a circuit of the New Territories , beginning with the new town of Tsuen Wan , situated in an area of heavy industry just west of Kowloon .

source_bert_toks: the main highway makes a circuit of the new territories , beginning with the new town of ts ##uen wan , situated in an area of heavy industry just west of ko ##wl ##oon .

reference_raw: The main road runs around the new territories, starting with the new city of Tsuen Wan, which is located in a large industrial area just west of Kowloon.

reference_spacy_tokens: The main road runs around the new territories , starting with the new city of Tsuen Wan , which is located in a large industrial area just west of Kowloon .


fn_spacy_tokens_for_baseline: Go through the underground walkway to Statue Square ; on the east side of the square is the Legislative Council Building , one of the few colonial buildings left in Hong Kong .

source_bert_toks: go through the underground walkway to statue square ; on the east side of the square is the legislative council building , one of the few colonial buildings left in hong kong .

reference_raw: On the east side of the square is the Legislative Council building, one of the few colonial buildings that remain in Hong Kong.

reference_spacy_tokens: On the east side of the square is the Legislative Council building , one of the few colonial buildings that remain in Hong Kong .


fn_spacy_tokens_for_baseline: It is as old as a hat pasted on a young man 's head in a mid - Victorian family album .

source_bert_toks: it is as old as a hat paste ##d on a young man ' s head in a mid - victorian family album .

reference_raw: It's the same age as a hat stuck on a young man's head in a mid-Victorian family album.

reference_spacy_tokens: It 's the same age as a hat stuck on a young man 's head in a mid - Victorian family album .


fn_spacy_tokens_for_baseline: The Great Hall of the school was hung with green drapery .

source_bert_toks: the great hall of the school was hung with green draper ##y .

reference_raw: The Great Hall of the School was draped with green curtains.

reference_spacy_tokens: The Great Hall of the School was draped with green curtains .


fn_spacy_tokens_for_baseline: Stirred up by this incident , nationalists took to the streets in several parts of Yerevan , setting up road blocks .

source_bert_toks: stirred up by this incident , nationalists took to the streets in several parts of yerevan , setting up road blocks .

reference_raw: In the wake of the incident, the nationalists took to the streets of several parts of Yerevan and set up roadblocks.

reference_spacy_tokens: In the wake of the incident , the nationalists took to the streets of several parts of Yerevan and set up roadblocks .


fn_spacy_tokens_for_baseline: Again , I do not have all of the information for July and August , so I can not give you any numbers .

source_bert_toks: again , i do not have all of the information for july and august , so i can not give you any numbers .

reference_raw: Once again, I don't have all the information for June and August, so I can't give you any numbers.

reference_spacy_tokens: Once again , I do n't have all the information for June and August , so I ca n't give you any numbers .


fn_spacy_tokens_for_baseline: Oh we we 've just sent out a six thousand mailer .

source_bert_toks: oh we we ' ve just sent out a six thousand mail ##er .

reference_raw: We just sent out 6,000 e-mails.

reference_spacy_tokens: We just sent out 6,000 e - mails .


fn_spacy_tokens_for_baseline: With a friendly mix of pleasant pop moments , this demo is outstanding to listen to .

source_bert_toks: with a friendly mix of pleasant pop moments , this demo is outstanding to listen to .

reference_raw: With a friendly mix of pleasant pop moments, this demo is excellent for listening to.

reference_spacy_tokens: With a friendly mix of pleasant pop moments , this demo is excellent for listening to .


fn_spacy_tokens_for_baseline: Apart from receiving numerous phone calls , the Girls learnt about the male New Yorker 's favourite pastime , the chase .

source_bert_toks: apart from receiving numerous phone calls , the girls learnt about the male new yorker ' s favourite past ##ime , the chase .

reference_raw: In addition to receiving a number of calls, the girls learned about a man's favorite pastime in New York, a chase.

reference_spacy_tokens: In addition to receiving a number of calls , the girls learned about a man 's favorite pastime in New York , a chase .


fn_spacy_tokens_for_baseline: BIRKENHEAD ST MARY 'S increased their lead at the head of the Bromborough Paints Merseyside Competition table but most excitement came at Ainsdale who tied with Rainhill .

source_bert_toks: bi ##rke ##nh ##ead st mary ' s increased their lead at the head of the bro ##mbo ##rou ##gh paints mer ##sey ##side competition table but most excitement came at ain ##sdale who tied with rain ##hill .

reference_raw: BIRKENHEAD ST MARY's lead at the head of the Bromborough Paints Merseyside competition table, but most of the excitement came from Ainsdale, which was bound to Rainhill.

reference_spacy_tokens: BIRKENHEAD ST MARY 's lead at the head of the Bromborough Paints Merseyside competition table , but most of the excitement came from Ainsdale , which was bound to Rainhill .


fn_spacy_tokens_for_baseline: The blast 's smoky remnants met with slivers of shrapnel propelled from a nearly simultaneous suicide bomb on the far end of the street .

source_bert_toks: the blast ' s smoky remnants met with sl ##iver ##s of sh ##ra ##p ##nel propelled from a nearly simultaneous suicide bomb on the far end of the street .

reference_raw: The smoked remains of the blast met with fragments of shrapnel propelled from a nearly parallel suicide bomb on the other side of the street.

reference_spacy_tokens: The smoked remains of the blast met with fragments of shrapnel propelled from a nearly parallel suicide bomb on the other side of the street .


fn_spacy_tokens_for_baseline: Still , the future of Las Vegas is sure to be determined as much by the pioneering spirit that built the city as by anything else .

source_bert_toks: still , the future of las vegas is sure to be determined as much by the pioneering spirit that built the city as by anything else .

reference_raw: But surely, the future of Las Vegas will be dictated by the pioneering spirit who built the city as much as anything else.

reference_spacy_tokens: But surely , the future of Las Vegas will be dictated by the pioneering spirit who built the city as much as anything else .


fn_spacy_tokens_for_baseline: The total number of publications , however , is not necessarily the best measure for assessing scientific productivity or technical advances ( May 1997 ) .

source_bert_toks: the total number of publications , however , is not necessarily the best measure for assessing scientific productivity or technical advances ( may 1997 ) .

reference_raw: However, the total number of publications is not necessarily the best measure for assessing scientific productivity or technological progress (May 1997).

reference_spacy_tokens: However , the total number of publications is not necessarily the best measure for assessing scientific productivity or technological progress ( May 1997 ) .


fn_spacy_tokens_for_baseline: Eliot was ' tall , gaunt , of pallid hue and tensely withdrawn from anything reminiscent of the flesh ' .

source_bert_toks: eliot was ' tall , gaunt , of pal ##lid hue and tense ##ly withdrawn from anything reminiscent of the flesh ' .

reference_raw: Eliot was tall, thin, pale, and tensely drawn from anything that reminded him of flesh.

reference_spacy_tokens: Eliot was tall , thin , pale , and tensely drawn from anything that reminded him of flesh .


fn_spacy_tokens_for_baseline: The study was only able to enroll non - sexual contacts for each category of controls .

source_bert_toks: the study was only able to enroll non - sexual contacts for each category of controls .

reference_raw: The study was able to enroll non-sexual contacts for each category of checks only.

reference_spacy_tokens: The study was able to enroll non - sexual contacts for each category of checks only .


fn_spacy_tokens_for_baseline: Unlike Henry , I have no intention of running my head into that particular noose .

source_bert_toks: unlike henry , i have no intention of running my head into that particular no ##ose .

reference_raw: Unlike Henry, I'm not going to put my head in this particular loop.

reference_spacy_tokens: Unlike Henry , I 'm not going to put my head in this particular loop .


fn_spacy_tokens_for_baseline: Some cuts involved not filling posts left vacant by teachers discouraged by the rock - bottom pay and difficult conditions .

source_bert_toks: some cuts involved not filling posts left vacant by teachers discouraged by the rock - bottom pay and difficult conditions .

reference_raw: Some of the cuts involved not filling jobs left vacant by teachers who were dissuaded by the salary of the rock bottom and difficult conditions.

reference_spacy_tokens: Some of the cuts involved not filling jobs left vacant by teachers who were dissuaded by the salary of the rock bottom and difficult conditions .


fn_spacy_tokens_for_baseline: Stephen looked round the shellhole at the exhausted faces of the Lancashire men .

source_bert_toks: stephen looked round the shell ##hole at the exhausted faces of the lancashire men .

reference_raw: Stephen glanced around the hole at the tired faces of the Lancashire men.

reference_spacy_tokens: Stephen glanced around the hole at the tired faces of the Lancashire men .


fn_spacy_tokens_for_baseline: He 'd made an unusual mistake in not locking the larder .

source_bert_toks: he ' d made an unusual mistake in not locking the la ##rder .

reference_raw: He made an unusual mistake when he didn't lock the pantry.

reference_spacy_tokens: He made an unusual mistake when he did n't lock the pantry .


fn_spacy_tokens_for_baseline: If one child in a family is maltreated , others in the same family are at high risk .

source_bert_toks: if one child in a family is mal ##tre ##ated , others in the same family are at high risk .

reference_raw: In the case of maltreatment of one child in the family, others in the same family are at high risk.

reference_spacy_tokens: In the case of maltreatment of one child in the family , others in the same family are at high risk .


fn_spacy_tokens_for_baseline: I still think of this when I rip up an old vest for a piece of silver - polishing rag .

source_bert_toks: i still think of this when i rip up an old vest for a piece of silver - polish ##ing rag .

reference_raw: I keep thinking about it when I tear up my old vest for a piece of silvery cloth.

reference_spacy_tokens: I keep thinking about it when I tear up my old vest for a piece of silvery cloth .


fn_spacy_tokens_for_baseline: Thunder , lightning and a torrential downpour provided an unreal prelude in the futuristic San Nicola stadium .

source_bert_toks: thunder , lightning and a torre ##ntial down ##pour provided an un ##real prelude in the futuristic san nicola stadium .

reference_raw: Thunder, lightning, and flooding were an unreal prelude to the futuristic San Nicola stadium.

reference_spacy_tokens: Thunder , lightning , and flooding were an unreal prelude to the futuristic San Nicola stadium .


fn_spacy_tokens_for_baseline: He sat alone , watching the lingerie girl wear her lingerie .

source_bert_toks: he sat alone , watching the linger ##ie girl wear her linger ##ie .

reference_raw: He sat by himself and watched the undergarment girl wear her underwear.

reference_spacy_tokens: He sat by himself and watched the undergarment girl wear her underwear .


fn_spacy_tokens_for_baseline: You 've dragged me along to all your trade shows and staff socials over the years .

source_bert_toks: you ' ve dragged me along to all your trade shows and staff social ##s over the years .

reference_raw: Over the years, you've taken me with you to all your business shows and staff clubs.

reference_spacy_tokens: Over the years , you 've taken me with you to all your business shows and staff clubs .


fn_spacy_tokens_for_baseline: ' But it is nothing to do with me , ' he squealed , turning to Mrs Patel for sympathy .

source_bert_toks: ' but it is nothing to do with me , ' he squealed , turning to mrs patel for sympathy .

reference_raw: 'But I don't have anything to do with it,' he said, turning to Mrs Patel for sympathy.

reference_spacy_tokens: ' But I do n't have anything to do with it , ' he said , turning to Mrs Patel for sympathy .


fn_spacy_tokens_for_baseline: Changing weather conditions also helped firefighting efforts , as temperature in the area fell to 90 degrees Fahrenheit , down from over a hundred degrees on Monday .

source_bert_toks: changing weather conditions also helped fire ##fighting efforts , as temperature in the area fell to 90 degrees fa ##hre ##nh ##eit , down from over a hundred degrees on monday .

reference_raw: The change in weather conditions also contributed to the fire-fighting effort, as the heat in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday.

reference_spacy_tokens: The change in weather conditions also contributed to the fire - fighting effort , as the heat in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday .


fn_spacy_tokens_for_baseline: He began to unbuckle his belt .

source_bert_toks: he began to un ##buck ##le his belt .

reference_raw: He started unfastening his belt.

reference_spacy_tokens: He started unfastening his belt .


fn_spacy_tokens_for_baseline: May I persuade you -- another morsel ?

source_bert_toks: may i persuade you - - another morse ##l ?

reference_raw: Can I convince you - another bite?

reference_spacy_tokens: Can I convince you - another bite ?


fn_spacy_tokens_for_baseline: This is a rather strange piece of behaviour , which gave rise in the l9th century to the belief that the female cuckoo swallowed her egg after laying it and then regurgitated it into the host 's nest .

source_bert_toks: this is a rather strange piece of behaviour , which gave rise in the l ##9th century to the belief that the female cuckoo swallowed her egg after laying it and then reg ##urg ##itated it into the host ' s nest .

reference_raw: It's a rather strange behavior that led to the belief in the 9th century that a female cuckoo swallowed an egg after laying it and then returned it to the host's nest.

reference_spacy_tokens: It 's a rather strange behavior that led to the belief in the 9th century that a female cuckoo swallowed an egg after laying it and then returned it to the host 's nest .


fn_spacy_tokens_for_baseline: TWO alert cops made a drug bust -- and seized cannabis plants growing at the POLICE STATION .

source_bert_toks: two alert cops made a drug bust - - and seized cannabis plants growing at the police station .

reference_raw: TWO warning cops broke down - and confiscated cannabis plants growing in POLICE STATION.

reference_spacy_tokens: TWO warning cops broke down - and confiscated cannabis plants growing in POLICE STATION .


fn_spacy_tokens_for_baseline: Gorbad bellowed in agony and swung Morgor wildly , catching Adolphus a glancing blow across the temple .

source_bert_toks: go ##rba ##d bellowed in agony and swung mor ##gor wildly , catching adolph ##us a glancing blow across the temple .

reference_raw: Gorbad screamed in agony and swung Morgor wildly, catching Adolphus with a glance across the temple.

reference_spacy_tokens: Gorbad screamed in agony and swung Morgor wildly , catching Adolphus with a glance across the temple .


fn_spacy_tokens_for_baseline: I understand that a local resident , a nurse , found a packet of dangerous drugs on the playing field near the children 's swings .

source_bert_toks: i understand that a local resident , a nurse , found a packet of dangerous drugs on the playing field near the children ' s swings .

reference_raw: I understand a local resident, a nurse, found a package of dangerous drugs on a playground near the children's swings.

reference_spacy_tokens: I understand a local resident , a nurse , found a package of dangerous drugs on a playground near the children 's swings .


fn_spacy_tokens_for_baseline: We are spending more than six million dollars a month with no end in sight .

source_bert_toks: we are spending more than six million dollars a month with no end in sight .

reference_raw: We spend over $6 million a month with no finals in sight.

reference_spacy_tokens: We spend over $ 6 million a month with no finals in sight .


fn_spacy_tokens_for_baseline: A sharper awareness among historians of the purpose of actions previously dismissed as desperate or revengeful has helped explain why groups of workers not infrequently combined intimidatory action with more ' legitimate ' forms .

source_bert_toks: a sharpe ##r awareness among historians of the purpose of actions previously dismissed as desperate or revenge ##ful has helped explain why groups of workers not in ##fr ##e ##quent ##ly combined int ##imi ##da ##tory action with more ' legitimate ' forms .

reference_raw: A sharper awareness among historians of the purpose of actions previously dismissed as desperate or vengeful helps explain why groups of workers do not often combine intimidatory action with more legitimate forms.

reference_spacy_tokens: A sharper awareness among historians of the purpose of actions previously dismissed as desperate or vengeful helps explain why groups of workers do not often combine intimidatory action with more legitimate forms .


fn_spacy_tokens_for_baseline: Net foreign investment through August this year has been running at a pace of $ 12.5 billion , about double the year - earlier rate .

source_bert_toks: net foreign investment through august this year has been running at a pace of $ 12 . 5 billion , about double the year - earlier rate .

reference_raw: By August, net foreign investment ran at a rate of $12.5 billion, about twice the year-early rate.

reference_spacy_tokens: By August , net foreign investment ran at a rate of $ 12.5 billion , about twice the year - early rate .


fn_spacy_tokens_for_baseline: Over the past six months , six journalists have been killed and 10 kidnapped by drug traffickers or leftist guerrillas -- who often are one and the same -- in Colombia .

source_bert_toks: over the past six months , six journalists have been killed and 10 kidnapped by drug traffic ##kers or leftist guerrillas - - who often are one and the same - - in colombia .

reference_raw: In the last six months, six journalists have been killed and ten have been abducted by drug dealers or leftist guerrillas - often the same - in Colombia.

reference_spacy_tokens: In the last six months , six journalists have been killed and ten have been abducted by drug dealers or leftist guerrillas - often the same - in Colombia .


fn_spacy_tokens_for_baseline: Maxine rushed to a pink file that lay on one of the opium beds , then stretched back against mauve and blue silk cushions as she skimmed through the newspaper clippings .

source_bert_toks: maxi ##ne rushed to a pink file that lay on one of the opium beds , then stretched back against ma ##uve and blue silk cushions as she skimmed through the newspaper clip ##ping ##s .

reference_raw: Maxine hurried to the pink folder lying on one of the opium beds, then leaned back against the mauve and blue silk pillows as she went through the newspaper clippings.

reference_spacy_tokens: Maxine hurried to the pink folder lying on one of the opium beds , then leaned back against the mauve and blue silk pillows as she went through the newspaper clippings .


fn_spacy_tokens_for_baseline: Hundreds of millions of birds around the world have been destroyed to try to contain the disease .

source_bert_toks: hundreds of millions of birds around the world have been destroyed to try to contain the disease .

reference_raw: Hundreds of millions of birds were killed all over the world trying to contain the disease.

reference_spacy_tokens: Hundreds of millions of birds were killed all over the world trying to contain the disease .


fn_spacy_tokens_for_baseline: In that time more than 1.2 million jobs have been created and the official jobless rate has been pushed below 17 % from 21 % .

source_bert_toks: in that time more than 1 . 2 million jobs have been created and the official job ##less rate has been pushed below 17 % from 21 % .

reference_raw: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17% from 21%.

reference_spacy_tokens: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17 % from 21 % .


fn_spacy_tokens_for_baseline: " The result is a generation of young people whose ignorance and intellectual incompetence is matched only by their good opinion of themselves .

source_bert_toks: " the result is a generation of young people whose ignorance and intellectual inc ##omp ##ete ##nce is matched only by their good opinion of themselves .

reference_raw: "The result is a generation of young people whose ignorance and intellectual incompetence are matched only by their good self-esteem.

reference_spacy_tokens: " The result is a generation of young people whose ignorance and intellectual incompetence are matched only by their good self - esteem .


fn_spacy_tokens_for_baseline: Traditional Irish music is also alive and well , especially in the pubs , and there has been a revival of storytelling , poetry reading , and traditional dancing .

source_bert_toks: traditional irish music is also alive and well , especially in the pubs , and there has been a revival of storytelling , poetry reading , and traditional dancing .

reference_raw: Traditional Irish music is also alive and well, especially in taverns, and stories, poetry readings, and traditional dances have been revived.

reference_spacy_tokens: Traditional Irish music is also alive and well , especially in taverns , and stories , poetry readings , and traditional dances have been revived .


fn_spacy_tokens_for_baseline: Many Greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the United States and Australia .

source_bert_toks: many greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the united states and australia .

reference_raw: Many Greek islanders have chosen to leave rather than live in poverty and horror, and many have created new homes in the United States and Australia.

reference_spacy_tokens: Many Greek islanders have chosen to leave rather than live in poverty and horror , and many have created new homes in the United States and Australia .


fn_spacy_tokens_for_baseline: Lucky Macau fit the specifications exactly .

source_bert_toks: lucky macau fit the specifications exactly .

reference_raw: Lucky Macau matched the specs exactly.

reference_spacy_tokens: Lucky Macau matched the specs exactly .


fn_spacy_tokens_for_baseline: ' He said the opposition was concerned that Kadafi 's forces might bomb or sabotage oil complexes in Port Brega and Ras Lanuf to keep them out of rebel hands .

source_bert_toks: ' he said the opposition was concerned that ka ##da ##fi ' s forces might bomb or sabotage oil complexes in port br ##ega and ras lan ##uf to keep them out of rebel hands .

reference_raw: 'He said that the opposition feared that Kadafi's forces might bomb or destroy the oil complexes in Port Brega and Ras Lanuf to protect them from the rebels.

reference_spacy_tokens: ' He said that the opposition feared that Kadafi 's forces might bomb or destroy the oil complexes in Port Brega and Ras Lanuf to protect them from the rebels .


fn_spacy_tokens_for_baseline: Let me show you the evolution of this case so far as I have been able to follow it .

source_bert_toks: let me show you the evolution of this case so far as i have been able to follow it .

reference_raw: I'll show you how this case evolves so far as I've been able to track it.

reference_spacy_tokens: I 'll show you how this case evolves so far as I 've been able to track it .


fn_spacy_tokens_for_baseline: Built 1847 - 1849 , this usually deserted Anglican foundation is Hong Kong 's oldest church .

source_bert_toks: built 1847 - 1849 , this usually deserted anglican foundation is hong kong ' s oldest church .

reference_raw: Built in 1847 - 1849, this typically abandoned Anglican base is the oldest church in Hong Kong.

reference_spacy_tokens: Built in 1847 - 1849 , this typically abandoned Anglican base is the oldest church in Hong Kong .


fn_spacy_tokens_for_baseline: I freaked out .

source_bert_toks: i freaked out .

reference_raw: I was scared.

reference_spacy_tokens: I was scared .


fn_spacy_tokens_for_baseline: Was she a shoplifter ?

source_bert_toks: was she a shop ##lift ##er ?

reference_raw: Was she a thief?

reference_spacy_tokens: Was she a thief ?


fn_spacy_tokens_for_baseline: The railroad needed a way station , and Las Vegas was the place .

source_bert_toks: the railroad needed a way station , and las vegas was the place .

reference_raw: The railway needed a road station, and it was Las Vegas.

reference_spacy_tokens: The railway needed a road station , and it was Las Vegas .


fn_spacy_tokens_for_baseline: Moreover , because of the inexorable force of gravity , in due course - over many billions of years - the entire galaxy must be consumed . if these ideas are correct .

source_bert_toks: moreover , because of the in ##ex ##ora ##ble force of gravity , in due course - over many billions of years - the entire galaxy must be consumed . if these ideas are correct .

reference_raw: Moreover, due to the inexorable force of gravity, the entire galaxy must be consumed in due course - for many millions of years - if these ideas are correct.

reference_spacy_tokens: Moreover , due to the inexorable force of gravity , the entire galaxy must be consumed in due course - for many millions of years - if these ideas are correct .


fn_spacy_tokens_for_baseline: It must be noted that Dr. Bruno Schiefer , the Canadian toxicologist approached by Iran , was doubtful that Iran would use the strains for illicit BW purposes .

source_bert_toks: it must be noted that dr . bruno sc ##hi ##efe ##r , the canadian toxic ##ologist approached by iran , was doubtful that iran would use the strains for illicit b ##w purposes .

reference_raw: It should be noted that Dr. Bruno Schiefer, a Canadian toxicologist approached by Iran, doubted that Iran would use the strains for illegal BW purposes.

reference_spacy_tokens: It should be noted that Dr. Bruno Schiefer , a Canadian toxicologist approached by Iran , doubted that Iran would use the strains for illegal BW purposes .


fn_spacy_tokens_for_baseline: Her cheeks were pink , and a couple of coils of copper hair had fallen from her hairdo , one on each side of her head .

source_bert_toks: her cheeks were pink , and a couple of coil ##s of copper hair had fallen from her hair ##do , one on each side of her head .

reference_raw: Her cheeks were pink, and two coils of copper hair fell out of her hair, one on each side of her head.

reference_spacy_tokens: Her cheeks were pink , and two coils of copper hair fell out of her hair , one on each side of her head .


fn_spacy_tokens_for_baseline: Hence , the greatest danger posed by Russia 's CW stockpile is that people living near the storage sites will be exposed to these agents .

source_bert_toks: hence , the greatest danger posed by russia ' s cw stock ##pile is that people living near the storage sites will be exposed to these agents .

reference_raw: The greatest danger posed by Russian stockpiles of CW is therefore that people living close to the warehouses will be exposed to these agents.

reference_spacy_tokens: The greatest danger posed by Russian stockpiles of CW is therefore that people living close to the warehouses will be exposed to these agents .


fn_spacy_tokens_for_baseline: Isabel had eventually hushed .

source_bert_toks: isabel had eventually hushed .

reference_raw: Isabel finally shut up.

reference_spacy_tokens: Isabel finally shut up .


fn_spacy_tokens_for_baseline: The work is preparation for Iran 's plans to install 3,000 centrifuges at the site , but so far no centrifuges have been emplaced , according to the Associated Press .

source_bert_toks: the work is preparation for iran ' s plans to install 3 , 000 cent ##ri ##fu ##ges at the site , but so far no cent ##ri ##fu ##ges have been em ##placed , according to the associated press .

reference_raw: The work is preparing Iran's plans to install 3,000 centrifuges on the site, but according to the associated press, no centrifuges have yet been replaced.

reference_spacy_tokens: The work is preparing Iran 's plans to install 3,000 centrifuges on the site , but according to the associated press , no centrifuges have yet been replaced .


fn_spacy_tokens_for_baseline: The built - in wooden dresser was already there , as was the exposed brick chimney breast -- which , with the cooker slotted into the fireplace , looks rather like an old - fashioned kitchen range .

source_bert_toks: the built - in wooden dresser was already there , as was the exposed brick chimney breast - - which , with the cooke ##r slot ##ted into the fireplace , looks rather like an old - fashioned kitchen range .

reference_raw: The built-in wooden dresser was already there, as was the exposed brick breast of the chimney-which, with the cooker stuck in the fireplace, looked more like an old-fashioned kitchen area.

reference_spacy_tokens: The built - in wooden dresser was already there , as was the exposed brick breast of the chimney - which , with the cooker stuck in the fireplace , looked more like an old - fashioned kitchen area .


fn_spacy_tokens_for_baseline: On Monday , you plan a lavish party for Tuesday ; when Tuesday arrives , you indulge your preference for anticipation by postponing the party till Wednesday .

source_bert_toks: on monday , you plan a lavish party for tuesday ; when tuesday arrives , you ind ##ul ##ge your preference for anticipation by post ##pon ##ing the party till wednesday .

reference_raw: On Monday, you schedule a fancy party for Tuesday; when Tuesday arrives, you indulge your preference for anticipation by postponing the party until Wednesday.

reference_spacy_tokens: On Monday , you schedule a fancy party for Tuesday ; when Tuesday arrives , you indulge your preference for anticipation by postponing the party until Wednesday .


fn_spacy_tokens_for_baseline: For example , I might think of a rather jolly idea for a cover story .

source_bert_toks: for example , i might think of a rather jolly idea for a cover story .

reference_raw: For example, I could come up with a rather cheerful idea for a cover story.

reference_spacy_tokens: For example , I could come up with a rather cheerful idea for a cover story .


fn_spacy_tokens_for_baseline: The expansion of air travel began the age of mass tourism , and Greece along with the Aegean Islands became exciting destinations for northern Europeans escaping their damp , cool summers .

source_bert_toks: the expansion of air travel began the age of mass tourism , and greece along with the aegean islands became exciting destinations for northern europeans escaping their damp , cool summers .

reference_raw: The expansion of air transport began in the age of mass tourism, and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet, cold summers.

reference_spacy_tokens: The expansion of air transport began in the age of mass tourism , and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet , cold summers .


fn_spacy_tokens_for_baseline: Goatlings can be inseminated as well as goats which have kidded before .

source_bert_toks: goat ##lings can be ins ##emi ##nated as well as goats which have kidd ##ed before .

reference_raw: The goats can be inseminated as well as the goats that have been fooled before.

reference_spacy_tokens: The goats can be inseminated as well as the goats that have been fooled before .


fn_spacy_tokens_for_baseline: Four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

source_bert_toks: four hundred troops are currently in the northwestern county guarding densely - populated areas , airports and power stations .

reference_raw: There are now 400 troops in the northwest region, guarding densely populated areas, airports, and power plants.

reference_spacy_tokens: There are now 400 troops in the northwest region , guarding densely populated areas , airports , and power plants .


fn_spacy_tokens_for_baseline: My face scorched , and I could n't see properly .

source_bert_toks: my face sc ##or ##ched , and i couldn ' t see properly .

reference_raw: My face was burned, and I couldn't see it.

reference_spacy_tokens: My face was burned , and I could n't see it .


fn_spacy_tokens_for_baseline: ' Social dimension ' is not a spine - tingling phrase .

source_bert_toks: ' social dimension ' is not a spine - tingling phrase .

reference_raw: "Social Dimension" is not a spinal phrase.

reference_spacy_tokens: " Social Dimension " is not a spinal phrase .


fn_spacy_tokens_for_baseline: It was the weather which really decided the issue for , one observer wrote , ' It blew a great storm and rained and hailed so hard that the water came out of the soldiers ' shoes . '

source_bert_toks: it was the weather which really decided the issue for , one observer wrote , ' it blew a great storm and rained and hailed so hard that the water came out of the soldiers ' shoes . '

reference_raw: It was the weather that really decided the question, one of the observers wrote, "It blew a great storm and rained and screamed so hard that the water came from the soldiers' boots."

reference_spacy_tokens: It was the weather that really decided the question , one of the observers wrote , " It blew a great storm and rained and screamed so hard that the water came from the soldiers ' boots . "


fn_spacy_tokens_for_baseline: The Handover Pavilion was meant to be a temporary structure , but public outcry ensured its preservation ( located on Xian Xing Hai ; open weekdays 10 am - 6 pm , until 10 pm weekends ) .

source_bert_toks: the hand ##over pavilion was meant to be a temporary structure , but public out ##cr ##y ensured its preservation ( located on xi ##an xi ##ng hai ; open weekdays 10 am - 6 pm , until 10 pm weekends ) .

reference_raw: The Handover Pavilion was supposed to be a temporary structure, but public outbursts ensured that it was maintained (located at Xian Xing Hai; open weekends at 10 - 6:00 p.m., until 10:00 p.m.).

reference_spacy_tokens: The Handover Pavilion was supposed to be a temporary structure , but public outbursts ensured that it was maintained ( located at Xian Xing Hai ; open weekends at 10 - 6:00 p.m. , until 10:00 p.m. ) .


fn_spacy_tokens_for_baseline: The case languished after Morsi was elected last year in the country 's first free presidential race , although local news outlets and Morsi 's opponents accused militants from Hamas , the Brotherhood 's Palestinian offshoot , of freeing their colleagues .

source_bert_toks: the case lang ##uis ##hed after mor ##si was elected last year in the country ' s first free presidential race , although local news outlets and mor ##si ' s opponents accused militants from hamas , the brotherhood ' s palestinian offs ##hoot , of freeing their colleagues .

reference_raw: After the election of Morsi last year in the country's first free presidential race, the case lingered, even though local news outlets and Morsi's opponents blamed the militia of Hamas, the Palestinian Brotherhood, for the release of their peers.

reference_spacy_tokens: After the election of Morsi last year in the country 's first free presidential race , the case lingered , even though local news outlets and Morsi 's opponents blamed the militia of Hamas , the Palestinian Brotherhood , for the release of their peers .


fn_spacy_tokens_for_baseline: Moreover , when taking into account the amount of research money available to researchers , Latin America actually out - published the United States and Canada by the year 2000 ( Figure 2 ) .

source_bert_toks: moreover , when taking into account the amount of research money available to researchers , latin america actually out - published the united states and canada by the year 2000 ( figure 2 ) .

reference_raw: In addition, given the amount of research money available to scientists, Latin America actually outsourced the United States and Canada in 2000 (Figure 2).

reference_spacy_tokens: In addition , given the amount of research money available to scientists , Latin America actually outsourced the United States and Canada in 2000 ( Figure 2 ) .


fn_spacy_tokens_for_baseline: BASRA , Iraq ( AP ) A U.S. lawmaker assessing the impact of U.N. sanctions on Iraq said Wednesday it is important not only to force Baghdad to give up its weapons of mass destruction but also to do more to ease the hardships on ordinary Iraqis .

source_bert_toks: bas ##ra , iraq ( ap ) a u . s . law ##maker assessing the impact of u . n . sanctions on iraq said wednesday it is important not only to force baghdad to give up its weapons of mass destruction but also to do more to ease the hardship ##s on ordinary iraqi ##s .

reference_raw: BASRA, Iraq (AP) A US legislator assessing the impact of UN sanctions on Iraq said on Wednesday that it is important not only to force Baghdad to surrender his weapons of mass destruction, but also to do more to ease the suffering of ordinary Iraqis.

reference_spacy_tokens: BASRA , Iraq ( AP ) A US legislator assessing the impact of UN sanctions on Iraq said on Wednesday that it is important not only to force Baghdad to surrender his weapons of mass destruction , but also to do more to ease the suffering of ordinary Iraqis .


fn_spacy_tokens_for_baseline: Part of this accord was an agreement to construct a nuclear research center that would include a 25MW research reactor .

source_bert_toks: part of this accord was an agreement to construct a nuclear research center that would include a 25 ##m ##w research reactor .

reference_raw: Part of the agreement was to build a nuclear research centre with a 25-MW research reactor.

reference_spacy_tokens: Part of the agreement was to build a nuclear research centre with a 25-MW research reactor .


fn_spacy_tokens_for_baseline: So when the team plays at home , his chum in Derby switches on the local sports show ready for Mike 's call .

source_bert_toks: so when the team plays at home , his chu ##m in derby switches on the local sports show ready for mike ' s call .

reference_raw: So when the team plays at home, his buddy in Derby switches to a local sports show ready for Mike's call.

reference_spacy_tokens: So when the team plays at home , his buddy in Derby switches to a local sports show ready for Mike 's call .


fn_spacy_tokens_for_baseline: Richmondshire council was raising its rents by £ 3 and Sedgefield borough council by £ 2.95 .

source_bert_toks: richmond ##shire council was raising its rents by £3 and se ##dge ##field borough council by £2 . 95 .

reference_raw: The Richmondshire Council increased its rent by £3 and the Sedgefield Borough Council by £2.95.

reference_spacy_tokens: The Richmondshire Council increased its rent by £ 3 and the Sedgefield Borough Council by £ 2.95 .


fn_spacy_tokens_for_baseline: It must be noted that this latter source , cited by Anthony Cordesman , can not be independently corroborated , and firsthand data on Iranian BW agents is unavailable in open sources .

source_bert_toks: it must be noted that this latter source , cited by anthony cord ##es ##man , can not be independently co ##rro ##bor ##ated , and first ##hand data on iranian b ##w agents is unavailable in open sources .

reference_raw: It should be pointed out that the latter source, cited by Anthony Cordesman, cannot be independently confirmed and that first-hand data on Iranian BW agents is not available from open sources.

reference_spacy_tokens: It should be pointed out that the latter source , cited by Anthony Cordesman , can not be independently confirmed and that first - hand data on Iranian BW agents is not available from open sources .


fn_spacy_tokens_for_baseline: Her friend 's well - known bluntness had been to the fore a few days ago , when she 'd discovered Laura sobbing quietly in her bedroom .

source_bert_toks: her friend ' s well - known blunt ##ness had been to the fore a few days ago , when she ' d discovered laura sobbing quietly in her bedroom .

reference_raw: Her friend's familiar bluntness had come to the fore a few days before, when she found Laura quietly weeping in her bedroom.

reference_spacy_tokens: Her friend 's familiar bluntness had come to the fore a few days before , when she found Laura quietly weeping in her bedroom .


fn_spacy_tokens_for_baseline: " Failure " is not a moment to be regretted in a process of adaption , or development into normality , which ideally takes its course ..

source_bert_toks: " failure " is not a moment to be regretted in a process of adapt ##ion , or development into normal ##ity , which ideally takes its course . .

reference_raw: "Failure" is not the time to feel sorry for the process of adaptation or evolution into normality that ideally takes its course.

reference_spacy_tokens: " Failure " is not the time to feel sorry for the process of adaptation or evolution into normality that ideally takes its course .


fn_spacy_tokens_for_baseline: All of a sudden , the child in the buggy gave a squeal of delight .

source_bert_toks: all of a sudden , the child in the bug ##gy gave a sq ##ue ##al of delight .

reference_raw: Suddenly the baby in the beetle gave a shriek of pleasure.

reference_spacy_tokens: Suddenly the baby in the beetle gave a shriek of pleasure .


fn_spacy_tokens_for_baseline: The Japanese interned those who surrendered without a struggle and killed all those French elements who put up a resistance .

source_bert_toks: the japanese interned those who surrendered without a struggle and killed all those french elements who put up a resistance .

reference_raw: The Japanese interred those who surrendered without a fight and killed all the French elements who raised the resistance.

reference_spacy_tokens: The Japanese interred those who surrendered without a fight and killed all the French elements who raised the resistance .


fn_spacy_tokens_for_baseline: A group of women in the rebel - controlled eastern city of Benghazi protested Sunday to demand her release .

source_bert_toks: a group of women in the rebel - controlled eastern city of ben ##gh ##azi protested sunday to demand her release .

reference_raw: On Sunday, a group of women in the rebel-controlled eastern city of Benghazi objected to her release.

reference_spacy_tokens: On Sunday , a group of women in the rebel - controlled eastern city of Benghazi objected to her release .


fn_spacy_tokens_for_baseline: But the Barbarians were all right , something to be remembered when you espy pot - bellied , spikey - haired British youth this Friday .

source_bert_toks: but the barbarians were all right , something to be remembered when you es ##py pot - bell ##ied , spike ##y - haired british youth this friday .

reference_raw: But the barbarians were fine, something to remember when you were spying on a pot-bellied, sharp-haired British boy this Friday.

reference_spacy_tokens: But the barbarians were fine , something to remember when you were spying on a pot - bellied , sharp - haired British boy this Friday .


fn_spacy_tokens_for_baseline: To a whirring of cine - cameras and a gratifying clicking of Nikons , Enid Coley progressed graciously into the stands .

source_bert_toks: to a w ##hir ##ring of ci ##ne - cameras and a gr ##ati ##fying clicking of nik ##ons , en ##id cole ##y progressed gr ##acious ##ly into the stands .

reference_raw: Enid Coley walked graciously to the stands to the whirring of the cameras and the satisfying click of the Nikons.

reference_spacy_tokens: Enid Coley walked graciously to the stands to the whirring of the cameras and the satisfying click of the Nikons .


fn_spacy_tokens_for_baseline: When I prised her off and tried to stand her on the floor she kept rocking back and sitting on her tail , then falling over sideways and lying there like a stuffed parrot .

source_bert_toks: when i pri ##sed her off and tried to stand her on the floor she kept rocking back and sitting on her tail , then falling over sideways and lying there like a stuffed parrot .

reference_raw: When I pushed her away and tried to put her on the floor, she rocked back and sat on her tail, then fell sideways and lay there like a stuffed parrot.

reference_spacy_tokens: When I pushed her away and tried to put her on the floor , she rocked back and sat on her tail , then fell sideways and lay there like a stuffed parrot .


fn_spacy_tokens_for_baseline: She is maddening and charming .

source_bert_toks: she is madden ##ing and charming .

reference_raw: She's crazy and charming.

reference_spacy_tokens: She 's crazy and charming .


fn_spacy_tokens_for_baseline: Discarding the culotte - shorts , she ran down into the water clad in her olive - green one - piece .

source_bert_toks: disc ##arding the cu ##lot ##te - shorts , she ran down into the water clad in her olive - green one - piece .

reference_raw: She dropped the culotte shorts and ran into the water, clad in an olive-green one-piece.

reference_spacy_tokens: She dropped the culotte shorts and ran into the water , clad in an olive - green one - piece .


fn_spacy_tokens_for_baseline: Be secretive and withhold information from the other person even though it affects them .

source_bert_toks: be secretive and with ##hold information from the other person even though it affects them .

reference_raw: Be discreet and withhold information from another person, even if it affects them.

reference_spacy_tokens: Be discreet and withhold information from another person , even if it affects them .


fn_spacy_tokens_for_baseline: He altered that to , ' Can you put the light out , dear ? ' when she bashed him with the book and asked him to repeat what he had said .

source_bert_toks: he altered that to , ' can you put the light out , dear ? ' when she bash ##ed him with the book and asked him to repeat what he had said .

reference_raw: He changed it to, "Can you turn off the light, dear?" when she hit him with the book and asked him to repeat what he had said.

reference_spacy_tokens: He changed it to , " Can you turn off the light , dear ? " when she hit him with the book and asked him to repeat what he had said .


fn_spacy_tokens_for_baseline: The dressing room was locked for 40 minutes .

source_bert_toks: the dressing room was locked for 40 minutes .

reference_raw: The locker room was locked for 40 minutes.

reference_spacy_tokens: The locker room was locked for 40 minutes .


fn_spacy_tokens_for_baseline: There 's us lot working and slaving from dawn till dusk for nowt , and the two who 've not stuck to the straight and narrow as come off t'best .

source_bert_toks: there ' s us lot working and sl ##avi ##ng from dawn till dusk for now ##t , and the two who ' ve not stuck to the straight and narrow as come off t ' best .

reference_raw: There's a lot of work and slavery between dawn and sunset, and the two of us that don't stick to the straight and narrow as we come from t'best.

reference_spacy_tokens: There 's a lot of work and slavery between dawn and sunset , and the two of us that do n't stick to the straight and narrow as we come from t'best .


fn_spacy_tokens_for_baseline: In a well - known detective - story involving church bells , English novelist Dorothy L. Sayers described ringing as a " passion { that } finds its satisfaction in mathematical completeness and mechanical perfection .

source_bert_toks: in a well - known detective - story involving church bells , english novelist dorothy l . say ##ers described ringing as a " passion { that } finds its satisfaction in mathematical complete ##ness and mechanical perfection .

reference_raw: In a well-known detective story involving church bells, English writer Dorothy L. Sayers described the ringing as "passion {that} is satisfied with mathematical completeness and mechanical perfection.

reference_spacy_tokens: In a well - known detective story involving church bells , English writer Dorothy L. Sayers described the ringing as " passion { that } is satisfied with mathematical completeness and mechanical perfection .


fn_spacy_tokens_for_baseline: The diary of Edmund Crocker of Frome , 8 February 1799 .

source_bert_toks: the diary of edmund cr ##ock ##er of from ##e , 8 february 1799 .

reference_raw: Edmund Crocker's journal from Frome, 8 February 1799.

reference_spacy_tokens: Edmund Crocker 's journal from Frome , 8 February 1799 .


fn_spacy_tokens_for_baseline: War was clearly central to Theudebert 's status , both at home and abroad .

source_bert_toks: war was clearly central to the ##ude ##bert ' s status , both at home and abroad .

reference_raw: The war was clearly central to Theudebert's position, both domestically and abroad.

reference_spacy_tokens: The war was clearly central to Theudebert 's position , both domestically and abroad .


fn_spacy_tokens_for_baseline: To his left , along the drive , he saw the grey - haired minister from Weem arriving at a gallop .

source_bert_toks: to his left , along the drive , he saw the grey - haired minister from wee ##m arriving at a gallo ##p .

reference_raw: To his left, on the way, he saw a gray-haired minister from Weem approaching at a gallop.

reference_spacy_tokens: To his left , on the way , he saw a gray - haired minister from Weem approaching at a gallop .


fn_spacy_tokens_for_baseline: The men 's blouses and hose were blue ; three - quarters of the women 's gowns were blue .

source_bert_toks: the men ' s blouse ##s and hose were blue ; three - quarters of the women ' s gown ##s were blue .

reference_raw: The men's blouses and stockings were blue; three-quarters of the women's clothes were blue.

reference_spacy_tokens: The men 's blouses and stockings were blue ; three - quarters of the women 's clothes were blue .


fn_spacy_tokens_for_baseline: Oswald 's marriage to Cyneburh , daughter of Cynegils , reveals clearly that relatively cordial relations could prevail between an overlord and a dependant if both stood to gain from the relationship .

source_bert_toks: oswald ' s marriage to cy ##ne ##bu ##rh , daughter of cy ##ne ##gil ##s , reveals clearly that relatively cord ##ial relations could pre ##va ##il between an over ##lord and a depend ##ant if both stood to gain from the relationship .

reference_raw: The marriage of Oswald to Cyneburh, the daughter of Cynegils, clearly shows that a relatively warm relationship can prevail between a ruler and a dependant if they both stand to gain from the relationship.

reference_spacy_tokens: The marriage of Oswald to Cyneburh , the daughter of Cynegils , clearly shows that a relatively warm relationship can prevail between a ruler and a dependant if they both stand to gain from the relationship .


fn_spacy_tokens_for_baseline: The teams will again parade through the city with a police escort back to the Albert Dock , before returning to the Blundellsands Hotel in Crosby for the evening awards party .

source_bert_toks: the teams will again parade through the city with a police escort back to the albert dock , before returning to the blu ##nde ##lls ##ands hotel in crosby for the evening awards party .

reference_raw: Teams will be marching through town with police escorts back to Albert Dock before returning to the Blundellsands Hotel in Crosby for the evening awards.

reference_spacy_tokens: Teams will be marching through town with police escorts back to Albert Dock before returning to the Blundellsands Hotel in Crosby for the evening awards .


fn_spacy_tokens_for_baseline: He went to work for the Gas Light & Coke Company at Beckton in 1908 but he soon chafed at not being given the free rein to which he had become accustomed at Davis Bros.

source_bert_toks: he went to work for the gas light & coke company at beck ##ton in 1908 but he soon cha ##fed at not being given the free rein to which he had become accustomed at davis bros .

reference_raw: In 1908 he went to work for the Gas Light & Coke Company in Beckton, but soon he was chaffed because he didn't get the free reins he'd gotten used to in Davis Bros.

reference_spacy_tokens: In 1908 he went to work for the Gas Light & Coke Company in Beckton , but soon he was chaffed because he did n't get the free reins he 'd gotten used to in Davis Bros.


fn_spacy_tokens_for_baseline: Stop Keith urinating on the carpet .

source_bert_toks: stop keith ur ##inating on the carpet .

reference_raw: Stop Keith peeing on the rug.

reference_spacy_tokens: Stop Keith peeing on the rug .


fn_spacy_tokens_for_baseline: ' Oh , for heaven 's sake stop twittering about Fabio .

source_bert_toks: ' oh , for heaven ' s sake stop twitter ##ing about fabio .

reference_raw: 'Oh, for God's sake, stop talking about Fabio.

reference_spacy_tokens: ' Oh , for God 's sake , stop talking about Fabio .


fn_spacy_tokens_for_baseline: And when I chanced one last look round I saw they 'd painted the front door green too .

source_bert_toks: and when i chance ##d one last look round i saw they ' d painted the front door green too .

reference_raw: And when I took one last look around, I saw that the front door was also painted green.

reference_spacy_tokens: And when I took one last look around , I saw that the front door was also painted green .


fn_spacy_tokens_for_baseline: Then one tried to unify gravity with quantum mechanics , one had to introduce the idea of ' imaginary ' time .

source_bert_toks: then one tried to un ##ify gravity with quantum mechanics , one had to introduce the idea of ' imaginary ' time .

reference_raw: Then you tried to combine gravity with quantum mechanics, and you had to introduce the idea of imaginary time.

reference_spacy_tokens: Then you tried to combine gravity with quantum mechanics , and you had to introduce the idea of imaginary time .


fn_spacy_tokens_for_baseline: At a recent anti - diet rally in West Virginia , women smashed their scales and toted banners proclaiming : ' Scales are for fish , not women . '

source_bert_toks: at a recent anti - diet rally in west virginia , women smashed their scales and to ##ted banners pro ##claiming : ' scales are for fish , not women . '

reference_raw: At a recent anti-diet rally in West Virginia, women broke the scales and tossed flags saying, "The scales are for fish, not women."

reference_spacy_tokens: At a recent anti - diet rally in West Virginia , women broke the scales and tossed flags saying , " The scales are for fish , not women . "


fn_spacy_tokens_for_baseline: He was a cornball when compared to the svelte politicians of today .

source_bert_toks: he was a corn ##ball when compared to the sv ##elt ##e politicians of today .

reference_raw: Compared to today's svelt politicians, he was a cornball.

reference_spacy_tokens: Compared to today 's svelt politicians , he was a cornball .


fn_spacy_tokens_for_baseline: It then crossed the Indian Ocean and rounded Australia and arrived at the small purpose - built port of Tokai northeast of Tokyo in early January .

source_bert_toks: it then crossed the indian ocean and rounded australia and arrived at the small purpose - built port of to ##kai northeast of tokyo in early january .

reference_raw: It then crossed the Indian Ocean, rounded Australia, and reached a small, purpose-built port in Tokai north-east of Tokyo in early January.

reference_spacy_tokens: It then crossed the Indian Ocean , rounded Australia , and reached a small , purpose - built port in Tokai north - east of Tokyo in early January .