fn_spacy_tokens_for_baseline: Moreover , particularly when a complex is relatively unstable , the bound protein can detach from the protected DNA fragment and reassociate to other DNA fragments that have already been modified by DMS .

source_bert_toks: moreover , particularly when a complex is relatively unstable , the bound protein can det ##ach from the protected dna fragment and re ##ass ##oc ##iate to other dna fragments that have already been modified by d ##ms .

reference_raw: In addition, especially if the complex is relatively unstable, the bound protein can separate from the protected DNA fragment and reconnect with other DNA fragments that have already been modified by DMS.

reference_spacy_tokens: In addition , especially if the complex is relatively unstable , the bound protein can separate from the protected DNA fragment and reconnect with other DNA fragments that have already been modified by DMS .


fn_spacy_tokens_for_baseline: Such exposures are destroying long - held notions that it is somehow unpatriotic for American investors to sell short the shares of American companies .

source_bert_toks: such exposure ##s are destroying long - held notions that it is somehow un ##pa ##tri ##otic for american investors to sell short the shares of american companies .

reference_raw: Such exposures destroy the long-term notion that it is somehow unpatriotic for US investors to sell small shares in American companies.

reference_spacy_tokens: Such exposures destroy the long - term notion that it is somehow unpatriotic for US investors to sell small shares in American companies .


fn_spacy_tokens_for_baseline: 2- Around the same period , our brothers on the other side of Uphrate river , killed Jasim al- ' Awwad in al - Malahima and AlbuHazim .

source_bert_toks: 2 - around the same period , our brothers on the other side of up ##hra ##te river , killed ja ##si ##m al - ' aw ##wad in al - mala ##hima and al ##bu ##ha ##zi ##m .

reference_raw: 2- About the same time, our brothers across the Uphrate River killed Jasim al-'Awwad in Al-Malahima and AlbuHazim.

reference_spacy_tokens: 2- About the same time , our brothers across the Uphrate River killed Jasim al-'Awwad in Al - Malahima and AlbuHazim .


fn_spacy_tokens_for_baseline: The one , familiar between the wars to Bloomsbury and the Sitwells , was mannered , urbane and aphoristic , dressed in silks and powdered wigs and usually more French than English .

source_bert_toks: the one , familiar between the wars to blooms ##bury and the sit ##well ##s , was manner ##ed , urban ##e and ap ##hor ##istic , dressed in silk ##s and powder ##ed wig ##s and usually more french than english .

reference_raw: The one, familiar with the wars between Bloomsbury and the Sitwells, was fashionable, urban and aphoristic, dressed in silken and dusty wigs, and usually more French than English.

reference_spacy_tokens: The one , familiar with the wars between Bloomsbury and the Sitwells , was fashionable , urban and aphoristic , dressed in silken and dusty wigs , and usually more French than English .


fn_spacy_tokens_for_baseline: In the long , frightening night after Tuesday 's devastating earthquake , Bay Area residents searched for comfort and solace wherever they could .

source_bert_toks: in the long , frightening night after tuesday ' s devastating earthquake , bay area residents searched for comfort and sol ##ace wherever they could .

reference_raw: In the long, gruesome night after the devastating earthquake on Tuesday, the inhabitants of the Bay Area sought consolation wherever they could.

reference_spacy_tokens: In the long , gruesome night after the devastating earthquake on Tuesday , the inhabitants of the Bay Area sought consolation wherever they could .


fn_spacy_tokens_for_baseline: Lawrence grunted , and the camera bulb flashed again , immediately answered by a fizzling flash of blue - white electricity in the sky and a rumbling of thunder .

source_bert_toks: lawrence grunted , and the camera bulb flashed again , immediately answered by a fi ##zzling flash of blue - white electricity in the sky and a rumbling of thunder .

reference_raw: Lawrence grunted, and the camera light flickered again, instantly responding to a flicker of blue-white electricity in the sky and a roar of thunder.

reference_spacy_tokens: Lawrence grunted , and the camera light flickered again , instantly responding to a flicker of blue - white electricity in the sky and a roar of thunder .


fn_spacy_tokens_for_baseline: The problem is that users are not a homogeneous group and their needs may conflict .

source_bert_toks: the problem is that users are not a homogeneous group and their needs may conflict .

reference_raw: The problem is that users are not a homogenous group and their needs may conflict.

reference_spacy_tokens: The problem is that users are not a homogenous group and their needs may conflict .


fn_spacy_tokens_for_baseline: In January 1982 , Malawi Radio announced that the Chirwas had been arrested with their son on Christmas Eve , and claimed that they had slipped back into the country to incite opposition to Banda 's Government .

source_bert_toks: in january 1982 , malawi radio announced that the chi ##r ##was had been arrested with their son on christmas eve , and claimed that they had slipped back into the country to inc ##ite opposition to banda ' s government .

reference_raw: In January 1982, the Malawi radio announced that the Chirwas and their son had been arrested on Christmas Eve, claiming that they had slipped back into the country to provoke opposition to the Banda government.

reference_spacy_tokens: In January 1982 , the Malawi radio announced that the Chirwas and their son had been arrested on Christmas Eve , claiming that they had slipped back into the country to provoke opposition to the Banda government .


fn_spacy_tokens_for_baseline: Mother licked cream from the ice - cave interior of the meringue , then broke off part of the superstructure with her fingers and popped it into her mouth .

source_bert_toks: mother licked cream from the ice - cave interior of the mer ##ing ##ue , then broke off part of the superstructure with her fingers and popped it into her mouth .

reference_raw: Mother licked cream from the ice cave inside of the meringue, then cut off part of the superstructure with her fingers and stuck it in her mouth.

reference_spacy_tokens: Mother licked cream from the ice cave inside of the meringue , then cut off part of the superstructure with her fingers and stuck it in her mouth .


fn_spacy_tokens_for_baseline: For them , it must be almost a relief to walk around listening to the cocks crowing or the cows mooing -- it must help to keep them sane .

source_bert_toks: for them , it must be almost a relief to walk around listening to the cock ##s crow ##ing or the cows mo ##oin ##g - - it must help to keep them sane .

reference_raw: It must be almost a relief for them to walk around and listen to the crows of birds or the mooring of cows - it must help to keep them sane.

reference_spacy_tokens: It must be almost a relief for them to walk around and listen to the crows of birds or the mooring of cows - it must help to keep them sane .


fn_spacy_tokens_for_baseline: The purveyor wiped his mouth with the dirty hem of his sleeve .

source_bert_toks: the pu ##r ##vey ##or wiped his mouth with the dirty hem of his sleeve .

reference_raw: The purveyor wiped his mouth with the dirty edge of his sleeve.

reference_spacy_tokens: The purveyor wiped his mouth with the dirty edge of his sleeve .


fn_spacy_tokens_for_baseline: The Bundesbank sees little virtue in surrendering power to a European central bank .

source_bert_toks: the bun ##des ##bank sees little virtue in surrender ##ing power to a european central bank .

reference_raw: The Bundesbank sees little value in the transfer of authority to the European Central Bank.

reference_spacy_tokens: The Bundesbank sees little value in the transfer of authority to the European Central Bank .


fn_spacy_tokens_for_baseline: ' What has outraged Sierra Club leaders is that external organizations would attempt to interfere and manipulate our election to advance their own agendas , ' said Robert Cox , a past Sierra Club president .

source_bert_toks: ' what has outraged sierra club leaders is that external organizations would attempt to interfere and manipulate our election to advance their own agenda ##s , ' said robert cox , a past sierra club president .

reference_raw: 'What upsets the leaders of the Sierra Club is that foreign organizations will try to intervene and manipulate our election to advance their own agendas,' said Robert Cox, the former president of the Sierra Club.

reference_spacy_tokens: ' What upsets the leaders of the Sierra Club is that foreign organizations will try to intervene and manipulate our election to advance their own agendas , ' said Robert Cox , the former president of the Sierra Club .


fn_spacy_tokens_for_baseline: She hushed him , imagining that if his language were overheard , those overhearing it would be as shocked as she pretended to be .

source_bert_toks: she hushed him , imagining that if his language were overheard , those over ##hear ##ing it would be as shocked as she pretended to be .

reference_raw: She silenced him, imagining that if he heard his tongue, those who heard him would be as shocked as she pretended to be.

reference_spacy_tokens: She silenced him , imagining that if he heard his tongue , those who heard him would be as shocked as she pretended to be .


fn_spacy_tokens_for_baseline: Within minutes he felt in control , and as Suzy quaffed glass after glass of white wine , he sensed her eyes upon him .

source_bert_toks: within minutes he felt in control , and as suzy qu ##af ##fed glass after glass of white wine , he sensed her eyes upon him .

reference_raw: In a few minutes he felt himself under control, and as Suzy quenched glass after glass of white wine, he felt her eyes on him.

reference_spacy_tokens: In a few minutes he felt himself under control , and as Suzy quenched glass after glass of white wine , he felt her eyes on him .


fn_spacy_tokens_for_baseline: Yet the best the far - left could do was not enough to deter the biggest voting bloc -- nearly 40 % -- from endorsing the direction Spain is taking .

source_bert_toks: yet the best the far - left could do was not enough to deter the biggest voting bloc - - nearly 40 % - - from end ##ors ##ing the direction spain is taking .

reference_raw: But the best that the far left can do is not sufficient to deter the largest voting block - almost 40% - from supporting the direction Spain is taking.

reference_spacy_tokens: But the best that the far left can do is not sufficient to deter the largest voting block - almost 40 % - from supporting the direction Spain is taking .


fn_spacy_tokens_for_baseline: JOHANNESBURG - After four days in the hospital battling a lung infection , former President Nelson Mandela of South Africa " is responding better to treatment , " President Jacob Zuma told Parliament in Cape Town on Wednesday .

source_bert_toks: johannesburg - after four days in the hospital battling a lung infection , former president nelson mandela of south africa " is responding better to treatment , " president jacob zu ##ma told parliament in cape town on wednesday .

reference_raw: JOHANNESBURG - After four days in the hospital fighting a pulmonary infection, former President Nelson Mandela of South Africa "responds better to treatment," President Jacob Zuma said to Parliament in Cape Town on Wednesday.

reference_spacy_tokens: JOHANNESBURG - After four days in the hospital fighting a pulmonary infection , former President Nelson Mandela of South Africa " responds better to treatment , " President Jacob Zuma said to Parliament in Cape Town on Wednesday .


fn_spacy_tokens_for_baseline: TOTALLY UNKNOWN US bluesman comes to Britain and gets schlepped into a studio to record with a bunch of locals who wish they 'd been born in America 's Deep South .

source_bert_toks: totally unknown us blues ##man comes to britain and gets sc ##hl ##ep ##ped into a studio to record with a bunch of locals who wish they ' d been born in america ' s deep south .

reference_raw: U.S. bluesman comes to Britain and gets stuck in the studio to record with a bunch of locals who want to be born in the U.S. Deep South.

reference_spacy_tokens: U.S. bluesman comes to Britain and gets stuck in the studio to record with a bunch of locals who want to be born in the U.S. Deep South .


fn_spacy_tokens_for_baseline: Jerusalem 's mayor , Teddy Kollek , spent the next 25 years orchestrating a vast program of development , adding new cultural institutions and parks and instituting neighborhood restoration projects while tirelessly mediating the concerns of Jerusalem 's many communities .

source_bert_toks: jerusalem ' s mayor , teddy ko ##lle ##k , spent the next 25 years orchestra ##ting a vast program of development , adding new cultural institutions and parks and institut ##ing neighborhood restoration projects while tire ##lessly media ##ting the concerns of jerusalem ' s many communities .

reference_raw: The mayor of Jerusalem, Teddy Kollek, spent the next twenty-five years organizing a huge development program, adding new cultural institutions and parks, and instigating neighbourhood restoration projects, while relentlessly meddling the fears of Jerusalem's many communities.

reference_spacy_tokens: The mayor of Jerusalem , Teddy Kollek , spent the next twenty - five years organizing a huge development program , adding new cultural institutions and parks , and instigating neighbourhood restoration projects , while relentlessly meddling the fears of Jerusalem 's many communities .


fn_spacy_tokens_for_baseline: Except for the gas tank at Hustead 's Towing Service exploding and burning in downtown Berkeley , things here are quite peaceful .

source_bert_toks: except for the gas tank at hu ##stead ' s towing service exploding and burning in downtown berkeley , things here are quite peaceful .

reference_raw: With the exception of a gas tank in Hustead's Towing Service exploding and burning in the center of Berkeley, it's pretty quiet here.

reference_spacy_tokens: With the exception of a gas tank in Hustead 's Towing Service exploding and burning in the center of Berkeley , it 's pretty quiet here .


fn_spacy_tokens_for_baseline: But we shall have to skirt these issues here ( see Fillmore , 1975 ) .

source_bert_toks: but we shall have to skirt these issues here ( see fill ##more , 1975 ) .

reference_raw: However, we must avoid these problems here (see Fillmore, 1975).

reference_spacy_tokens: However , we must avoid these problems here ( see Fillmore , 1975 ) .


fn_spacy_tokens_for_baseline: Also I am Khan of the Merkuts . '

source_bert_toks: also i am khan of the mer ##ku ##ts . '

reference_raw: I'm also Kan of Merkuts.'

reference_spacy_tokens: I 'm also Kan of Merkuts . '


fn_spacy_tokens_for_baseline: Midwinter waved his baton at me .

source_bert_toks: mid ##win ##ter waved his baton at me .

reference_raw: Midwinter gestured at me with his baton.

reference_spacy_tokens: Midwinter gestured at me with his baton .


fn_spacy_tokens_for_baseline: The case languished after Morsi was elected last year in the country 's first free presidential race , although local news outlets and Morsi 's opponents accused militants from Hamas , the Brotherhood 's Palestinian offshoot , of freeing their colleagues .

source_bert_toks: the case lang ##uis ##hed after mor ##si was elected last year in the country ' s first free presidential race , although local news outlets and mor ##si ' s opponents accused militants from hamas , the brotherhood ' s palestinian offs ##hoot , of freeing their colleagues .

reference_raw: After the election of Morsi last year in the first single presidential race in the country, the case lingered, even though local news outlets and Morsi's opponents blamed the militia of Hamas, the Palestinian Brotherhood, for the release of their colleagues.

reference_spacy_tokens: After the election of Morsi last year in the first single presidential race in the country , the case lingered , even though local news outlets and Morsi 's opponents blamed the militia of Hamas , the Palestinian Brotherhood , for the release of their colleagues .


fn_spacy_tokens_for_baseline: We could spend that money , you know , for starving children that are starving or twelve million other things would be more useful than that .

source_bert_toks: we could spend that money , you know , for starving children that are starving or twelve million other things would be more useful than that .

reference_raw: We could spend that money, you know, on starving children, who are hungry, or 12 million other things would be more helpful.

reference_spacy_tokens: We could spend that money , you know , on starving children , who are hungry , or 12 million other things would be more helpful .


fn_spacy_tokens_for_baseline: Baking , cooking , rocking the babies & hellip ; whatever needs done .

source_bert_toks: baking , cooking , rocking the babies & hell ##ip ; whatever needs done .

reference_raw: Baking, cooking, baby swinging &Hellip; whatever needs to be done.

reference_spacy_tokens: Baking , cooking , baby swinging & Hellip ; whatever needs to be done .


fn_spacy_tokens_for_baseline: Sightseeing in Hong Kong starts at sea level with the enthralling water traffic?-?a mix of freighters , ferries , tugs , junks , and yachts .

source_bert_toks: sights ##ee ##ing in hong kong starts at sea level with the en ##th ##ral ##ling water traffic ? - ? a mix of freighter ##s , ferries , tugs , junk ##s , and yacht ##s .

reference_raw: Sightseeing in Hong Kong begins at sea with fascinating water traffic? - a combination of cargo ships, ferries, tugs, junks, and sailboats.

reference_spacy_tokens: Sightseeing in Hong Kong begins at sea with fascinating water traffic ? - a combination of cargo ships , ferries , tugs , junks , and sailboats .


fn_spacy_tokens_for_baseline: The voice came from an oblong metal plaque like a dulled mirror which formed part of the surface of the right - hand wall .

source_bert_toks: the voice came from an ob ##long metal plaque like a dull ##ed mirror which formed part of the surface of the right - hand wall .

reference_raw: The voice came from a long iron plate, like a dim mirror that was part of the surface of the right-hand wall.

reference_spacy_tokens: The voice came from a long iron plate , like a dim mirror that was part of the surface of the right - hand wall .


fn_spacy_tokens_for_baseline: Scott 's Captain Waverley , as a southern Whig , is momentarily infatuated with the Jacobite Highlands , but he returns south and is pardoned for his treason .

source_bert_toks: scott ' s captain wave ##rley , as a southern whig , is momentarily in ##fat ##uated with the jacobite highlands , but he returns south and is pardon ##ed for his treason .

reference_raw: Scott's Captain Waverley, a Southern Whig, is in love with the Jacobite Highlands for a while, but he returns south and is pardoned for his treason.

reference_spacy_tokens: Scott 's Captain Waverley , a Southern Whig , is in love with the Jacobite Highlands for a while , but he returns south and is pardoned for his treason .


fn_spacy_tokens_for_baseline: Approaching Heligoland the weather was obviously unsuitable and so the mission was abandoned and the aircraft went home .

source_bert_toks: approaching he ##li ##gol ##and the weather was obviously unsuitable and so the mission was abandoned and the aircraft went home .

reference_raw: The approach of Heligoland was clearly unsuitable, so the mission had been deserted and the plane had gone home.

reference_spacy_tokens: The approach of Heligoland was clearly unsuitable , so the mission had been deserted and the plane had gone home .


fn_spacy_tokens_for_baseline: There are currently two options available on the market , one of which is a truly functional brace and the other merely a support .

source_bert_toks: there are currently two options available on the market , one of which is a truly functional brace and the other merely a support .

reference_raw: Two options are currently available on the market, one of which is a truly functioning brace and the other is merely a support.

reference_spacy_tokens: Two options are currently available on the market , one of which is a truly functioning brace and the other is merely a support .


fn_spacy_tokens_for_baseline: The six passengers boarded the aircraft at about 1520 hours and the aircraft received clearance from Norwich Tower to taxi out for take - off on Runway 28 .

source_bert_toks: the six passengers boarded the aircraft at about 152 ##0 hours and the aircraft received clearance from norwich tower to taxi out for take - off on runway 28 .

reference_raw: Six passengers boarded the aircraft at approximately 1520 hours, and the aircraft received permission from the Norwich Tower to taxi for take-off on Route 28.

reference_spacy_tokens: Six passengers boarded the aircraft at approximately 1520 hours , and the aircraft received permission from the Norwich Tower to taxi for take - off on Route 28 .


fn_spacy_tokens_for_baseline: A few Black Arks were left to patrol the stormy northern seas .

source_bert_toks: a few black ark ##s were left to patrol the stormy northern seas .

reference_raw: A few black arks remained to guard the turbulent northern seas.

reference_spacy_tokens: A few black arks remained to guard the turbulent northern seas .


fn_spacy_tokens_for_baseline: The Pentagon announced that women pilots in the navy and air force would be allowed to fly combat aircraft within the next few months .

source_bert_toks: the pentagon announced that women pilots in the navy and air force would be allowed to fly combat aircraft within the next few months .

reference_raw: The Pentagon has announced that female pilots in the Navy and the Air Force will be allowed to pilot combat aircraft in the next few months.

reference_spacy_tokens: The Pentagon has announced that female pilots in the Navy and the Air Force will be allowed to pilot combat aircraft in the next few months .


fn_spacy_tokens_for_baseline: When creating a stencil design , it is essential to remember to leave a space between each leaf or flower shape , otherwise the stencil card will drop to pieces when it is cut out .

source_bert_toks: when creating a ste ##nc ##il design , it is essential to remember to leave a space between each leaf or flower shape , otherwise the ste ##nc ##il card will drop to pieces when it is cut out .

reference_raw: When creating a stencil design, it is important to remember to leave a space between each leaf or flower form, otherwise the stencil card will fall to pieces when it is cut out.

reference_spacy_tokens: When creating a stencil design , it is important to remember to leave a space between each leaf or flower form , otherwise the stencil card will fall to pieces when it is cut out .


fn_spacy_tokens_for_baseline: ' You 're doing it for the child she 's foisting on you .

source_bert_toks: ' you ' re doing it for the child she ' s f ##ois ##ting on you .

reference_raw: 'You're doing this for a kid he's got on you.

reference_spacy_tokens: ' You 're doing this for a kid he 's got on you .


fn_spacy_tokens_for_baseline: At first they were of a mind to let him enter the house and to kill him as a detected burglar ; but they argued that if they were mixed up in an inquiry their own identity would at once be publicly disclosed and they would be open to further attacks .

source_bert_toks: at first they were of a mind to let him enter the house and to kill him as a detected bu ##rg ##lar ; but they argued that if they were mixed up in an inquiry their own identity would at once be publicly disclosed and they would be open to further attacks .

reference_raw: At first they intended to allow him to enter the house and kill him as an identified thief; but they argued that if they were involved in the investigation, their identity would be made public immediately and they would be open to further attacks.

reference_spacy_tokens: At first they intended to allow him to enter the house and kill him as an identified thief ; but they argued that if they were involved in the investigation , their identity would be made public immediately and they would be open to further attacks .


fn_spacy_tokens_for_baseline: Harry reached around her and carefully , even tenderly , plucked the bloom , savouring its fragrance before handing it to Katherine .

source_bert_toks: harry reached around her and carefully , even tenderly , plucked the bloom , sa ##vo ##uring its fragrance before handing it to katherine .

reference_raw: Harry reached around and carefully, even gently, plucked the flower, savoring its scent before handing it to Katherine.

reference_spacy_tokens: Harry reached around and carefully , even gently , plucked the flower , savoring its scent before handing it to Katherine .


fn_spacy_tokens_for_baseline: Freewheeling down this long , windy road can be especially exhilarating because emergency action is often needed to dodge the tractors that chug around the hedge - blind corners .

source_bert_toks: free ##wheel ##ing down this long , windy road can be especially ex ##hila ##rating because emergency action is often needed to dodge the tractors that chu ##g around the hedge - blind corners .

reference_raw: Free-wheeling on this long wind road can be particularly exciting, since emergency measures are often needed to avoid tractors pulsing around hedge-blind corners.

reference_spacy_tokens: Free - wheeling on this long wind road can be particularly exciting , since emergency measures are often needed to avoid tractors pulsing around hedge - blind corners .


fn_spacy_tokens_for_baseline: She sits me down in Jamie 's heap of a living room while she clatters in the kitchenette .

source_bert_toks: she sits me down in jamie ' s heap of a living room while she cl ##atter ##s in the kitchen ##ette .

reference_raw: He's sitting me in Jamie's living room pile while he rattles in the kitchen.

reference_spacy_tokens: He 's sitting me in Jamie 's living room pile while he rattles in the kitchen .


fn_spacy_tokens_for_baseline: There was an evening to pass before the midnight flight to London and , despite Tucker 's adamancy that Miss Kennedy would n't see her , she taxied to the Big Bamboo on Wulff Road .

source_bert_toks: there was an evening to pass before the midnight flight to london and , despite tucker ' s adam ##ancy that miss kennedy wouldn ' t see her , she taxi ##ed to the big bamboo on wu ##lf ##f road .

reference_raw: It was an evening before the midnight flight to London, and despite Tucker's insistence that Miss Kennedy would not see her, she took a cab to the Big Bamboo on Wulff Road.

reference_spacy_tokens: It was an evening before the midnight flight to London , and despite Tucker 's insistence that Miss Kennedy would not see her , she took a cab to the Big Bamboo on Wulff Road .


fn_spacy_tokens_for_baseline: On each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

source_bert_toks: on each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

reference_raw: A poster with a huge face was staring out of the wall at every drop across from the elevator shaft.

reference_spacy_tokens: A poster with a huge face was staring out of the wall at every drop across from the elevator shaft .


fn_spacy_tokens_for_baseline: Although the French are not big on vegetarian cuisine as such , their hors d'oeuvres usually cover a large gamut of toothsome vegetable - based dishes .

source_bert_toks: although the french are not big on vegetarian cuisine as such , their ho ##rs d ' o ##eu ##vres usually cover a large ga ##mut of tooth ##some vegetable - based dishes .

reference_raw: Although the French are not large in vegetarian cuisine as such, their hors d'oeuvres usually include a large gamut of tooth-based foods.

reference_spacy_tokens: Although the French are not large in vegetarian cuisine as such , their hors d'oeuvres usually include a large gamut of tooth - based foods .


fn_spacy_tokens_for_baseline: Much of the best Islamic architecture in the city was constructed in the Mameluke era , but the past thousand years had taken their toll : Jerusalem was unable to regain the prosperity it had enjoyed in earlier times .

source_bert_toks: much of the best islamic architecture in the city was constructed in the ma ##mel ##uke era , but the past thousand years had taken their toll : jerusalem was unable to regain the prosperity it had enjoyed in earlier times .

reference_raw: Most of the best Islamic architecture in the city had been built in the Mameluke era, but the last thousand years had taken their toll: Jerusalem could not regain the prosperity it had enjoyed in the past.

reference_spacy_tokens: Most of the best Islamic architecture in the city had been built in the Mameluke era , but the last thousand years had taken their toll : Jerusalem could not regain the prosperity it had enjoyed in the past .


fn_spacy_tokens_for_baseline: THREE masked thugs trussed up businessman Tom Hartley and his wife Helen at their home and drove off in their new £ 60,000 Mercedes with valuables worth £ 250,000 .

source_bert_toks: three masked thugs truss ##ed up businessman tom hartley and his wife helen at their home and drove off in their new £ ##60 , 000 mercedes with valuable ##s worth £2 ##50 , 000 .

reference_raw: THREE-masked thugs beat up businessman Tom Hartley and his wife Helen at home and drove away in their new £60,000 Mercedes with $250,000 worth of valuables.

reference_spacy_tokens: THREE - masked thugs beat up businessman Tom Hartley and his wife Helen at home and drove away in their new £ 60,000 Mercedes with $ 250,000 worth of valuables .


fn_spacy_tokens_for_baseline: Improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

source_bert_toks: improved export control laws and enforcement have addressed many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .

reference_raw: Improved export control legislation and enforcement have tackled many (but not all) concerns about nuclear and chemical weapons - related proliferation.

reference_spacy_tokens: Improved export control legislation and enforcement have tackled many ( but not all ) concerns about nuclear and chemical weapons - related proliferation .


fn_spacy_tokens_for_baseline: In joining SCS , you join the ranks of those who believe that bringing art and art education to the city makes life better , richer , and more rewarding for the entire community .

source_bert_toks: in joining sc ##s , you join the ranks of those who believe that bringing art and art education to the city makes life better , richer , and more reward ##ing for the entire community .

reference_raw: When you join the SCS, you join the ranks of those who believe that bringing art and art into the city makes life better, more rich, and more rewarding for the whole community.

reference_spacy_tokens: When you join the SCS , you join the ranks of those who believe that bringing art and art into the city makes life better , more rich , and more rewarding for the whole community .


fn_spacy_tokens_for_baseline: A fire chief working in Saudi Arabia is to be publicly flogged for breaking the country 's alcohol laws .

source_bert_toks: a fire chief working in saudi arabia is to be publicly fl ##og ##ged for breaking the country ' s alcohol laws .

reference_raw: The fire chief who works in Saudi Arabia will be publicly whipped for violating the country's alcohol laws.

reference_spacy_tokens: The fire chief who works in Saudi Arabia will be publicly whipped for violating the country 's alcohol laws .


fn_spacy_tokens_for_baseline: In 1984 , South Korea supplied Iran with copies of the Finnish Kemira respirators , which proved to be deficient .

source_bert_toks: in 1984 , south korea supplied iran with copies of the finnish ke ##mir ##a res ##pi ##rator ##s , which proved to be def ##icient .

reference_raw: In 1984, South Korea provided Iran with copies of Kemira respirators in Finland, which proved inadequate.

reference_spacy_tokens: In 1984 , South Korea provided Iran with copies of Kemira respirators in Finland , which proved inadequate .


fn_spacy_tokens_for_baseline: Some 15 - 40 % of patients taking it long term develop an asymptomatic hepatic dysfunction , which is both dose dependent and reversible on stopping treatment .

source_bert_toks: some 15 - 40 % of patients taking it long term develop an as ##ym ##pt ##oma ##tic he ##pati ##c dysfunction , which is both dose dependent and rev ##ers ##ible on stopping treatment .

reference_raw: Approximately 15-40% of patients taking it for a long period have an asymptomatic liver dysfunction that depends on dose and is reversible when treatment is stopped.

reference_spacy_tokens: Approximately 15 - 40 % of patients taking it for a long period have an asymptomatic liver dysfunction that depends on dose and is reversible when treatment is stopped .


fn_spacy_tokens_for_baseline: A federal magistrate informed Pickett of the charges against him --assaulting a federal officer with a deadly weapon , which carries a maximum 10 years in prison .

source_bert_toks: a federal magistrate informed picket ##t of the charges against him - - assault ##ing a federal officer with a deadly weapon , which carries a maximum 10 years in prison .

reference_raw: The federal judge informed Pickett of the charges against him - attacking a federal officer with a murder weapon that carries a maximum of 10 years in prison.

reference_spacy_tokens: The federal judge informed Pickett of the charges against him - attacking a federal officer with a murder weapon that carries a maximum of 10 years in prison .


fn_spacy_tokens_for_baseline: A BRITISH Airways crew feared they would be sucked out of the cockpit when the windscreen shattered at 33,000 ft yesterday .

source_bert_toks: a british airways crew feared they would be sucked out of the cockpit when the winds ##creen shattered at 33 , 000 ft yesterday .

reference_raw: The crew of BRITISH Airways feared they'd be sucked out of the cockpit when the windshield broke at 33,000 feet yesterday.

reference_spacy_tokens: The crew of BRITISH Airways feared they 'd be sucked out of the cockpit when the windshield broke at 33,000 feet yesterday .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frantic speed of rush hour, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frantic speed of rush hour , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: The curved and shadowed drive led us to a low , dark house , pitchblack against a slate - coloured sky .

source_bert_toks: the curved and shadowed drive led us to a low , dark house , pitch ##bla ##ck against a slate - coloured sky .

reference_raw: The curved and shadowed drive led us to a low, dark house, black against the slate-colored sky.

reference_spacy_tokens: The curved and shadowed drive led us to a low , dark house , black against the slate - colored sky .


fn_spacy_tokens_for_baseline: A circular piece of white lint was pinned over his heart as an aiming point and the firing squad , of the Scots Guards , opened fire .

source_bert_toks: a circular piece of white lin ##t was pinned over his heart as an aiming point and the firing squad , of the scots guards , opened fire .

reference_raw: A round piece of white lint had been pinned over his heart as a point of aim, and the Scottish Guard shooting squad had begun.

reference_spacy_tokens: A round piece of white lint had been pinned over his heart as a point of aim , and the Scottish Guard shooting squad had begun .


fn_spacy_tokens_for_baseline: The latest squabble between supermarkets and banks over the latter 's unilateral decision to hoist transaction charges may of course make debit cards less attractive to consumers if the charges end up being passed on .

source_bert_toks: the latest sq ##ua ##bble between supermarkets and banks over the latter ' s un ##ila ##tera ##l decision to ho ##ist transaction charges may of course make de ##bit cards less attractive to consumers if the charges end up being passed on .

reference_raw: Of course, the last argument between supermarkets and banks about a unilateral decision to raise transaction charges may make debit cards less attractive to consumers if the charges are eventually passed on.

reference_spacy_tokens: Of course , the last argument between supermarkets and banks about a unilateral decision to raise transaction charges may make debit cards less attractive to consumers if the charges are eventually passed on .


fn_spacy_tokens_for_baseline: A 25-mile strip of rich muckland south of the lake was designated for sugar - cane plantations , to be drained and flooded by huge pumps .

source_bert_toks: a 25 - mile strip of rich mu ##ck ##land south of the lake was designated for sugar - cane plantations , to be drained and flooded by huge pumps .

reference_raw: A 25-mile strip of rich muckland south of the lake has been designated for sugar cane plantations, which will be drained and watered by large pumps.

reference_spacy_tokens: A 25-mile strip of rich muckland south of the lake has been designated for sugar cane plantations , which will be drained and watered by large pumps .


fn_spacy_tokens_for_baseline: And it 's not as if she and I have had to deal with really bad cases -- like those men who go regularly for facials .

source_bert_toks: and it ' s not as if she and i have had to deal with really bad cases - - like those men who go regularly for facial ##s .

reference_raw: And it's not like we've had to deal with really bad cases, like the men who go to see faces on a regular basis.

reference_spacy_tokens: And it 's not like we 've had to deal with really bad cases , like the men who go to see faces on a regular basis .


fn_spacy_tokens_for_baseline: She had confidently expected to convalesce with her brother and his wife , but they had made no offer , indeed nothing but excuses .

source_bert_toks: she had confidently expected to con ##vale ##sc ##e with her brother and his wife , but they had made no offer , indeed nothing but excuses .

reference_raw: She had confidently expected to convene with her brother and his wife, but they had offered nothing, no more than excuses.

reference_spacy_tokens: She had confidently expected to convene with her brother and his wife , but they had offered nothing , no more than excuses .


fn_spacy_tokens_for_baseline: As he lies back in his armchair , grey hair falling across his brow and his fingertips steepled on his chest , he gives a rehearsed explanation .

source_bert_toks: as he lies back in his armchair , grey hair falling across his brow and his fingertips steep ##led on his chest , he gives a re ##hear ##sed explanation .

reference_raw: As he lay back in his chair, his gray hair falling over his forehead, his fingers falling over his chest, he gave a rehearsed explanation.

reference_spacy_tokens: As he lay back in his chair , his gray hair falling over his forehead , his fingers falling over his chest , he gave a rehearsed explanation .


fn_spacy_tokens_for_baseline: At night the streets are crowded with people bent on having a good time .

source_bert_toks: at night the streets are crowded with people bent on having a good time .

reference_raw: In the middle of the night, the streets are full of people who want to have fun.

reference_spacy_tokens: In the middle of the night , the streets are full of people who want to have fun .


fn_spacy_tokens_for_baseline: Browsing is a real pleasure in Macau 's main streets and byways , where shops aimed at the tourist market are interspersed with the more workaday ironmongers , herbalists , and noodle stalls .

source_bert_toks: brows ##ing is a real pleasure in macau ' s main streets and by ##ways , where shops aimed at the tourist market are interspersed with the more work ##aday iron ##mon ##gers , herbal ##ists , and no ##odle stalls .

reference_raw: Browsing is a real joy in the main streets and byways of Macao, where shops aimed at the tourist market are intertwined with more day-to-day ironmongers, herbalists, and noodle stalls.

reference_spacy_tokens: Browsing is a real joy in the main streets and byways of Macao , where shops aimed at the tourist market are intertwined with more day - to - day ironmongers , herbalists , and noodle stalls .


fn_spacy_tokens_for_baseline: She was cold and tired ; the oilskin had kept her shoulders dry but her socks were drenched and the turn - ups of her shorts flapped wetly against her knees .

source_bert_toks: she was cold and tired ; the oils ##kin had kept her shoulders dry but her socks were drenched and the turn - ups of her shorts flap ##ped wet ##ly against her knees .

reference_raw: She was cold and tired; the oil skin kept her shoulders dry, but her socks were soaked and her shorts flapped wetly on her knees.

reference_spacy_tokens: She was cold and tired ; the oil skin kept her shoulders dry , but her socks were soaked and her shorts flapped wetly on her knees .


fn_spacy_tokens_for_baseline: They sloshed through the mudholes and stepping stones of the twilight subway , nudging each other with a staccato of Derek questions and Alex answers until city grey daylight .

source_bert_toks: they sl ##osh ##ed through the mud ##holes and stepping stones of the twilight subway , nu ##d ##ging each other with a st ##ac ##cat ##o of derek questions and alex answers until city grey daylight .

reference_raw: They glided through the mudholes and stepping stones of the dusk subway, prodding each other with a staccato of Derek's questions, and Alex answers until the gray day of the city.

reference_spacy_tokens: They glided through the mudholes and stepping stones of the dusk subway , prodding each other with a staccato of Derek 's questions , and Alex answers until the gray day of the city .


fn_spacy_tokens_for_baseline: The cause of death was given as a combined overdose of barbiturates and alcohol .

source_bert_toks: the cause of death was given as a combined overdose of bar ##bit ##ura ##tes and alcohol .

reference_raw: The cause of death was administered in combination with a barbiturate and alcohol overdose.

reference_spacy_tokens: The cause of death was administered in combination with a barbiturate and alcohol overdose .


fn_spacy_tokens_for_baseline: The stone struck the wooden window surround and fell back hitting the metal cover of the rainwater butt with a loud clang .

source_bert_toks: the stone struck the wooden window surround and fell back hitting the metal cover of the rain ##water butt with a loud clan ##g .

reference_raw: The stone struck the wooden window around it and fell back against the metal cover of the rain-water butt with a loud click.

reference_spacy_tokens: The stone struck the wooden window around it and fell back against the metal cover of the rain - water butt with a loud click .


fn_spacy_tokens_for_baseline: Because people want to work .

source_bert_toks: because people want to work .

reference_raw: 'Cause people want to work.

reference_spacy_tokens: 'Cause people want to work .


fn_spacy_tokens_for_baseline: Most pool owners are thrilled if they can persuade their fish to breed successfully .

source_bert_toks: most pool owners are thrilled if they can persuade their fish to breed successfully .

reference_raw: Most pool owners are excited to convince their fish to breed successfully.

reference_spacy_tokens: Most pool owners are excited to convince their fish to breed successfully .


fn_spacy_tokens_for_baseline: 5 - 82 ) , and fair for those looking at pain ( 45 .

reference_raw: 5-82) and just for those who experience pain (45.

reference_spacy_tokens: 5 - 82 ) and just for those who experience pain ( 45 .


fn_spacy_tokens_for_baseline: It also welcomed these republics ' affirmation of ' their readiness to respect the international commitments of the Soviet Union and to ensure single control of nuclear weapons on their territory ' [ see p. 38655].

source_bert_toks: it also welcomed these republics ' af ##firm ##ation of ' their readiness to respect the international commitments of the soviet union and to ensure single control of nuclear weapons on their territory ' [ see p . 38 ##65 ##5 ] .

reference_raw: It also welcomed the confirmation by the Republics of their readiness to respect the international obligations of the Soviet Union and to ensure uniform control of nuclear weapons in their territory [see p. 38655].

reference_spacy_tokens: It also welcomed the confirmation by the Republics of their readiness to respect the international obligations of the Soviet Union and to ensure uniform control of nuclear weapons in their territory [ see p. 38655].


fn_spacy_tokens_for_baseline: The 2nd Cavalry Regiment [ at Fort Lewis ] recently received three vehicles that can detect radiation or biological and chemical hazards while keeping the soldiers safe inside .

source_bert_toks: the 2nd cavalry regiment [ at fort lewis ] recently received three vehicles that can detect radiation or biological and chemical hazards while keeping the soldiers safe inside .

reference_raw: The 2nd Cavalry Regiment [at Fort Lewis] has recently received three vehicles that can detect radiation or biological and chemical hazards while keeping the troops safe inside.

reference_spacy_tokens: The 2nd Cavalry Regiment [ at Fort Lewis ] has recently received three vehicles that can detect radiation or biological and chemical hazards while keeping the troops safe inside .


fn_spacy_tokens_for_baseline: The steps passed along the path on the other side of the wall under which I crouched .

source_bert_toks: the steps passed along the path on the other side of the wall under which i crouched .

reference_raw: The stairs crossed the path on the other side of the wall where I crouched.

reference_spacy_tokens: The stairs crossed the path on the other side of the wall where I crouched .


fn_spacy_tokens_for_baseline: The casinos have no admission charge and formal dress is optional , though long pants for men are required .

source_bert_toks: the casinos have no admission charge and formal dress is optional , though long pants for men are required .

reference_raw: Casinos have no admission fee and formal clothing is optional, although long trousers are required for men.

reference_spacy_tokens: Casinos have no admission fee and formal clothing is optional , although long trousers are required for men .


fn_spacy_tokens_for_baseline: One of the biologists ' jobs , according to chief scientist Bernard Courtney , will be to create pathogens to match strains that terrorists are clandestinely producing and then develop vaccines and drugs to combat them .

source_bert_toks: one of the biologist ##s ' jobs , according to chief scientist bernard courtney , will be to create pathogen ##s to match strains that terrorists are clandestine ##ly producing and then develop vaccines and drugs to combat them .

reference_raw: According to Chief Scientist Bernard Courtney, one of the roles of biologists is to create pathogens to match the strains that terrorists secretly produce and then develop vaccines and drugs to fight them.

reference_spacy_tokens: According to Chief Scientist Bernard Courtney , one of the roles of biologists is to create pathogens to match the strains that terrorists secretly produce and then develop vaccines and drugs to fight them .


fn_spacy_tokens_for_baseline: Walden thinks Lukas - trained Grand Slam , who is 4 for 4 at Belmont and 0 for 4 elsewhere , must be respected because of that statistic .

source_bert_toks: walden thinks lukas - trained grand slam , who is 4 for 4 at belmont and 0 for 4 elsewhere , must be respected because of that stat ##istic .

reference_raw: Walden is of the opinion that the Lukas-trained Grand Slam, which is four for four in Belmont and zero for four in other places, must be observed for this statistics.

reference_spacy_tokens: Walden is of the opinion that the Lukas - trained Grand Slam , which is four for four in Belmont and zero for four in other places , must be observed for this statistics .


fn_spacy_tokens_for_baseline: Fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

source_bert_toks: fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

reference_raw: Luckily, the same parents want their children to have a decent education, as traditionally understood, and they have enough common sense to know what it requires.

reference_spacy_tokens: Luckily , the same parents want their children to have a decent education , as traditionally understood , and they have enough common sense to know what it requires .


fn_spacy_tokens_for_baseline: ' If you 'd like to come this way , Mrs Bouverie , I 'll show you the warehouse and the rest room . '

source_bert_toks: ' if you ' d like to come this way , mrs bo ##uve ##rie , i ' ll show you the warehouse and the rest room . '

reference_raw: "If that's the way you want to go, Mrs. Bouverie, I'll show you the warehouse and the restroom."

reference_spacy_tokens: " If that 's the way you want to go , Mrs. Bouverie , I 'll show you the warehouse and the restroom . "


fn_spacy_tokens_for_baseline: Kowloon 's main street was created by Sir Matthew Nathan when he was governor of Hong Kong at the turn of the 19th century .

source_bert_toks: ko ##wl ##oon ' s main street was created by sir matthew nathan when he was governor of hong kong at the turn of the 19th century .

reference_raw: The main street of Kowloon was created by Sir Matthew Nathan when he was Governor of Hong Kong in the late 19th century.

reference_spacy_tokens: The main street of Kowloon was created by Sir Matthew Nathan when he was Governor of Hong Kong in the late 19th century .


fn_spacy_tokens_for_baseline: Figure 4.4 shows the result of a quantitative analysis of // realizations in two Belfast outer - city communities ( Andersonstown and Braniel ) and a smaller town ( Lurgan ) situated 17 miles southwest of Belfast .

source_bert_toks: figure 4 . 4 shows the result of a quantitative analysis of / / realization ##s in two belfast outer - city communities ( anderson ##stown and bran ##iel ) and a smaller town ( lu ##rgan ) situated 17 miles southwest of belfast .

reference_raw: Figure 4.4 shows the results of a quantitative analysis of // implementation in two Belfast suburban communities (Andersonstown and Braniel) and a small town (Lurgan) located 17 miles south-west of Belfast.

reference_spacy_tokens: Figure 4.4 shows the results of a quantitative analysis of // implementation in two Belfast suburban communities ( Andersonstown and Braniel ) and a small town ( Lurgan ) located 17 miles south - west of Belfast .


fn_spacy_tokens_for_baseline: The Romans believed the amethyst prevented drunkenness and used to drink out of goblets studded with these purple gems .

source_bert_toks: the romans believed the am ##eth ##yst prevented drunken ##ness and used to drink out of go ##ble ##ts stud ##ded with these purple gems .

reference_raw: The Romans believed that the amethyst prevented drunkenness and drank from cups stuffed with these purple jewels.

reference_spacy_tokens: The Romans believed that the amethyst prevented drunkenness and drank from cups stuffed with these purple jewels .


fn_spacy_tokens_for_baseline: No time to shout out -- the door clunked behind him .

source_bert_toks: no time to shout out - - the door cl ##unk ##ed behind him .

reference_raw: There was no time to scream - the door clicked behind him.

reference_spacy_tokens: There was no time to scream - the door clicked behind him .


fn_spacy_tokens_for_baseline: So he wisely avoided a clash of horns in front of the herd .

source_bert_toks: so he wise ##ly avoided a clash of horns in front of the herd .

reference_raw: So he wisely avoided the clank of horns in front of the herd.

reference_spacy_tokens: So he wisely avoided the clank of horns in front of the herd .


fn_spacy_tokens_for_baseline: ' Quiet please , ' hissed Bunny .

source_bert_toks: ' quiet please , ' hissed bunny .

reference_raw: 'Shut up, please,' Bunny hissed.

reference_spacy_tokens: ' Shut up , please , ' Bunny hissed .


fn_spacy_tokens_for_baseline: He was coming out of the bank , and I nearly peeped the horn to let him know I was there .

source_bert_toks: he was coming out of the bank , and i nearly pee ##ped the horn to let him know i was there .

reference_raw: He was leaving the bank, and I almost peeked at the corner to tell him I was there.

reference_spacy_tokens: He was leaving the bank , and I almost peeked at the corner to tell him I was there .


fn_spacy_tokens_for_baseline: Mr Spicer declined to disclose details .

source_bert_toks: mr spice ##r declined to disclose details .

reference_raw: Mr. Spicer refused to disclose the details.

reference_spacy_tokens: Mr. Spicer refused to disclose the details .


fn_spacy_tokens_for_baseline: William , busily digging some unrecognizable vegetable out of the mud , was wearing gumboots and the jaunty remnants of a straw hat .

source_bert_toks: william , bus ##ily digging some un ##re ##co ##gni ##za ##ble vegetable out of the mud , was wearing gum ##boot ##s and the ja ##unt ##y remnants of a straw hat .

reference_raw: William, who was busy digging some unrecognizable vegetable out of the mud, wore rubber boots and the jaunted remains of a straw hat.

reference_spacy_tokens: William , who was busy digging some unrecognizable vegetable out of the mud , wore rubber boots and the jaunted remains of a straw hat .


fn_spacy_tokens_for_baseline: It is possible that NORAD commanders would have ordered a shootdown in the absence of the authorization communicated by the Vice President , but given the gravity of the decision to shoot down a commercial airliner , and NORAD 's caution that a mistake not be made , we view this possibility as unlikely .

source_bert_toks: it is possible that nora ##d commanders would have ordered a shoot ##down in the absence of the authorization communicated by the vice president , but given the gravity of the decision to shoot down a commercial airline ##r , and nora ##d ' s caution that a mistake not be made , we view this possibility as unlikely .

reference_raw: It is possible that the NORAD commanders would have ordered a shooting without the permission of the Vice-President, but given the seriousness of the decision to shoot down a commercial airliner and NORAD's warning that there was no mistake, we consider that this possibility is unlikely.

reference_spacy_tokens: It is possible that the NORAD commanders would have ordered a shooting without the permission of the Vice - President , but given the seriousness of the decision to shoot down a commercial airliner and NORAD 's warning that there was no mistake , we consider that this possibility is unlikely .


fn_spacy_tokens_for_baseline: The fires sucked oxygen in from the outer suburbs until a raging inferno had been created in which temperatures rose so high that steel ran like water and concrete exploded like bombs .

source_bert_toks: the fires sucked oxygen in from the outer suburbs until a raging inferno had been created in which temperatures rose so high that steel ran like water and concrete exploded like bombs .

reference_raw: Fires sucked in oxygen from the outskirts of the outer suburbs, creating a raging hell where the temperatures rose so high that steel ran like water and concrete exploded like bombs.

reference_spacy_tokens: Fires sucked in oxygen from the outskirts of the outer suburbs , creating a raging hell where the temperatures rose so high that steel ran like water and concrete exploded like bombs .


fn_spacy_tokens_for_baseline: " Coming to Goodwill was the first step toward my becoming totally independent .

source_bert_toks: " coming to goodwill was the first step toward my becoming totally independent .

reference_raw: "Coming to Goodwill was the first step in making me completely independent."

reference_spacy_tokens: " Coming to Goodwill was the first step in making me completely independent . "


fn_spacy_tokens_for_baseline: Each biopsy specimen was sectioned into four pieces and immediately frozen in a drop of methylbutane in liquid nitrogen and kept at -80 ° C for subsequent studies .

source_bert_toks: each bio ##psy specimen was section ##ed into four pieces and immediately frozen in a drop of methyl ##bu ##tan ##e in liquid nitrogen and kept at - 80 ##° ##c for subsequent studies .

reference_raw: Each biopsy sample was divided into four pieces and immediately frozen in a drop of methylbutane in liquid nitrogen and stored at -80°C for further studies.

reference_spacy_tokens: Each biopsy sample was divided into four pieces and immediately frozen in a drop of methylbutane in liquid nitrogen and stored at -80 ° C for further studies .


fn_spacy_tokens_for_baseline: THE SNORTING TRAIN sent steam swirling through the buzzing crowd of people as they swarmed from the platform into the open wagons drawn up at Leicester station .

source_bert_toks: the snort ##ing train sent steam swirling through the buzzing crowd of people as they swarm ##ed from the platform into the open wagons drawn up at leicester station .

reference_raw: SNORTING TRAIN sent steam swirling through the humming crowd of people as they emerged from the platform into the open wagons parked at Leicester Station.

reference_spacy_tokens: SNORTING TRAIN sent steam swirling through the humming crowd of people as they emerged from the platform into the open wagons parked at Leicester Station .


fn_spacy_tokens_for_baseline: The popular phrase " Soon come " indicates an apparent lack of concern about time and an unhurried attitude to daily tasks .

source_bert_toks: the popular phrase " soon come " indicates an apparent lack of concern about time and an un ##hur ##ried attitude to daily tasks .

reference_raw: The popular phrase "Soon Coming" suggests a clear lack of concern about time and an unhurried approach to day-to-day tasks.

reference_spacy_tokens: The popular phrase " Soon Coming " suggests a clear lack of concern about time and an unhurried approach to day - to - day tasks .


fn_spacy_tokens_for_baseline: Use a stick or cream concealer under eyes to disguise dark circles , or try a touch of paler - toned foundation .

source_bert_toks: use a stick or cream conceal ##er under eyes to disguise dark circles , or try a touch of paler - toned foundation .

reference_raw: Use the stick or cream cover under the eyes to cover the dark circles, or try the touch of the paler-toned base.

reference_spacy_tokens: Use the stick or cream cover under the eyes to cover the dark circles , or try the touch of the paler - toned base .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali shooters who hijacked a United Nations chartered ship carrying food aid to victims of tsunamis released the ship after holding it for more than two months.

reference_spacy_tokens: According to the United Nations , Somali shooters who hijacked a United Nations chartered ship carrying food aid to victims of tsunamis released the ship after holding it for more than two months .


fn_spacy_tokens_for_baseline: Estimates vary on how soon North Korea could begin operating a uranium enrichment plant , but North Korea probably could not produce significant quantities of weapons - grade HEU until the end of the decade .

source_bert_toks: estimates vary on how soon north korea could begin operating a uranium enrichment plant , but north korea probably could not produce significant quantities of weapons - grade he ##u until the end of the decade .

reference_raw: Estimates differ as to how soon North Korea can start running a uranium enrichment plant, but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade.

reference_spacy_tokens: Estimates differ as to how soon North Korea can start running a uranium enrichment plant , but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade .


fn_spacy_tokens_for_baseline: Saturday 's quintet gave him the remarkable tally of 15 wins from the 35 races run on the Flat in Ireland in 1992 .

source_bert_toks: saturday ' s quintet gave him the remarkable tally of 15 wins from the 35 races run on the flat in ireland in 1992 .

reference_raw: Saturday's quintet gave him a remarkable sum of 15 wins from the 35 races that ran on the flat in Ireland in 1992.

reference_spacy_tokens: Saturday 's quintet gave him a remarkable sum of 15 wins from the 35 races that ran on the flat in Ireland in 1992 .


fn_spacy_tokens_for_baseline: However , sometimes it seems that the city produced artists of this stature by accident , even against its will .

source_bert_toks: however , sometimes it seems that the city produced artists of this stature by accident , even against its will .

reference_raw: Sometimes, however, the city seems to have created artists of this stature by accident, even against its wishes.

reference_spacy_tokens: Sometimes , however , the city seems to have created artists of this stature by accident , even against its wishes .


fn_spacy_tokens_for_baseline: I was to see that the doors were open and the signal of a green or white light in a window which faced the drive was to give notice if all was safe or if the attempt had better be postponed .

source_bert_toks: i was to see that the doors were open and the signal of a green or white light in a window which faced the drive was to give notice if all was safe or if the attempt had better be postponed .

reference_raw: I had to make sure that the door was open and that the sign of a green or white light in the window facing the driveway was to let me know if everything was safe or if the attempt had to be postponed.

reference_spacy_tokens: I had to make sure that the door was open and that the sign of a green or white light in the window facing the driveway was to let me know if everything was safe or if the attempt had to be postponed .


fn_spacy_tokens_for_baseline: North Korea appears to have emphasized the weaponization of mustard , phosgene , sarin , and V - type chemical agents .

source_bert_toks: north korea appears to have emphasized the weapon ##ization of mustard , ph ##os ##gen ##e , sar ##in , and v - type chemical agents .

reference_raw: North Korea seems to have underscored the weaponization of mustard, phosgene, sarin, and V-type chemicals.

reference_spacy_tokens: North Korea seems to have underscored the weaponization of mustard , phosgene , sarin , and V - type chemicals .


fn_spacy_tokens_for_baseline: But the Roman Empire became Christian in the fourth century , and Jerusalem became a center of religion once again .

source_bert_toks: but the roman empire became christian in the fourth century , and jerusalem became a center of religion once again .

reference_raw: But in the fourth century, the Roman Reich became a Christian, and Jerusalem was once again the center of religion.

reference_spacy_tokens: But in the fourth century , the Roman Reich became a Christian , and Jerusalem was once again the center of religion .


fn_spacy_tokens_for_baseline: Patsy and Jimmy were both showing a bit of their dad 's toughness .

source_bert_toks: patsy and jimmy were both showing a bit of their dad ' s tough ##ness .

reference_raw: Patsy and Jimmy showed some of their father's hardness.

reference_spacy_tokens: Patsy and Jimmy showed some of their father 's hardness .


fn_spacy_tokens_for_baseline: Laura 's frequent absences in London meant that her baby , Emma , was often left behind with Gwenny Hughes .

source_bert_toks: laura ' s frequent absence ##s in london meant that her baby , emma , was often left behind with gwen ##ny hughes .

reference_raw: Laura's frequent absenteeism in London meant that her child, Emma, was often left behind with Gwenny Hughes.

reference_spacy_tokens: Laura 's frequent absenteeism in London meant that her child , Emma , was often left behind with Gwenny Hughes .


fn_spacy_tokens_for_baseline: The curves and lines are strange and disorientating , giving the viewer an unpleasant feeling of unease and distraction , but nothing more .

source_bert_toks: the curves and lines are strange and di ##sor ##ient ##ating , giving the viewer an unpleasant feeling of unease and distraction , but nothing more .

reference_raw: The curvatures and lines are strange and disorienting, giving the viewer an uncomfortable feeling of uneasiness and distraction, but that's all.

reference_spacy_tokens: The curvatures and lines are strange and disorienting , giving the viewer an uncomfortable feeling of uneasiness and distraction , but that 's all .


fn_spacy_tokens_for_baseline: They did , however , find a higher rate of deviance in communication style , particularly among fathers , which was largely accounted for by overtalkativeness .

source_bert_toks: they did , however , find a higher rate of devi ##ance in communication style , particularly among fathers , which was largely accounted for by over ##talk ##ative ##ness .

reference_raw: But they found a higher degree of deviance in communication style, especially among fathers, largely due to overtalkativeness.

reference_spacy_tokens: But they found a higher degree of deviance in communication style , especially among fathers , largely due to overtalkativeness .


fn_spacy_tokens_for_baseline: LONDON ( AP ) --- The feud between the International Tennis Federation and the ATP Tour escalated Thursday over proposals for a new men 's circuit .

source_bert_toks: london ( ap ) - - - the feud between the international tennis federation and the atp tour escalated thursday over proposals for a new men ' s circuit .

reference_raw: LONDON (AP) -- The fight between the International Tennis Federation and the ATP Tour escalated on Thursday over the design of the new Men's Circle.

reference_spacy_tokens: LONDON ( AP ) -- The fight between the International Tennis Federation and the ATP Tour escalated on Thursday over the design of the new Men 's Circle .


fn_spacy_tokens_for_baseline: He subsequently bequeathed the results of his research to Cambridge University .

source_bert_toks: he subsequently bequeathed the results of his research to cambridge university .

reference_raw: Then he left the results of his research to the University of Cambridge.

reference_spacy_tokens: Then he left the results of his research to the University of Cambridge .


fn_spacy_tokens_for_baseline: Elinor twisted and swayed and twirled , her blue eyes blazing , the wick having been set afire by Aunt Bedelia .

source_bert_toks: eli ##nor twisted and swayed and t ##wi ##rled , her blue eyes blazing , the wi ##ck having been set afi ##re by aunt bed ##elia .

reference_raw: Elinor turned, swaying and twisting, her blue eyes blazing, and Aunt Bedelia set the wick on fire.

reference_spacy_tokens: Elinor turned , swaying and twisting , her blue eyes blazing , and Aunt Bedelia set the wick on fire .


fn_spacy_tokens_for_baseline: This is the closest the British pension system has got to earnings sharing between spouses , and it does not apply to men and women whose marriages end in divorce .

source_bert_toks: this is the closest the british pension system has got to earnings sharing between spouse ##s , and it does not apply to men and women whose marriages end in divorce .

reference_raw: This is the closest the British pension system has to a share of earnings between husbands, and it does not apply to men and women whose marriages end in divorce.

reference_spacy_tokens: This is the closest the British pension system has to a share of earnings between husbands , and it does not apply to men and women whose marriages end in divorce .


fn_spacy_tokens_for_baseline: The northernmost point in Macau is the frontier between two contrasting worlds .

source_bert_toks: the northernmost point in macau is the frontier between two contrasting worlds .

reference_raw: The northernmost place in Macao is the border between two contrasting worlds.

reference_spacy_tokens: The northernmost place in Macao is the border between two contrasting worlds .


fn_spacy_tokens_for_baseline: Mayne 's plan was to take his fighting patrols out into the Great Sand Sea and establish a forward base , from which they could sally out and harass the enemy .

source_bert_toks: may ##ne ' s plan was to take his fighting patrols out into the great sand sea and establish a forward base , from which they could sally out and hara ##ss the enemy .

reference_raw: Mayne's plan was to take his combat patrols to the Great Sand Sea and set up a forward base where they could attack and harass the enemy.

reference_spacy_tokens: Mayne 's plan was to take his combat patrols to the Great Sand Sea and set up a forward base where they could attack and harass the enemy .


fn_spacy_tokens_for_baseline: ' I tell you what , ' he clucks , pulling up his trousers .

source_bert_toks: ' i tell you what , ' he cl ##uck ##s , pulling up his trousers .

reference_raw: "I'll tell you what," he says, pulling up his pants.

reference_spacy_tokens: " I 'll tell you what , " he says , pulling up his pants .


fn_spacy_tokens_for_baseline: As a course this demands a very full timetable , but it offers strongly - motivated students an opportunity to develop in parallel the intellectual and practical sides of their study of art .

source_bert_toks: as a course this demands a very full timetable , but it offers strongly - motivated students an opportunity to develop in parallel the intellectual and practical sides of their study of art .

reference_raw: This requires a very complete schedule as a course, but offers highly motivated students the opportunity to develop at the same time the intellectual and practical aspects of their art studies.

reference_spacy_tokens: This requires a very complete schedule as a course , but offers highly motivated students the opportunity to develop at the same time the intellectual and practical aspects of their art studies .


fn_spacy_tokens_for_baseline: Politicians , trade union leaders and other assorted worthies leapt to the company 's defence , with impassioned declarations that its break - up at Hanson 's hands would be a national calamity .

source_bert_toks: politicians , trade union leaders and other ass ##orted worth ##ies leapt to the company ' s defence , with imp ##ass ##ioned declaration ##s that its break - up at hanson ' s hands would be a national cal ##ami ##ty .

reference_raw: Politicians, trade union leaders, and other assorted worthies leapt to the defense of the company, making an impassive statement that the breakup at Hanson's hands would be a national disaster.

reference_spacy_tokens: Politicians , trade union leaders , and other assorted worthies leapt to the defense of the company , making an impassive statement that the breakup at Hanson 's hands would be a national disaster .


fn_spacy_tokens_for_baseline: Such groups engage in violent attacks against civilian targets with the aim of influencing public opinion and applying pressure on government officials .

source_bert_toks: such groups engage in violent attacks against civilian targets with the aim of influencing public opinion and applying pressure on government officials .

reference_raw: These groups engage in violent attacks against civilian targets in order to influence public policy and exert pressure on government officials.

reference_spacy_tokens: These groups engage in violent attacks against civilian targets in order to influence public policy and exert pressure on government officials .


fn_spacy_tokens_for_baseline: Again , a bundle of drinking straws glued together provides a realistic model .

source_bert_toks: again , a bundle of drinking straw ##s glued together provides a realistic model .

reference_raw: Once again, a bundle of drinking straws stuck together provides a realistic model.

reference_spacy_tokens: Once again , a bundle of drinking straws stuck together provides a realistic model .


fn_spacy_tokens_for_baseline: The monist can be as easily floored by awkward questions as the dualist .

source_bert_toks: the mon ##ist can be as easily floor ##ed by awkward questions as the dual ##ist .

reference_raw: A monist can be flattened with clumsy questions like a double.

reference_spacy_tokens: A monist can be flattened with clumsy questions like a double .


fn_spacy_tokens_for_baseline: Use a little royal icing to cement the two pieces of roof on to the sloping sides of the house , propping up the eaves with toothpicks too if necessary .

source_bert_toks: use a little royal ic ##ing to cement the two pieces of roof on to the sloping sides of the house , prop ##ping up the ea ##ves with tooth ##pic ##ks too if necessary .

reference_raw: Use a little royal icing to put two pieces of roof on the sloping sides of the house, and, if necessary, toothpicks on the eaves.

reference_spacy_tokens: Use a little royal icing to put two pieces of roof on the sloping sides of the house , and , if necessary , toothpicks on the eaves .


fn_spacy_tokens_for_baseline: Also emerging beneath the cliffs of the narrows is the railway , resolutely maintaining a level contour despite all the difficulties of the terrain .

source_bert_toks: also emerging beneath the cliffs of the narrows is the railway , res ##ol ##ute ##ly maintaining a level con ##tour despite all the difficulties of the terrain .

reference_raw: There is also a railroad under the cliffs of the narrows, which, despite the difficulty of the terrain, is determined to maintain a level contour.

reference_spacy_tokens: There is also a railroad under the cliffs of the narrows , which , despite the difficulty of the terrain , is determined to maintain a level contour .


fn_spacy_tokens_for_baseline: He was hatless , and passers - by looked curiously at this young man who seemed to know where he was going , yet strode absently .

source_bert_toks: he was hat ##less , and pass ##ers - by looked curiously at this young man who seemed to know where he was going , yet strode absently .

reference_raw: He had no hat, and passersby looked curiously at the young man, who seemed to know where he was going, but walked absently.

reference_spacy_tokens: He had no hat , and passersby looked curiously at the young man , who seemed to know where he was going , but walked absently .


fn_spacy_tokens_for_baseline: She would represent herself as an angel of light and make her kind master and benefactor a devil incarnate .

source_bert_toks: she would represent herself as an angel of light and make her kind master and benefactor a devil inca ##rna ##te .

reference_raw: She would be the angel of light and make her kind master and benefactor the devil.

reference_spacy_tokens: She would be the angel of light and make her kind master and benefactor the devil .


fn_spacy_tokens_for_baseline: I have to pick tea for money to buy food .

source_bert_toks: i have to pick tea for money to buy food .

reference_raw: To buy food, I have to choose tea for money.

reference_spacy_tokens: To buy food , I have to choose tea for money .


fn_spacy_tokens_for_baseline: US trade representative Carla Hills said : ' We have demonstrated extraordinary patience and are open to further negotiation in the 30 days before the tariffs become effective . '

source_bert_toks: us trade representative carla hills said : ' we have demonstrated extraordinary patience and are open to further negotiation in the 30 days before the tariffs become effective . '

reference_raw: American business representative Carla Hills said, "We have shown extreme patience and are open to further negotiations within 30 days of the entry into force of the tariffs."

reference_spacy_tokens: American business representative Carla Hills said , " We have shown extreme patience and are open to further negotiations within 30 days of the entry into force of the tariffs . "


fn_spacy_tokens_for_baseline: Most of the 2.2 billion pet - food cans sold each year are made from steel coated with tin .

source_bert_toks: most of the 2 . 2 billion pet - food cans sold each year are made from steel coated with tin .

reference_raw: Most of the 2.2 billion pet food cans sold each year are made of tin-coated steel.

reference_spacy_tokens: Most of the 2.2 billion pet food cans sold each year are made of tin - coated steel .


fn_spacy_tokens_for_baseline: Next door is the Hong Kong Space Museum and Theatre ( open Monday , Wednesday - Friday 1 - 9 pm ; Saturday , Sunday 10 am - 9 pm ; closed Tuesday ; admission HK$10 adults , HK$5 children ; separate admission to theater ) .

source_bert_toks: next door is the hong kong space museum and theatre ( open monday , wednesday - friday 1 - 9 pm ; saturday , sunday 10 am - 9 pm ; closed tuesday ; admission hk $ 10 adults , hk $ 5 children ; separate admission to theater ) .

reference_raw: Next door is the Hong Kong Space Museum and Theatre (Open Monday, Wednesday - Friday 1 - 9:00 on Saturday, Sunday 10 - 9:00 in the morning; Closure Tuesday; Acceptance of HK$10 adults, HK$5 children; separate admission to the theatre).

reference_spacy_tokens: Next door is the Hong Kong Space Museum and Theatre ( Open Monday , Wednesday - Friday 1 - 9:00 on Saturday , Sunday 10 - 9:00 in the morning ; Closure Tuesday ; Acceptance of HK$10 adults , HK$5 children ; separate admission to the theatre ) .


fn_spacy_tokens_for_baseline: The Funding sources are shrinking , but the needs grow explosively .

source_bert_toks: the funding sources are shrinking , but the needs grow explosive ##ly .

reference_raw: Funding resources are decreasing, but needs are growing rapidly.

reference_spacy_tokens: Funding resources are decreasing , but needs are growing rapidly .


fn_spacy_tokens_for_baseline: And , although the skin thickens in the sun to protect itself , it does n't on a sunbed .

source_bert_toks: and , although the skin thick ##ens in the sun to protect itself , it doesn ' t on a sun ##bed .

reference_raw: And even though the skin grows thicker in the sun to protect itself, it's not on the sunbed.

reference_spacy_tokens: And even though the skin grows thicker in the sun to protect itself , it 's not on the sunbed .


fn_spacy_tokens_for_baseline: Sporting matted hair , an unkempt beard and purple sneakers he even gave Charles and Diana a thumbs - up sign at the end of his performance .

source_bert_toks: sporting matt ##ed hair , an un ##ke ##mpt beard and purple sneakers he even gave charles and diana a thumbs - up sign at the end of his performance .

reference_raw: He even gave Charles and Diana a thumbs-up sign at the end of the show, splattered hair, unkempt beard, and purple sneakers.

reference_spacy_tokens: He even gave Charles and Diana a thumbs - up sign at the end of the show , splattered hair , unkempt beard , and purple sneakers .


fn_spacy_tokens_for_baseline: Poor education is a particular concern .

source_bert_toks: poor education is a particular concern .

reference_raw: Poor education is a special concern.

reference_spacy_tokens: Poor education is a special concern .


fn_spacy_tokens_for_baseline: In a city of such human proportions it is not surprising that parks and gardens abound for recreation and relaxation .

source_bert_toks: in a city of such human proportions it is not surprising that parks and gardens ab ##ound for recreation and relaxation .

reference_raw: In a city of such human proportions, it is not surprising that parks and gardens are bound for recreation and rest.

reference_spacy_tokens: In a city of such human proportions , it is not surprising that parks and gardens are bound for recreation and rest .


fn_spacy_tokens_for_baseline: She had no memory of hearing the long peal of the doorbell , of moving stiffly across the hall to answer it .

source_bert_toks: she had no memory of hearing the long pea ##l of the doorbell , of moving stiffly across the hall to answer it .

reference_raw: She couldn't remember hearing the long ringing of the bell, or moving stiffly across the hall to answer it.

reference_spacy_tokens: She could n't remember hearing the long ringing of the bell , or moving stiffly across the hall to answer it .


fn_spacy_tokens_for_baseline: They acquitted him of three further charges of indecency and one of buggery .

source_bert_toks: they acquitted him of three further charges of ind ##ece ##ncy and one of bug ##ger ##y .

reference_raw: He was absolved of three other charges of indecency, and one for indecency.

reference_spacy_tokens: He was absolved of three other charges of indecency , and one for indecency .


fn_spacy_tokens_for_baseline: Geography is housed in its own substantial buildings close to the centre of the University , the libraries and the colleges .

source_bert_toks: geography is housed in its own substantial buildings close to the centre of the university , the libraries and the colleges .

reference_raw: Geography is located in its own large buildings near the centre of the university, libraries and universities.

reference_spacy_tokens: Geography is located in its own large buildings near the centre of the university , libraries and universities .


fn_spacy_tokens_for_baseline: He is said to have prophesied the French Revolution , the Crimean War , two devastating world wars , the rise and fall of Hitler , and the rise and rise of the Arab wealth .

source_bert_toks: he is said to have prop ##hes ##ied the french revolution , the crimean war , two devastating world wars , the rise and fall of hitler , and the rise and rise of the arab wealth .

reference_raw: They say he predicted the French Revolution, the Crimean War, two devastating world wars, Hitler's rise and fall, and the rise and rise of Arab wealth.

reference_spacy_tokens: They say he predicted the French Revolution , the Crimean War , two devastating world wars , Hitler 's rise and fall , and the rise and rise of Arab wealth .


fn_spacy_tokens_for_baseline: It was the Smith and Wesson Chiefs Special revolver that he had first seen in the Number One dressing room of the Prince 's Theatre , Taunton .

source_bert_toks: it was the smith and wes ##son chiefs special revolver that he had first seen in the number one dressing room of the prince ' s theatre , taunton .

reference_raw: It was the Smith and Wesson Chiefs special pistol he'd first seen in the Prince's Theatre Number One closet, Taunton.

reference_spacy_tokens: It was the Smith and Wesson Chiefs special pistol he 'd first seen in the Prince 's Theatre Number One closet , Taunton .


fn_spacy_tokens_for_baseline: Inside , Ace folded one piece of plastic explosive round the corner that led into the anteroom , and placed the other above the altar .

source_bert_toks: inside , ace folded one piece of plastic explosive round the corner that led into the ant ##ero ##om , and placed the other above the altar .

reference_raw: Inside, Ace folded one piece of plastic explosive around the corner leading to the front room and placed the other over the altar.

reference_spacy_tokens: Inside , Ace folded one piece of plastic explosive around the corner leading to the front room and placed the other over the altar .


fn_spacy_tokens_for_baseline: The U.S. lawmaker got acquainted with the sufferings of the Iraqi children because of acute shortage of food and medicine as a direct result of the embargo , reported the Iraqi News Agency ( INA ) .

source_bert_toks: the u . s . law ##maker got acquainted with the suffering ##s of the iraqi children because of acute shortage of food and medicine as a direct result of the em ##bar ##go , reported the iraqi news agency ( ina ) .

reference_raw: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo, and reported it to the Iraqi News Agency.

reference_spacy_tokens: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo , and reported it to the Iraqi News Agency .


fn_spacy_tokens_for_baseline: Both matches resume tomorrow after a rest day today .

source_bert_toks: both matches resume tomorrow after a rest day today .

reference_raw: Both matches continue tomorrow after the rest of the day.

reference_spacy_tokens: Both matches continue tomorrow after the rest of the day .


fn_spacy_tokens_for_baseline: The prince looked rueful .

source_bert_toks: the prince looked rue ##ful .

reference_raw: The prince looked sad.

reference_spacy_tokens: The prince looked sad .


fn_spacy_tokens_for_baseline: In that film you see yourself falling over , grazing your knees quite badly and , not surprisingly , crying .

source_bert_toks: in that film you see yourself falling over , grazing your knees quite badly and , not surprisingly , crying .

reference_raw: In this movie, you see yourself falling over, scratching your knees pretty hard, and no wonder you're crying.

reference_spacy_tokens: In this movie , you see yourself falling over , scratching your knees pretty hard , and no wonder you 're crying .


fn_spacy_tokens_for_baseline: He parked and killed the engine .

source_bert_toks: he parked and killed the engine .

reference_raw: He parked the car and shut down the engine.

reference_spacy_tokens: He parked the car and shut down the engine .


fn_spacy_tokens_for_baseline: Particularly interesting is the collection of paintings and photographs of old Hong Kong .

source_bert_toks: particularly interesting is the collection of paintings and photographs of old hong kong .

reference_raw: The collection of paintings and pictures of old Hong Kong is particularly interesting.

reference_spacy_tokens: The collection of paintings and pictures of old Hong Kong is particularly interesting .


fn_spacy_tokens_for_baseline: The Alexandra Dry Dock was completed with measurements of 100.58 metres length , 14.48 metres breadth and 5.67 metres over the sill on Spring Tides .

source_bert_toks: the alexandra dry dock was completed with measurements of 100 . 58 metres length , 14 . 48 metres breadth and 5 . 67 metres over the si ##ll on spring tides .

reference_raw: The Alexandra Dry Dock has been completed by measuring 100.58 m long, 14.48 m wide and 5.67 m above the spring tide sill.

reference_spacy_tokens: The Alexandra Dry Dock has been completed by measuring 100.58 m long , 14.48 m wide and 5.67 m above the spring tide sill .


fn_spacy_tokens_for_baseline: This man has been seen since the crime , for he was detected and pursued by Constable Walters on the same evening , when he had the audacity to revisit Wisteria Lodge .

source_bert_toks: this man has been seen since the crime , for he was detected and pursued by constable walters on the same evening , when he had the au ##da ##city to rev ##isi ##t wi ##ster ##ia lodge .

reference_raw: This man has been seen since the crime, for he was found and pursued by Constable Walters on the same night, when he had the audacity to see Wisteria Lodge again.

reference_spacy_tokens: This man has been seen since the crime , for he was found and pursued by Constable Walters on the same night , when he had the audacity to see Wisteria Lodge again .


fn_spacy_tokens_for_baseline: If the law can do nothing we must take the risk ourselves . '

source_bert_toks: if the law can do nothing we must take the risk ourselves . '

reference_raw: If the law can't do anything, we have to take the chance ourselves.'

reference_spacy_tokens: If the law ca n't do anything , we have to take the chance ourselves . '


fn_spacy_tokens_for_baseline: On 18 December 1997 , the Islamic Republic News Agency ( IRNA ) reported that the Eastern railroad network , run by the Bonyad - e Mostazafan va Janbazan , has purchased 100 tank cars from Ukraine , specifically designed to transport highly toxic chemicals .

source_bert_toks: on 18 december 1997 , the islamic republic news agency ( ir ##na ) reported that the eastern railroad network , run by the bony ##ad - e most ##az ##af ##an va jan ##ba ##zan , has purchased 100 tank cars from ukraine , specifically designed to transport highly toxic chemicals .

reference_raw: On 18 December 1997, the Islamic Republic News Agency (IRNA) announced that the Eastern Rail Network, operated by Bonyad-e Mostazafan va Janbazan, had purchased 100 tank-cars from Ukraine, specifically designed for the transport of highly toxic chemicals.

reference_spacy_tokens: On 18 December 1997 , the Islamic Republic News Agency ( IRNA ) announced that the Eastern Rail Network , operated by Bonyad - e Mostazafan va Janbazan , had purchased 100 tank - cars from Ukraine , specifically designed for the transport of highly toxic chemicals .


fn_spacy_tokens_for_baseline: It seemed to Joan that the wedding - ring was burning her finger ; it caught the light , glistering brightly as if wishing to draw attention to the fact that it was embellishing an alien hand .

source_bert_toks: it seemed to joan that the wedding - ring was burning her finger ; it caught the light , g ##list ##ering brightly as if wishing to draw attention to the fact that it was em ##bell ##ishing an alien hand .

reference_raw: It seemed to Joan that the wedding ring was burning her finger; it caught the light and glittered brightly, as if to draw attention to the fact that she was embellishing an alien hand.

reference_spacy_tokens: It seemed to Joan that the wedding ring was burning her finger ; it caught the light and glittered brightly , as if to draw attention to the fact that she was embellishing an alien hand .


fn_spacy_tokens_for_baseline: But they determined to get rid forever of Garcia .

source_bert_toks: but they determined to get rid forever of garcia .

reference_raw: But they decided to get rid of Garcia forever.

reference_spacy_tokens: But they decided to get rid of Garcia forever .


fn_spacy_tokens_for_baseline: The discussions so far have yielded little , prompting experts to question whether the Iraqi government will ever compromise if there is no penalty for failing to make hard choices .

source_bert_toks: the discussions so far have yielded little , prompting experts to question whether the iraqi government will ever compromise if there is no penalty for failing to make hard choices .

reference_raw: Negotiations so far have yielded little, and have prompted experts to question whether the Iraqi government will ever threaten if there is no punishment for not making difficult decisions.

reference_spacy_tokens: Negotiations so far have yielded little , and have prompted experts to question whether the Iraqi government will ever threaten if there is no punishment for not making difficult decisions .


fn_spacy_tokens_for_baseline: Temperature normal , lungs clear , only rumenal atony and extreme tenderness as I palpated the abdomen .

source_bert_toks: temperature normal , lungs clear , only rum ##ena ##l at ##ony and extreme tenderness as i pal ##pate ##d the abdomen .

reference_raw: Temperature normal, lungs clear, but only rumenal atony and extreme tenderness as I patted my stomach.

reference_spacy_tokens: Temperature normal , lungs clear , but only rumenal atony and extreme tenderness as I patted my stomach .


fn_spacy_tokens_for_baseline: Pilger was immediately sympathetic .

source_bert_toks: pi ##lge ##r was immediately sympathetic .

reference_raw: Pilger immediately sympathized.

reference_spacy_tokens: Pilger immediately sympathized .


fn_spacy_tokens_for_baseline: For fifteen years , Las Vegas was used as a Spanish Trail way - station .

source_bert_toks: for fifteen years , las vegas was used as a spanish trail way - station .

reference_raw: For 15 years, Las Vegas has been used as a Spanish road station.

reference_spacy_tokens: For 15 years , Las Vegas has been used as a Spanish road station .


fn_spacy_tokens_for_baseline: From 1989 to 1991 , Italy and the USSR decreased their contributions ; their joint share fell from a half to less than a quarter .

source_bert_toks: from 1989 to 1991 , italy and the ussr decreased their contributions ; their joint share fell from a half to less than a quarter .

reference_raw: Between 1989 and 1991, Italy and the Soviet Union reduced their contributions; their share fell from half to less than a quarter.

reference_spacy_tokens: Between 1989 and 1991 , Italy and the Soviet Union reduced their contributions ; their share fell from half to less than a quarter .


fn_spacy_tokens_for_baseline: With warm sunshine , beautiful beaches , lush tropical scenery , and fine hotels , it is guaranteed to provide a little rest and relaxation .

source_bert_toks: with warm sunshine , beautiful beaches , lush tropical scenery , and fine hotels , it is guaranteed to provide a little rest and relaxation .

reference_raw: With warm sunlight, beautiful beaches, lush tropical landscapes, and fine hotels, it is guaranteed to provide some rest and rest.

reference_spacy_tokens: With warm sunlight , beautiful beaches , lush tropical landscapes , and fine hotels , it is guaranteed to provide some rest and rest .


fn_spacy_tokens_for_baseline: Finally , a passenger reported that an announcement had been made by the " pilot " that the plane had been hijacked .

source_bert_toks: finally , a passenger reported that an announcement had been made by the " pilot " that the plane had been hi ##jack ##ed .

reference_raw: Finally, one of the passengers announced that the pilot had announced that the aircraft had been hijacked.

reference_spacy_tokens: Finally , one of the passengers announced that the pilot had announced that the aircraft had been hijacked .


fn_spacy_tokens_for_baseline: The quivers move through my house every few minutes at unpredictable intervals , and the mouse that 's been living in my kitchen has taken refuge under my desk .

source_bert_toks: the quiver ##s move through my house every few minutes at unpredictable intervals , and the mouse that ' s been living in my kitchen has taken refuge under my desk .

reference_raw: The quivers move through my house every few minutes at unpredictable times, and the mouse who lived in my kitchen hid under my desk.

reference_spacy_tokens: The quivers move through my house every few minutes at unpredictable times , and the mouse who lived in my kitchen hid under my desk .


fn_spacy_tokens_for_baseline: That gives Taylor just seven World Cup ties to rescue his own precarious position or accept that the only solution is an honourable resignation .

source_bert_toks: that gives taylor just seven world cup ties to rescue his own pre ##car ##ious position or accept that the only solution is an honourable resignation .

reference_raw: This gives Taylor only seven World Cup ties to save his own precarious position, or to accept that the only solution is an honorable resignation.

reference_spacy_tokens: This gives Taylor only seven World Cup ties to save his own precarious position , or to accept that the only solution is an honorable resignation .


fn_spacy_tokens_for_baseline: And as it turned out , private investors in Concorde would have lost a lot of money and minded terribly .

source_bert_toks: and as it turned out , private investors in concord ##e would have lost a lot of money and minded terribly .

reference_raw: And as it turned out, the private investors in Concorde would have missed out on a lot of money, and they would have been very worried about it.

reference_spacy_tokens: And as it turned out , the private investors in Concorde would have missed out on a lot of money , and they would have been very worried about it .


fn_spacy_tokens_for_baseline: Iran 's extensive CW program is allegedly masked using its sophisticated pharmaceutical and agro - industrial companies as plausible cover .

source_bert_toks: iran ' s extensive cw program is allegedly masked using its sophisticated pharmaceutical and ag ##ro - industrial companies as plausible cover .

reference_raw: Iran's large-scale CW program is supposedly masked by its ingenious pharmaceutical and agro-industrial corporations as a credible cover.

reference_spacy_tokens: Iran 's large - scale CW program is supposedly masked by its ingenious pharmaceutical and agro - industrial corporations as a credible cover .


fn_spacy_tokens_for_baseline: After Bell was dismissed in 1988 , the society 's once somnolent board hired a new director and began to change the institution 's orientation toward exhibitions and ' museum education ' .

source_bert_toks: after bell was dismissed in 1988 , the society ' s once so ##m ##no ##lent board hired a new director and began to change the institution ' s orientation toward exhibitions and ' museum education ' .

reference_raw: After Bell's dismissal in 1988, the company's once sleepy board hired a new director and started changing the institution's focus on exhibitions and 'museum education'.

reference_spacy_tokens: After Bell 's dismissal in 1988 , the company 's once sleepy board hired a new director and started changing the institution 's focus on exhibitions and ' museum education ' .


fn_spacy_tokens_for_baseline: These were not what she was hungry for , but they were English , and narrative .

source_bert_toks: these were not what she was hungry for , but they were english , and narrative .

reference_raw: It wasn't what she wanted, but it was English and a story.

reference_spacy_tokens: It was n't what she wanted , but it was English and a story .