fn_spacy_tokens_for_baseline: The flat was seven flights up , and Winston , who was thirty - nine and had a varicose ulcer above his right ankle , went slowly , resting several times on the way .

source_bert_toks: the flat was seven flights up , and winston , who was thirty - nine and had a var ##ico ##se ul ##cer above his right ankle , went slowly , resting several times on the way .

reference_raw: The apartment was seven flights up, and Winston, who was thirty-nine and had a varicose sore over his right ankle, walked slowly and rested several times along the way.

reference_spacy_tokens: The apartment was seven flights up , and Winston , who was thirty - nine and had a varicose sore over his right ankle , walked slowly and rested several times along the way .


fn_spacy_tokens_for_baseline: The difference was that he accepted her attempt at consolation , taking her palm between both of his own hands , holding it gently and meeting her compassionate gaze with the glimmer of a smile .

source_bert_toks: the difference was that he accepted her attempt at consolation , taking her palm between both of his own hands , holding it gently and meeting her compassionate gaze with the g ##lim ##mer of a smile .

reference_raw: The difference was that he accepted her attempt to comfort him, took her hand between his hands, held it gently, and met her sympathetic gaze with a flash of smile.

reference_spacy_tokens: The difference was that he accepted her attempt to comfort him , took her hand between his hands , held it gently , and met her sympathetic gaze with a flash of smile .


fn_spacy_tokens_for_baseline: Even fresh food can become depleted of vital nourishment such as vitamins , through incorrect storage , preparation and cooking .

source_bert_toks: even fresh food can become depleted of vital no ##uri ##sh ##ment such as vitamin ##s , through incorrect storage , preparation and cooking .

reference_raw: Even fresh food can be drained from vital food, such as vitamins, by incorrect storage, preparation and cooking.

reference_spacy_tokens: Even fresh food can be drained from vital food , such as vitamins , by incorrect storage , preparation and cooking .


fn_spacy_tokens_for_baseline: Since Friday morning , around 170 fires have been burning , many of which are believed to be caused by arson .

source_bert_toks: since friday morning , around 170 fires have been burning , many of which are believed to be caused by arson .

reference_raw: As of Friday morning, there have been about 170 fires, many of which are believed to have been caused by arson.

reference_spacy_tokens: As of Friday morning , there have been about 170 fires , many of which are believed to have been caused by arson .


fn_spacy_tokens_for_baseline: The £ 12 a copy book tells what brand of tea to buy and how to stop VIPs getting lost .

source_bert_toks: the £1 ##2 a copy book tells what brand of tea to buy and how to stop vip ##s getting lost .

reference_raw: Twelve pounds a copybook tells you what kind of tea to buy and how to stop the VIPs from disappearing.

reference_spacy_tokens: Twelve pounds a copybook tells you what kind of tea to buy and how to stop the VIPs from disappearing .


fn_spacy_tokens_for_baseline: The 7.05 from Hartlepool to Darlington and the 7.57 from Darlington to Hartlepool were both cancelled and passengers transferred to buses .

source_bert_toks: the 7 . 05 from hart ##le ##pool to darlington and the 7 . 57 from darlington to hart ##le ##pool were both cancelled and passengers transferred to buses .

reference_raw: The 7.05 from Hartlepool to Darlington and the 7.57 from Darlington to Hartlepool were canceled and the passengers were taken to the buses.

reference_spacy_tokens: The 7.05 from Hartlepool to Darlington and the 7.57 from Darlington to Hartlepool were canceled and the passengers were taken to the buses .


fn_spacy_tokens_for_baseline: So we called up Andy Bruaer and rented one and in about ten minutes , there it was ! '

source_bert_toks: so we called up andy br ##ua ##er and rented one and in about ten minutes , there it was ! '

reference_raw: So we got Andy Bruaer on the phone, and he rented one, and he was there in about ten minutes!'

reference_spacy_tokens: So we got Andy Bruaer on the phone , and he rented one , and he was there in about ten minutes ! '


fn_spacy_tokens_for_baseline: However , the military has held off on unleashing a second offensive against the Taliban in Waziristan , arguing that the best tack there is to blockade militants ' supply routes and use airstrikes against hide - outs and camps .

source_bert_toks: however , the military has held off on un ##lea ##shing a second offensive against the taliban in wa ##zi ##rist ##an , arguing that the best tack there is to blockade militants ' supply routes and use airs ##tri ##kes against hide - outs and camps .

reference_raw: But the military delayed the launch of a second attack on the Taliban in Waziristan, arguing that the best option is to block the military's supply lines and use air strikes against hiding places and camps.

reference_spacy_tokens: But the military delayed the launch of a second attack on the Taliban in Waziristan , arguing that the best option is to block the military 's supply lines and use air strikes against hiding places and camps .


fn_spacy_tokens_for_baseline: It had clearly been hand - delivered and was firmly stapled down , and she had to struggle to extract the infuriating metal clips before getting at the contents .

source_bert_toks: it had clearly been hand - delivered and was firmly staple ##d down , and she had to struggle to extract the in ##fur ##iating metal clips before getting at the contents .

reference_raw: It was obviously hand-delivered and fastened, and she had to struggle to pull out the infuriating metal clips before she could get to the contents.

reference_spacy_tokens: It was obviously hand - delivered and fastened , and she had to struggle to pull out the infuriating metal clips before she could get to the contents .


fn_spacy_tokens_for_baseline: His hair was very fair , his face naturally sanguine , his skin roughened by coarse soap and blunt razor blades and the cold of the winter that had just ended .

source_bert_toks: his hair was very fair , his face naturally sang ##uin ##e , his skin rough ##ened by coarse soap and blunt razor blades and the cold of the winter that had just ended .

reference_raw: His hair was very fair, his face sanguine, his skin rough with coarse soap and blunt razor blades, and the chill of the winter that had just come to an end.

reference_spacy_tokens: His hair was very fair , his face sanguine , his skin rough with coarse soap and blunt razor blades , and the chill of the winter that had just come to an end .


fn_spacy_tokens_for_baseline: Seminars link film with cultural identity

source_bert_toks: seminars link film with cultural identity

reference_raw: Seminars connect film to cultural identity


fn_spacy_tokens_for_baseline: Additionally , I am sending traditional background materials on the Museum and the two latest issues of our Previews Magazine detailing upcoming events , exhibitions , and educational programs .

source_bert_toks: additionally , i am sending traditional background materials on the museum and the two latest issues of our preview ##s magazine detailing upcoming events , exhibitions , and educational programs .

reference_raw: In addition, I'm sending traditional background material to the museum and the two latest editions of our Preview Magazine detailing upcoming events, exhibitions, and educational programs.

reference_spacy_tokens: In addition , I 'm sending traditional background material to the museum and the two latest editions of our Preview Magazine detailing upcoming events , exhibitions , and educational programs .


fn_spacy_tokens_for_baseline: Finally , as shown in the table , Democrats allocate a higher proportion of their personal staffs to district offices -- where local benefit - seeking duties matter more and national policy making activities matter less relative to Washington offices .

source_bert_toks: finally , as shown in the table , democrats all ##oca ##te a higher proportion of their personal staff ##s to district offices - - where local benefit - seeking duties matter more and national policy making activities matter less relative to washington offices .

reference_raw: Finally, as can be seen from the table, Democrats allocate more of their personal staff to district offices - where local benefit-seeking responsibilities are more important and national policy-making activities are less important than Washington authorities.

reference_spacy_tokens: Finally , as can be seen from the table , Democrats allocate more of their personal staff to district offices - where local benefit - seeking responsibilities are more important and national policy - making activities are less important than Washington authorities .


fn_spacy_tokens_for_baseline: Like others before him , Mr Gerstner is in danger of being bewitched by IBM 's glorious past .

source_bert_toks: like others before him , mr ge ##rst ##ner is in danger of being be ##wi ##tched by ibm ' s glorious past .

reference_raw: Like the others before him, Mr. Gerstner is in danger of being enchanted by the glorious past of IBM.

reference_spacy_tokens: Like the others before him , Mr. Gerstner is in danger of being enchanted by the glorious past of IBM .


fn_spacy_tokens_for_baseline: Apgood skimmed through Brigitte Schickert 's certificate , her husband 's name , parents ' names , place and date of birth , and the address of the Leistritz farmhouse , Dornhausen .

source_bert_toks: ap ##good skimmed through brig ##itte sc ##hic ##ker ##t ' s certificate , her husband ' s name , parents ' names , place and date of birth , and the address of the lei ##st ##rit ##z farmhouse , do ##rn ##hausen .

reference_raw: Apgood scanned Brigitte Schickert's certificate, the name of her husband, the name of her parents, the place and date of birth, and the address of the Leistritz farm in Dornhausen.

reference_spacy_tokens: Apgood scanned Brigitte Schickert 's certificate , the name of her husband , the name of her parents , the place and date of birth , and the address of the Leistritz farm in Dornhausen .


fn_spacy_tokens_for_baseline: Kun Iam Tong , off Avenida do Coronel Mesquita ( open daily 8 am - 6 pm ) , is a 17th - century Buddhist temple of considerable splendor and charm .

source_bert_toks: kun ia ##m tong , off ave ##ni ##da do co ##rone ##l me ##s ##qui ##ta ( open daily 8 am - 6 pm ) , is a 17th - century buddhist temple of considerable sp ##len ##dor and charm .

reference_raw: Kun Iam Tong, off Avenida do Coronel Mesquita (open daily at 8 - 6 p.m.), is a 17th-century Buddhist temple with great beauty and charm.

reference_spacy_tokens: Kun Iam Tong , off Avenida do Coronel Mesquita ( open daily at 8 - 6 p.m. ) , is a 17th - century Buddhist temple with great beauty and charm .


fn_spacy_tokens_for_baseline: His passion for , and expertise with oddballs has made his features very popular , and he is known as a thorough and punctual answerer of readers ' queries .

source_bert_toks: his passion for , and expertise with odd ##balls has made his features very popular , and he is known as a thorough and pun ##ct ##ual answer ##er of readers ' que ##ries .

reference_raw: His passion and experience with strangeballs have made his features very popular, and he's known as a thorough and accurate answerer to the reader's questions.

reference_spacy_tokens: His passion and experience with strangeballs have made his features very popular , and he 's known as a thorough and accurate answerer to the reader 's questions .


fn_spacy_tokens_for_baseline: As he walked he pondered dully on the crime he was trying to expiate , the murder of Clare 's happiness .

source_bert_toks: as he walked he pondered dull ##y on the crime he was trying to ex ##pia ##te , the murder of clare ' s happiness .

reference_raw: As he walked, he pondered dully the crime he was trying to expirate, the murder of Clare's happiness.

reference_spacy_tokens: As he walked , he pondered dully the crime he was trying to expirate , the murder of Clare 's happiness .


fn_spacy_tokens_for_baseline: But lacking the means to enforce its decision , the United Nations was powerless to halt the fighting that erupted as the British withdrew their troops in 1948 .

source_bert_toks: but lacking the means to enforce its decision , the united nations was powerless to halt the fighting that erupted as the british withdrew their troops in 1948 .

reference_raw: But without the means to enforce its decision, the United Nations was unable to stop the battle that erupted when the British withdrew their troops in 1948.

reference_spacy_tokens: But without the means to enforce its decision , the United Nations was unable to stop the battle that erupted when the British withdrew their troops in 1948 .


fn_spacy_tokens_for_baseline: I 'm tuckered . '

source_bert_toks: i ' m tucker ##ed . '

reference_raw: I'm in a tuck.'

reference_spacy_tokens: I 'm in a tuck . '


fn_spacy_tokens_for_baseline: The bed - posts are made of fused bones -- hundreds of them -- and the frame of fused ribs and skulls .

source_bert_toks: the bed - posts are made of fused bones - - hundreds of them - - and the frame of fused ribs and skulls .

reference_raw: The bedposts are made of melted bones-hundreds of them-and a frame of melted ribs and skulls.

reference_spacy_tokens: The bedposts are made of melted bones - hundreds of them - and a frame of melted ribs and skulls .


fn_spacy_tokens_for_baseline: Flashes of warmth darted uncomfortably through his chilled limbs and he felt nauseous .

source_bert_toks: flashes of warmth darted uncomfortably through his chilled limbs and he felt na ##use ##ous .

reference_raw: Flashes of warmth darted uncomfortably through his cold limbs and made him feel sick.

reference_spacy_tokens: Flashes of warmth darted uncomfortably through his cold limbs and made him feel sick .


fn_spacy_tokens_for_baseline: These patrols comb the greater area surrounding the location periodically ; anywhere between 3 and four times a week The patrol should be lead by a security officer in order to take immediate actions if the need arises .

source_bert_toks: these patrols comb the greater area surrounding the location periodically ; anywhere between 3 and four times a week the patrol should be lead by a security officer in order to take immediate actions if the need arises .

reference_raw: These patrols regularly comb the larger area around the site; anywhere from three to four times a week The patrol should be led by a security officer to take immediate action if necessary.

reference_spacy_tokens: These patrols regularly comb the larger area around the site ; anywhere from three to four times a week The patrol should be led by a security officer to take immediate action if necessary .


fn_spacy_tokens_for_baseline: The distance between the first and fourth bump should be 100 meters , and the distance between the fourth and the sixth should be 50 meters , so cars can not travel fast in the direction of the building 5- Barbed Wires : They should be placed around the building , around the walls , or on top of the walls 6- Nails Obstacle : These are placed at the main gate in order to puncture the tires of any car crashing in

source_bert_toks: the distance between the first and fourth bump should be 100 meters , and the distance between the fourth and the sixth should be 50 meters , so cars can not travel fast in the direction of the building 5 - barbed wires : they should be placed around the building , around the walls , or on top of the walls 6 - nails obstacle : these are placed at the main gate in order to pun ##cture the tires of any car crashing in

reference_raw: The distance between the first and fourth bump should be 100 metres, and the distance between the fourth and sixth should be 50 metres, so that vehicles cannot travel rapidly towards the building 5-barbed wires: they should be placed around the building, around the walls or above the walls 6-Nails Obstacle: they are placed at the main gate to puncture the tires of any collision.

reference_spacy_tokens: The distance between the first and fourth bump should be 100 metres , and the distance between the fourth and sixth should be 50 metres , so that vehicles can not travel rapidly towards the building 5-barbed wires : they should be placed around the building , around the walls or above the walls 6-Nails Obstacle : they are placed at the main gate to puncture the tires of any collision .


fn_spacy_tokens_for_baseline: Kids like Tommie J. , made a ward of the court because of repeated beatings by an alcoholic father ; Alice , sent to a group home to get help because of severe behavior disorders ; and John H. , a recovering alcoholic , rebuilding a relationships with his family so they can live together again .

source_bert_toks: kids like tom ##mie j . , made a ward of the court because of repeated beating ##s by an alcoholic father ; alice , sent to a group home to get help because of severe behavior disorders ; and john h . , a recovering alcoholic , rebuilding a relationships with his family so they can live together again .

reference_raw: Kids like Tommie J., who had been assigned to court for repeated beatings by an alcoholic father, Alice, who had been sent to a group home for help due to severe behavioral disturbances, and John H., a recovering alcoholic, had re-established a relationship with his family so that they could live together again.

reference_spacy_tokens: Kids like Tommie J. , who had been assigned to court for repeated beatings by an alcoholic father , Alice , who had been sent to a group home for help due to severe behavioral disturbances , and John H. , a recovering alcoholic , had re - established a relationship with his family so that they could live together again .


fn_spacy_tokens_for_baseline: About 400 of the more than 2,600 village residents were hospitalized in July and August .

source_bert_toks: about 400 of the more than 2 , 600 village residents were hospitalized in july and august .

reference_raw: In July and August, about 400 of the over 2,600 locals were hospitalized.

reference_spacy_tokens: In July and August , about 400 of the over 2,600 locals were hospitalized .


fn_spacy_tokens_for_baseline: The UN Food and Agriculture Organization ( FAO ) held its 26th biennial conference in Rome on Nov. 9 - 27 .

source_bert_toks: the un food and agriculture organization ( fa ##o ) held its 26th biennial conference in rome on nov . 9 - 27 .

reference_raw: On November 9-27, the United Nations Food and Agriculture Organisation (FAO) held its 26th two-year conference in Rome.

reference_spacy_tokens: On November 9 - 27 , the United Nations Food and Agriculture Organisation ( FAO ) held its 26th two - year conference in Rome .


fn_spacy_tokens_for_baseline: A car came speeding out of the fog , mounted the pavement and smashed into them .

source_bert_toks: a car came speeding out of the fog , mounted the pavement and smashed into them .

reference_raw: A car raced out of the mist, climbed onto the sidewalk, and crashed into them.

reference_spacy_tokens: A car raced out of the mist , climbed onto the sidewalk , and crashed into them .


fn_spacy_tokens_for_baseline: THE lovely spring crocuses are almost as pretty as sisters Sarah and Samantha Barker , who were clearly enjoying a stroll among the early flowers making a colourful backdrop in Southend Avenue , Darlington yesterday .

source_bert_toks: the lovely spring cr ##oc ##uses are almost as pretty as sisters sarah and samantha barker , who were clearly enjoying a stroll among the early flowers making a colourful backdrop in southend avenue , darlington yesterday .

reference_raw: The beautiful spring crocuses are almost as beautiful as Sisters Sarah and Samantha Barker, who apparently enjoyed the walk between the first flowers that made a colorful background on Southend Avenue, Darlington last night.

reference_spacy_tokens: The beautiful spring crocuses are almost as beautiful as Sisters Sarah and Samantha Barker , who apparently enjoyed the walk between the first flowers that made a colorful background on Southend Avenue , Darlington last night .


fn_spacy_tokens_for_baseline: When asked about the Bible 's literal account of creation , as opposed to the attractive concept of divine creation , every major Republican presidential candidate -- even Bauer -- has squirmed , ducked , and tried to steer the discussion back to " faith , " " morals , " and the general idea that humans " were created in the image of God . "

source_bert_toks: when asked about the bible ' s literal account of creation , as opposed to the attractive concept of divine creation , every major republican presidential candidate - - even bauer - - has sq ##ui ##rmed , ducked , and tried to steer the discussion back to " faith , " " morals , " and the general idea that humans " were created in the image of god . "

reference_raw: When asked about the Bible's literal account of creation, unlike the attractive concept of God's creation, every major Republican presidential candidate - even Bauer - was squirming, ducking, trying to steer the debate back to "faith," "morals," and the general idea that people were created in God's imagination.

reference_spacy_tokens: When asked about the Bible 's literal account of creation , unlike the attractive concept of God 's creation , every major Republican presidential candidate - even Bauer - was squirming , ducking , trying to steer the debate back to " faith , " " morals , " and the general idea that people were created in God 's imagination .


fn_spacy_tokens_for_baseline: Other absorbent materials are available for bedding , but problems can arise when they are used in breeding cages as they can desiccate the pups .

source_bert_toks: other absorb ##ent materials are available for bed ##ding , but problems can arise when they are used in breeding cages as they can des ##ic ##cate the pup ##s .

reference_raw: Other absorbent materials are available for bedding, but problems may arise when used in breeding cages, as they may dry the pups.

reference_spacy_tokens: Other absorbent materials are available for bedding , but problems may arise when used in breeding cages , as they may dry the pups .


fn_spacy_tokens_for_baseline: There has been a great deal of ca nt in the past 30 years to the effect that Dior 's era forced helpless women into a posture of submission with its fussily constructed garments , cumbersome skirts , cinched waists , and rigid hairstyles , crippling their feet in high heels and imprisoning their hands in white gloves .

source_bert_toks: there has been a great deal of can ##t in the past 30 years to the effect that di ##or ' s era forced helpless women into a posture of submission with its fuss ##ily constructed garments , cum ##bers ##ome skirts , ci ##nched waist ##s , and rigid hairs ##tyle ##s , cr ##ip ##pling their feet in high heels and imp ##ris ##oning their hands in white gloves .

reference_raw: Over the last 30 years, there's been a lot of cants that Dior's era has forced helpless women into a position of submission with their fussy dresses, cumbersome skirts, cinched waists, and sturdy hairstyles, crippling their feet in high heels and imprisoning their hands in white gloves.

reference_spacy_tokens: Over the last 30 years , there 's been a lot of cants that Dior 's era has forced helpless women into a position of submission with their fussy dresses , cumbersome skirts , cinched waists , and sturdy hairstyles , crippling their feet in high heels and imprisoning their hands in white gloves .


fn_spacy_tokens_for_baseline: The paper reports that the congressional investigation is trying to determine if the board was missing because the Chinese " took " it .

source_bert_toks: the paper reports that the congressional investigation is trying to determine if the board was missing because the chinese " took " it .

reference_raw: Newspaper says the congressional investigation is trying to determine whether the Council is missing because the Chinese "took" it.

reference_spacy_tokens: Newspaper says the congressional investigation is trying to determine whether the Council is missing because the Chinese " took " it .


fn_spacy_tokens_for_baseline: Today Jamaican population is a mixture of African and English , with Spanish , Indian , and a smattering of Portuguese Jews , Germans , Welsh , and Scots .

source_bert_toks: today jamaican population is a mixture of african and english , with spanish , indian , and a sm ##atter ##ing of portuguese jews , germans , welsh , and scots .

reference_raw: The Jamaican population is now a mixture of African and English, with Spanish, Indian, and a mass of Portuguese Jews, Germans, Welsh, and Scots.

reference_spacy_tokens: The Jamaican population is now a mixture of African and English , with Spanish , Indian , and a mass of Portuguese Jews , Germans , Welsh , and Scots .


fn_spacy_tokens_for_baseline: Our last prayer is to thank God the creator of the universe .

source_bert_toks: our last prayer is to thank god the creator of the universe .

reference_raw: The last thing we pray for is to thank God the creator of the universe.

reference_spacy_tokens: The last thing we pray for is to thank God the creator of the universe .


fn_spacy_tokens_for_baseline: Signs of even more advancement appeared halfway through the first millennium a.d . , when the Anasazi Indians inhabited the valley .

source_bert_toks: signs of even more advancement appeared halfway through the first millennium a . d . , when the ana ##sa ##zi indians inhabited the valley .

reference_raw: In the middle of the first millennium a.m., when the Anasazi Indians inhabited the valley, there were signs of further progress.

reference_spacy_tokens: In the middle of the first millennium a.m. , when the Anasazi Indians inhabited the valley , there were signs of further progress .


fn_spacy_tokens_for_baseline: It quickly spread to the first floor where the main bathroom was destroyed .

source_bert_toks: it quickly spread to the first floor where the main bathroom was destroyed .

reference_raw: It spread rapidly to the first level, where the main bathroom had been destroyed.

reference_spacy_tokens: It spread rapidly to the first level , where the main bathroom had been destroyed .


fn_spacy_tokens_for_baseline: There are also souvenir stands , benches for a rest , and perhaps Hong Kong 's last surviving rickshaws - however these are not for rides , but are a tourist photo opportunity .

source_bert_toks: there are also so ##uven ##ir stands , benches for a rest , and perhaps hong kong ' s last surviving rick ##shaw ##s - however these are not for rides , but are a tourist photo opportunity .

reference_raw: There are also souvenir stands, resting benches, and perhaps the last surviving Hong Kong rickshaws - but they're not for riding, they're a tourist photography opportunity.

reference_spacy_tokens: There are also souvenir stands , resting benches , and perhaps the last surviving Hong Kong rickshaws - but they 're not for riding , they 're a tourist photography opportunity .


fn_spacy_tokens_for_baseline: Some patients become disoriented , a more likely reaction if the patient is elderly or has already shown signs of mental confusion ( Clarke , 1987 ; Ford et al , 1986 ) .

source_bert_toks: some patients become di ##sor ##iente ##d , a more likely reaction if the patient is elderly or has already shown signs of mental confusion ( clarke , 1987 ; ford et al , 1986 ) .

reference_raw: Some patients become disorientated, which is more likely to be the case when the patient is older or shows signs of mental confusion (Clarke, 1987; Ford et al, 1986).

reference_spacy_tokens: Some patients become disorientated , which is more likely to be the case when the patient is older or shows signs of mental confusion ( Clarke , 1987 ; Ford et al , 1986 ) .


fn_spacy_tokens_for_baseline: My first days in this village were devoted to a series of walks in which in the intervals of my botanical researches I made a reconnaissance of all the large houses and an examination of the family history of the occupants .

source_bert_toks: my first days in this village were devoted to a series of walks in which in the intervals of my botanical researches i made a reconnaissance of all the large houses and an examination of the family history of the occupants .

reference_raw: My first days in this village were devoted to a series of walks, during which, in the course of my botanical research, I surveyed all the large houses and examined the family history of the inhabitants.

reference_spacy_tokens: My first days in this village were devoted to a series of walks , during which , in the course of my botanical research , I surveyed all the large houses and examined the family history of the inhabitants .


fn_spacy_tokens_for_baseline: It showed a group of legionnaires sitting on a wall in a wrecked and burning tropical town ; the soldiers were filthy , looked exhausted and were draped with hand grenades and belts of machine gun ammunition .

source_bert_toks: it showed a group of legion ##naire ##s sitting on a wall in a wrecked and burning tropical town ; the soldiers were filthy , looked exhausted and were draped with hand grenades and belts of machine gun ammunition .

reference_raw: It showed a group of legionnaires sitting on the wall in a ruined and burning tropical city; the soldiers were dirty, looked exhausted, and covered with hand grenades and belts of machine-gun ammunition.

reference_spacy_tokens: It showed a group of legionnaires sitting on the wall in a ruined and burning tropical city ; the soldiers were dirty , looked exhausted , and covered with hand grenades and belts of machine - gun ammunition .


fn_spacy_tokens_for_baseline: A HIGH - FLYING executive hounded out of her job after complaining of sexual harassment by her boss has won the maximum award of Pounds 10,000 .

source_bert_toks: a high - flying executive hound ##ed out of her job after complaining of sexual harassment by her boss has won the maximum award of pounds 10 , 000 .

reference_raw: The HIGH-Flying executive, who was run out of work after complaining that her boss was sexually harassed, won the maximum prize of £10,000.

reference_spacy_tokens: The HIGH - Flying executive , who was run out of work after complaining that her boss was sexually harassed , won the maximum prize of £ 10,000 .


fn_spacy_tokens_for_baseline: The EEC 's attitude is somewhat baffling to the Visegrad trade negotiators : it lectures them on the merits of free trade , while closing its own markets .

source_bert_toks: the ee ##c ' s attitude is somewhat ba ##ff ##ling to the vis ##eg ##rad trade ne ##go ##tia ##tors : it lectures them on the merits of free trade , while closing its own markets .

reference_raw: The position of the EEC is somewhat confusing to the Visegrad trade negotiators: it lectures them on the merits of free trade and closes its own markets.

reference_spacy_tokens: The position of the EEC is somewhat confusing to the Visegrad trade negotiators : it lectures them on the merits of free trade and closes its own markets .


fn_spacy_tokens_for_baseline: American Football Team , Edinburgh Eagles is looking for girls to join its squad of cheerleaders .

source_bert_toks: american football team , edinburgh eagles is looking for girls to join its squad of cheer ##leader ##s .

reference_raw: The American football team, Edinburgh Eagles, is looking for girls to join their team of cheerleaders.

reference_spacy_tokens: The American football team , Edinburgh Eagles , is looking for girls to join their team of cheerleaders .


fn_spacy_tokens_for_baseline: Errors will also be experienced during rotation immediately prior to take - off , but these are allowed for during calibration of flight instruments and static vents , during the pre - certification flight trials of an aircraft .

source_bert_toks: errors will also be experienced during rotation immediately prior to take - off , but these are allowed for during cal ##ib ##ration of flight instruments and static vents , during the pre - certification flight trials of an aircraft .

reference_raw: Errors shall also occur during rotation immediately prior to take-off, but shall be permitted during the pre-certification flight tests of the aircraft when calibrating flight instruments and static ventilation.

reference_spacy_tokens: Errors shall also occur during rotation immediately prior to take - off , but shall be permitted during the pre - certification flight tests of the aircraft when calibrating flight instruments and static ventilation .


fn_spacy_tokens_for_baseline: 9:53 a.m. PANDA : Flesh goes to total alert for flight or fight .

source_bert_toks: 9 : 53 a . m . panda : flesh goes to total alert for flight or fight .

reference_raw: 9:53 PANDA: Flesh is on full alert for flight or combat.

reference_spacy_tokens: 9:53 PANDA : Flesh is on full alert for flight or combat .


fn_spacy_tokens_for_baseline: Then she discovered he 'd gone off any idea of tucking into the delights of her home - made lasagne anyway as , without another word , he turned and headed out of the kitchen .

source_bert_toks: then she discovered he ' d gone off any idea of tucking into the delight ##s of her home - made las ##agne anyway as , without another word , he turned and headed out of the kitchen .

reference_raw: Then she found that he had lost all thought of tucking into the pleasures of her homemade lasagna when, without another word, he turned and left the kitchen.

reference_spacy_tokens: Then she found that he had lost all thought of tucking into the pleasures of her homemade lasagna when , without another word , he turned and left the kitchen .


fn_spacy_tokens_for_baseline: we are lobbying the EC to make sure its aid programmes and industrial activities are not destroying the rainforest .

source_bert_toks: we are lobbying the ec to make sure its aid programmes and industrial activities are not destroying the rainforest .

reference_raw: we lobby the EC to ensure that its support programmes and industrial activities do not destroy rain forests.

reference_spacy_tokens: we lobby the EC to ensure that its support programmes and industrial activities do not destroy rain forests .


fn_spacy_tokens_for_baseline: Taking his trousers from the chair - back , he slid his legs into them and buckled the belt round his waist .

source_bert_toks: taking his trousers from the chair - back , he slid his legs into them and buckled the belt round his waist .

reference_raw: He took his pants off the back of his chair, slipped his legs into them, and fastened the belt around his waist.

reference_spacy_tokens: He took his pants off the back of his chair , slipped his legs into them , and fastened the belt around his waist .


fn_spacy_tokens_for_baseline: However , the sausage and mash was n't at all bad and Tristan was lavish with his helpings .

source_bert_toks: however , the sausage and mas ##h wasn ' t at all bad and tristan was lavish with his helping ##s .

reference_raw: But the sausage and mash were not bad at all, and Tristan was enthusiastic with his help.

reference_spacy_tokens: But the sausage and mash were not bad at all , and Tristan was enthusiastic with his help .


fn_spacy_tokens_for_baseline: Put up lengths in the usual way , smoothing with a sponge , then flatten seams with a seam roller .

source_bert_toks: put up lengths in the usual way , smoothing with a sponge , then flat ##ten seam ##s with a seam roller .

reference_raw: Stretch the lengths in the usual way, smooth the sponge, and then straighten the seams with the seam roller.

reference_spacy_tokens: Stretch the lengths in the usual way , smooth the sponge , and then straighten the seams with the seam roller .


fn_spacy_tokens_for_baseline: TIRANA , Albania ( AP ) --- Two explosions damaged a police station in one northern town and disabled the water supply system in another on Saturday , leaving the surrounding area without water .

source_bert_toks: tirana , albania ( ap ) - - - two explosions damaged a police station in one northern town and disabled the water supply system in another on saturday , leaving the surrounding area without water .

reference_raw: TIRANA, Albania (AP) - Two explosions damaged a police station in one northern city and shut down the water supply system in the other on Saturday, leaving the area without water.

reference_spacy_tokens: TIRANA , Albania ( AP ) - Two explosions damaged a police station in one northern city and shut down the water supply system in the other on Saturday , leaving the area without water .


fn_spacy_tokens_for_baseline: From her flustered expression and the fact that I was n't instantly told to mend my manners , I knew she felt guilty .

source_bert_toks: from her flu ##stered expression and the fact that i wasn ' t instantly told to men ##d my manners , i knew she felt guilty .

reference_raw: From her flushed expression and the fact that I was not immediately told to correct my manners, I knew that she felt guilty.

reference_spacy_tokens: From her flushed expression and the fact that I was not immediately told to correct my manners , I knew that she felt guilty .


fn_spacy_tokens_for_baseline: ' Next time Fwinky and Boss Lady catch some big fish , ' he whooped , sweeping his arms wide .

source_bert_toks: ' next time f ##win ##ky and boss lady catch some big fish , ' he who ##oped , sweeping his arms wide .

reference_raw: 'Fwinky and Boss Lady catch a big fish next time,' he said, sweeping his arms wide.

reference_spacy_tokens: ' Fwinky and Boss Lady catch a big fish next time , ' he said , sweeping his arms wide .


fn_spacy_tokens_for_baseline: I leaned the painting against the van and sat on a box and waited .

source_bert_toks: i leaned the painting against the van and sat on a box and waited .

reference_raw: I put the painting on the van, sat on the box, and waited.

reference_spacy_tokens: I put the painting on the van , sat on the box , and waited .


fn_spacy_tokens_for_baseline: We can hear that for ourselves in the records that have been issued of Karajan rehearsing the late Mozart symphonies or the Finale of Beethoven 's Ninth Symphony .

source_bert_toks: we can hear that for ourselves in the records that have been issued of kara ##jan re ##hear ##sing the late mozart symphonies or the finale of beethoven ' s ninth symphony .

reference_raw: We can hear it from the records of Karajan rehearsing the late Mozart symphonies or the final of Beethoven's ninth symphony.

reference_spacy_tokens: We can hear it from the records of Karajan rehearsing the late Mozart symphonies or the final of Beethoven 's ninth symphony .


fn_spacy_tokens_for_baseline: During these first scuffles the blue civil rights banner was seized and ripped by the police .

source_bert_toks: during these first sc ##uf ##fles the blue civil rights banner was seized and ripped by the police .

reference_raw: During these first fights, the blue civil-rights banner was seized and torn by the police.

reference_spacy_tokens: During these first fights , the blue civil - rights banner was seized and torn by the police .


fn_spacy_tokens_for_baseline: * This is usually done by chilling the outside of the hot glass by means of air jets .

source_bert_toks: * this is usually done by chilling the outside of the hot glass by means of air jets .

reference_raw: * This is usually done by cooling the outside of the hot glass with air jets.

reference_spacy_tokens: * This is usually done by cooling the outside of the hot glass with air jets .


fn_spacy_tokens_for_baseline: Recent estimates of North Korean chemical ordnance by the South Korean Ministry of National Defense ( MND ) have since been raised to the thousands of tons , probably based on recent information provided by North Korean defectors , including former members of DPRK military and NBC defence organizations .

source_bert_toks: recent estimates of north korean chemical ordnance by the south korean ministry of national defense ( mn ##d ) have since been raised to the thousands of tons , probably based on recent information provided by north korean defect ##ors , including former members of d ##pr ##k military and nbc defence organizations .

reference_raw: Since then, recent estimates of North Korea's chemical order by the South Korean Ministry of National Defence (MND) have been increased to thousands of tonnes, possibly based on recent information provided by North Korean defectors, including former members of the DPRK Army and NBC Defence Organisations.

reference_spacy_tokens: Since then , recent estimates of North Korea 's chemical order by the South Korean Ministry of National Defence ( MND ) have been increased to thousands of tonnes , possibly based on recent information provided by North Korean defectors , including former members of the DPRK Army and NBC Defence Organisations .


fn_spacy_tokens_for_baseline: I 'm sitting by the pool chilling , munching on a bagel .

source_bert_toks: i ' m sitting by the pool chilling , mu ##nch ##ing on a bag ##el .

reference_raw: I sit by the pool cooling and chewing on my bagel.

reference_spacy_tokens: I sit by the pool cooling and chewing on my bagel .


fn_spacy_tokens_for_baseline: The gates clanged shut again , Berwick succoured , after a fashion , with a day to go .

source_bert_toks: the gates clan ##ged shut again , berwick su ##cco ##ured , after a fashion , with a day to go .

reference_raw: The gates slammed shut again, and Berwick succumbed after a fashion to the day.

reference_spacy_tokens: The gates slammed shut again , and Berwick succumbed after a fashion to the day .


fn_spacy_tokens_for_baseline: He was wearing a shiny black suit and white - and - black golfing shoes , but he was shirtless and sockless .

source_bert_toks: he was wearing a shiny black suit and white - and - black golf ##ing shoes , but he was shirt ##less and sock ##less .

reference_raw: He wore a shiny black suit and white and black golf boots, but he had no shirt and no socks.

reference_spacy_tokens: He wore a shiny black suit and white and black golf boots , but he had no shirt and no socks .


fn_spacy_tokens_for_baseline: The pain of this incomplete ending of a relationship is impossible to comprehend .

source_bert_toks: the pain of this incomplete ending of a relationship is impossible to comprehend .

reference_raw: It's impossible to understand the pain of this unfinished end of a relationship.

reference_spacy_tokens: It 's impossible to understand the pain of this unfinished end of a relationship .


fn_spacy_tokens_for_baseline: The island 's largest community is Tai O. The people of this picturesque village make their living by fishing , duck - breeding , and food - processing .

source_bert_toks: the island ' s largest community is tai o . the people of this picturesque village make their living by fishing , duck - breeding , and food - processing .

reference_raw: The largest community on the island is Tai O. The people of this quaint village make a living by fisheries, ducks, breeding, and food processing.

reference_spacy_tokens: The largest community on the island is Tai O. The people of this quaint village make a living by fisheries , ducks , breeding , and food processing .


fn_spacy_tokens_for_baseline: Burundi 's generation - long cycle of ethnic bloodshed has taken another turn for the worse .

source_bert_toks: burundi ' s generation - long cycle of ethnic blood ##shed has taken another turn for the worse .

reference_raw: For the worse, Burundi's generation-long cycle of ethnic carnage took another turn.

reference_spacy_tokens: For the worse , Burundi 's generation - long cycle of ethnic carnage took another turn .


fn_spacy_tokens_for_baseline: SPECIAL : Regiments of Archers are permitted to skirmish as described in the rules for skirmishing in the Warhammer rulebook .

source_bert_toks: special : regiments of archers are permitted to skirmish as described in the rules for skirmish ##ing in the war ##hammer rule ##book .

reference_raw: SPECIAL: The regiments of archers are allowed to fight as described in the Warhammer rules.

reference_spacy_tokens: SPECIAL : The regiments of archers are allowed to fight as described in the Warhammer rules .


fn_spacy_tokens_for_baseline: She gave him no explanation why ; he was too befuddled with sleep and a probable hangover for it to register anyway , whatever she told him .

source_bert_toks: she gave him no explanation why ; he was too be ##fu ##ddled with sleep and a probable hang ##over for it to register anyway , whatever she told him .

reference_raw: She didn't explain why; he was too confused with sleep and a likely hangover to register, no matter what she told him.

reference_spacy_tokens: She did n't explain why ; he was too confused with sleep and a likely hangover to register , no matter what she told him .


fn_spacy_tokens_for_baseline: Their defense , often crowding the line with eight men , did a decent job on Sanders , who now has 1,721 yards in his bid for a 2,000-yard season .

source_bert_toks: their defense , often crowd ##ing the line with eight men , did a decent job on sanders , who now has 1 , 72 ##1 yards in his bid for a 2 , 000 - yard season .

reference_raw: Their defense, often lined with eight men, had done a decent job on Sanders, who now had 1,721 yards to bid for the 2000-yard season.

reference_spacy_tokens: Their defense , often lined with eight men , had done a decent job on Sanders , who now had 1,721 yards to bid for the 2000-yard season .


fn_spacy_tokens_for_baseline: A trio of rickety buses takes us to our floating hotel , the Hatshepsut .

source_bert_toks: a trio of rick ##ety buses takes us to our floating hotel , the hats ##he ##ps ##ut .

reference_raw: Three rickety buses will take us to our flying hotel in Hatshepsut.

reference_spacy_tokens: Three rickety buses will take us to our flying hotel in Hatshepsut .


fn_spacy_tokens_for_baseline: During the latter years the only minute of interest was in October 1869 when ' the secretary was empowered to write to Mr Menzies and Dr. Campbell , the former from taking any papers and the latter from entering the room altogether , not being a subscriber , ' In 1870 there was a complaint about the pilfering of papers and the committee have to acknowledge , with regret , that their attempts to prevent this evil have not been attended with such success as had been anticipated .

source_bert_toks: during the latter years the only minute of interest was in october 1869 when ' the secretary was empowered to write to mr men ##zie ##s and dr . campbell , the former from taking any papers and the latter from entering the room altogether , not being a sub ##scribe ##r , ' in 1870 there was a complaint about the pi ##lf ##ering of papers and the committee have to acknowledge , with regret , that their attempts to prevent this evil have not been attended with such success as had been anticipated .

reference_raw: In the last few years, the only minute of interest was in October 1869, when the secretary was entitled to write to Mr. Menzies and Dr. Campbell, the first to accept all the documents, and the second to enter the room without being a participant," in 1870 there was a complaint about the collection of documents, and the committee must, regrettably, admit that their attempts to prevent this evil had not been so successful as it had been expected.

reference_spacy_tokens: In the last few years , the only minute of interest was in October 1869 , when the secretary was entitled to write to Mr. Menzies and Dr. Campbell , the first to accept all the documents , and the second to enter the room without being a participant , " in 1870 there was a complaint about the collection of documents , and the committee must , regrettably , admit that their attempts to prevent this evil had not been so successful as it had been expected .


fn_spacy_tokens_for_baseline: In the heat of the moment , the grey - coated wolf will wrestle with its quarry and Fido will violently shake rags until they lie motionless or chew squeaky toys until they squeak no more .

source_bert_toks: in the heat of the moment , the grey - coated wolf will wrestle with its quarry and fi ##do will violently shake rags until they lie motionless or chew squeak ##y toys until they squeak no more .

reference_raw: In the heat of the moment, the gray-coated wolf struggles with its prey, and Fido shakes the rags violently until they lie still or chew on the squeaky toys until they no longer squeal.

reference_spacy_tokens: In the heat of the moment , the gray - coated wolf struggles with its prey , and Fido shakes the rags violently until they lie still or chew on the squeaky toys until they no longer squeal .


fn_spacy_tokens_for_baseline: My room - mate happening to be a policeman , I was at a loss whether to look upon it as a special honour or a special precaution , mine host putting into my room a representative of the force .

source_bert_toks: my room - mate happening to be a policeman , i was at a loss whether to look upon it as a special honour or a special pre ##ca ##ution , mine host putting into my room a representative of the force .

reference_raw: My roommate happened to be a cop, and I didn't know whether to look at it as a special honor or a special precaution, and my host sent a police representative into my room.

reference_spacy_tokens: My roommate happened to be a cop , and I did n't know whether to look at it as a special honor or a special precaution , and my host sent a police representative into my room .


fn_spacy_tokens_for_baseline: ' It fulfills our NATO obligations .

source_bert_toks: ' it fulfill ##s our nato obligations .

reference_raw: 'Abides by our NATO obligations.

reference_spacy_tokens: ' Abides by our NATO obligations .


fn_spacy_tokens_for_baseline: Caroline took the chance to draw some calming deep breaths , get her scattered emotions under control .

source_bert_toks: caroline took the chance to draw some calming deep breaths , get her scattered emotions under control .

reference_raw: Caroline took the opportunity to take a quiet, deep breath, to control her scattered emotions.

reference_spacy_tokens: Caroline took the opportunity to take a quiet , deep breath , to control her scattered emotions .


fn_spacy_tokens_for_baseline: That last bomb had taken out those houses as if it had come with a great grasping fist and scooped them up and crunched them into rubble as easily as if they 'd been made of matchsticks .

source_bert_toks: that last bomb had taken out those houses as if it had come with a great grasping fist and scooped them up and crunch ##ed them into rubble as easily as if they ' d been made of match ##stick ##s .

reference_raw: The last bomb took out the houses as if it had come with a big fist, scooped them up and crushed them into rubble as easily as if they had been made of matchsticks.

reference_spacy_tokens: The last bomb took out the houses as if it had come with a big fist , scooped them up and crushed them into rubble as easily as if they had been made of matchsticks .


fn_spacy_tokens_for_baseline: They banded themselves into a society which should never be dissolved until the work was done .

source_bert_toks: they banded themselves into a society which should never be dissolved until the work was done .

reference_raw: They joined a company that should never be dissolved until the job was done.

reference_spacy_tokens: They joined a company that should never be dissolved until the job was done .


fn_spacy_tokens_for_baseline: The government insisted this was the reason he secretly contacted Castro to mediate a solution that would save him from the drug dealers ' retribution .

source_bert_toks: the government insisted this was the reason he secretly contacted castro to media ##te a solution that would save him from the drug dealers ' retribution .

reference_raw: The government insisted that this was why he had secretly contacted Castro to negotiate a solution that would protect him from the retaliation of drug dealers.

reference_spacy_tokens: The government insisted that this was why he had secretly contacted Castro to negotiate a solution that would protect him from the retaliation of drug dealers .


fn_spacy_tokens_for_baseline: She fumbles for defusing words .

source_bert_toks: she fumble ##s for def ##using words .

reference_raw: He's trying to defuse the words.

reference_spacy_tokens: He 's trying to defuse the words .


fn_spacy_tokens_for_baseline: However , its task is made much more difficult by the fact that derogations granted to the Welsh water authority allow it to pump raw sewage into both those rivers .

source_bert_toks: however , its task is made much more difficult by the fact that der ##oga ##tions granted to the welsh water authority allow it to pump raw sewage into both those rivers .

reference_raw: However, the fact that the derogations granted to the Welsh Water Authority allow it to pour raw sewage into both rivers makes it much more difficult to carry out its task.

reference_spacy_tokens: However , the fact that the derogations granted to the Welsh Water Authority allow it to pour raw sewage into both rivers makes it much more difficult to carry out its task .


fn_spacy_tokens_for_baseline: Joan had regaled her with details of the Twelfth Night festivities -- whilst remaining noticeably reticent on the subject of Prince Edward .

source_bert_toks: joan had regal ##ed her with details of the twelfth night festivities - - whilst remaining noticeably re ##tic ##ent on the subject of prince edward .

reference_raw: Joan gave her the details of the Twelfth Night Festival, while she remained noticeably restrained on Prince Edward's subject.

reference_spacy_tokens: Joan gave her the details of the Twelfth Night Festival , while she remained noticeably restrained on Prince Edward 's subject .


fn_spacy_tokens_for_baseline: The company seems to have been forgiven for its oil spill in the Mersey estuary in 1989 ; it came third in ' community and environmental responsibility ' , only one place down from last time .

source_bert_toks: the company seems to have been forgiven for its oil spill in the mer ##sey estuary in 1989 ; it came third in ' community and environmental responsibility ' , only one place down from last time .

reference_raw: It appears that the company was forgivable for its oil spill at the mouth of Mersey in 1989; it was the third in 'community and environmental responsibility', only one place since the last time.

reference_spacy_tokens: It appears that the company was forgivable for its oil spill at the mouth of Mersey in 1989 ; it was the third in ' community and environmental responsibility ' , only one place since the last time .


fn_spacy_tokens_for_baseline: As shown in Table 2 , the net effect of these assumptions is to lower the expected level of electricity consumption while continuing to meet the same level of service demanded by utility customers .

source_bert_toks: as shown in table 2 , the net effect of these assumptions is to lower the expected level of electricity consumption while continuing to meet the same level of service demanded by utility customers .

reference_raw: As shown in Table 2, the net effect of these assumptions is to reduce the expected level of electricity consumption while remaining at the same level of service required by public service customers.

reference_spacy_tokens: As shown in Table 2 , the net effect of these assumptions is to reduce the expected level of electricity consumption while remaining at the same level of service required by public service customers .


fn_spacy_tokens_for_baseline: Overstreet was one of two reservists killed Monday when a roadside bomb exploded near their vehicle in Al Anbar province , west of Baghdad .

source_bert_toks: overs ##tree ##t was one of two res ##er ##vis ##ts killed monday when a roadside bomb exploded near their vehicle in al an ##bar province , west of baghdad .

reference_raw: Overstreet was one of the two reservists who were killed on Monday when a road bomb blew up near their car in the province of Al Anbar, west of Baghdad.

reference_spacy_tokens: Overstreet was one of the two reservists who were killed on Monday when a road bomb blew up near their car in the province of Al Anbar , west of Baghdad .


fn_spacy_tokens_for_baseline: They watched as the taxi drove away .

source_bert_toks: they watched as the taxi drove away .

reference_raw: They watched the cab leave.

reference_spacy_tokens: They watched the cab leave .


fn_spacy_tokens_for_baseline: It struck sparks , flint against steel , from the bright fighting trim of his mercenaries .

source_bert_toks: it struck sparks , flint against steel , from the bright fighting trim of his mercenaries .

reference_raw: From the bright fighting trim of his mercenaries, it caught sparks, flint against steel.

reference_spacy_tokens: From the bright fighting trim of his mercenaries , it caught sparks , flint against steel .


fn_spacy_tokens_for_baseline: The answer was a shocker .

source_bert_toks: the answer was a shock ##er .

reference_raw: The answer was shocking.

reference_spacy_tokens: The answer was shocking .


fn_spacy_tokens_for_baseline: In the House of Lords debate on 27 July 1869 , Lord Romilly deprecated continuing the power of imprisonment for debt in the hands of county courts .

source_bert_toks: in the house of lords debate on 27 july 1869 , lord rom ##illy de ##pre ##cated continuing the power of imprisonment for debt in the hands of county courts .

reference_raw: In the debate of the House of Lords on 27 July 1869, Lord Romilly waived the right to remain incarcerated for debt in the hands of the county courts.

reference_spacy_tokens: In the debate of the House of Lords on 27 July 1869 , Lord Romilly waived the right to remain incarcerated for debt in the hands of the county courts .


fn_spacy_tokens_for_baseline: Indeed , Lane 's ( 1955 ) argument that a stream will restore its gradient at a higher or lower level following a baselevel change is conceptually correct because if the river is initially at grade , then to move its sediment load and water discharge through the channel , the original gradient of the stream must be reestablished .

source_bert_toks: indeed , lane ' s ( 1955 ) argument that a stream will restore its gradient at a higher or lower level following a basel ##eve ##l change is conceptual ##ly correct because if the river is initially at grade , then to move its sediment load and water discharge through the channel , the original gradient of the stream must be rees ##tablished .

reference_raw: In fact, the argument of Lane (1955) that a stream restores its gradient to a higher or lower degree after a fundamental change is conceptually correct, since if the river is first in grade, then to move its sediment load and discharge through the channel, the original gradient of the stream must be restored.

reference_spacy_tokens: In fact , the argument of Lane ( 1955 ) that a stream restores its gradient to a higher or lower degree after a fundamental change is conceptually correct , since if the river is first in grade , then to move its sediment load and discharge through the channel , the original gradient of the stream must be restored .


fn_spacy_tokens_for_baseline: Traditional Irish music is also alive and well , especially in the pubs , and there has been a revival of storytelling , poetry reading , and traditional dancing .

source_bert_toks: traditional irish music is also alive and well , especially in the pubs , and there has been a revival of storytelling , poetry reading , and traditional dancing .

reference_raw: Traditional Irish musicals are also alive and well, especially in pubs, and stories, poetry readings, and traditional dances have been revived.

reference_spacy_tokens: Traditional Irish musicals are also alive and well , especially in pubs , and stories , poetry readings , and traditional dances have been revived .


fn_spacy_tokens_for_baseline: In these cases , analysis may have to suffice , or feminists may have to be content with informal , guerilla - style resistance .

source_bert_toks: in these cases , analysis may have to su ##ffi ##ce , or feminist ##s may have to be content with informal , gu ##eri ##lla - style resistance .

reference_raw: In such cases, the analysis may be sufficient, or feminists may be satisfied with non-formal guerrilla resistance.

reference_spacy_tokens: In such cases , the analysis may be sufficient , or feminists may be satisfied with non - formal guerrilla resistance .


fn_spacy_tokens_for_baseline: It is best controlled by dusting the green parts of the vine , especially when it is hot , with finely powdered sulphur .

source_bert_toks: it is best controlled by dustin ##g the green parts of the vine , especially when it is hot , with finely powder ##ed sul ##ph ##ur .

reference_raw: It is best controlled by dusting the green parts of the wine, particularly when it is hot and with a finely dusted sulphur content.

reference_spacy_tokens: It is best controlled by dusting the green parts of the wine , particularly when it is hot and with a finely dusted sulphur content .


fn_spacy_tokens_for_baseline: TOP referee Ray Lewis is being investigated by the Football Association for allegedly swearing at a supporter and faces disciplinary action .

source_bert_toks: top referee ray lewis is being investigated by the football association for allegedly swearing at a supporter and faces disciplinary action .

reference_raw: TOP ref, Ray Lewis, is under investigation by the football association for allegedly swearing to a supporter and is facing disciplinary action.

reference_spacy_tokens: TOP ref , Ray Lewis , is under investigation by the football association for allegedly swearing to a supporter and is facing disciplinary action .


fn_spacy_tokens_for_baseline: My hazy memory of your novel suggests that you were entirely too kind to Victor 's betrothed , Elizabeth , and more than entirely too kind to his friend , Henry Clerval .

source_bert_toks: my hazy memory of your novel suggests that you were entirely too kind to victor ' s bet ##rot ##hed , elizabeth , and more than entirely too kind to his friend , henry cl ##er ##val .

reference_raw: My vague recollection of your novel suggests that you were entirely too kind to Victor's engagement, Elizabeth, and more than ever too kind to his friend, Henry Clerval.

reference_spacy_tokens: My vague recollection of your novel suggests that you were entirely too kind to Victor 's engagement , Elizabeth , and more than ever too kind to his friend , Henry Clerval .


fn_spacy_tokens_for_baseline: Conversely , the US regards Iran as a rogue state that sponsors international terrorism ( including support for terrorists targeting the United States ) and seeks to subvert US allies in the region .

source_bert_toks: conversely , the us regards iran as a rogue state that sponsors international terrorism ( including support for terrorists targeting the united states ) and seeks to sub ##vert us allies in the region .

reference_raw: The US, on the other hand, considers Iran to be a rogue state that sponsors international terrorism (including support to terrorists targeting the US) and seeks to overthrow American allies in the region.

reference_spacy_tokens: The US , on the other hand , considers Iran to be a rogue state that sponsors international terrorism ( including support to terrorists targeting the US ) and seeks to overthrow American allies in the region .


fn_spacy_tokens_for_baseline: Occasional hurricanes can spoil the idyllic climate and contribute to this " laid back " attitude : Jamaicans are aware that circumstances can suddenly alter dramatically and yet life will always carry on .

source_bert_toks: occasional hurricanes can spoil the id ##yl ##lic climate and contribute to this " laid back " attitude : jamaican ##s are aware that circumstances can suddenly alter dramatically and yet life will always carry on .

reference_raw: Sometimes hurricanes can spoil the idyllic climate and contribute to this "laid back" approach: the Jamaicans realize that circumstances can change dramatically, but life will always continue.

reference_spacy_tokens: Sometimes hurricanes can spoil the idyllic climate and contribute to this " laid back " approach : the Jamaicans realize that circumstances can change dramatically , but life will always continue .


fn_spacy_tokens_for_baseline: The critic must not be niggardly with his advice nor restrain himself so politely that he is unjust .

source_bert_toks: the critic must not be ni ##gga ##rd ##ly with his advice nor restrain himself so politely that he is un ##just .

reference_raw: A critic must not be negligent with his advice, nor be so courteous as to be unfair.

reference_spacy_tokens: A critic must not be negligent with his advice , nor be so courteous as to be unfair .


fn_spacy_tokens_for_baseline: He invoked a new law Monday allowing him to bypass the Pentagon acquisition process .

source_bert_toks: he invoked a new law monday allowing him to bypass the pentagon acquisition process .

reference_raw: On Monday, he invoked a new law that would allow him to circumvent the Pentagon's acquisition process.

reference_spacy_tokens: On Monday , he invoked a new law that would allow him to circumvent the Pentagon 's acquisition process .


fn_spacy_tokens_for_baseline: She knew Angel Clare preferred her to the others .

source_bert_toks: she knew angel clare preferred her to the others .

reference_raw: She knew that Angel Clare chose her over the others.

reference_spacy_tokens: She knew that Angel Clare chose her over the others .


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem . ( Do n't say Stephanopoulos did n't know .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem . ( don ' t say stephan ##op ##oulos didn ' t know .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around stupid artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had a disturbing zipper problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around stupid artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem .


fn_spacy_tokens_for_baseline: A date and walnut loaf .

source_bert_toks: a date and walnut loaf .

reference_raw: Day and walnut loaf.

reference_spacy_tokens: Day and walnut loaf .


fn_spacy_tokens_for_baseline: Many Jamaicans head to the States for further education , and the American economic influence on areas such as business investment and planning is growing .

source_bert_toks: many jamaican ##s head to the states for further education , and the american economic influence on areas such as business investment and planning is growing .

reference_raw: Many Jamaicans are heading to the States for further education, and America's economic impact on fields such as business investment and planning is increasing.

reference_spacy_tokens: Many Jamaicans are heading to the States for further education , and America 's economic impact on fields such as business investment and planning is increasing .


fn_spacy_tokens_for_baseline: A dead snail decomposes very rapidly , fouling the water badly .

source_bert_toks: a dead snail deco ##mp ##oses very rapidly , foul ##ing the water badly .

reference_raw: The dead snail disintegrates very quickly, fouling the water badly.

reference_spacy_tokens: The dead snail disintegrates very quickly , fouling the water badly .


fn_spacy_tokens_for_baseline: Leitenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told UPI that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

source_bert_toks: lei ##tenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told up ##i that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

reference_raw: Leitenberg, who has been working on weapons control and chemical and biological weapons issues for 40 years, told UPI that "the best-case scenario" could kill most people in a subway car, but added "any calculation (one can make a loss) depends on a number of assumptions."

reference_spacy_tokens: Leitenberg , who has been working on weapons control and chemical and biological weapons issues for 40 years , told UPI that " the best - case scenario " could kill most people in a subway car , but added " any calculation ( one can make a loss ) depends on a number of assumptions . "


fn_spacy_tokens_for_baseline: Whereas in Crime and Punishment and in the novels which follow he can , though his narrow glee over being ahead of the fact is unworthy of his art and of what ' idealism ' and ' deeper realism ' intend .

source_bert_toks: whereas in crime and punishment and in the novels which follow he can , though his narrow glee over being ahead of the fact is un ##worthy of his art and of what ' ideal ##ism ' and ' deeper realism ' intend .

reference_raw: Whereas, in crime and punishment, and in the novels that follow, he can do so, though his narrow pleasure at being ahead of the fact is not worthy of his art and what "idealism" and "deep realism" mean.

reference_spacy_tokens: Whereas , in crime and punishment , and in the novels that follow , he can do so , though his narrow pleasure at being ahead of the fact is not worthy of his art and what " idealism " and " deep realism " mean .


fn_spacy_tokens_for_baseline: Angiosperms grow from ovules ( seeds ) protected in their own case , where gymnosperms grow only from seeds without the protective case .

source_bert_toks: ang ##ios ##per ##ms grow from o ##vu ##les ( seeds ) protected in their own case , where gym ##nos ##per ##ms grow only from seeds without the protective case .

reference_raw: Angiosperms are produced from ovules (seeds) protected in their own case, where gymnosperms are only produced from seeds without a protective casing.

reference_spacy_tokens: Angiosperms are produced from ovules ( seeds ) protected in their own case , where gymnosperms are only produced from seeds without a protective casing .


fn_spacy_tokens_for_baseline: How can I fix a gate post to a wall ?

source_bert_toks: how can i fix a gate post to a wall ?

reference_raw: How can I repair the gatepost to the wall?

reference_spacy_tokens: How can I repair the gatepost to the wall ?


fn_spacy_tokens_for_baseline: Contralto , eyes rolling , ears flat , skittishly began to mince past them .

source_bert_toks: contra ##lto , eyes rolling , ears flat , ski ##tti ##sh ##ly began to min ##ce past them .

reference_raw: Contralto, his eyes rolling, his ears flat and skittish, began to brush past them.

reference_spacy_tokens: Contralto , his eyes rolling , his ears flat and skittish , began to brush past them .


fn_spacy_tokens_for_baseline: The expansion of air travel began the age of mass tourism , and Greece along with the Aegean Islands became exciting destinations for northern Europeans escaping their damp , cool summers .

source_bert_toks: the expansion of air travel began the age of mass tourism , and greece along with the aegean islands became exciting destinations for northern europeans escaping their damp , cool summers .

reference_raw: The expansion of air travel began in the age of mass tourism, and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet, cold summers.

reference_spacy_tokens: The expansion of air travel began in the age of mass tourism , and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet , cold summers .


fn_spacy_tokens_for_baseline: U. S. Marines talked about their arms -- including the imposing shoulder - fired multipurpose assault weapon , a rocket launcher used to take out armored vehicles , buildings and other fortified positions .

source_bert_toks: u . s . marines talked about their arms - - including the imposing shoulder - fired multi ##pur ##pose assault weapon , a rocket launcher used to take out armored vehicles , buildings and other fortified positions .

reference_raw: The U.S. Marines were talking about their weapons -- including an impressive multi-purpose assault weapon, a rocket launcher used to destroy armored vehicles, buildings, and other fortified positions.

reference_spacy_tokens: The U.S. Marines were talking about their weapons -- including an impressive multi - purpose assault weapon , a rocket launcher used to destroy armored vehicles , buildings , and other fortified positions .


fn_spacy_tokens_for_baseline: He tried a sip of tea and winced as the hot liquid scalded his tongue .

source_bert_toks: he tried a sip of tea and winced as the hot liquid sc ##ald ##ed his tongue .

reference_raw: He tried to drink his tea and winced as the hot liquid scalded his tongue.

reference_spacy_tokens: He tried to drink his tea and winced as the hot liquid scalded his tongue .


fn_spacy_tokens_for_baseline: Archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

source_bert_toks: archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

reference_raw: Archaeology shows that, during that period, companies lived mainly in coastal trading cities with small settlements in the interior.

reference_spacy_tokens: Archaeology shows that , during that period , companies lived mainly in coastal trading cities with small settlements in the interior .


fn_spacy_tokens_for_baseline: More detailed information on the designs and colours favoured by each country and individual group is contained in Chapters V , VI , and VII .

source_bert_toks: more detailed information on the designs and colours favoured by each country and individual group is contained in chapters v , vi , and vii .

reference_raw: Chapters V, VI and VII provide more detailed information on the designs and colours favoured by each country and group.

reference_spacy_tokens: Chapters V , VI and VII provide more detailed information on the designs and colours favoured by each country and group .


fn_spacy_tokens_for_baseline: With a low snigger , he bowed and left .

source_bert_toks: with a low s ##nig ##ger , he bowed and left .

reference_raw: He bowed and walked away with a low chuckle.

reference_spacy_tokens: He bowed and walked away with a low chuckle .


fn_spacy_tokens_for_baseline: Aoun and his two colleagues , Gen. Issam Abu Jamrah and Gen. Adgar Ma'luf , were subsequently given a special pardon by President Elias Hrawi .

source_bert_toks: ao ##un and his two colleagues , gen . iss ##am abu jam ##rah and gen . ad ##gar ma ' lu ##f , were subsequently given a special pardon by president elias hr ##aw ##i .

reference_raw: Aoun and his two colleagues, General Issam Abu Jamrah and General Adgar Ma'luf, were subsequently granted special remission by President Elias Hrawi.

reference_spacy_tokens: Aoun and his two colleagues , General Issam Abu Jamrah and General Adgar Ma'luf , were subsequently granted special remission by President Elias Hrawi .


fn_spacy_tokens_for_baseline: Geographically it is extremely diverse , with a central backbone of high mountains and hills blanketed with tropical rain - forest .

source_bert_toks: geographically it is extremely diverse , with a central backbone of high mountains and hills blanket ##ed with tropical rain - forest .

reference_raw: The geographical area is very different, with a central backbone of high mountains and hills covered with tropical rainforests.

reference_spacy_tokens: The geographical area is very different , with a central backbone of high mountains and hills covered with tropical rainforests .


fn_spacy_tokens_for_baseline: Similarly , use of maladaptive coping strategies such as avoidance behaviour , taking tranquillizers , and visiting their GP , decreased , while the adoption of adaptive coping strategies , such as relaxation , increased .

source_bert_toks: similarly , use of mala ##da ##ptive coping strategies such as avoidance behaviour , taking tran ##quil ##lizer ##s , and visiting their gp , decreased , while the adoption of adaptive coping strategies , such as relaxation , increased .

reference_raw: Similarly, the use of maladaptive coping strategies, such as avoiding behaviour, taking sedatives and visiting GDP, has decreased and the adoption of adaptive coping strategies, such as relaxation, has increased.

reference_spacy_tokens: Similarly , the use of maladaptive coping strategies , such as avoiding behaviour , taking sedatives and visiting GDP , has decreased and the adoption of adaptive coping strategies , such as relaxation , has increased .


fn_spacy_tokens_for_baseline: Iraq clears visit by Ohio official By Scott Montgomery

source_bert_toks: iraq clears visit by ohio official by scott montgomery

reference_raw: Iraq exonerates a visit from an Ohio official by Scott Montgomery


fn_spacy_tokens_for_baseline: However , intense U.S. pressure for Iran to prove it had no secret atomic weapons program culminated in a toughly worded UN resolution in September 2003 , prompting a walkout and subsequent freeze on nuclear inspections by Iran .

source_bert_toks: however , intense u . s . pressure for iran to prove it had no secret atomic weapons program culminated in a tough ##ly word ##ed un resolution in september 2003 , prompting a walk ##out and subsequent freeze on nuclear inspections by iran .

reference_raw: But the strong US pressure on Iran to prove that it did not have a secret nuclear-weapons program culminated in the hard-worded UN resolution of September 2003, which prompted the withdrawal and subsequent freezing of Iran's nuclear inspections.

reference_spacy_tokens: But the strong US pressure on Iran to prove that it did not have a secret nuclear - weapons program culminated in the hard - worded UN resolution of September 2003 , which prompted the withdrawal and subsequent freezing of Iran 's nuclear inspections .


fn_spacy_tokens_for_baseline: ' We begin descending into the Vale tomorrow , ' Bicker called from ahead .

source_bert_toks: ' we begin descending into the vale tomorrow , ' bi ##cker called from ahead .

reference_raw: 'Tomorrow we'll start descending into the valley,' Bicker called from the front.

reference_spacy_tokens: ' Tomorrow we 'll start descending into the valley , ' Bicker called from the front .


fn_spacy_tokens_for_baseline: Although liability for affray is excluded where the threats are by words alone , it would be a somewhat unusual altercation in which both participants stood stock still whilst uttering their imprecations and threats .

source_bert_toks: although liability for af ##fra ##y is excluded where the threats are by words alone , it would be a somewhat unusual alter ##cation in which both participants stood stock still whilst utter ##ing their imp ##re ##cation ##s and threats .

reference_raw: Although liability for affray is excluded if the threat is expressed only in words, it would be a rather unusual argument in which the two participants remained in stock at the same time as they expressed their imprecisions and threats.

reference_spacy_tokens: Although liability for affray is excluded if the threat is expressed only in words , it would be a rather unusual argument in which the two participants remained in stock at the same time as they expressed their imprecisions and threats .


fn_spacy_tokens_for_baseline: Even to get this much he had had to agree to a number of statutes which he construed as so prejudicial that he vowed to repeal them as soon as possible .

source_bert_toks: even to get this much he had had to agree to a number of statutes which he con ##st ##rued as so pre ##ju ##dic ##ial that he vowed to repeal them as soon as possible .

reference_raw: Even in order to get that much, he had to agree to a number of articles of association, which he interpreted as being so prejudiced that he vowed to abolish them as soon as possible.

reference_spacy_tokens: Even in order to get that much , he had to agree to a number of articles of association , which he interpreted as being so prejudiced that he vowed to abolish them as soon as possible .


fn_spacy_tokens_for_baseline: The almshouses ' occupants were old ladies who , to be eligible , had to be of good character and lifelong churchwomen .

source_bert_toks: the al ##ms ##houses ' occupants were old ladies who , to be eligible , had to be of good character and lifelong church ##wo ##men .

reference_raw: The people of the almshouses were old ladies who, in order to qualify, had to be of a good nature and a lifetime of churchwomen.

reference_spacy_tokens: The people of the almshouses were old ladies who , in order to qualify , had to be of a good nature and a lifetime of churchwomen .


fn_spacy_tokens_for_baseline: It takes a long time for him to gain the self - confidence to work elsewhere in the community .

source_bert_toks: it takes a long time for him to gain the self - confidence to work elsewhere in the community .

reference_raw: It takes him a long time to get his self-confidence to work elsewhere in the community.

reference_spacy_tokens: It takes him a long time to get his self - confidence to work elsewhere in the community .


fn_spacy_tokens_for_baseline: Nicola dropped her arms and the shirt cuffs fell over her knuckles ; it was a full size too big .

source_bert_toks: nicola dropped her arms and the shirt cuffs fell over her knuckles ; it was a full size too big .

reference_raw: Nicole lowered her arms and the cuffs of her shirt fell over her ankles; they were too big.

reference_spacy_tokens: Nicole lowered her arms and the cuffs of her shirt fell over her ankles ; they were too big .


fn_spacy_tokens_for_baseline: Mesa was indicted by the Cuyahoga County grand jury Jan. 16 on one count of rape , two counts of gross sexual imposition , one count of felonious assault and one count of carrying a concealed weapon .

source_bert_toks: mesa was indicted by the cu ##yah ##oga county grand jury jan . 16 on one count of rape , two counts of gross sexual imp ##osition , one count of fe ##lon ##ious assault and one count of carrying a concealed weapon .

reference_raw: Mesa has been charged by the Grand Jury of Cuyahoga County, Jan. 16, on one counts of rape, two counts of gross sexual assault, one count of criminal assault, and one count of possession of a concealed weapon.

reference_spacy_tokens: Mesa has been charged by the Grand Jury of Cuyahoga County , Jan. 16 , on one counts of rape , two counts of gross sexual assault , one count of criminal assault , and one count of possession of a concealed weapon .


fn_spacy_tokens_for_baseline: Prime Minister Ariel Sharon of Israel urged President Bush to step up pressure on Iran to give up all elements of its nuclear program .

source_bert_toks: prime minister ariel sharon of israel urged president bush to step up pressure on iran to give up all elements of its nuclear program .

reference_raw: President Ariel Sharon of Israel urged President Bush to step up pressure on Iran to surrender all elements of its nuclear program.

reference_spacy_tokens: President Ariel Sharon of Israel urged President Bush to step up pressure on Iran to surrender all elements of its nuclear program .


fn_spacy_tokens_for_baseline: In 1947 the United Nations voted for the partition of Palestine into two states , one Jewish and one Arab , with Jerusalem as an international city that belonged to neither .

source_bert_toks: in 1947 the united nations voted for the partition of palestine into two states , one jewish and one arab , with jerusalem as an international city that belonged to neither .

reference_raw: In 1947, the United Nations voted to divide Palestine into two states, one Jewish and one Arab, and Jerusalem was an international city that was not one of them.

reference_spacy_tokens: In 1947 , the United Nations voted to divide Palestine into two states , one Jewish and one Arab , and Jerusalem was an international city that was not one of them .


fn_spacy_tokens_for_baseline: The quick and the dead ( 12 ) The shapes , the voices that throng his mind , for there are days when the living have no substance and the dead are active ( 13 ) .

source_bert_toks: the quick and the dead ( 12 ) the shapes , the voices that th ##rong his mind , for there are days when the living have no substance and the dead are active ( 13 ) .

reference_raw: Fast and dead (12) Shapes, voices that strangle his mind, for there are days when life has no substance and the dead are active (13).

reference_spacy_tokens: Fast and dead ( 12 ) Shapes , voices that strangle his mind , for there are days when life has no substance and the dead are active ( 13 ) .


fn_spacy_tokens_for_baseline: Greece moved in to administer the land , but a new influence upset any grand dreams of making this region a part of greater Greece .

source_bert_toks: greece moved in to administer the land , but a new influence upset any grand dreams of making this region a part of greater greece .

reference_raw: Greece has moved in to manage the country, but the new influence has upset every great dream of making this region part of the larger Greece.

reference_spacy_tokens: Greece has moved in to manage the country , but the new influence has upset every great dream of making this region part of the larger Greece .


fn_spacy_tokens_for_baseline: Fire department spokesman Nikos Diamandis said most of the fires were started in entirely different areas , and were started after dark .

source_bert_toks: fire department spokesman nik ##os dia ##man ##dis said most of the fires were started in entirely different areas , and were started after dark .

reference_raw: Firefighter Nikos Diamandis said that most of the fires started in completely different areas and started after dark.

reference_spacy_tokens: Firefighter Nikos Diamandis said that most of the fires started in completely different areas and started after dark .


fn_spacy_tokens_for_baseline: This was the claim made , if memory serves , for the budget hashed out between Congress and George Bush in the extended wrangle of 1990 .

source_bert_toks: this was the claim made , if memory serves , for the budget hash ##ed out between congress and george bush in the extended wr ##ang ##le of 1990 .

reference_raw: This is the claim made, if memory is useful, for the budget between Congress and George Bush in the extended twist of 1990.

reference_spacy_tokens: This is the claim made , if memory is useful , for the budget between Congress and George Bush in the extended twist of 1990 .


fn_spacy_tokens_for_baseline: Later , on witnessing a sati ( the immolation of a Hindu widow ) , Ibn Battuta was so shocked he nearly fell off his camel .

source_bert_toks: later , on witnessing a sat ##i ( the im ##mo ##lation of a hindu widow ) , ibn bat ##tu ##ta was so shocked he nearly fell off his camel .

reference_raw: Later, when Ibn Battuta witnessed the sati (immolating the Hindu widow), he was so shocked that he almost fell from the camel.

reference_spacy_tokens: Later , when Ibn Battuta witnessed the sati ( immolating the Hindu widow ) , he was so shocked that he almost fell from the camel .


fn_spacy_tokens_for_baseline: She helped some bairns when she was living in the Australian outback .

source_bert_toks: she helped some bai ##rn ##s when she was living in the australian out ##back .

reference_raw: When she lived in the back of Australia, she helped some bairns.

reference_spacy_tokens: When she lived in the back of Australia , she helped some bairns .


fn_spacy_tokens_for_baseline: Sit out on the veranda and drink in the stunning view as you sip your gin pahit ( pink gin ) .

source_bert_toks: sit out on the vera ##nda and drink in the stunning view as you sip your gin pa ##hit ( pink gin ) .

reference_raw: When you sip your gin pahit (pink gin), sit on the porch and drink in a stunning view.

reference_spacy_tokens: When you sip your gin pahit ( pink gin ) , sit on the porch and drink in a stunning view .


fn_spacy_tokens_for_baseline: For the first time I noticed the brothers ' yarmulkes in the somewhat subdued light of the boardroom , plain black skullcaps blending in with the pale glow of the room .

source_bert_toks: for the first time i noticed the brothers ' ya ##rm ##ul ##kes in the somewhat subdued light of the board ##room , plain black skull ##cap ##s blending in with the pale glow of the room .

reference_raw: For the first time I noticed the yarmulkes of the brothers in the slightly subdued light of the boardroom, the plain black skull caps blending with the pale glow of the room.

reference_spacy_tokens: For the first time I noticed the yarmulkes of the brothers in the slightly subdued light of the boardroom , the plain black skull caps blending with the pale glow of the room .


fn_spacy_tokens_for_baseline: And yet , despite this , there was too much to separate the men ; they exasperated each other and yet they needed each other .

source_bert_toks: and yet , despite this , there was too much to separate the men ; they exasperated each other and yet they needed each other .

reference_raw: And yet, in spite of that, there was too much to separate the men; they were irritating each other, and yet they needed each other.

reference_spacy_tokens: And yet , in spite of that , there was too much to separate the men ; they were irritating each other , and yet they needed each other .


fn_spacy_tokens_for_baseline: As the indecision dragged on , Kadafi 's blood - streaked corpse remained in the cold storage warehouse , the natural process of decay taking an obvious toll .

source_bert_toks: as the ind ##ec ##ision dragged on , ka ##da ##fi ' s blood - streaked corpse remained in the cold storage warehouse , the natural process of decay taking an obvious toll .

reference_raw: As the indecision continued, Kadafi's blood-stained body remained in the cold storeroom, and the natural process of decay took a clear toll.

reference_spacy_tokens: As the indecision continued , Kadafi 's blood - stained body remained in the cold storeroom , and the natural process of decay took a clear toll .


fn_spacy_tokens_for_baseline: She would have liked to express her opinion of his girlfriend , but prudently refrained .

source_bert_toks: she would have liked to express her opinion of his girlfriend , but pr ##ude ##ntly refrain ##ed .

reference_raw: She wanted to say what she thought about his girlfriend, but she was careful not to.

reference_spacy_tokens: She wanted to say what she thought about his girlfriend , but she was careful not to .


fn_spacy_tokens_for_baseline: The IAEA also criticized Iran 's lack of forthrightness about its possession of P - 2 design drawings and other related research , and information regarding its manufacturing and mechanical testing activities , all of which was omitted from Iran 's 21 October 2003 declaration to the agency .

source_bert_toks: the ia ##ea also criticized iran ' s lack of forth ##right ##ness about its possession of p - 2 design drawings and other related research , and information regarding its manufacturing and mechanical testing activities , all of which was omitted from iran ' s 21 october 2003 declaration to the agency .

reference_raw: The IAEA also criticised Iran's lack of integrity in its possession of P-2 design drawings and other related research and information on its production and mechanical testing activities, all of which had been omitted from Iran's Declaration to the Agency on 21 October 2003.

reference_spacy_tokens: The IAEA also criticised Iran 's lack of integrity in its possession of P-2 design drawings and other related research and information on its production and mechanical testing activities , all of which had been omitted from Iran 's Declaration to the Agency on 21 October 2003 .


fn_spacy_tokens_for_baseline: Coincidentally , or maybe not , the storm chose that moment to let off a sheet of dazzling green lightning and an earsplitting crack of thunder .

source_bert_toks: coincidentally , or maybe not , the storm chose that moment to let off a sheet of dazzling green lightning and an ears ##pl ##itt ##ing crack of thunder .

reference_raw: By chance, or perhaps not, the storm had picked the moment to release a sheet of blinding green lightning and the sound of thunder.

reference_spacy_tokens: By chance , or perhaps not , the storm had picked the moment to release a sheet of blinding green lightning and the sound of thunder .


fn_spacy_tokens_for_baseline: Land speculators and locals alike were anxious to own a part of the newest railroad boomtown , and within an afternoon , more than 80 percent of the lots were sold .

source_bert_toks: land spec ##ulator ##s and locals alike were anxious to own a part of the newest railroad boom ##town , and within an afternoon , more than 80 percent of the lots were sold .

reference_raw: Land speculators and locals were eager to own part of the newest railway boomtown, and in the afternoon over 80% of the lots were sold.

reference_spacy_tokens: Land speculators and locals were eager to own part of the newest railway boomtown , and in the afternoon over 80 % of the lots were sold .


fn_spacy_tokens_for_baseline: Benjamin 's stomach seemed to have caught up with his memories for he now looked white - faced and confessed he felt queasy .

source_bert_toks: benjamin ' s stomach seemed to have caught up with his memories for he now looked white - faced and confessed he felt que ##as ##y .

reference_raw: Benjamin's stomach seemed to catch up with his memories, for his face was white now, and he admitted that he felt uneasy.

reference_spacy_tokens: Benjamin 's stomach seemed to catch up with his memories , for his face was white now , and he admitted that he felt uneasy .


fn_spacy_tokens_for_baseline: Recent business projections for Las Vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

source_bert_toks: recent business projections for las vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

reference_raw: Recent business forecasts in Las Vegas predict problems; tourism revenues need to increase significantly in order to maintain what has already been built, while actual data show that visits are stable or declining.

reference_spacy_tokens: Recent business forecasts in Las Vegas predict problems ; tourism revenues need to increase significantly in order to maintain what has already been built , while actual data show that visits are stable or declining .


fn_spacy_tokens_for_baseline: I 'd say shut up , shush .

source_bert_toks: i ' d say shut up , shu ##sh .

reference_raw: I'd say shut up, shut up.

reference_spacy_tokens: I 'd say shut up , shut up .


fn_spacy_tokens_for_baseline: A French jury found him guilty of involuntary manslaughter after a three - day trial in Paris .

source_bert_toks: a french jury found him guilty of involuntary mans ##lau ##ght ##er after a three - day trial in paris .

reference_raw: The French jury found him guilty of involuntary murder after a three-day trial in Paris.

reference_spacy_tokens: The French jury found him guilty of involuntary murder after a three - day trial in Paris .


fn_spacy_tokens_for_baseline: Thus , pressure is increasing to identify sources and modes of transmission , and to segregate colonised from non - colonised patients .

source_bert_toks: thus , pressure is increasing to identify sources and modes of transmission , and to se ##gre ##gate colon ##ised from non - colon ##ised patients .

reference_raw: As a result, pressure is increasing to identify sources and modes of transmission and to separate colonised patients from non-colonised patients.

reference_spacy_tokens: As a result , pressure is increasing to identify sources and modes of transmission and to separate colonised patients from non - colonised patients .


fn_spacy_tokens_for_baseline: QN : Has the transaction taken place ?

source_bert_toks: q ##n : has the transaction taken place ?

reference_raw: QN: Did the operation take place?

reference_spacy_tokens: QN : Did the operation take place ?


fn_spacy_tokens_for_baseline: He could not decide whether it boded good or ill .

source_bert_toks: he could not decide whether it bo ##ded good or ill .

reference_raw: He couldn't decide if it was good or bad.

reference_spacy_tokens: He could n't decide if it was good or bad .


fn_spacy_tokens_for_baseline: Sightseeing in Hong Kong starts at sea level with the enthralling water traffic?-?a mix of freighters , ferries , tugs , junks , and yachts .

source_bert_toks: sights ##ee ##ing in hong kong starts at sea level with the en ##th ##ral ##ling water traffic ? - ? a mix of freighter ##s , ferries , tugs , junk ##s , and yacht ##s .

reference_raw: Sightseeing in Hong Kong begins at sea with fascinating water traffic? - a combination of cargo ships, ferries, tugs, junks and yachts.

reference_spacy_tokens: Sightseeing in Hong Kong begins at sea with fascinating water traffic ? - a combination of cargo ships , ferries , tugs , junks and yachts .