fn_spacy_tokens_for_baseline: One day , she ran a mile or more after him , seeing only that stubby squat little figure going through traffic lights , ignoring cars that hooted and people who screamed warnings at him .

source_bert_toks: one day , she ran a mile or more after him , seeing only that stu ##bby squat little figure going through traffic lights , ignoring cars that ho ##oted and people who screamed warnings at him .

reference_raw: One day she ran a mile or more after him, seeing nothing but the stumpy, squat figure passing through the traffic lights, ignoring the cars hooting and the people shouting warnings at him.

reference_spacy_tokens: One day she ran a mile or more after him , seeing nothing but the stumpy , squat figure passing through the traffic lights , ignoring the cars hooting and the people shouting warnings at him .


fn_spacy_tokens_for_baseline: The interior walls are lined with marble slabs and both dome and vaults still have their original mosaics which are of rich and exceptional quality .

source_bert_toks: the interior walls are lined with marble slabs and both dome and vaults still have their original mosaic ##s which are of rich and exceptional quality .

reference_raw: The inner walls are lined with marble plates, and both the dome and the vaults still have their original mosaics, rich and unique.

reference_spacy_tokens: The inner walls are lined with marble plates , and both the dome and the vaults still have their original mosaics , rich and unique .


fn_spacy_tokens_for_baseline: The celebratory burial of the shoeless waif .

source_bert_toks: the ce ##le ##bra ##tory burial of the shoe ##less wai ##f .

reference_raw: Celebratory burial of a bootless waif.

reference_spacy_tokens: Celebratory burial of a bootless waif .


fn_spacy_tokens_for_baseline: ' Why , Mr. Holmes , when you were crawling in the shrubbery at High Gable I was up one of the trees in the plantation and saw you down below .

source_bert_toks: ' why , mr . holmes , when you were crawling in the shrub ##bery at high gable i was up one of the trees in the plantation and saw you down below .

reference_raw: 'Why, Mr. Holmes, when you crawled through the bushes at High Gable, I climbed one of the trees in the plants and I saw you downstairs.

reference_spacy_tokens: ' Why , Mr. Holmes , when you crawled through the bushes at High Gable , I climbed one of the trees in the plants and I saw you downstairs .


fn_spacy_tokens_for_baseline: They had gagged me , and Murillo twisted my arm round until I gave him the address .

source_bert_toks: they had gag ##ged me , and mu ##rill ##o twisted my arm round until i gave him the address .

reference_raw: They pulled me out, and Murillo turned my arm around until I gave him the address.

reference_spacy_tokens: They pulled me out , and Murillo turned my arm around until I gave him the address .


fn_spacy_tokens_for_baseline: The saint is much revered in the surrounding area .

source_bert_toks: the saint is much revered in the surrounding area .

reference_raw: The Holy One has a great deal of respect in the surrounding area.

reference_spacy_tokens: The Holy One has a great deal of respect in the surrounding area .


fn_spacy_tokens_for_baseline: A second cousin of the Queen had brawled on - stage with Manchester United 's centre forward .

source_bert_toks: a second cousin of the queen had brawl ##ed on - stage with manchester united ' s centre forward .

reference_raw: The second cousin of the Queen fought on stage with the center of Manchester United.

reference_spacy_tokens: The second cousin of the Queen fought on stage with the center of Manchester United .


fn_spacy_tokens_for_baseline: Lord Beddington clomped along in silence .

source_bert_toks: lord bed ##dington cl ##omp ##ed along in silence .

reference_raw: Lord Beddington closed in silently.

reference_spacy_tokens: Lord Beddington closed in silently .


fn_spacy_tokens_for_baseline: Censers burned , further hazing the air .

source_bert_toks: ce ##nse ##rs burned , further ha ##zing the air .

reference_raw: The censors were burning, and the air was still clouded.

reference_spacy_tokens: The censors were burning , and the air was still clouded .


fn_spacy_tokens_for_baseline: ' Great excitement was caused in Esher and the neighbouring district when it was learned late last night that an arrest had been effected in connection with the Oxshott murder .

source_bert_toks: ' great excitement was caused in es ##her and the neighbouring district when it was learned late last night that an arrest had been effect ##ed in connection with the ox ##shot ##t murder .

reference_raw: 'There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder.

reference_spacy_tokens: ' There was a great deal of excitement in Esher and in the neighboring district when it was discovered late last night that an arrest had been made in connection with the Oxshott murder .


fn_spacy_tokens_for_baseline: Paula_Zahn : And we now turn to senior medical correspondent Dr. Sanjay Gupto who has just gotten back from South Asia .

source_bert_toks: paula _ za ##hn : and we now turn to senior medical correspondent dr . sanjay gu ##pt ##o who has just gotten back from south asia .

reference_raw: Paula_Zahn: And now we turn to the chief medical correspondent, Dr. Sanjay Gupto, who has just returned from South Asia.

reference_spacy_tokens: Paula_Zahn : And now we turn to the chief medical correspondent , Dr. Sanjay Gupto , who has just returned from South Asia .


fn_spacy_tokens_for_baseline: Boxing Day brought a bumper crowd to Edgar Street .

source_bert_toks: boxing day brought a bumper crowd to edgar street .

reference_raw: "Boxing Day" brought a crowd of bumpers to Edgar Street.

reference_spacy_tokens: " Boxing Day " brought a crowd of bumpers to Edgar Street .


fn_spacy_tokens_for_baseline: Geranium though was obviously a good choice because of its diuretic properties -- and bergamot for its cheerful and uplifting aroma .

source_bert_toks: ge ##rani ##um though was obviously a good choice because of its di ##ure ##tic properties - - and berg ##amo ##t for its cheerful and up ##lifting aroma .

reference_raw: Geranium, though, was obviously a good choice because of its diuretic properties - and a bergamot because of its cheerful and refreshing aroma.

reference_spacy_tokens: Geranium , though , was obviously a good choice because of its diuretic properties - and a bergamot because of its cheerful and refreshing aroma .


fn_spacy_tokens_for_baseline: Within a few days of laying I place the egg mass in a dish , and squirt it with tank water from a pipette .

source_bert_toks: within a few days of laying i place the egg mass in a dish , and sq ##ui ##rt it with tank water from a pipe ##tte .

reference_raw: Within days of laying, I place the egg weight in a bowl and spray it with tank water from a pipette.

reference_spacy_tokens: Within days of laying , I place the egg weight in a bowl and spray it with tank water from a pipette .


fn_spacy_tokens_for_baseline: First , was the experience gained in missile operations during the previous three years , especially by the Missile Unit of the IRGC Air Force .

source_bert_toks: first , was the experience gained in missile operations during the previous three years , especially by the missile unit of the ir ##gc air force .

reference_raw: Firstly, the lessons learned from missile operations over the last three years, in particular from the IRGC Air Force Missile Unit.

reference_spacy_tokens: Firstly , the lessons learned from missile operations over the last three years , in particular from the IRGC Air Force Missile Unit .


fn_spacy_tokens_for_baseline: Note that alcohol and tobacco are both exceptions to Hong Kong 's duty - free regime and are subject to tax .

source_bert_toks: note that alcohol and tobacco are both exceptions to hong kong ' s duty - free regime and are subject to tax .

reference_raw: Note that alcohol and tobacco are both exemptions from Hong Kong's duty-free scheme and are subject to tax.

reference_spacy_tokens: Note that alcohol and tobacco are both exemptions from Hong Kong 's duty - free scheme and are subject to tax .


fn_spacy_tokens_for_baseline: Raoul was thirsty , hot and thirsty , and the rivers in the pictures danced and laughed at him .

source_bert_toks: raoul was thirsty , hot and thirsty , and the rivers in the pictures danced and laughed at him .

reference_raw: Raoul had a thirst, a hot thirst, and the rivers in the paintings danced and laughed at him.

reference_spacy_tokens: Raoul had a thirst , a hot thirst , and the rivers in the paintings danced and laughed at him .


fn_spacy_tokens_for_baseline: They will be documented in a substantial reference manual , the Guidelines for Text Encoding for Interchange .

source_bert_toks: they will be documented in a substantial reference manual , the guidelines for text encoding for interchange .

reference_raw: They shall be recorded in a significant reference manual, the text encoding guidelines for the exchange of information.

reference_spacy_tokens: They shall be recorded in a significant reference manual , the text encoding guidelines for the exchange of information .


fn_spacy_tokens_for_baseline: Much of the housing is unfit for human habitation , and the proportion of dwellings which are overcrowded or lack basic amenities is much higher in these areas than elsewhere .

source_bert_toks: much of the housing is unfit for human habitat ##ion , and the proportion of dwellings which are over ##crow ##ded or lack basic amenities is much higher in these areas than elsewhere .

reference_raw: Most dwellings are unfit for human consumption and the proportion of dwellings that are crowded or lack basic amenities is much higher in these areas than elsewhere.

reference_spacy_tokens: Most dwellings are unfit for human consumption and the proportion of dwellings that are crowded or lack basic amenities is much higher in these areas than elsewhere .


fn_spacy_tokens_for_baseline: If I had married and had a son , I reasoned to myself , that boy would be about Tom 's age .

source_bert_toks: if i had married and had a son , i reasoned to myself , that boy would be about tom ' s age .

reference_raw: If I had married and had a son, I thought, the boy would have been about Tom's age.

reference_spacy_tokens: If I had married and had a son , I thought , the boy would have been about Tom 's age .


fn_spacy_tokens_for_baseline: Some wore brightly coloured Chinese long gowns and black mandarin bonnets , others , shorter black silk coats and white trousers .

source_bert_toks: some wore brightly coloured chinese long gown ##s and black mandarin bonnet ##s , others , shorter black silk coats and white trousers .

reference_raw: Some wore brightly colored Chinese long robes and black mandarin hats, others shorter black silk jackets and white pants.

reference_spacy_tokens: Some wore brightly colored Chinese long robes and black mandarin hats , others shorter black silk jackets and white pants .


fn_spacy_tokens_for_baseline: The monastery is strictly vegetarian , and visitors are warned not to bring any meat with them .

source_bert_toks: the monastery is strictly vegetarian , and visitors are warned not to bring any meat with them .

reference_raw: The convent is strictly vegetarian, and the visitors are warned not to bring any meat.

reference_spacy_tokens: The convent is strictly vegetarian , and the visitors are warned not to bring any meat .


fn_spacy_tokens_for_baseline: " Ringing does become a bit of an obsession , " admits Stephanie Pattenden , master of the band at St. Mary Abbot and one of England 's best female ringers .

source_bert_toks: " ringing does become a bit of an obsession , " admits stephanie pat ##ten ##den , master of the band at st . mary abbot and one of england ' s best female ring ##ers .

reference_raw: "The ring is becoming a little obsessed," admits Stephanie Pattenden, master of St. Mary Abbot's band and one of England's finest ringers.

reference_spacy_tokens: " The ring is becoming a little obsessed , " admits Stephanie Pattenden , master of St. Mary Abbot 's band and one of England 's finest ringers .


fn_spacy_tokens_for_baseline: They are very considerable : Since 1986 , when Spain joined the European Community , its gross domestic product has grown at an annual average of 4.6 % -- the fastest in the EC .

source_bert_toks: they are very considerable : since 1986 , when spain joined the european community , its gross domestic product has grown at an annual average of 4 . 6 % - - the fastest in the ec .

reference_raw: These are very significant: since the accession of Spain to the European Community in 1986, its gross domestic product has increased by 4,6 % per year on average, the most rapid in the European Community.

reference_spacy_tokens: These are very significant : since the accession of Spain to the European Community in 1986 , its gross domestic product has increased by 4,6 % per year on average , the most rapid in the European Community .


fn_spacy_tokens_for_baseline: Private investment has even made an increasingly modern ferry fleet possible .

source_bert_toks: private investment has even made an increasingly modern ferry fleet possible .

reference_raw: In fact, private investments have made it possible to deploy an ever more modern ferry fleet.

reference_spacy_tokens: In fact , private investments have made it possible to deploy an ever more modern ferry fleet .


fn_spacy_tokens_for_baseline: They are teaming up with British and American publishers for simultaneous English and German editions of the same book , or themselves issuing an increasing number of bilingual ( usually German / English ) books .

source_bert_toks: they are teaming up with british and american publishers for simultaneous english and german editions of the same book , or themselves issuing an increasing number of bilingual ( usually german / english ) books .

reference_raw: They join British and American publishers for simultaneous English and German editions of the same book, or they themselves issue an increasing number of bilingual (usually German/English) books.

reference_spacy_tokens: They join British and American publishers for simultaneous English and German editions of the same book , or they themselves issue an increasing number of bilingual ( usually German / English ) books .


fn_spacy_tokens_for_baseline: He arched wicked black brows .

source_bert_toks: he arched wicked black brows .

reference_raw: He raised an evil black eyebrow.

reference_spacy_tokens: He raised an evil black eyebrow .


fn_spacy_tokens_for_baseline: Almost half of Ireland 's population is under twenty - five , and with its universities and professional schools , Dublin also has a large student population .

source_bert_toks: almost half of ireland ' s population is under twenty - five , and with its universities and professional schools , dublin also has a large student population .

reference_raw: Nearly half of the Irish population is under twenty-five, and Dublin also has a large student population with its universities and vocational schools.

reference_spacy_tokens: Nearly half of the Irish population is under twenty - five , and Dublin also has a large student population with its universities and vocational schools .


fn_spacy_tokens_for_baseline: One of my hands and ribs were broken as a result of torture ' .

source_bert_toks: one of my hands and ribs were broken as a result of torture ' .

reference_raw: One of my arms and ribs was fractured as a result of torture.

reference_spacy_tokens: One of my arms and ribs was fractured as a result of torture .


fn_spacy_tokens_for_baseline: In their sermons -- and particularly the ones they delivered at the Assizes -- Anglican clergymen continually stressed the need for judges , magistrates and juries to enforce the laws against the Nonconformists .

source_bert_toks: in their sermons - - and particularly the ones they delivered at the ass ##izes - - anglican clergy ##men continually stressed the need for judges , magistrates and ju ##ries to enforce the laws against the non ##con ##form ##ists .

reference_raw: In their sermons - and in particular those delivered by the Assizes - English priests have constantly emphasized the need for judges, judges and judges to enforce the law against non-conformists.

reference_spacy_tokens: In their sermons - and in particular those delivered by the Assizes - English priests have constantly emphasized the need for judges , judges and judges to enforce the law against non - conformists .


fn_spacy_tokens_for_baseline: " I 'm feeling a lot more optimistic today than I did yesterday .

source_bert_toks: " i ' m feeling a lot more optimistic today than i did yesterday .

reference_raw: "I feel much better today than I did yesterday."

reference_spacy_tokens: " I feel much better today than I did yesterday . "


fn_spacy_tokens_for_baseline: To me it 's a crock of shit to go out and harmonize with nature on my resin polyurethane surfboard . '

source_bert_toks: to me it ' s a cr ##ock of shit to go out and harmon ##ize with nature on my resin poly ##ure ##than ##e surf ##board . '

reference_raw: To me, it's a bunch of crap going out and aligning with the nature of my resin-polyurethane surfboard.'

reference_spacy_tokens: To me , it 's a bunch of crap going out and aligning with the nature of my resin - polyurethane surfboard . '


fn_spacy_tokens_for_baseline: He quietened his voice .

source_bert_toks: he quiet ##ened his voice .

reference_raw: He lowered his voice.

reference_spacy_tokens: He lowered his voice .


fn_spacy_tokens_for_baseline: Historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humored rivalry between the two areas .

source_bert_toks: historically and culturally this north - south distinction has always been significant , and it still is today , with a dose of good - humor ##ed rivalry between the two areas .

reference_raw: From a historical and cultural point of view, this distinction between the north and the south has always been significant, and it is still today, with a great deal of popular competition between the two regions.

reference_spacy_tokens: From a historical and cultural point of view , this distinction between the north and the south has always been significant , and it is still today , with a great deal of popular competition between the two regions .


fn_spacy_tokens_for_baseline: Governor Peter Leonard , who launched an inquiry yesterday , said only prompt action by staff prevented a violent free - for - all .

source_bert_toks: governor peter leonard , who launched an inquiry yesterday , said only prompt action by staff prevented a violent free - for - all .

reference_raw: Governor Peter Leonard, who opened the investigation yesterday, said that only immediate action by the staff prevented the violent freedom of all.

reference_spacy_tokens: Governor Peter Leonard , who opened the investigation yesterday , said that only immediate action by the staff prevented the violent freedom of all .


fn_spacy_tokens_for_baseline: The Chinese water deer , an escapee from zoos and parks , occurs in five English countries .

source_bert_toks: the chinese water deer , an escape ##e from zoo ##s and parks , occurs in five english countries .

reference_raw: China's water deer, a refugee from zoos and parks, is found in five English countries.

reference_spacy_tokens: China 's water deer , a refugee from zoos and parks , is found in five English countries .


fn_spacy_tokens_for_baseline: In this field , Iran 's research is concentrated in creating genes that produce toxins against insect pests ; improving the biological resistance of plants ; formulating new pesticides ; improving techniques of spraying or otherwise disseminating pesticides ; investigating the effects on native plant species after they have been introduced to various pests and diseases ; preventing the production of mycotoxins in crops ; producing plant viruses and their corresponding antiserums for an antiserum bank ; and manufacturing pheromones and hormones to combat arthropods that harm Iran 's agricultural industry .

source_bert_toks: in this field , iran ' s research is concentrated in creating genes that produce toxin ##s against insect pest ##s ; improving the biological resistance of plants ; formula ##ting new pest ##icides ; improving techniques of spraying or otherwise di ##sse ##minating pest ##icides ; investigating the effects on native plant species after they have been introduced to various pest ##s and diseases ; preventing the production of my ##cot ##ox ##ins in crops ; producing plant viruses and their corresponding anti ##ser ##ums for an anti ##ser ##um bank ; and manufacturing ph ##ero ##mon ##es and hormones to combat art ##hr ##op ##ods that harm iran ' s agricultural industry .

reference_raw: In this area, Iran's research focuses on the creation of genes that produce toxins against insect pests; the improvement of plant bioresistance; the formulation of new pesticides; the improvement of methods of spraying or otherwise spreading pesticides; the investigation of the effects on native plant species after their introduction on different pests and diseases; the prevention of the production of mycotoxins in crops; the production of plant viruses and their corresponding antis for antis. and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran.

reference_spacy_tokens: In this area , Iran 's research focuses on the creation of genes that produce toxins against insect pests ; the improvement of plant bioresistance ; the formulation of new pesticides ; the improvement of methods of spraying or otherwise spreading pesticides ; the investigation of the effects on native plant species after their introduction on different pests and diseases ; the prevention of the production of mycotoxins in crops ; the production of plant viruses and their corresponding antis for antis . and the production of pheromones and hormones to fight arthropods that harm the agricultural sector of Iran .


fn_spacy_tokens_for_baseline: This I was able to do by securing the position of governess in his family .

source_bert_toks: this i was able to do by securing the position of govern ##ess in his family .

reference_raw: I was able to do that by securing the status of a governess in his family.

reference_spacy_tokens: I was able to do that by securing the status of a governess in his family .


fn_spacy_tokens_for_baseline: There 's an abundance of nature , history , art , and modern culture to be explored and enjoyed .

source_bert_toks: there ' s an abundance of nature , history , art , and modern culture to be explored and enjoyed .

reference_raw: There are plenty of natural, historical, artistic, and modern cultures to explore and enjoy.

reference_spacy_tokens: There are plenty of natural , historical , artistic , and modern cultures to explore and enjoy .


fn_spacy_tokens_for_baseline: It is little wonder that the private sector mimics the Government in its disrespect for pensions .

source_bert_toks: it is little wonder that the private sector mimic ##s the government in its di ##sr ##es ##pe ##ct for pensions .

reference_raw: It is no wonder that the private sector is imitating the government in its disrespect to pensions.

reference_spacy_tokens: It is no wonder that the private sector is imitating the government in its disrespect to pensions .


fn_spacy_tokens_for_baseline: Indeed , I 'm not er sure that there are n't still members of both our organizations who believe that right now each of us is supping with the devil .

source_bert_toks: indeed , i ' m not er sure that there aren ' t still members of both our organizations who believe that right now each of us is su ##pping with the devil .

reference_raw: In fact, I'm not erratically certain that there are no members of both our organizations who believe that we're all succumbing to the devil right now.

reference_spacy_tokens: In fact , I 'm not erratically certain that there are no members of both our organizations who believe that we 're all succumbing to the devil right now .


fn_spacy_tokens_for_baseline: Wuerffel , who threw 35 TD passes and set an NCAA college record for passing efficiency in the regular season , was harassed into his worst performance of the year .

source_bert_toks: wu ##er ##ffe ##l , who threw 35 td passes and set an ncaa college record for passing efficiency in the regular season , was harassed into his worst performance of the year .

reference_raw: Wuerffel, who threw 35 TD tickets and set up an NCAA college record to pass performance in a regular season, was bullied into his worst performance of the year.

reference_spacy_tokens: Wuerffel , who threw 35 TD tickets and set up an NCAA college record to pass performance in a regular season , was bullied into his worst performance of the year .


fn_spacy_tokens_for_baseline: When an illness occurs , those who are knowledgeable in such matters proffer a diagnosis .

source_bert_toks: when an illness occurs , those who are knowledge ##able in such matters prof ##fer a diagnosis .

reference_raw: In the event of a disease, those with knowledge of such matters offer a diagnosis.

reference_spacy_tokens: In the event of a disease , those with knowledge of such matters offer a diagnosis .


fn_spacy_tokens_for_baseline: This void function will be called nestEnter ( ) , and will take in no inputs .

source_bert_toks: this void function will be called nest ##enter ( ) , and will take in no inputs .

reference_raw: This empty feature will be called nestEnter () and will not receive any inputs.

reference_spacy_tokens: This empty feature will be called nestEnter ( ) and will not receive any inputs .


fn_spacy_tokens_for_baseline: ' My bag ! ' she said out loud and then , more softly but with more than a touch of anguish , ' Oh no , the letter ! '

source_bert_toks: ' my bag ! ' she said out loud and then , more softly but with more than a touch of anguish , ' oh no , the letter ! '

reference_raw: "My bag!" she said aloud, then, more quietly but with more than a little anxiety, "Oh, no, the letter!"

reference_spacy_tokens: " My bag ! " she said aloud , then , more quietly but with more than a little anxiety , " Oh , no , the letter ! "


fn_spacy_tokens_for_baseline: They can take one of the following forms : 1- Steel pipes : Insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2- Barrels : They are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3- Ditches : They are better than road bumps because they are harder to see .

source_bert_toks: they can take one of the following forms : 1 - steel pipes : insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2 - barrels : they are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3 - ditch ##es : they are better than road bumps because they are harder to see .

reference_raw: They may take one of the following forms: 1-Steel pipes: insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre, then fill them with cement 2-Barrels: they are filled with cement and are located around the building, especially at the entrance to prevent vehicles from crashing into it 3-Ditches: they are better than road bumps because they are more difficult to see.

reference_spacy_tokens: They may take one of the following forms : 1-Steel pipes : insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre , then fill them with cement 2-Barrels : they are filled with cement and are located around the building , especially at the entrance to prevent vehicles from crashing into it 3-Ditches : they are better than road bumps because they are more difficult to see .


fn_spacy_tokens_for_baseline: You discern my going out and my lying down ;

source_bert_toks: you disc ##ern my going out and my lying down ;

reference_raw: You can tell me I'm going out and I'm lying down;

reference_spacy_tokens: You can tell me I 'm going out and I 'm lying down ;


fn_spacy_tokens_for_baseline: Incoming BASW chairperson Graham Thompson mused about language , confessing he had replaced his own references to ' miners ' wives ' with ' women in mining communities ' .

source_bert_toks: incoming bas ##w chairperson graham thompson mused about language , confess ##ing he had replaced his own references to ' miners ' wives ' with ' women in mining communities ' .

reference_raw: Incoming Chairman of the BASW Graham Thompson considered the language and admitted that he had replaced his own references to "miners' women" with "the women of the mining community."

reference_spacy_tokens: Incoming Chairman of the BASW Graham Thompson considered the language and admitted that he had replaced his own references to " miners ' women " with " the women of the mining community . "


fn_spacy_tokens_for_baseline: Most viewers who ponder the matter can decide -- from looking at the eyes -- which of the four sisters is married to the photographer .

source_bert_toks: most viewers who ponder the matter can decide - - from looking at the eyes - - which of the four sisters is married to the photographer .

reference_raw: Most spectators who consider this matter can decide - from the look in their eyes - which of the four sisters is married to the photographer.

reference_spacy_tokens: Most spectators who consider this matter can decide - from the look in their eyes - which of the four sisters is married to the photographer .


fn_spacy_tokens_for_baseline: Early in the film , with the Flowers crisis in full bloom , Sam Donaldson interviews Stephanopoulos , who blames it all on the " Republican attack machine . "

source_bert_toks: early in the film , with the flowers crisis in full bloom , sam donaldson interviews stephan ##op ##oulos , who blame ##s it all on the " republican attack machine . "

reference_raw: At the beginning of the movie, when the Flowers Depression was in full bloom, Sam Donaldson interviewed Stephanopoulos, who blamed everything on the Republican Attack Machine.

reference_spacy_tokens: At the beginning of the movie , when the Flowers Depression was in full bloom , Sam Donaldson interviewed Stephanopoulos , who blamed everything on the Republican Attack Machine .


fn_spacy_tokens_for_baseline: In 1809 Clarkson went to Liverpool to promote a local committee under William Roscoe 's leadership to monitor the observance of the slave trade law in the largest former slaving port .

source_bert_toks: in 1809 clarkson went to liverpool to promote a local committee under william ro ##scoe ' s leadership to monitor the ob ##ser ##vance of the slave trade law in the largest former sl ##avi ##ng port .

reference_raw: In 1809, Clarkson went to Liverpool to promote a local committee under the leadership of William Roscoe to monitor compliance with the slave trade laws of the largest former slave port.

reference_spacy_tokens: In 1809 , Clarkson went to Liverpool to promote a local committee under the leadership of William Roscoe to monitor compliance with the slave trade laws of the largest former slave port .


fn_spacy_tokens_for_baseline: Few concept cars have proved as significant and trend - setting as Pininfarina 's Dino Berlinetta Speciale , introduced to universal acclaim at the 1965 Paris motor show .

source_bert_toks: few concept cars have proved as significant and trend - setting as pin ##in ##far ##ina ' s dino berlin ##etta special ##e , introduced to universal acclaim at the 1965 paris motor show .

reference_raw: Few conceptual cars have proven to be as important and trend-oriented as the Pininfarina Dino Berlinetta Speciale, which was introduced for the universal recognition of the 1965 Paris Motor Show.

reference_spacy_tokens: Few conceptual cars have proven to be as important and trend - oriented as the Pininfarina Dino Berlinetta Speciale , which was introduced for the universal recognition of the 1965 Paris Motor Show .


fn_spacy_tokens_for_baseline: One of the most common complaints of parents is that their child will not obey them .

source_bert_toks: one of the most common complaints of parents is that their child will not obey them .

reference_raw: One of the most common criticisms of parents is that their child will not listen to them.

reference_spacy_tokens: One of the most common criticisms of parents is that their child will not listen to them .


fn_spacy_tokens_for_baseline: And that 's a pity because olive oil is very high in monounsaturated fats , and doctors claim all sorts of therapeutic properties for the pungent garlic .

source_bert_toks: and that ' s a pity because olive oil is very high in mono ##un ##sat ##ura ##ted fat ##s , and doctors claim all sorts of therapeutic properties for the pun ##gent garlic .

reference_raw: And that's a shame, because olive oil is very high in monounsaturated fats, and the doctors claim all sorts of therapeutic properties because of the stinging garlic.

reference_spacy_tokens: And that 's a shame , because olive oil is very high in monounsaturated fats , and the doctors claim all sorts of therapeutic properties because of the stinging garlic .


fn_spacy_tokens_for_baseline: An article warns Americans not to gloat over Japan 's economic woes : We need a strong Japan to keep the world economy stable .

source_bert_toks: an article warns americans not to g ##lo ##at over japan ' s economic wo ##es : we need a strong japan to keep the world economy stable .

reference_raw: The article warns Americans not to gloat over the economic woes of Japan: in order to keep the world economy stable, we need a powerful Japan.

reference_spacy_tokens: The article warns Americans not to gloat over the economic woes of Japan : in order to keep the world economy stable , we need a powerful Japan .


fn_spacy_tokens_for_baseline: Such behaviour , which always unnerved her when displayed by such as Higginbotham , did not unnerve her at all .

source_bert_toks: such behaviour , which always un ##ner ##ved her when displayed by such as hi ##gg ##in ##bot ##ham , did not un ##ner ##ve her at all .

reference_raw: Such behavior, which always made her nervous when the likes of Higginbotham showed, did not disturb her at all.

reference_spacy_tokens: Such behavior , which always made her nervous when the likes of Higginbotham showed , did not disturb her at all .


fn_spacy_tokens_for_baseline: Four hundred years ago these crops brought British colonists to rule the land and African slaves to work it .

source_bert_toks: four hundred years ago these crops brought british colonists to rule the land and african slaves to work it .

reference_raw: Four hundred years ago, these crops brought British settlers to rule the country and African slaves to work on it.

reference_spacy_tokens: Four hundred years ago , these crops brought British settlers to rule the country and African slaves to work on it .


fn_spacy_tokens_for_baseline: He stopped himself for a moment after his lips had uttered the words .

source_bert_toks: he stopped himself for a moment after his lips had uttered the words .

reference_raw: When his lips spoke, he stopped for a moment.

reference_spacy_tokens: When his lips spoke , he stopped for a moment .


fn_spacy_tokens_for_baseline: Her voice and expression were unrepentant and truculent .

source_bert_toks: her voice and expression were un ##re ##pen ##tan ##t and tr ##uc ##ulent .

reference_raw: Her voice and expression were neither repentant nor truculent.

reference_spacy_tokens: Her voice and expression were neither repentant nor truculent .


fn_spacy_tokens_for_baseline: Though the two cities remained unlinked by rail , this was about to change quickly .

source_bert_toks: though the two cities remained un ##link ##ed by rail , this was about to change quickly .

reference_raw: Although the two cities remained unconnected by the rails, it would soon be altered.

reference_spacy_tokens: Although the two cities remained unconnected by the rails , it would soon be altered .


fn_spacy_tokens_for_baseline: In December 2002 , an Italian newspaper cited an Iraqi officer who asserted that Syria had allowed Iraq to store its weapons of mass destruction in Syria research centers .

source_bert_toks: in december 2002 , an italian newspaper cited an iraqi officer who asserted that syria had allowed iraq to store its weapons of mass destruction in syria research centers .

reference_raw: In December 2002, a newspaper in Italy cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres.

reference_spacy_tokens: In December 2002 , a newspaper in Italy cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres .


fn_spacy_tokens_for_baseline: In secret diplomatic documents that were disclosed last year by Wikileaks , American diplomats portrayed Karzai inevitably referred to as ' AWK ' as a Mafia - like figure , entangled in a variety of illegal activities .

source_bert_toks: in secret diplomatic documents that were disclosed last year by wi ##ki ##lea ##ks , american diplomats portrayed ka ##rza ##i inevitably referred to as ' aw ##k ' as a mafia - like figure , en ##tangled in a variety of illegal activities .

reference_raw: In secret diplomatic documents published last year by the Wikileaks, American diplomats portrayed Karzai as the "AWK" as a mob-like figure involved in various illegal activities.

reference_spacy_tokens: In secret diplomatic documents published last year by the Wikileaks , American diplomats portrayed Karzai as the " AWK " as a mob - like figure involved in various illegal activities .


fn_spacy_tokens_for_baseline: It was n't until a.d . 330 , however , when the newly converted Emperor Constantine made Byzantium , renamed Constantinople , capital of his Eastern Empire that Christianity was assured of its dominant role in future Greek life .

source_bert_toks: it wasn ' t until a . d . 330 , however , when the newly converted emperor constantine made by ##zan ##tium , renamed constantinople , capital of his eastern empire that christianity was assured of its dominant role in future greek life .

reference_raw: But it was not until A.D. 330 that Christianity was assured of its dominant role in the future Greek life that the newly converted Emperor Constantine created Byzantium and changed the name of Constantinople, the capital of the Eastern Empire.

reference_spacy_tokens: But it was not until A.D. 330 that Christianity was assured of its dominant role in the future Greek life that the newly converted Emperor Constantine created Byzantium and changed the name of Constantinople , the capital of the Eastern Empire .


fn_spacy_tokens_for_baseline: He also owned ten bushels of wheat , and fourteen of barley , and had sown three dayworks ( roods ) of winter wheat , but no husbandry implements were listed .

source_bert_toks: he also owned ten bush ##els of wheat , and fourteen of barley , and had so ##wn three day ##works ( ro ##ods ) of winter wheat , but no husband ##ry implements were listed .

reference_raw: He also had ten wheat shrubs and fourteen barleys, and he had sown three days (roods) of winter wheat, but there were no breeding tools on the list.

reference_spacy_tokens: He also had ten wheat shrubs and fourteen barleys , and he had sown three days ( roods ) of winter wheat , but there were no breeding tools on the list .


fn_spacy_tokens_for_baseline: The large men were flooding largely back into the room .

source_bert_toks: the large men were flooding largely back into the room .

reference_raw: The big men surged back into the room for the most part.

reference_spacy_tokens: The big men surged back into the room for the most part .


fn_spacy_tokens_for_baseline: ' At first I was too flabbergasted to do anything .

source_bert_toks: ' at first i was too fl ##ab ##berg ##ast ##ed to do anything .

reference_raw: 'I was too flamboyant at first to do anything.

reference_spacy_tokens: ' I was too flamboyant at first to do anything .


fn_spacy_tokens_for_baseline: Hong Kong 's major venue for the performing arts , the building has been criticized for its fortress - like architecture and windowless facade .

source_bert_toks: hong kong ' s major venue for the performing arts , the building has been criticized for its fortress - like architecture and window ##less facade .

reference_raw: Hong Kong's main place for performing art, the building was criticized for its fortress, such as architecture and windowless facades.

reference_spacy_tokens: Hong Kong 's main place for performing art , the building was criticized for its fortress , such as architecture and windowless facades .


fn_spacy_tokens_for_baseline: I was sickened by the apparent ruthlessness of it , though afterwards I accepted the published assurances of Jardine and Larwood that there had been no such intention .

source_bert_toks: i was sick ##ened by the apparent ruthless ##ness of it , though afterwards i accepted the published assurance ##s of jar ##dine and la ##rwood that there had been no such intention .

reference_raw: The obvious ruthlessness made me sick, but then I accepted the published assurances from Jardine and Larwood that there was no such intention.

reference_spacy_tokens: The obvious ruthlessness made me sick , but then I accepted the published assurances from Jardine and Larwood that there was no such intention .


fn_spacy_tokens_for_baseline: Laps of water slapped against the boat , like wine trickling from a bottle .

source_bert_toks: laps of water slapped against the boat , like wine trick ##ling from a bottle .

reference_raw: Laps of water hit the boat like wine pouring out of a bottle.

reference_spacy_tokens: Laps of water hit the boat like wine pouring out of a bottle .


fn_spacy_tokens_for_baseline: He prescribed a strong placebo , but I do n't think it 's working .

source_bert_toks: he prescribed a strong place ##bo , but i don ' t think it ' s working .

reference_raw: He prescribed a lot of placebo, but I don't think it works.

reference_spacy_tokens: He prescribed a lot of placebo , but I do n't think it works .


fn_spacy_tokens_for_baseline: Fire - fighters first had hope of gaining control on the morning of Thursday , June 12 , but the wind changed direction during the day , causing a large extension of the fire .

source_bert_toks: fire - fighters first had hope of gaining control on the morning of thursday , june 12 , but the wind changed direction during the day , causing a large extension of the fire .

reference_raw: For the first time, on Thursday, June 12th, the firefighters had a chance to gain control, but the wind changed direction during the day, causing the fire to expand considerably.

reference_spacy_tokens: For the first time , on Thursday , June 12th , the firefighters had a chance to gain control , but the wind changed direction during the day , causing the fire to expand considerably .


fn_spacy_tokens_for_baseline: I 'll smash his face !

source_bert_toks: i ' ll smash his face !

reference_raw: I'm going to break his face!

reference_spacy_tokens: I 'm going to break his face !


fn_spacy_tokens_for_baseline: The device reportedly developed by al - Qaida to disperse deadly cyanide gas in subway cars and other confined spaces has never been used in a terrorist attack and probably would not be very effective , say experts .

source_bert_toks: the device reportedly developed by al - q ##aid ##a to disperse deadly cy ##ani ##de gas in subway cars and other confined spaces has never been used in a terrorist attack and probably would not be very effective , say experts .

reference_raw: The device that Al-Qaeda supposedly designed to disperse lethal cyanide gas in subway cars and other confined spaces has never been used in a terrorist attack and is unlikely to be very efficient, say experts.

reference_spacy_tokens: The device that Al - Qaeda supposedly designed to disperse lethal cyanide gas in subway cars and other confined spaces has never been used in a terrorist attack and is unlikely to be very efficient , say experts .


fn_spacy_tokens_for_baseline: He had been quite fazed by the guard - hostage situation and , feeling vulnerable , had decided that the other hostages , particularly Anderson and Jacobsen , thought him slow .

source_bert_toks: he had been quite fa ##zed by the guard - hostage situation and , feeling vulnerable , had decided that the other hostages , particularly anderson and jacobs ##en , thought him slow .

reference_raw: He was quite fascinated by the situation of the guards and, feeling vulnerable, decided that the other hostages, especially Anderson and Jacobsen, thought him slow.

reference_spacy_tokens: He was quite fascinated by the situation of the guards and , feeling vulnerable , decided that the other hostages , especially Anderson and Jacobsen , thought him slow .


fn_spacy_tokens_for_baseline: Helen clumped out of the office .

source_bert_toks: helen cl ##ump ##ed out of the office .

reference_raw: Helen pushed herself out of the office.

reference_spacy_tokens: Helen pushed herself out of the office .


fn_spacy_tokens_for_baseline: All she can do is tack forward and crash into him , which would be suicide for them all .

source_bert_toks: all she can do is tack forward and crash into him , which would be suicide for them all .

reference_raw: All she could do was step forward and hit him, which would have been suicide for all of them.

reference_spacy_tokens: All she could do was step forward and hit him , which would have been suicide for all of them .


fn_spacy_tokens_for_baseline: A simple solution is to use an old film canister and carry just a few hooks leaving the open box at home out of harm 's way .

source_bert_toks: a simple solution is to use an old film can ##ister and carry just a few hooks leaving the open box at home out of harm ' s way .

reference_raw: The simple solution is to use an old film container and carry only a few hooks that leave an open box at home out of danger.

reference_spacy_tokens: The simple solution is to use an old film container and carry only a few hooks that leave an open box at home out of danger .


fn_spacy_tokens_for_baseline: The extensive series of domal uplifts traversed by the East African Rift System has been widely regarded as a clear example of active rifting with uplift preceding the development of rift structures .

source_bert_toks: the extensive series of dom ##al up ##lift ##s traversed by the east african rift system has been widely regarded as a clear example of active rift ##ing with up ##lift preceding the development of rift structures .

reference_raw: The vast series of domal uplifts passed through the East African Rift System is generally considered to be a clear example of active rifts and uplifts prior to the development of rift structures.

reference_spacy_tokens: The vast series of domal uplifts passed through the East African Rift System is generally considered to be a clear example of active rifts and uplifts prior to the development of rift structures .


fn_spacy_tokens_for_baseline: The Bible tells us that the cruelty and impiety of the rulers of both kingdoms aroused the fury of the great Prophets .

source_bert_toks: the bible tells us that the cruelty and imp ##ie ##ty of the rulers of both kingdoms aroused the fury of the great prophets .

reference_raw: The Bible tells us that the cruelty and impudence of the rulers of both kingdoms has aroused the wrath of the great prophets.

reference_spacy_tokens: The Bible tells us that the cruelty and impudence of the rulers of both kingdoms has aroused the wrath of the great prophets .


fn_spacy_tokens_for_baseline: Along the Liffey to the west is Temple Bar , center of nightlife and home to many of Dublin 's cutting - edge artists and artistic endeavors .

source_bert_toks: along the li ##ffey to the west is temple bar , center of night ##life and home to many of dublin ' s cutting - edge artists and artistic endeavors .

reference_raw: On the west side of the Liffey is the Temple Bar, the center of the nightlife and home to many of Dublin's top artists and artists.

reference_spacy_tokens: On the west side of the Liffey is the Temple Bar , the center of the nightlife and home to many of Dublin 's top artists and artists .


fn_spacy_tokens_for_baseline: ' This looks like as good a spot as any , ' Matthew decided .

source_bert_toks: ' this looks like as good a spot as any , ' matthew decided .

reference_raw: 'This looks as good a place as any,' Matthew said.

reference_spacy_tokens: ' This looks as good a place as any , ' Matthew said .


fn_spacy_tokens_for_baseline: His glance denigrated her feeble attempt at humour .

source_bert_toks: his glance den ##ig ##rated her fee ##ble attempt at humour .

reference_raw: He looked down at her feeble attempt at humor.

reference_spacy_tokens: He looked down at her feeble attempt at humor .


fn_spacy_tokens_for_baseline: On a certain evening , which had been prearranged , I sent my friend final instructions , for the man was forever on the alert and continually changed his room .

source_bert_toks: on a certain evening , which had been pre ##ar ##rang ##ed , i sent my friend final instructions , for the man was forever on the alert and continually changed his room .

reference_raw: On a certain evening, which had been arranged, I sent my friend the final instructions, for he was always on alert and constantly altering his room.

reference_spacy_tokens: On a certain evening , which had been arranged , I sent my friend the final instructions , for he was always on alert and constantly altering his room .


fn_spacy_tokens_for_baseline: Finally , by a process which is not entirely clear , the Abbasid caliph al - Mutawakkil is said to have transferred to Sultan Selim and his heirs all rights to the caliphate .

source_bert_toks: finally , by a process which is not entirely clear , the abbas ##id caliph al - mu ##ta ##wa ##kki ##l is said to have transferred to sultan se ##lim and his heirs all rights to the caliphate .

reference_raw: Finally, in a process which is not entirely clear, it is alleged that the Abbasid calif al-Mutawakkil transferred to Sultan Selim and his heirs all the rights to the caliphate.

reference_spacy_tokens: Finally , in a process which is not entirely clear , it is alleged that the Abbasid calif al - Mutawakkil transferred to Sultan Selim and his heirs all the rights to the caliphate .


fn_spacy_tokens_for_baseline: Whilst in general each supported the other , there were clashes from time to time , both sides accusing the other of reprehensible acts .

source_bert_toks: whilst in general each supported the other , there were clashes from time to time , both sides accusing the other of rep ##re ##hen ##sible acts .

reference_raw: While the two generally supported each other, there were occasional conflicts, and both sides blamed each other for reproachful acts.

reference_spacy_tokens: While the two generally supported each other , there were occasional conflicts , and both sides blamed each other for reproachful acts .


fn_spacy_tokens_for_baseline: Haslemere also scents a whiff of dishonour in the reluctance of errant ministers to resign .

source_bert_toks: has ##lem ##ere also scents a w ##hiff of dish ##ono ##ur in the reluctance of er ##rant ministers to resign .

reference_raw: Haslemere also smells a hint of dishonor in the reluctance of errant ministers to resign.

reference_spacy_tokens: Haslemere also smells a hint of dishonor in the reluctance of errant ministers to resign .


fn_spacy_tokens_for_baseline: Having some lines ready to throw back at them induces guffaws of laughter and an appreciative slap on the back .

source_bert_toks: having some lines ready to throw back at them induce ##s gu ##ffa ##ws of laughter and an app ##re ##cia ##tive slap on the back .

reference_raw: Having a few lines ready to throw back at them induces a guffaw of laughter and a grateful slap on the back.

reference_spacy_tokens: Having a few lines ready to throw back at them induces a guffaw of laughter and a grateful slap on the back .


fn_spacy_tokens_for_baseline: Balls of Semtex -- slightly bigger than Maltesers but powerful enough to blast away doors -- were found in the shoe heels , which had been hollowed out and then bonded together again , security sources disclosed .

source_bert_toks: balls of se ##mt ##ex - - slightly bigger than maltese ##rs but powerful enough to blast away doors - - were found in the shoe heels , which had been hollow ##ed out and then bonded together again , security sources disclosed .

reference_raw: The Semtex balls-a little larger than the Maltesers, but strong enough to blow the door-were found in the heels of their boots, which were hollowed out and then reunited with security sources.

reference_spacy_tokens: The Semtex balls - a little larger than the Maltesers , but strong enough to blow the door - were found in the heels of their boots , which were hollowed out and then reunited with security sources .


fn_spacy_tokens_for_baseline: Robert Merkel , a former U.S. attorney handling drug indictments in Florida , does n't think for a minute that Castro 's much publicized trials of high officials engaged in the drug trade mean he has broken off with the Medellin drug cartel .

source_bert_toks: robert mer ##kel , a former u . s . attorney handling drug indictment ##s in florida , doesn ' t think for a minute that castro ' s much publicized trials of high officials engaged in the drug trade mean he has broken off with the med ##elli ##n drug cartel .

reference_raw: Robert Merkel, a former U.S. attorney dealing with drug charges in Florida, does not think for a moment that Castro's many publicized trials of high-level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel.

reference_spacy_tokens: Robert Merkel , a former U.S. attorney dealing with drug charges in Florida , does not think for a moment that Castro 's many publicized trials of high - level officials involved in drug trafficking mean that he broke up with the Medellin drug cartel .


fn_spacy_tokens_for_baseline: ' There are indications of scorching and the presence of particles of smokeless powder suggest a firearm wound , the weapon having been discharged at close range . '

source_bert_toks: ' there are indications of sc ##or ##ching and the presence of particles of smoke ##less powder suggest a firearm wound , the weapon having been discharged at close range . '

reference_raw: "There are signs of burning, and the presence of particles of smokeless powder suggests a gunshot wound, and the weapon was fired at close range."

reference_spacy_tokens: " There are signs of burning , and the presence of particles of smokeless powder suggests a gunshot wound , and the weapon was fired at close range . "


fn_spacy_tokens_for_baseline: This is close to what GM and Ford already practise in Europe , with one difference : the American firms ' subsidiaries rarely trade cars or parts with their parent .

source_bert_toks: this is close to what gm and ford already pr ##act ##ise in europe , with one difference : the american firms ' subsidiaries rarely trade cars or parts with their parent .

reference_raw: This is close to what GM and Ford have already practiced in Europe, with one difference: US subsidiaries rarely exchange cars or parts with their parent companies.

reference_spacy_tokens: This is close to what GM and Ford have already practiced in Europe , with one difference : US subsidiaries rarely exchange cars or parts with their parent companies .


fn_spacy_tokens_for_baseline: Sitting nonchalantly in straw boater and white suit and sporting a moustache , he sits in the Galleria at Milan , masquerading as the composer himself .

source_bert_toks: sitting non ##chal ##antly in straw boat ##er and white suit and sporting a mo ##ust ##ache , he sits in the gall ##eria at milan , mas ##que ##rad ##ing as the composer himself .

reference_raw: Sitting unchalantly in a straw boat and a white suit and sporting a mustache, he sits in a gallery in Milan and pretends to be a composer himself.

reference_spacy_tokens: Sitting unchalantly in a straw boat and a white suit and sporting a mustache , he sits in a gallery in Milan and pretends to be a composer himself .


fn_spacy_tokens_for_baseline: I think my father must have suffered some of this , if only because he refused to have us children christened .

source_bert_toks: i think my father must have suffered some of this , if only because he refused to have us children christ ##ened .

reference_raw: I think my father must have suffered something, if only because he didn't want us to be baptized.

reference_spacy_tokens: I think my father must have suffered something , if only because he did n't want us to be baptized .


fn_spacy_tokens_for_baseline: The bread sauce is certainly a mammoth task and involves an entire morning 's work , as the breadcrumbs must be crumbled by hand .

source_bert_toks: the bread sauce is certainly a mammoth task and involves an entire morning ' s work , as the bread ##cr ##umb ##s must be cr ##umble ##d by hand .

reference_raw: Bread sauce is definitely a mammoth job, and it involves a whole morning's work, because the crumbs have to be crushed by hand.

reference_spacy_tokens: Bread sauce is definitely a mammoth job , and it involves a whole morning 's work , because the crumbs have to be crushed by hand .


fn_spacy_tokens_for_baseline: Everything the Bookman did was recorded one way or another and now the piles of notes , drawings and maps were locked away in a safe .

source_bert_toks: everything the book ##man did was recorded one way or another and now the piles of notes , drawings and maps were locked away in a safe .

reference_raw: Everything the Bookman had done had been recorded one way or another, and now the stacks of notes, drawings, and maps were locked in a vault.

reference_spacy_tokens: Everything the Bookman had done had been recorded one way or another , and now the stacks of notes , drawings , and maps were locked in a vault .


fn_spacy_tokens_for_baseline: The fall of the Labour government in 1931 and MacDonald 's defection to lead an essentially Conservative National Government , marked the lowest point ever reached in the morale of the Labour Party .

source_bert_toks: the fall of the labour government in 1931 and macdonald ' s defect ##ion to lead an essentially conservative national government , marked the lowest point ever reached in the morale of the labour party .

reference_raw: The collapse of the Labour Government in 1931 and MacDonald's failure to lead a essentially conservative national government marked the lowest point in the Labour Party's morale.

reference_spacy_tokens: The collapse of the Labour Government in 1931 and MacDonald 's failure to lead a essentially conservative national government marked the lowest point in the Labour Party 's morale .


fn_spacy_tokens_for_baseline: 9:31 a.m. GR8FLRED : It 's amazing how one second can so completely change your life .

source_bert_toks: 9 : 31 a . m . gr ##8 ##fl ##red : it ' s amazing how one second can so completely change your life .

reference_raw: 9:31 A.M. GR8FLRED: It's amazing how a second can make a complete difference in your life.

reference_spacy_tokens: 9:31 A.M. GR8FLRED : It 's amazing how a second can make a complete difference in your life .


fn_spacy_tokens_for_baseline: Another try at the corner of Sassenach was made by Jimmy Marshall in 1953 , again from the Centurion groove .

source_bert_toks: another try at the corner of sas ##sen ##ach was made by jimmy marshall in 1953 , again from the cent ##uri ##on groove .

reference_raw: Jimmy Marshall made another attempt at the corner of Sassenach in 1953, again from the groove of the Centurion.

reference_spacy_tokens: Jimmy Marshall made another attempt at the corner of Sassenach in 1953 , again from the groove of the Centurion .


fn_spacy_tokens_for_baseline: Hall , heading a three - member delegation , arrived here at 19:17 ( 1517 GMT ) by land from Jordanian capital Amman , and stayed at the five - star Mansour Hotel .

source_bert_toks: hall , heading a three - member delegation , arrived here at 19 : 17 ( 151 ##7 gm ##t ) by land from jordanian capital amman , and stayed at the five - star mans ##our hotel .

reference_raw: Hall, the leader of the three-member delegation, arrived here at 19:17 (1517 GMT) on the land of the Jordanian capital Amman, and stayed at the five-star Mansour Hotel.

reference_spacy_tokens: Hall , the leader of the three - member delegation , arrived here at 19:17 ( 1517 GMT ) on the land of the Jordanian capital Amman , and stayed at the five - star Mansour Hotel .


fn_spacy_tokens_for_baseline: Businesses sprang up overnight , and wooden houses were erected to replace the tent city in which many of the early settlers had lived .

source_bert_toks: businesses sprang up overnight , and wooden houses were erected to replace the tent city in which many of the early settlers had lived .

reference_raw: The shops rose overnight, and wooden houses were erected to replace the tent city in which many of the first colonists lived.

reference_spacy_tokens: The shops rose overnight , and wooden houses were erected to replace the tent city in which many of the first colonists lived .


fn_spacy_tokens_for_baseline: A half - hour tour costs HK$50 ; pay at the end , or the driver may cut your trip short .

source_bert_toks: a half - hour tour costs hk $ 50 ; pay at the end , or the driver may cut your trip short .

reference_raw: Half-hour travel costs HK$50; pay at the end, or the driver can shorten your journey.

reference_spacy_tokens: Half - hour travel costs HK$50 ; pay at the end , or the driver can shorten your journey .


fn_spacy_tokens_for_baseline: Phonemes are obviously sensitive enough to make fine discriminations between lexical descriptions since this is their function by definition .

source_bert_toks: phone ##mes are obviously sensitive enough to make fine discrimination ##s between lexi ##cal descriptions since this is their function by definition .

reference_raw: Telephones are clearly sufficiently sensitive to make a fine distinction between lexical descriptions, since that is their function by definition.

reference_spacy_tokens: Telephones are clearly sufficiently sensitive to make a fine distinction between lexical descriptions , since that is their function by definition .


fn_spacy_tokens_for_baseline: We rose at five - thirty and breakfasted outside on fresh mangoes .

source_bert_toks: we rose at five - thirty and breakfast ##ed outside on fresh mango ##es .

reference_raw: We got up at five-thirty and ate out on fresh mangoes.

reference_spacy_tokens: We got up at five - thirty and ate out on fresh mangoes .


fn_spacy_tokens_for_baseline: She 's only fainted .

source_bert_toks: she ' s only faint ##ed .

reference_raw: She just passed out.

reference_spacy_tokens: She just passed out .


fn_spacy_tokens_for_baseline: His Palm Beach socialite mother Naoma was so outraged when John , 35 , we d the notorious divorcee Roxanne Pulitzer in Las Vegas , she cut him off .

source_bert_toks: his palm beach social ##ite mother na ##oma was so outraged when john , 35 , wed the notorious divorce ##e ro ##xa ##nne pulitzer in las vegas , she cut him off .

reference_raw: His socialite mother, Naoma, in Palm Beach, was so indignant when John, 35, married the famous divorced Roxanne Pulitzer in Las Vegas, that she interrupted him.

reference_spacy_tokens: His socialite mother , Naoma , in Palm Beach , was so indignant when John , 35 , married the famous divorced Roxanne Pulitzer in Las Vegas , that she interrupted him .


fn_spacy_tokens_for_baseline: But because these claims are more difficult to evaluate and have been coming in more slowly , the company has no estimate of the impact of the earthquake on fourth - quarter results .

source_bert_toks: but because these claims are more difficult to evaluate and have been coming in more slowly , the company has no estimate of the impact of the earthquake on fourth - quarter results .

reference_raw: However, since these allegations are more difficult to assess and come at a slower pace, the company does not estimate the impact of the earthquake on the outcome of the fourth and fourth quarters.

reference_spacy_tokens: However , since these allegations are more difficult to assess and come at a slower pace , the company does not estimate the impact of the earthquake on the outcome of the fourth and fourth quarters .


fn_spacy_tokens_for_baseline: The railway veered off towards the mine .

source_bert_toks: the railway ve ##ered off towards the mine .

reference_raw: The railroad turned toward the mine.

reference_spacy_tokens: The railroad turned toward the mine .


fn_spacy_tokens_for_baseline: Hearing loss can cause painful misunderstandings and can be extremely exasperating ; tempers may become frayed , and stressful tension may be allowed to mount .

source_bert_toks: hearing loss can cause painful misunderstanding ##s and can be extremely ex ##as ##per ##ating ; temper ##s may become fray ##ed , and stress ##ful tension may be allowed to mount .

reference_raw: Loss of hearing can cause painful misunderstandings and can be extremely irritating; moods can be frayed and stressful tensions can be allowed to increase.

reference_spacy_tokens: Loss of hearing can cause painful misunderstandings and can be extremely irritating ; moods can be frayed and stressful tensions can be allowed to increase .


fn_spacy_tokens_for_baseline: Philippe Douste - Blazy , France 's foreign minister , in Israel for diplomatic talks , was visiting Haifa when air - raid warning sirens went off .

source_bert_toks: philippe do ##ust ##e - b ##la ##zy , france ' s foreign minister , in israel for diplomatic talks , was visiting haifa when air - raid warning sirens went off .

reference_raw: Philippe Douste-Blazy, French Foreign Minister, was visiting Haifa for diplomatic talks in Israel when the alarm sirens exploded.

reference_spacy_tokens: Philippe Douste - Blazy , French Foreign Minister , was visiting Haifa for diplomatic talks in Israel when the alarm sirens exploded .


fn_spacy_tokens_for_baseline: The judge barred references to another proposed defense witness , Alwyn Martin , the victim of a carjacking that Fuhrman investigated .

source_bert_toks: the judge barred references to another proposed defense witness , al ##wyn martin , the victim of a car ##jack ##ing that fu ##hr ##man investigated .

reference_raw: The judge barred references to another proposed defense witness, Alwyn Martin, the victim of a car robbery that Fuhrman was investigating.

reference_spacy_tokens: The judge barred references to another proposed defense witness , Alwyn Martin , the victim of a car robbery that Fuhrman was investigating .


fn_spacy_tokens_for_baseline: The netting should fit quite snugly and reach to just below the rim of the container .

source_bert_toks: the netting should fit quite s ##nu ##gly and reach to just below the rim of the container .

reference_raw: The netting should fit quite tightly and extend to just below the edge of the container.

reference_spacy_tokens: The netting should fit quite tightly and extend to just below the edge of the container .


fn_spacy_tokens_for_baseline: Oil price rises were about to bring Iran colossal , unimagined wealth .

source_bert_toks: oil price rises were about to bring iran colossal , un ##ima ##gin ##ed wealth .

reference_raw: The rise in oil prices was about to bring a huge, unimagined wealth to Iran.

reference_spacy_tokens: The rise in oil prices was about to bring a huge , unimagined wealth to Iran .


fn_spacy_tokens_for_baseline: But as soon as I begin to be nice to him , a sort of self - satisfaction seems to creep into his voice and his manner ( very discreet , he 's been humility itself all day , no reproach about last night , of course ) and I begin to want to goad and slap him again .

source_bert_toks: but as soon as i begin to be nice to him , a sort of self - satisfaction seems to creep into his voice and his manner ( very discreet , he ' s been hum ##ility itself all day , no rep ##ro ##ach about last night , of course ) and i begin to want to goa ##d and slap him again .

reference_raw: But as soon as I start to be nice to him, there seems to be some self-satisfaction in his voice and manner (very discreet, he's been humility himself all day, no regrets about last night, of course) and I'm starting to want to goad him and slap him again.

reference_spacy_tokens: But as soon as I start to be nice to him , there seems to be some self - satisfaction in his voice and manner ( very discreet , he 's been humility himself all day , no regrets about last night , of course ) and I 'm starting to want to goad him and slap him again .


fn_spacy_tokens_for_baseline: North and South Korea then signed the " Joint Declaration on the Denuclearization of the Korean Peninsula , " whereby both sides promised " not test , manufacture , produce , receive , possess , store , deploy or use nuclear weapons . "

source_bert_toks: north and south korea then signed the " joint declaration on the den ##uc ##lea ##rization of the korean peninsula , " whereby both sides promised " not test , manufacture , produce , receive , possess , store , deploy or use nuclear weapons . "

reference_raw: North and South Korea then signed a "Joint Declaration on Denuclearisation of the Korean Peninsula", in which both parties promised "not to test, manufacture, manufacture, accept, possess, storage, deploy or use nuclear weapons."

reference_spacy_tokens: North and South Korea then signed a " Joint Declaration on Denuclearisation of the Korean Peninsula " , in which both parties promised " not to test , manufacture , manufacture , accept , possess , storage , deploy or use nuclear weapons . "


fn_spacy_tokens_for_baseline: Even if I had been sufficiently knowledgeable about the NHS funding system to counter his arguments , I still would n't have felt up to political sparring .

source_bert_toks: even if i had been sufficiently knowledge ##able about the nhs funding system to counter his arguments , i still wouldn ' t have felt up to political spa ##rring .

reference_raw: Even if I knew enough about the NHS funding system to counter his arguments, I still wouldn't feel like a political sparring.

reference_spacy_tokens: Even if I knew enough about the NHS funding system to counter his arguments , I still would n't feel like a political sparring .


fn_spacy_tokens_for_baseline: Nevertheless , the people who lived here were only comfortably rich , not seriously rich like those who lived , say , in the Bishops Avenue .

source_bert_toks: nevertheless , the people who lived here were only comfortably rich , not seriously rich like those who lived , say , in the bishops avenue .

reference_raw: However, the people who lived here were only comfortably wealthy, not as seriously wealthy as those who lived, say, on Bishops Avenue.

reference_spacy_tokens: However , the people who lived here were only comfortably wealthy , not as seriously wealthy as those who lived , say , on Bishops Avenue .


fn_spacy_tokens_for_baseline: ' If you were a secretary , you can probably be a manager or even run your own business .

source_bert_toks: ' if you were a secretary , you can probably be a manager or even run your own business .

reference_raw: 'If you were a secretary, you might as well be a manager, or you might even be in charge of your own business.

reference_spacy_tokens: ' If you were a secretary , you might as well be a manager , or you might even be in charge of your own business .


fn_spacy_tokens_for_baseline: It is silly libel on our teachers to think they would educate our children better if only they got a few thousand dollars a year more .

source_bert_toks: it is silly libel on our teachers to think they would educate our children better if only they got a few thousand dollars a year more .

reference_raw: It's a stupid libel for our teachers to think that they'd be a better education for our kids if they only had a few thousand dollars a year more.

reference_spacy_tokens: It 's a stupid libel for our teachers to think that they 'd be a better education for our kids if they only had a few thousand dollars a year more .


fn_spacy_tokens_for_baseline: If the accused leaves without paying because he is absent - minded , he is not liable , and remains not guilty even though he discovers his mistake afterwards .

source_bert_toks: if the accused leaves without paying because he is absent - minded , he is not liable , and remains not guilty even though he discovers his mistake afterwards .

reference_raw: If the defendant leaves without paying because he's distracted, he's not responsible, and he's innocent, even if he discovers his mistake later.

reference_spacy_tokens: If the defendant leaves without paying because he 's distracted , he 's not responsible , and he 's innocent , even if he discovers his mistake later .


fn_spacy_tokens_for_baseline: All these ' signs ' of ' inadequacy ' are nothing of the kind but are indicators of poverty and powerlessness .

source_bert_toks: all these ' signs ' of ' ina ##de ##qua ##cy ' are nothing of the kind but are indicators of poverty and powerless ##ness .

reference_raw: All these "signs" of "inadequacy" are nothing but indicators of poverty and helplessness.

reference_spacy_tokens: All these " signs " of " inadequacy " are nothing but indicators of poverty and helplessness .


fn_spacy_tokens_for_baseline: I was in Stinson Beach when the quake rolled through town .

source_bert_toks: i was in st ##ins ##on beach when the quake rolled through town .

reference_raw: I was in Stinson Beach when the earthquake hit the city.

reference_spacy_tokens: I was in Stinson Beach when the earthquake hit the city .


fn_spacy_tokens_for_baseline: The dreamer came and crouched before her .

source_bert_toks: the dreamer came and crouched before her .

reference_raw: The dreamer came and squatted in front of her.

reference_spacy_tokens: The dreamer came and squatted in front of her .


fn_spacy_tokens_for_baseline: Self - confident , yet cautious , she tends to be a loner .

source_bert_toks: self - confident , yet cautious , she tends to be a lone ##r .

reference_raw: Confident, but cautious, she tends to be lonely.

reference_spacy_tokens: Confident , but cautious , she tends to be lonely .


fn_spacy_tokens_for_baseline: The heathland had suddenly ended -- to give place to an expanse of emerald green , which looked bright and most attractive but which , Cheryl realised with a shudder , concealed treacherous shifting marsh .

source_bert_toks: the heath ##land had suddenly ended - - to give place to an expanse of emerald green , which looked bright and most attractive but which , cheryl realised with a shudder , concealed treacherous shifting marsh .

reference_raw: The land of the heath ended abruptly, giving way to an expanse of emerald green that looked bright and most attractive, but which, Cheryl realized with a shudder, concealed a treacherous shifting swamp.

reference_spacy_tokens: The land of the heath ended abruptly , giving way to an expanse of emerald green that looked bright and most attractive , but which , Cheryl realized with a shudder , concealed a treacherous shifting swamp .


fn_spacy_tokens_for_baseline: First and foremost , the requirements of the Regulations as amplified in communications from the revenue amounted on their face to lawful demands from the Crown .

source_bert_toks: first and foremost , the requirements of the regulations as amplified in communications from the revenue amounted on their face to lawful demands from the crown .

reference_raw: First of all, the requirements of the Regulations, which are reinforced by the communication of revenue, are in line with the legitimate demands of the Crown.

reference_spacy_tokens: First of all , the requirements of the Regulations , which are reinforced by the communication of revenue , are in line with the legitimate demands of the Crown .


fn_spacy_tokens_for_baseline: One man 's prison sentence is another man 's reprieve , though having escaped a mugging by Tyson , Holyfield understands that he 's still only on bail from the charge that he 's a heavyweight fraud .

source_bert_toks: one man ' s prison sentence is another man ' s rep ##rie ##ve , though having escaped a mug ##ging by tyson , holy ##field understands that he ' s still only on bail from the charge that he ' s a heavyweight fraud .

reference_raw: One man's prison sentence is another man's pardon, although he escaped Tyson's ambush, Holyfield understands he's still on bail for being a heavyweight fraud.

reference_spacy_tokens: One man 's prison sentence is another man 's pardon , although he escaped Tyson 's ambush , Holyfield understands he 's still on bail for being a heavyweight fraud .


fn_spacy_tokens_for_baseline: In the second he stood bareheaded , dressed in a swirling black cloak , fastened at the throat by a gold and enamel clasp .

source_bert_toks: in the second he stood bare ##head ##ed , dressed in a swirling black cloak , fastened at the throat by a gold and enamel clasp .

reference_raw: In the second he stood naked, dressed in a swirling black cloak, with a gold and enamel clasp attached to his neck.

reference_spacy_tokens: In the second he stood naked , dressed in a swirling black cloak , with a gold and enamel clasp attached to his neck .


fn_spacy_tokens_for_baseline: The exaltation of emotion and intuition above logical reasoning can readily disentangle them from any such disciplinary anchorage .

source_bert_toks: the ex ##al ##tation of emotion and intuition above logical reasoning can readily di ##sen ##tangle them from any such disciplinary anchorage .

reference_raw: Exalting emotions and intuitions over logic can easily dissipate them from any such disciplinary anchorage.

reference_spacy_tokens: Exalting emotions and intuitions over logic can easily dissipate them from any such disciplinary anchorage .


fn_spacy_tokens_for_baseline: The payments made by Federal employees are in the nature of taxes , compulsory payments demanded by the Government through the exercise of its power to compel payment .

source_bert_toks: the payments made by federal employees are in the nature of taxes , compulsory payments demanded by the government through the exercise of its power to com ##pel payment .

reference_raw: Payments made by federal employees are in the nature of taxes, compulsory payments required by the government in the exercise of its authority to compel payments.

reference_spacy_tokens: Payments made by federal employees are in the nature of taxes , compulsory payments required by the government in the exercise of its authority to compel payments .


fn_spacy_tokens_for_baseline: The Earls Court Boat Show last month saw the launching of a GPS set called the Pronav for £ 1,495 , including VAT , and other sets have begun to tumble in price .

source_bert_toks: the earls court boat show last month saw the launching of a gps set called the pro ##na ##v for £1 , 495 , including va ##t , and other sets have begun to tumble in price .

reference_raw: Last month, the Earls Court Boat Show saw the launch of a GPS set called Pronav for £1495, including VAT, and other sets began to fall in price.

reference_spacy_tokens: Last month , the Earls Court Boat Show saw the launch of a GPS set called Pronav for £ 1495 , including VAT , and other sets began to fall in price .


fn_spacy_tokens_for_baseline: I had a sudden mental picture of a struggling and reluctant group of climbers being herded into a minibus bound for Anglesey by Dunne , Littlejohn et al .

source_bert_toks: i had a sudden mental picture of a struggling and reluctant group of climb ##ers being herd ##ed into a mini ##bus bound for angles ##ey by dunne , little ##jo ##hn et al .

reference_raw: I had a sudden mental picture of a struggling and hesitant group of climbers flocking to a minibus bound for Anglesey by Dunne, Littlejohn et al.

reference_spacy_tokens: I had a sudden mental picture of a struggling and hesitant group of climbers flocking to a minibus bound for Anglesey by Dunne , Littlejohn et al .


fn_spacy_tokens_for_baseline: With a premonition of his fate he had refused to take me with him .

source_bert_toks: with a prem ##oni ##tion of his fate he had refused to take me with him .

reference_raw: With a sense of fate, he refused to take me with him.

reference_spacy_tokens: With a sense of fate , he refused to take me with him .


fn_spacy_tokens_for_baseline: Do I smuggle contraband goods ?

source_bert_toks: do i smug ##gle contra ##band goods ?

reference_raw: Smuggling contra-band goods?

reference_spacy_tokens: Smuggling contra - band goods ?


fn_spacy_tokens_for_baseline: All the time knowing that while I 'm round the back of a lorry he 's probably scarpered off up the road into limbo .

source_bert_toks: all the time knowing that while i ' m round the back of a lo ##rry he ' s probably scar ##per ##ed off up the road into limb ##o .

reference_raw: All the time knowing that while I'm around the back of the truck, he's probably scarred off the road to limbo.

reference_spacy_tokens: All the time knowing that while I 'm around the back of the truck , he 's probably scarred off the road to limbo .


fn_spacy_tokens_for_baseline: A cold and melancholy walk of a couple of miles brought us to a high wooden gate , which opened into a gloomy avenue of chestnuts .

source_bert_toks: a cold and melancholy walk of a couple of miles brought us to a high wooden gate , which opened into a gloom ##y avenue of chestnut ##s .

reference_raw: The cold, melancholy walk of several miles led us to a high wooden gate that opened into a dark avenue of chestnuts.

reference_spacy_tokens: The cold , melancholy walk of several miles led us to a high wooden gate that opened into a dark avenue of chestnuts .


fn_spacy_tokens_for_baseline: Like Khomeini a quarter of a century later , he was almost totally incomprehensible to many western Europeans and Americans .

source_bert_toks: like k ##hom ##ein ##i a quarter of a century later , he was almost totally inc ##omp ##re ##hen ##sible to many western europeans and americans .

reference_raw: Like Khomeini a quarter of a century later, many Western Europeans and Americans found him almost completely unintelligible.

reference_spacy_tokens: Like Khomeini a quarter of a century later , many Western Europeans and Americans found him almost completely unintelligible .


fn_spacy_tokens_for_baseline: It would have been interesting to listen to their discussion , trying to understand their arguments , for I 'm hanged if their decision makes an ounce of sense to my mundane way of thinking .

source_bert_toks: it would have been interesting to listen to their discussion , trying to understand their arguments , for i ' m hanged if their decision makes an ounce of sense to my mundane way of thinking .

reference_raw: It would be interesting to hear their discussion and try to understand their arguments, for I am hanged if their decision makes any sense to my ordinary way of thinking.

reference_spacy_tokens: It would be interesting to hear their discussion and try to understand their arguments , for I am hanged if their decision makes any sense to my ordinary way of thinking .


fn_spacy_tokens_for_baseline: He was writing a problem in calculus on the blackboard when those of his class who 'd come to school today piled into the classroom , jostling and swearing , accompanied by smells of tobacco and cheap perfume .

source_bert_toks: he was writing a problem in calculus on the black ##board when those of his class who ' d come to school today piled into the classroom , jo ##st ##ling and swearing , accompanied by smells of tobacco and cheap perfume .

reference_raw: He was writing a calculus problem on the board when those of his class who had come to school today piled up in the classroom, jostling and cursing, accompanied by the smell of cigarettes and cheap perfumes.

reference_spacy_tokens: He was writing a calculus problem on the board when those of his class who had come to school today piled up in the classroom , jostling and cursing , accompanied by the smell of cigarettes and cheap perfumes .


fn_spacy_tokens_for_baseline: Miss Hardbroom ground her teeth and managed a horribly false smile .

source_bert_toks: miss hard ##bro ##om ground her teeth and managed a horribly false smile .

reference_raw: Miss Hardbroom brushed her teeth and managed a hideously false smile.

reference_spacy_tokens: Miss Hardbroom brushed her teeth and managed a hideously false smile .


fn_spacy_tokens_for_baseline: After seventeen years ' service with Stoddard Ellen Gardner retired from her position as an Export Administrator on the 27th July .

source_bert_toks: after seventeen years ' service with st ##od ##dar ##d ellen gardner retired from her position as an export administrator on the 27th july .

reference_raw: After seventeen years of service with Stoddard Ellen Gardner resigned from her post as export administrator on July 27.

reference_spacy_tokens: After seventeen years of service with Stoddard Ellen Gardner resigned from her post as export administrator on July 27 .


fn_spacy_tokens_for_baseline: Wynn 's demolition of the existing properties started a trend that , more than any other , describes Las Vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

source_bert_toks: wynn ' s demolition of the existing properties started a trend that , more than any other , describes las vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

reference_raw: At the end of the 20th century, Wynn's destruction of existing properties began a trend which, more than anything else, describes Las Vegas: the removal of old properties in exchange for the potential of new ones.

reference_spacy_tokens: At the end of the 20th century , Wynn 's destruction of existing properties began a trend which , more than anything else , describes Las Vegas : the removal of old properties in exchange for the potential of new ones .


fn_spacy_tokens_for_baseline: 150 firemen were drafted in as flames swept through and destroyed number eight hangar .

source_bert_toks: 150 fire ##men were drafted in as flames swept through and destroyed number eight hangar .

reference_raw: 150 firefighters were drawn in as the flames swept through and destroyed the number eight bay.

reference_spacy_tokens: 150 firefighters were drawn in as the flames swept through and destroyed the number eight bay .


fn_spacy_tokens_for_baseline: Her incentive to take up painting came after she read an article in the Sunday Telegraph about Brigitte Bardot , and , in particular , a poem titled ' Complaint of an abandoned dog ' .

source_bert_toks: her incentive to take up painting came after she read an article in the sunday telegraph about brig ##itte bard ##ot , and , in particular , a poem titled ' complaint of an abandoned dog ' .

reference_raw: She was motivated to paint when she read an article on the Sunday Telegraph about Brigitte Bardot, especially a poem called "The Complaint of the Desolate Dog."

reference_spacy_tokens: She was motivated to paint when she read an article on the Sunday Telegraph about Brigitte Bardot , especially a poem called " The Complaint of the Desolate Dog . "


fn_spacy_tokens_for_baseline: The outcome , due to the power of speculators and property holders , was that Berlin 's Mietkaserne became a symbol throughout the West for substandard housing .

source_bert_toks: the outcome , due to the power of spec ##ulator ##s and property holders , was that berlin ' s mi ##et ##kas ##ern ##e became a symbol throughout the west for sub ##stand ##ard housing .

reference_raw: As a result, due to the power of speculators and real estate holders, Berlin's Mietkaserne has become a symbol of sub-standard housing throughout the West.

reference_spacy_tokens: As a result , due to the power of speculators and real estate holders , Berlin 's Mietkaserne has become a symbol of sub - standard housing throughout the West .


fn_spacy_tokens_for_baseline: The men ransacked the house before making off with mainly jewellery valued at £ 2,000 .

source_bert_toks: the men ran ##sack ##ed the house before making off with mainly jewellery valued at £2 , 000 .

reference_raw: The men searched the house before making their way with jewellery worth two thousand pounds.

reference_spacy_tokens: The men searched the house before making their way with jewellery worth two thousand pounds .


fn_spacy_tokens_for_baseline: No birds in here , calling out , not even the buzz of a fly , the swish of a cow 's tail .

source_bert_toks: no birds in here , calling out , not even the buzz of a fly , the sw ##ish of a cow ' s tail .

reference_raw: There are no birds calling, not even the hum of a fly, not the swish of a cow's tail.

reference_spacy_tokens: There are no birds calling , not even the hum of a fly , not the swish of a cow 's tail .


fn_spacy_tokens_for_baseline: But the chief superintendent knew he had to counterfeit genuine anger when he confronted Blanche , tear her off a strip , and put overweening ambition in its place .

source_bert_toks: but the chief superintendent knew he had to counter ##feit genuine anger when he confronted blanche , tear her off a strip , and put over ##wee ##ning ambition in its place .

reference_raw: But the Chief Inspector knew that when he faced Blanche, he had to fake genuine anger, tear her off the strip, and replace her with overweening ambition.

reference_spacy_tokens: But the Chief Inspector knew that when he faced Blanche , he had to fake genuine anger , tear her off the strip , and replace her with overweening ambition .


fn_spacy_tokens_for_baseline: His attendance has been confirmed by Disney but , as one organiser admitted , ' I ca n't see him eating a burger . '

source_bert_toks: his attendance has been confirmed by disney but , as one organise ##r admitted , ' i can ' t see him eating a burger . '

reference_raw: Disney acknowledged his presence, but as one of the organizers admitted, "I don't see him eating a burger."

reference_spacy_tokens: Disney acknowledged his presence , but as one of the organizers admitted , " I do n't see him eating a burger . "


fn_spacy_tokens_for_baseline: However , it could provide ammunition for legal action which Ferranti intends to take against advisers and individuals in an attempt to recover some of the losses it has suffered .

source_bert_toks: however , it could provide ammunition for legal action which fe ##rran ##ti intends to take against advisers and individuals in an attempt to recover some of the losses it has suffered .

reference_raw: It could, however, provide ammo for legal action that Ferranti intends to take against advisers and individuals in order to recover some of the losses it has suffered.

reference_spacy_tokens: It could , however , provide ammo for legal action that Ferranti intends to take against advisers and individuals in order to recover some of the losses it has suffered .


fn_spacy_tokens_for_baseline: Gret , a Brueghel peasant in a breastplate filches food and cutlery and mutters the occasional curse .

source_bert_toks: gr ##et , a br ##ue ##gh ##el peasant in a breast ##plate fi ##lch ##es food and cutler ##y and mutter ##s the occasional curse .

reference_raw: Gret, a Brueghel peasant in a breastplate, fills with food and food and murmurs the occasional curse.

reference_spacy_tokens: Gret , a Brueghel peasant in a breastplate , fills with food and food and murmurs the occasional curse .


fn_spacy_tokens_for_baseline: Very soon the place was so packed that knots of people integrated into a sway and the perimeter of the appointed area burst .

source_bert_toks: very soon the place was so packed that knots of people integrated into a sway and the perimeter of the appointed area burst .

reference_raw: Soon it was packed in such a way that the knots of people integrated into the rocking and the circumference of the designated area burst.

reference_spacy_tokens: Soon it was packed in such a way that the knots of people integrated into the rocking and the circumference of the designated area burst .


fn_spacy_tokens_for_baseline: The commencement of the trial ended a period of intense speculation that Barry would reach a plea bargain with the federal authorities .

source_bert_toks: the commencement of the trial ended a period of intense speculation that barry would reach a plea bargain with the federal authorities .

reference_raw: The start of the trial ended a period of intense speculation that Barry would reach a plea agreement with the federal authorities.

reference_spacy_tokens: The start of the trial ended a period of intense speculation that Barry would reach a plea agreement with the federal authorities .


fn_spacy_tokens_for_baseline: The Aegean Islands , which for centuries had been important ports on the trading routes , became the backwaters of this new transport network and the economies of several islands came close to collapse .

source_bert_toks: the aegean islands , which for centuries had been important ports on the trading routes , became the back ##water ##s of this new transport network and the economies of several islands came close to collapse .

reference_raw: The Aegean islands, which have been important ports on trade routes for centuries, have become the backdrop of this new traffic network, and the economies of several islands have almost collapsed.

reference_spacy_tokens: The Aegean islands , which have been important ports on trade routes for centuries , have become the backdrop of this new traffic network , and the economies of several islands have almost collapsed .


fn_spacy_tokens_for_baseline: 1 ) Voters can " buy " one of two brands when they select their political agents -- a Republican brand that believes in the minimalist state and in the virtues of private markets over the vices of public action , and a Democratic brand that believes in big government and in public intervention to remedy the excesses attendant to the pursuit of private interest .

source_bert_toks: 1 ) voters can " buy " one of two brands when they select their political agents - - a republican brand that believes in the minimal ##ist state and in the virtues of private markets over the vice ##s of public action , and a democratic brand that believes in big government and in public intervention to remedy the excess ##es attendant to the pursuit of private interest .

reference_raw: 1) Voters can "buy" one of two brands if they choose their political agents, a Republican brand that believes in the minimalist state and the virtues of private markets over the vices of public action, and a democratic brand that believes in large government and public intervention to correct excesses associated with the pursuit of private interests.

reference_spacy_tokens: 1 ) Voters can " buy " one of two brands if they choose their political agents , a Republican brand that believes in the minimalist state and the virtues of private markets over the vices of public action , and a democratic brand that believes in large government and public intervention to correct excesses associated with the pursuit of private interests .


fn_spacy_tokens_for_baseline: Most of the original infections in plywood are killed in the hot pressing process , but if the material is subsequently exposed to bacteria or fungi and water it will rot quite quickly .

source_bert_toks: most of the original infections in pl ##ywood are killed in the hot pressing process , but if the material is subsequently exposed to bacteria or fungi and water it will rot quite quickly .

reference_raw: Most of the original plywood infections are killed by the hot press, but if the material is subsequently exposed to bacteria or fungi and water, it will decay very quickly.

reference_spacy_tokens: Most of the original plywood infections are killed by the hot press , but if the material is subsequently exposed to bacteria or fungi and water , it will decay very quickly .


fn_spacy_tokens_for_baseline: Additionally , the insufficiency of the existing electrical infrastructure and dwindling oil revenues contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements .

source_bert_toks: additionally , the ins ##uf ##fi ##ciency of the existing electrical infrastructure and d ##wind ##ling oil revenues contributed to the withdrawal of foreign suppliers from iran and the abandonment of nuclear power agreements .

reference_raw: In addition, the lack of existing electricity infrastructure and the decline in oil revenues contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements.

reference_spacy_tokens: In addition , the lack of existing electricity infrastructure and the decline in oil revenues contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements .


fn_spacy_tokens_for_baseline: Nor in the case of animals will it undermine what we say of their consciousness , grounded as it is in their contiguity to the human paradigm .

source_bert_toks: nor in the case of animals will it undermine what we say of their consciousness , grounded as it is in their con ##ti ##gui ##ty to the human paradigm .

reference_raw: In the case of animals, it will not undermine what we say about their consciousness, which is based on their contiguousness to the human paradigm.

reference_spacy_tokens: In the case of animals , it will not undermine what we say about their consciousness , which is based on their contiguousness to the human paradigm .


fn_spacy_tokens_for_baseline: Thorpe J. decided that the mother had not established that the father had acquiesced in the removal or retention of the children .

source_bert_toks: thorpe j . decided that the mother had not established that the father had ac ##qui ##es ##ced in the removal or retention of the children .

reference_raw: Thorpe J. decided that his mother had not proved that his father had consented to the removal or retention of the children.

reference_spacy_tokens: Thorpe J. decided that his mother had not proved that his father had consented to the removal or retention of the children .