fn_spacy_tokens_for_baseline: The theatre was estimated to measure about 10 feet in height , 15 in breadth , and 20 in length ( can these measurements be correct -- classes sometimes numbered 70 or more students ? ) .

source_bert_toks: the theatre was estimated to measure about 10 feet in height , 15 in breadth , and 20 in length ( can these measurements be correct - - classes sometimes numbered 70 or more students ? ) .

reference_raw: The theatre was estimated to be about 10 feet tall, 15 in width, and 20 in length (can these measurements be correct--classes sometimes number 70 or more students?).

reference_spacy_tokens: The theatre was estimated to be about 10 feet tall , 15 in width , and 20 in length ( can these measurements be correct -- classes sometimes number 70 or more students ? ) .


fn_spacy_tokens_for_baseline: You can view artifacts from the Bronze Age , trace the history of the Easter Rising , or revisit Leopold Bloom 's odyssey in Ulysses .

source_bert_toks: you can view artifacts from the bronze age , trace the history of the easter rising , or rev ##isi ##t leopold bloom ' s odyssey in ulysses .

reference_raw: You can view the Bronze Age artifacts, trace the history of Easter Rising, or review the Odyssey of Leopold Bloom in Ulysses.

reference_spacy_tokens: You can view the Bronze Age artifacts , trace the history of Easter Rising , or review the Odyssey of Leopold Bloom in Ulysses .


fn_spacy_tokens_for_baseline: The constantly crowded and busy Grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the Irish crafts and souvenirs you expect .

source_bert_toks: the constantly crowded and busy grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the irish crafts and so ##uven ##irs you expect .

reference_raw: The ever-crowded and busy Grafton Street is the most visible shopping center, but there are shops everywhere that carry an international range of goods, as well as the Irish artisans and souvenirs you expect.

reference_spacy_tokens: The ever - crowded and busy Grafton Street is the most visible shopping center , but there are shops everywhere that carry an international range of goods , as well as the Irish artisans and souvenirs you expect .


fn_spacy_tokens_for_baseline: The winners : British Prime Minister Tony Blair ( " [ His ] reputation as a strong leader on the international stage will be enhanced .

source_bert_toks: the winners : british prime minister tony blair ( " [ his ] reputation as a strong leader on the international stage will be enhanced .

reference_raw: The winners: British Prime Minister Tony Blair ("[his] reputation as a powerful international leader) will be strengthened.

reference_spacy_tokens: The winners : British Prime Minister Tony Blair ( " [ his ] reputation as a powerful international leader ) will be strengthened .


fn_spacy_tokens_for_baseline: The right - of - way travels past fancy apartment blocks , bamboo stands , and jungle flowers .

source_bert_toks: the right - of - way travels past fancy apartment blocks , bamboo stands , and jungle flowers .

reference_raw: Right-of-way travels around fancy apartment blocks, bamboo stands, and jungle flowers.

reference_spacy_tokens: Right - of - way travels around fancy apartment blocks , bamboo stands , and jungle flowers .


fn_spacy_tokens_for_baseline: Parboil the vegetables in separate pans of boiling water until just tender .

source_bert_toks: par ##bo ##il the vegetables in separate pan ##s of boiling water until just tender .

reference_raw: Separate the vegetables in separate pans of boiling water until they are tender.

reference_spacy_tokens: Separate the vegetables in separate pans of boiling water until they are tender .


fn_spacy_tokens_for_baseline: The amount of substance is proportional to the number of specified elementary entities of that substance .

source_bert_toks: the amount of substance is proportional to the number of specified elementary entities of that substance .

reference_raw: The amount of the substance shall be proportionate to the number of specified elements of the substance.

reference_spacy_tokens: The amount of the substance shall be proportionate to the number of specified elements of the substance .


fn_spacy_tokens_for_baseline: The building of small , defensive forts , or blockhouses , is as old as the history of formal warfare .

source_bert_toks: the building of small , defensive forts , or block ##houses , is as old as the history of formal warfare .

reference_raw: The building of small, defensive forts or blocks is as old as the history of formal warfare.

reference_spacy_tokens: The building of small , defensive forts or blocks is as old as the history of formal warfare .


fn_spacy_tokens_for_baseline: She had never been able to equal her sister 's matchless beauty , she knew , but at least she presented the world with a fair imitation of it .

source_bert_toks: she had never been able to equal her sister ' s match ##less beauty , she knew , but at least she presented the world with a fair imitation of it .

reference_raw: She knew she had never been able to match her sister's unmatched beauty, but at least she had shown the world a fair imitation.

reference_spacy_tokens: She knew she had never been able to match her sister 's unmatched beauty , but at least she had shown the world a fair imitation .


fn_spacy_tokens_for_baseline: High on its waterless ridge , Battle grew with the fortunes of its abbey , but never achieved the sort of wealth that allowed Chichester to assert its independence .

source_bert_toks: high on its water ##less ridge , battle grew with the fortunes of its abbey , but never achieved the sort of wealth that allowed chichester to assert its independence .

reference_raw: High on its unwatered ridge, the battle had grown with the wealth of its abbey, but it had never achieved the wealth that would allow Chichester to assert his independence.

reference_spacy_tokens: High on its unwatered ridge , the battle had grown with the wealth of its abbey , but it had never achieved the wealth that would allow Chichester to assert his independence .


fn_spacy_tokens_for_baseline: El Espectador has been a special target because of the extraordinary courage of its publisher and his staff .

source_bert_toks: el es ##pe ##cta ##dor has been a special target because of the extraordinary courage of its publisher and his staff .

reference_raw: El Espectador was a special target, due to the exceptional courage of his publisher and his staff.

reference_spacy_tokens: El Espectador was a special target , due to the exceptional courage of his publisher and his staff .


fn_spacy_tokens_for_baseline: Work Advances at Iranian Uranium Enrichment Site

source_bert_toks: work advances at iranian uranium enrichment site

reference_raw: Work progress at the Iranian uranium enrichment site


fn_spacy_tokens_for_baseline: The request would only be considered if it had been submitted in a timely manner as indicated , except in special cases .

source_bert_toks: the request would only be considered if it had been submitted in a timely manner as indicated , except in special cases .

reference_raw: The application will only be considered if it has been submitted in due time, as indicated, except in specific cases.

reference_spacy_tokens: The application will only be considered if it has been submitted in due time , as indicated , except in specific cases .


fn_spacy_tokens_for_baseline: It took some time and hard work , but with the help of Goodwill , Jerry was able to work out a payment plan with the prosecutor 's office , find housing and conduct a more thorough job search .

source_bert_toks: it took some time and hard work , but with the help of goodwill , jerry was able to work out a payment plan with the prosecutor ' s office , find housing and conduct a more thorough job search .

reference_raw: It was a long time and a hard time, but with the help of Goodwill, Jerry was able to work out a payment plan with the D.A.'s office, find a place to live, and do a more thorough job search.

reference_spacy_tokens: It was a long time and a hard time , but with the help of Goodwill , Jerry was able to work out a payment plan with the D.A. 's office , find a place to live , and do a more thorough job search .


fn_spacy_tokens_for_baseline: The squealing became slightly louder , and clearer -- the yowls of an animal in pain .

source_bert_toks: the sq ##ue ##aling became slightly louder , and clearer - - the yo ##wl ##s of an animal in pain .

reference_raw: The screams grew louder and clearer - the screams of an animal in pain.

reference_spacy_tokens: The screams grew louder and clearer - the screams of an animal in pain .


fn_spacy_tokens_for_baseline: From Victoria Peak , Hong Kong 's highest point , or from skyscrapers and hotels , they are especially exciting at night when the lights are on .

source_bert_toks: from victoria peak , hong kong ' s highest point , or from skyscraper ##s and hotels , they are especially exciting at night when the lights are on .

reference_raw: From Victoria Peak, the highest point in Hong Kong, or from skyscrapers and hotels, it's particularly exciting at night when the lights go off.

reference_spacy_tokens: From Victoria Peak , the highest point in Hong Kong , or from skyscrapers and hotels , it 's particularly exciting at night when the lights go off .


fn_spacy_tokens_for_baseline: Twice Henderson has lashed at folk with his dog - whip , and only his long purse and heavy compensation have kept him out of the courts .

source_bert_toks: twice henderson has lashed at folk with his dog - whip , and only his long purse and heavy compensation have kept him out of the courts .

reference_raw: Henderson hit people twice with his dog whip, and only his long purse and heavy compensation kept him out of court.

reference_spacy_tokens: Henderson hit people twice with his dog whip , and only his long purse and heavy compensation kept him out of court .


fn_spacy_tokens_for_baseline: The occasional cry of gulls and unexpected distant vistas will remind you that Dublin is by the sea , and the Wicklow mountains , which hold Dublin closely to the coast , are visible from everywhere .

source_bert_toks: the occasional cry of gu ##lls and unexpected distant vista ##s will remind you that dublin is by the sea , and the wi ##ck ##low mountains , which hold dublin closely to the coast , are visible from everywhere .

reference_raw: The occasional scream of gulls and unexpected remote vistas will remind you that Dublin is at sea and that the Wicklow Mountains, which hold Dublin close to the shore, can be seen everywhere.

reference_spacy_tokens: The occasional scream of gulls and unexpected remote vistas will remind you that Dublin is at sea and that the Wicklow Mountains , which hold Dublin close to the shore , can be seen everywhere .


fn_spacy_tokens_for_baseline: First look out for the spoor on prominent areas of the banks , scatter the area with pieces of sliced apple and then sit and wait .

source_bert_toks: first look out for the sp ##oor on prominent areas of the banks , sc ##atter the area with pieces of sliced apple and then sit and wait .

reference_raw: First take care of the spoor in the prominent areas of the bank, sprinkle the area with bits of sliced apple, and then sit back and wait.

reference_spacy_tokens: First take care of the spoor in the prominent areas of the bank , sprinkle the area with bits of sliced apple , and then sit back and wait .


fn_spacy_tokens_for_baseline: Rain hissed against the tyres , and the beat of the wipers became almost hypnotic .

source_bert_toks: rain hissed against the tyres , and the beat of the wipe ##rs became almost hypnotic .

reference_raw: The rain sizzled against the tires, and the beat of the wipers became almost hypnotic.

reference_spacy_tokens: The rain sizzled against the tires , and the beat of the wipers became almost hypnotic .


fn_spacy_tokens_for_baseline: The only holiday on which all commerce comes to a halt is the Chinese New Year in January or February .

source_bert_toks: the only holiday on which all commerce comes to a halt is the chinese new year in january or february .

reference_raw: The only holiday where all trade stops is the New Year of China in January or February.

reference_spacy_tokens: The only holiday where all trade stops is the New Year of China in January or February .


fn_spacy_tokens_for_baseline: This little group forms the real family , for their travel about together , and Henderson is a great traveller , always on the move .

source_bert_toks: this little group forms the real family , for their travel about together , and henderson is a great traveller , always on the move .

reference_raw: This small group is a real family, because they travel together, and Henderson is a great traveler, always on the move.

reference_spacy_tokens: This small group is a real family , because they travel together , and Henderson is a great traveler , always on the move .


fn_spacy_tokens_for_baseline: The climate here can best be described as " changeable " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city 's magic .

source_bert_toks: the climate here can best be described as " change ##able " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city ' s magic .

reference_raw: The weather here is best described as "changeable", but the sudden shift from light to darkness, sun to shower, is part of the city's magic.

reference_spacy_tokens: The weather here is best described as " changeable " , but the sudden shift from light to darkness , sun to shower , is part of the city 's magic .


fn_spacy_tokens_for_baseline: Outside , the day was already well advanced and sunlight glimmered on the waters of the canal below , the towpath already thronging with people .

source_bert_toks: outside , the day was already well advanced and sunlight g ##lim ##mere ##d on the waters of the canal below , the tow ##path already th ##rong ##ing with people .

reference_raw: Outside, the day was well advanced, and the sun shone on the waters of the canal below, and the towpath was already crowded with humans.

reference_spacy_tokens: Outside , the day was well advanced , and the sun shone on the waters of the canal below , and the towpath was already crowded with humans .


fn_spacy_tokens_for_baseline: The recreational pleasures that ordinary islanders enjoy have become synonymous with the name Jamaica : dancing to the heavily rhythmic musical beat ; taking a little marijuana ( or " ganja , " as it 's known here ) , which many Jamaicans view as a kind of medicinal herb ; or simply sitting back and chatting with friends on a bench or street corner , where the situation is described as " Irie " the equivalent of " Everything 's just fine ! "

source_bert_toks: the recreational pleasures that ordinary islanders enjoy have become synonymous with the name jamaica : dancing to the heavily rhythmic musical beat ; taking a little marijuana ( or " gan ##ja , " as it ' s known here ) , which many jamaican ##s view as a kind of medicinal herb ; or simply sitting back and chatting with friends on a bench or street corner , where the situation is described as " ir ##ie " the equivalent of " everything ' s just fine ! "

reference_raw: Recreational pleasures enjoyed by ordinary islanders became synonymous with the name Jamaica: dancing to a very rhythmic musical rhythm; taking a bit of marijuana (or "ganja," as it is known here), which many Jamaicans view as some sort of medicinal herb; or simply sitting and chatting with friends on a bench or street corner, where the situation is described as "Irie" the equivalent of "Everything". All right!

reference_spacy_tokens: Recreational pleasures enjoyed by ordinary islanders became synonymous with the name Jamaica : dancing to a very rhythmic musical rhythm ; taking a bit of marijuana ( or " ganja , " as it is known here ) , which many Jamaicans view as some sort of medicinal herb ; or simply sitting and chatting with friends on a bench or street corner , where the situation is described as " Irie " the equivalent of " Everything " . All right !


fn_spacy_tokens_for_baseline: For all its historic grandeur , the loyal Senate now is the equivalent of a city council , its statesmanship dedicated to water supplies , sewage lines , and the establishment of playgrounds .

source_bert_toks: for all its historic grande ##ur , the loyal senate now is the equivalent of a city council , its statesman ##ship dedicated to water supplies , sewage lines , and the establishment of playground ##s .

reference_raw: For all its historical grandeur, the Loyal Council is now the equivalent of a city council, its statesmanship devoted to water supply, sewage lines, and the setting-up of playgrounds.

reference_spacy_tokens: For all its historical grandeur , the Loyal Council is now the equivalent of a city council , its statesmanship devoted to water supply , sewage lines , and the setting - up of playgrounds .


fn_spacy_tokens_for_baseline: The latest approach is perhaps the best of the post - mob era : the comprehensive resort .

source_bert_toks: the latest approach is perhaps the best of the post - mob era : the comprehensive resort .

reference_raw: The most recent approach is perhaps the best in the post-mob era: a complex resort.

reference_spacy_tokens: The most recent approach is perhaps the best in the post - mob era : a complex resort .


fn_spacy_tokens_for_baseline: Gently , Valence jetted the two suits back down to the training deck .

source_bert_toks: gently , vale ##nce jett ##ed the two suits back down to the training deck .

reference_raw: Valence gently pushed both suits back to the training deck.

reference_spacy_tokens: Valence gently pushed both suits back to the training deck .


fn_spacy_tokens_for_baseline: Sprinkle with Golden Granulated Sugar and drizzle with remaining butter .

source_bert_toks: sp ##rin ##kle with golden gran ##ulated sugar and dr ##iz ##zle with remaining butter .

reference_raw: Sprinkle with golden granulated sugar and drink with the remaining butter.

reference_spacy_tokens: Sprinkle with golden granulated sugar and drink with the remaining butter .


fn_spacy_tokens_for_baseline: She had badgered her parents into letting her join the Women 's Auxiliary Territorial Service after her eighteenth birthday .

source_bert_toks: she had badger ##ed her parents into letting her join the women ' s auxiliary territorial service after her eighteenth birthday .

reference_raw: After her eighteenth birthday, she told her parents to let her join the Women's Auxiliary Territorial Service.

reference_spacy_tokens: After her eighteenth birthday , she told her parents to let her join the Women 's Auxiliary Territorial Service .


fn_spacy_tokens_for_baseline: While the Scuds fell short of Lampedusa , they clearly illustrate how Qadhafi could use longer - range ballistic missiles to target NATO and Western interests in Europe and the Middle East .

source_bert_toks: while the sc ##ud ##s fell short of lamp ##ed ##usa , they clearly illustrate how q ##ad ##ha ##fi could use longer - range ballistic missiles to target nato and western interests in europe and the middle east .

reference_raw: While the Scuds missed Lampedusa, they clearly show how Qadhafi could use long-range ballistic missiles to target NATO and Western interests in Europe and the Middle East.

reference_spacy_tokens: While the Scuds missed Lampedusa , they clearly show how Qadhafi could use long - range ballistic missiles to target NATO and Western interests in Europe and the Middle East .


fn_spacy_tokens_for_baseline: The Taepodong-2 has not been flight - tested , but U.S. intelligence analysts believe it could be ready for testing at any time . Pyongyang has deployed as many as 600 - 750 ballistic missiles , including about 175 - 200 Nodongs .

source_bert_toks: the tae ##pod ##ong - 2 has not been flight - tested , but u . s . intelligence analysts believe it could be ready for testing at any time . p ##yon ##gy ##ang has deployed as many as 600 - 750 ballistic missiles , including about 175 - 200 nod ##ong ##s .

reference_raw: The Taepodong-2 has not been tested in flight, but American intelligence analysts believe it can be ready to test at any time. Pyongyang has deployed up to 600 - 750 ballistic missiles, including about 175 - 200 Nodongs.

reference_spacy_tokens: The Taepodong-2 has not been tested in flight , but American intelligence analysts believe it can be ready to test at any time . Pyongyang has deployed up to 600 - 750 ballistic missiles , including about 175 - 200 Nodongs .


fn_spacy_tokens_for_baseline: Entry procedures are similar to those in Hong Kong - most nationalities need only a passport to enter Macau .

source_bert_toks: entry procedures are similar to those in hong kong - most nationalities need only a passport to enter macau .

reference_raw: The entry procedures are similar to those in Hong Kong - most nationals only need a pass to enter Macao.

reference_spacy_tokens: The entry procedures are similar to those in Hong Kong - most nationals only need a pass to enter Macao .


fn_spacy_tokens_for_baseline: Car horns were blared for minutes on end , headlights were flashed , people danced and sang and shouted , ' The Shah is gone .

source_bert_toks: car horns were b ##lar ##ed for minutes on end , headlights were flashed , people danced and sang and shouted , ' the shah is gone .

reference_raw: The horns of the car were lit for minutes at the end, the lights were on, people were dancing and singing and screaming, "The Shah is gone.

reference_spacy_tokens: The horns of the car were lit for minutes at the end , the lights were on , people were dancing and singing and screaming , " The Shah is gone .


fn_spacy_tokens_for_baseline: I 'll amuse the children , I shall be perfectly happy . "

source_bert_toks: i ' ll am ##use the children , i shall be perfectly happy . "

reference_raw: I'll have fun with the kids, I'll be perfectly happy.

reference_spacy_tokens: I 'll have fun with the kids , I 'll be perfectly happy .


fn_spacy_tokens_for_baseline: THE FBI said yesterday that the Texas cult leader David Koresh had indicated that he appears close to receiving a sign from God , implying that an end to his 20-day standoff with federal agents might be near .

source_bert_toks: the fbi said yesterday that the texas cult leader david ko ##resh had indicated that he appears close to receiving a sign from god , implying that an end to his 20 - day stand ##off with federal agents might be near .

reference_raw: F.B.I. said yesterday that Texas cult leader David Koresh indicated that he appeared to be on the verge of receiving a sign from God, suggesting that the end of his 20-day stand-off with federal agents might be close.

reference_spacy_tokens: F.B.I. said yesterday that Texas cult leader David Koresh indicated that he appeared to be on the verge of receiving a sign from God , suggesting that the end of his 20-day stand - off with federal agents might be close .


fn_spacy_tokens_for_baseline: Cruel in the extreme , she would horsewhip them mercilessly , giving them little food and confining them in cold and filthy cellars .

source_bert_toks: cruel in the extreme , she would horse ##w ##hip them mer ##ci ##lessly , giving them little food and con ##fin ##ing them in cold and filthy cellar ##s .

reference_raw: In the extreme, he would ride them mercilessly, giving them little food and confining them in cold and dirty cellars.

reference_spacy_tokens: In the extreme , he would ride them mercilessly , giving them little food and confining them in cold and dirty cellars .


fn_spacy_tokens_for_baseline: This printer is fine for producing text and basic graphics .

source_bert_toks: this printer is fine for producing text and basic graphics .

reference_raw: This printer is good for producing text and basic graphics.

reference_spacy_tokens: This printer is good for producing text and basic graphics .


fn_spacy_tokens_for_baseline: This one meant either a crawl on my belly beneath a boulder , hoping to be able to escape out of the hole on the other side , or a wide sloping ledge on the right .

source_bert_toks: this one meant either a crawl on my belly beneath a boulder , hoping to be able to escape out of the hole on the other side , or a wide sloping ledge on the right .

reference_raw: This one meant either climbing under a boulder on my stomach, hoping to get out of the hole on the other side, or a wide sloping ledge on the right.

reference_spacy_tokens: This one meant either climbing under a boulder on my stomach , hoping to get out of the hole on the other side , or a wide sloping ledge on the right .


fn_spacy_tokens_for_baseline: ' Of course , ' Eline pointed out , ' the Clarks are not ready to go into production of their new line , not just yet .

source_bert_toks: ' of course , ' eli ##ne pointed out , ' the clark ##s are not ready to go into production of their new line , not just yet .

reference_raw: 'Certainly,' Eline pointed out, 'the Clarks aren't ready to start making their new series, not yet.

reference_spacy_tokens: ' Certainly , ' Eline pointed out , ' the Clarks are n't ready to start making their new series , not yet .


fn_spacy_tokens_for_baseline: Calton , who also used the alias Hans Schultz , had nearly escaped .

source_bert_toks: cal ##ton , who also used the alias hans schultz , had nearly escaped .

reference_raw: Calton, also using the name Hans Schultz, almost ran away.

reference_spacy_tokens: Calton , also using the name Hans Schultz , almost ran away .


fn_spacy_tokens_for_baseline: ' I was sure Henderson , as he calls himself , felt that he was suspected , and that he would lie low and make no move so long as he thought he was in any danger .

source_bert_toks: ' i was sure henderson , as he calls himself , felt that he was suspected , and that he would lie low and make no move so long as he thought he was in any danger .

reference_raw: 'I was sure that Henderson, as he called himself, felt suspicious, and that he would lie low and do nothing while he thought he was in danger.

reference_spacy_tokens: ' I was sure that Henderson , as he called himself , felt suspicious , and that he would lie low and do nothing while he thought he was in danger .


fn_spacy_tokens_for_baseline: Some days , when it 's damp , he has to use the stick inside , too , and I can hear him clacking about the uncarpeted rooms and corridors of the house ; a hollow noise , going from place to place .

source_bert_toks: some days , when it ' s damp , he has to use the stick inside , too , and i can hear him cl ##ack ##ing about the un ##car ##pet ##ed rooms and corridors of the house ; a hollow noise , going from place to place .

reference_raw: Sometimes, when it's wet, he'll have to use a stick inside, and I can hear it clattering around the uncarped rooms and corridors of the house; a hollow sound that goes from place to place.

reference_spacy_tokens: Sometimes , when it 's wet , he 'll have to use a stick inside , and I can hear it clattering around the uncarped rooms and corridors of the house ; a hollow sound that goes from place to place .


fn_spacy_tokens_for_baseline: He is not held in the same high esteem here as he is in other islands .

source_bert_toks: he is not held in the same high esteem here as he is in other islands .

reference_raw: He doesn't have the same respect here as he does on other islands.

reference_spacy_tokens: He does n't have the same respect here as he does on other islands .


fn_spacy_tokens_for_baseline: We need your support to continue getting people off of public assistance .

source_bert_toks: we need your support to continue getting people off of public assistance .

reference_raw: We need your support to keep people out of public help.

reference_spacy_tokens: We need your support to keep people out of public help .


fn_spacy_tokens_for_baseline: So in addition to our efforts to conserve wildlife preserves , we 'll escalate our trailblazing program to find alternatives for traditional tiger - based medicines ... rescue more rhinos in Kenya and Nepal through our ambitious translocation projects ... complete the first survey of China 's pandas in over a decade ... and fight to halt all commercial whaling , as well as the whale meat trade .

source_bert_toks: so in addition to our efforts to conserve wildlife preserves , we ' ll es ##cala ##te our trail ##bla ##zing program to find alternatives for traditional tiger - based medicines . . . rescue more rhino ##s in kenya and nepal through our ambitious trans ##lo ##cation projects . . . complete the first survey of china ' s panda ##s in over a decade . . . and fight to halt all commercial whaling , as well as the whale meat trade .

reference_raw: So, in addition to our efforts to preserve the wildlife, we're going to escalate our tracking program to seek alternatives to traditional tiger medicines, save more rhinos in Kenya and Nepal through our ambitious translocation projects, complete the first survey of Chinese pandas in more than ten years, and fight to stop all commercial whaling and the whaling trade.

reference_spacy_tokens: So , in addition to our efforts to preserve the wildlife , we 're going to escalate our tracking program to seek alternatives to traditional tiger medicines , save more rhinos in Kenya and Nepal through our ambitious translocation projects , complete the first survey of Chinese pandas in more than ten years , and fight to stop all commercial whaling and the whaling trade .


fn_spacy_tokens_for_baseline: The rhythm had been wrong for poetry circa the sixteenth century being committed to memory for homework , but that had been its flavour .

source_bert_toks: the rhythm had been wrong for poetry circa the sixteenth century being committed to memory for homework , but that had been its flavour .

reference_raw: The rhythm was bad for the 16th-century poetry circa, but it was his taste.

reference_spacy_tokens: The rhythm was bad for the 16th - century poetry circa , but it was his taste .


fn_spacy_tokens_for_baseline: Her hair needed washing and her legwarmers were in concertinas round her ankles .

source_bert_toks: her hair needed washing and her leg ##war ##mers were in concert ##inas round her ankles .

reference_raw: She had to wash her hair, and her legs were in concertinas around her ankles.

reference_spacy_tokens: She had to wash her hair , and her legs were in concertinas around her ankles .


fn_spacy_tokens_for_baseline: Democrats , unwilling to take another beating , folded , voting unanimously for the bill in full committee .

source_bert_toks: democrats , unwilling to take another beating , folded , voting unanimously for the bill in full committee .

reference_raw: Democrats who didn't want to be beaten again, rolled up and voted unanimously on the bill in full committee.

reference_spacy_tokens: Democrats who did n't want to be beaten again , rolled up and voted unanimously on the bill in full committee .


fn_spacy_tokens_for_baseline: At one end of it a coloured poster , too large for indoor display , had been tacked to the wall .

source_bert_toks: at one end of it a coloured poster , too large for indoor display , had been tack ##ed to the wall .

reference_raw: At one end of it was a colored billboard, too large for internal display, attached to the wall.

reference_spacy_tokens: At one end of it was a colored billboard , too large for internal display , attached to the wall .


fn_spacy_tokens_for_baseline: One firefighter is being treated for bite injuries to his face that he received while attempting to rescue a dog .

source_bert_toks: one fire ##fighter is being treated for bite injuries to his face that he received while attempting to rescue a dog .

reference_raw: One of the firemen is under treatment for bite wounds to the face he received while he was trying to save the dog.

reference_spacy_tokens: One of the firemen is under treatment for bite wounds to the face he received while he was trying to save the dog .


fn_spacy_tokens_for_baseline: Approximately 15 cabins are reported to have burned to the ground , but as of yet , no permanent dwellings or farms have been damaged .

source_bert_toks: approximately 15 cabins are reported to have burned to the ground , but as of yet , no permanent dwellings or farms have been damaged .

reference_raw: Some 15 cabins are reported to have been burned to the ground, but so far no permanent dwellings or holdings have been damaged.

reference_spacy_tokens: Some 15 cabins are reported to have been burned to the ground , but so far no permanent dwellings or holdings have been damaged .


fn_spacy_tokens_for_baseline: Requirements of joining AL QAEDA : 1 - Abiding by AL QAEDA rules , its beliefs and objectives as previously mentioned 2 - Obedience to the leaders in charge as much as possible , without disobeying Islamic rules 3 - No connection between AL QAEDA membership and any other Islamic group 4 - Maintain secrecy in work - related issues 5- Physically healthy ( except in administrative work ) 6- The candidate should not be in question when it comes to religion , integrity or his morality 7- Reciting the pledge of AL - QAEDA .

source_bert_toks: requirements of joining al qaeda : 1 - ab ##idi ##ng by al qaeda rules , its beliefs and objectives as previously mentioned 2 - obedience to the leaders in charge as much as possible , without di ##so ##bey ##ing islamic rules 3 - no connection between al qaeda membership and any other islamic group 4 - maintain secrecy in work - related issues 5 - physically healthy ( except in administrative work ) 6 - the candidate should not be in question when it comes to religion , integrity or his morality 7 - rec ##iting the pledge of al - qaeda .

reference_raw: Requests for membership of AL QAEDA: 1 - Abiding by the rules of the AL QAEDA, its beliefs and objectives as set out above 2 - Obedience to the leaders responsible, as far as possible, without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work-related matters 5- Physically sound (excluding administrative work) 6- in terms of religion, integrity or morality 7-Reciting AL-QAEDA's promise.

reference_spacy_tokens: Requests for membership of AL QAEDA : 1 - Abiding by the rules of the AL QAEDA , its beliefs and objectives as set out above 2 - Obedience to the leaders responsible , as far as possible , without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work - related matters 5- Physically sound ( excluding administrative work ) 6- in terms of religion , integrity or morality 7-Reciting AL - QAEDA 's promise .


fn_spacy_tokens_for_baseline: The transfer - part of the Global Threat Reduction Initiative ( GTRI ) , a nonproliferation effort that secures high - risk nuclear and radiological materials and equipment around the world - resulted from a cooperative effort by the United States , Uzbekistan , Kazakhstan and Russia , as well as coordination through the International Atomic Energy Agency ( IAEA ) . " ( News Blaze , 21Apr06 ) ( Link )

source_bert_toks: the transfer - part of the global threat reduction initiative ( gt ##ri ) , a non ##pro ##life ##ration effort that secure ##s high - risk nuclear and radio ##logical materials and equipment around the world - resulted from a cooperative effort by the united states , uzbekistan , kazakhstan and russia , as well as coordination through the international atomic energy agency ( ia ##ea ) . " ( news blaze , 21 ##ap ##r ##0 ##6 ) ( link )

reference_raw: The transfer - part of the Global Threat Reduction Initiative (GTRI), a non-proliferation effort to ensure high-risk nuclear and radiological materials and equipment worldwide - was the result of cooperation between the United States, Uzbekistan, Kazakhstan and Russia, as well as coordination through the International Atomic Energy Agency (IAEA) (News Blaze, 21 April 2006) (Link)

reference_spacy_tokens: The transfer - part of the Global Threat Reduction Initiative ( GTRI ) , a non - proliferation effort to ensure high - risk nuclear and radiological materials and equipment worldwide - was the result of cooperation between the United States , Uzbekistan , Kazakhstan and Russia , as well as coordination through the International Atomic Energy Agency ( IAEA ) ( News Blaze , 21 April 2006 ) ( Link )


fn_spacy_tokens_for_baseline: It was a bright cold day in April , and the clocks were striking thirteen .

source_bert_toks: it was a bright cold day in april , and the clocks were striking thirteen .

reference_raw: It was a clear, chilly day in April, and the clock had struck thirteen.

reference_spacy_tokens: It was a clear , chilly day in April , and the clock had struck thirteen .


fn_spacy_tokens_for_baseline: At the end , the Roman general Titus laid siege to Jerusalem in a.d . 70 , finally attacking its starved and weakened defenders .

source_bert_toks: at the end , the roman general titus laid siege to jerusalem in a . d . 70 , finally attacking its starved and weakened defenders .

reference_raw: At the end of the day, General Titus of Rome began a siege to Jerusalem at the age of 70, and finally attacked his hungry and weakened protectors.

reference_spacy_tokens: At the end of the day , General Titus of Rome began a siege to Jerusalem at the age of 70 , and finally attacked his hungry and weakened protectors .


fn_spacy_tokens_for_baseline: Separating main ideas from subsidiary points ( and both of these from supporting or qualifying information ) is not always easy and requires practice , good levels of concentration and a clear definition of your reading purposes .

source_bert_toks: separating main ideas from subsidiary points ( and both of these from supporting or qualifying information ) is not always easy and requires practice , good levels of concentration and a clear definition of your reading purposes .

reference_raw: The separation of key ideas from subsidiaries (and both from supporting or qualifying information) is not always easy and requires practice, a good concentration level and a clear definition of the purpose of the reading.

reference_spacy_tokens: The separation of key ideas from subsidiaries ( and both from supporting or qualifying information ) is not always easy and requires practice , a good concentration level and a clear definition of the purpose of the reading .


fn_spacy_tokens_for_baseline: Forest fires continue to rage in Spain

source_bert_toks: forest fires continue to rage in spain

reference_raw: Forest fires continue in Spain

reference_spacy_tokens: Forest fires continue in Spain


fn_spacy_tokens_for_baseline: If he loses , your shares are worthless .

source_bert_toks: if he loses , your shares are worthless .

reference_raw: If he fails, your stock will be worthless.

reference_spacy_tokens: If he fails , your stock will be worthless .


fn_spacy_tokens_for_baseline: The chief facility for researching and producing CW agents was a military front company called Delta G Scientific , located between Johannesburg and Pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weaponize " irritants ( Riot Control Agents such as CS and CR ) and incapacitants by placing them in artillery shells , mortar bombs , and grenades .

source_bert_toks: the chief facility for researching and producing cw agents was a military front company called delta g scientific , located between johannesburg and pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weapon ##ize " ir ##ritan ##ts ( riot control agents such as cs and cr ) and inca ##pac ##itan ##ts by placing them in artillery shells , mortar bombs , and grenades .

reference_raw: The main facility for research and production of CW agents was a military front company called Delta G Science, located between Johannesburg and Pretoria, and several other facilities were set up for the development of protective clothing, the production of exotic assassination devices, and "weaponizing" irritants (Riot Control Agents such as CS and CR) and incapacitators by placing them in artillery cartridges, mortar bombs, and grenades.

reference_spacy_tokens: The main facility for research and production of CW agents was a military front company called Delta G Science , located between Johannesburg and Pretoria , and several other facilities were set up for the development of protective clothing , the production of exotic assassination devices , and " weaponizing " irritants ( Riot Control Agents such as CS and CR ) and incapacitators by placing them in artillery cartridges , mortar bombs , and grenades .


fn_spacy_tokens_for_baseline: This report , of questionable reliability , was vigorously denied by the Ministry of National Defense ( MND ) .

source_bert_toks: this report , of questionable reliability , was vigorously denied by the ministry of national defense ( mn ##d ) .

reference_raw: The Ministry of National Defence (MND) strongly denied this report of dubious reliability.

reference_spacy_tokens: The Ministry of National Defence ( MND ) strongly denied this report of dubious reliability .


fn_spacy_tokens_for_baseline: The new culture spread throughout the Mediterranean , helped by a huge increase in migration from the mainland to new settlements such as Carthage , a Greek city on the African coast of the Mediterranean .

source_bert_toks: the new culture spread throughout the mediterranean , helped by a huge increase in migration from the mainland to new settlements such as carthage , a greek city on the african coast of the mediterranean .

reference_raw: The new culture spread across the Mediterranean, helped by a massive increase in migration from the continent to new settlements like Carthage, a Greek city on the African coast of the Mediterranean.

reference_spacy_tokens: The new culture spread across the Mediterranean , helped by a massive increase in migration from the continent to new settlements like Carthage , a Greek city on the African coast of the Mediterranean .


fn_spacy_tokens_for_baseline: This legacy has allowed Russia to retain its great power status even as its economy has collapsed , but the burden of supporting this oversized complex has strained the Russian political and economic system .

source_bert_toks: this legacy has allowed russia to retain its great power status even as its economy has collapsed , but the burden of supporting this oversized complex has strained the russian political and economic system .

reference_raw: This legacy has enabled Russia to maintain a high power position even after the collapse of its economy, but the burden of supporting this oversized compound has strained Russia's political and economic system.

reference_spacy_tokens: This legacy has enabled Russia to maintain a high power position even after the collapse of its economy , but the burden of supporting this oversized compound has strained Russia 's political and economic system .


fn_spacy_tokens_for_baseline: It was sleeting so hard we could barely see for 30 yards .

source_bert_toks: it was sl ##eet ##ing so hard we could barely see for 30 yards .

reference_raw: It was sleeping so hard that we could barely see for thirty yards.

reference_spacy_tokens: It was sleeping so hard that we could barely see for thirty yards .


fn_spacy_tokens_for_baseline: Gidromash , an Almaty -based Soviet - era producer of submarine - launched missiles , was converted to a civilian commercial enterprise under CTR 's Industrial Partnerships Program .

source_bert_toks: gi ##dro ##mas ##h , an alma ##ty - based soviet - era producer of submarine - launched missiles , was converted to a civilian commercial enterprise under ct ##r ' s industrial partnerships program .

reference_raw: Gidromash, an Almaty-based Soviet-era manufacturer of submarine-launched missiles, was converted into a civilian business under the CTR's industrial partnership program.

reference_spacy_tokens: Gidromash , an Almaty - based Soviet - era manufacturer of submarine - launched missiles , was converted into a civilian business under the CTR 's industrial partnership program .


fn_spacy_tokens_for_baseline: Lifeless , decrepit , falling alert , putrefying .

source_bert_toks: lifeless , dec ##re ##pit , falling alert , put ##re ##fying .

reference_raw: Lifeless, miserable, falling alert, putting up.

reference_spacy_tokens: Lifeless , miserable , falling alert , putting up .


fn_spacy_tokens_for_baseline: He found the meter and turned on the mains , and then switched the lights on after closing the drapes -- it would look a lot less suspicious than the occasional flicker of torchlight across the glass .

source_bert_toks: he found the meter and turned on the main ##s , and then switched the lights on after closing the dr ##apes - - it would look a lot less suspicious than the occasional flicker of torch ##light across the glass .

reference_raw: He found the meter and switched on the mains, then turned on the lights when the curtains were closed - it would look less suspicious than the occasional flash of torchlight on the glass.

reference_spacy_tokens: He found the meter and switched on the mains , then turned on the lights when the curtains were closed - it would look less suspicious than the occasional flash of torchlight on the glass .


fn_spacy_tokens_for_baseline: There is neither mystery nor paradox in the fact that as educational expenditures ( in real terms ) have increased sharply in the past quarter - of - a - century -- we now spend more per pupil than any other country in the world -- educational performance has declined .

source_bert_toks: there is neither mystery nor paradox in the fact that as educational expenditures ( in real terms ) have increased sharply in the past quarter - of - a - century - - we now spend more per pupil than any other country in the world - - educational performance has declined .

reference_raw: There is no mystery or paradox that as education spending (in real terms) has increased sharply over the last quarter of the century - we now spend more on pupils than any other country - education performance has declined.

reference_spacy_tokens: There is no mystery or paradox that as education spending ( in real terms ) has increased sharply over the last quarter of the century - we now spend more on pupils than any other country - education performance has declined .


fn_spacy_tokens_for_baseline: fiscal year 2001 are structured around common performance elements- service delivery , organizational support / teamwork , leadership development , external relations , and workplace responsibilities .

source_bert_toks: fiscal year 2001 are structured around common performance elements - service delivery , organizational support / team ##work , leadership development , external relations , and workplace responsibilities .

reference_raw: The financial year 2001 is structured around joint performance elements: the provision of services, organisational support/teamwork, management development, external relations and the responsibilities of the workplace.

reference_spacy_tokens: The financial year 2001 is structured around joint performance elements : the provision of services , organisational support / teamwork , management development , external relations and the responsibilities of the workplace .


fn_spacy_tokens_for_baseline: Moist exhalations from the sea explain other meteorological phenomena : clouds are a direct result , and wind and rain issue from clouds .

source_bert_toks: moist ex ##hala ##tions from the sea explain other meteorological phenomena : clouds are a direct result , and wind and rain issue from clouds .

reference_raw: Moist breaths from the sea explain other meteorological phenomena: clouds are the direct result, and clouds are the cause of wind and rain.

reference_spacy_tokens: Moist breaths from the sea explain other meteorological phenomena : clouds are the direct result , and clouds are the cause of wind and rain .


fn_spacy_tokens_for_baseline: Feel the texture of a hand offered in greeting and try to fathom the " Jamaican handshake , " a ritual whose rules seem to be more complex than those of the game of cricket .

source_bert_toks: feel the texture of a hand offered in greeting and try to fat ##hom the " jamaican hands ##hak ##e , " a ritual whose rules seem to be more complex than those of the game of cricket .

reference_raw: Feel the texture of the hand offered in greeting, and try to understand the "Jamaican Handshake," a rite whose rules seem more complicated than the rules of the cricket game.

reference_spacy_tokens: Feel the texture of the hand offered in greeting , and try to understand the " Jamaican Handshake , " a rite whose rules seem more complicated than the rules of the cricket game .


fn_spacy_tokens_for_baseline: The Benefication and Hydrometallurgical Research Center ( BHRC ) operates facilities involved in the production of yellowcake .

source_bert_toks: the ben ##ef ##ication and hydro ##met ##all ##urg ##ical research center ( b ##hr ##c ) operates facilities involved in the production of yellow ##cake .

reference_raw: The Benefication and Hydrometallurgical Research Centre (BHRC) operates facilities for the production of yellow cake.

reference_spacy_tokens: The Benefication and Hydrometallurgical Research Centre ( BHRC ) operates facilities for the production of yellow cake .


fn_spacy_tokens_for_baseline: In 1989 US authorities found Alcolac International Inc. , a pharmaceutical firm based out of Baltimore , Maryland , guilty of illegally shipping almost 120 tons of thiodyglycol ( a mustard gas precursor ) to Iran .

source_bert_toks: in 1989 us authorities found al ##cola ##c international inc . , a pharmaceutical firm based out of baltimore , maryland , guilty of illegally shipping almost 120 tons of th ##io ##dy ##gly ##col ( a mustard gas precursor ) to iran .

reference_raw: In 1989, the U.S. authorities found Alcolac International Inc., a pharmaceutical company located in Baltimore, Maryland, responsible for the illegal transport of nearly 120 tonnes of thiodyglycol (a mustard gas precursor) to Iran.

reference_spacy_tokens: In 1989 , the U.S. authorities found Alcolac International Inc. , a pharmaceutical company located in Baltimore , Maryland , responsible for the illegal transport of nearly 120 tonnes of thiodyglycol ( a mustard gas precursor ) to Iran .


fn_spacy_tokens_for_baseline: West Jerusalem , separated from the rest of the new Jewish nation , held out under siege for several months until Israeli forces secured a land corridor connecting the city to the coastal areas .

source_bert_toks: west jerusalem , separated from the rest of the new jewish nation , held out under siege for several months until israeli forces secured a land corridor connecting the city to the coastal areas .

reference_raw: West Jerusalem, separated from the rest of the new Jewish nation, had been besieged for several months, until Israeli forces had secured a land corridor linking the city to coastal areas.

reference_spacy_tokens: West Jerusalem , separated from the rest of the new Jewish nation , had been besieged for several months , until Israeli forces had secured a land corridor linking the city to coastal areas .


fn_spacy_tokens_for_baseline: ' The firefight started when enemy forces engaged the patrol .

source_bert_toks: ' the fire ##fight started when enemy forces engaged the patrol .

reference_raw: 'Firefight started when the enemy forces invaded the patrol.

reference_spacy_tokens: ' Firefight started when the enemy forces invaded the patrol .


fn_spacy_tokens_for_baseline: It shows the city from Bonsecours churchyard : the bridges , the spires , the river bending away past Croisset .

source_bert_toks: it shows the city from bon ##se ##co ##urs churchyard : the bridges , the spire ##s , the river bending away past cr ##ois ##set .

reference_raw: It shows the town of Bonsecours, the bridges, the towers, the river that curves around Croisset.

reference_spacy_tokens: It shows the town of Bonsecours , the bridges , the towers , the river that curves around Croisset .


fn_spacy_tokens_for_baseline: The SCS brochure I am enclosing will give you the historic significance of SCS , as well as listing activities and specific benefits awarded to donors at the Georgia O'Keeffe level .

source_bert_toks: the sc ##s bro ##chu ##re i am en ##cl ##osing will give you the historic significance of sc ##s , as well as listing activities and specific benefits awarded to donors at the georgia o ' ke ##ef ##fe level .

reference_raw: The SCS booklet I append will give you the historical significance of the SCS, as well as a list of activities and specific benefits granted to donors at the Georgia O'Keeffe level.

reference_spacy_tokens: The SCS booklet I append will give you the historical significance of the SCS , as well as a list of activities and specific benefits granted to donors at the Georgia O'Keeffe level .


fn_spacy_tokens_for_baseline: He and Dorothy would lie in wait the following day and cudgel her to death .

source_bert_toks: he and dorothy would lie in wait the following day and cu ##dge ##l her to death .

reference_raw: The next day, he and Dorothy would lie there and cuddle her to death.

reference_spacy_tokens: The next day , he and Dorothy would lie there and cuddle her to death .


fn_spacy_tokens_for_baseline: Of the nations with whom Iran had relations , only two were likely to run the risk reselling their Scud - Bs : Libya and Syria .

source_bert_toks: of the nations with whom iran had relations , only two were likely to run the risk res ##elling their sc ##ud - bs : libya and syria .

reference_raw: Of the countries with which Iran was in a relationship, only two of them were likely to be in danger of reselling their Scud-Bs: Libya and Syria.

reference_spacy_tokens: Of the countries with which Iran was in a relationship , only two of them were likely to be in danger of reselling their Scud - Bs : Libya and Syria .


fn_spacy_tokens_for_baseline: Our morning walk along the cliffs gave us terrific views of the secluded white sand bays dotted along the coastline followed by a few hours on Pompierre beach where the locals meet to picnic .

source_bert_toks: our morning walk along the cliffs gave us terrific views of the secluded white sand bays dotted along the coastline followed by a few hours on po ##mp ##ier ##re beach where the locals meet to picnic .

reference_raw: Our morning walk along the cliffs gave us an amazing view of the isolated white sand bays dotted along the coastline, followed by several hours on Pompierre Beach, where the locals met for picnics.

reference_spacy_tokens: Our morning walk along the cliffs gave us an amazing view of the isolated white sand bays dotted along the coastline , followed by several hours on Pompierre Beach , where the locals met for picnics .


fn_spacy_tokens_for_baseline: Earlier this year , some 70 U.S. congressmen sent a letter to U. S. President Bill Clinton , calling for an end to the humanitarian crisis in Iraq by having the sanctions lifted .

source_bert_toks: earlier this year , some 70 u . s . congress ##men sent a letter to u . s . president bill clinton , calling for an end to the humanitarian crisis in iraq by having the sanctions lifted .

reference_raw: Earlier this year, about 70 U.S. Congressmen wrote a letter to US President Bill Clinton calling for the end of the humanitarian crisis in Iraq by lifting sanctions.

reference_spacy_tokens: Earlier this year , about 70 U.S. Congressmen wrote a letter to US President Bill Clinton calling for the end of the humanitarian crisis in Iraq by lifting sanctions .


fn_spacy_tokens_for_baseline: I heard parts of the building above my head cracking .

source_bert_toks: i heard parts of the building above my head cracking .

reference_raw: Overhead, I could hear the crackling of parts of the building.

reference_spacy_tokens: Overhead , I could hear the crackling of parts of the building .


fn_spacy_tokens_for_baseline: As the next moonless period was in early March , there was some time for reorganization , and with the Eighth Army dug in defensively along the Gazala line there was no major offensive in the offing .

source_bert_toks: as the next moon ##less period was in early march , there was some time for reorganization , and with the eighth army dug in defensive ##ly along the gaza ##la line there was no major offensive in the off ##ing .

reference_raw: Since the next month was early in March, there was time to reorganize, and with the Eighth Army digging defensively along the Gazala line, there was no serious attack.

reference_spacy_tokens: Since the next month was early in March , there was time to reorganize , and with the Eighth Army digging defensively along the Gazala line , there was no serious attack .


fn_spacy_tokens_for_baseline: He gossips about the weather and American football , recalls that he played at school and in the Army , and was a big follower of the game .

source_bert_toks: he gossip ##s about the weather and american football , recalls that he played at school and in the army , and was a big follower of the game .

reference_raw: He talks about the weather and American football, he remembers playing in school and in the army, and he's a big fan of the game.

reference_spacy_tokens: He talks about the weather and American football , he remembers playing in school and in the army , and he 's a big fan of the game .


fn_spacy_tokens_for_baseline: In 1951 Desfourneaux was succeeded by Andry Obrecht who dispatched over thirty criminals during his term of office .

source_bert_toks: in 1951 des ##fo ##urne ##aux was succeeded by and ##ry ob ##recht who dispatched over thirty criminals during his term of office .

reference_raw: In 1951, Desfourneaux was succeeded by Andry Obrecht, who sent more than thirty criminals during his term of office.

reference_spacy_tokens: In 1951 , Desfourneaux was succeeded by Andry Obrecht , who sent more than thirty criminals during his term of office .


fn_spacy_tokens_for_baseline: ' She should have worn her flip - flops , ' he said , and was startled by the sudden explosion of mirth , but then his mother was always a bit prone to that sort of thing .

source_bert_toks: ' she should have worn her flip - flop ##s , ' he said , and was startled by the sudden explosion of mir ##th , but then his mother was always a bit prone to that sort of thing .

reference_raw: "She should have worn her flops," he said, startled by the sudden outburst of mirth, but then his mother was always a little prone to this sort of thing.

reference_spacy_tokens: " She should have worn her flops , " he said , startled by the sudden outburst of mirth , but then his mother was always a little prone to this sort of thing .


fn_spacy_tokens_for_baseline: Many thinkers have been troubled by the problems implicit in the occurrence of pain and suffering .

source_bert_toks: many thinkers have been troubled by the problems implicit in the occurrence of pain and suffering .

reference_raw: Many thinkers are concerned about the problems inherent in pain and suffering.

reference_spacy_tokens: Many thinkers are concerned about the problems inherent in pain and suffering .


fn_spacy_tokens_for_baseline: Company 's such as Campeau , which plunged too deeply into debt when it bought Bloomingdale 's , will no longer be able to count on the US taxpayer to bail them out .

source_bert_toks: company ' s such as camp ##eau , which plunged too deeply into debt when it bought bloom ##ing ##dale ' s , will no longer be able to count on the us taxpayer to bail them out .

reference_raw: A company like Campeau, which was too deeply in debt when it bought Bloomingdale's, could no longer rely on US taxpayers to bail it out.

reference_spacy_tokens: A company like Campeau , which was too deeply in debt when it bought Bloomingdale 's , could no longer rely on US taxpayers to bail it out .


fn_spacy_tokens_for_baseline: Flora laid The Sketch on her knee , ignoring a hungry look from a woman waiting with a fidgety child .

source_bert_toks: flora laid the sketch on her knee , ignoring a hungry look from a woman waiting with a fi ##dget ##y child .

reference_raw: Flora put the Sketch on her knee, ignoring the hungry look of a woman waiting with a fidget child.

reference_spacy_tokens: Flora put the Sketch on her knee , ignoring the hungry look of a woman waiting with a fidget child .


fn_spacy_tokens_for_baseline: Rahmi was plainly in awe of Boris , and fidgeted anxiously , fastening and unfastening the top button of his pink polo shirt while the Russian called room service .

source_bert_toks: ra ##hmi was plainly in awe of boris , and fi ##dget ##ed anxiously , fast ##ening and un ##fast ##ening the top button of his pink polo shirt while the russian called room service .

reference_raw: Rahmi was clearly apprehensive of Boris, fidgeting nervously, fastening and unbuttoning the upper button of his pink polo shirt, while the Russian called for room service.

reference_spacy_tokens: Rahmi was clearly apprehensive of Boris , fidgeting nervously , fastening and unbuttoning the upper button of his pink polo shirt , while the Russian called for room service .


fn_spacy_tokens_for_baseline: And I loathed all sport to the point of finding its ethics repellent .

source_bert_toks: and i lo ##ath ##ed all sport to the point of finding its ethics rep ##elle ##nt .

reference_raw: And I hated all sport so much that I found its moral repulsion repulsive.

reference_spacy_tokens: And I hated all sport so much that I found its moral repulsion repulsive .


fn_spacy_tokens_for_baseline: " They did the secretarial work , typed up the lists of names , nationalities and identification numbers furnished by the French police and the Germans . "

source_bert_toks: " they did the secret ##aria ##l work , typed up the lists of names , nationalities and identification numbers furnished by the french police and the germans . "

reference_raw: "They've done a secretarial job, and they've written a list of names, nationalities, and I.D. numbers provided by the French police and the Germans."

reference_spacy_tokens: " They 've done a secretarial job , and they 've written a list of names , nationalities , and I.D. numbers provided by the French police and the Germans . "


fn_spacy_tokens_for_baseline: The Labour Party is in favour of loosening the tax and legal inhibitions that stop people renting spare rooms .

source_bert_toks: the labour party is in favour of loosen ##ing the tax and legal inhibition ##s that stop people rent ##ing spare rooms .

reference_raw: The Labour Party supports the relaxation of tax and legal barriers to people's rental of spare rooms.

reference_spacy_tokens: The Labour Party supports the relaxation of tax and legal barriers to people 's rental of spare rooms .


fn_spacy_tokens_for_baseline: The Soviets , of course , described the same groups in exactly opposite terms .

source_bert_toks: the soviets , of course , described the same groups in exactly opposite terms .

reference_raw: The Soviets, of course, had the exact opposite description of the same groups.

reference_spacy_tokens: The Soviets , of course , had the exact opposite description of the same groups .


fn_spacy_tokens_for_baseline: The session ended with an extraordinary meeting demanded by the Conservative junior ministers in order that they might express their discontent to the Cabinet members of their own party .

source_bert_toks: the session ended with an extraordinary meeting demanded by the conservative junior ministers in order that they might express their discontent to the cabinet members of their own party .

reference_raw: The meeting ended with a special meeting requested by the conservative junior ministers to convey their displeasure to the cabinet members of their own party.

reference_spacy_tokens: The meeting ended with a special meeting requested by the conservative junior ministers to convey their displeasure to the cabinet members of their own party .


fn_spacy_tokens_for_baseline: The man pulled off his jeans and stood up .

source_bert_toks: the man pulled off his jeans and stood up .

reference_raw: The man removed his trousers and got to his feet.

reference_spacy_tokens: The man removed his trousers and got to his feet .


fn_spacy_tokens_for_baseline: If I mention our separate sleeping arrangements to friends , they are horrified .

source_bert_toks: if i mention our separate sleeping arrangements to friends , they are horrified .

reference_raw: When I tell my friends about our separate sleeping arrangements, they're terrified.

reference_spacy_tokens: When I tell my friends about our separate sleeping arrangements , they 're terrified .


fn_spacy_tokens_for_baseline: He then placed the ledger on top , and locked the articles into the sturdy cupboard beside the chimney breast .

source_bert_toks: he then placed the ledger on top , and locked the articles into the sturdy cupboard beside the chimney breast .

reference_raw: Then he placed the ledger on top of it and put the articles in a sturdy closet next to the chimney breast.

reference_spacy_tokens: Then he placed the ledger on top of it and put the articles in a sturdy closet next to the chimney breast .


fn_spacy_tokens_for_baseline: She did as she was told , and with surgical precision he slashed four inches off the legs of the jeans .

source_bert_toks: she did as she was told , and with surgical precision he slashed four inches off the legs of the jeans .

reference_raw: She did as she was told, and with surgical precision he cut four inches off her jeans.

reference_spacy_tokens: She did as she was told , and with surgical precision he cut four inches off her jeans .


fn_spacy_tokens_for_baseline: Since the new rule was rubber stamped last Monday , the blows raining down upon racing 's legislators in Portland Square , London , have come from fairly predictable sources .

source_bert_toks: since the new rule was rubber stamped last monday , the blows raining down upon racing ' s legislators in portland square , london , have come from fairly predictable sources .

reference_raw: Since the new rule had been stamped with rubber last Monday, the blows that had hit the race legislators in Portland Square, London had come from relatively predictable sources.

reference_spacy_tokens: Since the new rule had been stamped with rubber last Monday , the blows that had hit the race legislators in Portland Square , London had come from relatively predictable sources .


fn_spacy_tokens_for_baseline: The 210 children have taken up the panto 's challenge and sought the advice of professional builders so they can construct Wendy 's house in brick in their school yard .

source_bert_toks: the 210 children have taken up the pan ##to ' s challenge and sought the advice of professional builders so they can construct wendy ' s house in brick in their school yard .

reference_raw: 210 kids took the panto challenge and asked for advice from professional builders to build Wendy's home in bricks in their schoolyard.

reference_spacy_tokens: 210 kids took the panto challenge and asked for advice from professional builders to build Wendy 's home in bricks in their schoolyard .


fn_spacy_tokens_for_baseline: All this might run the risk of leaving the old hall under - used a hall lined with wood , acoustically marvellous but in danger of neglect .

source_bert_toks: all this might run the risk of leaving the old hall under - used a hall lined with wood , acoustic ##ally marvel ##lous but in danger of neglect .

reference_raw: All of this could run the risk of leaving the old hall unused in a wood-lined hall, acoustically wondrous but in danger of neglect.

reference_spacy_tokens: All of this could run the risk of leaving the old hall unused in a wood - lined hall , acoustically wondrous but in danger of neglect .


fn_spacy_tokens_for_baseline: The opponents see this near certainty of success as proof that the whole thing is rigged , but they would say that would n't they ?

source_bert_toks: the opponents see this near certainty of success as proof that the whole thing is rigged , but they would say that wouldn ' t they ?

reference_raw: Adversaries see this close assurance of success as proof that the whole thing is rigged, but they'd say it wasn't?

reference_spacy_tokens: Adversaries see this close assurance of success as proof that the whole thing is rigged , but they 'd say it was n't ?


fn_spacy_tokens_for_baseline: Who was the official winner of the 1976 British Grand Prix after James Hunt was disqualified ?

source_bert_toks: who was the official winner of the 1976 british grand prix after james hunt was disqualified ?

reference_raw: Who won the British Grand Prix in 1976 after James Hunt was disqualified?

reference_spacy_tokens: Who won the British Grand Prix in 1976 after James Hunt was disqualified ?


fn_spacy_tokens_for_baseline: Although a parliamentary report presented in April 1988 found no evidence of corrupt dealings [ see p. 36030 ] , the affair had already seriously damaged the standing of the Gandhi government .

source_bert_toks: although a parliamentary report presented in april 1988 found no evidence of corrupt dealings [ see p . 360 ##30 ] , the affair had already seriously damaged the standing of the gandhi government .

reference_raw: Although the parliamentary report presented in April 1988 found no evidence of corruption [see p. 36030], the situation has already seriously damaged the position of the Gandhi government.

reference_spacy_tokens: Although the parliamentary report presented in April 1988 found no evidence of corruption [ see p. 36030 ] , the situation has already seriously damaged the position of the Gandhi government .


fn_spacy_tokens_for_baseline: As long as the sun shines and the waters flow , this land will be here to give life to men and animals .

source_bert_toks: as long as the sun shine ##s and the waters flow , this land will be here to give life to men and animals .

reference_raw: While the sun shines and the water flows, this land will be here to give life to humans and animals.

reference_spacy_tokens: While the sun shines and the water flows , this land will be here to give life to humans and animals .


fn_spacy_tokens_for_baseline: Part of the fortress has been converted and is now used as a luxury inn .

source_bert_toks: part of the fortress has been converted and is now used as a luxury inn .

reference_raw: Part of the fort has been converted and is now used as a luxury inn.

reference_spacy_tokens: Part of the fort has been converted and is now used as a luxury inn .


fn_spacy_tokens_for_baseline: A second feature which characterises German Romanesque churches is the dramatic skyline pattern created by the multiplicity of towers , cupolas and turrets .

source_bert_toks: a second feature which character ##ises german romanesque churches is the dramatic skyline pattern created by the multi ##plicity of towers , cup ##ola ##s and turrets .

reference_raw: The second characteristic of the German Romanesque churches is the dramatic skyline model created by the multiplication of towers, domes, and towers.

reference_spacy_tokens: The second characteristic of the German Romanesque churches is the dramatic skyline model created by the multiplication of towers , domes , and towers .


fn_spacy_tokens_for_baseline: The trip begins in the Tarangire National Park , where baobab trees dot the horizon and tree - climbing lions doze in the shade .

source_bert_toks: the trip begins in the tara ##ng ##ire national park , where bao ##ba ##b trees dot the horizon and tree - climbing lions do ##ze in the shade .

reference_raw: The journey begins in the National Park of Tarangire, where the baobab trees dot the horizon, and the climbing lions sleep in the shadows.

reference_spacy_tokens: The journey begins in the National Park of Tarangire , where the baobab trees dot the horizon , and the climbing lions sleep in the shadows .


fn_spacy_tokens_for_baseline: There were no curtains to the small windows ; the moonlight was brighter than her candle and she blew out the steady flame long before she climbed between the stiff sheets .

source_bert_toks: there were no curtains to the small windows ; the moonlight was brighter than her candle and she blew out the steady flame long before she climbed between the stiff sheets .

reference_raw: There were no curtains on the small windows; the moonlight was brighter than a candle, and she blew out a steady flame long before she crawled among the stiff sheets.

reference_spacy_tokens: There were no curtains on the small windows ; the moonlight was brighter than a candle , and she blew out a steady flame long before she crawled among the stiff sheets .


fn_spacy_tokens_for_baseline: The real murderers now hid in the shadows , mocking both him and Cranston , believing they would never search out the truth .

source_bert_toks: the real murderers now hid in the shadows , mocking both him and cr ##ans ##ton , believing they would never search out the truth .

reference_raw: Now the real killers were hiding in the shadows, laughing at him and Cranston, believing they would never find the truth.

reference_spacy_tokens: Now the real killers were hiding in the shadows , laughing at him and Cranston , believing they would never find the truth .


fn_spacy_tokens_for_baseline: His eyes narrowed , and she felt a flicker of annoyance , this time aimed at herself .

source_bert_toks: his eyes narrowed , and she felt a flicker of annoyance , this time aimed at herself .

reference_raw: His eyes narrowed, and she felt a twinkle of irritation, this time aimed at herself.

reference_spacy_tokens: His eyes narrowed , and she felt a twinkle of irritation , this time aimed at herself .


fn_spacy_tokens_for_baseline: No special secrecy was attached to the cruiser -- indeed , Khrushchev told the disconcerted Admiralty that he would be glad to sell it to them because cruisers had been out - dated by missiles .

source_bert_toks: no special secrecy was attached to the cruiser - - indeed , k ##hr ##ush ##chev told the disco ##nce ##rted admiralty that he would be glad to sell it to them because cruisers had been out - dated by missiles .

reference_raw: There was no special secret attached to the cruiser-in fact, Khrushchev had told the dismayed Admiralty that he would be happy to sell it to them, since the cruisers were outnumbered by missiles.

reference_spacy_tokens: There was no special secret attached to the cruiser - in fact , Khrushchev had told the dismayed Admiralty that he would be happy to sell it to them , since the cruisers were outnumbered by missiles .


fn_spacy_tokens_for_baseline: The 1948 - 49 airlift to break the Soviet blockade of Berlin ?

source_bert_toks: the 1948 - 49 airlift to break the soviet blockade of berlin ?

reference_raw: A 1948-49 airlift to break the soviet blockage in Berlin?

reference_spacy_tokens: A 1948 - 49 airlift to break the soviet blockage in Berlin ?


fn_spacy_tokens_for_baseline: Thank you She fumbled at her belt with one hand and i laughed and took the briefcase from her .

source_bert_toks: thank you she fumbled at her belt with one hand and i laughed and took the briefcase from her .

reference_raw: She reached for her belt with one hand, and I laughed and took her briefcase.

reference_spacy_tokens: She reached for her belt with one hand , and I laughed and took her briefcase .


fn_spacy_tokens_for_baseline: I thought of making some smart remark to Jamie about stunting his growth , but all lines to and from my brain seemed to be jammed with urgent messages coming from my guts .

source_bert_toks: i thought of making some smart remark to jamie about stunt ##ing his growth , but all lines to and from my brain seemed to be jammed with urgent messages coming from my guts .

reference_raw: I thought I'd make a clever remark to Jamie about how to stun it, but all the lines in and out of my brain seemed to be jammed with urgent messages coming out of my stomach.

reference_spacy_tokens: I thought I 'd make a clever remark to Jamie about how to stun it , but all the lines in and out of my brain seemed to be jammed with urgent messages coming out of my stomach .


fn_spacy_tokens_for_baseline: However , if the Jumblies could turn that into a sea - going vessel , you should expect that the PC can be made as secure as you want .

source_bert_toks: however , if the ju ##mb ##lies could turn that into a sea - going vessel , you should expect that the pc can be made as secure as you want .

reference_raw: But if the Jumblies can turn it into a seagoing vessel, you should assume that the computer will be as safe as you want.

reference_spacy_tokens: But if the Jumblies can turn it into a seagoing vessel , you should assume that the computer will be as safe as you want .


fn_spacy_tokens_for_baseline: According to a Yugoslav newspaper report yesterday , which quoted Uefa 's vice - president Freddy Rumo , Dinamo are about to be disbanded .

source_bert_toks: according to a yugoslav newspaper report yesterday , which quoted uefa ' s vice - president freddy rum ##o , dinamo are about to be disbanded .

reference_raw: According to yesterday's Yugoslav newspaper report, which quoted Uefa's Vice President Freddy Rumo, Dinamo is about to be dissolved.

reference_spacy_tokens: According to yesterday 's Yugoslav newspaper report , which quoted Uefa 's Vice President Freddy Rumo , Dinamo is about to be dissolved .


fn_spacy_tokens_for_baseline: They paused to watch the rustics , bedecked with scarves , ribbons and laces , dance and carouse around their makeshift hobby horses to the raucous noise of pipers , drummers and other musicians .

source_bert_toks: they paused to watch the rustic ##s , bed ##eck ##ed with scar ##ves , ribbons and lace ##s , dance and car ##ouse around their makeshift hobby horses to the ra ##uc ##ous noise of piper ##s , drummer ##s and other musicians .

reference_raw: They stopped and watched the countryside, bedded with scarves, ribbons, and laces, dancing and carousing around their makeshift hobbies to the raucous sound of pipers, drummers, and other musicians.

reference_spacy_tokens: They stopped and watched the countryside , bedded with scarves , ribbons , and laces , dancing and carousing around their makeshift hobbies to the raucous sound of pipers , drummers , and other musicians .


fn_spacy_tokens_for_baseline: Although often dismissed as an opponent of evolutionism , Owen can thus be seen as an opponent of Darwinism who was quite happy to accept a theory of evolution based on preordained trends .

source_bert_toks: although often dismissed as an opponent of evolution ##ism , owen can thus be seen as an opponent of darwin ##ism who was quite happy to accept a theory of evolution based on pre ##ord ##aine ##d trends .

reference_raw: Although often rejected as an adversary of evolutionism, Owen can therefore be seen as an adversary of Darwinism, who was quite happy to accept the theory of evolution based on predetermined trends.

reference_spacy_tokens: Although often rejected as an adversary of evolutionism , Owen can therefore be seen as an adversary of Darwinism , who was quite happy to accept the theory of evolution based on predetermined trends .


fn_spacy_tokens_for_baseline: No matter whether a person is a Muslim , a Jew , a Hindu or an agnostic / atheist , they can be moral .

source_bert_toks: no matter whether a person is a muslim , a jew , a hindu or an ag ##nostic / atheist , they can be moral .

reference_raw: It doesn't matter if you're a Moslem, a Jew, a Hindu, or an agnostic/atheist, you can be moral.

reference_spacy_tokens: It does n't matter if you 're a Moslem , a Jew , a Hindu , or an agnostic / atheist , you can be moral .


fn_spacy_tokens_for_baseline: This introductory chapter defines CBW terrorism , explores what types of terrorist groups would be most likely to carry out such attacks , and summarizes U.S. government actions to combat CBW terrorism before and after September 11 .

source_bert_toks: this introductory chapter defines cb ##w terrorism , explores what types of terrorist groups would be most likely to carry out such attacks , and sum ##mar ##izes u . s . government actions to combat cb ##w terrorism before and after september 11 .

reference_raw: This introductory chapter defines CBW terrorism, examines which kinds of terrorist groups are most likely to carry out such attacks, and summarises the measures taken by the US government to combat CBW terrorism before and after September 11th.

reference_spacy_tokens: This introductory chapter defines CBW terrorism , examines which kinds of terrorist groups are most likely to carry out such attacks , and summarises the measures taken by the US government to combat CBW terrorism before and after September 11th .


fn_spacy_tokens_for_baseline: If you leave the park and walk up Cotton Tree Drive , you will find the Peak Tram terminal .

source_bert_toks: if you leave the park and walk up cotton tree drive , you will find the peak tram terminal .

reference_raw: If you leave the park and go to Cotton Tree Drive, you'll find the Peak Tram Console.

reference_spacy_tokens: If you leave the park and go to Cotton Tree Drive , you 'll find the Peak Tram Console .


fn_spacy_tokens_for_baseline: Doctor Rice would n't have chatted with her like he was doing ; he would have bawled at her and said , ' I 'll see him .

source_bert_toks: doctor rice wouldn ' t have chat ##ted with her like he was doing ; he would have ba ##wled at her and said , ' i ' ll see him .

reference_raw: Dr. Rice wouldn't talk to her the way he did; he'd yell at her and say, "I'll see him.

reference_spacy_tokens: Dr. Rice would n't talk to her the way he did ; he 'd yell at her and say , " I 'll see him .


fn_spacy_tokens_for_baseline: He said : ' The car had crashed through a wall and had overturned in a marshy field .

source_bert_toks: he said : ' the car had crashed through a wall and had overturned in a marsh ##y field .

reference_raw: He said, "The car went through the wall and overturned in the swampy field.

reference_spacy_tokens: He said , " The car went through the wall and overturned in the swampy field .


fn_spacy_tokens_for_baseline: You 've just had the nerve to make a public announcement about one of our major new film purchases for 1963 without so much as consulting Empire .

source_bert_toks: you ' ve just had the nerve to make a public announcement about one of our major new film purchases for 1963 without so much as consulting empire .

reference_raw: You just had the nerve to publish one of our major new 1963 movie purchases without consulting the Empire.

reference_spacy_tokens: You just had the nerve to publish one of our major new 1963 movie purchases without consulting the Empire .


fn_spacy_tokens_for_baseline: The topic of school / local - authority relationships is an area worthy of a chapter in its own right .

source_bert_toks: the topic of school / local - authority relationships is an area worthy of a chapter in its own right .

reference_raw: The subject of the school-local-authority relationship is an area worthy of the chapter itself.

reference_spacy_tokens: The subject of the school - local - authority relationship is an area worthy of the chapter itself .


fn_spacy_tokens_for_baseline: The FDA 's US Orphan Drug Act is intended to assist and encourage companies to develop safe and effective therapies for the treatment of rare diseases and disorders .

source_bert_toks: the fda ' s us orphan drug act is intended to assist and encourage companies to develop safe and effective the ##ra ##pies for the treatment of rare diseases and disorders .

reference_raw: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient therapies for the treatment of rare illnesses and disorders.

reference_spacy_tokens: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient therapies for the treatment of rare illnesses and disorders .


fn_spacy_tokens_for_baseline: The U.S. economy may be on the verge of falling back into recession after more than a year of half - hearted recovery that failed to generate either jobs or hope , according to economists .

source_bert_toks: the u . s . economy may be on the verge of falling back into recession after more than a year of half - hearted recovery that failed to generate either jobs or hope , according to economists .

reference_raw: According to economists, the US economy may be on the verge of falling back into recession after more than a year of half-hearted regeneration, which has failed to create jobs or hopes.

reference_spacy_tokens: According to economists , the US economy may be on the verge of falling back into recession after more than a year of half - hearted regeneration , which has failed to create jobs or hopes .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali gunmen who hijacked the United Nations - a chartered vessel carrying food aid to victims of tsunamis released the vessel after holding it for more than two months.

reference_spacy_tokens: According to the United Nations , Somali gunmen who hijacked the United Nations - a chartered vessel carrying food aid to victims of tsunamis released the vessel after holding it for more than two months .


fn_spacy_tokens_for_baseline: With sinking heart Sly realized that he was in a burger joint that was too trendy to peel its potatoes .

source_bert_toks: with sinking heart sly realized that he was in a burger joint that was too trend ##y to peel its potatoes .

reference_raw: With a sinking heart, Sly realized he was in a burger joint, too fashionable to peel his potatoes.

reference_spacy_tokens: With a sinking heart , Sly realized he was in a burger joint , too fashionable to peel his potatoes .


fn_spacy_tokens_for_baseline: When the company knew it had won an Award it telexed the Saudis .

source_bert_toks: when the company knew it had won an award it tel ##ex ##ed the saudi ##s .

reference_raw: When the company found out he'd won the Award, it sent a telegram to the Saudis.

reference_spacy_tokens: When the company found out he 'd won the Award , it sent a telegram to the Saudis .


fn_spacy_tokens_for_baseline: And what makes it such an invigorating saga is his ability to let his idiosyncratic Broadway denizens talk for themselves .

source_bert_toks: and what makes it such an in ##vi ##gor ##ating saga is his ability to let his id ##ios ##yn ##cratic broadway den ##ize ##ns talk for themselves .

reference_raw: And what makes him such a refreshing saga is his ability to let his idiosyncratic Broadway denizens speak for themselves.

reference_spacy_tokens: And what makes him such a refreshing saga is his ability to let his idiosyncratic Broadway denizens speak for themselves .


fn_spacy_tokens_for_baseline: A post - mortem revealed she had one and a half litres of blood in her right lung , which had almost completely collapsed .

source_bert_toks: a post - mort ##em revealed she had one and a half litres of blood in her right lung , which had almost completely collapsed .

reference_raw: The autopsy revealed that she had a liter of blood in her right lung that had almost completely collapsed.

reference_spacy_tokens: The autopsy revealed that she had a liter of blood in her right lung that had almost completely collapsed .


fn_spacy_tokens_for_baseline: Champagne glasses frozen in mid - air , Charles and her father exchanged glances , then turned to stare at Guy .

source_bert_toks: champagne glasses frozen in mid - air , charles and her father exchanged glances , then turned to stare at guy .

reference_raw: The champagne glasses were frozen in the air, and Charles and her father looked at each other, then turned to look at Guy.

reference_spacy_tokens: The champagne glasses were frozen in the air , and Charles and her father looked at each other , then turned to look at Guy .


fn_spacy_tokens_for_baseline: A robust economy helps by providing job opportunities , but to be honest , most of the people who are n't working today are quite simply the ones who face the greatest obstacles .

source_bert_toks: a robust economy helps by providing job opportunities , but to be honest , most of the people who aren ' t working today are quite simply the ones who face the greatest obstacles .

reference_raw: A strong economy helps by providing job opportunities, but, to be honest, most people who are not currently on the job are simply those who face the biggest obstacles.

reference_spacy_tokens: A strong economy helps by providing job opportunities , but , to be honest , most people who are not currently on the job are simply those who face the biggest obstacles .


fn_spacy_tokens_for_baseline: Where , for instance , remuneration is linked to earnings per share , managers have an interest in increasing short - term profits , which may be detrimental to investment and the company 's long - term value .

source_bert_toks: where , for instance , re ##mun ##eration is linked to earnings per share , managers have an interest in increasing short - term profits , which may be detrimental to investment and the company ' s long - term value .

reference_raw: For example, if the remuneration is linked to the earnings per share, the managers have a stake in increasing short-term profits, which may be detrimental to the investment and the long-term value of the company.

reference_spacy_tokens: For example , if the remuneration is linked to the earnings per share , the managers have a stake in increasing short - term profits , which may be detrimental to the investment and the long - term value of the company .


fn_spacy_tokens_for_baseline: And that part of my mind seemed to whine faintly and go very cold and still .

source_bert_toks: and that part of my mind seemed to w ##hine faintly and go very cold and still .

reference_raw: And that part of my mind seemed to whin and go very cold and quiet.

reference_spacy_tokens: And that part of my mind seemed to whin and go very cold and quiet .


fn_spacy_tokens_for_baseline: Five were traditional : McKim 's pure Classicism ; the Beaux - Arts French Modern ; Colonial , which was associated with houses but was also appearing in larger buildings such as the Johns Hopkins University campus ; Cram 's own High Gothic ; and a looser interpretation of the medieval style as practiced by his partner Goodhue .

source_bert_toks: five were traditional : mc ##kim ' s pure classic ##ism ; the beaux - arts french modern ; colonial , which was associated with houses but was also appearing in larger buildings such as the johns hopkins university campus ; cr ##am ' s own high gothic ; and a loose ##r interpretation of the medieval style as practiced by his partner good ##hue .

reference_raw: Five of them were traditional: McKim's pure classicism; the Beaux-Arts French Modern; the Colonial, which was linked to homes, but also showed up in larger buildings like Johns Hopkins University; the Cram High Gothic; and the looser interpretation of the medieval style practiced by his partner, Goodhue.

reference_spacy_tokens: Five of them were traditional : McKim 's pure classicism ; the Beaux - Arts French Modern ; the Colonial , which was linked to homes , but also showed up in larger buildings like Johns Hopkins University ; the Cram High Gothic ; and the looser interpretation of the medieval style practiced by his partner , Goodhue .


fn_spacy_tokens_for_baseline: They would certainly not approve of the various purges devised by Jan.

source_bert_toks: they would certainly not approve of the various purge ##s devised by jan .

reference_raw: They certainly wouldn't agree with the various cleansings Jan had devised.

reference_spacy_tokens: They certainly would n't agree with the various cleansings Jan had devised .


fn_spacy_tokens_for_baseline: He crept inconspicuously back to the dashboard , switched on the ignition , and looked at the gauge .

source_bert_toks: he crept inc ##ons ##pic ##uously back to the dashboard , switched on the ignition , and looked at the gauge .

reference_raw: He crawled unobtrusively back to the dashboard, switched on the ignition, and looked at the gauge.

reference_spacy_tokens: He crawled unobtrusively back to the dashboard , switched on the ignition , and looked at the gauge .


fn_spacy_tokens_for_baseline: Taking a heavy poker in one hand and a torch in the other , he charged down the steps , feeling certain that the intruder had entered the storeroom .

source_bert_toks: taking a heavy poker in one hand and a torch in the other , he charged down the steps , feeling certain that the intruder had entered the store ##room .

reference_raw: He took a heavy poker in one hand and a torch in the other and charged down the stairs, feeling sure the intruder had entered the warehouse.

reference_spacy_tokens: He took a heavy poker in one hand and a torch in the other and charged down the stairs , feeling sure the intruder had entered the warehouse .


fn_spacy_tokens_for_baseline: He was forthright with his questions but he was also the perfect host .

source_bert_toks: he was forth ##right with his questions but he was also the perfect host .

reference_raw: He'd been honest with his questions, but he'd also been a perfect guest.

reference_spacy_tokens: He 'd been honest with his questions , but he 'd also been a perfect guest .


fn_spacy_tokens_for_baseline: Therefore I would allow the appeal and restore the order .

source_bert_toks: therefore i would allow the appeal and restore the order .

reference_raw: That's why I'd allow the appeal and restore the warrant.

reference_spacy_tokens: That 's why I 'd allow the appeal and restore the warrant .


fn_spacy_tokens_for_baseline: He lifted a hand and , touching her pale cheek with gentle fingers , gave her a heart - stopping smile .

source_bert_toks: he lifted a hand and , touching her pale cheek with gentle fingers , gave her a heart - stopping smile .

reference_raw: He raised his hand and, touching her pale face with gentle fingers, gave her a heartless smile.

reference_spacy_tokens: He raised his hand and , touching her pale face with gentle fingers , gave her a heartless smile .


fn_spacy_tokens_for_baseline: Enrique headed through the field at the back of the garage making for the woods to the north .

source_bert_toks: enrique headed through the field at the back of the garage making for the woods to the north .

reference_raw: Enrique walked across the field at the rear of the garage, heading north into the forest.

reference_spacy_tokens: Enrique walked across the field at the rear of the garage , heading north into the forest .


fn_spacy_tokens_for_baseline: While the proliferation legacies of South Africa 's nuclear and missile programs were effectively resolved through verified disarmament measures that won international acclaim , dismantlement of the country 's CBW capabilities was not verified to a comparable degree of certainty .

source_bert_toks: while the proliferation leg ##acies of south africa ' s nuclear and missile programs were effectively resolved through verified di ##sar ##mament measures that won international acclaim , di ##sman ##tlement of the country ' s cb ##w capabilities was not verified to a comparable degree of certainty .

reference_raw: While the proliferation legacies of South Africa's nuclear and missile programmes have been effectively addressed through verified disarmament measures that have won international recognition, the dismantling of the country's CBW capabilities has not been verified to a similar degree of certainty.

reference_spacy_tokens: While the proliferation legacies of South Africa 's nuclear and missile programmes have been effectively addressed through verified disarmament measures that have won international recognition , the dismantling of the country 's CBW capabilities has not been verified to a similar degree of certainty .


fn_spacy_tokens_for_baseline: Must the existence of God be probable , or can theism seek to defend its position against the improbability of God 's existence ?

source_bert_toks: must the existence of god be probable , or can the ##ism seek to defend its position against the imp ##ro ##ba ##bility of god ' s existence ?

reference_raw: Must the existence of God be probable, or may theism seek to defend its position against the improbable existence of God?

reference_spacy_tokens: Must the existence of God be probable , or may theism seek to defend its position against the improbable existence of God ?


fn_spacy_tokens_for_baseline: But a top Russian intelligence chief declined Tuesday to predict when Dzhokhar Dudayev might be arrested .

source_bert_toks: but a top russian intelligence chief declined tuesday to predict when d ##zh ##ok ##har du ##day ##ev might be arrested .

reference_raw: But the top Russian intelligence chief refused Tuesday to predict when Dzhokhar Dudayev would be arrested.

reference_spacy_tokens: But the top Russian intelligence chief refused Tuesday to predict when Dzhokhar Dudayev would be arrested .


fn_spacy_tokens_for_baseline: The size of the Trident bill is particularly galling in view of the Budget decision to tax gas and electricity .

source_bert_toks: the size of the trident bill is particularly gall ##ing in view of the budget decision to tax gas and electricity .

reference_raw: With regard to the budgetary decision on taxation of gas and electricity, the size of the Trident Act is particularly challenging.

reference_spacy_tokens: With regard to the budgetary decision on taxation of gas and electricity , the size of the Trident Act is particularly challenging .


fn_spacy_tokens_for_baseline: She reached out for him again , and his arms felt lean and hard through the sleeves of his tunic .

source_bert_toks: she reached out for him again , and his arms felt lean and hard through the sleeves of his tunic .

reference_raw: She reached for him again, and his hands felt thin and hard in his tunic.

reference_spacy_tokens: She reached for him again , and his hands felt thin and hard in his tunic .