fn_spacy_tokens_for_baseline: Even a change of name -- from the Windscale that had witnessed the 1957 fire to the brave new world of Sellafield -- has failed to expunge public hostility .

source_bert_toks: even a change of name - - from the winds ##cal ##e that had witnessed the 1957 fire to the brave new world of sell ##af ##ield - - has failed to ex ##pu ##nge public hostility .

reference_raw: Even the change of name - from the Windscale who witnessed the fire in 1957 to the brave new world of Sellafield - failed to expel public hostility.

reference_spacy_tokens: Even the change of name - from the Windscale who witnessed the fire in 1957 to the brave new world of Sellafield - failed to expel public hostility .


fn_spacy_tokens_for_baseline: They 've also blocked off the railway line , and British drivers say they 've been threatened at knife point .

source_bert_toks: they ' ve also blocked off the railway line , and british drivers say they ' ve been threatened at knife point .

reference_raw: They also blocked the railroad, and the British drivers say they were threatened at the point of the knife.

reference_spacy_tokens: They also blocked the railroad , and the British drivers say they were threatened at the point of the knife .


fn_spacy_tokens_for_baseline: Specialty goods and souvenirs , often handmade , come from Hong Kong and elsewhere in China .

source_bert_toks: specialty goods and so ##uven ##irs , often hand ##made , come from hong kong and elsewhere in china .

reference_raw: The special goods and souvenirs, often hand-made, originate in Hong Kong and elsewhere in China.

reference_spacy_tokens: The special goods and souvenirs , often hand - made , originate in Hong Kong and elsewhere in China .


fn_spacy_tokens_for_baseline: Now begin to breathe in white light ( or whatever colour feels appropriate ) until you are radiating light .

source_bert_toks: now begin to breathe in white light ( or whatever colour feels appropriate ) until you are radiating light .

reference_raw: Now start breathing in white light (or whatever color you think is appropriate) until you light up.

reference_spacy_tokens: Now start breathing in white light ( or whatever color you think is appropriate ) until you light up .


fn_spacy_tokens_for_baseline: The individual artisans ' shops are no longer here , but you can visit a silk - weaving factory , a ceramics plant , and the Foshan Folk Art Studio , where you can observe workers making Chinese lanterns , carving sculptures , painting scrolls , and cutting intricate designs in paper .

source_bert_toks: the individual artisans ' shops are no longer here , but you can visit a silk - weaving factory , a ceramics plant , and the f ##osh ##an folk art studio , where you can observe workers making chinese lanterns , carving sculptures , painting scrolls , and cutting intricate designs in paper .

reference_raw: The various craftsmen's shops are no longer here, but you can visit the silk-weaving factory, the ceramic factory, and the Foshan Folk Art Studio, where you can see the workers who make Chinese lanterns, carve statues, paint scrolls, and cut intricate designs on paper.

reference_spacy_tokens: The various craftsmen 's shops are no longer here , but you can visit the silk - weaving factory , the ceramic factory , and the Foshan Folk Art Studio , where you can see the workers who make Chinese lanterns , carve statues , paint scrolls , and cut intricate designs on paper .


fn_spacy_tokens_for_baseline: Only the white hat did n't have a chance to pull his six - shooter .

source_bert_toks: only the white hat didn ' t have a chance to pull his six - shooter .

reference_raw: But the white hat couldn't get his six-shooter out.

reference_spacy_tokens: But the white hat could n't get his six - shooter out .


fn_spacy_tokens_for_baseline: If we wish to be serious about American education , we know exactly what to do -- and , just as important , what not to do .

source_bert_toks: if we wish to be serious about american education , we know exactly what to do - - and , just as important , what not to do .

reference_raw: If we want to take American education seriously, we know exactly what to do - and, equally importantly, what not to do.

reference_spacy_tokens: If we want to take American education seriously , we know exactly what to do - and , equally importantly , what not to do .


fn_spacy_tokens_for_baseline: Old customs are still followed : Fate and luck are taken very seriously , and astrologers and fortune - tellers do a steady business .

source_bert_toks: old customs are still followed : fate and luck are taken very seriously , and astro ##log ##ers and fortune - teller ##s do a steady business .

reference_raw: The old habits are still being followed: fate and happiness are taken very seriously, and astrologers and fortune-tellers do a steady business.

reference_spacy_tokens: The old habits are still being followed : fate and happiness are taken very seriously , and astrologers and fortune - tellers do a steady business .


fn_spacy_tokens_for_baseline: ' Last week , " she said , ' my nail snapped off .

source_bert_toks: ' last week , " she said , ' my nail snapped off .

reference_raw: "I broke my nail last week," she said.

reference_spacy_tokens: " I broke my nail last week , " she said .


fn_spacy_tokens_for_baseline: The release of nerve gas on the Tokyo subway by a Japanese cult on March 20 , 1995 , the terrorist attacks of September 11 , 2001 , and the sending of anthrax - tainted letters have made policymakers and the general public concerned that terrorists could use chemical or biological weapons ( CBW ) to inflict mass casualties .

source_bert_toks: the release of nerve gas on the tokyo subway by a japanese cult on march 20 , 1995 , the terrorist attacks of september 11 , 2001 , and the sending of ant ##hra ##x - tainted letters have made policy ##makers and the general public concerned that terrorists could use chemical or biological weapons ( cb ##w ) to in ##flict mass casualties .

reference_raw: Discharges of nerve gas on the Tokyo subway by a Japanese cult on March 20, 1995, the terrorist attacks of September 11, 2001, and the sending of anthrax-tainted letters caused politicians and the general public concerned that terrorists could use chemical or biological weapons (CBW) to cause mass casualties.

reference_spacy_tokens: Discharges of nerve gas on the Tokyo subway by a Japanese cult on March 20 , 1995 , the terrorist attacks of September 11 , 2001 , and the sending of anthrax - tainted letters caused politicians and the general public concerned that terrorists could use chemical or biological weapons ( CBW ) to cause mass casualties .


fn_spacy_tokens_for_baseline: Was n't it fine just to cruise the freeway , in the afternoon sunshine , a foxy lady in the seat beside you .

source_bert_toks: wasn ' t it fine just to cruise the freeway , in the afternoon sunshine , a fox ##y lady in the seat beside you .

reference_raw: It wasn't okay just riding the highway in the afternoon sun, a fox lady sitting next to you.

reference_spacy_tokens: It was n't okay just riding the highway in the afternoon sun , a fox lady sitting next to you .


fn_spacy_tokens_for_baseline: The Soviet BW arsenal included the causative agents of anthrax , smallpox , plague , tularemia , glanders , and hemorrhagic fever .

source_bert_toks: the soviet b ##w arsenal included the ca ##usa ##tive agents of ant ##hra ##x , smallpox , plague , tu ##lar ##emia , gland ##ers , and hem ##or ##rh ##agi ##c fever .

reference_raw: The Soviet BW arsenal included causes of anthrax, smallpox, plague, tularaemia, glanders, and hemorrhagic fever.

reference_spacy_tokens: The Soviet BW arsenal included causes of anthrax , smallpox , plague , tularaemia , glanders , and hemorrhagic fever .


fn_spacy_tokens_for_baseline: The children took deep breaths , tried to shrink their shoulder - blades , as the buttons were done up at the back .

source_bert_toks: the children took deep breaths , tried to shrink their shoulder - blades , as the buttons were done up at the back .

reference_raw: The children took a deep breath and tried to reduce their shoulder blades as the buttons went up behind them.

reference_spacy_tokens: The children took a deep breath and tried to reduce their shoulder blades as the buttons went up behind them .


fn_spacy_tokens_for_baseline: Additionally , personnel from Saghand University cooperate with AEOI staff to conduct research in mining and milling of uranium at BHRC laboratories .

source_bert_toks: additionally , personnel from sa ##ghan ##d university cooperate with ae ##oi staff to conduct research in mining and milling of uranium at b ##hr ##c laboratories .

reference_raw: In addition, Saghand University staff cooperate with AEOI staff to conduct uranium mining and milling research in the BHRC laboratories.

reference_spacy_tokens: In addition , Saghand University staff cooperate with AEOI staff to conduct uranium mining and milling research in the BHRC laboratories .


fn_spacy_tokens_for_baseline: The cab swung into the car park .

source_bert_toks: the cab swung into the car park .

reference_raw: The taxi turned into the parking lot.

reference_spacy_tokens: The taxi turned into the parking lot .


fn_spacy_tokens_for_baseline: When his companion and he had fled to some prearranged retreat - already occupied , no doubt by a confederate - the companion had persuaded him to leave so compromising an article of furniture .

source_bert_toks: when his companion and he had fled to some pre ##ar ##rang ##ed retreat - already occupied , no doubt by a confederate - the companion had persuaded him to leave so com ##promising an article of furniture .

reference_raw: When his companion and he had fled to some prearranged retreat - already occupied, no doubt by the Confederate - his companion had persuaded him to abandon such a compromised piece of furniture.

reference_spacy_tokens: When his companion and he had fled to some prearranged retreat - already occupied , no doubt by the Confederate - his companion had persuaded him to abandon such a compromised piece of furniture .


fn_spacy_tokens_for_baseline: However , it has been reported that Hall is expected to meet Iraqi Health Minister Umid Medhat Mubarak and representatives of all international aid organizations working in Iraq .

source_bert_toks: however , it has been reported that hall is expected to meet iraqi health minister um ##id med ##hat mu ##bara ##k and representatives of all international aid organizations working in iraq .

reference_raw: But Hall is expected to meet with Iraqi Health Minister Umid Medhat Mubarak and representatives of all international support organisations working in Iraq.

reference_spacy_tokens: But Hall is expected to meet with Iraqi Health Minister Umid Medhat Mubarak and representatives of all international support organisations working in Iraq .


fn_spacy_tokens_for_baseline: " With the aid of Indian companies , Iran is nearing the completion of a secret poison - gas plant , which was claimed by the Indian companies to be a pesticide factory . "

source_bert_toks: " with the aid of indian companies , iran is nearing the completion of a secret poison - gas plant , which was claimed by the indian companies to be a pest ##icide factory . "

reference_raw: "With the help of Indian companies, Iran is approaching the completion of a secret poison, a gas plant that Indian companies claim to be a pesticide plant."

reference_spacy_tokens: " With the help of Indian companies , Iran is approaching the completion of a secret poison , a gas plant that Indian companies claim to be a pesticide plant . "


fn_spacy_tokens_for_baseline: One of the most interesting sites in the New Territories is Tai Fu Tai , another rare survivor , this one a mansion that belonged to a Confucian high official .

source_bert_toks: one of the most interesting sites in the new territories is tai fu tai , another rare survivor , this one a mansion that belonged to a con ##fu ##cian high official .

reference_raw: One of the most interesting places in the new territories is Tai Fu Tai, another rare survivor, this one a mansion belonging to a Confucian high-ranking official.

reference_spacy_tokens: One of the most interesting places in the new territories is Tai Fu Tai , another rare survivor , this one a mansion belonging to a Confucian high - ranking official .


fn_spacy_tokens_for_baseline: Cornell found a number of employment options that he never dreamed existed after a work - site injury forced him out of his job at a foundry .

source_bert_toks: cornell found a number of employment options that he never dreamed existed after a work - site injury forced him out of his job at a foundry .

reference_raw: Cornell had found a number of job opportunities he had never dreamed would exist after the job-site injuries had forced him out of the job at the foundry.

reference_spacy_tokens: Cornell had found a number of job opportunities he had never dreamed would exist after the job - site injuries had forced him out of the job at the foundry .


fn_spacy_tokens_for_baseline: The military is training for the day a terrorist sets off not just a bomb , but a chemical or biological weapon that would spew out an invisible death .

source_bert_toks: the military is training for the day a terrorist sets off not just a bomb , but a chemical or biological weapon that would sp ##ew out an invisible death .

reference_raw: The army's training for the day when a terrorist launches not only a bomb, but a chemical or biological weapon that will evoke an invisible death.

reference_spacy_tokens: The army 's training for the day when a terrorist launches not only a bomb , but a chemical or biological weapon that will evoke an invisible death .


fn_spacy_tokens_for_baseline: The subject of their discourse was one Mike Donlin , as he appeared in vaudeville .

source_bert_toks: the subject of their discourse was one mike don ##lin , as he appeared in vaudeville .

reference_raw: The subject of their discussion was Mike Donlin, who showed up in Vaudeville.

reference_spacy_tokens: The subject of their discussion was Mike Donlin , who showed up in Vaudeville .


fn_spacy_tokens_for_baseline: Equal amounts of protein ( 30 µg ) were precipitated with trichloroacetic acid ( TCA ) , and electrophoresed through a 12.5 % SDS - polyacrylamide gel ( 37 ) .

source_bert_toks: equal amounts of protein ( 30 ##µ ##g ) were pre ##ci ##pit ##ated with tri ##ch ##lor ##oa ##ce ##tic acid ( tc ##a ) , and electro ##ph ##ores ##ed through a 12 . 5 % sd ##s - poly ##ac ##ryl ##ami ##de gel ( 37 ) .

reference_raw: The same protein content (30g) was precipitated with trichloroacetic acid (TCA) and electrophoresed with 12.5% S-polyacryl gel (37).

reference_spacy_tokens: The same protein content ( 30 g ) was precipitated with trichloroacetic acid ( TCA ) and electrophoresed with 12.5 % S - polyacryl gel ( 37 ) .


fn_spacy_tokens_for_baseline: For every pimply , dejected murderer I can give you one who looks like a movie star , for everyone who wo n't talk , one who will gab your ear off .

source_bert_toks: for every pi ##mp ##ly , de ##jected murderer i can give you one who looks like a movie star , for everyone who won ' t talk , one who will ga ##b your ear off .

reference_raw: For every pimpy, dejected killer, I can give you one that looks like a movie star, for anyone who won't talk to you, someone who'll cut off your ear.

reference_spacy_tokens: For every pimpy , dejected killer , I can give you one that looks like a movie star , for anyone who wo n't talk to you , someone who 'll cut off your ear .


fn_spacy_tokens_for_baseline: Both of them knew what damage these Hessian boots and the expensive felt hat could do to those scabbed wooden clogs and the coarse neckerchief .

source_bert_toks: both of them knew what damage these hess ##ian boots and the expensive felt hat could do to those sc ##ab ##bed wooden cl ##og ##s and the coarse neck ##er ##chi ##ef .

reference_raw: They both knew what damage the Hessian shoes and the expensive felt hat could do to the scabbed wooden clogs and the rough scarf.

reference_spacy_tokens: They both knew what damage the Hessian shoes and the expensive felt hat could do to the scabbed wooden clogs and the rough scarf .


fn_spacy_tokens_for_baseline: It 's an ideal way for the visitor to reach outlying sights and villages .

source_bert_toks: it ' s an ideal way for the visitor to reach outlying sights and villages .

reference_raw: It's an ideal way for visitors to reach distant sights and villages.

reference_spacy_tokens: It 's an ideal way for visitors to reach distant sights and villages .


fn_spacy_tokens_for_baseline: The first stage of the project , already complete , was a geophysical survey , which has revealed the remains of substantial stone buildings and has suggested a street plan of this part of the Roman city .

source_bert_toks: the first stage of the project , already complete , was a geo ##physical survey , which has revealed the remains of substantial stone buildings and has suggested a street plan of this part of the roman city .

reference_raw: The first phase of the project, which had already been completed, was a geophysical survey that revealed the remains of major stone buildings and suggested a street plan for this part of the city of Rome.

reference_spacy_tokens: The first phase of the project , which had already been completed , was a geophysical survey that revealed the remains of major stone buildings and suggested a street plan for this part of the city of Rome .


fn_spacy_tokens_for_baseline: The French invasion plan of 1762 was very different from all those that had preceded it .

source_bert_toks: the french invasion plan of 1762 was very different from all those that had preceded it .

reference_raw: The French invasion plan of 1762 was very different from the previous ones.

reference_spacy_tokens: The French invasion plan of 1762 was very different from the previous ones .


fn_spacy_tokens_for_baseline: The case was also , however , framed as a conspiracy between Shell and others to contravene the sanctions order .

source_bert_toks: the case was also , however , framed as a conspiracy between shell and others to contra ##ven ##e the sanctions order .

reference_raw: But the case was also framed as a plot between Shell and others to violate the penalty order.

reference_spacy_tokens: But the case was also framed as a plot between Shell and others to violate the penalty order .


fn_spacy_tokens_for_baseline: He felt her jump slightly when he slid his fingers beneath her braid .

source_bert_toks: he felt her jump slightly when he slid his fingers beneath her braid .

reference_raw: As he slipped his fingers under her plait, he felt her jump a little.

reference_spacy_tokens: As he slipped his fingers under her plait , he felt her jump a little .


fn_spacy_tokens_for_baseline: A strict control system should cover the above items .

source_bert_toks: a strict control system should cover the above items .

reference_raw: The above points should be covered by a strict control system.

reference_spacy_tokens: The above points should be covered by a strict control system .


fn_spacy_tokens_for_baseline: Its comparative absence of autonomy is underscored by the very absence of ' prophets ' in the field .

source_bert_toks: its comparative absence of autonomy is under ##sco ##red by the very absence of ' prophets ' in the field .

reference_raw: Its comparative lack of autonomy is underlined by the very absence of 'prophets' in the field.

reference_spacy_tokens: Its comparative lack of autonomy is underlined by the very absence of ' prophets ' in the field .


fn_spacy_tokens_for_baseline: For those petrified by the prospect of even the simplest programming , this basic approach is a real help .

source_bert_toks: for those pet ##rified by the prospect of even the simplest programming , this basic approach is a real help .

reference_raw: This basic approach is a real help to those who are fossilized by the prospect of even the simplest programming.

reference_spacy_tokens: This basic approach is a real help to those who are fossilized by the prospect of even the simplest programming .


fn_spacy_tokens_for_baseline: In March 2004 , the revelation , combined with IAEA evidence that nuclear activities had been pursued on Iranian military bases , led to a first - ever acknowledgment by Defense Minister Ali Shamkhani that the Iranian military had produced centrifuges to enrich uranium .

source_bert_toks: in march 2004 , the revelation , combined with ia ##ea evidence that nuclear activities had been pursued on iranian military bases , led to a first - ever ac ##k ##now ##led ##gm ##ent by defense minister ali sham ##khan ##i that the iranian military had produced cent ##ri ##fu ##ges to en ##rich uranium .

reference_raw: In March 2004, the revelation, together with the evidence from the IAEA that nuclear activities were carried out on Iranian military bases, led to the first-ever acknowledgement of Defense Minister Ali Shamkhani that the Iranian military produced centrifuges for uranium enrichment.

reference_spacy_tokens: In March 2004 , the revelation , together with the evidence from the IAEA that nuclear activities were carried out on Iranian military bases , led to the first - ever acknowledgement of Defense Minister Ali Shamkhani that the Iranian military produced centrifuges for uranium enrichment .


fn_spacy_tokens_for_baseline: They do not abase themselves in penitence but see themselves in a partnership which accepts responsibility for establishing peace and justice on this planet .

source_bert_toks: they do not aba ##se themselves in pen ##ite ##nce but see themselves in a partnership which accepts responsibility for establishing peace and justice on this planet .

reference_raw: They do not base themselves on penance, but see themselves in a partnership that accepts responsibility for the establishment of peace and justice on this planet.

reference_spacy_tokens: They do not base themselves on penance , but see themselves in a partnership that accepts responsibility for the establishment of peace and justice on this planet .


fn_spacy_tokens_for_baseline: VIENNA , Austria ( AP ) --- Senior Bosnian Serb and Muslim generals and officials sat down Thursday in Vienna 's august Hofburg palace to start swapping military secrets whose divulgence would have been treason just weeks ago .

source_bert_toks: vienna , austria ( ap ) - - - senior bosnian serb and muslim generals and officials sat down thursday in vienna ' s august ho ##fb ##urg palace to start swap ##ping military secrets whose di ##vu ##lge ##nce would have been treason just weeks ago .

reference_raw: VIENNA, Austria (AP) - Senior Bosnian Serbs, Muslim generals and officials sat at the Vienna August Hofburg Palace on Thursday and began to exchange military secrets whose disclosure would have been treason only a few weeks ago.

reference_spacy_tokens: VIENNA , Austria ( AP ) - Senior Bosnian Serbs , Muslim generals and officials sat at the Vienna August Hofburg Palace on Thursday and began to exchange military secrets whose disclosure would have been treason only a few weeks ago .


fn_spacy_tokens_for_baseline: And there was no way in which Bint Pomona could be induced , cajoled , enticed , bribed , threatened , or made to oblige people in any way .

source_bert_toks: and there was no way in which bin ##t po ##mona could be induced , ca ##jo ##led , en ##tic ##ed , bribe ##d , threatened , or made to ob ##li ##ge people in any way .

reference_raw: And there was no way Bint Pomona could be induced, mocked, seduced, bribed, threatened, or forced to oblige people in any way.

reference_spacy_tokens: And there was no way Bint Pomona could be induced , mocked , seduced , bribed , threatened , or forced to oblige people in any way .


fn_spacy_tokens_for_baseline: 27th , ' Finished Wastwater and dined with Mr. and Mistress Harden , was much gratified by the musical performances of the worthy couple and their drawings ' .

source_bert_toks: 27th , ' finished was ##t ##water and din ##ed with mr . and mistress harden , was much gr ##ati ##fied by the musical performances of the worthy couple and their drawings ' .

reference_raw: Twenty-seventh, 'Finished Wastwater and dinner with Mr. and Mrs. Harden, was very grateful for the musical performances of the worthy couple and their drawings.'

reference_spacy_tokens: Twenty - seventh , ' Finished Wastwater and dinner with Mr. and Mrs. Harden , was very grateful for the musical performances of the worthy couple and their drawings . '


fn_spacy_tokens_for_baseline: Her foot connected hard with Benton 's right shin and he yelped in pain , reaching down to massage the throbbing limb .

source_bert_toks: her foot connected hard with benton ' s right shin and he ye ##lp ##ed in pain , reaching down to massage the throbbing limb .

reference_raw: Her leg was firmly attached to Benton's right shin, and he cried out in pain, reaching down to rub his throbbing limb.

reference_spacy_tokens: Her leg was firmly attached to Benton 's right shin , and he cried out in pain , reaching down to rub his throbbing limb .


fn_spacy_tokens_for_baseline: There is no reason why a male bird should signal accurate information to its competitors , except in so far as it will scare them away .

source_bert_toks: there is no reason why a male bird should signal accurate information to its competitors , except in so far as it will scare them away .

reference_raw: There is no reason why a male bird should send accurate information to its competitors, except to frighten them.

reference_spacy_tokens: There is no reason why a male bird should send accurate information to its competitors , except to frighten them .


fn_spacy_tokens_for_baseline: He campaigned vigorously against the use of drugs and injected new life and efficiency into sports administration .

source_bert_toks: he campaigned vigorously against the use of drugs and injected new life and efficiency into sports administration .

reference_raw: He campaigned vigorously against drug use and added new life and efficiency to the sports administration.

reference_spacy_tokens: He campaigned vigorously against drug use and added new life and efficiency to the sports administration .


fn_spacy_tokens_for_baseline: Dr _ Gupto : On the other hand to be able to outline and do the thing that were talked about today to basically completely revamp the public health system so that local officials can talk to state officials that can talk to federal officials to be able to pinpoint exactly when a cluster of bird flu happens that takes probably a lot more money and a and a really a complete revamping of our public health systems .

source_bert_toks: dr _ gu ##pt ##o : on the other hand to be able to outline and do the thing that were talked about today to basically completely rev ##amp the public health system so that local officials can talk to state officials that can talk to federal officials to be able to pin ##point exactly when a cluster of bird flu happens that takes probably a lot more money and a and a really a complete rev ##amp ##ing of our public health systems .

reference_raw: Dr. Gupto: On the other hand, to be able to outline and do what we're talking about today, to essentially renovate the public health system, so that local officials can talk to government officials who can talk to U.S. officials so they can pinpoint exactly when a cluster of avian influenza occurs, which will probably take a lot more money and really a complete overhaul of our public health system.

reference_spacy_tokens: Dr. Gupto : On the other hand , to be able to outline and do what we 're talking about today , to essentially renovate the public health system , so that local officials can talk to government officials who can talk to U.S. officials so they can pinpoint exactly when a cluster of avian influenza occurs , which will probably take a lot more money and really a complete overhaul of our public health system .


fn_spacy_tokens_for_baseline: At Monterrey , publisher Luis Gabriel Cano , although shaken by the murders , issued a statement saying : " We will not cease our fight against drug trafficking .

source_bert_toks: at monterrey , publisher luis gabriel can ##o , although shaken by the murders , issued a statement saying : " we will not cease our fight against drug trafficking .

reference_raw: In Monterrey, publisher Luis Gabriel Cano, though shaken by the murders, issued a statement saying, "We will not stop fighting drug trafficking.

reference_spacy_tokens: In Monterrey , publisher Luis Gabriel Cano , though shaken by the murders , issued a statement saying , " We will not stop fighting drug trafficking .


fn_spacy_tokens_for_baseline: Everything was a delicious blend of tart and sweet : baby carrots with apricots , snow peas with prunes , roast potatoes sprinkled with basil .

source_bert_toks: everything was a delicious blend of tar ##t and sweet : baby carrot ##s with apr ##ico ##ts , snow peas with pr ##unes , roast potatoes sp ##rin ##kled with basil .

reference_raw: It was a delicious mixture of tart and sweet: baby carrots with apricots, snow peas with plums, basil-stained roast potatoes.

reference_spacy_tokens: It was a delicious mixture of tart and sweet : baby carrots with apricots , snow peas with plums , basil - stained roast potatoes .


fn_spacy_tokens_for_baseline: The old bill might be straight in Leyton but there are growing numbers who smoke weed and support calls for legalisation .

source_bert_toks: the old bill might be straight in ley ##ton but there are growing numbers who smoke weed and support calls for legal ##isation .

reference_raw: The old law may be straight in Leyton, but there's a growing number of people who smoke pot and encourage legalization.

reference_spacy_tokens: The old law may be straight in Leyton , but there 's a growing number of people who smoke pot and encourage legalization .


fn_spacy_tokens_for_baseline: The statue and a small museum are on a peak , up 268 steps , above Po Lin Monastery .

source_bert_toks: the statue and a small museum are on a peak , up 268 steps , above po lin monastery .

reference_raw: The statue and the little museum are at the top of the mountain, up 268 stairs, over the Monastery of Po Lin.

reference_spacy_tokens: The statue and the little museum are at the top of the mountain , up 268 stairs , over the Monastery of Po Lin .


fn_spacy_tokens_for_baseline: In the traditional natural sciences generality is achieved in two different ways , each based upon a particular choice of the informal inverse relation between the intension and extension of a class .

source_bert_toks: in the traditional natural sciences general ##ity is achieved in two different ways , each based upon a particular choice of the informal inverse relation between the int ##ens ##ion and extension of a class .

reference_raw: In traditional sciences, generality is achieved in two different ways, each based on a specific selection of the informal inverse relationship between the intensity and extension of the class.

reference_spacy_tokens: In traditional sciences , generality is achieved in two different ways , each based on a specific selection of the informal inverse relationship between the intensity and extension of the class .


fn_spacy_tokens_for_baseline: The resulting ' plant " has its own habitat requirements and unique reproductive structures , as if it was a single biological entity .

source_bert_toks: the resulting ' plant " has its own habitat requirements and unique reproductive structures , as if it was a single biological entity .

reference_raw: The resulting "plant" has its own habitat requirements and unique reproductive structures, as if it were a single biological unit.

reference_spacy_tokens: The resulting " plant " has its own habitat requirements and unique reproductive structures , as if it were a single biological unit .


fn_spacy_tokens_for_baseline: It was the first report of an improvement in Mandela 's condition since he was admitted to a hospital in Pretoria early Saturday after suffering a recurrence of a persistent lung ailment , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

source_bert_toks: it was the first report of an improvement in mandela ' s condition since he was admitted to a hospital in pretoria early saturday after suffering a rec ##ur ##rence of a persistent lung ai ##lm ##ent , a legacy of the tuberculosis he contracted during the 27 years he was imprisoned for opposing apartheid .

reference_raw: It was the first report that Mandela's condition had improved since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease, a legacy of the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid.

reference_spacy_tokens: It was the first report that Mandela 's condition had improved since he had been admitted to a hospital in Pretoria at the beginning of Saturday after he had suffered a recurrence of persistent lung disease , a legacy of the tuberculosis he had contracted during the 27 years he had been arrested for opposition to apartheid .


fn_spacy_tokens_for_baseline: At about 8:30 ( eastern time ) firefighters were called to the home on 48 Granger Place to put out a fire that had started in the basement .

source_bert_toks: at about 8 : 30 ( eastern time ) firefighters were called to the home on 48 grange ##r place to put out a fire that had started in the basement .

reference_raw: About 8:30 (east time) the firemen were summoned to the house at 48 Granger Place to extinguish the fire that had begun in the cellar.

reference_spacy_tokens: About 8:30 ( east time ) the firemen were summoned to the house at 48 Granger Place to extinguish the fire that had begun in the cellar .


fn_spacy_tokens_for_baseline: Since the construction of trenches here was so difficult , the Germans constructed concrete blockhouses , or pillboxes .

source_bert_toks: since the construction of trenches here was so difficult , the germans constructed concrete block ##houses , or pill ##box ##es .

reference_raw: Because it was so difficult to build trenches here, the Germans built concrete blocks or pillboxes.

reference_spacy_tokens: Because it was so difficult to build trenches here , the Germans built concrete blocks or pillboxes .


fn_spacy_tokens_for_baseline: I was on welfare and without my diploma .

source_bert_toks: i was on welfare and without my diploma .

reference_raw: I was on welfare and I didn't have a degree.

reference_spacy_tokens: I was on welfare and I did n't have a degree .


fn_spacy_tokens_for_baseline: While appearing with them in Berlin in 1937 she tore a ligament and had to give up further hope of dancing .

source_bert_toks: while appearing with them in berlin in 1937 she tore a ligament and had to give up further hope of dancing .

reference_raw: When she showed up in Berlin in 1937, she ripped off the ligament and had to give up hope of dancing.

reference_spacy_tokens: When she showed up in Berlin in 1937 , she ripped off the ligament and had to give up hope of dancing .


fn_spacy_tokens_for_baseline: And while multinational chains have made inroads , they seem less blatant here than elsewhere .

source_bert_toks: and while multinational chains have made in ##ro ##ads , they seem less b ##lat ##ant here than elsewhere .

reference_raw: And even though international chains have made road trips, they seem less shameful here than elsewhere.

reference_spacy_tokens: And even though international chains have made road trips , they seem less shameful here than elsewhere .


fn_spacy_tokens_for_baseline: It would bring about the development of an indigenous Iranian missile industry , two " wars of the cities , " and the evolution of a strategic concept concerning the military and political importance of ballistic missiles .

source_bert_toks: it would bring about the development of an indigenous iranian missile industry , two " wars of the cities , " and the evolution of a strategic concept concerning the military and political importance of ballistic missiles .

reference_raw: This would lead to the development of a domestic Iranian missile industry, two "town wars," and the development of a strategic concept on the military and political importance of ballistic missiles.

reference_spacy_tokens: This would lead to the development of a domestic Iranian missile industry , two " town wars , " and the development of a strategic concept on the military and political importance of ballistic missiles .


fn_spacy_tokens_for_baseline: Harry could see the sun glistening on the naked patches of her body although she had not yet removed her undergarments .

source_bert_toks: harry could see the sun glistening on the naked patches of her body although she had not yet removed her under ##gar ##ments .

reference_raw: Harry could see the sun gleaming on the naked patches of her body, though she hadn't taken off her underwear yet.

reference_spacy_tokens: Harry could see the sun gleaming on the naked patches of her body , though she had n't taken off her underwear yet .


fn_spacy_tokens_for_baseline: A judge said Tuesday he will not order the release of Llamas unless his bond is paid .

source_bert_toks: a judge said tuesday he will not order the release of ll ##ama ##s unless his bond is paid .

reference_raw: The judge said Tuesday he wouldn't order the release of Llamas if he didn't pay his debt.

reference_spacy_tokens: The judge said Tuesday he would n't order the release of Llamas if he did n't pay his debt .


fn_spacy_tokens_for_baseline: He held up his candle before an extraordinary object which stood at the back of the dresser .

source_bert_toks: he held up his candle before an extraordinary object which stood at the back of the dresser .

reference_raw: He raised the candle in front of a strange object standing in the back of the closet.

reference_spacy_tokens: He raised the candle in front of a strange object standing in the back of the closet .


fn_spacy_tokens_for_baseline: ' He is responsible for the sabotage on the Base and he has implicated himself by trying to escape , ' Bishop said harshly .

source_bert_toks: ' he is responsible for the sabotage on the base and he has implicated himself by trying to escape , ' bishop said harshly .

reference_raw: 'He's responsible for the bombing of the base, and he's involved in his escape attempt,' said Bishop harshly.

reference_spacy_tokens: ' He 's responsible for the bombing of the base , and he 's involved in his escape attempt , ' said Bishop harshly .


fn_spacy_tokens_for_baseline: The breeze tugged at her hair , pulled it loose from its bun .

source_bert_toks: the breeze tugged at her hair , pulled it loose from its bun .

reference_raw: The wind pulled at her hair and pulled it out of the bun.

reference_spacy_tokens: The wind pulled at her hair and pulled it out of the bun .


fn_spacy_tokens_for_baseline: Crisp yellow leaves scrunched satisfyingly underfoot , giving off a sweet sad scent .

source_bert_toks: crisp yellow leaves sc ##run ##ched satisfying ##ly under ##foot , giving off a sweet sad scent .

reference_raw: The crisp yellow leaves scrabbled comfortably underfoot and gave off a sweet, sad smell.

reference_spacy_tokens: The crisp yellow leaves scrabbled comfortably underfoot and gave off a sweet , sad smell .


fn_spacy_tokens_for_baseline: The quivers move through my house every few minutes at unpredictable intervals , and the mouse that 's been living in my kitchen has taken refuge under my desk .

source_bert_toks: the quiver ##s move through my house every few minutes at unpredictable intervals , and the mouse that ' s been living in my kitchen has taken refuge under my desk .

reference_raw: The tremors move through my house every few minutes at unpredictable intervals, and the mouse who lived in my kitchen hid under my desk.

reference_spacy_tokens: The tremors move through my house every few minutes at unpredictable intervals , and the mouse who lived in my kitchen hid under my desk .


fn_spacy_tokens_for_baseline: Dai - Siu ( Big and Small ) is a dice game in which the croupier throws three dice inside a glass container .

source_bert_toks: dai - si ##u ( big and small ) is a dice game in which the cr ##ou ##pie ##r throws three dice inside a glass container .

reference_raw: Dai-Siu (Big and Small) is a dice game where a croupier throws three cubes into a jar.

reference_spacy_tokens: Dai - Siu ( Big and Small ) is a dice game where a croupier throws three cubes into a jar .


fn_spacy_tokens_for_baseline: Lionfish have venom glands at the base of the dorsal fine spines and the sting can prove very serious and excruciatingly painful although there is no record of it causing any human fatalities

source_bert_toks: lion ##fish have venom glands at the base of the dorsal fine spines and the sting can prove very serious and ex ##cr ##uc ##iating ##ly painful although there is no record of it causing any human fatalities

reference_raw: Lionfish have poison glands at the bottom of the dorsal fine backbones, and the sting can be very serious and painful, even if there is no record of any human death.

reference_spacy_tokens: Lionfish have poison glands at the bottom of the dorsal fine backbones , and the sting can be very serious and painful , even if there is no record of any human death .


fn_spacy_tokens_for_baseline: An example is the experiment conducted by Rosenhan and his colleagues ( Rosenhan 1973 ) .

source_bert_toks: an example is the experiment conducted by rosen ##han and his colleagues ( rosen ##han 1973 ) .

reference_raw: An example is that of Rosenhan and his colleagues (Rosenhan 1973).

reference_spacy_tokens: An example is that of Rosenhan and his colleagues ( Rosenhan 1973 ) .


fn_spacy_tokens_for_baseline: Please use the enclosed envelope to give a generous gift to Goodwill today !

source_bert_toks: please use the enclosed envelope to give a generous gift to goodwill today !

reference_raw: Please use the sealed envelope to give Goodwill a generous present today!

reference_spacy_tokens: Please use the sealed envelope to give Goodwill a generous present today !


fn_spacy_tokens_for_baseline: Something even more expensive that the gold locket .

source_bert_toks: something even more expensive that the gold locke ##t .

reference_raw: Something even more expensive than a gold medallion.

reference_spacy_tokens: Something even more expensive than a gold medallion .


fn_spacy_tokens_for_baseline: Talk turns to the night before when we were woken as the convoy hit a sandbank with such force that the steel cables holding it together were torn loose .

source_bert_toks: talk turns to the night before when we were woken as the convoy hit a sand ##bank with such force that the steel cables holding it together were torn loose .

reference_raw: The conversation turns to the night before, when we were awakened, when the convoy struck the sand bank with such force that the steel cables that held it together were torn free.

reference_spacy_tokens: The conversation turns to the night before , when we were awakened , when the convoy struck the sand bank with such force that the steel cables that held it together were torn free .


fn_spacy_tokens_for_baseline: She mistook ' sha n't ' for ' shall ' and proceeded to give thought and time to the preparation of a delicious meal .

source_bert_toks: she mist ##ook ' shan ' t ' for ' shall ' and proceeded to give thought and time to the preparation of a delicious meal .

reference_raw: She mistook 'shan't' for 'shall' and continued to think and give time to prepare a tasty meal.

reference_spacy_tokens: She mistook ' sha n't ' for ' shall ' and continued to think and give time to prepare a tasty meal .


fn_spacy_tokens_for_baseline: At the time of Pentecost they appear to have numbered around four thousand ( dependent on Josephus , Philo and Pliny ) and to have established communities in most of the villages of Palestine .

source_bert_toks: at the time of pen ##tec ##ost they appear to have numbered around four thousand ( dependent on joseph ##us , phil ##o and pl ##iny ) and to have established communities in most of the villages of palestine .

reference_raw: At the time of Pentecost, it appears that they were around 4,000 (dependent on Josephus, Philo, and Pliny) and that most of the villages in Palestine had established communities.

reference_spacy_tokens: At the time of Pentecost , it appears that they were around 4,000 ( dependent on Josephus , Philo , and Pliny ) and that most of the villages in Palestine had established communities .


fn_spacy_tokens_for_baseline: She crept down toward the stink of blood .

source_bert_toks: she crept down toward the stink of blood .

reference_raw: She crawled down to the smell of blood.

reference_spacy_tokens: She crawled down to the smell of blood .


fn_spacy_tokens_for_baseline: ' The Author ! ' he snorted , out loud , mocking himself .

source_bert_toks: ' the author ! ' he snorted , out loud , mocking himself .

reference_raw: "The Author!" he sniffed aloud, mocking himself.

reference_spacy_tokens: " The Author ! " he sniffed aloud , mocking himself .


fn_spacy_tokens_for_baseline: And of course a familiar populist complaint about modernist fiction is that it does not communicate its meaning to the reader in a clear and comprehensible way .

source_bert_toks: and of course a familiar pop ##uli ##st complaint about modernist fiction is that it does not communicate its meaning to the reader in a clear and com ##pre ##hen ##sible way .

reference_raw: And, of course, a well-known populist complaint about modernist fiction is that it does not convey its meaning to the reader in a clear and understandable way.

reference_spacy_tokens: And , of course , a well - known populist complaint about modernist fiction is that it does not convey its meaning to the reader in a clear and understandable way .


fn_spacy_tokens_for_baseline: If you are trans - racially fostered or adopted , or feel the legal system mistreated you when your parents separated , phone 01 359 9392 .

source_bert_toks: if you are trans - racial ##ly foster ##ed or adopted , or feel the legal system mist ##reate ##d you when your parents separated , phone 01 35 ##9 93 ##9 ##2 .

reference_raw: If you have trans-racial support or adoption, or if you feel that the legal system has mistreated you when your parents split up, call 01 359 9392.

reference_spacy_tokens: If you have trans - racial support or adoption , or if you feel that the legal system has mistreated you when your parents split up , call 01 359 9392 .


fn_spacy_tokens_for_baseline: This technology has proven successful in our licence to Chevron at Cedar Bayou in the USA .

source_bert_toks: this technology has proven successful in our licence to che ##vron at cedar bayou in the usa .

reference_raw: This technology has proved to be a success in our license to Chevron at Cedar Bay in the United States.

reference_spacy_tokens: This technology has proved to be a success in our license to Chevron at Cedar Bay in the United States .


fn_spacy_tokens_for_baseline: Her hair was loose , falling in thick waves to her waist , a dark frame for her exquisite face , with its delicate bone - structure , softly curving mouth and expressive clear grey eyes .

source_bert_toks: her hair was loose , falling in thick waves to her waist , a dark frame for her exquisite face , with its delicate bone - structure , softly curving mouth and expressive clear grey eyes .

reference_raw: Her hair was loose, falling to her waist in thick ripples, the dark frame of her beautiful face, with a delicate bone structure, a gently curved mouth, and clear gray eyes.

reference_spacy_tokens: Her hair was loose , falling to her waist in thick ripples , the dark frame of her beautiful face , with a delicate bone structure , a gently curved mouth , and clear gray eyes .


fn_spacy_tokens_for_baseline: He was handcuffed to another prisoner and placed in an army , armoured personnel carrier .

source_bert_toks: he was hand ##cu ##ffed to another prisoner and placed in an army , armoured personnel carrier .

reference_raw: He was chained to another prisoner and placed in an army, an armored personnel carrier.

reference_spacy_tokens: He was chained to another prisoner and placed in an army , an armored personnel carrier .


fn_spacy_tokens_for_baseline: To do so invites a human and ecological catastrophe

source_bert_toks: to do so invites a human and ecological catastrophe

reference_raw: This calls for a human and environmental disaster


fn_spacy_tokens_for_baseline: At the entrance of the Mansour Hotel , Hall made a brief statement , saying that he came to Iraq because he has heard for a long time about the humanitarian situation here , especially the malnutrition among the Iraqi children and the increasing mortality rate of the children and the elderly .

source_bert_toks: at the entrance of the mans ##our hotel , hall made a brief statement , saying that he came to iraq because he has heard for a long time about the humanitarian situation here , especially the mal ##nut ##rit ##ion among the iraqi children and the increasing mortality rate of the children and the elderly .

reference_raw: Hall made a brief statement at the entrance to the Mansour Hotel, saying that he had come to Iraq because he had heard for a long time about the humanitarian situation here, in particular the malnutrition of Iraqi children and the increasing mortality rate of children and older people.

reference_spacy_tokens: Hall made a brief statement at the entrance to the Mansour Hotel , saying that he had come to Iraq because he had heard for a long time about the humanitarian situation here , in particular the malnutrition of Iraqi children and the increasing mortality rate of children and older people .


fn_spacy_tokens_for_baseline: Bavarians are somewhat chagrined that their last hope may lie in distant Berlin , in cool - blooded northern Germany , where the country 's top civil appeals court may hear the case .

source_bert_toks: bavarian ##s are somewhat cha ##grin ##ed that their last hope may lie in distant berlin , in cool - blooded northern germany , where the country ' s top civil appeals court may hear the case .

reference_raw: The Bavarians are somewhat confused that their last hope may lie in remote Berlin, in cold-blooded northern Germany, where the best civil appeal court in the country can hear the case.

reference_spacy_tokens: The Bavarians are somewhat confused that their last hope may lie in remote Berlin , in cold - blooded northern Germany , where the best civil appeal court in the country can hear the case .


fn_spacy_tokens_for_baseline: Police were given the slip during the night but the Porsche was sighted again Monday morning near Diepholz , about 140 kilometers ( 87 miles ) west of Celle .

source_bert_toks: police were given the slip during the night but the porsche was sighted again monday morning near die ##ph ##ol ##z , about 140 kilometers ( 87 miles ) west of cell ##e .

reference_raw: The police got a slip in the middle of the night, but the Porsche was spotted again Monday morning near Diepholz, about 140 kilometers (87 miles) west of Celle.

reference_spacy_tokens: The police got a slip in the middle of the night , but the Porsche was spotted again Monday morning near Diepholz , about 140 kilometers ( 87 miles ) west of Celle .


fn_spacy_tokens_for_baseline: Perhaps more important , such high - end accommodations raise the standards of expectations back to the mythology of the Rat Pack era .

source_bert_toks: perhaps more important , such high - end accommodations raise the standards of expectations back to the mythology of the rat pack era .

reference_raw: Perhaps more importantly, such high-end accommodations raise the standard of anticipation back to the mythology of the Rat Pack era.

reference_spacy_tokens: Perhaps more importantly , such high - end accommodations raise the standard of anticipation back to the mythology of the Rat Pack era .


fn_spacy_tokens_for_baseline: " I rode a bike to Goodwill in the rain and snow .

source_bert_toks: " i rode a bike to goodwill in the rain and snow .

reference_raw: "In the rain and snow, I drove my bike to Goodwill.

reference_spacy_tokens: " In the rain and snow , I drove my bike to Goodwill .


fn_spacy_tokens_for_baseline: He found himself along the bank of a low , wide stream and allowed himself to follow its current .

source_bert_toks: he found himself along the bank of a low , wide stream and allowed himself to follow its current .

reference_raw: He reached the bank of a low, wide stream and allowed himself to follow it.

reference_spacy_tokens: He reached the bank of a low , wide stream and allowed himself to follow it .


fn_spacy_tokens_for_baseline: By the spring of 1994 , the reactor core was burned up , and the spent fuel rods had to be discharged .

source_bert_toks: by the spring of 1994 , the reactor core was burned up , and the spent fuel rods had to be discharged .

reference_raw: In the spring of 1994, the reactor nucleus had been burned and the spent fuel rods had to be released.

reference_spacy_tokens: In the spring of 1994 , the reactor nucleus had been burned and the spent fuel rods had to be released .


fn_spacy_tokens_for_baseline: ' They were out of work and underprivileged and now they are working for cut rates . '

source_bert_toks: ' they were out of work and under ##pr ##iv ##ile ##ged and now they are working for cut rates . '

reference_raw: "They've lost their jobs and lost their privileges, and now they're working on lower rates."

reference_spacy_tokens: " They 've lost their jobs and lost their privileges , and now they 're working on lower rates . "


fn_spacy_tokens_for_baseline: ' And hurry up , Tommy , if you do n't want this lad to croak . '

source_bert_toks: ' and hurry up , tommy , if you don ' t want this lad to cr ##oa ##k . '

reference_raw: 'And hurry, Tommy, unless you want the boy to squeal.'

reference_spacy_tokens: ' And hurry , Tommy , unless you want the boy to squeal . '


fn_spacy_tokens_for_baseline: To lessen the risk and cost of developing new versions of Windows for everything from PDAs to combined PC - TVs , Mr Gates is entering into a slew of joint ventures .

source_bert_toks: to less ##en the risk and cost of developing new versions of windows for everything from pd ##as to combined pc - tv ##s , mr gates is entering into a sl ##ew of joint ventures .

reference_raw: In order to reduce the risk and costs of developing new versions of Windows for everything from PDAs to combined PC-TVs, Mr Gates enters into a series of joint ventures.

reference_spacy_tokens: In order to reduce the risk and costs of developing new versions of Windows for everything from PDAs to combined PC - TVs , Mr Gates enters into a series of joint ventures .


fn_spacy_tokens_for_baseline: In only one presidential election year prior to 1948 did more than 20 % of the nation 's congressional districts choose a different party 's candidate for the White House than for the House of Representatives .

source_bert_toks: in only one presidential election year prior to 1948 did more than 20 % of the nation ' s congressional districts choose a different party ' s candidate for the white house than for the house of representatives .

reference_raw: In just one presidential year before 1948, more than 20% of the national congressional districts chose another party candidate for the White House than for the House of Representatives.

reference_spacy_tokens: In just one presidential year before 1948 , more than 20 % of the national congressional districts chose another party candidate for the White House than for the House of Representatives .


fn_spacy_tokens_for_baseline: 8:01 a.m. HLR : Judy and I were in our back yard when the lawn started rolling like ocean waves .

source_bert_toks: 8 : 01 a . m . h ##lr : judy and i were in our back yard when the lawn started rolling like ocean waves .

reference_raw: 8:01 A.M. HLR: Judy and I were in the backyard when the lawn began to turn like ocean waves.

reference_spacy_tokens: 8:01 A.M. HLR : Judy and I were in the backyard when the lawn began to turn like ocean waves .


fn_spacy_tokens_for_baseline: Land speculators and locals alike were anxious to own a part of the newest railroad boomtown , and within an afternoon , more than 80 percent of the lots were sold .

source_bert_toks: land spec ##ulator ##s and locals alike were anxious to own a part of the newest railroad boom ##town , and within an afternoon , more than 80 percent of the lots were sold .

reference_raw: Land speculators and townspeople were eager to own part of the newest railway boomtown, and in the afternoon over 80% of the lots were sold.

reference_spacy_tokens: Land speculators and townspeople were eager to own part of the newest railway boomtown , and in the afternoon over 80 % of the lots were sold .


fn_spacy_tokens_for_baseline: Her head hung listlessly upon her breast , but as she raised it and turned her dull eyes upon us I saw that her pupils were dark dots in the centre of the broad gray iris .

source_bert_toks: her head hung list ##lessly upon her breast , but as she raised it and turned her dull eyes upon us i saw that her pupils were dark dots in the centre of the broad gray iris .

reference_raw: Her head hung indifferently on her chest, but when she lifted it and turned her dull eyes on us, I could see that her eyes were dark dots in the center of the wide gray iris.

reference_spacy_tokens: Her head hung indifferently on her chest , but when she lifted it and turned her dull eyes on us , I could see that her eyes were dark dots in the center of the wide gray iris .


fn_spacy_tokens_for_baseline: In 1959 , North Korea and the USSR signed an agreement on the peaceful use of nuclear energy that included a provision for Soviet help to establishment a nuclear research complex in Yo ( ngbyo ( n - kun , North P'yo ( ng'an Province .

source_bert_toks: in 1959 , north korea and the ussr signed an agreement on the peaceful use of nuclear energy that included a provision for soviet help to establishment a nuclear research complex in yo ( ng ##by ##o ( n - kun , north p ' yo ( ng ' an province .

reference_raw: In 1959, North Korea and the Soviet Union signed an agreement on the peaceful use of nuclear energy, including a clause for the Soviets to help set up a nuclear research complex in Yo (N-Kun, North P'yo).

reference_spacy_tokens: In 1959 , North Korea and the Soviet Union signed an agreement on the peaceful use of nuclear energy , including a clause for the Soviets to help set up a nuclear research complex in Yo ( N - Kun , North P'yo ) .


fn_spacy_tokens_for_baseline: 5- The brother who wants to leave AL - QAEDA without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

source_bert_toks: 5 - the brother who wants to leave al - qaeda without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

reference_raw: 5- A brother who wishes to depart AL-QAEDA without a legitimate justification shall not be eligible for financial assistance or any of the privileges mentioned above.

reference_spacy_tokens: 5- A brother who wishes to depart AL - QAEDA without a legitimate justification shall not be eligible for financial assistance or any of the privileges mentioned above .


fn_spacy_tokens_for_baseline: Parents act as role models of self - sufficiency instead of dependency .

source_bert_toks: parents act as role models of self - su ##ffi ##ciency instead of dependency .

reference_raw: Parents act like models of self-sufficiency, not dependency.

reference_spacy_tokens: Parents act like models of self - sufficiency , not dependency .


fn_spacy_tokens_for_baseline: The above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

source_bert_toks: the above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

reference_raw: The above-mentioned protection procedures are for observation purposes only, whereas patrols control fences, barriers and towers and report regularly on their findings.

reference_spacy_tokens: The above - mentioned protection procedures are for observation purposes only , whereas patrols control fences , barriers and towers and report regularly on their findings .


fn_spacy_tokens_for_baseline: Among the most engrossing parts of this book are those which demonstrate the confusion of Wells 's thought as he seeks to evade conflict , for instance by proving that ethics and evolution are one .

source_bert_toks: among the most eng ##ross ##ing parts of this book are those which demonstrate the confusion of wells ' s thought as he seeks to evade conflict , for instance by proving that ethics and evolution are one .

reference_raw: Among the most intriguing parts of the book are those that demonstrate the confusion of Wells' thoughts in his attempt to avoid conflict, for example by demonstrating that ethics and evolution are one of them.

reference_spacy_tokens: Among the most intriguing parts of the book are those that demonstrate the confusion of Wells ' thoughts in his attempt to avoid conflict , for example by demonstrating that ethics and evolution are one of them .


fn_spacy_tokens_for_baseline: Let them dry thoroughly , tack them onto a wall and note the difference in colour shade , value and vibrancy .

source_bert_toks: let them dry thoroughly , tack them onto a wall and note the difference in colour shade , value and vi ##bra ##ncy .

reference_raw: Allow them to dry thoroughly, place them on the wall, and notice the difference in colour, value, and vibrance.

reference_spacy_tokens: Allow them to dry thoroughly , place them on the wall , and notice the difference in colour , value , and vibrance .


fn_spacy_tokens_for_baseline: Years of breeding were in that voice , as if her forefathers spoke through her , all those who had been lords here when Master Higham 's kin had been peasants .

source_bert_toks: years of breeding were in that voice , as if her fore ##fat ##hers spoke through her , all those who had been lords here when master high ##am ' s kin had been peasants .

reference_raw: There were years of breeding in that voice, as if her ancestors had spoken through it, all those who were lords here when Master Higham's kin were peasants.

reference_spacy_tokens: There were years of breeding in that voice , as if her ancestors had spoken through it , all those who were lords here when Master Higham 's kin were peasants .


fn_spacy_tokens_for_baseline: It takes 10 minutes to reach the arch , slogging through the filth and scum .

source_bert_toks: it takes 10 minutes to reach the arch , sl ##og ##ging through the fi ##lth and sc ##um .

reference_raw: It takes ten minutes to get to the arc, slugging through dirt and dirt.

reference_spacy_tokens: It takes ten minutes to get to the arc , slugging through dirt and dirt .


fn_spacy_tokens_for_baseline: His teeth chattered and he whimpered .

source_bert_toks: his teeth chatter ##ed and he whimpered .

reference_raw: His teeth rattled and he whined.

reference_spacy_tokens: His teeth rattled and he whined .


fn_spacy_tokens_for_baseline: As they entered the gloomy vestibule , Father Connor reached into his cupboard and poured two very decent measures of whisky into a pair of tumblers .

source_bert_toks: as they entered the gloom ##y vest ##ib ##ule , father connor reached into his cupboard and poured two very decent measures of whisky into a pair of tumble ##rs .

reference_raw: As they entered the gloomy lobby, Father Connor reached into his closet and poured two very good measures of whiskey into the tumblers.

reference_spacy_tokens: As they entered the gloomy lobby , Father Connor reached into his closet and poured two very good measures of whiskey into the tumblers .


fn_spacy_tokens_for_baseline: For a cool shady corner which gets sun at some time during the day , comfrey , sorrel , costmary , alkanet and chervil would do well , and for perfume , the container could include Rosa damascena , pinks , mignonette , honeysuckle or jasmine , and wallflowers , herbs which release their fragrance into the air .

source_bert_toks: for a cool shady corner which gets sun at some time during the day , com ##frey , so ##rre ##l , cost ##mar ##y , al ##kan ##et and cher ##vil would do well , and for perfume , the container could include rosa dam ##as ##cen ##a , pink ##s , mig ##non ##ette , honey ##su ##ckle or jasmine , and wall ##flower ##s , herbs which release their fragrance into the air .

reference_raw: Comfrey, sorrel, costmary, alkanet and chervil would do well for a cold, shadowy corner, and in the case of perfume, the container could contain Rosa Damascena, pinks, mignonette, honeysuckle or jasmine, and wallflowers, herbs that release their scent into the air.

reference_spacy_tokens: Comfrey , sorrel , costmary , alkanet and chervil would do well for a cold , shadowy corner , and in the case of perfume , the container could contain Rosa Damascena , pinks , mignonette , honeysuckle or jasmine , and wallflowers , herbs that release their scent into the air .


fn_spacy_tokens_for_baseline: Importantly , stutterers were reported to have read most single words fluently .

source_bert_toks: importantly , stu ##tter ##ers were reported to have read most single words fluent ##ly .

reference_raw: It was important to note that the stutterers were fluent in most of the words.

reference_spacy_tokens: It was important to note that the stutterers were fluent in most of the words .


fn_spacy_tokens_for_baseline: When I went to live in the attic , Jean - Claude still took it for granted that the wood he needed for the stove should be filched from the railway sidings .

source_bert_toks: when i went to live in the attic , jean - claude still took it for granted that the wood he needed for the stove should be fi ##lch ##ed from the railway siding ##s .

reference_raw: When I went to live in the loft, Jean-Claude took it for granted that the wood he needed for the stove had to be filled from the rails.

reference_spacy_tokens: When I went to live in the loft , Jean - Claude took it for granted that the wood he needed for the stove had to be filled from the rails .


fn_spacy_tokens_for_baseline: He is not telling them to disband and regulate their weapons , so I have no faith in the ability of Abu Mazen to put terror aside .

source_bert_toks: he is not telling them to di ##sb ##and and regulate their weapons , so i have no faith in the ability of abu maze ##n to put terror aside .

reference_raw: He doesn't tell them to disband and regulate their weapons, so I don't believe Abu Mazen can put terror aside.

reference_spacy_tokens: He does n't tell them to disband and regulate their weapons , so I do n't believe Abu Mazen can put terror aside .


fn_spacy_tokens_for_baseline: Hazel and his friends conferred .

source_bert_toks: hazel and his friends conferred .

reference_raw: Hazel and his friends were talking to each other.

reference_spacy_tokens: Hazel and his friends were talking to each other .


fn_spacy_tokens_for_baseline: ' That must be a comfort , ' rejoined Ella , as she shut the kitchen door behind her .

source_bert_toks: ' that must be a comfort , ' rejoined ella , as she shut the kitchen door behind her .

reference_raw: 'It must be comforting,' said Ella, closing the kitchen door behind her.

reference_spacy_tokens: ' It must be comforting , ' said Ella , closing the kitchen door behind her .


fn_spacy_tokens_for_baseline: The Iraqi government has agreed to let U.S. Rep. Tony Hall visit the country next week to assess a humanitarian crisis that has festered since the Gulf War of 1990 , Hall 's office said Monday .

source_bert_toks: the iraqi government has agreed to let u . s . rep . tony hall visit the country next week to assess a humanitarian crisis that has fest ##ered since the gulf war of 1990 , hall ' s office said monday .

reference_raw: The Iraqi government has agreed to allow U.S. Deputy Tony Hall to visit the country next week to assess the humanitarian crisis that has been spreading since the Gulf War of 1990, according to Hall's office on Monday.

reference_spacy_tokens: The Iraqi government has agreed to allow U.S. Deputy Tony Hall to visit the country next week to assess the humanitarian crisis that has been spreading since the Gulf War of 1990 , according to Hall 's office on Monday .


fn_spacy_tokens_for_baseline: This led Professor H.W.R. Wade to argue that it was nonsensical to have a legal theory which said that Parliament could pass laws on any subject without restriction .

source_bert_toks: this led professor h . w . r . wade to argue that it was non ##sen ##sic ##al to have a legal theory which said that parliament could pass laws on any subject without restriction .

reference_raw: That led Professor H.W.R. Wade to argue that there was no point in having a legal theory that the Parliament could pass laws on any subject without restriction.

reference_spacy_tokens: That led Professor H.W.R. Wade to argue that there was no point in having a legal theory that the Parliament could pass laws on any subject without restriction .


fn_spacy_tokens_for_baseline: The October sun dipped into the Atlantic , silhouetting the Paps of Jura as we shoved off into the sound toward Harry 's Island .

source_bert_toks: the october sun dipped into the atlantic , si ##lho ##uet ##ting the pa ##ps of ju ##ra as we shoved off into the sound toward harry ' s island .

reference_raw: The October sun sank into the Atlantic, silhouetting the Papas of Jura as we pushed into the sound toward Harry's Island.

reference_spacy_tokens: The October sun sank into the Atlantic , silhouetting the Papas of Jura as we pushed into the sound toward Harry 's Island .


fn_spacy_tokens_for_baseline: When she finally reached the top she agreed with a young couple from Leeds that it was worth it for the view , which was stupendous in spite of a slight heat haze that hung in the air .

source_bert_toks: when she finally reached the top she agreed with a young couple from leeds that it was worth it for the view , which was stu ##pen ##dou ##s in spite of a slight heat haze that hung in the air .

reference_raw: When she finally got to the top, she agreed with the young Leeds couple that it was worth the view, which was staggering despite the slight heat haze that hung in the air.

reference_spacy_tokens: When she finally got to the top , she agreed with the young Leeds couple that it was worth the view , which was staggering despite the slight heat haze that hung in the air .


fn_spacy_tokens_for_baseline: ' I 'm a ballet dancer , ' she said , and they laughed as she pattered across the floor on her tip - toes .

source_bert_toks: ' i ' m a ballet dancer , ' she said , and they laughed as she pat ##tered across the floor on her tip - toes .

reference_raw: "I'm a ballet dancer," she said, and they laughed as she patted the floor with her toes.

reference_spacy_tokens: " I 'm a ballet dancer , " she said , and they laughed as she patted the floor with her toes .


fn_spacy_tokens_for_baseline: On this , their second Irish tour , they are joined by ex - Hotfoot guitar wizard Jimmy Faulkner .

source_bert_toks: on this , their second irish tour , they are joined by ex - hot ##foot guitar wizard jimmy faulkner .

reference_raw: On this, their second Irish tour, the ex-Hotfoot guitar magician, Jimmy Faulkner, joins them.

reference_spacy_tokens: On this , their second Irish tour , the ex - Hotfoot guitar magician , Jimmy Faulkner , joins them .


fn_spacy_tokens_for_baseline: One expert , whose job is so politically sensitive that he spoke on condition that he would n't be named or quoted , said the expected influx of East European refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

source_bert_toks: one expert , whose job is so politically sensitive that he spoke on condition that he wouldn ' t be named or quoted , said the expected influx of east european refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

reference_raw: One expert, whose work is politically sensitive enough to speak on the condition that he is not named or quoted, said that the expected inflow of Eastern European refugees over the next few years would greatly increase the chances of computer-protection workers, for example, doubling as foreign spies.

reference_spacy_tokens: One expert , whose work is politically sensitive enough to speak on the condition that he is not named or quoted , said that the expected inflow of Eastern European refugees over the next few years would greatly increase the chances of computer - protection workers , for example , doubling as foreign spies .


fn_spacy_tokens_for_baseline: Subsequently , the folds fuse , transforming the neural plate into a closed tube running the length of the embryo .

source_bert_toks: subsequently , the folds fuse , transforming the neural plate into a closed tube running the length of the embryo .

reference_raw: Then the folds melt, transforming the nerve plate into a closed tube that runs the length of the embryo.

reference_spacy_tokens: Then the folds melt , transforming the nerve plate into a closed tube that runs the length of the embryo .


fn_spacy_tokens_for_baseline: Its gold nylon curls had been yanked out .

source_bert_toks: its gold nylon curls had been yanked out .

reference_raw: His golden nylon curls were pulled out.

reference_spacy_tokens: His golden nylon curls were pulled out .


fn_spacy_tokens_for_baseline: QN : Is Iran a signatory to the Chemical Weapons Convention ( CWC ) ?

source_bert_toks: q ##n : is iran a sign ##atory to the chemical weapons convention ( cw ##c ) ?

reference_raw: QN: Is Iran a party to the Convention on Chemical Weapons?

reference_spacy_tokens: QN : Is Iran a party to the Convention on Chemical Weapons ?


fn_spacy_tokens_for_baseline: Within this novelettish framework the play veers from loopy comedy to serious moralising , from sub - Wildean epigrams ( some of them quite funny ) to horticultural symbolism .

source_bert_toks: within this novel ##etti ##sh framework the play ve ##ers from loop ##y comedy to serious moral ##ising , from sub - wilde ##an ep ##ig ##ram ##s ( some of them quite funny ) to horticultural symbolism .

reference_raw: In this new context, the game goes from a loopy comedy to a serious moralization, from a sub-Wildean epigraph (some of which are quite amusing) to a horticultural symbolism.

reference_spacy_tokens: In this new context , the game goes from a loopy comedy to a serious moralization , from a sub - Wildean epigraph ( some of which are quite amusing ) to a horticultural symbolism .


fn_spacy_tokens_for_baseline: On Wan Chai 's Bowen Road , Maiden 's Rock , also called Lover 's Rock , is the gathering place for the annual Maiden 's festival .

source_bert_toks: on wan cha ##i ' s bowen road , maiden ' s rock , also called lover ' s rock , is the gathering place for the annual maiden ' s festival .

reference_raw: On the Bowen Road of Wan Chai, the Maiden Rock, also known as the Lover's Rock, is a meeting place for the annual Maiden Festival.

reference_spacy_tokens: On the Bowen Road of Wan Chai , the Maiden Rock , also known as the Lover 's Rock , is a meeting place for the annual Maiden Festival .


fn_spacy_tokens_for_baseline: We pour another glass and vent our spleen on drug barons and dope fiends .

source_bert_toks: we pour another glass and vent our sp ##leen on drug barons and do ##pe fi ##end ##s .

reference_raw: We'll pour another glass and vent our spleen on the drug barons and drug lords.

reference_spacy_tokens: We 'll pour another glass and vent our spleen on the drug barons and drug lords .


fn_spacy_tokens_for_baseline: In addition , since all known Iranian nuclear facilities are under IAEA monitoring , Beijing views US demands that China suspend all its nuclear cooperation programs with Iran as unreasonable and contrary to Article IV of the NPT .

source_bert_toks: in addition , since all known iranian nuclear facilities are under ia ##ea monitoring , beijing views us demands that china suspend all its nuclear cooperation programs with iran as unreasonable and contrary to article iv of the np ##t .

reference_raw: Moreover, since all known Iranian nuclear facilities are under the control of the IAEA, Beijing considers that the US requires China to suspend all its nuclear cooperation programmes with Iran as disproportionate and in violation of Article IV of the NPT.

reference_spacy_tokens: Moreover , since all known Iranian nuclear facilities are under the control of the IAEA , Beijing considers that the US requires China to suspend all its nuclear cooperation programmes with Iran as disproportionate and in violation of Article IV of the NPT .


fn_spacy_tokens_for_baseline: Her hair -- her beautiful golden hair -- had been permanently waved , and lay in rigid loops along her cheeks .

source_bert_toks: her hair - - her beautiful golden hair - - had been permanently waved , and lay in rigid loops along her cheeks .

reference_raw: Her hair - her beautiful gold hair - was always wavering, and she lay in stiff nooses along her cheeks.

reference_spacy_tokens: Her hair - her beautiful gold hair - was always wavering , and she lay in stiff nooses along her cheeks .


fn_spacy_tokens_for_baseline: In the early 1990s -- according to reports from DPRK defectors -- the North Korean Foreign Ministry and the Ministry of the People 's Armed Forces debated over whether to join the Chemical Weapons Convention ( CWC ) .

source_bert_toks: in the early 1990s - - according to reports from d ##pr ##k defect ##ors - - the north korean foreign ministry and the ministry of the people ' s armed forces debated over whether to join the chemical weapons convention ( cw ##c ) .

reference_raw: In the early 1990s, according to reports from DPRK defectors, the Ministry of Foreign Affairs of North Korea and the Ministry of the People's Army discussed whether to join the Convention on Chemical Weapons (CWC).

reference_spacy_tokens: In the early 1990s , according to reports from DPRK defectors , the Ministry of Foreign Affairs of North Korea and the Ministry of the People 's Army discussed whether to join the Convention on Chemical Weapons ( CWC ) .


fn_spacy_tokens_for_baseline: Jesus was put on trial quickly and condemned to crucifixion , a Roman form of execution for political and religious dissidents as well as for common criminals .

source_bert_toks: jesus was put on trial quickly and condemned to cr ##uc ##if ##ix ##ion , a roman form of execution for political and religious di ##ssi ##dents as well as for common criminals .

reference_raw: Jesus was brought to justice quickly and sentenced to crucifixion, a Roman form of execution for both political and religious dissidents and ordinary criminals.

reference_spacy_tokens: Jesus was brought to justice quickly and sentenced to crucifixion , a Roman form of execution for both political and religious dissidents and ordinary criminals .


fn_spacy_tokens_for_baseline: The next morning his households and neighbors started talking to the tribe saying it was the national guards , they added that they heard some of them speaking English , meaning that the Americans are the ones who took Abu Dhari ( Sheik Nasr al - Fahdawi ) .

source_bert_toks: the next morning his households and neighbors started talking to the tribe saying it was the national guards , they added that they heard some of them speaking english , meaning that the americans are the ones who took abu dh ##ari ( she ##ik nas ##r al - fa ##hd ##aw ##i ) .

reference_raw: The next morning, his households and neighbours began talking to the tribe, saying it was the National Guard, and they added that they had heard some of them speak English, which meant that it was the Americans who had taken Abu Dhari (Sheik Nasr al-Fahdawi).

reference_spacy_tokens: The next morning , his households and neighbours began talking to the tribe , saying it was the National Guard , and they added that they had heard some of them speak English , which meant that it was the Americans who had taken Abu Dhari ( Sheik Nasr al - Fahdawi ) .


fn_spacy_tokens_for_baseline: We could not marry , but he has kept me in comfort ever since we became lovers and he fathered my two children .

source_bert_toks: we could not marry , but he has kept me in comfort ever since we became lovers and he father ##ed my two children .

reference_raw: We couldn't get married, but since we became lovers, he's kept me comfortable, and he's given birth to my two children.

reference_spacy_tokens: We could n't get married , but since we became lovers , he 's kept me comfortable , and he 's given birth to my two children .


fn_spacy_tokens_for_baseline: Our average intake of caffeine from tea and coffee is around 500 milligrams ( mg ) per day , enough to produce a significant effect .

source_bert_toks: our average intake of caf ##fe ##ine from tea and coffee is around 500 mill ##ig ##ram ##s ( mg ) per day , enough to produce a significant effect .

reference_raw: Our average intake of caffeine from tea and coffee is approximately 500 mg (mg) per day, which is sufficient to have a significant effect.

reference_spacy_tokens: Our average intake of caffeine from tea and coffee is approximately 500 mg ( mg ) per day , which is sufficient to have a significant effect .


fn_spacy_tokens_for_baseline: You 'll find that prices are about the same in Hong Kong Central and Kowloon , and somewhat cheaper in Causeway Bay , which caters to local shopping .

source_bert_toks: you ' ll find that prices are about the same in hong kong central and ko ##wl ##oon , and somewhat cheaper in causeway bay , which cater ##s to local shopping .

reference_raw: In Hong Kong Central and Kowloon, you'll find that prices are about the same, and a little cheaper in Causeway Bay, which caters for local purchases.

reference_spacy_tokens: In Hong Kong Central and Kowloon , you 'll find that prices are about the same , and a little cheaper in Causeway Bay , which caters for local purchases .


fn_spacy_tokens_for_baseline: The dogs live in appalling conditions , open to the weather , walking on wires , lying on excrement , they rarely exercise and often make pathetic attempts to escape .

source_bert_toks: the dogs live in app ##all ##ing conditions , open to the weather , walking on wires , lying on ex ##cre ##ment , they rarely exercise and often make pathetic attempts to escape .

reference_raw: Dogs live in terrible conditions, open to the weather, walk on wires, lie on excrement, rarely exercise, and often make poor attempts to escape.

reference_spacy_tokens: Dogs live in terrible conditions , open to the weather , walk on wires , lie on excrement , rarely exercise , and often make poor attempts to escape .


fn_spacy_tokens_for_baseline: The idea is that the person turns homosexual as a way of avoiding competition , conflict , or tension with a significant other .

source_bert_toks: the idea is that the person turns homosexual as a way of avoiding competition , conflict , or tension with a significant other .

reference_raw: The idea is that a person becomes gay to avoid competition, conflict, or tension with an important other person.

reference_spacy_tokens: The idea is that a person becomes gay to avoid competition , conflict , or tension with an important other person .


fn_spacy_tokens_for_baseline: Older kids , like Tracy and Kerry , left homeless after a recent murder - suicide in Indianapolis claimed Mom and Dad .

source_bert_toks: older kids , like tracy and kerry , left homeless after a recent murder - suicide in indianapolis claimed mom and dad .

reference_raw: Older children, like Tracy and Kerry, left homeless after a recent murder-suicide in Indianapolis claimed to be a mother and a father.

reference_spacy_tokens: Older children , like Tracy and Kerry , left homeless after a recent murder - suicide in Indianapolis claimed to be a mother and a father .


reference_raw: The next morning, his households and neighbors began to speak to the tribe, saying it was the National Guard, and they added that they had heard some of them speak English, which meant that it was the Americans who had taken Abu Dhari (Sheik Nasr al-Fahdawi).

reference_spacy_tokens: The next morning , his households and neighbors began to speak to the tribe , saying it was the National Guard , and they added that they had heard some of them speak English , which meant that it was the Americans who had taken Abu Dhari ( Sheik Nasr al - Fahdawi ) .


fn_spacy_tokens_for_baseline: In the long , frightening night after Tuesday 's devastating earthquake , Bay Area residents searched for comfort and solace wherever they could .

source_bert_toks: in the long , frightening night after tuesday ' s devastating earthquake , bay area residents searched for comfort and sol ##ace wherever they could .

reference_raw: In the long, terrifying night after the devastating earthquake on Tuesday, the inhabitants of the Bay Area sought comfort and comfort wherever they could.

reference_spacy_tokens: In the long , terrifying night after the devastating earthquake on Tuesday , the inhabitants of the Bay Area sought comfort and comfort wherever they could .


fn_spacy_tokens_for_baseline: They were a barbaric race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

source_bert_toks: they were a bar ##bari ##c race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

reference_raw: It was a barbaric race, and their care for the area had led to a dark period during which the written word had been forgotten and art had vanished.

reference_spacy_tokens: It was a barbaric race , and their care for the area had led to a dark period during which the written word had been forgotten and art had vanished .


fn_spacy_tokens_for_baseline: Day succeeded day , and my friend took no step forward .

source_bert_toks: day succeeded day , and my friend took no step forward .

reference_raw: The day was a success, and my friend didn't take a step forward.

reference_spacy_tokens: The day was a success , and my friend did n't take a step forward .


fn_spacy_tokens_for_baseline: People were coming over to us out of shops , pleading to be included in my trials .

source_bert_toks: people were coming over to us out of shops , pleading to be included in my trials .

reference_raw: People came to us from the stores, begging to be included in my trials.

reference_spacy_tokens: People came to us from the stores , begging to be included in my trials .


fn_spacy_tokens_for_baseline: Caroline Montalva had always been considered one of the smartest of Parisians and like most of them she was also thrifty .

source_bert_toks: caroline mont ##al ##va had always been considered one of the smart ##est of parisian ##s and like most of them she was also th ##rift ##y .

reference_raw: Caroline Montalva had always been considered one of the brightest Parisians, and, like most of them, she was also thriving.

reference_spacy_tokens: Caroline Montalva had always been considered one of the brightest Parisians , and , like most of them , she was also thriving .


fn_spacy_tokens_for_baseline: Or a priest of some unknown religion who strides towards us , implacably set on some atavistic rite ?

source_bert_toks: or a priest of some unknown religion who strides towards us , imp ##la ##ca ##bly set on some ata ##vis ##tic rite ?

reference_raw: Or a priest of some unknown religion that walks towards us, implacably set on some atavistic ritual?

reference_spacy_tokens: Or a priest of some unknown religion that walks towards us , implacably set on some atavistic ritual ?


fn_spacy_tokens_for_baseline: They were together in the big cupboard behind the staff room , refilling the sugar bowls .

source_bert_toks: they were together in the big cupboard behind the staff room , ref ##ill ##ing the sugar bowls .

reference_raw: They were sitting together in a large closet behind the staff room, filling up a can of sugar.

reference_spacy_tokens: They were sitting together in a large closet behind the staff room , filling up a can of sugar .


fn_spacy_tokens_for_baseline: QN : What does he need to do to be in Paris ?

source_bert_toks: q ##n : what does he need to do to be in paris ?

reference_raw: QN: What does he have to do to get to Paris?

reference_spacy_tokens: QN : What does he have to do to get to Paris ?


fn_spacy_tokens_for_baseline: But rebels claimed that hundreds of Kadafi loyalists and soldiers had abandoned their posts .

source_bert_toks: but rebels claimed that hundreds of ka ##da ##fi loyalists and soldiers had abandoned their posts .

reference_raw: But the rebels claimed that hundreds of Kadafi loyalists and soldiers had left their stations.

reference_spacy_tokens: But the rebels claimed that hundreds of Kadafi loyalists and soldiers had left their stations .


fn_spacy_tokens_for_baseline: The general said that the mutinous soldiers would abandon their positions , give up their ammunition and walk on foot to their camp at Fort Bonafacio about three miles away .

source_bert_toks: the general said that the mu ##tino ##us soldiers would abandon their positions , give up their ammunition and walk on foot to their camp at fort bon ##af ##acio about three miles away .

reference_raw: The general said the rebel soldiers would leave their posts, surrender their ammunition, and walk to their camp at Fort Bonafacio about three miles away.

reference_spacy_tokens: The general said the rebel soldiers would leave their posts , surrender their ammunition , and walk to their camp at Fort Bonafacio about three miles away .


fn_spacy_tokens_for_baseline: It promises to be a really super evening once again .

source_bert_toks: it promises to be a really super evening once again .

reference_raw: It promises to be a really cool night again.

reference_spacy_tokens: It promises to be a really cool night again .


fn_spacy_tokens_for_baseline: Iran agreed to an IAEA inspection schedule and to a mid - May 2004 deadline for the submission of complete details regarding its nuclear program and goals .

source_bert_toks: iran agreed to an ia ##ea inspection schedule and to a mid - may 2004 deadline for the submission of complete details regarding its nuclear program and goals .

reference_raw: Iran has consented to the IAEA inspection plan and to the mid-May 2004 deadline for the submission of complete information on its nuclear programme and objectives.

reference_spacy_tokens: Iran has consented to the IAEA inspection plan and to the mid - May 2004 deadline for the submission of complete information on its nuclear programme and objectives .


fn_spacy_tokens_for_baseline: At the level of molecular autonomous agents , I made the point repeatedly that work is the constrained release of energy and that autonomous agents do carry out work to construct the constraints on the release of energy such that the energy is released along specific channels and such that specific couplings of nonequilibrium energy sources to propagating organization arise .

source_bert_toks: at the level of molecular autonomous agents , i made the point repeatedly that work is the constrained release of energy and that autonomous agents do carry out work to construct the constraints on the release of energy such that the energy is released along specific channels and such that specific coupling ##s of none ##quil ##ib ##rium energy sources to prop ##aga ##ting organization arise .

reference_raw: At the level of molecular autonomic agents, I have repeatedly pointed out that a job is a limited release of energy and that independent agents are engaged in the construction of energy constraints such that the energy is released through specific channels and that there are special connections between non-qualibrium energy sources and propagating organisations.

reference_spacy_tokens: At the level of molecular autonomic agents , I have repeatedly pointed out that a job is a limited release of energy and that independent agents are engaged in the construction of energy constraints such that the energy is released through specific channels and that there are special connections between non - qualibrium energy sources and propagating organisations .


fn_spacy_tokens_for_baseline: The next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorist incidents .

source_bert_toks: the next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bio ##ter ##ror ##ism ; and approaches to the prevention and mit ##iga ##tion of bio ##ter ##ror ##ist incidents .

reference_raw: The next five chapters focus on the technical aspects of bioterrorism, including biological agents of major concern; technical barriers related to their acquisition, production and delivery; historical cases of bioterrorism; and approaches to the prevention and mitigation of bioterrorism incidents.

reference_spacy_tokens: The next five chapters focus on the technical aspects of bioterrorism , including biological agents of major concern ; technical barriers related to their acquisition , production and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorism incidents .


fn_spacy_tokens_for_baseline: The terror suspects were tailed around the clock by surveillance teams of about a dozen officers each .

source_bert_toks: the terror suspects were tailed around the clock by surveillance teams of about a dozen officers each .

reference_raw: Terrorist suspects were followed by surveillance teams of about a dozen officers each.

reference_spacy_tokens: Terrorist suspects were followed by surveillance teams of about a dozen officers each .


fn_spacy_tokens_for_baseline: There 's a reprimand on his record for improper treatment of a prisoner of war . '

source_bert_toks: there ' s a rep ##rim ##and on his record for improper treatment of a prisoner of war . '

reference_raw: There's a rebuke on his record for wrongful treatment of a prisoner of war.'

reference_spacy_tokens: There 's a rebuke on his record for wrongful treatment of a prisoner of war . '


fn_spacy_tokens_for_baseline: Software written to ToolChest will be able to bypass pricey compliance testing on all the various Sparc boxes .

source_bert_toks: software written to tool ##ches ##t will be able to bypass price ##y compliance testing on all the various spa ##rc boxes .

reference_raw: Software written to ToolChest will be able to circumvent the costly conformity testing of all different Sparc boxes.

reference_spacy_tokens: Software written to ToolChest will be able to circumvent the costly conformity testing of all different Sparc boxes .


fn_spacy_tokens_for_baseline: One study of Parkinson 's disease , an incurable nervous condition , showed that the use of garden pesticides was associated with a higher incidence of the disease .

source_bert_toks: one study of parkinson ' s disease , an inc ##urable nervous condition , showed that the use of garden pest ##icides was associated with a higher incidence of the disease .

reference_raw: One study of Parkinson's disease, an uncurable nervous state, has shown that the use of garden pesticides is associated with a higher incidence of the disease.

reference_spacy_tokens: One study of Parkinson 's disease , an uncurable nervous state , has shown that the use of garden pesticides is associated with a higher incidence of the disease .


fn_spacy_tokens_for_baseline: Many had to leave their birthplaces , fleeing to Lesvos , Chios , and Samos , the Greek - ruled islands just offshore .

source_bert_toks: many had to leave their birthplace ##s , fleeing to les ##vos , chi ##os , and sam ##os , the greek - ruled islands just offshore .

reference_raw: Many had to leave their homes and flee to Lesvos, Chios, and Samos, the Greek-ruled islands just off the coast.

reference_spacy_tokens: Many had to leave their homes and flee to Lesvos , Chios , and Samos , the Greek - ruled islands just off the coast .


fn_spacy_tokens_for_baseline: When registering by phone please refer to your Priority Code : 90791

source_bert_toks: when registering by phone please refer to your priority code : 90 ##7 ##9 ##1

reference_raw: When registering by telephone, see your priority code: 90791

reference_spacy_tokens: When registering by telephone , see your priority code : 90791


fn_spacy_tokens_for_baseline: They split when he was in some really posh place , up the West End .

source_bert_toks: they split when he was in some really po ##sh place , up the west end .

reference_raw: They broke up when he was in a really cool place on the West End.

reference_spacy_tokens: They broke up when he was in a really cool place on the West End .


fn_spacy_tokens_for_baseline: For reproducing or doubling alto and tenor lines the French horn is splendid in its ability to sustain a velvet tone .

source_bert_toks: for rep ##rod ##uc ##ing or doubling alto and tenor lines the french horn is splendid in its ability to sustain a velvet tone .

reference_raw: For the reproduction or doubling of alto and tenor lines, the French horn is magnificent in its ability to maintain a velvety tone.

reference_spacy_tokens: For the reproduction or doubling of alto and tenor lines , the French horn is magnificent in its ability to maintain a velvety tone .


fn_spacy_tokens_for_baseline: They may not be among the " best and brightest " of their generation -- there are very few such people , by definition .

source_bert_toks: they may not be among the " best and brightest " of their generation - - there are very few such people , by definition .

reference_raw: They don't have to be one of their generation's "best and brightest" - there's not enough of them, by definition.

reference_spacy_tokens: They do n't have to be one of their generation 's " best and brightest " - there 's not enough of them , by definition .