fn_spacy_tokens_for_baseline: Iran 's plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

source_bert_toks: iran ' s plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

reference_raw: Iran's plans to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons.

reference_spacy_tokens: Iran 's plans to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons .


fn_spacy_tokens_for_baseline: Is there any point which is not quite clear to you ? '

source_bert_toks: is there any point which is not quite clear to you ? '

reference_raw: Is there a reason you don't understand?'

reference_spacy_tokens: Is there a reason you do n't understand ? '


fn_spacy_tokens_for_baseline: I ended up getting carried to the station with my feet handcuffed , my hands handcuffed , lain in the bottom of the van .

source_bert_toks: i ended up getting carried to the station with my feet hand ##cu ##ffed , my hands hand ##cu ##ffed , lai ##n in the bottom of the van .

reference_raw: In the end, they carried me to the station with my legs tied, my hands cuffed, and I was lying in the bottom of the van.

reference_spacy_tokens: In the end , they carried me to the station with my legs tied , my hands cuffed , and I was lying in the bottom of the van .


fn_spacy_tokens_for_baseline: ' Big Brother is watching you ' , the caption beneath it ran .

source_bert_toks: ' big brother is watching you ' , the capt ##ion beneath it ran .

reference_raw: "Big Brother's watching you," and the label underneath was running.

reference_spacy_tokens: " Big Brother 's watching you , " and the label underneath was running .


fn_spacy_tokens_for_baseline: Others wailed and keened , as friends and relatives propped them up .

source_bert_toks: others wai ##led and keen ##ed , as friends and relatives propped them up .

reference_raw: Others howled and groaned as friends and relatives propped them up.

reference_spacy_tokens: Others howled and groaned as friends and relatives propped them up .


fn_spacy_tokens_for_baseline: The rich sculptural effects on the facade mix Eastern and Western symbols : familiar saints , Chinese dragons , and a Portuguese caravel .

source_bert_toks: the rich sc ##ul ##pt ##ural effects on the facade mix eastern and western symbols : familiar saints , chinese dragons , and a portuguese cara ##vel .

reference_raw: The great sculptural effects of the facade combine the Eastern and Western symbols: the familiar saints, the Chinese dragons, and the Portuguese caravel.

reference_spacy_tokens: The great sculptural effects of the facade combine the Eastern and Western symbols : the familiar saints , the Chinese dragons , and the Portuguese caravel .


fn_spacy_tokens_for_baseline: There is little evidence that the Romans used to flog their victims before crucifixion .

source_bert_toks: there is little evidence that the romans used to fl ##og their victims before cr ##uc ##if ##ix ##ion .

reference_raw: There is little evidence that the Romans whipped their victims before crucifixion.

reference_spacy_tokens: There is little evidence that the Romans whipped their victims before crucifixion .


fn_spacy_tokens_for_baseline: The indicated remedy appeared to be spigelia , but when she was given this she developed palpitations and became quite anxious .

source_bert_toks: the indicated remedy appeared to be sp ##ige ##lia , but when she was given this she developed pal ##pit ##ations and became quite anxious .

reference_raw: The indicated cure seemed to be spigelia, but when it was given to her, she felt palpitations and became quite nervous.

reference_spacy_tokens: The indicated cure seemed to be spigelia , but when it was given to her , she felt palpitations and became quite nervous .


fn_spacy_tokens_for_baseline: He could do more to cut public subsidies and transfers , thus making funds available for public services starved of money for six years .

source_bert_toks: he could do more to cut public subsidies and transfers , thus making funds available for public services starved of money for six years .

reference_raw: It could do more to reduce public subsidies and transfers, making funds available to the public sector for six years to starve.

reference_spacy_tokens: It could do more to reduce public subsidies and transfers , making funds available to the public sector for six years to starve .


fn_spacy_tokens_for_baseline: In late February 2003 , North Korea restarted its 5WW(e ) reactor , and in March , reports indicated that technicians were active at the Radiochemistry Laboratory , and on 2 October , the North Korean Foreign Ministry declared that the reprocessing of 8,000 spent fuel rods had been completed " to increase its nuclear deterrent force . "

source_bert_toks: in late february 2003 , north korea restarted its 5 ##w ##w ( e ) reactor , and in march , reports indicated that technicians were active at the radio ##chemist ##ry laboratory , and on 2 october , the north korean foreign ministry declared that the rep ##ro ##ces ##sing of 8 , 000 spent fuel rods had been completed " to increase its nuclear deter ##rent force . "

reference_raw: At the end of February 2003, North Korea re-established its 5WW(e) reactor, and in March reports reported that technicians were active in the Radiochemistry Laboratory, and on 2 October the North Korean Ministry of Foreign Affairs declared that the reprocessing of 8,000 spent fuel rods had been completed to increase its nuclear deterrence.

reference_spacy_tokens: At the end of February 2003 , North Korea re - established its 5WW(e ) reactor , and in March reports reported that technicians were active in the Radiochemistry Laboratory , and on 2 October the North Korean Ministry of Foreign Affairs declared that the reprocessing of 8,000 spent fuel rods had been completed to increase its nuclear deterrence .


fn_spacy_tokens_for_baseline: Fighting , stealing , homicide and rape were usually either individual initiatives or a group of friends on the rampage .

source_bert_toks: fighting , stealing , homicide and rape were usually either individual initiatives or a group of friends on the rampage .

reference_raw: Fighting, theft, murder and rape were usually either individual initiatives or a group of friends on a rampage.

reference_spacy_tokens: Fighting , theft , murder and rape were usually either individual initiatives or a group of friends on a rampage .


fn_spacy_tokens_for_baseline: Hillmarden House was situated on a small knoll just outside the village of Hillmarden itself .

source_bert_toks: hill ##mar ##den house was situated on a small kn ##oll just outside the village of hill ##mar ##den itself .

reference_raw: Hillmarden House was situated on a small hill just outside the village of Hillmarden itself.

reference_spacy_tokens: Hillmarden House was situated on a small hill just outside the village of Hillmarden itself .


fn_spacy_tokens_for_baseline: The uprising gained traction during bloody spring battles in coastal Misurata , Libya 's third - largest city , where residents barricaded streets with shipping containers in ferocious urban warfare .

source_bert_toks: the uprising gained traction during bloody spring battles in coastal mis ##ura ##ta , libya ' s third - largest city , where residents barr ##ica ##ded streets with shipping containers in ferocious urban warfare .

reference_raw: In the bloody spring battles of the coast of Misurata, the third largest city in Libya, where the inhabitants blocked the streets with shipping containers in violent urban wars, the rebellion gained traction.

reference_spacy_tokens: In the bloody spring battles of the coast of Misurata , the third largest city in Libya , where the inhabitants blocked the streets with shipping containers in violent urban wars , the rebellion gained traction .


fn_spacy_tokens_for_baseline: Adding to the ghostly effect , heavy fogs often enshroud the ruins of the town and the wasteland surrounding it .

source_bert_toks: adding to the ghostly effect , heavy fog ##s often en ##sh ##roud the ruins of the town and the waste ##land surrounding it .

reference_raw: In addition to the eerie effect, heavy mists often enveloped the ruins of the city and the wastelands surrounding it.

reference_spacy_tokens: In addition to the eerie effect , heavy mists often enveloped the ruins of the city and the wastelands surrounding it .


fn_spacy_tokens_for_baseline: Seeing the flash of anger in Drew 's eyes , Bas tactfully enquired after the baby .

source_bert_toks: seeing the flash of anger in drew ' s eyes , bas ta ##ct ##fully en ##qui ##red after the baby .

reference_raw: When Bas saw the flicker of anger in Drew's eyes, he tactfully questioned the child.

reference_spacy_tokens: When Bas saw the flicker of anger in Drew 's eyes , he tactfully questioned the child .


fn_spacy_tokens_for_baseline: He was , in the eyes of the Church , already a Catholic , since he had been baptized into the Church , and had received the sacraments of Penance , Communion and Confirmation before leaving the convent .

source_bert_toks: he was , in the eyes of the church , already a catholic , since he had been baptized into the church , and had received the sacrament ##s of pena ##nce , communion and confirmation before leaving the convent .

reference_raw: In the eyes of the Church, he was already a Catholic, for he had been baptized in the Church, and had been given the sacraments of penance, communion, and acknowledgment before he left the monastery.

reference_spacy_tokens: In the eyes of the Church , he was already a Catholic , for he had been baptized in the Church , and had been given the sacraments of penance , communion , and acknowledgment before he left the monastery .


fn_spacy_tokens_for_baseline: The most popular is reconstituted stone : this is made by bonding coloured aggregates together under pressure , to recreate blocks with one decorative face and end , in imitation of natural quarried stone .

source_bert_toks: the most popular is rec ##ons ##tituted stone : this is made by bonding coloured aggregate ##s together under pressure , to rec ##reate blocks with one decorative face and end , in imitation of natural qu ##ar ##ried stone .

reference_raw: Reconstituted stone is the most popular: it is produced by tying the coloured aggregates together under pressure to recreate the blocks with one decorative face and end by imitating the natural quarried stone.

reference_spacy_tokens: Reconstituted stone is the most popular : it is produced by tying the coloured aggregates together under pressure to recreate the blocks with one decorative face and end by imitating the natural quarried stone .


fn_spacy_tokens_for_baseline: It was an arm 's length away and raising its head to hook at him with the horn that was already dark with his father 's blood when he discharged his second barrel .

source_bert_toks: it was an arm ' s length away and raising its head to hook at him with the horn that was already dark with his father ' s blood when he discharged his second barrel .

reference_raw: It was an arm's length away, and he lifted his head to catch it with a horn that was already dark with his father's blood as he released the second barrel.

reference_spacy_tokens: It was an arm 's length away , and he lifted his head to catch it with a horn that was already dark with his father 's blood as he released the second barrel .


fn_spacy_tokens_for_baseline: They also continued to trade in obsidian and the local marble .

source_bert_toks: they also continued to trade in obsidian and the local marble .

reference_raw: They also continued their business in obsidian and local marble.

reference_spacy_tokens: They also continued their business in obsidian and local marble .


fn_spacy_tokens_for_baseline: Sadly , unscrupulous ski resorts might misuse the new polymer , surreptitiously dusting it on the slopes of their rivals .

source_bert_toks: sadly , un ##sc ##rup ##ulous ski resorts might mis ##use the new polymer , sur ##re ##pt ##iti ##ously dustin ##g it on the slopes of their rivals .

reference_raw: Unfortunately, reckless ski resorts could take advantage of the new polymer and sneak it down the slopes of their rivals.

reference_spacy_tokens: Unfortunately , reckless ski resorts could take advantage of the new polymer and sneak it down the slopes of their rivals .


fn_spacy_tokens_for_baseline: The Orc Warlord that led them was Azhag the Slaughterer , and under his command were tribes of Orcs and Goblins from the highlands around Red Eye Mountain .

source_bert_toks: the or ##c warlord that led them was az ##ha ##g the slaughter ##er , and under his command were tribes of or ##cs and goblin ##s from the highlands around red eye mountain .

reference_raw: The goblin warrior who led them was Azhag the Slaughter, and under his command were the tribes of goblins and goblins from the highlands around Red Eye Mountain.

reference_spacy_tokens: The goblin warrior who led them was Azhag the Slaughter , and under his command were the tribes of goblins and goblins from the highlands around Red Eye Mountain .


fn_spacy_tokens_for_baseline: Three months later Hugo was drowned in a boating accident ; there were rumours of suicide , which were hushed up .

source_bert_toks: three months later hugo was drowned in a boating accident ; there were rumours of suicide , which were hushed up .

reference_raw: Three months later, Hugo had been drowned in a boating accident; there had been rumors of suicide that had been silenced.

reference_spacy_tokens: Three months later , Hugo had been drowned in a boating accident ; there had been rumors of suicide that had been silenced .


fn_spacy_tokens_for_baseline: Finally , Greece was ousted from its new territory in Asia Minor , which became part of the new Turkish state .

source_bert_toks: finally , greece was ousted from its new territory in asia minor , which became part of the new turkish state .

reference_raw: Finally, Greece has been expelled from its new territory in Asia Minor, which has become part of a new country in Turkey.

reference_spacy_tokens: Finally , Greece has been expelled from its new territory in Asia Minor , which has become part of a new country in Turkey .


fn_spacy_tokens_for_baseline: It was meant to be a dry run for a much bigger event in September .

source_bert_toks: it was meant to be a dry run for a much bigger event in september .

reference_raw: It was supposed to be a dry ride for a much larger event in September.

reference_spacy_tokens: It was supposed to be a dry ride for a much larger event in September .


fn_spacy_tokens_for_baseline: The center contains a concert hall with acclaimed acoustics , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

source_bert_toks: the center contains a concert hall with acclaimed acoustic ##s , theaters , a library , an exhibition gallery , shops , restaurants , and bars .

reference_raw: The centre comprises a concert hall with acoustics, theatres, bookshelves, exhibition gallery, shops, restaurants and bars.

reference_spacy_tokens: The centre comprises a concert hall with acoustics , theatres , bookshelves , exhibition gallery , shops , restaurants and bars .


fn_spacy_tokens_for_baseline: The man licked mud - caked lips , eyes half - closing in weariness .

source_bert_toks: the man licked mud - cake ##d lips , eyes half - closing in wear ##iness .

reference_raw: The man moistened his mud-covered lips, his eyes half-closed in fatigue.

reference_spacy_tokens: The man moistened his mud - covered lips , his eyes half - closed in fatigue .


fn_spacy_tokens_for_baseline: Well if I - I saw on one of the talk shows this woman judge i believe from Florida and she just has just really stiff penalties and i saw that in in the hands of a judge that really was conscientious and really , you know , took the pains to give a sentence for what was deserved , it could - you could have a - a judge that would really make a good impact , but likewise you could have the flip side and have some judge that was paid off or you know had good - a good old boy network , or , for whatever reasons , you know , politics , just let all kinds of people through so he - he would have a heck - or - she would have a heck of a lot of power , you know , if used wrongly .

source_bert_toks: well if i - i saw on one of the talk shows this woman judge i believe from florida and she just has just really stiff penalties and i saw that in in the hands of a judge that really was con ##sc ##ient ##ious and really , you know , took the pains to give a sentence for what was deserved , it could - you could have a - a judge that would really make a good impact , but likewise you could have the flip side and have some judge that was paid off or you know had good - a good old boy network , or , for whatever reasons , you know , politics , just let all kinds of people through so he - he would have a heck - or - she would have a heck of a lot of power , you know , if used wrongly .

reference_raw: Well, if I-I saw on one of those interviews that this woman judge I believe in from Florida, and she just had some really stiff punishments, and I saw that in the hands of a judge who was really conscientious and really, you know, took the pains to make a sentence for what's earned, you could-- you could have a judge who'd really have a good impact, but you could have the flip side and you could have a judge who've got paid for it. you know, it was good - a good old boy's network, or, for some reason, you know, politics, just let a lot of people through to him - he'd have a heck - or - he'd have a lot of power, you know, if he'd used it wrong.

reference_spacy_tokens: Well , if I - I saw on one of those interviews that this woman judge I believe in from Florida , and she just had some really stiff punishments , and I saw that in the hands of a judge who was really conscientious and really , you know , took the pains to make a sentence for what 's earned , you could-- you could have a judge who 'd really have a good impact , but you could have the flip side and you could have a judge who 've got paid for it . you know , it was good - a good old boy 's network , or , for some reason , you know , politics , just let a lot of people through to him - he 'd have a heck - or - he 'd have a lot of power , you know , if he 'd used it wrong .


fn_spacy_tokens_for_baseline: " I wish , I wish , I wish in vain , I wish I was a maid again . " she warbled .

source_bert_toks: " i wish , i wish , i wish in vain , i wish i was a maid again . " she war ##bled .

reference_raw: "I wish, I wish, I wish in vain, I wish I could be a servant again," she said.

reference_spacy_tokens: " I wish , I wish , I wish in vain , I wish I could be a servant again , " she said .


fn_spacy_tokens_for_baseline: More advance liquid fuel programs include the Shehab-4 and Shehab-5 .

source_bert_toks: more advance liquid fuel programs include the she ##hab - 4 and she ##hab - 5 .

reference_raw: The Shehab-4 and Shehab-5 are more advanced fluid fuel programs.

reference_spacy_tokens: The Shehab-4 and Shehab-5 are more advanced fluid fuel programs .


fn_spacy_tokens_for_baseline: A US judge late on Thursday threw out Mr Kerkorian 's claims that Daimler had fraudulently described the 1998 deal bringing together Daimler - Benz and Chrysler as a merger rather than a takeover to avoid paying a premium .

source_bert_toks: a us judge late on thursday threw out mr ke ##rk ##oria ##n ' s claims that dai ##mler had fraudulent ##ly described the 1998 deal bringing together dai ##mler - benz and chrysler as a merger rather than a takeover to avoid paying a premium .

reference_raw: Later on Thursday, a U.S. judge rejected Mr. Kerkorian's claim that Daimler had fraudulently described the 1998 agreement linking Daimler-Benz and Chrysler to a merger rather than a takeover in order to avoid payment of the premium.

reference_spacy_tokens: Later on Thursday , a U.S. judge rejected Mr. Kerkorian 's claim that Daimler had fraudulently described the 1998 agreement linking Daimler - Benz and Chrysler to a merger rather than a takeover in order to avoid payment of the premium .


fn_spacy_tokens_for_baseline: My sense is for a simpler system .

source_bert_toks: my sense is for a simpler system .

reference_raw: I'm thinking of a simpler system.

reference_spacy_tokens: I 'm thinking of a simpler system .


fn_spacy_tokens_for_baseline: Papaver somniferum , is the only commercial source of codeine , an alkaloid widely used in cough suppressants and pain killers .

source_bert_toks: papa ##ver so ##m ##ni ##fer ##um , is the only commercial source of code ##ine , an al ##kal ##oid widely used in cough suppress ##ants and pain killers .

reference_raw: Papaver somniferum is the only commercial source of codein, an alkaloid widely used in cough suppressants and painkillers.

reference_spacy_tokens: Papaver somniferum is the only commercial source of codein , an alkaloid widely used in cough suppressants and painkillers .


fn_spacy_tokens_for_baseline: The chief facility for researching and producing CW agents was a military front company called Delta G Scientific , located between Johannesburg and Pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weaponize " irritants ( Riot Control Agents such as CS and CR ) and incapacitants by placing them in artillery shells , mortar bombs , and grenades .

source_bert_toks: the chief facility for researching and producing cw agents was a military front company called delta g scientific , located between johannesburg and pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weapon ##ize " ir ##ritan ##ts ( riot control agents such as cs and cr ) and inca ##pac ##itan ##ts by placing them in artillery shells , mortar bombs , and grenades .

reference_raw: The main facility for research and production of CW agents was a military lead company called Delta G Science, located between Johannesburg and Pretoria, and several other facilities were set up for the development of protective clothing, the production of exotic assassination devices, and "weaponizing" irritants (Riot Control Agents such as CS and CR) and incapacitators by placing them in artillery shells, mortar bombs, and grenades.

reference_spacy_tokens: The main facility for research and production of CW agents was a military lead company called Delta G Science , located between Johannesburg and Pretoria , and several other facilities were set up for the development of protective clothing , the production of exotic assassination devices , and " weaponizing " irritants ( Riot Control Agents such as CS and CR ) and incapacitators by placing them in artillery shells , mortar bombs , and grenades .


fn_spacy_tokens_for_baseline: Early in November Henry led his Brabancons in a thrust to the south of Chinon , threatening the lands of Ralph de Faye .

source_bert_toks: early in november henry led his bra ##ban ##con ##s in a thrust to the south of chin ##on , threatening the lands of ralph de faye .

reference_raw: At the beginning of November, Henry led his Brabancons into the southern part of Chinon and threatened Ralph de Faye's lands.

reference_spacy_tokens: At the beginning of November , Henry led his Brabancons into the southern part of Chinon and threatened Ralph de Faye 's lands .


fn_spacy_tokens_for_baseline: She went on to add that distance from home and family precluded the use of rehabilitative measures available to boys and that the lack of any alternative facilities for girl offenders added to the strain of the institution .

source_bert_toks: she went on to add that distance from home and family pre ##cl ##uded the use of rehab ##ili ##tative measures available to boys and that the lack of any alternative facilities for girl offenders added to the strain of the institution .

reference_raw: She added that the distance from home and family precludes the use of rehabilitation measures available to boys and that the absence of alternative facilities for girl offenders adds to the pressure of the institution.

reference_spacy_tokens: She added that the distance from home and family precludes the use of rehabilitation measures available to boys and that the absence of alternative facilities for girl offenders adds to the pressure of the institution .


fn_spacy_tokens_for_baseline: As the Byzantine Empire weakened at the end of the first millennium , Crusader forces were sent from Western Europe to counter the Muslim forces and retake Jerusalem for the Christian faith .

source_bert_toks: as the byzantine empire weakened at the end of the first millennium , crusader forces were sent from western europe to counter the muslim forces and re ##take jerusalem for the christian faith .

reference_raw: As the Byzantine Empire weakened at the end of the first millennia, crusaders were sent from Western Europe to fight against Muslim forces and take Jerusalem back to the Christian faith.

reference_spacy_tokens: As the Byzantine Empire weakened at the end of the first millennia , crusaders were sent from Western Europe to fight against Muslim forces and take Jerusalem back to the Christian faith .


fn_spacy_tokens_for_baseline: It is an area I have visited many times , especially the coastal areas which are superb for walking .

source_bert_toks: it is an area i have visited many times , especially the coastal areas which are superb for walking .

reference_raw: It's an area I've visited many times, especially coastal areas that are perfect for walking.

reference_spacy_tokens: It 's an area I 've visited many times , especially coastal areas that are perfect for walking .


fn_spacy_tokens_for_baseline: But opponents say it will almost double the population of little Deadwood , sending property prices skyrocketing .

source_bert_toks: but opponents say it will almost double the population of little dead ##wood , sending property prices sky ##rock ##eti ##ng .

reference_raw: But the adversaries say it almost doubles the population of Little Deadwood and sends real estate prices up.

reference_spacy_tokens: But the adversaries say it almost doubles the population of Little Deadwood and sends real estate prices up .


fn_spacy_tokens_for_baseline: Mostly I am concerned that my nieces ' reputations will suffer when they return home to the inevitable questions from curious friends .

source_bert_toks: mostly i am concerned that my niece ##s ' reputation ##s will suffer when they return home to the inevitable questions from curious friends .

reference_raw: Most of the time, I fear that the reputation of my nieces will suffer when they return home to the inevitable questions of strange friends.

reference_spacy_tokens: Most of the time , I fear that the reputation of my nieces will suffer when they return home to the inevitable questions of strange friends .


fn_spacy_tokens_for_baseline: Kazakhstan is a party to START - I , the Nuclear Non - Proliferation Treaty ( NPT ) , and the Comprehensive Test Ban Treaty ( CTBT ) .

source_bert_toks: kazakhstan is a party to start - i , the nuclear non - proliferation treaty ( np ##t ) , and the comprehensive test ban treaty ( ct ##bt ) .

reference_raw: Kazakhstan participates in START-I, the Nuclear Non-Proliferation Treaty (NPT) and the Comprehensive Test Ban Treaty (CTBT).

reference_spacy_tokens: Kazakhstan participates in START - I , the Nuclear Non - Proliferation Treaty ( NPT ) and the Comprehensive Test Ban Treaty ( CTBT ) .


fn_spacy_tokens_for_baseline: QN : Has North Korea taken steps to protect its military airfields from chemical weapons attacks ?

source_bert_toks: q ##n : has north korea taken steps to protect its military airfields from chemical weapons attacks ?

reference_raw: QN: Did North Korea take steps to protect its military airports from chemical weapons attacks?

reference_spacy_tokens: QN : Did North Korea take steps to protect its military airports from chemical weapons attacks ?


fn_spacy_tokens_for_baseline: At night , light restrictions are in effect to make it harder for militants to take aim , plunging the camp into near - total darkness .

source_bert_toks: at night , light restrictions are in effect to make it harder for militants to take aim , plunging the camp into near - total darkness .

reference_raw: At night, there are light restrictions that make it more difficult for the militants to target and plunge the camp into almost total darkness.

reference_spacy_tokens: At night , there are light restrictions that make it more difficult for the militants to target and plunge the camp into almost total darkness .


fn_spacy_tokens_for_baseline: Freight trains are a mile long and their lonely whistles do blow whoo - whoo in the night ; Coney Island hot dogs do come with a million toppings ; hamburgers are gigantic .

source_bert_toks: freight trains are a mile long and their lonely whistle ##s do blow who ##o - who ##o in the night ; cone ##y island hot dogs do come with a million topping ##s ; hamburger ##s are gigantic .

reference_raw: The freight trains are a mile long, and their lonely whistles blow whoo-whoo at night; the Hot Dogs of Coney Island come with a million tops; the hamburgers are huge.

reference_spacy_tokens: The freight trains are a mile long , and their lonely whistles blow whoo - whoo at night ; the Hot Dogs of Coney Island come with a million tops ; the hamburgers are huge .


fn_spacy_tokens_for_baseline: Left foot forwards , knees slightly bent , I rode the board down that precipitous slope like a man tobogganing down a glacier .

source_bert_toks: left foot forwards , knees slightly bent , i rode the board down that pre ##ci ##pit ##ous slope like a man to ##bo ##gga ##ning down a glacier .

reference_raw: Left foot forward, knees slightly bent, I rode the board down the steep slope like a man toggling down a glacier.

reference_spacy_tokens: Left foot forward , knees slightly bent , I rode the board down the steep slope like a man toggling down a glacier .


fn_spacy_tokens_for_baseline: Shall we duel over this ? '

source_bert_toks: shall we duel over this ? '

reference_raw: Should we fight about it?'

reference_spacy_tokens: Should we fight about it ? '


fn_spacy_tokens_for_baseline: A spokesman for the college , Scott Craig , described the scene : " I saw flames about 100 feet high in the air shooting up with the wind just howling .

source_bert_toks: a spokesman for the college , scott craig , described the scene : " i saw flames about 100 feet high in the air shooting up with the wind just howling .

reference_raw: The school speaker, Scott Craig, described the scene: "I saw fires in the air, about a hundred feet high, shot up by the wind, howling.

reference_spacy_tokens: The school speaker , Scott Craig , described the scene : " I saw fires in the air , about a hundred feet high , shot up by the wind , howling .


fn_spacy_tokens_for_baseline: Oh , I just snitched the eyebrows from the top of the totem - pole .

source_bert_toks: oh , i just s ##ni ##tched the eyebrows from the top of the to ##tem - pole .

reference_raw: I just blew my eyebrows off the top of the totem pole.

reference_spacy_tokens: I just blew my eyebrows off the top of the totem pole .


fn_spacy_tokens_for_baseline: A number of L and C supporters , decked out in the team 's lime green and guava fruit colours , decided to swop hats with predictably side - splitting results .

source_bert_toks: a number of l and c supporters , deck ##ed out in the team ' s lime green and gu ##ava fruit colours , decided to sw ##op hats with predict ##ably side - splitting results .

reference_raw: Several L and C supporters, decked in the lime-green and guava-fruit colors of the team, decided to swipe their hats with predictable spill-over results.

reference_spacy_tokens: Several L and C supporters , decked in the lime - green and guava - fruit colors of the team , decided to swipe their hats with predictable spill - over results .


fn_spacy_tokens_for_baseline: The document " defines the act of nuclear terrorism as the use or threat to use nuclear material , nuclear fuel , radioactive products or waste , or any other radioactive substances with toxic , explosive , or other dangerous properties , " and outlines measures aimed to prevent terrorist acts involving the use of nuclear or other radioactive materials . ( Russian News and Information Agency Novosti , 26Jun06 ) http://en.rian.ru/ russia /20060626/50069639.html

source_bert_toks: the document " defines the act of nuclear terrorism as the use or threat to use nuclear material , nuclear fuel , radioactive products or waste , or any other radioactive substances with toxic , explosive , or other dangerous properties , " and outlines measures aimed to prevent terrorist acts involving the use of nuclear or other radioactive materials . ( russian news and information agency novo ##sti , 26 ##jun ##0 ##6 ) http : / / en . ri ##an . ru / russia / 2006 ##0 ##6 ##26 / 500 ##6 ##9 ##6 ##39 . html

reference_raw: The document "defines the act of nuclear terrorism as the use or threat of the use of nuclear material, nuclear fuel, radioactive products or waste, or other radioactive substances with toxic, explosive or other hazardous properties" and outlines actions to prevent acts of terrorism involving the use of nuclear or other radioactive materials (Russian News and Information Agency Novosti, 26 June 2006) http://en.rian.ru/Russia /2006/0626 June 2006) 50069639.html

reference_spacy_tokens: The document " defines the act of nuclear terrorism as the use or threat of the use of nuclear material , nuclear fuel , radioactive products or waste , or other radioactive substances with toxic , explosive or other hazardous properties " and outlines actions to prevent acts of terrorism involving the use of nuclear or other radioactive materials ( Russian News and Information Agency Novosti , 26 June 2006 ) http://en.rian.ru/Russia /2006/0626 June 2006 ) 50069639.html


fn_spacy_tokens_for_baseline: My first days in this village were devoted to a series of walks in which in the intervals of my botanical researches I made a reconnaissance of all the large houses and an examination of the family history of the occupants .

source_bert_toks: my first days in this village were devoted to a series of walks in which in the intervals of my botanical researches i made a reconnaissance of all the large houses and an examination of the family history of the occupants .

reference_raw: My first days in this village were devoted to a series of walks, during which, in the course of my botanical research, I surveyed all the large houses and examined the family history of the inhabitants.

reference_spacy_tokens: My first days in this village were devoted to a series of walks , during which , in the course of my botanical research , I surveyed all the large houses and examined the family history of the inhabitants .


fn_spacy_tokens_for_baseline: It included , not surprisingly , the protection of the church and promotion of Christianity , and the suppression of evildoers .

source_bert_toks: it included , not surprisingly , the protection of the church and promotion of christianity , and the suppression of evil ##do ##ers .

reference_raw: It included, no wonder, the protection of the Church, the promotion of Christianity, and the repression of evil.

reference_spacy_tokens: It included , no wonder , the protection of the Church , the promotion of Christianity , and the repression of evil .


fn_spacy_tokens_for_baseline: QN : Will Japan 's share of global economic output decrease in the next few decades ?

source_bert_toks: q ##n : will japan ' s share of global economic output decrease in the next few decades ?

reference_raw: QN: Will Japan's share of world economic output fall over the next few decades?

reference_spacy_tokens: QN : Will Japan 's share of world economic output fall over the next few decades ?


fn_spacy_tokens_for_baseline: The deputy mayor of the town , Panayiotis Bitakos , told Skai TV that " I call on all residents to follow the instructions of the police as to where they will go .

source_bert_toks: the deputy mayor of the town , pan ##ay ##iot ##is bit ##ako ##s , told ska ##i tv that " i call on all residents to follow the instructions of the police as to where they will go .

reference_raw: The city's deputy mayor, Panayiotis Bitakos, said to Skai TV, "I'm asking all residents to follow the instructions of the cops on where they're going.

reference_spacy_tokens: The city 's deputy mayor , Panayiotis Bitakos , said to Skai TV , " I 'm asking all residents to follow the instructions of the cops on where they 're going .


fn_spacy_tokens_for_baseline: Animals can usually only ' talk ' about things happening here and now -- a bird will squawk when danger is imminent .

source_bert_toks: animals can usually only ' talk ' about things happening here and now - - a bird will sq ##ua ##wk when danger is imminent .

reference_raw: Animals can usually just "talk" about what's going on here and now--the bird squeals when the danger is imminent.

reference_spacy_tokens: Animals can usually just " talk " about what 's going on here and now -- the bird squeals when the danger is imminent .


fn_spacy_tokens_for_baseline: The rest of us could just sit and twiddle our thumbs and drink iced coffee .

source_bert_toks: the rest of us could just sit and t ##wi ##ddle our thumbs and drink iced coffee .

reference_raw: The rest of us can sit back and twist our thumbs and drink iced coffee.

reference_spacy_tokens: The rest of us can sit back and twist our thumbs and drink iced coffee .


fn_spacy_tokens_for_baseline: Young adults , like Mary T. , a jobless mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

source_bert_toks: young adults , like mary t . , a job ##less mother of three , trying desperately to keep her kids out of trouble in a crime - ridden neighborhood .

reference_raw: A young adult, like Mary T., a three-year-old mother, desperately trying to keep her children from getting into trouble in a crime-ridden neighborhood.

reference_spacy_tokens: A young adult , like Mary T. , a three - year - old mother , desperately trying to keep her children from getting into trouble in a crime - ridden neighborhood .


fn_spacy_tokens_for_baseline: If , you study the evidences and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

source_bert_toks: if , you study the evidence ##s and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

reference_raw: When you study the evidence and statements released by these people, we tend to appreciate their ignorance, which is based on prominent opinions.

reference_spacy_tokens: When you study the evidence and statements released by these people , we tend to appreciate their ignorance , which is based on prominent opinions .


fn_spacy_tokens_for_baseline: The end of my teddy - tail is tickling like mad , but it is not - nice for boys to scratch down below .

source_bert_toks: the end of my teddy - tail is tick ##ling like mad , but it is not - nice for boys to scratch down below .

reference_raw: The end of my tail ticks like a madman, but it's not nice for the boys to scratch down.

reference_spacy_tokens: The end of my tail ticks like a madman , but it 's not nice for the boys to scratch down .


fn_spacy_tokens_for_baseline: In the 1960s , Ferndale resident Jack Alderson commanded a group of light tugs that made trips to the islands that last week were declared a monument , as well as other remote atolls in the region .

source_bert_toks: in the 1960s , fern ##dale resident jack al ##ders ##on commanded a group of light tugs that made trips to the islands that last week were declared a monument , as well as other remote atoll ##s in the region .

reference_raw: In the 1960s, the resident of Ferndale, Jack Alderson, commanded a group of small tugs that made trips to the islands that had been declared monumental in the past week, and other remote tolls in the region.

reference_spacy_tokens: In the 1960s , the resident of Ferndale , Jack Alderson , commanded a group of small tugs that made trips to the islands that had been declared monumental in the past week , and other remote tolls in the region .


fn_spacy_tokens_for_baseline: An all - out offensive against the Taliban in Swat during the spring succeeded in flushing militants out of the volatile region 's urban centers and towns .

source_bert_toks: an all - out offensive against the taliban in swat during the spring succeeded in flushing militants out of the volatile region ' s urban centers and towns .

reference_raw: In the spring, the full attack on the Taliban in Swat succeeded in rinsing militants from the city centers and cities of the unstable region.

reference_spacy_tokens: In the spring , the full attack on the Taliban in Swat succeeded in rinsing militants from the city centers and cities of the unstable region .


fn_spacy_tokens_for_baseline: In a city of such human proportions it is not surprising that parks and gardens abound for recreation and relaxation .

source_bert_toks: in a city of such human proportions it is not surprising that parks and gardens ab ##ound for recreation and relaxation .

reference_raw: In a city of such human proportions, it is not surprising that parks and gardens are bound for recreation and rest.

reference_spacy_tokens: In a city of such human proportions , it is not surprising that parks and gardens are bound for recreation and rest .


fn_spacy_tokens_for_baseline: Hardly a star showed , for the sky was veiled by a lacy wrack , bleached snow - white by the moon that rose in a clear unclouded patch .

source_bert_toks: hardly a star showed , for the sky was veil ##ed by a lacy wr ##ack , b ##lea ##ched snow - white by the moon that rose in a clear un ##cl ##oud ##ed patch .

reference_raw: The star was barely visible, for the sky was covered with a lacy crack, white-snowed by the moon that rose in a clear, cloudless patch.

reference_spacy_tokens: The star was barely visible , for the sky was covered with a lacy crack , white - snowed by the moon that rose in a clear , cloudless patch .


fn_spacy_tokens_for_baseline: The rest of the building and an adjoining college were destroyed in a typhoon - fanned fire in 1835 .

source_bert_toks: the rest of the building and an adjoining college were destroyed in a typhoon - fan ##ned fire in 1835 .

reference_raw: The rest of the building and the adjoining university were destroyed in a typhoon-fanned fire in 1835.

reference_spacy_tokens: The rest of the building and the adjoining university were destroyed in a typhoon - fanned fire in 1835 .


fn_spacy_tokens_for_baseline: Most of these , including notable assemblages from the mammoth - hunter encampments of Gagarino and Kostienki I in the Ukraine and the head and torso from the French cave site of Brassempouy , depict unclothed women .

source_bert_toks: most of these , including notable ass ##em ##bla ##ges from the mammoth - hunter en ##camp ##ments of gaga ##rino and ko ##sti ##en ##ki i in the ukraine and the head and torso from the french cave site of brass ##em ##po ##uy , depict un ##cloth ##ed women .

reference_raw: Most of these, including the remarkable assembly of the mammoth hunting camps in Gagarino and Kostienki I in Ukraine and the head and torso of the French cave site in Brassempoy, represent undressed women.

reference_spacy_tokens: Most of these , including the remarkable assembly of the mammoth hunting camps in Gagarino and Kostienki I in Ukraine and the head and torso of the French cave site in Brassempoy , represent undressed women .


fn_spacy_tokens_for_baseline: Follow this path through Gleann Choinneachain until it fords the stream .

source_bert_toks: follow this path through g ##lean ##n choi ##nne ##ach ##ain until it ford ##s the stream .

reference_raw: Follow this path through Gleann Choinneachain until it crosses the stream.

reference_spacy_tokens: Follow this path through Gleann Choinneachain until it crosses the stream .


fn_spacy_tokens_for_baseline: The ' Weed do n't take themselves too seriously , either , as demonstrated by Lenny 's sleeve artwork , which invariably depicts outrageously attired hippy freaks in various states of narcotic oblivion .

source_bert_toks: the ' weed don ' t take themselves too seriously , either , as demonstrated by lenny ' s sleeve artwork , which invariably depicts outrageous ##ly attire ##d hip ##py freaks in various states of na ##rco ##tic oblivion .

reference_raw: The weeds don't take each other too seriously, as Lenny's sleevework shows, always depicting indignantly dressed hippie monsters in various states of drug oblivion.

reference_spacy_tokens: The weeds do n't take each other too seriously , as Lenny 's sleevework shows , always depicting indignantly dressed hippie monsters in various states of drug oblivion .


fn_spacy_tokens_for_baseline: I wonder if that means geography is destiny , and it 's still location , location , location .

source_bert_toks: i wonder if that means geography is destiny , and it ' s still location , location , location .

reference_raw: I wonder if it means that geography is fate, and it's still a place, a place, a place.

reference_spacy_tokens: I wonder if it means that geography is fate , and it 's still a place , a place , a place .


fn_spacy_tokens_for_baseline: The river forms a natural line between the north and south sections of the city .

source_bert_toks: the river forms a natural line between the north and south sections of the city .

reference_raw: The river is a natural border between the northern and southern parts of the city.

reference_spacy_tokens: The river is a natural border between the northern and southern parts of the city .


fn_spacy_tokens_for_baseline: This created a pattern seen today throughout the Aegean of a small port ( skala ) which serves an inland settlement or chora , making it easier to protect the island from attack .

source_bert_toks: this created a pattern seen today throughout the aegean of a small port ( ska ##la ) which serves an inland settlement or cho ##ra , making it easier to protect the island from attack .

reference_raw: This created a pattern seen today throughout the Aegean of a small harbor (skala) serving an inland settlement or chora, which facilitates the protection of the island from attack.

reference_spacy_tokens: This created a pattern seen today throughout the Aegean of a small harbor ( skala ) serving an inland settlement or chora , which facilitates the protection of the island from attack .


fn_spacy_tokens_for_baseline: He competed in the early rounds of the ASP contests , but ten to fifteen feet was a millpond for Bradshaw and he sank like a stone .

source_bert_toks: he competed in the early rounds of the as ##p contests , but ten to fifteen feet was a mill ##pon ##d for bradshaw and he sank like a stone .

reference_raw: He was in competition in the first rounds of the ASP competition, but ten to fifteen feet was Bradshaw's millpond and he sank like a rock.

reference_spacy_tokens: He was in competition in the first rounds of the ASP competition , but ten to fifteen feet was Bradshaw 's millpond and he sank like a rock .


fn_spacy_tokens_for_baseline: I 've always wanted to live in a penthouse . '

source_bert_toks: i ' ve always wanted to live in a penthouse . '

reference_raw: I always wanted to live in a house.'

reference_spacy_tokens: I always wanted to live in a house . '


fn_spacy_tokens_for_baseline: In the 1960s , South Africa began to explore the technical utility of " peaceful nuclear explosions " for mining and engineering purposes .

source_bert_toks: in the 1960s , south africa began to explore the technical utility of " peaceful nuclear explosions " for mining and engineering purposes .

reference_raw: In the 1960s, South Africa began exploring the technical usefulness of "peaceful nuclear explosions" for mining and engineering purposes.

reference_spacy_tokens: In the 1960s , South Africa began exploring the technical usefulness of " peaceful nuclear explosions " for mining and engineering purposes .


fn_spacy_tokens_for_baseline: The Clwydian Hills , rising to the south and cloaked in cloud , looked wonderfully alluring : so I threw myself into the long climb with far more vigour than I might have done normally .

source_bert_toks: the cl ##wy ##dian hills , rising to the south and cloak ##ed in cloud , looked wonderful ##ly all ##uring : so i threw myself into the long climb with far more vi ##go ##ur than i might have done normally .

reference_raw: The Clwydian Hills, which rose to the south and covered with clouds, seemed wonderfully attractive; so I plunged into the long climb with much more vigor than I would normally have done.

reference_spacy_tokens: The Clwydian Hills , which rose to the south and covered with clouds , seemed wonderfully attractive ; so I plunged into the long climb with much more vigor than I would normally have done .


fn_spacy_tokens_for_baseline: Warhol 's collections included airplane menus , unpaid invoices , pizza dough , pornographic pulp novels , newspapers , stamps , supermarket flyers , and cookie jars , among other eccentricities .

source_bert_toks: war ##hol ' s collections included airplane menu ##s , unpaid in ##vo ##ices , pizza dough , pornographic pulp novels , newspapers , stamps , supermarket flyers , and cookie jars , among other eccentric ##ities .

reference_raw: Warhol's collections included airplane menus, unpaid bills, pizza dough, pornographic pulp novels, newspapers, stamps, supermarket fliers, and biscuit jars, among other eccentricities.

reference_spacy_tokens: Warhol 's collections included airplane menus , unpaid bills , pizza dough , pornographic pulp novels , newspapers , stamps , supermarket fliers , and biscuit jars , among other eccentricities .


fn_spacy_tokens_for_baseline: They are n't accepted everywhere , however .

source_bert_toks: they aren ' t accepted everywhere , however .

reference_raw: But they're not taken everywhere.

reference_spacy_tokens: But they 're not taken everywhere .


fn_spacy_tokens_for_baseline: Most of the sources have a pre - existing bias against Iran , rendering a bulk of their information subject to speculation .

source_bert_toks: most of the sources have a pre - existing bias against iran , rendering a bulk of their information subject to speculation .

reference_raw: Most sources have pre-existing prejudices against Iran, which make most of their information speculative.

reference_spacy_tokens: Most sources have pre - existing prejudices against Iran , which make most of their information speculative .


fn_spacy_tokens_for_baseline: Then as things got rougher , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet oozing up and down , and the flowers waving in an eerie rhythm .

source_bert_toks: then as things got rough ##er , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet o ##oz ##ing up and down , and the flowers waving in an eerie rhythm .

reference_raw: Then, as things got rougher, we ran to the door and spent the next few minutes outside watching the brick walkway beneath our feet, and the flowers rippled in an eerie beat.

reference_spacy_tokens: Then , as things got rougher , we ran to the door and spent the next few minutes outside watching the brick walkway beneath our feet , and the flowers rippled in an eerie beat .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frantic speed of rush hour, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frantic speed of rush hour , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: Firefighters spent three hours tackling the blaze , which spread through the roof and into an adjoining property in Pensby Road .

source_bert_toks: firefighters spent three hours tack ##ling the blaze , which spread through the roof and into an adjoining property in pens ##by road .

reference_raw: The firemen had been fighting the fire for three hours, spreading from the roof to the next building on Pensby Road.

reference_spacy_tokens: The firemen had been fighting the fire for three hours , spreading from the roof to the next building on Pensby Road .


fn_spacy_tokens_for_baseline: Reduction in beds puts city [ Sydney ] at risk : hospital official

source_bert_toks: reduction in beds puts city [ sydney ] at risk : hospital official

reference_raw: Reducing beds puts city [Sydney] at risk: hospital official

reference_spacy_tokens: Reducing beds puts city [ Sydney ] at risk : hospital official


fn_spacy_tokens_for_baseline: Jetfoils leave every 15 to 30 minutes 24 hours a day .

source_bert_toks: jet ##foil ##s leave every 15 to 30 minutes 24 hours a day .

reference_raw: The jets leave every 15-30-minute 24 hours a day.

reference_spacy_tokens: The jets leave every 15 - 30-minute 24 hours a day .


fn_spacy_tokens_for_baseline: Few traditional ancestral halls remain in China since the anti - historical destruction during the Cultural Revolution , so these New Territories ancestral halls are rare survivors .

source_bert_toks: few traditional ancestral halls remain in china since the anti - historical destruction during the cultural revolution , so these new territories ancestral halls are rare survivors .

reference_raw: Since the antihistorical destruction of the cultural revolution, few traditional ancestral halls have remained in China, so these New Territories' ancestorial halls are scarce survivors.

reference_spacy_tokens: Since the antihistorical destruction of the cultural revolution , few traditional ancestral halls have remained in China , so these New Territories ' ancestorial halls are scarce survivors .


fn_spacy_tokens_for_baseline: But like the tale of the three little pigs , a wolf stands snarling at the door .

source_bert_toks: but like the tale of the three little pigs , a wolf stands snarl ##ing at the door .

reference_raw: But like the story of the three little pigs, there's a wolf growling in the doorway.

reference_spacy_tokens: But like the story of the three little pigs , there 's a wolf growling in the doorway .


fn_spacy_tokens_for_baseline: " They had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

source_bert_toks: " they had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

reference_raw: "They had a few more meters to go when it was too warm, and we had to evacuate them because it would put them in danger."

reference_spacy_tokens: " They had a few more meters to go when it was too warm , and we had to evacuate them because it would put them in danger . "


fn_spacy_tokens_for_baseline: Finlay was terrific at doing that .

source_bert_toks: fin ##lay was terrific at doing that .

reference_raw: Finlay was great at it.

reference_spacy_tokens: Finlay was great at it .


fn_spacy_tokens_for_baseline: However , Aetna 's employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

source_bert_toks: however , ae ##t ##na ' s employee benefits division , which includes its group health insurance operations , posted a 34 % profit gain to $ 106 million .

reference_raw: However, Aetna's employee benefits division, including its collective health insurance operations, added a profit of 34% to $106 million.

reference_spacy_tokens: However , Aetna 's employee benefits division , including its collective health insurance operations , added a profit of 34 % to $ 106 million .


fn_spacy_tokens_for_baseline: It has an incubation period of three to nine days with most deaths occurring within one week after the onset of symptoms .

source_bert_toks: it has an inc ##uba ##tion period of three to nine days with most deaths occurring within one week after the onset of symptoms .

reference_raw: It has an incubation period of three to nine days, with the majority of deaths occurring within one week of the start of symptoms.

reference_spacy_tokens: It has an incubation period of three to nine days , with the majority of deaths occurring within one week of the start of symptoms .


fn_spacy_tokens_for_baseline: The CBW program was officially dismantled in 1993 , in the midst of a liberalizing transformation of the regime .

source_bert_toks: the cb ##w program was officially dismantled in 1993 , in the midst of a liberal ##izing transformation of the regime .

reference_raw: In 1993, the CBW programme was officially dismantled in the midst of the liberalisation of the regime.

reference_spacy_tokens: In 1993 , the CBW programme was officially dismantled in the midst of the liberalisation of the regime .


fn_spacy_tokens_for_baseline: You and I have done some important work together .

source_bert_toks: you and i have done some important work together .

reference_raw: We've done some important work with each other.

reference_spacy_tokens: We 've done some important work with each other .


fn_spacy_tokens_for_baseline: The people are brave , resilient , humorous , friendly in the face of great change and adversity .

source_bert_toks: the people are brave , res ##ili ##ent , humorous , friendly in the face of great change and ad ##vers ##ity .

reference_raw: People are brave, resilient, humorous, amiable in the face of great change and adversity.

reference_spacy_tokens: People are brave , resilient , humorous , amiable in the face of great change and adversity .


fn_spacy_tokens_for_baseline: In the year following that first visit , I read and devoured everything I could about Rennes - le - Chateau .

source_bert_toks: in the year following that first visit , i read and dev ##oured everything i could about ren ##nes - le - chateau .

reference_raw: The year after my first visit, I read and ate everything I could about Rennes-le-Chateau.

reference_spacy_tokens: The year after my first visit , I read and ate everything I could about Rennes - le - Chateau .


fn_spacy_tokens_for_baseline: But whereas the plant makes the flesh of its fruit easily available to animals , it goes to great lengths to protect its seeds from pilferers , usually enclosing them in armour of some sort .

source_bert_toks: but whereas the plant makes the flesh of its fruit easily available to animals , it goes to great lengths to protect its seeds from pi ##lf ##ere ##rs , usually en ##cl ##osing them in armour of some sort .

reference_raw: However, while the plant makes the meat of its fruit easily accessible to the animals, it goes to great lengths to protect its seeds from the pilfers and usually encloses them in some sort of armor.

reference_spacy_tokens: However , while the plant makes the meat of its fruit easily accessible to the animals , it goes to great lengths to protect its seeds from the pilfers and usually encloses them in some sort of armor .


fn_spacy_tokens_for_baseline: With the sun shimmering on the glass of the palm house and the frost turning every shadow pale blue , the whole place looked like a gem , set perfectly upon the hillside .

source_bert_toks: with the sun shimmering on the glass of the palm house and the frost turning every shadow pale blue , the whole place looked like a gem , set perfectly upon the hillside .

reference_raw: When the sun shone on the glass of the palm house and the frost turned all the shades pale blue, the whole place looked like a jewel set perfectly on a hillside.

reference_spacy_tokens: When the sun shone on the glass of the palm house and the frost turned all the shades pale blue , the whole place looked like a jewel set perfectly on a hillside .


fn_spacy_tokens_for_baseline: Skidelsky 's book , believe it or not , is actually quite absorbing : Although he was an economist , Keynes led an interesting life -- though , to tell the truth , what I personally found myself envying was the way he managed to change the world without having to visit quite so much of it .

source_bert_toks: ski ##del ##sky ' s book , believe it or not , is actually quite absorbing : although he was an economist , keynes led an interesting life - - though , to tell the truth , what i personally found myself envy ##ing was the way he managed to change the world without having to visit quite so much of it .

reference_raw: In fact, Skidelsky's book, believe it or not, is quite absorbing: even though he was an economist, Keynes led an interesting life-though, to be honest, what I was personally envious of was how he managed to change the world without having to visit so much.

reference_spacy_tokens: In fact , Skidelsky 's book , believe it or not , is quite absorbing : even though he was an economist , Keynes led an interesting life - though , to be honest , what I was personally envious of was how he managed to change the world without having to visit so much .


fn_spacy_tokens_for_baseline: The food may not live up to expectations , but the fantasy environment makes up for it .

source_bert_toks: the food may not live up to expectations , but the fantasy environment makes up for it .

reference_raw: Food may not be expected, but the fantasy environment will make up for it.

reference_spacy_tokens: Food may not be expected , but the fantasy environment will make up for it .


fn_spacy_tokens_for_baseline: Donors are asked to wash and squash the cans before depositing them .

source_bert_toks: donors are asked to wash and squash the cans before deposit ##ing them .

reference_raw: Donors are asked to wash and crush cans before depositing them.

reference_spacy_tokens: Donors are asked to wash and crush cans before depositing them .


fn_spacy_tokens_for_baseline: How dare he influence her to give up her studies in England to walk the streets of Copenhagen ? '

source_bert_toks: how dare he influence her to give up her studies in england to walk the streets of copenhagen ? '

reference_raw: How dare he force her to give up studying in England and walk the streets of Copenhagen?'

reference_spacy_tokens: How dare he force her to give up studying in England and walk the streets of Copenhagen ? '


fn_spacy_tokens_for_baseline: Colonnaded public buildings , iron balconies , winding streets , flagstoned squares and the many churches all speak of the Portuguese inheritance as well as the Chinese , a fusion of East and West that has produced the unique Macanese culture .

source_bert_toks: colon ##nad ##ed public buildings , iron bal ##con ##ies , winding streets , flags ##tone ##d squares and the many churches all speak of the portuguese inheritance as well as the chinese , a fusion of east and west that has produced the unique mac ##ane ##se culture .

reference_raw: The colonned public buildings, the iron balconies, the winding streets, the flagstone squares, and many churches, all speak of the Portuguese heritage, as well as of China, the fusion of East and West, which created a single Macanese culture.

reference_spacy_tokens: The colonned public buildings , the iron balconies , the winding streets , the flagstone squares , and many churches , all speak of the Portuguese heritage , as well as of China , the fusion of East and West , which created a single Macanese culture .


fn_spacy_tokens_for_baseline: Shops in Central are an exception ; they generally close at 6 pm and are not open on Sunday .

source_bert_toks: shops in central are an exception ; they generally close at 6 pm and are not open on sunday .

reference_raw: The shopping centre is an exception; it usually closes at 6 p.m. and is not open on Sundays.

reference_spacy_tokens: The shopping centre is an exception ; it usually closes at 6 p.m. and is not open on Sundays .


fn_spacy_tokens_for_baseline: Despite its initial failings , Siegel 's Flamingo survived him , as did mob infiltration of casinos .

source_bert_toks: despite its initial failing ##s , siegel ' s flaming ##o survived him , as did mob in ##filtration of casinos .

reference_raw: Despite his initial failures, Siegel's Flamingo had survived him, as had the mob infiltrated the casinos.

reference_spacy_tokens: Despite his initial failures , Siegel 's Flamingo had survived him , as had the mob infiltrated the casinos .


fn_spacy_tokens_for_baseline: Despite persistent suspicions of offensive and defensive chemical and biological weapons ( CBW ) programs , there is no conclusive evidence that Taiwan has developed or deployed chemical or biological weapons .

source_bert_toks: despite persistent suspicions of offensive and defensive chemical and biological weapons ( cb ##w ) programs , there is no con ##clusive evidence that taiwan has developed or deployed chemical or biological weapons .

reference_raw: Despite persistent suspicions of attack and defence chemical and biological weapons (CBW) programmes, there is no conclusive evidence that Taiwan has developed or deployed chemical or biological weapons.

reference_spacy_tokens: Despite persistent suspicions of attack and defence chemical and biological weapons ( CBW ) programmes , there is no conclusive evidence that Taiwan has developed or deployed chemical or biological weapons .


fn_spacy_tokens_for_baseline: Finally , the Polish General Staff has not only seen itself as an avid ' consumer ' of Soviet military doctrine , but a contributor as well , which has authored its own innovations with Soviet endorsement .

source_bert_toks: finally , the polish general staff has not only seen itself as an avid ' consumer ' of soviet military doctrine , but a contributor as well , which has authored its own innovations with soviet endorsement .

reference_raw: Finally, the Polish General Staff saw itself not only as an avid "consumer" of the Soviet military doctrine, but also as a contributor to its own innovations with Soviet support.

reference_spacy_tokens: Finally , the Polish General Staff saw itself not only as an avid " consumer " of the Soviet military doctrine , but also as a contributor to its own innovations with Soviet support .


fn_spacy_tokens_for_baseline: Just up a lane from the market is the Man Mo Temple , with long - burning incense coils hanging from its ceiling , a popular spot dedicated to the Taoist gods of war and literature .

source_bert_toks: just up a lane from the market is the man mo temple , with long - burning incense coil ##s hanging from its ceiling , a popular spot dedicated to the tao ##ist gods of war and literature .

reference_raw: The Man Mo Temple is just down the street from the marketplace, with long-burned incense coils hanging from the ceiling, a popular place dedicated to the Taoist gods of war and literature.

reference_spacy_tokens: The Man Mo Temple is just down the street from the marketplace , with long - burned incense coils hanging from the ceiling , a popular place dedicated to the Taoist gods of war and literature .


fn_spacy_tokens_for_baseline: But despite the risks , for a man of ambition and determination the reward was ample ; for a prevote might bridge the gap between the upper peasantry and the lower echelons of the aristocracy .

source_bert_toks: but despite the risks , for a man of ambition and determination the reward was ample ; for a pre ##vot ##e might bridge the gap between the upper peasant ##ry and the lower ec ##hel ##ons of the aristocracy .

reference_raw: But in spite of the risks, for a man of ambition and determination, the reward was enough; for a prevote could bridge the gap between the upper peasants and the lower echelons of the aristocracy.

reference_spacy_tokens: But in spite of the risks , for a man of ambition and determination , the reward was enough ; for a prevote could bridge the gap between the upper peasants and the lower echelons of the aristocracy .


fn_spacy_tokens_for_baseline: The police had summonsed the wrong man , and the court dismissed the case against him .

source_bert_toks: the police had summons ##ed the wrong man , and the court dismissed the case against him .

reference_raw: The police called the wrong man, and the court dismissed the case against him.

reference_spacy_tokens: The police called the wrong man , and the court dismissed the case against him .


fn_spacy_tokens_for_baseline: Russia currently lacks the necessary capacity to dispose of its chemical munitions .

source_bert_toks: russia currently lacks the necessary capacity to dispose of its chemical munitions .

reference_raw: Russia currently lacks the necessary capacity to dispose of its chemical ammunition.

reference_spacy_tokens: Russia currently lacks the necessary capacity to dispose of its chemical ammunition .


fn_spacy_tokens_for_baseline: More workers were twining vines of ivy around pillars newly painted orange , while an elderly woman was strewing the floor with French chalk so that the dancing shoes would not slip on the polished parquet .

source_bert_toks: more workers were twin ##ing vines of ivy around pillars newly painted orange , while an elderly woman was st ##rew ##ing the floor with french chalk so that the dancing shoes would not slip on the polished par ##quet .

reference_raw: Other workers twirled vines of ivy around the newly painted orange pillars, while an older woman was strung the floor with French chalk to keep her dancing boots from sliding on the polished floor.

reference_spacy_tokens: Other workers twirled vines of ivy around the newly painted orange pillars , while an older woman was strung the floor with French chalk to keep her dancing boots from sliding on the polished floor .


fn_spacy_tokens_for_baseline: I 've got a shop and my own workrooms .

source_bert_toks: i ' ve got a shop and my own work ##rooms .

reference_raw: I have a shop and a study of my own.

reference_spacy_tokens: I have a shop and a study of my own .


fn_spacy_tokens_for_baseline: Her head hung listlessly upon her breast , but as she raised it and turned her dull eyes upon us I saw that her pupils were dark dots in the centre of the broad gray iris .

source_bert_toks: her head hung list ##lessly upon her breast , but as she raised it and turned her dull eyes upon us i saw that her pupils were dark dots in the centre of the broad gray iris .

reference_raw: Her head hung indifferently on her chest, but when she lifted it and turned her dull eyes on us, I could see that her pupils were dark dots in the center of the wide grey iris.

reference_spacy_tokens: Her head hung indifferently on her chest , but when she lifted it and turned her dull eyes on us , I could see that her pupils were dark dots in the center of the wide grey iris .


fn_spacy_tokens_for_baseline: Seoul lies within easy striking distance of North Korea 's artillery and rocket systems and , today , the South Korean civilian population has no protection against CW attack .

source_bert_toks: seoul lies within easy striking distance of north korea ' s artillery and rocket systems and , today , the south korean civilian population has no protection against cw attack .

reference_raw: Seoul is well within striking range of North Korea's artillery and missile systems, and the civilian population of South Korea is currently unprotected from the attack of the CW.

reference_spacy_tokens: Seoul is well within striking range of North Korea 's artillery and missile systems , and the civilian population of South Korea is currently unprotected from the attack of the CW .


fn_spacy_tokens_for_baseline: In an effort to provide yet one more thing to bet on , players are imported from Spain to take part in this lightning - fast Basque ball game .

source_bert_toks: in an effort to provide yet one more thing to bet on , players are imported from spain to take part in this lightning - fast basque ball game .

reference_raw: In an effort to make another bet, the players are imported from Spain to participate in the lightning game - a quick basque ball game.

reference_spacy_tokens: In an effort to make another bet , the players are imported from Spain to participate in the lightning game - a quick basque ball game .


fn_spacy_tokens_for_baseline: Rose Clough , nee Machin , lived on the outskirts of Oswaldston on a spick and span , jerry - built private estate .

source_bert_toks: rose cl ##ough , nee mach ##in , lived on the outskirts of oswald ##ston on a sp ##ick and span , jerry - built private estate .

reference_raw: Rose Clough, Nea Machin, lived in the suburbs of Oswaldston on a spick and span, a jerry-built private property.

reference_spacy_tokens: Rose Clough , Nea Machin , lived in the suburbs of Oswaldston on a spick and span , a jerry - built private property .


fn_spacy_tokens_for_baseline: In 1642 , Worcester witnessed a Royalist victory , under the command of Prince Rupert , the King 's nephew , at the Battle of Powick Bridge -- the first clash of Civil War arms .

source_bert_toks: in 1642 , worcester witnessed a royalist victory , under the command of prince rupert , the king ' s nephew , at the battle of pow ##ick bridge - - the first clash of civil war arms .

reference_raw: In 1642, Worcester witnessed a Royalist victory under the command of Prince Rupert, the King's nephew, at the Battle of Powick Bridge, the first conflict of civil war weapons.

reference_spacy_tokens: In 1642 , Worcester witnessed a Royalist victory under the command of Prince Rupert , the King 's nephew , at the Battle of Powick Bridge , the first conflict of civil war weapons .


fn_spacy_tokens_for_baseline: Hence it was not surprising that Britain declined the invitation to join the proposed coal and steel structure , ostensibly because it was unwilling to accept beforehand the principle of a new and binding supranational authority .

source_bert_toks: hence it was not surprising that britain declined the invitation to join the proposed coal and steel structure , ostensibly because it was unwilling to accept beforehand the principle of a new and binding su ##pr ##ana ##tion ##al authority .

reference_raw: It is not surprising, therefore, that Britain refused to join the proposed coal and steel structure, ostensibly because it was reluctant to accept the principle of a new and binding supranational authority in advance.

reference_spacy_tokens: It is not surprising , therefore , that Britain refused to join the proposed coal and steel structure , ostensibly because it was reluctant to accept the principle of a new and binding supranational authority in advance .


fn_spacy_tokens_for_baseline: Mary was posted to a notorious station in the Fens , called Sledgwick , which was universally known as HMS Sledgwick because it was practically under water and everyone wore gumboots and walked about on duckboards .

source_bert_toks: mary was posted to a notorious station in the fen ##s , called sl ##ed ##g ##wick , which was universally known as hms sl ##ed ##g ##wick because it was practically under water and everyone wore gum ##boot ##s and walked about on duck ##boards .

reference_raw: Mary had been sent to a well-known Fen station called Sledgwick, which was generally known as HMS Sledgwick, because it was almost underwater, and everyone was wearing rubber shoes and walking on duckboards.

reference_spacy_tokens: Mary had been sent to a well - known Fen station called Sledgwick , which was generally known as HMS Sledgwick , because it was almost underwater , and everyone was wearing rubber shoes and walking on duckboards .


fn_spacy_tokens_for_baseline: because even if you said okay you know armed forces could have them

reference_raw: because even if you say yes, you know that the military can have them.

reference_spacy_tokens: because even if you say yes , you know that the military can have them .


fn_spacy_tokens_for_baseline: 4- The Kiosk should be equipped with wireless communication equipment , and a mechanist to open and close the gate automatically .

source_bert_toks: 4 - the ki ##os ##k should be equipped with wireless communication equipment , and a me ##chan ##ist to open and close the gate automatically .

reference_raw: 4- The Kiosk should be equipped with a wireless com device and a mechanic to open and close the gate automatically.

reference_spacy_tokens: 4- The Kiosk should be equipped with a wireless com device and a mechanic to open and close the gate automatically .


fn_spacy_tokens_for_baseline: In 431 b.c . , Athens began a war with its neighbor and league member Sparta .

source_bert_toks: in 43 ##1 b . c . , athens began a war with its neighbor and league member sparta .

reference_raw: At 431 B.C., Athens began a war with Sparta's neighbours and league members.

reference_spacy_tokens: At 431 B.C. , Athens began a war with Sparta 's neighbours and league members .


fn_spacy_tokens_for_baseline: Some were whipped up with egg whites , lemon peel , and extra cream , some were served with raspberry , strawberry , redcurrant , apple , quince or medlar jelly .

source_bert_toks: some were whipped up with egg whites , lemon peel , and extra cream , some were served with ras ##p ##berry , strawberry , red ##cu ##rran ##t , apple , qui ##nce or med ##lar jelly .

reference_raw: Some were lashed with egg whites, lemon peel and extra cream, some served with raspberry, strawberry, red currant, apple, quince, or medlar jelly.

reference_spacy_tokens: Some were lashed with egg whites , lemon peel and extra cream , some served with raspberry , strawberry , red currant , apple , quince , or medlar jelly .


fn_spacy_tokens_for_baseline: Tuesday 's rout of a GOP congressional hopeful in a Mississippi district that has n't backed a Democratic presidential candidate since Adlai Stevenson is another reminder that , at least at the federal level , political " ticket splitting " has been on the rise over the past half century .

source_bert_toks: tuesday ' s ro ##ut of a go ##p congressional hopeful in a mississippi district that hasn ' t backed a democratic presidential candidate since ad ##lai stevenson is another reminder that , at least at the federal level , political " ticket splitting " has been on the rise over the past half century .

reference_raw: Tuesday's round of government congressional hopes in the Mississippi precinct, which has not supported a democratic presidential candidate since Adlai Stevenson, is another reminder that political "ticket split" has risen in the last half-century, at least at the federal level.

reference_spacy_tokens: Tuesday 's round of government congressional hopes in the Mississippi precinct , which has not supported a democratic presidential candidate since Adlai Stevenson , is another reminder that political " ticket split " has risen in the last half - century , at least at the federal level .


fn_spacy_tokens_for_baseline: This gives you access to the main centre 's restaurant , bar , squash courts , snooker rooms , gym , sauna and solarium .

source_bert_toks: this gives you access to the main centre ' s restaurant , bar , squash courts , snooker rooms , gym , sa ##una and solar ##ium .

reference_raw: This will give you access to the main-centre restaurant, bar, squash courts, snooker rooms, gym, sauna and sun.

reference_spacy_tokens: This will give you access to the main - centre restaurant , bar , squash courts , snooker rooms , gym , sauna and sun .


fn_spacy_tokens_for_baseline: She carried the censer carefully over to the bed and placed it on the floor .

source_bert_toks: she carried the ce ##nse ##r carefully over to the bed and placed it on the floor .

reference_raw: Carefully she carried the censor to the bed and laid it on the floor.

reference_spacy_tokens: Carefully she carried the censor to the bed and laid it on the floor .


fn_spacy_tokens_for_baseline: Prime Minister Costas Karamanlis was to for an emergency meeting of the senior ministers in the country 's capital , Athens .

source_bert_toks: prime minister costa ##s kara ##man ##lis was to for an emergency meeting of the senior ministers in the country ' s capital , athens .

reference_raw: Prime Minister Costas Karamanlis was scheduled for an emergency meeting with high-ranking ministers in the capital of Athens.

reference_spacy_tokens: Prime Minister Costas Karamanlis was scheduled for an emergency meeting with high - ranking ministers in the capital of Athens .


fn_spacy_tokens_for_baseline: ' They are afraid to spend money even when it is necessary , fond of receiving , niggardly in giving .

source_bert_toks: ' they are afraid to spend money even when it is necessary , fond of receiving , ni ##gga ##rd ##ly in giving .

reference_raw: They're afraid to spend money when it's necessary, they like to receive it, they're afraid to give it to them.

reference_spacy_tokens: They 're afraid to spend money when it 's necessary , they like to receive it , they 're afraid to give it to them .


fn_spacy_tokens_for_baseline: First , several brokers interviewed in Katmandu said that existing laws could be bypassed easily , thanks to corruption in the government .

source_bert_toks: first , several broker ##s interviewed in kat ##man ##du said that existing laws could be bypassed easily , thanks to corruption in the government .

reference_raw: First, several brokers interviewed in Katmandu said that the current laws can be easily circumvented by corruption in the government.

reference_spacy_tokens: First , several brokers interviewed in Katmandu said that the current laws can be easily circumvented by corruption in the government .


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around stupid artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had a disturbing Zipper problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around stupid artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing Zipper problem .


fn_spacy_tokens_for_baseline: These are particularly exciting times at the Indianapolis Museum of Art : Progress continues on the J.K. Lilly estate - Oldfields , our Ravine Garden has been restored to its original splendor , and there is national attention showered on our current exhibition of Japanese Painting . ( please see The New York Times article I have included . ) With thousands of trees and flowers in bloom , we are having a beautiful Spring !

source_bert_toks: these are particularly exciting times at the indianapolis museum of art : progress continues on the j . k . lilly estate - old ##fields , our ravine garden has been restored to its original sp ##len ##dor , and there is national attention showered on our current exhibition of japanese painting . ( please see the new york times article i have included . ) with thousands of trees and flowers in bloom , we are having a beautiful spring !

reference_raw: This is a particularly exciting time at the Indianapolis Museum of Art: progress continues on the J.K. Lilly estate-oldfields, the Ravine Garden has been restored to its original beauty, and national attention has been showered on our present exhibition of Japan's paintings (see the New York Times article I've included), with thousands of trees and flowers in bloom, we have a beautiful spring!

reference_spacy_tokens: This is a particularly exciting time at the Indianapolis Museum of Art : progress continues on the J.K. Lilly estate - oldfields , the Ravine Garden has been restored to its original beauty , and national attention has been showered on our present exhibition of Japan 's paintings ( see the New York Times article I 've included ) , with thousands of trees and flowers in bloom , we have a beautiful spring !


fn_spacy_tokens_for_baseline: Already she could visualise the lay - out -- ' The Other Side of Fashion ' she 'd entitled it in her mind 's eye when she 'd discussed it with Nick .

source_bert_toks: already she could visual ##ise the lay - out - - ' the other side of fashion ' she ' d entitled it in her mind ' s eye when she ' d discussed it with nick .

reference_raw: She could already imagine the lay-'Other Side of Fashion' in her mind's eye as she discussed it with Nick.

reference_spacy_tokens: She could already imagine the lay-'Other Side of Fashion ' in her mind 's eye as she discussed it with Nick .


fn_spacy_tokens_for_baseline: Except that Ray and I held back , watching the rain wet the while ash , carry it down in trickling grey rills .

source_bert_toks: except that ray and i held back , watching the rain wet the while ash , carry it down in trick ##ling grey ri ##lls .

reference_raw: Except for the fact that Ray and I were holding back, watching the rain wet the moment ash, carrying it down in a trickling gray rim.

reference_spacy_tokens: Except for the fact that Ray and I were holding back , watching the rain wet the moment ash , carrying it down in a trickling gray rim .


fn_spacy_tokens_for_baseline: His laconic comment was ' Nearly got that one , ' while the petrified Kington giggled nervously .

source_bert_toks: his lac ##onic comment was ' nearly got that one , ' while the pet ##rified king ##ton giggled nervously .

reference_raw: His laconic comment was "I almost got it," and the frozen Kington chuckled nervously.

reference_spacy_tokens: His laconic comment was " I almost got it , " and the frozen Kington chuckled nervously .


fn_spacy_tokens_for_baseline: According to International Atomic Energy Agency Director General Mohamed ElBaradei , who led a December 2003 inspection team to Libya , Libya 's nuclear weapons program is in the very initial stages , about three to seven years away from producing a nuclear weapon .

source_bert_toks: according to international atomic energy agency director general mohamed el ##bara ##de ##i , who led a december 2003 inspection team to libya , libya ' s nuclear weapons program is in the very initial stages , about three to seven years away from producing a nuclear weapon .

reference_raw: According to the Director-General of the International Atomic Energy Agency, Mohamed ElBaradei, who led an inspection team in November 2003 in Libya, the Libyan Nuclear Weapons Programme is in the first phase, which is about three to seven years from the production of a nuclear weapon.

reference_spacy_tokens: According to the Director - General of the International Atomic Energy Agency , Mohamed ElBaradei , who led an inspection team in November 2003 in Libya , the Libyan Nuclear Weapons Programme is in the first phase , which is about three to seven years from the production of a nuclear weapon .


fn_spacy_tokens_for_baseline: I pushed Kaptan up the bank with my palm in the seat of his pants .

source_bert_toks: i pushed ka ##pta ##n up the bank with my palm in the seat of his pants .

reference_raw: I pushed Kaptan up the bank with my hand in his trousers.

reference_spacy_tokens: I pushed Kaptan up the bank with my hand in his trousers .


fn_spacy_tokens_for_baseline: She had grabbed his arm , hard enough to bruise it , and she was staring wildly at him , as though she meant something quite different .

source_bert_toks: she had grabbed his arm , hard enough to bruise it , and she was staring wildly at him , as though she meant something quite different .

reference_raw: She grabbed him by the arm, hard enough to hurt him, and stared at him wildly, as if she meant something else entirely.

reference_spacy_tokens: She grabbed him by the arm , hard enough to hurt him , and stared at him wildly , as if she meant something else entirely .


fn_spacy_tokens_for_baseline: However , the label ' semantic ' will continue to be used , although it is intended that the reader should not restrict its denotation to the strict linguistic sense .

source_bert_toks: however , the label ' semantic ' will continue to be used , although it is intended that the reader should not restrict its den ##ota ##tion to the strict linguistic sense .

reference_raw: However, the label's semantics will continue to be used, but the reader should not limit its designation to a strict linguistic sense.

reference_spacy_tokens: However , the label 's semantics will continue to be used , but the reader should not limit its designation to a strict linguistic sense .


fn_spacy_tokens_for_baseline: He waited three days longer , and then his piety or his superstition drove him to try once more .

source_bert_toks: he waited three days longer , and then his pie ##ty or his super ##sti ##tion drove him to try once more .

reference_raw: He waited three more days, and then his piety or his superstition made him try again.

reference_spacy_tokens: He waited three more days , and then his piety or his superstition made him try again .


fn_spacy_tokens_for_baseline: Initially , North Korea claimed it had no intention of producing nuclear weapons , and that the lifting of the nuclear freeze was necessary to generate needed electricity .

source_bert_toks: initially , north korea claimed it had no intention of producing nuclear weapons , and that the lifting of the nuclear freeze was necessary to generate needed electricity .

reference_raw: North Korea initially claimed that it did not intend to produce nuclear weapons and that the abolition of the nuclear freeze was necessary to generate the necessary electricity.

reference_spacy_tokens: North Korea initially claimed that it did not intend to produce nuclear weapons and that the abolition of the nuclear freeze was necessary to generate the necessary electricity .


fn_spacy_tokens_for_baseline: Charles , eating his toast , opening his mail , had suddenly exclaimed with a parody of fury , ' Christ , it 's the Venables again ! "

source_bert_toks: charles , eating his toast , opening his mail , had suddenly exclaimed with a parody of fury , ' christ , it ' s the ve ##nable ##s again ! "

reference_raw: Charles, who had eaten his toast and opened his e-mail, suddenly cried in a parody of rage, "Christ, it's the Venables again!"

reference_spacy_tokens: Charles , who had eaten his toast and opened his e - mail , suddenly cried in a parody of rage , " Christ , it 's the Venables again ! "


fn_spacy_tokens_for_baseline: Gorgeous truffles from Carricknowe , cheese scones from the Manse and superlative Scottish baking from Trinity seemed to arrive hourly !

source_bert_toks: gorgeous tr ##uf ##fles from carr ##ick ##now ##e , cheese sc ##ones from the mans ##e and super ##lative scottish baking from trinity seemed to arrive hourly !

reference_raw: Gorgeous truffles from Carricknow, Manse cheese scones, and Trinity's super-lative Scottish baking seemed to arrive every hour!

reference_spacy_tokens: Gorgeous truffles from Carricknow , Manse cheese scones , and Trinity 's super - lative Scottish baking seemed to arrive every hour !


fn_spacy_tokens_for_baseline: A pounce , the cheetah 's jaws fasten on the gazelle 's throat , and it is quickly throttled to death .

source_bert_toks: a po ##unce , the che ##eta ##h ' s jaws fast ##en on the gaze ##lle ' s throat , and it is quickly throttle ##d to death .

reference_raw: The pounce, the cheetah's jaws are fixed on the gazelle's neck, and it's fast throttled to death.

reference_spacy_tokens: The pounce , the cheetah 's jaws are fixed on the gazelle 's neck , and it 's fast throttled to death .


fn_spacy_tokens_for_baseline: And the old Dublin is with us , too -- the irreverent city of wit and charm and that peculiar magic possessed by Ireland and the Irish .

source_bert_toks: and the old dublin is with us , too - - the ir ##re ##vere ##nt city of wit and charm and that peculiar magic possessed by ireland and the irish .

reference_raw: The old Dublin is with us, too - an irrespectable city of wits and charms, and a strange magic possessed by Ireland and the Irish.

reference_spacy_tokens: The old Dublin is with us , too - an irrespectable city of wits and charms , and a strange magic possessed by Ireland and the Irish .


fn_spacy_tokens_for_baseline: 1 ) Voters can " buy " one of two brands when they select their political agents -- a Republican brand that believes in the minimalist state and in the virtues of private markets over the vices of public action , and a Democratic brand that believes in big government and in public intervention to remedy the excesses attendant to the pursuit of private interest .

source_bert_toks: 1 ) voters can " buy " one of two brands when they select their political agents - - a republican brand that believes in the minimal ##ist state and in the virtues of private markets over the vice ##s of public action , and a democratic brand that believes in big government and in public intervention to remedy the excess ##es attendant to the pursuit of private interest .

reference_raw: 1) Voters can "buy" one of two brands if they choose their political agents, a Republican brand that believes in the minimalist state and the virtues of private markets over the vices of public action, and a democratic brand that believes in large government and public intervention to correct excesses associated with the pursuit of private interests.

reference_spacy_tokens: 1 ) Voters can " buy " one of two brands if they choose their political agents , a Republican brand that believes in the minimalist state and the virtues of private markets over the vices of public action , and a democratic brand that believes in large government and public intervention to correct excesses associated with the pursuit of private interests .


fn_spacy_tokens_for_baseline: Half a million civilians died in the Galilee and Judea as a result of this first revolt against Rome , a number unequaled in ancient warfare .

source_bert_toks: half a million civilians died in the galilee and jude ##a as a result of this first revolt against rome , a number une ##qual ##ed in ancient warfare .

reference_raw: In Galilee and Judea, half a million civilians died as a result of the first rebellion against Rome, many of them uneven during the ancient wars.

reference_spacy_tokens: In Galilee and Judea , half a million civilians died as a result of the first rebellion against Rome , many of them uneven during the ancient wars .


fn_spacy_tokens_for_baseline: The gossip among the servants is that their master is terribly afraid of something .

source_bert_toks: the gossip among the servants is that their master is terribly afraid of something .

reference_raw: There's a rumor among the servants that their master has a terrible fear of something.

reference_spacy_tokens: There 's a rumor among the servants that their master has a terrible fear of something .


fn_spacy_tokens_for_baseline: Since independence in 1962 , tourism has been Jamaica 's primary industry and the island has become renowned as one of the prime destinations in the Caribbean .

source_bert_toks: since independence in 1962 , tourism has been jamaica ' s primary industry and the island has become renowned as one of the prime destinations in the caribbean .

reference_raw: Since independence in 1962, tourism has been the main industry in Jamaica and the island has become known as one of the main destinations in the Caribbean.

reference_spacy_tokens: Since independence in 1962 , tourism has been the main industry in Jamaica and the island has become known as one of the main destinations in the Caribbean .


fn_spacy_tokens_for_baseline: Under the terms of the agreement , North Korea provided an " initial declaration " of its nuclear facilities and materials , provided access for IAEA inspectors to verify the completeness and correctness of the initial declaration .

source_bert_toks: under the terms of the agreement , north korea provided an " initial declaration " of its nuclear facilities and materials , provided access for ia ##ea inspectors to verify the complete ##ness and correct ##ness of the initial declaration .

reference_raw: Under the terms of the Agreement, North Korea has provided an initial declaration of its nuclear facilities and materials, providing access to the IAEA inspectors to verify the completeness and accuracy of the original declaration.

reference_spacy_tokens: Under the terms of the Agreement , North Korea has provided an initial declaration of its nuclear facilities and materials , providing access to the IAEA inspectors to verify the completeness and accuracy of the original declaration .


fn_spacy_tokens_for_baseline: And to a former federal bomb investigator , that description suggests a powerful military - style plastic explosive C-4 that can be cut or molded into different shapes .

source_bert_toks: and to a former federal bomb investigator , that description suggests a powerful military - style plastic explosive c - 4 that can be cut or molded into different shapes .

reference_raw: And for an ex-Federal Bomb Investigator, this description suggests a powerful military-style Plastique C-4 that can be cut or shaped in various forms.

reference_spacy_tokens: And for an ex - Federal Bomb Investigator , this description suggests a powerful military - style Plastique C-4 that can be cut or shaped in various forms .