fn_spacy_tokens_for_baseline: Reports of exports and leakage of Russian missile technology to countries such as Iran , India , China , Libya , and North Korea have led to concerns that Russia is contravening its obligations as a member of the Missile Technology Control Regime ( MTCR ) .

source_bert_toks: reports of exports and leak ##age of russian missile technology to countries such as iran , india , china , libya , and north korea have led to concerns that russia is contra ##ven ##ing its obligations as a member of the missile technology control regime ( mt ##cr ) .

reference_raw: Reports of exports and leakages of Russian missile technology to countries like Iran, India, China, Libya, and North Korea have led to concerns that Russia is in breach of its commitments as a member of the MTCR.

reference_spacy_tokens: Reports of exports and leakages of Russian missile technology to countries like Iran , India , China , Libya , and North Korea have led to concerns that Russia is in breach of its commitments as a member of the MTCR .


fn_spacy_tokens_for_baseline: Under Cooperative Threat Reduction ( CTR ) programs , Biomedpreparat has been dismantled and safety and security have been upgraded at SCQZI and SRAI .

source_bert_toks: under cooperative threat reduction ( ct ##r ) programs , bio ##med ##pre ##para ##t has been dismantled and safety and security have been upgraded at sc ##q ##zi and sr ##ai .

reference_raw: Biomedpreparat has been dismantled under cooperative threat reduction programmes and security and security has been improved in SCQZI and SRAI.

reference_spacy_tokens: Biomedpreparat has been dismantled under cooperative threat reduction programmes and security and security has been improved in SCQZI and SRAI .


fn_spacy_tokens_for_baseline: This difficulty is compounded by the fact that much of the information can be directly traced back to just a handful of sources , none of which can be independently verified .

source_bert_toks: this difficulty is compound ##ed by the fact that much of the information can be directly traced back to just a handful of sources , none of which can be independently verified .

reference_raw: This difficulty is compounded by the fact that most of the information can be directly traced back to only a few sources, none of which can be independently verified.

reference_spacy_tokens: This difficulty is compounded by the fact that most of the information can be directly traced back to only a few sources , none of which can be independently verified .


fn_spacy_tokens_for_baseline: Lizaveta 's final outrage is inflicted by a man who almost cleaves her head in two .

source_bert_toks: liza ##vet ##a ' s final outrage is inflicted by a man who almost cl ##ea ##ves her head in two .

reference_raw: Lizaveta's final indignation is caused by a man who nearly cuts his head in two.

reference_spacy_tokens: Lizaveta 's final indignation is caused by a man who nearly cuts his head in two .


fn_spacy_tokens_for_baseline: The contrast struck Mr. Thorndike 's sense of humor full in the centre .

source_bert_toks: the contrast struck mr . thorn ##di ##ke ' s sense of humor full in the centre .

reference_raw: Mr. Thorndike felt full of humor in the middle of that contrast.

reference_spacy_tokens: Mr. Thorndike felt full of humor in the middle of that contrast .


fn_spacy_tokens_for_baseline: ' Oh , I do n't mind them , " said Bob , wedging his head against the back of the chair , so that the colossal thumping going on inside his skull would n't shake it loose from its mountings .

source_bert_toks: ' oh , i don ' t mind them , " said bob , wed ##ging his head against the back of the chair , so that the colossal thumping going on inside his skull wouldn ' t shake it loose from its mounting ##s .

reference_raw: "Oh, they don't bother me," Bob said, wedding his head against the back of his chair, so that the colossal thump in his skull would not free him from his mountings.

reference_spacy_tokens: " Oh , they do n't bother me , " Bob said , wedding his head against the back of his chair , so that the colossal thump in his skull would not free him from his mountings .


fn_spacy_tokens_for_baseline: If they are afraid of the undead , a Vampire is unleashed upon them .

source_bert_toks: if they are afraid of the undead , a vampire is unleashed upon them .

reference_raw: If they fear the zombies, the vampire will be unleashed on them.

reference_spacy_tokens: If they fear the zombies , the vampire will be unleashed on them .


fn_spacy_tokens_for_baseline: Sightseeing in Hong Kong starts at sea level with the enthralling water traffic?-?a mix of freighters , ferries , tugs , junks , and yachts .

source_bert_toks: sights ##ee ##ing in hong kong starts at sea level with the en ##th ##ral ##ling water traffic ? - ? a mix of freighter ##s , ferries , tugs , junk ##s , and yacht ##s .

reference_raw: Sightseeing in Hong Kong begins at sea with an enthralling sea traffic? - a combination of cargo ships, ferries, tugs, junks, and yachts.

reference_spacy_tokens: Sightseeing in Hong Kong begins at sea with an enthralling sea traffic ? - a combination of cargo ships , ferries , tugs , junks , and yachts .


fn_spacy_tokens_for_baseline: Immediately , they heard raised voices and saw that the porter was engaged in an altercation with two men in trench coats .

source_bert_toks: immediately , they heard raised voices and saw that the porter was engaged in an alter ##cation with two men in trench coats .

reference_raw: Instantly they heard raised voices and saw that the porter was engaged in a fight with two men in trench coats.

reference_spacy_tokens: Instantly they heard raised voices and saw that the porter was engaged in a fight with two men in trench coats .


fn_spacy_tokens_for_baseline: But some arms control specialists worry that the National Biodefense Analysis and Countermeasures Center -- now operating out of borrowed lab space at the Frederick base and elsewhere -- might develop new vaccine - resistant or lethal microbes without solid evidence of a terrorist plot to unleash similar bugs .

source_bert_toks: but some arms control specialists worry that the national bio ##de ##fen ##se analysis and counter ##me ##as ##ures center - - now operating out of borrowed lab space at the frederick base and elsewhere - - might develop new vaccine - resistant or lethal micro ##bes without solid evidence of a terrorist plot to un ##lea ##sh similar bugs .

reference_raw: But some weapons control experts fear that the National Biodefence Analysis and Countermeasures Center, now operating from borrowed laboratory space at Frederick Base and elsewhere, may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs.

reference_spacy_tokens: But some weapons control experts fear that the National Biodefence Analysis and Countermeasures Center , now operating from borrowed laboratory space at Frederick Base and elsewhere , may develop new vaccines - resistant or lethal microbes without solid proof of a terrorist conspiracy to release such bugs .


fn_spacy_tokens_for_baseline: Someone has typed in the team news already ( I actually got into teh ground a bit late so I missed the starting line - up ) .

source_bert_toks: someone has typed in the team news already ( i actually got into te ##h ground a bit late so i missed the starting line - up ) .

reference_raw: Someone's already written the team's news (in fact, I got to the ground a little late, so I missed the start-up lineup).

reference_spacy_tokens: Someone 's already written the team 's news ( in fact , I got to the ground a little late , so I missed the start - up lineup ) .


fn_spacy_tokens_for_baseline: 3 ) Republican congressional representatives , because of their belief in a minimalist state , are less willing to engage in local benefit - seeking than are Democratic members of Congress .

source_bert_toks: 3 ) republican congressional representatives , because of their belief in a minimal ##ist state , are less willing to engage in local benefit - seeking than are democratic members of congress .

reference_raw: (3) Representatives of the Republican Congress are less willing to engage in local benefit-seeking due to their belief in a minimalist state than democratic members of Congress.

reference_spacy_tokens: ( 3 ) Representatives of the Republican Congress are less willing to engage in local benefit - seeking due to their belief in a minimalist state than democratic members of Congress .


fn_spacy_tokens_for_baseline: He really lusted after me in those days .

source_bert_toks: he really lust ##ed after me in those days .

reference_raw: He really wanted me back then.

reference_spacy_tokens: He really wanted me back then .


fn_spacy_tokens_for_baseline: ' It 's put us in a fix . '

source_bert_toks: ' it ' s put us in a fix . '

reference_raw: "That puts us in trouble."

reference_spacy_tokens: " That puts us in trouble . "


fn_spacy_tokens_for_baseline: A bullet clanged monstrously loud on a brass barrel and ricocheted up into the sky .

source_bert_toks: a bullet clan ##ged monstrous ##ly loud on a brass barrel and rico ##chet ##ed up into the sky .

reference_raw: The bullet clicked monstrously loudly on the brass barrel and bounced up into the sky.

reference_spacy_tokens: The bullet clicked monstrously loudly on the brass barrel and bounced up into the sky .


fn_spacy_tokens_for_baseline: CW agents are then moved to either a Sakchu - or Kanggye - based chemical weapons facility for weaponization , i.e. , the filling of weapons with agents for deployment .

source_bert_toks: cw agents are then moved to either a sa ##k ##chu - or kang ##gy ##e - based chemical weapons facility for weapon ##ization , i . e . , the filling of weapons with agents for deployment .

reference_raw: The CW agents are then transferred to either Sakchu-or Kanggy-based chemical weapons equipment for weaponization, that is to say, the filling of weapons with agents for deployment.

reference_spacy_tokens: The CW agents are then transferred to either Sakchu - or Kanggy - based chemical weapons equipment for weaponization , that is to say , the filling of weapons with agents for deployment .


fn_spacy_tokens_for_baseline: ' Then came the downfall of the tyrant .

source_bert_toks: ' then came the downfall of the tyrant .

reference_raw: 'Then came the downfall of the bully.

reference_spacy_tokens: ' Then came the downfall of the bully .


fn_spacy_tokens_for_baseline: Depending on what side of the city you live in Buenos Aires , Maradona is either the greatest player of his generation --- or an arrogant loudmouth who should have retired at his peak .

source_bert_toks: depending on what side of the city you live in buenos aires , mara ##don ##a is either the greatest player of his generation - - - or an arrogant loud ##mouth who should have retired at his peak .

reference_raw: Depending on which side of the city you live in Buenos Aires, Maradona is either the greatest player of his generation - or an arrogant loudspeaker who should retire at his peak.

reference_spacy_tokens: Depending on which side of the city you live in Buenos Aires , Maradona is either the greatest player of his generation - or an arrogant loudspeaker who should retire at his peak .


fn_spacy_tokens_for_baseline: It noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would degrade the fighting ability of enemy forces .

source_bert_toks: it noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would de ##grade the fighting ability of enemy forces .

reference_raw: He noted how useful it was to get the enemy to "suit up" in preparation for the actual or imagined use of chemical agents, because it would undermine the fighting capabilities of the enemy.

reference_spacy_tokens: He noted how useful it was to get the enemy to " suit up " in preparation for the actual or imagined use of chemical agents , because it would undermine the fighting capabilities of the enemy .


fn_spacy_tokens_for_baseline: The board frequently has engaged in public disputes and has been accused by the federal court of making decisions based on narrow agendas and meddling where it should n't . QN : Does the board often make decisions based on narrow agendas ?

source_bert_toks: the board frequently has engaged in public disputes and has been accused by the federal court of making decisions based on narrow agenda ##s and med ##dling where it shouldn ' t . q ##n : does the board often make decisions based on narrow agenda ##s ?

reference_raw: The board of directors is often involved in public disputes and is charged by the federal court with taking decisions on the basis of narrow agendas and interfering where they should not. QN: Does the board often make decisions on the basis of narrow agendas?

reference_spacy_tokens: The board of directors is often involved in public disputes and is charged by the federal court with taking decisions on the basis of narrow agendas and interfering where they should not . QN : Does the board often make decisions on the basis of narrow agendas ?


fn_spacy_tokens_for_baseline: Henceforward they were a minor annoyance on the very fringes of European politics rather than a serious menace to British security .

source_bert_toks: hence ##for ##ward they were a minor annoyance on the very fringe ##s of european politics rather than a serious menace to british security .

reference_raw: From now on, they were a minor nuisance at the very edge of European politics, rather than a serious threat to British security.

reference_spacy_tokens: From now on , they were a minor nuisance at the very edge of European politics , rather than a serious threat to British security .


fn_spacy_tokens_for_baseline: A spear squealed on the rim of his shield and he lifted his sword .

source_bert_toks: a spear squealed on the rim of his shield and he lifted his sword .

reference_raw: A spear whistled at the edge of his shield, and he raised his sword.

reference_spacy_tokens: A spear whistled at the edge of his shield , and he raised his sword .


fn_spacy_tokens_for_baseline: The fight lasted 20 gripping minutes before the streamlined , sharp toothed giant was landed on the deck of his boat .

source_bert_toks: the fight lasted 20 gripping minutes before the streamlined , sharp tooth ##ed giant was landed on the deck of his boat .

reference_raw: The battle took twenty clutching minutes before the streamlined, sharp-toothed giant landed on the deck of his ship.

reference_spacy_tokens: The battle took twenty clutching minutes before the streamlined , sharp - toothed giant landed on the deck of his ship .


fn_spacy_tokens_for_baseline: There are a lot of barriers that keep people from working : physical and mental disabilities , history of welfare dependency and lack of education or self - esteem .

source_bert_toks: there are a lot of barriers that keep people from working : physical and mental disabilities , history of welfare dependency and lack of education or self - esteem .

reference_raw: There are many obstacles that prevent people from working: physical and mental disabilities, a history of social dependence and a lack of education or self-respect.

reference_spacy_tokens: There are many obstacles that prevent people from working : physical and mental disabilities , a history of social dependence and a lack of education or self - respect .


fn_spacy_tokens_for_baseline: The software then automatically routes the document to the next person in the process .

source_bert_toks: the software then automatically routes the document to the next person in the process .

reference_raw: The software then automatically redirects the document to the next person in the process.

reference_spacy_tokens: The software then automatically redirects the document to the next person in the process .


fn_spacy_tokens_for_baseline: ' ' The true voodoo - worshipper attempts nothing of importance without certain sacrifices which are intended to propitiate his unclean gods .

source_bert_toks: ' ' the true voodoo - worship ##per attempts nothing of importance without certain sacrifices which are intended to prop ##itia ##te his uncle ##an gods .

reference_raw: 'A true voodoo worshipper doesn't try to do anything important without certain sacrifices to propagate his unclean gods.

reference_spacy_tokens: ' A true voodoo worshipper does n't try to do anything important without certain sacrifices to propagate his unclean gods .


fn_spacy_tokens_for_baseline: Several hours earlier the caliph woke feeling very strange .

source_bert_toks: several hours earlier the caliph woke feeling very strange .

reference_raw: A few hours ago, the calif woke up feeling very strange.

reference_spacy_tokens: A few hours ago , the calif woke up feeling very strange .


fn_spacy_tokens_for_baseline: It was highly reprehensible for a young girl who had not been properly initiated into the status of motherhood to become pregnant .

source_bert_toks: it was highly rep ##re ##hen ##sible for a young girl who had not been properly initiated into the status of mother ##hood to become pregnant .

reference_raw: It was highly repulsive for a young girl who had not been properly conceived as a mother to become pregnant.

reference_spacy_tokens: It was highly repulsive for a young girl who had not been properly conceived as a mother to become pregnant .


fn_spacy_tokens_for_baseline: The young man said he came forward because a friend had been killed by insurgents , and because he had been heartened by the earlier raid .

source_bert_toks: the young man said he came forward because a friend had been killed by insurgents , and because he had been heart ##ened by the earlier raid .

reference_raw: The young man said he'd come in because his friend had been killed by the rebels, and because he'd been heartened by the previous raid.

reference_spacy_tokens: The young man said he 'd come in because his friend had been killed by the rebels , and because he 'd been heartened by the previous raid .


fn_spacy_tokens_for_baseline: His Treasury officials were infected by the gloomy whiff of failure clinging to him since September .

source_bert_toks: his treasury officials were infected by the gloom ##y w ##hiff of failure clinging to him since september .

reference_raw: His treasury officials had been infected by a grim wave of failure that had clung to him since September.

reference_spacy_tokens: His treasury officials had been infected by a grim wave of failure that had clung to him since September .


fn_spacy_tokens_for_baseline: AKU 's Biomaterials Laboratory is the largest university laboratory fostering research in the area of synthesis , processing , and modification of materials for use in biological environments .

source_bert_toks: ak ##u ' s bio ##mate ##rial ##s laboratory is the largest university laboratory foster ##ing research in the area of synthesis , processing , and modification of materials for use in biological environments .

reference_raw: The AKU Biomaterials Laboratory is the largest university laboratory promoting research in the field of synthesis, processing and adaptation of materials for use in biological environments.

reference_spacy_tokens: The AKU Biomaterials Laboratory is the largest university laboratory promoting research in the field of synthesis , processing and adaptation of materials for use in biological environments .


fn_spacy_tokens_for_baseline: Her kind would do anything to append the heavenly word ' artist ' to themselves .

source_bert_toks: her kind would do anything to app ##end the heavenly word ' artist ' to themselves .

reference_raw: Her kind would do anything to add the celestial word "artist."

reference_spacy_tokens: Her kind would do anything to add the celestial word " artist . "


fn_spacy_tokens_for_baseline: How pale and remorseless his eyes were , even though the set of his other features was quite neutral .

source_bert_toks: how pale and remorse ##less his eyes were , even though the set of his other features was quite neutral .

reference_raw: How pale and ruthless his eyes were, though his other features were quite neutral.

reference_spacy_tokens: How pale and ruthless his eyes were , though his other features were quite neutral .


fn_spacy_tokens_for_baseline: The tape controlled the entire show , including all lighting cues , and the stage manager would have little more to do than read his newspaper and greenlight the girls as they waited in the wings .

source_bert_toks: the tape controlled the entire show , including all lighting cues , and the stage manager would have little more to do than read his newspaper and green ##light the girls as they waited in the wings .

reference_raw: The tape controlled the whole show, including all the lights, and the stage manager had no choice but to read his newspaper and light the girls while they waited in the wings.

reference_spacy_tokens: The tape controlled the whole show , including all the lights , and the stage manager had no choice but to read his newspaper and light the girls while they waited in the wings .


fn_spacy_tokens_for_baseline: It is administered by the authorities on Taiwan .

source_bert_toks: it is administered by the authorities on taiwan .

reference_raw: It is managed by the Taiwanese authorities.

reference_spacy_tokens: It is managed by the Taiwanese authorities .


fn_spacy_tokens_for_baseline: Local fire departments put the current death toll at at least 37 , nine of which were children .

source_bert_toks: local fire departments put the current death toll at at least 37 , nine of which were children .

reference_raw: The local firefighters put the current death toll at least 37, nine of which were children.

reference_spacy_tokens: The local firefighters put the current death toll at least 37 , nine of which were children .


fn_spacy_tokens_for_baseline: a unit that , during 1985 , served a generator in any State that producedelectricity for sale .

source_bert_toks: a unit that , during 1985 , served a generator in any state that produced ##ele ##ctric ##ity for sale .

reference_raw: a unit which, in 1985, was used by a producer in any State which produced electricity for sale.

reference_spacy_tokens: a unit which , in 1985 , was used by a producer in any State which produced electricity for sale .


fn_spacy_tokens_for_baseline: This is not a luxury Aussie skyscraper that caters for soft city folk -- it 's for those who relish a taste of adventure in the New Zealand outback .

source_bert_toks: this is not a luxury aus ##sie skyscraper that cater ##s for soft city folk - - it ' s for those who re ##lish a taste of adventure in the new zealand out ##back .

reference_raw: It's not the luxurious Australian skyscraper that caters for the soft townspeople - it's for those who enjoy the adventures of New Zealand's outdoors.

reference_spacy_tokens: It 's not the luxurious Australian skyscraper that caters for the soft townspeople - it 's for those who enjoy the adventures of New Zealand 's outdoors .


fn_spacy_tokens_for_baseline: In time , the kingdom of Babylon was overthrown and the Israelites were permitted to return to Jerusalem in 539 b.c . The city was now under the more tolerant rule of the Persians , but rebuilding was slow work .

source_bert_toks: in time , the kingdom of babylon was overthrow ##n and the israeli ##tes were permitted to return to jerusalem in 53 ##9 b . c . the city was now under the more tolerant rule of the persians , but rebuilding was slow work .

reference_raw: In time, Babylon was overthrown and the Israelis were allowed to return to Jerusalem in 539 B.C., the city was now under a more tolerant Persian government, but the reconstruction was slow work.

reference_spacy_tokens: In time , Babylon was overthrown and the Israelis were allowed to return to Jerusalem in 539 B.C. , the city was now under a more tolerant Persian government , but the reconstruction was slow work .


fn_spacy_tokens_for_baseline: Enormous chains were fastened to our ankles .

source_bert_toks: enormous chains were fastened to our ankles .

reference_raw: We had huge chains attached to our ankles.

reference_spacy_tokens: We had huge chains attached to our ankles .


fn_spacy_tokens_for_baseline: No evidence obtained to date suggests that Al Qa'ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

source_bert_toks: no evidence obtained to date suggests that al q ##a ' ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

reference_raw: There is no evidence that Al Qa'ida has actually been able to produce a significant amount of chemical or biological agents or that it has developed an effective means of delivery, but the intention to do so is clear.

reference_spacy_tokens: There is no evidence that Al Qa'ida has actually been able to produce a significant amount of chemical or biological agents or that it has developed an effective means of delivery , but the intention to do so is clear .


fn_spacy_tokens_for_baseline: The two traces on top of each image correspond to the time course of the fluo-4 fluorescence averaged across the entire line - scan at -10 mV , which is close to the threshold , and at +90 mV , which produced the maximum Ca 2+transient .

source_bert_toks: the two traces on top of each image correspond to the time course of the flu ##o - 4 flu ##orescence averaged across the entire line - scan at - 10 mv , which is close to the threshold , and at + 90 mv , which produced the maximum ca 2 + transient .

reference_raw: The two marks at the top of each image correspond to the fluo-4 fluorescence time cycle averaged over the whole line scan at -10 mV, close to the threshold, and at +90 mV, producing the maximum Ca 2+-transient.

reference_spacy_tokens: The two marks at the top of each image correspond to the fluo-4 fluorescence time cycle averaged over the whole line scan at -10 mV , close to the threshold , and at +90 mV , producing the maximum Ca 2 + -transient .


fn_spacy_tokens_for_baseline: I wanted that card to complete the set , so ruefully handed over twelve of my duplicates .

source_bert_toks: i wanted that card to complete the set , so rue ##fully handed over twelve of my duplicate ##s .

reference_raw: I wanted the card to finish the set, so I sadly handed over twelve of my copies.

reference_spacy_tokens: I wanted the card to finish the set , so I sadly handed over twelve of my copies .


fn_spacy_tokens_for_baseline: He gave a triumphant bellow as Bull O'Malley shook his head .

source_bert_toks: he gave a triumphant bell ##ow as bull o ' malley shook his head .

reference_raw: As Bull O'Malley shook his head, he shouted triumphantly.

reference_spacy_tokens: As Bull O'Malley shook his head , he shouted triumphantly .


fn_spacy_tokens_for_baseline: Felonious assault is punishable by 2 - 8 years , and the weapons charge , also a felony , carries a penalty of 6 - 18 months upon conviction .

source_bert_toks: fe ##lon ##ious assault is punish ##able by 2 - 8 years , and the weapons charge , also a felony , carries a penalty of 6 - 18 months upon conviction .

reference_raw: A felony assault is punishable by two to eight years, and a weapon charge, as well as a crime, is punishable by six to eighteen months after conviction.

reference_spacy_tokens: A felony assault is punishable by two to eight years , and a weapon charge , as well as a crime , is punishable by six to eighteen months after conviction .


fn_spacy_tokens_for_baseline: Politically , the 1990s have been relatively quite times for the islands , although the divorce of Greek prime minister Andreas Papandreou and his subsequent marriage to a much younger woman caused consternation within conservative Greek society .

source_bert_toks: politically , the 1990s have been relatively quite times for the islands , although the divorce of greek prime minister andreas papa ##nd ##re ##ou and his subsequent marriage to a much younger woman caused con ##ster ##nation within conservative greek society .

reference_raw: From a political point of view, the 1990s were quite a time for the islands, although the divorce of Greek Premier Andreas Papandreou and his subsequent marriage to a much younger woman caused consternation in a conservative Greek society.

reference_spacy_tokens: From a political point of view , the 1990s were quite a time for the islands , although the divorce of Greek Premier Andreas Papandreou and his subsequent marriage to a much younger woman caused consternation in a conservative Greek society .


fn_spacy_tokens_for_baseline: The Archdeacon did not , diplomatically , point out that the Bishop had not consulted Lord Dersingham when the living had been in his gift .

source_bert_toks: the archdeacon did not , diplomatic ##ally , point out that the bishop had not consulted lord der ##sing ##ham when the living had been in his gift .

reference_raw: Diplomatically, the Archdeacon did not point out that the bishop had not consulted Lord Dersingham when the life was in his gift.

reference_spacy_tokens: Diplomatically , the Archdeacon did not point out that the bishop had not consulted Lord Dersingham when the life was in his gift .


fn_spacy_tokens_for_baseline: The state legislature helped as well , by legalizing gambling in 1931 and thus solidifying the future of the town , though legislators and residents could never have known this at the time .

source_bert_toks: the state legislature helped as well , by legal ##izing gambling in 1931 and thus solid ##ifying the future of the town , though legislators and residents could never have known this at the time .

reference_raw: The State legislature also helped to legalize gambling in 1931 and thus to strengthen the future of the city, although the legislature and residents could not have known at the time.

reference_spacy_tokens: The State legislature also helped to legalize gambling in 1931 and thus to strengthen the future of the city , although the legislature and residents could not have known at the time .


fn_spacy_tokens_for_baseline: Quigley waved the paper over my face .

source_bert_toks: qui ##gley waved the paper over my face .

reference_raw: Quigley swept the paper across my face.

reference_spacy_tokens: Quigley swept the paper across my face .


fn_spacy_tokens_for_baseline: He read about the unemployed in newspapers and saw films about them on television , pacing across photogenic sections of contemporary Britain and muttering darkly about waste and emptiness .

source_bert_toks: he read about the unemployed in newspapers and saw films about them on television , pacing across photo ##genic sections of contemporary britain and muttering darkly about waste and emptiness .

reference_raw: He studied the unemployed in the newspapers and watched movies about them on TV, pacing the photogenic parts of the modern Britain, muttering darkly about waste and emptiness.

reference_spacy_tokens: He studied the unemployed in the newspapers and watched movies about them on TV , pacing the photogenic parts of the modern Britain , muttering darkly about waste and emptiness .


fn_spacy_tokens_for_baseline: Furthermore , Iran clearly possesses technology useful for producing biological weapons ( as will be elucidated in the Facilities section of this profile ) .

source_bert_toks: furthermore , iran clearly possesses technology useful for producing biological weapons ( as will be el ##uc ##ida ##ted in the facilities section of this profile ) .

reference_raw: In addition, Iran clearly has a technology of use for the production of biological weapons (as will be explained in the Facilities section of this profile).

reference_spacy_tokens: In addition , Iran clearly has a technology of use for the production of biological weapons ( as will be explained in the Facilities section of this profile ) .


fn_spacy_tokens_for_baseline: All Iran 's research activities in the recent past undoubtedly contribute to the future development of a complete nuclear fuel cycle , which in turn would enable Iran to weaponize without relying on outside assistance .

source_bert_toks: all iran ' s research activities in the recent past undoubtedly contribute to the future development of a complete nuclear fuel cycle , which in turn would enable iran to weapon ##ize without relying on outside assistance .

reference_raw: All Iranian research activities in the recent past undoubtedly contribute to the future development of a full nuclear fuel cycle that would enable Iran to weaponize without relying on external assistance.

reference_spacy_tokens: All Iranian research activities in the recent past undoubtedly contribute to the future development of a full nuclear fuel cycle that would enable Iran to weaponize without relying on external assistance .


fn_spacy_tokens_for_baseline: ' We Queens must stick together , ' Minton had once told John Norris Wood who had expressed surprise at Minton 's devotion to the Queen Mother .

source_bert_toks: ' we queens must stick together , ' mint ##on had once told john norris wood who had expressed surprise at mint ##on ' s devotion to the queen mother .

reference_raw: 'We Queens have to stick together,' Minton had once said to John Norris Wood, who had expressed his astonishment at Minton's devotion to the Queen Mother.

reference_spacy_tokens: ' We Queens have to stick together , ' Minton had once said to John Norris Wood , who had expressed his astonishment at Minton 's devotion to the Queen Mother .


fn_spacy_tokens_for_baseline: From Washington 's perspective , " improved implementation of the Agreed Framework " meant an acceleration of safeguards inspections , even though the agreement did not require Pyongyang to submit to full safeguards inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

source_bert_toks: from washington ' s perspective , " improved implementation of the agreed framework " meant an acceleration of safeguard ##s inspections , even though the agreement did not require p ##yon ##gy ##ang to submit to full safeguard ##s inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

reference_raw: From Washington's point of view, "improved application of the agreed framework" meant speeding up security inspections, although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the construction of the reactor was completed but before the delivery of critical reactor components.

reference_spacy_tokens: From Washington 's point of view , " improved application of the agreed framework " meant speeding up security inspections , although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the construction of the reactor was completed but before the delivery of critical reactor components .


fn_spacy_tokens_for_baseline: At one end of it a coloured poster , too large for indoor display , had been tacked to the wall .

source_bert_toks: at one end of it a coloured poster , too large for indoor display , had been tack ##ed to the wall .

reference_raw: At one end of the wall was a colored poster, too large for internal display.

reference_spacy_tokens: At one end of the wall was a colored poster , too large for internal display .


fn_spacy_tokens_for_baseline: Russia has also supported Iran 's disclosure efforts , despite Russian President Vladimir Putin 's November 2003 charge that Iran acted in bad faith by failing to fully comply with IAEA inspections .

source_bert_toks: russia has also supported iran ' s disclosure efforts , despite russian president vladimir putin ' s november 2003 charge that iran acted in bad faith by failing to fully comply with ia ##ea inspections .

reference_raw: Russia has also supported Iranian disclosure efforts, despite the allegations made by Russian President Vladimir Putin in November 2003 that Iran behaved in bad faith by failing to fully comply with the IAEA inspections.

reference_spacy_tokens: Russia has also supported Iranian disclosure efforts , despite the allegations made by Russian President Vladimir Putin in November 2003 that Iran behaved in bad faith by failing to fully comply with the IAEA inspections .


fn_spacy_tokens_for_baseline: While China has publicly declared to be consistently in compliance with the BTWC , past U.S. government reports have alleged that China not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as Iran .

source_bert_toks: while china has publicly declared to be consistently in compliance with the bt ##wc , past u . s . government reports have alleged that china not only has a small - scale offensive biological weapons program , but has also transferred controlled biological weapons - related items to nations of proliferation concern such as iran .

reference_raw: While China has publicly declared that it is consistent with the BTWC, past US government reports claim that China has not only a small-scale attack biological weapons program, but also transferred controlled biological weapons - related items to proliferation-related countries such as Iran.

reference_spacy_tokens: While China has publicly declared that it is consistent with the BTWC , past US government reports claim that China has not only a small - scale attack biological weapons program , but also transferred controlled biological weapons - related items to proliferation - related countries such as Iran .


fn_spacy_tokens_for_baseline: But the scene seemed to invigorate Ivanisevic 's game even more .

source_bert_toks: but the scene seemed to in ##vi ##gor ##ate ivan ##ise ##vic ' s game even more .

reference_raw: But the scene seemed to make Ivanisevic's play even more exciting.

reference_spacy_tokens: But the scene seemed to make Ivanisevic 's play even more exciting .


fn_spacy_tokens_for_baseline: An Excursion to Guangzhou ( Canton ) Guangzhou was China 's major seaport for 2,000 years and the center for European traders in the 19th century .

source_bert_toks: an excursion to guangzhou ( canton ) guangzhou was china ' s major sea ##port for 2 , 000 years and the center for european traders in the 19th century .

reference_raw: Guangzhou's trip to Guangzhou (Canton) has been China's main port for 2,000 years and the centre of European merchants in the 19th century.

reference_spacy_tokens: Guangzhou 's trip to Guangzhou ( Canton ) has been China 's main port for 2,000 years and the centre of European merchants in the 19th century .


reference_raw: According to the available information, Iran has a current ballistic missile list of 325 - 550 systems: 200 - 300 Shehab-1, 100 - 150 Shehab-2, 25 - 100 Shehab-3 and 1 - 5 Shehab-4/5 prototypes.


fn_spacy_tokens_for_baseline: CIA officer Tyler Drumheller said he personally crossed out a reference to the labs from a classified draft of a U.N. speech by Secretary of State Colin Powell because he recognized the source as a defector , code - named Curveball , who was suspected to be mentally unstable and a liar .

source_bert_toks: cia officer tyler drum ##hell ##er said he personally crossed out a reference to the labs from a classified draft of a u . n . speech by secretary of state colin powell because he recognized the source as a defect ##or , code - named curve ##ball , who was suspected to be mentally unstable and a liar .

reference_raw: C.I.A. Officer Tyler Drumheller said that he personally removed a reference to the lab from a secret UN speech from Secretary of State Colin Powell because he recognized the source as a defector, code-named Curveball, who was suspected to be mentally unstable and a liar.

reference_spacy_tokens: C.I.A. Officer Tyler Drumheller said that he personally removed a reference to the lab from a secret UN speech from Secretary of State Colin Powell because he recognized the source as a defector , code - named Curveball , who was suspected to be mentally unstable and a liar .


fn_spacy_tokens_for_baseline: QN : Is Iran running a secret weapons program under the cover of plans to build nuclear power plants for electricity ?

source_bert_toks: q ##n : is iran running a secret weapons program under the cover of plans to build nuclear power plants for electricity ?

reference_raw: QN: Does Iran run a secret weapons program under the cover of plans for the construction of nuclear power plants?

reference_spacy_tokens: QN : Does Iran run a secret weapons program under the cover of plans for the construction of nuclear power plants ?


fn_spacy_tokens_for_baseline: After they had left the tavern , there were always some globules of mercury on the floor which the charitable thought had spilt from their bottles , but the waiters knew had come from the men themselves .

source_bert_toks: after they had left the tavern , there were always some g ##lo ##bu ##les of mercury on the floor which the charitable thought had sp ##il ##t from their bottles , but the waiter ##s knew had come from the men themselves .

reference_raw: When they left the inn, there were always lumps of mercury on the floor that the charitable thought had spilled out of the bottles, but the waiters knew it was the men themselves.

reference_spacy_tokens: When they left the inn , there were always lumps of mercury on the floor that the charitable thought had spilled out of the bottles , but the waiters knew it was the men themselves .


fn_spacy_tokens_for_baseline: One orang - utan peels a banana as the pair chat about the advantages of having an electric tumble drier .

source_bert_toks: one or ##ang - uta ##n peel ##s a banana as the pair chat about the advantages of having an electric tumble dr ##ier .

reference_raw: One of the orang-utans peels it while the couple talks about the benefits of having an electric tumble dryer.

reference_spacy_tokens: One of the orang - utans peels it while the couple talks about the benefits of having an electric tumble dryer .


fn_spacy_tokens_for_baseline: Some consist of a simple bowl with a lip , over which the water trickles , while others come in sections of varying lengths and shapes which can be joined together to form complex arrangements .

source_bert_toks: some consist of a simple bowl with a lip , over which the water trickle ##s , while others come in sections of varying lengths and shapes which can be joined together to form complex arrangements .

reference_raw: Some consist of a simple bowl with a lip, over which water flows, while others come in sections of different lengths and shapes that can be combined to form complex arrangements.

reference_spacy_tokens: Some consist of a simple bowl with a lip , over which water flows , while others come in sections of different lengths and shapes that can be combined to form complex arrangements .


fn_spacy_tokens_for_baseline: On the fourth day he received a long chatty letter from Eleanor .

source_bert_toks: on the fourth day he received a long chat ##ty letter from eleanor .

reference_raw: On the fourth day, he received a long letter from Eleanor.

reference_spacy_tokens: On the fourth day , he received a long letter from Eleanor .


fn_spacy_tokens_for_baseline: The only traces of passengers and crew were hundreds of pairs of shoes , eerily littering the cabins , passage ways and decks ; the treated leather was all that had withstood the salt water .

source_bert_toks: the only traces of passengers and crew were hundreds of pairs of shoes , ee ##rily litter ##ing the cabins , passage ways and decks ; the treated leather was all that had with ##sto ##od the salt water .

reference_raw: The only traces of passengers and crew were hundreds of pairs of boots, eerily covering the cabins, passageways, and decks; the treated skin was all that resisted salt water.

reference_spacy_tokens: The only traces of passengers and crew were hundreds of pairs of boots , eerily covering the cabins , passageways , and decks ; the treated skin was all that resisted salt water .


fn_spacy_tokens_for_baseline: On his head he wore a white nightcap . '

source_bert_toks: on his head he wore a white night ##cap . '

reference_raw: He wore a white bedcap on his head.

reference_spacy_tokens: He wore a white bedcap on his head .


fn_spacy_tokens_for_baseline: Some groups may have a particular fascination with plagues and poisons .

source_bert_toks: some groups may have a particular fascination with plague ##s and poison ##s .

reference_raw: Some groups may be particularly fascinated by diseases and poisons.

reference_spacy_tokens: Some groups may be particularly fascinated by diseases and poisons .


fn_spacy_tokens_for_baseline: ' But you knew how I felt about him , ' pouted Anne .

source_bert_toks: ' but you knew how i felt about him , ' po ##uted anne .

reference_raw: 'But you know what I think of him,' said Anne.

reference_spacy_tokens: ' But you know what I think of him , ' said Anne .


fn_spacy_tokens_for_baseline: Browsing is a real pleasure in Macau 's main streets and byways , where shops aimed at the tourist market are interspersed with the more workaday ironmongers , herbalists , and noodle stalls .

source_bert_toks: brows ##ing is a real pleasure in macau ' s main streets and by ##ways , where shops aimed at the tourist market are interspersed with the more work ##aday iron ##mon ##gers , herbal ##ists , and no ##odle stalls .

reference_raw: Browsing is a real pleasure in the main streets and byways of Macao, where shops targeted at the tourist market are intertwined with more day-to-day ironmongers, herbalists, and noodle stalls.

reference_spacy_tokens: Browsing is a real pleasure in the main streets and byways of Macao , where shops targeted at the tourist market are intertwined with more day - to - day ironmongers , herbalists , and noodle stalls .


fn_spacy_tokens_for_baseline: Stones too large to pass through the Amplatz sheath were fragmented by intracorporeal electrohydraulic , or ultrasound lithotripsy and removed piecemeal .

source_bert_toks: stones too large to pass through the amp ##lat ##z sheath were fragmented by intra ##corp ##ore ##al electro ##hy ##dra ##uli ##c , or ultrasound lit ##hot ##rip ##sy and removed piece ##me ##al .

reference_raw: The stones too large to pass through the amplatz sheath were shattered by intracorporeal electrohydraulic or ultrasound lithotripsy and removed piecemeal.

reference_spacy_tokens: The stones too large to pass through the amplatz sheath were shattered by intracorporeal electrohydraulic or ultrasound lithotripsy and removed piecemeal .


fn_spacy_tokens_for_baseline: Establishments are no longer called " Royal , " Queen Elizabeth has vanished from the coinage , and the Union Jack has been replaced by the flag of China and the new Hong Kong flag with its bauhinia flower .

source_bert_toks: establishments are no longer called " royal , " queen elizabeth has vanished from the coinage , and the union jack has been replaced by the flag of china and the new hong kong flag with its ba ##uh ##inia flower .

reference_raw: The place is no longer called "Royal," Queen Elizabeth disappeared from the coinage, and Union Jack was replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower.

reference_spacy_tokens: The place is no longer called " Royal , " Queen Elizabeth disappeared from the coinage , and Union Jack was replaced by a Chinese flag and a new Hong Kong flag with a bauhinian flower .


fn_spacy_tokens_for_baseline: In silence the two craft coasted alongside each other ; they were very close .

source_bert_toks: in silence the two craft coast ##ed alongside each other ; they were very close .

reference_raw: The two ships shored together in silence; they were very close.

reference_spacy_tokens: The two ships shored together in silence ; they were very close .


fn_spacy_tokens_for_baseline: Henry stared , dimly remembering babyhood , sitting on his gran 's lap while a stubby girl with ginger plaits rushed off to the lavatory in the middle of postman 's Knock .

source_bert_toks: henry stared , dimly remembering baby ##hood , sitting on his gran ' s lap while a stu ##bby girl with ginger pl ##ai ##ts rushed off to the lava ##tory in the middle of post ##man ' s knock .

reference_raw: Henry stared, vaguely remembering childhood, as he sat on his grandmother's lap while a stumpy girl with ginger plaits rushed into the bathroom in the middle of Postman's Knock.

reference_spacy_tokens: Henry stared , vaguely remembering childhood , as he sat on his grandmother 's lap while a stumpy girl with ginger plaits rushed into the bathroom in the middle of Postman 's Knock .


fn_spacy_tokens_for_baseline: House of Fraser shares were highly sensitive to any rumours of a bid , and we waited with caution and anxiety for the green light from the ministry .

source_bert_toks: house of fraser shares were highly sensitive to any rumours of a bid , and we waited with caution and anxiety for the green light from the ministry .

reference_raw: The Fraser stock house was very sensitive to any rumor of an offer, and we waited carefully and anxiously for the Ministry's green glow.

reference_spacy_tokens: The Fraser stock house was very sensitive to any rumor of an offer , and we waited carefully and anxiously for the Ministry 's green glow .


fn_spacy_tokens_for_baseline: Two of the interior walls were painted canvas , and the others only more substantial so they could support the catwalks necessary for the fight .

source_bert_toks: two of the interior walls were painted canvas , and the others only more substantial so they could support the cat ##walk ##s necessary for the fight .

reference_raw: Two of the inner walls were painted with canvas, and the others were only more substantial to support the walkways needed to fight.

reference_spacy_tokens: Two of the inner walls were painted with canvas , and the others were only more substantial to support the walkways needed to fight .


fn_spacy_tokens_for_baseline: When Alix arrived home in Wandsworth , she found Brian and Sam sitting comfortably in front of the television on the ancient sofa with their socked and shoeless feet up watching a Len Deighton movie .

source_bert_toks: when ali ##x arrived home in wand ##sworth , she found brian and sam sitting comfortably in front of the television on the ancient sofa with their sock ##ed and shoe ##less feet up watching a len dei ##ghton movie .

reference_raw: When Alix got home to Wandsworth, she found Brian and Sam sitting comfortably in front of the TV on the old couch with their sockless feet up and watching a Len Deighton movie.

reference_spacy_tokens: When Alix got home to Wandsworth , she found Brian and Sam sitting comfortably in front of the TV on the old couch with their sockless feet up and watching a Len Deighton movie .


fn_spacy_tokens_for_baseline: A particularly big tremor on 1 September 1880 damaged an important lighthouse on the Java coast , and was perceptible as far away as northern Australia .

source_bert_toks: a particularly big tremor on 1 september 1880 damaged an important lighthouse on the java coast , and was per ##ce ##pt ##ible as far away as northern australia .

reference_raw: A particularly large tremor on 1 September 1880 damaged a major beacon on the coast of Java and was perceptible as far as northern Australia.

reference_spacy_tokens: A particularly large tremor on 1 September 1880 damaged a major beacon on the coast of Java and was perceptible as far as northern Australia .


fn_spacy_tokens_for_baseline: ' And so you came to live here after you were widowed ? '

source_bert_toks: ' and so you came to live here after you were widowed ? '

reference_raw: "So you've come to live here after you've been divorced?"

reference_spacy_tokens: " So you 've come to live here after you 've been divorced ? "


fn_spacy_tokens_for_baseline: Decades of educational research tell us unequivocally that even smaller classes have zero effect on the academic performance of the pupils -- though they may sometimes be desirable for other reasons .

source_bert_toks: decades of educational research tell us une ##qui ##vo ##cal ##ly that even smaller classes have zero effect on the academic performance of the pupils - - though they may sometimes be desirable for other reasons .

reference_raw: Decades of educational research clearly show that even smaller classes have no impact on the academic performance of pupils-though they may sometimes be desirable for other purposes.

reference_spacy_tokens: Decades of educational research clearly show that even smaller classes have no impact on the academic performance of pupils - though they may sometimes be desirable for other purposes .


fn_spacy_tokens_for_baseline: He started up in alarm , staring dazedly , and then , realising his lapse , paled with mortification .

source_bert_toks: he started up in alarm , staring dazed ##ly , and then , realising his laps ##e , pale ##d with mort ##ification .

reference_raw: He got to his feet in alarm, stared dazedly, then realized that he had lapsed, paled with disgust.

reference_spacy_tokens: He got to his feet in alarm , stared dazedly , then realized that he had lapsed , paled with disgust .


fn_spacy_tokens_for_baseline: Wingti also promised to provide compensation for those killed and , on Sept. 20 , it was reported that the abducted man had been returned to Honiara .

source_bert_toks: wing ##ti also promised to provide compensation for those killed and , on sept . 20 , it was reported that the abducted man had been returned to hon ##ia ##ra .

reference_raw: Wingti also promised to pay compensation for those who were killed, and on September 20 it was reported that the kidnapped man had been returned to Honiara.

reference_spacy_tokens: Wingti also promised to pay compensation for those who were killed , and on September 20 it was reported that the kidnapped man had been returned to Honiara .


fn_spacy_tokens_for_baseline: A key uncertainty is how ongoing military modernization efforts will ultimately reshape China 's strategic nuclear capabilities , but U.S. deployments of missile defenses are likely to be a key variable .

source_bert_toks: a key uncertainty is how ongoing military modernization efforts will ultimately res ##ha ##pe china ' s strategic nuclear capabilities , but u . s . deployment ##s of missile defenses are likely to be a key variable .

reference_raw: The main uncertainty is how the ongoing military modernisation efforts will eventually transform China's strategic nuclear capabilities, but the US deployment of missile defense is likely to be a key variable.

reference_spacy_tokens: The main uncertainty is how the ongoing military modernisation efforts will eventually transform China 's strategic nuclear capabilities , but the US deployment of missile defense is likely to be a key variable .


fn_spacy_tokens_for_baseline: In this way , they impose costs on miscreants and alter the incentives to break down Chinese Walls and engage in insider dealing .

source_bert_toks: in this way , they impose costs on mis ##cre ##ants and alter the incentives to break down chinese walls and engage in insider dealing .

reference_raw: In this way, they impose costs on the perpetrators and change incentives to break down Chinese walls and engage in insider dealing.

reference_spacy_tokens: In this way , they impose costs on the perpetrators and change incentives to break down Chinese walls and engage in insider dealing .


fn_spacy_tokens_for_baseline: On his fifth birthday , he climbed a tall tree until he reached twig level , where he sat contentedly as the wind rocked him to and fro .

source_bert_toks: on his fifth birthday , he climbed a tall tree until he reached t ##wig level , where he sat content ##edly as the wind rocked him to and fr ##o .

reference_raw: On his fifth birthday he climbed a tall tree until he reached the branch level, where he sat contentedly as the wind shook him back and forth.

reference_spacy_tokens: On his fifth birthday he climbed a tall tree until he reached the branch level , where he sat contentedly as the wind shook him back and forth .


fn_spacy_tokens_for_baseline: Most of these great lords are downright infatuated with Italy .

source_bert_toks: most of these great lords are down ##right in ##fat ##uated with italy .

reference_raw: Most of these great lords fall in love with Italy.

reference_spacy_tokens: Most of these great lords fall in love with Italy .


fn_spacy_tokens_for_baseline: He also gave an assurance that he was abandoning plans to alter the Constitution so that the executive would be prime ministerial rather than presidential .

source_bert_toks: he also gave an assurance that he was abandoning plans to alter the constitution so that the executive would be prime ministerial rather than presidential .

reference_raw: He also assured himself that he was relinquishing his plans to change the Constitution to make the executive prime minister rather than president.

reference_spacy_tokens: He also assured himself that he was relinquishing his plans to change the Constitution to make the executive prime minister rather than president .


fn_spacy_tokens_for_baseline: In a between - species cross , in which there is even greater dissimilarity between the antigens , one would expect the rejection to be even more axiomatic , but the immunological evidence is difficult to interpret .

source_bert_toks: in a between - species cross , in which there is even greater di ##ssi ##mi ##lar ##ity between the antigen ##s , one would expect the rejection to be even more ax ##iom ##atic , but the im ##mun ##ological evidence is difficult to interpret .

reference_raw: In a cross between species, where the difference between antigens is even greater, one would expect the refusal to be more axiomatic, but immunological evidence is difficult to interpret.

reference_spacy_tokens: In a cross between species , where the difference between antigens is even greater , one would expect the refusal to be more axiomatic , but immunological evidence is difficult to interpret .


fn_spacy_tokens_for_baseline: I was petrified of having the same thing as my mother did .

source_bert_toks: i was pet ##rified of having the same thing as my mother did .

reference_raw: I was fossilized that I had what my mother had.

reference_spacy_tokens: I was fossilized that I had what my mother had .


fn_spacy_tokens_for_baseline: Morton drifted into the grand salon , which was teeming with people .

source_bert_toks: morton drifted into the grand salon , which was tee ##ming with people .

reference_raw: Morton floated into a large saloon full of people.

reference_spacy_tokens: Morton floated into a large saloon full of people .


fn_spacy_tokens_for_baseline: Then she thought about Piers , seeing his nudity as he stepped into the bath with astounding clarity .

source_bert_toks: then she thought about piers , seeing his nu ##dity as he stepped into the bath with as ##tou ##nding clarity .

reference_raw: Then she thought of Piers, and saw his nakedness as he entered the bath with surprising clarity.

reference_spacy_tokens: Then she thought of Piers , and saw his nakedness as he entered the bath with surprising clarity .


fn_spacy_tokens_for_baseline: Her eyebrows had been plucked in the manner of the thirties , thin arches high above the natural line of the brow .

source_bert_toks: her eyebrows had been plucked in the manner of the thirties , thin arches high above the natural line of the brow .

reference_raw: Her eyebrows were pulled up in the manner of her mid-thirties, thin arches high above the natural line of her forehead.

reference_spacy_tokens: Her eyebrows were pulled up in the manner of her mid - thirties , thin arches high above the natural line of her forehead .


fn_spacy_tokens_for_baseline: One firefighter is being treated for bite injuries to his face that he received while attempting to rescue a dog .

source_bert_toks: one fire ##fighter is being treated for bite injuries to his face that he received while attempting to rescue a dog .

reference_raw: One fireman is being treated for bite wounds to the face he received when he tried to save the dog.

reference_spacy_tokens: One fireman is being treated for bite wounds to the face he received when he tried to save the dog .


fn_spacy_tokens_for_baseline: The announcement of the pull - out from the ERM was made by Mr Lamont by a drain in the Treasury forecourt .

source_bert_toks: the announcement of the pull - out from the er ##m was made by mr lam ##ont by a drain in the treasury fore ##court .

reference_raw: The announcement of the withdrawal from the ERM was made by Mr Lamont through a drain at the Treasury Court.

reference_spacy_tokens: The announcement of the withdrawal from the ERM was made by Mr Lamont through a drain at the Treasury Court .


fn_spacy_tokens_for_baseline: However strict the instructions about attending to the stimuli , subjects in the control condition might fail to do so .

source_bert_toks: however strict the instructions about attending to the stimuli , subjects in the control condition might fail to do so .

reference_raw: However strict the instructions for handling the stimuli may be, subjects in a control state may not do so.

reference_spacy_tokens: However strict the instructions for handling the stimuli may be , subjects in a control state may not do so .


fn_spacy_tokens_for_baseline: ' We make a simple flat triangular truss of iron , like a railway station roof , and we glaze it direct .

source_bert_toks: ' we make a simple flat triangular truss of iron , like a railway station roof , and we g ##laze it direct .

reference_raw: We make a simple, flat, triangular truss of iron, like the roof of a railway station, and we glare it directly.

reference_spacy_tokens: We make a simple , flat , triangular truss of iron , like the roof of a railway station , and we glare it directly .


fn_spacy_tokens_for_baseline: Add 50 g of stoned black olives , a medium sliced tomato , scalded in water to remove its skin and de - seeded , and a glass of dry white wine .

source_bert_toks: add 50 ##g of stone ##d black olive ##s , a medium sliced tomato , sc ##ald ##ed in water to remove its skin and de - seeded , and a glass of dry white wine .

reference_raw: Add 50 g of stoned black olives, a medium sliced tomato, scaled with water to remove the skin and de-seed, and a glass of dry white wine.

reference_spacy_tokens: Add 50 g of stoned black olives , a medium sliced tomato , scaled with water to remove the skin and de - seed , and a glass of dry white wine .


fn_spacy_tokens_for_baseline: Peter , a senior defensive tackle , was noted during the season not so much for his play but for his 1993 conviction of third - degree sexual assault for groping a woman at a Lincoln bar .

source_bert_toks: peter , a senior defensive tackle , was noted during the season not so much for his play but for his 1993 conviction of third - degree sexual assault for gr ##oping a woman at a lincoln bar .

reference_raw: Peter, a senior defender, had been noted during the season, not so much for his game, but for his 1993 conviction of a third-degree sex attack for groping a woman in a Lincoln bar.

reference_spacy_tokens: Peter , a senior defender , had been noted during the season , not so much for his game , but for his 1993 conviction of a third - degree sex attack for groping a woman in a Lincoln bar .


fn_spacy_tokens_for_baseline: Q : Is n't this change a sign that you 're getting desperate , that Microsoft is losing interest , that you 're about to fold , that the end is nigh , strange and dreadful diseases are about to ravage the population , the stock market is going to tank , Linda Tripp will get her own TV talk show , and so on ?

source_bert_toks: q : isn ' t this change a sign that you ' re getting desperate , that microsoft is losing interest , that you ' re about to fold , that the end is ni ##gh , strange and dreadful diseases are about to ra ##va ##ge the population , the stock market is going to tank , linda trip ##p will get her own tv talk show , and so on ?

reference_raw: Q: Isn't that change a sign that you're getting desperate, that Microsoft is losing interest, that you're going to fall apart, that it's going to end at night, that strange and terrible diseases are going to ravage the population, that the stock market is going to tank, that Linda Tripp is going to get her own TV talk show, and so on?

reference_spacy_tokens: Q : Is n't that change a sign that you 're getting desperate , that Microsoft is losing interest , that you 're going to fall apart , that it 's going to end at night , that strange and terrible diseases are going to ravage the population , that the stock market is going to tank , that Linda Tripp is going to get her own TV talk show , and so on ?


fn_spacy_tokens_for_baseline: Inspector Baynes 's small eyes twinkled with pleasure .

source_bert_toks: inspector bay ##nes ' s small eyes twinkle ##d with pleasure .

reference_raw: Inspector Baynes's small eyes twinkled with joy.

reference_spacy_tokens: Inspector Baynes 's small eyes twinkled with joy .


fn_spacy_tokens_for_baseline: In English it means zeal , its aim -- the destruction of Israel .

source_bert_toks: in english it means ze ##al , its aim - - the destruction of israel .

reference_raw: In English, it is zeal, its purpose - the destruction of Israel.

reference_spacy_tokens: In English , it is zeal , its purpose - the destruction of Israel .


fn_spacy_tokens_for_baseline: He saw that an area 25 feet to 30 feet long and 10 feet to 15 feet broad had subsided to a depth of 2 feet and that the hole was full of water .

source_bert_toks: he saw that an area 25 feet to 30 feet long and 10 feet to 15 feet broad had subsided to a depth of 2 feet and that the hole was full of water .

reference_raw: He saw that the area between twenty-five and thirty feet long and ten to fifteen feet wide was two feet deep, and that the hole was filled with water.

reference_spacy_tokens: He saw that the area between twenty - five and thirty feet long and ten to fifteen feet wide was two feet deep , and that the hole was filled with water .


fn_spacy_tokens_for_baseline: Surrounded by statues , carvings , and incense burners , here the faithful make their devotions and check their fortunes , and traditional funerary displays give a cheerful send - off to the recently departed .

source_bert_toks: surrounded by statues , carvings , and incense burn ##ers , here the faithful make their devotion ##s and check their fortunes , and traditional fun ##era ##ry displays give a cheerful send - off to the recently departed .

reference_raw: Surrounded by statues, carvings, and incense burners, the faithful here make their dedication and check their wealth, and traditional funeral displays give a happy message to the recently departed.

reference_spacy_tokens: Surrounded by statues , carvings , and incense burners , the faithful here make their dedication and check their wealth , and traditional funeral displays give a happy message to the recently departed .


fn_spacy_tokens_for_baseline: On 11 January 2007 , China successfully carried out a test of a direct ascent anti - satellite ( ASAT ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the Earth 's surface .

source_bert_toks: on 11 january 2007 , china successfully carried out a test of a direct ascent anti - satellite ( asa ##t ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the earth ' s surface .

reference_raw: On November 11, 2007, China successfully tested a direct-accession anti-sat (ASAT) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth.

reference_spacy_tokens: On November 11 , 2007 , China successfully tested a direct - accession anti - sat ( ASAT ) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth .


fn_spacy_tokens_for_baseline: We are in the middle of this inquiry , so it is far too early for anyone to make predictions about the outcome , ' he said .

source_bert_toks: we are in the middle of this inquiry , so it is far too early for anyone to make predictions about the outcome , ' he said .

reference_raw: We're in the middle of this investigation, so it's too soon for anyone to predict the outcome," he said.

reference_spacy_tokens: We 're in the middle of this investigation , so it 's too soon for anyone to predict the outcome , " he said .


fn_spacy_tokens_for_baseline: Since many doctors refuse to perform the procedure , families take their daughters to midwives or so - called surgical barbers who use anything from dull , dirty razor blades to knives , and often work without anesthetic .

source_bert_toks: since many doctors refuse to perform the procedure , families take their daughters to mid ##wives or so - called surgical barber ##s who use anything from dull , dirty razor blades to knives , and often work without an ##est ##hetic .

reference_raw: Since many doctors refuse to perform this procedure, families take their daughters to midwives or so-called surgical barbers who use anything from blunt, dirty razor blades to knives, and often work without anesthetics.

reference_spacy_tokens: Since many doctors refuse to perform this procedure , families take their daughters to midwives or so - called surgical barbers who use anything from blunt , dirty razor blades to knives , and often work without anesthetics .


fn_spacy_tokens_for_baseline: Return to the saucepan and heat very slowly , stirring constantly until the mixture becomes thick ; too much heat too soon will curdle it .

source_bert_toks: return to the sauce ##pan and heat very slowly , stirring constantly until the mixture becomes thick ; too much heat too soon will cu ##rd ##le it .

reference_raw: Return to the saucepan and heat very slowly, stirring steadily until the mixture thickens; too much heat will be curled too soon.

reference_spacy_tokens: Return to the saucepan and heat very slowly , stirring steadily until the mixture thickens ; too much heat will be curled too soon .


fn_spacy_tokens_for_baseline: Probably nothing a quick tweak on the truss rod and bridge adjusters would n't sort out , but seeing as that would have involved taking the neck off , I did n't pursue it .

source_bert_toks: probably nothing a quick t ##we ##ak on the truss rod and bridge adjust ##ers wouldn ' t sort out , but seeing as that would have involved taking the neck off , i didn ' t pursue it .

reference_raw: Probably nothing a quick twist on a truss pole and a bridge adapter wouldn't work out, but since it would involve taking off my neck, I didn't pursue it.

reference_spacy_tokens: Probably nothing a quick twist on a truss pole and a bridge adapter would n't work out , but since it would involve taking off my neck , I did n't pursue it .


fn_spacy_tokens_for_baseline: The mayor 's mystification was understandable .

source_bert_toks: the mayor ' s my ##sti ##fication was understand ##able .

reference_raw: The mayor's mystery was understandable.

reference_spacy_tokens: The mayor 's mystery was understandable .


fn_spacy_tokens_for_baseline: But as the reader enters the second and main section , ' The Church ' , the style changes completely and the book becomes the record of a soul 's colloquy with God .

source_bert_toks: but as the reader enters the second and main section , ' the church ' , the style changes completely and the book becomes the record of a soul ' s col ##lo ##qu ##y with god .

reference_raw: But as the reader enters the second and main section of "The Church", the style changes completely, and the book becomes a record of a soul-to-god meeting.

reference_spacy_tokens: But as the reader enters the second and main section of " The Church " , the style changes completely , and the book becomes a record of a soul - to - god meeting .


fn_spacy_tokens_for_baseline: As there is no concrete mechanism for verifying government reports or allegations from exile groups , many of the allegations regarding the Iranian BW program remain unsubstantiated .

source_bert_toks: as there is no concrete mechanism for verify ##ing government reports or allegations from exile groups , many of the allegations regarding the iranian b ##w program remain un ##su ##bs ##tan ##tia ##ted .

reference_raw: In the absence of a specific system to verify government reports or allegations from exile groups, many allegations concerning the Iranian BW programme remain unfounded.

reference_spacy_tokens: In the absence of a specific system to verify government reports or allegations from exile groups , many allegations concerning the Iranian BW programme remain unfounded .


fn_spacy_tokens_for_baseline: ' Yeah ! ' yelps Paul , furiously .

source_bert_toks: ' yeah ! ' ye ##lp ##s paul , furiously .

reference_raw: 'Yes!' Paul barks furiously.

reference_spacy_tokens: ' Yes ! ' Paul barks furiously .


fn_spacy_tokens_for_baseline: and trucking industry when they pulled the plugs away from from that a lot of the safety that used to be in force disappeared the independent truckers will run on thin tires and

source_bert_toks: and truck ##ing industry when they pulled the plug ##s away from from that a lot of the safety that used to be in force disappeared the independent truck ##ers will run on thin tires and

reference_raw: and the truck industry, when they pull the plugs out of it, a lot of the security that was in place is gone, the independent truckers run on thin tires,

reference_spacy_tokens: and the truck industry , when they pull the plugs out of it , a lot of the security that was in place is gone , the independent truckers run on thin tires ,


fn_spacy_tokens_for_baseline: You were here yesterday ? ' said Fieldfare , mildly affronted by this discovery .

source_bert_toks: you were here yesterday ? ' said field ##fare , mildly af ##front ##ed by this discovery .

reference_raw: Were you here last night?" asked Fieldfare, mildly offended by the discovery.

reference_spacy_tokens: Were you here last night ? " asked Fieldfare , mildly offended by the discovery .


fn_spacy_tokens_for_baseline: Each legislator , after all , is only one out of 535 when it comes to national policy making .

source_bert_toks: each legislator , after all , is only one out of 53 ##5 when it comes to national policy making .

reference_raw: In the case of national policy-making, each legislator is only one in 535.

reference_spacy_tokens: In the case of national policy - making , each legislator is only one in 535 .


fn_spacy_tokens_for_baseline: On the title - page of Williams Pantycelyn 's elegy to Davies , the poet notes that he died 13 January 1770 , ' in the fifty - third year of his age ' .

source_bert_toks: on the title - page of williams pan ##ty ##cel ##yn ' s el ##eg ##y to davies , the poet notes that he died 13 january 1770 , ' in the fifty - third year of his age ' .

reference_raw: On the title page of Williams Pantycelyn's elegance to Davies, the poet notes that he died on January 13, 1770, in his fifty-third year of age.

reference_spacy_tokens: On the title page of Williams Pantycelyn 's elegance to Davies , the poet notes that he died on January 13 , 1770 , in his fifty - third year of age .


fn_spacy_tokens_for_baseline: The five of us stared at the ungracious guest and , for the first time that evening , I wondered what could possibly be coming next .

source_bert_toks: the five of us stared at the un ##gra ##cious guest and , for the first time that evening , i wondered what could possibly be coming next .

reference_raw: The five of us stared at the ungrateful guest, and for the first time that night I wondered what might happen next.

reference_spacy_tokens: The five of us stared at the ungrateful guest , and for the first time that night I wondered what might happen next .


fn_spacy_tokens_for_baseline: Ecstatic , the boy tried on one mask after another , roaring like a lion or mewing like a cat .

source_bert_toks: ec ##static , the boy tried on one mask after another , roaring like a lion or me ##wing like a cat .

reference_raw: Ecstasy, the boy tried to put on one mask at a time, roaring like a lion or a mow like a cat.

reference_spacy_tokens: Ecstasy , the boy tried to put on one mask at a time , roaring like a lion or a mow like a cat .


fn_spacy_tokens_for_baseline: A totem pole marks the site where Captain Vancouver met with members of the Squamish tribe .

source_bert_toks: a to ##tem pole marks the site where captain vancouver met with members of the sq ##ua ##mis ##h tribe .

reference_raw: The totem pole marks the place where Captain Vancouver met the members of the Squamish tribe.

reference_spacy_tokens: The totem pole marks the place where Captain Vancouver met the members of the Squamish tribe .


fn_spacy_tokens_for_baseline: Ed_Henry : Reed refused to back down demanding the Republican led intelligence committee finish a long awaited report on whether the Bush administration twisted intelligence .

source_bert_toks: ed _ henry : reed refused to back down demanding the republican led intelligence committee finish a long awaited report on whether the bush administration twisted intelligence .

reference_raw: Ed_Henry: Reed refused to back down and demand that the Republican-led intelligence committee complete a long-awaited report about whether the Bush administration distorted intelligence.

reference_spacy_tokens: Ed_Henry : Reed refused to back down and demand that the Republican - led intelligence committee complete a long - awaited report about whether the Bush administration distorted intelligence .


fn_spacy_tokens_for_baseline: Believed to actually be A-24A 42 - 60817 , ( N9142H ) the old Douglas was trucked in from Seattle to Long Beach for some much - needed mechanical work .

source_bert_toks: believed to actually be a - 24 ##a 42 - 60 ##8 ##17 , ( n ##9 ##14 ##2 ##h ) the old douglas was truck ##ed in from seattle to long beach for some much - needed mechanical work .

reference_raw: It was believed that the old Douglas was, in fact, A-24A 42-60817 (N9142H), driven from Seattle to Long Beach for some very needed mechanical work.

reference_spacy_tokens: It was believed that the old Douglas was , in fact , A-24A 42 - 60817 ( N9142H ) , driven from Seattle to Long Beach for some very needed mechanical work .


fn_spacy_tokens_for_baseline: Malcolm Marshall was named as Hampshire 's vice - captain yesterday as their season got underway with a friendly against Holland .

source_bert_toks: malcolm marshall was named as hampshire ' s vice - captain yesterday as their season got underway with a friendly against holland .

reference_raw: Malcolm Marshall's name was Hampshire's Vice-Captain yesterday, when the season began with a friend of Holland's.

reference_spacy_tokens: Malcolm Marshall 's name was Hampshire 's Vice - Captain yesterday , when the season began with a friend of Holland 's .


fn_spacy_tokens_for_baseline: It pierced the wizard 's forehead and penetrated to his brain as he stood cursing ; death took him unawares as it did Goliath , and his lifeless body fell backwards on to the sand .

source_bert_toks: it pierced the wizard ' s forehead and penetrated to his brain as he stood cursing ; death took him unaware ##s as it did go ##lia ##th , and his lifeless body fell backwards on to the sand .

reference_raw: It pierced the wizard's forehead and penetrated into his brain as he stood cursing; death took him unconscious, like Goliath, and his dead body fell back to the sand.

reference_spacy_tokens: It pierced the wizard 's forehead and penetrated into his brain as he stood cursing ; death took him unconscious , like Goliath , and his dead body fell back to the sand .


fn_spacy_tokens_for_baseline: While some of the men held the weight of the body in place , others bound the forelegs , and the hind legs , together with rope .

source_bert_toks: while some of the men held the weight of the body in place , others bound the fore ##leg ##s , and the hind legs , together with rope .

reference_raw: While some men held the weight in place, others tied the forelegs and hind legs together with rope.

reference_spacy_tokens: While some men held the weight in place , others tied the forelegs and hind legs together with rope .


fn_spacy_tokens_for_baseline: Ward and Kassebaum studied the Californian State Penitentiary at Alderson and Giallombardo the Federal Penitentiary , and later three state institutions for delinquent girls ( Giallombardo , 1966 , 1974 ) .

source_bert_toks: ward and ka ##sse ##baum studied the california ##n state penitentiary at al ##ders ##on and gia ##llo ##mba ##rdo the federal penitentiary , and later three state institutions for del ##in ##quent girls ( gia ##llo ##mba ##rdo , 1966 , 1974 ) .

reference_raw: Ward and Kassebaum studied California State Prison in Alderson and Giallombardo, Federal Prison, and later three state institutions for delinquent girls (Giallombardo, 1966, 1974).

reference_spacy_tokens: Ward and Kassebaum studied California State Prison in Alderson and Giallombardo , Federal Prison , and later three state institutions for delinquent girls ( Giallombardo , 1966 , 1974 ) .


fn_spacy_tokens_for_baseline: Packer and Sheehy were both taxiing around Sydney airport in their respective corporate jets on Tuesday when they accidentally collided .

source_bert_toks: pack ##er and she ##eh ##y were both taxi ##ing around sydney airport in their respective corporate jets on tuesday when they accidentally collided .

reference_raw: Packer and Sheehy were both cabbing around Sydney Airport on Tuesdays in their respective corporate jets when they accidentally collided.

reference_spacy_tokens: Packer and Sheehy were both cabbing around Sydney Airport on Tuesdays in their respective corporate jets when they accidentally collided .


fn_spacy_tokens_for_baseline: Kahane said she sorted through more than 1,000 costumes , including a pair of pantyhose from the mid-19th century .

source_bert_toks: ka ##hane said she sorted through more than 1 , 000 costumes , including a pair of pan ##ty ##hos ##e from the mid - 19th century .

reference_raw: Kahane said she sorted out over a thousand costumes, including a mid-19th-century pair of pants.

reference_spacy_tokens: Kahane said she sorted out over a thousand costumes , including a mid-19th - century pair of pants .


fn_spacy_tokens_for_baseline: Earlier this year , some 70 U.S. congressmen sent a letter to U. S. President Bill Clinton , calling for an end to the humanitarian crisis in Iraq by having the sanctions lifted .

source_bert_toks: earlier this year , some 70 u . s . congress ##men sent a letter to u . s . president bill clinton , calling for an end to the humanitarian crisis in iraq by having the sanctions lifted .

reference_raw: Early this year, about 70 U.S. Congressmen sent a letter to US President Bill Clinton calling for the end of the humanitarian crisis in Iraq by lifting sanctions.

reference_spacy_tokens: Early this year , about 70 U.S. Congressmen sent a letter to US President Bill Clinton calling for the end of the humanitarian crisis in Iraq by lifting sanctions .


fn_spacy_tokens_for_baseline: Shrub roses were trussed to let people pass ; signs erected to divert visitors from the non - scenic compost heap .

source_bert_toks: shrub roses were truss ##ed to let people pass ; signs erected to divert visitors from the non - scenic com ##post heap .

reference_raw: The shrub roses were trusted to allow people to pass; the signs were erected to divert visitors from a non-scenic pile of compost.

reference_spacy_tokens: The shrub roses were trusted to allow people to pass ; the signs were erected to divert visitors from a non - scenic pile of compost .


fn_spacy_tokens_for_baseline: They can also very often rank sentences in order of normality .

source_bert_toks: they can also very often rank sentences in order of normal ##ity .

reference_raw: They can also very often order sentences in order of normality.

reference_spacy_tokens: They can also very often order sentences in order of normality .


fn_spacy_tokens_for_baseline: Into a steady rain from the northwest we drove , following the faint yellow glow of our headlights .

source_bert_toks: into a steady rain from the northwest we drove , following the faint yellow glow of our headlights .

reference_raw: We rode in the steady rain from the northwestern, following the faint yellow glow of our headlights.

reference_spacy_tokens: We rode in the steady rain from the northwestern , following the faint yellow glow of our headlights .


fn_spacy_tokens_for_baseline: The coat was capacious , a home to guns , and the boots were home to knives .

source_bert_toks: the coat was cap ##acious , a home to guns , and the boots were home to knives .

reference_raw: The coat was capable, a home for guns, and the shoes were home for knives.

reference_spacy_tokens: The coat was capable , a home for guns , and the shoes were home for knives .


fn_spacy_tokens_for_baseline: They have been melded together , giving rise to a fascinating national identity .

source_bert_toks: they have been mel ##ded together , giving rise to a fascinating national identity .

reference_raw: They were blended together, creating a fascinating national identity.

reference_spacy_tokens: They were blended together , creating a fascinating national identity .


fn_spacy_tokens_for_baseline: 1- Outside Protection : A : Barriers , walls , parking lots B : Human protection : - Patrols close to locations - Patrols distant from the location C : Animal protection : Dogs D : Electronic protection : Cameras , alarm equipment , night vision equipment ... etc

source_bert_toks: 1 - outside protection : a : barriers , walls , parking lots b : human protection : - patrols close to locations - patrols distant from the location c : animal protection : dogs d : electronic protection : cameras , alarm equipment , night vision equipment . . . etc

reference_raw: 1-External protection: A: Barriers, walls, lots B: Human protection: - Patrols close to the site C: Animal protection: Dogs D: Electronic protection: cameras, alarms, night vision equipment, etc.

reference_spacy_tokens: 1-External protection : A : Barriers , walls , lots B : Human protection : - Patrols close to the site C : Animal protection : Dogs D : Electronic protection : cameras , alarms , night vision equipment , etc .


fn_spacy_tokens_for_baseline: QN : Did the Chinese Premier say the protests should give Tokyo serious pause for thought about its bid for the UNSC ?

source_bert_toks: q ##n : did the chinese premier say the protests should give tokyo serious pause for thought about its bid for the un ##sc ?

reference_raw: QN: Did the Chinese Prime Minister say that protests should give Tokyo a serious pause to consider its offer to the United Nations Security Council?

reference_spacy_tokens: QN : Did the Chinese Prime Minister say that protests should give Tokyo a serious pause to consider its offer to the United Nations Security Council ?


fn_spacy_tokens_for_baseline: The man from Forensic arrives , his steel heel - caps pinging across the tarmac .

source_bert_toks: the man from forensic arrives , his steel heel - caps ping ##ing across the tar ##mac .

reference_raw: A man from Forensic arrives, his steel heel caps piercing the asphalt.

reference_spacy_tokens: A man from Forensic arrives , his steel heel caps piercing the asphalt .


fn_spacy_tokens_for_baseline: From inside the vast atrium you can view the whole structure as well as the mechanical workings of the building .

source_bert_toks: from inside the vast atrium you can view the whole structure as well as the mechanical workings of the building .

reference_raw: From within the vast atrium, you can see the entire structure and the mechanics of the building.

reference_spacy_tokens: From within the vast atrium , you can see the entire structure and the mechanics of the building .


fn_spacy_tokens_for_baseline: While allied airmen risk their lives in the Arabian desert , politicians in Bonn squabble over whether Germany is bound by treaty to aid Turkey , a NATO partner , should it be attacked by Iraq .

source_bert_toks: while allied airmen risk their lives in the arabian desert , politicians in bonn sq ##ua ##bble over whether germany is bound by treaty to aid turkey , a nato partner , should it be attacked by iraq .

reference_raw: While allied airmen risk their lives in the Arabian Desert, politicians in Bonn argue that Germany is bound by a treaty to help Turkey, a NATO partner, if Iraq attacks it.

reference_spacy_tokens: While allied airmen risk their lives in the Arabian Desert , politicians in Bonn argue that Germany is bound by a treaty to help Turkey , a NATO partner , if Iraq attacks it .


fn_spacy_tokens_for_baseline: The whole thing created a lot of stress and tension , moving this humongous thing around the country .

source_bert_toks: the whole thing created a lot of stress and tension , moving this hum ##ong ##ous thing around the country .

reference_raw: This whole thing has created a lot of stress and tension, and it's been moving this ridiculous thing around the country.

reference_spacy_tokens: This whole thing has created a lot of stress and tension , and it 's been moving this ridiculous thing around the country .


fn_spacy_tokens_for_baseline: It was possible she had never been in a tunnel before , except perhaps in a car going quickly through some underpass .

source_bert_toks: it was possible she had never been in a tunnel before , except perhaps in a car going quickly through some under ##pass .

reference_raw: It was possible that she had never been in the tunnel before, except maybe in a car that was going through some kind of subway.

reference_spacy_tokens: It was possible that she had never been in the tunnel before , except maybe in a car that was going through some kind of subway .


fn_spacy_tokens_for_baseline: Some men insisted that it was not possible to make your first jump without voiding your bowels .

source_bert_toks: some men insisted that it was not possible to make your first jump without void ##ing your bow ##els .

reference_raw: Some men insisted you couldn't make the first jump without emptying your guts.

reference_spacy_tokens: Some men insisted you could n't make the first jump without emptying your guts .


fn_spacy_tokens_for_baseline: The following morning , French forces arrived to succour the battered British line .

source_bert_toks: the following morning , french forces arrived to su ##cco ##ur the battered british line .

reference_raw: The next morning, French troops arrived to succumb to the battered British line.

reference_spacy_tokens: The next morning , French troops arrived to succumb to the battered British line .


fn_spacy_tokens_for_baseline: Trading Standards officers say anyone using the mower risks electrocution .

source_bert_toks: trading standards officers say anyone using the mo ##wer risks electro ##cut ##ion .

reference_raw: Business Standards officers say that anyone who uses a mower risks electrocuting.

reference_spacy_tokens: Business Standards officers say that anyone who uses a mower risks electrocuting .


fn_spacy_tokens_for_baseline: By acting professionally ( dispassionate , responsible , with technical competence ) Britain can , through its army , embrace war as a means of creating an identity for itself in today 's shifty international order .

source_bert_toks: by acting professionally ( di ##sp ##ass ##ion ##ate , responsible , with technical competence ) britain can , through its army , embrace war as a means of creating an identity for itself in today ' s shift ##y international order .

reference_raw: By acting professionally (dispassionate, responsible, and technically competent), Britain can accept war through its military as a means to create an identity for itself in today's shifting international order.

reference_spacy_tokens: By acting professionally ( dispassionate , responsible , and technically competent ) , Britain can accept war through its military as a means to create an identity for itself in today 's shifting international order .


fn_spacy_tokens_for_baseline: A gorgeously dressed footman inspected her ticket , then bowed her into the hallway which was brilliant with candles and thronged with people .

source_bert_toks: a gorgeous ##ly dressed foot ##man inspected her ticket , then bowed her into the hallway which was brilliant with candles and th ##rong ##ed with people .

reference_raw: The beautifully dressed footman looked at her ticket, then bowed her into a corridor that was bright with candles and crowded with people.

reference_spacy_tokens: The beautifully dressed footman looked at her ticket , then bowed her into a corridor that was bright with candles and crowded with people .


fn_spacy_tokens_for_baseline: Aged 18 , she was given £ 50,000 from the fund to buy her famous Colherne Court flat , where she lived until her engagement to Charles .

source_bert_toks: aged 18 , she was given £5 ##0 , 000 from the fund to buy her famous col ##her ##ne court flat , where she lived until her engagement to charles .

reference_raw: When she was 18, she got £50,000 from the fund to buy her famous apartment in Colherne Court, where she lived until she was engaged to Charles.

reference_spacy_tokens: When she was 18 , she got £ 50,000 from the fund to buy her famous apartment in Colherne Court , where she lived until she was engaged to Charles .


fn_spacy_tokens_for_baseline: Profit for its commercial insurance division fell 30 % to $ 59 million , reflecting higher catastrophe losses and the price war in the property / casualty market for nearly three years .

source_bert_toks: profit for its commercial insurance division fell 30 % to $ 59 million , reflecting higher catastrophe losses and the price war in the property / casualty market for nearly three years .

reference_raw: The profits of its commercial insurance division have fallen from 30% to $59 million, reflecting higher disaster casualties and price wars on the property/loss market for almost three years.

reference_spacy_tokens: The profits of its commercial insurance division have fallen from 30 % to $ 59 million , reflecting higher disaster casualties and price wars on the property / loss market for almost three years .


fn_spacy_tokens_for_baseline: At the very beginning , it was encouraged by Israel because they thought it was a counter weight to Palestinian nationalism which is , of course , a secular movement .

source_bert_toks: at the very beginning , it was encouraged by israel because they thought it was a counter weight to palestinian nationalism which is , of course , a secular movement .

reference_raw: At first, Israel supported it, thinking that it was a counterweight to Palestinian nationalism, which is, of course, a secular movement.

reference_spacy_tokens: At first , Israel supported it , thinking that it was a counterweight to Palestinian nationalism , which is , of course , a secular movement .


fn_spacy_tokens_for_baseline: Later that night , he said , an American military helicopter landed in the streambed and evacuated Tillman 's body .

source_bert_toks: later that night , he said , an american military helicopter landed in the stream ##bed and evacuated till ##man ' s body .

reference_raw: Later that night, he said, a U.S. military helicopter arrived in the streambed and evacuated Tillman's body.

reference_spacy_tokens: Later that night , he said , a U.S. military helicopter arrived in the streambed and evacuated Tillman 's body .


fn_spacy_tokens_for_baseline: The midday sun glinted against the bronze bas - reliefs of famous battle scenes on Napoleon 's column as Chantal steered the Harley - Davidson through the place de l'Opera and turned down the busy rue de la Paix .

source_bert_toks: the midday sun glint ##ed against the bronze bas - reliefs of famous battle scenes on napoleon ' s column as chant ##al steered the harley - davidson through the place de l ' opera and turned down the busy rue de la pa ##ix .

reference_raw: The noonday sun shone on the bronze bas-reliefs of the famous battle scenes in Napoleon's column as Chantal led the Harley-Davidson through the place de l'Opera and rejected the busy rue de la Paix.

reference_spacy_tokens: The noonday sun shone on the bronze bas - reliefs of the famous battle scenes in Napoleon 's column as Chantal led the Harley - Davidson through the place de l'Opera and rejected the busy rue de la Paix .


fn_spacy_tokens_for_baseline: He wore blue leggings and his feet were pushed into soft leather buskins .

source_bert_toks: he wore blue leg ##ging ##s and his feet were pushed into soft leather bus ##kins .

reference_raw: He was wearing blue leggings, and his feet were tucked into soft leather leather.

reference_spacy_tokens: He was wearing blue leggings , and his feet were tucked into soft leather leather .


fn_spacy_tokens_for_baseline: However , these British influences have , even from the earliest days of colonial rule , always been tempered and molded to the Jamaican style .

source_bert_toks: however , these british influences have , even from the earliest days of colonial rule , always been tempered and molded to the jamaican style .

reference_raw: But these British influences, even in the early days of colonial rule, have always been tempered and shaped into Jamaican style.

reference_spacy_tokens: But these British influences , even in the early days of colonial rule , have always been tempered and shaped into Jamaican style .


fn_spacy_tokens_for_baseline: In contrast to most Alsace types , there is seldom much of a bouquet from Pinot Blanc wines .

source_bert_toks: in contrast to most alsace types , there is seldom much of a bouquet from pin ##ot blanc wines .

reference_raw: Unlike most types of Alsace, there is rarely much of a bottle of Pinot Blanc wine.

reference_spacy_tokens: Unlike most types of Alsace , there is rarely much of a bottle of Pinot Blanc wine .