fn_spacy_tokens_for_baseline: Using the SCI databases produced by the Institute for Scientific Information ( ISI ) , as well as data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia ( RICYT ) , we examined the differences in the number and proportion of scientific publications between the developed world and the developing world from 1990 until 2000 , focusing on the Americas as a case study .

source_bert_toks: using the sci databases produced by the institute for scientific information ( is ##i ) , as well as data compiled by the red ib ##ero ##americana de ind ##ica ##dor ##es de ci ##encia y te ##c ##no ##log ##ia ( ric ##yt ) , we examined the differences in the number and proportion of scientific publications between the developed world and the developing world from 1990 until 2000 , focusing on the americas as a case study .

reference_raw: Using the SCI databases produced by the Institute for Scientific Information (ISI) and the data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia (RICYT), we have examined the differences in the number and proportion of scientific publications between the advanced world and the emerging world between 1990 and 2000, focusing on the United States as a case study.

reference_spacy_tokens: Using the SCI databases produced by the Institute for Scientific Information ( ISI ) and the data compiled by the Red Iberoamericana de Indicadores de Ciencia y Tecnologia ( RICYT ) , we have examined the differences in the number and proportion of scientific publications between the advanced world and the emerging world between 1990 and 2000 , focusing on the United States as a case study .


fn_spacy_tokens_for_baseline: Once we attain the transcendental standpoint , we have ceased to carry with us the substantive concept of truth required to raise epistemological questions .

source_bert_toks: once we attain the trans ##cend ##ental stand ##point , we have ceased to carry with us the substantive concept of truth required to raise ep ##iste ##mo ##logical questions .

reference_raw: Once we've reached a transcendental point of view, we've stopped carrying with us the substantive concept of truth needed to raise epistemological questions.

reference_spacy_tokens: Once we 've reached a transcendental point of view , we 've stopped carrying with us the substantive concept of truth needed to raise epistemological questions .


fn_spacy_tokens_for_baseline: Meta - analysis of Time - series Suties of Air Pollution and Mortality : Effects of Gases and Particles and the Influence of Cause of Death , Age , and Season .

source_bert_toks: meta - analysis of time - series su ##ties of air pollution and mortality : effects of gases and particles and the influence of cause of death , age , and season .

reference_raw: Meta-analysis of time series Suties of air pollution and mortality: effects of gases and particulates and impact of causes of death, age and season.

reference_spacy_tokens: Meta - analysis of time series Suties of air pollution and mortality : effects of gases and particulates and impact of causes of death , age and season .


fn_spacy_tokens_for_baseline: No foe should ever sneak up on an exhausted Marine slumbering during prolonged combat .

source_bert_toks: no foe should ever sneak up on an exhausted marine sl ##umber ##ing during prolonged combat .

reference_raw: No enemy should ever sneak into an exhausted Marine sleep during a long battle.

reference_spacy_tokens: No enemy should ever sneak into an exhausted Marine sleep during a long battle .


fn_spacy_tokens_for_baseline: He was not to be mollified .

source_bert_toks: he was not to be mo ##lli ##fied .

reference_raw: He shouldn't have been molified.

reference_spacy_tokens: He should n't have been molified .


fn_spacy_tokens_for_baseline: He put his lips softly to her neck and mouthed the little wound .

source_bert_toks: he put his lips softly to her neck and mouthed the little wound .

reference_raw: He put his lips gently to her throat and mouthed a small wound.

reference_spacy_tokens: He put his lips gently to her throat and mouthed a small wound .


fn_spacy_tokens_for_baseline: his book , with its curious title , Investigations , seeks new questions about the universe .

source_bert_toks: his book , with its curious title , investigations , seeks new questions about the universe .

reference_raw: his book, with its strange name, Investigations, is looking for new questions about the universe.

reference_spacy_tokens: his book , with its strange name , Investigations , is looking for new questions about the universe .


fn_spacy_tokens_for_baseline: Every candidate launches his campaign with a glossy account of his upbringing and career , but McCain 's heroism in Vietnam makes his story a far easier sell than Bush 's , Gore 's , or Bradley 's .

source_bert_toks: every candidate launches his campaign with a glossy account of his upbringing and career , but mccain ' s heroism in vietnam makes his story a far easier sell than bush ' s , gore ' s , or bradley ' s .

reference_raw: Each candidate starts his campaign with a shiny account of his education and career, but McCain's heroism in Vietnam makes his story a lot easier to sell than Bush's, Gore's, or Bradley's.

reference_spacy_tokens: Each candidate starts his campaign with a shiny account of his education and career , but McCain 's heroism in Vietnam makes his story a lot easier to sell than Bush 's , Gore 's , or Bradley 's .


fn_spacy_tokens_for_baseline: There are many small engineering firms , some specialising in scientific instruments .

source_bert_toks: there are many small engineering firms , some specialising in scientific instruments .

reference_raw: There are a lot of small engineering companies, some specializing in scientific tools.

reference_spacy_tokens: There are a lot of small engineering companies , some specializing in scientific tools .


fn_spacy_tokens_for_baseline: The moon was now hidden by clouds as Ellie turned and looked back out of the window .

source_bert_toks: the moon was now hidden by clouds as ellie turned and looked back out of the window .

reference_raw: As Ellie turned and looked out the window, the moon was now cloudy.

reference_spacy_tokens: As Ellie turned and looked out the window , the moon was now cloudy .


fn_spacy_tokens_for_baseline: It is now compulsory for all firms with more than 25 employees to have a ' car journey reduction plan ' , cutting down on the use of cars to get to work .

source_bert_toks: it is now compulsory for all firms with more than 25 employees to have a ' car journey reduction plan ' , cutting down on the use of cars to get to work .

reference_raw: It is now mandatory for all companies with more than 25 employees to have a "car trip reduction plan" which reduces the use of cars to get to work.

reference_spacy_tokens: It is now mandatory for all companies with more than 25 employees to have a " car trip reduction plan " which reduces the use of cars to get to work .


fn_spacy_tokens_for_baseline: The stewardess came down the aisle , a big - breasted young woman exuding a strong odour of perspiration .

source_bert_toks: the steward ##ess came down the aisle , a big - breast ##ed young woman ex ##uding a strong o ##dou ##r of per ##sp ##ira ##tion .

reference_raw: The flight attendant came down the aisle, a large-breasted young woman emitting a strong scent of sweat.

reference_spacy_tokens: The flight attendant came down the aisle , a large - breasted young woman emitting a strong scent of sweat .


fn_spacy_tokens_for_baseline: Then , eerily , the sickening stench turns to something more tolerable , the familiar aroma of barbecuing meat .

source_bert_toks: then , ee ##rily , the sick ##ening stench turns to something more to ##ler ##able , the familiar aroma of bar ##be ##cu ##ing meat .

reference_raw: Then, eerily, the foul smell turns into something more tolerable, a familiar smell of grilled meat.

reference_spacy_tokens: Then , eerily , the foul smell turns into something more tolerable , a familiar smell of grilled meat .


fn_spacy_tokens_for_baseline: Keeping the length almost the same , he restructured the front with a textured cut for a more casual look .

source_bert_toks: keeping the length almost the same , he rest ##ructured the front with a texture ##d cut for a more casual look .

reference_raw: He maintained almost the same length and restructured the front with a textured slash for a more casual look.

reference_spacy_tokens: He maintained almost the same length and restructured the front with a textured slash for a more casual look .


fn_spacy_tokens_for_baseline: Now she fetched in the tray , and they all sat down .

source_bert_toks: now she fetch ##ed in the tray , and they all sat down .

reference_raw: She brought the tray back now, and they all sat down.

reference_spacy_tokens: She brought the tray back now , and they all sat down .


fn_spacy_tokens_for_baseline: Her long flaxen hair was coiled up in a thick plait at the top of her head .

source_bert_toks: her long fl ##ax ##en hair was coiled up in a thick pl ##ai ##t at the top of her head .

reference_raw: Her long, flaxy hair was curled up in a thick plait at the top of her head.

reference_spacy_tokens: Her long , flaxy hair was curled up in a thick plait at the top of her head .


fn_spacy_tokens_for_baseline: The main reason why channel offset caused by the San Andreas fault is clear is the extremely high rate of displacement along the fault ( 20.3 mm / year , Brown and Wallace , 1968 ) and the relatively small size of streams crossing and flowing along the fault .

source_bert_toks: the main reason why channel offset caused by the san andreas fault is clear is the extremely high rate of displacement along the fault ( 20 . 3 mm / year , brown and wallace , 1968 ) and the relatively small size of streams crossing and flowing along the fault .

reference_raw: The main reason why the channel compensation caused by the San Andreas fault is clear is the extreme rate of displacement along the fault (20.3 mm/year, Brown and Wallace, 1968) and the relatively small number of currents that cross and flow through the fault.

reference_spacy_tokens: The main reason why the channel compensation caused by the San Andreas fault is clear is the extreme rate of displacement along the fault ( 20.3 mm / year , Brown and Wallace , 1968 ) and the relatively small number of currents that cross and flow through the fault .


fn_spacy_tokens_for_baseline: The shortest route , depending on weapon design , could be to purchase or steal fissile material .

source_bert_toks: the shortest route , depending on weapon design , could be to purchase or steal fis ##sil ##e material .

reference_raw: Depending on the design of the weapon, the shortest way could be to buy or steal fissile material.

reference_spacy_tokens: Depending on the design of the weapon , the shortest way could be to buy or steal fissile material .


fn_spacy_tokens_for_baseline: Alarm bells would not start ringing until these efforts - which could take five minutes or more - were tried and had failed .

source_bert_toks: alarm bells would not start ringing until these efforts - which could take five minutes or more - were tried and had failed .

reference_raw: The alarm bells would not begin to ring until the attempts - which might take five minutes or more - had been attempted and failed.

reference_spacy_tokens: The alarm bells would not begin to ring until the attempts - which might take five minutes or more - had been attempted and failed .


fn_spacy_tokens_for_baseline: Mr Clinton 's campaign promises were dropping like autumn leaves , he charged in a newspaper editorial , while ' taxes have never succeeded in promoting economic growth . '

source_bert_toks: mr clinton ' s campaign promises were dropping like autumn leaves , he charged in a newspaper editorial , while ' taxes have never succeeded in promoting economic growth . '

reference_raw: Mr. Clinton's campaign promises were dropping like autumn leaves, and he charged the press, while 'taxes were never able to promote economic growth.'

reference_spacy_tokens: Mr. Clinton 's campaign promises were dropping like autumn leaves , and he charged the press , while ' taxes were never able to promote economic growth . '


fn_spacy_tokens_for_baseline: It 's summer , and the English middle class prepare for their annual pilgrimage to the land of their putative forebears .

source_bert_toks: it ' s summer , and the english middle class prepare for their annual pilgrimage to the land of their put ##ative fore ##be ##ars .

reference_raw: It's summer, and the middle class of England is preparing for their yearly journey to the land of their putative ancestors.

reference_spacy_tokens: It 's summer , and the middle class of England is preparing for their yearly journey to the land of their putative ancestors .


fn_spacy_tokens_for_baseline: U.S. authorities admit they are worried about the possibility of a repeat of the mass suicide in Guyana in 1978 when more than 900 followers of cult leader Jim Jones took cyanide .

source_bert_toks: u . s . authorities admit they are worried about the possibility of a repeat of the mass suicide in guyana in 1978 when more than 900 followers of cult leader jim jones took cy ##ani ##de .

reference_raw: The US authorities admit that they fear a recurring mass suicide in Guyana in 1978, when over 900 followers of cult leader Jim Jones took cyanide.

reference_spacy_tokens: The US authorities admit that they fear a recurring mass suicide in Guyana in 1978 , when over 900 followers of cult leader Jim Jones took cyanide .


fn_spacy_tokens_for_baseline: He argued the congested roads and lack of parking spaces adversely affected the town 's all - important tourist industry by putting off visitors .

source_bert_toks: he argued the cong ##ested roads and lack of parking spaces adverse ##ly affected the town ' s all - important tourist industry by putting off visitors .

reference_raw: He claimed that the overloaded roads and the lack of parking spaces had had a negative impact on the city's all-important tourist industry by delaying visitors.

reference_spacy_tokens: He claimed that the overloaded roads and the lack of parking spaces had had a negative impact on the city 's all - important tourist industry by delaying visitors .


fn_spacy_tokens_for_baseline: In November 1 172 he had met his father - in - law on the Norman border and it was believed that Louis VII had urged him to demand what was rightfully his .

source_bert_toks: in november 1 172 he had met his father - in - law on the norman border and it was believed that louis vii had urged him to demand what was rightful ##ly his .

reference_raw: On November 172, he met his father-in-Law on the Norman border, and it was believed that Louis VII had urged him to demand what was rightfully his.

reference_spacy_tokens: On November 172 , he met his father - in - Law on the Norman border , and it was believed that Louis VII had urged him to demand what was rightfully his .


fn_spacy_tokens_for_baseline: A united Germany acceded on Oct. 3 , reducing the membership again to 159 countries .

source_bert_toks: a united germany acc ##eded on oct . 3 , reducing the membership again to 159 countries .

reference_raw: On October 3, one united Germany joined and again reduced membership to 159 countries.

reference_spacy_tokens: On October 3 , one united Germany joined and again reduced membership to 159 countries .


fn_spacy_tokens_for_baseline: Access to these tunnels is limited to the town guard and to certain licensed adventurers who are permitted to search for ancient treasures amongst the ancient tombs and catacombs .

source_bert_toks: access to these tunnels is limited to the town guard and to certain licensed adventurer ##s who are permitted to search for ancient treasures amongst the ancient tombs and cat ##aco ##mbs .

reference_raw: Access to these tunnels is restricted to the city guard and certain licensed adventurers who are allowed to search for old treasures among old graves and catacombs.

reference_spacy_tokens: Access to these tunnels is restricted to the city guard and certain licensed adventurers who are allowed to search for old treasures among old graves and catacombs .


fn_spacy_tokens_for_baseline: He could hide behind the door and club them down one by one when they came in .

source_bert_toks: he could hide behind the door and club them down one by one when they came in .

reference_raw: When they came in, he could get behind the door and shove them down one by one.

reference_spacy_tokens: When they came in , he could get behind the door and shove them down one by one .


fn_spacy_tokens_for_baseline: We had to staple a polythene vapour barrier to the rafters of a pitched roof .

source_bert_toks: we had to staple a poly ##the ##ne va ##pour barrier to the raft ##ers of a pitched roof .

reference_raw: We had to attach a polythene vapour barrier to the beams of the pitched roof.

reference_spacy_tokens: We had to attach a polythene vapour barrier to the beams of the pitched roof .


fn_spacy_tokens_for_baseline: ' Your goons want to know whether you want them to take us , ' Zimmerman said , eyeing the table around which Sly 's men were sat .

source_bert_toks: ' your goo ##ns want to know whether you want them to take us , ' zimmerman said , eyeing the table around which sly ' s men were sat .

reference_raw: 'Your goons want to know if they want to take us,' Zimmerman said, looking at the table where Sly's men were seated.

reference_spacy_tokens: ' Your goons want to know if they want to take us , ' Zimmerman said , looking at the table where Sly 's men were seated .


fn_spacy_tokens_for_baseline: Motivation : The terrorist groups of greatest concern are motivated to inflict indiscriminate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

source_bert_toks: motivation : the terrorist groups of greatest concern are motivated to in ##flict ind ##is ##cr ##imi ##nate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

reference_raw: Motivation: Terrorist groups of greatest concern are motivated to cause indiscriminate mass casualties (random; not targeting a particular person or persons) and participate in innovative and risky tactics.

reference_spacy_tokens: Motivation : Terrorist groups of greatest concern are motivated to cause indiscriminate mass casualties ( random ; not targeting a particular person or persons ) and participate in innovative and risky tactics .


fn_spacy_tokens_for_baseline: However , the discontinuation of BCG vaccination for teenagers is premature for a number of reasons .

source_bert_toks: however , the disco ##nti ##nu ##ation of bc ##g va ##cci ##nation for teenagers is premature for a number of reasons .

reference_raw: However, interruption of vaccination against BCG in adolescents is premature for several reasons.

reference_spacy_tokens: However , interruption of vaccination against BCG in adolescents is premature for several reasons .


fn_spacy_tokens_for_baseline: We can see in this Nietzsche 's aspirations towards a total philosophy of life .

source_bert_toks: we can see in this nietzsche ' s aspirations towards a total philosophy of life .

reference_raw: In this Nietzsche we can see the ambition of a complete philosophy of life.

reference_spacy_tokens: In this Nietzsche we can see the ambition of a complete philosophy of life .


fn_spacy_tokens_for_baseline: Main picture : Pat with Orlando , 10 , and Camellia , 5 , in her favourite fairy outfit

source_bert_toks: main picture : pat with orlando , 10 , and camel ##lia , 5 , in her favourite fairy outfit

reference_raw: The main picture: Pat with Orlando, 10, and Camellia, 5, in her favorite fairy suit.

reference_spacy_tokens: The main picture : Pat with Orlando , 10 , and Camellia , 5 , in her favorite fairy suit .


fn_spacy_tokens_for_baseline: You may wish to embellish the controls with rubdown lettering followed by a coat of spray - on protective lacquer as usual .

source_bert_toks: you may wish to em ##bell ##ish the controls with rub ##down lettering followed by a coat of spray - on protective lac ##que ##r as usual .

reference_raw: You may want to engrave the controls with a rubdown letter followed by a spray-on protective lacquer coat as usual.

reference_spacy_tokens: You may want to engrave the controls with a rubdown letter followed by a spray - on protective lacquer coat as usual .


fn_spacy_tokens_for_baseline: This is obviously a wildly prejudiced view , but if you are keen to climb on sea cliffs , go to Cornwall or Pembroke !

source_bert_toks: this is obviously a wildly prejudice ##d view , but if you are keen to climb on sea cliffs , go to cornwall or pembroke !

reference_raw: It's a wildly prejudiced view, of course, but if you want to climb the reefs of the sea, go to Cornwall or Pembroke!

reference_spacy_tokens: It 's a wildly prejudiced view , of course , but if you want to climb the reefs of the sea , go to Cornwall or Pembroke !


fn_spacy_tokens_for_baseline: Hall , who recently returned from a trip to Iraq , said U.N. economic sanctions have hurt millions of civilians there .

source_bert_toks: hall , who recently returned from a trip to iraq , said u . n . economic sanctions have hurt millions of civilians there .

reference_raw: Hall, who had recently returned from his journey to Iraq, said that the economic sanctions of the United Nations had hurt millions of civilians there.

reference_spacy_tokens: Hall , who had recently returned from his journey to Iraq , said that the economic sanctions of the United Nations had hurt millions of civilians there .


fn_spacy_tokens_for_baseline: Recent research has shown that babies as young as 6 months comprehend changes in the direction of gaze of an adult as a signal .

source_bert_toks: recent research has shown that babies as young as 6 months comprehend changes in the direction of gaze of an adult as a signal .

reference_raw: Recent research has shown that children under six months of age understand the change in the direction of an adult's eyes as a signal.

reference_spacy_tokens: Recent research has shown that children under six months of age understand the change in the direction of an adult 's eyes as a signal .


fn_spacy_tokens_for_baseline: So I was n't bitter when I put myself into the hands of the surgeon and that splendid bank nurse was so thoughtful as to ask me the question .

source_bert_toks: so i wasn ' t bitter when i put myself into the hands of the surgeon and that splendid bank nurse was so thoughtful as to ask me the question .

reference_raw: So I wasn't bitter when I put myself in the hands of a surgeon, and the great bank nurse was so considerate as to ask me a question.

reference_spacy_tokens: So I was n't bitter when I put myself in the hands of a surgeon , and the great bank nurse was so considerate as to ask me a question .


fn_spacy_tokens_for_baseline: The world well knows how this conflict began . and I am certain of how it will end .

source_bert_toks: the world well knows how this conflict began . and i am certain of how it will end .

reference_raw: The world knows how this conflict began... and I'm sure it's going to end.

reference_spacy_tokens: The world knows how this conflict began ... and I 'm sure it 's going to end .


fn_spacy_tokens_for_baseline: A MYGT succession of discoveries has taught us about archeabacteria , very ancient and primitive single - cell organisms that live in the places you 'd least expect anything to call home .

source_bert_toks: a my ##gt succession of discoveries has taught us about arch ##ea ##ba ##cter ##ia , very ancient and primitive single - cell organisms that live in the places you ' d least expect anything to call home .

reference_raw: The MyGT series of discoveries taught us about archeabacteria, very ancient and primitive single-cell organisms that live in places you least expect to call home.

reference_spacy_tokens: The MyGT series of discoveries taught us about archeabacteria , very ancient and primitive single - cell organisms that live in places you least expect to call home .


fn_spacy_tokens_for_baseline: This time , it just got stronger and then the building started shaking violently up and down as though it were a child 's toy block that was being tossed .

source_bert_toks: this time , it just got stronger and then the building started shaking violently up and down as though it were a child ' s toy block that was being tossed .

reference_raw: This time it grew stronger, and then the building began to tremble violently up and down, as if it were a child's toy block.

reference_spacy_tokens: This time it grew stronger , and then the building began to tremble violently up and down , as if it were a child 's toy block .


fn_spacy_tokens_for_baseline: The Museum site includes a hard - standing and all the volunteers are keeping a covetous eye on a nearby T2-type hangar .

source_bert_toks: the museum site includes a hard - standing and all the volunteers are keeping a cove ##tou ##s eye on a nearby t ##2 - type hangar .

reference_raw: The museum site has a hard position, and all volunteers keep an eye on the nearby T2 hangar.

reference_spacy_tokens: The museum site has a hard position , and all volunteers keep an eye on the nearby T2 hangar .


fn_spacy_tokens_for_baseline: If the flat only has one entrance / exit ( which it will because it is not on the ground floor ) , it should have a fire escape , or some means of escape over a balcony or roof .

source_bert_toks: if the flat only has one entrance / exit ( which it will because it is not on the ground floor ) , it should have a fire escape , or some means of escape over a balcony or roof .

reference_raw: If the apartment has only one entry/exit (which will be the case because it is not on the ground floor), it should be equipped with a fire-fighting or some way out of the balcony or roof.

reference_spacy_tokens: If the apartment has only one entry / exit ( which will be the case because it is not on the ground floor ) , it should be equipped with a fire - fighting or some way out of the balcony or roof .


fn_spacy_tokens_for_baseline: It was reported on Jan. 16 that the government had also requested assistance worth $ US130,000,000 from the International Monetary Fund and the World Bank .

source_bert_toks: it was reported on jan . 16 that the government had also requested assistance worth $ us ##13 ##0 , 000 , 000 from the international monetary fund and the world bank .

reference_raw: On January 16, the government also asked the International Monetary Fund and the World Bank for assistance worth USD 130,000,000.

reference_spacy_tokens: On January 16 , the government also asked the International Monetary Fund and the World Bank for assistance worth USD 130,000,000 .


fn_spacy_tokens_for_baseline: He also had unusually heavy , drooping eyelids which could make him look comic or sinister , benevolent or supercilious .

source_bert_toks: he also had unusually heavy , dr ##ooping eyelids which could make him look comic or sinister , benevolent or super ##ci ##lio ##us .

reference_raw: He also wore unusually heavy, drooping lids that made him look comical or ominous, benevolent or supercilious.

reference_spacy_tokens: He also wore unusually heavy , drooping lids that made him look comical or ominous , benevolent or supercilious .


fn_spacy_tokens_for_baseline: Not so in Aachen , or anywhere in the old Federal Republic where the townscapes are sprightly and well kept , the public parks devoid of litter and the shopping malls reek of prosperity .

source_bert_toks: not so in aachen , or anywhere in the old federal republic where the towns ##cape ##s are sp ##right ##ly and well kept , the public parks devoid of litter and the shopping malls re ##ek of prosperity .

reference_raw: Not in Aachen, or anywhere else in the old Federal Republic, where the countryside is sprightly and well maintained, public parks with no litter and shopping malls smell of prosperity.

reference_spacy_tokens: Not in Aachen , or anywhere else in the old Federal Republic , where the countryside is sprightly and well maintained , public parks with no litter and shopping malls smell of prosperity .


fn_spacy_tokens_for_baseline: Technical analysis of clandestine programs is based on the widely known physical and engineering aspects of nuclear materials and weapons , which enable estimates of capabilities based on fragmentary and uncertain information , as follows .

source_bert_toks: technical analysis of clandestine programs is based on the widely known physical and engineering aspects of nuclear materials and weapons , which enable estimates of capabilities based on fragment ##ary and uncertain information , as follows .

reference_raw: The technical analysis of classified software is based on well-known physical and technical aspects of nuclear materials and weapons, which allow for the estimation of capabilities based on fragmentary and uncertain information as follows.

reference_spacy_tokens: The technical analysis of classified software is based on well - known physical and technical aspects of nuclear materials and weapons , which allow for the estimation of capabilities based on fragmentary and uncertain information as follows .


fn_spacy_tokens_for_baseline: U.N. officials have said a small spark could set off a wider war that could meld with the fighting in Bosnia .

source_bert_toks: u . n . officials have said a small spark could set off a wider war that could mel ##d with the fighting in bosnia .

reference_raw: According to UN officials, a small spark could trigger a wider war that could be combined with fighting in Bosnia.

reference_spacy_tokens: According to UN officials , a small spark could trigger a wider war that could be combined with fighting in Bosnia .


fn_spacy_tokens_for_baseline: Unix System Laboratories Inc is reportedly getting ready to do something serious with the Chorus Systemes SA microkernel .

source_bert_toks: unix system laboratories inc is reportedly getting ready to do something serious with the chorus system ##es sa micro ##ker ##nel .

reference_raw: Unix System Laboratories Inc. is allegedly preparing for something serious with the Chorus Systems SA microkernel.

reference_spacy_tokens: Unix System Laboratories Inc. is allegedly preparing for something serious with the Chorus Systems SA microkernel .


fn_spacy_tokens_for_baseline: Several families they knew had sons or fathers missing or drowned at sea , and men were being sent to France with the British Expeditionary Force .

source_bert_toks: several families they knew had sons or fathers missing or drowned at sea , and men were being sent to france with the british expeditionary force .

reference_raw: Some of the families they knew had sons or fathers who had been lost or sunk at sea, and men who had been sent to France by the British expeditionary force.

reference_spacy_tokens: Some of the families they knew had sons or fathers who had been lost or sunk at sea , and men who had been sent to France by the British expeditionary force .


fn_spacy_tokens_for_baseline: We never did have a proper wash house at our place like some people , with a big boiler and a fire underneath for hot water .

source_bert_toks: we never did have a proper wash house at our place like some people , with a big boiler and a fire underneath for hot water .

reference_raw: We've never had a proper washhouse, like some people, with a big boiler and a fire under it for hot water.

reference_spacy_tokens: We 've never had a proper washhouse , like some people , with a big boiler and a fire under it for hot water .


fn_spacy_tokens_for_baseline: There were no serious injuries at all , in fact .

source_bert_toks: there were no serious injuries at all , in fact .

reference_raw: In fact, there weren't any serious injuries.

reference_spacy_tokens: In fact , there were n't any serious injuries .


fn_spacy_tokens_for_baseline: A girl was coming in their direction , driving a flock of geese in front of her .

source_bert_toks: a girl was coming in their direction , driving a flock of geese in front of her .

reference_raw: A girl came toward them, driving a herd of geese ahead of her.

reference_spacy_tokens: A girl came toward them , driving a herd of geese ahead of her .


fn_spacy_tokens_for_baseline: He wore a tarnished gold watch chain across his waistcoat .

source_bert_toks: he wore a tar ##nished gold watch chain across his waist ##coat .

reference_raw: He had a stained gold watch chain on his vest.

reference_spacy_tokens: He had a stained gold watch chain on his vest .


fn_spacy_tokens_for_baseline: Whether it is used for drinking , bathing , preparing food , cleaning , fighting fires or turning the wheels of industry -- we all take a readily available supply of water for granted today .

source_bert_toks: whether it is used for drinking , bathing , preparing food , cleaning , fighting fires or turning the wheels of industry - - we all take a readily available supply of water for granted today .

reference_raw: Whether it is used to drink, to bathe, to prepare food, to clean, to combat fires, or to turn the wheels of industry - we all take for granted the supply of water.

reference_spacy_tokens: Whether it is used to drink , to bathe , to prepare food , to clean , to combat fires , or to turn the wheels of industry - we all take for granted the supply of water .


fn_spacy_tokens_for_baseline: The boys are also charged with abduction and attempting another boy of two last February .

source_bert_toks: the boys are also charged with abduction and attempting another boy of two last february .

reference_raw: The boys are also accused of kidnapping and attempting another boy last February.

reference_spacy_tokens: The boys are also accused of kidnapping and attempting another boy last February .


fn_spacy_tokens_for_baseline: Last week , sitting in the Luxembourg Gardens , he became aware of a pain in his foot .

source_bert_toks: last week , sitting in the luxembourg gardens , he became aware of a pain in his foot .

reference_raw: Last week, sitting in the Luxembourg Gardens, he realized his leg hurt.

reference_spacy_tokens: Last week , sitting in the Luxembourg Gardens , he realized his leg hurt .


fn_spacy_tokens_for_baseline: ' This is difficult , very difficult , ' said one Bosnian soldier as he crouched in a trench about to sprint across open ground under the sights of Serb gunners .

source_bert_toks: ' this is difficult , very difficult , ' said one bosnian soldier as he crouched in a trench about to sprint across open ground under the sights of serb gunners .

reference_raw: 'It's hard, it's hard,' said one of the Bosnian soldiers, ducking into the trench and running across the open ground under the eyes of the Serbian gunners.

reference_spacy_tokens: ' It 's hard , it 's hard , ' said one of the Bosnian soldiers , ducking into the trench and running across the open ground under the eyes of the Serbian gunners .


fn_spacy_tokens_for_baseline: Hiding near the door , I could just see into the kitchen through a small uncurtained window .

source_bert_toks: hiding near the door , i could just see into the kitchen through a small un ##cu ##rta ##ined window .

reference_raw: I hid by the door and looked through the small, uncurtained window into the kitchen.

reference_spacy_tokens: I hid by the door and looked through the small , uncurtained window into the kitchen .


fn_spacy_tokens_for_baseline: His trademark is an endless supply of baggy designer suits , but his modernity belies an old fashioned belief in diligence and grasp of detail .

source_bert_toks: his trademark is an endless supply of bag ##gy designer suits , but his modern ##ity bel ##ies an old fashioned belief in dil ##igen ##ce and grasp of detail .

reference_raw: His mark is an endless supply of baggy designer suits, but his modernity is an old-fashioned faith in care and understanding of detail.

reference_spacy_tokens: His mark is an endless supply of baggy designer suits , but his modernity is an old - fashioned faith in care and understanding of detail .


fn_spacy_tokens_for_baseline: Certainly it has produced some wonderful books and backed some new authors ( John Grisham springs to mind , of course ) .

source_bert_toks: certainly it has produced some wonderful books and backed some new authors ( john gr ##isha ##m springs to mind , of course ) .

reference_raw: He certainly produced some great books and supported some of the new authors (of course John Grisham springs to mind).

reference_spacy_tokens: He certainly produced some great books and supported some of the new authors ( of course John Grisham springs to mind ) .


fn_spacy_tokens_for_baseline: York Crown Court heard yesterday that he had committed the offence to finance his drug addiction .

source_bert_toks: york crown court heard yesterday that he had committed the offence to finance his drug addiction .

reference_raw: The York Crown Court heard yesterday that he had committed a crime in order to fund his dependence on drugs.

reference_spacy_tokens: The York Crown Court heard yesterday that he had committed a crime in order to fund his dependence on drugs .


fn_spacy_tokens_for_baseline: Anxiously she peered in among the trees .

source_bert_toks: anxiously she peered in among the trees .

reference_raw: She looked anxiously through the trees.

reference_spacy_tokens: She looked anxiously through the trees .


fn_spacy_tokens_for_baseline: He was incensed , stunned , at her action , and stood rigid with anger as he felt the slime roll down his cheek .

source_bert_toks: he was incense ##d , stunned , at her action , and stood rigid with anger as he felt the slim ##e roll down his cheek .

reference_raw: He was enthusiastic, stunned by her action, and he stood stiff with anger as the slime rolled down his face.

reference_spacy_tokens: He was enthusiastic , stunned by her action , and he stood stiff with anger as the slime rolled down his face .


fn_spacy_tokens_for_baseline: Still , I envied him .

source_bert_toks: still , i en ##vie ##d him .

reference_raw: I was jealous of him, though.

reference_spacy_tokens: I was jealous of him , though .


fn_spacy_tokens_for_baseline: Sun - kings and Moon - queens stood in stately adoration of each other or , in other guises , warred .

source_bert_toks: sun - kings and moon - queens stood in state ##ly ad ##oration of each other or , in other guise ##s , war ##red .

reference_raw: The sun-kings and queens of the moon stood admiring each other or, in other guises, warring.

reference_spacy_tokens: The sun - kings and queens of the moon stood admiring each other or , in other guises , warring .


fn_spacy_tokens_for_baseline: Packer and Sheehy were both taxiing around Sydney airport in their respective corporate jets on Tuesday when they accidentally collided .

source_bert_toks: pack ##er and she ##eh ##y were both taxi ##ing around sydney airport in their respective corporate jets on tuesday when they accidentally collided .

reference_raw: Both Packer and Sheehy were taxiing around Sydney Airport on Tuesdays in their respective corporate jets when they happened to crash.

reference_spacy_tokens: Both Packer and Sheehy were taxiing around Sydney Airport on Tuesdays in their respective corporate jets when they happened to crash .


fn_spacy_tokens_for_baseline: Penry ushered her into the kitchen , unzipping her jacket as though she were a child .

source_bert_toks: pen ##ry ushered her into the kitchen , un ##zi ##pping her jacket as though she were a child .

reference_raw: Penry led her into the kitchen and unbuttoned her jacket as if she were a child.

reference_spacy_tokens: Penry led her into the kitchen and unbuttoned her jacket as if she were a child .


fn_spacy_tokens_for_baseline: The dolphins were trained to use pressurized canisters to shoot intruders with a .45 calibre bullets at point - blank range .

source_bert_toks: the dolphins were trained to use press ##urized can ##ister ##s to shoot intruder ##s with a . 45 cal ##ib ##re bullets at point - blank range .

reference_raw: Dolphins have been taught to use pressure canisters to shoot aliens with .45-calibre bullets at point-blank range.

reference_spacy_tokens: Dolphins have been taught to use pressure canisters to shoot aliens with .45-calibre bullets at point - blank range .


fn_spacy_tokens_for_baseline: A 1 -- mile run will be a doddle and repetition miles a cinch to handle , because in comparison they are over so quickly .

source_bert_toks: a 1 - - mile run will be a dodd ##le and repetition miles a ci ##nch to handle , because in comparison they are over so quickly .

reference_raw: A one-mile run is going to be a doddle and repeating miles a centimetre, because compared to that, it's over so fast.

reference_spacy_tokens: A one - mile run is going to be a doddle and repeating miles a centimetre , because compared to that , it 's over so fast .


fn_spacy_tokens_for_baseline: Three people were reportedly hanged in the oil - rich southwestern province of Khuzestan this month in connection with a series of deadly bombings last year .

source_bert_toks: three people were reportedly hanged in the oil - rich southwestern province of k ##hu ##zes ##tan this month in connection with a series of deadly bombings last year .

reference_raw: Three people were reportedly hanged this month in the oil-rich southwest province of Khuzestan in connection with a series of deadly attacks last year.

reference_spacy_tokens: Three people were reportedly hanged this month in the oil - rich southwest province of Khuzestan in connection with a series of deadly attacks last year .


fn_spacy_tokens_for_baseline: The archosaurs had thus acquired an intermediate position , what has been referred to as ' semi - erect ' , particularly in those immediately ancestral to the dinosaur .

source_bert_toks: the arch ##osa ##urs had thus acquired an intermediate position , what has been referred to as ' semi - erect ' , particularly in those immediately ancestral to the dinosaur .

reference_raw: The archosaurs thus gained an intermediate position called "semi-erect", especially in the immediate ancestors of dinosaurs.

reference_spacy_tokens: The archosaurs thus gained an intermediate position called " semi - erect " , especially in the immediate ancestors of dinosaurs .


fn_spacy_tokens_for_baseline: Hospital nurses opposing a plan to make them wear their own clothes for work have put off a decision to take action in protest .

source_bert_toks: hospital nurses opposing a plan to make them wear their own clothes for work have put off a decision to take action in protest .

reference_raw: The hospital sisters who objected to the plan to force them to wear their own clothes for work postponed the decision to act in protest.

reference_spacy_tokens: The hospital sisters who objected to the plan to force them to wear their own clothes for work postponed the decision to act in protest .


fn_spacy_tokens_for_baseline: She tossed her hair back and addressed him levelly , keeping her rage in check .

source_bert_toks: she tossed her hair back and addressed him level ##ly , keeping her rage in check .

reference_raw: She threw back her hair and spoke to him levelly, keeping her anger in check.

reference_spacy_tokens: She threw back her hair and spoke to him levelly , keeping her anger in check .


fn_spacy_tokens_for_baseline: And the policy is bearing fruit : India 's economy will probably expand by more than 5 % this year and inflation is down to 7 % .

source_bert_toks: and the policy is bearing fruit : india ' s economy will probably expand by more than 5 % this year and inflation is down to 7 % .

reference_raw: And politics is fruitful: the Indian economy is likely to grow by more than 5% this year, with inflation falling to 7%.

reference_spacy_tokens: And politics is fruitful : the Indian economy is likely to grow by more than 5 % this year , with inflation falling to 7 % .


fn_spacy_tokens_for_baseline: Nevertheless , Griffin et al found in 10 % of their patients that oxygen saturation dropped below 90 % for longer than a minute even when supplementary oxygen was used and only modest doses of sedative had been given .

source_bert_toks: nevertheless , griffin et al found in 10 % of their patients that oxygen sat ##uration dropped below 90 % for longer than a minute even when supplementary oxygen was used and only modest doses of se ##da ##tive had been given .

reference_raw: However, Griffin et al found in 10% of patients that oxygen saturation had fallen below 90% for more than one minute, even if additional oxygen had been used and only a modest dose of sedation had been administered.

reference_spacy_tokens: However , Griffin et al found in 10 % of patients that oxygen saturation had fallen below 90 % for more than one minute , even if additional oxygen had been used and only a modest dose of sedation had been administered .


fn_spacy_tokens_for_baseline: The headsman , considerate enough to have hidden his sword beneath the straw , then signalled his English assistant to approach the Queen , thereby distracting her attention .

source_bert_toks: the heads ##man , consider ##ate enough to have hidden his sword beneath the straw , then signal ##led his english assistant to approach the queen , thereby distracting her attention .

reference_raw: The leader, considerate enough to hide his sword under the straw, then motioned for his English assistant to approach the Queen, distracting her attention.

reference_spacy_tokens: The leader , considerate enough to hide his sword under the straw , then motioned for his English assistant to approach the Queen , distracting her attention .


fn_spacy_tokens_for_baseline: As with the two Faure chamber music sets reviewed above , it is hard to imagine finer performances of most of these pieces .

source_bert_toks: as with the two fa ##ure chamber music sets reviewed above , it is hard to imagine finer performances of most of these pieces .

reference_raw: As with the two music sets of the Faure Chamber examined above, it is difficult to imagine a better performance of most of them.

reference_spacy_tokens: As with the two music sets of the Faure Chamber examined above , it is difficult to imagine a better performance of most of them .


fn_spacy_tokens_for_baseline: And I should n't worry about suiting .

source_bert_toks: and i shouldn ' t worry about suit ##ing .

reference_raw: And I'm not supposed to be afraid of a suit.

reference_spacy_tokens: And I 'm not supposed to be afraid of a suit .


fn_spacy_tokens_for_baseline: The fish and chips he did buy were simply scrumptious .

source_bert_toks: the fish and chips he did buy were simply sc ##rum ##pt ##ious .

reference_raw: The fish and chips he bought were simply scrupulous.

reference_spacy_tokens: The fish and chips he bought were simply scrupulous .


fn_spacy_tokens_for_baseline: There was nothing in Luke 's voice to suggest anything more than a mild curiosity , but Fran could feel the tension radiating from his powerful body as he leant forward in the seat .

source_bert_toks: there was nothing in luke ' s voice to suggest anything more than a mild curiosity , but fran could feel the tension radiating from his powerful body as he lean ##t forward in the seat .

reference_raw: There was nothing in Luke's voice that suggested anything but mild curiosity, but as he leaned back in his seat, Fran felt the tension emanating from his strong body.

reference_spacy_tokens: There was nothing in Luke 's voice that suggested anything but mild curiosity , but as he leaned back in his seat , Fran felt the tension emanating from his strong body .


fn_spacy_tokens_for_baseline: ' All this industry must be a sign of things looking good . '

source_bert_toks: ' all this industry must be a sign of things looking good . '

reference_raw: "This whole industry has to be a symptom of things that look good."

reference_spacy_tokens: " This whole industry has to be a symptom of things that look good . "


fn_spacy_tokens_for_baseline: Tod Richardson protects himself from burglars .

source_bert_toks: tod richardson protects himself from bu ##rg ##lars .

reference_raw: Tod Richardson is shielding himself from thieves.

reference_spacy_tokens: Tod Richardson is shielding himself from thieves .


fn_spacy_tokens_for_baseline: NATO 's commanders say that the missiles are there to deter , to prove to the Soviet Union that the West can knock out ports , factories and other ' strategic ' targets with pinpoint accuracy .

source_bert_toks: nato ' s commanders say that the missiles are there to deter , to prove to the soviet union that the west can knock out ports , factories and other ' strategic ' targets with pin ##point accuracy .

reference_raw: NATO leaders say the missiles are there to discourage and show the Soviet Union that the West can destroy ports, factories, and other strategic targets with precision.

reference_spacy_tokens: NATO leaders say the missiles are there to discourage and show the Soviet Union that the West can destroy ports , factories , and other strategic targets with precision .


fn_spacy_tokens_for_baseline: Miss Dunstable decided to say nothing about the Rector 's imperfectly ironed surplice .

source_bert_toks: miss dun ##sta ##ble decided to say nothing about the rector ' s imperfect ##ly iron ##ed sur ##pl ##ice .

reference_raw: Miss Dunstable decided not to mention the Emperor's imperfectly ironed surplus.

reference_spacy_tokens: Miss Dunstable decided not to mention the Emperor 's imperfectly ironed surplus .


fn_spacy_tokens_for_baseline: We would be foolish to believe that nothing good could come out of modernity .

source_bert_toks: we would be foolish to believe that nothing good could come out of modern ##ity .

reference_raw: We'd be fools to believe that nothing good can come from modernity.

reference_spacy_tokens: We 'd be fools to believe that nothing good can come from modernity .


fn_spacy_tokens_for_baseline: It all started early this morning , when a rather anxious mum called in at the office .

source_bert_toks: it all started early this morning , when a rather anxious mum called in at the office .

reference_raw: It all started early this morning when a rather nervous mother called the office.

reference_spacy_tokens: It all started early this morning when a rather nervous mother called the office .


fn_spacy_tokens_for_baseline: Already the mare was trotting past the yurt , heading for the plain beyond the trees .

source_bert_toks: already the mare was tr ##otti ##ng past the yu ##rt , heading for the plain beyond the trees .

reference_raw: The mare was already running past the yurt, heading for the plain beyond the trees.

reference_spacy_tokens: The mare was already running past the yurt , heading for the plain beyond the trees .


fn_spacy_tokens_for_baseline: Interpol investigations revealed Lisa was in a buggy being pushed by her mum Elizabeth when the car reversed , catching the pram and crushing it against a pillarbox .

source_bert_toks: inter ##pol investigations revealed lisa was in a bug ##gy being pushed by her mum elizabeth when the car reversed , catching the pr ##am and crushing it against a pillar ##box .

reference_raw: Interpol investigations revealed that Lisa was being pushed by her mother Elizabeth when the car reversed, caught the pram and smashed it against the pillar box.

reference_spacy_tokens: Interpol investigations revealed that Lisa was being pushed by her mother Elizabeth when the car reversed , caught the pram and smashed it against the pillar box .


fn_spacy_tokens_for_baseline: He was still in the middle of the road when the horses thundered up to the inn .

source_bert_toks: he was still in the middle of the road when the horses thunder ##ed up to the inn .

reference_raw: He was still in the middle of the road when the horses roared toward the inn.

reference_spacy_tokens: He was still in the middle of the road when the horses roared toward the inn .


fn_spacy_tokens_for_baseline: Her hands massaged his testicles and fondled the shaft of his risen pole , while she covered his chest and belly with a flurry of butterfly kisses .

source_bert_toks: her hands massage ##d his test ##icles and fond ##led the shaft of his risen pole , while she covered his chest and belly with a flu ##rry of butterfly kisses .

reference_raw: She rubbed his testicles with her hands, fondling the shaft of his risen pole, while she covered his chest and stomach with a flurry of butterfly kisses.

reference_spacy_tokens: She rubbed his testicles with her hands , fondling the shaft of his risen pole , while she covered his chest and stomach with a flurry of butterfly kisses .


fn_spacy_tokens_for_baseline: The events of 1934 showed Joyce the propagandist in a different and more chilling role .

source_bert_toks: the events of 1934 showed joyce the prop ##aga ##ndi ##st in a different and more chilling role .

reference_raw: The events of 1934 showed Joyce the propagandaist in a different and cooler role.

reference_spacy_tokens: The events of 1934 showed Joyce the propagandaist in a different and cooler role .


fn_spacy_tokens_for_baseline: This was the first thought he had ever had of the commune , it was at that moment it first came to him , out on the terrace sitting beside Rufus under Hilbert 's umbrella , while the Vermstroy man hunted his quarry along the woodland streams and Mary pursued him with cries of protest .

source_bert_toks: this was the first thought he had ever had of the commune , it was at that moment it first came to him , out on the terrace sitting beside rufus under hilbert ' s umbrella , while the ve ##rm ##st ##roy man hunted his quarry along the woodland streams and mary pursued him with cries of protest .

reference_raw: This was the first thought he had ever had about the community, the first time he had come to him, out on the terrace, sitting next to Rufus under Hilbert's umbrella, while the Vermstroy man hunted his prey down the streams of the forest, and Mary followed him with shouts of protest.

reference_spacy_tokens: This was the first thought he had ever had about the community , the first time he had come to him , out on the terrace , sitting next to Rufus under Hilbert 's umbrella , while the Vermstroy man hunted his prey down the streams of the forest , and Mary followed him with shouts of protest .


fn_spacy_tokens_for_baseline: Analysis of the Corpus has already yielded valuable information about grammar , new meanings , spelling , and usage , which is of obvious benefit in the field of lexicography .

source_bert_toks: analysis of the corpus has already yielded valuable information about grammar , new meanings , spelling , and usage , which is of obvious benefit in the field of lexi ##co ##graphy .

reference_raw: The Corpus analysis has already provided valuable information on grammar, new meanings, spelling and use, which is clearly beneficial for lexicography.

reference_spacy_tokens: The Corpus analysis has already provided valuable information on grammar , new meanings , spelling and use , which is clearly beneficial for lexicography .


fn_spacy_tokens_for_baseline: Your brother may have been a junkie , but he was also my friend and I happened to love him !

source_bert_toks: your brother may have been a junk ##ie , but he was also my friend and i happened to love him !

reference_raw: Your brother may be an addict, but he's also a friend of mine, and I happen to love him!

reference_spacy_tokens: Your brother may be an addict , but he 's also a friend of mine , and I happen to love him !


fn_spacy_tokens_for_baseline: This week , two days after Arafat and Israel 's new prime minister , Ehud Barak , signed another deal , terrorists struck again .

source_bert_toks: this week , two days after ara ##fat and israel ' s new prime minister , eh ##ud barak , signed another deal , terrorists struck again .

reference_raw: This week, two days after the new Prime Minister of Arafat and Israel, Ehud Barak, signed a new agreement, the terrorists attacked again.

reference_spacy_tokens: This week , two days after the new Prime Minister of Arafat and Israel , Ehud Barak , signed a new agreement , the terrorists attacked again .


fn_spacy_tokens_for_baseline: Uncover , stir gently and then continue to cook for another 15 minutes , or until most of the liquid has evaporated , and you are left with a browned , thickened sauce .

source_bert_toks: uncover , stir gently and then continue to cook for another 15 minutes , or until most of the liquid has eva ##por ##ated , and you are left with a browne ##d , thick ##ened sauce .

reference_raw: Uncover, mix gently, and then continue cooking for the next 15 minutes, or until most of the liquid is gone, and you're left with a brown, thickened sauce.

reference_spacy_tokens: Uncover , mix gently , and then continue cooking for the next 15 minutes , or until most of the liquid is gone , and you 're left with a brown , thickened sauce .


fn_spacy_tokens_for_baseline: It was whispered that he would soon die and he did .

source_bert_toks: it was whispered that he would soon die and he did .

reference_raw: They said he was going to die soon, and he did.

reference_spacy_tokens: They said he was going to die soon , and he did .


fn_spacy_tokens_for_baseline: Shortly before the war , she had committed suicide by throwing herself from the bridge into the path of a train .

source_bert_toks: shortly before the war , she had committed suicide by throwing herself from the bridge into the path of a train .

reference_raw: Shortly before the war, she killed herself by throwing herself off a bridge into a train path.

reference_spacy_tokens: Shortly before the war , she killed herself by throwing herself off a bridge into a train path .


fn_spacy_tokens_for_baseline: Was John F. Kennedy assassinated to protect aliens resident on earth ?

source_bert_toks: was john f . kennedy assassinated to protect aliens resident on earth ?

reference_raw: Was John F. Kennedy murdered to protect extraterrestrials living on Earth?

reference_spacy_tokens: Was John F. Kennedy murdered to protect extraterrestrials living on Earth ?


fn_spacy_tokens_for_baseline: Despite critical letters from their families and harrowing interviews with different social workers , they remain resolute .

source_bert_toks: despite critical letters from their families and harrow ##ing interviews with different social workers , they remain res ##ol ##ute .

reference_raw: Despite critical letters from their families and disturbing interviews with various social workers, they remain determined.

reference_spacy_tokens: Despite critical letters from their families and disturbing interviews with various social workers , they remain determined .


fn_spacy_tokens_for_baseline: Nowadays Moscow balletgoers grumble that the best have fled to Europe and America , that the great Bolshoi Ballet is looking as threadbare on stage as its building does .

source_bert_toks: nowadays moscow ballet ##go ##ers gr ##umble that the best have fled to europe and america , that the great bo ##ls ##ho ##i ballet is looking as thread ##bar ##e on stage as its building does .

reference_raw: Today, the Moscow balletgoers complain that the best have fled to Europe and America, and that the great Bolshoi ballet looks like a threadbare on stage, just like its own building.

reference_spacy_tokens: Today , the Moscow balletgoers complain that the best have fled to Europe and America , and that the great Bolshoi ballet looks like a threadbare on stage , just like its own building .


fn_spacy_tokens_for_baseline: It is a paradox that while sex crimes are popularly abhorred little action is taken against the majority of offenders .

source_bert_toks: it is a paradox that while sex crimes are popularly ab ##hor ##red little action is taken against the majority of offenders .

reference_raw: It is paradoxical that while sex crimes are popularly repulsive, little action is taken against most perpetrators.

reference_spacy_tokens: It is paradoxical that while sex crimes are popularly repulsive , little action is taken against most perpetrators .


fn_spacy_tokens_for_baseline: The pair will co - star in a new BBC 2 show , Absolutely Fabulous , written by Jennifer .

source_bert_toks: the pair will co - star in a new bbc 2 show , absolutely fabulous , written by jennifer .

reference_raw: The couple will be the star of the new BBC 2 show, Absolutely Fabulous, written by Jennifer.

reference_spacy_tokens: The couple will be the star of the new BBC 2 show , Absolutely Fabulous , written by Jennifer .


fn_spacy_tokens_for_baseline: The Editor travels to delightful Malta to see the work of CFS Aeroengines , providing power to piston operators far and wide .

source_bert_toks: the editor travels to delightful malta to see the work of cf ##s aero ##eng ##ines , providing power to piston operators far and wide .

reference_raw: The editor travels to lovely Malta to watch the work of the CFS Aeroengines and provides power to the piston operators far and wide.

reference_spacy_tokens: The editor travels to lovely Malta to watch the work of the CFS Aeroengines and provides power to the piston operators far and wide .


fn_spacy_tokens_for_baseline: Despite unemployment and money worries , he made two donations of £ 250 and £ 100 to Christian Aid and sympathised with victims of Serbian cruelty in Bosnia .

source_bert_toks: despite unemployment and money worries , he made two donations of £2 ##50 and £100 to christian aid and sy ##mp ##athi ##sed with victims of serbian cruelty in bosnia .

reference_raw: Despite unemployment and financial concerns, he made two gifts of £250 and £100 to Christian Aid and sympathized with the victims of Serbian cruelty in Bosnia.

reference_spacy_tokens: Despite unemployment and financial concerns , he made two gifts of £ 250 and £ 100 to Christian Aid and sympathized with the victims of Serbian cruelty in Bosnia .


fn_spacy_tokens_for_baseline: Thy just rebuke I 'll bear . '

source_bert_toks: thy just re ##bu ##ke i ' ll bear . '

reference_raw: All you have to do is reproach me.'

reference_spacy_tokens: All you have to do is reproach me . '


fn_spacy_tokens_for_baseline: I grilled a man called George Evans , the managing director of their operations here on the Continent .

source_bert_toks: i grille ##d a man called george evans , the managing director of their operations here on the continent .

reference_raw: I barbecued a man named George Evans, director of their operations here on the continent.

reference_spacy_tokens: I barbecued a man named George Evans , director of their operations here on the continent .


fn_spacy_tokens_for_baseline: Meanwhile , his literary reputation continued to grow as later generations came to appreciate and reassess the immense significance of his contribution to English literature .

source_bert_toks: meanwhile , his literary reputation continued to grow as later generations came to appreciate and re ##asse ##ss the immense significance of his contribution to english literature .

reference_raw: In the meantime, his literary reputation continued to grow as later generations appreciated and re-evaluated the enormous importance of his contribution to English literature.

reference_spacy_tokens: In the meantime , his literary reputation continued to grow as later generations appreciated and re - evaluated the enormous importance of his contribution to English literature .


fn_spacy_tokens_for_baseline: Almost each day in Iraq will end with an American on patrol losing an arm , a leg , an eye or a life to an earth - shattering detonation of high explosives .

source_bert_toks: almost each day in iraq will end with an american on patrol losing an arm , a leg , an eye or a life to an earth - shattering det ##ona ##tion of high explosives .

reference_raw: Almost every day in Iraq, an American on watch loses his hand, leg, eye, or life to an earth-shattering explosion of high explosives.

reference_spacy_tokens: Almost every day in Iraq , an American on watch loses his hand , leg , eye , or life to an earth - shattering explosion of high explosives .


fn_spacy_tokens_for_baseline: But Yemen 's president says the FBI has told him the explosive material could only have come from the U.S. , Israel or two Arab countries .

source_bert_toks: but yemen ' s president says the fbi has told him the explosive material could only have come from the u . s . , israel or two arab countries .

reference_raw: But the Chairman of Yemen says the FBI told him that the explosive material could only come from the United States, Israel, or two Arab countries.

reference_spacy_tokens: But the Chairman of Yemen says the FBI told him that the explosive material could only come from the United States , Israel , or two Arab countries .


fn_spacy_tokens_for_baseline: Indeed it would be quite absurd if companies can not correct any mistake if all interested parties agree .

source_bert_toks: indeed it would be quite absurd if companies can not correct any mistake if all interested parties agree .

reference_raw: Indeed, it would be preposterous if companies could not correct any errors if all stakeholders agreed.

reference_spacy_tokens: Indeed , it would be preposterous if companies could not correct any errors if all stakeholders agreed .


fn_spacy_tokens_for_baseline: She rubbed her chin slowly with her forefinger .

source_bert_toks: she rubbed her chin slowly with her fore ##finger .

reference_raw: Slowly she rubbed her chin with her index finger.

reference_spacy_tokens: Slowly she rubbed her chin with her index finger .


fn_spacy_tokens_for_baseline: Badgers smell musky , which is not surprising because they habitually deposit tiny amounts of musk , a smelly fluid secreted from a gland near the anus , to mark the home territory and individuals within that territory .

source_bert_toks: badger ##s smell mu ##sky , which is not surprising because they habit ##ually deposit tiny amounts of mu ##sk , a smell ##y fluid secret ##ed from a gland near the an ##us , to mark the home territory and individuals within that territory .

reference_raw: Badgers stink of musk, which is not surprising, since they usually store small quantities of musk, a scented liquid extracted from a gland near the anus, in order to mark the home territory and the individuals in it.

reference_spacy_tokens: Badgers stink of musk , which is not surprising , since they usually store small quantities of musk , a scented liquid extracted from a gland near the anus , in order to mark the home territory and the individuals in it .


fn_spacy_tokens_for_baseline: The oral shield is distinctly pentagonal , with an obtuse proximal angle and a convex distal edge .

source_bert_toks: the oral shield is distinctly pentagon ##al , with an ob ##tus ##e pro ##xi ##mal angle and a convex distal edge .

reference_raw: The oral shield is clearly pentagonal, with an obtuse proximal angle and a convex distal rim.

reference_spacy_tokens: The oral shield is clearly pentagonal , with an obtuse proximal angle and a convex distal rim .


fn_spacy_tokens_for_baseline: I fell under his freezing spell , obeying all his commands without thinking .

source_bert_toks: i fell under his freezing spell , obey ##ing all his commands without thinking .

reference_raw: I fell under his freezing spell, obeying all his orders without thinking.

reference_spacy_tokens: I fell under his freezing spell , obeying all his orders without thinking .


fn_spacy_tokens_for_baseline: I watched through George 's window as Filmer made great effort to go towards her with a smile , drawing attention away from the gaunt - faced man , who returned to the station .

source_bert_toks: i watched through george ' s window as film ##er made great effort to go towards her with a smile , drawing attention away from the gaunt - faced man , who returned to the station .

reference_raw: I saw through George's window that Filmer was trying very hard to walk toward her, smiling, drawing attention away from the gaunt-faced man who had returned to the station.

reference_spacy_tokens: I saw through George 's window that Filmer was trying very hard to walk toward her , smiling , drawing attention away from the gaunt - faced man who had returned to the station .


fn_spacy_tokens_for_baseline: ' Lots of semi - precious stones , coral , turquoise , garnet -- here 's a garnet necklace .

source_bert_toks: ' lots of semi - precious stones , coral , turquoise , ga ##rnet - - here ' s a ga ##rnet necklace .

reference_raw: A lot of semi-precious stones, corals, turquoises, garnets -- here's the garnet chain.

reference_spacy_tokens: A lot of semi - precious stones , corals , turquoises , garnets -- here 's the garnet chain .


fn_spacy_tokens_for_baseline: Moisten each trout with 1 tsp oil , then stuff the inside of each with a few tarragon sprigs .

source_bert_toks: moist ##en each trout with 1 ts ##p oil , then stuff the inside of each with a few tar ##rag ##on sp ##ri ##gs .

reference_raw: Wet each trout with 1 tsp of oil, then stuff each inside with a couple of tarragon sprigs.

reference_spacy_tokens: Wet each trout with 1 tsp of oil , then stuff each inside with a couple of tarragon sprigs .


fn_spacy_tokens_for_baseline: The land is already farmed organically .

source_bert_toks: the land is already farm ##ed organic ##ally .

reference_raw: The soil is already organically reared.

reference_spacy_tokens: The soil is already organically reared .


fn_spacy_tokens_for_baseline: The time flew past and we got onto the ferry at 4.00 pm and sailed at 5.00 pm .

source_bert_toks: the time flew past and we got onto the ferry at 4 . 00 pm and sailed at 5 . 00 pm .

reference_raw: Time passed, and at four o'clock we boarded the boat and sailed at five o'clock.

reference_spacy_tokens: Time passed , and at four o'clock we boarded the boat and sailed at five o'clock .


fn_spacy_tokens_for_baseline: Other ' salts involving metallic ions such as iron , zinc , copper , magnesium , sodium , potassium , strontium although present in very small quantities , make up the total hardness levels .

source_bert_toks: other ' salts involving metallic ions such as iron , zinc , copper , magnesium , sodium , potassium , st ##ron ##tium although present in very small quantities , make up the total hardness levels .

reference_raw: Other 'salts containing metallic ions such as iron, zinc, copper, magnesium, sodium, potassium and strontium, but present in very small amounts, constitute the total level of hardness.

reference_spacy_tokens: Other ' salts containing metallic ions such as iron , zinc , copper , magnesium , sodium , potassium and strontium , but present in very small amounts , constitute the total level of hardness .


fn_spacy_tokens_for_baseline: They were silent as she walked through the door to the dining room , as if they had a secret .

source_bert_toks: they were silent as she walked through the door to the dining room , as if they had a secret .

reference_raw: As she walked through the door into the cafeteria, they were silent, as if they had a secret.

reference_spacy_tokens: As she walked through the door into the cafeteria , they were silent , as if they had a secret .


fn_spacy_tokens_for_baseline: I would caution care in buying though , and can not stress this strongly enough .

source_bert_toks: i would caution care in buying though , and can not stress this strongly enough .

reference_raw: But I'd be careful to buy it, and I can't stress it too much.

reference_spacy_tokens: But I 'd be careful to buy it , and I ca n't stress it too much .


fn_spacy_tokens_for_baseline: Once it was finished we went outside and swept round the entire barrack block in an extended line , picking up litter from the damp grass .

source_bert_toks: once it was finished we went outside and swept round the entire barr ##ack block in an extended line , picking up litter from the damp grass .

reference_raw: When we were done, we went out and swept the block of the barracks in a long line, picking up litter from the wet grass.

reference_spacy_tokens: When we were done , we went out and swept the block of the barracks in a long line , picking up litter from the wet grass .


fn_spacy_tokens_for_baseline: It was later traced by police to the locker of club skipper Cyril Proby .

source_bert_toks: it was later traced by police to the locker of club skipper cyril pro ##by .

reference_raw: The police later traced it to Captain Cyril Proby's dressing room.

reference_spacy_tokens: The police later traced it to Captain Cyril Proby 's dressing room .


fn_spacy_tokens_for_baseline: There were bitter recriminations within the party about who was to blame for her decision to resign .

source_bert_toks: there were bitter rec ##rim ##inations within the party about who was to blame for her decision to resign .

reference_raw: There were bitter accusations about who was responsible for her decision to resign.

reference_spacy_tokens: There were bitter accusations about who was responsible for her decision to resign .


fn_spacy_tokens_for_baseline: That fortress - monastery was the nearest roost of ultimate warriors capable of obliterating a world .

source_bert_toks: that fortress - monastery was the nearest ro ##ost of ultimate warriors capable of ob ##lite ##rating a world .

reference_raw: This fortress monastery was the closest roost of the ultimate warriors capable of destroying the world.

reference_spacy_tokens: This fortress monastery was the closest roost of the ultimate warriors capable of destroying the world .


fn_spacy_tokens_for_baseline: QN : Has Russia built facilities for the disposal of chemical weapons in the past ?

source_bert_toks: q ##n : has russia built facilities for the disposal of chemical weapons in the past ?

reference_raw: QN: Has Russia built equipment to dispose of chemical weapons in the past?

reference_spacy_tokens: QN : Has Russia built equipment to dispose of chemical weapons in the past ?


fn_spacy_tokens_for_baseline: Perseus , the Gorgon Slayer ; Aesop the fable writer ; Socrates the great philosopher . 3000 years ago Gods and Mortals , Poets and Politicians , Artists and Athletes were founding Greek civilisation .

source_bert_toks: per ##se ##us , the go ##rgo ##n slayer ; ae ##sop the fable writer ; socrates the great philosopher . 3000 years ago gods and mortals , poets and politicians , artists and athletes were founding greek civil ##isation .

reference_raw: Perseus, the Gorgon Killer; Aesop the legendary writer; Socrates the great philosopher ... 3000 years ago, gods and mortals, poets and politicians, artists and athletes founded Greek civilization.

reference_spacy_tokens: Perseus , the Gorgon Killer ; Aesop the legendary writer ; Socrates the great philosopher ... 3000 years ago , gods and mortals , poets and politicians , artists and athletes founded Greek civilization .


fn_spacy_tokens_for_baseline: An encouraging voice should always be used , except when you are displeased .

source_bert_toks: an encouraging voice should always be used , except when you are di ##sp ##lea ##sed .

reference_raw: You should always use an encouraging voice, except if you don't like it.

reference_spacy_tokens: You should always use an encouraging voice , except if you do n't like it .


fn_spacy_tokens_for_baseline: In the VSEL yard a brass bell hangs in a museum of shipbuilding , all that remains of the original HMS Vanguard which was sunk in Scapa Flow .

source_bert_toks: in the vs ##el yard a brass bell hangs in a museum of shipbuilding , all that remains of the original hms vanguard which was sunk in sc ##apa flow .

reference_raw: There's a brass bell hanging in the VSEL yard at the Museum of Shipbuilding, all that's left of the original HMS Vanguard that was sunk in Scapa Flow.

reference_spacy_tokens: There 's a brass bell hanging in the VSEL yard at the Museum of Shipbuilding , all that 's left of the original HMS Vanguard that was sunk in Scapa Flow .


fn_spacy_tokens_for_baseline: ' You can imagine our horror at finding a false ceiling in a secure establishment and ducts like this .

source_bert_toks: ' you can imagine our horror at finding a false ceiling in a secure establishment and duct ##s like this .

reference_raw: You can imagine our terror of finding a false ceiling in a secure facility like this.

reference_spacy_tokens: You can imagine our terror of finding a false ceiling in a secure facility like this .


fn_spacy_tokens_for_baseline: It is intended to provide household water to 30 million people , and irrigate crops which could feed 20 million , as well as generating large quantities of hydro - electric power .

source_bert_toks: it is intended to provide household water to 30 million people , and ir ##ri ##gate crops which could feed 20 million , as well as generating large quantities of hydro - electric power .

reference_raw: It is intended to provide household water to 30 million people and to irrigate crops that can feed 20 million people and produce large amounts of hydroelectric energy.

reference_spacy_tokens: It is intended to provide household water to 30 million people and to irrigate crops that can feed 20 million people and produce large amounts of hydroelectric energy .


fn_spacy_tokens_for_baseline: On the night of 4 March 1990 , in a run - down part of Guatemala City , Nahaman and a group of street kids were sniffing glue .

source_bert_toks: on the night of 4 march 1990 , in a run - down part of guatemala city , nah ##aman and a group of street kids were sniffing glue .

reference_raw: On the night of March 4, 1990, Nahaman and a group of street children were sniffing glue in a run-down section of Guatemala City.

reference_spacy_tokens: On the night of March 4 , 1990 , Nahaman and a group of street children were sniffing glue in a run - down section of Guatemala City .


fn_spacy_tokens_for_baseline: At other times he was scornful of anhimsa , non - violence , and he criticised Gandhi and Nehru as ' philosophemes ' inclined to philosophical concepts which weakened the Indian nationalist movement .

source_bert_toks: at other times he was sc ##orn ##ful of an ##him ##sa , non - violence , and he criticised gandhi and nehru as ' phil ##oso ##ph ##eme ##s ' inclined to philosophical concepts which weakened the indian nationalist movement .

reference_raw: At other times, he despised anhimsa, nonviolence, and criticized Gandhi and Nehru as "philosophemes" for philosophical concepts that weakened the Indian nationalist movement.

reference_spacy_tokens: At other times , he despised anhimsa , nonviolence , and criticized Gandhi and Nehru as " philosophemes " for philosophical concepts that weakened the Indian nationalist movement .


fn_spacy_tokens_for_baseline: As a former schoolmaster , he has always been outspoken on education issues and a firm supporter of traditional learning methods .

source_bert_toks: as a former school ##master , he has always been outspoken on education issues and a firm supporter of traditional learning methods .

reference_raw: As a former teacher, he has always been open to education issues and a strong supporter of traditional learning methods.

reference_spacy_tokens: As a former teacher , he has always been open to education issues and a strong supporter of traditional learning methods .


fn_spacy_tokens_for_baseline: ' It was like a cock - sparrow hopping about by the side of a dinosaur .

source_bert_toks: ' it was like a cock - sparrow hopping about by the side of a dinosaur .

reference_raw: It was like a bird sparrow bouncing around on the side of a dinosaur.

reference_spacy_tokens: It was like a bird sparrow bouncing around on the side of a dinosaur .


fn_spacy_tokens_for_baseline: None of the workers was injured in the incident , the second at the Edgewood Chemical Biological Center , a 1.5 million - square - foot research and engineering facility within APG for chemical and biological defense .

source_bert_toks: none of the workers was injured in the incident , the second at the edge ##wood chemical biological center , a 1 . 5 million - square - foot research and engineering facility within ap ##g for chemical and biological defense .

reference_raw: None of the employees were injured in the accident, the other at the Edgewood Chemical Biology Center, 1.5 million-square-foot research and engineering facilities under the APG for chemical and biological defense.

reference_spacy_tokens: None of the employees were injured in the accident , the other at the Edgewood Chemical Biology Center , 1.5 million - square - foot research and engineering facilities under the APG for chemical and biological defense .


fn_spacy_tokens_for_baseline: How they are set is a difficult question to which I shall return , but those who decry as too narrow the scope of a Convention running to over a hundred Articles must surely embody the resuscitated spirit of Oliver Twist who will always cry for more !

source_bert_toks: how they are set is a difficult question to which i shall return , but those who dec ##ry as too narrow the scope of a convention running to over a hundred articles must surely em ##body the res ##us ##cit ##ated spirit of oliver twist who will always cry for more !

reference_raw: How they are set is a difficult question that I shall return to, but those who denounce as too narrow the scope of the Convention to more than a hundred articles must surely embody the resuscitated spirit of Oliver Twist, who will always cry for more!

reference_spacy_tokens: How they are set is a difficult question that I shall return to , but those who denounce as too narrow the scope of the Convention to more than a hundred articles must surely embody the resuscitated spirit of Oliver Twist , who will always cry for more !


fn_spacy_tokens_for_baseline: Very few of these long - period stars are suitable for observation with binoculars .

source_bert_toks: very few of these long - period stars are suitable for observation with binoculars .

reference_raw: Very few of these long-term stars are suitable for sighting with telescopes.

reference_spacy_tokens: Very few of these long - term stars are suitable for sighting with telescopes .


fn_spacy_tokens_for_baseline: He said Pakistan would not export nuclear technology ( 7212 ) .

source_bert_toks: he said pakistan would not export nuclear technology ( 72 ##12 ) .

reference_raw: He said Pakistan wouldn't export atomics (7212).

reference_spacy_tokens: He said Pakistan would n't export atomics ( 7212 ) .


fn_spacy_tokens_for_baseline: Of all the races of men , the Arabs learning from the Persians and the Indians and especially the Syrians and other peoples , make the most incomparable gardens .

source_bert_toks: of all the races of men , the arabs learning from the persians and the indians and especially the syrian ##s and other peoples , make the most inc ##omp ##arable gardens .

reference_raw: Of all human breeds, Arabs who learn from Persians and Indians, especially Syrians and other nations, make the most incomparable gardens.

reference_spacy_tokens: Of all human breeds , Arabs who learn from Persians and Indians , especially Syrians and other nations , make the most incomparable gardens .


fn_spacy_tokens_for_baseline: Taking his visitor by the arm , he walked her slowly along the corridor .

source_bert_toks: taking his visitor by the arm , he walked her slowly along the corridor .

reference_raw: He took his visitor by the arm and walked her slowly down the hall.

reference_spacy_tokens: He took his visitor by the arm and walked her slowly down the hall .


fn_spacy_tokens_for_baseline: As it happens , the four countries cited , Colombia , Cuba , Panama and Nicaragua , are not only where the press is under greatest attack but also are linked by the drug trade and left - wing politics .

source_bert_toks: as it happens , the four countries cited , colombia , cuba , panama and nicaragua , are not only where the press is under greatest attack but also are linked by the drug trade and left - wing politics .

reference_raw: As it happens, the four countries listed, Colombia, Cuba, Panama and Nicaragua, are not only where the press is under the greatest attack, but also linked to drug trafficking and left-wing policies.

reference_spacy_tokens: As it happens , the four countries listed , Colombia , Cuba , Panama and Nicaragua , are not only where the press is under the greatest attack , but also linked to drug trafficking and left - wing policies .


fn_spacy_tokens_for_baseline: Only those advocating acts of violent sedition would be liable for punishment under the criminal code .

source_bert_toks: only those advocating acts of violent se ##dition would be liable for punishment under the criminal code .

reference_raw: Only those who defend acts of violent sedition will be punishable by criminal law.

reference_spacy_tokens: Only those who defend acts of violent sedition will be punishable by criminal law .


fn_spacy_tokens_for_baseline: A playroom and bathroom painted by Berlin artist Frena Gould is officially opened today by consultant gynaecologist Ann Ryall in the maternity outpatients department at North Tees General Hospital , Stockton .

source_bert_toks: a play ##room and bathroom painted by berlin artist fr ##ena gould is officially opened today by consultant g ##yna ##ec ##ologist ann ry ##all in the maternity out ##patient ##s department at north tee ##s general hospital , stockton .

reference_raw: The playroom and bathroom drawn by the Berlin artist, Frena Gould, is now officially opened by consultant gynaecologist Ann Ryall from the maternity ward at North Tees General Hospital in Stockton.

reference_spacy_tokens: The playroom and bathroom drawn by the Berlin artist , Frena Gould , is now officially opened by consultant gynaecologist Ann Ryall from the maternity ward at North Tees General Hospital in Stockton .


fn_spacy_tokens_for_baseline: By the second meeting Eleanor knew that Gina 's friends walked into their bedroom .

source_bert_toks: by the second meeting eleanor knew that gina ' s friends walked into their bedroom .

reference_raw: By the second meeting Eleanor knew that Gina's friends had entered the room.

reference_spacy_tokens: By the second meeting Eleanor knew that Gina 's friends had entered the room .


fn_spacy_tokens_for_baseline: Knowledge by a bird of a sibling 's appearance must necessarily be an imperfect guide to what a first - cousin will look like .

source_bert_toks: knowledge by a bird of a sibling ' s appearance must necessarily be an imperfect guide to what a first - cousin will look like .

reference_raw: Knowing what a sibling bird looks like is necessarily an imperfect guide to what a first cousin looks like.

reference_spacy_tokens: Knowing what a sibling bird looks like is necessarily an imperfect guide to what a first cousin looks like .


fn_spacy_tokens_for_baseline: Finishing touches were silver handbags , flashing neon ear - rings , pale blue eyeshadow and tomatoes -- everywhere !

source_bert_toks: finishing touches were silver hand ##bags , flashing neon ear - rings , pale blue eyes ##had ##ow and tomatoes - - everywhere !

reference_raw: The final touches were silver purses, flashing neon earrings, pale blue eye shadows, and tomatoes - everywhere!

reference_spacy_tokens: The final touches were silver purses , flashing neon earrings , pale blue eye shadows , and tomatoes - everywhere !


fn_spacy_tokens_for_baseline: Western countries have handed over more than $ 1 billion in aid , mainly as food , which is sold by the government as its main source of revenue .

source_bert_toks: western countries have handed over more than $ 1 billion in aid , mainly as food , which is sold by the government as its main source of revenue .

reference_raw: Western countries have provided more than one billion dollars in aid, mainly in the form of food, which the government trades as its main source of income.

reference_spacy_tokens: Western countries have provided more than one billion dollars in aid , mainly in the form of food , which the government trades as its main source of income .


fn_spacy_tokens_for_baseline: This is not to suggest that Dickson 's book is a catalogue of bloopers , or what Amsel Greene ( and Jack Smith ) like to call pullet surprises .

source_bert_toks: this is not to suggest that dickson ' s book is a catalogue of b ##lo ##opers , or what am ##sel greene ( and jack smith ) like to call pull ##et surprises .

reference_raw: That doesn't mean Dickson's novel is a catalogue of bloopers, or what Amsel Greene (and Jack Smith) likes to call pullet surprises.

reference_spacy_tokens: That does n't mean Dickson 's novel is a catalogue of bloopers , or what Amsel Greene ( and Jack Smith ) likes to call pullet surprises .


fn_spacy_tokens_for_baseline: A circular shaped fence is harder to protect because of hidden angles .

source_bert_toks: a circular shaped fence is harder to protect because of hidden angles .

reference_raw: Circular-shaped fences are more difficult to protect because of concealed angles.

reference_spacy_tokens: Circular - shaped fences are more difficult to protect because of concealed angles .


fn_spacy_tokens_for_baseline: It was the same in the Loire , at the Chateau de Chavigny , where the famous mirrored salon , built for the seventh baron de Chavigny , had been used as a shooting - gallery .

source_bert_toks: it was the same in the loire , at the chateau de cha ##vi ##gny , where the famous mirrored salon , built for the seventh baron de cha ##vi ##gny , had been used as a shooting - gallery .

reference_raw: It was the same in the Loire, in the Chateau de Chavigny, where the famous mirrored saloon, built for the seventh baron de Chavigny, was used as a shooting gallery.

reference_spacy_tokens: It was the same in the Loire , in the Chateau de Chavigny , where the famous mirrored saloon , built for the seventh baron de Chavigny , was used as a shooting gallery .


fn_spacy_tokens_for_baseline: So now Maggie was not afraid of the dark , even though the great windows exposed her to the full moon and turned her own skin white and pearly -- a reflection of reflected light .

source_bert_toks: so now maggie was not afraid of the dark , even though the great windows exposed her to the full moon and turned her own skin white and pearl ##y - - a reflection of reflected light .

reference_raw: So Maggie wasn't afraid of the dark now, though the big windows exposed her to the full moon and made her skin white and pearly - a reflection of reflected light.

reference_spacy_tokens: So Maggie was n't afraid of the dark now , though the big windows exposed her to the full moon and made her skin white and pearly - a reflection of reflected light .


fn_spacy_tokens_for_baseline: He gave him no time to pay and ordered he be jailed for up to the alternative of 14 days .

source_bert_toks: he gave him no time to pay and ordered he be jailed for up to the alternative of 14 days .

reference_raw: He didn't have time to pay, and told him to go to prison for up to 14 days.

reference_spacy_tokens: He did n't have time to pay , and told him to go to prison for up to 14 days .


fn_spacy_tokens_for_baseline: The general manager of the company Ian McCall said ; ' We have had a tremendous response already and we expect parents who wore them in the fifties and sixties to buy them for their children . '

source_bert_toks: the general manager of the company ian mccall said ; ' we have had a tremendous response already and we expect parents who wore them in the fifties and sixties to buy them for their children . '

reference_raw: Ian McCall's CEO said, "We've had a huge reaction, and we expect the parents who wore it in the '50s and '60s to buy it for their kids."

reference_spacy_tokens: Ian McCall 's CEO said , " We 've had a huge reaction , and we expect the parents who wore it in the ' 50s and ' 60s to buy it for their kids . "


fn_spacy_tokens_for_baseline: He took the hand she held out to him and guided her inside the cottage .

source_bert_toks: he took the hand she held out to him and guided her inside the cottage .

reference_raw: He took the hand she held out to him and led her into the cabin.

reference_spacy_tokens: He took the hand she held out to him and led her into the cabin .


fn_spacy_tokens_for_baseline: Besides Oxford University , the side everyone wanted to avoid , Dick Clarke also has to prepare for confrontations with in - form Anchorians from Surrey and Essex rivals Crostyx .

source_bert_toks: besides oxford university , the side everyone wanted to avoid , dick clarke also has to prepare for confrontation ##s with in - form anchor ##ians from surrey and essex rivals cr ##ost ##yx .

reference_raw: In addition to Oxford University, which was the side everyone wanted to avoid, Dick Clarke had to prepare himself for the encounter with the informed Anchorians of Surrey and Essex rivals of Crostyx.

reference_spacy_tokens: In addition to Oxford University , which was the side everyone wanted to avoid , Dick Clarke had to prepare himself for the encounter with the informed Anchorians of Surrey and Essex rivals of Crostyx .


fn_spacy_tokens_for_baseline: She was still wearing her nightie and the draught - board hair with ginger patches was standing up on end .

source_bert_toks: she was still wearing her night ##ie and the draught - board hair with ginger patches was standing up on end .

reference_raw: She was still wearing a nightgown, and her draught-board hair with ginger patches stood at the end of it.

reference_spacy_tokens: She was still wearing a nightgown , and her draught - board hair with ginger patches stood at the end of it .


fn_spacy_tokens_for_baseline: HONG KONG 's top try - scorer and inspiration , Stewart Brew , ( a top cricketer ) , got injured in the final against Namibia and boarded the flight back home on crutches .

source_bert_toks: hong kong ' s top try - scorer and inspiration , stewart brew , ( a top cricketer ) , got injured in the final against namibia and boarded the flight back home on cr ##ut ##ches .

reference_raw: HONG KONG's top test score and inspiration, Stewart Brew, the top cricketer, was wounded in the final fight against Namibia and flew home on crutches.

reference_spacy_tokens: HONG KONG 's top test score and inspiration , Stewart Brew , the top cricketer , was wounded in the final fight against Namibia and flew home on crutches .


fn_spacy_tokens_for_baseline: Just concentrate on watching out for the right opportunity to broach the subject of Janice , she reminded herself .

source_bert_toks: just concentrate on watching out for the right opportunity to bro ##ach the subject of janice , she reminded herself .

reference_raw: Concentrate on watching for the right opportunity to broach Janice, she reminded herself.

reference_spacy_tokens: Concentrate on watching for the right opportunity to broach Janice , she reminded herself .


fn_spacy_tokens_for_baseline: The foot soldiers came up in rows , yelling and dancing and it was a marvel they were not ridden down , as the cavalry seemed to dash right into them .

source_bert_toks: the foot soldiers came up in rows , yelling and dancing and it was a marvel they were not ridden down , as the cavalry seemed to dash right into them .

reference_raw: The foot soldiers came up in rows, shouting and dancing, and it was a miracle they didn't come down, because the cavalry seemed to rush into them.

reference_spacy_tokens: The foot soldiers came up in rows , shouting and dancing , and it was a miracle they did n't come down , because the cavalry seemed to rush into them .


fn_spacy_tokens_for_baseline: The mare writhed and groaned as another spasm of pain shook her body .

source_bert_toks: the mare writ ##hed and groaned as another spa ##sm of pain shook her body .

reference_raw: The mare squirmed and groaned as another spasm of pain shook her body.

reference_spacy_tokens: The mare squirmed and groaned as another spasm of pain shook her body .


fn_spacy_tokens_for_baseline: Although generally not territorial , cuckoos return regularly to the area in which they bred in previous years .

source_bert_toks: although generally not territorial , cuckoo ##s return regularly to the area in which they bred in previous years .

reference_raw: While the cuckoos are generally not territorial, they regularly return to the area in which they were reared in previous years.

reference_spacy_tokens: While the cuckoos are generally not territorial , they regularly return to the area in which they were reared in previous years .


fn_spacy_tokens_for_baseline: In 1966 , for reasons that are unclear , the DPRK later turned to the Soviets for assistance in CW , mostly in the form of training manuals and small quantities of nerve and mustard agents .

source_bert_toks: in 1966 , for reasons that are unclear , the d ##pr ##k later turned to the soviets for assistance in cw , mostly in the form of training manual ##s and small quantities of nerve and mustard agents .

reference_raw: In 1966, for reasons that are not clear, the DPRK later turned to the Soviets for help in the CW, mainly in the form of training manuals and a small number of nerve and mustard agents.

reference_spacy_tokens: In 1966 , for reasons that are not clear , the DPRK later turned to the Soviets for help in the CW , mainly in the form of training manuals and a small number of nerve and mustard agents .


fn_spacy_tokens_for_baseline: This geography is important in understanding Dublin .

source_bert_toks: this geography is important in understanding dublin .

reference_raw: This geography is important for the interpretation of Dublin.

reference_spacy_tokens: This geography is important for the interpretation of Dublin .


fn_spacy_tokens_for_baseline: Fat Trask choked with laughter , spattering half - chewed pasta over another man who slapped him upside the head .

source_bert_toks: fat tr ##ask choked with laughter , spat ##tering half - chewed pasta over another man who slapped him upside the head .

reference_raw: Fat Trask choked with laughter and splashed half-chewed pasta over another man who had hit him in the head.

reference_spacy_tokens: Fat Trask choked with laughter and splashed half - chewed pasta over another man who had hit him in the head .


fn_spacy_tokens_for_baseline: Before Canby , Bosley Crowther ruled the roost for three decades .

source_bert_toks: before can ##by , bo ##sley crow ##ther ruled the ro ##ost for three decades .

reference_raw: Before Canby, Bosley Crowther had been in charge of the cock for three decades.

reference_spacy_tokens: Before Canby , Bosley Crowther had been in charge of the cock for three decades .