fn_spacy_tokens_for_baseline: As they taxied in , Myeloski decided he would not comment on what had obviously been a most difficult landing with a lucky outcome .

source_bert_toks: as they taxi ##ed in , my ##elo ##ski decided he would not comment on what had obviously been a most difficult landing with a lucky outcome .

reference_raw: As they rode in, Myeloski decided not to comment on what seemed to be the most difficult landing with a happy result.

reference_spacy_tokens: As they rode in , Myeloski decided not to comment on what seemed to be the most difficult landing with a happy result .


fn_spacy_tokens_for_baseline: DUNCAN , British Columbia ( AP ) --- An intrepid burglar who wears black pantyhose and little else has been arrested in connection with several underwear thefts .

source_bert_toks: duncan , british columbia ( ap ) - - - an int ##re ##pid bu ##rg ##lar who wears black pan ##ty ##hos ##e and little else has been arrested in connection with several underwear theft ##s .

reference_raw: DUNCAN, British Columbia (AP) -- an intrepid thief wearing black pants and little else was arrested in connection with several lingerie thefts.

reference_spacy_tokens: DUNCAN , British Columbia ( AP ) -- an intrepid thief wearing black pants and little else was arrested in connection with several lingerie thefts .


fn_spacy_tokens_for_baseline: She did as he asked , then fetched the coils of rope , quickly and efficiently trussing the two men like Christmas turkeys as Adam stood over them with the gun .

source_bert_toks: she did as he asked , then fetch ##ed the coil ##s of rope , quickly and efficiently truss ##ing the two men like christmas turkey ##s as adam stood over them with the gun .

reference_raw: She did what he asked her to do, then fetched the coils of rope, and quickly and efficiently pushed the two men like Christmas turkeys while Adam was standing over them with a gun.

reference_spacy_tokens: She did what he asked her to do , then fetched the coils of rope , and quickly and efficiently pushed the two men like Christmas turkeys while Adam was standing over them with a gun .


fn_spacy_tokens_for_baseline: Sexual activities can be ranked according to estimated risk .

source_bert_toks: sexual activities can be ranked according to estimated risk .

reference_raw: Sexual activities may be classified according to the estimated risk.

reference_spacy_tokens: Sexual activities may be classified according to the estimated risk .


fn_spacy_tokens_for_baseline: 4- They should have a protruding area to better control their surroundings .

source_bert_toks: 4 - they should have a protruding area to better control their surroundings .

reference_raw: 4- They should have a protruding area that better manages their surroundings.

reference_spacy_tokens: 4- They should have a protruding area that better manages their surroundings .


fn_spacy_tokens_for_baseline: Philip , 36 , ran into the house clutching his neck as blood pumped from the wound .

source_bert_toks: philip , 36 , ran into the house clutching his neck as blood pumped from the wound .

reference_raw: Philip, thirty-six years old, ran into the house, clutching his throat as blood flowed from the wound.

reference_spacy_tokens: Philip , thirty - six years old , ran into the house , clutching his throat as blood flowed from the wound .


fn_spacy_tokens_for_baseline: 4:02 a.m. SHIBUMI : Power is back on , and UCSF { medical center } seems to have quieted down for the night ( they were doing triage out in the parking lot from the sound and lights of it ) .

source_bert_toks: 4 : 02 a . m . shi ##bu ##mi : power is back on , and uc ##sf { medical center } seems to have quiet ##ed down for the night ( they were doing tri ##age out in the parking lot from the sound and lights of it ) .

reference_raw: 4:02 A.M. SHIBUMI: The power is back on, and the UCSF {medical center} appears to have quieted for the night (they've been doing trips in the garage by the sound and lights of the car).

reference_spacy_tokens: 4:02 A.M. SHIBUMI : The power is back on , and the UCSF { medical center } appears to have quieted for the night ( they 've been doing trips in the garage by the sound and lights of the car ) .


fn_spacy_tokens_for_baseline: Here children will share and squabble , will make and break friendships .

source_bert_toks: here children will share and sq ##ua ##bble , will make and break friendships .

reference_raw: Here the children share and argue, make and break friendships.

reference_spacy_tokens: Here the children share and argue , make and break friendships .


fn_spacy_tokens_for_baseline: The victim , aged 31 , was attacked by a gang of four men in the pedestrian underpass in Crouch Street , Colchester , at 10.45 pm last Friday .

source_bert_toks: the victim , aged 31 , was attacked by a gang of four men in the pedestrian under ##pass in crouch street , colchester , at 10 . 45 pm last friday .

reference_raw: Last Friday at 10.45 p.m., the victim was attacked by a group of four men in a pedestrian subway in Crouch Street, Colchester.

reference_spacy_tokens: Last Friday at 10.45 p.m. , the victim was attacked by a group of four men in a pedestrian subway in Crouch Street , Colchester .


fn_spacy_tokens_for_baseline: ' God succour you . '

source_bert_toks: ' god su ##cco ##ur you . '

reference_raw: "God bless you."

reference_spacy_tokens: " God bless you . "


fn_spacy_tokens_for_baseline: PENSIONER Frank Marshall escaped electrocution yesterday after his car hit a lamp - post and touched live wires .

source_bert_toks: pension ##er frank marshall escaped electro ##cut ##ion yesterday after his car hit a lamp - post and touched live wires .

reference_raw: Last night, Pensioner Frank Marshall ran away from electrocuting after his car hit the lamppost and touched the live wires.

reference_spacy_tokens: Last night , Pensioner Frank Marshall ran away from electrocuting after his car hit the lamppost and touched the live wires .


fn_spacy_tokens_for_baseline: Printers and typesetting houses have been embracing new methods for the last 15 years or so and now rely entirely upon them .

source_bert_toks: printers and types ##etti ##ng houses have been embracing new methods for the last 15 years or so and now rely entirely upon them .

reference_raw: For the past 15 years or so, printers and type-setting houses have been introducing new methods and are now relying entirely on them.

reference_spacy_tokens: For the past 15 years or so , printers and type - setting houses have been introducing new methods and are now relying entirely on them .


fn_spacy_tokens_for_baseline: In the latest quarter , Aetna had a $ 23 million loss on its auto / homeowners line , compared with earnings of $ 33 million last year .

source_bert_toks: in the latest quarter , ae ##t ##na had a $ 23 million loss on its auto / home ##own ##ers line , compared with earnings of $ 33 million last year .

reference_raw: In the last quarter, Aetna lost $23 million on its auto/homeowner line, compared to a profit of $33 million last year.

reference_spacy_tokens: In the last quarter , Aetna lost $ 23 million on its auto / homeowner line , compared to a profit of $ 33 million last year .


fn_spacy_tokens_for_baseline: That , combined with the formation of the Nevada Gaming Control Board , would signal the beginning of the end for heavy mob influence in the city .

source_bert_toks: that , combined with the formation of the nevada gaming control board , would signal the beginning of the end for heavy mob influence in the city .

reference_raw: This, combined with the creation of the Nevada Gaming Control Board, would signal the start of the end of the city's massive crowd influence.

reference_spacy_tokens: This , combined with the creation of the Nevada Gaming Control Board , would signal the start of the end of the city 's massive crowd influence .


fn_spacy_tokens_for_baseline: The constantly crowded and busy Grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the Irish crafts and souvenirs you expect .

source_bert_toks: the constantly crowded and busy grafton street is the most visible center for shopping , but there are shops all over that carry an international array of goods as well as the irish crafts and so ##uven ##irs you expect .

reference_raw: The ever-crowding and busy Grafton Street is the most visible shopping center, but there are shops everywhere that carry an international range of goods, as well as Ireland's crafts and souvenirs that you expect.

reference_spacy_tokens: The ever - crowding and busy Grafton Street is the most visible shopping center , but there are shops everywhere that carry an international range of goods , as well as Ireland 's crafts and souvenirs that you expect .


fn_spacy_tokens_for_baseline: The military said another helicopter landed and rescued the nine people aboard the Black Hawk .

source_bert_toks: the military said another helicopter landed and rescued the nine people aboard the black hawk .

reference_raw: According to the army, another helicopter hit the ground and rescued nine people on board the Black Hawk.

reference_spacy_tokens: According to the army , another helicopter hit the ground and rescued nine people on board the Black Hawk .


fn_spacy_tokens_for_baseline: It was hard to tell because of the sun glinting on his glasses .

source_bert_toks: it was hard to tell because of the sun glint ##ing on his glasses .

reference_raw: It was hard to tell because the sun was shining on his spectacles.

reference_spacy_tokens: It was hard to tell because the sun was shining on his spectacles .


fn_spacy_tokens_for_baseline: These were similar to the ordinary buskins but extended up beyond the knee : ' They used to flap about as you walked ; but they were whoolly useful in bad weather . '

source_bert_toks: these were similar to the ordinary bus ##kins but extended up beyond the knee : ' they used to flap about as you walked ; but they were who ##oll ##y useful in bad weather . '

reference_raw: They were similar to ordinary skins, but they stretched out behind the knee: 'They used to flap around while you were walking, but they were very useful in bad weather.'

reference_spacy_tokens: They were similar to ordinary skins , but they stretched out behind the knee : ' They used to flap around while you were walking , but they were very useful in bad weather . '


fn_spacy_tokens_for_baseline: The Tang clan 's earliest walled village was Lo Wai , which also has its defensive wall intact and is entered by a narrow gate .

source_bert_toks: the tang clan ' s earliest walled village was lo wai , which also has its defensive wall intact and is entered by a narrow gate .

reference_raw: The first walled village of the Tang clan was Lo Wai, which also had an undamaged defensive wall, and was entered by a narrow gateway.

reference_spacy_tokens: The first walled village of the Tang clan was Lo Wai , which also had an undamaged defensive wall , and was entered by a narrow gateway .


fn_spacy_tokens_for_baseline: However , it is not clear how well North Korea would be able to manufacture large quantities of nerve agents , such as sarin , soman , and VX , without putting a great burden on already limited resources .

source_bert_toks: however , it is not clear how well north korea would be able to manufacture large quantities of nerve agents , such as sar ##in , so ##man , and v ##x , without putting a great burden on already limited resources .

reference_raw: However, it is unclear how well North Korea could produce large quantities of nerve agents, such as sarin, soman, and VX, without imposing a significant burden on already limited resources.

reference_spacy_tokens: However , it is unclear how well North Korea could produce large quantities of nerve agents , such as sarin , soman , and VX , without imposing a significant burden on already limited resources .


fn_spacy_tokens_for_baseline: And there was a man handcuffed to his chair .

source_bert_toks: and there was a man hand ##cu ##ffed to his chair .

reference_raw: And a man was chained to a chair.

reference_spacy_tokens: And a man was chained to a chair .


fn_spacy_tokens_for_baseline: A large man , the executioner , flogged the woman upon her back fifty blows .

source_bert_toks: a large man , the execution ##er , fl ##og ##ged the woman upon her back fifty blows .

reference_raw: The big man, the executioner, whipped the woman on her back fifty times.

reference_spacy_tokens: The big man , the executioner , whipped the woman on her back fifty times .


fn_spacy_tokens_for_baseline: But she was shaking as she poured it , unable to cope with the disorientating events of the evening .

source_bert_toks: but she was shaking as she poured it , unable to cope with the di ##sor ##ient ##ating events of the evening .

reference_raw: But when she poured it, she shuddered, unable to cope with the disorientation of the evening.

reference_spacy_tokens: But when she poured it , she shuddered , unable to cope with the disorientation of the evening .


fn_spacy_tokens_for_baseline: The actual figure for applications in October was 4,400 and the number is likely to reach between 45,000 and 50,000 this year , whereas we used to receive 2,000 or 3,000 applications .

source_bert_toks: the actual figure for applications in october was 4 , 400 and the number is likely to reach between 45 , 000 and 50 , 000 this year , whereas we used to receive 2 , 000 or 3 , 000 applications .

reference_raw: The actual number of applications in October was 4 400 and is likely to be between 45 000 and 50,000 this year, while 2000 or 3 000 applications were received.

reference_spacy_tokens: The actual number of applications in October was 4 400 and is likely to be between 45 000 and 50,000 this year , while 2000 or 3 000 applications were received .


fn_spacy_tokens_for_baseline: ' Rachel Santerre , ' he intoned , ' I arrest you for treason and the most horrible homicides .

source_bert_toks: ' rachel sant ##erre , ' he into ##ned , ' i arrest you for treason and the most horrible homicide ##s .

reference_raw: "Rachel Santerre," he said, "I'm arresting you for treason and the worst murders.

reference_spacy_tokens: " Rachel Santerre , " he said , " I 'm arresting you for treason and the worst murders .


fn_spacy_tokens_for_baseline: The photogenic windmill standing on a knoll at the north - west side of the village is a post mill dating from around 1680 , and is among the oldest in England .

source_bert_toks: the photo ##genic windmill standing on a kn ##oll at the north - west side of the village is a post mill dating from around 1680 , and is among the oldest in england .

reference_raw: The photogenic windmill, which stands on a hill on the northwest side of the village, is a post mill dating back to about 1680 and is one of the oldest in England.

reference_spacy_tokens: The photogenic windmill , which stands on a hill on the northwest side of the village , is a post mill dating back to about 1680 and is one of the oldest in England .


fn_spacy_tokens_for_baseline: It is possible that Offa would have liked Ecgfrith to have been consecrated either by the pope or by the papal legates .

source_bert_toks: it is possible that off ##a would have liked ec ##gf ##rith to have been consecrated either by the pope or by the papal leg ##ates .

reference_raw: It's possible Offa would like Ecgfrith to be sanctified either by the Pope or by the papal legates.

reference_spacy_tokens: It 's possible Offa would like Ecgfrith to be sanctified either by the Pope or by the papal legates .


fn_spacy_tokens_for_baseline: Inside , a series of narrow rooms were filled with lounging aristocrats dressed in silks and satins ablaze with fake jewels .

source_bert_toks: inside , a series of narrow rooms were filled with lou ##nging ari ##sto ##crats dressed in silk ##s and satin ##s ab ##laze with fake jewels .

reference_raw: Inside, a series of narrow rooms were filled with lounging aristocrats, clothed in silken, and satins ablaze with false jewels.

reference_spacy_tokens: Inside , a series of narrow rooms were filled with lounging aristocrats , clothed in silken , and satins ablaze with false jewels .


fn_spacy_tokens_for_baseline: Of course , there are a number of other phenomena , such as lightning and reflections of sunlight off tumbling satellites and orbiting debris , that can also give flashes in the sky .

source_bert_toks: of course , there are a number of other phenomena , such as lightning and reflections of sunlight off tumbling satellites and orbiting debris , that can also give flashes in the sky .

reference_raw: There are, of course, many other phenomena, such as lightning and rays of sunlight from falling satellites and orbiting debris, which can also cause lightning in the sky.

reference_spacy_tokens: There are , of course , many other phenomena , such as lightning and rays of sunlight from falling satellites and orbiting debris , which can also cause lightning in the sky .


fn_spacy_tokens_for_baseline: In telling me that , until my confirmation , my godparents were , by proxy , responsible for my sins , merely drove me to keep it that way .

source_bert_toks: in telling me that , until my confirmation , my god ##par ##ents were , by proxy , responsible for my sins , merely drove me to keep it that way .

reference_raw: By telling me that until I confirmed that my godfathers were, by proxy, responsible for my sins, only drove me to keep it that way.

reference_spacy_tokens: By telling me that until I confirmed that my godfathers were , by proxy , responsible for my sins , only drove me to keep it that way .


fn_spacy_tokens_for_baseline: The grasses are woven together with cotton to form a mat , which is then bonded on to a paper backing .

source_bert_toks: the grasses are woven together with cotton to form a mat , which is then bonded on to a paper backing .

reference_raw: The grass is woven together with cotton to form a mat, which is then attached to a paper backing.

reference_spacy_tokens: The grass is woven together with cotton to form a mat , which is then attached to a paper backing .


fn_spacy_tokens_for_baseline: Once all nine barrels have been discharged the weapon is of no further use , although hopefully it will have done its job by this time , and your enemies will be running for the hills .

source_bert_toks: once all nine barrels have been discharged the weapon is of no further use , although hopefully it will have done its job by this time , and your enemies will be running for the hills .

reference_raw: Once all nine barrels are released, the weapon will be useless, though I hope it will do its job by now, and your enemies will run for the hills.

reference_spacy_tokens: Once all nine barrels are released , the weapon will be useless , though I hope it will do its job by now , and your enemies will run for the hills .


fn_spacy_tokens_for_baseline: He was more than prepared to trade blows with the former circus act Benichou .

source_bert_toks: he was more than prepared to trade blows with the former circus act ben ##ich ##ou .

reference_raw: He was more than ready to exchange blows with the former Benichou circus act.

reference_spacy_tokens: He was more than ready to exchange blows with the former Benichou circus act .


fn_spacy_tokens_for_baseline: A blue powder was dusted inside the jodhpur - like underwear .

source_bert_toks: a blue powder was dust ##ed inside the jo ##dh ##pur - like underwear .

reference_raw: In his jodhpur-like underwear was a blue powder.

reference_spacy_tokens: In his jodhpur - like underwear was a blue powder .


fn_spacy_tokens_for_baseline: " You little fellow , you . you lovely baby , " he warbled idiotically .

source_bert_toks: " you little fellow , you . you lovely baby , " he war ##bled idiot ##ically .

reference_raw: "You little boy, you... you beautiful child," he said idiotically.

reference_spacy_tokens: " You little boy , you ... you beautiful child , " he said idiotically .


fn_spacy_tokens_for_baseline: Building upon the foundations established during the war , Iran 's missile and long - range artillery rocket programs were reorganized during the late 1980s and have developed along two broad paths -- solid - fueled and liquid - fueled systems .

source_bert_toks: building upon the foundations established during the war , iran ' s missile and long - range artillery rocket programs were reorganized during the late 1980s and have developed along two broad paths - - solid - fueled and liquid - fueled systems .

reference_raw: On the basis of the foundations established during the war, Iran's missile and long-range artillery rocket programs were reorganized in the late 1980s and developed on two broad paths - solid-fuelled and fluid-fuelled systems.

reference_spacy_tokens: On the basis of the foundations established during the war , Iran 's missile and long - range artillery rocket programs were reorganized in the late 1980s and developed on two broad paths - solid - fuelled and fluid - fuelled systems .


fn_spacy_tokens_for_baseline: Later , however , it was revealed that another post - mortem discovered 14 different drugs in Presley 's body -- including codeine , three sedatives , five varieties of ' downers ' , two anti - depressants and a decongestant .

source_bert_toks: later , however , it was revealed that another post - mort ##em discovered 14 different drugs in presley ' s body - - including code ##ine , three se ##da ##tive ##s , five varieties of ' down ##ers ' , two anti - de ##press ##ants and a deco ##nge ##stan ##t .

reference_raw: But later it was discovered that another autopsy found 14 different drugs in Presley's body, including codein, three sedatives, five varieties of "downers", two antidepressants, and a decongestant.

reference_spacy_tokens: But later it was discovered that another autopsy found 14 different drugs in Presley 's body , including codein , three sedatives , five varieties of " downers " , two antidepressants , and a decongestant .


fn_spacy_tokens_for_baseline: Middle East Defense News reports that AKU has been used as a front company to purchase the following equipment from the United States : computers , Unix software , and training from NCR , Apple Computer , and Sun Microsystems , and neutron - shielding from Reactor Experiments , Inc. None of these technologies appears to be directly related to biological weapons .

source_bert_toks: middle east defense news reports that ak ##u has been used as a front company to purchase the following equipment from the united states : computers , unix software , and training from nc ##r , apple computer , and sun micro ##systems , and neutron - shielding from reactor experiments , inc . none of these technologies appears to be directly related to biological weapons .

reference_raw: The Middle East Defense News reports that AKU was used as a lead company to purchase the following equipment from the United States: computers, Unix software, and training from NCR, Apple Computer, Sun Microsystems, and neutron-protection from reactor experiments, Inc. None of these technologies appear to be directly related to biological weapons.

reference_spacy_tokens: The Middle East Defense News reports that AKU was used as a lead company to purchase the following equipment from the United States : computers , Unix software , and training from NCR , Apple Computer , Sun Microsystems , and neutron - protection from reactor experiments , Inc. None of these technologies appear to be directly related to biological weapons .


fn_spacy_tokens_for_baseline: On the whole , it seems unlikely that Knossos ' territory extended only half - way to Arkhanes , only 8 kilometres to the south of Knossos .

source_bert_toks: on the whole , it seems unlikely that kn ##oss ##os ' territory extended only half - way to ark ##hane ##s , only 8 kilometres to the south of kn ##oss ##os .

reference_raw: On the whole, it seems unlikely that Knossos's territory extends only half the way to Arkhanes, only eight kilometers north of Knossos.

reference_spacy_tokens: On the whole , it seems unlikely that Knossos 's territory extends only half the way to Arkhanes , only eight kilometers north of Knossos .


fn_spacy_tokens_for_baseline: The volcanic nature of the Aeolian islands benefits the visitor by warming the local waters to ideal bathing temperatures and the clear blue waters are superb for underwater swimming .

source_bert_toks: the volcanic nature of the ae ##oli ##an islands benefits the visitor by warming the local waters to ideal bathing temperatures and the clear blue waters are superb for underwater swimming .

reference_raw: The volcanic nature of the Aeolian islands benefits visitors by warming the local waters to ideal bathing temperatures, and clear blue waters are excellent for underwater swimming.

reference_spacy_tokens: The volcanic nature of the Aeolian islands benefits visitors by warming the local waters to ideal bathing temperatures , and clear blue waters are excellent for underwater swimming .


fn_spacy_tokens_for_baseline: The cost of the welfare system has skyrocketed : spending on all federal programmes more than tripled between 1965 and 1987 , from $ 141 billion to $ 520 billion ( in 1988 dollars ) .

source_bert_toks: the cost of the welfare system has sky ##rock ##ete ##d : spending on all federal programmes more than triple ##d between 1965 and 1987 , from $ 141 billion to $ 520 billion ( in 1988 dollars ) .

reference_raw: The cost of the social security system has increased: expenditure on all federal programs has more than tripled between 1965 and 1987, from $141 billion to $520 billion (in 1988).

reference_spacy_tokens: The cost of the social security system has increased : expenditure on all federal programs has more than tripled between 1965 and 1987 , from $ 141 billion to $ 520 billion ( in 1988 ) .


fn_spacy_tokens_for_baseline: ( Lily gossips some with her sister , an annoyingly perky single creature , but goes on and on about her fears of dating with her daughters ; Rick mostly keeps things to himself , but is interrogated by curious children . )

source_bert_toks: ( lily gossip ##s some with her sister , an annoying ##ly per ##ky single creature , but goes on and on about her fears of dating with her daughters ; rick mostly keeps things to himself , but is inter ##rogated by curious children . )

reference_raw: (Lilly talks some of it to her sister, an annoyingly perky single creature, but goes on and on about her fear of dating her daughters; Rick tends to keep things to himself, but is questioned by strange children.)

reference_spacy_tokens: ( Lilly talks some of it to her sister , an annoyingly perky single creature , but goes on and on about her fear of dating her daughters ; Rick tends to keep things to himself , but is questioned by strange children . )


fn_spacy_tokens_for_baseline: In June 2009 , another purported audio message took aim at President Obama .

source_bert_toks: in june 2009 , another purported audio message took aim at president obama .

reference_raw: In June 2009, another alleged audio message was directed at President Obama.

reference_spacy_tokens: In June 2009 , another alleged audio message was directed at President Obama .


fn_spacy_tokens_for_baseline: More relevant measurements for these factors include the proportional change in the number of publications and the total number of publications when corrected for investment in research and development ( May 1997 ) .

source_bert_toks: more relevant measurements for these factors include the proportional change in the number of publications and the total number of publications when corrected for investment in research and development ( may 1997 ) .

reference_raw: The more relevant measurements for these elements include a proportional change in the number of publications and the total number of publications corrected for R&D investments (May 1997).

reference_spacy_tokens: The more relevant measurements for these elements include a proportional change in the number of publications and the total number of publications corrected for R&D investments ( May 1997 ) .


fn_spacy_tokens_for_baseline: She had left the two of them to duel , not even acting as referee , waiting for them to tire , perhaps even to appeal to her .

source_bert_toks: she had left the two of them to duel , not even acting as referee , waiting for them to tire , perhaps even to appeal to her .

reference_raw: She left them to fight, not even to act as a referee, waiting for them to tire, perhaps even to appeal to her.

reference_spacy_tokens: She left them to fight , not even to act as a referee , waiting for them to tire , perhaps even to appeal to her .


fn_spacy_tokens_for_baseline: Squawking madly in what appeared to be a family squabble over the direction they should take , they suddenly closed ranks , as if by order , and formed a perfect vee behind their leader .

source_bert_toks: sq ##ua ##wk ##ing madly in what appeared to be a family sq ##ua ##bble over the direction they should take , they suddenly closed ranks , as if by order , and formed a perfect ve ##e behind their leader .

reference_raw: They squealed madly in what appeared to be a family squabbling in the direction they were supposed to take, and suddenly, as if by order, they closed the ranks and formed a perfect vee behind their leader.

reference_spacy_tokens: They squealed madly in what appeared to be a family squabbling in the direction they were supposed to take , and suddenly , as if by order , they closed the ranks and formed a perfect vee behind their leader .


fn_spacy_tokens_for_baseline: A snood is like a hairband with a net attached to it .

source_bert_toks: a s ##no ##od is like a hair ##band with a net attached to it .

reference_raw: It's like a hairband with a net attached to it.

reference_spacy_tokens: It 's like a hairband with a net attached to it .


fn_spacy_tokens_for_baseline: Yes , sir , my own views are very different . '

source_bert_toks: yes , sir , my own views are very different . '

reference_raw: Yes, sir, I have a very different opinion.'

reference_spacy_tokens: Yes , sir , I have a very different opinion . '


fn_spacy_tokens_for_baseline: The patrol should be armed with light weapon such as Kalashnikovs and RPGs , and cover the area on foot .

source_bert_toks: the patrol should be armed with light weapon such as kala ##sh ##nikov ##s and rpg ##s , and cover the area on foot .

reference_raw: The patrol should be armed with a small weapon like the Kalashnikovs and the RPGs and cover the area on foot.

reference_spacy_tokens: The patrol should be armed with a small weapon like the Kalashnikovs and the RPGs and cover the area on foot .


fn_spacy_tokens_for_baseline: Man shuffled along over the cold floors , some dressed in grey prison - issue pyjamas , others bare - chested or in boxer shorts .

source_bert_toks: man shuffled along over the cold floors , some dressed in grey prison - issue p ##y ##ja ##mas , others bare - chest ##ed or in boxer shorts .

reference_raw: A man shuffled across the cold floors, some wearing gray prison-issue pajamas, some wearing bare chests or boxer shorts.

reference_spacy_tokens: A man shuffled across the cold floors , some wearing gray prison - issue pajamas , some wearing bare chests or boxer shorts .


fn_spacy_tokens_for_baseline: They wish NATO troops would help them flush out Kadafi 's fighters and destroy the antiaircraft guns , mortars and artillery that hammer Misurata .

source_bert_toks: they wish nato troops would help them flush out ka ##da ##fi ' s fighters and destroy the anti ##air ##craft guns , mortar ##s and artillery that hammer mis ##ura ##ta .

reference_raw: They want NATO troops to help them destroy Kadafi's fighters and destroy the anti-aircraft weapons, mortars, and artillery that hammer Misurata.

reference_spacy_tokens: They want NATO troops to help them destroy Kadafi 's fighters and destroy the anti - aircraft weapons , mortars , and artillery that hammer Misurata .


fn_spacy_tokens_for_baseline: Despite their differences it seemed likely that if no result was reported by 31 January the AFPFL and Communists would both revolt .

source_bert_toks: despite their differences it seemed likely that if no result was reported by 31 january the af ##pf ##l and communists would both revolt .

reference_raw: Despite their differences, it seemed likely that the AFPFL and the Communists would rebel if the results were not reported by 31 January.

reference_spacy_tokens: Despite their differences , it seemed likely that the AFPFL and the Communists would rebel if the results were not reported by 31 January .


fn_spacy_tokens_for_baseline: It hopes to speak to students at theological colleges about the joys of bell ringing and will shortly publish a booklet for every vicar in the country entitled , " The Bells in Your Care .

source_bert_toks: it hopes to speak to students at theological colleges about the joy ##s of bell ringing and will shortly publish a booklet for every vicar in the country entitled , " the bells in your care .

reference_raw: He hopes to talk to the students of theology schools about the joys of ringing bells and will soon publish a brochure for every vicar in the country entitled "Bells in Your Care."

reference_spacy_tokens: He hopes to talk to the students of theology schools about the joys of ringing bells and will soon publish a brochure for every vicar in the country entitled " Bells in Your Care . "


fn_spacy_tokens_for_baseline: The unclothed body is not a ' self but a socialised body , a body that is opened by instruments , technologized , wounded , its organs displayed to the outside world .

source_bert_toks: the un ##cloth ##ed body is not a ' self but a social ##ised body , a body that is opened by instruments , techno ##log ##ized , wounded , its organs displayed to the outside world .

reference_raw: The undressed body is not itself, but a socialized body, a body that opens with tools, technologists, wounded, its organs exposed to the outside world.

reference_spacy_tokens: The undressed body is not itself , but a socialized body , a body that opens with tools , technologists , wounded , its organs exposed to the outside world .


fn_spacy_tokens_for_baseline: They also wore the helmet , like the similarly attired British Transport Police at the main railway station ( who are also despised as police marginals ) .

source_bert_toks: they also wore the helmet , like the similarly attire ##d british transport police at the main railway station ( who are also despised as police marginal ##s ) .

reference_raw: They also wore a helmet, like the similarly dressed British transport police at the main railway station (who are also despised as police marginals).

reference_spacy_tokens: They also wore a helmet , like the similarly dressed British transport police at the main railway station ( who are also despised as police marginals ) .


fn_spacy_tokens_for_baseline: Like Hong Kong , Macau is a duty - free port .

source_bert_toks: like hong kong , macau is a duty - free port .

reference_raw: Like Hong Kong, Macao is a duty-free harbor.

reference_spacy_tokens: Like Hong Kong , Macao is a duty - free harbor .


fn_spacy_tokens_for_baseline: To conform with most Government economic statistics , the scope of the survey is defined by the Standard Industrial Classification definition of manufacturing .

source_bert_toks: to conform with most government economic statistics , the scope of the survey is defined by the standard industrial classification definition of manufacturing .

reference_raw: In order to be consistent with most of the government's economic statistics, the scale of the survey is defined in the standard definition of industrial classification of production.

reference_spacy_tokens: In order to be consistent with most of the government 's economic statistics , the scale of the survey is defined in the standard definition of industrial classification of production .


fn_spacy_tokens_for_baseline: Finances were riding along the crest of a slump and I lived in a one - room penthouse in Bakers Arms , Leyton ( on top of the opticians ) .

source_bert_toks: finances were riding along the crest of a slump and i lived in a one - room penthouse in baker ##s arms , ley ##ton ( on top of the optic ##ians ) .

reference_raw: The money went up the slope, and I was living in a one-room apartment in Bakers Arms, Leyton (atop the opticians).

reference_spacy_tokens: The money went up the slope , and I was living in a one - room apartment in Bakers Arms , Leyton ( atop the opticians ) .


fn_spacy_tokens_for_baseline: One look at the dramatic bays and steep - sided cracks in the rock cloaked in shrubs and plants shows why .

source_bert_toks: one look at the dramatic bays and steep - sided cracks in the rock cloak ##ed in shrubs and plants shows why .

reference_raw: One look at the dramatic bays and steep-sided cracks in a rock covered with bushes and plants shows why.

reference_spacy_tokens: One look at the dramatic bays and steep - sided cracks in a rock covered with bushes and plants shows why .


fn_spacy_tokens_for_baseline: Angela Drake will be moving to California with her husband , where she has accepted a full - time position with the San Diego Public Library .

source_bert_toks: angela drake will be moving to california with her husband , where she has accepted a full - time position with the san diego public library .

reference_raw: Angela Drake is moving to California with her husband, where she's taken a full-time position in the public library in San Diego.

reference_spacy_tokens: Angela Drake is moving to California with her husband , where she 's taken a full - time position in the public library in San Diego .


fn_spacy_tokens_for_baseline: He did not go as far as he could have in tax reductions ; indeed he combined them with increases in indirect taxes .

source_bert_toks: he did not go as far as he could have in tax reductions ; indeed he combined them with increases in indirect taxes .

reference_raw: He didn't go as far as he could in terms of tax cuts; in fact, he combined them with an increase in indirect taxes.

reference_spacy_tokens: He did n't go as far as he could in terms of tax cuts ; in fact , he combined them with an increase in indirect taxes .


fn_spacy_tokens_for_baseline: The dogs snarled and cowered about his ankles .

source_bert_toks: the dogs snarled and cow ##ered about his ankles .

reference_raw: Dogs growled and crouched around his ankles.

reference_spacy_tokens: Dogs growled and crouched around his ankles .


fn_spacy_tokens_for_baseline: The people seemed friendly to him as if he often went there .

source_bert_toks: the people seemed friendly to him as if he often went there .

reference_raw: People seemed amiable to him, as if he'd been there a lot.

reference_spacy_tokens: People seemed amiable to him , as if he 'd been there a lot .


fn_spacy_tokens_for_baseline: Mrs Baggley examined the disbelief in Theodora 's eye before she went on , ' I 'm not sure how much Mrs Thrigg is influenced here by the theme of the novelettes she devours .

source_bert_toks: mrs bag ##gley examined the disbelief in theodor ##a ' s eye before she went on , ' i ' m not sure how much mrs th ##ri ##gg is influenced here by the theme of the novel ##ettes she dev ##ours .

reference_raw: Mrs. Baggley examined the incredulity in Theodora's eyes before continuing, "I don't know how much Mrs. Thrigg is affected by the subject of the novels she eats.

reference_spacy_tokens: Mrs. Baggley examined the incredulity in Theodora 's eyes before continuing , " I do n't know how much Mrs. Thrigg is affected by the subject of the novels she eats .


fn_spacy_tokens_for_baseline: " Something about your face makes me want to tell the truth . "

source_bert_toks: " something about your face makes me want to tell the truth . "

reference_raw: "There's something about your face that makes me want to be honest."

reference_spacy_tokens: " There 's something about your face that makes me want to be honest . "


fn_spacy_tokens_for_baseline: The Millwall brick , for example , was a newspaper folded again and again and squashed together to form a cosh .

source_bert_toks: the mill ##wall brick , for example , was a newspaper folded again and again and squash ##ed together to form a co ##sh .

reference_raw: The Millwall brick, for example, was a newspaper folded over and over and crushed together to make money.

reference_spacy_tokens: The Millwall brick , for example , was a newspaper folded over and over and crushed together to make money .


fn_spacy_tokens_for_baseline: You can also take a ferry to Macau to find an entirely different kind of city , a unique blend of Chinese and Iberian culture .

source_bert_toks: you can also take a ferry to macau to find an entirely different kind of city , a unique blend of chinese and iberian culture .

reference_raw: You can also take the ferry to Macao to find a completely different kind of town, an extraordinary mixture of Chinese and Iberian cultures.

reference_spacy_tokens: You can also take the ferry to Macao to find a completely different kind of town , an extraordinary mixture of Chinese and Iberian cultures .


fn_spacy_tokens_for_baseline: The village of Coloane is picturesque , with a central square lined with cafes .

source_bert_toks: the village of col ##oa ##ne is picturesque , with a central square lined with cafes .

reference_raw: Coloane's village is quaint, with a center square lined with coffee shops.

reference_spacy_tokens: Coloane 's village is quaint , with a center square lined with coffee shops .


fn_spacy_tokens_for_baseline: Proponents of this school often argue that North Korea 's nuclear motivations are defensive in nature and designed to deter external threats to the DPRK .

source_bert_toks: proponents of this school often argue that north korea ' s nuclear motivation ##s are defensive in nature and designed to deter external threats to the d ##pr ##k .

reference_raw: Proponents of this school often argue that North Korea's nuclear motives are self-defense and are designed to discourage external threats to the DPRK.

reference_spacy_tokens: Proponents of this school often argue that North Korea 's nuclear motives are self - defense and are designed to discourage external threats to the DPRK .


fn_spacy_tokens_for_baseline: Almost four million people in England and Wales were summonsed in the first half of this year for failing to pay .

source_bert_toks: almost four million people in england and wales were summons ##ed in the first half of this year for failing to pay .

reference_raw: In the first half of this year, nearly four million people were called to England and Wales for not paying.

reference_spacy_tokens: In the first half of this year , nearly four million people were called to England and Wales for not paying .


fn_spacy_tokens_for_baseline: It is not clear , however , if this amount includes the munitions or only the CW agents themselves .

source_bert_toks: it is not clear , however , if this amount includes the munitions or only the cw agents themselves .

reference_raw: However, it is unclear whether that amount includes ammunition or only CW agents themselves.

reference_spacy_tokens: However , it is unclear whether that amount includes ammunition or only CW agents themselves .


fn_spacy_tokens_for_baseline: A correspondent for the Reuters news agency described a scene of desolation , reporting that the city 's streets had been strewn with rotting corpses .

source_bert_toks: a correspondent for the reuters news agency described a scene of des ##ola ##tion , reporting that the city ' s streets had been strewn with rotting corpses .

reference_raw: The Reuters News Agency correspondent described the scene of desolation and reported that the streets of the city were littered with rotting corpses.

reference_spacy_tokens: The Reuters News Agency correspondent described the scene of desolation and reported that the streets of the city were littered with rotting corpses .


fn_spacy_tokens_for_baseline: Outside Athelstan could hear him shouting orders , the sound of running feet and the clash of arms .

source_bert_toks: outside at ##hel ##stan could hear him shouting orders , the sound of running feet and the clash of arms .

reference_raw: Outside Athelstan heard him shouting orders, the sound of running feet and the clattering of arms.

reference_spacy_tokens: Outside Athelstan heard him shouting orders , the sound of running feet and the clattering of arms .


fn_spacy_tokens_for_baseline: Fenn declined the offer to buy with a bemused wave of his hand .

source_bert_toks: fen ##n declined the offer to buy with a be ##mus ##ed wave of his hand .

reference_raw: Fenn refused to buy with a bemused wave of his hand.

reference_spacy_tokens: Fenn refused to buy with a bemused wave of his hand .


fn_spacy_tokens_for_baseline: Little Amaru looked down at the street and kicked a can with his red gumboots .

source_bert_toks: little amar ##u looked down at the street and kicked a can with his red gum ##boot ##s .

reference_raw: Little Amaru looked down the street and kicked a can with his red rubber boots.

reference_spacy_tokens: Little Amaru looked down the street and kicked a can with his red rubber boots .


fn_spacy_tokens_for_baseline: Jamaicans are sociable people , living their lives out in the open and knowing everything about their neighbor business .

source_bert_toks: jamaican ##s are soc ##iable people , living their lives out in the open and knowing everything about their neighbor business .

reference_raw: Jamaicans are social people who live their lives in public and know everything about their neighbours' business.

reference_spacy_tokens: Jamaicans are social people who live their lives in public and know everything about their neighbours ' business .


fn_spacy_tokens_for_baseline: At once regretting that she had let herself become riled , she delved into her bag and came out with a bar of soap .

source_bert_toks: at once regret ##ting that she had let herself become ri ##led , she del ##ved into her bag and came out with a bar of soap .

reference_raw: Instantly, regretting that she had allowed herself to rindle, she plunged into her bag and came out with a bar of soap.

reference_spacy_tokens: Instantly , regretting that she had allowed herself to rindle , she plunged into her bag and came out with a bar of soap .


fn_spacy_tokens_for_baseline: The island communities were undecided about which side to back for a time .

source_bert_toks: the island communities were und ##ec ##ided about which side to back for a time .

reference_raw: The island communities haven't decided which side to support for a while.

reference_spacy_tokens: The island communities have n't decided which side to support for a while .


fn_spacy_tokens_for_baseline: The acolyte Rizla walks before , swinging a lighted censer .

source_bert_toks: the ac ##ol ##yte ri ##z ##la walks before , swinging a lighted ce ##nse ##r .

reference_raw: Rizla's acolyte walked earlier, swinging a lighted censor.

reference_spacy_tokens: Rizla 's acolyte walked earlier , swinging a lighted censor .


fn_spacy_tokens_for_baseline: Sex , when properly understood , is one of the greatest human pleasures , and I have never seen why the older generation should be so niggardly about passing on the information .

source_bert_toks: sex , when properly understood , is one of the greatest human pleasures , and i have never seen why the older generation should be so ni ##gga ##rd ##ly about passing on the information .

reference_raw: Sex, if properly understood, is one of the greatest human pleasures, and I've never seen why an older generation should be so nigger about passing on information.

reference_spacy_tokens: Sex , if properly understood , is one of the greatest human pleasures , and I 've never seen why an older generation should be so nigger about passing on information .


fn_spacy_tokens_for_baseline: During World War II , the church was turned into a club for Japanese officers ; it was restored after the war .

source_bert_toks: during world war ii , the church was turned into a club for japanese officers ; it was restored after the war .

reference_raw: During the Second World War, the church became a club for Japan's officers; it was re-established after the war.

reference_spacy_tokens: During the Second World War , the church became a club for Japan 's officers ; it was re - established after the war .


fn_spacy_tokens_for_baseline: Wherever Defoe passed a house he found a little rill of running water .

source_bert_toks: wherever def ##oe passed a house he found a little ri ##ll of running water .

reference_raw: Wherever Defoe passed the house, he found a small stream of running water.

reference_spacy_tokens: Wherever Defoe passed the house , he found a small stream of running water .


fn_spacy_tokens_for_baseline: He burst into a loud peal of laughter , the Irishman grinned sheepishly and I giggled .

source_bert_toks: he burst into a loud pea ##l of laughter , the irish ##man grinned sheep ##ishly and i giggled .

reference_raw: He burst into a loud peal of laughter, and the Irishman smiled sheepishly, and I laughed.

reference_spacy_tokens: He burst into a loud peal of laughter , and the Irishman smiled sheepishly , and I laughed .


fn_spacy_tokens_for_baseline: In December 2002 , an Italian newspaper cited an Iraqi officer who asserted that Syria had allowed Iraq to store its weapons of mass destruction in Syria research centers .

source_bert_toks: in december 2002 , an italian newspaper cited an iraqi officer who asserted that syria had allowed iraq to store its weapons of mass destruction in syria research centers .

reference_raw: In November 2002, an Italian newspaper cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres.

reference_spacy_tokens: In November 2002 , an Italian newspaper cited an Iraqi officer claiming that Syria allowed Iraq to store its weapons of mass destruction in Syrian research centres .


fn_spacy_tokens_for_baseline: Several coloured patches were sewn neatly round the seat of his pants .

source_bert_toks: several coloured patches were se ##wn neatly round the seat of his pants .

reference_raw: A few colored patches had been neatly sewn around the chair of his trousers.

reference_spacy_tokens: A few colored patches had been neatly sewn around the chair of his trousers .


fn_spacy_tokens_for_baseline: Jim 's and Alfred 's friendly monickers .

source_bert_toks: jim ' s and alfred ' s friendly mon ##ick ##ers .

reference_raw: The friendly monks of Jim and Alfred.

reference_spacy_tokens: The friendly monks of Jim and Alfred .


fn_spacy_tokens_for_baseline: The fact that he is capable of making discs of superlative quality is also in no doubt , as this stunning new Stravinsky disc strikingly bears out .

source_bert_toks: the fact that he is capable of making discs of super ##lative quality is also in no doubt , as this stunning new st ##ra ##vinsky disc striking ##ly bears out .

reference_raw: There is no doubt that it is capable of producing super-lative disks, as this stunning new Stravinsky disc is strikingly bearable.

reference_spacy_tokens: There is no doubt that it is capable of producing super - lative disks , as this stunning new Stravinsky disc is strikingly bearable .


fn_spacy_tokens_for_baseline: All poor Clinton was doing was trying to " struggle with the gummy , vexed exigencies of the merely human . "

source_bert_toks: all poor clinton was doing was trying to " struggle with the gum ##my , ve ##xed ex ##igen ##cies of the merely human . "

reference_raw: All that crappy Clinton was trying to do was try to "struggle with the gummy, vexed exigencies of a single man."

reference_spacy_tokens: All that crappy Clinton was trying to do was try to " struggle with the gummy , vexed exigencies of a single man . "


fn_spacy_tokens_for_baseline: It had been just after Christmas ; she had worn a new pair of fur mittens her sister had given her .

source_bert_toks: it had been just after christmas ; she had worn a new pair of fur mit ##tens her sister had given her .

reference_raw: It was just after Christmas; she was wearing a new pair of fur gloves her sister had given her.

reference_spacy_tokens: It was just after Christmas ; she was wearing a new pair of fur gloves her sister had given her .


fn_spacy_tokens_for_baseline: Many moths , like the eyed hawkmoth , have a dramatic pair of eye - spots on their hind wings .

source_bert_toks: many moths , like the eyed hawk ##mot ##h , have a dramatic pair of eye - spots on their hind wings .

reference_raw: Many moths, like a hawk moth, have a dramatic pair of eye spots on their rear wings.

reference_spacy_tokens: Many moths , like a hawk moth , have a dramatic pair of eye spots on their rear wings .


fn_spacy_tokens_for_baseline: Currently , twenty - two percent of the blaze is contained , rising from only five percent as little as a day ago .

source_bert_toks: currently , twenty - two percent of the blaze is contained , rising from only five percent as little as a day ago .

reference_raw: At the moment, twenty-two percent of the fire is contained, rising from only five percent to less than a day ago.

reference_spacy_tokens: At the moment , twenty - two percent of the fire is contained , rising from only five percent to less than a day ago .


fn_spacy_tokens_for_baseline: The stage Englishman wore a pink silk shirt and a lime polka - dot bow - tie .

source_bert_toks: the stage englishman wore a pink silk shirt and a lime polka - dot bow - tie .

reference_raw: The stage Englishman was wearing a pink silk shirt and a lime dot bow tie.

reference_spacy_tokens: The stage Englishman was wearing a pink silk shirt and a lime dot bow tie .


fn_spacy_tokens_for_baseline: He went into the sacristy , removed his alb and carefully folded his violet stole .

source_bert_toks: he went into the sac ##rist ##y , removed his al ##b and carefully folded his violet stole .

reference_raw: He went to the sacristy, removed his alba and carefully folded the purple he had stolen.

reference_spacy_tokens: He went to the sacristy , removed his alba and carefully folded the purple he had stolen .


fn_spacy_tokens_for_baseline: Mr Spence , of Brunel Way , Darlington , County Durham denies threatening to kill his wife , having an imitation firearm and causing an affray .

source_bert_toks: mr spence , of br ##une ##l way , darlington , county durham denies threatening to kill his wife , having an imitation firearm and causing an af ##fra ##y .

reference_raw: Mr. Spence, from Brunel Way, Darlington, County Durham, denies threatening to kill his wife with a fake gun and causing an attack.

reference_spacy_tokens: Mr. Spence , from Brunel Way , Darlington , County Durham , denies threatening to kill his wife with a fake gun and causing an attack .


fn_spacy_tokens_for_baseline: Conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

source_bert_toks: conversely , there are the majority of unsuccessful schools , and we know which efforts at educational reform are doomed beforehand .

reference_raw: On the other hand, most failed schools exist, and we know which attempts to re-form education are lost in advance.

reference_spacy_tokens: On the other hand , most failed schools exist , and we know which attempts to re - form education are lost in advance .


fn_spacy_tokens_for_baseline: But Feathers was to split when Hermione Farthingale decided she did not wish to continue with the group .

source_bert_toks: but feathers was to split when her ##mi ##one far ##thing ##ale decided she did not wish to continue with the group .

reference_raw: But Feathers was about to break up when Hermione Farthingale decided she didn't want to go on with the group.

reference_spacy_tokens: But Feathers was about to break up when Hermione Farthingale decided she did n't want to go on with the group .


fn_spacy_tokens_for_baseline: When police arrived they found two Englishmen who seemed to be shocked victims of an armed hold - up , said James Curtis , prosecuting .

source_bert_toks: when police arrived they found two english ##men who seemed to be shocked victims of an armed hold - up , said james curtis , prose ##cuting .

reference_raw: When the police arrived, they found two Englishmen who appeared to be shocked victims of an armed robbery, said James Curtis.

reference_spacy_tokens: When the police arrived , they found two Englishmen who appeared to be shocked victims of an armed robbery , said James Curtis .


fn_spacy_tokens_for_baseline: The province 's security forces have often found themselves embroiled in Kirkuk 's Arab - Kurdish controversies .

source_bert_toks: the province ' s security forces have often found themselves em ##bro ##iled in kirk ##uk ' s arab - kurdish controversies .

reference_raw: Provincial security forces often found themselves involved in Kirkuk's Arab-Kurdish controversy.

reference_spacy_tokens: Provincial security forces often found themselves involved in Kirkuk 's Arab - Kurdish controversy .


fn_spacy_tokens_for_baseline: The symptoms disappeared quite rapidly and never returned .

source_bert_toks: the symptoms disappeared quite rapidly and never returned .

reference_raw: Symptoms were gone pretty fast and never came back.

reference_spacy_tokens: Symptoms were gone pretty fast and never came back .


fn_spacy_tokens_for_baseline: There was some speculation by the estimable political correspondent , John Cole , ( brought back by the BBC for the conference ) about the role Lady Thatcher might play .

source_bert_toks: there was some speculation by the est ##ima ##ble political correspondent , john cole , ( brought back by the bbc for the conference ) about the role lady thatcher might play .

reference_raw: The estimate political correspondent John Cole (brought to a conference by the BBC) was speculating on the role Lady Thatcher could play.

reference_spacy_tokens: The estimate political correspondent John Cole ( brought to a conference by the BBC ) was speculating on the role Lady Thatcher could play .


fn_spacy_tokens_for_baseline: Derek Johns of Sheffield writes in to say that a company that has a rare new species named after it could find its share price sensitive to any environmental news .

source_bert_toks: derek johns of sheffield writes in to say that a company that has a rare new species named after it could find its share price sensitive to any environmental news .

reference_raw: Derek Johns from Sheffield says that a company with a rare new species named after it may find its share price sensitive to any environmental news.

reference_spacy_tokens: Derek Johns from Sheffield says that a company with a rare new species named after it may find its share price sensitive to any environmental news .


fn_spacy_tokens_for_baseline: It goes without saying that such developments demand fundamental changes of attitude on behalf of drivers .

source_bert_toks: it goes without saying that such developments demand fundamental changes of attitude on behalf of drivers .

reference_raw: It goes without saying that such developments require fundamental changes in the attitude of drivers.

reference_spacy_tokens: It goes without saying that such developments require fundamental changes in the attitude of drivers .


fn_spacy_tokens_for_baseline: The CPR carried 3.9 million bushels of grain in 1882 ; 7.8 million bushels in 1885 ; 29.3 million bushels in 1892 ; 42.8 million at the end of the century ; and 175.5 million in 1921 .

source_bert_toks: the cp ##r carried 3 . 9 million bush ##els of grain in 1882 ; 7 . 8 million bush ##els in 1885 ; 29 . 3 million bush ##els in 1892 ; 42 . 8 million at the end of the century ; and 175 . 5 million in 1921 .

reference_raw: In 1882, the CPR carried 3.9 million grain bushes, 7.8 million bushes in 1885, 29.3 million bushes in 1892, 42.8 million at the end of the century, and 175.5 million in 1921.

reference_spacy_tokens: In 1882 , the CPR carried 3.9 million grain bushes , 7.8 million bushes in 1885 , 29.3 million bushes in 1892 , 42.8 million at the end of the century , and 175.5 million in 1921 .


fn_spacy_tokens_for_baseline: The hip and femur bones were fused together and no movement was possible at that joint .

source_bert_toks: the hip and fe ##mur bones were fused together and no movement was possible at that joint .

reference_raw: The hip and femur bones were melted together, and there was no movement in the joint.

reference_spacy_tokens: The hip and femur bones were melted together , and there was no movement in the joint .


fn_spacy_tokens_for_baseline: This means that Iran will place the Natanz facility , and any enriched uranium it produces , under IAEA inspection but that , as long as no nuclear materials are present , the IAEA would have no ability to examine locations in Iran where it believed nuclear weapons design research might be under way .

source_bert_toks: this means that iran will place the nat ##an ##z facility , and any enriched uranium it produces , under ia ##ea inspection but that , as long as no nuclear materials are present , the ia ##ea would have no ability to examine locations in iran where it believed nuclear weapons design research might be under way .

reference_raw: This implies that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA, but that until there is no nuclear material, the IAEA will not be able to examine the locations in Iran where it believes that research on the design of nuclear weapons may be ongoing.

reference_spacy_tokens: This implies that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA , but that until there is no nuclear material , the IAEA will not be able to examine the locations in Iran where it believes that research on the design of nuclear weapons may be ongoing .


fn_spacy_tokens_for_baseline: At 25 he 'd found his way into the hearts - and often the beds - of every foxy fraulein in the fatherland .

source_bert_toks: at 25 he ' d found his way into the hearts - and often the beds - of every fox ##y fra ##ule ##in in the father ##land .

reference_raw: When he was twenty-five, he found his way to the hearts - and often to the beds - of every fox fraulein in the country.

reference_spacy_tokens: When he was twenty - five , he found his way to the hearts - and often to the beds - of every fox fraulein in the country .


fn_spacy_tokens_for_baseline: Mr Rowse 's patients , forever winding down the path , oppressed Ken with the sense of his own age and mortality .

source_bert_toks: mr rows ##e ' s patients , forever winding down the path , op ##pressed ken with the sense of his own age and mortality .

reference_raw: Mr. Rowse's patients, who had always been on the road, had oppressed Ken with a sense of his own age and mortality.

reference_spacy_tokens: Mr. Rowse 's patients , who had always been on the road , had oppressed Ken with a sense of his own age and mortality .


fn_spacy_tokens_for_baseline: He tore a knee ligament during PSV Endhoven 's 3 - 0 victory over Willem II Tilburg on Saturday and will be out for the rest of the season .

source_bert_toks: he tore a knee ligament during ps ##v end ##ho ##ven ' s 3 - 0 victory over willem ii til ##burg on saturday and will be out for the rest of the season .

reference_raw: During PSV Endhoven's 3-0 victory over Willem II Tilburg on Saturday, he ripped off his knee ligament, and he'll be out for the rest of the season.

reference_spacy_tokens: During PSV Endhoven 's 3 - 0 victory over Willem II Tilburg on Saturday , he ripped off his knee ligament , and he 'll be out for the rest of the season .


fn_spacy_tokens_for_baseline: Sister Cecilia was flushed with vexation .

source_bert_toks: sister cecilia was flushed with ve ##xa ##tion .

reference_raw: Sister Cecilia was flushed with exultation.

reference_spacy_tokens: Sister Cecilia was flushed with exultation .


fn_spacy_tokens_for_baseline: Within days , the transplanted kidney began to enlarge .

source_bert_toks: within days , the transplant ##ed kidney began to en ##lar ##ge .

reference_raw: In a few days, the transplanted kidney began to expand.

reference_spacy_tokens: In a few days , the transplanted kidney began to expand .


fn_spacy_tokens_for_baseline: She tells me that the 3,666 people we helped find jobs in 1998 earned approximately $ 49 million dollars .

source_bert_toks: she tells me that the 3 , 66 ##6 people we helped find jobs in 1998 earned approximately $ 49 million dollars .

reference_raw: She told me that the 3666 people we helped find a job in 1998 made about $49 million.

reference_spacy_tokens: She told me that the 3666 people we helped find a job in 1998 made about $ 49 million .


fn_spacy_tokens_for_baseline: We 've expanded Goodwill 's proven methods to towns and neighborhoods where they are needed most .

source_bert_toks: we ' ve expanded goodwill ' s proven methods to towns and neighborhoods where they are needed most .

reference_raw: We've expanded Goodwill's proven ways to the cities and neighbourhoods where we need them most.

reference_spacy_tokens: We 've expanded Goodwill 's proven ways to the cities and neighbourhoods where we need them most .


fn_spacy_tokens_for_baseline: Oh baby , if I were n't so trammelled , would I ever like to rev up and give this little sweetheart one cosmic klop on the jaw .

source_bert_toks: oh baby , if i weren ' t so tram ##mel ##led , would i ever like to rev up and give this little sweetheart one cosmic k ##lo ##p on the jaw .

reference_raw: Oh, honey, if I wasn't so trampled, I'd love to stand up and give this little sweetheart a cosmic slap on the jaw.

reference_spacy_tokens: Oh , honey , if I was n't so trampled , I 'd love to stand up and give this little sweetheart a cosmic slap on the jaw .


fn_spacy_tokens_for_baseline: ' They do n't make them like that nowadays , ' he agreed , shaking out a scarlet Victorian ballgown .

source_bert_toks: ' they don ' t make them like that nowadays , ' he agreed , shaking out a scarlet victorian ball ##go ##wn .

reference_raw: 'They don't make them that way these days,' he said, shaking off the scarlet Victorian robe.

reference_spacy_tokens: ' They do n't make them that way these days , ' he said , shaking off the scarlet Victorian robe .


fn_spacy_tokens_for_baseline: ' I love the smell of the grass at night , ' Cara said .

source_bert_toks: ' i love the smell of the grass at night , ' cara said .

reference_raw: 'I like the smell of weed at night,' said Cara.

reference_spacy_tokens: ' I like the smell of weed at night , ' said Cara .


fn_spacy_tokens_for_baseline: A misguided attempt to bombard the Castle with rocks conveyed by magically controlled Wyverns failed spectacularly in 1513 , while demonstrating the accuracy and numbers of the undead archers within the towers of the Castle .

source_bert_toks: a mis ##guide ##d attempt to bomb ##ard the castle with rocks conveyed by magical ##ly controlled w ##y ##vern ##s failed spectacular ##ly in 151 ##3 , while demonstrating the accuracy and numbers of the undead archers within the towers of the castle .

reference_raw: In 1513, the misguided attempt to bombard the castle with stones carried by magically controlled Wyverns failed spectacularly, demonstrating the accuracy and number of the dead archers in the towers of the castle.

reference_spacy_tokens: In 1513 , the misguided attempt to bombard the castle with stones carried by magically controlled Wyverns failed spectacularly , demonstrating the accuracy and number of the dead archers in the towers of the castle .


fn_spacy_tokens_for_baseline: He was planning to meet Bob who was waiting for him there .

source_bert_toks: he was planning to meet bob who was waiting for him there .

reference_raw: He was going to meet Bob, who was waiting for him.

reference_spacy_tokens: He was going to meet Bob , who was waiting for him .


fn_spacy_tokens_for_baseline: In many other places , the ancient sites lay buried - and still do - beneath modern cities : modern property owners quite understandably take a dim view of tearing down their buildings on the off chance that the remnants of an ancient town will be found several yards below .

source_bert_toks: in many other places , the ancient sites lay buried - and still do - beneath modern cities : modern property owners quite understand ##ably take a dim view of tearing down their buildings on the off chance that the remnants of an ancient town will be found several yards below .

reference_raw: In many other places, ancient sites lay buried-and still do-under modern cities: modern landowners, quite understandably, have a vague view of tearing down their buildings at the risk that the remains of an ancient city might be discovered a few yards below.

reference_spacy_tokens: In many other places , ancient sites lay buried - and still do - under modern cities : modern landowners , quite understandably , have a vague view of tearing down their buildings at the risk that the remains of an ancient city might be discovered a few yards below .


fn_spacy_tokens_for_baseline: ' I do n't ask about your private affairs , now do I ? ' he said , in a mildly affronted tone .

source_bert_toks: ' i don ' t ask about your private affairs , now do i ? ' he said , in a mildly af ##front ##ed tone .

reference_raw: 'I'm not asking about your private business, am I?' he said, his voice slightly offended.

reference_spacy_tokens: ' I 'm not asking about your private business , am I ? ' he said , his voice slightly offended .


fn_spacy_tokens_for_baseline: ' They were warehoused the following day , ' explained Philip .

source_bert_toks: ' they were warehouse ##d the following day , ' explained philip .

reference_raw: 'They were in storage the next day,' said Philip.

reference_spacy_tokens: ' They were in storage the next day , ' said Philip .


fn_spacy_tokens_for_baseline: She came out of the marshes , and she was grey all over grey hair , grey face , grey rags and tatters and all mired and spattered , besides , from the marsh mud .

source_bert_toks: she came out of the marshes , and she was grey all over grey hair , grey face , grey rags and ta ##tters and all mir ##ed and spat ##tered , besides , from the marsh mud .

reference_raw: She came out of the swamp and was gray all over her gray hair, her gray face, her gray rags and shreds, all muddy and muddy.

reference_spacy_tokens: She came out of the swamp and was gray all over her gray hair , her gray face , her gray rags and shreds , all muddy and muddy .


fn_spacy_tokens_for_baseline: The flesh was tender but not particularly flavoursome .

source_bert_toks: the flesh was tender but not particularly flavour ##some .

reference_raw: The meat was tender, but not particularly tasteful.

reference_spacy_tokens: The meat was tender , but not particularly tasteful .


fn_spacy_tokens_for_baseline: We were screened from the wild birds as we hurried along behind high earth banks planted with willow .

source_bert_toks: we were screened from the wild birds as we hurried along behind high earth banks planted with willow .

reference_raw: As we hurried past the high ground banks planted with willows, we were shielded from wild birds.

reference_spacy_tokens: As we hurried past the high ground banks planted with willows , we were shielded from wild birds .


fn_spacy_tokens_for_baseline: If it is hungry , the moment the food dish appears the animal 's pupils will dilate .

source_bert_toks: if it is hungry , the moment the food dish appears the animal ' s pupils will dil ##ate .

reference_raw: If he's hungry, the moment the food meal appears, the pupils of the animal will spread.

reference_spacy_tokens: If he 's hungry , the moment the food meal appears , the pupils of the animal will spread .


fn_spacy_tokens_for_baseline: But he was a bit flummoxed at the reality of Nuadu , because nobody had ever told him how to address a bastard of the Ireland 's Royal House .

source_bert_toks: but he was a bit flu ##mm ##ox ##ed at the reality of nu ##ad ##u , because nobody had ever told him how to address a bastard of the ireland ' s royal house .

reference_raw: But he was a little overwhelmed by Nuadu's reality, for no one had ever told him how to address the bastard of the Irish Royal House.

reference_spacy_tokens: But he was a little overwhelmed by Nuadu 's reality , for no one had ever told him how to address the bastard of the Irish Royal House .


fn_spacy_tokens_for_baseline: Jenny nodded and moved away from the pantry ; she looked preoccupied and the tiniest bit uncomfortable .

source_bert_toks: jenny nodded and moved away from the pantry ; she looked preoccupied and the tin ##iest bit uncomfortable .

reference_raw: Jenny nodded and moved away from the closet, looking busy and a little uncomfortable.

reference_spacy_tokens: Jenny nodded and moved away from the closet , looking busy and a little uncomfortable .


fn_spacy_tokens_for_baseline: Now 71 , and only as oldish as he feels , he still plays penetratively for Bearpark .

source_bert_toks: now 71 , and only as old ##ish as he feels , he still plays pen ##et ##rative ##ly for bear ##park .

reference_raw: Now he's 71, and he's just as old as he thinks he is, and he's still playing a penetrative game for Bearpark.

reference_spacy_tokens: Now he 's 71 , and he 's just as old as he thinks he is , and he 's still playing a penetrative game for Bearpark .


fn_spacy_tokens_for_baseline: When I reported in Africa and the Middle East , I often traveled with a small French press coffee maker and a stash of Toblerone chocolate in my duffle bag .

source_bert_toks: when i reported in africa and the middle east , i often traveled with a small french press coffee maker and a st ##ash of to ##bler ##one chocolate in my duff ##le bag .

reference_raw: When I reported to Africa and the Middle East, I often travelled with a small French press coffee maker and a box of Toblerone chocolate in my duffle bag.

reference_spacy_tokens: When I reported to Africa and the Middle East , I often travelled with a small French press coffee maker and a box of Toblerone chocolate in my duffle bag .


fn_spacy_tokens_for_baseline: QN : Is Iran running a secret weapons program under the cover of plans to build nuclear power plants for electricity ?

source_bert_toks: q ##n : is iran running a secret weapons program under the cover of plans to build nuclear power plants for electricity ?

reference_raw: QN: Does Iran operate a secret weapons program under the cover of plans for the construction of nuclear power plants for electricity?

reference_spacy_tokens: QN : Does Iran operate a secret weapons program under the cover of plans for the construction of nuclear power plants for electricity ?


fn_spacy_tokens_for_baseline: During the Sixth Crusade ( 1228 - 1229 ) , the Holy Roman Emperor Frederick II managed to secure Jerusalem for the Christians by negotiation .

source_bert_toks: during the sixth crusade ( 122 ##8 - 122 ##9 ) , the holy roman emperor frederick ii managed to secure jerusalem for the christians by negotiation .

reference_raw: During the Sixth Crusade (1228-1229), the Holy Roman Emperor Frederick II succeeded in securing Jerusalem for the Christians through negotiations.

reference_spacy_tokens: During the Sixth Crusade ( 1228 - 1229 ) , the Holy Roman Emperor Frederick II succeeded in securing Jerusalem for the Christians through negotiations .


fn_spacy_tokens_for_baseline: Add a teaspoon of salt , and a sprinkling of milled pepper .

source_bert_toks: add a tea ##sp ##oon of salt , and a sp ##rin ##kling of mill ##ed pepper .

reference_raw: Add a spoonful of salt and a sprinkle of ground pepper.

reference_spacy_tokens: Add a spoonful of salt and a sprinkle of ground pepper .


fn_spacy_tokens_for_baseline: Er he used to do , we used to have a round each morning and collect all the films from the chemists and then we developed and printed them and took them back at night .

source_bert_toks: er he used to do , we used to have a round each morning and collect all the films from the chemist ##s and then we developed and printed them and took them back at night .

reference_raw: Er, we used to do a round every morning, pick up all the movies from the chemists, and then we'd create and print them, and we'd take them back at night.

reference_spacy_tokens: Er , we used to do a round every morning , pick up all the movies from the chemists , and then we 'd create and print them , and we 'd take them back at night .


fn_spacy_tokens_for_baseline: The rider parked the bike nose - in to the pavement and killed the engine .

source_bert_toks: the rider parked the bike nose - in to the pavement and killed the engine .

reference_raw: The rider parked his bike nose on the sidewalk and shut down the engine.

reference_spacy_tokens: The rider parked his bike nose on the sidewalk and shut down the engine .


fn_spacy_tokens_for_baseline: If one were to multiply an animal 's breadth , height and length by ten , its surface area would be increased by 100 , but its weight by 1000 .

source_bert_toks: if one were to multi ##ply an animal ' s breadth , height and length by ten , its surface area would be increased by 100 , but its weight by 1000 .

reference_raw: If you multiply the width, height and length of the animal by 10, the surface area is going to be increased by 100, but the weight is going to be 1000.

reference_spacy_tokens: If you multiply the width , height and length of the animal by 10 , the surface area is going to be increased by 100 , but the weight is going to be 1000 .


fn_spacy_tokens_for_baseline: Explaining the Increase in Publishing Productivity in Latin America One potential explanation for the increase in scientific productivity in Latin America is that scientific development during the 1990s was particularly strong for many countries of this region .

source_bert_toks: explaining the increase in publishing productivity in latin america one potential explanation for the increase in scientific productivity in latin america is that scientific development during the 1990s was particularly strong for many countries of this region .

reference_raw: Explaining the increase in public productivity in Latin America One possible explanation for the increase in scientific productivity in Latin America is that scientific development in the 1990s was particularly powerful in many countries in the region.

reference_spacy_tokens: Explaining the increase in public productivity in Latin America One possible explanation for the increase in scientific productivity in Latin America is that scientific development in the 1990s was particularly powerful in many countries in the region .


fn_spacy_tokens_for_baseline: If artists gather in stables then New York in the summertime is a veritable art rodeo : group shows abound and it is a matchless time to take the measure of any given gallery .

source_bert_toks: if artists gather in stables then new york in the summer ##time is a ve ##rita ##ble art rodeo : group shows ab ##ound and it is a match ##less time to take the measure of any given gallery .

reference_raw: When artists gather in stables, New York in the summer is a verifiable art rodeo: the group shows up and it is timeless to measure any gallery.

reference_spacy_tokens: When artists gather in stables , New York in the summer is a verifiable art rodeo : the group shows up and it is timeless to measure any gallery .


fn_spacy_tokens_for_baseline: 2- The towers should be located in a manner where they can easily communicate with one another , and totally cover the area they are guarding .

source_bert_toks: 2 - the towers should be located in a manner where they can easily communicate with one another , and totally cover the area they are guarding .

reference_raw: 2- Towers should be positioned in such a way that they can easily communicate with each other and completely cover the area they guard.

reference_spacy_tokens: 2- Towers should be positioned in such a way that they can easily communicate with each other and completely cover the area they guard .


fn_spacy_tokens_for_baseline: Pour the garlic vinaigrette over and toss the salad , then serve immediately , scattered with cress .

source_bert_toks: pour the garlic vin ##ai ##gre ##tte over and toss the salad , then serve immediately , scattered with cr ##ess .

reference_raw: Pour the garlic vinaigrette and throw the lettuce, then serve immediately, sprinkled with cress.

reference_spacy_tokens: Pour the garlic vinaigrette and throw the lettuce , then serve immediately , sprinkled with cress .


fn_spacy_tokens_for_baseline: Additionally , I am sending traditional background materials on the Museum and the two latest issues of our Previews Magazine detailing upcoming events , exhibitions , and educational programs .

source_bert_toks: additionally , i am sending traditional background materials on the museum and the two latest issues of our preview ##s magazine detailing upcoming events , exhibitions , and educational programs .

reference_raw: In addition, I'm sending traditional background material to the museum and two recent editions of our preview magazine detailing future events, exhibitions, and educational programs.

reference_spacy_tokens: In addition , I 'm sending traditional background material to the museum and two recent editions of our preview magazine detailing future events , exhibitions , and educational programs .


fn_spacy_tokens_for_baseline: There was , for example , the theory that A'Tuin had come from nowhere and would continue at a uniform crawl , or steady gait , into nowhere , for all time .

source_bert_toks: there was , for example , the theory that a ' tu ##in had come from nowhere and would continue at a uniform crawl , or steady ga ##it , into nowhere , for all time .

reference_raw: There was, for example, a theory that A'Tuin had come out of nowhere and would continue to walk in uniform, or even walk, into nowhere forever.

reference_spacy_tokens: There was , for example , a theory that A'Tuin had come out of nowhere and would continue to walk in uniform , or even walk , into nowhere forever .


fn_spacy_tokens_for_baseline: His alias is Owen Money .

source_bert_toks: his alias is owen money .

reference_raw: His name is Owen Money.

reference_spacy_tokens: His name is Owen Money .


fn_spacy_tokens_for_baseline: Then came the corner , the road bending round the walled compound of a Sheikh 's racing stables .

source_bert_toks: then came the corner , the road bending round the walled compound of a sheikh ' s racing stables .

reference_raw: Then there was a corner, and the road curved around the walled compound of the sheik's racing stables.

reference_spacy_tokens: Then there was a corner , and the road curved around the walled compound of the sheik 's racing stables .


fn_spacy_tokens_for_baseline: You do n't have to have curtains ; blinds are a good alternative or if the room has a marvellous view you might want to do without any form of window dressing .

source_bert_toks: you don ' t have to have curtains ; blinds are a good alternative or if the room has a marvel ##lous view you might want to do without any form of window dressing .

reference_raw: You don't need curtains; blinds are a good alternative, or if there's a wonderful view in the room, you might want to do it without some kind of window dressing.

reference_spacy_tokens: You do n't need curtains ; blinds are a good alternative , or if there 's a wonderful view in the room , you might want to do it without some kind of window dressing .


fn_spacy_tokens_for_baseline: And the remote possibility of that happy event is enough to make every trip to the mat to pick up the post a potential thrill , despite the near statistical certainty of disappointment .

source_bert_toks: and the remote possibility of that happy event is enough to make every trip to the mat to pick up the post a potential thrill , despite the near statistical certainty of disappointment .

reference_raw: And the remote possibility of such a happy event is enough to make every trip to the mat to pick up a post a potential excitement, despite the near-statistical surety of disappointment.

reference_spacy_tokens: And the remote possibility of such a happy event is enough to make every trip to the mat to pick up a post a potential excitement , despite the near - statistical surety of disappointment .


fn_spacy_tokens_for_baseline: He thinks everyone is corrupt , everyone tries to get money and keep it .

source_bert_toks: he thinks everyone is corrupt , everyone tries to get money and keep it .

reference_raw: They think everybody's dirty, they're all trying to get the money and keep it.

reference_spacy_tokens: They think everybody 's dirty , they 're all trying to get the money and keep it .


fn_spacy_tokens_for_baseline: ' Responding , ' he answered , with a heart - stopping smile .

source_bert_toks: ' responding , ' he answered , with a heart - stopping smile .

reference_raw: "I'm responding," he said, smiling heartily.

reference_spacy_tokens: " I 'm responding , " he said , smiling heartily .


fn_spacy_tokens_for_baseline: Guinness Flight ( 071 - 522 2109 ) pioneered the concept of managed currency funds in the early 1980s and offers both distributor and roll - up versions .

source_bert_toks: guinness flight ( 07 ##1 - 52 ##2 210 ##9 ) pioneered the concept of managed currency funds in the early 1980s and offers both distributor and roll - up versions .

reference_raw: At the beginning of the 1980s, Guinness Flight (071-522 2109) pierced the concept of managed monetary funds and offered both distribution and roll-up versions.

reference_spacy_tokens: At the beginning of the 1980s , Guinness Flight ( 071 - 522 2109 ) pierced the concept of managed monetary funds and offered both distribution and roll - up versions .


fn_spacy_tokens_for_baseline: At once he made for the hill .

source_bert_toks: at once he made for the hill .

reference_raw: He went up the hill immediately.

reference_spacy_tokens: He went up the hill immediately .


fn_spacy_tokens_for_baseline: One calculation , offered by opponents of Darwin 's theory , is based on the improbability of an object as complex as a living organism arising by chance .

source_bert_toks: one calculation , offered by opponents of darwin ' s theory , is based on the imp ##ro ##ba ##bility of an object as complex as a living organism arising by chance .

reference_raw: One of the calculations offered by the opponents of Darwin's theory is based on the implausibility of an object as complex as a living organism created by chance.

reference_spacy_tokens: One of the calculations offered by the opponents of Darwin 's theory is based on the implausibility of an object as complex as a living organism created by chance .


fn_spacy_tokens_for_baseline: And some analysts have forecast that the airline might even go into the red for the first time since it was listed .

source_bert_toks: and some analysts have forecast that the airline might even go into the red for the first time since it was listed .

reference_raw: And some analysts predict that the airline could go to red for the first time since it was on the list.

reference_spacy_tokens: And some analysts predict that the airline could go to red for the first time since it was on the list .


fn_spacy_tokens_for_baseline: No man likes to have his driving criticised . '

source_bert_toks: no man likes to have his driving criticised . '

reference_raw: No man likes to be criticized for driving.'

reference_spacy_tokens: No man likes to be criticized for driving . '


fn_spacy_tokens_for_baseline: The risk is that the shares may fall in value leaving the securities house with a huge loss .

source_bert_toks: the risk is that the shares may fall in value leaving the securities house with a huge loss .

reference_raw: There is a risk that the shares will drop in value, leaving the stock house with a huge loss.

reference_spacy_tokens: There is a risk that the shares will drop in value , leaving the stock house with a huge loss .


fn_spacy_tokens_for_baseline: Belief in God can be eroded from two opposite directions -- from the effort to prove God 's existence on the one hand , and from the denial of any evidence for God 's existence on the other .

source_bert_toks: belief in god can be eroded from two opposite directions - - from the effort to prove god ' s existence on the one hand , and from the denial of any evidence for god ' s existence on the other .

reference_raw: Belief in God can be eroded from two opposite directions, on the one hand, from trying to prove the existence of God, and, on the other hand, from denying any proof of God's existence.

reference_spacy_tokens: Belief in God can be eroded from two opposite directions , on the one hand , from trying to prove the existence of God , and , on the other hand , from denying any proof of God 's existence .


fn_spacy_tokens_for_baseline: Having been left by her husband in his urge for voyages abroad , Erendis retreats to the centre of Numenor , away from the sea , where she hears only the bleating of sheep .

source_bert_toks: having been left by her husband in his urge for voyages abroad , er ##end ##is retreat ##s to the centre of nu ##men ##or , away from the sea , where she hears only the b ##lea ##ting of sheep .

reference_raw: Leaving her husband's desire to go abroad, Erendis retreats to the center of Numenor, away from the sea, where she hears only the bleating of sheep.

reference_spacy_tokens: Leaving her husband 's desire to go abroad , Erendis retreats to the center of Numenor , away from the sea , where she hears only the bleating of sheep .


fn_spacy_tokens_for_baseline: In some ways , life must seem to be a very cruel joke to millions of people on this earth .

source_bert_toks: in some ways , life must seem to be a very cruel joke to millions of people on this earth .

reference_raw: In some ways, life must seem like a very harsh joke to millions of people in the world.

reference_spacy_tokens: In some ways , life must seem like a very harsh joke to millions of people in the world .


fn_spacy_tokens_for_baseline: He unfolded it carefully , took a stub of pencil from his ammunition pouch , and marked a cross where he had seen the enemy cavalry .

source_bert_toks: he unfolded it carefully , took a stu ##b of pencil from his ammunition pouch , and marked a cross where he had seen the enemy cavalry .

reference_raw: Carefully he unfolded it, removed a stub of pencil from his ammo bag, and marked the cross where he had seen the enemy cavalry.

reference_spacy_tokens: Carefully he unfolded it , removed a stub of pencil from his ammo bag , and marked the cross where he had seen the enemy cavalry .


fn_spacy_tokens_for_baseline: Whole cities have been created in the New Territories , although the unimaginative architecture of these towns has been criticized .

source_bert_toks: whole cities have been created in the new territories , although the un ##ima ##gina ##tive architecture of these towns has been criticized .

reference_raw: All cities were created in the new territories, but the unimaginative architecture of these cities was criticized.

reference_spacy_tokens: All cities were created in the new territories , but the unimaginative architecture of these cities was criticized .


fn_spacy_tokens_for_baseline: In 1949 he and Rosellina settled in England , where he worked for Picture Post and The Observer .

source_bert_toks: in 1949 he and rose ##llin ##a settled in england , where he worked for picture post and the observer .

reference_raw: In 1949, he and Rosellina moved to England, where he worked for the Picture Post and the Watcher.

reference_spacy_tokens: In 1949 , he and Rosellina moved to England , where he worked for the Picture Post and the Watcher .


fn_spacy_tokens_for_baseline: The battle of Marja is the largest coalition assault since the 2001 U. S. -led invasion that toppled the Taliban .

source_bert_toks: the battle of mar ##ja is the largest coalition assault since the 2001 u . s . - led invasion that toppled the taliban .

reference_raw: The Battle of Marja is the largest coalition attack since the 2001 U.S.-led invasion that toppled the Taliban.

reference_spacy_tokens: The Battle of Marja is the largest coalition attack since the 2001 U.S.-led invasion that toppled the Taliban .


fn_spacy_tokens_for_baseline: He was on TV last night talking about the alien kidnapping .

source_bert_toks: he was on tv last night talking about the alien kidnapping .

reference_raw: Last night, he was on TV talking about an alien abduction.

reference_spacy_tokens: Last night , he was on TV talking about an alien abduction .


fn_spacy_tokens_for_baseline: Place the potatoes , apples , sugar , one teaspoon of salt and the vinegar in a large pan and just cover with water .

source_bert_toks: place the potatoes , apples , sugar , one tea ##sp ##oon of salt and the vinegar in a large pan and just cover with water .

reference_raw: Place potatoes, apples, sugar, one spoonful of salt and vinegar in a big pan and cover it with water.

reference_spacy_tokens: Place potatoes , apples , sugar , one spoonful of salt and vinegar in a big pan and cover it with water .


fn_spacy_tokens_for_baseline: ' Everyone says how awful the teenage years are , and we had our share of rows and problems , but I enjoyed those years with my children -- far better than the baby or toddler stages . '

source_bert_toks: ' everyone says how awful the teenage years are , and we had our share of rows and problems , but i enjoyed those years with my children - - far better than the baby or todd ##ler stages . '

reference_raw: "They're all saying how terrible the adolescence is, and we've had our share of rows and troubles, but I've enjoyed those years with my children - much better than the stages of a child or a toddler."

reference_spacy_tokens: " They 're all saying how terrible the adolescence is , and we 've had our share of rows and troubles , but I 've enjoyed those years with my children - much better than the stages of a child or a toddler . "


fn_spacy_tokens_for_baseline: The newest Andrew Lloyd Webber production is poised to build on his unmatched success , writes Mick Brown .

source_bert_toks: the newest andrew lloyd webber production is poised to build on his un ##mat ##ched success , writes mick brown .

reference_raw: The latest production of Andrew Lloyd Webber is based on his outstanding success, and he writes Mick Brown.

reference_spacy_tokens: The latest production of Andrew Lloyd Webber is based on his outstanding success , and he writes Mick Brown .


fn_spacy_tokens_for_baseline: Over the centuries citrus fruits have also been used to cure fever and protect against poisoning .

source_bert_toks: over the centuries citrus fruits have also been used to cure fever and protect against poisoning .

reference_raw: Over the centuries, citrus fruits have also been utilized to cure fever and protect against poisoning.

reference_spacy_tokens: Over the centuries , citrus fruits have also been utilized to cure fever and protect against poisoning .


fn_spacy_tokens_for_baseline: As a result of armistice agreements in 1949 , Jerusalem was divided : West Jerusalem was to be under Israeli control , and East Jerusalem ( including the Old City , with its Jewish , Muslim , Christian , and Armenian quarters ) came under Jordanian authority .

source_bert_toks: as a result of armistice agreements in 1949 , jerusalem was divided : west jerusalem was to be under israeli control , and east jerusalem ( including the old city , with its jewish , muslim , christian , and armenian quarters ) came under jordanian authority .

reference_raw: As a result of the ceasefire agreement in 1949, Jerusalem was divided: West Jerusalem was to be controlled by Israel, and East Jerusalem (including the Old City, with its Jewish, Muslim, Christian, and Armenian quarters) was to be controlled by Jordanian government.

reference_spacy_tokens: As a result of the ceasefire agreement in 1949 , Jerusalem was divided : West Jerusalem was to be controlled by Israel , and East Jerusalem ( including the Old City , with its Jewish , Muslim , Christian , and Armenian quarters ) was to be controlled by Jordanian government .


fn_spacy_tokens_for_baseline: Morathi shrieked her protests at her son not being chosen but he calmed her and agreed that the selection was a good one .

source_bert_toks: mora ##thi shrieked her protests at her son not being chosen but he calmed her and agreed that the selection was a good one .

reference_raw: Morathi screamed her protests that her son had not been chosen, but he reassured her, agreeing that the choice was good.

reference_spacy_tokens: Morathi screamed her protests that her son had not been chosen , but he reassured her , agreeing that the choice was good .


fn_spacy_tokens_for_baseline: Chairman Ed Abbott said the appeal would begin in earnest soon and he confirmed that Mr Rhys - Jones had pledged his support .

source_bert_toks: chairman ed abbott said the appeal would begin in earnest soon and he confirmed that mr rhys - jones had pledged his support .

reference_raw: President Ed Abbott said that the appeal would be serious soon, and confirmed that Mr. Rhys-Jones had promised to support him.

reference_spacy_tokens: President Ed Abbott said that the appeal would be serious soon , and confirmed that Mr. Rhys - Jones had promised to support him .


fn_spacy_tokens_for_baseline: As Mr Perez will attest , that is no small accomplishment .

source_bert_toks: as mr perez will at ##test , that is no small accomplishment .

reference_raw: As Mr. Perez will testify, it's not a small success.

reference_spacy_tokens: As Mr. Perez will testify , it 's not a small success .


fn_spacy_tokens_for_baseline: ' By using our income in this way , the taxpayer benefits because we do not have to borrow public money via the Treasury , " he said .

source_bert_toks: ' by using our income in this way , the taxpayer benefits because we do not have to borrow public money via the treasury , " he said .

reference_raw: "By using our income in this way, taxpayers benefit from the fact that we don't have to lend public money through the Treasury," he said.

reference_spacy_tokens: " By using our income in this way , taxpayers benefit from the fact that we do n't have to lend public money through the Treasury , " he said .


fn_spacy_tokens_for_baseline: Be especially attentive around the nostrils .

source_bert_toks: be especially at ##ten ##tive around the nostrils .

reference_raw: Be particularly careful around your nose.

reference_spacy_tokens: Be particularly careful around your nose .