fn_spacy_tokens_for_baseline: ' He glanced over his shoulder to where Calatin was trumpeting into a red spotted handkerchief .

source_bert_toks: ' he glanced over his shoulder to where cal ##atin was trumpet ##ing into a red spotted handkerchief .

reference_raw: He looked over his shoulder to where Calatin trumped into a red-stained handkerchief.

reference_spacy_tokens: He looked over his shoulder to where Calatin trumped into a red - stained handkerchief .


fn_spacy_tokens_for_baseline: However , as a matter of principle it annoys Hon . Members to think that Welsh Members should adopt such an attitude , because millions of pounds of English taxpayers ' money are directed towards Wales .

source_bert_toks: however , as a matter of principle it ann ##oys hon . members to think that welsh members should adopt such an attitude , because millions of pounds of english taxpayers ' money are directed towards wales .

reference_raw: In principle, however, it irritates Hon. Members to think that the Welsh Members should adopt such an approach, since millions of pounds of English taxpayers' money is directed to Wales.

reference_spacy_tokens: In principle , however , it irritates Hon . Members to think that the Welsh Members should adopt such an approach , since millions of pounds of English taxpayers ' money is directed to Wales .


fn_spacy_tokens_for_baseline: The locality can not be fully protected without having patrols roaming on the outside area of the fence .

source_bert_toks: the locality can not be fully protected without having patrols roaming on the outside area of the fence .

reference_raw: The site cannot be fully protected without patrols roaming the outside of the fence.

reference_spacy_tokens: The site can not be fully protected without patrols roaming the outside of the fence .


fn_spacy_tokens_for_baseline: ' The wine here is also very good , ' he mentioned .

source_bert_toks: ' the wine here is also very good , ' he mentioned .

reference_raw: 'The wine is very good here, too,' he said.

reference_spacy_tokens: ' The wine is very good here , too , ' he said .


fn_spacy_tokens_for_baseline: Eyes implored other eyes , smoky and dark .

source_bert_toks: eyes imp ##lore ##d other eyes , smoky and dark .

reference_raw: His eyes were pleading with other eyes, smoky and dark.

reference_spacy_tokens: His eyes were pleading with other eyes , smoky and dark .


fn_spacy_tokens_for_baseline: It was dark on the river , the moon obscured behind the Wall 's north - western edge .

source_bert_toks: it was dark on the river , the moon obscured behind the wall ' s north - western edge .

reference_raw: The river was dark, and the moon was hidden beyond the northwest rim of the Wall.

reference_spacy_tokens: The river was dark , and the moon was hidden beyond the northwest rim of the Wall .


fn_spacy_tokens_for_baseline: They were on the choppy , wavelike hills before Milford , a narrow road with too much Friday evening traffic heading south , against them , for Maxim to risk trying to overtake an elderly truck in front .

source_bert_toks: they were on the chop ##py , wave ##like hills before milford , a narrow road with too much friday evening traffic heading south , against them , for maxim to risk trying to over ##take an elderly truck in front .

reference_raw: They were in the choppy, wave-like hills in front of Milford, a narrow road with too many Friday evening traffic heading south, and Maxim took the chance to overtake the old truck in front of him.

reference_spacy_tokens: They were in the choppy , wave - like hills in front of Milford , a narrow road with too many Friday evening traffic heading south , and Maxim took the chance to overtake the old truck in front of him .


fn_spacy_tokens_for_baseline: This can be allied to Derrida 's critique of ' a certain fundamental Europeanization of world culture ' .

source_bert_toks: this can be allied to der ##rid ##a ' s critique of ' a certain fundamental european ##ization of world culture ' .

reference_raw: This can be attributed to Derrida's criticism of "a certain basic Europeanization of world culture."

reference_spacy_tokens: This can be attributed to Derrida 's criticism of " a certain basic Europeanization of world culture . "


fn_spacy_tokens_for_baseline: She clung to the waist of his crackling leather overcoat as they thundered up the hill and roared along Hope Street , past the Mission Hall and the Institute and the ruined silhouette of the Methodist church .

source_bert_toks: she clung to the waist of his crack ##ling leather over ##coat as they thunder ##ed up the hill and roared along hope street , past the mission hall and the institute and the ruined silhouette of the methodist church .

reference_raw: As they thundered up the hill and roared along Hope Street, past the Mission Hall and the Institute and the ruined silhouette of the Methodist Church, she clung to the waist of his crackling leather jacket.

reference_spacy_tokens: As they thundered up the hill and roared along Hope Street , past the Mission Hall and the Institute and the ruined silhouette of the Methodist Church , she clung to the waist of his crackling leather jacket .


fn_spacy_tokens_for_baseline: And the glistening ruby that means longing -- set it in the crystal frame .

source_bert_toks: and the glistening ruby that means longing - - set it in the crystal frame .

reference_raw: And a shiny ruby, which means desire, put it in a crystal frame.

reference_spacy_tokens: And a shiny ruby , which means desire , put it in a crystal frame .


fn_spacy_tokens_for_baseline: 2 hours before the show starts , the Fire Brigade and 2 besuited men from the local authority are in grim conference over the safety of some fireworks in the production .

source_bert_toks: 2 hours before the show starts , the fire brigade and 2 be ##suit ##ed men from the local authority are in grim conference over the safety of some fireworks in the production .

reference_raw: Two hours before the show starts, the Fire Brigade and two of the local authorities are having a grim meeting about the safety of some of the fireworks in the production.

reference_spacy_tokens: Two hours before the show starts , the Fire Brigade and two of the local authorities are having a grim meeting about the safety of some of the fireworks in the production .


fn_spacy_tokens_for_baseline: well if you if you 're on you 're on the usenet groups you might try uh alt privacy

source_bert_toks: well if you if you ' re on you ' re on the use ##net groups you might try uh alt privacy

reference_raw: well, if you're in usenet groups, you can test uh alt privacy

reference_spacy_tokens: well , if you 're in usenet groups , you can test uh alt privacy


fn_spacy_tokens_for_baseline: The inauguration of Dubai Internet City coincides with the opening of an annual IT show in Dubai , the Gulf Information Technology Exhibition ( Gitex ) , the biggest in the Middle East .

source_bert_toks: the inauguration of dubai internet city coincide ##s with the opening of an annual it show in dubai , the gulf information technology exhibition ( gi ##te ##x ) , the biggest in the middle east .

reference_raw: The launch of the Internet City of Dubai coincides with the launch of a yearly IT show in Dubai, the Gulf Information Technology Exhibition (Gitex), which is the largest in the Middle East.

reference_spacy_tokens: The launch of the Internet City of Dubai coincides with the launch of a yearly IT show in Dubai , the Gulf Information Technology Exhibition ( Gitex ) , which is the largest in the Middle East .


fn_spacy_tokens_for_baseline: The Centre Party was also committed to ending what it saw as the system of political patronage and was more sceptical than the other main parties about the possibility of Finland joining the European Communities .

source_bert_toks: the centre party was also committed to ending what it saw as the system of political patronage and was more sc ##ept ##ical than the other main parties about the possibility of finland joining the european communities .

reference_raw: The Centre Party has also committed itself to putting an end to what it considers to be a system of political patronage and is more skeptical than the other main parties about Finland's possible accession to the European Community.

reference_spacy_tokens: The Centre Party has also committed itself to putting an end to what it considers to be a system of political patronage and is more skeptical than the other main parties about Finland 's possible accession to the European Community .


fn_spacy_tokens_for_baseline: Adrian Gozzard , ex - Plessey , spoke for many executives responsible for recruitment in Britain 's largest companies when he argued his preference for broad - based search firms , rather than those specialising by functional discipline .

source_bert_toks: adrian go ##zza ##rd , ex - pl ##ess ##ey , spoke for many executives responsible for recruitment in britain ' s largest companies when he argued his preference for broad - based search firms , rather than those specialising by functional discipline .

reference_raw: Adrian Gozzard, former Plessey, spoke for many of the executives responsible for recruiting the largest companies in Britain, claiming that he preferred large-scale search firms rather than those specialising in functional discipline.

reference_spacy_tokens: Adrian Gozzard , former Plessey , spoke for many of the executives responsible for recruiting the largest companies in Britain , claiming that he preferred large - scale search firms rather than those specialising in functional discipline .


fn_spacy_tokens_for_baseline: He walked through to the back of the shop and called out to his father - in - law .

source_bert_toks: he walked through to the back of the shop and called out to his father - in - law .

reference_raw: He went to the back of the store and called out to his father-in-law.

reference_spacy_tokens: He went to the back of the store and called out to his father - in - law .


fn_spacy_tokens_for_baseline: Iraq has accused the U.S. , which vehemently opposes the lifting of the sanctions against Iraq , of using the sanctions as a tool to contain the Iraqi regime headed by President Saddam Hussein .

source_bert_toks: iraq has accused the u . s . , which ve ##hem ##ently opposes the lifting of the sanctions against iraq , of using the sanctions as a tool to contain the iraqi regime headed by president saddam hussein .

reference_raw: Iraq has accused the United States, which vehemently opposes lifting sanctions against Iraq, of using sanctions as a tool to contain Iraq's regime, led by President Saddam Hussein.

reference_spacy_tokens: Iraq has accused the United States , which vehemently opposes lifting sanctions against Iraq , of using sanctions as a tool to contain Iraq 's regime , led by President Saddam Hussein .


fn_spacy_tokens_for_baseline: In the event of a tie , the prize will be awarded to the entrant who answers the tie break in the most apt and amusing way .

source_bert_toks: in the event of a tie , the prize will be awarded to the en ##tra ##nt who answers the tie break in the most apt and amusing way .

reference_raw: In the case of a tie, the prize shall be awarded to the entrant who responds to the tie break in the most appropriate and entertaining manner.

reference_spacy_tokens: In the case of a tie , the prize shall be awarded to the entrant who responds to the tie break in the most appropriate and entertaining manner .


fn_spacy_tokens_for_baseline: I 've been ringing my family at regular intervals to see how things are going . '

source_bert_toks: i ' ve been ringing my family at regular intervals to see how things are going . '

reference_raw: I call my family at regular intervals to see how things are going.'

reference_spacy_tokens: I call my family at regular intervals to see how things are going . '


fn_spacy_tokens_for_baseline: The most memorable scene has German officers and their ladies trapped in an underground bunker and showered with hand grenades and gasoline .

source_bert_toks: the most memorable scene has german officers and their ladies trapped in an underground bunker and showered with hand grenades and gasoline .

reference_raw: The most memorable scene is that German officers and their ladies are trapped in a subterranean bunker and showered with hand grenades and gasoline.

reference_spacy_tokens: The most memorable scene is that German officers and their ladies are trapped in a subterranean bunker and showered with hand grenades and gasoline .


fn_spacy_tokens_for_baseline: In fact there is nothing fixed about such interpretations , because the way the fossils are understood may change over the years , but it is usually some time before new discoveries percolate into the popular presentations .

source_bert_toks: in fact there is nothing fixed about such interpretations , because the way the fossils are understood may change over the years , but it is usually some time before new discoveries per ##cola ##te into the popular presentations .

reference_raw: In fact, there is nothing fixed about such interpretations, since the way fossils are understood may change over the years, but it usually takes time for new discoveries to come into popular presentations.

reference_spacy_tokens: In fact , there is nothing fixed about such interpretations , since the way fossils are understood may change over the years , but it usually takes time for new discoveries to come into popular presentations .


fn_spacy_tokens_for_baseline: ' I rely on him for information .

source_bert_toks: ' i rely on him for information .

reference_raw: I'm counting on him for information.

reference_spacy_tokens: I 'm counting on him for information .


fn_spacy_tokens_for_baseline: Dr Adams tortured each child with something he or she feared .

source_bert_toks: dr adams tortured each child with something he or she feared .

reference_raw: Dr. Adams tormented every child with something that he or she was afraid of.

reference_spacy_tokens: Dr. Adams tormented every child with something that he or she was afraid of .


fn_spacy_tokens_for_baseline: A monstrous shadow lurched on the stairs two floors below .

source_bert_toks: a monstrous shadow lurched on the stairs two floors below .

reference_raw: Two floors below, a monstrous shadow swayed on the stairs.

reference_spacy_tokens: Two floors below , a monstrous shadow swayed on the stairs .


fn_spacy_tokens_for_baseline: Now she has clearly given me to know his villainy , and shown that all this wandering since her abduction she has indeed herself devised , to return to this place from which she was taken .

source_bert_toks: now she has clearly given me to know his villain ##y , and shown that all this wandering since her abduction she has indeed herself devised , to return to this place from which she was taken .

reference_raw: Now she made it clear to me that she knew what he was doing, and she showed that all the wanderings since the kidnapping, she'd actually invented, so that she could go back to the place where she was taken.

reference_spacy_tokens: Now she made it clear to me that she knew what he was doing , and she showed that all the wanderings since the kidnapping , she 'd actually invented , so that she could go back to the place where she was taken .


fn_spacy_tokens_for_baseline: The next morning , Jean felt thoroughly lethargic , and tasks that she normally would have done without a second thought became like huge unclimbable mountains .

source_bert_toks: the next morning , jean felt thoroughly let ##har ##gic , and tasks that she normally would have done without a second thought became like huge un ##cl ##im ##ba ##ble mountains .

reference_raw: The next morning Jean felt thoroughly lethargy, and the tasks she would normally do without a second thought became like giant mountains.

reference_spacy_tokens: The next morning Jean felt thoroughly lethargy , and the tasks she would normally do without a second thought became like giant mountains .


fn_spacy_tokens_for_baseline: Discussion of the best or most accessible vein is strikingly similar to embalmers ' discussions about arterial accessibility .

source_bert_toks: discussion of the best or most accessible vein is striking ##ly similar to em ##bal ##mers ' discussions about arterial accessibility .

reference_raw: The debate on the best or most accessible vein is strikingly similar to that of embalmers on the availability of arterials.

reference_spacy_tokens: The debate on the best or most accessible vein is strikingly similar to that of embalmers on the availability of arterials .


fn_spacy_tokens_for_baseline: Unemployed , homeless and with a prison record , Jerry now faced going back to prison for failure to pay child support .

source_bert_toks: unemployed , homeless and with a prison record , jerry now faced going back to prison for failure to pay child support .

reference_raw: Unemployed, homeless, and with a prison record, Jerry was now facing a return to prison for failing to pay child support.

reference_spacy_tokens: Unemployed , homeless , and with a prison record , Jerry was now facing a return to prison for failing to pay child support .


fn_spacy_tokens_for_baseline: Two smaller " cascades " of centrifuges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since November without using any uranium gas , according to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) .

source_bert_toks: two smaller " cascade ##s " of cent ##ri ##fu ##ges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since november without using any uranium gas , according to ap ( george ja ##hn , associated press / houston chronicle , feb . 2 ) .

reference_raw: Since last year, two smaller "cascades" of centrifuges have been operating on the ground and a smaller set of machines have been tested underground since November without the use of uranium gas in accordance with AP (George Jahn, Associated Press/Houston Chronicle, Feb.2).

reference_spacy_tokens: Since last year , two smaller " cascades " of centrifuges have been operating on the ground and a smaller set of machines have been tested underground since November without the use of uranium gas in accordance with AP ( George Jahn , Associated Press / Houston Chronicle , Feb.2 ) .


fn_spacy_tokens_for_baseline: Like a large rufous and grey domestic fowl or a giant partridge , with whitish cheeks , and distinctive blackish striations on upper breast ; the snowcock with least white in its plumage .

source_bert_toks: like a large ru ##fo ##us and grey domestic f ##ow ##l or a giant partridge , with whitish cheeks , and distinctive blackish st ##riation ##s on upper breast ; the snow ##cock with least white in its plumage .

reference_raw: It's like a big rufous, gray domestic cowl, or a giant partridge with white cheeks, and distinctive blackish stripes on the upper chest; a snowcock with the least white in its feathers.

reference_spacy_tokens: It 's like a big rufous , gray domestic cowl , or a giant partridge with white cheeks , and distinctive blackish stripes on the upper chest ; a snowcock with the least white in its feathers .


fn_spacy_tokens_for_baseline: The canny Taiwanese have perfected the technique of ' shadow dancing ' .

source_bert_toks: the can ##ny taiwanese have perfect ##ed the technique of ' shadow dancing ' .

reference_raw: Canny Taiwanese refined the technique of shadow dancing.

reference_spacy_tokens: Canny Taiwanese refined the technique of shadow dancing .


fn_spacy_tokens_for_baseline: Alice suppressed an impulse to say : Liquidate all men .

source_bert_toks: alice suppressed an impulse to say : liquid ##ate all men .

reference_raw: Alice suppressed the urge to say, "Kill all men.

reference_spacy_tokens: Alice suppressed the urge to say , " Kill all men .


fn_spacy_tokens_for_baseline: In Silesia both Poles and Germans brought in thousands of relatives and in - laws to swell their vote .

source_bert_toks: in silesia both poles and germans brought in thousands of relatives and in - laws to swell their vote .

reference_raw: In Silesia, the Poles and the Germans brought thousands of relatives and relatives to raise their voices.

reference_spacy_tokens: In Silesia , the Poles and the Germans brought thousands of relatives and relatives to raise their voices .


fn_spacy_tokens_for_baseline: Cook the onion , garlic and tomatoes in the water for 10 minutes .

source_bert_toks: cook the onion , garlic and tomatoes in the water for 10 minutes .

reference_raw: Make onions, garlic and tomatoes for 10 minutes.

reference_spacy_tokens: Make onions , garlic and tomatoes for 10 minutes .


fn_spacy_tokens_for_baseline: The prostate gland can be involved by infection , both gonococcal and non - gonococcal , and in order to tell whether it is inflamed it is helpful to be able to examine some of the fluid that it secretes .

source_bert_toks: the prostate gland can be involved by infection , both go ##no ##co ##cca ##l and non - go ##no ##co ##cca ##l , and in order to tell whether it is in ##fl ##ame ##d it is helpful to be able to examine some of the fluid that it secret ##es .

reference_raw: The prostate gland may be involved in infections, both gonococcal and non-gonococcal, and it is useful to examine some of the liquids it excavates to determine if they are infected.

reference_spacy_tokens: The prostate gland may be involved in infections , both gonococcal and non - gonococcal , and it is useful to examine some of the liquids it excavates to determine if they are infected .


fn_spacy_tokens_for_baseline: When at last she did so Giles Carnaby was warmly effusive .

source_bert_toks: when at last she did so giles car ##na ##by was warmly e ##ff ##us ##ive .

reference_raw: When she finally did, Giles Carnaby was warmly exhausted.

reference_spacy_tokens: When she finally did , Giles Carnaby was warmly exhausted .


fn_spacy_tokens_for_baseline: Never a true superstar , he managed to succeed mainly because he continued to perform and his voice miraculously seemed to improve with age .

source_bert_toks: never a true superstar , he managed to succeed mainly because he continued to perform and his voice miraculous ##ly seemed to improve with age .

reference_raw: He'd never been a real star, but he'd been successful mainly because he'd continued to perform, and his voice had miraculously improved with age.

reference_spacy_tokens: He 'd never been a real star , but he 'd been successful mainly because he 'd continued to perform , and his voice had miraculously improved with age .


fn_spacy_tokens_for_baseline: Skilled ringers use their wrists to advance or retard the next swing , so that one bell can swap places with another in the following change .

source_bert_toks: skilled ring ##ers use their wrists to advance or re ##tar ##d the next swing , so that one bell can swap places with another in the following change .

reference_raw: Skilled ringers use their wrists to move or slow down the next swing, so that one bell can switch places with the other in the next change.

reference_spacy_tokens: Skilled ringers use their wrists to move or slow down the next swing , so that one bell can switch places with the other in the next change .


fn_spacy_tokens_for_baseline: Meredith escaped through the door he held open and walked quickly home feeling both discomfited and dissatisfied .

source_bert_toks: meredith escaped through the door he held open and walked quickly home feeling both disco ##m ##fi ##ted and dissatisfied .

reference_raw: Meredith ran through the door, which he held open, and went home quickly, feeling both uncomfortable and dissatisfied.

reference_spacy_tokens: Meredith ran through the door , which he held open , and went home quickly , feeling both uncomfortable and dissatisfied .


fn_spacy_tokens_for_baseline: Those unfortunates who were late received two cuts from the weapon -- one on each hand and were admonished not to be late again .

source_bert_toks: those unfortunate ##s who were late received two cuts from the weapon - - one on each hand and were ad ##mon ##ished not to be late again .

reference_raw: The unfortunates who had been late had received two wounds from the weapon, one on each arm, and had been warned not to be late again.

reference_spacy_tokens: The unfortunates who had been late had received two wounds from the weapon , one on each arm , and had been warned not to be late again .


fn_spacy_tokens_for_baseline: In 1997 , two more Chinese companies and were sanctioned by the US State Department for selling Iran CW related precursors and equipment .

source_bert_toks: in 1997 , two more chinese companies and were sanctioned by the us state department for selling iran cw related precursor ##s and equipment .

reference_raw: In 1997, two other Chinese companies were sanctioned by the U.S. State Department for the sale of precursors and equipment associated with Iran's CW.

reference_spacy_tokens: In 1997 , two other Chinese companies were sanctioned by the U.S. State Department for the sale of precursors and equipment associated with Iran 's CW .


fn_spacy_tokens_for_baseline: The colour was thinned with water to the consistency of cream and applied with soft synthetic haired brushes .

source_bert_toks: the colour was thin ##ned with water to the consistency of cream and applied with soft synthetic haired brushes .

reference_raw: The colour was narrowed by water to cream consistency and applied to soft synthetic hairbrushes.

reference_spacy_tokens: The colour was narrowed by water to cream consistency and applied to soft synthetic hairbrushes .


fn_spacy_tokens_for_baseline: For this reason we can see a little way beyond the horizon H even on the Earth .

source_bert_toks: for this reason we can see a little way beyond the horizon h even on the earth .

reference_raw: That's why we can look beyond the horizon of H, even on Earth.

reference_spacy_tokens: That 's why we can look beyond the horizon of H , even on Earth .


fn_spacy_tokens_for_baseline: It makes a stronger seam of two panels and is a trademark of some of the best sewn , professionally - made kites .

source_bert_toks: it makes a stronger seam of two panels and is a trademark of some of the best se ##wn , professionally - made kite ##s .

reference_raw: It creates a stronger seam of two panels and is the mark of some of the finest kites sewn and professionally made.

reference_spacy_tokens: It creates a stronger seam of two panels and is the mark of some of the finest kites sewn and professionally made .


fn_spacy_tokens_for_baseline: ' I remember she used to tell me stories of a wonderful place where she 'd had a job once as a lady 's maid .

source_bert_toks: ' i remember she used to tell me stories of a wonderful place where she ' d had a job once as a lady ' s maid .

reference_raw: I remember she told me stories about a beautiful place where she used to work as a maid.

reference_spacy_tokens: I remember she told me stories about a beautiful place where she used to work as a maid .


fn_spacy_tokens_for_baseline: She gives me antibiotics for my heroin addiction .

source_bert_toks: she gives me antibiotics for my heroin addiction .

reference_raw: He's giving me antibiotics to get addicted to heroin.

reference_spacy_tokens: He 's giving me antibiotics to get addicted to heroin .


fn_spacy_tokens_for_baseline: It was very easy to imagine eyes peering from the gloom , or strange beings creeping along the path behind them .

source_bert_toks: it was very easy to imagine eyes peering from the gloom , or strange beings creeping along the path behind them .

reference_raw: It was easy to imagine eyes staring out of the darkness, or strange beings creeping along the trail behind them.

reference_spacy_tokens: It was easy to imagine eyes staring out of the darkness , or strange beings creeping along the trail behind them .


fn_spacy_tokens_for_baseline: De Gaulle was incensed , ordered Massu 's recall to Paris , and , against the advice of several senior advisers , insisted that Massu should not be permitted to return to his command .

source_bert_toks: de gaulle was incense ##d , ordered mass ##u ' s recall to paris , and , against the advice of several senior advisers , insisted that mass ##u should not be permitted to return to his command .

reference_raw: De Gaulle was enthusiastic, ordered Massu to be recalled to Paris, and, on the advice of several senior advisors, insisted that Massu should not be allowed to return to his command.

reference_spacy_tokens: De Gaulle was enthusiastic , ordered Massu to be recalled to Paris , and , on the advice of several senior advisors , insisted that Massu should not be allowed to return to his command .


fn_spacy_tokens_for_baseline: Every time I go out in the rain or down a flooded road , the front carpets get soaked .

source_bert_toks: every time i go out in the rain or down a flooded road , the front carpets get soaked .

reference_raw: Every time I go out in the rain or on a flooded road, the front carpets get wet.

reference_spacy_tokens: Every time I go out in the rain or on a flooded road , the front carpets get wet .


fn_spacy_tokens_for_baseline: Villa are currently fourth in the table , but with Bryan Robson making his long - awaited return from injury today , Atkinson warned : ' Robbo will be a great influence on United .

source_bert_toks: villa are currently fourth in the table , but with bryan robson making his long - awaited return from injury today , atkinson warned : ' robb ##o will be a great influence on united .

reference_raw: Villa is now the fourth in the table, but now that Bryan Robson has made his long-awaited comeback from injury today, Atkinson warned: 'Robbo will have a big influence on United.

reference_spacy_tokens: Villa is now the fourth in the table , but now that Bryan Robson has made his long - awaited comeback from injury today , Atkinson warned : ' Robbo will have a big influence on United .


fn_spacy_tokens_for_baseline: They shaved off my hair and sewed up my head .

source_bert_toks: they shaved off my hair and se ##wed up my head .

reference_raw: They cut my hair off and stitched my head.

reference_spacy_tokens: They cut my hair off and stitched my head .


fn_spacy_tokens_for_baseline: The steak was hissing in the frying pan and he was slicing Chinese leaf on the kitchen table when the doorbell rang .

source_bert_toks: the steak was hissing in the fry ##ing pan and he was slicing chinese leaf on the kitchen table when the doorbell rang .

reference_raw: The steak sizzled in the frying pan, and he was cutting Chinese leaves on the kitchen table when the bell rang.

reference_spacy_tokens: The steak sizzled in the frying pan , and he was cutting Chinese leaves on the kitchen table when the bell rang .


fn_spacy_tokens_for_baseline: Among the responses the Swiss trader got was one from the Soviet national shipping company , which had n't been invited to submit a bid .

source_bert_toks: among the responses the swiss trader got was one from the soviet national shipping company , which hadn ' t been invited to submit a bid .

reference_raw: One of the replies the Swiss merchant received was from a Soviet national shipping company that was not invited to submit an offer.

reference_spacy_tokens: One of the replies the Swiss merchant received was from a Soviet national shipping company that was not invited to submit an offer .


fn_spacy_tokens_for_baseline: Luke took the reins from him and struck the horse 's hindquarters with the handle of the whip .

source_bert_toks: luke took the reins from him and struck the horse ' s hind ##qua ##rter ##s with the handle of the whip .

reference_raw: Luke took the reins and hit the horse in the rear with the whip handle.

reference_spacy_tokens: Luke took the reins and hit the horse in the rear with the whip handle .


fn_spacy_tokens_for_baseline: Her cockpit seated two , a pilot and a co - pilot , each in a standard zero - g web .

source_bert_toks: her cockpit seated two , a pilot and a co - pilot , each in a standard zero - g web .

reference_raw: There were two of her cockpits, a pilot and a co-pilot, each in a standard zero-g net.

reference_spacy_tokens: There were two of her cockpits , a pilot and a co - pilot , each in a standard zero - g net .


fn_spacy_tokens_for_baseline: Willie squeezed the bag more tightly .

source_bert_toks: willie squeezed the bag more tightly .

reference_raw: Willie held the bag tighter.

reference_spacy_tokens: Willie held the bag tighter .


fn_spacy_tokens_for_baseline: The placenta detaches itself from the uterine wall and , with other material , is forced out after the baby .

source_bert_toks: the place ##nta det ##ache ##s itself from the ut ##erine wall and , with other material , is forced out after the baby .

reference_raw: The placenta separates itself from the uterine wall and is forced to leave after the child with other materials.

reference_spacy_tokens: The placenta separates itself from the uterine wall and is forced to leave after the child with other materials .


fn_spacy_tokens_for_baseline: The girl curtsied again before scuttling off down a nearby passage .

source_bert_toks: the girl curt ##sie ##d again before sc ##ut ##tling off down a nearby passage .

reference_raw: The girl curtsied again, then hurried down a nearby corridor.

reference_spacy_tokens: The girl curtsied again , then hurried down a nearby corridor .


fn_spacy_tokens_for_baseline: MacDonald thought that it would further alarm the public if he cancelled his journey .

source_bert_toks: macdonald thought that it would further alarm the public if he cancelled his journey .

reference_raw: MacDonald thought it would scare the public even more if he canceled the trip.

reference_spacy_tokens: MacDonald thought it would scare the public even more if he canceled the trip .


fn_spacy_tokens_for_baseline: Okay all he 's done is given tacit consent , he owns property in England , fine , but that still counts only as tacit consent .

source_bert_toks: okay all he ' s done is given ta ##cit consent , he owns property in england , fine , but that still counts only as ta ##cit consent .

reference_raw: Okay, all he did was give tacit consent, he owns land in England, okay, but that still counts as tacit consent.

reference_spacy_tokens: Okay , all he did was give tacit consent , he owns land in England , okay , but that still counts as tacit consent .


fn_spacy_tokens_for_baseline: We had roast meat once a week on Sundays , served at noon on the dot , usually their own home - killed sheep or pork .

source_bert_toks: we had roast meat once a week on sundays , served at noon on the dot , usually their own home - killed sheep or pork .

reference_raw: On Sundays we had roasted flesh, served at noon at the dot, usually their home-killed sheep or pork.

reference_spacy_tokens: On Sundays we had roasted flesh , served at noon at the dot , usually their home - killed sheep or pork .


fn_spacy_tokens_for_baseline: It is potty and ridiculous to suggest that stopping people spraying their armpits with deodorants will have an effect on issues of that scale .

source_bert_toks: it is pot ##ty and ridiculous to suggest that stopping people spraying their arm ##pit ##s with de ##od ##oran ##ts will have an effect on issues of that scale .

reference_raw: It is potty and absurd to suggest that stopping people spraying their armpits with deodorants will affect matters of this scale.

reference_spacy_tokens: It is potty and absurd to suggest that stopping people spraying their armpits with deodorants will affect matters of this scale .


fn_spacy_tokens_for_baseline: Labour will continue the present talks on Northern Ireland .

source_bert_toks: labour will continue the present talks on northern ireland .

reference_raw: Labour will continue the current negotiations on Northern Ireland.

reference_spacy_tokens: Labour will continue the current negotiations on Northern Ireland .


fn_spacy_tokens_for_baseline: In 1978 they already expected the measures , not announced until 1981 , to restrict quantities of money held by individuals .

source_bert_toks: in 1978 they already expected the measures , not announced until 1981 , to restrict quantities of money held by individuals .

reference_raw: In 1978, they expected that the measures, which were not announced until 1981, would limit the amount of money held by individuals.

reference_spacy_tokens: In 1978 , they expected that the measures , which were not announced until 1981 , would limit the amount of money held by individuals .


fn_spacy_tokens_for_baseline: He glared up at Liartes , who was beginning to descend in wide sweeps .

source_bert_toks: he glared up at liar ##tes , who was beginning to descend in wide sweeps .

reference_raw: He looked at Liartes, who was beginning to fall in broad sweeps.

reference_spacy_tokens: He looked at Liartes , who was beginning to fall in broad sweeps .


fn_spacy_tokens_for_baseline: ON THE WAY to the pantry to get the Christmas cookies , Nina got lost .

source_bert_toks: on the way to the pantry to get the christmas cookies , nina got lost .

reference_raw: On the way to the pantry for Christmas biscuits, Nina was lost.

reference_spacy_tokens: On the way to the pantry for Christmas biscuits , Nina was lost .


fn_spacy_tokens_for_baseline: John said ' I 'll ask the barman if he knows anything about it . '

source_bert_toks: john said ' i ' ll ask the bar ##man if he knows anything about it . '

reference_raw: John said, "If he knows anything about this, I'll talk to the bartender."

reference_spacy_tokens: John said , " If he knows anything about this , I 'll talk to the bartender . "


fn_spacy_tokens_for_baseline: Why was it then that she almost envied the girl ?

source_bert_toks: why was it then that she almost en ##vie ##d the girl ?

reference_raw: Then why was she almost jealous of the girl?

reference_spacy_tokens: Then why was she almost jealous of the girl ?


fn_spacy_tokens_for_baseline: He was a great lad now , though still slight and not above average height for eleven years , but he had not changed towards her in the least and his adoration of Pilade was touching .

source_bert_toks: he was a great lad now , though still slight and not above average height for eleven years , but he had not changed towards her in the least and his ad ##oration of pi ##lad ##e was touching .

reference_raw: He was a big boy now, though he was still small and no more than an average height for eleven years, but he hadn't changed to her at all, and his admiration for Pilade was touching.

reference_spacy_tokens: He was a big boy now , though he was still small and no more than an average height for eleven years , but he had n't changed to her at all , and his admiration for Pilade was touching .


fn_spacy_tokens_for_baseline: The gun teams began to follow , but two teams collided , their limber wheels locked , and there was a sudden tangle of cursing drivers , stalled cannon and frightened horses .

source_bert_toks: the gun teams began to follow , but two teams collided , their limb ##er wheels locked , and there was a sudden tangle of cursing drivers , stalled cannon and frightened horses .

reference_raw: Gun teams began to follow, but two teams crashed together, their limber wheels locked, and there was a sudden confusion of cursed drivers, stalled guns, and frightened horses.

reference_spacy_tokens: Gun teams began to follow , but two teams crashed together , their limber wheels locked , and there was a sudden confusion of cursed drivers , stalled guns , and frightened horses .


fn_spacy_tokens_for_baseline: Langton realized her impatience and ushered them out of the office towards another door , which he opened with a heavy key he took from his pocket .

source_bert_toks: lang ##ton realized her impatience and ushered them out of the office towards another door , which he opened with a heavy key he took from his pocket .

reference_raw: Recognizing her impatience, Langton led them from the office to the next door, which he opened with the heavy key he had taken from his pocket.

reference_spacy_tokens: Recognizing her impatience , Langton led them from the office to the next door , which he opened with the heavy key he had taken from his pocket .


fn_spacy_tokens_for_baseline: David was trained for christian service at the Scottish Baptist College and at the BTI .

source_bert_toks: david was trained for christian service at the scottish baptist college and at the bt ##i .

reference_raw: David had been taught Christian service at the Scottish Baptist College and at the BTI.

reference_spacy_tokens: David had been taught Christian service at the Scottish Baptist College and at the BTI .


fn_spacy_tokens_for_baseline: Edith finds the cooking a cinch .

source_bert_toks: edith finds the cooking a ci ##nch .

reference_raw: Edith found a cinch in the kitchen.

reference_spacy_tokens: Edith found a cinch in the kitchen .


fn_spacy_tokens_for_baseline: I chanced a peek at myself .

source_bert_toks: i chance ##d a peek at myself .

reference_raw: I chanced to look at myself.

reference_spacy_tokens: I chanced to look at myself .


fn_spacy_tokens_for_baseline: They were very companionable .

source_bert_toks: they were very companion ##able .

reference_raw: They were very friendly.

reference_spacy_tokens: They were very friendly .


fn_spacy_tokens_for_baseline: You might assume that the quarter - point hike means the Fed is n't that worried about inflation , even though there are signs that continued strong demand and tight labor markets are beginning to make themselves felt .

source_bert_toks: you might assume that the quarter - point hike means the fed isn ' t that worried about inflation , even though there are signs that continued strong demand and tight labor markets are beginning to make themselves felt .

reference_raw: One can assume that a quarter-point hike means that the Fed is not so worried about inflation, although there are signs that continued high demand and tight labor markets are starting to feel.

reference_spacy_tokens: One can assume that a quarter - point hike means that the Fed is not so worried about inflation , although there are signs that continued high demand and tight labor markets are starting to feel .


fn_spacy_tokens_for_baseline: The response was coldly polite .

source_bert_toks: the response was coldly polite .

reference_raw: The answer was coolly courteous.

reference_spacy_tokens: The answer was coolly courteous .


fn_spacy_tokens_for_baseline: They are bright and enchanting and look superb in a rock garden , at the front of a border or in pots .

source_bert_toks: they are bright and en ##chan ##ting and look superb in a rock garden , at the front of a border or in pots .

reference_raw: They're bright and charming, and they look great in a stone garden, on the border, or in pots.

reference_spacy_tokens: They 're bright and charming , and they look great in a stone garden , on the border , or in pots .


fn_spacy_tokens_for_baseline: Last month , the Italian government threatened to withdraw its troops after a suicide bomber attacked a military convoy along Kabul 's airport road , killing six Italian soldiers and 10 Afghan civilians .

source_bert_toks: last month , the italian government threatened to withdraw its troops after a suicide bomber attacked a military convoy along kabul ' s airport road , killing six italian soldiers and 10 afghan civilians .

reference_raw: Last month, the Italian government threatened to withdraw its troops after a suicide bomber attacked a military column on Kabul Airport Road, killing six Italian soldiers and ten Afghan civilians.

reference_spacy_tokens: Last month , the Italian government threatened to withdraw its troops after a suicide bomber attacked a military column on Kabul Airport Road , killing six Italian soldiers and ten Afghan civilians .


fn_spacy_tokens_for_baseline: A water vole swam vigorously across from a little island , its round face and bright eyes showing above the water .

source_bert_toks: a water vol ##e swam vigorously across from a little island , its round face and bright eyes showing above the water .

reference_raw: A vole of water swam vigorously across the small island, its round face and clear eyes visible above the water.

reference_spacy_tokens: A vole of water swam vigorously across the small island , its round face and clear eyes visible above the water .


fn_spacy_tokens_for_baseline: ' Nevertheless , ' she said , ' it is not what I like , unmarried girls going about alone together . '

source_bert_toks: ' nevertheless , ' she said , ' it is not what i like , unmarried girls going about alone together . '

reference_raw: 'Nevertheless,' she said, 'I don't like it when single women go around alone.'

reference_spacy_tokens: ' Nevertheless , ' she said , ' I do n't like it when single women go around alone . '


fn_spacy_tokens_for_baseline: His reply is terse and informative :

source_bert_toks: his reply is ter ##se and inform ##ative :

reference_raw: His answer is brief and informative:

reference_spacy_tokens: His answer is brief and informative :


fn_spacy_tokens_for_baseline: Because the machine 's speed is reliant upon the whim of its rather dim - witted crew , the player has little control over its speed at all .

source_bert_toks: because the machine ' s speed is re ##lian ##t upon the w ##him of its rather dim - wit ##ted crew , the player has little control over its speed at all .

reference_raw: Since the speed of the machine depends on the whims of its rather vague crew, the player has little control over its speed.

reference_spacy_tokens: Since the speed of the machine depends on the whims of its rather vague crew , the player has little control over its speed .


fn_spacy_tokens_for_baseline: Currently , its growing biotechnology industry does have the potential to divert dual - use agents for illicit warfare purposes .

source_bert_toks: currently , its growing biotechnology industry does have the potential to divert dual - use agents for illicit warfare purposes .

reference_raw: At present, its growing biotechnology sector has the potential to divert double-use agents for illicit war purposes.

reference_spacy_tokens: At present , its growing biotechnology sector has the potential to divert double - use agents for illicit war purposes .


fn_spacy_tokens_for_baseline: The low rate of accumulation in the United States is undoubtedly a crucial symptom of the declining relative strength of US business .

source_bert_toks: the low rate of accumulation in the united states is undoubtedly a crucial sy ##mpt ##om of the declining relative strength of us business .

reference_raw: The low accumulation rate in the US is undoubtedly a key sign of the declining relative power of US businesses.

reference_spacy_tokens: The low accumulation rate in the US is undoubtedly a key sign of the declining relative power of US businesses .


fn_spacy_tokens_for_baseline: We followed it , passed a massive Iron Age earthwork called Abbotsbury Castle , and gradually entered an isolated valley shielded from the sea by the massive bulk of Wears Hill .

source_bert_toks: we followed it , passed a massive iron age earth ##work called abbot ##sbury castle , and gradually entered an isolated valley shielded from the sea by the massive bulk of wears hill .

reference_raw: We followed him, passing the great earthwork of the Iron Age known as Abbotsbury Castle, and gradually entering an isolated valley protected from the sea by the great bulk of Wears Hill.

reference_spacy_tokens: We followed him , passing the great earthwork of the Iron Age known as Abbotsbury Castle , and gradually entering an isolated valley protected from the sea by the great bulk of Wears Hill .


fn_spacy_tokens_for_baseline: He refrained from taking any alcohol or drugs , but when he returned to Hollywood to commence filming , he began drinking again and was picked up by the police for drunken driving .

source_bert_toks: he refrain ##ed from taking any alcohol or drugs , but when he returned to hollywood to commence filming , he began drinking again and was picked up by the police for drunken driving .

reference_raw: He didn't take any liquor or drugs, but when he went back to Hollywood to start shooting, he started drinking again, and the police picked him up for drunk driving.

reference_spacy_tokens: He did n't take any liquor or drugs , but when he went back to Hollywood to start shooting , he started drinking again , and the police picked him up for drunk driving .


fn_spacy_tokens_for_baseline: Here tramcar bogies are overhauled , wheels re - tyred , under - frames fabricated , pantographs made , and a thousand - and - one other jobs carried out to keep the tramway operational .

source_bert_toks: here tram ##car bog ##ies are overhaul ##ed , wheels re - tyre ##d , under - frames fabricated , pan ##to ##graphs made , and a thousand - and - one other jobs carried out to keep the tramway operational .

reference_raw: This is where the tramcar bogies are rearranged, the wheels are retyred, the underframes are made, the pantographs are made, and a thousand and one more work is done to keep the tramway running.

reference_spacy_tokens: This is where the tramcar bogies are rearranged , the wheels are retyred , the underframes are made , the pantographs are made , and a thousand and one more work is done to keep the tramway running .


fn_spacy_tokens_for_baseline: During our young years we were very poor .

source_bert_toks: during our young years we were very poor .

reference_raw: We were very poor in our youth.

reference_spacy_tokens: We were very poor in our youth .


fn_spacy_tokens_for_baseline: His political astuteness means he has no sentimentality about ditching unpopular and unworkable policies bequeathed to him .

source_bert_toks: his political as ##tute ##ness means he has no sentimental ##ity about ditch ##ing unpopular and un ##work ##able policies bequeathed to him .

reference_raw: His political stamina means that he has no sentimentality to get rid of the unpopular and unworkable policies left to him.

reference_spacy_tokens: His political stamina means that he has no sentimentality to get rid of the unpopular and unworkable policies left to him .


fn_spacy_tokens_for_baseline: Bromley ( 1981 ) has shown how abundant biogenic and inorganic sedimentary textures can be revealed by lightly brushing thin mineral oil on a dry chalk surface and allowing it to ' develop ' over about 30 minutes .

source_bert_toks: bromley ( 1981 ) has shown how abundant bio ##genic and inorganic sedimentary textures can be revealed by lightly brushing thin mineral oil on a dry chalk surface and allowing it to ' develop ' over about 30 minutes .

reference_raw: Bromley (1981) showed how abundant biogenic and inorganic sedimentary structures can be detected by lightly scrubbing thin mineral oil on the dry chalk surface and allowing it to "develop" for approximately 30 minutes.

reference_spacy_tokens: Bromley ( 1981 ) showed how abundant biogenic and inorganic sedimentary structures can be detected by lightly scrubbing thin mineral oil on the dry chalk surface and allowing it to " develop " for approximately 30 minutes .


fn_spacy_tokens_for_baseline: One medium - sized firm of solicitors in East Anglia has written to its staff asking them to forgo their pay for December .

source_bert_toks: one medium - sized firm of solicitor ##s in east anglia has written to its staff asking them to for ##go their pay for december .

reference_raw: A medium-sized law firm in East Anglia wrote to its employees asking them to waive their wages in December.

reference_spacy_tokens: A medium - sized law firm in East Anglia wrote to its employees asking them to waive their wages in December .


fn_spacy_tokens_for_baseline: This is very much the way in which the law approaches the extraction of the truth , and it is different both from the vivid imprecision of ordinary life and the intimacy of a police interrogation .

source_bert_toks: this is very much the way in which the law approaches the extraction of the truth , and it is different both from the vivid imp ##re ##cision of ordinary life and the intimacy of a police interrogation .

reference_raw: This is very much the way the law approaches extracting the truth, but it is different from the lively inaccuracy of ordinary life and the intimacy of police interviews.

reference_spacy_tokens: This is very much the way the law approaches extracting the truth , but it is different from the lively inaccuracy of ordinary life and the intimacy of police interviews .


fn_spacy_tokens_for_baseline: She could n't prevent a tiny ironic smile from curving her lips .

source_bert_toks: she couldn ' t prevent a tiny ironic smile from curving her lips .

reference_raw: She could not stop a small, ironic grin from curving her lips.

reference_spacy_tokens: She could not stop a small , ironic grin from curving her lips .


fn_spacy_tokens_for_baseline: He ate fast and heartily , but his skinny frame never gained a pound .

source_bert_toks: he ate fast and heart ##ily , but his skinny frame never gained a pound .

reference_raw: His meal was quick and hearty, but his thin body had never gained a pound.

reference_spacy_tokens: His meal was quick and hearty , but his thin body had never gained a pound .


fn_spacy_tokens_for_baseline: ( One time we did scrape the black paint off the windows at the back and we served tea and pastries in the afternoon and had no music , but that was n't a great success with us .

source_bert_toks: ( one time we did scrape the black paint off the windows at the back and we served tea and past ##ries in the afternoon and had no music , but that wasn ' t a great success with us .

reference_raw: (We once scraped black paint from the back windows and served tea and cakes in the afternoon and didn't have any music, but that wasn't very good for us.

reference_spacy_tokens: ( We once scraped black paint from the back windows and served tea and cakes in the afternoon and did n't have any music , but that was n't very good for us .


fn_spacy_tokens_for_baseline: This is a scaled - down version of Blaggdon , and has always been one of my early - season pilgrimages .

source_bert_toks: this is a scaled - down version of b ##lag ##g ##don , and has always been one of my early - season pilgrimage ##s .

reference_raw: It's a scaled-down version of Blaggdon, and it's always been one of my first season trips.

reference_spacy_tokens: It 's a scaled - down version of Blaggdon , and it 's always been one of my first season trips .


fn_spacy_tokens_for_baseline: ' You were always so angry and violent , such a wicked child ! '

source_bert_toks: ' you were always so angry and violent , such a wicked child ! '

reference_raw: "You've always been so angry and violent, such an evil child!"

reference_spacy_tokens: " You 've always been so angry and violent , such an evil child ! "


fn_spacy_tokens_for_baseline: The man who did the job , thereby impressing Bernard greatly , was Dai Jones , working at the time as a service engineer for domestic appliances .

source_bert_toks: the man who did the job , thereby impress ##ing bernard greatly , was dai jones , working at the time as a service engineer for domestic appliances .

reference_raw: The man who had done the job, which had made a great impression on Bernard, was Dai Jones, who had worked at the time as a service engineer for domestic equipment.

reference_spacy_tokens: The man who had done the job , which had made a great impression on Bernard , was Dai Jones , who had worked at the time as a service engineer for domestic equipment .


fn_spacy_tokens_for_baseline: I 'll make sure the drab never interferes in my plans again . '

source_bert_toks: i ' ll make sure the dr ##ab never interfere ##s in my plans again . '

reference_raw: I'll make sure that drab doesn't get in the way of my plans again.'

reference_spacy_tokens: I 'll make sure that drab does n't get in the way of my plans again . '


fn_spacy_tokens_for_baseline: Well , even if it 's life like you say , we end up spending sixty thousand dollars a year to keep some , you know , joker in there for life .

source_bert_toks: well , even if it ' s life like you say , we end up spending sixty thousand dollars a year to keep some , you know , joker in there for life .

reference_raw: Even if it's life like you're telling us, we'll end up spending $60,000 a year to keep some, you know, jokers there for the rest of our lives.

reference_spacy_tokens: Even if it 's life like you 're telling us , we 'll end up spending $ 60,000 a year to keep some , you know , jokers there for the rest of our lives .


fn_spacy_tokens_for_baseline: Analytic tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country 's nuclear infrastructure .

source_bert_toks: analytic tools include examining statements and articles in the news media , government reports including un ##class ##ified intelligence estimates , interviewing insider ##s who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country ' s nuclear infrastructure .

reference_raw: The analytical tools include examining statements and articles in the news media, government reports, including unclassified intelligence estimates, interviewing insiders who had access to classified information, reviewing secondary sources, such as analysts' reports, and making scientific calculations based on the most available information on the nuclear infrastructure of a country.

reference_spacy_tokens: The analytical tools include examining statements and articles in the news media , government reports , including unclassified intelligence estimates , interviewing insiders who had access to classified information , reviewing secondary sources , such as analysts ' reports , and making scientific calculations based on the most available information on the nuclear infrastructure of a country .


fn_spacy_tokens_for_baseline: One lot featuring 34 books , Cardus & Arlott 's The Noblest Game and Macartney 's autobiography among them , sold for only £ 80 .

source_bert_toks: one lot featuring 34 books , card ##us & ar ##lot ##t ' s the nobles ##t game and mac ##art ##ney ' s autobiography among them , sold for only £ ##80 .

reference_raw: One lot of 34 books, Cardus & Arlott's The Noblest Game and Macartney's Autobiographer, sold for only 80 pounds.

reference_spacy_tokens: One lot of 34 books , Cardus & Arlott 's The Noblest Game and Macartney 's Autobiographer , sold for only 80 pounds .


fn_spacy_tokens_for_baseline: After five years of easy credit , the Fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

source_bert_toks: after five years of easy credit , the fed has reversed course , leaving no doubt about its commitment to fighting inflation in an economy that has finally started to gain momentum .

reference_raw: After five years of easy credit, the Fed has reversed its course, leaving no doubt about its commitment to combat inflation in an economy that has finally begun to gain momentum.

reference_spacy_tokens: After five years of easy credit , the Fed has reversed its course , leaving no doubt about its commitment to combat inflation in an economy that has finally begun to gain momentum .


fn_spacy_tokens_for_baseline: She opened a wicker sewing box , looked inside , shook her head and closed the box again .

source_bert_toks: she opened a wi ##cker sewing box , looked inside , shook her head and closed the box again .

reference_raw: Opening the wicker sewing box, she glanced in, shook her head, and closed it again.

reference_spacy_tokens: Opening the wicker sewing box , she glanced in , shook her head , and closed it again .


fn_spacy_tokens_for_baseline: The idea that organisms or even whole species adapt in order to survive is a useful explanatory hypothesis to account for the acceptance or rejection of small genetic mutations .

source_bert_toks: the idea that organisms or even whole species adapt in order to survive is a useful ex ##pl ##ana ##tory hypothesis to account for the acceptance or rejection of small genetic mutations .

reference_raw: The idea that organisms or even entire species adapt to survive is a useful explanation for the acceptance or rejection of small genetic mutations.

reference_spacy_tokens: The idea that organisms or even entire species adapt to survive is a useful explanation for the acceptance or rejection of small genetic mutations .


fn_spacy_tokens_for_baseline: The Britons originated in the northern parts of England but had settled in the area that is now Ayrshire and Renfrewshire .

source_bert_toks: the brit ##ons originated in the northern parts of england but had settled in the area that is now a ##yr ##shire and ren ##fr ##ew ##shire .

reference_raw: The British were from the northern part of England, but they were established in what is now Ayrshire and Renfrewshire.

reference_spacy_tokens: The British were from the northern part of England , but they were established in what is now Ayrshire and Renfrewshire .


fn_spacy_tokens_for_baseline: KABUL , AFGHANISTAN Insurgents armed with machine guns , mortars and rocket - propelled grenades mounted a fierce assault on a remote , relatively lightly manned U. S. outpost in northeastern Afghanistan on Sunday , killing nine American soldiers .

source_bert_toks: kabul , afghanistan insurgents armed with machine guns , mortar ##s and rocket - propelled grenades mounted a fierce assault on a remote , relatively lightly manned u . s . outpost in northeastern afghanistan on sunday , killing nine american soldiers .

reference_raw: KABUL, Afghanistan Insurgents armed with machine-guns, mortars, and rocket-powered grenades mounted a fierce attack on a remote, relatively light-manned U.S. base in Northeast Afghanistan on Sunday, killing nine American soldiers.

reference_spacy_tokens: KABUL , Afghanistan Insurgents armed with machine - guns , mortars , and rocket - powered grenades mounted a fierce attack on a remote , relatively light - manned U.S. base in Northeast Afghanistan on Sunday , killing nine American soldiers .


fn_spacy_tokens_for_baseline: Later , Kirby organises the kidnapping of a top Communist officer with the aid of a beautiful spy .

source_bert_toks: later , kirby organise ##s the kidnapping of a top communist officer with the aid of a beautiful spy .

reference_raw: Later, Kirby organized the abduction of a top communist officer with the help of a beautiful spy.

reference_spacy_tokens: Later , Kirby organized the abduction of a top communist officer with the help of a beautiful spy .


fn_spacy_tokens_for_baseline: ' I 'm going swimming on Saturday , ' said Willis , in an assumedly bored voice that was modelled on Hilary 's .

source_bert_toks: ' i ' m going swimming on saturday , ' said willis , in an assumed ##ly bored voice that was modelled on hilary ' s .

reference_raw: 'I'll go for a swim on Saturday,' said Willis, in a supposedly dull voice modeled on Hilary's.

reference_spacy_tokens: ' I 'll go for a swim on Saturday , ' said Willis , in a supposedly dull voice modeled on Hilary 's .


fn_spacy_tokens_for_baseline: This means that there is a 95 percent chance ( there 's the degree of confidence ) that between 30 and 40 percent of the population supports McCain ( that 's McCain 's 35 percent plus or minus the margin of error ) , and a 95 percent chance that between 27 and 37 percent supports Bush .

source_bert_toks: this means that there is a 95 percent chance ( there ' s the degree of confidence ) that between 30 and 40 percent of the population supports mccain ( that ' s mccain ' s 35 percent plus or minus the margin of error ) , and a 95 percent chance that between 27 and 37 percent supports bush .

reference_raw: This means that there is a 95 per cent probability (there is a degree of confidence) that between 30 and 40 per cent of the population support McCain (that is McCain's 35 per cent plus or minus the margin of error) and a 95 per cent probability that between 27 and 37 per cent support Bush.

reference_spacy_tokens: This means that there is a 95 per cent probability ( there is a degree of confidence ) that between 30 and 40 per cent of the population support McCain ( that is McCain 's 35 per cent plus or minus the margin of error ) and a 95 per cent probability that between 27 and 37 per cent support Bush .


fn_spacy_tokens_for_baseline: ' If he has to be tied in a sack and dragged , I 'll have him down . '

source_bert_toks: ' if he has to be tied in a sack and dragged , i ' ll have him down . '

reference_raw: "If you have to put him in a bag and drag him out, I'll have him down."

reference_spacy_tokens: " If you have to put him in a bag and drag him out , I 'll have him down . "


fn_spacy_tokens_for_baseline: And if you do something with the stuff you want , and there are consequences .

source_bert_toks: and if you do something with the stuff you want , and there are consequences .

reference_raw: And if you do anything about what you want, and there are consequences.

reference_spacy_tokens: And if you do anything about what you want , and there are consequences .


fn_spacy_tokens_for_baseline: The Reiki practitioner treats the patient by laying their hands gently onto the body .

source_bert_toks: the rei ##ki practitioner treats the patient by laying their hands gently onto the body .

reference_raw: The Reiki doctor handles the patient by gently laying his hands on the body.

reference_spacy_tokens: The Reiki doctor handles the patient by gently laying his hands on the body .


fn_spacy_tokens_for_baseline: Richard , back from work after a tiresome day , stopped on the Embankment to look , and remembered that he had once gone on board the Waalhaven for a drink when she put in at Orfordness .

source_bert_toks: richard , back from work after a tires ##ome day , stopped on the embankment to look , and remembered that he had once gone on board the wa ##al ##haven for a drink when she put in at or ##ford ##ness .

reference_raw: Richard, back from work after a weary day, stopped at the Embankment to look, remembering that he had once gone aboard the Waalhaven for a drink while she was in Orfordness.

reference_spacy_tokens: Richard , back from work after a weary day , stopped at the Embankment to look , remembering that he had once gone aboard the Waalhaven for a drink while she was in Orfordness .


fn_spacy_tokens_for_baseline: Nowadays the rich snort coke ; in those days they got drunk and had orgies . '

source_bert_toks: nowadays the rich snort coke ; in those days they got drunk and had org ##ies . '

reference_raw: Today's rich snort cocaine; in those days they got drunk and had an orgy.'

reference_spacy_tokens: Today 's rich snort cocaine ; in those days they got drunk and had an orgy . '


fn_spacy_tokens_for_baseline: The oil price rises of the 1970s have created conditions in many Third World countries similar to those of a wartime siege economy .

source_bert_toks: the oil price rises of the 1970s have created conditions in many third world countries similar to those of a wartime siege economy .

reference_raw: The increase in oil prices in the 1970s created conditions similar to those of the wartime siege economy in many third world countries.

reference_spacy_tokens: The increase in oil prices in the 1970s created conditions similar to those of the wartime siege economy in many third world countries .


fn_spacy_tokens_for_baseline: The 747 - 400 jet ended its veer off the runway with its nose in a one - meter gulch and its tail on the tarmac .

source_bert_toks: the 747 - 400 jet ended its ve ##er off the runway with its nose in a one - meter gu ##lch and its tail on the tar ##mac .

reference_raw: The 747-400 jet ended its veer off the runway with its nose in a half-meter gully and its tail on the asphalt.

reference_spacy_tokens: The 747 - 400 jet ended its veer off the runway with its nose in a half - meter gully and its tail on the asphalt .


fn_spacy_tokens_for_baseline: Passports found in one of the houses identify the men as from a privilege convenience province noted for lawless tribes .

source_bert_toks: passports found in one of the houses identify the men as from a privilege convenience province noted for law ##less tribes .

reference_raw: The passports found in one of the houses identify the men from the privileged comfort zone of the lawless tribes.

reference_spacy_tokens: The passports found in one of the houses identify the men from the privileged comfort zone of the lawless tribes .


fn_spacy_tokens_for_baseline: They appeared behind a dumpster and stepped out into the street , and then inside Montier Hotel , greeting the warmth happily .

source_bert_toks: they appeared behind a dump ##ster and stepped out into the street , and then inside mont ##ier hotel , greeting the warmth happily .

reference_raw: They emerged from behind the container and went out into the street and into the Montier Hotel, greeting the heat happily.

reference_spacy_tokens: They emerged from behind the container and went out into the street and into the Montier Hotel , greeting the heat happily .


fn_spacy_tokens_for_baseline: Research in Germany on the cold hardiness of Primula acaulis shows that the red - flowered cultivars are more frost - sensitive than the white or blue equivalents .

source_bert_toks: research in germany on the cold hardin ##ess of pri ##mu ##la ac ##au ##lis shows that the red - flower ##ed cult ##ivar ##s are more frost - sensitive than the white or blue equivalent ##s .

reference_raw: Research in Germany on the cold hardness of Primula acaulis shows that red-flowered cultivars are more frozen than white or blue equivalents.

reference_spacy_tokens: Research in Germany on the cold hardness of Primula acaulis shows that red - flowered cultivars are more frozen than white or blue equivalents .


fn_spacy_tokens_for_baseline: He recalls that the Dominic Savio club , designed to safeguard bodily purity , forbade its members from even watching a screen kiss at the Saturday matinee .

source_bert_toks: he recalls that the dominic sa ##vio club , designed to safeguard bodily purity , forbade its members from even watching a screen kiss at the saturday mat ##ine ##e .

reference_raw: He remembers that the Dominic Savio Club, designed to protect physical purity, prohibited its members from even watching a screen kiss on a Saturday matinee.

reference_spacy_tokens: He remembers that the Dominic Savio Club , designed to protect physical purity , prohibited its members from even watching a screen kiss on a Saturday matinee .


fn_spacy_tokens_for_baseline: The proprietor brought them their plates heaped with beef and wild mushrooms and bordered with vegetables , breaking the silence between them .

source_bert_toks: the proprietor brought them their plates heap ##ed with beef and wild mushrooms and bordered with vegetables , breaking the silence between them .

reference_raw: The owner brought their plates piled with beef and wild mushrooms and bordered with vegetables, breaking the silence between them.

reference_spacy_tokens: The owner brought their plates piled with beef and wild mushrooms and bordered with vegetables , breaking the silence between them .


fn_spacy_tokens_for_baseline: Early the following morning , the planes flew again .

source_bert_toks: early the following morning , the planes flew again .

reference_raw: The aircraft flew again early the next morning.

reference_spacy_tokens: The aircraft flew again early the next morning .


fn_spacy_tokens_for_baseline: The Group Environmental Manager has responsibility for ensuring that the Company complies with all relevant legislation concerning environmental issues .

source_bert_toks: the group environmental manager has responsibility for ensuring that the company com ##pl ##ies with all relevant legislation concerning environmental issues .

reference_raw: The environmental manager of the group shall be responsible for ensuring compliance of the company with all relevant environmental legislation.

reference_spacy_tokens: The environmental manager of the group shall be responsible for ensuring compliance of the company with all relevant environmental legislation .


fn_spacy_tokens_for_baseline: For some years Amnesty International has gazed with envy at those charities and voluntary organizations that have found it relatively easy to attract donations and sponsorship of events from companies .

source_bert_toks: for some years amnesty international has gazed with envy at those charities and voluntary organizations that have found it relatively easy to attract donations and sponsorship of events from companies .

reference_raw: For several years, Amnesty International has looked enviously at charities and volunteer organisations who find it relatively easy to attract corporate donations and sponsorship.

reference_spacy_tokens: For several years , Amnesty International has looked enviously at charities and volunteer organisations who find it relatively easy to attract corporate donations and sponsorship .


fn_spacy_tokens_for_baseline: It 's a warm , sunny day , just like the picture .

source_bert_toks: it ' s a warm , sunny day , just like the picture .

reference_raw: It's a warm, sun-sunny day, just like the picture.

reference_spacy_tokens: It 's a warm , sun - sunny day , just like the picture .


fn_spacy_tokens_for_baseline: Housing is scarce and public services -- the court system , schools , mail service , telephone network and the highways -- are in disgraceful condition .

source_bert_toks: housing is scarce and public services - - the court system , schools , mail service , telephone network and the highways - - are in disgrace ##ful condition .

reference_raw: Housing is scarce, and public services - the court system, schools, postal services, telephone networks and roads - are in a state of shame.

reference_spacy_tokens: Housing is scarce , and public services - the court system , schools , postal services , telephone networks and roads - are in a state of shame .


fn_spacy_tokens_for_baseline: Clearly the Government decided to tread carefully so as not to offend the judiciary by appearing to interfere directly with their discretionary powers to sentence as they think appropriate .

source_bert_toks: clearly the government decided to tread carefully so as not to off ##end the judiciary by appearing to interfere directly with their discretion ##ary powers to sentence as they think appropriate .

reference_raw: It is clear that the government has decided to tread carefully so as not to insult the judiciary by appearing to interfere directly with their discretionary powers of punishment as they see fit.

reference_spacy_tokens: It is clear that the government has decided to tread carefully so as not to insult the judiciary by appearing to interfere directly with their discretionary powers of punishment as they see fit .


fn_spacy_tokens_for_baseline: The outer layer of the skin ( epidermis ) is made up of cells which are shed over a cycle of 28 days .

source_bert_toks: the outer layer of the skin ( ep ##ider ##mis ) is made up of cells which are shed over a cycle of 28 days .

reference_raw: The external layer of the skin (epidermis) consists of cells that are shed over a 28-day cycle.

reference_spacy_tokens: The external layer of the skin ( epidermis ) consists of cells that are shed over a 28-day cycle .


fn_spacy_tokens_for_baseline: It is hoped that the initiative will continue to snowball , attracting new participants from European supercomputer manufacturers and sponsorship from wider industry into research projects .

source_bert_toks: it is hoped that the initiative will continue to snow ##ball , attracting new participants from european super ##com ##put ##er manufacturers and sponsorship from wider industry into research projects .

reference_raw: It is hoped that the initiative will continue to snowball, attracting new players from European supercomputer producers and sponsoring wider industry for research projects.

reference_spacy_tokens: It is hoped that the initiative will continue to snowball , attracting new players from European supercomputer producers and sponsoring wider industry for research projects .


fn_spacy_tokens_for_baseline: Pundits rehashed the rules of succession in the event of something worse .

source_bert_toks: pun ##dit ##s re ##has ##hed the rules of succession in the event of something worse .

reference_raw: Pundits have changed the rules of inheritance in case of worse.

reference_spacy_tokens: Pundits have changed the rules of inheritance in case of worse .


fn_spacy_tokens_for_baseline: Lin Foh seemed incensed , but kept his voice down as they reached the outside steps of the Coroner 's Court .

source_bert_toks: lin f ##oh seemed incense ##d , but kept his voice down as they reached the outside steps of the coroner ' s court .

reference_raw: Lin Foh seemed incensed, but when they reached the outer steps of the coroner's court he kept his voice low.

reference_spacy_tokens: Lin Foh seemed incensed , but when they reached the outer steps of the coroner 's court he kept his voice low .


fn_spacy_tokens_for_baseline: The conference will be attended by directors , health service chief executives and directors of purchasing , as well as delegates from the independent sector .

source_bert_toks: the conference will be attended by directors , health service chief executives and directors of purchasing , as well as delegates from the independent sector .

reference_raw: Directors, Heads of Health Services and Purchasing Directors, as well as delegates from the independent sector will participate in the conference.

reference_spacy_tokens: Directors , Heads of Health Services and Purchasing Directors , as well as delegates from the independent sector will participate in the conference .


fn_spacy_tokens_for_baseline: Repton was an Anglo - Saxon town , on the south bank of the River Trent , and was at one time a chief city of the Kingdom of Mercia .

source_bert_toks: rep ##ton was an anglo - saxon town , on the south bank of the river trent , and was at one time a chief city of the kingdom of mer ##cia .

reference_raw: Repton was an Anglo-Saxon city on the southern shore of the River Trent, and was once the capital of the Kingdom of Mercia.

reference_spacy_tokens: Repton was an Anglo - Saxon city on the southern shore of the River Trent , and was once the capital of the Kingdom of Mercia .


fn_spacy_tokens_for_baseline: Then she rattled off efficiently , ' Jett is in the drawing room with his manager , Mr Kleinman .

source_bert_toks: then she rattled off efficiently , ' jett is in the drawing room with his manager , mr klein ##man .

reference_raw: "Jett's in the saloon with his manager, Mr. Kleinman," she said effectively.

reference_spacy_tokens: " Jett 's in the saloon with his manager , Mr. Kleinman , " she said effectively .


fn_spacy_tokens_for_baseline: Thus schools which are having difficulty attracting pupils over a couple of years may find that they are powerless to avoid progressive deterioration in their position .

source_bert_toks: thus schools which are having difficulty attracting pupils over a couple of years may find that they are powerless to avoid progressive deterioration in their position .

reference_raw: Thus, schools that find it difficult to attract pupils for several years may find themselves unable to prevent a gradual deterioration of their position.

reference_spacy_tokens: Thus , schools that find it difficult to attract pupils for several years may find themselves unable to prevent a gradual deterioration of their position .


fn_spacy_tokens_for_baseline: More than a million Chinese live in such cave dwellings .

source_bert_toks: more than a million chinese live in such cave dwellings .

reference_raw: There are over a million Chinese living in these cave homes.

reference_spacy_tokens: There are over a million Chinese living in these cave homes .


fn_spacy_tokens_for_baseline: Others sip nectar during their brief lives to renew their energies and to provide sustenance for egg production , but none need to feed in order to build their bodies ; their growth has come to an end .

source_bert_toks: others sip nectar during their brief lives to renew their energies and to provide su ##sten ##ance for egg production , but none need to feed in order to build their bodies ; their growth has come to an end .

reference_raw: Others drink nectar during their short lives in order to restore energy and provide food for egg production, but none of them need to feed to build their bodies; their growth is over.

reference_spacy_tokens: Others drink nectar during their short lives in order to restore energy and provide food for egg production , but none of them need to feed to build their bodies ; their growth is over .


fn_spacy_tokens_for_baseline: Many of the villages in close proximity to Sherwood Forest have also played a role in the legendary tales of our hero .

source_bert_toks: many of the villages in close proximity to sherwood forest have also played a role in the legendary tales of our hero .

reference_raw: Many villages close to Sherwood Forest also played a part in the legendary tales of our hero.

reference_spacy_tokens: Many villages close to Sherwood Forest also played a part in the legendary tales of our hero .


fn_spacy_tokens_for_baseline: It was full of trees and boulders , but with a team of local men Jack set about getting the field cleared of rocks , fences and walls .

source_bert_toks: it was full of trees and boulders , but with a team of local men jack set about getting the field cleared of rocks , fences and walls .

reference_raw: It was full of trees and boulders, but with a team of locals, Jack began to cleanse the field of rocks, fences, and walls.

reference_spacy_tokens: It was full of trees and boulders , but with a team of locals , Jack began to cleanse the field of rocks , fences , and walls .


fn_spacy_tokens_for_baseline: This " Temple of Green Pines " is a spacious complex containing temples and pavilions , statues , and gardens .

source_bert_toks: this " temple of green pines " is a spacious complex containing temples and pavilion ##s , statues , and gardens .

reference_raw: This "Green Pine Temple" is a spacious complex with temples and pavilions, statues, and backyards.

reference_spacy_tokens: This " Green Pine Temple " is a spacious complex with temples and pavilions , statues , and backyards .


fn_spacy_tokens_for_baseline: The nipples stiffened and she squeezed her breasts through the silk , her breathing growing heavier as she kneaded the sensitive buds with her fingers , her excitement growing rapidly .

source_bert_toks: the nipples stiffened and she squeezed her breasts through the silk , her breathing growing heavier as she kn ##ead ##ed the sensitive buds with her fingers , her excitement growing rapidly .

reference_raw: Her nipples stiffened and she squeezed her breasts through the silk, her breathing heavier as she fingered the delicate buds, her excitement growing fast.

reference_spacy_tokens: Her nipples stiffened and she squeezed her breasts through the silk , her breathing heavier as she fingered the delicate buds , her excitement growing fast .


fn_spacy_tokens_for_baseline: Sam was thoroughly disgruntled because the boy from the bistro had failed to appear .

source_bert_toks: sam was thoroughly di ##sg ##run ##tled because the boy from the bis ##tro had failed to appear .

reference_raw: Sam was thoroughly displeased because the boy from the diner didn't show up.

reference_spacy_tokens: Sam was thoroughly displeased because the boy from the diner did n't show up .


fn_spacy_tokens_for_baseline: He hopped across the ditch to the farther bank and looked round him again .

source_bert_toks: he hopped across the ditch to the farther bank and looked round him again .

reference_raw: He jumped across the ditch to the far bank and looked around again.

reference_spacy_tokens: He jumped across the ditch to the far bank and looked around again .


fn_spacy_tokens_for_baseline: Any sensible construction of the terms of service involved that paragraph 19 must be read in the light of , and subject to , the obligation imposed by paragraph 16 .

source_bert_toks: any sensible construction of the terms of service involved that paragraph 19 must be read in the light of , and subject to , the obligation imposed by paragraph 16 .

reference_raw: Any reasonable interpretation of the terms of service implies that paragraph 19 must be interpreted in the light of and subject to the obligation laid down in paragraph 16.

reference_spacy_tokens: Any reasonable interpretation of the terms of service implies that paragraph 19 must be interpreted in the light of and subject to the obligation laid down in paragraph 16 .


fn_spacy_tokens_for_baseline: In 1989 , living in a motel between Santa Cruz and Watsonville only a few miles from the epicentre of the Loma Prieta earthquake , I had walked with Frank Bardacke in its aftermath down the streets of Watsonville and counted score and score of the old Maybeck homes , tossed off their piers , broken - backed , red - tagged , finished .

source_bert_toks: in 1989 , living in a motel between santa cruz and watson ##ville only a few miles from the epic ##ent ##re of the lo ##ma pri ##eta earthquake , i had walked with frank bard ##ack ##e in its aftermath down the streets of watson ##ville and counted score and score of the old maybe ##ck homes , tossed off their piers , broken - backed , red - tagged , finished .

reference_raw: In 1989, when I lived in a hotel between Santa Cruz and Watsonville just a few miles from the epicenter of the Loma Prieta earthquake, I followed Frank Bardack down the streets of Watsonville, counting scores and dozens of old Mayck homes, throwing down their piers, broken-backed, red-tagged, finished.

reference_spacy_tokens: In 1989 , when I lived in a hotel between Santa Cruz and Watsonville just a few miles from the epicenter of the Loma Prieta earthquake , I followed Frank Bardack down the streets of Watsonville , counting scores and dozens of old Mayck homes , throwing down their piers , broken - backed , red - tagged , finished .


fn_spacy_tokens_for_baseline: The package includes a word processor , database , drawing and paint applications plus a spreadsheet with graphs and charts and finally a communications program .

source_bert_toks: the package includes a word processor , database , drawing and paint applications plus a spreads ##hee ##t with graphs and charts and finally a communications program .

reference_raw: The package contains a word processor, database, drawing and painting applications, plus a table with charts and graphs, and finally a communication program.

reference_spacy_tokens: The package contains a word processor , database , drawing and painting applications , plus a table with charts and graphs , and finally a communication program .


fn_spacy_tokens_for_baseline: But most were content to chant slogans and burn effigies of Ray MacSharry , the Irish Commissioner who finalised the deal .

source_bert_toks: but most were content to chant slogan ##s and burn e ##ffi ##gies of ray mac ##sha ##rry , the irish commissioner who final ##ised the deal .

reference_raw: But most of them were content to sing the slogans and burn the effigies of Ray MacSharry, the Irish commissioner who had finished the deal.

reference_spacy_tokens: But most of them were content to sing the slogans and burn the effigies of Ray MacSharry , the Irish commissioner who had finished the deal .


fn_spacy_tokens_for_baseline: Along its southern edge stands of low trees intermix with the shrubs , in places grading insensibly into forest .

source_bert_toks: along its southern edge stands of low trees inter ##mi ##x with the shrubs , in places grading ins ##ens ##ibly into forest .

reference_raw: Along its southern rim stands of low trees intertwine with bushes, in places that grade insensibly into the forest.

reference_spacy_tokens: Along its southern rim stands of low trees intertwine with bushes , in places that grade insensibly into the forest .


fn_spacy_tokens_for_baseline: The coup attempt in March 1987 was foiled when explosives , army uniforms , arms , a rocket launcher and Sierra Leone currency were found in a raid by security officers in a house in Freetown .

source_bert_toks: the coup attempt in march 1987 was foil ##ed when explosives , army uniforms , arms , a rocket launcher and sierra leone currency were found in a raid by security officers in a house in free ##town .

reference_raw: A coup attempt in March 1987 was destroyed when explosives, military uniforms, weapons, rocket launcher, and Sierra Leone currency were found in a raid by a security guard at a house in Freetown.

reference_spacy_tokens: A coup attempt in March 1987 was destroyed when explosives , military uniforms , weapons , rocket launcher , and Sierra Leone currency were found in a raid by a security guard at a house in Freetown .


fn_spacy_tokens_for_baseline: It is a saddening year , a year for sobbing .

source_bert_toks: it is a sad ##den ##ing year , a year for sobbing .

reference_raw: It's a sad year, a year to cry.

reference_spacy_tokens: It 's a sad year , a year to cry .


fn_spacy_tokens_for_baseline: Moreover , people who covenanted money to the hospitals for over six years secured income tax relief on the sum ( 1922 Finance Act ) .

source_bert_toks: moreover , people who covenant ##ed money to the hospitals for over six years secured income tax relief on the sum ( 1922 finance act ) .

reference_raw: In addition, persons who have spent more than six years in hospitals have secured income tax relief on the amount (1922 Finance Act).

reference_spacy_tokens: In addition , persons who have spent more than six years in hospitals have secured income tax relief on the amount ( 1922 Finance Act ) .


fn_spacy_tokens_for_baseline: And , more touching , ' We 'd find that , while we 'd been asleep , she 'd piled all the ornaments on top of our bed .

source_bert_toks: and , more touching , ' we ' d find that , while we ' d been asleep , she ' d piled all the ornaments on top of our bed .

reference_raw: And, more touchingly, we found that while we were asleep, she had stacked all the decorations on our bed.

reference_spacy_tokens: And , more touchingly , we found that while we were asleep , she had stacked all the decorations on our bed .


fn_spacy_tokens_for_baseline: Fish take in oxygen from the water and excrete ammonia and carbon dioxide through their gills .

source_bert_toks: fish take in oxygen from the water and ex ##cre ##te ammonia and carbon dioxide through their gills .

reference_raw: The fish extract oxygen from the water and extract ammonia and carbon dioxide through their gills.

reference_spacy_tokens: The fish extract oxygen from the water and extract ammonia and carbon dioxide through their gills .


fn_spacy_tokens_for_baseline: With regretful eyes on the sunshine outside , they had reluctantly yielded , though not as reluctantly as Auguste had yielded to Angelina 's entreaties to be allowed to interrupt the lesson .

source_bert_toks: with regret ##ful eyes on the sunshine outside , they had reluctantly yielded , though not as reluctantly as auguste had yielded to angelina ' s en ##tre ##ati ##es to be allowed to interrupt the lesson .

reference_raw: They gave in reluctantly, though not as hesitantly as Auguste gave in to Angelina's efforts to interrupt the lesson.

reference_spacy_tokens: They gave in reluctantly , though not as hesitantly as Auguste gave in to Angelina 's efforts to interrupt the lesson .


fn_spacy_tokens_for_baseline: She always tried to put in an appearance at the funerals of patients who had the misfortune to die .

source_bert_toks: she always tried to put in an appearance at the funeral ##s of patients who had the mis ##fort ##une to die .

reference_raw: She always tried to show up at the funerals of patients who were unlucky enough to die.

reference_spacy_tokens: She always tried to show up at the funerals of patients who were unlucky enough to die .


fn_spacy_tokens_for_baseline: It 's not certain that driver fatigue did contribute to this latest accident .

source_bert_toks: it ' s not certain that driver fatigue did contribute to this latest accident .

reference_raw: We're not sure the driver's tiredness contributed to the last accident.

reference_spacy_tokens: We 're not sure the driver 's tiredness contributed to the last accident .


fn_spacy_tokens_for_baseline: If you are unsure of which flowers will be suitable , or are hard - pressed to think of any small flowers at all , there are many alpine plants that may be ideal .

source_bert_toks: if you are unsure of which flowers will be suitable , or are hard - pressed to think of any small flowers at all , there are many alpine plants that may be ideal .

reference_raw: If you're not sure which flowers are suitable, or if you're having a hard time thinking about any small flowers, there's a lot of alpine plants that might be ideal.

reference_spacy_tokens: If you 're not sure which flowers are suitable , or if you 're having a hard time thinking about any small flowers , there 's a lot of alpine plants that might be ideal .


fn_spacy_tokens_for_baseline: QN : Does Mr Kerkorian think Daimler fraudlently described the 1998 deal to avoid paying a premium ?

source_bert_toks: q ##n : does mr ke ##rk ##oria ##n think dai ##mler fraud ##lent ##ly described the 1998 deal to avoid paying a premium ?

reference_raw: QN: Is Mr Kerkorian of the opinion that Daimler fraudulently described the 1998 agreement in order to avoid payment of the premium?

reference_spacy_tokens: QN : Is Mr Kerkorian of the opinion that Daimler fraudulently described the 1998 agreement in order to avoid payment of the premium ?


fn_spacy_tokens_for_baseline: This helps them to respond sensitively to their clients ' suggestions and to furnish a diagnosis and accusation of guilt which is highly acceptable to the victim .

source_bert_toks: this helps them to respond sensitive ##ly to their clients ' suggestions and to fur ##nish a diagnosis and accusation of guilt which is highly acceptable to the victim .

reference_raw: This helps them to react sensitively to their client's suggestions and to provide a diagnosis and charge of guilt that is highly acceptable to the victim.

reference_spacy_tokens: This helps them to react sensitively to their client 's suggestions and to provide a diagnosis and charge of guilt that is highly acceptable to the victim .


fn_spacy_tokens_for_baseline: IRISH premier Albert Reynolds looks certain to fall today , after three members of his frail coalition government resigned yesterday and affirmed they would oppose a vote of confidence .

source_bert_toks: irish premier albert reynolds looks certain to fall today , after three members of his frail coalition government resigned yesterday and affirmed they would oppose a vote of confidence .

reference_raw: IRISH Prime Minister Albert Reynolds seems certain to fall today, when three members of his fragile coalition government resigned yesterday and confirmed that they would oppose a vote of trust.

reference_spacy_tokens: IRISH Prime Minister Albert Reynolds seems certain to fall today , when three members of his fragile coalition government resigned yesterday and confirmed that they would oppose a vote of trust .


fn_spacy_tokens_for_baseline: In our day the argument is more frequently encountered that ' the wreck of human affairs ' disproves the existence of an all - merciful and all - powerful God .

source_bert_toks: in our day the argument is more frequently encountered that ' the wreck of human affairs ' di ##sp ##rove ##s the existence of an all - mer ##ciful and all - powerful god .

reference_raw: In our time, it is often argued that "the ruin of human affairs" denies the existence of an all-merciful and all-powerful God.

reference_spacy_tokens: In our time , it is often argued that " the ruin of human affairs " denies the existence of an all - merciful and all - powerful God .


fn_spacy_tokens_for_baseline: According to Herr Sanders , it was not you who were desirous of learning Dutch , but your wife . '

source_bert_toks: according to herr sanders , it was not you who were des ##iro ##us of learning dutch , but your wife . '

reference_raw: According to Herr Sanders, it wasn't you who wanted to learn Dutch, it was your wife.'

reference_spacy_tokens: According to Herr Sanders , it was n't you who wanted to learn Dutch , it was your wife . '


fn_spacy_tokens_for_baseline: And our own early recipes for tomato soups thickened with rice or bread were derived from Portuguese rather than American , French or Italian cookery .

source_bert_toks: and our own early recipes for tomato soup ##s thick ##ened with rice or bread were derived from portuguese rather than american , french or italian cooke ##ry .

reference_raw: And our first recipes for tomato soups thick with rice or bread were made from Portuguese rather than American, French, or Italian cuisine.

reference_spacy_tokens: And our first recipes for tomato soups thick with rice or bread were made from Portuguese rather than American , French , or Italian cuisine .


fn_spacy_tokens_for_baseline: As he left the pitch he blacked out and fell through a glass door , cutting his hand .

source_bert_toks: as he left the pitch he black ##ed out and fell through a glass door , cutting his hand .

reference_raw: He blacked out as he left the field and fell through the glass door, slashing his hand.

reference_spacy_tokens: He blacked out as he left the field and fell through the glass door , slashing his hand .


fn_spacy_tokens_for_baseline: Right : The little stream which flows under Puente Chinoluiz where we found an abundance of fish .

source_bert_toks: right : the little stream which flows under pu ##ente chin ##ol ##ui ##z where we found an abundance of fish .

reference_raw: Right: A small stream that flows under Puente Chinoluiz, where we found a lot of fish.

reference_spacy_tokens: Right : A small stream that flows under Puente Chinoluiz , where we found a lot of fish .