fn_spacy_tokens_for_baseline: She sat , straddling him , while his hands touched and teased and caressed .

source_bert_toks: she sat , st ##rad ##dling him , while his hands touched and teased and caressed .

reference_raw: She sat there, striding him while his hands touched and teased and caressed.

reference_spacy_tokens: She sat there , striding him while his hands touched and teased and caressed .


fn_spacy_tokens_for_baseline: When it was over , Hughes owned six casinos , an airport , and an airline , along with numerous plots of land stretching from the Strip to the mountains .

source_bert_toks: when it was over , hughes owned six casinos , an airport , and an airline , along with numerous plots of land stretching from the strip to the mountains .

reference_raw: When it was over, Hughes owned six casinos, an airfield, and an airline, along with a lot of land stretching from the Strip to the mountains.

reference_spacy_tokens: When it was over , Hughes owned six casinos , an airfield , and an airline , along with a lot of land stretching from the Strip to the mountains .


fn_spacy_tokens_for_baseline: Our first sight of the restaurant was one of lanterns twinkling through the dusk .

source_bert_toks: our first sight of the restaurant was one of lanterns twin ##kling through the dusk .

reference_raw: Our first view of the restaurant was one of the lanterns flashing in the dark.

reference_spacy_tokens: Our first view of the restaurant was one of the lanterns flashing in the dark .


fn_spacy_tokens_for_baseline: Meadow turned to marsh .

source_bert_toks: meadow turned to marsh .

reference_raw: Meadow faced the wetlands.

reference_spacy_tokens: Meadow faced the wetlands .


fn_spacy_tokens_for_baseline: His shabby King 's Cross flat was wallpapered with photographs of all the current top models , mostly clipped from magazines and newspapers .

source_bert_toks: his sha ##bby king ' s cross flat was wall ##paper ##ed with photographs of all the current top models , mostly clipped from magazines and newspapers .

reference_raw: His shabby King's Cross apartment was wall-papered with photographs of all the modern models, mostly clipped from magazines and newspapers.

reference_spacy_tokens: His shabby King 's Cross apartment was wall - papered with photographs of all the modern models , mostly clipped from magazines and newspapers .


fn_spacy_tokens_for_baseline: She went in , hunted through the cupboards until she found everything she needed , then cooked herself a large meal .

source_bert_toks: she went in , hunted through the cupboard ##s until she found everything she needed , then cooked herself a large meal .

reference_raw: She went inside, rummaging through the closets until she found what she needed, then made herself a big meal.

reference_spacy_tokens: She went inside , rummaging through the closets until she found what she needed , then made herself a big meal .


fn_spacy_tokens_for_baseline: The possession of a female or females can be viewed as one more validation of male status , which is an end in itself , because , once achieved , the women follow anyway .

source_bert_toks: the possession of a female or females can be viewed as one more validation of male status , which is an end in itself , because , once achieved , the women follow anyway .

reference_raw: Ownership of a female or female can be seen as another confirmation of the status of a male, which is the end in itself, since, once achieved, the females still follow.

reference_spacy_tokens: Ownership of a female or female can be seen as another confirmation of the status of a male , which is the end in itself , since , once achieved , the females still follow .


fn_spacy_tokens_for_baseline: He was shirtless , had the merest hint of a moustache and smiled easily .

source_bert_toks: he was shirt ##less , had the mere ##st hint of a mo ##ust ##ache and smiled easily .

reference_raw: He had no shirt, only the faintest hint of a mustache, and he smiled easily.

reference_spacy_tokens: He had no shirt , only the faintest hint of a mustache , and he smiled easily .


fn_spacy_tokens_for_baseline: ' We have not been massacred in any game over the last six years and it wo n't start on Wednesday , ' he said .

source_bert_toks: ' we have not been massacre ##d in any game over the last six years and it won ' t start on wednesday , ' he said .

reference_raw: 'We haven't been slaughtered in any game in six years, and it's not going to start on Wednesday,' he said.

reference_spacy_tokens: ' We have n't been slaughtered in any game in six years , and it 's not going to start on Wednesday , ' he said .


fn_spacy_tokens_for_baseline: As she looked around she felt a twinge of sadness that in a carriage where 70 per cent of the commuters were men there were five women forced to stand in the aisle .

source_bert_toks: as she looked around she felt a twin ##ge of sadness that in a carriage where 70 per cent of the commuter ##s were men there were five women forced to stand in the aisle .

reference_raw: Looking around, she felt a twinge of sorrow that five women were forced to stand in an alley in a carriage where 70 percent of the commuters were men.

reference_spacy_tokens: Looking around , she felt a twinge of sorrow that five women were forced to stand in an alley in a carriage where 70 percent of the commuters were men .


fn_spacy_tokens_for_baseline: The Academy lists are full of spelling mistakes ; whether they reflect the carelessness of the artists or later wrong transcriptions one can not tell .

source_bert_toks: the academy lists are full of spelling mistakes ; whether they reflect the careless ##ness of the artists or later wrong transcription ##s one can not tell .

reference_raw: The lists of the Academy are full of spelling errors; whether they reflect the indifference of artists or later mistranscribed one cannot tell.

reference_spacy_tokens: The lists of the Academy are full of spelling errors ; whether they reflect the indifference of artists or later mistranscribed one can not tell .


fn_spacy_tokens_for_baseline: MOTHER Teresa has persuaded bosses of Britain 's powerful Housing Corporation to find a possible £ 500,000 to help those without a roof over their heads .

source_bert_toks: mother teresa has persuaded bosses of britain ' s powerful housing corporation to find a possible £5 ##00 , 000 to help those without a roof over their heads .

reference_raw: Other Teresa convinced the bosses of the British House Corporation to find a possible £500,000 to help those with no roof over their heads.

reference_spacy_tokens: Other Teresa convinced the bosses of the British House Corporation to find a possible £ 500,000 to help those with no roof over their heads .


fn_spacy_tokens_for_baseline: Rumours of lawlessness and factional fighting had increased since the government had withdrawn its troops in March and the BRA had made a unilateral declaration of independence in May.

source_bert_toks: rumours of law ##lessness and faction ##al fighting had increased since the government had withdrawn its troops in march and the bra had made a un ##ila ##tera ##l declaration of independence in may .

reference_raw: Rumors of illegal and factional fighting have increased since the government withdrew its troops in March and the BRA made a unilateral declaration of independence in May.


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid, but the potential agreement still lacked the key element to verify that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid , but the potential agreement still lacked the key element to verify that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: On the way , you should also discover one of Scotland 's most spectacular waterfalls , Eas Coul , ' the maiden 's tresses ' , four times higher than Niagara Falls .

source_bert_toks: on the way , you should also discover one of scotland ' s most spectacular waterfalls , ea ##s co ##ul , ' the maiden ' s tres ##ses ' , four times higher than niagara falls .

reference_raw: On the way, you should also discover one of the most spectacular waterfalls in Scotland, Eas Coul, "the girl's trestles", four times the size of Niagara Falls.

reference_spacy_tokens: On the way , you should also discover one of the most spectacular waterfalls in Scotland , Eas Coul , " the girl 's trestles " , four times the size of Niagara Falls .


fn_spacy_tokens_for_baseline: Iran is generally viewed as having been forthcoming and helpful to these IAEA efforts , although this cooperation has clearly not been absolute .

source_bert_toks: iran is generally viewed as having been forthcoming and helpful to these ia ##ea efforts , although this cooperation has clearly not been absolute .

reference_raw: Iran is generally considered to be forthcoming and useful to these efforts of the IAEA, although this cooperation is clearly not absolute.

reference_spacy_tokens: Iran is generally considered to be forthcoming and useful to these efforts of the IAEA , although this cooperation is clearly not absolute .


fn_spacy_tokens_for_baseline: Despite the fact that he has been involved in more intimidating tackles than most professionals of his generation , he thinks a line has to be drawn between hard edged professionalism and pathological violence .

source_bert_toks: despite the fact that he has been involved in more intimidating tackles than most professionals of his generation , he thinks a line has to be drawn between hard edged professional ##ism and path ##ological violence .

reference_raw: Despite the fact that he was involved in more fearsome solutions than most of his generation's professionals, he believes that a line must be drawn between hardened professionalism and pathological violence.

reference_spacy_tokens: Despite the fact that he was involved in more fearsome solutions than most of his generation 's professionals , he believes that a line must be drawn between hardened professionalism and pathological violence .


fn_spacy_tokens_for_baseline: Las Vegas was no longer a small pioneer settlement .

source_bert_toks: las vegas was no longer a small pioneer settlement .

reference_raw: Las Vegas wasn't a small pioneer settlement anymore.

reference_spacy_tokens: Las Vegas was n't a small pioneer settlement anymore .


fn_spacy_tokens_for_baseline: He has this privilege , since his kinswoman is dying . '

source_bert_toks: he has this privilege , since his kin ##sw ##oman is dying . '

reference_raw: He's got that privilege because his relative's dying.'

reference_spacy_tokens: He 's got that privilege because his relative 's dying . '


fn_spacy_tokens_for_baseline: the square roots obtained from all the interest category loan components are totalled and then each individual square root is calculated as a percentage of that total .

source_bert_toks: the square roots obtained from all the interest category loan components are total ##led and then each individual square root is calculated as a percentage of that total .

reference_raw: the square roots obtained from all the interest-category components of the loan shall be aggregated, and each individual square root shall be calculated as a percentage of this sum.

reference_spacy_tokens: the square roots obtained from all the interest - category components of the loan shall be aggregated , and each individual square root shall be calculated as a percentage of this sum .


fn_spacy_tokens_for_baseline: Hence , too , the formulation of theories that the intelligentsia forms the new ruling class in technocratic , collectivized societies ( Lane 1982 , pp . 141 - 4 ) .

source_bert_toks: hence , too , the formulation of theories that the intelligent ##sia forms the new ruling class in techno ##cratic , collect ##iv ##ized societies ( lane 1982 , pp . 141 - 4 ) .

reference_raw: The theory that intelligentsia is the new ruling class of technocratic and collective societies (Lane 1982, p. 141-4).

reference_spacy_tokens: The theory that intelligentsia is the new ruling class of technocratic and collective societies ( Lane 1982 , p. 141 - 4 ) .


fn_spacy_tokens_for_baseline: Armour is beautifully made from a myriad of tiny metal scales making it lightweight and very flexible but stronger than steel .

source_bert_toks: armour is beautifully made from a myriad of tiny metal scales making it lightweight and very flexible but stronger than steel .

reference_raw: The armor is beautifully made of countless small metal scales, which make it light and very flexible but stronger than steel.

reference_spacy_tokens: The armor is beautifully made of countless small metal scales , which make it light and very flexible but stronger than steel .


fn_spacy_tokens_for_baseline: This does n't mean that you should take time off work ; quite the opposite , as it is preferable that you remain occupied while on the diet .

source_bert_toks: this doesn ' t mean that you should take time off work ; quite the opposite , as it is prefer ##able that you remain occupied while on the diet .

reference_raw: That doesn't mean you should take a break from work; it's the other way around, because it's better to stay busy while you're on a diet.

reference_spacy_tokens: That does n't mean you should take a break from work ; it 's the other way around , because it 's better to stay busy while you 're on a diet .


fn_spacy_tokens_for_baseline: On the run , he learned that his family was paying the price for his failed plot against Kadafi .

source_bert_toks: on the run , he learned that his family was paying the price for his failed plot against ka ##da ##fi .

reference_raw: As he fled, he learned that his family paid for his failed plot against Kadafi.

reference_spacy_tokens: As he fled , he learned that his family paid for his failed plot against Kadafi .


fn_spacy_tokens_for_baseline: It was strange , the comfort she got from Ben 's words , a sudden consoling warmth like finding an electric fire to turn on when the central heating failed in winter .

source_bert_toks: it was strange , the comfort she got from ben ' s words , a sudden con ##sol ##ing warmth like finding an electric fire to turn on when the central heating failed in winter .

reference_raw: It was strange, the comfort in Ben's words, the sudden comforting warmth of finding an electric fire to turn on when the central heat failed in winter.

reference_spacy_tokens: It was strange , the comfort in Ben 's words , the sudden comforting warmth of finding an electric fire to turn on when the central heat failed in winter .


fn_spacy_tokens_for_baseline: While the icing is still soft dampen the ends of the tentacles and press them , one at a time , around the base of the cake .

source_bert_toks: while the ic ##ing is still soft damp ##en the ends of the tentacles and press them , one at a time , around the base of the cake .

reference_raw: While the ice is still soft, the ends of the tentacles are damped and pressed, one by one, around the bottom of the cake.

reference_spacy_tokens: While the ice is still soft , the ends of the tentacles are damped and pressed , one by one , around the bottom of the cake .


fn_spacy_tokens_for_baseline: A public body which has power to construct lavatories can not use that power in order to build a subway under a street .

source_bert_toks: a public body which has power to construct lava ##tori ##es can not use that power in order to build a subway under a street .

reference_raw: A public body with the power to build toilets cannot use that power to build a subway under the street.

reference_spacy_tokens: A public body with the power to build toilets can not use that power to build a subway under the street .


fn_spacy_tokens_for_baseline: Montgomery said that the spring offensive of 1943 was ' the heaviest and most savage fighting we have had since I have commanded the Eighth Army ' .

source_bert_toks: montgomery said that the spring offensive of 1943 was ' the heaviest and most savage fighting we have had since i have commanded the eighth army ' .

reference_raw: Montgomery said that the spring attack in 1943 was 'the hardest and most ferocious battle we've had since I was in charge of the Eighth Army.'

reference_spacy_tokens: Montgomery said that the spring attack in 1943 was ' the hardest and most ferocious battle we 've had since I was in charge of the Eighth Army . '


fn_spacy_tokens_for_baseline: Yellow Post - it notes , glowing with the thoughts of the day , stuck to the shelves of his voluminous bookcase .

source_bert_toks: yellow post - it notes , glowing with the thoughts of the day , stuck to the shelves of his vol ##umi ##nous book ##case .

reference_raw: The yellow post-it notes, glowing with the thoughts of the day, were glued to the shelves of his bulky library.

reference_spacy_tokens: The yellow post - it notes , glowing with the thoughts of the day , were glued to the shelves of his bulky library .


fn_spacy_tokens_for_baseline: So solving the difficulty involves a combination of understanding with memorisation of particular examples .

source_bert_toks: so solving the difficulty involves a combination of understanding with memo ##ris ##ation of particular examples .

reference_raw: Solving the problem requires a combination of understanding and memory of specific examples.

reference_spacy_tokens: Solving the problem requires a combination of understanding and memory of specific examples .


fn_spacy_tokens_for_baseline: Suddenly , the pole thumped so hard into an unseen object it almost dislodged Maggie .

source_bert_toks: suddenly , the pole thumped so hard into an unseen object it almost di ##sl ##od ##ged maggie .

reference_raw: Suddenly the pole slammed so hard into an invisible object that it almost knocked Maggie out.

reference_spacy_tokens: Suddenly the pole slammed so hard into an invisible object that it almost knocked Maggie out .


fn_spacy_tokens_for_baseline: During the spring and autumn festivals , when people traditionally seek out the hilltops , the throngs are so large you would be better advised to try another time .

source_bert_toks: during the spring and autumn festivals , when people traditionally seek out the hilltop ##s , the th ##rong ##s are so large you would be better advised to try another time .

reference_raw: During the summer and autumn festivals, when people traditionally look for hilltops, the crowds are so big that you'd better try again.

reference_spacy_tokens: During the summer and autumn festivals , when people traditionally look for hilltops , the crowds are so big that you 'd better try again .


fn_spacy_tokens_for_baseline: While I did not attend the trial -- I was lucky to be able to read your highly amusing and informative dispatches , several of which made me spit up my lunch laughing -- it certainly seemed as if the image of Bill Gates took a beating and the insular culture of Microsoft did not look so good .

source_bert_toks: while i did not attend the trial - - i was lucky to be able to read your highly amusing and inform ##ative dispatch ##es , several of which made me spit up my lunch laughing - - it certainly seemed as if the image of bill gates took a beating and the ins ##ular culture of microsoft did not look so good .

reference_raw: Even though I didn't attend the trial-I was fortunate enough to read your highly amusing and informative dispatches, some of which made me spat my lunch laughing-it certainly seemed to me that Bill Gates had been beaten and Microsoft's insular culture didn't look so good.

reference_spacy_tokens: Even though I did n't attend the trial - I was fortunate enough to read your highly amusing and informative dispatches , some of which made me spat my lunch laughing - it certainly seemed to me that Bill Gates had been beaten and Microsoft 's insular culture did n't look so good .


fn_spacy_tokens_for_baseline: Two smaller " cascades " of centrifuges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since November without using any uranium gas , according to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) .

source_bert_toks: two smaller " cascade ##s " of cent ##ri ##fu ##ges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since november without using any uranium gas , according to ap ( george ja ##hn , associated press / houston chronicle , feb . 2 ) .

reference_raw: According to AP (George Jahn, Associated Press/Houston Chronicle, Feb. 2), two smaller "cascades" of centrifuges have been in operation on the site since last year, and a smaller set of machines have been tested underground since November without the use of uranium gas.

reference_spacy_tokens: According to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) , two smaller " cascades " of centrifuges have been in operation on the site since last year , and a smaller set of machines have been tested underground since November without the use of uranium gas .


fn_spacy_tokens_for_baseline: In August 2002 , China issued regulations and a control list restricting the export of missiles and missile technology .

source_bert_toks: in august 2002 , china issued regulations and a control list restricting the export of missiles and missile technology .

reference_raw: In August 2002, China issued regulations and checklists limiting exports of missile and missile technology.

reference_spacy_tokens: In August 2002 , China issued regulations and checklists limiting exports of missile and missile technology .


fn_spacy_tokens_for_baseline: Sometimes the waltzer whirls in a graveyard , sometimes in an empty house , encircled by a ring of shadows , who flap their wings to keep time .

source_bert_toks: sometimes the waltz ##er w ##hir ##ls in a graveyard , sometimes in an empty house , encircled by a ring of shadows , who flap their wings to keep time .

reference_raw: Sometimes the waltzer spins in a cemetery, sometimes in an empty house, surrounded by a circle of shadows that flaps their wings to keep up.

reference_spacy_tokens: Sometimes the waltzer spins in a cemetery , sometimes in an empty house , surrounded by a circle of shadows that flaps their wings to keep up .


fn_spacy_tokens_for_baseline: They may view extreme violence as divinely sanctioned and the fulfillment of God 's commandments .

source_bert_toks: they may view extreme violence as divine ##ly sanctioned and the fulfillment of god ' s command ##ments .

reference_raw: They may consider extreme violence to be divinely sanctioned and to comply with God's commandments.

reference_spacy_tokens: They may consider extreme violence to be divinely sanctioned and to comply with God 's commandments .


fn_spacy_tokens_for_baseline: Third - quarter results included net realized capital gains of $ 48 million , which included $ 27 million from the sale of Federated Investors in August and a $ 15 million tax credit .

source_bert_toks: third - quarter results included net realized capital gains of $ 48 million , which included $ 27 million from the sale of fed ##erated investors in august and a $ 15 million tax credit .

reference_raw: Third-quarter results included net realised equity gains of $48 million, including 27 million from the sale of federal investors in August and a tax credit of $15 million.

reference_spacy_tokens: Third - quarter results included net realised equity gains of $ 48 million , including 27 million from the sale of federal investors in August and a tax credit of $ 15 million .


fn_spacy_tokens_for_baseline: She wondered if it was accessible and scanned the trees for signs of a coombe .

source_bert_toks: she wondered if it was accessible and scanned the trees for signs of a co ##om ##be .

reference_raw: Wondering if it was available, she scanned the trees for signs of a coomb.

reference_spacy_tokens: Wondering if it was available , she scanned the trees for signs of a coomb .


fn_spacy_tokens_for_baseline: He 's only a so - so golfer , but today of all days he gets a hole in one !

source_bert_toks: he ' s only a so - so golfer , but today of all days he gets a hole in one !

reference_raw: He's just such a golfer, but today, of all days, he's got a hole in one of them!

reference_spacy_tokens: He 's just such a golfer , but today , of all days , he 's got a hole in one of them !


fn_spacy_tokens_for_baseline: He drove to a favourite spot and walked , in the late afternoon , up the long flank of a hillside , in the lea of an old hedgebank .

source_bert_toks: he drove to a favourite spot and walked , in the late afternoon , up the long flank of a hillside , in the lea of an old hedge ##bank .

reference_raw: He drove to his favorite place and, late in the afternoon, walked up the long side of the hill to the foot of the old hedgebank.

reference_spacy_tokens: He drove to his favorite place and , late in the afternoon , walked up the long side of the hill to the foot of the old hedgebank .


fn_spacy_tokens_for_baseline: Guy heard the sound of bad - tempered heels clacking away across flagstones , and relaxed slightly .

source_bert_toks: guy heard the sound of bad - tempered heels cl ##ack ##ing away across flags ##tones , and relaxed slightly .

reference_raw: Guy heard the sound of bad-tempered heels clattering over the flagstones and relaxed a little.

reference_spacy_tokens: Guy heard the sound of bad - tempered heels clattering over the flagstones and relaxed a little .


fn_spacy_tokens_for_baseline: The art of change - ringing is peculiar to the English , and , like most English peculiarities , unintelligible to the rest of the world .

source_bert_toks: the art of change - ringing is peculiar to the english , and , like most english peculiar ##ities , un ##int ##elli ##gible to the rest of the world .

reference_raw: The art of changing rings is peculiar to the English and, like most English specialities, is incomprehensible to the rest of the world.

reference_spacy_tokens: The art of changing rings is peculiar to the English and , like most English specialities , is incomprehensible to the rest of the world .


fn_spacy_tokens_for_baseline: The deer was drowned in a lake .

source_bert_toks: the deer was drowned in a lake .

reference_raw: The deer was sunk in the lake.

reference_spacy_tokens: The deer was sunk in the lake .


fn_spacy_tokens_for_baseline: Waters reversed the Shogun and did a backward handbrake turn , shooting off in a cloud of exhaust fumes and clods of grass and earth .

source_bert_toks: waters reversed the sho ##gun and did a backward hand ##bra ##ke turn , shooting off in a cloud of exhaust fu ##mes and cl ##ods of grass and earth .

reference_raw: Waters turned the Shogun and reversed the handbrake, blasting away in a cloud of exhaust fumes and clouds of grass and earth.

reference_spacy_tokens: Waters turned the Shogun and reversed the handbrake , blasting away in a cloud of exhaust fumes and clouds of grass and earth .


fn_spacy_tokens_for_baseline: Try to remember to put your jewellery on last when getting ready ; hairsprays , nail enamels and make - up could tarnish the gold and also you might catch rings on zip fasteners or earrings and necklaces on clothing .

source_bert_toks: try to remember to put your jewellery on last when getting ready ; hairs ##pr ##ays , nail enamel ##s and make - up could tar ##nish the gold and also you might catch rings on zip fast ##ener ##s or earrings and necklace ##s on clothing .

reference_raw: Try to remember to put your jewelry on when you're ready; hairsprays, nail enamels, and makeup can stain gold, and you can also catch rings on zip fasteners or earrings and necklaces on clothes.

reference_spacy_tokens: Try to remember to put your jewelry on when you 're ready ; hairsprays , nail enamels , and makeup can stain gold , and you can also catch rings on zip fasteners or earrings and necklaces on clothes .


fn_spacy_tokens_for_baseline: The monks , bearded and serious , passed in their black robes and cowls like cats on padded feet .

source_bert_toks: the monks , bearded and serious , passed in their black robes and cow ##ls like cats on padded feet .

reference_raw: The monks, bearded and serious, walked around in their black robes and hoods like cats on stuffed feet.

reference_spacy_tokens: The monks , bearded and serious , walked around in their black robes and hoods like cats on stuffed feet .


fn_spacy_tokens_for_baseline: Harry_Reed : This investigation has been stymied stopped , obstructions thrown up every step of the way .

source_bert_toks: harry _ reed : this investigation has been st ##ym ##ied stopped , obstruction ##s thrown up every step of the way .

reference_raw: Harry_Reed: This investigation has been stymied, obstacles thrown up every step of the way.

reference_spacy_tokens: Harry_Reed : This investigation has been stymied , obstacles thrown up every step of the way .


fn_spacy_tokens_for_baseline: She awoke from a light drowse to the distant strains of Tchaikovsky 's Violin Concerto , the lyrical theme of the first movement .

source_bert_toks: she awoke from a light dr ##ows ##e to the distant strains of tchaikovsky ' s violin concerto , the lyrical theme of the first movement .

reference_raw: She awoke from a faint sleep to the distant strains of Tchaikovsky's Violin Concerto, the lyrical theme of the first movement.

reference_spacy_tokens: She awoke from a faint sleep to the distant strains of Tchaikovsky 's Violin Concerto , the lyrical theme of the first movement .


fn_spacy_tokens_for_baseline: Additionally , AIDS statistics have become increasingly worrisome .

source_bert_toks: additionally , aids statistics have become increasingly wo ##rri ##some .

reference_raw: Moreover, AIDS statistics are becoming more and more worrying.

reference_spacy_tokens: Moreover , AIDS statistics are becoming more and more worrying .


fn_spacy_tokens_for_baseline: There is nothing upon which we can apply for a warrant .

source_bert_toks: there is nothing upon which we can apply for a warrant .

reference_raw: There's nothing to ask for permission.

reference_spacy_tokens: There 's nothing to ask for permission .


fn_spacy_tokens_for_baseline: But it is unfair to dump on teachers , as distinct from the educational establishment .

source_bert_toks: but it is unfair to dump on teachers , as distinct from the educational establishment .

reference_raw: But it's not fair to dump on teachers that are different from the school.

reference_spacy_tokens: But it 's not fair to dump on teachers that are different from the school .


fn_spacy_tokens_for_baseline: PHOTOGRAPHY magazine will endeavour to return all entries if accompanied by a stamped addressed envelope .

source_bert_toks: photography magazine will endeavour to return all entries if accompanied by a stamped addressed envelope .

reference_raw: PHOTOGRAPHY Magazine will attempt to return all entries when accompanied by a stamped envelope.

reference_spacy_tokens: PHOTOGRAPHY Magazine will attempt to return all entries when accompanied by a stamped envelope .


fn_spacy_tokens_for_baseline: It lay over there with the gold helm made in Germany to replace the helm of Canute 's that had blown in pearls to the wind , beading the ashes of his forebears ' great hall at Orphir .

source_bert_toks: it lay over there with the gold helm made in germany to replace the helm of can ##ute ' s that had blown in pearls to the wind , bea ##ding the ashes of his fore ##be ##ars ' great hall at or ##phi ##r .

reference_raw: He lay there, wearing a golden helmet made in Germany to replace Canute's helmet, which blew into the wind in pearls, and carried the ashes of the great hall of his ancestors in Orphir.

reference_spacy_tokens: He lay there , wearing a golden helmet made in Germany to replace Canute 's helmet , which blew into the wind in pearls , and carried the ashes of the great hall of his ancestors in Orphir .


fn_spacy_tokens_for_baseline: The Senate majority leader , George J. Mitchell , described the decision as a ' historic vote ' , noting that the Senate had never agreed to put any limits on nuclear testing before .

source_bert_toks: the senate majority leader , george j . mitchell , described the decision as a ' historic vote ' , noting that the senate had never agreed to put any limits on nuclear testing before .

reference_raw: The Senate's majority leader, George J. Mitchell, described the decision as a "historical vote" and noted that the Senate had never consented to restrict nuclear testing.

reference_spacy_tokens: The Senate 's majority leader , George J. Mitchell , described the decision as a " historical vote " and noted that the Senate had never consented to restrict nuclear testing .


fn_spacy_tokens_for_baseline: She ducked her head in , and tried to go deeper before making towards the fallen flare .

source_bert_toks: she ducked her head in , and tried to go deeper before making towards the fallen flare .

reference_raw: She lowered her head and tried to get deeper before she made her way to the fallen flare.

reference_spacy_tokens: She lowered her head and tried to get deeper before she made her way to the fallen flare .


fn_spacy_tokens_for_baseline: The room was festooned with cobwebs , the air musty and thick with dust and disuse .

source_bert_toks: the room was fest ##oon ##ed with co ##b ##we ##bs , the air must ##y and thick with dust and di ##sus ##e .

reference_raw: The room was littered with spiderwebs, the air stale and thick with dust and disuse.

reference_spacy_tokens: The room was littered with spiderwebs , the air stale and thick with dust and disuse .


fn_spacy_tokens_for_baseline: She had done acid once , at college , and it had not been anything like this evening 's entertainment .

source_bert_toks: she had done acid once , at college , and it had not been anything like this evening ' s entertainment .

reference_raw: She'd made acid once in college, and it wasn't like tonight's fun.

reference_spacy_tokens: She 'd made acid once in college , and it was n't like tonight 's fun .


fn_spacy_tokens_for_baseline: Some members also believe that setting up a faculty would be tantamount to handing auditing on a plate to those critics of the profession who have called for auditing matters to be placed under independent control .

source_bert_toks: some members also believe that setting up a faculty would be tan ##tam ##ount to handing audit ##ing on a plate to those critics of the profession who have called for audit ##ing matters to be placed under independent control .

reference_raw: Some Members also believe that the establishment of a faculty would amount to the handing over of audits to critics of the profession who have called for the audit of matters to be subject to independent control.

reference_spacy_tokens: Some Members also believe that the establishment of a faculty would amount to the handing over of audits to critics of the profession who have called for the audit of matters to be subject to independent control .


fn_spacy_tokens_for_baseline: It runs out frantically now and then , and is clearly pretty distressed .

source_bert_toks: it runs out frantically now and then , and is clearly pretty distressed .

reference_raw: He runs out of it from time to time, and he's obviously very upset.

reference_spacy_tokens: He runs out of it from time to time , and he 's obviously very upset .


fn_spacy_tokens_for_baseline: Master locksmiths can make duplicates of most keys -- including those for cars , safes , padlocks , etc .

source_bert_toks: master locks ##mith ##s can make duplicate ##s of most keys - - including those for cars , safe ##s , pad ##lock ##s , etc .

reference_raw: The master locksmiths can make copies of most keys - including cars, safes, padlocks, etc.

reference_spacy_tokens: The master locksmiths can make copies of most keys - including cars , safes , padlocks , etc .


fn_spacy_tokens_for_baseline: Balor let out a bellow of fear and , in the same moment , the Trees closed in .

source_bert_toks: bal ##or let out a bell ##ow of fear and , in the same moment , the trees closed in .

reference_raw: Balor let out a cry of fear, and at the same time the trees closed in.

reference_spacy_tokens: Balor let out a cry of fear , and at the same time the trees closed in .


fn_spacy_tokens_for_baseline: He laughed softly , and it tickled up her spine .

source_bert_toks: he laughed softly , and it tick ##led up her spine .

reference_raw: He laughed softly, and it twitched on her back.

reference_spacy_tokens: He laughed softly , and it twitched on her back .


fn_spacy_tokens_for_baseline: QN : Are 22 million people employed in agriculture ?

source_bert_toks: q ##n : are 22 million people employed in agriculture ?

reference_raw: QN: Do 22 million people work in agriculture?

reference_spacy_tokens: QN : Do 22 million people work in agriculture ?


fn_spacy_tokens_for_baseline: 24 BILL : - and come up with a reason to go down .

source_bert_toks: 24 bill : - and come up with a reason to go down .

reference_raw: 24 BILL: - and find a reason to go down.

reference_spacy_tokens: 24 BILL : - and find a reason to go down .


fn_spacy_tokens_for_baseline: How Northampton people amused themselves , strolling players to modern day entertainment .

source_bert_toks: how northampton people amused themselves , stroll ##ing players to modern day entertainment .

reference_raw: How the people of Northampton enjoy themselves, walking the players to the modern entertainment of the day.

reference_spacy_tokens: How the people of Northampton enjoy themselves , walking the players to the modern entertainment of the day .


fn_spacy_tokens_for_baseline: Even dynamic centre - forward Kenny Mentle was found to be flat - footed and short - sighted .

source_bert_toks: even dynamic centre - forward kenny men ##tle was found to be flat - footed and short - sighted .

reference_raw: Even the dynamic center front of Kenny Mentle was found flatfooted and short-sighted.

reference_spacy_tokens: Even the dynamic center front of Kenny Mentle was found flatfooted and short - sighted .


fn_spacy_tokens_for_baseline: The river also irrigates the carefully tended surrounding farmlands , creating a beautifully lush , subtropical scene .

source_bert_toks: the river also ir ##ri ##gate ##s the carefully tended surrounding farmland ##s , creating a beautifully lush , subtropical scene .

reference_raw: The river also irrigates the well-tended surrounding farmlands and creates a beautifully luxurious subtropical scene.

reference_spacy_tokens: The river also irrigates the well - tended surrounding farmlands and creates a beautifully luxurious subtropical scene .


fn_spacy_tokens_for_baseline: Armlets and wrist - rings tattling answer shrill ;

source_bert_toks: arm ##lets and wrist - rings ta ##tt ##ling answer shrill ;

reference_raw: The bracelets and wrist rings tattling the reply sharply;

reference_spacy_tokens: The bracelets and wrist rings tattling the reply sharply ;


fn_spacy_tokens_for_baseline: The casinos have no admission charge and formal dress is optional , though long pants for men are required .

source_bert_toks: the casinos have no admission charge and formal dress is optional , though long pants for men are required .

reference_raw: Casinos have no admission fee and formal clothing is optional, although long trousers are needed for men.

reference_spacy_tokens: Casinos have no admission fee and formal clothing is optional , although long trousers are needed for men .


fn_spacy_tokens_for_baseline: If you have n't got a tremolo arm fitted on your guitar , then you can simulate the effect by playing one fret down and using a normal ' bend up ' into the required note .

source_bert_toks: if you haven ' t got a tre ##mo ##lo arm fitted on your guitar , then you can simulate the effect by playing one fr ##et down and using a normal ' bend up ' into the required note .

reference_raw: If you don't have a tremolo arm attached to your guitar, you can imitate the effect by playing one fret down and using a normal 'bend up' to the required note.

reference_spacy_tokens: If you do n't have a tremolo arm attached to your guitar , you can imitate the effect by playing one fret down and using a normal ' bend up ' to the required note .


fn_spacy_tokens_for_baseline: The setting sun flickered through the trunks of the palm trees along the track , disappearing into haze before it reached the horizon .

source_bert_toks: the setting sun flickered through the trunks of the palm trees along the track , disappearing into haze before it reached the horizon .

reference_raw: The setting sun flashed through the trunks of the palm trees along the track, disappearing into the mist before it reached the horizon.

reference_spacy_tokens: The setting sun flashed through the trunks of the palm trees along the track , disappearing into the mist before it reached the horizon .


fn_spacy_tokens_for_baseline: Karamanlis said , " This is a day of national mourning ... I wish to express my deep grief over the lost lives ... We are fighting against heavy odds , on many fronts and under particularly tough conditions . "

source_bert_toks: kara ##man ##lis said , " this is a day of national mourning . . . i wish to express my deep grief over the lost lives . . . we are fighting against heavy odds , on many fronts and under particularly tough conditions . "

reference_raw: Karamanlis said, "This is a day of national sorrow, and I would like to express my deep sorrow for the loss of our lives, and we fight against great odds, on many fronts, and in particularly difficult circumstances."

reference_spacy_tokens: Karamanlis said , " This is a day of national sorrow , and I would like to express my deep sorrow for the loss of our lives , and we fight against great odds , on many fronts , and in particularly difficult circumstances . "


fn_spacy_tokens_for_baseline: In the other were a pair of brooches ornamented with silver wire , silver hairpins , a plaited silver wire chain , a glass linen smoother and other relics .

source_bert_toks: in the other were a pair of bro ##oche ##s or ##name ##nted with silver wire , silver hair ##pins , a pl ##ai ##ted silver wire chain , a glass linen smooth ##er and other relics .

reference_raw: The other was a pair of silver-wired brooches, silver-haired pins, a silver-wired chain, a glass-linen smoother, and other relics.

reference_spacy_tokens: The other was a pair of silver - wired brooches , silver - haired pins , a silver - wired chain , a glass - linen smoother , and other relics .


fn_spacy_tokens_for_baseline: The lack of liability in unlawful act manslaughter for an omission which caused death has been criticised on the grounds that an omission , especially a deliberate one , is blameworthy , and it can cause death .

source_bert_toks: the lack of liability in unlawful act mans ##lau ##ght ##er for an om ##iss ##ion which caused death has been criticised on the grounds that an om ##iss ##ion , especially a deliberate one , is blame ##worthy , and it can cause death .

reference_raw: The non-responsibility of the unlawful act of killing for the omission giving rise to death is criticised for the fact that the omission, in particular the intentional one, is imputable and may cause death.

reference_spacy_tokens: The non - responsibility of the unlawful act of killing for the omission giving rise to death is criticised for the fact that the omission , in particular the intentional one , is imputable and may cause death .


fn_spacy_tokens_for_baseline: He cackled as he told me of his plan .

source_bert_toks: he ca ##ckle ##d as he told me of his plan .

reference_raw: When he told me about his plan, he chuckled.

reference_spacy_tokens: When he told me about his plan , he chuckled .


fn_spacy_tokens_for_baseline: Fortunately his calculations were accurate and the chemistry department at Manchester is still just about intact .

source_bert_toks: fortunately his calculations were accurate and the chemistry department at manchester is still just about intact .

reference_raw: Luckily, his calculations were correct, and the chemistry department in Manchester is still almost untouched.

reference_spacy_tokens: Luckily , his calculations were correct , and the chemistry department in Manchester is still almost untouched .


fn_spacy_tokens_for_baseline: The stage is set for a showdown over a new constitution for Russia .

source_bert_toks: the stage is set for a showdown over a new constitution for russia .

reference_raw: The stage is set for the demonstration of the new constitution for Russia.

reference_spacy_tokens: The stage is set for the demonstration of the new constitution for Russia .


fn_spacy_tokens_for_baseline: The sky was darkening , and no breeze disturbing the trees , so Juliet slipped on her red raincoat over her jeans and cream shirt .

source_bert_toks: the sky was darkening , and no breeze disturbing the trees , so juliet slipped on her red rain ##coat over her jeans and cream shirt .

reference_raw: The sky was dark and the trees were not disturbed by the wind, so Juliet put on a red raincoat over her jeans and a cream shirt.

reference_spacy_tokens: The sky was dark and the trees were not disturbed by the wind , so Juliet put on a red raincoat over her jeans and a cream shirt .


fn_spacy_tokens_for_baseline: But such heady progress would soon come to a halt .

source_bert_toks: but such head ##y progress would soon come to a halt .

reference_raw: But such heady progress would soon stop.

reference_spacy_tokens: But such heady progress would soon stop .


fn_spacy_tokens_for_baseline: She was in her warmup kit of white tank top , running shorts , red legwarmers , and basketball shoes .

source_bert_toks: she was in her warm ##up kit of white tank top , running shorts , red leg ##war ##mers , and basketball shoes .

reference_raw: She was wearing a white tank top warm-up kit, wearing shorts, red leg-warmers, and basketball boots.

reference_spacy_tokens: She was wearing a white tank top warm - up kit , wearing shorts , red leg - warmers , and basketball boots .


fn_spacy_tokens_for_baseline: Corbett did not mind ; he broke off his constant walking for a meal of fish broiled in milk and herbs , then returned to his task .

source_bert_toks: corbett did not mind ; he broke off his constant walking for a meal of fish bro ##iled in milk and herbs , then returned to his task .

reference_raw: Corbett didn't mind; he stopped walking constantly for a meal of fish boiled in milk and herbs and went back to work.

reference_spacy_tokens: Corbett did n't mind ; he stopped walking constantly for a meal of fish boiled in milk and herbs and went back to work .


fn_spacy_tokens_for_baseline: One elderly woman , Anna Bencinich , the mother of Evelyn , was rescued by neighbors who helped her from the burning house .

source_bert_toks: one elderly woman , anna ben ##cini ##ch , the mother of evelyn , was rescued by neighbors who helped her from the burning house .

reference_raw: An older woman, Anna Bencinich, Evelyn's mother, was rescued by neighbors who helped her out of a burning house.

reference_spacy_tokens: An older woman , Anna Bencinich , Evelyn 's mother , was rescued by neighbors who helped her out of a burning house .


fn_spacy_tokens_for_baseline: Pour half into a charlotte russe tin or a 15 cm ( 6 ") cake tin and leave to set .

source_bert_toks: pour half into a charlotte russ ##e tin or a 15 cm ( 6 " ) cake tin and leave to set .

reference_raw: Pour half of it into a charlotte russe can or 15 cm (6 ") can of cake and go to the table.

reference_spacy_tokens: Pour half of it into a charlotte russe can or 15 cm ( 6 ") can of cake and go to the table .


fn_spacy_tokens_for_baseline: Meanwhile , however , he is shacked up with a girlfriend he calls the Monkey , who fulfills his sexual fantasies but leaves him living in fear of tabloid scandal .

source_bert_toks: meanwhile , however , he is shack ##ed up with a girlfriend he calls the monkey , who fulfill ##s his sexual fantasies but leaves him living in fear of tabloid scandal .

reference_raw: But in the meantime, he's shacked up with a friend he calls a monkey, who fulfills his sexual fantasies, but keeps him alive in fear of a tabloid scandal.

reference_spacy_tokens: But in the meantime , he 's shacked up with a friend he calls a monkey , who fulfills his sexual fantasies , but keeps him alive in fear of a tabloid scandal .


fn_spacy_tokens_for_baseline: It clunks into position and I sit on it to take off my shoes .

source_bert_toks: it cl ##unk ##s into position and i sit on it to take off my shoes .

reference_raw: It clings to position, and I sit on it to take off my boots.

reference_spacy_tokens: It clings to position , and I sit on it to take off my boots .


fn_spacy_tokens_for_baseline: Much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

source_bert_toks: much of it , of course , using the standards of top newspapers , can not be used since it is largely gossip we are repeating , although it certainly could make for some very good stories .

reference_raw: Most of it, of course, can't be used by the standards of the best newspapers, because it's mostly rumors that we repeat, though it can certainly make up some very good stories.

reference_spacy_tokens: Most of it , of course , ca n't be used by the standards of the best newspapers , because it 's mostly rumors that we repeat , though it can certainly make up some very good stories .


fn_spacy_tokens_for_baseline: She squatted down to read it , balancing on the balls of her feet .

source_bert_toks: she squat ##ted down to read it , balancing on the balls of her feet .

reference_raw: She crouched down to read it, resting on her feet' balls.

reference_spacy_tokens: She crouched down to read it , resting on her feet ' balls .


fn_spacy_tokens_for_baseline: There are several reasons why certain terrorist groups or individuals might favor the use of CBW over other kinds of weapons :

source_bert_toks: there are several reasons why certain terrorist groups or individuals might favor the use of cb ##w over other kinds of weapons :

reference_raw: There are several reasons why some terrorist groups or individuals may prefer the use of CBW to other types of weapons:

reference_spacy_tokens: There are several reasons why some terrorist groups or individuals may prefer the use of CBW to other types of weapons :


fn_spacy_tokens_for_baseline: And there are a lot of people who face these challenges every day of their lives .

source_bert_toks: and there are a lot of people who face these challenges every day of their lives .

reference_raw: And there are many people who face these challenges every day of their lives.

reference_spacy_tokens: And there are many people who face these challenges every day of their lives .


fn_spacy_tokens_for_baseline: Lately , as the southern city of Quetta has become increasingly unsafe for Afghan Taliban leaders , they have also been making the trek to Karachi to establish new cells , experts say .

source_bert_toks: lately , as the southern city of que ##tta has become increasingly unsafe for afghan taliban leaders , they have also been making the trek to karachi to establish new cells , experts say .

reference_raw: Recently, as the southern city of Quetta has become increasingly dangerous to Afghan Taliban leaders, they have also tried to build new cells in Karachi, experts say.

reference_spacy_tokens: Recently , as the southern city of Quetta has become increasingly dangerous to Afghan Taliban leaders , they have also tried to build new cells in Karachi , experts say .


fn_spacy_tokens_for_baseline: With a smock artfully covering his paunchy frame , Pavarotti , 56 , burst into golden - toned song .

source_bert_toks: with a sm ##ock art ##fully covering his pau ##nch ##y frame , pa ##var ##otti , 56 , burst into golden - toned song .

reference_raw: Pavarotti, 56 years old, smocked artfully over his stumpy frame, burst into a golden-toned song.

reference_spacy_tokens: Pavarotti , 56 years old , smocked artfully over his stumpy frame , burst into a golden - toned song .


fn_spacy_tokens_for_baseline: Stalin died in March 1953 and was succeeded by the moderate Malenkov , who was to be ousted by the raucous Khrushchev in February 1955 .

source_bert_toks: stalin died in march 1953 and was succeeded by the moderate male ##nko ##v , who was to be ousted by the ra ##uc ##ous k ##hr ##ush ##chev in february 1955 .

reference_raw: Stalin died in March 1953 and was succeeded by a moderate Malenkov, who was to be quenched by a raucous Khrushchev in February 1955.

reference_spacy_tokens: Stalin died in March 1953 and was succeeded by a moderate Malenkov , who was to be quenched by a raucous Khrushchev in February 1955 .


fn_spacy_tokens_for_baseline: Your speed in reporting , printing and distribution is highly commendable .

source_bert_toks: your speed in reporting , printing and distribution is highly com ##men ##dable .

reference_raw: Your speed in reporting, printing, and distribution is highly praiseworthy.

reference_spacy_tokens: Your speed in reporting , printing , and distribution is highly praiseworthy .


fn_spacy_tokens_for_baseline: Another possibility was Lotus , but Lotus 's Colin Chapman was notoriously stingy to his drivers .

source_bert_toks: another possibility was lotus , but lotus ' s colin chapman was notorious ##ly sting ##y to his drivers .

reference_raw: The other option was Lotus, but Lotus's Colin Chapman was notoriously stinging with his drivers.

reference_spacy_tokens: The other option was Lotus , but Lotus 's Colin Chapman was notoriously stinging with his drivers .


fn_spacy_tokens_for_baseline: ' I do n't trust anyone .

source_bert_toks: ' i don ' t trust anyone .

reference_raw: I believe no one.

reference_spacy_tokens: I believe no one .


fn_spacy_tokens_for_baseline: Barely able to remain upright , Aenarion staggered into the fray .

source_bert_toks: barely able to remain upright , ae ##nar ##ion staggered into the fray .

reference_raw: Barely able to stand upright, Aenarion stumbled into the fight.

reference_spacy_tokens: Barely able to stand upright , Aenarion stumbled into the fight .


fn_spacy_tokens_for_baseline: You can even connect a 5.25 ' diskette drive to the external drive port .

source_bert_toks: you can even connect a 5 . 25 ' disk ##ette drive to the external drive port .

reference_raw: You can also link the 5.25 disk drive to the external drive port.

reference_spacy_tokens: You can also link the 5.25 disk drive to the external drive port .


fn_spacy_tokens_for_baseline: Wildfires in California continued to spread on Tuesday , having burned more than 140,000 acres of land throughout the state and caused an estimated US$ 13 million worth of damage .

source_bert_toks: wild ##fires in california continued to spread on tuesday , having burned more than 140 , 000 acres of land throughout the state and caused an estimated us $ 13 million worth of damage .

reference_raw: On Tuesday, the wildfires in California continued to spread, burning over 140,000 acres of land across the country, causing an estimated $13 million worth of damage.

reference_spacy_tokens: On Tuesday , the wildfires in California continued to spread , burning over 140,000 acres of land across the country , causing an estimated $ 13 million worth of damage .


fn_spacy_tokens_for_baseline: Most obviously , water is an excellent building material : eminently flexible , but not very compressible .

source_bert_toks: most obviously , water is an excellent building material : eminent ##ly flexible , but not very com ##press ##ible .

reference_raw: Of course, water is an excellent building material: eminently elastic, but not very compressive.

reference_spacy_tokens: Of course , water is an excellent building material : eminently elastic , but not very compressive .


fn_spacy_tokens_for_baseline: It was a decent wage , an easy job , plenty of energy left over for rugby , for girls , for the play - acting in which he was becoming interested .

source_bert_toks: it was a decent wage , an easy job , plenty of energy left over for rugby , for girls , for the play - acting in which he was becoming interested .

reference_raw: It was a good wage, an easy job, and a lot of energy left for rugby, for the girls, for the play he was beginning to care about.

reference_spacy_tokens: It was a good wage , an easy job , and a lot of energy left for rugby , for the girls , for the play he was beginning to care about .


fn_spacy_tokens_for_baseline: Radical change was embraced most enthusiastically in Poland , Hungary and , after a critical interlude , in Czechoslovakia , whilst in East Germany there were moves towards reunification with the West .

source_bert_toks: radical change was embraced most enthusiastically in poland , hungary and , after a critical interlude , in czechoslovakia , whilst in east germany there were moves towards reunification with the west .

reference_raw: Radical change has been most enthusiastically accepted in Poland, Hungary and, following a critical intercourse, in Czechoslovakia, while in East Germany there have been steps towards reunification with the West.

reference_spacy_tokens: Radical change has been most enthusiastically accepted in Poland , Hungary and , following a critical intercourse , in Czechoslovakia , while in East Germany there have been steps towards reunification with the West .


fn_spacy_tokens_for_baseline: The streets are quite narrow , and thronged with people .

source_bert_toks: the streets are quite narrow , and th ##rong ##ed with people .

reference_raw: The streets are pretty narrow and crowded.

reference_spacy_tokens: The streets are pretty narrow and crowded .


fn_spacy_tokens_for_baseline: A few minutes later Sophie placed the tray on the low table beside Joanna and began to discuss the news of Helen 's engagement , but Joanna showed very little interest .

source_bert_toks: a few minutes later sophie placed the tray on the low table beside joanna and began to discuss the news of helen ' s engagement , but joanna showed very little interest .

reference_raw: A few minutes later Sophie placed the tray on the low table next to Joanna and began to talk about the news of Helen's involvement, but Joanna showed little interest in it.

reference_spacy_tokens: A few minutes later Sophie placed the tray on the low table next to Joanna and began to talk about the news of Helen 's involvement , but Joanna showed little interest in it .


fn_spacy_tokens_for_baseline: It was an empty palace which was stormed by the insurgents next day .

source_bert_toks: it was an empty palace which was stormed by the insurgents next day .

reference_raw: It was an empty palace that the rebels stormed the next day.

reference_spacy_tokens: It was an empty palace that the rebels stormed the next day .


fn_spacy_tokens_for_baseline: Geographically it is extremely diverse , with a central backbone of high mountains and hills blanketed with tropical rain - forest .

source_bert_toks: geographically it is extremely diverse , with a central backbone of high mountains and hills blanket ##ed with tropical rain - forest .

reference_raw: The geographical area is very diverse, with a central backbone of high mountains and hills covered with tropical rainforests.

reference_spacy_tokens: The geographical area is very diverse , with a central backbone of high mountains and hills covered with tropical rainforests .


fn_spacy_tokens_for_baseline: The statue and a small museum are on a peak , up 268 steps , above Po Lin Monastery .

source_bert_toks: the statue and a small museum are on a peak , up 268 steps , above po lin monastery .

reference_raw: The statue and the little museum are at the top of the mountain, up 268 steps, over the Monastery of Po Lin.

reference_spacy_tokens: The statue and the little museum are at the top of the mountain , up 268 steps , over the Monastery of Po Lin .


fn_spacy_tokens_for_baseline: I think it almost does not matter what the judge does since it 's clear that the balance of power is shifting again , although it not clear where it will land .

source_bert_toks: i think it almost does not matter what the judge does since it ' s clear that the balance of power is shifting again , although it not clear where it will land .

reference_raw: I think it almost doesn't matter what the judge does, because it's clear that the balance of power is changing again, even though it doesn't know where it's going to land.

reference_spacy_tokens: I think it almost does n't matter what the judge does , because it 's clear that the balance of power is changing again , even though it does n't know where it 's going to land .


fn_spacy_tokens_for_baseline: Surrounded by statues , carvings , and incense burners , here the faithful make their devotions and check their fortunes , and traditional funerary displays give a cheerful send - off to the recently departed .

source_bert_toks: surrounded by statues , carvings , and incense burn ##ers , here the faithful make their devotion ##s and check their fortunes , and traditional fun ##era ##ry displays give a cheerful send - off to the recently departed .

reference_raw: Surrounded by statues, carvings, and incense burners, the faithful here make their dedication and control their fortunes, and traditional funeral displays give a happy message to the recently departed.

reference_spacy_tokens: Surrounded by statues , carvings , and incense burners , the faithful here make their dedication and control their fortunes , and traditional funeral displays give a happy message to the recently departed .


fn_spacy_tokens_for_baseline: " Before I got to Goodwill , I was on a mission .

source_bert_toks: " before i got to goodwill , i was on a mission .

reference_raw: "I was on an assignment before I got to Goodwill.

reference_spacy_tokens: " I was on an assignment before I got to Goodwill .


fn_spacy_tokens_for_baseline: By this time , Mattie was feeling irked , not by Urquhart but by O'Neill .

source_bert_toks: by this time , matt ##ie was feeling ir ##ked , not by ur ##qu ##hart but by o ' neill .

reference_raw: Mattie felt irritated now, not by Urquhart, but by O'Neill.

reference_spacy_tokens: Mattie felt irritated now , not by Urquhart , but by O'Neill .


fn_spacy_tokens_for_baseline: The fascinating collection of artifacts pertaining showcases 6,000 years of Hong Kong 's history and Chinese culture .

source_bert_toks: the fascinating collection of artifacts pertaining showcases 6 , 000 years of hong kong ' s history and chinese culture .

reference_raw: A fascinating collection of artefacts related to exhibits 6,000 years of Hong Kong history and Chinese culture.

reference_spacy_tokens: A fascinating collection of artefacts related to exhibits 6,000 years of Hong Kong history and Chinese culture .


fn_spacy_tokens_for_baseline: I clasp the mahogany handle just as the door shivers its infection and walk down the crazy paving path as each stone vaporises one step behind me .

source_bert_toks: i clasp the mahogany handle just as the door shivers its infection and walk down the crazy paving path as each stone vapor ##ises one step behind me .

reference_raw: I clasp the mahogany handle just as the door shakes the infection and walks down the crazy paving path as every stone evaporates a step behind me.

reference_spacy_tokens: I clasp the mahogany handle just as the door shakes the infection and walks down the crazy paving path as every stone evaporates a step behind me .


fn_spacy_tokens_for_baseline: On top of all his other commitments , Lewis was writing the second volume of his space trilogy .

source_bert_toks: on top of all his other commitments , lewis was writing the second volume of his space trilogy .

reference_raw: On top of all his other commitments, Lewis wrote a second piece of his cosmic trilogy.

reference_spacy_tokens: On top of all his other commitments , Lewis wrote a second piece of his cosmic trilogy .


fn_spacy_tokens_for_baseline: The Avon , Conn. , company 's stock hit a high in 1983 after it unveiled its Adam home computer , but the product was plagued with glitches and the company 's fortunes plunged .

source_bert_toks: the avon , con ##n . , company ' s stock hit a high in 1983 after it unveiled its adam home computer , but the product was plagued with g ##lit ##ches and the company ' s fortunes plunged .

reference_raw: Avon, Conn., the company's stock went up in 1983 after revealing his Adam's home computer, but the product was plagued by slippages and the company's wealth went down.

reference_spacy_tokens: Avon , Conn. , the company 's stock went up in 1983 after revealing his Adam 's home computer , but the product was plagued by slippages and the company 's wealth went down .


fn_spacy_tokens_for_baseline: A few days short of his fifteenth birthday , Gert attempted suicide , cutting his wrist and jumping from a third - floor window .

source_bert_toks: a few days short of his fifteenth birthday , ge ##rt attempted suicide , cutting his wrist and jumping from a third - floor window .

reference_raw: A few days before his fifteenth birthday, Gert tried to kill himself, cut his wrist and leap out the window on the third floor.

reference_spacy_tokens: A few days before his fifteenth birthday , Gert tried to kill himself , cut his wrist and leap out the window on the third floor .


fn_spacy_tokens_for_baseline: You were a fish wife because your mother , or your granny , or your auntie was a fish wife .

source_bert_toks: you were a fish wife because your mother , or your granny , or your aunt ##ie was a fish wife .

reference_raw: You were a fish woman because your mother, or your grandmother, or your aunt was a fish woman.

reference_spacy_tokens: You were a fish woman because your mother , or your grandmother , or your aunt was a fish woman .


fn_spacy_tokens_for_baseline: They also provide extra fire power in when guards or other patrols are engaged in a gun battle .

source_bert_toks: they also provide extra fire power in when guards or other patrols are engaged in a gun battle .

reference_raw: They also provide additional firepower when the guards or other patrols are involved in a firefight.

reference_spacy_tokens: They also provide additional firepower when the guards or other patrols are involved in a firefight .


fn_spacy_tokens_for_baseline: She turned , the soggy , dripping plaster bandage in her hand , but he was gone , only the last swoosh of the swing door left to show he had ever been there .

source_bert_toks: she turned , the so ##ggy , dripping plaster bandage in her hand , but he was gone , only the last sw ##oo ##sh of the swing door left to show he had ever been there .

reference_raw: She turned around, a wet, dripping plaster bandage in her hand, but he was gone, and there was only the last sweep of the swing door to show that he had ever been there.

reference_spacy_tokens: She turned around , a wet , dripping plaster bandage in her hand , but he was gone , and there was only the last sweep of the swing door to show that he had ever been there .


fn_spacy_tokens_for_baseline: It celebrates the founding of Guangzhou , when five spirits rode their goats down from the celestial realm to present the inhabitants of the city with their very first grains of rice .

source_bert_toks: it celebrates the founding of guangzhou , when five spirits rode their goats down from the celestial realm to present the inhabitants of the city with their very first grains of rice .

reference_raw: It celebrates the founding of Guangzhou, when five spirits drove their goats from the Celestial Empire to bring their first grain of rice to the people of the city.

reference_spacy_tokens: It celebrates the founding of Guangzhou , when five spirits drove their goats from the Celestial Empire to bring their first grain of rice to the people of the city .


fn_spacy_tokens_for_baseline: Mills was suspected of having worked for the KGB .

source_bert_toks: mills was suspected of having worked for the kgb .

reference_raw: Mills was on suspicion of working for the KGB.

reference_spacy_tokens: Mills was on suspicion of working for the KGB .


fn_spacy_tokens_for_baseline: Several forest fires which have ruined well over ten thousand hectares of land are continuing to burn in the Spanish region of Galicia today .

source_bert_toks: several forest fires which have ruined well over ten thousand hectares of land are continuing to burn in the spanish region of galicia today .

reference_raw: In the Spanish region of Galicia, several forest fires that destroyed much more than 10,000 hectares of land continue to burn.

reference_spacy_tokens: In the Spanish region of Galicia , several forest fires that destroyed much more than 10,000 hectares of land continue to burn .


fn_spacy_tokens_for_baseline: Unemployment still is officially recorded at 16.5 % , the highest rate in Europe , although actual joblessness may be lower .

source_bert_toks: unemployment still is officially recorded at 16 . 5 % , the highest rate in europe , although actual job ##lessness may be lower .

reference_raw: Unemployment is still officially recorded at 16.5%, the highest rate in Europe, although real unemployment may be lower.

reference_spacy_tokens: Unemployment is still officially recorded at 16.5 % , the highest rate in Europe , although real unemployment may be lower .


fn_spacy_tokens_for_baseline: When later Dennis found the management using his invention in a production of Macbeth , he protested in anger that they had ' stolen his thunder ' .

source_bert_toks: when later dennis found the management using his invention in a production of macbeth , he protested in anger that they had ' stolen his thunder ' .

reference_raw: When Dennis later discovered that the management had been using his device to produce Macbeth, he protested angrily that they had 'stolen his thunder.'

reference_spacy_tokens: When Dennis later discovered that the management had been using his device to produce Macbeth , he protested angrily that they had ' stolen his thunder . '


fn_spacy_tokens_for_baseline: The city 's impact on the rock and pop music scene with the likes of U2 and Bob Geldof is well known -- there 's even a self - guided tour of their haunts .

source_bert_toks: the city ' s impact on the rock and pop music scene with the likes of u2 and bob gel ##do ##f is well known - - there ' s even a self - guided tour of their haunt ##s .

reference_raw: The city's impact on rock and pop music scenes like U2 and Bob Geldof is well-known - even a self-directed tour of their haunts.

reference_spacy_tokens: The city 's impact on rock and pop music scenes like U2 and Bob Geldof is well - known - even a self - directed tour of their haunts .


fn_spacy_tokens_for_baseline: The occasional cry of gulls and unexpected distant vistas will remind you that Dublin is by the sea , and the Wicklow mountains , which hold Dublin closely to the coast , are visible from everywhere .

source_bert_toks: the occasional cry of gu ##lls and unexpected distant vista ##s will remind you that dublin is by the sea , and the wi ##ck ##low mountains , which hold dublin closely to the coast , are visible from everywhere .

reference_raw: The occasional scream of gulls and unexpected distant vistas will remind you that Dublin is at sea and that the Wicklow Mountains, which hold Dublin close to the shore, can be seen everywhere.

reference_spacy_tokens: The occasional scream of gulls and unexpected distant vistas will remind you that Dublin is at sea and that the Wicklow Mountains , which hold Dublin close to the shore , can be seen everywhere .


fn_spacy_tokens_for_baseline: He stops , creases his brows and stares with closed eyelids into the distance , as if wrestling with some new concept .

source_bert_toks: he stops , cr ##ease ##s his brows and stares with closed eyelids into the distance , as if wrestling with some new concept .

reference_raw: He pauses, wrinkles his eyebrows and stares at the distance with his eyelids closed, as if he were struggling with a new concept.

reference_spacy_tokens: He pauses , wrinkles his eyebrows and stares at the distance with his eyelids closed , as if he were struggling with a new concept .


fn_spacy_tokens_for_baseline: Iran has traditionally felt insecure among its neighbors , first vis - a - vis Iraq , whom it considered its most immediate physical and ideological threat , and now that the Hussein regime is gone , the growing presence and influence of the United States .

source_bert_toks: iran has traditionally felt ins ##ecure among its neighbors , first vis - a - vis iraq , whom it considered its most immediate physical and ideological threat , and now that the hussein regime is gone , the growing presence and influence of the united states .

reference_raw: Iran has traditionally felt uncertain among its neighbours, first vis-à-vis Iraq, which it considers to be the most immediate physical and ideological threat, and now that the Hussein regime is gone, the growing presence and influence of the United States.

reference_spacy_tokens: Iran has traditionally felt uncertain among its neighbours , first vis - a - vis Iraq , which it considers to be the most immediate physical and ideological threat , and now that the Hussein regime is gone , the growing presence and influence of the United States .


fn_spacy_tokens_for_baseline: I said loudly and desperately , wondering if my father could see my goosebumps .

source_bert_toks: i said loudly and desperately , wondering if my father could see my goose ##bu ##mps .

reference_raw: I said it loudly and desperately, wondering if my father would see my goose bumps.

reference_spacy_tokens: I said it loudly and desperately , wondering if my father would see my goose bumps .


fn_spacy_tokens_for_baseline: Kagemni , who was the vizier of the Sixth Dynasty king Teti , was buried in a fine tomb at Saqqara near the pyramid of his king and was revered as a sage .

source_bert_toks: ka ##ge ##m ##ni , who was the viz ##ier of the sixth dynasty king te ##ti , was buried in a fine tomb at sa ##q ##qa ##ra near the pyramid of his king and was revered as a sage .

reference_raw: Kagemni, who was the vision of King Teti's sixth dynasty, was buried in a beautiful tomb in Saqqara near his king's pyramid and worshipped as a sage.

reference_spacy_tokens: Kagemni , who was the vision of King Teti 's sixth dynasty , was buried in a beautiful tomb in Saqqara near his king 's pyramid and worshipped as a sage .


fn_spacy_tokens_for_baseline: Mrs Mantini did not upbraid her , but she pursed her tangerine lips and made a great thing of getting ready to go out in a hurry .

source_bert_toks: mrs man ##tin ##i did not up ##bra ##id her , but she pursed her tang ##erine lips and made a great thing of getting ready to go out in a hurry .

reference_raw: Mrs. Mantini didn't raise her, but she pursed her tangerine lips and prepared to leave in a hurry.

reference_spacy_tokens: Mrs. Mantini did n't raise her , but she pursed her tangerine lips and prepared to leave in a hurry .


fn_spacy_tokens_for_baseline: I have tried , but I am too wee to reach .

source_bert_toks: i have tried , but i am too wee to reach .

reference_raw: I tried, but I'm too wet to get there.

reference_spacy_tokens: I tried , but I 'm too wet to get there .


fn_spacy_tokens_for_baseline: It is exactly that : a few smudged traces of pencil on an elaborately matted and framed piece of paper .

source_bert_toks: it is exactly that : a few sm ##udged traces of pencil on an elaborate ##ly matt ##ed and framed piece of paper .

reference_raw: That's exactly what it is: a few blurs of pencil on an elaborately matted and framed piece of paper.

reference_spacy_tokens: That 's exactly what it is : a few blurs of pencil on an elaborately matted and framed piece of paper .


fn_spacy_tokens_for_baseline: Find where the old timers panned gold , and go to look for what they missed .

source_bert_toks: find where the old timer ##s pan ##ned gold , and go to look for what they missed .

reference_raw: Find out where the old timers panted the gold and find out what they missed.

reference_spacy_tokens: Find out where the old timers panted the gold and find out what they missed .


fn_spacy_tokens_for_baseline: They were like a great flock of gulls swooping to tear and gobble at their prey .

source_bert_toks: they were like a great flock of gu ##lls sw ##ooping to tear and go ##bble at their prey .

reference_raw: They were like a great flock of seagulls swooping to tear and swallow at their prey.

reference_spacy_tokens: They were like a great flock of seagulls swooping to tear and swallow at their prey .


fn_spacy_tokens_for_baseline: The aroma of drying fish hangs heavily and it is stifling .

source_bert_toks: the aroma of drying fish hangs heavily and it is st ##if ##ling .

reference_raw: The smell of drying fish is heavy and stifling.

reference_spacy_tokens: The smell of drying fish is heavy and stifling .


fn_spacy_tokens_for_baseline: By this time , the valley was in much the same geographic state as it exists in today , with one exception -- the presence of artesian springs that bubbled to the surface in several areas .

source_bert_toks: by this time , the valley was in much the same geographic state as it exists in today , with one exception - - the presence of arte ##sian springs that bubble ##d to the surface in several areas .

reference_raw: By that time, the valley was in much the same geographical state as it is now, with one exception: the presence of artesian springs that bubbled up in several areas.

reference_spacy_tokens: By that time , the valley was in much the same geographical state as it is now , with one exception : the presence of artesian springs that bubbled up in several areas .


fn_spacy_tokens_for_baseline: Starve the English host .

source_bert_toks: star ##ve the english host .

reference_raw: Hungry the English host.

reference_spacy_tokens: Hungry the English host .


fn_spacy_tokens_for_baseline: NOTHING in Neil Kinnock 's eight and half years as Labour leader so became the man as his dignified acceptance of his party 's calamitous general election defeat .

source_bert_toks: nothing in neil kin ##nock ' s eight and half years as labour leader so became the man as his dig ##nified acceptance of his party ' s cal ##ami ##tou ##s general election defeat .

reference_raw: In the eight-and-a-half years of Neil Kinnock's job leader, he had become a man as a dignified acceptance of his party's disastrous general election defeat.

reference_spacy_tokens: In the eight - and - a - half years of Neil Kinnock 's job leader , he had become a man as a dignified acceptance of his party 's disastrous general election defeat .


fn_spacy_tokens_for_baseline: And the fact that I am a small blonde is probably a bonus on this occasion .

source_bert_toks: and the fact that i am a small blonde is probably a bonus on this occasion .

reference_raw: And the fact that I'm a little blond is probably a bonus for the occasion.

reference_spacy_tokens: And the fact that I 'm a little blond is probably a bonus for the occasion .


fn_spacy_tokens_for_baseline: The statues in the main shrine represent Man , the god of literature , and Mo , the god of war , a curious juxtaposition .

source_bert_toks: the statues in the main shrine represent man , the god of literature , and mo , the god of war , a curious ju ##xt ##ap ##osition .

reference_raw: The sculptures in the main sanctum represent Man, the god of literature, and Mo, the god of war, a curious juxtaposition.

reference_spacy_tokens: The sculptures in the main sanctum represent Man , the god of literature , and Mo , the god of war , a curious juxtaposition .


fn_spacy_tokens_for_baseline: Chop the onions finely .

source_bert_toks: chop the onions finely .

reference_raw: Cut the onions nicely.

reference_spacy_tokens: Cut the onions nicely .


fn_spacy_tokens_for_baseline: There was particular interest around 1970 when companies were prosperous , stable and innovative ( IPM , 1972 , Patten , 1971 ) .

source_bert_toks: there was particular interest around 1970 when companies were prosperous , stable and innovative ( ip ##m , 1972 , pat ##ten , 1971 ) .

reference_raw: Around 1970, when companies were successful, stable and innovative (IPM, 1972, Patten, 1971), there was a particular interest.

reference_spacy_tokens: Around 1970 , when companies were successful , stable and innovative ( IPM , 1972 , Patten , 1971 ) , there was a particular interest .


fn_spacy_tokens_for_baseline: The vegetation within , protected from the dry air , begins to decay and the mound starts to warm .

source_bert_toks: the vegetation within , protected from the dry air , begins to decay and the mound starts to warm .

reference_raw: The vegetation inside, protected from the dry air, begins to decompose, and the heap begins to warm.

reference_spacy_tokens: The vegetation inside , protected from the dry air , begins to decompose , and the heap begins to warm .


fn_spacy_tokens_for_baseline: The basic elements of life in the Aegean began to come together as early as 5000 b.c . , and were already in place by the late Bronze Age ( c. 2700 b.c . ) .

source_bert_toks: the basic elements of life in the aegean began to come together as early as 5000 b . c . , and were already in place by the late bronze age ( c . 270 ##0 b . c . ) .

reference_raw: The basic elements of life in the Aegean began to gather at 5,000 b.c. and were already in place at the end of the Bronze Age (c. 2700 b.c.).

reference_spacy_tokens: The basic elements of life in the Aegean began to gather at 5,000 b.c . and were already in place at the end of the Bronze Age ( c. 2700 b.c . ) .


fn_spacy_tokens_for_baseline: College Green , the home of Trinity College , provides a natural focus just south of the O'Connell Street bridge .

source_bert_toks: college green , the home of trinity college , provides a natural focus just south of the o ' connell street bridge .

reference_raw: College Green, home of Trinity College, provides the natural center of attention just north of the O'Connell Street Bridge.

reference_spacy_tokens: College Green , home of Trinity College , provides the natural center of attention just north of the O'Connell Street Bridge .


fn_spacy_tokens_for_baseline: Rose was grooming the Charolais bull when Ballater decided some plain speaking was necessary .

source_bert_toks: rose was groom ##ing the char ##ola ##is bull when ball ##ater decided some plain speaking was necessary .

reference_raw: Rose was fixing the Charolais bull when Ballater decided that it was necessary to speak plainly.

reference_spacy_tokens: Rose was fixing the Charolais bull when Ballater decided that it was necessary to speak plainly .


fn_spacy_tokens_for_baseline: However , with uncommunicative buyers this may be difficult .

source_bert_toks: however , with un ##com ##mun ##icative buyers this may be difficult .

reference_raw: However, this can be difficult for non-communicative buyers.

reference_spacy_tokens: However , this can be difficult for non - communicative buyers .


fn_spacy_tokens_for_baseline: At that moment a youth sprinted past , tipped over her glass and splattered the tomato juice across the concrete .

source_bert_toks: at that moment a youth sprinted past , tipped over her glass and sp ##lat ##tered the tomato juice across the concrete .

reference_raw: At that moment a young man sprinted past her, tipped over her glass, and splashed the tomato juice on the concrete.

reference_spacy_tokens: At that moment a young man sprinted past her , tipped over her glass , and splashed the tomato juice on the concrete .


fn_spacy_tokens_for_baseline: His marriage to Aethelburh gave him a connection with cross - Channel diplomacy and his children by Aethelburh were kinsfolk of a Mer ovingian king in Gaul .

source_bert_toks: his marriage to ae ##the ##lb ##ur ##h gave him a connection with cross - channel diplomacy and his children by ae ##the ##lb ##ur ##h were kin ##sf ##ol ##k of a mer o ##ving ##ian king in gaul .

reference_raw: His marriage to Aethelburh had given him a connection to interchannel diplomacy, and Aethelburh's children were related to the King of Mer Ovingia in Gaul.

reference_spacy_tokens: His marriage to Aethelburh had given him a connection to interchannel diplomacy , and Aethelburh 's children were related to the King of Mer Ovingia in Gaul .


fn_spacy_tokens_for_baseline: The International Atomic Energy Association ( IAEA ) has assisted Syria on numerous projects including uranium exploration , uranium extraction from phosphoric acid , isotope production , construction of a cyclotron facility , development of nuclear research laboratories , and preparation for a nuclear power program .

source_bert_toks: the international atomic energy association ( ia ##ea ) has assisted syria on numerous projects including uranium exploration , uranium extraction from ph ##os ##ph ##oric acid , isotope production , construction of a cy ##cl ##ot ##ron facility , development of nuclear research laboratories , and preparation for a nuclear power program .

reference_raw: The International Atomic Energy Association (IAEA) has assisted Syria in a number of projects, including uranium exploration, phosphoric acid uranium extraction, isotope production, the construction of a cyclotron facility, the development of nuclear research laboratories and the preparation of a nuclear energy programme.

reference_spacy_tokens: The International Atomic Energy Association ( IAEA ) has assisted Syria in a number of projects , including uranium exploration , phosphoric acid uranium extraction , isotope production , the construction of a cyclotron facility , the development of nuclear research laboratories and the preparation of a nuclear energy programme .


fn_spacy_tokens_for_baseline: High heels pattered across the cloakroom floor and someone pushed at the toilet door .

source_bert_toks: high heels pat ##tered across the cloak ##room floor and someone pushed at the toilet door .

reference_raw: High heels clattered across the floor of the cloakroom, and someone pushed against the bathroom door.

reference_spacy_tokens: High heels clattered across the floor of the cloakroom , and someone pushed against the bathroom door .


fn_spacy_tokens_for_baseline: He scrunched his money up again , then went for Henry with both hands .

source_bert_toks: he sc ##run ##ched his money up again , then went for henry with both hands .

reference_raw: He scratched the money again and went to Henry with both hands.

reference_spacy_tokens: He scratched the money again and went to Henry with both hands .


fn_spacy_tokens_for_baseline: The cone begins to vibrate more and more -- then it explodes into thousands of fragments of light , which fall gently around you .

source_bert_toks: the cone begins to vi ##brate more and more - - then it explodes into thousands of fragments of light , which fall gently around you .

reference_raw: The cone begins to vibrate more and more - then explodes into a thousand pieces of light that fall gently around you.

reference_spacy_tokens: The cone begins to vibrate more and more - then explodes into a thousand pieces of light that fall gently around you .


fn_spacy_tokens_for_baseline: The bird had thudded against the wallpaper and started to flop downwards and then swooped round and up , seeming ignorant of the opening through which it had entered .

source_bert_toks: the bird had thud ##ded against the wall ##paper and started to flop downwards and then sw ##ooped round and up , seeming ignorant of the opening through which it had entered .

reference_raw: The bird thumped against the wallpaper and began to fall down, then swooped up and down, seemingly unaware of the opening through which it had entered.

reference_spacy_tokens: The bird thumped against the wallpaper and began to fall down , then swooped up and down , seemingly unaware of the opening through which it had entered .


fn_spacy_tokens_for_baseline: While Angel slept , Sarah planned her future with heartbreaking realism .

source_bert_toks: while angel slept , sarah planned her future with heartbreak ##ing realism .

reference_raw: While Angel slept, Sara planned her future with a heart-broken realism.

reference_spacy_tokens: While Angel slept , Sara planned her future with a heart - broken realism .


fn_spacy_tokens_for_baseline: ' So you 're adding forgery to your many other dubious talents . '

source_bert_toks: ' so you ' re adding forge ##ry to your many other dubious talents . '

reference_raw: "So you add counterfeiting to your many other dubious talents."

reference_spacy_tokens: " So you add counterfeiting to your many other dubious talents . "


fn_spacy_tokens_for_baseline: It was never completely black through that window .

source_bert_toks: it was never completely black through that window .

reference_raw: It's never been completely dark in that window.

reference_spacy_tokens: It 's never been completely dark in that window .


fn_spacy_tokens_for_baseline: I was talking to Maazel on the morning before the performance , having battled through a snowstorm that even Puccini , in all the Pelleas -like flurries of Fanciulla 's Second Act , could hardly have exaggerated .

source_bert_toks: i was talking to ma ##az ##el on the morning before the performance , having battled through a snow ##storm that even pu ##cci ##ni , in all the pe ##lle ##as - like flu ##rries of fan ##ci ##ulla ' s second act , could hardly have exaggerated .

reference_raw: The morning before the show I spoke to Maazel, who had fought through a storm that even Puccini, in all the Pelleas - like the flurries of the Second Act of Fanciulla, could hardly have exaggerated.

reference_spacy_tokens: The morning before the show I spoke to Maazel , who had fought through a storm that even Puccini , in all the Pelleas - like the flurries of the Second Act of Fanciulla , could hardly have exaggerated .


fn_spacy_tokens_for_baseline: Even if she had n't , the warnings had been there all along , right from his cavalier mockery in St Lucia , the first moment he saw her .

source_bert_toks: even if she hadn ' t , the warnings had been there all along , right from his cavalier mock ##ery in st lucia , the first moment he saw her .

reference_raw: Even if she hadn't, the warnings had been there the whole time, from the cavalier's ridicule in St Lucia, the first time he'd seen her.

reference_spacy_tokens: Even if she had n't , the warnings had been there the whole time , from the cavalier 's ridicule in St Lucia , the first time he 'd seen her .


fn_spacy_tokens_for_baseline: This designation provides companies with financial and regulatory benefits during the course of orphan drug development , including tax credits related to clinical trial expenses and a possible exemption from the FDA - user fee .

source_bert_toks: this designation provides companies with financial and regulatory benefits during the course of orphan drug development , including tax credits related to clinical trial expenses and a possible exemption from the fda - user fee .

reference_raw: The designation provides financial and regulatory benefits to companies during the development of orphan drugs, including tax credits related to clinical trial costs and a possible exemption from the FDA - user fee.

reference_spacy_tokens: The designation provides financial and regulatory benefits to companies during the development of orphan drugs , including tax credits related to clinical trial costs and a possible exemption from the FDA - user fee .


fn_spacy_tokens_for_baseline: Two smaller " cascades " of centrifuges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since November without using any uranium gas , according to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) .

source_bert_toks: two smaller " cascade ##s " of cent ##ri ##fu ##ges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since november without using any uranium gas , according to ap ( george ja ##hn , associated press / houston chronicle , feb . 2 ) .

reference_raw: According to AP (George Jahn, Associated Press/Houston Chronicle, Feb. 2), two smaller "cascades" of centrifuges have been operating on the site since the previous year, and a smaller set of machines have been tested underground since November without the use of uranium gas.

reference_spacy_tokens: According to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) , two smaller " cascades " of centrifuges have been operating on the site since the previous year , and a smaller set of machines have been tested underground since November without the use of uranium gas .


fn_spacy_tokens_for_baseline: Dispatches ( C4 ) went a lot further and , on the basis of British Rail 's own recent inquiries , came up with a luridly tangled tale of opportunism , misappropriation and downright fraud .

source_bert_toks: dispatch ##es ( c ##4 ) went a lot further and , on the basis of british rail ' s own recent inquiries , came up with a lu ##rid ##ly tangled tale of op ##port ##uni ##sm , mis ##app ##ropriation and down ##right fraud .

reference_raw: Dispatches (C4) went much further and, based on a recent investigation by British Rail, came up with a lurid tale of opportunism, abuse, and downright fraud.

reference_spacy_tokens: Dispatches ( C4 ) went much further and , based on a recent investigation by British Rail , came up with a lurid tale of opportunism , abuse , and downright fraud .


fn_spacy_tokens_for_baseline: Lucy paced , rampaged , flung out scads of unrequited ire , impassioned as Jay had never seen her .

source_bert_toks: lucy paced , rampage ##d , flung out sc ##ads of un ##re ##qui ##ted ir ##e , imp ##ass ##ioned as jay had never seen her .

reference_raw: Lucy paced, raging, throwing out the sheaths of unrequited ire, impassive as Jay had ever seen her.

reference_spacy_tokens: Lucy paced , raging , throwing out the sheaths of unrequited ire , impassive as Jay had ever seen her .


fn_spacy_tokens_for_baseline: Shales picked up one of the newspapers in front of him and pitched it down the table in Dowd 's direction .

source_bert_toks: shale ##s picked up one of the newspapers in front of him and pitched it down the table in dow ##d ' s direction .

reference_raw: Shales picked up a newspaper in front of him and tossed it to Dowd.

reference_spacy_tokens: Shales picked up a newspaper in front of him and tossed it to Dowd .


fn_spacy_tokens_for_baseline: ' I have to shred my garbage now , ' moans Cher .

source_bert_toks: ' i have to sh ##red my garbage now , ' moans cher .

reference_raw: 'I've got to tear up the trash now,' Cher groans.

reference_spacy_tokens: ' I 've got to tear up the trash now , ' Cher groans .


fn_spacy_tokens_for_baseline: The infantry regiment performed miracles : it got two truckloads of troops on the road to Barce only seven minutes after Schramm had asked for help .

source_bert_toks: the infantry regiment performed miracles : it got two truck ##load ##s of troops on the road to bar ##ce only seven minutes after sc ##hra ##mm had asked for help .

reference_raw: The infantry regiment had performed miracles: only seven minutes after Schramm had asked for help, he had received two trucks of soldiers on the way to Barce.

reference_spacy_tokens: The infantry regiment had performed miracles : only seven minutes after Schramm had asked for help , he had received two trucks of soldiers on the way to Barce .


fn_spacy_tokens_for_baseline: But people , especially when they ganged together into that mysterious thing called a crowd , were his liberation .

source_bert_toks: but people , especially when they gang ##ed together into that mysterious thing called a crowd , were his liberation .

reference_raw: But the people, especially when they joined the mysterious thing called the mob, were his liberation.

reference_spacy_tokens: But the people , especially when they joined the mysterious thing called the mob , were his liberation .


fn_spacy_tokens_for_baseline: The instrument ( the telescreen , it was called ) could be dimmed , but there was no way of shutting it off completely .

source_bert_toks: the instrument ( the tel ##es ##creen , it was called ) could be dim ##med , but there was no way of shutting it off completely .

reference_raw: The instrument (the telescreen, it was known) could be dimmed, but there was no way to shut it down altogether.

reference_spacy_tokens: The instrument ( the telescreen , it was known ) could be dimmed , but there was no way to shut it down altogether .


fn_spacy_tokens_for_baseline: Nina pulled her shawl so roughly from the hook on the door that she tore a hole in it .

source_bert_toks: nina pulled her shaw ##l so roughly from the hook on the door that she tore a hole in it .

reference_raw: Nina pulled the scarf so roughly from the hook on the door that she ripped a hole in it.

reference_spacy_tokens: Nina pulled the scarf so roughly from the hook on the door that she ripped a hole in it .


fn_spacy_tokens_for_baseline: The Protocols of the Elders of Zion were proved to be a forgery by The Times in 1921 and this went some way to defuse the growth of anti - semitic tendencies within the wider political culture .

source_bert_toks: the protocols of the elders of zion were proved to be a forge ##ry by the times in 1921 and this went some way to def ##use the growth of anti - semitic tendencies within the wider political culture .

reference_raw: In 1921, the protocols of the elders of Zion proved to be a falsification of the Times, which somehow defused the growth of anti-Semitic tendencies in a wider political culture.

reference_spacy_tokens: In 1921 , the protocols of the elders of Zion proved to be a falsification of the Times , which somehow defused the growth of anti - Semitic tendencies in a wider political culture .