fn_spacy_tokens_for_baseline: Here , a group of young Muslim girls in new mirror - work costumes were sitting cross - legged under the watchful eye of their father ; each one wore a tinsel hairband plaited into her pigtails .

source_bert_toks: here , a group of young muslim girls in new mirror - work costumes were sitting cross - legged under the watch ##ful eye of their father ; each one wore a tin ##sel hair ##band pl ##ai ##ted into her pig ##tails .

reference_raw: Here, a group of young Muslim girls in their new mirror costumes sat cross-legged under their father's watchful eyes, each of them wearing a tinsel of hair plaited in their tails.

reference_spacy_tokens: Here , a group of young Muslim girls in their new mirror costumes sat cross - legged under their father 's watchful eyes , each of them wearing a tinsel of hair plaited in their tails .


fn_spacy_tokens_for_baseline: There are now more adventurous ways of teaching and examining art and design , with greater emphasis on the educative value of the subject , particularly in developing critical and aesthetic judgements .

source_bert_toks: there are now more adventurous ways of teaching and examining art and design , with greater emphasis on the ed ##uca ##tive value of the subject , particularly in developing critical and aesthetic judgement ##s .

reference_raw: There are now more adventurous ways to teach and study art and design, with a greater focus on the educational value of the subject, in particular in the development of critical and aesthetic judgments.

reference_spacy_tokens: There are now more adventurous ways to teach and study art and design , with a greater focus on the educational value of the subject , in particular in the development of critical and aesthetic judgments .


fn_spacy_tokens_for_baseline: ' I was a skinhead before you were born , ' he would bellow , and only she knew how it hurt him .

source_bert_toks: ' i was a skin ##head before you were born , ' he would bell ##ow , and only she knew how it hurt him .

reference_raw: "Before you were born, I was a skinhead," he shouted, and only she knew how much it hurt him.

reference_spacy_tokens: " Before you were born , I was a skinhead , " he shouted , and only she knew how much it hurt him .


fn_spacy_tokens_for_baseline: ' Telford -- of course -- I 'd forgotten her sister 's married name is Telford .

source_bert_toks: ' tel ##ford - - of course - - i ' d forgotten her sister ' s married name is tel ##ford .

reference_raw: 'Telford - of course - I forgot her sister's wedding name was Telford.

reference_spacy_tokens: ' Telford - of course - I forgot her sister 's wedding name was Telford .


fn_spacy_tokens_for_baseline: A dresser holds a collection of old tins that once contained pills for headaches , stomach and liver ailments , concocted by Tim 's great - grandfather , a manufacturing chemist who set up in business in the 1880s .

source_bert_toks: a dresser holds a collection of old tin ##s that once contained pills for headache ##s , stomach and liver ai ##lm ##ents , con ##co ##cted by tim ' s great - grandfather , a manufacturing chemist who set up in business in the 1880s .

reference_raw: There's a collection of old cans in the closet that used to contain painkillers, stomach and liver disease, made up by Tim's great-grandfather, a manufacturing chemist who started his business in the 1880s.

reference_spacy_tokens: There 's a collection of old cans in the closet that used to contain painkillers , stomach and liver disease , made up by Tim 's great - grandfather , a manufacturing chemist who started his business in the 1880s .


fn_spacy_tokens_for_baseline: ' Congress derided President Truman 's domestic program , passed significant legislation over his veto and generally dismissed his hope of extending the Roosevelt New Deal into the Truman Fair Deal . '

source_bert_toks: ' congress der ##ided president truman ' s domestic program , passed significant legislation over his veto and generally dismissed his hope of extending the roosevelt new deal into the truman fair deal . '

reference_raw: Congress derailed President Truman's domestic program, passed a major law on his veto, and generally rejected his hopes of extending Roosevelt's new deal to the Truman Fair.

reference_spacy_tokens: Congress derailed President Truman 's domestic program , passed a major law on his veto , and generally rejected his hopes of extending Roosevelt 's new deal to the Truman Fair .


fn_spacy_tokens_for_baseline: Not so much a merciful touch , more likely a measure to prevent suddenly terror - stricken passengers from attempting to escape into the crowd .

source_bert_toks: not so much a mer ##ciful touch , more likely a measure to prevent suddenly terror - stricken passengers from attempting to escape into the crowd .

reference_raw: It was not so much a merciful touch, but rather a measure to prevent the sudden horror-stricken passengers from trying to escape into the crowd.

reference_spacy_tokens: It was not so much a merciful touch , but rather a measure to prevent the sudden horror - stricken passengers from trying to escape into the crowd .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multinational corporations and investments in the European Union mean that they have a lot of opportunities in their homes.

reference_spacy_tokens: And young graduates do n't leave now - multinational corporations and investments in the European Union mean that they have a lot of opportunities in their homes .


fn_spacy_tokens_for_baseline: Portugal 's resulting near - monopoly of East - West trade understandably awakened the competitive instincts of other European powers .

source_bert_toks: portugal ' s resulting near - monopoly of east - west trade understand ##ably awakened the competitive instincts of other european powers .

reference_raw: The result of Portugal's near-monopolis of the East-West Trade was understandably aroused by the competitive instincts of other European powers.

reference_spacy_tokens: The result of Portugal 's near - monopolis of the East - West Trade was understandably aroused by the competitive instincts of other European powers .


fn_spacy_tokens_for_baseline: Lunch consisted of garbure , a thick vegetable soup , followed by veal a la forestiere and pot - au - chocolat for dessert .

source_bert_toks: lunch consisted of ga ##rb ##ure , a thick vegetable soup , followed by ve ##al a la forest ##iere and pot - au - cho ##cola ##t for dessert .

reference_raw: The lunch consisted of a garbure, a thick vegetable broth, followed by a veal la forestiere and a pot-au-chocolat for dessert.

reference_spacy_tokens: The lunch consisted of a garbure , a thick vegetable broth , followed by a veal la forestiere and a pot - au - chocolat for dessert .


fn_spacy_tokens_for_baseline: He 's old , but he 's used to doing what he 's told .

source_bert_toks: he ' s old , but he ' s used to doing what he ' s told .

reference_raw: He's old, but he's used to doing what he's supposed to do.

reference_spacy_tokens: He 's old , but he 's used to doing what he 's supposed to do .


fn_spacy_tokens_for_baseline: In contrast , it would now be a consideration of primary and pervasive significance that the two epics were produced in quite different epochs and were , perhaps correspondingly , composed in quite different ways .

source_bert_toks: in contrast , it would now be a consideration of primary and per ##vas ##ive significance that the two epic ##s were produced in quite different epoch ##s and were , perhaps corresponding ##ly , composed in quite different ways .

reference_raw: On the other hand, it would now be necessary to take into account the primary and pervasive significance of the fact that the two epics were produced in quite different epochs and were, perhaps, in a very different way.

reference_spacy_tokens: On the other hand , it would now be necessary to take into account the primary and pervasive significance of the fact that the two epics were produced in quite different epochs and were , perhaps , in a very different way .


fn_spacy_tokens_for_baseline: He clutched onto Gillian 's hand with alarming gratitude , as if previously girls had always insisted on his wearing oven - gloves .

source_bert_toks: he clutched onto gillian ' s hand with alarm ##ing gratitude , as if previously girls had always insisted on his wearing oven - gloves .

reference_raw: He gripped Gillian's hand with alarming gratitude, as if the girls had always insisted on wearing oven gloves.

reference_spacy_tokens: He gripped Gillian 's hand with alarming gratitude , as if the girls had always insisted on wearing oven gloves .


fn_spacy_tokens_for_baseline: In that time more than 1.2 million jobs have been created and the official jobless rate has been pushed below 17 % from 21 % .

source_bert_toks: in that time more than 1 . 2 million jobs have been created and the official job ##less rate has been pushed below 17 % from 21 % .

reference_raw: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17% from 21%.

reference_spacy_tokens: Over 1.2 million jobs were created during this period and the official unemployment rate was reduced to less than 17 % from 21 % .


fn_spacy_tokens_for_baseline: The other de - luxe range is manufactured from leather and real hide and is priced at £ 95 .

source_bert_toks: the other de - lux ##e range is manufactured from leather and real hide and is priced at £ ##9 ##5 .

reference_raw: The second de-luxe range is made of leather and actual leather and is priced at £95.

reference_spacy_tokens: The second de - luxe range is made of leather and actual leather and is priced at £ 95 .


fn_spacy_tokens_for_baseline: Pavlova aspired to take the beauty of her art to the whole world .

source_bert_toks: pa ##v ##lova as ##pired to take the beauty of her art to the whole world .

reference_raw: Pavlova sought to bring the beauty of her art to the world.

reference_spacy_tokens: Pavlova sought to bring the beauty of her art to the world .


fn_spacy_tokens_for_baseline: The New Territories can be explored by taking the Kowloon - Canton Railway ( KCR ) , which makes 10 stops between the station in Kowloon and Sheung Shui , the last stop before entering China .

source_bert_toks: the new territories can be explored by taking the ko ##wl ##oon - canton railway ( kc ##r ) , which makes 10 stops between the station in ko ##wl ##oon and she ##ung shu ##i , the last stop before entering china .

reference_raw: The new territories can be explored by using the Kowloon-Canton railway (KCR), which makes 10 stops between Kowloon and Sheung Shui, the final stop before entering China.

reference_spacy_tokens: The new territories can be explored by using the Kowloon - Canton railway ( KCR ) , which makes 10 stops between Kowloon and Sheung Shui , the final stop before entering China .


fn_spacy_tokens_for_baseline: Soviet leaders cited the examples of Afghanistan , Burma and India in Asia to urge Turkey , Iran and Pakistan to withdraw from multilateral and bilateral military pacts .

source_bert_toks: soviet leaders cited the examples of afghanistan , burma and india in asia to urge turkey , iran and pakistan to withdraw from multi ##lateral and bilateral military pact ##s .

reference_raw: Soviet leaders cited examples of Afghanistan, Burma, and India in Asia to encourage Turkey, Iran, and Pakistan to move away from multilateral and bilateral military pacts.

reference_spacy_tokens: Soviet leaders cited examples of Afghanistan , Burma , and India in Asia to encourage Turkey , Iran , and Pakistan to move away from multilateral and bilateral military pacts .


fn_spacy_tokens_for_baseline: One way of ' stealing ' another company 's loyal users is to tempt them into using your product by way of a massive discount .

source_bert_toks: one way of ' stealing ' another company ' s loyal users is to te ##mpt them into using your product by way of a massive discount .

reference_raw: One way to "steal" the loyal users of another company is to seduce them into using your product with a massive discount.

reference_spacy_tokens: One way to " steal " the loyal users of another company is to seduce them into using your product with a massive discount .


fn_spacy_tokens_for_baseline: A year or so later , or it may have been an hour , I crumpled up four sheets of paper and threw them to the floor , and started another , and I was there .

source_bert_toks: a year or so later , or it may have been an hour , i crumpled up four sheets of paper and threw them to the floor , and started another , and i was there .

reference_raw: About a year later, or maybe an hour later, I folded up four sheets of paper, threw them to the floor, started another one, and there I was.

reference_spacy_tokens: About a year later , or maybe an hour later , I folded up four sheets of paper , threw them to the floor , started another one , and there I was .


fn_spacy_tokens_for_baseline: This experience is very different from that of Brasseur and colleagues in neighbouring Congo .

source_bert_toks: this experience is very different from that of brass ##eur and colleagues in neighbouring congo .

reference_raw: The experience is very different from that of Brasseur and his colleagues in the adjacent Congo.

reference_spacy_tokens: The experience is very different from that of Brasseur and his colleagues in the adjacent Congo .


fn_spacy_tokens_for_baseline: The appellant was however described as flat and detached , with no signs of remorse for his offences : he was thought to be developing a personality disorder .

source_bert_toks: the app ##ellant was however described as flat and detached , with no signs of remorse for his offences : he was thought to be developing a personality disorder .

reference_raw: However, the appellant was described as flat and indifferent, without any reproach for his crimes: he was considered to have developed a personality disorder.

reference_spacy_tokens: However , the appellant was described as flat and indifferent , without any reproach for his crimes : he was considered to have developed a personality disorder .


fn_spacy_tokens_for_baseline: The Imperial Engineers are technical innovators whose products are carried by some of the most unusual troops in the Imperial army .

source_bert_toks: the imperial engineers are technical inn ##ova ##tors whose products are carried by some of the most unusual troops in the imperial army .

reference_raw: Imperial engineers are technical innovators whose products are carried by some of the most extraordinary soldiers in the Imperial Army.

reference_spacy_tokens: Imperial engineers are technical innovators whose products are carried by some of the most extraordinary soldiers in the Imperial Army .


fn_spacy_tokens_for_baseline: However , this development would require public support in the form of a new East Coast motorway .

source_bert_toks: however , this development would require public support in the form of a new east coast motorway .

reference_raw: However, this development would require public support in the form of a new East Coast highway.

reference_spacy_tokens: However , this development would require public support in the form of a new East Coast highway .


fn_spacy_tokens_for_baseline: When I quit my job it felt like the end of term , it felt like Saturday morning , it felt great , it felt illegal .

source_bert_toks: when i quit my job it felt like the end of term , it felt like saturday morning , it felt great , it felt illegal .

reference_raw: When I left work, it was like the end of the semester, it was like Saturday morning, it was cool, it was illegal.

reference_spacy_tokens: When I left work , it was like the end of the semester , it was like Saturday morning , it was cool , it was illegal .


fn_spacy_tokens_for_baseline: There is another way of understanding the cold war , not as a conflict but as a kind of collusion , although the term ' collusion ' perhaps implies too much conscious purpose .

source_bert_toks: there is another way of understanding the cold war , not as a conflict but as a kind of col ##lusion , although the term ' col ##lusion ' perhaps implies too much conscious purpose .

reference_raw: There are other ways to understand the Cold War, not as a conflict, but as a kind of collusion, though the term "collusion" may mean too much conscious purpose.

reference_spacy_tokens: There are other ways to understand the Cold War , not as a conflict , but as a kind of collusion , though the term " collusion " may mean too much conscious purpose .


fn_spacy_tokens_for_baseline: Two things are needed : a training revolution to modernise people 's skills , and rights for employees to fair treatment at work .

source_bert_toks: two things are needed : a training revolution to modern ##ise people ' s skills , and rights for employees to fair treatment at work .

reference_raw: There are two things that need to be done: the development of training to modernise people's skills and the right of workers to be treated fairly at work.

reference_spacy_tokens: There are two things that need to be done : the development of training to modernise people 's skills and the right of workers to be treated fairly at work .


fn_spacy_tokens_for_baseline: Since the late 1970s feminist sociologists have increasingly drawn attention to gender as a dividing principle too .

source_bert_toks: since the late 1970s feminist sociologist ##s have increasingly drawn attention to gender as a dividing principle too .

reference_raw: Since the end of the 1970s, feminist sociologists have increasingly drawn attention to sex as a dividing line.

reference_spacy_tokens: Since the end of the 1970s , feminist sociologists have increasingly drawn attention to sex as a dividing line .


fn_spacy_tokens_for_baseline: Establishments are no longer called " Royal , " Queen Elizabeth has vanished from the coinage , and the Union Jack has been replaced by the flag of China and the new Hong Kong flag with its bauhinia flower .

source_bert_toks: establishments are no longer called " royal , " queen elizabeth has vanished from the coinage , and the union jack has been replaced by the flag of china and the new hong kong flag with its ba ##uh ##inia flower .

reference_raw: The establishment is no longer called "Royal," Queen Elizabeth has disappeared from the coinage, and Union Jack has been substituted by the flag of China and the new Hong Kong flag with its bauhinian flower.

reference_spacy_tokens: The establishment is no longer called " Royal , " Queen Elizabeth has disappeared from the coinage , and Union Jack has been substituted by the flag of China and the new Hong Kong flag with its bauhinian flower .


fn_spacy_tokens_for_baseline: ' That was no carver 's or miniaturist 's craft , but black magic , for that was the castle in which I lived , and the forests and meadows round it were mine , where I roamed freely , with my beloved brother , until the black artist came one night seeking shelter from foul weather .

source_bert_toks: ' that was no carver ' s or mini ##at ##uri ##st ' s craft , but black magic , for that was the castle in which i lived , and the forests and meadows round it were mine , where i roam ##ed freely , with my beloved brother , until the black artist came one night seeking shelter from foul weather .

reference_raw: It was not a carver's or a miniaturist's craft, but a black magic, for it was the chateau in which I lived, and the woods and meadows around it were mine, where I roamed freely with my beloved brother, until one night a black artist came to seek shelter from foul weather.

reference_spacy_tokens: It was not a carver 's or a miniaturist 's craft , but a black magic , for it was the chateau in which I lived , and the woods and meadows around it were mine , where I roamed freely with my beloved brother , until one night a black artist came to seek shelter from foul weather .


fn_spacy_tokens_for_baseline: It seemed to be competing in the age - old quest for the secret of perpetual motion and drove everyone bananas .

source_bert_toks: it seemed to be competing in the age - old quest for the secret of perpetual motion and drove everyone bananas .

reference_raw: He seemed to compete in an age-old quest for the secret of eternal movement, driving all bananas.

reference_spacy_tokens: He seemed to compete in an age - old quest for the secret of eternal movement , driving all bananas .


fn_spacy_tokens_for_baseline: Stapleton was talking with animation , but the baronet looked pale and distrait .

source_bert_toks: staple ##ton was talking with animation , but the baronet looked pale and di ##stra ##it .

reference_raw: Stapleton spoke with animation, but the Baronet looked pale and dismayed.

reference_spacy_tokens: Stapleton spoke with animation , but the Baronet looked pale and dismayed .


fn_spacy_tokens_for_baseline: Before Nina dies she and Gael again make peace , she repents her sins , and Gael vows to rewrite his novel .

source_bert_toks: before nina dies she and gael again make peace , she rep ##ents her sins , and gael vows to re ##write his novel .

reference_raw: Before Nina dies, she and Gael make peace again, she regrets her sins, and Gael promises to rewrite his novel.

reference_spacy_tokens: Before Nina dies , she and Gael make peace again , she regrets her sins , and Gael promises to rewrite his novel .


fn_spacy_tokens_for_baseline: Their secrets are no longer safe .

source_bert_toks: their secrets are no longer safe .

reference_raw: Their secrets are no longer secure.

reference_spacy_tokens: Their secrets are no longer secure .


fn_spacy_tokens_for_baseline: In southern Greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

source_bert_toks: in southern greece today , huge forest fires continue to burn on destroying homes and causing severe damage to the region .

reference_raw: In southern Greece, large forest fires continue to burn as they destroy homes and cause serious damage to the region.

reference_spacy_tokens: In southern Greece , large forest fires continue to burn as they destroy homes and cause serious damage to the region .


fn_spacy_tokens_for_baseline: The inspection team learned that Iran has the capability to build more centrifuges .

source_bert_toks: the inspection team learned that iran has the capability to build more cent ##ri ##fu ##ges .

reference_raw: The inspection team has learned that Iran is capable of building additional centrifuges.

reference_spacy_tokens: The inspection team has learned that Iran is capable of building additional centrifuges .


fn_spacy_tokens_for_baseline: It happens in affluent families as well as families that live in poverty . '

source_bert_toks: it happens in affluent families as well as families that live in poverty . '

reference_raw: It happens to rich families and families in poverty.'

reference_spacy_tokens: It happens to rich families and families in poverty . '


fn_spacy_tokens_for_baseline: The court ruled by a 9 - 3 majority after an all - night sitting that Mr Yeltsin 's declaration of ' special rule ' in a television address on Saturday violated five or six points of the Soviet - era constitution .

source_bert_toks: the court ruled by a 9 - 3 majority after an all - night sitting that mr ye ##lts ##in ' s declaration of ' special rule ' in a television address on saturday violated five or six points of the soviet - era constitution .

reference_raw: After all night's sitting, the court ruled by a 9-3 majority that Mr. Yeltsin's statement of "special rule" on a television address on Saturday broke five or six points of the Constitution of the Soviet era.

reference_spacy_tokens: After all night 's sitting , the court ruled by a 9 - 3 majority that Mr. Yeltsin 's statement of " special rule " on a television address on Saturday broke five or six points of the Constitution of the Soviet era .


fn_spacy_tokens_for_baseline: In social anthropology this becomes important for a variety of reasons .

source_bert_toks: in social anthropology this becomes important for a variety of reasons .

reference_raw: This is important in social anthropology for various reasons.

reference_spacy_tokens: This is important in social anthropology for various reasons .


fn_spacy_tokens_for_baseline: In 1811 the governors laid out £ 2.0s.0d . for surgeons ' instruments , £ 103.3s.8d . for medicines and £ 15.12s.3d . on leeches .

source_bert_toks: in 1811 the governors laid out £2 . 0 ##s . 0 ##d . for surgeons ' instruments , £10 ##3 . 3 ##s . 8 ##d . for medicines and £1 ##5 . 12 ##s . 3d . on lee ##ches .

reference_raw: In 1811, the governors laid out £2.0d for surgical tools, £103.3.8d for pharmaceuticals and £15.12.3d for leeches.

reference_spacy_tokens: In 1811 , the governors laid out £ 2.0d for surgical tools , £ 103.3.8d for pharmaceuticals and £ 15.12.3d for leeches .


fn_spacy_tokens_for_baseline: Police are also interested in a stolen white Ford Fiesta car , registration number UXI 8624 , which was also seen in Lisburn town centre around 4.15am .

source_bert_toks: police are also interested in a stolen white ford fiesta car , registration number u ##xi 86 ##24 , which was also seen in li ##sb ##urn town centre around 4 . 15 ##am .

reference_raw: The police are also interested in the missing white Ford Fiesta vehicle, registration number UXI 8624, which was also seen at the centre of the city of Lisburn around 4:15 a.m.

reference_spacy_tokens: The police are also interested in the missing white Ford Fiesta vehicle , registration number UXI 8624 , which was also seen at the centre of the city of Lisburn around 4:15 a.m.


fn_spacy_tokens_for_baseline: You are a head receptionist at a medium - sized hotel , instructing a new trainee receptionist .

source_bert_toks: you are a head receptionist at a medium - sized hotel , ins ##tructing a new trainee receptionist .

reference_raw: You're the head secretary at a middle-sized hotel and you're instructing a new intern clerk.

reference_spacy_tokens: You 're the head secretary at a middle - sized hotel and you 're instructing a new intern clerk .


fn_spacy_tokens_for_baseline: ' Presumably , an earlier train coming into the station had hit the bird and lodged it on its bumpers .

source_bert_toks: ' presumably , an earlier train coming into the station had hit the bird and lodged it on its bumper ##s .

reference_raw: 'An earlier train arriving at the station probably hit the bird and put it on its bumpers.

reference_spacy_tokens: ' An earlier train arriving at the station probably hit the bird and put it on its bumpers .


fn_spacy_tokens_for_baseline: Only 20 % of electric cables are buried beneath the streets in Tokyo , compared with 100 % in London and Paris .

source_bert_toks: only 20 % of electric cables are buried beneath the streets in tokyo , compared with 100 % in london and paris .

reference_raw: In Tokyo, only 20% of the electric cables are buried under the roads, compared to 100% in London and Paris.

reference_spacy_tokens: In Tokyo , only 20 % of the electric cables are buried under the roads , compared to 100 % in London and Paris .


fn_spacy_tokens_for_baseline: Again , nothing turns on this point .

source_bert_toks: again , nothing turns on this point .

reference_raw: Again, there's nothing going on at this point.

reference_spacy_tokens: Again , there 's nothing going on at this point .


fn_spacy_tokens_for_baseline: Flora envied them because all the things she craved in life they could buy cheaply in the NAAFI .

source_bert_toks: flora en ##vie ##d them because all the things she craved in life they could buy cheap ##ly in the na ##af ##i .

reference_raw: Flora envied them because everything she wanted in life could be bought cheaply at NAAFI.

reference_spacy_tokens: Flora envied them because everything she wanted in life could be bought cheaply at NAAFI .


fn_spacy_tokens_for_baseline: They are inevitably stringent , but for obvious reasons : because fatigued drivers are a potential danger both to other users of the road and to the passengers whom they carry .

source_bert_toks: they are inevitably string ##ent , but for obvious reasons : because fatigue ##d drivers are a potential danger both to other users of the road and to the passengers whom they carry .

reference_raw: They are inevitably strict, but for obvious reasons: because tired drivers pose a potential danger to other road users and to the passengers they carry.

reference_spacy_tokens: They are inevitably strict , but for obvious reasons : because tired drivers pose a potential danger to other road users and to the passengers they carry .


fn_spacy_tokens_for_baseline: Reciprocation is infrequent when females and young are the enlisters .

source_bert_toks: rec ##ip ##ro ##cation is in ##fr ##e ##quent when females and young are the enlist ##ers .

reference_raw: Reciprocation is rare when women and young are enlisters.

reference_spacy_tokens: Reciprocation is rare when women and young are enlisters .


fn_spacy_tokens_for_baseline: Folding her against him , he gave a long sigh , then moved her back so that he could look into her face .

source_bert_toks: folding her against him , he gave a long sigh , then moved her back so that he could look into her face .

reference_raw: He leaned her against him and let out a long breath, then moved her back so that he could see her face.

reference_spacy_tokens: He leaned her against him and let out a long breath , then moved her back so that he could see her face .


fn_spacy_tokens_for_baseline: Her life at Remaisnil in the first years had no routine ; she continued to travel regularly around Europe overseeing shops as well as production in Helmond .

source_bert_toks: her life at re ##ma ##is ##ni ##l in the first years had no routine ; she continued to travel regularly around europe overseeing shops as well as production in helm ##ond .

reference_raw: Her life in Remaisnil had not been routine in the first years; she continued to visit Europe on a regular basis, overseeing shops and production in Helmond.

reference_spacy_tokens: Her life in Remaisnil had not been routine in the first years ; she continued to visit Europe on a regular basis , overseeing shops and production in Helmond .


fn_spacy_tokens_for_baseline: Coleridge looks at such ' dramatic ' poems as ' The Brothers ' , ' Michael ' , ' Ruth ' , and ' The Mad Mother ' .

source_bert_toks: cole ##ridge looks at such ' dramatic ' poems as ' the brothers ' , ' michael ' , ' ruth ' , and ' the mad mother ' .

reference_raw: Coleridge looks at such 'dramatic' poetry as 'Brethren' , 'Michael' , 'Ruth' and 'Mad Mother'.

reference_spacy_tokens: Coleridge looks at such ' dramatic ' poetry as ' Brethren ' , ' Michael ' , ' Ruth ' and ' Mad Mother ' .


fn_spacy_tokens_for_baseline: We stayed in a dormitory that was full of couples with noisy small children , and it put quite a strain on our marriage .

source_bert_toks: we stayed in a dormitory that was full of couples with noisy small children , and it put quite a strain on our marriage .

reference_raw: We stayed in a bedroom filled with couples with noisy little kids, and it put a lot of pressure on our marriage.

reference_spacy_tokens: We stayed in a bedroom filled with couples with noisy little kids , and it put a lot of pressure on our marriage .


fn_spacy_tokens_for_baseline: Continuing around the peninsula in a clockwise direction brings you to the Rua da Praia Grande ( Big Beach Street ) - a pleasant promenade with shaded benches under the banyan trees .

source_bert_toks: continuing around the peninsula in a clockwise direction brings you to the ru ##a da pr ##aia grande ( big beach street ) - a pleasant promenade with shaded benches under the ban ##yan trees .

reference_raw: Continuing around the peninsula in a clockwise direction will lead you to the Rua da Praia Grande (Big Beach Street) - a pleasant promenade with shaded benches under the banyan trees.

reference_spacy_tokens: Continuing around the peninsula in a clockwise direction will lead you to the Rua da Praia Grande ( Big Beach Street ) - a pleasant promenade with shaded benches under the banyan trees .


fn_spacy_tokens_for_baseline: As the Balkans flared to war once again , Greek nationalism has stirred , and there have been discussions in the kafeneion about the land of Macedonia returning to the fold of its forefathers .

source_bert_toks: as the balkans flared to war once again , greek nationalism has stirred , and there have been discussions in the ka ##fen ##ei ##on about the land of macedonia returning to the fold of its fore ##fat ##hers .

reference_raw: As the Balkans flared into war again, Greece's nationalism stirred, and the Kafeneion debated that the country of Macedonia would return to the folds of its ancestors.

reference_spacy_tokens: As the Balkans flared into war again , Greece 's nationalism stirred , and the Kafeneion debated that the country of Macedonia would return to the folds of its ancestors .


fn_spacy_tokens_for_baseline: Assertions from pupils about what teachers call them may not always be believed by sceptical readers .

source_bert_toks: assertion ##s from pupils about what teachers call them may not always be believed by sc ##ept ##ical readers .

reference_raw: Sceptical readers may not always believe in what teachers call them.

reference_spacy_tokens: Sceptical readers may not always believe in what teachers call them .


fn_spacy_tokens_for_baseline: Now and then lightning flickered through the gloom , the lights dimmed , and thunder rattled every loose panel and plank in the building .

source_bert_toks: now and then lightning flickered through the gloom , the lights dim ##med , and thunder rattled every loose panel and plank in the building .

reference_raw: Lightning flickered from time to time in the darkness, the lights dimmed, and thunder shook every loose panel and board in the building.

reference_spacy_tokens: Lightning flickered from time to time in the darkness , the lights dimmed , and thunder shook every loose panel and board in the building .


fn_spacy_tokens_for_baseline: She would prove that boorish man wrong , if it was the last thing she did !

source_bert_toks: she would prove that boo ##rish man wrong , if it was the last thing she did !

reference_raw: If it's the last thing she'll do, she'll prove the Borish man wrong!

reference_spacy_tokens: If it 's the last thing she 'll do , she 'll prove the Borish man wrong !


fn_spacy_tokens_for_baseline: Well unfortunately my girlfriend is dragging me off to Rhodes for a week so I 'll miss the Norwich , Scouse and Oldham game .

source_bert_toks: well unfortunately my girlfriend is dragging me off to rhodes for a week so i ' ll miss the norwich , sc ##ouse and oldham game .

reference_raw: Unfortunately, my friend's taking me to Rhodes for a week, so I'm gonna miss the Norwich, Scouse, and Oldham game.

reference_spacy_tokens: Unfortunately , my friend 's taking me to Rhodes for a week , so I 'm gon na miss the Norwich , Scouse , and Oldham game .


fn_spacy_tokens_for_baseline: The man in white is thin and wiry with flashing black eyes and black hair sticking out from under the cap , wild looking .

source_bert_toks: the man in white is thin and wi ##ry with flashing black eyes and black hair sticking out from under the cap , wild looking .

reference_raw: The man in white is thin and wry, his black eyes flashing and his black hair sticking out from under his hat, his eyes wild.

reference_spacy_tokens: The man in white is thin and wry , his black eyes flashing and his black hair sticking out from under his hat , his eyes wild .


fn_spacy_tokens_for_baseline: He liked hearing about their families , although he never was part of that . '

source_bert_toks: he liked hearing about their families , although he never was part of that . '

reference_raw: He loved to hear about their families, though he'd never been a part of it.'

reference_spacy_tokens: He loved to hear about their families , though he 'd never been a part of it . '


fn_spacy_tokens_for_baseline: ' There may be more , and I 'm in charge , let 's continue , ' replied Ralph .

source_bert_toks: ' there may be more , and i ' m in charge , let ' s continue , ' replied ralph .

reference_raw: 'Maybe there's more, and I'll take the lead, let's go on,' said Ralph.

reference_spacy_tokens: ' Maybe there 's more , and I 'll take the lead , let 's go on , ' said Ralph .


fn_spacy_tokens_for_baseline: Edward in return undertook to renounce his claim to the French throne .

source_bert_toks: edward in return undertook to reno ##unce his claim to the french throne .

reference_raw: In return, Edward undertook to give up his claim to the throne of France.

reference_spacy_tokens: In return , Edward undertook to give up his claim to the throne of France .


fn_spacy_tokens_for_baseline: One day she rang me to ask if I could come along on Saturday and help plant potatoes in the back yard ; ' Uncle John is far too busy at this time of the year ' .

source_bert_toks: one day she rang me to ask if i could come along on saturday and help plant potatoes in the back yard ; ' uncle john is far too busy at this time of the year ' .

reference_raw: She called me one day and asked me if I could come with her on Saturday and help her plant pots in the backyard; 'Uncle John's too busy this time of year.'

reference_spacy_tokens: She called me one day and asked me if I could come with her on Saturday and help her plant pots in the backyard ; ' Uncle John 's too busy this time of year . '


fn_spacy_tokens_for_baseline: Armenian reporters said their forces on Saturday had dislodged Azeri defenders from Aterk , the largest village in the Mardakert region of northern Nagorno - Karabakh . -- AP and Reuter

source_bert_toks: armenian reporters said their forces on saturday had di ##sl ##od ##ged az ##eri defenders from ate ##rk , the largest village in the mar ##dak ##ert region of northern na ##gor ##no - kara ##ba ##kh . - - ap and re ##uter

reference_raw: Armenian journalists say that on Saturday their forces took out the Azeri defenders from Aterk, the largest village in the Mardakert region of North Nagorno-Karabakh.

reference_spacy_tokens: Armenian journalists say that on Saturday their forces took out the Azeri defenders from Aterk , the largest village in the Mardakert region of North Nagorno - Karabakh .


fn_spacy_tokens_for_baseline: The bear scarcely repaid the compliment but sat on his hindquarters , hungrily stuffing his great muzzle from a pile of scraps thrown around him .

source_bert_toks: the bear scarcely rep ##aid the compliment but sat on his hind ##qua ##rter ##s , hung ##rily stuffing his great muzzle from a pile of scrap ##s thrown around him .

reference_raw: The bear hardly paid the compliment, but he sat down on his back and hungrily stuffed his big barrel out of the pile of scraps he had thrown around him.

reference_spacy_tokens: The bear hardly paid the compliment , but he sat down on his back and hungrily stuffed his big barrel out of the pile of scraps he had thrown around him .


fn_spacy_tokens_for_baseline: The original cars seated 69 , but the new one seated only 64 .

source_bert_toks: the original cars seated 69 , but the new one seated only 64 .

reference_raw: The original cars were 69, but the new one was only 64.

reference_spacy_tokens: The original cars were 69 , but the new one was only 64 .


fn_spacy_tokens_for_baseline: He squeezed my hand .

source_bert_toks: he squeezed my hand .

reference_raw: He clasped my hand.

reference_spacy_tokens: He clasped my hand .


fn_spacy_tokens_for_baseline: Alex detached himself from the crowd and came towards them .

source_bert_toks: alex detached himself from the crowd and came towards them .

reference_raw: Alex stepped away from the crowd and approached them.

reference_spacy_tokens: Alex stepped away from the crowd and approached them .


fn_spacy_tokens_for_baseline: He scuttled behind the nearest tank and watched Fakrid and Jinkwa 's predictable reaction to the latest development with amusement .

source_bert_toks: he sc ##ut ##tled behind the nearest tank and watched fa ##kr ##id and jin ##k ##wa ' s predictable reaction to the latest development with amusement .

reference_raw: He hurried behind the nearest tank, watching with amusement Fakrid and Jinkwa's predictable reaction to the latest developments.

reference_spacy_tokens: He hurried behind the nearest tank , watching with amusement Fakrid and Jinkwa 's predictable reaction to the latest developments .


fn_spacy_tokens_for_baseline: I thought them beautiful , but they clearly alarmed Mr Singh who was not used to my wife 's Celtic colouring .

source_bert_toks: i thought them beautiful , but they clearly alarmed mr singh who was not used to my wife ' s celtic colour ##ing .

reference_raw: I thought they were beautiful, but they clearly frightened Mr. Singh, who wasn't used to my wife's Celtic colors.

reference_spacy_tokens: I thought they were beautiful , but they clearly frightened Mr. Singh , who was n't used to my wife 's Celtic colors .


fn_spacy_tokens_for_baseline: The main chemical ingredients for life are derived from combinations of carbon , hydrogen , oxygen and nitrogen , which we can abbreviate to CHON .

source_bert_toks: the main chemical ingredients for life are derived from combinations of carbon , hydrogen , oxygen and nitrogen , which we can ab ##bre ##via ##te to cho ##n .

reference_raw: The major chemical components of life are derived from a combination of carbon, hydrogen, oxygen, and nitrogen that can be abbreviated to CHON.

reference_spacy_tokens: The major chemical components of life are derived from a combination of carbon , hydrogen , oxygen , and nitrogen that can be abbreviated to CHON .


fn_spacy_tokens_for_baseline: When the tops became straw - coloured the clumps were eased from the ground and the bulbs were dried off until the skins were yellow and brittle .

source_bert_toks: when the tops became straw - coloured the cl ##ump ##s were eased from the ground and the bulbs were dried off until the skins were yellow and brittle .

reference_raw: When the tops had become straw-colored, the clusters had been removed from the ground, and the bulbs had been desiccated until the skin was yellow and fragile.

reference_spacy_tokens: When the tops had become straw - colored , the clusters had been removed from the ground , and the bulbs had been desiccated until the skin was yellow and fragile .


fn_spacy_tokens_for_baseline: He said he 'd expire if he had to sit on that high stool much longer .

source_bert_toks: he said he ' d ex ##pire if he had to sit on that high stool much longer .

reference_raw: He said he'd run out if he had to sit on that high stool for a long time.

reference_spacy_tokens: He said he 'd run out if he had to sit on that high stool for a long time .


fn_spacy_tokens_for_baseline: With his high - minded scorn for all security , he had almost walked into a White House meeting with an explosive device planted in his attache case by someone he had taken on trust .

source_bert_toks: with his high - minded sc ##orn for all security , he had almost walked into a white house meeting with an explosive device planted in his attache case by someone he had taken on trust .

reference_raw: With a high contempt for security, he almost walked into the White House meeting with an explosive device planted in his attache case by someone he trusted.

reference_spacy_tokens: With a high contempt for security , he almost walked into the White House meeting with an explosive device planted in his attache case by someone he trusted .


fn_spacy_tokens_for_baseline: Down from the top floor bounced the offspring of Mr and Mrs Beavis , the girls in nightdresses , the boys in nightshirts .

source_bert_toks: down from the top floor bounced the offspring of mr and mrs bea ##vis , the girls in night ##dre ##sse ##s , the boys in nights ##hir ##ts .

reference_raw: The descendants of Mr. and Mrs. Beavis, girls in nightgowns, boys in nightgowns, bounced off the top floor.

reference_spacy_tokens: The descendants of Mr. and Mrs. Beavis , girls in nightgowns , boys in nightgowns , bounced off the top floor .


fn_spacy_tokens_for_baseline: Technical Capability : The terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

source_bert_toks: technical capability : the terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

reference_raw: Technical capacity: Terrorist groups of major concern have the technical capacity and know-how to acquire, manufacture and supply chemical or biological agents or to recruit scientific experts in these fields.

reference_spacy_tokens: Technical capacity : Terrorist groups of major concern have the technical capacity and know - how to acquire , manufacture and supply chemical or biological agents or to recruit scientific experts in these fields .


fn_spacy_tokens_for_baseline: When Democrats wonder why there is so much resentment of Clinton , they do n't need to look much further than the Big Lie about philandering that Stephanopoulos , Carville ( and a cooperative campaign press corps ) helped to put over in 1992 .

source_bert_toks: when democrats wonder why there is so much resentment of clinton , they don ' t need to look much further than the big lie about phil ##ander ##ing that stephan ##op ##oulos , car ##ville ( and a cooperative campaign press corps ) helped to put over in 1992 .

reference_raw: If Democrats wonder why Clinton has so much resentment, they may not look much further than the Great Lie about the philandering that Stephanopoulos and Carville (and the Cooperative Press Force) helped put in place in 1992.

reference_spacy_tokens: If Democrats wonder why Clinton has so much resentment , they may not look much further than the Great Lie about the philandering that Stephanopoulos and Carville ( and the Cooperative Press Force ) helped put in place in 1992 .


fn_spacy_tokens_for_baseline: That night it freezes hard and next morning after a brief breakfast we thaw out the boat and set off again .

source_bert_toks: that night it freeze ##s hard and next morning after a brief breakfast we tha ##w out the boat and set off again .

reference_raw: It freezes hard that night, and the next morning, after a short breakfast, we dissolved the ship and set off again.

reference_spacy_tokens: It freezes hard that night , and the next morning , after a short breakfast , we dissolved the ship and set off again .


fn_spacy_tokens_for_baseline: As a result , steel reinforcing in the concrete has corroded , cracks have formed and water has penetrated the walls of the building .

source_bert_toks: as a result , steel rein ##for ##cing in the concrete has co ##rro ##ded , cracks have formed and water has penetrated the walls of the building .

reference_raw: As a result, steel reinforcements in the concrete corrosived, cracks formed, and water penetrated the walls of the building.

reference_spacy_tokens: As a result , steel reinforcements in the concrete corrosived , cracks formed , and water penetrated the walls of the building .


fn_spacy_tokens_for_baseline: If that is not the case , then the returns owing to the investors simply accumulate until circumstances permit them to be paid .

source_bert_toks: if that is not the case , then the returns owing to the investors simply accumulate until circumstances permit them to be paid .

reference_raw: If this is not the case, the returns due to investors simply accumulate until circumstances allow them to be paid.

reference_spacy_tokens: If this is not the case , the returns due to investors simply accumulate until circumstances allow them to be paid .


fn_spacy_tokens_for_baseline: A monk , especially a recluse like Hopkins , would have few friends and would scarcely confide in his brothers at Glastonbury .

source_bert_toks: a monk , especially a rec ##lus ##e like hopkins , would have few friends and would scarcely con ##fide in his brothers at g ##las ##ton ##bury .

reference_raw: A monk, especially a loner like Hopkins, would have few friends, and would hardly share with his brothers in Glastonbury.

reference_spacy_tokens: A monk , especially a loner like Hopkins , would have few friends , and would hardly share with his brothers in Glastonbury .


fn_spacy_tokens_for_baseline: Pastiche has been defined as a literary work that imitates the work of an earlier writer .

source_bert_toks: past ##iche has been defined as a literary work that im ##itate ##s the work of an earlier writer .

reference_raw: Pastiche is defined as a literary work that mimics the work of an earlier author.

reference_spacy_tokens: Pastiche is defined as a literary work that mimics the work of an earlier author .


fn_spacy_tokens_for_baseline: Conceived by James Freed , a Jew born in Germany who escaped with his parents to the United States in 1939 , it is an eerie , grim and splendidly daunting structure .

source_bert_toks: conceived by james freed , a jew born in germany who escaped with his parents to the united states in 1939 , it is an eerie , grim and splendid ##ly da ##unt ##ing structure .

reference_raw: Conceived by James Freed, a Jew born in Germany who fled with his parents to the United States in 1939, it's a ghostly, gloomy, beautifully fearsome structure.

reference_spacy_tokens: Conceived by James Freed , a Jew born in Germany who fled with his parents to the United States in 1939 , it 's a ghostly , gloomy , beautifully fearsome structure .


fn_spacy_tokens_for_baseline: He presented the Bishop , from the parish , with a crystal goblet engraved with the symbols of the two dioceses .

source_bert_toks: he presented the bishop , from the parish , with a crystal go ##ble ##t engraved with the symbols of the two dioceses .

reference_raw: He presented the bishop from the parish with a crystal cup engraved with the symbols of both dioceses.

reference_spacy_tokens: He presented the bishop from the parish with a crystal cup engraved with the symbols of both dioceses .


fn_spacy_tokens_for_baseline: ' I 've had more relaxing lunches , ' she admitted ruefully .

source_bert_toks: ' i ' ve had more relaxing lunch ##es , ' she admitted rue ##fully .

reference_raw: "I had more resting lunches," she said sadly.

reference_spacy_tokens: " I had more resting lunches , " she said sadly .


fn_spacy_tokens_for_baseline: He advised a military and naval action involving seizure of one or more Chinese islands for British commerce .

source_bert_toks: he advised a military and naval action involving seizure of one or more chinese islands for british commerce .

reference_raw: He recommended military and naval measures involving the capture of one or more Chinese islands for British trade.

reference_spacy_tokens: He recommended military and naval measures involving the capture of one or more Chinese islands for British trade .


fn_spacy_tokens_for_baseline: More commonly , the term is now used to describe any really frightening dream .

source_bert_toks: more commonly , the term is now used to describe any really frightening dream .

reference_raw: More often, the term is now used to describe any truly terrifying dream.

reference_spacy_tokens: More often , the term is now used to describe any truly terrifying dream .


fn_spacy_tokens_for_baseline: There are several delivery routes Iran could take for its chemical agents .

source_bert_toks: there are several delivery routes iran could take for its chemical agents .

reference_raw: There are a number of routes Iran can take for its chemical agents.

reference_spacy_tokens: There are a number of routes Iran can take for its chemical agents .


fn_spacy_tokens_for_baseline: The next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorist incidents .

source_bert_toks: the next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bio ##ter ##ror ##ism ; and approaches to the prevention and mit ##iga ##tion of bio ##ter ##ror ##ist incidents .

reference_raw: The next five chapters focus on the technical aspects of bioterrorism, including biological agents of major concern; technical barriers related to their acquisition, manufacture and delivery; historical cases of bioterrorism; and approaches to the prevention and mitigation of bioterrorism incidents.

reference_spacy_tokens: The next five chapters focus on the technical aspects of bioterrorism , including biological agents of major concern ; technical barriers related to their acquisition , manufacture and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorism incidents .


fn_spacy_tokens_for_baseline: This is a day for thinking of the Four Last Things and meditating on sin . '

source_bert_toks: this is a day for thinking of the four last things and med ##itating on sin . '

reference_raw: It's a day to think about the Four Last Things and meditation about sin.'

reference_spacy_tokens: It 's a day to think about the Four Last Things and meditation about sin . '


fn_spacy_tokens_for_baseline: On Dec. 7 the Islamic Conference Organization ( ICO ) denounced the affair as a ' heinous crime ' .

source_bert_toks: on dec . 7 the islamic conference organization ( ic ##o ) denounced the affair as a ' he ##ino ##us crime ' .

reference_raw: On December 7, the Islamic Conference Organisation (ICO) condemned the affair as a "horrific crime."

reference_spacy_tokens: On December 7 , the Islamic Conference Organisation ( ICO ) condemned the affair as a " horrific crime . "


fn_spacy_tokens_for_baseline: Gatting 's altercation with Shakoor Rana was to have a considerable effect on the West Indies Test rubber .

source_bert_toks: ga ##tting ' s alter ##cation with sha ##ko ##or rana was to have a considerable effect on the west indies test rubber .

reference_raw: Gatting's fight with Shakoor Rana should have had a significant impact on the West India Test Rubber.

reference_spacy_tokens: Gatting 's fight with Shakoor Rana should have had a significant impact on the West India Test Rubber .


fn_spacy_tokens_for_baseline: Even though Linux is supposed to demolish Microsoft , the Microsoft Helpdesk , which provides computer assistance to its employees , was surprisingly helpful .

source_bert_toks: even though linux is supposed to demo ##lish microsoft , the microsoft help ##des ##k , which provides computer assistance to its employees , was surprisingly helpful .

reference_raw: Although Linux is expected to destroy Microsoft, Microsoft Helpdesk, which provides computer support to its employees, has been surprisingly useful.

reference_spacy_tokens: Although Linux is expected to destroy Microsoft , Microsoft Helpdesk , which provides computer support to its employees , has been surprisingly useful .


fn_spacy_tokens_for_baseline: Alice was vexed by this remark , since she and Harold had updated the house in many ways , only five years earlier .

source_bert_toks: alice was ve ##xed by this remark , since she and harold had updated the house in many ways , only five years earlier .

reference_raw: Alice was annoyed with that remark, for she and Harold had updated the house in many ways, just five years ago.

reference_spacy_tokens: Alice was annoyed with that remark , for she and Harold had updated the house in many ways , just five years ago .


fn_spacy_tokens_for_baseline: Another patient withdrew because of work commitments , and two were withdrawn while taking propanolol ( one patient 's diastolic blood pressure rose above 125 mm Hg and one had symptoms suggesting heart failure ) .

source_bert_toks: another patient withdrew because of work commitments , and two were withdrawn while taking prop ##ano ##lo ##l ( one patient ' s dia ##sto ##lic blood pressure rose above 125 mm h ##g and one had symptoms suggesting heart failure ) .

reference_raw: Another patient withdrew due to an obligation to work and two were withdrawn during treatment with propanolol (one patient's diastolic blood pressure increased above 125 mmHg and one patient's symptoms suggestive of heart failure).

reference_spacy_tokens: Another patient withdrew due to an obligation to work and two were withdrawn during treatment with propanolol ( one patient 's diastolic blood pressure increased above 125 mmHg and one patient 's symptoms suggestive of heart failure ) .


fn_spacy_tokens_for_baseline: He may need to have the lump removed .

source_bert_toks: he may need to have the lump removed .

reference_raw: Maybe he'll have to take the lump out.

reference_spacy_tokens: Maybe he 'll have to take the lump out .


fn_spacy_tokens_for_baseline: But the plan has drawn criticism from the Palestinians ' Arab peace talks partners , who accuse Arafat of lack of consultation , and from hardline Palestinian groups who denounce it as a sell .

source_bert_toks: but the plan has drawn criticism from the palestinians ' arab peace talks partners , who accuse ara ##fat of lack of consultation , and from hard ##line palestinian groups who den ##oun ##ce it as a sell .

reference_raw: But the plan draws criticism from Arab peace talks partners who blame Arafat for lack of consultation, and from hardline Palestinian groups who condemn it as a sale.

reference_spacy_tokens: But the plan draws criticism from Arab peace talks partners who blame Arafat for lack of consultation , and from hardline Palestinian groups who condemn it as a sale .


fn_spacy_tokens_for_baseline: What is important is that each student is made aware of the chasm which separates the comfortable assumptions we make as teachers and the reality of the world beyond the school walls .

source_bert_toks: what is important is that each student is made aware of the cha ##sm which separates the comfortable assumptions we make as teachers and the reality of the world beyond the school walls .

reference_raw: What's important is that every student is aware of the chasm that separates the comfortable assumptions that we make as teachers from the reality of the world outside the school walls.

reference_spacy_tokens: What 's important is that every student is aware of the chasm that separates the comfortable assumptions that we make as teachers from the reality of the world outside the school walls .


fn_spacy_tokens_for_baseline: She felt his fingertips , cold and clammy with perspiration .

source_bert_toks: she felt his fingertips , cold and cl ##am ##my with per ##sp ##ira ##tion .

reference_raw: She could feel his fingers, cold and sweaty.

reference_spacy_tokens: She could feel his fingers , cold and sweaty .


fn_spacy_tokens_for_baseline: The rebels also captured the Boulogne tank factory on the outskirts of the city , killing three civilians when a tank they had commandeered collided with a bus .

source_bert_toks: the rebels also captured the bo ##ulo ##gne tank factory on the outskirts of the city , killing three civilians when a tank they had command ##eer ##ed collided with a bus .

reference_raw: The rebels also captured the Boulogne tank factory on the outskirts of the city and killed three civilians when the tank they commanded hit the bus.

reference_spacy_tokens: The rebels also captured the Boulogne tank factory on the outskirts of the city and killed three civilians when the tank they commanded hit the bus .


fn_spacy_tokens_for_baseline: There was no shortage of evidence from her Cabinet purges about the disagreeable qualities of life in the Thatcher Cabinet Room .

source_bert_toks: there was no shortage of evidence from her cabinet purge ##s about the disagree ##able qualities of life in the thatcher cabinet room .

reference_raw: There was no lack of evidence from her cabinet cleansing of the disagreeable quality of life in the Thatcher cabinet room.

reference_spacy_tokens: There was no lack of evidence from her cabinet cleansing of the disagreeable quality of life in the Thatcher cabinet room .


fn_spacy_tokens_for_baseline: Her blonde curls looked as if she had just come from a hairdresser rather than from the hand basin in her own bedroom which was where she had washed her hair this morning .

source_bert_toks: her blonde curls looked as if she had just come from a hair ##dre ##sser rather than from the hand basin in her own bedroom which was where she had washed her hair this morning .

reference_raw: Her blond curls looked more like she'd just come out of a hairdresser than out of the handbasin in her bedroom, where she'd washed her hair this morning.

reference_spacy_tokens: Her blond curls looked more like she 'd just come out of a hairdresser than out of the handbasin in her bedroom , where she 'd washed her hair this morning .


fn_spacy_tokens_for_baseline: Julie smiled , remembering the times she and her friends had hidden in the old shed during hilarious games of hide and seek and sardines .

source_bert_toks: julie smiled , remembering the times she and her friends had hidden in the old shed during hilarious games of hide and seek and sar ##dine ##s .

reference_raw: Julia smiled, remembering the time she and her friends had been hiding in the old shed during funny games of hide-and-seek and sardine.

reference_spacy_tokens: Julia smiled , remembering the time she and her friends had been hiding in the old shed during funny games of hide - and - seek and sardine .


fn_spacy_tokens_for_baseline: US officials report that Iran can produce several hundred tons of chemical agent annually and that it may have already produced as much as 2,000 tons of agent , including mustard , cyanide , and possibly sarin nerve agent , at plants near Qazvin , Parchin , and Esfahan .

source_bert_toks: us officials report that iran can produce several hundred tons of chemical agent annually and that it may have already produced as much as 2 , 000 tons of agent , including mustard , cy ##ani ##de , and possibly sar ##in nerve agent , at plants near q ##az ##vin , parc ##hin , and es ##fahan .

reference_raw: American officials report that Iran can produce several hundred tons of chemicals per year, and that it can already produce up to 2,000 tons of agents, including mustard, cyanide, and possibly sarin nerves, in factories near Qazvin, Parchin, and Esfahan.

reference_spacy_tokens: American officials report that Iran can produce several hundred tons of chemicals per year , and that it can already produce up to 2,000 tons of agents , including mustard , cyanide , and possibly sarin nerves , in factories near Qazvin , Parchin , and Esfahan .


fn_spacy_tokens_for_baseline: In contrast , loss of cortical and furrow localization is seen for GFP - MHCK - C in the absence of myosin II .

source_bert_toks: in contrast , loss of co ##rti ##cal and fur ##row local ##ization is seen for g ##fp - m ##hc ##k - c in the absence of my ##osi ##n ii .

reference_raw: In contrast, GFP-MHCK-C loss of cortical and furrow location is observed without myosin II.

reference_spacy_tokens: In contrast , GFP - MHCK - C loss of cortical and furrow location is observed without myosin II .


fn_spacy_tokens_for_baseline: In an emergency session on January 18th , it praised Iraq for playing ' its historic role in resisting the great Satan who is threatening every Arab country . '

source_bert_toks: in an emergency session on january 18th , it praised iraq for playing ' its historic role in resisting the great satan who is threatening every arab country . '

reference_raw: In an emergency meeting on January 18, he commended Iraq for playing "his historical role in resisting the great Satan that threatens all Arab countries."

reference_spacy_tokens: In an emergency meeting on January 18 , he commended Iraq for playing " his historical role in resisting the great Satan that threatens all Arab countries . "


fn_spacy_tokens_for_baseline: The game has brought the Cheltenham festival to a thrilling climax .

source_bert_toks: the game has brought the cheltenham festival to a thrilling climax .

reference_raw: The game brought the Cheltenham Festival to an exciting peak.

reference_spacy_tokens: The game brought the Cheltenham Festival to an exciting peak .


fn_spacy_tokens_for_baseline: He had spent his life in the labour movement , having migrated to the coast from the impoverished countryside of the north - east at the age of twelve , looking for work .

source_bert_toks: he had spent his life in the labour movement , having migrated to the coast from the impoverished countryside of the north - east at the age of twelve , looking for work .

reference_raw: He spent a lifetime in the labor movement, moving to the shore from the poor countryside of the northeast at the age of twelve, looking for a job.

reference_spacy_tokens: He spent a lifetime in the labor movement , moving to the shore from the poor countryside of the northeast at the age of twelve , looking for a job .


fn_spacy_tokens_for_baseline: In Wasit province , southeast of the capital , an explosive device detonated near an Iraqi police vehicle , killing three officers .

source_bert_toks: in was ##it province , southeast of the capital , an explosive device detonated near an iraqi police vehicle , killing three officers .

reference_raw: In the province of Wasit, southeast of the capital, an explosive device exploded near an Iraqi police car and killed three officers.

reference_spacy_tokens: In the province of Wasit , southeast of the capital , an explosive device exploded near an Iraqi police car and killed three officers .


fn_spacy_tokens_for_baseline: Economic Man , seeing two boxes of chocolates , of which one is cheaper because the manufacturer has not had to pay for consequential damage to some third party , would choose that cheaper box .

source_bert_toks: economic man , seeing two boxes of chocolate ##s , of which one is cheaper because the manufacturer has not had to pay for con ##se ##quent ##ial damage to some third party , would choose that cheaper box .

reference_raw: An economical man who sees two cartons of chocolate, one of which is cheaper because the manufacturer does not have to pay for the resulting damage to a third party, would choose the cheaper one.

reference_spacy_tokens: An economical man who sees two cartons of chocolate , one of which is cheaper because the manufacturer does not have to pay for the resulting damage to a third party , would choose the cheaper one .


fn_spacy_tokens_for_baseline: And Jessamy knew better than to argue with him when he used that particular tone of voice .

source_bert_toks: and jess ##amy knew better than to argue with him when he used that particular tone of voice .

reference_raw: And Jessamy knew better than to quarrel with him, using that particular tone of voice.

reference_spacy_tokens: And Jessamy knew better than to quarrel with him , using that particular tone of voice .


fn_spacy_tokens_for_baseline: Holy River is usually identified with that still called Helga A , which enters the sea near Kristianstad in southern Sweden , and then lay roughly on the eastern border of the Danish province of Skane .

source_bert_toks: holy river is usually identified with that still called he ##lga a , which enters the sea near kris ##tian ##stad in southern sweden , and then lay roughly on the eastern border of the danish province of ska ##ne .

reference_raw: The Holy River is usually identified by the name of Helga A, which enters the ocean near Kristianstad in southern Sweden, and then lies roughly on the eastern border of the Danish province of Skane.

reference_spacy_tokens: The Holy River is usually identified by the name of Helga A , which enters the ocean near Kristianstad in southern Sweden , and then lies roughly on the eastern border of the Danish province of Skane .


fn_spacy_tokens_for_baseline: Had n't he already said that he disliked women who threw themselves at him ?

source_bert_toks: hadn ' t he already said that he disliked women who threw themselves at him ?

reference_raw: Didn't he say he didn't like women who threw themselves at him?

reference_spacy_tokens: Did n't he say he did n't like women who threw themselves at him ?


fn_spacy_tokens_for_baseline: He once candidly described himself in an interview as ' a manipulative little bastard ' , but his mission , as he sees it , outstrips everyday politics in its importance .

source_bert_toks: he once candi ##dly described himself in an interview as ' a mani ##pu ##lative little bastard ' , but his mission , as he sees it , outs ##trip ##s everyday politics in its importance .

reference_raw: He had once sincerely described himself in the interview as "a manipulative little bastard," but his mission, as he saw it, was beyond the daily politics of his importance.

reference_spacy_tokens: He had once sincerely described himself in the interview as " a manipulative little bastard , " but his mission , as he saw it , was beyond the daily politics of his importance .


fn_spacy_tokens_for_baseline: Emmitt Smith rushed for 163 yards and Troy Aikman threw for 214 yards and two touchdowns as the Cowboys avenged their only defeat of the season by beating Philadelphia Eagles 20 - 10 .

source_bert_toks: em ##mit ##t smith rushed for 163 yards and troy ai ##km ##an threw for 214 yards and two touchdowns as the cowboys avenge ##d their only defeat of the season by beating philadelphia eagles 20 - 10 .

reference_raw: Emmitt Smith raced for 163 yards, and Troy Aikman threw 214 yards and two touchdowns, while the cowboys retaliated their only defeat of the season by defeating the 20-10 Philadelphia Eagles.

reference_spacy_tokens: Emmitt Smith raced for 163 yards , and Troy Aikman threw 214 yards and two touchdowns , while the cowboys retaliated their only defeat of the season by defeating the 20 - 10 Philadelphia Eagles .


fn_spacy_tokens_for_baseline: Murty Killilea and Padraig Kelly were outstanding in defence , with Joe McGrath proving his worth in attack .

source_bert_toks: mu ##rt ##y kill ##ile ##a and pad ##rai ##g kelly were outstanding in defence , with joe mcgrath proving his worth in attack .

reference_raw: Murty Killilea and Padraig Kelly were excellent in defense, and Joe McGrath proved his worth in the attack.

reference_spacy_tokens: Murty Killilea and Padraig Kelly were excellent in defense , and Joe McGrath proved his worth in the attack .


fn_spacy_tokens_for_baseline: He led us up a steep track until we were 1,000 feet above the long Lochranza inlet .

source_bert_toks: he led us up a steep track until we were 1 , 000 feet above the long loch ##ran ##za inlet .

reference_raw: He led us up a steep trail until we were a thousand feet above the long entrance to Lochranza.

reference_spacy_tokens: He led us up a steep trail until we were a thousand feet above the long entrance to Lochranza .


fn_spacy_tokens_for_baseline: Haunting the city from across the Nile are the three Great Pyramids and the Sphinx , these colossal constructions have guarded the desert border for over three and a half thousand years .

source_bert_toks: haunting the city from across the nile are the three great pyramid ##s and the sphinx , these colossal constructions have guarded the desert border for over three and a half thousand years .

reference_raw: The three Great Pyramids and the Sphinx hunt the city from the other side of the Nile, these colossal structures have been patrolling the desert border for more than three and a half thousand years.

reference_spacy_tokens: The three Great Pyramids and the Sphinx hunt the city from the other side of the Nile , these colossal structures have been patrolling the desert border for more than three and a half thousand years .


fn_spacy_tokens_for_baseline: Fully compatible with all leading software , the HP LaserJet can handle even the most sophisticated word - processing packages .

source_bert_toks: fully compatible with all leading software , the hp laser ##jet can handle even the most sophisticated word - processing packages .

reference_raw: The HP LaserJet, fully compliant with all the main software, can handle even the most sophisticated word-processing packages.

reference_spacy_tokens: The HP LaserJet , fully compliant with all the main software , can handle even the most sophisticated word - processing packages .


fn_spacy_tokens_for_baseline: Miss Barrett entered the flat in a strawberry - red coat with a white fur collar , a yellow wool hat and brown fur gloves without fingers .

source_bert_toks: miss barrett entered the flat in a strawberry - red coat with a white fur collar , a yellow wool hat and brown fur gloves without fingers .

reference_raw: Miss Barrett came into the apartment wearing a strawberry-red coat with a white fur collar, a yellow wool hat, and a brown fur glove with no fingers.

reference_spacy_tokens: Miss Barrett came into the apartment wearing a strawberry - red coat with a white fur collar , a yellow wool hat , and a brown fur glove with no fingers .


fn_spacy_tokens_for_baseline: He came on , walking in the same direction as Rachaela , the dilute snow sparkling in his hat like sequins .

source_bert_toks: he came on , walking in the same direction as ra ##cha ##ela , the dil ##ute snow sparkling in his hat like se ##quin ##s .

reference_raw: He continued, walking in the same direction as Rachaela, the dilute snow gleaming like sequins in his hat.

reference_spacy_tokens: He continued , walking in the same direction as Rachaela , the dilute snow gleaming like sequins in his hat .


fn_spacy_tokens_for_baseline: In 20 years only one company with an investment - grade rating from Moody 's has defaulted on long - term debt -- Manville , a single - A company that went bankrupt voluntarily to protect itself from asbestosis lawsuits .

source_bert_toks: in 20 years only one company with an investment - grade rating from moody ' s has defaulted on long - term debt - - man ##ville , a single - a company that went bankrupt voluntarily to protect itself from asbestos ##is lawsuits .

reference_raw: In 20 years, only one of Moody's investment-grade companies defaulted on long-term debts - Manville, the one-and-one company that defaulted voluntarily to protect itself from asbestos lawsuits.

reference_spacy_tokens: In 20 years , only one of Moody 's investment - grade companies defaulted on long - term debts - Manville , the one - and - one company that defaulted voluntarily to protect itself from asbestos lawsuits .


fn_spacy_tokens_for_baseline: In Stage 15 , the riders cross the northern Rhone valley , racing through the Hermitage vineyards which produce classic red and white wines .

source_bert_toks: in stage 15 , the riders cross the northern rhone valley , racing through the hermitage vineyards which produce classic red and white wines .

reference_raw: In the 15th stage, the riders cross the northern Rhone Vale and race through the hermitage vineyards that produce the classic red and white wines.

reference_spacy_tokens: In the 15th stage , the riders cross the northern Rhone Vale and race through the hermitage vineyards that produce the classic red and white wines .


fn_spacy_tokens_for_baseline: She undermined his private notion of himself .

source_bert_toks: she undermine ##d his private notion of himself .

reference_raw: It weakened his private image of himself.

reference_spacy_tokens: It weakened his private image of himself .


fn_spacy_tokens_for_baseline: It landed in the water just in front of where the boy was standing .

source_bert_toks: it landed in the water just in front of where the boy was standing .

reference_raw: He landed in the water just outside where the boy stood.

reference_spacy_tokens: He landed in the water just outside where the boy stood .


fn_spacy_tokens_for_baseline: Note brigadier 's cap badge ; and cavalry yellow backing to the rank pips on his shoulder slides .

source_bert_toks: note brigadier ' s cap badge ; and cavalry yellow backing to the rank pip ##s on his shoulder slides .

reference_raw: Note the brigadier's cap, and the cavalry's yellow backing to the rank pipes on his shoulder slides.

reference_spacy_tokens: Note the brigadier 's cap , and the cavalry 's yellow backing to the rank pipes on his shoulder slides .


fn_spacy_tokens_for_baseline: And , lastly , the definition of rules for housework establishes a mechanism whereby the housewife can reward herself for doing it .

source_bert_toks: and , lastly , the definition of rules for house ##work establishes a mechanism whereby the house ##wife can reward herself for doing it .

reference_raw: Finally, the definition of the rules for domestic work creates a mechanism in which a housewife can be remunerated for doing so.

reference_spacy_tokens: Finally , the definition of the rules for domestic work creates a mechanism in which a housewife can be remunerated for doing so .


fn_spacy_tokens_for_baseline: The above groups pose the following dangers : 1- Attacking for the purpose of : A : Assassination B : Kidnapping C : Aerial raids and artillery attacks 2- Sabotage A : Setting fires B : Explosions C : Technical sabotage D : Chemical sabotage 3- Spying A : Recruiting a member of society B : Planting a mole within society C : Spying surveillance operation 4- Stealing 5- Pests : A : Poisonous such as snakes and scorpions B : Harmful such as rats and cockroaches C : Sickening such as mosquitoes

source_bert_toks: the above groups pose the following dangers : 1 - attacking for the purpose of : a : assassination b : kidnapping c : aerial raids and artillery attacks 2 - sabotage a : setting fires b : explosions c : technical sabotage d : chemical sabotage 3 - spying a : recruiting a member of society b : planting a mole within society c : spying surveillance operation 4 - stealing 5 - pest ##s : a : poisonous such as snakes and scorpion ##s b : harmful such as rats and cock ##ro ##ache ##s c : sick ##ening such as mosquito ##es

reference_raw: The above groups present the following hazards: 1-Assaults: A: Assassination B: Abduction C: Aerial assaults and artillery attacks 2-Sabotage A: Firefighting B: Explosion C: Technical sabotage D: Chemical sabotage 3-Spying A: Recruitment of a member of society B: Planting of a spy in society C: Spying surveillance operation 4-S. A: Poisonous like snakes and scorpions B: Harmful like rats and cockroaches C: Sickening like mosquitoes

reference_spacy_tokens: The above groups present the following hazards : 1-Assaults : A : Assassination B : Abduction C : Aerial assaults and artillery attacks 2-Sabotage A : Firefighting B : Explosion C : Technical sabotage D : Chemical sabotage 3-Spying A : Recruitment of a member of society B : Planting of a spy in society C : Spying surveillance operation 4-S. A : Poisonous like snakes and scorpions B : Harmful like rats and cockroaches C : Sickening like mosquitoes


fn_spacy_tokens_for_baseline: He was in stained black trousers and an open shirt , and his chin was rapidly disappearing beneath a growth of soft , curly hair .

source_bert_toks: he was in stained black trousers and an open shirt , and his chin was rapidly disappearing beneath a growth of soft , curly hair .

reference_raw: He was wearing stained black pants and an open shirt, and his chin was rapidly fading under the growth of soft, curly hair.

reference_spacy_tokens: He was wearing stained black pants and an open shirt , and his chin was rapidly fading under the growth of soft , curly hair .


fn_spacy_tokens_for_baseline: ' Oh , we rented this space from the Poetry Society .

source_bert_toks: ' oh , we rented this space from the poetry society .

reference_raw: 'Oh, we've leased this place from the Poetry Society.

reference_spacy_tokens: ' Oh , we 've leased this place from the Poetry Society .


fn_spacy_tokens_for_baseline: Responding to the barrage of critics who insist that Iran 's illicit intentions are obvious , El - Baradei has pointed to the continued absence of a " smoking gun " and the fundamental shortcomings of attempts to concretely assess Iran 's programmatic goals without such evidence .

source_bert_toks: responding to the barrage of critics who insist that iran ' s illicit intentions are obvious , el - bar ##ade ##i has pointed to the continued absence of a " smoking gun " and the fundamental short ##coming ##s of attempts to concrete ##ly assess iran ' s program ##matic goals without such evidence .

reference_raw: In response to the barrage of critics who insist that Iran's illegal intentions are clear, El-Baradei pointed out the continued absence of a "smoking weapon" and the fundamental shortcomings of attempts to specifically assess Iran's programmatic objectives without such evidence.

reference_spacy_tokens: In response to the barrage of critics who insist that Iran 's illegal intentions are clear , El - Baradei pointed out the continued absence of a " smoking weapon " and the fundamental shortcomings of attempts to specifically assess Iran 's programmatic objectives without such evidence .


fn_spacy_tokens_for_baseline: She left about ten minutes ago .

source_bert_toks: she left about ten minutes ago .

reference_raw: She was gone about 10 minutes ago.

reference_spacy_tokens: She was gone about 10 minutes ago .


fn_spacy_tokens_for_baseline: Slowly , each movement a vast , unexplored continent of pain , she pushed out from the steps and hobbled past him .

source_bert_toks: slowly , each movement a vast , une ##x ##pl ##ored continent of pain , she pushed out from the steps and ho ##bbled past him .

reference_raw: Slowly, each movement a vast, unexplored continent of pain, she pushed herself out of the stairs and limped past him.

reference_spacy_tokens: Slowly , each movement a vast , unexplored continent of pain , she pushed herself out of the stairs and limped past him .


fn_spacy_tokens_for_baseline: He bent forward to take the bouquet , and she felt something inside her tighten and twist as she shrank further behind her flowers .

source_bert_toks: he bent forward to take the bouquet , and she felt something inside her tighten and twist as she sh ##rank further behind her flowers .

reference_raw: He leaned forward to pick up the bouquet, and she felt something inside her tighten and twist as she shrank further behind the flowers.

reference_spacy_tokens: He leaned forward to pick up the bouquet , and she felt something inside her tighten and twist as she shrank further behind the flowers .


fn_spacy_tokens_for_baseline: ' Am I gon na have a good or bad day , that 's all I want to know . '

source_bert_toks: ' am i go ##n na have a good or bad day , that ' s all i want to know . '

reference_raw: "I'm going to have a good day or I'm not going to have a good day, that's all I want to know."

reference_spacy_tokens: " I 'm going to have a good day or I 'm not going to have a good day , that 's all I want to know . "


fn_spacy_tokens_for_baseline: ' I 'll leave out some of my clothes to replace those , ' Susan said , gesturing towards the clothes Maggie had acquired at The Haven .

source_bert_toks: ' i ' ll leave out some of my clothes to replace those , ' susan said , gesturing towards the clothes maggie had acquired at the haven .

reference_raw: 'I'm going to leave out some of my clothes to replace them,' said Susan, pointing to the dress Maggie had bought in The Haven.

reference_spacy_tokens: ' I 'm going to leave out some of my clothes to replace them , ' said Susan , pointing to the dress Maggie had bought in The Haven .


fn_spacy_tokens_for_baseline: On it , perhaps , the few simple words : ' To the Jewish emigrants from lands across the seas .

source_bert_toks: on it , perhaps , the few simple words : ' to the jewish emi ##grants from lands across the seas .

reference_raw: There might be a few simple words on it: 'Jewish immigrants from overseas lands.

reference_spacy_tokens: There might be a few simple words on it : ' Jewish immigrants from overseas lands .


fn_spacy_tokens_for_baseline: Gould grew to depend on the Aborigines ' local knowledge to find birds that were new to the Western world and to learn about their habits .

source_bert_toks: gould grew to depend on the ab ##ori ##gin ##es ' local knowledge to find birds that were new to the western world and to learn about their habits .

reference_raw: Gould had grown dependent on the local knowledge of the natives to find the birds that were new to the western world and learn of their habits.

reference_spacy_tokens: Gould had grown dependent on the local knowledge of the natives to find the birds that were new to the western world and learn of their habits .


fn_spacy_tokens_for_baseline: Appropriately modest , he credits his success to his " physical equipment " rather than his talent : his height and good health , as well as that voice , that jaw , and that nose .

source_bert_toks: appropriately modest , he credits his success to his " physical equipment " rather than his talent : his height and good health , as well as that voice , that jaw , and that nose .

reference_raw: Adequately modest, he attributes his achievement to his "physical equipment" rather than to his talent: his height and good health, as well as his voice, his jaw, and his nose.

reference_spacy_tokens: Adequately modest , he attributes his achievement to his " physical equipment " rather than to his talent : his height and good health , as well as his voice , his jaw , and his nose .


fn_spacy_tokens_for_baseline: Among other things , I was anxious to show him Chaldon Church , with its medieval wall painting of the Last Judgment .

source_bert_toks: among other things , i was anxious to show him cha ##ldon church , with its medieval wall painting of the last judgment .

reference_raw: I wanted to show him, among other things, the Chaldon Church with its medieval wall image of the Last Judgment.

reference_spacy_tokens: I wanted to show him , among other things , the Chaldon Church with its medieval wall image of the Last Judgment .


fn_spacy_tokens_for_baseline: A moth flew past her face , making her jump , and his grasp tightened around her waist .

source_bert_toks: a moth flew past her face , making her jump , and his grasp tightened around her waist .

reference_raw: A moth passed her face, forcing her to jump, and his grip tightened around her waist.

reference_spacy_tokens: A moth passed her face , forcing her to jump , and his grip tightened around her waist .


fn_spacy_tokens_for_baseline: He was asked to stand for parliament , but declined , having no particular relish for party - politics ; he was too large - hearted a man for that .

source_bert_toks: he was asked to stand for parliament , but declined , having no particular re ##lish for party - politics ; he was too large - hearted a man for that .

reference_raw: He'd been asked to stand for Parliament, but he'd refused because he didn't particularly like party politics; he was too big-hearted a man for that.

reference_spacy_tokens: He 'd been asked to stand for Parliament , but he 'd refused because he did n't particularly like party politics ; he was too big - hearted a man for that .


fn_spacy_tokens_for_baseline: A mechanical response with which he had grown up , natural as breathing .

source_bert_toks: a mechanical response with which he had grown up , natural as breathing .

reference_raw: The mechanical reaction with which he grew up, natural as breath.

reference_spacy_tokens: The mechanical reaction with which he grew up , natural as breath .


fn_spacy_tokens_for_baseline: However , thanks to sponsorship from Natal Building Society and public fund - raising both parents flew to Sydney to see the exciting but frustrating semi - final against England .

source_bert_toks: however , thanks to sponsorship from natal building society and public fund - raising both parents flew to sydney to see the exciting but frustrating semi - final against england .

reference_raw: But thanks to the sponsorship of the Natal Building Society and the public fundraising, both parents flew to Sydney to see a thrilling but frustrating half-final against England.

reference_spacy_tokens: But thanks to the sponsorship of the Natal Building Society and the public fundraising , both parents flew to Sydney to see a thrilling but frustrating half - final against England .


fn_spacy_tokens_for_baseline: Had he murdered his uncle in the meantime ? '

source_bert_toks: had he murdered his uncle in the meantime ? '

reference_raw: In the meantime, did he kill his cousin?'

reference_spacy_tokens: In the meantime , did he kill his cousin ? '


fn_spacy_tokens_for_baseline: Although Iran ratified the Chemical Weapons Convention ( CWC ) in November 1997 , the United States believes that Iran has maintained a chemical weapons program since 1984 , including production of sarin , mustard , phosgene , and hydrocyanic acid .

source_bert_toks: although iran ratified the chemical weapons convention ( cw ##c ) in november 1997 , the united states believes that iran has maintained a chemical weapons program since 1984 , including production of sar ##in , mustard , ph ##os ##gen ##e , and hydro ##cy ##ani ##c acid .

reference_raw: Despite Iran's ratification of the Convention on Chemical Weapons (CWC) in November 1997, the United States considers that Iran has maintained a chemical weapons programme, including the manufacture of sarin, mustard, phosphorus and hydrocyanic acid since 1984.

reference_spacy_tokens: Despite Iran 's ratification of the Convention on Chemical Weapons ( CWC ) in November 1997 , the United States considers that Iran has maintained a chemical weapons programme , including the manufacture of sarin , mustard , phosphorus and hydrocyanic acid since 1984 .


fn_spacy_tokens_for_baseline: Sounding like a variation of Buffalo Tom , the Pixies and Sebadoh ( with hints of The Cure , Teenage Fanclub and Can ) , they 've fused agonised tunes with fey and angst - riddled melodies .

source_bert_toks: sounding like a variation of buffalo tom , the pi ##xie ##s and se ##bad ##oh ( with hints of the cure , teenage fan ##cl ##ub and can ) , they ' ve fused ago ##nis ##ed tunes with fey and ang ##st - riddle ##d melodies .

reference_raw: It sounded like the variation of Buffalo Tom, the Pixies, and Sebadoh (with the hints of The Cure, Teenage Fanclub, and Can), and mixed the tortured melodies with fey and angst-riddled melodies.

reference_spacy_tokens: It sounded like the variation of Buffalo Tom , the Pixies , and Sebadoh ( with the hints of The Cure , Teenage Fanclub , and Can ) , and mixed the tortured melodies with fey and angst - riddled melodies .


fn_spacy_tokens_for_baseline: Windows were shattered in the blast , at Farnham Street in the Catholic lower Ormeau area .

source_bert_toks: windows were shattered in the blast , at far ##nham street in the catholic lower or ##me ##au area .

reference_raw: The windows were smashed in an explosion on Farnham Street in the Catholic Lower Ormeau region.

reference_spacy_tokens: The windows were smashed in an explosion on Farnham Street in the Catholic Lower Ormeau region .


fn_spacy_tokens_for_baseline: Let bards sing now of barbiturates as bright as violets .

source_bert_toks: let bard ##s sing now of bar ##bit ##ura ##tes as bright as violet ##s .

reference_raw: Now let the bards chant of barbiturates as bright as violets.

reference_spacy_tokens: Now let the bards chant of barbiturates as bright as violets .


fn_spacy_tokens_for_baseline: She shouted a warning to Defries and fired .

source_bert_toks: she shouted a warning to def ##ries and fired .

reference_raw: Screaming a warning to Defries, she fired.

reference_spacy_tokens: Screaming a warning to Defries , she fired .


fn_spacy_tokens_for_baseline: There is considerable species variation in the response of the stomach to alcohol and so animal studies will be cited only where data from humans are inadequate .

source_bert_toks: there is considerable species variation in the response of the stomach to alcohol and so animal studies will be cited only where data from humans are inadequate .

reference_raw: There are significant species differences in the response of the stomach to alcohol and therefore animal studies will only be cited if human data are insufficient.

reference_spacy_tokens: There are significant species differences in the response of the stomach to alcohol and therefore animal studies will only be cited if human data are insufficient .


fn_spacy_tokens_for_baseline: I was so sure I was drowning that I forgot about the race and screamed out , ' Father !

source_bert_toks: i was so sure i was drowning that i forgot about the race and screamed out , ' father !

reference_raw: I was so sure I was drowning, I forgot the race and yelled, "Father!

reference_spacy_tokens: I was so sure I was drowning , I forgot the race and yelled , " Father !


fn_spacy_tokens_for_baseline: I am confident we will capture quite a share of that still undecided vote . "

source_bert_toks: i am confident we will capture quite a share of that still und ##ec ##ided vote . "

reference_raw: I'm sure we'll catch a fair share of this undecided vote.

reference_spacy_tokens: I 'm sure we 'll catch a fair share of this undecided vote .


fn_spacy_tokens_for_baseline: Their houses are coloured in weathered pastels and ochres set amidst silvery olive trees .

source_bert_toks: their houses are coloured in weathered paste ##ls and och ##res set amidst silvery olive trees .

reference_raw: Their homes are colored with weathered pastels and ochres set between silvery olive trees.

reference_spacy_tokens: Their homes are colored with weathered pastels and ochres set between silvery olive trees .


fn_spacy_tokens_for_baseline: You did n't like being woken in the middle of the night for ice cream , but you sat up and ate it in bed before it melted to please your father .

source_bert_toks: you didn ' t like being woken in the middle of the night for ice cream , but you sat up and ate it in bed before it melted to please your father .

reference_raw: You didn't like being awakened for ice cream in the middle of the night, but you sat down and ate it in bed before it melted to please your father.

reference_spacy_tokens: You did n't like being awakened for ice cream in the middle of the night , but you sat down and ate it in bed before it melted to please your father .


fn_spacy_tokens_for_baseline: YOUR article suggesting the Queen has now given up on Charles and Diana being the next king and queen of England was fascinating .

source_bert_toks: your article suggesting the queen has now given up on charles and diana being the next king and queen of england was fascinating .

reference_raw: Your article that suggested that Charles and Diana had just surrendered to be the next King and King of England was fascinating.

reference_spacy_tokens: Your article that suggested that Charles and Diana had just surrendered to be the next King and King of England was fascinating .


fn_spacy_tokens_for_baseline: One morning he spent in town , and I learned from a casual reference that he had visited the British Museum .

source_bert_toks: one morning he spent in town , and i learned from a casual reference that he had visited the british museum .

reference_raw: He was in town one morning, and I was told by a casual reference that he had visited the British Museum.

reference_spacy_tokens: He was in town one morning , and I was told by a casual reference that he had visited the British Museum .


fn_spacy_tokens_for_baseline: He knew of course that Theo would equivocate .

source_bert_toks: he knew of course that theo would e ##qui ##vo ##cate .

reference_raw: Of course he knew Theo would evocate.

reference_spacy_tokens: Of course he knew Theo would evocate .


fn_spacy_tokens_for_baseline: ' If some of our visitors are somewhat lacking in restraint , ' noted an RCM report euphemistically , ' it must be remembered that many are overwrought with anxiety . '

source_bert_toks: ' if some of our visitors are somewhat lacking in restraint , ' noted an rc ##m report eu ##ph ##emi ##stic ##ally , ' it must be remembered that many are over ##wr ##ough ##t with anxiety . '

reference_raw: "If some of our guests lack restraint," the RCM report said euphemistically, "it must be borne in mind that many of them are filled with anxiety."

reference_spacy_tokens: " If some of our guests lack restraint , " the RCM report said euphemistically , " it must be borne in mind that many of them are filled with anxiety . "


fn_spacy_tokens_for_baseline: His mouth twitched uncontrollably , tom by conflicting emotions .

source_bert_toks: his mouth twitched un ##con ##tro ##lla ##bly , tom by conflicting emotions .

reference_raw: His mouth twisted uncontrollably, Tom with conflicting emotions.

reference_spacy_tokens: His mouth twisted uncontrollably , Tom with conflicting emotions .


fn_spacy_tokens_for_baseline: The grey eyes blinked , small and frightened .

source_bert_toks: the grey eyes blinked , small and frightened .

reference_raw: His gray eyes flickered, small and frightened.

reference_spacy_tokens: His gray eyes flickered , small and frightened .


fn_spacy_tokens_for_baseline: Within seconds , the formerly empty sky was full with birds plummeting onto the carcass .

source_bert_toks: within seconds , the formerly empty sky was full with birds plum ##met ##ing onto the car ##cas ##s .

reference_raw: Within seconds, the previously empty sky was full of birds hitting the carcass.

reference_spacy_tokens: Within seconds , the previously empty sky was full of birds hitting the carcass .


fn_spacy_tokens_for_baseline: After initially rebuffing the idea , Israel on Sunday said it would consider deployment of an international stabilization force on the border .

source_bert_toks: after initially re ##bu ##ffin ##g the idea , israel on sunday said it would consider deployment of an international stabilization force on the border .

reference_raw: After initially rejecting the idea, Israel said on Sunday that it would consider deploying an international stabilization force at the border.

reference_spacy_tokens: After initially rejecting the idea , Israel said on Sunday that it would consider deploying an international stabilization force at the border .