fn_spacy_tokens_for_baseline: But then she was no longer classed as a shop assistant , Mrs Miller had made that quite plain .

source_bert_toks: but then she was no longer classed as a shop assistant , mrs miller had made that quite plain .

reference_raw: But then she was no longer classified as a business assistant, Mrs. Miller made it very clear.

reference_spacy_tokens: But then she was no longer classified as a business assistant , Mrs. Miller made it very clear .


fn_spacy_tokens_for_baseline: They were interrupted by Janet Halstead who bustled into the room , a tight smile betraying her tiredness .

source_bert_toks: they were interrupted by janet hal ##stead who bust ##led into the room , a tight smile betray ##ing her tired ##ness .

reference_raw: Janet Halstead interrupted, who hurried into the room, a tight smile betraying her fatigue.

reference_spacy_tokens: Janet Halstead interrupted , who hurried into the room , a tight smile betraying her fatigue .


fn_spacy_tokens_for_baseline: Yanto parked the bike in the small alley which separated his Mother 's cottage from the Post Office and stood back to admire the machine again .

source_bert_toks: yan ##to parked the bike in the small alley which separated his mother ' s cottage from the post office and stood back to admire the machine again .

reference_raw: In a small alley that separated his mother's cabin from the Post Office, Yanto stopped and admired the machine again.

reference_spacy_tokens: In a small alley that separated his mother 's cabin from the Post Office , Yanto stopped and admired the machine again .


fn_spacy_tokens_for_baseline: He decided to be nice about the whole business , though he still could not see the point of it , and offered to put the little biscuity things into bowls .

source_bert_toks: he decided to be nice about the whole business , though he still could not see the point of it , and offered to put the little bis ##cuit ##y things into bowls .

reference_raw: He decided to be kind to the whole thing, though he still didn't know what it was, and offered to put the cookies in the bowls.

reference_spacy_tokens: He decided to be kind to the whole thing , though he still did n't know what it was , and offered to put the cookies in the bowls .


fn_spacy_tokens_for_baseline: She 's always reading the fashion mags and spends loads of money on clothes .

source_bert_toks: she ' s always reading the fashion mag ##s and spends loads of money on clothes .

reference_raw: He always reads fashion magazines and spends a lot of money on clothes.

reference_spacy_tokens: He always reads fashion magazines and spends a lot of money on clothes .


fn_spacy_tokens_for_baseline: Israel reportedly has doubts about following through on its request that Mousa Mohammed Abu Marzook be extradited to stand trial on charges of conspiracy to commit murder , fearing a trial in Israel could spark violence .

source_bert_toks: israel reportedly has doubts about following through on its request that mo ##usa mohammed abu mar ##zoo ##k be extra ##dit ##ed to stand trial on charges of conspiracy to commit murder , fearing a trial in israel could spark violence .

reference_raw: Israel reportedly has doubts that it will follow its request for the extradition of Mousa Mohammed Abu Marzook to stand trial for conspiracy to commit murder, fearing that a trial in Israel might spark violence.

reference_spacy_tokens: Israel reportedly has doubts that it will follow its request for the extradition of Mousa Mohammed Abu Marzook to stand trial for conspiracy to commit murder , fearing that a trial in Israel might spark violence .


fn_spacy_tokens_for_baseline: Neil Blender and Billy Ruff were the first pros from the States to skate the ramp .

source_bert_toks: neil blend ##er and billy ru ##ff were the first pro ##s from the states to skate the ramp .

reference_raw: Neil Blender and Billy Ruff were the first pros in the U.S. to roll a ramp.

reference_spacy_tokens: Neil Blender and Billy Ruff were the first pros in the U.S. to roll a ramp .


fn_spacy_tokens_for_baseline: When , a few days later , I asked one morning , ' When a hen lays an egg , does it come out of hen 's beak ? ' a deathly hush fell over the breakfast table .

source_bert_toks: when , a few days later , i asked one morning , ' when a hen lays an egg , does it come out of hen ' s beak ? ' a death ##ly hush fell over the breakfast table .

reference_raw: When I asked one morning a few days later, "When a chicken puts an egg down, does it come out of a chicken's beak?" a deadly silence fell over the breakfast table.

reference_spacy_tokens: When I asked one morning a few days later , " When a chicken puts an egg down , does it come out of a chicken 's beak ? " a deadly silence fell over the breakfast table .


fn_spacy_tokens_for_baseline: Finally , by the late 1980s , it was reported that North Korea was able to produce CW agents in large quantity , and deployed large numbers of chemical ordnance .

source_bert_toks: finally , by the late 1980s , it was reported that north korea was able to produce cw agents in large quantity , and deployed large numbers of chemical ordnance .

reference_raw: Finally, by the end of the 1980s, it was reported that North Korea was able to produce CW agents in large quantities and used a large number of chemical orders.

reference_spacy_tokens: Finally , by the end of the 1980s , it was reported that North Korea was able to produce CW agents in large quantities and used a large number of chemical orders .


fn_spacy_tokens_for_baseline: Mr Everitt says the answer is longer sentences , but experts are divided on whether institutionalising young offenders is the best solution .

source_bert_toks: mr ever ##itt says the answer is longer sentences , but experts are divided on whether institutional ##ising young offenders is the best solution .

reference_raw: Mr. Everitt says longer sentences are the answer, but experts are divided on whether institutionalisation of young offenders is the best solution.

reference_spacy_tokens: Mr. Everitt says longer sentences are the answer , but experts are divided on whether institutionalisation of young offenders is the best solution .


fn_spacy_tokens_for_baseline: Cut the rich fruit cake in half diagonally and place one half on top of the other to form a triangle , sandwiching on with a little apricot glaze .

source_bert_toks: cut the rich fruit cake in half diagonal ##ly and place one half on top of the other to form a triangle , sandwich ##ing on with a little apr ##ico ##t g ##laze .

reference_raw: Cut the rich fruit cake half diagonally and place one half on the other to make a triangular sandwich with a small apricot glaze.

reference_spacy_tokens: Cut the rich fruit cake half diagonally and place one half on the other to make a triangular sandwich with a small apricot glaze .


fn_spacy_tokens_for_baseline: And I 've been shitting in my pants all the way . '

source_bert_toks: and i ' ve been shit ##ting in my pants all the way . '

reference_raw: And I've been pooping in my pants the whole time.'

reference_spacy_tokens: And I 've been pooping in my pants the whole time . '


fn_spacy_tokens_for_baseline: His father became a Protestant lecturer in England , and according to his son a Catholic mob stoned him to death .

source_bert_toks: his father became a protestant lecturer in england , and according to his son a catholic mob stone ##d him to death .

reference_raw: His father became a Protestant lecturer in England, and according to his son, the Catholic Mafia shot him to death.

reference_spacy_tokens: His father became a Protestant lecturer in England , and according to his son , the Catholic Mafia shot him to death .


fn_spacy_tokens_for_baseline: During this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

source_bert_toks: during this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

reference_raw: During that time, the natives lived in caves and hunted mammals that had gathered on the shore.

reference_spacy_tokens: During that time , the natives lived in caves and hunted mammals that had gathered on the shore .


fn_spacy_tokens_for_baseline: You will feel very relaxed and comfortable .

source_bert_toks: you will feel very relaxed and comfortable .

reference_raw: You'll be very calm and comfortable.

reference_spacy_tokens: You 'll be very calm and comfortable .


fn_spacy_tokens_for_baseline: He showed immense energy in completing assignments and generating new business , and was especially successful at convincing clients of the wisdom of his choices and candidates of the importance of the opportunity on offer .

source_bert_toks: he showed immense energy in completing assignments and generating new business , and was especially successful at convincing clients of the wisdom of his choices and candidates of the importance of the opportunity on offer .

reference_raw: He showed tremendous energy in completing assignments and creating new businesses, and in particular he succeeded in convincing clients of the wisdom of his choices and candidates of the importance of the opportunities offered.

reference_spacy_tokens: He showed tremendous energy in completing assignments and creating new businesses , and in particular he succeeded in convincing clients of the wisdom of his choices and candidates of the importance of the opportunities offered .


fn_spacy_tokens_for_baseline: But next morning , she had woken determined to make the best of it .

source_bert_toks: but next morning , she had woken determined to make the best of it .

reference_raw: But the next morning she awoke determined to do the best she could.

reference_spacy_tokens: But the next morning she awoke determined to do the best she could .


fn_spacy_tokens_for_baseline: She reached for her brandy glass , her fingers tight around it .

source_bert_toks: she reached for her brandy glass , her fingers tight around it .

reference_raw: She reached for the brandy jar and wrapped her fingers tightly around it.

reference_spacy_tokens: She reached for the brandy jar and wrapped her fingers tightly around it .


fn_spacy_tokens_for_baseline: Libya remains a significant proliferation concern .

source_bert_toks: libya remains a significant proliferation concern .

reference_raw: Libya remains a major concern for the spread of information.

reference_spacy_tokens: Libya remains a major concern for the spread of information .


fn_spacy_tokens_for_baseline: Indeed , according to Marvin Wolfgang ( Braithwaite 1981b : 15 ) the chances of being a victim of homicide in the US are five times as high for white males inside prison than for those outside .

source_bert_toks: indeed , according to marvin wolfgang ( bra ##ith ##waite 1981 ##b : 15 ) the chances of being a victim of homicide in the us are five times as high for white males inside prison than for those outside .

reference_raw: According to Marvin Wolfgang (Braithwaite 1981b: 15), the chances of murder in the United States are five times higher for white men in prison than for outsiders.

reference_spacy_tokens: According to Marvin Wolfgang ( Braithwaite 1981b : 15 ) , the chances of murder in the United States are five times higher for white men in prison than for outsiders .


fn_spacy_tokens_for_baseline: Although certain other languages were geographically nearby , it was impossible to establish any resemblances between them , hence Basque , for example , is not classified as being in the same family with other European languages , nor are Hungarian and Finnish , both of which belong to their own group .

source_bert_toks: although certain other languages were geographically nearby , it was impossible to establish any resemblance ##s between them , hence basque , for example , is not classified as being in the same family with other european languages , nor are hungarian and finnish , both of which belong to their own group .

reference_raw: Although some of the other languages were geographically close, no similarities could be established, for example, Basque is not classified as belonging to the same group as other European languages, and neither is Hungary nor Finland, both of which are part of their own group.

reference_spacy_tokens: Although some of the other languages were geographically close , no similarities could be established , for example , Basque is not classified as belonging to the same group as other European languages , and neither is Hungary nor Finland , both of which are part of their own group .


fn_spacy_tokens_for_baseline: Gerald watched in horror as his prize possession disappeared into a red leather box held open by the King 's private secretary , who stood poised behind his sovereign .

source_bert_toks: gerald watched in horror as his prize possession disappeared into a red leather box held open by the king ' s private secretary , who stood poised behind his sovereign .

reference_raw: Gerald watched in horror as his prize possession vanished into the red leather box held open by the King's private secretary, who stood behind his ruler.

reference_spacy_tokens: Gerald watched in horror as his prize possession vanished into the red leather box held open by the King 's private secretary , who stood behind his ruler .


fn_spacy_tokens_for_baseline: ' Newspapers have promoted a witch hunt rather than reassure a worried public , ' it says .

source_bert_toks: ' newspapers have promoted a witch hunt rather than reassure a worried public , ' it says .

reference_raw: "The newspapers promote witch hunts rather than comfort the concerned public," he says.

reference_spacy_tokens: " The newspapers promote witch hunts rather than comfort the concerned public , " he says .


fn_spacy_tokens_for_baseline: We have shown that ? -actinin is abundant in the bone marrow stroma matrix , presumably at focal adhesion sites [ 5]. We have also reported that a 31 kDa amino - terminal ? -actinin fragment , which we have named mactinin , is generated by the degradation of extracellular ? -actinin by monocyte - secreted urokinase [ 6]. Furthermore , we have demonstrated that mactinin is present in inflammation caused by Pneumocystis carinii pneumonia , by examining bronchoalveolar lavage fluid from mice with infection [ 6]. It was not present in mice not challenged with P. carinii , suggesting that inflammaton is necessary for mactinin formation .

source_bert_toks: we have shown that ? - act ##ini ##n is abundant in the bone marrow st ##rom ##a matrix , presumably at focal ad ##hesion sites [ 5 ] . we have also reported that a 31 k ##da amino - terminal ? - act ##ini ##n fragment , which we have named mac ##tin ##in , is generated by the degradation of extra ##cellular ? - act ##ini ##n by mono ##cy ##te - secret ##ed ur ##oki ##nas ##e [ 6 ] . furthermore , we have demonstrated that mac ##tin ##in is present in inflammation caused by p ##ne ##um ##oc ##yst ##is car ##ini ##i pneumonia , by examining bro ##nch ##oa ##l ##ve ##olar lava ##ge fluid from mice with infection [ 6 ] . it was not present in mice not challenged with p . car ##ini ##i , suggesting that in ##fl ##am ##mat ##on is necessary for mac ##tin ##in formation .

reference_raw: We have demonstrated that ?-actinin is abundant in the bone marrow stroma matrix, probably at focal adhesion sites [5]. We have also reported that the 31 kDa amino-terminal ?-actinin fragment, which we call mactinin, is due to the degradation of extracellular ?-actin by urokinase secreted by monocytes[6]. Inflammation caused by Pneumocystis carinii pneumonia is present by examining bronchoalveolar lavage fluid from mice infected with infection [6]. It was not present in mice not challenged by P. carinii, suggesting that inflammatory fluids are needed to produce mactinin.

reference_spacy_tokens: We have demonstrated that ? -actinin is abundant in the bone marrow stroma matrix , probably at focal adhesion sites [ 5]. We have also reported that the 31 kDa amino - terminal ? -actinin fragment , which we call mactinin , is due to the degradation of extracellular ? -actin by urokinase secreted by monocytes[6]. Inflammation caused by Pneumocystis carinii pneumonia is present by examining bronchoalveolar lavage fluid from mice infected with infection [ 6]. It was not present in mice not challenged by P. carinii , suggesting that inflammatory fluids are needed to produce mactinin .


fn_spacy_tokens_for_baseline: You can also use your Cashline card to withdraw cash from cash dispensers in some European countries .

source_bert_toks: you can also use your cash ##line card to withdraw cash from cash di ##sp ##ense ##rs in some european countries .

reference_raw: In some European countries, you can also use your Cashline card to withdraw cash from the cash-distributors.

reference_spacy_tokens: In some European countries , you can also use your Cashline card to withdraw cash from the cash - distributors .


fn_spacy_tokens_for_baseline: Although they are discussed here as separate issues , tourism , recreation and sport are not mutually exclusive .

source_bert_toks: although they are discussed here as separate issues , tourism , recreation and sport are not mutually exclusive .

reference_raw: Although they are dealt with as separate issues, tourism, leisure and sport are not mutually exclusive.

reference_spacy_tokens: Although they are dealt with as separate issues , tourism , leisure and sport are not mutually exclusive .


fn_spacy_tokens_for_baseline: She sat up with a gasp and blew her nose hard ; then , since he was close , she rested her aching head against his ample stomach .

source_bert_toks: she sat up with a gasp and blew her nose hard ; then , since he was close , she rested her aching head against his ample stomach .

reference_raw: She sat up with a breath and blew her nose hard; then, when he was close, she rested her aching head on his ample stomach.

reference_spacy_tokens: She sat up with a breath and blew her nose hard ; then , when he was close , she rested her aching head on his ample stomach .


fn_spacy_tokens_for_baseline: Abbot Kenneth was holding a cup of medicine to the old man 's lips , but Eachuinn Odhar pushed it away and turned , eyes hooded , to face his son .

source_bert_toks: abbot kenneth was holding a cup of medicine to the old man ' s lips , but each ##uin ##n o ##dhar pushed it away and turned , eyes hooded , to face his son .

reference_raw: Abbot Kenneth held a mug of medicine to the old man's lips, but Eachuinn Odhar pushed it aside and turned to face his son with hooded eyes.

reference_spacy_tokens: Abbot Kenneth held a mug of medicine to the old man 's lips , but Eachuinn Odhar pushed it aside and turned to face his son with hooded eyes .


fn_spacy_tokens_for_baseline: ' Simon Cooper , ' Simon promptly declared , and looked expectant .

source_bert_toks: ' simon cooper , ' simon promptly declared , and looked expect ##ant .

reference_raw: 'Simon Cooper,' Simon said quickly, looking expectant.

reference_spacy_tokens: ' Simon Cooper , ' Simon said quickly , looking expectant .


fn_spacy_tokens_for_baseline: Bernice had reached the apex of the terminal dome by now .

source_bert_toks: bern ##ice had reached the apex of the terminal dome by now .

reference_raw: Bernice was already at the top of the terminal dome.

reference_spacy_tokens: Bernice was already at the top of the terminal dome .


fn_spacy_tokens_for_baseline: The tracks it left behind it bisected a faded trail of bootprints .

source_bert_toks: the tracks it left behind it bis ##ect ##ed a faded trail of boot ##print ##s .

reference_raw: The footprints he had left behind made a faded trail of footprints.

reference_spacy_tokens: The footprints he had left behind made a faded trail of footprints .


fn_spacy_tokens_for_baseline: The woman gasped and then called after me but I would n't stop .

source_bert_toks: the woman gasped and then called after me but i wouldn ' t stop .

reference_raw: The woman took a deep breath and called after me, but I didn't want to stop.

reference_spacy_tokens: The woman took a deep breath and called after me , but I did n't want to stop .


fn_spacy_tokens_for_baseline: As I walked down the front steps for the last time , a feeling of elation swept over me .

source_bert_toks: as i walked down the front steps for the last time , a feeling of el ##ation swept over me .

reference_raw: The last time I walked down the front steps, I felt a surge of joy.

reference_spacy_tokens: The last time I walked down the front steps , I felt a surge of joy .


fn_spacy_tokens_for_baseline: We have already seen the role that these organizations played at key stages of the struggle .

source_bert_toks: we have already seen the role that these organizations played at key stages of the struggle .

reference_raw: We've seen the role these organizations play in the crucial stages of the fight.

reference_spacy_tokens: We 've seen the role these organizations play in the crucial stages of the fight .


fn_spacy_tokens_for_baseline: What are the prospects of disconnection for industrial customers in the coming year if they can not afford to pay the exorbitant increases that the electricity companies are seeking from them ?

source_bert_toks: what are the prospects of disco ##nne ##ction for industrial customers in the coming year if they can not afford to pay the ex ##or ##bit ##ant increases that the electricity companies are seeking from them ?

reference_raw: What are the prospects for industrial customers to be disconnected in the coming year if they cannot afford to pay the excessive increase that electricity companies seek from them?

reference_spacy_tokens: What are the prospects for industrial customers to be disconnected in the coming year if they can not afford to pay the excessive increase that electricity companies seek from them ?


fn_spacy_tokens_for_baseline: Here is a woman who insists upon being treated with all the formality of royal protocol .

source_bert_toks: here is a woman who insists upon being treated with all the formal ##ity of royal protocol .

reference_raw: There's a woman who's insinuating that she'll be treated with all the formalities of royal protocol.

reference_spacy_tokens: There 's a woman who 's insinuating that she 'll be treated with all the formalities of royal protocol .


fn_spacy_tokens_for_baseline: The young reader wonders how one human being could invent such an interesting story , and write it all in words that are so easily read .

source_bert_toks: the young reader wonders how one human being could in ##vent such an interesting story , and write it all in words that are so easily read .

reference_raw: The young reader wonders how a human being can make up such an interesting story and write it all in words that are so easy to read.

reference_spacy_tokens: The young reader wonders how a human being can make up such an interesting story and write it all in words that are so easy to read .


fn_spacy_tokens_for_baseline: This program would subsequently lead into the Shehab-2 ( Scud - C / Hwasong-6 ) and Shehab-3 ( Nodong ) programs .

source_bert_toks: this program would subsequently lead into the she ##hab - 2 ( sc ##ud - c / h ##was ##ong - 6 ) and she ##hab - 3 ( nod ##ong ) programs .

reference_raw: The program will then result in Shehab-2 (Scud-C/Hwasong-6) and Shehab-3 (Nodong).

reference_spacy_tokens: The program will then result in Shehab-2 ( Scud - C / Hwasong-6 ) and Shehab-3 ( Nodong ) .


fn_spacy_tokens_for_baseline: London appointed the first school medical officer in 1890 .

source_bert_toks: london appointed the first school medical officer in 1890 .

reference_raw: In 1890, London nominated the first medical officer in the school.

reference_spacy_tokens: In 1890 , London nominated the first medical officer in the school .


fn_spacy_tokens_for_baseline: He said the biggest element in the rise from last year 's £ 309 was the Government 's withdrawal of the " safety net " , which adds £ 14.87 to each bill .

source_bert_toks: he said the biggest element in the rise from last year ' s £3 ##0 ##9 was the government ' s withdrawal of the " safety net " , which adds £1 ##4 . 87 to each bill .

reference_raw: He said that the biggest part of the increase from last year's £309 was the government's removal of the safety net, which adds £14.87 to every bill.

reference_spacy_tokens: He said that the biggest part of the increase from last year 's £ 309 was the government 's removal of the safety net , which adds £ 14.87 to every bill .


fn_spacy_tokens_for_baseline: Paul and John strap themselves into the back seats of the small plane .

source_bert_toks: paul and john strap themselves into the back seats of the small plane .

reference_raw: Paul and John buckled into the backseats of the little plane.

reference_spacy_tokens: Paul and John buckled into the backseats of the little plane .


fn_spacy_tokens_for_baseline: A carload of friends and relations drive up to his premises , sign a visitors ' book and ring for service .

source_bert_toks: a carlo ##ad of friends and relations drive up to his premises , sign a visitors ' book and ring for service .

reference_raw: A truckload of friends and relatives goes to his premises, signs a guest book, and rings for service.

reference_spacy_tokens: A truckload of friends and relatives goes to his premises , signs a guest book , and rings for service .


fn_spacy_tokens_for_baseline: She roasted a chicken and made a fresh fruit trifle for supper as it was my last night .

source_bert_toks: she roasted a chicken and made a fresh fruit tri ##fle for supper as it was my last night .

reference_raw: She baked the chicken and made some fresh fruit for dinner, just like last night.

reference_spacy_tokens: She baked the chicken and made some fresh fruit for dinner , just like last night .


fn_spacy_tokens_for_baseline: They eventually reached the islands , and founded colonies on the islands in the northernmost part of the Aegean Sea .

source_bert_toks: they eventually reached the islands , and founded colonies on the islands in the northernmost part of the aegean sea .

reference_raw: Eventually, they reached the islands and colonized the islands in the northmost part of the Aegean Sea.

reference_spacy_tokens: Eventually , they reached the islands and colonized the islands in the northmost part of the Aegean Sea .


fn_spacy_tokens_for_baseline: One might have expected the intense difficulties confronting British film producers to stimulate discussion ; instead it seems to have narrowed their perspective .

source_bert_toks: one might have expected the intense difficulties confronting british film producers to stimulate discussion ; instead it seems to have narrowed their perspective .

reference_raw: One could expect the intense difficulties faced by British film manufacturers to stimulate debate; instead, they seem to have narrowed their perspectives.

reference_spacy_tokens: One could expect the intense difficulties faced by British film manufacturers to stimulate debate ; instead , they seem to have narrowed their perspectives .


fn_spacy_tokens_for_baseline: But when you see older people who are addicted , I think it looks double sad '

source_bert_toks: but when you see older people who are addicted , i think it looks double sad '

reference_raw: But when you see older people who are dependent, I think it's twice as sad.'

reference_spacy_tokens: But when you see older people who are dependent , I think it 's twice as sad . '


fn_spacy_tokens_for_baseline: For example , you could make batches of meals from fresh food , then freeze them .

source_bert_toks: for example , you could make batch ##es of meals from fresh food , then freeze them .

reference_raw: For example, you can cook a lot of food out of fresh food and then freeze it.

reference_spacy_tokens: For example , you can cook a lot of food out of fresh food and then freeze it .


fn_spacy_tokens_for_baseline: At their best they combine funky chugs of hyperactive bass with agonised guitar and belt - across - the - chops vocals which verge on the schizophrenic .

source_bert_toks: at their best they combine funky chu ##gs of hyper ##active bass with ago ##nis ##ed guitar and belt - across - the - chop ##s vocals which verge on the sc ##hi ##zo ##ph ##ren ##ic .

reference_raw: The best they can do is mix the funky chugs of hyperactive bass with agonized guitar and a belt-cross-the-chops vocals that border on schizophrenia.

reference_spacy_tokens: The best they can do is mix the funky chugs of hyperactive bass with agonized guitar and a belt - cross - the - chops vocals that border on schizophrenia .


fn_spacy_tokens_for_baseline: Though it has been altered in later periods , it retains some Gothic features .

source_bert_toks: though it has been altered in later periods , it retains some gothic features .

reference_raw: Although it was changed at a later stage, it retains some Gothic features.

reference_spacy_tokens: Although it was changed at a later stage , it retains some Gothic features .


fn_spacy_tokens_for_baseline: She had asked to borrow his pyjama bottoms but he drew the line at that .

source_bert_toks: she had asked to borrow his p ##y ##ja ##ma bottoms but he drew the line at that .

reference_raw: She asked him to borrow the bottoms of his pajamas, but he drew a line.

reference_spacy_tokens: She asked him to borrow the bottoms of his pajamas , but he drew a line .


fn_spacy_tokens_for_baseline: Security reasons , ' he gasped .

source_bert_toks: security reasons , ' he gasped .

reference_raw: "Security reasons," he said.

reference_spacy_tokens: " Security reasons , " he said .


fn_spacy_tokens_for_baseline: The engineers involved in this final part of the supply chain handling process have had their work cut out .

source_bert_toks: the engineers involved in this final part of the supply chain handling process have had their work cut out .

reference_raw: Engineers involved in this last part of the supply chain process have been cut off.

reference_spacy_tokens: Engineers involved in this last part of the supply chain process have been cut off .


fn_spacy_tokens_for_baseline: She still had on the revealing silk blouse she had worn in the show , with stage jewellery sparkling at her throat and breast .

source_bert_toks: she still had on the revealing silk blouse she had worn in the show , with stage jewellery sparkling at her throat and breast .

reference_raw: She was still wearing the revealing silk blouse she'd worn in the show, and the stage jewelry glittered on her neck and chest.

reference_spacy_tokens: She was still wearing the revealing silk blouse she 'd worn in the show , and the stage jewelry glittered on her neck and chest .


fn_spacy_tokens_for_baseline: The angry look on the judge 's sallow face showed that either his attendance in court that morning or Cranston 's arrival had put him in an ill humour .

source_bert_toks: the angry look on the judge ' s sal ##low face showed that either his attendance in court that morning or cr ##ans ##ton ' s arrival had put him in an ill humour .

reference_raw: The angry expression on the judge's sallow face showed that either his presence in court that morning or Cranston's arrival had put him in a bad mood.

reference_spacy_tokens: The angry expression on the judge 's sallow face showed that either his presence in court that morning or Cranston 's arrival had put him in a bad mood .


fn_spacy_tokens_for_baseline: Having reluctantly cleared me of the charge of indulging in orgies with my entire sales force , you seem to have got it into your head that Lexy and I are carrying on some kind of affair .

source_bert_toks: having reluctantly cleared me of the charge of ind ##ul ##ging in org ##ies with my entire sales force , you seem to have got it into your head that lex ##y and i are carrying on some kind of affair .

reference_raw: After hesitantly exonerating me for having an orgy with my entire sales force, it seems you've come to the conclusion that Lexy and I are having an affair.

reference_spacy_tokens: After hesitantly exonerating me for having an orgy with my entire sales force , it seems you 've come to the conclusion that Lexy and I are having an affair .


fn_spacy_tokens_for_baseline: He left immediately for the airport , and chartered a jet .

source_bert_toks: he left immediately for the airport , and chartered a jet .

reference_raw: He went straight to the airport and rented a plane.

reference_spacy_tokens: He went straight to the airport and rented a plane .


fn_spacy_tokens_for_baseline: The PKO bill originated from a bill introduced in 1990 which was designed to allow Japanese forces to participate as non - combatants in support of the UN - authorized multinational force assembled to expel Iraqi forces from Kuwait .

source_bert_toks: the p ##ko bill originated from a bill introduced in 1990 which was designed to allow japanese forces to participate as non - combatants in support of the un - authorized multinational force assembled to ex ##pel iraqi forces from kuwait .

reference_raw: The PKO bill came from a law introduced in 1990, which was designed to enable the Japanese forces to participate as non-combatants in support of the UN-authorized multinational forces assembled to expel Iraqi troops from Kuwait.

reference_spacy_tokens: The PKO bill came from a law introduced in 1990 , which was designed to enable the Japanese forces to participate as non - combatants in support of the UN - authorized multinational forces assembled to expel Iraqi troops from Kuwait .


fn_spacy_tokens_for_baseline: Somehow he had traversed the latest scorching zone , feeling that he was being utterly consumed .

source_bert_toks: somehow he had traversed the latest sc ##or ##ching zone , feeling that he was being utterly consumed .

reference_raw: He had somehow crossed the last burn zone and felt as if he had been completely consumed.

reference_spacy_tokens: He had somehow crossed the last burn zone and felt as if he had been completely consumed .


fn_spacy_tokens_for_baseline: She surveyed his long - limbed body with an attempt at cool detachment , her gaze flickering over the dark denims that moulded his strong thighs , and the jade sweater that clung to his hard male chest .

source_bert_toks: she surveyed his long - limb ##ed body with an attempt at cool detachment , her gaze flickering over the dark denim ##s that mo ##uld ##ed his strong thighs , and the jade sweater that clung to his hard male chest .

reference_raw: She studied his long-limbed body in a cold effort, her eyes darting over the dark jeans that shaped his strong thighs and the jade sweater that clung to his hard man's chest.

reference_spacy_tokens: She studied his long - limbed body in a cold effort , her eyes darting over the dark jeans that shaped his strong thighs and the jade sweater that clung to his hard man 's chest .


fn_spacy_tokens_for_baseline: In only one presidential election year prior to 1948 did more than 20 % of the nation 's congressional districts choose a different party 's candidate for the White House than for the House of Representatives .

source_bert_toks: in only one presidential election year prior to 1948 did more than 20 % of the nation ' s congressional districts choose a different party ' s candidate for the white house than for the house of representatives .

reference_raw: In just one presidential election year before 1948, more than 20% of the national congressional precincts chose another party candidate for the White House than for the House of Representatives.

reference_spacy_tokens: In just one presidential election year before 1948 , more than 20 % of the national congressional precincts chose another party candidate for the White House than for the House of Representatives .


fn_spacy_tokens_for_baseline: We arrive to witness a near riot -- the dull hungry eyes of the children having been lit up by fear that the food is about to run out .

source_bert_toks: we arrive to witness a near riot - - the dull hungry eyes of the children having been lit up by fear that the food is about to run out .

reference_raw: We come here to witness an almost unrest - the starved eyes of the children, who are illuminated by the fear that the food will soon run out.

reference_spacy_tokens: We come here to witness an almost unrest - the starved eyes of the children , who are illuminated by the fear that the food will soon run out .


fn_spacy_tokens_for_baseline: Every year , a staggering £ 80 m is wagered on this spectacular racing phenomenon .

source_bert_toks: every year , a staggering £ ##80 ##m is wage ##red on this spectacular racing phenomenon .

reference_raw: Each year, we bet a staggering 80 million pounds on this spectacular race phenomenon.

reference_spacy_tokens: Each year , we bet a staggering 80 million pounds on this spectacular race phenomenon .


fn_spacy_tokens_for_baseline: The former deals largely with the ideology or taken - for - granted assumptions behind action , the latter the unforeseen outcomes of it , which may of course challenge the nature of recurrent practices and modify them .

source_bert_toks: the former deals largely with the ideology or taken - for - granted assumptions behind action , the latter the un ##for ##ese ##en outcomes of it , which may of course challenge the nature of rec ##urrent practices and modify them .

reference_raw: The first deals to a large extent with ideological or accepted assumptions behind action, the second with unforeseen outcomes, which, of course, may call into question the nature of repeated practices and change them.

reference_spacy_tokens: The first deals to a large extent with ideological or accepted assumptions behind action , the second with unforeseen outcomes , which , of course , may call into question the nature of repeated practices and change them .


fn_spacy_tokens_for_baseline: GARY McALLISTER last night laughed off Wimbledon manager Joe Kinnear 's stinging attack on champions Leeds .

source_bert_toks: gary mca ##llis ##ter last night laughed off wimbledon manager joe kin ##nea ##r ' s stinging attack on champions leeds .

reference_raw: Gary McAllister laughed last night at Wimbledon Manager Joe Kinnear's stabbing attack on Champion Leeds.

reference_spacy_tokens: Gary McAllister laughed last night at Wimbledon Manager Joe Kinnear 's stabbing attack on Champion Leeds .


fn_spacy_tokens_for_baseline: The whole board , apart from libel lawyer Jonathan Crystal , is against Venables and wants him to go , if only to end the disastrous deadlock which is keeping the club in a state of commercial limbo .

source_bert_toks: the whole board , apart from libel lawyer jonathan crystal , is against ve ##nable ##s and wants him to go , if only to end the disastrous dead ##lock which is keeping the club in a state of commercial limb ##o .

reference_raw: The entire board of directors, with the exception of libel attorney Jonathan Crystal, is against Venables and wants him to leave, if only to put an end to the disastrous deadlock that keeps the club in business limbo.

reference_spacy_tokens: The entire board of directors , with the exception of libel attorney Jonathan Crystal , is against Venables and wants him to leave , if only to put an end to the disastrous deadlock that keeps the club in business limbo .


fn_spacy_tokens_for_baseline: What they saw , as one put it , were two people who were n't up to boating in the bath , never mind on the Thames in spate .

source_bert_toks: what they saw , as one put it , were two people who weren ' t up to boating in the bath , never mind on the thames in spat ##e .

reference_raw: What they saw, as one might say, was two people who didn't want to swim in the bathroom, and they didn't care about the Thames in spate.

reference_spacy_tokens: What they saw , as one might say , was two people who did n't want to swim in the bathroom , and they did n't care about the Thames in spate .


fn_spacy_tokens_for_baseline: We agreed on two voyages from the Thames to Nantes and then we would review the situation .

source_bert_toks: we agreed on two voyages from the thames to nantes and then we would review the situation .

reference_raw: We agreed on two trips from the Thames to Nantes, and then we're going to go over the situation.

reference_spacy_tokens: We agreed on two trips from the Thames to Nantes , and then we 're going to go over the situation .


fn_spacy_tokens_for_baseline: In addition to securing Commonwealth support for their position , the British sought to consolidate their own aviation policy into some definable form , something which had eluded them for several years .

source_bert_toks: in addition to securing commonwealth support for their position , the british sought to consolidate their own aviation policy into some def ##ina ##ble form , something which had el ##uded them for several years .

reference_raw: In addition to providing Commonwealth support for their position, the British tried to consolidate their own aviation policy into a defined form, something they had missed for several years.

reference_spacy_tokens: In addition to providing Commonwealth support for their position , the British tried to consolidate their own aviation policy into a defined form , something they had missed for several years .


fn_spacy_tokens_for_baseline: ' They were hooded , capped and masked , though they had crude Templar crosses painted on their cloaks .

source_bert_toks: ' they were hooded , capped and masked , though they had crude templar crosses painted on their cloak ##s .

reference_raw: They were cloaked, capped, and masked, though their cloaks were painted with crude Templar crosses.

reference_spacy_tokens: They were cloaked , capped , and masked , though their cloaks were painted with crude Templar crosses .


fn_spacy_tokens_for_baseline: The vote has disappointed the anti - hunting lobby which was hoping the groundswell of public opinion would sway MPs .

source_bert_toks: the vote has disappointed the anti - hunting lobby which was hoping the grounds ##well of public opinion would sway mps .

reference_raw: The vote failed the anti-hunting lobby, hoping that public opinion would sway the MPs.

reference_spacy_tokens: The vote failed the anti - hunting lobby , hoping that public opinion would sway the MPs .


fn_spacy_tokens_for_baseline: Blanche winked at Dexter and nodded for him to follow her outside with his coat .

source_bert_toks: blanche winked at dexter and nodded for him to follow her outside with his coat .

reference_raw: Blanche glanced at Dexter and motioned for him to follow her out with his coat.

reference_spacy_tokens: Blanche glanced at Dexter and motioned for him to follow her out with his coat .


fn_spacy_tokens_for_baseline: Athens became the most powerful , heralding the start of the classical Greek period .

source_bert_toks: athens became the most powerful , herald ##ing the start of the classical greek period .

reference_raw: Athens became the strongest and heralded the beginning of the classic Greek era.

reference_spacy_tokens: Athens became the strongest and heralded the beginning of the classic Greek era .


fn_spacy_tokens_for_baseline: He is sitting behind his large desk and does not gesture you to sit .

source_bert_toks: he is sitting behind his large desk and does not gesture you to sit .

reference_raw: She sits behind her big desk and doesn't motion to you to sit down.

reference_spacy_tokens: She sits behind her big desk and does n't motion to you to sit down .


fn_spacy_tokens_for_baseline: It seemed there was nothing he could do to persuade the child to cease her disobedience , nothing he could say which would frighten her sufficiently for her to come to her senses .

source_bert_toks: it seemed there was nothing he could do to persuade the child to cease her di ##so ##bed ##ience , nothing he could say which would fright ##en her sufficiently for her to come to her senses .

reference_raw: There seemed to be nothing he could do to convince the child to stop her disobedience, nothing he could say that would scare her enough to come to her senses.

reference_spacy_tokens: There seemed to be nothing he could do to convince the child to stop her disobedience , nothing he could say that would scare her enough to come to her senses .


fn_spacy_tokens_for_baseline: Susan 's head lay where she had rested it , one arm curled round , the other hanging so that her fingertips brushed the floorboards .

source_bert_toks: susan ' s head lay where she had rested it , one arm curled round , the other hanging so that her fingertips brushed the floor ##boards .

reference_raw: Susan's head was where she had rested it, one arm curled around, the other hanging so that her fingers brushed the floorboards.

reference_spacy_tokens: Susan 's head was where she had rested it , one arm curled around , the other hanging so that her fingers brushed the floorboards .


fn_spacy_tokens_for_baseline: The scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeways is rampant .

source_bert_toks: the scary traffic is a real experience - vehicles of all kinds jockey for position on crowded streets , missing each other by inches , and speeding on the freeway ##s is rampant .

reference_raw: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets, lost by inches, and speeding on highways is rampant.

reference_spacy_tokens: Scary traffic is a real experience - cars of all sorts of jockeys for positioning on crowded streets , lost by inches , and speeding on highways is rampant .


fn_spacy_tokens_for_baseline: The demonstration in Hillah , capital of Babil province , underscored deep rivalries that threaten stability in the overwhelmingly Shiite south , generally one of the calmer parts of Iraq since the 2003 U. S. -led invasion .

source_bert_toks: the demonstration in hill ##ah , capital of ba ##bil province , under ##sco ##red deep rival ##ries that threaten stability in the overwhelmingly shi ##ite south , generally one of the calm ##er parts of iraq since the 2003 u . s . - led invasion .

reference_raw: The illustration in Hillah, the capital of Babil Province, underscored deep rivalries that threaten stability in the overwhelming Shiite South, usually one of the more peaceful parts of Iraq since the US-led invasion of 2003.

reference_spacy_tokens: The illustration in Hillah , the capital of Babil Province , underscored deep rivalries that threaten stability in the overwhelming Shiite South , usually one of the more peaceful parts of Iraq since the US - led invasion of 2003 .


fn_spacy_tokens_for_baseline: Across the water , the loud hailers were blaring and squealing as they had in the winter , when Tzani - bey had caught and herded the Order .

source_bert_toks: across the water , the loud hail ##ers were b ##lar ##ing and sq ##ue ##aling as they had in the winter , when t ##zan ##i - bey had caught and herd ##ed the order .

reference_raw: On the other side of the water, the noisy hailers screamed and screamed as they had in the winter when Tzani-bey caught and herded the Order.

reference_spacy_tokens: On the other side of the water , the noisy hailers screamed and screamed as they had in the winter when Tzani - bey caught and herded the Order .


fn_spacy_tokens_for_baseline: However , Lawclub is not the panacea for all the legal bills of the affluent Premier Visa cardholders .

source_bert_toks: however , law ##cl ##ub is not the pan ##ace ##a for all the legal bills of the affluent premier visa card ##holders .

reference_raw: However, Lawclub is not a panacea for all the legal bills of wealthy Premier Visa cardholders.

reference_spacy_tokens: However , Lawclub is not a panacea for all the legal bills of wealthy Premier Visa cardholders .


fn_spacy_tokens_for_baseline: All guests staying at the Hotel Maas are entitled to make use of their special hotel limousine service .

source_bert_toks: all guests staying at the hotel ma ##as are entitled to make use of their special hotel limousine service .

reference_raw: All guests living in the Maas Hotel have the right to use their special hotel limousine service.

reference_spacy_tokens: All guests living in the Maas Hotel have the right to use their special hotel limousine service .


fn_spacy_tokens_for_baseline: Think of ' 70s soul and the entreaties of Candi Staton , the exaggerated seductions of Barry White , and the smoothness of Teddy Pendergrass .

source_bert_toks: think of ' 70s soul and the en ##tre ##ati ##es of candi stat ##on , the exaggerated seduction ##s of barry white , and the smooth ##ness of teddy pen ##der ##grass .

reference_raw: Think of the soul of the '70s and the affairs of Candi Staton, Barry White's excessive seduction, and Teddy Pendergrass's smoothness.

reference_spacy_tokens: Think of the soul of the ' 70s and the affairs of Candi Staton , Barry White 's excessive seduction , and Teddy Pendergrass 's smoothness .


fn_spacy_tokens_for_baseline: ' It is the misfortune of war , Madame , that places us in this position .

source_bert_toks: ' it is the mis ##fort ##une of war , madame , that places us in this position .

reference_raw: 'It is the unhappiness of war, madam, that puts us in this position.

reference_spacy_tokens: ' It is the unhappiness of war , madam , that puts us in this position .


fn_spacy_tokens_for_baseline: Jess was riveted , the last of her fatigue fled .

source_bert_toks: jess was ri ##vet ##ed , the last of her fatigue fled .

reference_raw: Jess was riveted, and the last of her tiredness was gone.

reference_spacy_tokens: Jess was riveted , and the last of her tiredness was gone .


fn_spacy_tokens_for_baseline: Corman , who was both producer and director of The Trip , was unsure about Nicholson 's script .

source_bert_toks: co ##rman , who was both producer and director of the trip , was unsure about nicholson ' s script .

reference_raw: Corman, who was both a producer and a director of the Trip, wasn't sure about Nicholson's script.

reference_spacy_tokens: Corman , who was both a producer and a director of the Trip , was n't sure about Nicholson 's script .


fn_spacy_tokens_for_baseline: As a result , one of his sacred titles was ' He who causes the springs to flow ' .

source_bert_toks: as a result , one of his sacred titles was ' he who causes the springs to flow ' .

reference_raw: As a result, one of his sacred titles was "the one who caused the streams to flow."

reference_spacy_tokens: As a result , one of his sacred titles was " the one who caused the streams to flow . "


fn_spacy_tokens_for_baseline: But in fact , once news of the handover vanished from the front pages , the people of Hong Kong returned to their usual topics of conversation : the economy and the price of housing .

source_bert_toks: but in fact , once news of the hand ##over vanished from the front pages , the people of hong kong returned to their usual topics of conversation : the economy and the price of housing .

reference_raw: But in fact, when the news of the transfer disappeared on the front page, the people of Hong Kong returned to their usual topics of conversation: the economy and the cost of living.

reference_spacy_tokens: But in fact , when the news of the transfer disappeared on the front page , the people of Hong Kong returned to their usual topics of conversation : the economy and the cost of living .


fn_spacy_tokens_for_baseline: Recent estimates of North Korean chemical ordnance by the South Korean Ministry of National Defense ( MND ) have since been raised to the thousands of tons , probably based on recent information provided by North Korean defectors , including former members of DPRK military and NBC defence organizations .

source_bert_toks: recent estimates of north korean chemical ordnance by the south korean ministry of national defense ( mn ##d ) have since been raised to the thousands of tons , probably based on recent information provided by north korean defect ##ors , including former members of d ##pr ##k military and nbc defence organizations .

reference_raw: Since then, recent estimates of North Korea's chemical order by the South Korean Ministry of National Defence (MND) have been increased to thousands of tonnes, possibly based on recent information provided by North Korean defectors, including former members of the DPRK military and NBC defence organizations.

reference_spacy_tokens: Since then , recent estimates of North Korea 's chemical order by the South Korean Ministry of National Defence ( MND ) have been increased to thousands of tonnes , possibly based on recent information provided by North Korean defectors , including former members of the DPRK military and NBC defence organizations .


fn_spacy_tokens_for_baseline: He was followed shortly afterwards by the sound of wooden clogs on cobble stones as people hurried to the mill before the hooter started .

source_bert_toks: he was followed shortly afterwards by the sound of wooden cl ##og ##s on cobb ##le stones as people hurried to the mill before the ho ##ote ##r started .

reference_raw: Shortly afterward, the sound of wooden blocks on cobblestones followed him as people hurried to the mill before the hooter began.

reference_spacy_tokens: Shortly afterward , the sound of wooden blocks on cobblestones followed him as people hurried to the mill before the hooter began .


fn_spacy_tokens_for_baseline: The subject matter itself , a view of the native bush for example , with its vast array of plant forms , demands the applications of thick layers of paint , often with a palette knife .

source_bert_toks: the subject matter itself , a view of the native bush for example , with its vast array of plant forms , demands the applications of thick layers of paint , often with a palette knife .

reference_raw: The object itself, a view of the native bush, for example, with its vast variety of plant shapes, requires the use of thick layers of paint, often with a palette knife.

reference_spacy_tokens: The object itself , a view of the native bush , for example , with its vast variety of plant shapes , requires the use of thick layers of paint , often with a palette knife .


fn_spacy_tokens_for_baseline: My waist size had suddenly increased and I could not get into my trousers any more .

source_bert_toks: my waist size had suddenly increased and i could not get into my trousers any more .

reference_raw: My waist suddenly got bigger, and I couldn't get into my pants anymore.

reference_spacy_tokens: My waist suddenly got bigger , and I could n't get into my pants anymore .


fn_spacy_tokens_for_baseline: This motion calls for safety reps to be given the right to be involved in all workplace environmental issues , including inspections of all plant and equipment , assessing the compliance with company policies and the regulatory requirements .

source_bert_toks: this motion calls for safety rep ##s to be given the right to be involved in all workplace environmental issues , including inspections of all plant and equipment , assessing the compliance with company policies and the regulatory requirements .

reference_raw: This proposal calls for safety authorities to be given the right to participate in all environmental aspects of the workplace, including inspections of all plants and equipment, assessment of the respect of company policies and regulatory requirements.

reference_spacy_tokens: This proposal calls for safety authorities to be given the right to participate in all environmental aspects of the workplace , including inspections of all plants and equipment , assessment of the respect of company policies and regulatory requirements .


fn_spacy_tokens_for_baseline: Glen Affric is considered to be one of the most beautiful glens in Scotland and there are plenty of excellent walks in the area .

source_bert_toks: glen af ##fr ##ic is considered to be one of the most beautiful glen ##s in scotland and there are plenty of excellent walks in the area .

reference_raw: 'Glen Affric is considered one of the most beautiful ravines in Scotland, 'and there are many excellent walks in the region.

reference_spacy_tokens: ' Glen Affric is considered one of the most beautiful ravines in Scotland , ' and there are many excellent walks in the region .


fn_spacy_tokens_for_baseline: The theme running through all these myths about behaviour is ' Do n't blame me , it 's not my fault . '

source_bert_toks: the theme running through all these myths about behaviour is ' don ' t blame me , it ' s not my fault . '

reference_raw: The theme that goes through all these behavioral myths is, "Don't blame me, I'm not to blame."

reference_spacy_tokens: The theme that goes through all these behavioral myths is , " Do n't blame me , I 'm not to blame . "


fn_spacy_tokens_for_baseline: And got heavier as they left the small station and straggled down a steep , cinder path .

source_bert_toks: and got heavier as they left the small station and st ##rag ##gled down a steep , cinder path .

reference_raw: And it got heavier as they left the small station and walked down the steep, cindery road.

reference_spacy_tokens: And it got heavier as they left the small station and walked down the steep , cindery road .


fn_spacy_tokens_for_baseline: Children are more prone to disease .

source_bert_toks: children are more prone to disease .

reference_raw: Kids are more susceptible to disease.

reference_spacy_tokens: Kids are more susceptible to disease .


fn_spacy_tokens_for_baseline: Karamanlis said , " This is a day of national mourning ... I wish to express my deep grief over the lost lives ... We are fighting against heavy odds , on many fronts and under particularly tough conditions . "

source_bert_toks: kara ##man ##lis said , " this is a day of national mourning . . . i wish to express my deep grief over the lost lives . . . we are fighting against heavy odds , on many fronts and under particularly tough conditions . "

reference_raw: Karamanlis said, "This is a nation's day of mourning... and I would like to express my deep sorrow for the loss of our lives... we fight against the great odds, on many fronts and in particularly difficult conditions."

reference_spacy_tokens: Karamanlis said , " This is a nation 's day of mourning ... and I would like to express my deep sorrow for the loss of our lives ... we fight against the great odds , on many fronts and in particularly difficult conditions . "


fn_spacy_tokens_for_baseline: In recent days , Kadyrov stirred outrage in Russia 's rights community by insulting Estemirova .

source_bert_toks: in recent days , ka ##dy ##rov stirred outrage in russia ' s rights community by insulting este ##mir ##ova .

reference_raw: In the last few days, Kadyrov has provoked indignation in the Russian rights community by insulting Estemirova.

reference_spacy_tokens: In the last few days , Kadyrov has provoked indignation in the Russian rights community by insulting Estemirova .


fn_spacy_tokens_for_baseline: The kind of tasks carried out for them by the support workers is similarly hard to classify .

source_bert_toks: the kind of tasks carried out for them by the support workers is similarly hard to classify .

reference_raw: Similarly, it is difficult to classify the type of tasks performed by the support staff for them.

reference_spacy_tokens: Similarly , it is difficult to classify the type of tasks performed by the support staff for them .


fn_spacy_tokens_for_baseline: Julie 's devastated husband Tim , 32 , was last night preparing to fly from their home in Northampton to identify his wife 's body .

source_bert_toks: julie ' s devastated husband tim , 32 , was last night preparing to fly from their home in northampton to identify his wife ' s body .

reference_raw: Julie's ruined husband, Tim, 32, was preparing to leave his home in Northampton yesterday to identify his wife's body.

reference_spacy_tokens: Julie 's ruined husband , Tim , 32 , was preparing to leave his home in Northampton yesterday to identify his wife 's body .


fn_spacy_tokens_for_baseline: In one , experimental therapy with interleukin II was attempted without success .

source_bert_toks: in one , experimental therapy with inter ##le ##uki ##n ii was attempted without success .

reference_raw: In one case, experimental treatment with interleukin II was tried unsuccessfully.

reference_spacy_tokens: In one case , experimental treatment with interleukin II was tried unsuccessfully .


fn_spacy_tokens_for_baseline: Lady Weighall was also responsible for laying out Jubilee Park , opposite Petwood , and later gifting it to the authorities .

source_bert_toks: lady weigh ##all was also responsible for laying out jubilee park , opposite pet ##wood , and later gift ##ing it to the authorities .

reference_raw: Lady Weighall was also responsible for setting up Jubilee Park across from Petwood, and then handing it over to the authorities.

reference_spacy_tokens: Lady Weighall was also responsible for setting up Jubilee Park across from Petwood , and then handing it over to the authorities .


fn_spacy_tokens_for_baseline: On Nov. 23 the party announced that 12,500 of its 48,000,000 members had been expelled in 1989 , largely for corruption .

source_bert_toks: on nov . 23 the party announced that 12 , 500 of its 48 , 000 , 000 members had been expelled in 1989 , largely for corruption .

reference_raw: On November 23, the party announced that 12,500 of its 48,000,000 members were voted out in 1989, mainly for corruption.

reference_spacy_tokens: On November 23 , the party announced that 12,500 of its 48,000,000 members were voted out in 1989 , mainly for corruption .


fn_spacy_tokens_for_baseline: Fulham were ordered to pay the overdue sum , amounting to £ 20 4s 5d , plus three guineas expenses , and Leeds were reprimanded for not taking money at the gates .

source_bert_toks: fulham were ordered to pay the over ##due sum , amount ##ing to £2 ##0 4 ##s 5 ##d , plus three guineas expenses , and leeds were rep ##rim ##and ##ed for not taking money at the gates .

reference_raw: Fulham was ordered to pay a late sum of £20 4s 5d, plus three guinea expenses, and Leeds was accused of not taking money at the gate.

reference_spacy_tokens: Fulham was ordered to pay a late sum of £ 20 4s 5d , plus three guinea expenses , and Leeds was accused of not taking money at the gate .


fn_spacy_tokens_for_baseline: As Kelly recuperated she was able to do more and more things .

source_bert_toks: as kelly rec ##up ##erated she was able to do more and more things .

reference_raw: As Kelly recovered, she could do more and more.

reference_spacy_tokens: As Kelly recovered , she could do more and more .


fn_spacy_tokens_for_baseline: The officers had examined the window in Zambia 's showercub but had considered it too small for hir to escape through , the wall outside too sheer .

source_bert_toks: the officers had examined the window in zambia ' s shower ##cu ##b but had considered it too small for hi ##r to escape through , the wall outside too sheer .

reference_raw: The officers scrutinized the window in Zambia's shower cub, but they thought it was too small for him to escape, and the wall outside was too sheer.

reference_spacy_tokens: The officers scrutinized the window in Zambia 's shower cub , but they thought it was too small for him to escape , and the wall outside was too sheer .


fn_spacy_tokens_for_baseline: These odd experiences , typical of getting to sleep , or periods of drowsiness during the day , are not uncommon .

source_bert_toks: these odd experiences , typical of getting to sleep , or periods of dr ##ows ##iness during the day , are not uncommon .

reference_raw: These strange experiences, typical of sleeping or sleepy periods during the day, are not uncommon.

reference_spacy_tokens: These strange experiences , typical of sleeping or sleepy periods during the day , are not uncommon .


fn_spacy_tokens_for_baseline: Should the parties be allowed to examine and cross - examine witnesses ?

source_bert_toks: should the parties be allowed to examine and cross - examine witnesses ?

reference_raw: Should the parties be allowed to investigate and cross-examine witnesses?

reference_spacy_tokens: Should the parties be allowed to investigate and cross - examine witnesses ?


fn_spacy_tokens_for_baseline: It was nicknamed the ' People 's Avenger ' , the ' Patriotic Shortener ' , the ' National Razor ' and the ' Red Theatre ' .

source_bert_toks: it was nicknamed the ' people ' s avenge ##r ' , the ' patriotic short ##ener ' , the ' national razor ' and the ' red theatre ' .

reference_raw: It was called "People's Revenge", "Patriotic Shortener", "National Razor" and "Red Theatre".

reference_spacy_tokens: It was called " People 's Revenge " , " Patriotic Shortener " , " National Razor " and " Red Theatre " .


fn_spacy_tokens_for_baseline: There was a darker side to the growth of Arab - American consciousness .

source_bert_toks: there was a darker side to the growth of arab - american consciousness .

reference_raw: The rise of Arab-American consciousness had a darker side.

reference_spacy_tokens: The rise of Arab - American consciousness had a darker side .


fn_spacy_tokens_for_baseline: Despite my anger and despair at what had happened to Brian , killing myself now would n't make amends for not helping him .

source_bert_toks: despite my anger and despair at what had happened to brian , killing myself now wouldn ' t make amend ##s for not helping him .

reference_raw: In spite of my anger and desperation at what happened to Brian, killing myself now would not make up for the fact that I didn't help him.

reference_spacy_tokens: In spite of my anger and desperation at what happened to Brian , killing myself now would not make up for the fact that I did n't help him .


fn_spacy_tokens_for_baseline: What was once a sure thing became much more competitive .

source_bert_toks: what was once a sure thing became much more competitive .

reference_raw: What had once been a certain thing had become more competitive.

reference_spacy_tokens: What had once been a certain thing had become more competitive .


fn_spacy_tokens_for_baseline: The preceding discussion applies not only to jurisdictional errors of law but to all heads of illegality which render a decision ultra vires , including breach of natural justice .

source_bert_toks: the preceding discussion applies not only to jurisdiction ##al errors of law but to all heads of illegal ##ity which render a decision ultra vi ##res , including breach of natural justice .

reference_raw: The previous discussion applies not only to errors of law in jurisdiction, but also to all pleas of illegality which make the decision ultra vires, including violations of natural justice.

reference_spacy_tokens: The previous discussion applies not only to errors of law in jurisdiction , but also to all pleas of illegality which make the decision ultra vires , including violations of natural justice .


fn_spacy_tokens_for_baseline: Have you got Tracey 's middle name on there ?

source_bert_toks: have you got tracey ' s middle name on there ?

reference_raw: Do you have Tracey's second name?

reference_spacy_tokens: Do you have Tracey 's second name ?


fn_spacy_tokens_for_baseline: Seventy - two years ago , the Germans shipped Lenin in a sealed train , like a dangerous bacillus , from Switzerland to Petrograd to make a revolution .

source_bert_toks: seventy - two years ago , the germans shipped lenin in a sealed train , like a dangerous ba ##ci ##llus , from switzerland to pet ##ro ##grad to make a revolution .

reference_raw: Seventy-two years ago, the Germans sent Lenin on a sealed train, like a dangerous bacillus, from Switzerland to Petrograd for revolution.

reference_spacy_tokens: Seventy - two years ago , the Germans sent Lenin on a sealed train , like a dangerous bacillus , from Switzerland to Petrograd for revolution .


fn_spacy_tokens_for_baseline: But he was dismayed , in the circumstances , to see Gabriel ride off the moor and up the street in the company of a young monk .

source_bert_toks: but he was dismay ##ed , in the circumstances , to see gabriel ride off the moor and up the street in the company of a young monk .

reference_raw: But under the circumstances, he was horrified to see Gabriel riding off the moor and down the street in the company of a young monk.

reference_spacy_tokens: But under the circumstances , he was horrified to see Gabriel riding off the moor and down the street in the company of a young monk .


fn_spacy_tokens_for_baseline: Whereas it is simple to make a robust chair , combining these three characteristics and yet producing a chair which has individual character can be a real challenge .

source_bert_toks: whereas it is simple to make a robust chair , combining these three characteristics and yet producing a chair which has individual character can be a real challenge .

reference_raw: While it is easy to create a strong chair that combines these three features and yet creates an individual chair can be a real challenge.

reference_spacy_tokens: While it is easy to create a strong chair that combines these three features and yet creates an individual chair can be a real challenge .


fn_spacy_tokens_for_baseline: However , reports of transactions of various dual - use material is publicly known .

source_bert_toks: however , reports of transactions of various dual - use material is publicly known .

reference_raw: However, reports of transactions of different dual-use items are known to the public.

reference_spacy_tokens: However , reports of transactions of different dual - use items are known to the public .


fn_spacy_tokens_for_baseline: A former CIA officer says he made repeated efforts to alert top agency officials to problems with an Iraqi defector 's claims about the country 's mobile biological weapons labs but he was ignored , the Washington Post reported Sunday .

source_bert_toks: a former cia officer says he made repeated efforts to alert top agency officials to problems with an iraqi defect ##or ' s claims about the country ' s mobile biological weapons labs but he was ignored , the washington post reported sunday .

reference_raw: An ex-C.I.A. officer said he repeatedly tried to alert top agency officials to problems with the Iraqi defector's claims about the country's mobile bio-weapons labs, but he was ignored, and the Washington Post reported it on Sunday.

reference_spacy_tokens: An ex - C.I.A. officer said he repeatedly tried to alert top agency officials to problems with the Iraqi defector 's claims about the country 's mobile bio - weapons labs , but he was ignored , and the Washington Post reported it on Sunday .


fn_spacy_tokens_for_baseline: You stand the best chance of finding a patch of sand to yourself to the east of Nerja and west of Estepona .

source_bert_toks: you stand the best chance of finding a patch of sand to yourself to the east of ne ##r ##ja and west of este ##pon ##a .

reference_raw: Your best shot is to find a patch of sand for yourself east of Nerja and west of Estepona.

reference_spacy_tokens: Your best shot is to find a patch of sand for yourself east of Nerja and west of Estepona .


fn_spacy_tokens_for_baseline: They tied him into the car and set it alight .

source_bert_toks: they tied him into the car and set it ali ##ght .

reference_raw: They put him in the car and set him on fire.

reference_spacy_tokens: They put him in the car and set him on fire .


fn_spacy_tokens_for_baseline: A NEW health card is to be launched in Cheshire with the aim of helping doctors and paramedics to treat a patient more quickly in an emergency .

source_bert_toks: a new health card is to be launched in cheshire with the aim of helping doctors and para ##med ##ics to treat a patient more quickly in an emergency .

reference_raw: A new medical card will be launched in Cheshire in order to help doctors and paramedics deal with patients more quickly in case of emergency.

reference_spacy_tokens: A new medical card will be launched in Cheshire in order to help doctors and paramedics deal with patients more quickly in case of emergency .


fn_spacy_tokens_for_baseline: ' She is n't boring , but she can be awfully tiresome .

source_bert_toks: ' she isn ' t boring , but she can be awful ##ly tires ##ome .

reference_raw: She's not boring, but she can be very tired.

reference_spacy_tokens: She 's not boring , but she can be very tired .


fn_spacy_tokens_for_baseline: ' Nazis , ' she said , once the door was shut and she could n't be overheard .

source_bert_toks: ' nazis , ' she said , once the door was shut and she couldn ' t be overheard .

reference_raw: "Nazis," she said as soon as the door was closed and no one could hear her.

reference_spacy_tokens: " Nazis , " she said as soon as the door was closed and no one could hear her .


fn_spacy_tokens_for_baseline: ' It 's for the starving multitudes , ' he whined through his matted beard , holding out the crock of gold in his blood - stained fingers .

source_bert_toks: ' it ' s for the starving multitude ##s , ' he w ##hine ##d through his matt ##ed beard , holding out the cr ##ock of gold in his blood - stained fingers .

reference_raw: 'It's for the hungry crowds,' he moaned through his matted beard, holding out a rustle of gold in his blood-stained fingers.

reference_spacy_tokens: ' It 's for the hungry crowds , ' he moaned through his matted beard , holding out a rustle of gold in his blood - stained fingers .


fn_spacy_tokens_for_baseline: Kay L.J. also concurred in the result .

source_bert_toks: kay l . j . also con ##cu ##rred in the result .

reference_raw: Kay L.J. also agreed.

reference_spacy_tokens: Kay L.J. also agreed .


fn_spacy_tokens_for_baseline: But none of the officials we have interviewed recalled that an opportunity arose at that time justifying the consideration of a strike .

source_bert_toks: but none of the officials we have interviewed recalled that an opportunity arose at that time justify ##ing the consideration of a strike .

reference_raw: But none of the officials we interviewed reminded us that there was an opportunity at that time to justify the consideration of an attack.

reference_spacy_tokens: But none of the officials we interviewed reminded us that there was an opportunity at that time to justify the consideration of an attack .


fn_spacy_tokens_for_baseline: On the second day the guests worked with the R&D flavourists concocting flavours they themselves had suggested .

source_bert_toks: on the second day the guests worked with the r & d flavour ##ists con ##co ##cting flavour ##s they themselves had suggested .

reference_raw: On the second day, the guests were working with the R&D flavourists who invented the flavors they themselves suggested.

reference_spacy_tokens: On the second day , the guests were working with the R&D flavourists who invented the flavors they themselves suggested .


fn_spacy_tokens_for_baseline: As we squelched along the road and into the farmyard I felt a feeling of utter exhaustion .

source_bert_toks: as we sq ##uel ##ched along the road and into the farm ##yard i felt a feeling of utter exhaustion .

reference_raw: As we squealed along the road and into the farmyard, I felt exhausted.

reference_spacy_tokens: As we squealed along the road and into the farmyard , I felt exhausted .


fn_spacy_tokens_for_baseline: But he knew his own mind , did Gabriel , and persevered so that the holly adorned the bottom edge of the beam like a curving curtain pelmet .

source_bert_toks: but he knew his own mind , did gabriel , and per ##se ##vered so that the holly adorned the bottom edge of the beam like a curving curtain pe ##lm ##et .

reference_raw: But he knew what he was thinking, did Gabriel, and persevered so that Holly adorned the lower edge of the beam like a curving curtain.

reference_spacy_tokens: But he knew what he was thinking , did Gabriel , and persevered so that Holly adorned the lower edge of the beam like a curving curtain .


fn_spacy_tokens_for_baseline: He began punching the paper , sending flurries of cheap newsprint showering to the ground .

source_bert_toks: he began punching the paper , sending flu ##rries of cheap news ##print shower ##ing to the ground .

reference_raw: He began to hit the paper, sending down flurries of cheap newsprints.

reference_spacy_tokens: He began to hit the paper , sending down flurries of cheap newsprints .


fn_spacy_tokens_for_baseline: Joanna , who has brown shoulder - length hair , was last seen wearing a turquoise and blue anorak over a green sweatshirt with a Harpers logo .

source_bert_toks: joanna , who has brown shoulder - length hair , was last seen wearing a turquoise and blue an ##ora ##k over a green sweatshirt with a harper ##s logo .

reference_raw: Joanna, with brown shoulder-length hair, was last seen wearing a turquoise and a blue anorak over a green sweater with the Harpers logo on it.

reference_spacy_tokens: Joanna , with brown shoulder - length hair , was last seen wearing a turquoise and a blue anorak over a green sweater with the Harpers logo on it .


fn_spacy_tokens_for_baseline: Today , it has a membership of over one thousand .

source_bert_toks: today , it has a membership of over one thousand .

reference_raw: Today, he's got more than a thousand members.

reference_spacy_tokens: Today , he 's got more than a thousand members .


fn_spacy_tokens_for_baseline: If you can manage that , and , come out with the right answer , then there 's a pretty good chance you 'll have a smirk on your face the next time the heavens open .

source_bert_toks: if you can manage that , and , come out with the right answer , then there ' s a pretty good chance you ' ll have a smirk on your face the next time the heavens open .

reference_raw: If you can do it, and if you come up with the right answer, there's a good chance you'll have a smile on your face the next time the sky opens.

reference_spacy_tokens: If you can do it , and if you come up with the right answer , there 's a good chance you 'll have a smile on your face the next time the sky opens .


fn_spacy_tokens_for_baseline: ' I 've never been on a boat before , ' he admitted to Tommy , ' unless you count the paddle steamer at Brighton . '

source_bert_toks: ' i ' ve never been on a boat before , ' he admitted to tommy , ' unless you count the paddle steamer at brighton . '

reference_raw: 'I've never been on a ship before,' he said to Tommy, 'unless you count the Brighton paddle steamer.'

reference_spacy_tokens: ' I 've never been on a ship before , ' he said to Tommy , ' unless you count the Brighton paddle steamer . '


fn_spacy_tokens_for_baseline: Some of the mosaics have been lost during the centuries but much remains and is carefully looked after by the Ravenna authorities .

source_bert_toks: some of the mosaic ##s have been lost during the centuries but much remains and is carefully looked after by the raven ##na authorities .

reference_raw: Some of the mosaics have disappeared over the centuries, but many remain, and the Ravenna authorities are taking care of them carefully.

reference_spacy_tokens: Some of the mosaics have disappeared over the centuries , but many remain , and the Ravenna authorities are taking care of them carefully .


fn_spacy_tokens_for_baseline: He realised with a shock that he was nervous -- as nervous as a randy adolescent on a hot date -- and likely to be about as subtle !

source_bert_toks: he realised with a shock that he was nervous - - as nervous as a randy adolescent on a hot date - - and likely to be about as subtle !

reference_raw: He realized with a shock that he was nervous - as nervous as a randy teenager on a hot date - and probably as gentle!

reference_spacy_tokens: He realized with a shock that he was nervous - as nervous as a randy teenager on a hot date - and probably as gentle !


fn_spacy_tokens_for_baseline: The attorney agreed with Haydon about the injustice of the proceedings , and told him to return that evening to settle the matter finally .

source_bert_toks: the attorney agreed with hay ##don about the injustice of the proceedings , and told him to return that evening to settle the matter finally .

reference_raw: The lawyer concurred with Haydon on the unfairness of the proceedings, and told him to come back that night and settle the matter at last.

reference_spacy_tokens: The lawyer concurred with Haydon on the unfairness of the proceedings , and told him to come back that night and settle the matter at last .


fn_spacy_tokens_for_baseline: Father Watson had been more than a little frightened by it , and had confided in the nuns that it was more like something produced by some mechanical contrivance , than by a human being .

source_bert_toks: father watson had been more than a little frightened by it , and had con ##fide ##d in the nuns that it was more like something produced by some mechanical con ##tri ##vance , than by a human being .

reference_raw: Father Watson was more than a little frightened by it, and told the nuns that it was more of a mechanical device than a human being.

reference_spacy_tokens: Father Watson was more than a little frightened by it , and told the nuns that it was more of a mechanical device than a human being .


fn_spacy_tokens_for_baseline: Don has cleared up the way he diddled his income - tax returns .

source_bert_toks: don has cleared up the way he did ##dled his income - tax returns .

reference_raw: Don explained how he was doing his income tax returns.

reference_spacy_tokens: Don explained how he was doing his income tax returns .


fn_spacy_tokens_for_baseline: He commenced by stemming the revenue loss resulting from smuggling by reducing duty levels to lower its profitability , as well as by strengthening the preventative service .

source_bert_toks: he commenced by stemming the revenue loss resulting from smuggling by reducing duty levels to lower its profit ##ability , as well as by strengthening the prevent ##ative service .

reference_raw: It started by reducing the revenue loss resulting from smuggling by lowering the level of customs duties in order to reduce its profitability and strengthening the preventive service.

reference_spacy_tokens: It started by reducing the revenue loss resulting from smuggling by lowering the level of customs duties in order to reduce its profitability and strengthening the preventive service .


fn_spacy_tokens_for_baseline: At that same time , American 11 had its last routine communication with the ground when it acknowledged navigational instructions from the FAA 's air traffic control ( ATC ) center in Boston .

source_bert_toks: at that same time , american 11 had its last routine communication with the ground when it acknowledged navigation ##al instructions from the faa ' s air traffic control ( at ##c ) center in boston .

reference_raw: At the same time, American 11 had its last routine contact with the ground by accepting navigation instructions from the Air Traffic Control Center (ATC) in Boston.

reference_spacy_tokens: At the same time , American 11 had its last routine contact with the ground by accepting navigation instructions from the Air Traffic Control Center ( ATC ) in Boston .


fn_spacy_tokens_for_baseline: The floor of the gazebo was two feet above the level of the surrounding grass .

source_bert_toks: the floor of the gaze ##bo was two feet above the level of the surrounding grass .

reference_raw: The pavilion floor was two feet above the level of the surrounding grass.

reference_spacy_tokens: The pavilion floor was two feet above the level of the surrounding grass .


fn_spacy_tokens_for_baseline: Hence the brief he handed out to his staff was to make TV drama a popular medium , like the cinema , by having it comment and reflect on worlds and situations familiar to mass audiences .

source_bert_toks: hence the brief he handed out to his staff was to make tv drama a popular medium , like the cinema , by having it comment and reflect on worlds and situations familiar to mass audiences .

reference_raw: That's why the brief he gave to his staff was to make television drama a popular media, such as cinema, by having it comment and reflect on worlds and situations known to the public.

reference_spacy_tokens: That 's why the brief he gave to his staff was to make television drama a popular media , such as cinema , by having it comment and reflect on worlds and situations known to the public .


fn_spacy_tokens_for_baseline: and you treated it as a function of a function .

reference_raw: and you thought of it as a function.

reference_spacy_tokens: and you thought of it as a function .


fn_spacy_tokens_for_baseline: The man awoke with a start .

source_bert_toks: the man awoke with a start .

reference_raw: The man woke with a start.

reference_spacy_tokens: The man woke with a start .


fn_spacy_tokens_for_baseline: The first and most important question to mull over as you gaze at your patch is : What is this garden for ?

source_bert_toks: the first and most important question to mu ##ll over as you gaze at your patch is : what is this garden for ?

reference_raw: The first and most important question you have to think about when you're looking at your patch is, what's this garden for?

reference_spacy_tokens: The first and most important question you have to think about when you 're looking at your patch is , what 's this garden for ?


fn_spacy_tokens_for_baseline: I felt totally alienated from my body , the inferior female body that labelled me second - rate , the body that I did not ask to have .

source_bert_toks: i felt totally alien ##ated from my body , the inferior female body that labelled me second - rate , the body that i did not ask to have .

reference_raw: I felt completely alienated from my body, from the subservient female body that marked me as second-class, from a body I didn't ask for.

reference_spacy_tokens: I felt completely alienated from my body , from the subservient female body that marked me as second - class , from a body I did n't ask for .


fn_spacy_tokens_for_baseline: Goebbels was a master with words , but he also realized that words alone were not always enough .

source_bert_toks: go ##eb ##bel ##s was a master with words , but he also realized that words alone were not always enough .

reference_raw: Goebbels was a man of words, but he also realized that words alone were not always enough.

reference_spacy_tokens: Goebbels was a man of words , but he also realized that words alone were not always enough .


fn_spacy_tokens_for_baseline: How many stepmothers would think of that ?

source_bert_toks: how many stepmother ##s would think of that ?

reference_raw: How many half-mothers would have thought about that?

reference_spacy_tokens: How many half - mothers would have thought about that ?


fn_spacy_tokens_for_baseline: We men like to win , and it is quite improper for the servant to be so impudent to the Master as not to allow him to win . '

source_bert_toks: we men like to win , and it is quite improper for the servant to be so imp ##ude ##nt to the master as not to allow him to win . '

reference_raw: We men like to win, and it's not fair for a servant to be so insolent to the Master that he won't win.'

reference_spacy_tokens: We men like to win , and it 's not fair for a servant to be so insolent to the Master that he wo n't win . '


fn_spacy_tokens_for_baseline: ROBERT FRANKLIN of Los Gatos , California , has come up with a neat way of ensuring that electric gadgets such as irons and hair curlers turn themselves off when left unattended .

source_bert_toks: robert franklin of los ga ##tos , california , has come up with a neat way of ensuring that electric ga ##dgets such as iron ##s and hair curl ##ers turn themselves off when left una ##tten ##ded .

reference_raw: ROBERT FRANKLIN of Los Gatos, California, has come up with a neat way to ensure that electrical equipment such as irons and hair curlers turn off when left unattended.

reference_spacy_tokens: ROBERT FRANKLIN of Los Gatos , California , has come up with a neat way to ensure that electrical equipment such as irons and hair curlers turn off when left unattended .


fn_spacy_tokens_for_baseline: What a contrast to those wet rags she wore in the movie !

source_bert_toks: what a contrast to those wet rags she wore in the movie !

reference_raw: What a contrast to the wet clothes she was wearing in the movie!

reference_spacy_tokens: What a contrast to the wet clothes she was wearing in the movie !


fn_spacy_tokens_for_baseline: Behind him , along the road leading down to the town , he could see lights start to glow as home fires were kindled against the cold night .

source_bert_toks: behind him , along the road leading down to the town , he could see lights start to glow as home fires were kind ##led against the cold night .

reference_raw: Behind him, along the road leading down to the city, he could see the lights beginning to glow as the fires of the house were warm against the cold night.

reference_spacy_tokens: Behind him , along the road leading down to the city , he could see the lights beginning to glow as the fires of the house were warm against the cold night .


fn_spacy_tokens_for_baseline: ' You 're jokin ' ! ' splutters Gordon , and they crack up .

source_bert_toks: ' you ' re jo ##kin ' ! ' sp ##lu ##tters gordon , and they crack up .

reference_raw: 'You're kidding!' says Gordon, and they break.

reference_spacy_tokens: ' You 're kidding ! ' says Gordon , and they break .


fn_spacy_tokens_for_baseline: Ramsey bicycled over to Wordsworth Grove to see if there were any letters .

source_bert_toks: ramsey bicycle ##d over to words ##worth grove to see if there were any letters .

reference_raw: Ramsey wheeled to Wordsworth Grove to see if there were any letters.

reference_spacy_tokens: Ramsey wheeled to Wordsworth Grove to see if there were any letters .


fn_spacy_tokens_for_baseline: Or is the genuine Dublin culture to be found in the new sprawling suburbs with its run - down libraries and shopping malls ?

source_bert_toks: or is the genuine dublin culture to be found in the new sprawling suburbs with its run - down libraries and shopping malls ?

reference_raw: Or is the real Dublin culture to be found in the new, sprawling suburbs with its run-down libraries and shopping malls?

reference_spacy_tokens: Or is the real Dublin culture to be found in the new , sprawling suburbs with its run - down libraries and shopping malls ?


fn_spacy_tokens_for_baseline: ' Sixteen , ' said Jimmy , buttering his toast .

source_bert_toks: ' sixteen , ' said jimmy , butter ##ing his toast .

reference_raw: 'Sixteen,' Jimmy said, making toast.

reference_spacy_tokens: ' Sixteen , ' Jimmy said , making toast .


fn_spacy_tokens_for_baseline: ' Why , ' I demanded as the grey car disappeared , ' did n't you ? '

source_bert_toks: ' why , ' i demanded as the grey car disappeared , ' didn ' t you ? '

reference_raw: "Why," I asked as the gray car vanished, "do you not?"

reference_spacy_tokens: " Why , " I asked as the gray car vanished , " do you not ? "


fn_spacy_tokens_for_baseline: John escaped death because he could not settle in the doomed cabin where 15-year - old Catherine and 12-year - old James were sleeping .

source_bert_toks: john escaped death because he could not settle in the doomed cabin where 15 - year - old catherine and 12 - year - old james were sleeping .

reference_raw: John got away from death because he couldn't get into a doomed cabin where 15-year-old Catherine and 12-year-old James slept.

reference_spacy_tokens: John got away from death because he could n't get into a doomed cabin where 15-year - old Catherine and 12-year - old James slept .


fn_spacy_tokens_for_baseline: I am a daughter of late Mr. Jeremiah Otomeh , My father Mr. Jeremiah .E.

source_bert_toks: i am a daughter of late mr . jeremiah ot ##ome ##h , my father mr . jeremiah . e .

reference_raw: I'm the daughter of the deceased Mr. Jeremiah Otomeh, my father, Mr. Jeremiah E.

reference_spacy_tokens: I 'm the daughter of the deceased Mr. Jeremiah Otomeh , my father , Mr. Jeremiah E.


fn_spacy_tokens_for_baseline: During a visit the assistant , her boss , and Thomas make to Vernon Jordan , she is all but sexually harassed by the Democratic power broker -- he kisses her as he takes his leave and calls her ' sweetheart . '

source_bert_toks: during a visit the assistant , her boss , and thomas make to vernon jordan , she is all but sexually harassed by the democratic power broker - - he kisses her as he takes his leave and calls her ' sweetheart . '

reference_raw: When the assistant, her boss, and Thomas go to Vernon Jordan, she's all but sexually harassed by a democratic power broker-he kisses her when he's off and calls her sweetheart.'

reference_spacy_tokens: When the assistant , her boss , and Thomas go to Vernon Jordan , she 's all but sexually harassed by a democratic power broker - he kisses her when he 's off and calls her sweetheart . '


fn_spacy_tokens_for_baseline: Finally , there is the highly significant question of the relation between the court itself and other political institutions , especially executives and assemblies .

source_bert_toks: finally , there is the highly significant question of the relation between the court itself and other political institutions , especially executives and assemblies .

reference_raw: Finally, there is a very important question of the relationship between the court itself and other political institutions, in particular executives and assemblies.

reference_spacy_tokens: Finally , there is a very important question of the relationship between the court itself and other political institutions , in particular executives and assemblies .


fn_spacy_tokens_for_baseline: Narrowly victorious in a mudslinging campaign , Mrs Richards -- a divorced mother of four -- became the first woman to hold the office since 1935 .

source_bert_toks: narrowly victorious in a mud ##sling ##ing campaign , mrs richards - - a divorced mother of four - - became the first woman to hold the office since 1935 .

reference_raw: Shortly won in the muddling campaign, Mrs. Richards, a divorced mother of four, became the first woman to be in office since 1935.

reference_spacy_tokens: Shortly won in the muddling campaign , Mrs. Richards , a divorced mother of four , became the first woman to be in office since 1935 .


fn_spacy_tokens_for_baseline: The deputy mayor of the town , Panayiotis Bitakos , told Skai TV that " I call on all residents to follow the instructions of the police as to where they will go .

source_bert_toks: the deputy mayor of the town , pan ##ay ##iot ##is bit ##ako ##s , told ska ##i tv that " i call on all residents to follow the instructions of the police as to where they will go .

reference_raw: The city's deputy mayor, Panayiotis Bitakos, said to Skai TV, "I invite all residents to follow the police's instructions as to where they're going.

reference_spacy_tokens: The city 's deputy mayor , Panayiotis Bitakos , said to Skai TV , " I invite all residents to follow the police 's instructions as to where they 're going .


fn_spacy_tokens_for_baseline: It is therefore a legal necessity for almost all goat - keepers to have a copy of the MAFF Code of Welfare of Goats .

source_bert_toks: it is therefore a legal necessity for almost all goat - keepers to have a copy of the ma ##ff code of welfare of goats .

reference_raw: It is therefore legally necessary for almost all goat-keepers to have a copy of the MAFF Code of Welfare for Goats.

reference_spacy_tokens: It is therefore legally necessary for almost all goat - keepers to have a copy of the MAFF Code of Welfare for Goats .


fn_spacy_tokens_for_baseline: He lit a cigarette , took a long drag .

source_bert_toks: he lit a cigarette , took a long drag .

reference_raw: He lit a cigarette and drew on it.

reference_spacy_tokens: He lit a cigarette and drew on it .


fn_spacy_tokens_for_baseline: Water stained his shoulders , shone on his footwear , stood in drops on the furry ribs of the socks between his breeches and his boots .

source_bert_toks: water stained his shoulders , shone on his foot ##wear , stood in drops on the furry ribs of the socks between his bree ##ches and his boots .

reference_raw: The water stained his shoulders, shone on his shoes, and stood in drops on the furry ribs of his socks between his pants and his shoes.

reference_spacy_tokens: The water stained his shoulders , shone on his shoes , and stood in drops on the furry ribs of his socks between his pants and his shoes .


fn_spacy_tokens_for_baseline: In 1947 the United Nations voted for the partition of Palestine into two states , one Jewish and one Arab , with Jerusalem as an international city that belonged to neither .

source_bert_toks: in 1947 the united nations voted for the partition of palestine into two states , one jewish and one arab , with jerusalem as an international city that belonged to neither .

reference_raw: In 1947, the United Nations voted to divide Palestine into two states, one Jewish and one Arab, and Jerusalem was an international city that was not one of them.

reference_spacy_tokens: In 1947 , the United Nations voted to divide Palestine into two states , one Jewish and one Arab , and Jerusalem was an international city that was not one of them .


fn_spacy_tokens_for_baseline: Gaynor Wynne was filming her with a camcorder during a champagne reception at the Imperial Hotel .

source_bert_toks: gay ##nor wynn ##e was filming her with a cam ##cor ##der during a champagne reception at the imperial hotel .

reference_raw: Gaynor Wynne filmed her with a camera while receiving champagne at the Imperial Hotel.

reference_spacy_tokens: Gaynor Wynne filmed her with a camera while receiving champagne at the Imperial Hotel .


fn_spacy_tokens_for_baseline: This is not surprising , since it was derived from a study of past searches by users of the same library .

source_bert_toks: this is not surprising , since it was derived from a study of past searches by users of the same library .

reference_raw: This is not surprising, since it was derived from a study of previous research carried out by users in the same library.

reference_spacy_tokens: This is not surprising , since it was derived from a study of previous research carried out by users in the same library .


fn_spacy_tokens_for_baseline: Mr Wilson , the MP for Cunninghame North , said it was gangsterism and claimed that people were being blackmailed to accept lower terms and conditions .

source_bert_toks: mr wilson , the mp for cunningham ##e north , said it was gangster ##ism and claimed that people were being blackmail ##ed to accept lower terms and conditions .

reference_raw: Mr. Wilson, MP of Cunninghame North, said it was gangsterism and said that people were being extorted to accept lower conditions.

reference_spacy_tokens: Mr. Wilson , MP of Cunninghame North , said it was gangsterism and said that people were being extorted to accept lower conditions .