fn_spacy_tokens_for_baseline: If the fees certified by The Law Society are lower than those in the bill , only the lower sum is recoverable by the solicitor .

source_bert_toks: if the fees certified by the law society are lower than those in the bill , only the lower sum is recover ##able by the solicitor .

reference_raw: If the fees attested by the Law Society are lower than those in the law, the lawyer can only recover the lower amount.

reference_spacy_tokens: If the fees attested by the Law Society are lower than those in the law , the lawyer can only recover the lower amount .


fn_spacy_tokens_for_baseline: As you near the end of your first video safari , the low - battery warning in your viewfinder may begin to flash , indicating that you have not long to go before switch - off for the day .

source_bert_toks: as you near the end of your first video safari , the low - battery warning in your view ##finder may begin to flash , indicating that you have not long to go before switch - off for the day .

reference_raw: As you close to the end of your first video safari, a low battery warning in your browser can start flashing, suggesting you don't have much time before you turn off for the day.

reference_spacy_tokens: As you close to the end of your first video safari , a low battery warning in your browser can start flashing , suggesting you do n't have much time before you turn off for the day .


fn_spacy_tokens_for_baseline: Translator : The armed Intifada must end and we must use and resort to peaceful means in our quest to end the occupation and the suffering of the Palestinians , and the Israelis , and to establish the Palestinian state .

source_bert_toks: translator : the armed int ##if ##ada must end and we must use and resort to peaceful means in our quest to end the occupation and the suffering of the palestinians , and the israelis , and to establish the palestinian state .

reference_raw: Translator: Armed Intifada must end, and we must use and use peaceful resources to end the occupation and suffering of Palestinians and Israelis and establish a Palestinian state.

reference_spacy_tokens: Translator : Armed Intifada must end , and we must use and use peaceful resources to end the occupation and suffering of Palestinians and Israelis and establish a Palestinian state .


fn_spacy_tokens_for_baseline: Not a peep from the Treasury Solicitor ; the D - Notice Committee obviously did n't ( notice , that is ) .

source_bert_toks: not a pee ##p from the treasury solicitor ; the d - notice committee obviously didn ' t ( notice , that is ) .

reference_raw: Not a glance from the Treasury Attorney; the D-Notice Committee clearly did not (notice, i.e.).

reference_spacy_tokens: Not a glance from the Treasury Attorney ; the D - Notice Committee clearly did not ( notice , i.e. ) .


fn_spacy_tokens_for_baseline: Ever since I took over the tips section in the hallowed pages of ZZAP ! 64 , folks have whinged that most of the pokes are for Reset and Action Replay carts .

source_bert_toks: ever since i took over the tips section in the hall ##owed pages of z ##za ##p ! 64 , folks have w ##hing ##ed that most of the poke ##s are for reset and action replay carts .

reference_raw: Since I took over the tip section on the sacred pages of ZZAP! 64, people have been whining that most of the pokes are for Restore and Action Replay Carts.

reference_spacy_tokens: Since I took over the tip section on the sacred pages of ZZAP ! 64 , people have been whining that most of the pokes are for Restore and Action Replay Carts .


fn_spacy_tokens_for_baseline: ' If you 're so concerned for his safety , had n't you better get dressed and go after him ? '

source_bert_toks: ' if you ' re so concerned for his safety , hadn ' t you better get dressed and go after him ? '

reference_raw: "If you're so concerned about his safety, wouldn't you rather get dressed and go after him?"

reference_spacy_tokens: " If you 're so concerned about his safety , would n't you rather get dressed and go after him ? "


fn_spacy_tokens_for_baseline: The F2B creaked through a 180-degree turn and began photographing another strip .

source_bert_toks: the f ##2 ##b creaked through a 180 - degree turn and began photograph ##ing another strip .

reference_raw: The F2B squealed at a 180-degree turn and began to photograph the next strip.

reference_spacy_tokens: The F2B squealed at a 180-degree turn and began to photograph the next strip .


fn_spacy_tokens_for_baseline: " I rang my mother and she said : ' Tell that Mr. Branson that you phoned your mother and she said you were not going to go . "

source_bert_toks: " i rang my mother and she said : ' tell that mr . bran ##son that you phone ##d your mother and she said you were not going to go . "

reference_raw: "I called my mother and she said, "Tell Mr. Branson you called your mother and she said you weren't coming."

reference_spacy_tokens: " I called my mother and she said , " Tell Mr. Branson you called your mother and she said you were n't coming . "


fn_spacy_tokens_for_baseline: The same study also corroborated the finding of other studies that the status of the college attended , apart from the years of attendance , was closely related to future earnings .

source_bert_toks: the same study also co ##rro ##bor ##ated the finding of other studies that the status of the college attended , apart from the years of attendance , was closely related to future earnings .

reference_raw: The same study also confirmed the conclusion of other studies that, in addition to the years of participation, the status of the university was closely linked to future earnings.

reference_spacy_tokens: The same study also confirmed the conclusion of other studies that , in addition to the years of participation , the status of the university was closely linked to future earnings .


fn_spacy_tokens_for_baseline: ' In this respect we are unable to conclude on the completeness and accuracy of the company 's accounting records . '

source_bert_toks: ' in this respect we are unable to conclude on the complete ##ness and accuracy of the company ' s accounting records . '

reference_raw: "We cannot conclude in this regard that the company's accounting records are complete and accurate."

reference_spacy_tokens: " We can not conclude in this regard that the company 's accounting records are complete and accurate . "


fn_spacy_tokens_for_baseline: Soon afterwards , the Finance Minister will present an austerity budget for 1990 .

source_bert_toks: soon afterwards , the finance minister will present an aus ##ter ##ity budget for 1990 .

reference_raw: Soon thereafter, the Finance Minister will present the 1990 savings budget.

reference_spacy_tokens: Soon thereafter , the Finance Minister will present the 1990 savings budget .


fn_spacy_tokens_for_baseline: SOCIAL security fraud investigators have saved the province 's taxpayers more than £ million after uncovering over 6 , bogus claims from local benefit cheats .

source_bert_toks: social security fraud investigators have saved the province ' s taxpayers more than £ ##mill ##ion after uncover ##ing over 6 , bog ##us claims from local benefit cheat ##s .

reference_raw: SOCIAL security fraud investigators saved over a million pounds of taxpayers in the province after the discovery of more than six false claims from local benefit frauds.

reference_spacy_tokens: SOCIAL security fraud investigators saved over a million pounds of taxpayers in the province after the discovery of more than six false claims from local benefit frauds .


fn_spacy_tokens_for_baseline: On the one hand , if no explanation is given , the creditor will be at risk that the surety 's misunderstanding , or the debtor 's misrepresentation will render the security unenforceable in equity .

source_bert_toks: on the one hand , if no explanation is given , the credit ##or will be at risk that the sure ##ty ' s misunderstanding , or the debt ##or ' s mis ##re ##pres ##entation will render the security une ##n ##force ##able in equity .

reference_raw: On the one hand, if no explanation is given, the creditor risks a misunderstanding of the guarantee or a distortion of the debtor renders the guarantee unenforceable in equity.

reference_spacy_tokens: On the one hand , if no explanation is given , the creditor risks a misunderstanding of the guarantee or a distortion of the debtor renders the guarantee unenforceable in equity .


fn_spacy_tokens_for_baseline: The cause of this was somebody trying to spear me with a javelin , but a javelin with a yellow pennant tied to it .

source_bert_toks: the cause of this was somebody trying to spear me with a javelin , but a javelin with a yellow pennant tied to it .

reference_raw: The reason was that someone tried to javelin me, but it was a javelin with a yellow pennant tied to it.

reference_spacy_tokens: The reason was that someone tried to javelin me , but it was a javelin with a yellow pennant tied to it .


fn_spacy_tokens_for_baseline: The blood transfusion brought colour to my face and I am deeply indebted to some anonymous donor .

source_bert_toks: the blood trans ##fusion brought colour to my face and i am deeply ind ##eb ##ted to some anonymous donor .

reference_raw: The blood transfusion has brought color to my face, and I'm deeply indebted to an anonymous sponsor.

reference_spacy_tokens: The blood transfusion has brought color to my face , and I 'm deeply indebted to an anonymous sponsor .


fn_spacy_tokens_for_baseline: I coped at the time but now , five years on , I feel guilty and resentful about the whole affair .

source_bert_toks: i cope ##d at the time but now , five years on , i feel guilty and res ##ent ##ful about the whole affair .

reference_raw: I dealt with it then, but now, five years later, I feel guilty and angry about the whole thing.

reference_spacy_tokens: I dealt with it then , but now , five years later , I feel guilty and angry about the whole thing .


fn_spacy_tokens_for_baseline: And the victims you know the family of these people that have been murdered they just have to have it dragged on for years and years before they ever get any resolution .

source_bert_toks: and the victims you know the family of these people that have been murdered they just have to have it dragged on for years and years before they ever get any resolution .

reference_raw: And the victims, you know, the families of those people who were killed, they just have to drag it out for years and years before they get a resolution.

reference_spacy_tokens: And the victims , you know , the families of those people who were killed , they just have to drag it out for years and years before they get a resolution .


fn_spacy_tokens_for_baseline: If you have a dog that behaves in this fashion , do not encourage it by making soothing noises , entreating it to calm down .

source_bert_toks: if you have a dog that behave ##s in this fashion , do not encourage it by making soothing noises , en ##tre ##ating it to calm down .

reference_raw: If you have a dog that behaves that way, don't encourage it by making soothing noises and trying to calm it down.

reference_spacy_tokens: If you have a dog that behaves that way , do n't encourage it by making soothing noises and trying to calm it down .


fn_spacy_tokens_for_baseline: The principal settlements are Yung Shue Wan on Lamma 's northwest , and Sok Kwu Wan , on the east coast .

source_bert_toks: the principal settlements are yun ##g shu ##e wan on lam ##ma ' s northwest , and so ##k kw ##u wan , on the east coast .

reference_raw: The main settlements are Yung Shue Wan on the northwest of Lamma and Sok Kwu Wan on the eastern shore.

reference_spacy_tokens: The main settlements are Yung Shue Wan on the northwest of Lamma and Sok Kwu Wan on the eastern shore .


fn_spacy_tokens_for_baseline: It came from the direction of the strangely attired man in the dock , and the more observant members of the jury could see that this bell was attached to the end of the man 's hat .

source_bert_toks: it came from the direction of the strangely attire ##d man in the dock , and the more ob ##ser ##vant members of the jury could see that this bell was attached to the end of the man ' s hat .

reference_raw: It came from the direction of the strangely dressed man on the dock, and the more attentive members of the jury saw that the bell was attached to the end of his hat.

reference_spacy_tokens: It came from the direction of the strangely dressed man on the dock , and the more attentive members of the jury saw that the bell was attached to the end of his hat .


fn_spacy_tokens_for_baseline: I always use two simple words when people tell me that one company -- whether it is AOL or Microsoft or Disney -- is in charge of all our destinies : Babylon was .

source_bert_toks: i always use two simple words when people tell me that one company - - whether it is ao ##l or microsoft or disney - - is in charge of all our des ##tin ##ies : babylon was .

reference_raw: When people tell me that one company, whether it's AOL or Microsoft or Disney, is responsible for all our fates, I always use two simple words: Babylon was.

reference_spacy_tokens: When people tell me that one company , whether it 's AOL or Microsoft or Disney , is responsible for all our fates , I always use two simple words : Babylon was .


fn_spacy_tokens_for_baseline: Because of the new legitimacy Las Vegas acquired from Hughes ' investments , established companies such as Hilton Hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal skimming of profits was rampant .

source_bert_toks: because of the new legitimacy las vegas acquired from hughes ' investments , established companies such as hilton hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal ski ##mming of profits was rampant .

reference_raw: Due to the new legitimacy that Las Vegas has acquired from Hughes' investments, established companies like Hilton Hotels have bought into gambling, and their influence has helped to draw a link in the desert sand between legitimate operations and mafia casinos, where illegal profit skimming is rampant.

reference_spacy_tokens: Due to the new legitimacy that Las Vegas has acquired from Hughes ' investments , established companies like Hilton Hotels have bought into gambling , and their influence has helped to draw a link in the desert sand between legitimate operations and mafia casinos , where illegal profit skimming is rampant .


fn_spacy_tokens_for_baseline: ' What became of him ? '

source_bert_toks: ' what became of him ? '

reference_raw: "What happened to it?"

reference_spacy_tokens: " What happened to it ? "


fn_spacy_tokens_for_baseline: The ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

source_bert_toks: the ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

reference_raw: The harbors are within the hiking distance of several beautiful beaches, and within an hour of each other on a marked path.

reference_spacy_tokens: The harbors are within the hiking distance of several beautiful beaches , and within an hour of each other on a marked path .


fn_spacy_tokens_for_baseline: Behind the church is the 1917 French Mission Building , now used as the Court of Final Appeal .

source_bert_toks: behind the church is the 1917 french mission building , now used as the court of final appeal .

reference_raw: Behind the church is the building of France's 1917 mission, which is now used as a court of final appeal.

reference_spacy_tokens: Behind the church is the building of France 's 1917 mission , which is now used as a court of final appeal .


fn_spacy_tokens_for_baseline: In days of yore , such places were spattered with the blood of sacrificial victims to ensure good fortune in battle , and dunters are thought to be the spirits of these unhappy people .

source_bert_toks: in days of yo ##re , such places were spat ##tered with the blood of sac ##ri ##fi ##cial victims to ensure good fortune in battle , and dun ##ters are thought to be the spirits of these unhappy people .

reference_raw: In the days of Yore, such places have been splattered with the blood of sacrifices to ensure happiness in battle, and the dunters are thought to be the souls of these unfortunates.

reference_spacy_tokens: In the days of Yore , such places have been splattered with the blood of sacrifices to ensure happiness in battle , and the dunters are thought to be the souls of these unfortunates .


fn_spacy_tokens_for_baseline: Alternatively , was it an iniquitous form of torture perfected in Munich ?

source_bert_toks: alternatively , was it an in ##iq ##uit ##ous form of torture perfect ##ed in munich ?

reference_raw: Or was it an evil form of torture perfected in Munich?

reference_spacy_tokens: Or was it an evil form of torture perfected in Munich ?


fn_spacy_tokens_for_baseline: We are all fine here , although Mame was extremely freaked .

source_bert_toks: we are all fine here , although ma ##me was extremely freaked .

reference_raw: We're all fine here, even though Mame was very scared.

reference_spacy_tokens: We 're all fine here , even though Mame was very scared .


fn_spacy_tokens_for_baseline: The shop assistant may glimpse the bulges that we conceal so cleverly , and the beauty parlour attendant get a close - up of nasty blackheads and facial hair .

source_bert_toks: the shop assistant may glimpse the bulge ##s that we conceal so clever ##ly , and the beauty par ##lou ##r attendant get a close - up of nasty black ##heads and facial hair .

reference_raw: A shop assistant can see the bulges we hide so cleverly, and a beauty parlor attendant gets close to ugly black hair and facial hair.

reference_spacy_tokens: A shop assistant can see the bulges we hide so cleverly , and a beauty parlor attendant gets close to ugly black hair and facial hair .


fn_spacy_tokens_for_baseline: Ocean should be thoroughly ashamed of themselves for releasing this third - rate rubbish .

source_bert_toks: ocean should be thoroughly ashamed of themselves for releasing this third - rate rubbish .

reference_raw: The oceans should be thoroughly ashamed of themselves for releasing this third-class crap.

reference_spacy_tokens: The oceans should be thoroughly ashamed of themselves for releasing this third - class crap .


fn_spacy_tokens_for_baseline: For example , Walter Laqueur , a terrorism specialist at the Center for Strategic and International Studies in Washington , D.C. , defines terrorism as : " The sub - state application of violence or threatened violence intended to sow panic in a society , to weaken or even overthrow the incumbents , and to bring about political change . "

source_bert_toks: for example , walter la ##que ##ur , a terrorism specialist at the center for strategic and international studies in washington , d . c . , defines terrorism as : " the sub - state application of violence or threatened violence intended to so ##w panic in a society , to weaken or even overthrow the incumbent ##s , and to bring about political change . "

reference_raw: For example, Walter Laqueur, a terrorist expert at the Center for Strategic and International Studies in Washington, Washington, D.C., defines terrorism as "a sub-state application of violence or threat of violence aimed at sowing panic in society, weakening or even overthrowing incumbents, and bringing about political change."

reference_spacy_tokens: For example , Walter Laqueur , a terrorist expert at the Center for Strategic and International Studies in Washington , Washington , D.C. , defines terrorism as " a sub - state application of violence or threat of violence aimed at sowing panic in society , weakening or even overthrowing incumbents , and bringing about political change . "


fn_spacy_tokens_for_baseline: The value of the coin collection should be typed in .

source_bert_toks: the value of the coin collection should be typed in .

reference_raw: The value of the coin collection should be entered.

reference_spacy_tokens: The value of the coin collection should be entered .


fn_spacy_tokens_for_baseline: A circular shaped fence is harder to protect because of hidden angles .

source_bert_toks: a circular shaped fence is harder to protect because of hidden angles .

reference_raw: A round-shaped fence is more difficult to protect due to hidden angles.

reference_spacy_tokens: A round - shaped fence is more difficult to protect due to hidden angles .


fn_spacy_tokens_for_baseline: There were plenty of promises of big money , fame , glamour , fast cars and all the trappings that any actor might lust towards .

source_bert_toks: there were plenty of promises of big money , fame , glamour , fast cars and all the trapping ##s that any actor might lust towards .

reference_raw: There were many promises of great money, fame, charm, fast cars, and all the traps that any actor could wish for.

reference_spacy_tokens: There were many promises of great money , fame , charm , fast cars , and all the traps that any actor could wish for .


fn_spacy_tokens_for_baseline: ' I agreed to marry Janice to get her out of a fix .

source_bert_toks: ' i agreed to marry janice to get her out of a fix .

reference_raw: I agreed to marry Janice to get her out of trouble.

reference_spacy_tokens: I agreed to marry Janice to get her out of trouble .


fn_spacy_tokens_for_baseline: 1- Sheik Hatim Abd al - Razzaq Mu'jil al - Ka'ud , Sheik AlbuNimr tribe .

source_bert_toks: 1 - she ##ik hat ##im abd al - ra ##zza ##q mu ' ji ##l al - ka ' ud , she ##ik al ##bu ##ni ##m ##r tribe .

reference_raw: 1-Sheik Hatim Abd al-Razzaq Mu'jil al-Ka'ud, tribe of Sheika AlbuNimr.

reference_spacy_tokens: 1-Sheik Hatim Abd al - Razzaq Mu'jil al - Ka'ud , tribe of Sheika AlbuNimr .


fn_spacy_tokens_for_baseline: Wycliffe opened the door , waited for her to switch out the lights and pass through , then he locked the door and pocketed the keys .

source_bert_toks: w ##y ##cliffe opened the door , waited for her to switch out the lights and pass through , then he locked the door and pocket ##ed the keys .

reference_raw: Wycliffe opened the door, waited for it to turn off the lights and pass through, then locked the door and put the keys in it.

reference_spacy_tokens: Wycliffe opened the door , waited for it to turn off the lights and pass through , then locked the door and put the keys in it .


fn_spacy_tokens_for_baseline: His expression was contemptuous .

source_bert_toks: his expression was contempt ##uous .

reference_raw: He looked scornful.

reference_spacy_tokens: He looked scornful .


fn_spacy_tokens_for_baseline: Franca decided that Alison had probably been drinking on the plane and was already a bit tipsy .

source_bert_toks: fran ##ca decided that alison had probably been drinking on the plane and was already a bit tips ##y .

reference_raw: Franca decided that Alison was probably drinking on the plane, and she was already a little drunk.

reference_spacy_tokens: Franca decided that Alison was probably drinking on the plane , and she was already a little drunk .


fn_spacy_tokens_for_baseline: Apulia is part of Italy 's deepest south , an area rich in rustic traditions and superbly scenic .

source_bert_toks: ap ##ulia is part of italy ' s deepest south , an area rich in rustic traditions and superb ##ly scenic .

reference_raw: Apulia is part of the deepest southern part of Italy, a region rich in rural traditions and excellent scenery.

reference_spacy_tokens: Apulia is part of the deepest southern part of Italy , a region rich in rural traditions and excellent scenery .


fn_spacy_tokens_for_baseline: Sulphur hexafluoride itself is harmless except in a confined space , where it displaces oxygen and can asphyxiate people .

source_bert_toks: sul ##ph ##ur he ##xa ##fl ##uo ##ride itself is harmless except in a confined space , where it di ##sp ##lace ##s oxygen and can as ##phy ##xia ##te people .

reference_raw: The sulphur hexafluoride itself is harmless, except in a confined space where oxygen is displaced and can suffocate humans.

reference_spacy_tokens: The sulphur hexafluoride itself is harmless , except in a confined space where oxygen is displaced and can suffocate humans .


fn_spacy_tokens_for_baseline: The museum also offers boat tours aboard a fishing junk .

source_bert_toks: the museum also offers boat tours aboard a fishing junk .

reference_raw: The museum also offers ship-to-ship tours on fishing gear.

reference_spacy_tokens: The museum also offers ship - to - ship tours on fishing gear .


fn_spacy_tokens_for_baseline: Parish registers of baptisms were increasingly incomplete , of declining value as proof of ancestry and statistically inadequate , a source of annoyance to officials and derision by foreigners .

source_bert_toks: parish registers of baptism ##s were increasingly incomplete , of declining value as proof of ancestry and statistical ##ly inadequate , a source of annoyance to officials and der ##ision by foreigners .

reference_raw: The Parish registers of baptisms were increasingly incomplete, of declining value as evidence of ancestry and statistically inadequate, a source of annoyance to officials and mockery by foreigners.

reference_spacy_tokens: The Parish registers of baptisms were increasingly incomplete , of declining value as evidence of ancestry and statistically inadequate , a source of annoyance to officials and mockery by foreigners .


fn_spacy_tokens_for_baseline: PALESTINIAN gunmen shot and wounded an Israeli soldier in the occu pied West Bank yesterday , as army patrols searched for a kidnapped border guard .

source_bert_toks: palestinian gunmen shot and wounded an israeli soldier in the o ##cc ##u pie ##d west bank yesterday , as army patrols searched for a kidnapped border guard .

reference_raw: Palestinian gunmen shot and injured an Israeli soldier in the Occu pied West Bank yesterday while military patrols were looking for a hijacked border guard.

reference_spacy_tokens: Palestinian gunmen shot and injured an Israeli soldier in the Occu pied West Bank yesterday while military patrols were looking for a hijacked border guard .


fn_spacy_tokens_for_baseline: The kids were mortified but I thought it was a real hoot . '

source_bert_toks: the kids were mort ##ified but i thought it was a real ho ##ot . '

reference_raw: The children were humiliated, but I thought it was a real hoot.'

reference_spacy_tokens: The children were humiliated , but I thought it was a real hoot . '


fn_spacy_tokens_for_baseline: Richter stumbled back and retched against the wall .

source_bert_toks: richter stumbled back and re ##tched against the wall .

reference_raw: Richter staggered back and leaned back against the wall.

reference_spacy_tokens: Richter staggered back and leaned back against the wall .


fn_spacy_tokens_for_baseline: However , sometimes it seems that the city produced artists of this stature by accident , even against its will .

source_bert_toks: however , sometimes it seems that the city produced artists of this stature by accident , even against its will .

reference_raw: Sometimes, however, the city seems to have created artisans of this stature by accident, even against its will.

reference_spacy_tokens: Sometimes , however , the city seems to have created artisans of this stature by accident , even against its will .


fn_spacy_tokens_for_baseline: There 's an edginess , a tough guy 's melancholy , to Davis ' sound .

source_bert_toks: there ' s an ed ##gin ##ess , a tough guy ' s melancholy , to davis ' sound .

reference_raw: To Davis's voice, there's an edge, a tough guy's melancholy.

reference_spacy_tokens: To Davis 's voice , there 's an edge , a tough guy 's melancholy .


fn_spacy_tokens_for_baseline: Aside from the fact that Jill is quite capable of carrying her own books , her glumness could easily be due to being a young lesbian forced to suppress it and wishing Jack would take his stupid pick - up lines elsewhere .

source_bert_toks: aside from the fact that jill is quite capable of carrying her own books , her g ##lum ##ness could easily be due to being a young lesbian forced to suppress it and wishing jack would take his stupid pick - up lines elsewhere .

reference_raw: Besides the fact that Jill was quite capable of carrying her own books, her resentment could easily have been caused by the fact that she was a young lesbian who had been forced to suppress it and wished Jack had taken his stupid pickup line elsewhere.

reference_spacy_tokens: Besides the fact that Jill was quite capable of carrying her own books , her resentment could easily have been caused by the fact that she was a young lesbian who had been forced to suppress it and wished Jack had taken his stupid pickup line elsewhere .


fn_spacy_tokens_for_baseline: The chatterbox will keep talking about anything so long as there is n't a pause where there could be an opportunity to engage brain before mouth .

source_bert_toks: the chatter ##box will keep talking about anything so long as there isn ' t a pause where there could be an opportunity to engage brain before mouth .

reference_raw: The chat box talks about everything until there's a pause where there's a chance to hit the brain in front of the mouth.

reference_spacy_tokens: The chat box talks about everything until there 's a pause where there 's a chance to hit the brain in front of the mouth .


fn_spacy_tokens_for_baseline: They are entrusted with the task of tracking down the movement of strangers who are approaching the location .

source_bert_toks: they are entrusted with the task of tracking down the movement of strangers who are approaching the location .

reference_raw: Their mission is to track the movement of aliens approaching the site.

reference_spacy_tokens: Their mission is to track the movement of aliens approaching the site .


fn_spacy_tokens_for_baseline: Brandon then told one of the other group : ' Order your food and leave if you do n't want trouble , or I 'll splatter your face across the road . '

source_bert_toks: brandon then told one of the other group : ' order your food and leave if you don ' t want trouble , or i ' ll sp ##lat ##ter your face across the road . '

reference_raw: Brandon said to another group, "Order your food and leave if you don't want any trouble, or I'll spray your face across the street."

reference_spacy_tokens: Brandon said to another group , " Order your food and leave if you do n't want any trouble , or I 'll spray your face across the street . "


fn_spacy_tokens_for_baseline: Lucenzo seemed to be making up his mind about her , and she knew intuitively that everything she longed for hung on his decision .

source_bert_toks: luce ##nzo seemed to be making up his mind about her , and she knew intuitive ##ly that everything she longed for hung on his decision .

reference_raw: Lucenzo seemed to have made up his mind about her, and she knew intuitively that everything she wanted depended on his decision.

reference_spacy_tokens: Lucenzo seemed to have made up his mind about her , and she knew intuitively that everything she wanted depended on his decision .


fn_spacy_tokens_for_baseline: Shots were returned , but the gunmen escaped to a nearby copse .

source_bert_toks: shots were returned , but the gunmen escaped to a nearby cops ##e .

reference_raw: The shots had been returned, but the shooters had fled to a nearby police station.

reference_spacy_tokens: The shots had been returned , but the shooters had fled to a nearby police station .


fn_spacy_tokens_for_baseline: This consisted of a long or short shaft with a staple at the end , to which a chain was attached .

source_bert_toks: this consisted of a long or short shaft with a staple at the end , to which a chain was attached .

reference_raw: It consisted of a long or short shaft with a manacle at the end, with a chain attached to it.

reference_spacy_tokens: It consisted of a long or short shaft with a manacle at the end , with a chain attached to it .


fn_spacy_tokens_for_baseline: This trend is partly accounted for by the steady increase in cohabitation .

source_bert_toks: this trend is partly accounted for by the steady increase in co ##hab ##itation .

reference_raw: This trend is partly explained by a steady increase in living conditions.

reference_spacy_tokens: This trend is partly explained by a steady increase in living conditions .


fn_spacy_tokens_for_baseline: It was a place to associate with bare - breasted maidens , the bohemian European artists of the thirties who immortalised them , floral garlands , towering cloud peaks .

source_bert_toks: it was a place to associate with bare - breast ##ed maiden ##s , the bohemian european artists of the thirties who immortal ##ised them , floral garland ##s , towering cloud peaks .

reference_raw: It was a place to associate with bare-breasted virgins, bohemian European artists of the 1930s who immortalized them, flowery garlands, towering peaks of cloud.

reference_spacy_tokens: It was a place to associate with bare - breasted virgins , bohemian European artists of the 1930s who immortalized them , flowery garlands , towering peaks of cloud .


fn_spacy_tokens_for_baseline: I was never more disappointed in anyone .

source_bert_toks: i was never more disappointed in anyone .

reference_raw: No one has ever let me down more.

reference_spacy_tokens: No one has ever let me down more .


fn_spacy_tokens_for_baseline: We passed through Tembladera , a scattering of houses clinging to the mountain side .

source_bert_toks: we passed through te ##mb ##lad ##era , a scattering of houses clinging to the mountain side .

reference_raw: We crossed Tembladera, a scattering of houses clinging to the side of the mountain.

reference_spacy_tokens: We crossed Tembladera , a scattering of houses clinging to the side of the mountain .


fn_spacy_tokens_for_baseline: My sense is for a simpler system .

source_bert_toks: my sense is for a simpler system .

reference_raw: I'm thinking of a simpler system.

reference_spacy_tokens: I 'm thinking of a simpler system .


fn_spacy_tokens_for_baseline: The alkaloid , thebaine , can be easily converted into codeine by demethylation .

source_bert_toks: the al ##kal ##oid , the ##bain ##e , can be easily converted into code ##ine by dem ##eth ##yla ##tion .

reference_raw: The alkaloid, thebaine, can easily be converted to codein by demethylation.

reference_spacy_tokens: The alkaloid , thebaine , can easily be converted to codein by demethylation .


fn_spacy_tokens_for_baseline: It is further claimed that these companies serve as a front for importing important chemical precursors and related equipment , which are then diverted to the Iranian CW program .

source_bert_toks: it is further claimed that these companies serve as a front for import ##ing important chemical precursor ##s and related equipment , which are then diverted to the iranian cw program .

reference_raw: It is also claimed that these companies serve as a cover for imports of important chemical precursors and related equipment which are subsequently transferred to the Iranian CW programme.

reference_spacy_tokens: It is also claimed that these companies serve as a cover for imports of important chemical precursors and related equipment which are subsequently transferred to the Iranian CW programme .


fn_spacy_tokens_for_baseline: Standing looking up at the east front , he knew that the Alpheus lay to the south , on his left , and the Cladeus flowed into it from his right .

source_bert_toks: standing looking up at the east front , he knew that the al ##pheus lay to the south , on his left , and the clade ##us flowed into it from his right .

reference_raw: He stood looking at the eastern front, and knew that the Alpheus lay to the north, to the left, and the Cladeus flowed into it from the right.

reference_spacy_tokens: He stood looking at the eastern front , and knew that the Alpheus lay to the north , to the left , and the Cladeus flowed into it from the right .


fn_spacy_tokens_for_baseline: Slowing to a crawl , Mortimer looked back , searching for Benny .

source_bert_toks: slowing to a crawl , mortimer looked back , searching for benny .

reference_raw: Mortimer slowed and looked back, looking for Benny.

reference_spacy_tokens: Mortimer slowed and looked back , looking for Benny .


fn_spacy_tokens_for_baseline: It covers two continents , concerns two groups of mysterious persons , and is further complicated by the highly respectable presence of our friend , Scott Eccles , whose inclusion shows me that the deceased Garcia had a scheming mind and a well - developed instinct of selfpreservation .

source_bert_toks: it covers two continents , concerns two groups of mysterious persons , and is further complicated by the highly respectable presence of our friend , scott ec ##cles , whose inclusion shows me that the deceased garcia had a sc ##hem ##ing mind and a well - developed instinct of self ##pres ##er ##vation .

reference_raw: It covers two mainlands, concerns two groups of mysterious people, and is further complicated by the highly respectable presence of our friend, Scott Eccles, whose inclusion shows me that the deceased Garcia had a scheming mind and a well-developed instinct for self-preservation.

reference_spacy_tokens: It covers two mainlands , concerns two groups of mysterious people , and is further complicated by the highly respectable presence of our friend , Scott Eccles , whose inclusion shows me that the deceased Garcia had a scheming mind and a well - developed instinct for self - preservation .


fn_spacy_tokens_for_baseline: Mr. Caring Philanthropy 01234 Giving Way Contribution , USA 56789

reference_raw: Mr. Caring Philanthropy 01234 Contribution to the Gayway, U.S. 56789

reference_spacy_tokens: Mr. Caring Philanthropy 01234 Contribution to the Gayway , U.S. 56789


fn_spacy_tokens_for_baseline: Is Chatterbox alone in thinking there is something strange and even disgusting about Stephanopoulos ' eager show of independence from the president ?

source_bert_toks: is chatter ##box alone in thinking there is something strange and even disgusting about stephan ##op ##oulos ' eager show of independence from the president ?

reference_raw: Is Chatterbox the only one who thinks that Stephanopoulos' eager display of independence from the President is odd, even repulsive?

reference_spacy_tokens: Is Chatterbox the only one who thinks that Stephanopoulos ' eager display of independence from the President is odd , even repulsive ?


fn_spacy_tokens_for_baseline: Both the representation of learning to write as a universal performance hierarchy , and the ordering of the specific items in Profiles of Development are at odds with such studies .

source_bert_toks: both the representation of learning to write as a universal performance hierarchy , and the ordering of the specific items in profiles of development are at odds with such studies .

reference_raw: Both the presentation of learning to write as a universal performance hierarchy and the ordering of specific items in the Profiles of Development run counter to these studies.

reference_spacy_tokens: Both the presentation of learning to write as a universal performance hierarchy and the ordering of specific items in the Profiles of Development run counter to these studies .


fn_spacy_tokens_for_baseline: Huggett ( 1976b ) also noted that the systems of the atoms - to - planet and the atoms - to - societies hierarchies commingle to produce a third hierarchy which is the hierarchy of environmental systems .

source_bert_toks: hug ##get ##t ( 1976 ##b ) also noted that the systems of the atoms - to - planet and the atoms - to - societies hi ##era ##rch ##ies com ##ming ##le to produce a third hierarchy which is the hierarchy of environmental systems .

reference_raw: Huggett (1976b) also pointed out that atom-to-planet systems and atom-to-society hierarchy are linked to the creation of a third hierarchy that is the hierarchy of environmental systems.

reference_spacy_tokens: Huggett ( 1976b ) also pointed out that atom - to - planet systems and atom - to - society hierarchy are linked to the creation of a third hierarchy that is the hierarchy of environmental systems .


fn_spacy_tokens_for_baseline: Notice that the extraction set is almost never the same as the denotation of the noun qualified .

source_bert_toks: notice that the extraction set is almost never the same as the den ##ota ##tion of the noun qualified .

reference_raw: Notice that the extraction kit is almost never the same as the designation of a noun qualified.

reference_spacy_tokens: Notice that the extraction kit is almost never the same as the designation of a noun qualified .


fn_spacy_tokens_for_baseline: Changing weather conditions also helped firefighting efforts , as temperature in the area fell to 90 degrees Fahrenheit , down from over a hundred degrees on Monday .

source_bert_toks: changing weather conditions also helped fire ##fighting efforts , as temperature in the area fell to 90 degrees fa ##hre ##nh ##eit , down from over a hundred degrees on monday .

reference_raw: The change in weather conditions also helped firefighting, as the temperature in the area dropped from more than 100 degrees on Monday to 90 degrees Fahrenheit.

reference_spacy_tokens: The change in weather conditions also helped firefighting , as the temperature in the area dropped from more than 100 degrees on Monday to 90 degrees Fahrenheit .


fn_spacy_tokens_for_baseline: ' I must congratulate you , Inspector , on handling so distinctive and instructive a case .

source_bert_toks: ' i must cong ##rat ##ulate you , inspector , on handling so distinctive and ins ##truct ##ive a case .

reference_raw: 'Congratulations, Inspector, for handling such a unique and instructive case.

reference_spacy_tokens: ' Congratulations , Inspector , for handling such a unique and instructive case .


fn_spacy_tokens_for_baseline: There is certainly some indication that the public perceives homosexual rape , particularly if perpetrated against a child , as an especially heinous offence .

source_bert_toks: there is certainly some indication that the public perceive ##s homosexual rape , particularly if per ##pet ##rated against a child , as an especially he ##ino ##us offence .

reference_raw: There is certainly some indication that the public perceives homosexual rape, especially when it is committed against a child, as a particularly gruesome crime.

reference_spacy_tokens: There is certainly some indication that the public perceives homosexual rape , especially when it is committed against a child , as a particularly gruesome crime .


fn_spacy_tokens_for_baseline: ' We are getting trainloads of rotten food - full of worms .

source_bert_toks: ' we are getting train ##load ##s of rotten food - full of worms .

reference_raw: 'We're getting a train full of rotten food - full of worms.

reference_spacy_tokens: ' We 're getting a train full of rotten food - full of worms .


fn_spacy_tokens_for_baseline: Members of the Ovens Action Group ( OAG ) claimed that they had followed a dumping truck from the Raybestos factory to the city dump , where the company had permission to dump non - toxic waste .

source_bert_toks: members of the oven ##s action group ( o ##ag ) claimed that they had followed a dumping truck from the ray ##bes ##tos factory to the city dump , where the company had permission to dump non - toxic waste .

reference_raw: Members of the Ovens Action Group (OAG) claimed to have followed the dumper from the Raybestos factory to the municipal landfill, where the company was authorised to dispose of non-toxic waste.

reference_spacy_tokens: Members of the Ovens Action Group ( OAG ) claimed to have followed the dumper from the Raybestos factory to the municipal landfill , where the company was authorised to dispose of non - toxic waste .


fn_spacy_tokens_for_baseline: All three of the participants in that clandestine meeting , looking back a few months later , were to recall the weather on that day as an omen -- a mirror of the tempestuous events which followed .

source_bert_toks: all three of the participants in that clandestine meeting , looking back a few months later , were to recall the weather on that day as an om ##en - - a mirror of the tempest ##uous events which followed .

reference_raw: All three of the participants in this secret meeting, looking back a few months later, would remember the weather that day as a sign - a mirror of the stormy events that followed.

reference_spacy_tokens: All three of the participants in this secret meeting , looking back a few months later , would remember the weather that day as a sign - a mirror of the stormy events that followed .


fn_spacy_tokens_for_baseline: On the other hand , Libya has declined to join the Chemical Weapons Convention , which was opened for signature in January 1993 and entered into force on April 29 , 1997 QN : Has Libya ratified the Chemical Weapons Convention ?

source_bert_toks: on the other hand , libya has declined to join the chemical weapons convention , which was opened for signature in january 1993 and entered into force on april 29 , 1997 q ##n : has libya ratified the chemical weapons convention ?

reference_raw: On the other hand, Libya refused to accede to the Chemical Weapons Convention, which was signed in January 1993 and entered into force on 29 April 1997 QN: Has Libya ratified the Chemical Weapons Convention?

reference_spacy_tokens: On the other hand , Libya refused to accede to the Chemical Weapons Convention , which was signed in January 1993 and entered into force on 29 April 1997 QN : Has Libya ratified the Chemical Weapons Convention ?


fn_spacy_tokens_for_baseline: The last term is the difference between the first two columns , not the more complex statistical measure .

source_bert_toks: the last term is the difference between the first two columns , not the more complex statistical measure .

reference_raw: The last term is a distinction between the first two columns, not a more complex statistical measure.

reference_spacy_tokens: The last term is a distinction between the first two columns , not a more complex statistical measure .


fn_spacy_tokens_for_baseline: 7- Safeguard AL - QAEDA 's general funds and do not mishandle these funds . ( Albukhairi ) 8- Sincerity in providing advice to commanders and to your brethren in AL - QAEDA , without harboring deception .

source_bert_toks: 7 - safeguard al - qaeda ' s general funds and do not mis ##hand ##le these funds . ( al ##bu ##kha ##iri ) 8 - sincerity in providing advice to commanders and to your brethren in al - qaeda , without harbor ##ing deception .

reference_raw: 7-Safeguard AL-QAEDA general funds and do not mishandle these funds. (Albukhairi) 8-Fairness to advise the commanders and your brothers in AL-QAEDA without concealing fraud.

reference_spacy_tokens: 7-Safeguard AL - QAEDA general funds and do not mishandle these funds . ( Albukhairi ) 8-Fairness to advise the commanders and your brothers in AL - QAEDA without concealing fraud .


fn_spacy_tokens_for_baseline: Among the ponds is one inhabited by turtles : Visitors toss in coins in the hope of bouncing one off a turtle 's head , a sure way of achieving good fortune .

source_bert_toks: among the ponds is one inhabited by turtles : visitors toss in coins in the hope of bouncing one off a turtle ' s head , a sure way of achieving good fortune .

reference_raw: There is one inhabited by tortoises among the ponds: Visitors throw coins in the hope of bouncing one off the head of a tortoise, a sure way to achieve happiness.

reference_spacy_tokens: There is one inhabited by tortoises among the ponds : Visitors throw coins in the hope of bouncing one off the head of a tortoise , a sure way to achieve happiness .


fn_spacy_tokens_for_baseline: The exhalation blots out my vision altogether .

source_bert_toks: the ex ##hala ##tion b ##lot ##s out my vision altogether .

reference_raw: The breath is a blur of my vision.

reference_spacy_tokens: The breath is a blur of my vision .


fn_spacy_tokens_for_baseline: Stephanopoulos skillfully bullies and cajoles him into keeping quiet .

source_bert_toks: stephan ##op ##oulos skill ##fully bull ##ies and ca ##jo ##les him into keeping quiet .

reference_raw: Stephanopoulos deftly bullies him and encourages him to keep his mouth shut.

reference_spacy_tokens: Stephanopoulos deftly bullies him and encourages him to keep his mouth shut .


fn_spacy_tokens_for_baseline: I have presented the papers I handed to them and they are very much Pleased with the paper 's I presented but the only thing that is still Keeping me here is the airport delivery Tag which is not placed on the Boxes , one of the Airport Authority has advise that we get the Delivery tag so that I can exit the airport immediately and make my Delivery successful .

source_bert_toks: i have presented the papers i handed to them and they are very much pleased with the paper ' s i presented but the only thing that is still keeping me here is the airport delivery tag which is not placed on the boxes , one of the airport authority has advise that we get the delivery tag so that i can exit the airport immediately and make my delivery successful .

reference_raw: I've presented the documents I've given them, and they're very happy with the documents I've presented, but the only thing that's keeping me here is an airport delivery tag that's not on the boxes, and one of the airport authorities has advised us to get a delivery tag so that I can leave the airport immediately and make my delivery successful.

reference_spacy_tokens: I 've presented the documents I 've given them , and they 're very happy with the documents I 've presented , but the only thing that 's keeping me here is an airport delivery tag that 's not on the boxes , and one of the airport authorities has advised us to get a delivery tag so that I can leave the airport immediately and make my delivery successful .


fn_spacy_tokens_for_baseline: The administrators are alleging that the company 's money was misappropriated and paid away for no benefit to the company .

source_bert_toks: the administrators are alleging that the company ' s money was mis ##app ##rop ##riated and paid away for no benefit to the company .

reference_raw: The trustees claim that the company's money was misused and paid to the company without any advantage.

reference_spacy_tokens: The trustees claim that the company 's money was misused and paid to the company without any advantage .


fn_spacy_tokens_for_baseline: The dogs follow the trail , so there is no problem , but it does mean that I miss seeing the sudden three metre drop that we go down to reach a frozen river .

source_bert_toks: the dogs follow the trail , so there is no problem , but it does mean that i miss seeing the sudden three metre drop that we go down to reach a frozen river .

reference_raw: Dogs follow the trail, so it's not a problem, but it means I miss seeing a sudden three-meter drop that we're going down to an icy river.

reference_spacy_tokens: Dogs follow the trail , so it 's not a problem , but it means I miss seeing a sudden three - meter drop that we 're going down to an icy river .


fn_spacy_tokens_for_baseline: The report mentions the sale of 58,000 gas masks by Shalon Chemical Industries after the Iran - Iraq War as well as the supply of gas detectors by Elbit for the identification of chemical warfare agents .

source_bert_toks: the report mentions the sale of 58 , 000 gas masks by sha ##lon chemical industries after the iran - iraq war as well as the supply of gas detectors by el ##bit for the identification of chemical warfare agents .

reference_raw: The report mentions the sale of 58,000 gas masks by Shalon Chemical Industries following the Iran-Iraq War and the delivery of gas detectors by Elbit to identify chemical warfare agents.

reference_spacy_tokens: The report mentions the sale of 58,000 gas masks by Shalon Chemical Industries following the Iran - Iraq War and the delivery of gas detectors by Elbit to identify chemical warfare agents .


fn_spacy_tokens_for_baseline: The word ' pornography ' was first coined in 1864 from the Greek root porne , meaning ' prostitute ' .

source_bert_toks: the word ' pornography ' was first coined in 1864 from the greek root porn ##e , meaning ' prostitute ' .

reference_raw: The word "pornography" first came out of Greek root porn in 1864, which means "prostitution."

reference_spacy_tokens: The word " pornography " first came out of Greek root porn in 1864 , which means " prostitution . "


fn_spacy_tokens_for_baseline: Once uncomfortably aboard the wizard moved his white - knuckle grip to a convenient piece of harness and prodded K!sdra lightly with the sword .

source_bert_toks: once uncomfortably aboard the wizard moved his white - kn ##uck ##le grip to a convenient piece of harness and pro ##dded k ! sd ##ra lightly with the sword .

reference_raw: As soon as he was uncomfortably on board, the wizard shifted his white-knuckled grip to a convenient piece of harness and prodded K!sdra lightly with his sword.

reference_spacy_tokens: As soon as he was uncomfortably on board , the wizard shifted his white - knuckled grip to a convenient piece of harness and prodded K!sdra lightly with his sword .


fn_spacy_tokens_for_baseline: I think that is why I welcomed doing a book -- it gives one the ability to use so much of what is left on the cutting room floor of daily journalism .

source_bert_toks: i think that is why i welcomed doing a book - - it gives one the ability to use so much of what is left on the cutting room floor of daily journalism .

reference_raw: I think that's why I welcomed writing a book -- it gives you the ability to use so much of what's left on the floor of everyday journalism.

reference_spacy_tokens: I think that 's why I welcomed writing a book -- it gives you the ability to use so much of what 's left on the floor of everyday journalism .


fn_spacy_tokens_for_baseline: Anna , exhausted by all she was trying to do , plummeted from fury to weeping .

source_bert_toks: anna , exhausted by all she was trying to do , plum ##met ##ed from fury to weeping .

reference_raw: Exhausted by what she was trying to do, Anna fell from anger to tears.

reference_spacy_tokens: Exhausted by what she was trying to do , Anna fell from anger to tears .


fn_spacy_tokens_for_baseline: ' And the health benefits of getting into shape are immeasurable . '

source_bert_toks: ' and the health benefits of getting into shape are im ##me ##asurable . '

reference_raw: "And the health benefits of getting in shape are immense."

reference_spacy_tokens: " And the health benefits of getting in shape are immense . "


fn_spacy_tokens_for_baseline: Mr Braithwaite drained off his lime squash and added a couple of jiggers of rum to his empty glass .

source_bert_toks: mr bra ##ith ##waite drained off his lime squash and added a couple of ji ##gger ##s of rum to his empty glass .

reference_raw: Mr. Braithwaite drained the lime squash and added a few jigs of rum to the empty glass.

reference_spacy_tokens: Mr. Braithwaite drained the lime squash and added a few jigs of rum to the empty glass .


fn_spacy_tokens_for_baseline: Her hankering for the outside world is shown through a solo where she is cruelly tangled in the legs of a chair .

source_bert_toks: her hank ##ering for the outside world is shown through a solo where she is cruel ##ly tangled in the legs of a chair .

reference_raw: Her bowing to the outside world is shown by a solo where she's brutally tangled in the legs of a chair.

reference_spacy_tokens: Her bowing to the outside world is shown by a solo where she 's brutally tangled in the legs of a chair .


fn_spacy_tokens_for_baseline: People will not be kidded that easily .

source_bert_toks: people will not be kidd ##ed that easily .

reference_raw: People can't be fooled that easily.

reference_spacy_tokens: People ca n't be fooled that easily .


fn_spacy_tokens_for_baseline: ' And ? ' said John , surprised that the usually articulate Comfort should phrase her approval in such pedestrian words .

source_bert_toks: ' and ? ' said john , surprised that the usually art ##iculate comfort should phrase her approval in such pedestrian words .

reference_raw: 'And?' said John, surprised that the normally articulated Comfort would put her approval in such pedestrian words.

reference_spacy_tokens: ' And ? ' said John , surprised that the normally articulated Comfort would put her approval in such pedestrian words .


fn_spacy_tokens_for_baseline: It was fortunate indeed that we had put him in a cell with another person .

source_bert_toks: it was fortunate indeed that we had put him in a cell with another person .

reference_raw: We were lucky to have put him in a cell with someone else.

reference_spacy_tokens: We were lucky to have put him in a cell with someone else .


fn_spacy_tokens_for_baseline: Hall , an Ohio Democrat and one of very few U.S. congressmen to visit Iraq since the 1991 Gulf War over Kuwait , is scheduled to embark Sunday the 12-hour overland trip to the Iraqi capital , Baghdad .

source_bert_toks: hall , an ohio democrat and one of very few u . s . congress ##men to visit iraq since the 1991 gulf war over kuwait , is scheduled to embark sunday the 12 - hour overland trip to the iraqi capital , baghdad .

reference_raw: Hall, the Ohio Democrat and one of the few congressmen in the United States to visit Iraq since the Gulf War of 1991 over Kuwait, is scheduled to take a 12-hour trip to the Iraqi capital of Baghdad on Sunday.

reference_spacy_tokens: Hall , the Ohio Democrat and one of the few congressmen in the United States to visit Iraq since the Gulf War of 1991 over Kuwait , is scheduled to take a 12-hour trip to the Iraqi capital of Baghdad on Sunday .


fn_spacy_tokens_for_baseline: All was well at first , but when she calved it was another story .

source_bert_toks: all was well at first , but when she cal ##ved it was another story .

reference_raw: At first everything was fine, but when she calmed, it was a different story.

reference_spacy_tokens: At first everything was fine , but when she calmed , it was a different story .


fn_spacy_tokens_for_baseline: Two primitive truck trails run through the fire area , but were considered too dangerous for use by traditional firefighting equipment .

source_bert_toks: two primitive truck trails run through the fire area , but were considered too dangerous for use by traditional fire ##fighting equipment .

reference_raw: Two primitive trails of trucks pass through the fire zone, but they were considered too dangerous to use traditional fire-fighting equipment.

reference_spacy_tokens: Two primitive trails of trucks pass through the fire zone , but they were considered too dangerous to use traditional fire - fighting equipment .


fn_spacy_tokens_for_baseline: Benny and Mortimer immediately launched themselves from the bushes , the rest of the Marines following , firing at any worshipper who had a weapon .

source_bert_toks: benny and mortimer immediately launched themselves from the bushes , the rest of the marines following , firing at any worship ##per who had a weapon .

reference_raw: Benny and Mortimer jumped out of the bushes at once, and the other Marines followed, firing at every worshipper with a gun.

reference_spacy_tokens: Benny and Mortimer jumped out of the bushes at once , and the other Marines followed , firing at every worshipper with a gun .


fn_spacy_tokens_for_baseline: Initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

source_bert_toks: initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

reference_raw: The first call said there were a lot of animals in the house, and the firemen were working fast to save all the cats and dogs.

reference_spacy_tokens: The first call said there were a lot of animals in the house , and the firemen were working fast to save all the cats and dogs .


fn_spacy_tokens_for_baseline: Far more progressive than the Archaics , the Anasazi utilized such formal agricultural techniques as irrigation to assist their harvest .

source_bert_toks: far more progressive than the archaic ##s , the ana ##sa ##zi utilized such formal agricultural techniques as irrigation to assist their harvest .

reference_raw: Far more advanced than the archaics, the Anasazi used such formal farming methods as irrigation to help them harvest.

reference_spacy_tokens: Far more advanced than the archaics , the Anasazi used such formal farming methods as irrigation to help them harvest .


fn_spacy_tokens_for_baseline: Tentatively , she let her fingertips graze against his skin .

source_bert_toks: tentatively , she let her fingertips graz ##e against his skin .

reference_raw: She let her fingers touch his skin tentatively.

reference_spacy_tokens: She let her fingers touch his skin tentatively .


fn_spacy_tokens_for_baseline: Many easterners are still not convinced by the virtues of unfettered markets , and only a handful were in any active sense dissenters under the previous regime .

source_bert_toks: many eastern ##ers are still not convinced by the virtues of un ##fe ##ttered markets , and only a handful were in any active sense dissent ##ers under the previous regime .

reference_raw: Many Easterners are still unconvinced by the virtues of unrestricted markets, and few of them have actively opposed the previous regime.

reference_spacy_tokens: Many Easterners are still unconvinced by the virtues of unrestricted markets , and few of them have actively opposed the previous regime .


fn_spacy_tokens_for_baseline: Along this elegant avenue is Government House , a modest pink palace .

source_bert_toks: along this elegant avenue is government house , a modest pink palace .

reference_raw: There's a government house on this graceful street, a modest pink palace.

reference_spacy_tokens: There 's a government house on this graceful street , a modest pink palace .


fn_spacy_tokens_for_baseline: The chair behind her knees scraped on the floor with a raucous metallic sound , and she winced .

source_bert_toks: the chair behind her knees scraped on the floor with a ra ##uc ##ous metallic sound , and she winced .

reference_raw: The chair behind her knees scratched the floor with a raucous metallic sound, and she winced.

reference_spacy_tokens: The chair behind her knees scratched the floor with a raucous metallic sound , and she winced .


fn_spacy_tokens_for_baseline: In six tests for the Wallabies since the World Cup final his success ratio has dipped below 50 per cent .

source_bert_toks: in six tests for the wall ##abi ##es since the world cup final his success ratio has dipped below 50 per cent .

reference_raw: In six tests for the Wallabies since the World Cup, his success rate has dropped below 50 percent.

reference_spacy_tokens: In six tests for the Wallabies since the World Cup , his success rate has dropped below 50 percent .


fn_spacy_tokens_for_baseline: I knew it was n't healthy or good for me to spend so many hours thinking about eating and cooking up plans for new diets or exercise programmes .

source_bert_toks: i knew it wasn ' t healthy or good for me to spend so many hours thinking about eating and cooking up plans for new diet ##s or exercise programmes .

reference_raw: I knew it was neither healthy nor good for me to spend so many hours thinking about eating and making plans for a new diet or exercise program.

reference_spacy_tokens: I knew it was neither healthy nor good for me to spend so many hours thinking about eating and making plans for a new diet or exercise program .


fn_spacy_tokens_for_baseline: They put the device on 200 pennants suspended from utility poles , and paint it directly on crosswalks in the downtown area .

source_bert_toks: they put the device on 200 pennant ##s suspended from utility poles , and paint it directly on cross ##walk ##s in the downtown area .

reference_raw: They put the device on 200 pennants suspended from utility poles and painted it directly on the intersections in the center of the city.

reference_spacy_tokens: They put the device on 200 pennants suspended from utility poles and painted it directly on the intersections in the center of the city .


fn_spacy_tokens_for_baseline: Second , correct me if I 'm wrong , but in the excellent John Stoddart picture he 's wearing foundation and eyeliner , but apart from that absolutely no make - up at all .

source_bert_toks: second , correct me if i ' m wrong , but in the excellent john st ##od ##dar ##t picture he ' s wearing foundation and eye ##liner , but apart from that absolutely no make - up at all .

reference_raw: Second of all, correct me if I'm wrong, but in the brilliant picture of John Stoddart, he's wearing a base and an eye liner, but apart from the fact that there's absolutely no make-up.

reference_spacy_tokens: Second of all , correct me if I 'm wrong , but in the brilliant picture of John Stoddart , he 's wearing a base and an eye liner , but apart from the fact that there 's absolutely no make - up .


fn_spacy_tokens_for_baseline: However , young and old , stranger and Dubliner rub shoulders quite happily .

source_bert_toks: however , young and old , stranger and dublin ##er rub shoulders quite happily .

reference_raw: But the young and the old, the stranger and the Dubliner rub each other's shoulders in a happy way.

reference_spacy_tokens: But the young and the old , the stranger and the Dubliner rub each other 's shoulders in a happy way .


fn_spacy_tokens_for_baseline: The curved and shadowed drive led us to a low , dark house , pitchblack against a slate - coloured sky .

source_bert_toks: the curved and shadowed drive led us to a low , dark house , pitch ##bla ##ck against a slate - coloured sky .

reference_raw: The curved and shadowed drive led us to a small, dark house, black against the slate-colored sky.

reference_spacy_tokens: The curved and shadowed drive led us to a small , dark house , black against the slate - colored sky .


fn_spacy_tokens_for_baseline: The Waitrose champagne is of the ' 83 vintage ; it has a glorious style of its own , light yet biscuity , classy with the muted perfume of hollyhocks and it makes a superb apertif .

source_bert_toks: the wait ##rose champagne is of the ' 83 vintage ; it has a glorious style of its own , light yet bis ##cuit ##y , class ##y with the muted perfume of holly ##ho ##cks and it makes a superb ape ##rti ##f .

reference_raw: The Waitrose Champagne is from the '83 vintage; it has its own beautiful style, light but biscuity, classy with the muffled fragrance of the Hollyhocks, and it makes an excellent apertif.

reference_spacy_tokens: The Waitrose Champagne is from the ' 83 vintage ; it has its own beautiful style , light but biscuity , classy with the muffled fragrance of the Hollyhocks , and it makes an excellent apertif .


fn_spacy_tokens_for_baseline: Early in the film , with the Flowers crisis in full bloom , Sam Donaldson interviews Stephanopoulos , who blames it all on the " Republican attack machine . "

source_bert_toks: early in the film , with the flowers crisis in full bloom , sam donaldson interviews stephan ##op ##oulos , who blame ##s it all on the " republican attack machine . "

reference_raw: At the beginning of the movie, when the Flowers crisis is in full bloom, Sam Donaldson interviews Stephanopoulos, who accuses everything of the Republican attack machine.

reference_spacy_tokens: At the beginning of the movie , when the Flowers crisis is in full bloom , Sam Donaldson interviews Stephanopoulos , who accuses everything of the Republican attack machine .


fn_spacy_tokens_for_baseline: How did experienced radio and TV people of both genders turn into Valley Girls , and do you know where this annoying development came from ?

source_bert_toks: how did experienced radio and tv people of both gender ##s turn into valley girls , and do you know where this annoying development came from ?

reference_raw: How did experienced radio and television people of both sexes turn into Valley Girls, and you know where that annoying evolution came from?

reference_spacy_tokens: How did experienced radio and television people of both sexes turn into Valley Girls , and you know where that annoying evolution came from ?


fn_spacy_tokens_for_baseline: The beck trickles into the main street in the Market Place .

source_bert_toks: the beck trickle ##s into the main street in the market place .

reference_raw: The signal runs down the main street at Market Place.

reference_spacy_tokens: The signal runs down the main street at Market Place .


fn_spacy_tokens_for_baseline: I know the spreadsheet is a working tool , but I hate having to use 1 - 2 - 3 and its clones -- so many key combinations to remember .

source_bert_toks: i know the spreads ##hee ##t is a working tool , but i hate having to use 1 - 2 - 3 and its clones - - so many key combinations to remember .

reference_raw: I know the table is a working tool, but I don't like the use of 1-2-3 and its clons - so many key combinations that I can remember.

reference_spacy_tokens: I know the table is a working tool , but I do n't like the use of 1 - 2 - 3 and its clons - so many key combinations that I can remember .


fn_spacy_tokens_for_baseline: Other groups have acquired a pathogen or toxin and have been motivated to use it , but were penetrated by law enforcement or exposed by defectors before the attack could be carried out .

source_bert_toks: other groups have acquired a pathogen or toxin and have been motivated to use it , but were penetrated by law enforcement or exposed by defect ##ors before the attack could be carried out .

reference_raw: Other groups acquired pathogens or toxins and were encouraged to use them, but were infiltrated by the police or exposed by defectors before the attack could take place.

reference_spacy_tokens: Other groups acquired pathogens or toxins and were encouraged to use them , but were infiltrated by the police or exposed by defectors before the attack could take place .


fn_spacy_tokens_for_baseline: The quaint Taipa Village , with its narrow lanes and colonial buildings painted yellow , blue , and green , has almost been completely swallowed up by the development of nearby housing projects .

source_bert_toks: the qu ##aint tai ##pa village , with its narrow lanes and colonial buildings painted yellow , blue , and green , has almost been completely swallowed up by the development of nearby housing projects .

reference_raw: The quaint Taipa village, with its narrow lanes and colonial buildings painted yellow, blue, and blue, was almost completely absorbed by the development of nearby housing projects.

reference_spacy_tokens: The quaint Taipa village , with its narrow lanes and colonial buildings painted yellow , blue , and blue , was almost completely absorbed by the development of nearby housing projects .


fn_spacy_tokens_for_baseline: I think you should try to get a table up there , or at least fix a leg on that one .

source_bert_toks: i think you should try to get a table up there , or at least fix a leg on that one .

reference_raw: You should try getting a table up there, or at least put your foot on it.

reference_spacy_tokens: You should try getting a table up there , or at least put your foot on it .


fn_spacy_tokens_for_baseline: The " Hsin Chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a reprocessing research laboratory , and a plutonium separation plant .

source_bert_toks: the " hs ##in chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a rep ##ro ##ces ##sing research laboratory , and a pluto ##nium separation plant .

reference_raw: The Hsin Chu programme included the procurement and operation of a heavy-water reactor, a heavy-water plant, a reprocessing research lab, and a plutonium separation plant.

reference_spacy_tokens: The Hsin Chu programme included the procurement and operation of a heavy - water reactor , a heavy - water plant , a reprocessing research lab , and a plutonium separation plant .


fn_spacy_tokens_for_baseline: Just then several swans began flapping their wings and hissing .

source_bert_toks: just then several swans began flap ##ping their wings and hissing .

reference_raw: At that moment a few swans began to flutter their wings and hiss.

reference_spacy_tokens: At that moment a few swans began to flutter their wings and hiss .


fn_spacy_tokens_for_baseline: He was well known in the Formby area and his death stunned the local community .

source_bert_toks: he was well known in the form ##by area and his death stunned the local community .

reference_raw: He was well known in the Formby region, and his death was a shock to the local community.

reference_spacy_tokens: He was well known in the Formby region , and his death was a shock to the local community .


fn_spacy_tokens_for_baseline: The cottage is essentially of the seventeenth century , but was restored in 1800 and greatly enlarged during the second half of the nineteenth century

source_bert_toks: the cottage is essentially of the seventeenth century , but was restored in 1800 and greatly enlarged during the second half of the nineteenth century

reference_raw: The house is essentially from the seventeenth century, but it was restored in 1800 and significantly expanded in the second half of the nineteenth century.

reference_spacy_tokens: The house is essentially from the seventeenth century , but it was restored in 1800 and significantly expanded in the second half of the nineteenth century .


fn_spacy_tokens_for_baseline: She stood stock - still , panting , listening to the harsh rasp of her own breathing .

source_bert_toks: she stood stock - still , panting , listening to the harsh ras ##p of her own breathing .

reference_raw: She stood stock-still, panting, listening to the harsh whine of her own breath.

reference_spacy_tokens: She stood stock - still , panting , listening to the harsh whine of her own breath .


fn_spacy_tokens_for_baseline: Hir stomach contracted so fiercely , SHe nearly threw up .

source_bert_toks: hi ##r stomach contracted so fiercely , she nearly threw up .

reference_raw: His stomach contracted so violently that she almost vomited.

reference_spacy_tokens: His stomach contracted so violently that she almost vomited .


fn_spacy_tokens_for_baseline: Just as with word processing type can be set flush with the left - hand margin , centred or justified .

source_bert_toks: just as with word processing type can be set flush with the left - hand margin , centred or justified .

reference_raw: As with the word processing type, it is possible to set the flush with the left-hand margin, centered or warranted.

reference_spacy_tokens: As with the word processing type , it is possible to set the flush with the left - hand margin , centered or warranted .


fn_spacy_tokens_for_baseline: The Random House general book division will be divided into two operating groups , allowing editors to see their authors ' books through from hardback to paperback publication ( or to choose which they find most appropriate ) .

source_bert_toks: the random house general book division will be divided into two operating groups , allowing editors to see their authors ' books through from hard ##back to paperback publication ( or to choose which they find most appropriate ) .

reference_raw: The Random House General Book Division will be divided into two operating groups, which will allow editors to view the books of their authors from a hard-back to a paperback publication (or to choose which one they consider most appropriate).

reference_spacy_tokens: The Random House General Book Division will be divided into two operating groups , which will allow editors to view the books of their authors from a hard - back to a paperback publication ( or to choose which one they consider most appropriate ) .


fn_spacy_tokens_for_baseline: Unable to replicate the agricultural techniques of the Anasazi , the Paiutes were destined to a semi - nomadic lifestyle until European settlers arrived , changing the nature of existence in the valley forever .

source_bert_toks: unable to replicate the agricultural techniques of the ana ##sa ##zi , the pa ##iu ##tes were destined to a semi - nomadic lifestyle until european settlers arrived , changing the nature of existence in the valley forever .

reference_raw: The Paiutes, unable to replicate the farming techniques of the Anasazi, were destined for a semi-nomadic lifestyle before the European settlers arrived and changed the nature of life in the valley forever.

reference_spacy_tokens: The Paiutes , unable to replicate the farming techniques of the Anasazi , were destined for a semi - nomadic lifestyle before the European settlers arrived and changed the nature of life in the valley forever .


fn_spacy_tokens_for_baseline: More recently , South Africa began working more closely with the IAEA in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a South African businessman exposed connections to the A.Q. Khan network .

source_bert_toks: more recently , south africa began working more closely with the ia ##ea in 2004 , in order to monitor international smuggling of nuclear weapons materials , after investigations of a south african businessman exposed connections to the a . q . khan network .

reference_raw: Recently, South Africa started to work more closely with the IAEA in 2004 to monitor the international smuggling of nuclear weapons materials, following an investigation into a South African businessman who exposed contact with the A.Q. Khan network.

reference_spacy_tokens: Recently , South Africa started to work more closely with the IAEA in 2004 to monitor the international smuggling of nuclear weapons materials , following an investigation into a South African businessman who exposed contact with the A.Q. Khan network .


fn_spacy_tokens_for_baseline: It was in back of a pick- up .

source_bert_toks: it was in back of a pick - up .

reference_raw: It was behind the pickup.

reference_spacy_tokens: It was behind the pickup .


fn_spacy_tokens_for_baseline: Digital watches work because a small sliver of quartz inside them pulses at a rhythmic and unchanging frequency , which is stimulated by energy from the battery .

source_bert_toks: digital watches work because a small sl ##iver of quartz inside them pulses at a rhythmic and un ##chang ##ing frequency , which is stimulated by energy from the battery .

reference_raw: Digital watches work because a small fraction of quartz inside them is pulsing at a rhythmic and constant frequency that is stimulated by the battery's energy.

reference_spacy_tokens: Digital watches work because a small fraction of quartz inside them is pulsing at a rhythmic and constant frequency that is stimulated by the battery 's energy .


fn_spacy_tokens_for_baseline: I mean there are so many just major major serial murders and it 's not just like one instance or something it 's just , uh , horrifying some of the murders that go on .

source_bert_toks: i mean there are so many just major major serial murders and it ' s not just like one instance or something it ' s just , uh , ho ##rri ##fying some of the murders that go on .

reference_raw: I mean, there's a lot of big serial murders, and it's not just one case or something, it's just, uh, it's scary about some of the killings that happen.

reference_spacy_tokens: I mean , there 's a lot of big serial murders , and it 's not just one case or something , it 's just , uh , it 's scary about some of the killings that happen .


fn_spacy_tokens_for_baseline: The Community would monitor Hungary 's programme to restructure its economy on more market - oriented lines , and disburse the second and third tranches of the money only if satisfied about progress .

source_bert_toks: the community would monitor hungary ' s programme to rest ##ru ##cture its economy on more market - oriented lines , and di ##sb ##urse the second and third tran ##ches of the money only if satisfied about progress .

reference_raw: The Commission will monitor Hungary's economic restructuring programme on more market-oriented routes and will only pay the second and third instalments of the money if it is satisfied with progress.

reference_spacy_tokens: The Commission will monitor Hungary 's economic restructuring programme on more market - oriented routes and will only pay the second and third instalments of the money if it is satisfied with progress .


fn_spacy_tokens_for_baseline: Example 5 shows the true dominance of the perfect fourth ; the set created is a ten - note set derived by stacking fourths .

source_bert_toks: example 5 shows the true dominance of the perfect fourth ; the set created is a ten - note set derived by stack ##ing fourth ##s .

reference_raw: Example 5 shows the actual dominance of the perfect fourth; the set created is a set of ten notes derived from the stacking of fours.

reference_spacy_tokens: Example 5 shows the actual dominance of the perfect fourth ; the set created is a set of ten notes derived from the stacking of fours .


fn_spacy_tokens_for_baseline: Take the coin and wet it with water , and then press it against the victim 's head for a short time ' to get it to stick ' .

source_bert_toks: take the coin and wet it with water , and then press it against the victim ' s head for a short time ' to get it to stick ' .

reference_raw: Take the coin, soak it with water, and then press it on the victim's head for a little while, "to make it stick."

reference_spacy_tokens: Take the coin , soak it with water , and then press it on the victim 's head for a little while , " to make it stick . "


fn_spacy_tokens_for_baseline: Mrs Helmsley was found guilty after a trial replete with tales of how she bawled out employees and charged $ 12 department store brassieres to her hotel .

source_bert_toks: mrs helm ##sley was found guilty after a trial rep ##lete with tales of how she ba ##wled out employees and charged $ 12 department store brass ##iere ##s to her hotel .

reference_raw: Mrs. Helmsley was found guilty after a trial replenishment of stories about how she bawled employees and charged her hotel with $12 store bras.

reference_spacy_tokens: Mrs. Helmsley was found guilty after a trial replenishment of stories about how she bawled employees and charged her hotel with $ 12 store bras .


fn_spacy_tokens_for_baseline: For the sake of clarity , it is important to analyse what role electoral reform could have played , and did play , in the election campaign .

source_bert_toks: for the sake of clarity , it is important to anal ##yse what role electoral reform could have played , and did play , in the election campaign .

reference_raw: For the sake of clarity, an analysis of the role that electoral reform could have played and played in the election campaign should be carried out.

reference_spacy_tokens: For the sake of clarity , an analysis of the role that electoral reform could have played and played in the election campaign should be carried out .


fn_spacy_tokens_for_baseline: Once the milk has clotted and the cheese - maker is satisfied that it has set firmly enough , the curd is cut by hand , using large metal paddles .

source_bert_toks: once the milk has cl ##otted and the cheese - maker is satisfied that it has set firmly enough , the cu ##rd is cut by hand , using large metal paddle ##s .

reference_raw: Once the milk has coagulated and the cheese maker is satisfied that it is firmly fixed, the curd is sliced manually using large metal paddles.

reference_spacy_tokens: Once the milk has coagulated and the cheese maker is satisfied that it is firmly fixed , the curd is sliced manually using large metal paddles .


fn_spacy_tokens_for_baseline: In Europe , where music fans are usually more broad - minded , people in their thirties and forties often attend Wedding Present gigs .

source_bert_toks: in europe , where music fans are usually more broad - minded , people in their thirties and fort ##ies often attend wedding present gigs .

reference_raw: In Europe, where music fans are usually more general, people in their 30s and 40s often attend wedding present concerts.

reference_spacy_tokens: In Europe , where music fans are usually more general , people in their 30s and 40s often attend wedding present concerts .


fn_spacy_tokens_for_baseline: The Act contains no provisions permitting retirement specifically on the grounds of old age or ill health or for the expulsion of miscreant or unwanted partners .

source_bert_toks: the act contains no provisions permitting retirement specifically on the grounds of old age or ill health or for the expulsion of mis ##cre ##ant or unwanted partners .

reference_raw: The law does not contain any provision which specifically authorises retirement on grounds of old age or ill health or the expulsion of rogue or unwanted partners.

reference_spacy_tokens: The law does not contain any provision which specifically authorises retirement on grounds of old age or ill health or the expulsion of rogue or unwanted partners .


fn_spacy_tokens_for_baseline: STEPHEN HENDRY last night advanced to the last eight of the Humo European Open in Antwerp with a narrow 5 - 4 victory over Dennis Taylor .

source_bert_toks: stephen hen ##dry last night advanced to the last eight of the hum ##o european open in antwerp with a narrow 5 - 4 victory over dennis taylor .

reference_raw: Last night, STEPHEN HENDRY moved to the last eight Humo European Opens in Antwerp with a tight 5-4 victory over Dennis Taylor.

reference_spacy_tokens: Last night , STEPHEN HENDRY moved to the last eight Humo European Opens in Antwerp with a tight 5 - 4 victory over Dennis Taylor .


fn_spacy_tokens_for_baseline: Stunned pilgrims remained crouched in alleys and ditches .

source_bert_toks: stunned pilgrims remained crouched in alley ##s and ditch ##es .

reference_raw: The stunned pilgrims remained huddled in the alleys and trenches.

reference_spacy_tokens: The stunned pilgrims remained huddled in the alleys and trenches .


fn_spacy_tokens_for_baseline: People catching buses were advised to expect long delays .

source_bert_toks: people catching buses were advised to expect long delays .

reference_raw: People who catch buses have been advised to expect a long time late.

reference_spacy_tokens: People who catch buses have been advised to expect a long time late .


fn_spacy_tokens_for_baseline: No one believed him guilty of financial dishonesty but the governor , John Elphinstone ( thirteenth Baron Elphinstone , q.v . ) , demanded restitution of the money .

source_bert_toks: no one believed him guilty of financial dish ##ones ##ty but the governor , john el ##phi ##nst ##one ( thirteenth baron el ##phi ##nst ##one , q . v . ) , demanded rest ##it ##ution of the money .

reference_raw: No one believed him to be responsible for financial dishonesty, but Governor John Elphinstone (the 13th Baron Elphinstone, q.v.) demanded that the money be returned.

reference_spacy_tokens: No one believed him to be responsible for financial dishonesty , but Governor John Elphinstone ( the 13th Baron Elphinstone , q.v . ) demanded that the money be returned .


fn_spacy_tokens_for_baseline: Angelina ran forward and knelt over him .

source_bert_toks: angelina ran forward and knelt over him .

reference_raw: Angelina ran forward and dropped to her knees.

reference_spacy_tokens: Angelina ran forward and dropped to her knees .


fn_spacy_tokens_for_baseline: it 's just about dark and Harriet 's hair flies out and glimmers as she moves her head .

source_bert_toks: it ' s just about dark and harriet ' s hair flies out and g ##lim ##mers as she moves her head .

reference_raw: It's almost dark, and Harriet's hair goes out and flashes as she moves her head.

reference_spacy_tokens: It 's almost dark , and Harriet 's hair goes out and flashes as she moves her head .


fn_spacy_tokens_for_baseline: In a roomful of thin boys one fat boy is odd man out .

source_bert_toks: in a room ##ful of thin boys one fat boy is odd man out .

reference_raw: There's a fat boy out there in a room full of thin boys.

reference_spacy_tokens: There 's a fat boy out there in a room full of thin boys .


fn_spacy_tokens_for_baseline: She was born , and christened Roberta Anne Penrose , in Melbourne , Australia , nearly thirty - three years ago , but left that country at the age of five to accompany her parents to England .

source_bert_toks: she was born , and christ ##ened roberta anne pen ##rose , in melbourne , australia , nearly thirty - three years ago , but left that country at the age of five to accompany her parents to england .

reference_raw: She was born and baptized Roberta Anne Penrose in Melbourne, Australia, almost thirty-three years ago, but she left the country when she was five to accompany her parents to England.

reference_spacy_tokens: She was born and baptized Roberta Anne Penrose in Melbourne , Australia , almost thirty - three years ago , but she left the country when she was five to accompany her parents to England .


fn_spacy_tokens_for_baseline: " Rhode Island is preparing itself for a major hurricane or other natural disaster , state and local officials testified at a field hearing of the Senate Homeland Security Committee Thursday , including establishing interoperable communications systems and community evacuation plans .

source_bert_toks: " rhode island is preparing itself for a major hurricane or other natural disaster , state and local officials testified at a field hearing of the senate homeland security committee thursday , including establishing inter ##oper ##able communications systems and community evacuation plans .

reference_raw: "Rhode Island is preparing for a major hurricane or other natural disaster, state and local officials testified in a field hearing of the Senate National Security Committee on Thursday, including the setting up of interoperable communication systems and community evacuation plans.

reference_spacy_tokens: " Rhode Island is preparing for a major hurricane or other natural disaster , state and local officials testified in a field hearing of the Senate National Security Committee on Thursday , including the setting up of interoperable communication systems and community evacuation plans .


fn_spacy_tokens_for_baseline: The speaker scraped and clicked a few more times , but after half a minute of no reply the phone was rehooked .

source_bert_toks: the speaker scraped and clicked a few more times , but after half a minute of no reply the phone was re ##ho ##oked .

reference_raw: The loudspeaker scratched and clicked again, but after half a minute of no response, the phone was rehooked.

reference_spacy_tokens: The loudspeaker scratched and clicked again , but after half a minute of no response , the phone was rehooked .


fn_spacy_tokens_for_baseline: In September 1999 , Pyongyang agreed to a moratorium on missile flight tests and later announced that it would maintain the moratorium until at least 2003 .

source_bert_toks: in september 1999 , p ##yon ##gy ##ang agreed to a mora ##torium on missile flight tests and later announced that it would maintain the mora ##torium until at least 2003 .

reference_raw: In September 1999, Pyongyang agreed to a moratorium on rocket tests and later announced that it would maintain the moratorium until at least 2003.

reference_spacy_tokens: In September 1999 , Pyongyang agreed to a moratorium on rocket tests and later announced that it would maintain the moratorium until at least 2003 .


fn_spacy_tokens_for_baseline: She giggled and then began to laugh .

source_bert_toks: she giggled and then began to laugh .

reference_raw: She laughed, then laughed.

reference_spacy_tokens: She laughed , then laughed .


fn_spacy_tokens_for_baseline: SHARE prices weakened sharply after a sound start based on the overnight strength of Wall Street and the FT - SE 100-Share Index swung through nearly 40 points .

source_bert_toks: share prices weakened sharply after a sound start based on the overnight strength of wall street and the ft - se 100 - share index swung through nearly 40 points .

reference_raw: SHARE prices fell sharply after a sound start based on the overnight strength of Wall Street and the FT-SE 100-share index went up almost 40 points.

reference_spacy_tokens: SHARE prices fell sharply after a sound start based on the overnight strength of Wall Street and the FT - SE 100-share index went up almost 40 points .


fn_spacy_tokens_for_baseline: It still revels in its own identity , which is now internationally recognized through such influential cultural products as the Rastafarian religion and reggae music .

source_bert_toks: it still rev ##els in its own identity , which is now internationally recognized through such influential cultural products as the ras ##ta ##far ##ian religion and reggae music .

reference_raw: It is still reveling in its own identity, which is now at international level recognised by such powerful cultural products as the Rastafarian religion and reggae music.

reference_spacy_tokens: It is still reveling in its own identity , which is now at international level recognised by such powerful cultural products as the Rastafarian religion and reggae music .


fn_spacy_tokens_for_baseline: If he so much as bruises a finger without good reason , I 'll come for you .

source_bert_toks: if he so much as bruises a finger without good reason , i ' ll come for you .

reference_raw: If he hurts a finger for no good reason, I'll come get you.

reference_spacy_tokens: If he hurts a finger for no good reason , I 'll come get you .


fn_spacy_tokens_for_baseline: A piece of shrapnel hit her helmet when six mortar bombs rained down outside the BBC 's base near the UN headquarters in Sarajevo .

source_bert_toks: a piece of sh ##ra ##p ##nel hit her helmet when six mortar bombs rained down outside the bbc ' s base near the un headquarters in sarajevo .

reference_raw: A piece of shrapnel struck her helmet as six mortar bombs fell outside the BBC base near the U.N. headquarters in Sarajevo.

reference_spacy_tokens: A piece of shrapnel struck her helmet as six mortar bombs fell outside the BBC base near the U.N. headquarters in Sarajevo .


fn_spacy_tokens_for_baseline: Walk west along Hollywood Road until you come to Man Mo Temple , the island 's oldest house of worship ( though the date of its founding is subject to dispute ) .

source_bert_toks: walk west along hollywood road until you come to man mo temple , the island ' s oldest house of worship ( though the date of its founding is subject to dispute ) .

reference_raw: Walk west along Hollywood Road until you reach the Temple of Man Mo, the oldest home of worship on the island (though the date of its founding is disputed).

reference_spacy_tokens: Walk west along Hollywood Road until you reach the Temple of Man Mo , the oldest home of worship on the island ( though the date of its founding is disputed ) .


fn_spacy_tokens_for_baseline: A nice discussion of the phenomenon can be found in Martin Gardner 's marvellous book , The Ambidextrous Universe .

source_bert_toks: a nice discussion of the phenomenon can be found in martin gardner ' s marvel ##lous book , the am ##bid ##ex ##tro ##us universe .

reference_raw: A good discussion of this phenomenon can be found in Martin Gardner's wonderful book, the Ambidextrous universe.

reference_spacy_tokens: A good discussion of this phenomenon can be found in Martin Gardner 's wonderful book , the Ambidextrous universe .


fn_spacy_tokens_for_baseline: Day 8 Orders -- Realization principle here we have certainty of payment but completion of earning process is questionable .

source_bert_toks: day 8 orders - - realization principle here we have certainty of payment but completion of earning process is questionable .

reference_raw: Day 8 Orders - The principle of implementation here is certain of payment, but the completion of the profit process is questionable.

reference_spacy_tokens: Day 8 Orders - The principle of implementation here is certain of payment , but the completion of the profit process is questionable .


fn_spacy_tokens_for_baseline: It also includes a piece of ' cynghanedd ' Welsh verse written by the former Mayor of Ruthin , Robin Llwyd ap Owain , a National Eisteddfod winner in 1991 .

source_bert_toks: it also includes a piece of ' cy ##ng ##hane ##dd ' welsh verse written by the former mayor of ruth ##in , robin ll ##wy ##d ap ow ##ain , a national e ##iste ##dd ##fo ##d winner in 1991 .

reference_raw: It also includes a piece of "Cynghanedd" Welsh verse written by former mayor Ruthin, Robin Llwyd ap Owain, a 1991 national Eisteddfod champion.

reference_spacy_tokens: It also includes a piece of " Cynghanedd " Welsh verse written by former mayor Ruthin , Robin Llwyd ap Owain , a 1991 national Eisteddfod champion .


fn_spacy_tokens_for_baseline: Other acts sought to prohibit as far as possible corrupt practices and limited the amount of money a candidate could spend on election expenses .

source_bert_toks: other acts sought to prohibit as far as possible corrupt practices and limited the amount of money a candidate could spend on election expenses .

reference_raw: The purpose of other acts was to prohibit as much corruption as possible and to limit the amount of money a candidate could spend on election expenses.

reference_spacy_tokens: The purpose of other acts was to prohibit as much corruption as possible and to limit the amount of money a candidate could spend on election expenses .


fn_spacy_tokens_for_baseline: After a few heart - stopping moments the old engine coughed into life , and he managed to accelerate the loaded vehicle through the flames out to safety .

source_bert_toks: after a few heart - stopping moments the old engine coughed into life , and he managed to accelerate the loaded vehicle through the flames out to safety .

reference_raw: After a few heartbeats, the old engine coughed and managed to speed up the loaded car through the flames to safety.

reference_spacy_tokens: After a few heartbeats , the old engine coughed and managed to speed up the loaded car through the flames to safety .


fn_spacy_tokens_for_baseline: He stood up at the same time as she did , and caught her as she made for the door .

source_bert_toks: he stood up at the same time as she did , and caught her as she made for the door .

reference_raw: Just as she did, he got up and caught her as she headed for the door.

reference_spacy_tokens: Just as she did , he got up and caught her as she headed for the door .