fn_spacy_tokens_for_baseline: ' You stink , ' said the voice , steely cold .

source_bert_toks: ' you stink , ' said the voice , steel ##y cold .

reference_raw: "You smell," the voice said, steely cold.

reference_spacy_tokens: " You smell , " the voice said , steely cold .


fn_spacy_tokens_for_baseline: He could also see a line of washing , which included , he realized to his delight , the clerical undergarments .

source_bert_toks: he could also see a line of washing , which included , he realized to his delight , the clerical under ##gar ##ments .

reference_raw: He could also see the line of laundry, including, he realized to his delight, the clerical underwear.

reference_spacy_tokens: He could also see the line of laundry , including , he realized to his delight , the clerical underwear .


fn_spacy_tokens_for_baseline: It was no use trying the lift .

source_bert_toks: it was no use trying the lift .

reference_raw: There was no point in trying an elevator.

reference_spacy_tokens: There was no point in trying an elevator .


fn_spacy_tokens_for_baseline: He loved this end - of - the - night sensation of hardly being able to think , just feel .

source_bert_toks: he loved this end - of - the - night sensation of hardly being able to think , just feel .

reference_raw: He loved the feeling at the end of the night that he could barely think, just feel.

reference_spacy_tokens: He loved the feeling at the end of the night that he could barely think , just feel .


fn_spacy_tokens_for_baseline: What JessPMoon said , with the volume cranked up and blasted from the rooftops .

source_bert_toks: what jess ##pm ##oon said , with the volume crank ##ed up and blasted from the rooftop ##s .

reference_raw: What Jesspmoon had said was that the volume had turned up and exploded from the rooftops.

reference_spacy_tokens: What Jesspmoon had said was that the volume had turned up and exploded from the rooftops .


fn_spacy_tokens_for_baseline: You could shave the whole damn British army in that bloody great cauldron of water . '

source_bert_toks: you could shave the whole damn british army in that bloody great ca ##uld ##ron of water . '

reference_raw: You can shave the whole damn British army in that damn big pot of water.'

reference_spacy_tokens: You can shave the whole damn British army in that damn big pot of water . '


fn_spacy_tokens_for_baseline: ' This poor murdered girl must be revenged .

source_bert_toks: ' this poor murdered girl must be revenge ##d .

reference_raw: 'This poor murdered girl has to be avenged.

reference_spacy_tokens: ' This poor murdered girl has to be avenged .


fn_spacy_tokens_for_baseline: In the few fatal seconds following the explosion , human beings were vaporized where they stood or suffered agonizing flash burns that ripped skin from bone .

source_bert_toks: in the few fatal seconds following the explosion , human beings were vapor ##ized where they stood or suffered ago ##ni ##zing flash burns that ripped skin from bone .

reference_raw: In the few fatal seconds after the explosion, human beings disappeared where they stood or suffered painful flash-burns that ripped the skin from the bone.

reference_spacy_tokens: In the few fatal seconds after the explosion , human beings disappeared where they stood or suffered painful flash - burns that ripped the skin from the bone .


fn_spacy_tokens_for_baseline: We strap them to the plane 's fuselage and pump them full of compressed air until we achieve neutral buoyancy . '

source_bert_toks: we strap them to the plane ' s fuselage and pump them full of compressed air until we achieve neutral bu ##oya ##ncy . '

reference_raw: We'll strap them to the hull of the plane and pour them full of compressed air until we reach neutral buoyancy.'

reference_spacy_tokens: We 'll strap them to the hull of the plane and pour them full of compressed air until we reach neutral buoyancy . '


fn_spacy_tokens_for_baseline: ' It was a vital factor on a day when we needed all 13 players . '

source_bert_toks: ' it was a vital factor on a day when we needed all 13 players . '

reference_raw: "The day we needed all thirteen players, it was an important factor."

reference_spacy_tokens: " The day we needed all thirteen players , it was an important factor . "


fn_spacy_tokens_for_baseline: Before Trevithick 's invention and Stephenson 's vision and tenacity , the furthest most people travelled from home was the next village or the nearest town on market day .

source_bert_toks: before tre ##vi ##thic ##k ' s invention and stephenson ' s vision and ten ##ac ##ity , the fur ##thest most people travelled from home was the next village or the nearest town on market day .

reference_raw: Before Trevithick's creation and Stephenson's vision and tenacity, the farthest people ever traveled from home was the next village or the nearest city on a market day.

reference_spacy_tokens: Before Trevithick 's creation and Stephenson 's vision and tenacity , the farthest people ever traveled from home was the next village or the nearest city on a market day .


fn_spacy_tokens_for_baseline: The next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bioterrorism ; and approaches to the prevention and mitigation of bioterrorist incidents .

source_bert_toks: the next five chapters focus on the technical aspects of biological terrorism , including the biological agents of greatest concern ; the technical hurdles associated with their acquisition , production , and delivery ; historical cases of bio ##ter ##ror ##ism ; and approaches to the prevention and mit ##iga ##tion of bio ##ter ##ror ##ist incidents .

reference_raw: The next five chapters focus on the technical aspects of bioterrorism, including biological agents of major concern; technical barriers related to their acquisition, production and delivery; historical cases of bioterrorism; and approaches to preventing and mitigating bioterrorism incidents.

reference_spacy_tokens: The next five chapters focus on the technical aspects of bioterrorism , including biological agents of major concern ; technical barriers related to their acquisition , production and delivery ; historical cases of bioterrorism ; and approaches to preventing and mitigating bioterrorism incidents .


fn_spacy_tokens_for_baseline: His lively and entertaining speech proved our long - held view of the sales force that when they are not annoying us , they are out playing golf !

source_bert_toks: his lively and entertaining speech proved our long - held view of the sales force that when they are not annoying us , they are out playing golf !

reference_raw: His lively and amusing speech showed our long-standing view of the sales force that if they don't bother us, they're out playing golf!

reference_spacy_tokens: His lively and amusing speech showed our long - standing view of the sales force that if they do n't bother us , they 're out playing golf !


fn_spacy_tokens_for_baseline: The quay was white and slippery with the granules of a recent hailstorm .

source_bert_toks: the quay was white and slippery with the gran ##ules of a recent hail ##storm .

reference_raw: The wharf was white and slippery with the granules of a recent storm.

reference_spacy_tokens: The wharf was white and slippery with the granules of a recent storm .


fn_spacy_tokens_for_baseline: Next to the Jardine building is Exchange Square , a complex with a large shopping mall ; just behind it is the General Post Office with a philatelic center on the ground floor .

source_bert_toks: next to the jar ##dine building is exchange square , a complex with a large shopping mall ; just behind it is the general post office with a phil ##ate ##lic center on the ground floor .

reference_raw: There's Exchange Square next to Jardine's building, a complex with a large shopping mall, just behind it is the General Post, with a philatelic center on the ground floor.

reference_spacy_tokens: There 's Exchange Square next to Jardine 's building , a complex with a large shopping mall , just behind it is the General Post , with a philatelic center on the ground floor .


fn_spacy_tokens_for_baseline: He 's a quiet but often voluble ex - veteran of the Boston hardcore scene and seemingly the most welcome member of Sebadoh .

source_bert_toks: he ' s a quiet but often vol ##ub ##le ex - veteran of the boston hardcore scene and seemingly the most welcome member of se ##bad ##oh .

reference_raw: He's a quiet but often voluminous ex-veteran from the hardcore scene in Boston, and he's probably the most welcome member of Sebadoh.

reference_spacy_tokens: He 's a quiet but often voluminous ex - veteran from the hardcore scene in Boston , and he 's probably the most welcome member of Sebadoh .


fn_spacy_tokens_for_baseline: Burning with mortification , Leonora looked away , sliding lower beneath the quilt like an animal burrowing for cover as Penry sat on the edge of the bed .

source_bert_toks: burning with mort ##ification , leon ##ora looked away , sliding lower beneath the quilt like an animal burr ##owing for cover as pen ##ry sat on the edge of the bed .

reference_raw: Leonora glowed with disgust and looked away, sliding under the blanket like an animal buried in a blanket while Penry sat on the edge of the bed.

reference_spacy_tokens: Leonora glowed with disgust and looked away , sliding under the blanket like an animal buried in a blanket while Penry sat on the edge of the bed .


fn_spacy_tokens_for_baseline: But our education proceeded at the hands of those others , who were merely competent and conscientious .

source_bert_toks: but our education proceeded at the hands of those others , who were merely competent and con ##sc ##ient ##ious .

reference_raw: But our education continued at the hands of the others, who were only capable and conscientious.

reference_spacy_tokens: But our education continued at the hands of the others , who were only capable and conscientious .


fn_spacy_tokens_for_baseline: We know that Eworth can be associated with a long series of signed pictures bearing his monogram HE .

source_bert_toks: we know that e ##worth can be associated with a long series of signed pictures bearing his mono ##gram he .

reference_raw: We know Eworth can be associated with a long series of signed images bearing his HE monograph.

reference_spacy_tokens: We know Eworth can be associated with a long series of signed images bearing his HE monograph .


fn_spacy_tokens_for_baseline: Such a list may quite simply be typed out on sheets of paper and duplicated so that additions and changes may be made until the list has to be retyped for clarity 's sake .

source_bert_toks: such a list may quite simply be typed out on sheets of paper and duplicate ##d so that additions and changes may be made until the list has to be re ##type ##d for clarity ' s sake .

reference_raw: Such a list can simply be written on sheets of paper and duplicated in such a way that additions and amendments can be made until it is necessary, in the interests of clarity, to retype the list.

reference_spacy_tokens: Such a list can simply be written on sheets of paper and duplicated in such a way that additions and amendments can be made until it is necessary , in the interests of clarity , to retype the list .


fn_spacy_tokens_for_baseline: Closing a raft of useless federal establishments will get rid of only some 80,000 of them .

source_bert_toks: closing a raft of useless federal establishments will get rid of only some 80 , 000 of them .

reference_raw: Only about 80,000 will get rid of them by shutting down a boat of useless federal facilities.

reference_spacy_tokens: Only about 80,000 will get rid of them by shutting down a boat of useless federal facilities .


fn_spacy_tokens_for_baseline: My deeper antipathy to Germany and Germans I restrained for a while , on the absurd grounds that it was somehow unreasonable to abominate each of two mutually ill - disposed nations .

source_bert_toks: my deeper anti ##pathy to germany and germans i restrained for a while , on the absurd grounds that it was somehow unreasonable to ab ##omi ##nate each of two mutually ill - disposed nations .

reference_raw: My deeper antipathy with Germany and the Germans I held back for some time on the preposterous grounds that it was somehow unreasonable to absolve each of the two mutually ill-disposed nations.

reference_spacy_tokens: My deeper antipathy with Germany and the Germans I held back for some time on the preposterous grounds that it was somehow unreasonable to absolve each of the two mutually ill - disposed nations .


fn_spacy_tokens_for_baseline: Your contribution to Goodwill will mean more than you may know .

source_bert_toks: your contribution to goodwill will mean more than you may know .

reference_raw: Your share of Goodwill will mean more than you know.

reference_spacy_tokens: Your share of Goodwill will mean more than you know .


fn_spacy_tokens_for_baseline: Something purred towards him .

source_bert_toks: something pu ##rred towards him .

reference_raw: Something was pulsing toward him.

reference_spacy_tokens: Something was pulsing toward him .


fn_spacy_tokens_for_baseline: It had claws like an eagle talons ; she could hear them shredding and splintering the wood .

source_bert_toks: it had claws like an eagle talon ##s ; she could hear them sh ##red ##ding and splinter ##ing the wood .

reference_raw: It had claws like eagle claws; she could hear them tearing and splintering wood.

reference_spacy_tokens: It had claws like eagle claws ; she could hear them tearing and splintering wood .


fn_spacy_tokens_for_baseline: There was a chill wind on the Hill of the Dead , but Biff took off his top - hat and mopped his forehead with a red spotted handkerchief .

source_bert_toks: there was a chill wind on the hill of the dead , but bi ##ff took off his top - hat and mo ##pped his forehead with a red spotted handkerchief .

reference_raw: The wind was cold on the Hill of the Dead, but Biff took off his hat and wiped his forehead with a red-stained handkerchief.

reference_spacy_tokens: The wind was cold on the Hill of the Dead , but Biff took off his hat and wiped his forehead with a red - stained handkerchief .


fn_spacy_tokens_for_baseline: That 's how much it took to free 28-year - old Rustam Khalimov , who says he was detained Sept. 24 with a friend at a roadblock outside the mountain village of Tangi - Chu .

source_bert_toks: that ' s how much it took to free 28 - year - old rust ##am k ##hal ##imov , who says he was detained sept . 24 with a friend at a road ##block outside the mountain village of tang ##i - chu .

reference_raw: That's what it took to free 28-year-old Rustam Khalimov, who claims to have been arrested on September 24 with a friend at a road block outside the Tangi-Chu mountain village.

reference_spacy_tokens: That 's what it took to free 28-year - old Rustam Khalimov , who claims to have been arrested on September 24 with a friend at a road block outside the Tangi - Chu mountain village .


fn_spacy_tokens_for_baseline: Luke 's voice was so low that she had to strain to hear it above the noisy chatter of the birds , the rustle of the breeze in the trees .

source_bert_toks: luke ' s voice was so low that she had to strain to hear it above the noisy chatter of the birds , the rust ##le of the breeze in the trees .

reference_raw: Luke's voice was so low that she had to strain to hear it over the roar of the birds and the rustle of the wind in the trees.

reference_spacy_tokens: Luke 's voice was so low that she had to strain to hear it over the roar of the birds and the rustle of the wind in the trees .


fn_spacy_tokens_for_baseline: Organisers Karen Stead and Sue Symes badgered twenty - eight people into giving baby and recent photographs .

source_bert_toks: organise ##rs karen ste ##ad and sue sy ##mes badger ##ed twenty - eight people into giving baby and recent photographs .

reference_raw: The organizers Karen Stead and Sue Symes badged twenty-eight people to give a child and a recent photo.

reference_spacy_tokens: The organizers Karen Stead and Sue Symes badged twenty - eight people to give a child and a recent photo .


fn_spacy_tokens_for_baseline: I 'm not going to illustrate these evidences and statements ; God is my witness , I do n't want to deceive anyone .

source_bert_toks: i ' m not going to illustrate these evidence ##s and statements ; god is my witness , i don ' t want to dec ##ei ##ve anyone .

reference_raw: I don't want to show the evidence and the testimony; God is my witness, I don't want to fool anybody.

reference_spacy_tokens: I do n't want to show the evidence and the testimony ; God is my witness , I do n't want to fool anybody .


fn_spacy_tokens_for_baseline: In August 1998 , North Korea flight - tested the Paektusan-1 ( Taepodong-1 ) in a failed attempt to place a small satellite into earth orbit .

source_bert_toks: in august 1998 , north korea flight - tested the pa ##ek ##tus ##an - 1 ( tae ##pod ##ong - 1 ) in a failed attempt to place a small satellite into earth orbit .

reference_raw: In August 1998, a flight from North Korea tested the Paektusan-1 (Taepodong-1) in a failed attempt to place a small satellite on Earth's orbit.

reference_spacy_tokens: In August 1998 , a flight from North Korea tested the Paektusan-1 ( Taepodong-1 ) in a failed attempt to place a small satellite on Earth 's orbit .


fn_spacy_tokens_for_baseline: Translucent shapes undulated through the jungle , glimmering in the sunlight : the only life the Lucifer System had so far offered up for study .

source_bert_toks: translucent shapes und ##ulated through the jungle , g ##lim ##mering in the sunlight : the only life the lucifer system had so far offered up for study .

reference_raw: Translucent shapes rippled through the jungle, glittering in the sun: the only life the Lucifer system had ever offered to study.

reference_spacy_tokens: Translucent shapes rippled through the jungle , glittering in the sun : the only life the Lucifer system had ever offered to study .


fn_spacy_tokens_for_baseline: Passports found in one of the houses identify the men as from a privilege convenience province noted for lawless tribes .

source_bert_toks: passports found in one of the houses identify the men as from a privilege convenience province noted for law ##less tribes .

reference_raw: The passes found in one of the houses identify the men from the privileged comfort province of lawless tribes.

reference_spacy_tokens: The passes found in one of the houses identify the men from the privileged comfort province of lawless tribes .


fn_spacy_tokens_for_baseline: A nearby car blared its horn loudly and , to Jessamy 's intense relief , Julius seemed to get control over himself again very rapidly , steering them back on to a straight course .

source_bert_toks: a nearby car b ##lar ##ed its horn loudly and , to jess ##amy ' s intense relief , julius seemed to get control over himself again very rapidly , steering them back on to a straight course .

reference_raw: The nearby car blew its horn loudly and, to Jessamy's intense relief, Julius seemed to regain control of himself very quickly and steer them straight again.

reference_spacy_tokens: The nearby car blew its horn loudly and , to Jessamy 's intense relief , Julius seemed to regain control of himself very quickly and steer them straight again .


fn_spacy_tokens_for_baseline: Gemma nudges my shoulder .

source_bert_toks: gemma nu ##dge ##s my shoulder .

reference_raw: Gemma's poking me on the shoulder.

reference_spacy_tokens: Gemma 's poking me on the shoulder .


fn_spacy_tokens_for_baseline: Atypical of their material thus far , it also hinted at Barlow 's imminent return from the backwoods .

source_bert_toks: at ##yp ##ical of their material thus far , it also hinted at barlow ' s imminent return from the back ##woods .

reference_raw: Atypical of their material so far, it also hinted at Barlow's imminent return from the woods.

reference_spacy_tokens: Atypical of their material so far , it also hinted at Barlow 's imminent return from the woods .


fn_spacy_tokens_for_baseline: The tall man screamed with pain , slumping forward , Newman 's hand came down , nails jabbing into the back of the half - withdrawn hand .

source_bert_toks: the tall man screamed with pain , slump ##ing forward , newman ' s hand came down , nails ja ##bbing into the back of the half - withdrawn hand .

reference_raw: The big man cried out in pain and fell forward, Newman's hand dropped, nails thrusting into the back of his half-drawn hand.

reference_spacy_tokens: The big man cried out in pain and fell forward , Newman 's hand dropped , nails thrusting into the back of his half - drawn hand .


fn_spacy_tokens_for_baseline: It was n't until a.d . 330 , however , when the newly converted Emperor Constantine made Byzantium , renamed Constantinople , capital of his Eastern Empire that Christianity was assured of its dominant role in future Greek life .

source_bert_toks: it wasn ' t until a . d . 330 , however , when the newly converted emperor constantine made by ##zan ##tium , renamed constantinople , capital of his eastern empire that christianity was assured of its dominant role in future greek life .

reference_raw: But only in April 330, when the newly converted Emperor Constantine created Byzantium and renamed Constantinople, the capital of the Eastern Empire, did Christianity have a dominant role in the future Greek life.

reference_spacy_tokens: But only in April 330 , when the newly converted Emperor Constantine created Byzantium and renamed Constantinople , the capital of the Eastern Empire , did Christianity have a dominant role in the future Greek life .


fn_spacy_tokens_for_baseline: Sampras said tendons in the back of his right knee started acting up immediately after he suffered cramps in Moscow .

source_bert_toks: sam ##pr ##as said tend ##ons in the back of his right knee started acting up immediately after he suffered cr ##amps in moscow .

reference_raw: Sampras said that the tendons on the back of his right knee began to appear as soon as he had a spasm in Moscow.

reference_spacy_tokens: Sampras said that the tendons on the back of his right knee began to appear as soon as he had a spasm in Moscow .


fn_spacy_tokens_for_baseline: The reasons are complex , but one simple reason ought not to be underestimated .

source_bert_toks: the reasons are complex , but one simple reason ought not to be under ##est ##imated .

reference_raw: Reasons are complex, but one simple reason should not be underestimated.

reference_spacy_tokens: Reasons are complex , but one simple reason should not be underestimated .


fn_spacy_tokens_for_baseline: Trammelled by my exhaustive cataloguing of habit , which I had continued to practise at Mr Broadhurst 's insistence , my visual escapades had become fully manageable .

source_bert_toks: tram ##mel ##led by my exhaust ##ive catalog ##uing of habit , which i had continued to pr ##act ##ise at mr broad ##hurst ' s insistence , my visual es ##cap ##ades had become fully manage ##able .

reference_raw: Trapped by my exhaustive catalogue of habits, which I continued to practice at the insistence of Mr. Broadhurst, my visual escapades were fully manageable.

reference_spacy_tokens: Trapped by my exhaustive catalogue of habits , which I continued to practice at the insistence of Mr. Broadhurst , my visual escapades were fully manageable .


fn_spacy_tokens_for_baseline: She also allayed her insecurity with a massive spending spree ; each charity dinner required a new ballgown , and each new glittering friend -- contacts for Scott -- required a glittering party .

source_bert_toks: she also alla ##yed her ins ##ec ##urity with a massive spending sp ##ree ; each charity dinner required a new ball ##go ##wn , and each new glittering friend - - contacts for scott - - required a glittering party .

reference_raw: She also eased her uncertainty with a massive spending spree; every charity dinner required a new dress, and every new glittering friend - contact with Scott - required a glittering party.

reference_spacy_tokens: She also eased her uncertainty with a massive spending spree ; every charity dinner required a new dress , and every new glittering friend - contact with Scott - required a glittering party .


fn_spacy_tokens_for_baseline: An instant later a white - faced , hardbreathing policeman had opened the door , the candle wavering in his trembling hand .

source_bert_toks: an instant later a white - faced , hard ##bre ##athing policeman had opened the door , the candle wave ##ring in his trembling hand .

reference_raw: A moment later, a white-faced, hard-breathed cop unlocked the door, and the candle wavered in his shaking hand.

reference_spacy_tokens: A moment later , a white - faced , hard - breathed cop unlocked the door , and the candle wavered in his shaking hand .


fn_spacy_tokens_for_baseline: 3 RICH : OK , so we 're just comin ' down for some maintenance , like a forced outage type thing ?

source_bert_toks: 3 rich : ok , so we ' re just com ##in ' down for some maintenance , like a forced out ##age type thing ?

reference_raw: 3 RICH: Okay, so we're just going to go down for a little bit of upkeep, like some kind of forced blackout?

reference_spacy_tokens: 3 RICH : Okay , so we 're just going to go down for a little bit of upkeep , like some kind of forced blackout ?


fn_spacy_tokens_for_baseline: ' I must congratulate you , Inspector , on handling so distinctive and instructive a case .

source_bert_toks: ' i must cong ##rat ##ulate you , inspector , on handling so distinctive and ins ##truct ##ive a case .

reference_raw: 'I must congratulate you, Inspector, for dealing with such a unique and instructive case.

reference_spacy_tokens: ' I must congratulate you , Inspector , for dealing with such a unique and instructive case .


fn_spacy_tokens_for_baseline: A Roger Rabbit - style cartoon , Evil Toons , released on video this month , promotes itself like this : ' Innocently the four girls unleash a nymphomaniacal cartoon monster from the pages of a spell - book which intends to scare more than the girls ' pants off . '

source_bert_toks: a roger rabbit - style cartoon , evil too ##ns , released on video this month , promotes itself like this : ' innocent ##ly the four girls un ##lea ##sh a ny ##mp ##hom ##ania ##cal cartoon monster from the pages of a spell - book which intends to scare more than the girls ' pants off . '

reference_raw: Roger Rabbit's cartoon, the Evil Toons, published this month's video, goes like this: "Innocently, four girls release a nymphomaniacal cartoon monster from the pages of a magic book that wants to scare more than a girl's pants off."

reference_spacy_tokens: Roger Rabbit 's cartoon , the Evil Toons , published this month 's video , goes like this : " Innocently , four girls release a nymphomaniacal cartoon monster from the pages of a magic book that wants to scare more than a girl 's pants off . "


fn_spacy_tokens_for_baseline: She voided the lavatory , and ran cold water in the basin , laving her face , hands , wrists .

source_bert_toks: she void ##ed the lava ##tory , and ran cold water in the basin , la ##ving her face , hands , wrists .

reference_raw: She emptied the toilet and poured cold water into the sink, lashing her face, hands, wrists.

reference_spacy_tokens: She emptied the toilet and poured cold water into the sink , lashing her face , hands , wrists .


fn_spacy_tokens_for_baseline: In order to develop job skills , a man with some serious disabilities begins working in Goodwill 's industrial division .

source_bert_toks: in order to develop job skills , a man with some serious disabilities begins working in goodwill ' s industrial division .

reference_raw: To develop the skills of a job, a man with a severe disability starts working at the Goodwill industrial division.

reference_spacy_tokens: To develop the skills of a job , a man with a severe disability starts working at the Goodwill industrial division .


fn_spacy_tokens_for_baseline: ' I 've had a plain - clothes man waiting at the station all the week .

source_bert_toks: ' i ' ve had a plain - clothes man waiting at the station all the week .

reference_raw: 'There's a guy in plain clothes waiting for me at the station all week.

reference_spacy_tokens: ' There 's a guy in plain clothes waiting for me at the station all week .


fn_spacy_tokens_for_baseline: WOE betide a small company in an unfashionable sector .

source_bert_toks: wo ##e bet ##ide a small company in an un ##fa ##shi ##ona ##ble sector .

reference_raw: WOE bets a small company in an unfashionable sector.

reference_spacy_tokens: WOE bets a small company in an unfashionable sector .


fn_spacy_tokens_for_baseline: The teachers categorized all pupils as poor , satisfactory or good -- or ( sometimes ) excellent .

source_bert_toks: the teachers categorized all pupils as poor , satisfactory or good - - or ( sometimes ) excellent .

reference_raw: Teachers classified all pupils as poor, satisfactory or good - or (sometimes) excellent.

reference_spacy_tokens: Teachers classified all pupils as poor , satisfactory or good - or ( sometimes ) excellent .


fn_spacy_tokens_for_baseline: The management of the Suffolk Water Company have admitted that the borehole is damaging the fen , and are exploring the possibility of opening an alternative .

source_bert_toks: the management of the suffolk water company have admitted that the bore ##hole is damaging the fen , and are exploring the possibility of opening an alternative .

reference_raw: The management of the Suffolk Water Company has acknowledged that the well damages the fence and is exploring the possibility of opening an alternative.

reference_spacy_tokens: The management of the Suffolk Water Company has acknowledged that the well damages the fence and is exploring the possibility of opening an alternative .


fn_spacy_tokens_for_baseline: Quick was the head women 's coach in the 1988 Olympics and also coached in two other Olympics .

source_bert_toks: quick was the head women ' s coach in the 1988 olympics and also coached in two other olympics .

reference_raw: Quick was the first female trainer at the 1988 Olympics, and he was also a trainer at the other two Olympics.

reference_spacy_tokens: Quick was the first female trainer at the 1988 Olympics , and he was also a trainer at the other two Olympics .


fn_spacy_tokens_for_baseline: Two days dead , the body was beginning to putrefy and the stench made both Benjamin and myself gag .

source_bert_toks: two days dead , the body was beginning to put ##re ##fy and the stench made both benjamin and myself gag .

reference_raw: Two days dead, the body began to give in, and the smell made Benjamin and me gag.

reference_spacy_tokens: Two days dead , the body began to give in , and the smell made Benjamin and me gag .


fn_spacy_tokens_for_baseline: The proportional change in the number of publications , using 1990 as a comparison , revealed that scientific publishing in Latin America increased the most rapidly in the Americas , far outpacing the United States and Canada ( Figure 1 ) .

source_bert_toks: the proportional change in the number of publications , using 1990 as a comparison , revealed that scientific publishing in latin america increased the most rapidly in the americas , far out ##pac ##ing the united states and canada ( figure 1 ) .

reference_raw: A relative change in the number of publications, using 1990 as a benchmark, has shown that scientific publications in Latin America have increased the fastest in the US, far beyond the United States and Canada (Figure 1).

reference_spacy_tokens: A relative change in the number of publications , using 1990 as a benchmark , has shown that scientific publications in Latin America have increased the fastest in the US , far beyond the United States and Canada ( Figure 1 ) .


fn_spacy_tokens_for_baseline: ' A plausible lawyer could make it out as an act of self - defence .

source_bert_toks: ' a plausible lawyer could make it out as an act of self - defence .

reference_raw: 'A credible lawyer would say that as an act of self-defense.

reference_spacy_tokens: ' A credible lawyer would say that as an act of self - defense .


fn_spacy_tokens_for_baseline: Let me show you the evolution of this case so far as I have been able to follow it .

source_bert_toks: let me show you the evolution of this case so far as i have been able to follow it .

reference_raw: I'll show you how this case evolves so far as I can keep track of it.

reference_spacy_tokens: I 'll show you how this case evolves so far as I can keep track of it .


fn_spacy_tokens_for_baseline: She divides it into great scoopfuls and fills a cornflake bowl for each of us .

source_bert_toks: she divides it into great scoop ##ful ##s and fills a corn ##fl ##ake bowl for each of us .

reference_raw: He divides it into big scoops and fills each of us with a bowl of cornflake.

reference_spacy_tokens: He divides it into big scoops and fills each of us with a bowl of cornflake .


fn_spacy_tokens_for_baseline: He braced the top of his head against a section of partly - demolished brickwork , and heaved with laughter , his face slick with tears , his limbs weak with the effort .

source_bert_toks: he braced the top of his head against a section of partly - demolished brick ##work , and heaved with laughter , his face slick with tears , his limbs weak with the effort .

reference_raw: He leaned the top of his head against a section of partially demolished brickwork, and heaved with laughter, his face slick with tears, his limbs weak with the effort.

reference_spacy_tokens: He leaned the top of his head against a section of partially demolished brickwork , and heaved with laughter , his face slick with tears , his limbs weak with the effort .


fn_spacy_tokens_for_baseline: He smelled the burning in the air , saw the stars dimmed by smoke above him .

source_bert_toks: he smelled the burning in the air , saw the stars dim ##med by smoke above him .

reference_raw: He could feel the burning in the air, and he could see the stars dimming with the smoke above him.

reference_spacy_tokens: He could feel the burning in the air , and he could see the stars dimming with the smoke above him .


fn_spacy_tokens_for_baseline: The plaintiff , a fireman , was injured by an explosion on premises occupied by the defendants , a fish and chip shop , when a fire in the premises melted a seal on a gas meter , thus allowing gas to escape .

source_bert_toks: the plaintiff , a fire ##man , was injured by an explosion on premises occupied by the defendants , a fish and chip shop , when a fire in the premises melted a seal on a gas meter , thus allowing gas to escape .

reference_raw: The applicant, a firefighter, was injured by an explosion in the premises occupied by the defendants, a fish and chip shop, when the fire in the premises dissolved the gas-meter cap, allowing the gas to escape.

reference_spacy_tokens: The applicant , a firefighter , was injured by an explosion in the premises occupied by the defendants , a fish and chip shop , when the fire in the premises dissolved the gas - meter cap , allowing the gas to escape .


fn_spacy_tokens_for_baseline: Swift and deadly , they are armoured in shining silver and armed with white lances with diamond - hard tips which glitter like stars .

source_bert_toks: swift and deadly , they are armoured in shining silver and armed with white lance ##s with diamond - hard tips which glitter like stars .

reference_raw: Swift and deadly, they are armored in bright silver and armed with white spears with diamond-hard tips that glitter like stars.

reference_spacy_tokens: Swift and deadly , they are armored in bright silver and armed with white spears with diamond - hard tips that glitter like stars .


fn_spacy_tokens_for_baseline: In addition , since all known Iranian nuclear facilities are under IAEA monitoring , Beijing views US demands that China suspend all its nuclear cooperation programs with Iran as unreasonable and contrary to Article IV of the NPT .

source_bert_toks: in addition , since all known iranian nuclear facilities are under ia ##ea monitoring , beijing views us demands that china suspend all its nuclear cooperation programs with iran as unreasonable and contrary to article iv of the np ##t .

reference_raw: Moreover, since all known Iranian nuclear facilities are under the control of the IAEA, Beijing considers that the US requires China to suspend all its nuclear cooperation programmes with Iran as disproportionate and in violation of Article IV of the NPT.

reference_spacy_tokens: Moreover , since all known Iranian nuclear facilities are under the control of the IAEA , Beijing considers that the US requires China to suspend all its nuclear cooperation programmes with Iran as disproportionate and in violation of Article IV of the NPT .


fn_spacy_tokens_for_baseline: Sure enough , the wolf came and devoured him ; only his skull was left which went on reiterating the prophecy of doom for Rome .

source_bert_toks: sure enough , the wolf came and dev ##oured him ; only his skull was left which went on rei ##tera ##ting the prophecy of doom for rome .

reference_raw: Of course, the wolf had come and eaten him; only his skull remained, repeating the prophecy of destruction for Rome.

reference_spacy_tokens: Of course , the wolf had come and eaten him ; only his skull remained , repeating the prophecy of destruction for Rome .


fn_spacy_tokens_for_baseline: Prisons should be places which are austere but decent , providing a busy and positive regime which prepared prisoners for their ultimate release .

source_bert_toks: prisons should be places which are aus ##ter ##e but decent , providing a busy and positive regime which prepared prisoners for their ultimate release .

reference_raw: Prisons should be sparse but decent places that provide a busy and positive regime that prepares the prisoners for their final release.

reference_spacy_tokens: Prisons should be sparse but decent places that provide a busy and positive regime that prepares the prisoners for their final release .


fn_spacy_tokens_for_baseline: His hair was very fair , his face naturally sanguine , his skin roughened by coarse soap and blunt razor blades and the cold of the winter that had just ended .

source_bert_toks: his hair was very fair , his face naturally sang ##uin ##e , his skin rough ##ened by coarse soap and blunt razor blades and the cold of the winter that had just ended .

reference_raw: His hair was very fair, his face sanguine, his skin rough with coarse soap and dull razor blades, and the cold winter that had just come to an end.

reference_spacy_tokens: His hair was very fair , his face sanguine , his skin rough with coarse soap and dull razor blades , and the cold winter that had just come to an end .


fn_spacy_tokens_for_baseline: ' So Peter Sebastian is an alias ? '

source_bert_toks: ' so peter sebastian is an alias ? '

reference_raw: "So Peter Sebastian's a nickname?"

reference_spacy_tokens: " So Peter Sebastian 's a nickname ? "


fn_spacy_tokens_for_baseline: Since 2004 , China has been engaged in consultation with the MTCR ; however , its application for membership has so far not been successful and suspicions , especially in the United States , about Chinese missile technology transfers remain .

source_bert_toks: since 2004 , china has been engaged in consultation with the mt ##cr ; however , its application for membership has so far not been successful and suspicions , especially in the united states , about chinese missile technology transfers remain .

reference_raw: Since 2004, China has been consulted with the MTCR; however, its request for membership has not been successful so far and there are still suspicions, particularly in the United States, of the transfer of Chinese missile technology.

reference_spacy_tokens: Since 2004 , China has been consulted with the MTCR ; however , its request for membership has not been successful so far and there are still suspicions , particularly in the United States , of the transfer of Chinese missile technology .


fn_spacy_tokens_for_baseline: Odds and ends , some pipes , a few novels , two of them in Spanish , and old - fashioned pinfire revolver , and a guitar were among the personal property .

source_bert_toks: odds and ends , some pipes , a few novels , two of them in spanish , and old - fashioned pin ##fire revolver , and a guitar were among the personal property .

reference_raw: Odds and ends, a few pipes, several novels, two in Spanish, and an ancient pinfire revolver, and a guitar were among the personal possessions.

reference_spacy_tokens: Odds and ends , a few pipes , several novels , two in Spanish , and an ancient pinfire revolver , and a guitar were among the personal possessions .


fn_spacy_tokens_for_baseline: The IAEA Board of Governors has imposed on Iran a 31 October 2003 deadline to resolve all outstanding issues and to provide full and complete declaration of its nuclear material and nuclear activities , specifically Iran 's enrichment program and past conversion experiments .

source_bert_toks: the ia ##ea board of governors has imposed on iran a 31 october 2003 deadline to resolve all outstanding issues and to provide full and complete declaration of its nuclear material and nuclear activities , specifically iran ' s enrichment program and past conversion experiments .

reference_raw: The IAEA Board of Governors imposed a deadline of 31 October 2003 on Iran to resolve all outstanding issues and to provide a full and comprehensive statement of its nuclear material and nuclear activities, in particular the Iranian enrichment programme and past conversion experiments.

reference_spacy_tokens: The IAEA Board of Governors imposed a deadline of 31 October 2003 on Iran to resolve all outstanding issues and to provide a full and comprehensive statement of its nuclear material and nuclear activities , in particular the Iranian enrichment programme and past conversion experiments .


fn_spacy_tokens_for_baseline: After the cleaning in AlbuFahd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he 's ready to cooperate .

source_bert_toks: after the cleaning in al ##bu ##fa ##hd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he ' s ready to cooperate .

reference_raw: After cleaning up in AlbuFahd, the brothers killed three of his tribe's spies, and for the first time there was no response to the brothers, but instead he came to them and asked for his pardon, and he was prepared to cooperate.

reference_spacy_tokens: After cleaning up in AlbuFahd , the brothers killed three of his tribe 's spies , and for the first time there was no response to the brothers , but instead he came to them and asked for his pardon , and he was prepared to cooperate .


fn_spacy_tokens_for_baseline: He took himself to the call - box in his lodgings night after night , but whether he was sloshed or sober there was no way of finding the nerve to dial .

source_bert_toks: he took himself to the call - box in his lodging ##s night after night , but whether he was sl ##osh ##ed or sober there was no way of finding the nerve to dial .

reference_raw: Night after night he went to the phone booth in his quarters, but whether he was sloppy or sober, he couldn't find the courage to dial.

reference_spacy_tokens: Night after night he went to the phone booth in his quarters , but whether he was sloppy or sober , he could n't find the courage to dial .


fn_spacy_tokens_for_baseline: Piers was quick to conceal his surprise .

source_bert_toks: piers was quick to conceal his surprise .

reference_raw: Piers quickly concealed his astonishment.

reference_spacy_tokens: Piers quickly concealed his astonishment .


fn_spacy_tokens_for_baseline: While the Agreed Framework froze North Korea 's plutonium program for almost a decade , neither party was completely satisfied with either the compromise reached or its implementation .

source_bert_toks: while the agreed framework froze north korea ' s pluto ##nium program for almost a decade , neither party was completely satisfied with either the compromise reached or its implementation .

reference_raw: While the agreed framework frozen North Korea's plutonium program for nearly a decade, neither side was fully satisfied with the compromise reached or its execution.

reference_spacy_tokens: While the agreed framework frozen North Korea 's plutonium program for nearly a decade , neither side was fully satisfied with the compromise reached or its execution .


fn_spacy_tokens_for_baseline: But Jill is very talented , she 's going to be really big once she gets her music together . '

source_bert_toks: but jill is very talented , she ' s going to be really big once she gets her music together . '

reference_raw: But Jill's very talented, and when she puts her music together, she'll be great.'

reference_spacy_tokens: But Jill 's very talented , and when she puts her music together , she 'll be great . '


fn_spacy_tokens_for_baseline: It " may well be " that theft of business data is " as serious a strategic threat to national security " as it is a threat to the survival of victimized U.S. firms , said Michelle Van Cleave , the White House 's assistant director for National Security Affairs .

source_bert_toks: it " may well be " that theft of business data is " as serious a strategic threat to national security " as it is a threat to the survival of victim ##ized u . s . firms , said michelle van cl ##ea ##ve , the white house ' s assistant director for national security affairs .

reference_raw: "It may well be," said Michelle Van Cleave, White House Assistant Director of National Security, "that theft of commercial information is "as serious a strategic threat to national security" as it threatens the survival of the victimized American companies.

reference_spacy_tokens: " It may well be , " said Michelle Van Cleave , White House Assistant Director of National Security , " that theft of commercial information is " as serious a strategic threat to national security " as it threatens the survival of the victimized American companies .


fn_spacy_tokens_for_baseline: The inhabitants of the closes and the tenements had headed for the high ground , leaving the trams and turmoil behind for the mist , the heather , and a good brew - up in the but and ben .

source_bert_toks: the inhabitants of the closes and the ten ##ement ##s had headed for the high ground , leaving the trams and turmoil behind for the mist , the heather , and a good brew - up in the but and ben .

reference_raw: The occupants of the closets and tenements were on their way to the high ground, leaving the trams and confusion behind for the fog, the heather, and a good brew in the butt and the bench.

reference_spacy_tokens: The occupants of the closets and tenements were on their way to the high ground , leaving the trams and confusion behind for the fog , the heather , and a good brew in the butt and the bench .


fn_spacy_tokens_for_baseline: ' You 're right -- a badly chosen phrase , ' he conceded derisively as he looked at his watch again .

source_bert_toks: ' you ' re right - - a badly chosen phrase , ' he conceded der ##isi ##vel ##y as he looked at his watch again .

reference_raw: 'You're right - the wrong phrase,' he admitted mockingly, looking back at his watch.

reference_spacy_tokens: ' You 're right - the wrong phrase , ' he admitted mockingly , looking back at his watch .


fn_spacy_tokens_for_baseline: It is not difficult to imagine the shock which would attend such discovery after being deceived into marriage .

source_bert_toks: it is not difficult to imagine the shock which would attend such discovery after being dec ##ei ##ved into marriage .

reference_raw: It's not hard to imagine the shock that would take part in such a discovery when it's tricked into a marriage.

reference_spacy_tokens: It 's not hard to imagine the shock that would take part in such a discovery when it 's tricked into a marriage .


fn_spacy_tokens_for_baseline: But such retaliation seems to have been powerless to harm him .

source_bert_toks: but such retaliation seems to have been powerless to harm him .

reference_raw: But it seems that such retaliation was helpless to hurt him.

reference_spacy_tokens: But it seems that such retaliation was helpless to hurt him .


fn_spacy_tokens_for_baseline: To confront you at that particular moment was deplorable . '

source_bert_toks: to confront you at that particular moment was de ##pl ##ora ##ble . '

reference_raw: It was regrettable to confront you at this particular moment.'

reference_spacy_tokens: It was regrettable to confront you at this particular moment . '


fn_spacy_tokens_for_baseline: I simply do not see the need to exalt one code by denigrating the other .

source_bert_toks: i simply do not see the need to ex ##al ##t one code by den ##ig ##rating the other .

reference_raw: I just don't see the need to enhance one code by denigrating the other.

reference_spacy_tokens: I just do n't see the need to enhance one code by denigrating the other .


fn_spacy_tokens_for_baseline: It was the moment when a choice had to be made about how to approach the exploitation and inequitable treatment meted out to Black subjects in Britain .

source_bert_toks: it was the moment when a choice had to be made about how to approach the exploitation and in ##e ##quitable treatment met ##ed out to black subjects in britain .

reference_raw: This was the moment when it was necessary to decide how to approach the exploitation and unequal treatment of black subjects in Britain.

reference_spacy_tokens: This was the moment when it was necessary to decide how to approach the exploitation and unequal treatment of black subjects in Britain .


fn_spacy_tokens_for_baseline: All that is material to this case is what substantial evidence Frank has to back up his claim about Militant infiltration .

source_bert_toks: all that is material to this case is what substantial evidence frank has to back up his claim about militant in ##filtration .

reference_raw: All that matters in this case is the substantial evidence that Frank has to support his allegations about military infiltration.

reference_spacy_tokens: All that matters in this case is the substantial evidence that Frank has to support his allegations about military infiltration .


fn_spacy_tokens_for_baseline: The two sides scheduled seven meetings in July before a strike decision would be made , Bouris added .

source_bert_toks: the two sides scheduled seven meetings in july before a strike decision would be made , bo ##uri ##s added .

reference_raw: Bouris added that the two parties planned seven meetings in July before the strike decision was taken.

reference_spacy_tokens: Bouris added that the two parties planned seven meetings in July before the strike decision was taken .


fn_spacy_tokens_for_baseline: But there are also contrary examples : the frames around Velazquez 's paintings , for instance , do not harmonise in this way with the formal treatment of the paintings themselves .

source_bert_toks: but there are also contrary examples : the frames around ve ##la ##zquez ' s paintings , for instance , do not harmon ##ise in this way with the formal treatment of the paintings themselves .

reference_raw: However, there are also opposite examples: for example, the frames around Velazquez paintings do not harmonize in this way with the formal treatment of the paintings themselves.

reference_spacy_tokens: However , there are also opposite examples : for example , the frames around Velazquez paintings do not harmonize in this way with the formal treatment of the paintings themselves .


fn_spacy_tokens_for_baseline: Prior to 1932 , the pattern was nearly the opposite .

source_bert_toks: prior to 1932 , the pattern was nearly the opposite .

reference_raw: Before 1932, the pattern was almost the other way around.

reference_spacy_tokens: Before 1932 , the pattern was almost the other way around .


fn_spacy_tokens_for_baseline: These are songs stripped to their basics and then adorned with beautifully hooked melodies and harmonies .

source_bert_toks: these are songs stripped to their basics and then adorned with beautifully hooked melodies and harmonies .

reference_raw: These are songs stripped to the ground and then decorated with beautifully hooked tunes and harmony.

reference_spacy_tokens: These are songs stripped to the ground and then decorated with beautifully hooked tunes and harmony .


fn_spacy_tokens_for_baseline: The fourth managed to elude his pursuers by escaping into a bog where no horse could follow .

source_bert_toks: the fourth managed to el ##ude his pursue ##rs by escaping into a bog where no horse could follow .

reference_raw: The fourth managed to escape his pursuers by fleeing into the swamp where no horse could follow.

reference_spacy_tokens: The fourth managed to escape his pursuers by fleeing into the swamp where no horse could follow .


fn_spacy_tokens_for_baseline: Main picture : An outhouse was knocked down to create this spacious kitchen leading to an attractive breakfast area

source_bert_toks: main picture : an out ##house was knocked down to create this spacious kitchen leading to an attractive breakfast area

reference_raw: The main picture: an outdoor has been knocked down to create a spacious kitchen that leads to an attractive breakfast area.

reference_spacy_tokens: The main picture : an outdoor has been knocked down to create a spacious kitchen that leads to an attractive breakfast area .


fn_spacy_tokens_for_baseline: Similarly , the special relationship between Thatcher and Reagan was a meeting of ideologies , which in turn expressed congruent interests within a larger system of forces .

source_bert_toks: similarly , the special relationship between thatcher and reagan was a meeting of id ##eo ##logies , which in turn expressed cong ##ru ##ent interests within a larger system of forces .

reference_raw: Similarly, that particular relationship between Thatcher and Reagan was a meeting of ideologies that, in turn, expressed a common interest in a larger force system.

reference_spacy_tokens: Similarly , that particular relationship between Thatcher and Reagan was a meeting of ideologies that , in turn , expressed a common interest in a larger force system .


fn_spacy_tokens_for_baseline: Any lumberjack who was feeling sufficiently ill - disposed towards his fellow drinking companions could place on his shoulder a small chip of wood to indicate he would take on any man who cared to flick it off .

source_bert_toks: any lumber ##jack who was feeling sufficiently ill - disposed towards his fellow drinking companions could place on his shoulder a small chip of wood to indicate he would take on any man who cared to flick it off .

reference_raw: Any lumberjack who felt bad enough about his drinking companions could place a small piece of wood on his shoulder to indicate that he would take any man who wanted to throw it away.

reference_spacy_tokens: Any lumberjack who felt bad enough about his drinking companions could place a small piece of wood on his shoulder to indicate that he would take any man who wanted to throw it away .


fn_spacy_tokens_for_baseline: Perhaps you still think I 'm merely being vengeful towards a dead scholar who ca n't answer for herself .

source_bert_toks: perhaps you still think i ' m merely being ve ##nge ##ful towards a dead scholar who can ' t answer for herself .

reference_raw: Maybe you still think I'm just trying to get revenge on a dead scientist who can't answer for himself.

reference_spacy_tokens: Maybe you still think I 'm just trying to get revenge on a dead scientist who ca n't answer for himself .


fn_spacy_tokens_for_baseline: The drug lords who claimed responsibility said they would blow up the Bogota newspaper 's offices if it continued to distribute in Medellin .

source_bert_toks: the drug lords who claimed responsibility said they would blow up the bogota newspaper ' s offices if it continued to distribute in med ##elli ##n .

reference_raw: The drug masters who claimed responsibility said they'd blow up the offices of the Bogota newspapers if it continued to be distributed in Medellin.

reference_spacy_tokens: The drug masters who claimed responsibility said they 'd blow up the offices of the Bogota newspapers if it continued to be distributed in Medellin .


fn_spacy_tokens_for_baseline: Some still claimed the Fuhrer was not being told the truth by those around him , and received a far too rosy depiction of the situation .

source_bert_toks: some still claimed the fu ##hrer was not being told the truth by those around him , and received a far too rosy depiction of the situation .

reference_raw: Some still claimed that the Führer had not been told the truth by those around him, and had been given too pink a picture of the situation.

reference_spacy_tokens: Some still claimed that the Fuhrer had not been told the truth by those around him , and had been given too pink a picture of the situation .


fn_spacy_tokens_for_baseline: According to Friedersdorf , ' We knew we had to get our bills enacted before the Labor Day recess . '

source_bert_toks: according to fried ##ers ##dorf , ' we knew we had to get our bills enacted before the labor day recess . '

reference_raw: According to Friedersdorf, "We knew we had to have our accounts approved before the workday break."

reference_spacy_tokens: According to Friedersdorf , " We knew we had to have our accounts approved before the workday break . "


fn_spacy_tokens_for_baseline: Frederica slept in a windowless loft that held her suitcase , a camp bed , and no more .

source_bert_toks: frederic ##a slept in a window ##less loft that held her suitcase , a camp bed , and no more .

reference_raw: Frederica slept in the windowless attic with her suitcase in it, the camp bed, and no more.

reference_spacy_tokens: Frederica slept in the windowless attic with her suitcase in it , the camp bed , and no more .


fn_spacy_tokens_for_baseline: Firefighters Responsibilities : 1- Firefighting training 2- Evacuation training 3- Supervise the fire equipment in order to ensure : A : It remains in place B : Does not get damaged 4- Run some tests to identify the negatives .

source_bert_toks: firefighters responsibilities : 1 - fire ##fighting training 2 - evacuation training 3 - supervise the fire equipment in order to ensure : a : it remains in place b : does not get damaged 4 - run some tests to identify the negative ##s .

reference_raw: Firemen Responsibilities: 1-Firefighting training 2-Evacuation training 3-Supervise fire equipment to ensure: A: Stays in place B: Do not get damaged 4-Do some tests to detect negatives.

reference_spacy_tokens: Firemen Responsibilities : 1-Firefighting training 2-Evacuation training 3-Supervise fire equipment to ensure : A : Stays in place B : Do not get damaged 4-Do some tests to detect negatives .


fn_spacy_tokens_for_baseline: 1:11 a.m. RD : Building on the corner severely damaged , so an old lady and her very old mother are in the guest room .

source_bert_toks: 1 : 11 a . m . rd : building on the corner severely damaged , so an old lady and her very old mother are in the guest room .

reference_raw: 1:11 a.m. RD: The building on the corner is badly damaged, which means the old lady and her very old mother are in the guest room.

reference_spacy_tokens: 1:11 a.m. RD : The building on the corner is badly damaged , which means the old lady and her very old mother are in the guest room .


fn_spacy_tokens_for_baseline: I dare n't wear that nice fur coat that cousin Freda gave me in case I get bombed by the Animal Liberation Front .

source_bert_toks: i dare ##n ' t wear that nice fur coat that cousin fred ##a gave me in case i get bombed by the animal liberation front .

reference_raw: I don't dare wear that nice fur coat that my nephew Freda gave me in case the Animal Liberation Front bombed me.

reference_spacy_tokens: I do n't dare wear that nice fur coat that my nephew Freda gave me in case the Animal Liberation Front bombed me .


fn_spacy_tokens_for_baseline: Homer wrote his epic works on Chios ; and lyrical poetry was much admired , particularly the work of the poets Archilochos on Paros and Sappho on Lesvos .

source_bert_toks: homer wrote his epic works on chi ##os ; and lyrical poetry was much admired , particularly the work of the poets arch ##ilo ##cho ##s on par ##os and sap ##ph ##o on les ##vos .

reference_raw: Homer had written his impressive work on Chios; and lyrical poetry had been greatly admired, especially the work of the poets Archilochos on Paros and Sappho on Lesvos.

reference_spacy_tokens: Homer had written his impressive work on Chios ; and lyrical poetry had been greatly admired , especially the work of the poets Archilochos on Paros and Sappho on Lesvos .


fn_spacy_tokens_for_baseline: Besides , Botha does not defend , which is not really a problem because he stayed miles from his scrum - half , Du Preez , and made him look terrible with a slippery ball .

source_bert_toks: besides , both ##a does not defend , which is not really a problem because he stayed miles from his sc ##rum - half , du pre ##ez , and made him look terrible with a slippery ball .

reference_raw: Besides, Botha doesn't defend himself, which is no problem, because he stayed miles away from his crummy half, Du Preez, and made him look bad with a slippery ball.

reference_spacy_tokens: Besides , Botha does n't defend himself , which is no problem , because he stayed miles away from his crummy half , Du Preez , and made him look bad with a slippery ball .


fn_spacy_tokens_for_baseline: Kit car replicas arrive as a confusing jigsaw of pieces which have to be bolted together , often in the family garage .

source_bert_toks: kit car replica ##s arrive as a confusing ji ##gs ##aw of pieces which have to be bolted together , often in the family garage .

reference_raw: The replicas of the kits come as a confusing puzzle of pieces that have to be locked together, often in the family garage.

reference_spacy_tokens: The replicas of the kits come as a confusing puzzle of pieces that have to be locked together , often in the family garage .


fn_spacy_tokens_for_baseline: Can I book you a guest room until tomorrow ? '

source_bert_toks: can i book you a guest room until tomorrow ? '

reference_raw: Do you mind if I book you a visitor's room till tomorrow?'

reference_spacy_tokens: Do you mind if I book you a visitor 's room till tomorrow ? '


fn_spacy_tokens_for_baseline: The device is somehow congruous with the repeated images of hair like a shadow , beauty flying , leaves and years falling , through it all the hemlock of death .

source_bert_toks: the device is somehow cong ##ru ##ous with the repeated images of hair like a shadow , beauty flying , leaves and years falling , through it all the hem ##lock of death .

reference_raw: The device sort of fits with recurring images of hair, like shadow, beauty flying, leaves, and years falling, all the way through the hemlock of death.

reference_spacy_tokens: The device sort of fits with recurring images of hair , like shadow , beauty flying , leaves , and years falling , all the way through the hemlock of death .


fn_spacy_tokens_for_baseline: Even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

source_bert_toks: even at the best of times it was seldom working , and at present the electric current was cut off during daylight hours .

reference_raw: Even at the best of times, it rarely worked, and the current was now cut off during the daytime.

reference_spacy_tokens: Even at the best of times , it rarely worked , and the current was now cut off during the daytime .


fn_spacy_tokens_for_baseline: ' That 's my Granada over there by pump number two .

source_bert_toks: ' that ' s my granada over there by pump number two .

reference_raw: 'That's my grandmother at pump two.

reference_spacy_tokens: ' That 's my grandmother at pump two .


fn_spacy_tokens_for_baseline: There were fears that the crane could buckle due to the heat and collapse .

source_bert_toks: there were fears that the crane could buckle due to the heat and collapse .

reference_raw: He feared that the crane might buckle because of the heat and collapse.

reference_spacy_tokens: He feared that the crane might buckle because of the heat and collapse .


fn_spacy_tokens_for_baseline: Misch pointed to one of the boys who already bore two medals on the breast of his uniform .

source_bert_toks: mis ##ch pointed to one of the boys who already bore two medals on the breast of his uniform .

reference_raw: Misch pointed to one of the boys who were already wearing a pair of decorations on the breast of his uniform.

reference_spacy_tokens: Misch pointed to one of the boys who were already wearing a pair of decorations on the breast of his uniform .


fn_spacy_tokens_for_baseline: As mentioned , IBM has opted for the mouse stick in the middle of the keyboard instead of the little trackball or the little panel you diddle with your finger .

source_bert_toks: as mentioned , ibm has opted for the mouse stick in the middle of the keyboard instead of the little track ##ball or the little panel you did ##dle with your finger .

reference_raw: As mentioned above, IBM chose a mouse stick in the middle of the keyboard instead of a small trackball or a small panel that you did with your finger.

reference_spacy_tokens: As mentioned above , IBM chose a mouse stick in the middle of the keyboard instead of a small trackball or a small panel that you did with your finger .


fn_spacy_tokens_for_baseline: Never in my life have I been so frightened .

source_bert_toks: never in my life have i been so frightened .

reference_raw: I've never been so scared in my life.

reference_spacy_tokens: I 've never been so scared in my life .


fn_spacy_tokens_for_baseline: Archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

source_bert_toks: archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

reference_raw: Archaeology shows that, during that period, companies lived mainly in coastal trading cities with a small population inland.

reference_spacy_tokens: Archaeology shows that , during that period , companies lived mainly in coastal trading cities with a small population inland .


fn_spacy_tokens_for_baseline: In about a.d . 30 he and his followers went for Passover to Jerusalem , which was in unrest at this time , dissatisfied with Roman domination .

source_bert_toks: in about a . d . 30 he and his followers went for pass ##over to jerusalem , which was in unrest at this time , dissatisfied with roman domination .

reference_raw: About thirty years later, he and his followers went to Jerusalem for Passover, which was in turmoil at the time, dissatisfied with Roman rule.

reference_spacy_tokens: About thirty years later , he and his followers went to Jerusalem for Passover , which was in turmoil at the time , dissatisfied with Roman rule .


fn_spacy_tokens_for_baseline: Patti is the one with the details , I 'm just the deal maker and do n't have access to any of the systems .

source_bert_toks: patti is the one with the details , i ' m just the deal maker and don ' t have access to any of the systems .

reference_raw: Patti's the one with the specifics, I'm just a businessman, and I don't have access to any system.

reference_spacy_tokens: Patti 's the one with the specifics , I 'm just a businessman , and I do n't have access to any system .


fn_spacy_tokens_for_baseline: Panoramic vistas open on to galaxies more immense than human minds can contemplate .

source_bert_toks: pan ##ora ##mic vista ##s open on to galaxies more immense than human minds can con ##tem ##plate .

reference_raw: Panoramic vistas open to galaxies far greater than the human mind can imagine.

reference_spacy_tokens: Panoramic vistas open to galaxies far greater than the human mind can imagine .


fn_spacy_tokens_for_baseline: Thessy gasped at such blasphemy , while I scowled at Ellen 's blackmail .

source_bert_toks: the ##ss ##y gasped at such b ##las ##ph ##emy , while i scowled at ellen ' s blackmail .

reference_raw: As I frowned at Ellen's extortion, Thessy sighed with such blasphemy.

reference_spacy_tokens: As I frowned at Ellen 's extortion , Thessy sighed with such blasphemy .


fn_spacy_tokens_for_baseline: When the free - kick eventually took place , Irwin sidestepped a defender and squared the ball for Paul Ince , whose shot was blocked by Monkou .

source_bert_toks: when the free - kick eventually took place , irwin sides ##te ##pped a defender and squared the ball for paul inc ##e , whose shot was blocked by monk ##ou .

reference_raw: When the free kick finally took place, Irwin backed up the defender and squared the ball for Paul Ince, who had been blocked by Monkou.

reference_spacy_tokens: When the free kick finally took place , Irwin backed up the defender and squared the ball for Paul Ince , who had been blocked by Monkou .


fn_spacy_tokens_for_baseline: Wall mounted Honeywell central heating thermostat . 2 windows to either side aspect , making this a very light and airy room .

source_bert_toks: wall mounted honey ##well central heating the ##rm ##osta ##t . 2 windows to either side aspect , making this a very light and air ##y room .

reference_raw: The wall mounted Honeywell Central Heating Thermostat. Two windows on both sides, making it a very bright and airy room.

reference_spacy_tokens: The wall mounted Honeywell Central Heating Thermostat . Two windows on both sides , making it a very bright and airy room .


fn_spacy_tokens_for_baseline: Now he 's overboard for France , and spells his name with a ' c ' instead of a ' k ' .

source_bert_toks: now he ' s overboard for france , and spells his name with a ' c ' instead of a ' k ' .

reference_raw: He's overboard for France now, and he writes his name with a 'c' instead of a 'k'.

reference_spacy_tokens: He 's overboard for France now , and he writes his name with a ' c ' instead of a ' k ' .


fn_spacy_tokens_for_baseline: ' We were rather brusque and offhand with her when she came in that first time , ' Waterman remembered .

source_bert_toks: ' we were rather br ##us ##que and off ##hand with her when she came in that first time , ' water ##man remembered .

reference_raw: 'When she first came here, we were pretty rough and off-limits,' Waterman said.

reference_spacy_tokens: ' When she first came here , we were pretty rough and off - limits , ' Waterman said .


fn_spacy_tokens_for_baseline: In his lifetime an obscure figure ( he was ignored by contemporary obituarists ) , he became known in the twentieth century through the publication of his Diaries , journals of horseback tours through England and Wales .

source_bert_toks: in his lifetime an obscure figure ( he was ignored by contemporary ob ##it ##ua ##rist ##s ) , he became known in the twentieth century through the publication of his diaries , journals of horseback tours through england and wales .

reference_raw: In his life, a shadowy figure (he was ignored by the current obituarists) became known in the twentieth century through the publication of his newspapers and magazines on horseback tours in England and Wales.

reference_spacy_tokens: In his life , a shadowy figure ( he was ignored by the current obituarists ) became known in the twentieth century through the publication of his newspapers and magazines on horseback tours in England and Wales .


fn_spacy_tokens_for_baseline: An artist appointed to depict life along the River Tees will be working at the Gray Art Gallery and Museum in Hartlepool during March and April .

source_bert_toks: an artist appointed to depict life along the river tee ##s will be working at the gray art gallery and museum in hart ##le ##pool during march and april .

reference_raw: The artist appointed to represent life along the River Tees will work at the Gray Art Gallery and Museum in Hartlepool in March and April.

reference_spacy_tokens: The artist appointed to represent life along the River Tees will work at the Gray Art Gallery and Museum in Hartlepool in March and April .


fn_spacy_tokens_for_baseline: You want to do the things other girls do , like making yourself cheap , going to discos , letting those louts paw you ?

source_bert_toks: you want to do the things other girls do , like making yourself cheap , going to disco ##s , letting those lou ##ts paw you ?

reference_raw: Do you want to do what other girls do, like make yourself cheap, go to discos, get your hands on you?

reference_spacy_tokens: Do you want to do what other girls do , like make yourself cheap , go to discos , get your hands on you ?


fn_spacy_tokens_for_baseline: Meanwhile , in London , motorists fumed as the M4 the main artery to Heathrow and the West was shut when concrete joints buckled in the heat .

source_bert_toks: meanwhile , in london , motor ##ists fu ##med as the m ##4 the main artery to heath ##row and the west was shut when concrete joints buckled in the heat .

reference_raw: In London, motorists smoked as the M4 main artery to Heathrow and the West closed when the concrete joints buckled in the heat.

reference_spacy_tokens: In London , motorists smoked as the M4 main artery to Heathrow and the West closed when the concrete joints buckled in the heat .


fn_spacy_tokens_for_baseline: If we turned up an hour late for a function in England we would be hammered by everybody . '

source_bert_toks: if we turned up an hour late for a function in england we would be hammered by everybody . '

reference_raw: If we show up an hour late for a job in England, everyone's gonna beat us up.'

reference_spacy_tokens: If we show up an hour late for a job in England , everyone 's gon na beat us up . '


fn_spacy_tokens_for_baseline: ' That 's the bathroom , ' he said , vaguely indicating a door to the right behind which , we were to discover , an array of ancient pipework gurgled and glugged .

source_bert_toks: ' that ' s the bathroom , ' he said , vaguely indicating a door to the right behind which , we were to discover , an array of ancient pipe ##work gu ##rg ##led and g ##lu ##gged .

reference_raw: "This is the bathroom," he said, vaguely pointing to the door to the right, behind which, as we were to see, a series of ancient pipeworks grumbled and gagged.

reference_spacy_tokens: " This is the bathroom , " he said , vaguely pointing to the door to the right , behind which , as we were to see , a series of ancient pipeworks grumbled and gagged .


fn_spacy_tokens_for_baseline: Although Ratagan was beclouded , the sun shone through behind me , putting a shine on the slate - coloured waters below .

source_bert_toks: although rat ##aga ##n was be ##cl ##oud ##ed , the sun shone through behind me , putting a shine on the slate - coloured waters below .

reference_raw: Though Ratagan was clouded, the sun shone behind me and shone on the slate-colored water below.

reference_spacy_tokens: Though Ratagan was clouded , the sun shone behind me and shone on the slate - colored water below .


fn_spacy_tokens_for_baseline: Their behaviour patterns may be consistent with the dominant culture or may differ from it .

source_bert_toks: their behaviour patterns may be consistent with the dominant culture or may differ from it .

reference_raw: Their behavioural patterns may or may differ from the dominant culture.

reference_spacy_tokens: Their behavioural patterns may or may differ from the dominant culture .


fn_spacy_tokens_for_baseline: I ca n't say I feel much sympathy for them .

source_bert_toks: i can ' t say i feel much sympathy for them .

reference_raw: I can't say I sympathize with them.

reference_spacy_tokens: I ca n't say I sympathize with them .


fn_spacy_tokens_for_baseline: 5- Direct the visitors ' cars to special parking spots , away from the fence and the control tower .

source_bert_toks: 5 - direct the visitors ' cars to special parking spots , away from the fence and the control tower .

reference_raw: 5-Redirect the visitors' cars to special parking spaces, away from the fence and the control tower.

reference_spacy_tokens: 5-Redirect the visitors ' cars to special parking spaces , away from the fence and the control tower .


fn_spacy_tokens_for_baseline: I do n't know if they will make it but , either way , I doubt if I will see him again .

source_bert_toks: i don ' t know if they will make it but , either way , i doubt if i will see him again .

reference_raw: I don't know if they can, but anyway, I don't think I'll ever see him again.

reference_spacy_tokens: I do n't know if they can , but anyway , I do n't think I 'll ever see him again .


fn_spacy_tokens_for_baseline: 12 - 3 - 1892 The classes were not held owing to the amount of sickness in the district .

source_bert_toks: 12 - 3 - 1892 the classes were not held owing to the amount of sickness in the district .

reference_raw: 12-3-1892 Due to the number of diseases in the district, the classes were not held.

reference_spacy_tokens: 12 - 3 - 1892 Due to the number of diseases in the district , the classes were not held .


fn_spacy_tokens_for_baseline: If in Japan the railway symbolized the country 's rapid response to Western power and influence , Chinese resistance to the West was characterized by an often violent antipathy to railways .

source_bert_toks: if in japan the railway symbol ##ized the country ' s rapid response to western power and influence , chinese resistance to the west was characterized by an often violent anti ##pathy to railways .

reference_raw: If the railroad in Japan symbolizes the country's fast response to Western power and influence, Chinese resistance to the West is characterised by a often violent antipathy to railroads.

reference_spacy_tokens: If the railroad in Japan symbolizes the country 's fast response to Western power and influence , Chinese resistance to the West is characterised by a often violent antipathy to railroads .


fn_spacy_tokens_for_baseline: During the sharp decline in strike activity which accompanied the industrial downturn of 1899 - 1901 , worker - intelligentsia contact withered as the revolutionaries became absorbed in internal party bickering .

source_bert_toks: during the sharp decline in strike activity which accompanied the industrial down ##turn of 1899 - 1901 , worker - intelligent ##sia contact with ##ered as the revolutionaries became absorbed in internal party bi ##cker ##ing .

reference_raw: During the sharp decline in strike activity that accompanied the industrial downturn of 1899-1901, the contact between workers and intelligence withered as the revolutionaries became absorbed in internal party squabbling.

reference_spacy_tokens: During the sharp decline in strike activity that accompanied the industrial downturn of 1899 - 1901 , the contact between workers and intelligence withered as the revolutionaries became absorbed in internal party squabbling .


fn_spacy_tokens_for_baseline: " I can not conceal my elation that the surgery is completed , " said Bishop Raymond E. Goedert , who will fill in during Bernardin 's recuperation .

source_bert_toks: " i can not conceal my el ##ation that the surgery is completed , " said bishop raymond e . go ##ede ##rt , who will fill in during bernard ##in ' s rec ##up ##eration .

reference_raw: "I can't hide my enthusiasm for the end of the operation," Bishop Raymond E. Goedert said, filling in for Bernardin's recovery.

reference_spacy_tokens: " I ca n't hide my enthusiasm for the end of the operation , " Bishop Raymond E. Goedert said , filling in for Bernardin 's recovery .


fn_spacy_tokens_for_baseline: They farmed sheep and pigs and cattle and lived in homesteads .

source_bert_toks: they farm ##ed sheep and pigs and cattle and lived in homestead ##s .

reference_raw: They farmed sheep and pigs and cattle and lived in their own homes.

reference_spacy_tokens: They farmed sheep and pigs and cattle and lived in their own homes .


fn_spacy_tokens_for_baseline: A barmaid who cudgelled her landlord boyfriend to death with a beer flagon has been sentenced to eighteen months imprisonment ( suspended ) .

source_bert_toks: a bar ##maid who cu ##dge ##lled her landlord boyfriend to death with a beer flag ##on has been sentenced to eighteen months imprisonment ( suspended ) .

reference_raw: The bartender who cuddled her landlord's friend to death with a beer bottle was sentenced to 18 months in prison (suspension).

reference_spacy_tokens: The bartender who cuddled her landlord 's friend to death with a beer bottle was sentenced to 18 months in prison ( suspension ) .


fn_spacy_tokens_for_baseline: On this particular day , they had been shooting at Taos and at the end of it they dropped some acid and took off with two other friends to visit the nearby tomb of D.H. Lawrence .

source_bert_toks: on this particular day , they had been shooting at tao ##s and at the end of it they dropped some acid and took off with two other friends to visit the nearby tomb of d . h . lawrence .

reference_raw: On that very day they were shooting at Taos, and at the end of it they dropped a little sour and went off with two other friends to visit the nearby tomb of D.H. Lawrence.

reference_spacy_tokens: On that very day they were shooting at Taos , and at the end of it they dropped a little sour and went off with two other friends to visit the nearby tomb of D.H. Lawrence .


fn_spacy_tokens_for_baseline: In the wake of Dutskche 's wounding in Berlin the Nanterre students descended on the Sorbonne , the ancient university of Paris .

source_bert_toks: in the wake of du ##tsk ##che ' s wounding in berlin the nan ##ter ##re students descended on the sorbonne , the ancient university of paris .

reference_raw: After Dutsche's injuries in Berlin, the students of Nanterre came down to Sorbonne, the ancient University of Paris.

reference_spacy_tokens: After Dutsche 's injuries in Berlin , the students of Nanterre came down to Sorbonne , the ancient University of Paris .


fn_spacy_tokens_for_baseline: The tram clanged its bell and rattled off angrily into the gloom .

source_bert_toks: the tram clan ##ged its bell and rattled off angrily into the gloom .

reference_raw: The tram rang its bell and rattled furiously into the darkness.

reference_spacy_tokens: The tram rang its bell and rattled furiously into the darkness .


fn_spacy_tokens_for_baseline: ' With or without a reason , they conduct sweeps , take people away , maim them , and then as a rule their relatives have to buy them back , ' Aslakhanov says .

source_bert_toks: ' with or without a reason , they conduct sweeps , take people away , mai ##m them , and then as a rule their relatives have to buy them back , ' as ##lak ##han ##ov says .

reference_raw: 'They do searches with or without reason, take people away, mutilate them, and then, as a rule, their relatives have to buy them back,' said Aslakhanov.

reference_spacy_tokens: ' They do searches with or without reason , take people away , mutilate them , and then , as a rule , their relatives have to buy them back , ' said Aslakhanov .


fn_spacy_tokens_for_baseline: The remains of the 17th - century Barra Fortress , which once defended the southern tip of the peninsula , contains the chapel of Santiago ( St. James ) .

source_bert_toks: the remains of the 17th - century barr ##a fortress , which once defended the southern tip of the peninsula , contains the chapel of santiago ( st . james ) .

reference_raw: The remnants of the Fortress of the 17th-century Barra, which once defended the south end of the peninsula, contain the chapel of Santiago (St. James).

reference_spacy_tokens: The remnants of the Fortress of the 17th - century Barra , which once defended the south end of the peninsula , contain the chapel of Santiago ( St. James ) .


fn_spacy_tokens_for_baseline: The attempt to portray Reagan as an extremist , meanwhile , failed in the face of his likeability .

source_bert_toks: the attempt to portray reagan as an ex ##tre ##mist , meanwhile , failed in the face of his like ##ability .

reference_raw: In the meantime, the attempt to depict Reagan as an extremist failed in the face of his similarity.

reference_spacy_tokens: In the meantime , the attempt to depict Reagan as an extremist failed in the face of his similarity .


fn_spacy_tokens_for_baseline: The people who can benefit most directly from your generosity have no time to waste .

source_bert_toks: the people who can benefit most directly from your generosity have no time to waste .

reference_raw: People who benefit most directly from your generosity don't have time to lose.

reference_spacy_tokens: People who benefit most directly from your generosity do n't have time to lose .


fn_spacy_tokens_for_baseline: How uncommonly civil of him to make such a co - operative and hospitable offer !

source_bert_toks: how uncommon ##ly civil of him to make such a co - operative and ho ##sp ##ita ##ble offer !

reference_raw: How unusually polite of him to make such a cooperative and hospitable offer!

reference_spacy_tokens: How unusually polite of him to make such a cooperative and hospitable offer !


fn_spacy_tokens_for_baseline: Some were dragged out of their cars and butchered by angry crowds in the street .

source_bert_toks: some were dragged out of their cars and butcher ##ed by angry crowds in the street .

reference_raw: Some of them had been pulled out of their cars and slaughtered in the street by angry mobs.

reference_spacy_tokens: Some of them had been pulled out of their cars and slaughtered in the street by angry mobs .


fn_spacy_tokens_for_baseline: During 19 - 21 April 2004 , North Korean National Defense Commission Chairman Kim Jong Il visited China and reportedly told Chinese President Hu Jintao that " the DRPK side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

source_bert_toks: during 19 - 21 april 2004 , north korean national defense commission chairman kim jong il visited china and reportedly told chinese president hu jin ##tao that " the dr ##p ##k side will continue to adopt a patient and flexible manner and actively participate in the six - party talks process , and make its own contributions to the progress of the talks . "

reference_raw: In the course of 19-21 April 2004, Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that "the DRPK Party will continue to take a patient and flexible approach and actively participate in the six-party talks process and contribute to the process of the negotiations."

reference_spacy_tokens: In the course of 19 - 21 April 2004 , Chairman of the North Korean National Defence Commission Kim Jong II visited China and reportedly informed Chinese President Hu Jintao that " the DRPK Party will continue to take a patient and flexible approach and actively participate in the six - party talks process and contribute to the process of the negotiations . "


fn_spacy_tokens_for_baseline: Faith was done with old - fashioned equipment ; we needed more equipment to do the water - crossings ahead .

source_bert_toks: faith was done with old - fashioned equipment ; we needed more equipment to do the water - crossings ahead .

reference_raw: Faith was finished with old-fashioned equipment; we needed more equipment to cross the water in front of us.

reference_spacy_tokens: Faith was finished with old - fashioned equipment ; we needed more equipment to cross the water in front of us .


fn_spacy_tokens_for_baseline: As reprehensible are provisions enabling the Secretary of State to make ( to use a favourite phrase ) ' such supplementary , incidental or consequential provisions as may be expedient for the purposes ' of the Act .

source_bert_toks: as rep ##re ##hen ##sible are provisions enabling the secretary of state to make ( to use a favourite phrase ) ' such supplementary , incident ##al or con ##se ##quent ##ial provisions as may be ex ##ped ##ient for the purposes ' of the act .

reference_raw: As reprehensive are provisions which allow the Secretary of State to make (using a favorite phrase) such supplementary, incidental or subsequent provisions as may be appropriate for the purposes of the Act.

reference_spacy_tokens: As reprehensive are provisions which allow the Secretary of State to make ( using a favorite phrase ) such supplementary , incidental or subsequent provisions as may be appropriate for the purposes of the Act .


fn_spacy_tokens_for_baseline: There we are , in Lundhags , a Swedish boot that is wonderful for its purpose but looks like a refugee prop from a Boris Karloff Frankenstein film , and oddly coloured clothes , rolling about .

source_bert_toks: there we are , in lund ##ha ##gs , a swedish boot that is wonderful for its purpose but looks like a refugee prop from a boris karl ##off frankenstein film , and oddly coloured clothes , rolling about .

reference_raw: There's a Swedish shoe in Lundhags that's beautiful for its purpose, but it looks like a refugee prop from a Boris Karloff Frankenstein movie, and oddly colored clothing that rolls around.

reference_spacy_tokens: There 's a Swedish shoe in Lundhags that 's beautiful for its purpose , but it looks like a refugee prop from a Boris Karloff Frankenstein movie , and oddly colored clothing that rolls around .


fn_spacy_tokens_for_baseline: Sophronia 's behaviour is , then , linked to a belittling of Leapor 's poetry .

source_bert_toks: so ##ph ##ronia ' s behaviour is , then , linked to a bel ##itt ##ling of leap ##or ' s poetry .

reference_raw: Sophronia's behavior is associated with the confusion of Leapor's poetry.

reference_spacy_tokens: Sophronia 's behavior is associated with the confusion of Leapor 's poetry .


fn_spacy_tokens_for_baseline: Maybe you 'll feel like a drink after that .

source_bert_toks: maybe you ' ll feel like a drink after that .

reference_raw: Then maybe you'll feel drunk.

reference_spacy_tokens: Then maybe you 'll feel drunk .


fn_spacy_tokens_for_baseline: In tests at Linkoping University the paint removed around 80 per cent of smelly chemicals -- absorbing them through tiny pores .

source_bert_toks: in tests at link ##oping university the paint removed around 80 per cent of smell ##y chemicals - - absorbing them through tiny por ##es .

reference_raw: In the tests at Linkoping University, the paint removed about 80 percent of the scented chemicals, absorbing them with tiny pores.

reference_spacy_tokens: In the tests at Linkoping University , the paint removed about 80 percent of the scented chemicals , absorbing them with tiny pores .


fn_spacy_tokens_for_baseline: Hours of wrangling over the protocol of such matters was squandered during both the preparation and the course of the pair 's ceaseless round of state visits to ever more obscure countries .

source_bert_toks: hours of wr ##ang ##ling over the protocol of such matters was sq ##uan ##der ##ed during both the preparation and the course of the pair ' s cease ##less round of state visits to ever more obscure countries .

reference_raw: During both the preparation and the incessant round of state visits to ever more obscure countries, hours of twisting over the protocol of such matters had been wasted.

reference_spacy_tokens: During both the preparation and the incessant round of state visits to ever more obscure countries , hours of twisting over the protocol of such matters had been wasted .


fn_spacy_tokens_for_baseline: She tells me that the 3,666 people we helped find jobs in 1998 earned approximately $ 49 million dollars .

source_bert_toks: she tells me that the 3 , 66 ##6 people we helped find jobs in 1998 earned approximately $ 49 million dollars .

reference_raw: She told me that the 3666 people we helped find a job in 1998 made about $49 million.

reference_spacy_tokens: She told me that the 3666 people we helped find a job in 1998 made about $ 49 million .


fn_spacy_tokens_for_baseline: The recreational pleasures that ordinary islanders enjoy have become synonymous with the name Jamaica : dancing to the heavily rhythmic musical beat ; taking a little marijuana ( or " ganja , " as it 's known here ) , which many Jamaicans view as a kind of medicinal herb ; or simply sitting back and chatting with friends on a bench or street corner , where the situation is described as " Irie " the equivalent of " Everything 's just fine ! "

source_bert_toks: the recreational pleasures that ordinary islanders enjoy have become synonymous with the name jamaica : dancing to the heavily rhythmic musical beat ; taking a little marijuana ( or " gan ##ja , " as it ' s known here ) , which many jamaican ##s view as a kind of medicinal herb ; or simply sitting back and chatting with friends on a bench or street corner , where the situation is described as " ir ##ie " the equivalent of " everything ' s just fine ! "

reference_raw: Recreational pleasures enjoyed by ordinary islanders became synonymous with the name Jamaica: dancing to a very rhythmic musical rhythm; taking a bit of marijuana (or "ganja," as it is known here), which many Jamaicans view as some sort of medicinal herb; or simply sitting and chatting with friends on a bench or street corner, where the situation is described as "Irie" the equivalent of "Everything". All right!

reference_spacy_tokens: Recreational pleasures enjoyed by ordinary islanders became synonymous with the name Jamaica : dancing to a very rhythmic musical rhythm ; taking a bit of marijuana ( or " ganja , " as it is known here ) , which many Jamaicans view as some sort of medicinal herb ; or simply sitting and chatting with friends on a bench or street corner , where the situation is described as " Irie " the equivalent of " Everything " . All right !


fn_spacy_tokens_for_baseline: She found her mother 's wedding shoes , and her headpiece and veil as well .

source_bert_toks: she found her mother ' s wedding shoes , and her head ##piece and veil as well .

reference_raw: She found her mother's wedding boots, her headphones, and her veil.

reference_spacy_tokens: She found her mother 's wedding boots , her headphones , and her veil .


fn_spacy_tokens_for_baseline: As Peter looked outward , he was able to motivate others to change their perspective too .

source_bert_toks: as peter looked outward , he was able to mo ##tiv ##ate others to change their perspective too .

reference_raw: As Peter looked out, he could encourage others to change their perspectives.

reference_spacy_tokens: As Peter looked out , he could encourage others to change their perspectives .


fn_spacy_tokens_for_baseline: If you parted the net curtains and peered sideways and upwards you could see one tiny piece of bright blue sky , but you might pull a muscle doing it .

source_bert_toks: if you parted the net curtains and peered sideways and upwards you could see one tiny piece of bright blue sky , but you might pull a muscle doing it .

reference_raw: If you opened the net curtains and looked up and down, you could see a tiny bit of bright blue sky, but you could get a muscle to do it.

reference_spacy_tokens: If you opened the net curtains and looked up and down , you could see a tiny bit of bright blue sky , but you could get a muscle to do it .


fn_spacy_tokens_for_baseline: In 1238 Alexander III 's father promised me the crown but then he married again and begat Alexander , the third of that name , and the up was dashed from my lips .

source_bert_toks: in 123 ##8 alexander iii ' s father promised me the crown but then he married again and beg ##at alexander , the third of that name , and the up was dashed from my lips .

reference_raw: In 1238, Alexander III's father promised me a crown, but then he remarried and began Alexander, the third of his name, and I threw the crown out of my mouth.

reference_spacy_tokens: In 1238 , Alexander III 's father promised me a crown , but then he remarried and began Alexander , the third of his name , and I threw the crown out of my mouth .


fn_spacy_tokens_for_baseline: The kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compounded by factors like physical and mental disabilities , illiteracy and lack of job skills .

source_bert_toks: the kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compound ##ed by factors like physical and mental disabilities , ill ##iter ##acy and lack of job skills .

reference_raw: What we provide helps people to tackle obstacles such as health care, transport and childcare - problems that are large enough in themselves, without being compounded by factors such as physical and mental handicaps, illiteracy and lack of employment skills.

reference_spacy_tokens: What we provide helps people to tackle obstacles such as health care , transport and childcare - problems that are large enough in themselves , without being compounded by factors such as physical and mental handicaps , illiteracy and lack of employment skills .


fn_spacy_tokens_for_baseline: A large cat was seen in November 1989 , and police marksmen hunted the animal for several days .

source_bert_toks: a large cat was seen in november 1989 , and police marks ##men hunted the animal for several days .

reference_raw: In November 1989, a big cat was seen, and police shooters chased it for a few days.

reference_spacy_tokens: In November 1989 , a big cat was seen , and police shooters chased it for a few days .


fn_spacy_tokens_for_baseline: I might abuse my kids , but where 's the harm in that ?

source_bert_toks: i might abuse my kids , but where ' s the harm in that ?

reference_raw: I could take advantage of my children, but what's wrong with it?

reference_spacy_tokens: I could take advantage of my children , but what 's wrong with it ?