fn_spacy_tokens_for_baseline: A QAO log is also created for any installed Pmodel module and holds records of any installations and deinstallations occurring under the module name .

source_bert_toks: a q ##ao log is also created for any installed pm ##ode ##l module and holds records of any installations and dei ##nst ##alla ##tions occurring under the module name .

reference_raw: The QAO protocol is also created for all installed Pmodel modules and has records of all installations and deinstallations that occur under the module name.

reference_spacy_tokens: The QAO protocol is also created for all installed Pmodel modules and has records of all installations and deinstallations that occur under the module name .


fn_spacy_tokens_for_baseline: She pronounces the word ' damn ' with a little gurgle of amusement : ' Dem cheek .

source_bert_toks: she pro ##no ##unce ##s the word ' damn ' with a little gu ##rg ##le of amusement : ' dem cheek .

reference_raw: He pronounces the word "damn" with a bit of amusement: "Dem Face.

reference_spacy_tokens: He pronounces the word " damn " with a bit of amusement : " Dem Face .


fn_spacy_tokens_for_baseline: They made a long , unhurried descent .

source_bert_toks: they made a long , un ##hur ##ried descent .

reference_raw: They descended long, unhurriedly.

reference_spacy_tokens: They descended long , unhurriedly .


fn_spacy_tokens_for_baseline: More than that , it was ' one of the most important classical art forgeries ever discovered ' .

source_bert_toks: more than that , it was ' one of the most important classical art forge ##ries ever discovered ' .

reference_raw: What's more, it was 'one of the most important classic art counterfeits ever discovered'.

reference_spacy_tokens: What 's more , it was ' one of the most important classic art counterfeits ever discovered ' .


fn_spacy_tokens_for_baseline: ' He stinks too , and those clothes must be crawling .

source_bert_toks: ' he stink ##s too , and those clothes must be crawling .

reference_raw: 'It smells, too, and the clothes must be crawling.

reference_spacy_tokens: ' It smells , too , and the clothes must be crawling .


fn_spacy_tokens_for_baseline: Then he had sent her off to the lingerie department with the assistant , admonishing her to choose the prettiest undergarments .

source_bert_toks: then he had sent her off to the linger ##ie department with the assistant , ad ##mon ##ishing her to choose the pre ##tti ##est under ##gar ##ments .

reference_raw: Then he and his assistant sent her to the underwear department and told her to pick out the most beautiful underwear.

reference_spacy_tokens: Then he and his assistant sent her to the underwear department and told her to pick out the most beautiful underwear .


fn_spacy_tokens_for_baseline: I remember a sensation of being above myself , certainly not in my body anyway .

source_bert_toks: i remember a sensation of being above myself , certainly not in my body anyway .

reference_raw: I remember feeling like I was above myself, definitely not in my body.

reference_spacy_tokens: I remember feeling like I was above myself , definitely not in my body .


fn_spacy_tokens_for_baseline: It moved slowly and she cursed herself for having forgotten her gloves and scarf .

source_bert_toks: it moved slowly and she cursed herself for having forgotten her gloves and scarf .

reference_raw: She moved slowly, cursing herself for leaving her gloves and scarf behind.

reference_spacy_tokens: She moved slowly , cursing herself for leaving her gloves and scarf behind .


fn_spacy_tokens_for_baseline: The hypopharynx is well adapted to the presence of a foreign body , and insertion of the laryngeal mask can easily be achieved in awake patients under topical anaesthesia and sedation .

source_bert_toks: the h ##yp ##op ##har ##yn ##x is well adapted to the presence of a foreign body , and insertion of the la ##ryn ##ge ##al mask can easily be achieved in awake patients under topical ana ##esthesia and se ##dation .

reference_raw: Hypopharynx is well adapted to the presence of a foreign body and inserting a laryngeal mask can easily be achieved in awake patients under local anaesthesia and sedation.

reference_spacy_tokens: Hypopharynx is well adapted to the presence of a foreign body and inserting a laryngeal mask can easily be achieved in awake patients under local anaesthesia and sedation .


fn_spacy_tokens_for_baseline: ' I do n't care what anyone says , Craig would n't stoop to thieving , I just know he would n't .

source_bert_toks: ' i don ' t care what anyone says , craig wouldn ' t st ##oop to th ##ieving , i just know he wouldn ' t .

reference_raw: I don't care what anybody says, Craig wouldn't stoop to stealing, I just know he wouldn't do it.

reference_spacy_tokens: I do n't care what anybody says , Craig would n't stoop to stealing , I just know he would n't do it .


fn_spacy_tokens_for_baseline: There was lack of comprehension at how it could have happened and why the 63th Army could not have been relieved , and little consolation for bereaved relatives in the official interpretation of ' heroic sacrifice ' .

source_bert_toks: there was lack of comprehension at how it could have happened and why the 63 ##th army could not have been relieved , and little consolation for be ##rea ##ved relatives in the official interpretation of ' heroic sacrifice ' .

reference_raw: There was a lack of understanding of how this could happen and why the 63th Army couldn't be relieved, and there was little comfort in the official interpretation of 'heroic sacrifice' for bereaved relatives.

reference_spacy_tokens: There was a lack of understanding of how this could happen and why the 63th Army could n't be relieved , and there was little comfort in the official interpretation of ' heroic sacrifice ' for bereaved relatives .


fn_spacy_tokens_for_baseline: Inspector Blakelock 's hand enveloped the receiver .

source_bert_toks: inspector blake ##lock ' s hand enveloped the receiver .

reference_raw: Inspector Blakelock wrapped his hand around the phone.

reference_spacy_tokens: Inspector Blakelock wrapped his hand around the phone .


fn_spacy_tokens_for_baseline: That shift , together with the emphasis on ' the right team " leadership and traditional Tory reserves of loyalty , undoubtedly helped the party to fend off the week 's much - resented media attention to division and disarray .

source_bert_toks: that shift , together with the emphasis on ' the right team " leadership and traditional tory reserves of loyalty , undoubtedly helped the party to fen ##d off the week ' s much - resented media attention to division and di ##sar ##ray .

reference_raw: This shift, coupled with the emphasis on "the right team" leadership and traditional Tory loyalties reserves, undoubtedly helped the party avoid a week's much-resented media attention to division and confusion.

reference_spacy_tokens: This shift , coupled with the emphasis on " the right team " leadership and traditional Tory loyalties reserves , undoubtedly helped the party avoid a week 's much - resented media attention to division and confusion .


fn_spacy_tokens_for_baseline: The Tellsplatte lies at the base of the Axenberg mount , part of the precipitous east face of the Urner See .

source_bert_toks: the tells ##pl ##att ##e lies at the base of the axe ##nberg mount , part of the pre ##ci ##pit ##ous east face of the ur ##ner see .

reference_raw: The Tellsplatte lies at the base of the Axenberg horse, part of the precipitous eastern face of the Urner See.

reference_spacy_tokens: The Tellsplatte lies at the base of the Axenberg horse , part of the precipitous eastern face of the Urner See .


fn_spacy_tokens_for_baseline: Mr Stead was middle - aged and paunchy , with deep shadows under his eyes and square rimless glasses .

source_bert_toks: mr ste ##ad was middle - aged and pau ##nch ##y , with deep shadows under his eyes and square rim ##less glasses .

reference_raw: Mr. Stead was middle-aged and sturdy, with deep shadows under his eyes and square rimless spectacles.

reference_spacy_tokens: Mr. Stead was middle - aged and sturdy , with deep shadows under his eyes and square rimless spectacles .


fn_spacy_tokens_for_baseline: Gradually one theory becomes dominant and ousts all the others , and scientific research proceeds within the framework ( ' paradigm ' ) of that one theory .

source_bert_toks: gradually one theory becomes dominant and ou ##sts all the others , and scientific research proceeds within the framework ( ' paradigm ' ) of that one theory .

reference_raw: Gradually, one theory becomes dominant and expels all other theories, and scientific research proceeds within the ("paradigm") framework of this one theory.

reference_spacy_tokens: Gradually , one theory becomes dominant and expels all other theories , and scientific research proceeds within the ( " paradigm " ) framework of this one theory .


fn_spacy_tokens_for_baseline: Here the outer movements had a sense of commendable urgency and there was a nobility about the slow movement which was memorable .

source_bert_toks: here the outer movements had a sense of com ##men ##dable urgency and there was a nobility about the slow movement which was memorable .

reference_raw: There was a sense of laudable urgency in the outer movements, and there was a nobility in the slow motion that was unforgettable.

reference_spacy_tokens: There was a sense of laudable urgency in the outer movements , and there was a nobility in the slow motion that was unforgettable .


fn_spacy_tokens_for_baseline: He became stingy with words , and sombre .

source_bert_toks: he became sting ##y with words , and so ##mbre .

reference_raw: He was stinging with words and gloom.

reference_spacy_tokens: He was stinging with words and gloom .


fn_spacy_tokens_for_baseline: She would n't trust her to the end of the street .

source_bert_toks: she wouldn ' t trust her to the end of the street .

reference_raw: She didn't want to believe it until the end of the street.

reference_spacy_tokens: She did n't want to believe it until the end of the street .


fn_spacy_tokens_for_baseline: Like Michael , they share two common characteristics .

source_bert_toks: like michael , they share two common characteristics .

reference_raw: Like Michael, they have two shared features.

reference_spacy_tokens: Like Michael , they have two shared features .


fn_spacy_tokens_for_baseline: The Praya , the promenade in front of the ferry pier , is a good place to observe the many junks and fishing boats in the harbor .

source_bert_toks: the pray ##a , the promenade in front of the ferry pier , is a good place to observe the many junk ##s and fishing boats in the harbor .

reference_raw: Praya, the promenade before the ferry pier, is a great place to watch a lot of junk and fishing boats in the harbor.

reference_spacy_tokens: Praya , the promenade before the ferry pier , is a great place to watch a lot of junk and fishing boats in the harbor .


fn_spacy_tokens_for_baseline: If certain aspects of Vincent 's personality repel us , it is perhaps because he is never full face .

source_bert_toks: if certain aspects of vincent ' s personality rep ##el us , it is perhaps because he is never full face .

reference_raw: If certain aspects of Vincent's personality dispel us, maybe it's because he's never a full face.

reference_spacy_tokens: If certain aspects of Vincent 's personality dispel us , maybe it 's because he 's never a full face .


fn_spacy_tokens_for_baseline: Another witness had earlier reported seeing four hooded and shackled men under arrest at the military section of the airport during the coup , but there was no way of identifying them .

source_bert_toks: another witness had earlier reported seeing four hooded and shack ##led men under arrest at the military section of the airport during the coup , but there was no way of identifying them .

reference_raw: Another witness reported seeing four hooded and chained men arrested in the military section of the airport during the coup, but there was no way to identify them.

reference_spacy_tokens: Another witness reported seeing four hooded and chained men arrested in the military section of the airport during the coup , but there was no way to identify them .


fn_spacy_tokens_for_baseline: And Mr Ataie 's thesis that the British have a deep - seated reverence for war is too easily symbolised by having Penny make Remembrance Day poppies or court Sya in front of a military monument .

source_bert_toks: and mr ata ##ie ' s thesis that the british have a deep - seated rev ##erence for war is too easily symbol ##ised by having penny make remembrance day pop ##pies or court sy ##a in front of a military monument .

reference_raw: And Mr. Atai's thesis that the British have deep respect for war is too easy to symbolize by Penny making the Remembrance Day poppies or courting Sy before a military monument.

reference_spacy_tokens: And Mr. Atai 's thesis that the British have deep respect for war is too easy to symbolize by Penny making the Remembrance Day poppies or courting Sy before a military monument .


fn_spacy_tokens_for_baseline: He stripped off his scaly shirt and breeches and ran his hand over his armpits and groin .

source_bert_toks: he stripped off his sc ##aly shirt and bree ##ches and ran his hand over his arm ##pit ##s and groin .

reference_raw: He removed his scaled shirt and pants and ran his hand over his armpits and groin.

reference_spacy_tokens: He removed his scaled shirt and pants and ran his hand over his armpits and groin .


fn_spacy_tokens_for_baseline: I want you for the West End after your six weeks in the sticks , and you 'll have to have a bit of bosom . '

source_bert_toks: i want you for the west end after your six weeks in the sticks , and you ' ll have to have a bit of bo ##som . '

reference_raw: I want you to go to the West End after six weeks in a cane, and you're gonna need some breasts.'

reference_spacy_tokens: I want you to go to the West End after six weeks in a cane , and you 're gon na need some breasts . '


fn_spacy_tokens_for_baseline: Training exercises had to be postponed after the fire , which destroyed a hangar used to pack and repair all of the country 's military parachutes .

source_bert_toks: training exercises had to be postponed after the fire , which destroyed a hangar used to pack and repair all of the country ' s military parachute ##s .

reference_raw: The training exercises had to be postponed after the fire, which destroyed the bay used to pack and repair all the military parachutes in the country.

reference_spacy_tokens: The training exercises had to be postponed after the fire , which destroyed the bay used to pack and repair all the military parachutes in the country .


fn_spacy_tokens_for_baseline: Substandard nursing practice may or may not be the fault of the individual , but it always points to inadequate supervision and teaching .

source_bert_toks: sub ##stand ##ard nursing practice may or may not be the fault of the individual , but it always points to inadequate supervision and teaching .

reference_raw: Sub-standard breast-feeding may or may not be the fault of the individual, but it always points to a lack of supervision and education.

reference_spacy_tokens: Sub - standard breast - feeding may or may not be the fault of the individual , but it always points to a lack of supervision and education .


fn_spacy_tokens_for_baseline: The plain - clothed cockney ransacks my underwear drawer , sticking his hand into bras and panties .

source_bert_toks: the plain - clothed cock ##ney ran ##sack ##s my underwear drawer , sticking his hand into bra ##s and panties .

reference_raw: A plain-clothed cockney goes through my underwear drawer and puts his hand in bras and panties.

reference_spacy_tokens: A plain - clothed cockney goes through my underwear drawer and puts his hand in bras and panties .


fn_spacy_tokens_for_baseline: He was interrupted by the buzz of the intercom .

source_bert_toks: he was interrupted by the buzz of the inter ##com .

reference_raw: The hum of the intercom interrupted him.

reference_spacy_tokens: The hum of the intercom interrupted him .


fn_spacy_tokens_for_baseline: You can not counterfeit forty years ' honest work , or get the same result by being a clever young man who prefers vanilla to orange or heliotrope to lavender perfume .

source_bert_toks: you can not counter ##feit forty years ' honest work , or get the same result by being a clever young man who prefers vanilla to orange or he ##lio ##tro ##pe to lavender perfume .

reference_raw: You can't fake 40 years of honest work, and you can't get the same result if you're a smart young man who prefers vanilla to orange or heliotrope to lavender perfume.

reference_spacy_tokens: You ca n't fake 40 years of honest work , and you ca n't get the same result if you 're a smart young man who prefers vanilla to orange or heliotrope to lavender perfume .


fn_spacy_tokens_for_baseline: Some experts believe that the fact we have more material possessions these days means that there is simply more to steal -- after all , car theft is the most popular form of theft .

source_bert_toks: some experts believe that the fact we have more material possessions these days means that there is simply more to steal - - after all , car theft is the most popular form of theft .

reference_raw: Some experts believe that the fact that we have more material property these days means that there's just more to steal - after all, car theft is the most popular form of theft.

reference_spacy_tokens: Some experts believe that the fact that we have more material property these days means that there 's just more to steal - after all , car theft is the most popular form of theft .


fn_spacy_tokens_for_baseline: ' I Started Something I Could n't Finish ' was a cute and solid pop song with Morrissey growling determinedly in comical self - analysis .

source_bert_toks: ' i started something i couldn ' t finish ' was a cute and solid pop song with morris ##sey growling determined ##ly in comical self - analysis .

reference_raw: "I started something I couldn't finish" was a sweet, solid pop song, and Morrissey growled determinedly in comic self-analysis.

reference_spacy_tokens: " I started something I could n't finish " was a sweet , solid pop song , and Morrissey growled determinedly in comic self - analysis .


fn_spacy_tokens_for_baseline: The unavailability of Intel Corp 's promised Pentium chip is forcing hardware vendors like Unisys Corp , much of whose product line is Intel , to scramble .

source_bert_toks: the una ##va ##ila ##bility of intel corp ' s promised pen ##tium chip is forcing hardware vendors like un ##is ##ys corp , much of whose product line is intel , to scramble .

reference_raw: The unavailability of Intel Corp's promised pentium chip forces hardware sellers like Unisys Corp, most of whose product line is Intel, to scramble.

reference_spacy_tokens: The unavailability of Intel Corp 's promised pentium chip forces hardware sellers like Unisys Corp , most of whose product line is Intel , to scramble .


fn_spacy_tokens_for_baseline: By 10 am , the potatoes have been boiled and roasted and stored in insulated containers .

source_bert_toks: by 10 ##am , the potatoes have been boiled and roasted and stored in ins ##ulated containers .

reference_raw: By 10 a.m., the potatoes were cooked and roasted and stored in isolated containers.

reference_spacy_tokens: By 10 a.m. , the potatoes were cooked and roasted and stored in isolated containers .


fn_spacy_tokens_for_baseline: A special law then will be adopted to open the way for the two ex - presidents and aides to be prosecuted in connection with the Kwangju blood - bath , they said .

source_bert_toks: a special law then will be adopted to open the way for the two ex - presidents and aide ##s to be prosecuted in connection with the kwan ##g ##ju blood - bath , they said .

reference_raw: A special law will then be adopted to open the way for two former presidents and assistants to be prosecuted in connection with a blood bath in Kwangju, they said.

reference_spacy_tokens: A special law will then be adopted to open the way for two former presidents and assistants to be prosecuted in connection with a blood bath in Kwangju , they said .


fn_spacy_tokens_for_baseline: The threat of alliance between the king of France and an unfriendly ruler of northern Spain was one which must have worried the English in Bordeaux .

source_bert_toks: the threat of alliance between the king of france and an un ##fr ##ien ##dly ruler of northern spain was one which must have worried the english in bordeaux .

reference_raw: The threat of an alliance between the King of France and the enemy ruler of northern Spain was one that must have worried the English in Bordeaux.

reference_spacy_tokens: The threat of an alliance between the King of France and the enemy ruler of northern Spain was one that must have worried the English in Bordeaux .


fn_spacy_tokens_for_baseline: And why should it , he reflected , when a sullen anger smouldered in him still ?

source_bert_toks: and why should it , he reflected , when a sul ##len anger sm ##ou ##lder ##ed in him still ?

reference_raw: And why would he do that, he thought, when he was still smoldered with sullen anger?

reference_spacy_tokens: And why would he do that , he thought , when he was still smoldered with sullen anger ?


fn_spacy_tokens_for_baseline: In 1995 , it became evident that Iran may be pursuing nuclear weapons through another track : by procuring dual - use items from Western firms .

source_bert_toks: in 1995 , it became evident that iran may be pursuing nuclear weapons through another track : by pro ##cu ##ring dual - use items from western firms .

reference_raw: In 1995, it became clear that Iran could pursue nuclear weapons through a different route: by purchasing dual-use items from Western companies.

reference_spacy_tokens: In 1995 , it became clear that Iran could pursue nuclear weapons through a different route : by purchasing dual - use items from Western companies .


fn_spacy_tokens_for_baseline: ' Zarqawi is daring , elusive .

source_bert_toks: ' za ##r ##qa ##wi is daring , elusive .

reference_raw: 'Zarqawi is brave and evasive.

reference_spacy_tokens: ' Zarqawi is brave and evasive .


fn_spacy_tokens_for_baseline: Unknown to anyone the herring meal contained DMNA , a substance which was poisonous to mink .

source_bert_toks: unknown to anyone the herring meal contained d ##m ##na , a substance which was poisonous to min ##k .

reference_raw: No one knew that the herring food contained DMNA, a substance that was toxic to the mink.

reference_spacy_tokens: No one knew that the herring food contained DMNA , a substance that was toxic to the mink .


fn_spacy_tokens_for_baseline: PLANNERS bungled when they designed a new bridge over a railway line -- without leaving enough room for trains to pass underneath .

source_bert_toks: planners bun ##gled when they designed a new bridge over a railway line - - without leaving enough room for trains to pass underneath .

reference_raw: The PLANNERS blundered as they designed a new bridge over the railway line - without leaving enough room for the trains to pass below.

reference_spacy_tokens: The PLANNERS blundered as they designed a new bridge over the railway line - without leaving enough room for the trains to pass below .


fn_spacy_tokens_for_baseline: Scatter the freshly ground almonds over the base of the pastry case and carefully pour the syrup mixture on top .

source_bert_toks: sc ##atter the freshly ground almond ##s over the base of the pastry case and carefully pour the syrup mixture on top .

reference_raw: Spread the freshly earthed tonsils over the base of the pastry case and carefully pour the syrup mixture to the top.

reference_spacy_tokens: Spread the freshly earthed tonsils over the base of the pastry case and carefully pour the syrup mixture to the top .


fn_spacy_tokens_for_baseline: The woman reporter almost wailed the words .

source_bert_toks: the woman reporter almost wai ##led the words .

reference_raw: The reporter almost howled the words.

reference_spacy_tokens: The reporter almost howled the words .


fn_spacy_tokens_for_baseline: You must keep your Card safely and take all possible care to avoid its loss or theft .

source_bert_toks: you must keep your card safely and take all possible care to avoid its loss or theft .

reference_raw: You must keep your card safe and be careful not to lose it or steal it.

reference_spacy_tokens: You must keep your card safe and be careful not to lose it or steal it .


fn_spacy_tokens_for_baseline: Outside the kitchen door scullions were bringing out steaming chunks of bloody red meat to throw into huge casks of pickle and salt to preserve them .

source_bert_toks: outside the kitchen door sc ##ull ##ions were bringing out steaming chunks of bloody red meat to throw into huge cas ##ks of pick ##le and salt to preserve them .

reference_raw: In front of the kitchen door, scullions brought out steaming chunks of blood-red meat to throw into huge barrels of cucumber and salt to keep them safe.

reference_spacy_tokens: In front of the kitchen door , scullions brought out steaming chunks of blood - red meat to throw into huge barrels of cucumber and salt to keep them safe .


fn_spacy_tokens_for_baseline: Last night 's lovemaking had changed everything for Sarella herself ; she had never guessed it could be like that , and she could n't imagine that it might not have been as earth - shattering for Marc too .

source_bert_toks: last night ' s love ##making had changed everything for sar ##ella herself ; she had never guessed it could be like that , and she couldn ' t imagine that it might not have been as earth - shattering for marc too .

reference_raw: The lovemaking of last night had changed everything for Sarella herself; she had never thought it could be like this, and she could not imagine that it might not be as earthly as it was for Marc.

reference_spacy_tokens: The lovemaking of last night had changed everything for Sarella herself ; she had never thought it could be like this , and she could not imagine that it might not be as earthly as it was for Marc .


fn_spacy_tokens_for_baseline: 4- Maintaining physical fitness and military exercises as much as possible .

source_bert_toks: 4 - maintaining physical fitness and military exercises as much as possible .

reference_raw: 4- Maintain physical fitness and military training as much as possible.

reference_spacy_tokens: 4- Maintain physical fitness and military training as much as possible .


fn_spacy_tokens_for_baseline: One of the teachers there was her aunt Nuala O'Connor who did not immediately realise the quiet , intense girl was a relative .

source_bert_toks: one of the teachers there was her aunt nu ##ala o ' connor who did not immediately realise the quiet , intense girl was a relative .

reference_raw: One of the teachers was Aunt Nuala O'Connor, who didn't immediately realize that the quiet, tense girl was a relative.

reference_spacy_tokens: One of the teachers was Aunt Nuala O'Connor , who did n't immediately realize that the quiet , tense girl was a relative .


fn_spacy_tokens_for_baseline: It 's possible , mathematically , that Hartlepool will end up in the Second Division next season .

source_bert_toks: it ' s possible , mathematical ##ly , that hart ##le ##pool will end up in the second division next season .

reference_raw: It's possible, mathematically, that Hartlepool is going to be in the Second Division next season.

reference_spacy_tokens: It 's possible , mathematically , that Hartlepool is going to be in the Second Division next season .


fn_spacy_tokens_for_baseline: He was hardly aware of lurching downstairs and into the sharp rain , binoculars thumping his chest .

source_bert_toks: he was hardly aware of lu ##rch ##ing downstairs and into the sharp rain , binoculars thumping his chest .

reference_raw: He was barely aware that he was bouncing down into the rain, his telescope pounding against his chest.

reference_spacy_tokens: He was barely aware that he was bouncing down into the rain , his telescope pounding against his chest .


fn_spacy_tokens_for_baseline: She did n't seem perturbed .

source_bert_toks: she didn ' t seem per ##tur ##bed .

reference_raw: She didn't seem upset.

reference_spacy_tokens: She did n't seem upset .


fn_spacy_tokens_for_baseline: The White House spokesman , Mr Marlin Fitzwater , explained that while the President ' deplores the tragedy of Tiananmen Square last June .

source_bert_toks: the white house spokesman , mr mar ##lin fitz ##water , explained that while the president ' de ##pl ##ores the tragedy of tian ##an ##men square last june .

reference_raw: Speaker of the White House, Mr. Marlin Fitzwater, explained that while the President "deplores the tragic situation in Tiananmen Square last June.

reference_spacy_tokens: Speaker of the White House , Mr. Marlin Fitzwater , explained that while the President " deplores the tragic situation in Tiananmen Square last June .


fn_spacy_tokens_for_baseline: Though the figures may well be inaccurate , they attest the contemporary impression that even local forces could be very large , at least in time of emergency .

source_bert_toks: though the figures may well be inaccurate , they at ##test the contemporary impression that even local forces could be very large , at least in time of emergency .

reference_raw: Although these figures may be inaccurate, they confirm the current impression that even local forces can be very large, at least in times of emergency.

reference_spacy_tokens: Although these figures may be inaccurate , they confirm the current impression that even local forces can be very large , at least in times of emergency .


fn_spacy_tokens_for_baseline: It is a beautiful car , I swear to you . '

source_bert_toks: it is a beautiful car , i swear to you . '

reference_raw: I promise you, it's a beautiful car.'

reference_spacy_tokens: I promise you , it 's a beautiful car . '


fn_spacy_tokens_for_baseline: This last was uttered so sharply that the dog at once lay down , uttering a whimper as he rested his head on his paws , dark eyes longingly fixed on the newcomer .

source_bert_toks: this last was uttered so sharply that the dog at once lay down , utter ##ing a whimper as he rested his head on his paws , dark eyes longing ##ly fixed on the newcomer .

reference_raw: The last was uttered so sharply that the dog lay down at once and let out a whine as he rested his head on his paws, his dark eyes longing for the newcomer.

reference_spacy_tokens: The last was uttered so sharply that the dog lay down at once and let out a whine as he rested his head on his paws , his dark eyes longing for the newcomer .


fn_spacy_tokens_for_baseline: But in fact , there have been changes , many of them due to economic progress , new construction , and other factors that influence cities all over the world .

source_bert_toks: but in fact , there have been changes , many of them due to economic progress , new construction , and other factors that influence cities all over the world .

reference_raw: In fact, there have been changes, many of them due to economic progress, new construction, and other factors affecting cities around the world.

reference_spacy_tokens: In fact , there have been changes , many of them due to economic progress , new construction , and other factors affecting cities around the world .


fn_spacy_tokens_for_baseline: These accounts are contradictory but not incompatible : it is probable that he was indeed in a state of shock , since the nature of shock is to suspend ordinary or familiar reactions .

source_bert_toks: these accounts are contradictory but not incompatible : it is probable that he was indeed in a state of shock , since the nature of shock is to suspend ordinary or familiar reactions .

reference_raw: These accounts are contradictory but not incompatible: it is likely that he was in a state of shock, since the nature of shock is to suspend normal or familiar reactions.

reference_spacy_tokens: These accounts are contradictory but not incompatible : it is likely that he was in a state of shock , since the nature of shock is to suspend normal or familiar reactions .


fn_spacy_tokens_for_baseline: Lucy wanted to back out , and now .

source_bert_toks: lucy wanted to back out , and now .

reference_raw: Lucy wanted to leave, but now.

reference_spacy_tokens: Lucy wanted to leave , but now .


fn_spacy_tokens_for_baseline: Clearly , industrial policy can not fully explain the extraordinary dynamism of Japanese accumulation .

source_bert_toks: clearly , industrial policy can not fully explain the extraordinary d ##yna ##mism of japanese accumulation .

reference_raw: It is clear that industrial policy cannot fully explain the extraordinary dynamics of Japanese accumulation.

reference_spacy_tokens: It is clear that industrial policy can not fully explain the extraordinary dynamics of Japanese accumulation .


fn_spacy_tokens_for_baseline: Painfully sweet memories assailed her .

source_bert_toks: painfully sweet memories ass ##ailed her .

reference_raw: Painfully sweet memories attacked her.

reference_spacy_tokens: Painfully sweet memories attacked her .


fn_spacy_tokens_for_baseline: They welcome the chance to belong , to become self - sufficient , to regain their self - esteem and confidence .

source_bert_toks: they welcome the chance to belong , to become self - sufficient , to regain their self - esteem and confidence .

reference_raw: They welcome the opportunity to be part of it, to be self-sufficient, to regain self-esteem and self-confidence.

reference_spacy_tokens: They welcome the opportunity to be part of it , to be self - sufficient , to regain self - esteem and self - confidence .


fn_spacy_tokens_for_baseline: Steam issued from the shower room .

source_bert_toks: steam issued from the shower room .

reference_raw: The steam came out of the shower room.

reference_spacy_tokens: The steam came out of the shower room .


fn_spacy_tokens_for_baseline: Identifying the triggers or cues for your own behaviour and other people 's provides a useful foothold when it comes to working out how to change or modify behaviour .

source_bert_toks: identifying the triggers or cues for your own behaviour and other people ' s provides a useful foot ##hold when it comes to working out how to change or modify behaviour .

reference_raw: The identification of triggers or cues for your own behaviour and the behaviour of others provides a useful basis for finding out how to change or change behaviour.

reference_spacy_tokens: The identification of triggers or cues for your own behaviour and the behaviour of others provides a useful basis for finding out how to change or change behaviour .


fn_spacy_tokens_for_baseline: They 're great for tiredness , flu , hangovers . '

source_bert_toks: they ' re great for tired ##ness , flu , hang ##overs . '

reference_raw: They're good for fatigue, flu, hangovers.'

reference_spacy_tokens: They 're good for fatigue , flu , hangovers . '


fn_spacy_tokens_for_baseline: But the Government has been severely embarrassed by the burgeoning cost of the programme .

source_bert_toks: but the government has been severely embarrassed by the bu ##rgeon ##ing cost of the programme .

reference_raw: But the government was deeply ashamed of the burgeoning costs of the program.

reference_spacy_tokens: But the government was deeply ashamed of the burgeoning costs of the program .


fn_spacy_tokens_for_baseline: Unable to replicate the agricultural techniques of the Anasazi , the Paiutes were destined to a semi - nomadic lifestyle until European settlers arrived , changing the nature of existence in the valley forever .

source_bert_toks: unable to replicate the agricultural techniques of the ana ##sa ##zi , the pa ##iu ##tes were destined to a semi - nomadic lifestyle until european settlers arrived , changing the nature of existence in the valley forever .

reference_raw: The Paiutes, unable to replicate the farming techniques of the Anasazi, were destined for a semi-nomadic lifestyle until the settlers of Europe arrived and changed the nature of life in the valley forever.

reference_spacy_tokens: The Paiutes , unable to replicate the farming techniques of the Anasazi , were destined for a semi - nomadic lifestyle until the settlers of Europe arrived and changed the nature of life in the valley forever .


fn_spacy_tokens_for_baseline: However , it is vital that the importance of a disciplined approach to management information and the necessary action which follows , is instilled and regularly reinforced from the top .

source_bert_toks: however , it is vital that the importance of a disciplined approach to management information and the necessary action which follows , is ins ##till ##ed and regularly reinforced from the top .

reference_raw: It is important, however, that the importance of a disciplined approach to management information and the necessary follow-up action is instilled and regularly strengthened from the top.

reference_spacy_tokens: It is important , however , that the importance of a disciplined approach to management information and the necessary follow - up action is instilled and regularly strengthened from the top .


fn_spacy_tokens_for_baseline: " They 're far too precious to our heritage for us to allow them to simply moulder away .

source_bert_toks: " they ' re far too precious to our heritage for us to allow them to simply mo ##uld ##er away .

reference_raw: "They are too valuable to our heritage to be able to simply shape."

reference_spacy_tokens: " They are too valuable to our heritage to be able to simply shape . "


fn_spacy_tokens_for_baseline: A hostile historian later maintained that the whole treaty was an Athenian invention .

source_bert_toks: a hostile historian later maintained that the whole treaty was an athenian invention .

reference_raw: The enemy historian later claimed that the entire contract was an Athenian device.

reference_spacy_tokens: The enemy historian later claimed that the entire contract was an Athenian device .


fn_spacy_tokens_for_baseline: He was kneeling up .

source_bert_toks: he was kneeling up .

reference_raw: He was on his knees.

reference_spacy_tokens: He was on his knees .


fn_spacy_tokens_for_baseline: He scoured the town for a car but , ironically for a man who owned one of the oldest automobile companies in Europe , there was not a vehicle to be found anywhere .

source_bert_toks: he sc ##oured the town for a car but , ironically for a man who owned one of the oldest automobile companies in europe , there was not a vehicle to be found anywhere .

reference_raw: He searched the city for a car, but ironically for a man who owned one of the oldest car companies in Europe, there was no vehicle.

reference_spacy_tokens: He searched the city for a car , but ironically for a man who owned one of the oldest car companies in Europe , there was no vehicle .


fn_spacy_tokens_for_baseline: Taiwan is currently developing the Tien Chi , a short - range ballistic missile system that can reach the coast of China .

source_bert_toks: taiwan is currently developing the tie ##n chi , a short - range ballistic missile system that can reach the coast of china .

reference_raw: Taiwan is currently developing Tien Chi, a short-range ballistic missile network that can reach the coast of China.

reference_spacy_tokens: Taiwan is currently developing Tien Chi , a short - range ballistic missile network that can reach the coast of China .


fn_spacy_tokens_for_baseline: The rocks missed him , yet Jack did not give up and set alight the forest .

source_bert_toks: the rocks missed him , yet jack did not give up and set ali ##ght the forest .

reference_raw: The rocks missed him, but Jack didn't give up and set the forest on fire.

reference_spacy_tokens: The rocks missed him , but Jack did n't give up and set the forest on fire .


fn_spacy_tokens_for_baseline: ' We want to be reassuring the risk of anyone catching this is infinitesimal .

source_bert_toks: ' we want to be reassuring the risk of anyone catching this is infinite ##si ##mal .

reference_raw: We want to assure you that the risk of being caught is infinite.

reference_spacy_tokens: We want to assure you that the risk of being caught is infinite .


fn_spacy_tokens_for_baseline: Libya admitted having secretly imported raw uranium and the necessary equipment to convert it for enrichment into weapons - grade material but added that the enrichment plan had been dismantled and that no highly enriched uranium had been produced over the past decade .

source_bert_toks: libya admitted having secretly imported raw uranium and the necessary equipment to convert it for enrichment into weapons - grade material but added that the enrichment plan had been dismantled and that no highly enriched uranium had been produced over the past decade .

reference_raw: Libya admits that it has secretly imported raw uranium and the necessary equipment to convert it into weapons-grade material, but adds that the enrichment plan has been dismantled and that no high-enrichment uranium has been produced in the last decade.

reference_spacy_tokens: Libya admits that it has secretly imported raw uranium and the necessary equipment to convert it into weapons - grade material , but adds that the enrichment plan has been dismantled and that no high - enrichment uranium has been produced in the last decade .


fn_spacy_tokens_for_baseline: The wind rustled lightly through the cottonwoods and willows alongside the Mattole , not 60 yards from Euclid 's peaceful nose .

source_bert_toks: the wind rust ##led lightly through the cotton ##woods and willow ##s alongside the matt ##ole , not 60 yards from eu ##cl ##id ' s peaceful nose .

reference_raw: The wind blew lightly through the cottonwoods and willows beside Mattole, not sixty yards from Euclid's peaceful nose.

reference_spacy_tokens: The wind blew lightly through the cottonwoods and willows beside Mattole , not sixty yards from Euclid 's peaceful nose .


fn_spacy_tokens_for_baseline: To reduce the extent of farm - related youth injuries , the National Institute of Occupational Safety and Health ( NIOSH ) and the Marshfield Clinic Research Foundation have issued a set of guidelines known as the North American Guidelines for Children 's Agricultural Tasks ( NAGCAT ) based on child development principles that matched children 's abilities with the requirements of specific farm work .

source_bert_toks: to reduce the extent of farm - related youth injuries , the national institute of occupational safety and health ( ni ##osh ) and the marsh ##field clinic research foundation have issued a set of guidelines known as the north american guidelines for children ' s agricultural tasks ( na ##gc ##at ) based on child development principles that matched children ' s abilities with the requirements of specific farm work .

reference_raw: In order to reduce the number of farm-related youth injuries, the National Institute of Occupational Safety and Health (NIOSH) and the Marshfield Clinic Research Foundation have issued a set of guidelines known as the North American Guidelines on Children's Agricultural Tasks (NAGCAT) based on the principles of child development, which correspond to the skills of children with the requirements of specific farm work.

reference_spacy_tokens: In order to reduce the number of farm - related youth injuries , the National Institute of Occupational Safety and Health ( NIOSH ) and the Marshfield Clinic Research Foundation have issued a set of guidelines known as the North American Guidelines on Children 's Agricultural Tasks ( NAGCAT ) based on the principles of child development , which correspond to the skills of children with the requirements of specific farm work .


fn_spacy_tokens_for_baseline: An unnamed buyer has agreed to purchase the site for an undisclosed sum .

source_bert_toks: an unnamed buyer has agreed to purchase the site for an undisclosed sum .

reference_raw: The unnamed purchaser agreed to purchase the site for an undisclosed amount.

reference_spacy_tokens: The unnamed purchaser agreed to purchase the site for an undisclosed amount .


fn_spacy_tokens_for_baseline: Tim found out the appalling details of his wife 's killing when he finally got through to Elizabeth 's fiance Cuan Cronje .

source_bert_toks: tim found out the app ##all ##ing details of his wife ' s killing when he finally got through to elizabeth ' s fiance cu ##an cr ##on ##je .

reference_raw: Tim learned the terrible details of his wife's murder when he finally reached Elizabeth's fiancée, Cuan Cronje.

reference_spacy_tokens: Tim learned the terrible details of his wife 's murder when he finally reached Elizabeth 's fiancee , Cuan Cronje .


fn_spacy_tokens_for_baseline: A general point is that punishment is inflicted by the state for breaches of the law .

source_bert_toks: a general point is that punishment is inflicted by the state for breach ##es of the law .

reference_raw: Generally speaking, the State is punishable by violations of the law.

reference_spacy_tokens: Generally speaking , the State is punishable by violations of the law .


fn_spacy_tokens_for_baseline: There are some reports that between 1984 and 1988 Iran employed chemical agents on a limited scale during the war with Iraq ; however , an intensive review of the open literature ( including UN reports from that era ) have failed to verify such claims .

source_bert_toks: there are some reports that between 1984 and 1988 iran employed chemical agents on a limited scale during the war with iraq ; however , an intensive review of the open literature ( including un reports from that era ) have failed to verify such claims .

reference_raw: There are some reports that Iran used chemical agents to a limited extent during the war with Iraq during the period 1984 to 1988; however, an in-depth review of open literature (including UN reports from that period) did not examine such claims.

reference_spacy_tokens: There are some reports that Iran used chemical agents to a limited extent during the war with Iraq during the period 1984 to 1988 ; however , an in - depth review of open literature ( including UN reports from that period ) did not examine such claims .


fn_spacy_tokens_for_baseline: Mr. Hallworth was considerably shaken by the scene and finally said , ' All right .

source_bert_toks: mr . hall ##worth was considerably shaken by the scene and finally said , ' all right .

reference_raw: Mr. Hallworth was shocked by the scene, and finally he said, "Very well.

reference_spacy_tokens: Mr. Hallworth was shocked by the scene , and finally he said , " Very well .


fn_spacy_tokens_for_baseline: Francesca nearly laughed , but McLeish 's expression sobered her .

source_bert_toks: francesca nearly laughed , but mc ##lei ##sh ' s expression sober ##ed her .

reference_raw: Francesca almost laughed, but McLeish's expression made her calm.

reference_spacy_tokens: Francesca almost laughed , but McLeish 's expression made her calm .


fn_spacy_tokens_for_baseline: A number of words are homophonous in this way ( e.g. sew / so , meat / mete / meet ) , but the size of such equivalence classes is very small .

source_bert_toks: a number of words are homo ##phon ##ous in this way ( e . g . se ##w / so , meat / met ##e / meet ) , but the size of such equivalence classes is very small .

reference_raw: Many words are homophony in this way (e.g. sewing/s, meat/mete/meet) but the size of these equivalence classes is very small.

reference_spacy_tokens: Many words are homophony in this way ( e.g. sewing / s , meat / mete / meet ) but the size of these equivalence classes is very small .


fn_spacy_tokens_for_baseline: The planning committee decided on Monday evening to defer its decision about the application until after that meeting .

source_bert_toks: the planning committee decided on monday evening to def ##er its decision about the application until after that meeting .

reference_raw: On Monday night, the Planning Committee decided to postpone its decision on the application until after that meeting.

reference_spacy_tokens: On Monday night , the Planning Committee decided to postpone its decision on the application until after that meeting .


fn_spacy_tokens_for_baseline: Now it was Ferreira 's turn to show his frustration , often slamming his racket to the ground in anger as he could only muster 11 points in a set lasting only 20 minutes .

source_bert_toks: now it was ferreira ' s turn to show his frustration , often slamming his rack ##et to the ground in anger as he could only muster 11 points in a set lasting only 20 minutes .

reference_raw: Now it was Ferreira's turn to show his frustration, and he often hit the ground with anger, for he could only score eleven points in a set that lasted only twenty minutes.

reference_spacy_tokens: Now it was Ferreira 's turn to show his frustration , and he often hit the ground with anger , for he could only score eleven points in a set that lasted only twenty minutes .


fn_spacy_tokens_for_baseline: Around 7000 b.c . , the Phoenicians set out from what is now Iran to explore their surroundings .

source_bert_toks: around 700 ##0 b . c . , the ph ##oe ##nic ##ians set out from what is now iran to explore their surroundings .

reference_raw: Around 7000 B.C., the Phoenicians left what is now Iran to investigate their surroundings.

reference_spacy_tokens: Around 7000 B.C. , the Phoenicians left what is now Iran to investigate their surroundings .


fn_spacy_tokens_for_baseline: She was up in arms , riled by his easy assurance , his certainty that he could manipulate her like some puppet .

source_bert_toks: she was up in arms , ri ##led by his easy assurance , his certainty that he could manipulate her like some puppet .

reference_raw: She stood in her arms, bewildered by his easy assurance, by his assurance that he could manipulate her like a puppet.

reference_spacy_tokens: She stood in her arms , bewildered by his easy assurance , by his assurance that he could manipulate her like a puppet .


fn_spacy_tokens_for_baseline: This contradicts the view that home appliances eased the pressure on the mother to toilet train early because these families were less likely to have washing machines .

source_bert_toks: this contra ##dict ##s the view that home appliances eased the pressure on the mother to toilet train early because these families were less likely to have washing machines .

reference_raw: This is in contradiction with the view that household appliances eased the pressure on mothers to train toilets early, since those families were less likely to have washing machines.

reference_spacy_tokens: This is in contradiction with the view that household appliances eased the pressure on mothers to train toilets early , since those families were less likely to have washing machines .


fn_spacy_tokens_for_baseline: The interception of their boat was part of a growing pattern of interception of illegal would - be immigrants into Spain .

source_bert_toks: the interception of their boat was part of a growing pattern of interception of illegal would - be immigrants into spain .

reference_raw: The capture of their ship was part of a growing pattern of intercepting illegal, would-be immigrants from Spain.

reference_spacy_tokens: The capture of their ship was part of a growing pattern of intercepting illegal , would - be immigrants from Spain .


fn_spacy_tokens_for_baseline: A sour taste flooded into his mouth .

source_bert_toks: a sour taste flooded into his mouth .

reference_raw: There was a bitter taste in his mouth.

reference_spacy_tokens: There was a bitter taste in his mouth .


fn_spacy_tokens_for_baseline: I mean we did see some strange tracks and we did find this sheep which had been completely gutted , but apparently that could have been done by a snow leopard .

source_bert_toks: i mean we did see some strange tracks and we did find this sheep which had been completely gut ##ted , but apparently that could have been done by a snow leopard .

reference_raw: We saw some strange footprints and found a sheep that was completely disemboweled, but apparently a snow leopard could have done it.

reference_spacy_tokens: We saw some strange footprints and found a sheep that was completely disemboweled , but apparently a snow leopard could have done it .


fn_spacy_tokens_for_baseline: They went through the house like so many screaming wheelbarrows , soon to be silenced by men with sharp knives and rubber aprons and boots that did not slip on the bloodied floor .

source_bert_toks: they went through the house like so many screaming wheel ##bar ##row ##s , soon to be silenced by men with sharp knives and rubber apron ##s and boots that did not slip on the blood ##ied floor .

reference_raw: They walked through the house like so many screaming wheelbarrows, and soon they were quieted by men with sharp knives and rubber aprons and boots that didn't slip on the bloody floor.

reference_spacy_tokens: They walked through the house like so many screaming wheelbarrows , and soon they were quieted by men with sharp knives and rubber aprons and boots that did n't slip on the bloody floor .


fn_spacy_tokens_for_baseline: Even before Monday 's suicide bombing , senior military officials had repeatedly threatened to launch a ground invasion of Gaza , from which Israel withdrew troops and Jewish settlers last summer .

source_bert_toks: even before monday ' s suicide bombing , senior military officials had repeatedly threatened to launch a ground invasion of gaza , from which israel withdrew troops and jewish settlers last summer .

reference_raw: Even before Monday's suicide attack, senior military officials repeatedly threatened to launch a ground invasion of Gaza, from which Israel withdrew troops and Jewish settlers last summer.

reference_spacy_tokens: Even before Monday 's suicide attack , senior military officials repeatedly threatened to launch a ground invasion of Gaza , from which Israel withdrew troops and Jewish settlers last summer .


fn_spacy_tokens_for_baseline: The huge building across the street blocked my view of the horizon .

source_bert_toks: the huge building across the street blocked my view of the horizon .

reference_raw: A huge building across the street barred my view of the horizon.

reference_spacy_tokens: A huge building across the street barred my view of the horizon .


fn_spacy_tokens_for_baseline: Although Mr Raban has been described as ' the finest writer afloat since Conrad ' , he modestly forbears to include his own work .

source_bert_toks: although mr ra ##ban has been described as ' the finest writer afl ##oat since conrad ' , he modest ##ly for ##be ##ars to include his own work .

reference_raw: Although Mr. Raban was described as "the best writer on board since Conrad," he modestly refrained from including his own work.

reference_spacy_tokens: Although Mr. Raban was described as " the best writer on board since Conrad , " he modestly refrained from including his own work .


fn_spacy_tokens_for_baseline: Barratt jiggles his foot , looking anywhere but at Bill .

source_bert_toks: barr ##att ji ##ggles his foot , looking anywhere but at bill .

reference_raw: Barratt jerks his leg and looks away from Bill.

reference_spacy_tokens: Barratt jerks his leg and looks away from Bill .


fn_spacy_tokens_for_baseline: Langbaurgh 's mountain bike series concludes in Guisborough Woods on tomorrow with registration from 8.30am on the day .

source_bert_toks: lang ##bau ##rgh ' s mountain bike series concludes in gui ##sboro ##ugh woods on tomorrow with registration from 8 . 30 ##am on the day .

reference_raw: Langbaurgh's mountain bike series ends tomorrow in Guisborough Woods with a registration at 8:30 a.m.

reference_spacy_tokens: Langbaurgh 's mountain bike series ends tomorrow in Guisborough Woods with a registration at 8:30 a.m.


fn_spacy_tokens_for_baseline: She was a slim , attractive woman in her late twenties and had long fair hair which was tightly piled up under a straw boater .

source_bert_toks: she was a slim , attractive woman in her late twenties and had long fair hair which was tightly piled up under a straw boat ##er .

reference_raw: She was a slender, attractive woman in her mid-twenties, with long blond hair that was stacked tightly under a straw boat.

reference_spacy_tokens: She was a slender , attractive woman in her mid - twenties , with long blond hair that was stacked tightly under a straw boat .


fn_spacy_tokens_for_baseline: But mother crumbled it up and sprinkled dry salt over it instead .

source_bert_toks: but mother cr ##umble ##d it up and sp ##rin ##kled dry salt over it instead .

reference_raw: But my mother crushed it and poured dry salt over it instead.

reference_spacy_tokens: But my mother crushed it and poured dry salt over it instead .


fn_spacy_tokens_for_baseline: One duck usually raises the alarm ( a deep quack ) and suddenly every eye on the jetty snaps open to follow the man across the bridge until out of sight .

source_bert_toks: one duck usually raises the alarm ( a deep qu ##ack ) and suddenly every eye on the jett ##y snaps open to follow the man across the bridge until out of sight .

reference_raw: One duck usually raises an alarm (a deep charlatan) and suddenly every eye on the wharf opens and follows the man across the bridge until he's out of sight.

reference_spacy_tokens: One duck usually raises an alarm ( a deep charlatan ) and suddenly every eye on the wharf opens and follows the man across the bridge until he 's out of sight .


fn_spacy_tokens_for_baseline: There was the unexplained presence of a nineteenth - century journal in Matthew 's safe : nothing to do with the case .

source_bert_toks: there was the une ##x ##pl ##aine ##d presence of a nineteenth - century journal in matthew ' s safe : nothing to do with the case .

reference_raw: In Matthew's vault was the unexplained presence of a nineteenth-century diary: nothing to do with the case.

reference_spacy_tokens: In Matthew 's vault was the unexplained presence of a nineteenth - century diary : nothing to do with the case .


fn_spacy_tokens_for_baseline: Asked about apparent defections from his cause , he claimed never to have said that he was counting on anybody .

source_bert_toks: asked about apparent defect ##ions from his cause , he claimed never to have said that he was counting on anybody .

reference_raw: He asked about obvious defects in his cause, and he said he never said he was counting on anyone.

reference_spacy_tokens: He asked about obvious defects in his cause , and he said he never said he was counting on anyone .


fn_spacy_tokens_for_baseline: When a Federal judge ruled last Friday evening that Microsoft had abused its monopoly power , many reports noted that the company 's stock price fell in " after - hours trading . "

source_bert_toks: when a federal judge ruled last friday evening that microsoft had abused its monopoly power , many reports noted that the company ' s stock price fell in " after - hours trading . "

reference_raw: Last Friday night, when a federal judge decided that Microsoft had abused its monopoly power, a number of reports reported that the company's stock price had fallen into "after-hour trading."

reference_spacy_tokens: Last Friday night , when a federal judge decided that Microsoft had abused its monopoly power , a number of reports reported that the company 's stock price had fallen into " after - hour trading . "


fn_spacy_tokens_for_baseline: They were stopped at Watford Gap and sent back to West Yorkshire .

source_bert_toks: they were stopped at watford gap and sent back to west yorkshire .

reference_raw: They were stopped at the Watford Gape and sent back to West Yorkshire.

reference_spacy_tokens: They were stopped at the Watford Gape and sent back to West Yorkshire .


fn_spacy_tokens_for_baseline: One day a young , moustached British officer arrived in a jeep and asked people in the village where I lived .

source_bert_toks: one day a young , mo ##ust ##ache ##d british officer arrived in a jeep and asked people in the village where i lived .

reference_raw: One day, a young, mustached British officer arrived in a jeep and asked the people of my village.

reference_spacy_tokens: One day , a young , mustached British officer arrived in a jeep and asked the people of my village .


fn_spacy_tokens_for_baseline: We watched several patrol cars surround the area without confronting the crowd .

source_bert_toks: we watched several patrol cars surround the area without confronting the crowd .

reference_raw: We watched a few patrol cars encircling the area without facing the crowd.

reference_spacy_tokens: We watched a few patrol cars encircling the area without facing the crowd .


fn_spacy_tokens_for_baseline: Taking one hand off the wheel , Nathan reached out and hooked his fingers through the front of her harness .

source_bert_toks: taking one hand off the wheel , nathan reached out and hooked his fingers through the front of her harness .

reference_raw: Nathan took one hand from the steering wheel, reached out, and slipped his fingers through the front of her harness.

reference_spacy_tokens: Nathan took one hand from the steering wheel , reached out , and slipped his fingers through the front of her harness .


fn_spacy_tokens_for_baseline: I am also supposed to have died , according to the surprised traders to whom I have revealed my identity over the phone .

source_bert_toks: i am also supposed to have died , according to the surprised traders to whom i have revealed my identity over the phone .

reference_raw: I'm also supposed to die, according to the startled merchants to whom I revealed my identity over the phone.

reference_spacy_tokens: I 'm also supposed to die , according to the startled merchants to whom I revealed my identity over the phone .


fn_spacy_tokens_for_baseline: Parents are too likely to blame schools for the educational limitations of their children .

source_bert_toks: parents are too likely to blame schools for the educational limitations of their children .

reference_raw: Parents are too likely to blame schools for their kids' educational constraints.

reference_spacy_tokens: Parents are too likely to blame schools for their kids ' educational constraints .


fn_spacy_tokens_for_baseline: The river of Luz , the Bastan , enters the town briskly from the east , along the deep lateral valley of Bareges .

source_bert_toks: the river of luz , the bas ##tan , enters the town brisk ##ly from the east , along the deep lateral valley of bare ##ges .

reference_raw: The river Luz, Bastan, enters the city briskly from the west, along the deep side valley of Bareges.

reference_spacy_tokens: The river Luz , Bastan , enters the city briskly from the west , along the deep side valley of Bareges .


fn_spacy_tokens_for_baseline: The Poyser monograph on The Barn Owl was published at the same time ; it has more words , contains many photo graphs and even has a colour plate , yet is £ 15 cheaper .

source_bert_toks: the po ##yse ##r monograph on the barn owl was published at the same time ; it has more words , contains many photo graphs and even has a colour plate , yet is £1 ##5 cheaper .

reference_raw: At the same time, the Poyser monogram on the Barn Owl was published; it has more words, it contains many photographs, and it even has a color plate, but it's 15 pounds cheaper.

reference_spacy_tokens: At the same time , the Poyser monogram on the Barn Owl was published ; it has more words , it contains many photographs , and it even has a color plate , but it 's 15 pounds cheaper .


fn_spacy_tokens_for_baseline: He was astonished at the change in him .

source_bert_toks: he was astonished at the change in him .

reference_raw: The change in him surprised him.

reference_spacy_tokens: The change in him surprised him .


fn_spacy_tokens_for_baseline: A greenhouse offers an unparalleled opportunity to extend both the season of growing and variety of plants you can raise .

source_bert_toks: a greenhouse offers an un ##para ##lle ##led opportunity to extend both the season of growing and variety of plants you can raise .

reference_raw: The greenhouse offers a unique opportunity to extend the growing season and the variety of plants you can grow.

reference_spacy_tokens: The greenhouse offers a unique opportunity to extend the growing season and the variety of plants you can grow .


fn_spacy_tokens_for_baseline: Primary among these are : The continued willingness of the Democratic People 's Republic of Korea ( DPRK ) , the People 's Republic of China ( PRC ) , and Russia to provide Iran with both missiles and missile - related technology that at the very least exceed the intentions of the Missile Technology Control Regime ( MTCR ) .

source_bert_toks: primary among these are : the continued willingness of the democratic people ' s republic of korea ( d ##pr ##k ) , the people ' s republic of china ( prc ) , and russia to provide iran with both missiles and missile - related technology that at the very least exceed the intentions of the missile technology control regime ( mt ##cr ) .

reference_raw: The main among these are: the continuing readiness of the Democratic People's Republic of Korea (DPRK), the People's Republic of China (PRC) and Russia to provide both missiles and missiles to Iran - related technologies that at least go beyond the intentions of the MTCR.

reference_spacy_tokens: The main among these are : the continuing readiness of the Democratic People 's Republic of Korea ( DPRK ) , the People 's Republic of China ( PRC ) and Russia to provide both missiles and missiles to Iran - related technologies that at least go beyond the intentions of the MTCR .


fn_spacy_tokens_for_baseline: The kitchen was to the left of the hall ; Robyn could hear the bang of a cupboard door , smell the distinctive aroma of fresh coffee .

source_bert_toks: the kitchen was to the left of the hall ; robyn could hear the bang of a cupboard door , smell the distinctive aroma of fresh coffee .

reference_raw: The kitchen was to the left of the hall; Robyn could hear the door of the closet and smell the distinctive smell of fresh coffee.

reference_spacy_tokens: The kitchen was to the left of the hall ; Robyn could hear the door of the closet and smell the distinctive smell of fresh coffee .


fn_spacy_tokens_for_baseline: ' Adam ? ' she ventured tentatively .

source_bert_toks: ' adam ? ' she ventured tentatively .

reference_raw: "Adam?" she asked hesitantly.

reference_spacy_tokens: " Adam ? " she asked hesitantly .


fn_spacy_tokens_for_baseline: The Committee concluded that the broadcasters could legitimately claim to have made a praiseworthy attempt to deliver the sort of programmes they had promised .

source_bert_toks: the committee concluded that the broadcasters could legitimate ##ly claim to have made a praise ##worthy attempt to deliver the sort of programmes they had promised .

reference_raw: The Committee concluded that the broadcasters could legitimately claim that they had made a commendable attempt to implement the programmes they had promised.

reference_spacy_tokens: The Committee concluded that the broadcasters could legitimately claim that they had made a commendable attempt to implement the programmes they had promised .


fn_spacy_tokens_for_baseline: QN : Has North Korea taken steps to protect its military airfields from chemical weapons attacks ?

source_bert_toks: q ##n : has north korea taken steps to protect its military airfields from chemical weapons attacks ?

reference_raw: QN: Did North Korea take action to protect its military airports from chemical weapons attacks?

reference_spacy_tokens: QN : Did North Korea take action to protect its military airports from chemical weapons attacks ?


fn_spacy_tokens_for_baseline: Police believe this was when he hatched his plot to kill .

source_bert_toks: police believe this was when he hatch ##ed his plot to kill .

reference_raw: The police believe that's when he came up with a conspiracy to kill.

reference_spacy_tokens: The police believe that 's when he came up with a conspiracy to kill .


fn_spacy_tokens_for_baseline: Reduction in beds puts city [ Sydney ] at risk : hospital official

source_bert_toks: reduction in beds puts city [ sydney ] at risk : hospital official

reference_raw: Reducing beds puts the town [Sydney] at risk: hospital official

reference_spacy_tokens: Reducing beds puts the town [ Sydney ] at risk : hospital official


fn_spacy_tokens_for_baseline: Arthur is inclined to be delicate and it 's feared he has not long to live .

source_bert_toks: arthur is inclined to be delicate and it ' s feared he has not long to live .

reference_raw: Arthur tends to be sensitive, and he's afraid he doesn't want to live long.

reference_spacy_tokens: Arthur tends to be sensitive , and he 's afraid he does n't want to live long .


fn_spacy_tokens_for_baseline: The scenario came direct from Brian Lecomber 's best - selling thriller Talk Down .

source_bert_toks: the scenario came direct from brian le ##combe ##r ' s best - selling thriller talk down .

reference_raw: The script had come straight from Brian Lecomber's best-selling excitement Talk Down.

reference_spacy_tokens: The script had come straight from Brian Lecomber 's best - selling excitement Talk Down .


fn_spacy_tokens_for_baseline: ' Ger'em off ! ' slurred one , to the amusement of his fellows .

source_bert_toks: ' ge ##r ' em off ! ' sl ##ur ##red one , to the amusement of his fellows .

reference_raw: 'Ger'em gone!' said one of them, to the amusement of his comrades.

reference_spacy_tokens: ' Ger'em gone ! ' said one of them , to the amusement of his comrades .


fn_spacy_tokens_for_baseline: Anders was there , supposedly supervising the preparation of an assortment of mixed salads for the buffet .

source_bert_toks: anders was there , supposedly supervising the preparation of an assortment of mixed salad ##s for the buffet .

reference_raw: Anders was there, supposedly overseeing the mixing of salads for the buffet.

reference_spacy_tokens: Anders was there , supposedly overseeing the mixing of salads for the buffet .


fn_spacy_tokens_for_baseline: The electorate numbered 5,700,000 and the turnout was 83.81 per cent in the first round and 80 per cent in the second round .

source_bert_toks: the electorate numbered 5 , 700 , 000 and the turnout was 83 . 81 per cent in the first round and 80 per cent in the second round .

reference_raw: The voter was 5,700,000, and the turnout was 83,81 percent in the first round and 80 percent in the second round.

reference_spacy_tokens: The voter was 5,700,000 , and the turnout was 83,81 percent in the first round and 80 percent in the second round .


fn_spacy_tokens_for_baseline: The flames leaped up , with an overpowering stink of burning cheese .

source_bert_toks: the flames leaped up , with an over ##powering stink of burning cheese .

reference_raw: The flames sprang up, the stench of burning cheese overpowering.

reference_spacy_tokens: The flames sprang up , the stench of burning cheese overpowering .


fn_spacy_tokens_for_baseline: ' Really , ' the Doctor snorted .

source_bert_toks: ' really , ' the doctor snorted .

reference_raw: 'Indeed,' said the Doctor.

reference_spacy_tokens: ' Indeed , ' said the Doctor .


fn_spacy_tokens_for_baseline: During the year under review a total of 132 press releases , 12 press conferences and 67 radio and television interviews helped communicate the Council 's news and views in Scotland .

source_bert_toks: during the year under review a total of 132 press releases , 12 press conferences and 67 radio and television interviews helped communicate the council ' s news and views in scotland .

reference_raw: In the course of the year under review, a total of 132 press releases, 12 press conferences and 67 radio and television interviews contributed to the communication of Council reports and opinions in Scotland.

reference_spacy_tokens: In the course of the year under review , a total of 132 press releases , 12 press conferences and 67 radio and television interviews contributed to the communication of Council reports and opinions in Scotland .


fn_spacy_tokens_for_baseline: ' You stay in your nightwear when you come home and you go back to bed .

source_bert_toks: ' you stay in your night ##wear when you come home and you go back to bed .

reference_raw: When you get home, you stay in your nightgown and go back to bed.

reference_spacy_tokens: When you get home , you stay in your nightgown and go back to bed .


fn_spacy_tokens_for_baseline: Evreux 's Communist mayor , Roland Plaisance , said he was " revolted " by the firing and praised Gaillot 's commitment to " staying close to the poor and the excluded . "

source_bert_toks: ev ##re ##ux ' s communist mayor , roland pl ##ais ##ance , said he was " revolt ##ed " by the firing and praised gail ##lot ' s commitment to " staying close to the poor and the excluded . "

reference_raw: The Communist Mayor of Evreux, Roland Plaisance, said that he was "revolved" by the fire, and praised Gaillot's commitment to "stay close to the poor and the excluded."

reference_spacy_tokens: The Communist Mayor of Evreux , Roland Plaisance , said that he was " revolved " by the fire , and praised Gaillot 's commitment to " stay close to the poor and the excluded . "


fn_spacy_tokens_for_baseline: Skating to " Brick House " by the Commodores , Browning 's rubber - legged act wowed the crowd of 18,150 .

source_bert_toks: skating to " brick house " by the commodore ##s , browning ' s rubber - legged act wow ##ed the crowd of 18 , 150 .

reference_raw: The Commodores skated to "Brick House," and Browning's rubber-legged act made a crowd of 18,150.

reference_spacy_tokens: The Commodores skated to " Brick House , " and Browning 's rubber - legged act made a crowd of 18,150 .


fn_spacy_tokens_for_baseline: If the Nazis of the extermination camps are the measure of our humanity , then we are left in darkness and despair .

source_bert_toks: if the nazis of the ex ##ter ##mina ##tion camps are the measure of our humanity , then we are left in darkness and despair .

reference_raw: If the Nazis of annihilation camps are the measure of our humanity, then we are left in darkness and despair.

reference_spacy_tokens: If the Nazis of annihilation camps are the measure of our humanity , then we are left in darkness and despair .


fn_spacy_tokens_for_baseline: Ace sensed that its forward speed had slowed too , and that its course was veering rightwards .

source_bert_toks: ace sensed that its forward speed had slowed too , and that its course was ve ##ering right ##ward ##s .

reference_raw: Ace sensed that his forward speed had also slowed, and that his course was turning to the right.

reference_spacy_tokens: Ace sensed that his forward speed had also slowed , and that his course was turning to the right .


fn_spacy_tokens_for_baseline: They were charged , Friday , in federal court with bank robbery , firearms violations , carjacking and conspiracy .

source_bert_toks: they were charged , friday , in federal court with bank robbery , firearms violations , car ##jack ##ing and conspiracy .

reference_raw: On Friday, they were charged with bank robberies, firearms violations, car theft, and conspiracy in federal court.

reference_spacy_tokens: On Friday , they were charged with bank robberies , firearms violations , car theft , and conspiracy in federal court .


fn_spacy_tokens_for_baseline: Surrounding the stones is a wooden tun lined with zinc .

source_bert_toks: surrounding the stones is a wooden tun lined with zinc .

reference_raw: The stones are surrounded by a wooden tin lined with zinc.

reference_spacy_tokens: The stones are surrounded by a wooden tin lined with zinc .


fn_spacy_tokens_for_baseline: The caller from the agency may plead and cajole you into agreeing to accept the job , especially if it is a last minute booking and they are desperate for someone .

source_bert_toks: the caller from the agency may plead and ca ##jo ##le you into agreeing to accept the job , especially if it is a last minute booking and they are desperate for someone .

reference_raw: The caller at the agency can beg you to accept the job, especially if it's a last-minute reservation and they're desperate for someone.

reference_spacy_tokens: The caller at the agency can beg you to accept the job , especially if it 's a last - minute reservation and they 're desperate for someone .


fn_spacy_tokens_for_baseline: If you were a thrifty citizen and wanted a safe piggy - bank secure from the prying eyes of nasty parties such .

source_bert_toks: if you were a th ##rift ##y citizen and wanted a safe pig ##gy - bank secure from the pry ##ing eyes of nasty parties such .

reference_raw: If you were a thriving citizen and wanted a safe pig bank safe from the prying eyes of ugly parties like that.

reference_spacy_tokens: If you were a thriving citizen and wanted a safe pig bank safe from the prying eyes of ugly parties like that .


fn_spacy_tokens_for_baseline: In spite of the dangers , he mixed with Muslim pilgrims and performed all the religious rites , making copious notes of everything he saw .

source_bert_toks: in spite of the dangers , he mixed with muslim pilgrims and performed all the religious rites , making cop ##ious notes of everything he saw .

reference_raw: Despite the dangers, he blended with Muslim pilgrims and performed all the religious rituals, making copies of everything he had seen.

reference_spacy_tokens: Despite the dangers , he blended with Muslim pilgrims and performed all the religious rituals , making copies of everything he had seen .


fn_spacy_tokens_for_baseline: Abbas and his aides said they would hunt and arrest those behind Tuesday night 's bombing .

source_bert_toks: abbas and his aide ##s said they would hunt and arrest those behind tuesday night ' s bombing .

reference_raw: Abbas and his assistants said they were going to hunt and arrest the ones who were responsible for the bombing on Tuesday night.

reference_spacy_tokens: Abbas and his assistants said they were going to hunt and arrest the ones who were responsible for the bombing on Tuesday night .


fn_spacy_tokens_for_baseline: He dropped his gaze from her face to his empty bowl .

source_bert_toks: he dropped his gaze from her face to his empty bowl .

reference_raw: He looked away from her face at the empty basin.

reference_spacy_tokens: He looked away from her face at the empty basin .


fn_spacy_tokens_for_baseline: Before assessing the threat of CBW terrorism , we need to define the word " terrorism . "

source_bert_toks: before assessing the threat of cb ##w terrorism , we need to define the word " terrorism . "

reference_raw: We must define the word "terrorism" before we assess the threat of CBW terrorism.

reference_spacy_tokens: We must define the word " terrorism " before we assess the threat of CBW terrorism .


fn_spacy_tokens_for_baseline: The shot rang out , but she missed .

source_bert_toks: the shot rang out , but she missed .

reference_raw: There was a gunshot, but she missed it.

reference_spacy_tokens: There was a gunshot , but she missed it .


fn_spacy_tokens_for_baseline: School officials tout programs such as Joint Venture as proof that the district is n't throwing completely unprepared people into the classroom .

source_bert_toks: school officials to ##ut programs such as joint venture as proof that the district isn ' t throwing completely un ##pre ##par ##ed people into the classroom .

reference_raw: School officials use programs like Joint Venture as evidence that the precinct doesn't throw completely unprepared people into the classroom.

reference_spacy_tokens: School officials use programs like Joint Venture as evidence that the precinct does n't throw completely unprepared people into the classroom .


fn_spacy_tokens_for_baseline: In the capital there 's a magnificent parade of roughly caparisoned elephants , floats and costumed walkers , culminating in a fly - past decorating the sky with the colours of the national flag .

source_bert_toks: in the capital there ' s a magnificent parade of roughly cap ##aris ##oned elephants , floats and costume ##d walkers , culminating in a fly - past decor ##ating the sky with the colours of the national flag .

reference_raw: There is a magnificent parade in the capital of crudely caparisoned elephants, floaters, and dressed pedestrians, culminating in a fly-past that decorates the sky with the colors of a national flag.

reference_spacy_tokens: There is a magnificent parade in the capital of crudely caparisoned elephants , floaters , and dressed pedestrians , culminating in a fly - past that decorates the sky with the colors of a national flag .


fn_spacy_tokens_for_baseline: She popped a prawn ball into her mouth and bit on it , showering him with sweet and sour sauce .

source_bert_toks: she popped a pr ##aw ##n ball into her mouth and bit on it , shower ##ing him with sweet and sour sauce .

reference_raw: She stuck a shrimp ball in her mouth and bit on it, spraying it with sweet and sour sauce.

reference_spacy_tokens: She stuck a shrimp ball in her mouth and bit on it , spraying it with sweet and sour sauce .


fn_spacy_tokens_for_baseline: He crawled on his hands and knees to his quilt and slumped down on top of it , breathing heavily and filling the darkness with the reek of beer .

source_bert_toks: he crawled on his hands and knees to his quilt and slumped down on top of it , breathing heavily and filling the darkness with the re ##ek of beer .

reference_raw: He crawled on his hands and knees to his blanket and collapsed on top of it, breathing heavily, filling the darkness with the smell of beer.

reference_spacy_tokens: He crawled on his hands and knees to his blanket and collapsed on top of it , breathing heavily , filling the darkness with the smell of beer .


fn_spacy_tokens_for_baseline: ' We could build a sitting room up there . '

source_bert_toks: ' we could build a sitting room up there . '

reference_raw: "We can build a living room upstairs."

reference_spacy_tokens: " We can build a living room upstairs . "


fn_spacy_tokens_for_baseline: Springsteen finished the mince and inspected his whiskers for any he 'd missed .

source_bert_toks: springsteen finished the min ##ce and inspected his w ##his ##kers for any he ' d missed .

reference_raw: Springsteen finished his mince and checked his beard to see if he had missed it.

reference_spacy_tokens: Springsteen finished his mince and checked his beard to see if he had missed it .


fn_spacy_tokens_for_baseline: A handbell in the Bishop 's fist clanged like a ship 's bell .

source_bert_toks: a hand ##bell in the bishop ' s fist clan ##ged like a ship ' s bell .

reference_raw: The bell in the Bishop's fist rang like a ship's bell.

reference_spacy_tokens: The bell in the Bishop 's fist rang like a ship 's bell .


fn_spacy_tokens_for_baseline: ' Pooley stretched out a tentative boot to nudge the copper coin aside .

source_bert_toks: ' poole ##y stretched out a tentative boot to nu ##dge the copper coin aside .

reference_raw: Pooley reached out his hesitant boot and pushed the copper coin aside.

reference_spacy_tokens: Pooley reached out his hesitant boot and pushed the copper coin aside .


fn_spacy_tokens_for_baseline: His lips clamped together and he raised one corner of his thin mouth in a spiteful leer , his large bald head nodding deliberately to and fro while he waited for the younger man 's response .

source_bert_toks: his lips clamped together and he raised one corner of his thin mouth in a spite ##ful lee ##r , his large bald head nodding deliberately to and fr ##o while he waited for the younger man ' s response .

reference_raw: He clamped his lips together and lifted one corner of his thin mouth in a malicious leer, his big bald head nodding deliberately back and forth as he waited for the younger man's reply.

reference_spacy_tokens: He clamped his lips together and lifted one corner of his thin mouth in a malicious leer , his big bald head nodding deliberately back and forth as he waited for the younger man 's reply .


fn_spacy_tokens_for_baseline: No one suggests he should be left to the mercy of mad killers , but if he 's really on the run he should be sheltering in some safe house , not bopping around town .

source_bert_toks: no one suggests he should be left to the mercy of mad killers , but if he ' s really on the run he should be shelter ##ing in some safe house , not bop ##ping around town .

reference_raw: No one's suggesting that he should be left at the mercy of mad killers, but if he's really on the run, he should be hiding in a safe house, not bouncing around the city.

reference_spacy_tokens: No one 's suggesting that he should be left at the mercy of mad killers , but if he 's really on the run , he should be hiding in a safe house , not bouncing around the city .


fn_spacy_tokens_for_baseline: I was just annoyed that he 'd chosen to do it while I 'd been away .

source_bert_toks: i was just annoyed that he ' d chosen to do it while i ' d been away .

reference_raw: I was just upset that he decided to do it while I was gone.

reference_spacy_tokens: I was just upset that he decided to do it while I was gone .


fn_spacy_tokens_for_baseline: I speak , of course , of Mike Teague -- once of England , British Lions and Gloucester , who became a battered , knackered cripple .

source_bert_toks: i speak , of course , of mike tea ##gue - - once of england , british lions and gloucester , who became a battered , kn ##acker ##ed cr ##ip ##ple .

reference_raw: I'm talking about Mike Teague, of course, once from England, British lions and Gloucester, who became a battered, scratched cripple.

reference_spacy_tokens: I 'm talking about Mike Teague , of course , once from England , British lions and Gloucester , who became a battered , scratched cripple .


fn_spacy_tokens_for_baseline: Sir John stopped and slouched against the wall , staring upwards at the great beams resting on their corbels of stone .

source_bert_toks: sir john stopped and sl ##ou ##ched against the wall , staring upwards at the great beams resting on their co ##rb ##els of stone .

reference_raw: Sir John stopped and leaned back against the wall, staring up at the huge beams resting on their stone corbels.

reference_spacy_tokens: Sir John stopped and leaned back against the wall , staring up at the huge beams resting on their stone corbels .


fn_spacy_tokens_for_baseline: I heard the creak of a door and the crisp sound of boots upon gravel .

source_bert_toks: i heard the cr ##eak of a door and the crisp sound of boots upon gravel .

reference_raw: I could hear the creak of doorways and the crunching sound of shoes on gravel.

reference_spacy_tokens: I could hear the creak of doorways and the crunching sound of shoes on gravel .


fn_spacy_tokens_for_baseline: She turned the rifle on its side and clubbed him down brutally with the butt .

source_bert_toks: she turned the rifle on its side and club ##bed him down brutally with the butt .

reference_raw: Turning the rifle on her side, she slammed the butt brutally into it.

reference_spacy_tokens: Turning the rifle on her side , she slammed the butt brutally into it .


fn_spacy_tokens_for_baseline: She was followed five minutes later by an angry Carole , suitcase in hand , who was to find that she was unable to quit the hotel until midnight .

source_bert_toks: she was followed five minutes later by an angry carole , suitcase in hand , who was to find that she was unable to quit the hotel until midnight .

reference_raw: Five minutes later she was followed by an angry Carole with a suitcase in her hand, who found herself unable to leave the hotel until midnight.

reference_spacy_tokens: Five minutes later she was followed by an angry Carole with a suitcase in her hand , who found herself unable to leave the hotel until midnight .


fn_spacy_tokens_for_baseline: I had plenty of time to think between sentences , since the detective who 'd collared me was carefully writing it into a statement .

source_bert_toks: i had plenty of time to think between sentences , since the detective who ' d collar ##ed me was carefully writing it into a statement .

reference_raw: I had plenty of time to think between the sentences, for the detective who had clasped me had carefully written it into a statement.

reference_spacy_tokens: I had plenty of time to think between the sentences , for the detective who had clasped me had carefully written it into a statement .


fn_spacy_tokens_for_baseline: Once again , I was restless and unfulfilled , though I now had a successful business and was happily married .

source_bert_toks: once again , i was restless and un ##ful ##fi ##lled , though i now had a successful business and was happily married .

reference_raw: I was restless and unsatisfactory again, though I now had a successful business and was happily married.

reference_spacy_tokens: I was restless and unsatisfactory again , though I now had a successful business and was happily married .


fn_spacy_tokens_for_baseline: In particular , Notimex said government officials were complaining about access to the site thronged by the Zapatista sympathizers .

source_bert_toks: in particular , not ##ime ##x said government officials were complaining about access to the site th ##rong ##ed by the za ##pati ##sta sy ##mp ##athi ##zers .

reference_raw: Notimex, in particular, said that government officials complained about accessing a site crowded by Zapatista sympathizers.

reference_spacy_tokens: Notimex , in particular , said that government officials complained about accessing a site crowded by Zapatista sympathizers .


fn_spacy_tokens_for_baseline: Several of these latter , above all the toxic organophosphates , were almost certainly employed to assassinate individual " enemies of the state . "

source_bert_toks: several of these latter , above all the toxic organ ##op ##hos ##phate ##s , were almost certainly employed to assassinate individual " enemies of the state . "

reference_raw: Some of them, especially toxic organophosphates, were almost certainly used to kill individual "national enemies."

reference_spacy_tokens: Some of them , especially toxic organophosphates , were almost certainly used to kill individual " national enemies . "


fn_spacy_tokens_for_baseline: Another version of this Trojan origin legend was written down in 727 by the author of the Liber Historiae Francorum .

source_bert_toks: another version of this trojan origin legend was written down in 72 ##7 by the author of the li ##ber historia ##e franco ##rum .

reference_raw: In 727, the author of the Liber Historiae Francorum recorded another version of this Trojan origin legend.

reference_spacy_tokens: In 727 , the author of the Liber Historiae Francorum recorded another version of this Trojan origin legend .


fn_spacy_tokens_for_baseline: While the British press is usually circumspect in discussing the German question , there are frequent articles in the French press about the dangers of German domination .

source_bert_toks: while the british press is usually ci ##rc ##ums ##pe ##ct in discussing the german question , there are frequent articles in the french press about the dangers of german domination .

reference_raw: While the British press is usually careful to discuss the German question, the French press has frequent stories about the dangers of German dominance.

reference_spacy_tokens: While the British press is usually careful to discuss the German question , the French press has frequent stories about the dangers of German dominance .


fn_spacy_tokens_for_baseline: Students back fight over union funding

source_bert_toks: students back fight over union funding

reference_raw: Students back struggle for union funding


fn_spacy_tokens_for_baseline: Zahedi advised the Shah to stay in Morocco .

source_bert_toks: za ##hed ##i advised the shah to stay in morocco .

reference_raw: Zahedi recommended that the Sah stay in Morocco.

reference_spacy_tokens: Zahedi recommended that the Sah stay in Morocco .


fn_spacy_tokens_for_baseline: I do pretend a little , especially since Richard died .

source_bert_toks: i do pretend a little , especially since richard died .

reference_raw: I've been acting a little, especially since Richard died.

reference_spacy_tokens: I 've been acting a little , especially since Richard died .


fn_spacy_tokens_for_baseline: Such direct measures were first undertaken in rural areas by the Development Commission , established in 1947 .

source_bert_toks: such direct measures were first undertaken in rural areas by the development commission , established in 1947 .

reference_raw: These direct actions were first taken in rural areas by the Development Commission, set up in 1947.

reference_spacy_tokens: These direct actions were first taken in rural areas by the Development Commission , set up in 1947 .


fn_spacy_tokens_for_baseline: The Mistral SST is the board used for the Youth and Ladies World Championships , for which identical boards are supplied for competitors at the race site .

source_bert_toks: the mist ##ral ss ##t is the board used for the youth and ladies world championships , for which identical boards are supplied for competitors at the race site .

reference_raw: The Mistral SST is the board used for the World Youth and Ladies Championships, for which the same boards are provided to rivals at the site of the race.

reference_spacy_tokens: The Mistral SST is the board used for the World Youth and Ladies Championships , for which the same boards are provided to rivals at the site of the race .


fn_spacy_tokens_for_baseline: When they moved to their cottage it was meant to be temporary . despite the lack of facilities they 've been here over 30 years .

source_bert_toks: when they moved to their cottage it was meant to be temporary . despite the lack of facilities they ' ve been here over 30 years .

reference_raw: When they moved into their cabin, it was supposed to be temporary . . . despite the lack of equipment, they'd been here for more than 30 years.

reference_spacy_tokens: When they moved into their cabin , it was supposed to be temporary . . . despite the lack of equipment , they 'd been here for more than 30 years .


fn_spacy_tokens_for_baseline: This shows itself in a variety of ways : in the all - consuming craving for more money and possessions , more power and social status , and more pleasure and entertainment .

source_bert_toks: this shows itself in a variety of ways : in the all - consuming craving for more money and possessions , more power and social status , and more pleasure and entertainment .

reference_raw: It shows itself in a variety of ways: an all-consuming desire for more money and wealth, more power and social status, and more pleasure and entertainment.

reference_spacy_tokens: It shows itself in a variety of ways : an all - consuming desire for more money and wealth , more power and social status , and more pleasure and entertainment .


fn_spacy_tokens_for_baseline: And as Fabia gasped at the implication she saw behind that statement Lubor was going on , ' It is I who asks you , for myself .

source_bert_toks: and as fa ##bia gasped at the implication she saw behind that statement lu ##bor was going on , ' it is i who asks you , for myself .

reference_raw: And as Fabia panted at the implication she saw behind that statement that Lubor was saying, "I'm asking you for myself.

reference_spacy_tokens: And as Fabia panted at the implication she saw behind that statement that Lubor was saying , " I 'm asking you for myself .


fn_spacy_tokens_for_baseline: Before she could struggle to her feet , Diana neatly sidestepped her bruised stepmother and marched off without a word or a backward glance .

source_bert_toks: before she could struggle to her feet , diana neatly sides ##te ##pped her bruised stepmother and marched off without a word or a backward glance .

reference_raw: Before she could get to her feet, Diana carefully backed away from her bruised stepmother and marched away without a word or a backward glance.

reference_spacy_tokens: Before she could get to her feet , Diana carefully backed away from her bruised stepmother and marched away without a word or a backward glance .


fn_spacy_tokens_for_baseline: The sun had just set , and the sky was still light and glowing with softly pastel mauves and pinks , but here in the thick trees , it was hard to see .

source_bert_toks: the sun had just set , and the sky was still light and glowing with softly paste ##l ma ##uve ##s and pink ##s , but here in the thick trees , it was hard to see .

reference_raw: The sun had just set, and the sky was still bright and shining with soft pastel mauves and roses, but it was hard to see here in the thick trees.

reference_spacy_tokens: The sun had just set , and the sky was still bright and shining with soft pastel mauves and roses , but it was hard to see here in the thick trees .


fn_spacy_tokens_for_baseline: And there was one boss -- well , if he could n't spell your name you 'd had it .

source_bert_toks: and there was one boss - - well , if he couldn ' t spell your name you ' d had it .

reference_raw: And there was one boss -- well, if he didn't write your name, you'd have it.

reference_spacy_tokens: And there was one boss -- well , if he did n't write your name , you 'd have it .


fn_spacy_tokens_for_baseline: She says you have to be brusque with them because they 're getting on a bit , you know .

source_bert_toks: she says you have to be br ##us ##que with them because they ' re getting on a bit , you know .

reference_raw: She said you had to be rude to them, 'cause they're getting along a little bit, you know.

reference_spacy_tokens: She said you had to be rude to them , 'cause they 're getting along a little bit , you know .


fn_spacy_tokens_for_baseline: Sift in remaining flours , cocoa and spice .

source_bert_toks: si ##ft in remaining flour ##s , cocoa and spice .

reference_raw: Sip in the remaining flour, cocoa, and melange.

reference_spacy_tokens: Sip in the remaining flour , cocoa , and melange .


fn_spacy_tokens_for_baseline: Briefly she saw in her mind a slender girl walking the shore , beating her hands one against the other in bitter rebellion .

source_bert_toks: briefly she saw in her mind a slender girl walking the shore , beating her hands one against the other in bitter rebellion .

reference_raw: In her mind she saw a thin girl walking along the bank, beating her hands one against the other in bitter rebellion.

reference_spacy_tokens: In her mind she saw a thin girl walking along the bank , beating her hands one against the other in bitter rebellion .