fn_spacy_tokens_for_baseline: Roy Strait said he heard at least two men as they administered sleeping pills to the film star -- then smothered her to death .

source_bert_toks: roy strait said he heard at least two men as they administered sleeping pills to the film star - - then sm ##oth ##ered her to death .

reference_raw: Roy Strait said he'd heard at least two men give a movie star sleeping pills and then choke her to death.

reference_spacy_tokens: Roy Strait said he 'd heard at least two men give a movie star sleeping pills and then choke her to death .


fn_spacy_tokens_for_baseline: I have pricked my first blister , squeezed out the fluid , and dabbed it with surgical spirit .

source_bert_toks: i have prick ##ed my first b ##list ##er , squeezed out the fluid , and da ##bbed it with surgical spirit .

reference_raw: I stabbed the first blister, squeezed out the liquid, and rubbed it with surgical spirit.

reference_spacy_tokens: I stabbed the first blister , squeezed out the liquid , and rubbed it with surgical spirit .


fn_spacy_tokens_for_baseline: Private cars guzzle about 7 % of the world 's commercial ( non - industrial ) energy or 17 % of the oil used each year .

source_bert_toks: private cars gu ##zzle about 7 % of the world ' s commercial ( non - industrial ) energy or 17 % of the oil used each year .

reference_raw: Private cars consume about 7% of the world's commercial (non-industrial) energy, or 17% of the oil used every year.

reference_spacy_tokens: Private cars consume about 7 % of the world 's commercial ( non - industrial ) energy , or 17 % of the oil used every year .


fn_spacy_tokens_for_baseline: Feet crunched past me , I caught a glimpse of a brown boot , the tongue flapping , the sole tied on with string .

source_bert_toks: feet crunch ##ed past me , i caught a glimpse of a brown boot , the tongue flap ##ping , the sole tied on with string .

reference_raw: My feet brushed past me, and I saw the brown boot, the tongue flapping, the sole tied with string.

reference_spacy_tokens: My feet brushed past me , and I saw the brown boot , the tongue flapping , the sole tied with string .


fn_spacy_tokens_for_baseline: He was a fiery character of immense stubbornness who stood out against the new plans to merge his land into a co - operative pool that would benefit everyone .

source_bert_toks: he was a fiery character of immense stubborn ##ness who stood out against the new plans to merge his land into a co - operative pool that would benefit everyone .

reference_raw: He was a fiery figure of immense stubbornness, standing out against new plans to combine his country into a cooperative pool that would benefit everyone.

reference_spacy_tokens: He was a fiery figure of immense stubbornness , standing out against new plans to combine his country into a cooperative pool that would benefit everyone .


fn_spacy_tokens_for_baseline: ' I do n't often agree with what this aggravating old fool says , but this time I think she 's talking sense . '

source_bert_toks: ' i don ' t often agree with what this ag ##gra ##vating old fool says , but this time i think she ' s talking sense . '

reference_raw: "I don't often agree with what this annoying old fool is saying, but I think he's speaking sense this time."

reference_spacy_tokens: " I do n't often agree with what this annoying old fool is saying , but I think he 's speaking sense this time . "


fn_spacy_tokens_for_baseline: The German architect Karl Friedrich Schinkel is best known for his severe Classical public buildings such as the superb Altes Museum in Berlin , but he also worked in other styles : Gothic in churches , and picturesque Italianate in villas .

source_bert_toks: the german architect karl friedrich sc ##hin ##kel is best known for his severe classical public buildings such as the superb alt ##es museum in berlin , but he also worked in other styles : gothic in churches , and picturesque italianate in villas .

reference_raw: The German architect Karl Friedrich Schinkel is best known for his serious classic public buildings, such as the great Altes Museum in Berlin, but he also worked in other styles: Gothic in churches, and picturesque Italianate in villas.

reference_spacy_tokens: The German architect Karl Friedrich Schinkel is best known for his serious classic public buildings , such as the great Altes Museum in Berlin , but he also worked in other styles : Gothic in churches , and picturesque Italianate in villas .


fn_spacy_tokens_for_baseline: There were ornate neck circles with chippings of moonstones and slender , silver anklets engraved with the tree symbols of fertility and great chunks of raw gold somehow veined with amber which would be used as Coronation accessories .

source_bert_toks: there were ornate neck circles with chip ##ping ##s of moons ##tones and slender , silver ankle ##ts engraved with the tree symbols of fertility and great chunks of raw gold somehow vein ##ed with amber which would be used as coronation accessories .

reference_raw: There were decorative rings of neck, with chips of moonstones, and slender silver knuckles engraved with tree symbols of fertility, and large chunks of raw gold that were somehow veined with amber to be used as coronation accessories.

reference_spacy_tokens: There were decorative rings of neck , with chips of moonstones , and slender silver knuckles engraved with tree symbols of fertility , and large chunks of raw gold that were somehow veined with amber to be used as coronation accessories .


fn_spacy_tokens_for_baseline: So radical has the change been that Freddie and Caroline are sometimes at Prue 's dinner - parties now .

source_bert_toks: so radical has the change been that freddie and caroline are sometimes at pr ##ue ' s dinner - parties now .

reference_raw: The change was so radical that Freddie and Caroline are sometimes at Prue's party.

reference_spacy_tokens: The change was so radical that Freddie and Caroline are sometimes at Prue 's party .


fn_spacy_tokens_for_baseline: This is a somewhat disingenuous letter .

source_bert_toks: this is a somewhat di ##sing ##en ##uous letter .

reference_raw: It's a rather inconvenient letter.

reference_spacy_tokens: It 's a rather inconvenient letter .


fn_spacy_tokens_for_baseline: The committee says that UK Nirex , the nuclear waste disposal company , has consistently underestimated the time it will take to prepare and build a repository .

source_bert_toks: the committee says that uk ni ##re ##x , the nuclear waste disposal company , has consistently under ##est ##imated the time it will take to prepare and build a repository .

reference_raw: According to the Committee, UK Nirex, a nuclear waste disposal company, has consistently underestimated the time needed to prepare and build a storage site.

reference_spacy_tokens: According to the Committee , UK Nirex , a nuclear waste disposal company , has consistently underestimated the time needed to prepare and build a storage site .


fn_spacy_tokens_for_baseline: He says : ' It would have been very bad to perform at a butcher 's wedding . '

source_bert_toks: he says : ' it would have been very bad to perform at a butcher ' s wedding . '

reference_raw: He said, "It'd be a terrible thing to do at a butcher's marriage."

reference_spacy_tokens: He said , " It 'd be a terrible thing to do at a butcher 's marriage . "


fn_spacy_tokens_for_baseline: On Oct. 20 masked gunmen burst into a crowded cafe in Sidon and shot dead three al - Fatah officials .

source_bert_toks: on oct . 20 masked gunmen burst into a crowded cafe in sid ##on and shot dead three al - fat ##ah officials .

reference_raw: On October 20 camouflage gunmen burst into a crowded cafe in Sidon and shot three Al-Fatah officials dead.

reference_spacy_tokens: On October 20 camouflage gunmen burst into a crowded cafe in Sidon and shot three Al - Fatah officials dead .


fn_spacy_tokens_for_baseline: 2- Sheik of Albu'Ubaid ( Salah al - Dhari ) , who slaughtered thirty sheeps in one dinner party , where he invited heads and Sheiks of tribes in Ramadi , to encourage their youth to join the police and the national guard , and that 's two days before the murder of Sheik Nasr al - Fahdawi .

source_bert_toks: 2 - she ##ik of al ##bu ' u ##bai ##d ( sal ##ah al - dh ##ari ) , who slaughtered thirty sheep ##s in one dinner party , where he invited heads and she ##ik ##s of tribes in rama ##di , to encourage their youth to join the police and the national guard , and that ' s two days before the murder of she ##ik nas ##r al - fa ##hd ##aw ##i .

reference_raw: 2-Sheik of Albu'Ubaid (Salah al-Dhari) who slaughtered thirty sheep at a dinner party where he invited the heads and sheiks of the tribes of Ramadi to encourage their youth to join the police and the National Guard, two days before the assassination of Sheik Nasr al-Fahdawi.

reference_spacy_tokens: 2-Sheik of Albu'Ubaid ( Salah al - Dhari ) who slaughtered thirty sheep at a dinner party where he invited the heads and sheiks of the tribes of Ramadi to encourage their youth to join the police and the National Guard , two days before the assassination of Sheik Nasr al - Fahdawi .


fn_spacy_tokens_for_baseline: He was just 17 when he we d Sue Walpole in 1971 .

source_bert_toks: he was just 17 when he wed sue wal ##pole in 1971 .

reference_raw: When he married Sue Walpole in 1971, he was only 17.

reference_spacy_tokens: When he married Sue Walpole in 1971 , he was only 17 .


fn_spacy_tokens_for_baseline: We inched our way slowly forward and finally reached the harried , unsmiling agent .

source_bert_toks: we inched our way slowly forward and finally reached the ha ##rrie ##d , un ##sm ##iling agent .

reference_raw: We took a slow step forward, and at last we came to the hairy, unsmiling agent.

reference_spacy_tokens: We took a slow step forward , and at last we came to the hairy , unsmiling agent .


fn_spacy_tokens_for_baseline: The fact remains , and will become more and more evident as the year goes by , that the deliberate under - funding of the Act was an act of incompetence by incompetent ministers .

source_bert_toks: the fact remains , and will become more and more evident as the year goes by , that the deliberate under - funding of the act was an act of inc ##omp ##ete ##nce by inc ##omp ##ete ##nt ministers .

reference_raw: The fact remains, and will become more and more evident as the year goes by, that the intentional underfunding of the law was an act of incompetence by incompetence ministers.

reference_spacy_tokens: The fact remains , and will become more and more evident as the year goes by , that the intentional underfunding of the law was an act of incompetence by incompetence ministers .


fn_spacy_tokens_for_baseline: It was a year since her wedding , and on that bright cold morning her unspoken hope was to win over her husband 's family and so persuade him back to her .

source_bert_toks: it was a year since her wedding , and on that bright cold morning her unspoken hope was to win over her husband ' s family and so persuade him back to her .

reference_raw: It had been a year since she'd been married, and on that clear cold morning, her unspoken hope had been to win over her husband's family and convince him to come back to her.

reference_spacy_tokens: It had been a year since she 'd been married , and on that clear cold morning , her unspoken hope had been to win over her husband 's family and convince him to come back to her .


fn_spacy_tokens_for_baseline: The Squat tugged his flak - jacket straight , brushed dirt off it , combed his gingery beard with his fingers , flicked at his knotted ponytail as if a fly had landed on it .

source_bert_toks: the squat tugged his fl ##ak - jacket straight , brushed dirt off it , comb ##ed his ginger ##y beard with his fingers , flicked at his knotted ponytail as if a fly had landed on it .

reference_raw: The Squat pulled his jacket straight, brushed the dirt from it, brushed his gingery beard with his fingers, and flicked his knotted ponytail as if a fly had landed on it.

reference_spacy_tokens: The Squat pulled his jacket straight , brushed the dirt from it , brushed his gingery beard with his fingers , and flicked his knotted ponytail as if a fly had landed on it .


fn_spacy_tokens_for_baseline: A child will not conform ' naturally ' to all the rules of his or her parents or society , no matter how benevolent the home environment may be .

source_bert_toks: a child will not conform ' naturally ' to all the rules of his or her parents or society , no matter how benevolent the home environment may be .

reference_raw: The child does not "naturally" comply with all the rules of his parents or society, no matter how kind the home environment may be.

reference_spacy_tokens: The child does not " naturally " comply with all the rules of his parents or society , no matter how kind the home environment may be .


fn_spacy_tokens_for_baseline: I also wondered if Sir John Santerre , despite his bluff bonhomie , was skilled and well - versed in seeking out a man 's weakness and pandering to it .

source_bert_toks: i also wondered if sir john sant ##erre , despite his bluff bon ##hom ##ie , was skilled and well - verse ##d in seeking out a man ' s weakness and pan ##der ##ing to it .

reference_raw: I also wondered if Sir John Santerre, despite his bluff bonhomie, had the skill and skill to find a man's weakness and pander to him.

reference_spacy_tokens: I also wondered if Sir John Santerre , despite his bluff bonhomie , had the skill and skill to find a man 's weakness and pander to him .


fn_spacy_tokens_for_baseline: Bright jets of material sometimes spurt from the nuclei of comets .

source_bert_toks: bright jets of material sometimes spur ##t from the nuclei of comets .

reference_raw: Bright streams of material sometimes erupt from the core of comets.

reference_spacy_tokens: Bright streams of material sometimes erupt from the core of comets .


fn_spacy_tokens_for_baseline: There 's enough explosive power in a really big display to make the twenty kegs of powder Guy Fawkes planted below the Houses of Parliament look like a damp roman candle .

source_bert_toks: there ' s enough explosive power in a really big display to make the twenty ke ##gs of powder guy fa ##wk ##es planted below the houses of parliament look like a damp roman candle .

reference_raw: In a very large display, there's enough explosive power to make the twenty barrels of powder Guy Fawkes planted under Parliament's Houses look like a wet Roman candle.

reference_spacy_tokens: In a very large display , there 's enough explosive power to make the twenty barrels of powder Guy Fawkes planted under Parliament 's Houses look like a wet Roman candle .


fn_spacy_tokens_for_baseline: I 'll nosh your sausages And snap

source_bert_toks: i ' ll nos ##h your sausage ##s and snap

reference_raw: I'm nosing your sausages and snapping

reference_spacy_tokens: I 'm nosing your sausages and snapping


fn_spacy_tokens_for_baseline: It was n't that important a part anyhow . '

source_bert_toks: it wasn ' t that important a part any ##how . '

reference_raw: It wasn't that important, anyway.'

reference_spacy_tokens: It was n't that important , anyway . '


fn_spacy_tokens_for_baseline: Even more important was his use of lymph taken from a smallpox pustule in its early stage of development , rather than from a mature pustule which was likely to be contaminated with a variety of organisms .

source_bert_toks: even more important was his use of l ##ym ##ph taken from a smallpox pu ##st ##ule in its early stage of development , rather than from a mature pu ##st ##ule which was likely to be contaminated with a variety of organisms .

reference_raw: What was even more important was the use of lymph that had been taken from the smallpox capsule in the early stages of development, rather than from a mature cell likely to be contaminated by various organisms.

reference_spacy_tokens: What was even more important was the use of lymph that had been taken from the smallpox capsule in the early stages of development , rather than from a mature cell likely to be contaminated by various organisms .


fn_spacy_tokens_for_baseline: Meanwhile , the furor over a Florida evangelical church 's Koran burning last month again sent demonstrators surging into the streets in several locales , although the protests appeared to be tapering off in size and ferocity .

source_bert_toks: meanwhile , the fur ##or over a florida evangelical church ' s ko ##ran burning last month again sent demonstrators sur ##ging into the streets in several local ##es , although the protests appeared to be tape ##ring off in size and fe ##rocity .

reference_raw: In the meantime, the furor of the Florida Evangelical Church's Koran fire last month sent demonstrators swarming into the streets in several places, though the protests seemed to be slowing down in size and ferocity.

reference_spacy_tokens: In the meantime , the furor of the Florida Evangelical Church 's Koran fire last month sent demonstrators swarming into the streets in several places , though the protests seemed to be slowing down in size and ferocity .


fn_spacy_tokens_for_baseline: He ignored the affronted expression that crossed Isabel 's face at this sardonic rejoinder , and continued .

source_bert_toks: he ignored the af ##front ##ed expression that crossed isabel ' s face at this sar ##don ##ic rejoin ##der , and continued .

reference_raw: Ignoring the offended expression on Isabel's face at this sardonic rejoinder, he went on.

reference_spacy_tokens: Ignoring the offended expression on Isabel 's face at this sardonic rejoinder , he went on .


fn_spacy_tokens_for_baseline: It was certain from the first , however , that they would eventually be detected , as the cook , from the evidence of one or two tradespeople who have caught a glimpse of him through the window , was a man of most remarkable appearance - being a huge and hideous mulatto , with yellowish features of a pronounced negroid type .

source_bert_toks: it was certain from the first , however , that they would eventually be detected , as the cook , from the evidence of one or two trades ##pe ##ople who have caught a glimpse of him through the window , was a man of most remarkable appearance - being a huge and hideous mu ##lat ##to , with yellowish features of a pronounced negro ##id type .

reference_raw: From the first, however, it was certain that they would eventually be discovered, because the cook, from the evidence of one or two merchants who had seen him through the window, was a man of the most remarkable appearance - a large and ugly mulatto with yellowish features of a pronounced black type.

reference_spacy_tokens: From the first , however , it was certain that they would eventually be discovered , because the cook , from the evidence of one or two merchants who had seen him through the window , was a man of the most remarkable appearance - a large and ugly mulatto with yellowish features of a pronounced black type .


fn_spacy_tokens_for_baseline: A French visitor to Birmingham in 1790 observed : Until the middle of the century there was not one Birmingham trader who had direct relations with foreign countries : London merchants warehoused and exported Birmingham goods .

source_bert_toks: a french visitor to birmingham in 1790 observed : until the middle of the century there was not one birmingham trader who had direct relations with foreign countries : london merchants warehouse ##d and exported birmingham goods .

reference_raw: A French visitor to Birmingham in 1790 observed that, until the middle of the century, there was no Birmingham merchant with direct relations with foreign countries: London merchants stored and exported Birmingham goods.

reference_spacy_tokens: A French visitor to Birmingham in 1790 observed that , until the middle of the century , there was no Birmingham merchant with direct relations with foreign countries : London merchants stored and exported Birmingham goods .


fn_spacy_tokens_for_baseline: The state legislature helped as well , by legalizing gambling in 1931 and thus solidifying the future of the town , though legislators and residents could never have known this at the time .

source_bert_toks: the state legislature helped as well , by legal ##izing gambling in 1931 and thus solid ##ifying the future of the town , though legislators and residents could never have known this at the time .

reference_raw: The State legislature also helped to legalize gambling in 1931 and thus strengthen the future of the city, although the legislators and residents could not have known at the time.

reference_spacy_tokens: The State legislature also helped to legalize gambling in 1931 and thus strengthen the future of the city , although the legislators and residents could not have known at the time .


fn_spacy_tokens_for_baseline: Totally absorbed , the ringers stare straight ahead , using peripheral vision ( they call it " rope - sight " ) to watch the other ropes and thus time their pulls .

source_bert_toks: totally absorbed , the ring ##ers stare straight ahead , using peripheral vision ( they call it " rope - sight " ) to watch the other ropes and thus time their pulls .

reference_raw: Absolutely absorbed, the ringers are staring straight ahead, using peripheral vision (they call it "rope-sight") to look at the other ropes, and thus time their tugs.

reference_spacy_tokens: Absolutely absorbed , the ringers are staring straight ahead , using peripheral vision ( they call it " rope - sight " ) to look at the other ropes , and thus time their tugs .


fn_spacy_tokens_for_baseline: I tell you , sir , I could n't move a finger , nor get my breath , till it whisked away and was gone .

source_bert_toks: i tell you , sir , i couldn ' t move a finger , nor get my breath , till it w ##his ##ked away and was gone .

reference_raw: I'm telling you, sir, I couldn't lift a finger or breathe until it was whisked away and gone.

reference_spacy_tokens: I 'm telling you , sir , I could n't lift a finger or breathe until it was whisked away and gone .


fn_spacy_tokens_for_baseline: As they got out of the car and walked across the yard , their feet scrunching on the stones , Jinny had a queer feeling that they were being watched .

source_bert_toks: as they got out of the car and walked across the yard , their feet sc ##run ##ching on the stones , jin ##ny had a queer feeling that they were being watched .

reference_raw: When they got out of the car and crossed the yard, their feet scratching against the rocks, Jinny had a strange feeling that they were being watched.

reference_spacy_tokens: When they got out of the car and crossed the yard , their feet scratching against the rocks , Jinny had a strange feeling that they were being watched .


fn_spacy_tokens_for_baseline: Their curiosity pushed them to build vessels that were strong enough to ford the open seas and reach these islands , marking the start of the long legacy of Mediterranean seafaring .

source_bert_toks: their curiosity pushed them to build vessels that were strong enough to ford the open seas and reach these islands , marking the start of the long legacy of mediterranean sea ##far ##ing .

reference_raw: Curiosity forced them to build vessels that were strong enough to forge open seas and reach these islands, marking the beginning of a long legacy of Mediterranean seafaring.

reference_spacy_tokens: Curiosity forced them to build vessels that were strong enough to forge open seas and reach these islands , marking the beginning of a long legacy of Mediterranean seafaring .


fn_spacy_tokens_for_baseline: Some nearby buildings have also been evacuated , including the KPMG building and offices of the Macquarie Bank .

source_bert_toks: some nearby buildings have also been evacuated , including the k ##pm ##g building and offices of the macquarie bank .

reference_raw: Some of the nearby buildings were also evacuated, including the KPMG building and Macquarie's offices.

reference_spacy_tokens: Some of the nearby buildings were also evacuated , including the KPMG building and Macquarie 's offices .


fn_spacy_tokens_for_baseline: " Uranium enrichment will nevertheless proceed inside the halls uninterrupted and unmonitored by the international community , " the diplomat added ( Michael Adler , Agence France - Presse / Yahoo ! News , Feb. 1 ) .

source_bert_toks: " uranium enrichment will nevertheless proceed inside the halls un ##int ##er ##rup ##ted and un ##mon ##itor ##ed by the international community , " the diplomat added ( michael adler , age ##nce france - press ##e / yahoo ! news , feb . 1 ) .

reference_raw: "But the enrichment of uranium will continue in the halls without interruption and supervision by the international community," the diplomat added (Michael Adler, Agence France-press/Yahoo! News, February 1).

reference_spacy_tokens: " But the enrichment of uranium will continue in the halls without interruption and supervision by the international community , " the diplomat added ( Michael Adler , Agence France - press / Yahoo ! News , February 1 ) .


fn_spacy_tokens_for_baseline: Where root crops are fed on the ground to cattle the rabbit has easy pickings and it remains interested and satisfied with the debris littering a field that once held a root crop .

source_bert_toks: where root crops are fed on the ground to cattle the rabbit has easy picking ##s and it remains interested and satisfied with the debris litter ##ing a field that once held a root crop .

reference_raw: When the root crops are fed to cattle on the ground, the rabbit is easily harvested and remains interested and satisfied with the debris that has covered the field that once held the root crop.

reference_spacy_tokens: When the root crops are fed to cattle on the ground , the rabbit is easily harvested and remains interested and satisfied with the debris that has covered the field that once held the root crop .


fn_spacy_tokens_for_baseline: But after failing to sway villagers attending the annual meeting , he allowed himself to comment : ' Well , all I can say is good luck to you and your children . '

source_bert_toks: but after failing to sway villagers attending the annual meeting , he allowed himself to comment : ' well , all i can say is good luck to you and your children . '

reference_raw: But when he failed to persuade the villagers to attend the annual meeting, he allowed himself to say, "Well, all I can say is good luck to you and your children."

reference_spacy_tokens: But when he failed to persuade the villagers to attend the annual meeting , he allowed himself to say , " Well , all I can say is good luck to you and your children . "


fn_spacy_tokens_for_baseline: ' It will not be possible for you to present in that compact form which is dear to your heart .

source_bert_toks: ' it will not be possible for you to present in that compact form which is dear to your heart .

reference_raw: 'You won't be able to present yourself in the compact form that's precious to your heart.

reference_spacy_tokens: ' You wo n't be able to present yourself in the compact form that 's precious to your heart .


fn_spacy_tokens_for_baseline: Propped up in bed to ease her breathing , her nightcap pulled down over her ears , Aunt Sarah seemed to have shrunk inside the shawls which had been heaped upon her against the chill of the room .

source_bert_toks: propped up in bed to ease her breathing , her night ##cap pulled down over her ears , aunt sarah seemed to have sh ##run ##k inside the shaw ##ls which had been heap ##ed upon her against the chill of the room .

reference_raw: She leaned back in bed to ease her breathing, and her hood pulled down over her ears, and Aunt Sarah seemed to shrink into the scarves that were piled on her against the chill of the room.

reference_spacy_tokens: She leaned back in bed to ease her breathing , and her hood pulled down over her ears , and Aunt Sarah seemed to shrink into the scarves that were piled on her against the chill of the room .


fn_spacy_tokens_for_baseline: The interesting Edwardian building was formerly the Pathological Institute , founded to combat the 19th century 's 30 - year - long outbreak of bubonic plague .

source_bert_toks: the interesting edward ##ian building was formerly the path ##ological institute , founded to combat the 19th century ' s 30 - year - long outbreak of bu ##bon ##ic plague .

reference_raw: The interesting Edwardian building was once a pathology institute set up to fight the 30th century - a long outbreak of bubonic disease.

reference_spacy_tokens: The interesting Edwardian building was once a pathology institute set up to fight the 30th century - a long outbreak of bubonic disease .


fn_spacy_tokens_for_baseline: The Bolshevik reputation stood high , and rightly so , for at least they acknowledged the question and officially embraced national independence .

source_bert_toks: the bolshevik reputation stood high , and right ##ly so , for at least they acknowledged the question and officially embraced national independence .

reference_raw: Bolshevik's reputation was high, and he was right, for at least they accepted the question and officially accepted national independence.

reference_spacy_tokens: Bolshevik 's reputation was high , and he was right , for at least they accepted the question and officially accepted national independence .


fn_spacy_tokens_for_baseline: I must have bored you out of your mind . '

source_bert_toks: i must have bored you out of your mind . '

reference_raw: I must have dulled you.'

reference_spacy_tokens: I must have dulled you . '


fn_spacy_tokens_for_baseline: They are alleged to have taken cannabis at two end - of - term parties outside the school .

source_bert_toks: they are alleged to have taken cannabis at two end - of - term parties outside the school .

reference_raw: They allegedly took hemp at two end-of-term parties outside the school.

reference_spacy_tokens: They allegedly took hemp at two end - of - term parties outside the school .


fn_spacy_tokens_for_baseline: The tree produces its nuts in groups that fit neatly together like the segments of an orange and are packaged in a box .

source_bert_toks: the tree produces its nuts in groups that fit neatly together like the segments of an orange and are packaged in a box .

reference_raw: The tree produces its nuts in groups that fit neatly, like orange segments, and are packed in a box.

reference_spacy_tokens: The tree produces its nuts in groups that fit neatly , like orange segments , and are packed in a box .


fn_spacy_tokens_for_baseline: The second is equipped with Shehab-2 and Shehab-3 systems .

source_bert_toks: the second is equipped with she ##hab - 2 and she ##hab - 3 systems .

reference_raw: The other system is equipped with Shehab-2 and Shehab-3 systems.

reference_spacy_tokens: The other system is equipped with Shehab-2 and Shehab-3 systems .


fn_spacy_tokens_for_baseline: He hummed to himself as he left the elevator , something from The King and I , but even he did n't know what it was .

source_bert_toks: he hummed to himself as he left the elevator , something from the king and i , but even he didn ' t know what it was .

reference_raw: As he left the lift, he hummed to himself, something from the King and me, but even he did not know what it was.

reference_spacy_tokens: As he left the lift , he hummed to himself , something from the King and me , but even he did not know what it was .


fn_spacy_tokens_for_baseline: Phoenix Park in the northwest is the largest open space , but squares like St. Stephen 's Green are the garden oases of the city .

source_bert_toks: phoenix park in the northwest is the largest open space , but squares like st . stephen ' s green are the garden o ##ase ##s of the city .

reference_raw: Phoenix Park is the largest open space in the north-west, but squares like St. Stephen's Green are the city's garden oases.

reference_spacy_tokens: Phoenix Park is the largest open space in the north - west , but squares like St. Stephen 's Green are the city 's garden oases .


fn_spacy_tokens_for_baseline: These studies were not ' wrong ' , but it would be wrong to conclude that this pattern of interest - group politics holds for all issues .

source_bert_toks: these studies were not ' wrong ' , but it would be wrong to conclude that this pattern of interest - group politics holds for all issues .

reference_raw: These studies weren't wrong, but it would be wrong to assume that this pattern of interest-group policy applies to all issues.

reference_spacy_tokens: These studies were n't wrong , but it would be wrong to assume that this pattern of interest - group policy applies to all issues .


fn_spacy_tokens_for_baseline: Iraq has accused the U.S. , which vehemently opposes the lifting of the sanctions against Iraq , of using the sanctions as a tool to contain the Iraqi regime headed by President Saddam Hussein .

source_bert_toks: iraq has accused the u . s . , which ve ##hem ##ently opposes the lifting of the sanctions against iraq , of using the sanctions as a tool to contain the iraqi regime headed by president saddam hussein .

reference_raw: Iraq has accused the United States, which strongly opposes the abolition of sanctions against Iraq, of using those sanctions as an instrument to stop the Iraqi regime under President Saddam Hussein.

reference_spacy_tokens: Iraq has accused the United States , which strongly opposes the abolition of sanctions against Iraq , of using those sanctions as an instrument to stop the Iraqi regime under President Saddam Hussein .


fn_spacy_tokens_for_baseline: This waterway accounts for much of the local charm and excitement , as the daily drama of the ferryboats , junks , sampans , freighters - and even small tankers and big gunboats - unfolds right in the center of town .

source_bert_toks: this waterway accounts for much of the local charm and excitement , as the daily drama of the ferry ##boats , junk ##s , sam ##pan ##s , freighter ##s - and even small tanker ##s and big gun ##boats - un ##fold ##s right in the center of town .

reference_raw: This waterway represents most of the local charm and excitement, as the day-to-day drama of ferryboats, junks, sampans, cargo ships - and even small tankers and large gunships - emerges right in the middle of the city.

reference_spacy_tokens: This waterway represents most of the local charm and excitement , as the day - to - day drama of ferryboats , junks , sampans , cargo ships - and even small tankers and large gunships - emerges right in the middle of the city .


fn_spacy_tokens_for_baseline: Of course there was nothing to guarantee that the soup you were canning would measure up to the quality or taste of Mother 's , nor that other soup canners would not make the same sales appeal .

source_bert_toks: of course there was nothing to guarantee that the soup you were canning would measure up to the quality or taste of mother ' s , nor that other soup can ##ners would not make the same sales appeal .

reference_raw: There was no guarantee, of course, that the soup you preserved would measure the quality or taste of your mother's, or that the other soup-canners would not make the same sales appeal.

reference_spacy_tokens: There was no guarantee , of course , that the soup you preserved would measure the quality or taste of your mother 's , or that the other soup - canners would not make the same sales appeal .


fn_spacy_tokens_for_baseline: I have begun my classes , as you know , but Aunt Millicent always grouses when I go to them , because they are in the evening , and that means she has to cook the supper .

source_bert_toks: i have begun my classes , as you know , but aunt mill ##ice ##nt always gr ##ouse ##s when i go to them , because they are in the evening , and that means she has to cook the supper .

reference_raw: I started my class, as you know, but Aunt Millicent always grumbles when I go to them, because they're at night, which means she has to cook dinner.

reference_spacy_tokens: I started my class , as you know , but Aunt Millicent always grumbles when I go to them , because they 're at night , which means she has to cook dinner .


fn_spacy_tokens_for_baseline: The youth sat down opposite .

source_bert_toks: the youth sat down opposite .

reference_raw: The young man sat across from him.

reference_spacy_tokens: The young man sat across from him .


fn_spacy_tokens_for_baseline: There are other exceptions besides consent : lawful chastisement of a child , force used to effect an arrest , reasonable force in self - defence or to prevent crime .

source_bert_toks: there are other exceptions besides consent : lawful cha ##stis ##ement of a child , force used to effect an arrest , reasonable force in self - defence or to prevent crime .

reference_raw: There are other exceptions in addition to consent: legal punishment of the child, force used for arrest, reasonable self-defense or crime prevention.

reference_spacy_tokens: There are other exceptions in addition to consent : legal punishment of the child , force used for arrest , reasonable self - defense or crime prevention .


fn_spacy_tokens_for_baseline: The biggest tragedy is that the problems do n't go away ; they only grow .

source_bert_toks: the biggest tragedy is that the problems don ' t go away ; they only grow .

reference_raw: The biggest tragedy is that problems don't go away, they just get bigger.

reference_spacy_tokens: The biggest tragedy is that problems do n't go away , they just get bigger .


fn_spacy_tokens_for_baseline: Exactly because it 's not next day they have the start the trial which is X number of months and just prolongs the situation that much more .

source_bert_toks: exactly because it ' s not next day they have the start the trial which is x number of months and just pro ##long ##s the situation that much more .

reference_raw: That's because they're not starting a trial tomorrow, which is the X number of months, and they're just prolonging the situation a lot longer.

reference_spacy_tokens: That 's because they 're not starting a trial tomorrow , which is the X number of months , and they 're just prolonging the situation a lot longer .


fn_spacy_tokens_for_baseline: Into this pool plunge rank after rank of children chained together .

source_bert_toks: into this pool plunge rank after rank of children chained together .

reference_raw: The pool plunges rank after rank of children bound together.

reference_spacy_tokens: The pool plunges rank after rank of children bound together .


fn_spacy_tokens_for_baseline: It 's recognized as our most magnificent falcon , diving at up to 200 mph to capture its prey .

source_bert_toks: it ' s recognized as our most magnificent falcon , diving at up to 200 mph to capture its prey .

reference_raw: He's known as our most beautiful falcon, diving up to 200 miles to catch his prey.

reference_spacy_tokens: He 's known as our most beautiful falcon , diving up to 200 miles to catch his prey .


fn_spacy_tokens_for_baseline: Bill was badly humiliated at the airfield today .

source_bert_toks: bill was badly humiliated at the airfield today .

reference_raw: Bill was very embarrassed at the airport today.

reference_spacy_tokens: Bill was very embarrassed at the airport today .


fn_spacy_tokens_for_baseline: Market prices per tael ( 34 grams / 1.2 ounces ) of gold are set daily .

source_bert_toks: market prices per tae ##l ( 34 grams / 1 . 2 ounce ##s ) of gold are set daily .

reference_raw: Market prices per tael (34 grams per 1.2 ounces) of gold are set on a day-to-day basis.

reference_spacy_tokens: Market prices per tael ( 34 grams per 1.2 ounces ) of gold are set on a day - to - day basis .


fn_spacy_tokens_for_baseline: ' Ye gods , at this time of the day , my friend ? ' he said , his portly form draped by a dark grey suit comfortable enough to give his portliness room to live and breathe .

source_bert_toks: ' ye gods , at this time of the day , my friend ? ' he said , his port ##ly form draped by a dark grey suit comfortable enough to give his port ##liness room to live and breathe .

reference_raw: "Are you gods at this hour of the day, my friend?" he asked, his port-shaped figure draped in a dark gray suit so comfortable that his openness gave him a place to live and breathe.

reference_spacy_tokens: " Are you gods at this hour of the day , my friend ? " he asked , his port - shaped figure draped in a dark gray suit so comfortable that his openness gave him a place to live and breathe .


fn_spacy_tokens_for_baseline: A left shoe , sock , shirt , comb , diary , clean handkerchief , badge , ring , a white sock , bracelet , necklace , or hairslide .

source_bert_toks: a left shoe , sock , shirt , comb , diary , clean handkerchief , badge , ring , a white sock , bracelet , necklace , or hairs ##lide .

reference_raw: Left boot, sock, shirt, comb, journal, clean handkerchief, badge, ring, white sock, bracelet, necklace, or hair slide.

reference_spacy_tokens: Left boot , sock , shirt , comb , journal , clean handkerchief , badge , ring , white sock , bracelet , necklace , or hair slide .


fn_spacy_tokens_for_baseline: For my part , I feel elated and close to tears .

source_bert_toks: for my part , i feel el ##ated and close to tears .

reference_raw: As far as I'm concerned, I feel long and close to tears.

reference_spacy_tokens: As far as I 'm concerned , I feel long and close to tears .


fn_spacy_tokens_for_baseline: Raising heavy lids a fraction , he cocked a quizzical eyebrow at her .

source_bert_toks: raising heavy lids a fraction , he cocked a quiz ##zic ##al eyebrow at her .

reference_raw: He raised his heavy lids a fraction and raised his questioning eyebrows at her.

reference_spacy_tokens: He raised his heavy lids a fraction and raised his questioning eyebrows at her .


fn_spacy_tokens_for_baseline: The X - ray image produced is nothing more than a large amorphous black mass . I fear that for every trash truck caught carrying contraband into Michigan , many more get through undetected with drugs , medical waste or other illegal material .

source_bert_toks: the x - ray image produced is nothing more than a large amor ##ph ##ous black mass . i fear that for every trash truck caught carrying contra ##band into michigan , many more get through und ##ete ##cted with drugs , medical waste or other illegal material .

reference_raw: The X-ray image produced is nothing more than a large amorphous black mass. I'm afraid that for every garbage truck caught carrying contraband to Michigan, a lot of others will pass undetected by drugs, medical waste, or other illegal materials.

reference_spacy_tokens: The X - ray image produced is nothing more than a large amorphous black mass . I 'm afraid that for every garbage truck caught carrying contraband to Michigan , a lot of others will pass undetected by drugs , medical waste , or other illegal materials .


fn_spacy_tokens_for_baseline: Two smaller " cascades " of centrifuges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since November without using any uranium gas , according to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) .

source_bert_toks: two smaller " cascade ##s " of cent ##ri ##fu ##ges have been operating in above - ground buildings at the site since last year , and a smaller set of machinery has been tested underground since november without using any uranium gas , according to ap ( george ja ##hn , associated press / houston chronicle , feb . 2 ) .

reference_raw: According to AP (George Jahn, Associated Press/Houston Chronicle, Feb. 2), two smaller "cascades" of centrifuges have been operating on the site since last year, and a smaller set of machines have been tested below ground since November without the use of uranium gas.

reference_spacy_tokens: According to AP ( George Jahn , Associated Press / Houston Chronicle , Feb. 2 ) , two smaller " cascades " of centrifuges have been operating on the site since last year , and a smaller set of machines have been tested below ground since November without the use of uranium gas .


fn_spacy_tokens_for_baseline: The period 's drama which was not seriously considered as literature until the Jacobean period ( and then only selectively ) has been critically absorbed to now belong to elite literature .

source_bert_toks: the period ' s drama which was not seriously considered as literature until the jacob ##ean period ( and then only selective ##ly ) has been critically absorbed to now belong to elite literature .

reference_raw: The dramatic period that was not seriously considered literature until the Jacobian period (and then only selectively) was critically absorbed into elite literature.

reference_spacy_tokens: The dramatic period that was not seriously considered literature until the Jacobian period ( and then only selectively ) was critically absorbed into elite literature .


fn_spacy_tokens_for_baseline: She was not like the Glasgow woman , who had shown him out into the street .

source_bert_toks: she was not like the glasgow woman , who had shown him out into the street .

reference_raw: She wasn't like the Glasgow woman who had led him to the street.

reference_spacy_tokens: She was n't like the Glasgow woman who had led him to the street .


fn_spacy_tokens_for_baseline: A THIEF walked into Kerridge 's service station , Butts Road , Alton last week and took two cans of petrol worth £ 5.89 .

source_bert_toks: a thief walked into kerr ##idge ' s service station , butt ##s road , alton last week and took two cans of petrol worth £5 . 89 .

reference_raw: Last week, a THIEF went to Kerridge's service station, Butts Road, Alton, and took two bottles of £5.89 worth of gasoline.

reference_spacy_tokens: Last week , a THIEF went to Kerridge 's service station , Butts Road , Alton , and took two bottles of £ 5.89 worth of gasoline .


fn_spacy_tokens_for_baseline: But her thoughts were brought to an abrupt end , as she descried two figures on their way up the path , and knew she must vacate the viewpoint for Rosie and her Francisco .

source_bert_toks: but her thoughts were brought to an abrupt end , as she des ##cr ##ied two figures on their way up the path , and knew she must va ##cate the viewpoint for rosie and her francisco .

reference_raw: But her thoughts came to an abrupt end as she described the two figures on the way down the road and knew she had to leave Rosie and her Francisco out of sight.

reference_spacy_tokens: But her thoughts came to an abrupt end as she described the two figures on the way down the road and knew she had to leave Rosie and her Francisco out of sight .


fn_spacy_tokens_for_baseline: Her mother was shaking her head in mystification , glancing round the lunch - table .

source_bert_toks: her mother was shaking her head in my ##sti ##fication , glancing round the lunch - table .

reference_raw: Her mother shook her head in confusion and looked around the lunch table.

reference_spacy_tokens: Her mother shook her head in confusion and looked around the lunch table .


fn_spacy_tokens_for_baseline: European Colloquy on Gypsies in the Locality

source_bert_toks: european col ##lo ##qu ##y on g ##yp ##sies in the locality

reference_raw: European Gypsy Collection in a locality

reference_spacy_tokens: European Gypsy Collection in a locality


fn_spacy_tokens_for_baseline: Within Iran , the Hwasong-5 was designated the Shehab-1 ( " meteor " or " shooting star " ) .

source_bert_toks: within iran , the h ##was ##ong - 5 was designated the she ##hab - 1 ( " meteor " or " shooting star " ) .

reference_raw: In Iran, Hwasong-5 has been identified as Shehab-1 ("meteor" or "shooting star").

reference_spacy_tokens: In Iran , Hwasong-5 has been identified as Shehab-1 ( " meteor " or " shooting star " ) .


fn_spacy_tokens_for_baseline: His health has been frail lately , and this hospitalization was his fourth in the last seven months .

source_bert_toks: his health has been frail lately , and this hospital ##ization was his fourth in the last seven months .

reference_raw: His health has been fragile lately, and this hospitalization has been his fourth in seven months.

reference_spacy_tokens: His health has been fragile lately , and this hospitalization has been his fourth in seven months .


fn_spacy_tokens_for_baseline: Organizational Structure : The terrorist groups of greatest concern have an organizational structure and internal control mechanisms that enable them to prevent penetration by government agents or defection by group members .

source_bert_toks: organizational structure : the terrorist groups of greatest concern have an organizational structure and internal control mechanisms that enable them to prevent penetration by government agents or defect ##ion by group members .

reference_raw: Organisational structure: Terrorist groups of major concern have an organisational structure and internal control system that allows them to avoid the penetration of government agents or the defection of group members.

reference_spacy_tokens: Organisational structure : Terrorist groups of major concern have an organisational structure and internal control system that allows them to avoid the penetration of government agents or the defection of group members .


fn_spacy_tokens_for_baseline: ' I could not fault my players for commitment .

source_bert_toks: ' i could not fault my players for commitment .

reference_raw: I couldn't blame my players for their commitment.

reference_spacy_tokens: I could n't blame my players for their commitment .


fn_spacy_tokens_for_baseline: It managed to lift off and set down half a mile away after mechanical problems made it difficult to keep flying .

source_bert_toks: it managed to lift off and set down half a mile away after mechanical problems made it difficult to keep flying .

reference_raw: After mechanical problems made it difficult to keep flying, he managed to get off and set off half a mile away.

reference_spacy_tokens: After mechanical problems made it difficult to keep flying , he managed to get off and set off half a mile away .


fn_spacy_tokens_for_baseline: And within easy travelling distance of the city are the other major sights of the Dead Sea region .

source_bert_toks: and within easy travelling distance of the city are the other major sights of the dead sea region .

reference_raw: And the other main views of the Dead Sea region are within easy travel distances from the city.

reference_spacy_tokens: And the other main views of the Dead Sea region are within easy travel distances from the city .


fn_spacy_tokens_for_baseline: The Woman thumped the table with her fist and shouted .

source_bert_toks: the woman thumped the table with her fist and shouted .

reference_raw: The woman slammed her fist against the table and screamed.

reference_spacy_tokens: The woman slammed her fist against the table and screamed .


fn_spacy_tokens_for_baseline: With your stomach nicely fibre - full from other meals you should not , at least , arrive at the restaurant table like a ravenous wolf .

source_bert_toks: with your stomach nicely fibre - full from other meals you should not , at least , arrive at the restaurant table like a raven ##ous wolf .

reference_raw: With your stomach full of fibers from other foods, you shouldn't at least come to the restaurant table like a hungry wolf.

reference_spacy_tokens: With your stomach full of fibers from other foods , you should n't at least come to the restaurant table like a hungry wolf .


fn_spacy_tokens_for_baseline: Ruth deeply inhaled the scent of the pines so richly sweet , warm and Mediterranean .

source_bert_toks: ruth deeply inhaled the scent of the pines so richly sweet , warm and mediterranean .

reference_raw: Ruth drew in a deep breath the smell of pines so richly sweet, warm, and Mediterranean.

reference_spacy_tokens: Ruth drew in a deep breath the smell of pines so richly sweet , warm , and Mediterranean .


fn_spacy_tokens_for_baseline: Their teaching qualifications are of obvious benefit to the church ; the ability of a musical director to teach is as important as his or her mastery of musical skills .

source_bert_toks: their teaching qualifications are of obvious benefit to the church ; the ability of a musical director to teach is as important as his or her mastery of musical skills .

reference_raw: Their teaching skills clearly benefit the church; the ability of a music director to teach is as important as his ability to learn music.

reference_spacy_tokens: Their teaching skills clearly benefit the church ; the ability of a music director to teach is as important as his ability to learn music .


fn_spacy_tokens_for_baseline: That is , the probability is 1 in 1000 for the result to have occurred by chance .

source_bert_toks: that is , the probability is 1 in 1000 for the result to have occurred by chance .

reference_raw: So the chance is 1 in 1,000 that the result will happen by accident.

reference_spacy_tokens: So the chance is 1 in 1,000 that the result will happen by accident .


fn_spacy_tokens_for_baseline: ' It 's a bastard this one , Mrs Q , ' he said .

source_bert_toks: ' it ' s a bastard this one , mrs q , ' he said .

reference_raw: "This one is a son of a bitch, Mrs. Q," he said.

reference_spacy_tokens: " This one is a son of a bitch , Mrs. Q , " he said .


fn_spacy_tokens_for_baseline: It was very still , with the landscape painted in shades of smoke .

source_bert_toks: it was very still , with the landscape painted in shades of smoke .

reference_raw: It was very quiet, and the countryside was covered with smoke.

reference_spacy_tokens: It was very quiet , and the countryside was covered with smoke .


fn_spacy_tokens_for_baseline: It killed 8,000 people , wrecked hundreds of ships , destroyed Eddystone lighthouse , 400 windmills and 800 houses .

source_bert_toks: it killed 8 , 000 people , wrecked hundreds of ships , destroyed eddy ##stone lighthouse , 400 windmill ##s and 800 houses .

reference_raw: Killed 8,000 people, destroyed hundreds of ships, destroyed Eddystone's beacon, 400 windmills and 800 homes.

reference_spacy_tokens: Killed 8,000 people , destroyed hundreds of ships , destroyed Eddystone 's beacon , 400 windmills and 800 homes .


fn_spacy_tokens_for_baseline: " We are very happy with the progress that he 's now making , following a difficult few days , " Zuma said .

source_bert_toks: " we are very happy with the progress that he ' s now making , following a difficult few days , " zu ##ma said .

reference_raw: "We're very happy with the progress he's making after a rough couple of days," Zuma said.

reference_spacy_tokens: " We 're very happy with the progress he 's making after a rough couple of days , " Zuma said .


fn_spacy_tokens_for_baseline: Phoenix Park in the northwest is the largest open space , but squares like St. Stephen 's Green are the garden oases of the city .

source_bert_toks: phoenix park in the northwest is the largest open space , but squares like st . stephen ' s green are the garden o ##ase ##s of the city .

reference_raw: Phoenix Park is the largest open area in the northwest, but squares like St. Stephen's Green are the city's garden oases.

reference_spacy_tokens: Phoenix Park is the largest open area in the northwest , but squares like St. Stephen 's Green are the city 's garden oases .


fn_spacy_tokens_for_baseline: She tugged on Penry 's hand as the path levelled out .

source_bert_toks: she tugged on pen ##ry ' s hand as the path level ##led out .

reference_raw: She pulled Penry's hand as the path leveled.

reference_spacy_tokens: She pulled Penry 's hand as the path leveled .


fn_spacy_tokens_for_baseline: He gave a low cough .

source_bert_toks: he gave a low cough .

reference_raw: He cleared his throat.

reference_spacy_tokens: He cleared his throat .


fn_spacy_tokens_for_baseline: I sit disconsolate in the snow .

source_bert_toks: i sit disco ##ns ##olate in the snow .

reference_raw: I sit comfortably in the snow.

reference_spacy_tokens: I sit comfortably in the snow .


fn_spacy_tokens_for_baseline: She was vice - chairman of the planning committee .

source_bert_toks: she was vice - chairman of the planning committee .

reference_raw: She was the vice president of the planning committee.

reference_spacy_tokens: She was the vice president of the planning committee .


fn_spacy_tokens_for_baseline: Quarter - facet . and Jaq uttered a malediction .

source_bert_toks: quarter - face ##t . and ja ##q uttered a male ##dict ##ion .

reference_raw: Quarterface . . . and Jaq uttered a malevolent word.

reference_spacy_tokens: Quarterface . . . and Jaq uttered a malevolent word .


fn_spacy_tokens_for_baseline: It managed to lift off and set down half a mile away after mechanical problems made it difficult to keep flying .

source_bert_toks: it managed to lift off and set down half a mile away after mechanical problems made it difficult to keep flying .

reference_raw: After mechanical problems made it difficult to keep flying, he managed to get off and set off half a mile away.

reference_spacy_tokens: After mechanical problems made it difficult to keep flying , he managed to get off and set off half a mile away .


fn_spacy_tokens_for_baseline: Yet the best the far - left could do was not enough to deter the biggest voting bloc -- nearly 40 % -- from endorsing the direction Spain is taking .

source_bert_toks: yet the best the far - left could do was not enough to deter the biggest voting bloc - - nearly 40 % - - from end ##ors ##ing the direction spain is taking .

reference_raw: But the best the far left could do was not enough to deter the largest voting block - almost 40% - from supporting the direction Spain is taking.

reference_spacy_tokens: But the best the far left could do was not enough to deter the largest voting block - almost 40 % - from supporting the direction Spain is taking .


fn_spacy_tokens_for_baseline: I stabled my own horse and was in the buttery when I heard screams , the crashing of hooves and Vulcan 's neighs .

source_bert_toks: i stable ##d my own horse and was in the butter ##y when i heard screams , the crashing of hooves and vulcan ' s ne ##igh ##s .

reference_raw: I stabilized my horse and was in the butter when I heard the screams, the hooves crashing, and the Vulcan's neighbors.

reference_spacy_tokens: I stabilized my horse and was in the butter when I heard the screams , the hooves crashing , and the Vulcan 's neighbors .


fn_spacy_tokens_for_baseline: He should consider his victory a mandate to continue his growth - oriented economic reforms and not a demand that he move further left .

source_bert_toks: he should consider his victory a mandate to continue his growth - oriented economic reforms and not a demand that he move further left .

reference_raw: He should consider his victory a mandate to continue his growth-driven economic reforms, not a demand to go further to the left.

reference_spacy_tokens: He should consider his victory a mandate to continue his growth - driven economic reforms , not a demand to go further to the left .


fn_spacy_tokens_for_baseline: He sprawled out in his shorts and drank thirstily before fervently putting down her suggestion .

source_bert_toks: he sprawled out in his shorts and drank thirst ##ily before fe ##r ##vent ##ly putting down her suggestion .

reference_raw: He stretched out in his shorts and drank thirstily before deferring to her suggestion.

reference_spacy_tokens: He stretched out in his shorts and drank thirstily before deferring to her suggestion .


fn_spacy_tokens_for_baseline: They were warm under the sun and full of vigour hardly drained in the short battle and soon flooding back .

source_bert_toks: they were warm under the sun and full of vi ##go ##ur hardly drained in the short battle and soon flooding back .

reference_raw: They were hot under the sun and full of vigour, barely exhausted in the brief battle, and soon flooded back again.

reference_spacy_tokens: They were hot under the sun and full of vigour , barely exhausted in the brief battle , and soon flooded back again .


fn_spacy_tokens_for_baseline: The White House wanted to achieve something dramatic in Afghanistan , so they asked the CIA to loan them an agent .

source_bert_toks: the white house wanted to achieve something dramatic in afghanistan , so they asked the cia to loan them an agent .

reference_raw: In Afghanistan, the White House wanted to do something dramatic, so they asked the CIA to lend them an agent.

reference_spacy_tokens: In Afghanistan , the White House wanted to do something dramatic , so they asked the CIA to lend them an agent .


fn_spacy_tokens_for_baseline: A man came out with a big bouquet of Regale lilies , festooned with white ribbons .

source_bert_toks: a man came out with a big bouquet of regal ##e lil ##ies , fest ##oon ##ed with white ribbons .

reference_raw: A man came out with a large bouquet of Regale lilies and a feast of white ribbons.

reference_spacy_tokens: A man came out with a large bouquet of Regale lilies and a feast of white ribbons .


fn_spacy_tokens_for_baseline: It is in places almost congruent with the tectonic Pacific ; its outline follows the Andesite Line along the western margin of the Pacific plate , from Kamchatka to Christchurch .

source_bert_toks: it is in places almost cong ##ru ##ent with the te ##cton ##ic pacific ; its outline follows the andes ##ite line along the western margin of the pacific plate , from kam ##cha ##t ##ka to christchurch .

reference_raw: It is in places that are almost identical to the tectonic Pacific; its outline follows the Andesite border along the western edge of the Pacific plateau, from Kamchatka to Christchurch.

reference_spacy_tokens: It is in places that are almost identical to the tectonic Pacific ; its outline follows the Andesite border along the western edge of the Pacific plateau , from Kamchatka to Christchurch .


fn_spacy_tokens_for_baseline: A few terrorist groups active today are more motivated to carry out mass - casualty attacks , better organized to resist outside penetration , and are actively pursuing technologies and know - how relevant to CBW terrorism .

source_bert_toks: a few terrorist groups active today are more motivated to carry out mass - casualty attacks , better organized to resist outside penetration , and are actively pursuing technologies and know - how relevant to cb ##w terrorism .

reference_raw: Several terrorist groups active today are more motivated to carry out mass attacks - victim attacks, better organised to resist external penetration, and actively pursue technologies and knowledge relevant to CBW terrorism.

reference_spacy_tokens: Several terrorist groups active today are more motivated to carry out mass attacks - victim attacks , better organised to resist external penetration , and actively pursue technologies and knowledge relevant to CBW terrorism .


fn_spacy_tokens_for_baseline: After nearly a week of rapid government advances behind air , land and sea bombardments , the conflict in rebel - controlled eastern Libya stagnated along the 45-mile coastal strip between Port Brega and Ajdabiya .

source_bert_toks: after nearly a week of rapid government advances behind air , land and sea bombardment ##s , the conflict in rebel - controlled eastern libya st ##ag ##nated along the 45 - mile coastal strip between port br ##ega and aj ##da ##bi ##ya .

reference_raw: After almost a week of rapid government progress behind air, land and sea bombing, the conflict in rebel-controlled eastern Libya stagnated along a 45-mile coastline between Port Brega and Ajdabiya.

reference_spacy_tokens: After almost a week of rapid government progress behind air , land and sea bombing , the conflict in rebel - controlled eastern Libya stagnated along a 45-mile coastline between Port Brega and Ajdabiya .


fn_spacy_tokens_for_baseline: The pension is recently built , but is finished off in the traditional style .

source_bert_toks: the pension is recently built , but is finished off in the traditional style .

reference_raw: Retirement has recently been built, but it's completed in a traditional way.

reference_spacy_tokens: Retirement has recently been built , but it 's completed in a traditional way .


fn_spacy_tokens_for_baseline: She stirred four spoons of sugar into her cup .

source_bert_toks: she stirred four spoon ##s of sugar into her cup .

reference_raw: She mixed four teaspoons of sugar into the cup.

reference_spacy_tokens: She mixed four teaspoons of sugar into the cup .


fn_spacy_tokens_for_baseline: ' Yes , I have , ' fibbed Snow .

source_bert_toks: ' yes , i have , ' fi ##bbed snow .

reference_raw: 'Yes, I do,' said Snow.

reference_spacy_tokens: ' Yes , I do , ' said Snow .


fn_spacy_tokens_for_baseline: All too soon , the finest rocky clough in the Dark Peak levels out at around the 1500 feet contour and falls back at an easy angle towards Shining Clough Moss and Bleaklow Head .

source_bert_toks: all too soon , the finest rocky cl ##ough in the dark peak levels out at around the 1500 feet con ##tour and falls back at an easy angle towards shining cl ##ough moss and bleak ##low head .

reference_raw: Too early, the best rocky cloud in the Dark Peak levels out at about 1,500 feet of contour and falls back at an easy angle to the Shining Clough Moss and the Bleaklow Head.

reference_spacy_tokens: Too early , the best rocky cloud in the Dark Peak levels out at about 1,500 feet of contour and falls back at an easy angle to the Shining Clough Moss and the Bleaklow Head .


fn_spacy_tokens_for_baseline: The vicar , W.D. Jones , refuses to talk about it , saying it would " reopen the wound .

source_bert_toks: the vicar , w . d . jones , refuses to talk about it , saying it would " re ##open the wound .

reference_raw: The vicar, W.D.Jones, refuses to talk about it, says it'll open up.

reference_spacy_tokens: The vicar , W.D.Jones , refuses to talk about it , says it 'll open up .


fn_spacy_tokens_for_baseline: Previously in 1997 , a statement submitted by the office of Madeline Albright -- then US Secretary of State -- concluded that SinoChem had not been involved in any dual - use shipments to Iran .

source_bert_toks: previously in 1997 , a statement submitted by the office of madeline al ##bright - - then us secretary of state - - concluded that sino ##che ##m had not been involved in any dual - use shipments to iran .

reference_raw: Previously in 1997, a statement from Madeline Albright's office, then the U.S. Secretary of State, concluded that SinoChem was not involved in any dual use of consignments to Iran.

reference_spacy_tokens: Previously in 1997 , a statement from Madeline Albright 's office , then the U.S. Secretary of State , concluded that SinoChem was not involved in any dual use of consignments to Iran .


fn_spacy_tokens_for_baseline: ' We came across some people from Papua New Guinea who were selling handicrafts and were confronted with a boatload of western tourists -- all convinced they could buy for a knock - down rate .

source_bert_toks: ' we came across some people from papua new guinea who were selling hand ##ic ##raf ##ts and were confronted with a boat ##load of western tourists - - all convinced they could buy for a knock - down rate .

reference_raw: 'We've come across some people from Papua New Guinea who sell craft and face a shipload of Western tourists - they're all convinced they can buy at a knock-down rate.

reference_spacy_tokens: ' We 've come across some people from Papua New Guinea who sell craft and face a shipload of Western tourists - they 're all convinced they can buy at a knock - down rate .


fn_spacy_tokens_for_baseline: The renewed investigation of Morsi and members of the Muslim Brotherhood dates to the uprising that led to the ouster of Mubarak in 2011 .

source_bert_toks: the renewed investigation of mor ##si and members of the muslim brotherhood dates to the uprising that led to the ou ##ster of mu ##bara ##k in 2011 .

reference_raw: The re-investigation of Morsi and members of the Muslim Brotherhood coincided with the uprising that led to Mubarak's outburst in 2011.

reference_spacy_tokens: The re - investigation of Morsi and members of the Muslim Brotherhood coincided with the uprising that led to Mubarak 's outburst in 2011 .


fn_spacy_tokens_for_baseline: So far there have been no injuries and no homes have yet been damaged , but one building storing equipment used by firefighters was burned to the ground .

source_bert_toks: so far there have been no injuries and no homes have yet been damaged , but one building storing equipment used by firefighters was burned to the ground .

reference_raw: So far, no wounds have been made and no homes have been damaged, but one of the buildings storing equipment used by the firemen has been burned to the ground.

reference_spacy_tokens: So far , no wounds have been made and no homes have been damaged , but one of the buildings storing equipment used by the firemen has been burned to the ground .


fn_spacy_tokens_for_baseline: Before the trial , the Sunday Times had just asked him to pose for the fashion pages of their magazine , wearing tough - guy togs .

source_bert_toks: before the trial , the sunday times had just asked him to pose for the fashion pages of their magazine , wearing tough - guy to ##gs .

reference_raw: Before the trial, the Sunday Times had asked him to pose for the fashion pages of their magazine, with heavy toggles on it.

reference_spacy_tokens: Before the trial , the Sunday Times had asked him to pose for the fashion pages of their magazine , with heavy toggles on it .


fn_spacy_tokens_for_baseline: American education 's future will be determined by the degree to which we -- all of us -- allow this common sense to prevail over the illusions that we also share .

source_bert_toks: american education ' s future will be determined by the degree to which we - - all of us - - allow this common sense to pre ##va ##il over the illusions that we also share .

reference_raw: The future of American education will depend on the extent to which we - all of us - allow this common sense to overcome the illusions we share.

reference_spacy_tokens: The future of American education will depend on the extent to which we - all of us - allow this common sense to overcome the illusions we share .


fn_spacy_tokens_for_baseline: Additionally the political atmosphere has not been conducive to encouraging oil companies to engage in active exploration and development though this still continues despite the pull - out of Exxon and Mobil .

source_bert_toks: additionally the political atmosphere has not been con ##du ##ci ##ve to encouraging oil companies to engage in active exploration and development though this still continues despite the pull - out of ex ##xon and mob ##il .

reference_raw: Moreover, the political climate did not encourage oil companies to engage in active research and development, although it continued despite Exxon and Mobil's withdrawal.

reference_spacy_tokens: Moreover , the political climate did not encourage oil companies to engage in active research and development , although it continued despite Exxon and Mobil 's withdrawal .


fn_spacy_tokens_for_baseline: He attended without wavering as she took him round to the head of the little dale , above the cottage , pointing out the hare 's field below them as they went .

source_bert_toks: he attended without wave ##ring as she took him round to the head of the little dale , above the cottage , pointing out the hare ' s field below them as they went .

reference_raw: He did so without hesitation as she led him to the head of the small valley, above the cabin, and pointed to the hare field below.

reference_spacy_tokens: He did so without hesitation as she led him to the head of the small valley , above the cabin , and pointed to the hare field below .


fn_spacy_tokens_for_baseline: A FORMER public school boy yesterday won £ 8,000 damages for a caning he received nine years ago .

source_bert_toks: a former public school boy yesterday won £ ##8 , 000 damages for a can ##ing he received nine years ago .

reference_raw: Yesterday, a FORMER public schoolboy won £8,000 in damages for a tin he got nine years ago.

reference_spacy_tokens: Yesterday , a FORMER public schoolboy won £ 8,000 in damages for a tin he got nine years ago .


fn_spacy_tokens_for_baseline: Also , ringers do n't always live where the bells need to be rung -- like in small , rural parishes and inner - city churches .

source_bert_toks: also , ring ##ers don ' t always live where the bells need to be run ##g - - like in small , rural parishes and inner - city churches .

reference_raw: Also, ringers do not always live where the bells must be ringed - as in small village parishes and churches in the inner city.

reference_spacy_tokens: Also , ringers do not always live where the bells must be ringed - as in small village parishes and churches in the inner city .


fn_spacy_tokens_for_baseline: Rebuilt in modern times , the mosque serves the small local community of Muslims .

source_bert_toks: rebuilt in modern times , the mosque serves the small local community of muslims .

reference_raw: Reconstructed in modern times, the mosque is used by a small local community of Muslims.

reference_spacy_tokens: Reconstructed in modern times , the mosque is used by a small local community of Muslims .


fn_spacy_tokens_for_baseline: I was confined to my room , terrorized by the most horrible threats , cruelly ill - used to break my spirit - see this stab on my shoulder and the bruises from end to end of my arms - and a gag was thrust into my mouth on the one occasion when I tried to call from the window .

source_bert_toks: i was confined to my room , terror ##ized by the most horrible threats , cruel ##ly ill - used to break my spirit - see this stab on my shoulder and the bruises from end to end of my arms - and a gag was thrust into my mouth on the one occasion when i tried to call from the window .

reference_raw: I was confined to my room, terrorized by the most terrible threats, cruelly ill-used to break my soul-see the stab on my arm and the bruises from the end of my arms-and for the first time when I tried to call from the window, I had a gag in my mouth.

reference_spacy_tokens: I was confined to my room , terrorized by the most terrible threats , cruelly ill - used to break my soul - see the stab on my arm and the bruises from the end of my arms - and for the first time when I tried to call from the window , I had a gag in my mouth .


fn_spacy_tokens_for_baseline: He pushed his food off the table and refused to eat even the cheesecake .

source_bert_toks: he pushed his food off the table and refused to eat even the cheese ##cake .

reference_raw: He pushed the food away from the table and refused to eat the cheese cake.

reference_spacy_tokens: He pushed the food away from the table and refused to eat the cheese cake .


fn_spacy_tokens_for_baseline: An Iraq dependent on Iran for survival could undercut any sanctions that the international community places on Iran to prevent its acquisition of nuclear weapons .

source_bert_toks: an iraq dependent on iran for survival could under ##cut any sanctions that the international community places on iran to prevent its acquisition of nuclear weapons .

reference_raw: An Iraq dependent on Iran for survival could undermine any sanctions imposed on Iran by the international community in order to prevent it from acquiring nuclear weapons.

reference_spacy_tokens: An Iraq dependent on Iran for survival could undermine any sanctions imposed on Iran by the international community in order to prevent it from acquiring nuclear weapons .


fn_spacy_tokens_for_baseline: They should see to it that their kids do n't play truant ; they should make certain that the children spend enough time doing homework ; they should scrutinize the report card .

source_bert_toks: they should see to it that their kids don ' t play tr ##uan ##t ; they should make certain that the children spend enough time doing homework ; they should sc ##rut ##ini ##ze the report card .

reference_raw: They should make sure the kids don't play truant; they should make sure the kids spend a lot of time doing their homework; they should check the report card.

reference_spacy_tokens: They should make sure the kids do n't play truant ; they should make sure the kids spend a lot of time doing their homework ; they should check the report card .


fn_spacy_tokens_for_baseline: The tiger , however , roams only the jungles of the East .

source_bert_toks: the tiger , however , roam ##s only the jungle ##s of the east .

reference_raw: But the tiger wanders only in the eastern jungles.

reference_spacy_tokens: But the tiger wanders only in the eastern jungles .


fn_spacy_tokens_for_baseline: He looked down at her astonished face with darkly angled brows .

source_bert_toks: he looked down at her astonished face with darkly angled brows .

reference_raw: He looked down at her bewildered face with darkly angled eyebrows.

reference_spacy_tokens: He looked down at her bewildered face with darkly angled eyebrows .


fn_spacy_tokens_for_baseline: Rather than mix grass and flower seed before sowing , I raise seedlings of the flowering plants in trays .

source_bert_toks: rather than mix grass and flower seed before so ##wing , i raise seed ##lings of the flowering plants in tray ##s .

reference_raw: Instead of mixing grass and flower seeds before sowing, I grow flower seedlings on trays.

reference_spacy_tokens: Instead of mixing grass and flower seeds before sowing , I grow flower seedlings on trays .


fn_spacy_tokens_for_baseline: Libya has demonstrated a willingness to use its missile capabilities .

source_bert_toks: libya has demonstrated a willingness to use its missile capabilities .

reference_raw: Libya has demonstrated its readiness to use its missile capabilities.

reference_spacy_tokens: Libya has demonstrated its readiness to use its missile capabilities .


fn_spacy_tokens_for_baseline: On the desk of the precinct commandant lay the passport in the name of Hans Grauber , picked up from the street where the broken - nosed VOPO had dropped it .

source_bert_toks: on the desk of the precinct commandant lay the passport in the name of hans gr ##au ##ber , picked up from the street where the broken - nosed vo ##po had dropped it .

reference_raw: A passport in the name of Hans Grauber was placed on the desk of the district commander and picked up from the street where the broken-nosed VOPO had dropped it.

reference_spacy_tokens: A passport in the name of Hans Grauber was placed on the desk of the district commander and picked up from the street where the broken - nosed VOPO had dropped it .


fn_spacy_tokens_for_baseline: They would have married sooner but had to wait for her divorce ; Pamela Chrimes told me that it took some time to obtain the evidence of adultery which was then necessary .

source_bert_toks: they would have married sooner but had to wait for her divorce ; pamela ch ##rim ##es told me that it took some time to obtain the evidence of adultery which was then necessary .

reference_raw: They'd get married sooner, but they'd have to wait for her to get married; Pamela Chrimes told me it would take a while to get the proof of adultery that was necessary.

reference_spacy_tokens: They 'd get married sooner , but they 'd have to wait for her to get married ; Pamela Chrimes told me it would take a while to get the proof of adultery that was necessary .


fn_spacy_tokens_for_baseline: Virtually all the largest American corporations broke the law in one way or another ; laws controlling pollution , the adulteration of products , the regulating of prices and so on were ignored and broken at will .

source_bert_toks: virtually all the largest american corporations broke the law in one way or another ; laws controlling pollution , the adult ##eration of products , the regulating of prices and so on were ignored and broken at will .

reference_raw: Virtually all the major American corporations violated the law in one way or another; the laws that control pollution, adulteration of products, price regulation, etc. were ignored and violated at will.

reference_spacy_tokens: Virtually all the major American corporations violated the law in one way or another ; the laws that control pollution , adulteration of products , price regulation , etc . were ignored and violated at will .


fn_spacy_tokens_for_baseline: Fundamentalists execrate someone for writing a book that they have n't read , and a famous novelist has to go into hiding for fear of his life .

source_bert_toks: fundamental ##ists ex ##ec ##rate someone for writing a book that they haven ' t read , and a famous novelist has to go into hiding for fear of his life .

reference_raw: Fundamentalists execute someone for writing a book they didn't read, and a famous writer has to hide because he's afraid of his life.

reference_spacy_tokens: Fundamentalists execute someone for writing a book they did n't read , and a famous writer has to hide because he 's afraid of his life .


fn_spacy_tokens_for_baseline: The doctors said that Karen 's body was still a little radioactive , but Drew and Paula were all right .

source_bert_toks: the doctors said that karen ' s body was still a little radioactive , but drew and paula were all right .

reference_raw: Doc said Karen's body was still a little radioactive, but Drew and Paula were fine.

reference_spacy_tokens: Doc said Karen 's body was still a little radioactive , but Drew and Paula were fine .


fn_spacy_tokens_for_baseline: The redhead was leggy and had a terrific figure .

source_bert_toks: the redhead was leg ##gy and had a terrific figure .

reference_raw: The red-haired man was leggy and had an amazing figure.

reference_spacy_tokens: The red - haired man was leggy and had an amazing figure .


fn_spacy_tokens_for_baseline: Dropping her head , she tugged a brush vigorously through the rippling red - gold , and then tossed it all back in a wild wavy curtain .

source_bert_toks: dropping her head , she tugged a brush vigorously through the rip ##pling red - gold , and then tossed it all back in a wild wavy curtain .

reference_raw: She dropped her head, pulled the brush vigorously through the rippling red-gold, and threw it all back into a wild, wavy curtain.

reference_spacy_tokens: She dropped her head , pulled the brush vigorously through the rippling red - gold , and threw it all back into a wild , wavy curtain .


fn_spacy_tokens_for_baseline: He tries so hard that it seems churlish to deny him a few points for effort .

source_bert_toks: he tries so hard that it seems chu ##rl ##ish to deny him a few points for effort .

reference_raw: He's trying so hard, it seems charming to deny him a few points of effort.

reference_spacy_tokens: He 's trying so hard , it seems charming to deny him a few points of effort .


fn_spacy_tokens_for_baseline: He 'd gone again , disappeared back inside his spindly self .

source_bert_toks: he ' d gone again , disappeared back inside his spin ##dly self .

reference_raw: He left again, disappearing back into his spinal self.

reference_spacy_tokens: He left again , disappearing back into his spinal self .


fn_spacy_tokens_for_baseline: That bull was sired by Globe Titan , the Canadian imported bull which also sired the bull champion , withdrawn at l,400gns by Messrs McConchie , and the female champion , also from Mains of Penninghame .

source_bert_toks: that bull was sired by globe titan , the canadian imported bull which also sired the bull champion , withdrawn at l , 400 ##gn ##s by mess ##rs mcc ##on ##chi ##e , and the female champion , also from main ##s of penn ##ingham ##e .

reference_raw: The bull was made by Globe Titan, a Canadian imported bull, who also created a bull champion, who was withdrawn by Messr McConchie at I.400gn, and a female champion from the mains of Penninghame.

reference_spacy_tokens: The bull was made by Globe Titan , a Canadian imported bull , who also created a bull champion , who was withdrawn by Messr McConchie at I.400gn , and a female champion from the mains of Penninghame .


fn_spacy_tokens_for_baseline: Upon arrival , Hall said that his visit , the first of its kind by an American congressman since the 1991 Gulf War , was not political but humanitarian .

source_bert_toks: upon arrival , hall said that his visit , the first of its kind by an american congressman since the 1991 gulf war , was not political but humanitarian .

reference_raw: When Hall arrived, he said that his visit, the first of his kind to be made by a U.S. Congresswoman since the Gulf War of 1991, was not political but humanitarian.

reference_spacy_tokens: When Hall arrived , he said that his visit , the first of his kind to be made by a U.S. Congresswoman since the Gulf War of 1991 , was not political but humanitarian .


fn_spacy_tokens_for_baseline: But the wild ducks carved by Alex Mair had been recognizably ducks , the piquant sauce , new to him , enhanced rather than dominated the taste of the birds , and the small mounds of creamed turnip and parsnip were an agreeable addition to green peas .

source_bert_toks: but the wild ducks carved by alex mai ##r had been rec ##og ##ni ##za ##bly ducks , the pi ##qua ##nt sauce , new to him , enhanced rather than dominated the taste of the birds , and the small mounds of cream ##ed turn ##ip and par ##s ##ni ##p were an agree ##able addition to green peas .

reference_raw: But the wild ducks cut by Alex Mair were recognizable ducks, and the piquant sauce, new to him, improved rather than dominated the taste of birds, and the small piles of creamy turnip and parsnip were a pleasant addition to the green peas.

reference_spacy_tokens: But the wild ducks cut by Alex Mair were recognizable ducks , and the piquant sauce , new to him , improved rather than dominated the taste of birds , and the small piles of creamy turnip and parsnip were a pleasant addition to the green peas .


fn_spacy_tokens_for_baseline: Young kids used to quack at us as we went past .

source_bert_toks: young kids used to qu ##ack at us as we went past .

reference_raw: When we passed, the young children laughed at us.

reference_spacy_tokens: When we passed , the young children laughed at us .


fn_spacy_tokens_for_baseline: He said Arabs had feared that Christians would ally themselves with the Kurds and sabotaged this possibility by blocking the larger quotas .

source_bert_toks: he said arabs had feared that christians would ally themselves with the ku ##rds and sabotage ##d this possibility by blocking the larger quota ##s .

reference_raw: He said that the Arabs were afraid that Christians would ally themselves with the Kurds, and that by blocking larger quotas, they were sabotaging that possibility.

reference_spacy_tokens: He said that the Arabs were afraid that Christians would ally themselves with the Kurds , and that by blocking larger quotas , they were sabotaging that possibility .


fn_spacy_tokens_for_baseline: The casinos offer familiar international games - baccarat , blackjack , boule , craps , roulette - along with more exotic Chinese pastimes .

source_bert_toks: the casinos offer familiar international games - ba ##cca ##rat , black ##jack , bo ##ule , crap ##s , ro ##ule ##tte - along with more exotic chinese past ##ime ##s .

reference_raw: Casinos offer familiar foreign games - baccarat, blackjack, boule, bullshit, roulette - along with more exotic Chinese pastimes.

reference_spacy_tokens: Casinos offer familiar foreign games - baccarat , blackjack , boule , bullshit , roulette - along with more exotic Chinese pastimes .


fn_spacy_tokens_for_baseline: In 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

source_bert_toks: in 1904 , the narrow , double - decker trams ran along the waterfront , but land reclamation has placed them far inland .

reference_raw: In 1904, narrow, double-decker trams ran along the waterfront, but land reclamation put them deep inland.

reference_spacy_tokens: In 1904 , narrow , double - decker trams ran along the waterfront , but land reclamation put them deep inland .


fn_spacy_tokens_for_baseline: You could n't simply ignore the fact that he had sentenced you to death , but it was important to let him know that you were n't rattled .

source_bert_toks: you couldn ' t simply ignore the fact that he had sentenced you to death , but it was important to let him know that you weren ' t rattled .

reference_raw: You couldn't just ignore the fact that he'd sentenced you to death, but you had to tell him that you weren't shaken.

reference_spacy_tokens: You could n't just ignore the fact that he 'd sentenced you to death , but you had to tell him that you were n't shaken .


fn_spacy_tokens_for_baseline: One bright sign is that a growing number of women have entered the once male - dominated field ; more than a third of the ringers today are women .

source_bert_toks: one bright sign is that a growing number of women have entered the once male - dominated field ; more than a third of the ring ##ers today are women .

reference_raw: One clear sign is that more and more women have entered the once-male domain; more than one-third of the ringers today are women.

reference_spacy_tokens: One clear sign is that more and more women have entered the once - male domain ; more than one - third of the ringers today are women .


fn_spacy_tokens_for_baseline: On 23 June 1996 , the Sunday Telegraph reported about a " secret multi - million - pound deal with the Indian government which will supply banned materials used to manufacture poison gas . "

source_bert_toks: on 23 june 1996 , the sunday telegraph reported about a " secret multi - million - pound deal with the indian government which will supply banned materials used to manufacture poison gas . "

reference_raw: On 23 June 1996, the Sunday Telegraph announced a "secret multi-million-pound deal with the Government of India to supply prohibited materials used for the production of poison gas."

reference_spacy_tokens: On 23 June 1996 , the Sunday Telegraph announced a " secret multi - million - pound deal with the Government of India to supply prohibited materials used for the production of poison gas . "


fn_spacy_tokens_for_baseline: ' What ? ' he roared as he leapt to his feet .

source_bert_toks: ' what ? ' he roared as he leapt to his feet .

reference_raw: 'What?' he shouted, leaping to his feet.

reference_spacy_tokens: ' What ? ' he shouted , leaping to his feet .


fn_spacy_tokens_for_baseline: Still the thunder thundered and burned and shook them .

source_bert_toks: still the thunder thunder ##ed and burned and shook them .

reference_raw: The storm still roared and burned and shook them.

reference_spacy_tokens: The storm still roared and burned and shook them .


fn_spacy_tokens_for_baseline: He has now set up a British company , Flyda Ltd , to exploit his invention .

source_bert_toks: he has now set up a british company , fly ##da ltd , to exploit his invention .

reference_raw: He has now set up a British company, Flyda Ltd, to use it.

reference_spacy_tokens: He has now set up a British company , Flyda Ltd , to use it .


fn_spacy_tokens_for_baseline: The dog circled him , barking .

source_bert_toks: the dog circled him , barking .

reference_raw: The dog came around and barked.

reference_spacy_tokens: The dog came around and barked .


fn_spacy_tokens_for_baseline: Unhappily , Murillo heard of his excellence , recalled him on some pretext , and had him shot .

source_bert_toks: un ##ha ##pp ##ily , mu ##rill ##o heard of his excellence , recalled him on some pre ##text , and had him shot .

reference_raw: Unfortunately, Murillo had heard of his perfection, recalled him under some pretext, and had him killed.

reference_spacy_tokens: Unfortunately , Murillo had heard of his perfection , recalled him under some pretext , and had him killed .


fn_spacy_tokens_for_baseline: Lying on the bed in her Marks and Spencer 's slip , she read with interest of the range of conference delights available that evening for those who were otherwise unengaged .

source_bert_toks: lying on the bed in her marks and spencer ' s slip , she read with interest of the range of conference delight ##s available that evening for those who were otherwise une ##nga ##ged .

reference_raw: She was lying on the bed in her Marks and Spencer's pocket, reading with interest the range of conference pleasures available to those who were not otherwise engaged that evening.

reference_spacy_tokens: She was lying on the bed in her Marks and Spencer 's pocket , reading with interest the range of conference pleasures available to those who were not otherwise engaged that evening .


fn_spacy_tokens_for_baseline: We had been begging the authorities since early in the morning to send forces [ ... ] It is too late now .

source_bert_toks: we had been begging the authorities since early in the morning to send forces [ . . . ] it is too late now .

reference_raw: From the beginning of the morning, we begged the authorities to send troops.

reference_spacy_tokens: From the beginning of the morning , we begged the authorities to send troops .


fn_spacy_tokens_for_baseline: The girl , Jamie Auld , and 13 other children , aged between 10 and 13 , built a den in 60 tons of hay in the barn and lit a candle as it got dark .

source_bert_toks: the girl , jamie au ##ld , and 13 other children , aged between 10 and 13 , built a den in 60 tons of hay in the barn and lit a candle as it got dark .

reference_raw: The girl, Jamie Auld, and 13 other children, between the ages of ten and thirteen, had built a lair in 60 tons of hay in the barn and lit a candle in the dark.

reference_spacy_tokens: The girl , Jamie Auld , and 13 other children , between the ages of ten and thirteen , had built a lair in 60 tons of hay in the barn and lit a candle in the dark .


fn_spacy_tokens_for_baseline: Golding 's office was grey and cheerless , with the disorientating feature of being substantially higher than it was wide .

source_bert_toks: gold ##ing ' s office was grey and cheer ##less , with the di ##sor ##ient ##ating feature of being substantially higher than it was wide .

reference_raw: Golding's office was gray and cheerless, and its disorientation was that it was considerably higher than it was wide.

reference_spacy_tokens: Golding 's office was gray and cheerless , and its disorientation was that it was considerably higher than it was wide .


fn_spacy_tokens_for_baseline: Tax dollars that would have been spent on public assistance are saved .

source_bert_toks: tax dollars that would have been spent on public assistance are saved .

reference_raw: The tax dollars that would be spent on government support will be saved.

reference_spacy_tokens: The tax dollars that would be spent on government support will be saved .


fn_spacy_tokens_for_baseline: Inflation reached levels beyond the control of the authorities , and mines and bakeries were among the few concerns continuing to operate , as workers did not arrive to work or raw materials were lacking .

source_bert_toks: inflation reached levels beyond the control of the authorities , and mines and baker ##ies were among the few concerns continuing to operate , as workers did not arrive to work or raw materials were lacking .

reference_raw: Inflation was at a level beyond the control of the authorities, and mines and bakeries were among the few concerns that continued to operate, as workers did not come to work or the shortage of raw materials.

reference_spacy_tokens: Inflation was at a level beyond the control of the authorities , and mines and bakeries were among the few concerns that continued to operate , as workers did not come to work or the shortage of raw materials .


fn_spacy_tokens_for_baseline: However , the program has been restarted , possibly in reaction to the revelations about the scope of Iraq 's nuclear weapons program .

source_bert_toks: however , the program has been restarted , possibly in reaction to the revelations about the scope of iraq ' s nuclear weapons program .

reference_raw: But the program was rebooted, possibly in response to revelations about the scope of Iraq's nuclear weapons program.

reference_spacy_tokens: But the program was rebooted , possibly in response to revelations about the scope of Iraq 's nuclear weapons program .


fn_spacy_tokens_for_baseline: The backs of pews were generally panelled which makes them super for panelling a whole room if you can get the quantity , given a bit of designing skill and reworking .

source_bert_toks: the backs of pew ##s were generally panel ##led which makes them super for panel ##ling a whole room if you can get the quantity , given a bit of designing skill and re ##working .

reference_raw: The backs of the benches were usually panelled, so they're great for panelling the entire room if you can get that amount, given some design skills and reworking.

reference_spacy_tokens: The backs of the benches were usually panelled , so they 're great for panelling the entire room if you can get that amount , given some design skills and reworking .


fn_spacy_tokens_for_baseline: As we ruminated , suddenly into our midst burst a young girl visibly in distress .

source_bert_toks: as we rum ##inated , suddenly into our midst burst a young girl visibly in distress .

reference_raw: As we were rummaging, a young girl appeared to burst into our midst.

reference_spacy_tokens: As we were rummaging , a young girl appeared to burst into our midst .


fn_spacy_tokens_for_baseline: She went to the bathroom next and peed loudly .

source_bert_toks: she went to the bathroom next and pee ##d loudly .

reference_raw: She went to the bathroom next time, urinating loudly.

reference_spacy_tokens: She went to the bathroom next time , urinating loudly .


fn_spacy_tokens_for_baseline: City and Countryside

source_bert_toks: city and countryside

reference_raw: City and country

reference_spacy_tokens: City and country


fn_spacy_tokens_for_baseline: But in the two decades since this mindless butchery no one has been made to answer for a crime which sent shockwaves far beyond the shores of Ulster .

source_bert_toks: but in the two decades since this mind ##less butcher ##y no one has been made to answer for a crime which sent shock ##wave ##s far beyond the shores of ulster .

reference_raw: But in the twenty years since this mindless slaughter, no one had been forced to answer for a crime that had sent shock waves far beyond Ulster's shores.

reference_spacy_tokens: But in the twenty years since this mindless slaughter , no one had been forced to answer for a crime that had sent shock waves far beyond Ulster 's shores .