fn_spacy_tokens_for_baseline: Thick slabs of bacon sizzled on a pan that sat by the fire , and they mopped up the fat with grainy bread , washing it down with spring water .

source_bert_toks: thick slabs of bacon si ##zzled on a pan that sat by the fire , and they mo ##pped up the fat with grain ##y bread , washing it down with spring water .

reference_raw: A thick plate of bacon hissed on a pan that sat by the fire, and they wiped the fat with grainy bread and washed it with spring water.

reference_spacy_tokens: A thick plate of bacon hissed on a pan that sat by the fire , and they wiped the fat with grainy bread and washed it with spring water .


fn_spacy_tokens_for_baseline: The head of Loch Duich is in view backed by the Kintail ridge of Five Sisters and the Saddle with its satellites .

source_bert_toks: the head of loch du ##ich is in view backed by the kin ##tail ridge of five sisters and the saddle with its satellites .

reference_raw: Loch Duich's head is in sight, supported by the Kintail crest of the Five Sisters and the Saddle with its satellites.

reference_spacy_tokens: Loch Duich 's head is in sight , supported by the Kintail crest of the Five Sisters and the Saddle with its satellites .


fn_spacy_tokens_for_baseline: However -- bowing to public demand -- we hope to host another dance in October / November so you 're being given ample warning .

source_bert_toks: however - - bowing to public demand - - we hope to host another dance in october / november so you ' re being given ample warning .

reference_raw: However, by bowing to public demand, we hope to host another ball in October/November to give you plenty of warning.

reference_spacy_tokens: However , by bowing to public demand , we hope to host another ball in October / November to give you plenty of warning .


fn_spacy_tokens_for_baseline: He put it to his mouth and tasted it , then looked back at Wang Sau - leyan , his ancient face creased into a smile .

source_bert_toks: he put it to his mouth and tasted it , then looked back at wang sa ##u - ley ##an , his ancient face cr ##eased into a smile .

reference_raw: He put it to his mouth and tried it, then looked back at Wang Sau-leyan, his old face wrinkled in a smile.

reference_spacy_tokens: He put it to his mouth and tried it , then looked back at Wang Sau - leyan , his old face wrinkled in a smile .


fn_spacy_tokens_for_baseline: Cranston , however , acted as if she was an old friend , flattered and fussed her .

source_bert_toks: cr ##ans ##ton , however , acted as if she was an old friend , flat ##tered and fuss ##ed her .

reference_raw: Cranston, however, behaved as if she were an old friend, flattered and agitated.

reference_spacy_tokens: Cranston , however , behaved as if she were an old friend , flattered and agitated .


fn_spacy_tokens_for_baseline: Well , ' I sighed , looking up to the night sky , where the clouds were starting to blot out the few stars that the city lights did not obscure .

source_bert_toks: well , ' i sighed , looking up to the night sky , where the clouds were starting to b ##lot out the few stars that the city lights did not obscure .

reference_raw: "Well," I sighed, looking up at the night sky, where the clouds began to blur a few stars that were not obscured by the city's lights.

reference_spacy_tokens: " Well , " I sighed , looking up at the night sky , where the clouds began to blur a few stars that were not obscured by the city 's lights .


fn_spacy_tokens_for_baseline: When you are in a room with him , his eyes follow you everywhere .

source_bert_toks: when you are in a room with him , his eyes follow you everywhere .

reference_raw: When you're in the room with him, he's watching you everywhere.

reference_spacy_tokens: When you 're in the room with him , he 's watching you everywhere .


fn_spacy_tokens_for_baseline: The Gault Clay gives rise to very heavy soils which are often waterlogged , and is primarily an area of woodland and grassland , cultivation being difficult .

source_bert_toks: the gaul ##t clay gives rise to very heavy soils which are often water ##log ##ged , and is primarily an area of woodland and grassland , cultivation being difficult .

reference_raw: Gault Clay produces very heavy land, which is often water-logged, and is mainly woodland and grassland, which is difficult to grow.

reference_spacy_tokens: Gault Clay produces very heavy land , which is often water - logged , and is mainly woodland and grassland , which is difficult to grow .


fn_spacy_tokens_for_baseline: She is dubious about the mass appropriation of hip hop style in fashion , believing that many stylists are ' cashing in ' .

source_bert_toks: she is dubious about the mass app ##ropriation of hip hop style in fashion , believing that many st ##yl ##ists are ' cash ##ing in ' .

reference_raw: She doubts the mass items of hip-hop style in fashion, and believes that many stylists "cash in."

reference_spacy_tokens: She doubts the mass items of hip - hop style in fashion , and believes that many stylists " cash in . "


fn_spacy_tokens_for_baseline: The nation 's best teacher believes that when students feel their school belongs to them , they damage the building .

source_bert_toks: the nation ' s best teacher believes that when students feel their school belongs to them , they damage the building .

reference_raw: The best teacher in the country believes that if students feel their school belongs to them, they will destroy the building.

reference_spacy_tokens: The best teacher in the country believes that if students feel their school belongs to them , they will destroy the building .


fn_spacy_tokens_for_baseline: He had not heard them pass him ; he had been too intent on watching the singer .

source_bert_toks: he had not heard them pass him ; he had been too intent on watching the singer .

reference_raw: He didn't listen to them pass him; he was too intent on following the singer.

reference_spacy_tokens: He did n't listen to them pass him ; he was too intent on following the singer .


fn_spacy_tokens_for_baseline: Most prowl among the rocks and reefs -- crabs , shrimps , prawns and lobsters .

source_bert_toks: most pro ##wl among the rocks and reefs - - crabs , shrimp ##s , pr ##aw ##ns and lobster ##s .

reference_raw: Most of them crawl among rocks and cliffs - crabs, shrimps, shrimps and lobsters.

reference_spacy_tokens: Most of them crawl among rocks and cliffs - crabs , shrimps , shrimps and lobsters .


fn_spacy_tokens_for_baseline: With this award the Programme will be expanded to more than three times its present size and become one of the University 's most important academic developments .

source_bert_toks: with this award the programme will be expanded to more than three times its present size and become one of the university ' s most important academic developments .

reference_raw: With this award, the programme will be extended to more than three times its current size and become one of the most important academic developments in the university.

reference_spacy_tokens: With this award , the programme will be extended to more than three times its current size and become one of the most important academic developments in the university .


fn_spacy_tokens_for_baseline: Mrs Miller had booked them both into a small inn on the outskirts of Street and from the window beneath the sloping roof of her room , Eline could see along the main roadway of the town .

source_bert_toks: mrs miller had booked them both into a small inn on the outskirts of street and from the window beneath the sloping roof of her room , eli ##ne could see along the main roadway of the town .

reference_raw: Mrs. Miller had booked them both to a small inn on the edge of the street, and Eline could see from the window under the sloping roof of her room along the main street of the city.

reference_spacy_tokens: Mrs. Miller had booked them both to a small inn on the edge of the street , and Eline could see from the window under the sloping roof of her room along the main street of the city .


fn_spacy_tokens_for_baseline: Simply smear on a generous amount over your skin after cleansing to make a revitalising face mask .

source_bert_toks: simply sm ##ear on a generous amount over your skin after cleansing to make a rev ##ital ##ising face mask .

reference_raw: Simply stain the skin with a generous amount after cleansing to revitalize the facial mask.

reference_spacy_tokens: Simply stain the skin with a generous amount after cleansing to revitalize the facial mask .


fn_spacy_tokens_for_baseline: The atomic bombs dropped on Hiroshima and Nagasaki used low - level nuclear weapons technology .

source_bert_toks: the atomic bombs dropped on hiroshima and nagasaki used low - level nuclear weapons technology .

reference_raw: Atom bombs dropped on Hiroshima, and Nagasaki used low-level nuclear-weapon technology.

reference_spacy_tokens: Atom bombs dropped on Hiroshima , and Nagasaki used low - level nuclear - weapon technology .


fn_spacy_tokens_for_baseline: For the rest of the morning he searched aimlessly through the town , visiting the place names he had found in Ixora 's diary .

source_bert_toks: for the rest of the morning he searched aim ##lessly through the town , visiting the place names he had found in ix ##ora ' s diary .

reference_raw: He spent the rest of the morning looking aimlessly through the city, visiting the names he had found in Ixora's journal.

reference_spacy_tokens: He spent the rest of the morning looking aimlessly through the city , visiting the names he had found in Ixora 's journal .


fn_spacy_tokens_for_baseline: With the model benchmarked to AEO2001 , and given the different mix of scenario assumptions previously described , AMIGA reports the results in the figures and tables that follow .

source_bert_toks: with the model bench ##mark ##ed to ae ##o ##200 ##1 , and given the different mix of scenario assumptions previously described , amiga reports the results in the figures and tables that follow .

reference_raw: Based on the model compared to AEO2001 and taking into account the various combinations of scenario assumptions described above, AMIGA reports the results in the following figures and tables.

reference_spacy_tokens: Based on the model compared to AEO2001 and taking into account the various combinations of scenario assumptions described above , AMIGA reports the results in the following figures and tables .


fn_spacy_tokens_for_baseline: ' Eileen says her whiskey cake is better , but I have n't let her prove it yet . '

source_bert_toks: ' eileen says her whiskey cake is better , but i haven ' t let her prove it yet . '

reference_raw: "Eileen says she's better off with a whiskey pie, but I haven't let her prove it yet."

reference_spacy_tokens: " Eileen says she 's better off with a whiskey pie , but I have n't let her prove it yet . "


fn_spacy_tokens_for_baseline: The Church of England vicar blessed the Northamp stately home , splashed holy water on the walls and said prayers to ward off the spirit .

source_bert_toks: the church of england vicar blessed the north ##amp state ##ly home , splashed holy water on the walls and said prayers to ward off the spirit .

reference_raw: The Church of England blessed the noble house of Northamp, spattered holy water on the walls, and prayed to ward off the spirit.

reference_spacy_tokens: The Church of England blessed the noble house of Northamp , spattered holy water on the walls , and prayed to ward off the spirit .


fn_spacy_tokens_for_baseline: I think he was trying out his thought - control on me , though I could n't be sure .

source_bert_toks: i think he was trying out his thought - control on me , though i couldn ' t be sure .

reference_raw: I think he tried to control me, but I wasn't sure.

reference_spacy_tokens: I think he tried to control me , but I was n't sure .


fn_spacy_tokens_for_baseline: Most people find that some added artificial reverberation gives a more pleasant sound than ' raw ' recordings from electronic instruments .

source_bert_toks: most people find that some added artificial rev ##er ##ber ##ation gives a more pleasant sound than ' raw ' recordings from electronic instruments .

reference_raw: Most people find that some of the added artificial echoes produce a much nicer sound than the "raw" recordings of electronic instruments.

reference_spacy_tokens: Most people find that some of the added artificial echoes produce a much nicer sound than the " raw " recordings of electronic instruments .


fn_spacy_tokens_for_baseline: In a nightmare - blur of frenzied activity , Cardiff saw Duvall lunging back through the storm in their direction , a shower of sparkling glass on his shoulders ; saw Rohmer seize Gilbert by the collar of his jacket and whirl him away bodily from the monstrous , thrashing shape and drag him backwards , hair and coat whipping madly in the hellwind .

source_bert_toks: in a nightmare - blur of fr ##en ##zie ##d activity , cardiff saw duval ##l lung ##ing back through the storm in their direction , a shower of sparkling glass on his shoulders ; saw ro ##hm ##er seize gilbert by the collar of his jacket and w ##hir ##l him away bodily from the monstrous , thrash ##ing shape and drag him backwards , hair and coat whipping madly in the hell ##wind .

reference_raw: In a nightmare blur of frantic activity, Cardiff could see Duvall leaping back through the storm toward them, a shower of sparkling glass on his shoulders; he saw Rohmer grab Gilbert by the collar of his jacket, whirling him bodily away from the monstrous, throbbing figure, pulling him backwards, his hair and his coat whipping madly in the wind of hell.

reference_spacy_tokens: In a nightmare blur of frantic activity , Cardiff could see Duvall leaping back through the storm toward them , a shower of sparkling glass on his shoulders ; he saw Rohmer grab Gilbert by the collar of his jacket , whirling him bodily away from the monstrous , throbbing figure , pulling him backwards , his hair and his coat whipping madly in the wind of hell .


fn_spacy_tokens_for_baseline: Iran first acquired SCUD - B ballistic missiles from Libya and North Korea and used them during the Iran - Iraq war .

source_bert_toks: iran first acquired sc ##ud - b ballistic missiles from libya and north korea and used them during the iran - iraq war .

reference_raw: Iran initially acquired SCUD-B ballistic missiles from Libya and North Korea and used them during the Iran-Iraq war.

reference_spacy_tokens: Iran initially acquired SCUD - B ballistic missiles from Libya and North Korea and used them during the Iran - Iraq war .


fn_spacy_tokens_for_baseline: I have adhered strictly to the rules and conventions relating to the conduct of the Prime Minister .

source_bert_toks: i have adhere ##d strictly to the rules and conventions relating to the conduct of the prime minister .

reference_raw: I strictly followed the rules and conventions concerning the Prime Minister's conduct.

reference_spacy_tokens: I strictly followed the rules and conventions concerning the Prime Minister 's conduct .


fn_spacy_tokens_for_baseline: Now we have a corps of locally born and educated doctors with foreign sounding names in search of a medical career facing the same circumstances others faced before .

source_bert_toks: now we have a corps of locally born and educated doctors with foreign sounding names in search of a medical career facing the same circumstances others faced before .

reference_raw: We now have a group of locally-born and educated doctors with foreign-sounding names looking for a medical career facing the same conditions as before.

reference_spacy_tokens: We now have a group of locally - born and educated doctors with foreign - sounding names looking for a medical career facing the same conditions as before .


fn_spacy_tokens_for_baseline: For the most part , Mrs Knelle 's world seemed a cosmopolitan one , for well - to - do foreigners from Europe and America were buying houses and bungalows all around Lough Corrib .

source_bert_toks: for the most part , mrs kn ##elle ' s world seemed a cosmopolitan one , for well - to - do foreigners from europe and america were buying houses and bungalow ##s all around lough co ##rri ##b .

reference_raw: For the most part, Mrs. Knell's world seemed cosmopolitan, because well-to-do strangers from Europe and America bought houses and bungalows all over Lough Corrib.

reference_spacy_tokens: For the most part , Mrs. Knell 's world seemed cosmopolitan , because well - to - do strangers from Europe and America bought houses and bungalows all over Lough Corrib .


fn_spacy_tokens_for_baseline: Despite the competition , four years later she was able to purchase a wooden cart with small wheels .

source_bert_toks: despite the competition , four years later she was able to purchase a wooden cart with small wheels .

reference_raw: In spite of the competition, four years later she was able to buy a small-wheeled wooden wagon.

reference_spacy_tokens: In spite of the competition , four years later she was able to buy a small - wheeled wooden wagon .


fn_spacy_tokens_for_baseline: On the Sunday of the recent Bank Holiday weekend , I took my young grandson to Alresford , in the hope that something would be running !

source_bert_toks: on the sunday of the recent bank holiday weekend , i took my young grandson to al ##res ##ford , in the hope that something would be running !

reference_raw: On Sunday of the last weekend of bank holidays, I took my little grandchild to Alresford in the hope that something was going on!

reference_spacy_tokens: On Sunday of the last weekend of bank holidays , I took my little grandchild to Alresford in the hope that something was going on !


fn_spacy_tokens_for_baseline: These symptoms may be difficult to recognize in a patient after anaesthesia .

source_bert_toks: these symptoms may be difficult to recognize in a patient after ana ##esthesia .

reference_raw: After anaesthesia, these symptoms may be difficult to identify in patients.

reference_spacy_tokens: After anaesthesia , these symptoms may be difficult to identify in patients .


fn_spacy_tokens_for_baseline: Estimates vary on how soon North Korea could begin operating a uranium enrichment plant , but North Korea probably could not produce significant quantities of weapons - grade HEU until the end of the decade .

source_bert_toks: estimates vary on how soon north korea could begin operating a uranium enrichment plant , but north korea probably could not produce significant quantities of weapons - grade he ##u until the end of the decade .

reference_raw: Estimates vary as soon as North Korea can start running a uranium enrichment plant, but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade.

reference_spacy_tokens: Estimates vary as soon as North Korea can start running a uranium enrichment plant , but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade .


fn_spacy_tokens_for_baseline: Sharpe did the same , simply aiming the rifle in the direction of the column , and pulling the trigger so that the bullet whipped off through the stalks .

source_bert_toks: sharpe did the same , simply aiming the rifle in the direction of the column , and pulling the trigger so that the bullet whipped off through the stalks .

reference_raw: Sharpe did the same, simply pointing the rifle toward the column and pulling the trigger so that the bullet flew through the stems.

reference_spacy_tokens: Sharpe did the same , simply pointing the rifle toward the column and pulling the trigger so that the bullet flew through the stems .


fn_spacy_tokens_for_baseline: Gun pellet stuck next to ballerina 's eye

source_bert_toks: gun pe ##llet stuck next to ball ##erina ' s eye

reference_raw: Gun pellet stuck by ballerina's eye

reference_spacy_tokens: Gun pellet stuck by ballerina 's eye


fn_spacy_tokens_for_baseline: Mrs Browning gave an exclamation of astonishment -- a great breathing - out and almost a groan that came with it -- and Mr Browning simply stared at her in disbelief .

source_bert_toks: mrs browning gave an ex ##cl ##ama ##tion of astonishment - - a great breathing - out and almost a groan that came with it - - and mr browning simply stared at her in disbelief .

reference_raw: Mrs. Browning gave a cry of surprise-a great exhalation and almost a groan that came with it-and Mr. Browning simply stared at her incredulously.

reference_spacy_tokens: Mrs. Browning gave a cry of surprise - a great exhalation and almost a groan that came with it - and Mr. Browning simply stared at her incredulously .


fn_spacy_tokens_for_baseline: The mother postponed her second marriage for six months to give time to sort out the new relationships .

source_bert_toks: the mother postponed her second marriage for six months to give time to sort out the new relationships .

reference_raw: My mother put off her second marriage for six months to give me time to sort out new relationships.

reference_spacy_tokens: My mother put off her second marriage for six months to give me time to sort out new relationships .


fn_spacy_tokens_for_baseline: I knew it rang a bell somewhere .

source_bert_toks: i knew it rang a bell somewhere .

reference_raw: I knew it was ringing somewhere.

reference_spacy_tokens: I knew it was ringing somewhere .


fn_spacy_tokens_for_baseline: I leapt into my dressing gown , raced downstairs , grabbed the ashtray , opened the front door and flew out after the dog .

source_bert_toks: i leapt into my dressing gown , raced downstairs , grabbed the ash ##tray , opened the front door and flew out after the dog .

reference_raw: I jumped into my robe, ran down the stairs, grabbed the ashtray, opened the front door, and ran after the dog.

reference_spacy_tokens: I jumped into my robe , ran down the stairs , grabbed the ashtray , opened the front door , and ran after the dog .


fn_spacy_tokens_for_baseline: But as the plaster hardened and the doctor attached two metal struts from her ' halo ' to the jacket , panic began to set in .

source_bert_toks: but as the plaster hardened and the doctor attached two metal st ##rut ##s from her ' halo ' to the jacket , panic began to set in .

reference_raw: But as the plaster hardened and the doctor fastened the two metal struts from her 'halo' to her jacket, panic began.

reference_spacy_tokens: But as the plaster hardened and the doctor fastened the two metal struts from her ' halo ' to her jacket , panic began .


fn_spacy_tokens_for_baseline: By being subtle rather than obvious , you avoid appearing naive .

source_bert_toks: by being subtle rather than obvious , you avoid appearing naive .

reference_raw: If you're gentle rather than obvious, you don't seem naive.

reference_spacy_tokens: If you 're gentle rather than obvious , you do n't seem naive .


fn_spacy_tokens_for_baseline: Subsequent years of Tory rule reduced the Labour establishment to frustration .

source_bert_toks: subsequent years of tory rule reduced the labour establishment to frustration .

reference_raw: The following years of Tory's rule have reduced the Labor Facility to frustration.

reference_spacy_tokens: The following years of Tory 's rule have reduced the Labor Facility to frustration .


fn_spacy_tokens_for_baseline: And it has to do with bed hygiene , for you do n't become allergic to the mite -- you become allergic to the mite 's dung .

source_bert_toks: and it has to do with bed hygiene , for you don ' t become allergic to the mit ##e - - you become allergic to the mit ##e ' s dung .

reference_raw: And it has something to do with bed hygiene, because you don't get allergy to the mite, you get allergy to the mite's manure.

reference_spacy_tokens: And it has something to do with bed hygiene , because you do n't get allergy to the mite , you get allergy to the mite 's manure .


fn_spacy_tokens_for_baseline: The provincial gentry 's disunity reduced their capacity to obstruct the work of the Ministry of Internal Affairs .

source_bert_toks: the provincial gentry ' s di ##sun ##ity reduced their capacity to ob ##st ##ru ##ct the work of the ministry of internal affairs .

reference_raw: The disunity of the provincial gentry has reduced their ability to obstruct the work of the Ministry of Internal Affairs.

reference_spacy_tokens: The disunity of the provincial gentry has reduced their ability to obstruct the work of the Ministry of Internal Affairs .


fn_spacy_tokens_for_baseline: The wild offer by Elizabeth of England of her discarded favourite , the Earl of Leicester , met with justifiable incredulity .

source_bert_toks: the wild offer by elizabeth of england of her discarded favourite , the earl of leicester , met with just ##if ##iable inc ##red ##uli ##ty .

reference_raw: Elizabeth of England's wild offer of her discarded favorite, the Earl of Leicester, encountered justifiable incredulity.

reference_spacy_tokens: Elizabeth of England 's wild offer of her discarded favorite , the Earl of Leicester , encountered justifiable incredulity .


fn_spacy_tokens_for_baseline: Eventually the light was left behind and they walked by the glow of the snow itself .

source_bert_toks: eventually the light was left behind and they walked by the glow of the snow itself .

reference_raw: At last the light was gone, and they walked in the glare of the snow itself.

reference_spacy_tokens: At last the light was gone , and they walked in the glare of the snow itself .


fn_spacy_tokens_for_baseline: Tasting delicious food is one of them .

source_bert_toks: tasting delicious food is one of them .

reference_raw: Tasting tasty food is one of them.

reference_spacy_tokens: Tasting tasty food is one of them .


fn_spacy_tokens_for_baseline: Some experts believe that Iran is developing the capability to deliver biological agents by Scud missiles , aircraft , or other aerosolization techniques .

source_bert_toks: some experts believe that iran is developing the capability to deliver biological agents by sc ##ud missiles , aircraft , or other aero ##sol ##ization techniques .

reference_raw: Some experts believe Iran is developing the capacity of Scud missiles, aircraft, or other aerosolization techniques to supply biological agents.

reference_spacy_tokens: Some experts believe Iran is developing the capacity of Scud missiles , aircraft , or other aerosolization techniques to supply biological agents .


fn_spacy_tokens_for_baseline: Revealing , among other things , three large man - sized casks on deck , upended , with lids .

source_bert_toks: revealing , among other things , three large man - sized cas ##ks on deck , up ##ended , with lids .

reference_raw: He revealed, among other things, three large man-sized barrels on the deck, overturned, with lids.

reference_spacy_tokens: He revealed , among other things , three large man - sized barrels on the deck , overturned , with lids .


fn_spacy_tokens_for_baseline: Longthorne denied being involved in the disturbance in which bottles and glasses were smashed .

source_bert_toks: long ##thor ##ne denied being involved in the disturbance in which bottles and glasses were smashed .

reference_raw: Longthorne refused to be involved in the disruption in which the bottles and glasses were broken.

reference_spacy_tokens: Longthorne refused to be involved in the disruption in which the bottles and glasses were broken .


fn_spacy_tokens_for_baseline: Ember mouthed , ' Could you just shuck off your outer suit , Jez ?

source_bert_toks: em ##ber mouthed , ' could you just shu ##ck off your outer suit , je ##z ?

reference_raw: Ember said, 'Can you get out of your outer suit, Jez?

reference_spacy_tokens: Ember said , ' Can you get out of your outer suit , Jez ?


fn_spacy_tokens_for_baseline: There is no need whatsoever to spend large amounts of money on flower pressing equipment , since the majority of items are either very inexpensive or are things you may already have around the house .

source_bert_toks: there is no need whatsoever to spend large amounts of money on flower pressing equipment , since the majority of items are either very inexpensive or are things you may already have around the house .

reference_raw: You don't have to spend a lot of money on flower-pressing equipment, because most items are either very cheap or are things you might already have around the house.

reference_spacy_tokens: You do n't have to spend a lot of money on flower - pressing equipment , because most items are either very cheap or are things you might already have around the house .


fn_spacy_tokens_for_baseline: The danger to civilians in the Helmand combat zone was underscored Sunday when NATO announced the deaths of 12 people in what it characterized as an errant rocket strike that hit a residential compound .

source_bert_toks: the danger to civilians in the helm ##and combat zone was under ##sco ##red sunday when nato announced the deaths of 12 people in what it characterized as an er ##rant rocket strike that hit a residential compound .

reference_raw: The threat to civilians in the Helmand battle zone was underscored on Sunday when NATO announced the deaths of 12 people in what it described as an errant missile strike that had hit a residential complex.

reference_spacy_tokens: The threat to civilians in the Helmand battle zone was underscored on Sunday when NATO announced the deaths of 12 people in what it described as an errant missile strike that had hit a residential complex .


fn_spacy_tokens_for_baseline: He says it 's upsetting seeing children on the side of the road begging for sweets or any item , it 's hard not to be affected

source_bert_toks: he says it ' s upset ##ting seeing children on the side of the road begging for sweets or any item , it ' s hard not to be affected

reference_raw: He says it's upsetting to see kids on the side of the road begging for candy or something, so it's hard not to be affected.

reference_spacy_tokens: He says it 's upsetting to see kids on the side of the road begging for candy or something , so it 's hard not to be affected .


fn_spacy_tokens_for_baseline: Far away from overpriced hotels and overcrowded tourist areas .

source_bert_toks: far away from over ##pr ##ice ##d hotels and over ##crow ##ded tourist areas .

reference_raw: Away from expensive hotels and crowded tourist areas.

reference_spacy_tokens: Away from expensive hotels and crowded tourist areas .


fn_spacy_tokens_for_baseline: Strangle the fury and say in a sweet , gentle voice : ' Thank you very much for ringing me . '

source_bert_toks: st ##rangle the fury and say in a sweet , gentle voice : ' thank you very much for ringing me . '

reference_raw: Suffocate the anger and say in a kind, gentle voice, "Thank you so much for ringing me."

reference_spacy_tokens: Suffocate the anger and say in a kind , gentle voice , " Thank you so much for ringing me . "


fn_spacy_tokens_for_baseline: Rigid adherence to the letter of their instructions by commissioners can only have served to obscure important aspects of the structure of landholding .

source_bert_toks: rigid adherence to the letter of their instructions by commissioners can only have served to obscure important aspects of the structure of land ##holding .

reference_raw: Strict compliance with the letter of instructions from the Commissioners could only serve to obscure important aspects of the structure of the land.

reference_spacy_tokens: Strict compliance with the letter of instructions from the Commissioners could only serve to obscure important aspects of the structure of the land .


fn_spacy_tokens_for_baseline: The pervasive nature of torture , disappearance and killings and the fact that they went unpunished suggests that these violations were officially sanctioned .

source_bert_toks: the per ##vas ##ive nature of torture , disappearance and killings and the fact that they went un ##pu ##nished suggests that these violations were officially sanctioned .

reference_raw: The pervasive nature of torture, disappearance and murder and the fact that they went unpunished suggests that these violations have been officially punished.

reference_spacy_tokens: The pervasive nature of torture , disappearance and murder and the fact that they went unpunished suggests that these violations have been officially punished .


fn_spacy_tokens_for_baseline: The decision follows as to whether to have the baby or an abortion , assuming the pregnancy is made known early enough .

source_bert_toks: the decision follows as to whether to have the baby or an abortion , assuming the pregnancy is made known early enough .

reference_raw: The decision is based on whether to have a baby or to have an abortion, provided that the pregnancy is known in good time.

reference_spacy_tokens: The decision is based on whether to have a baby or to have an abortion , provided that the pregnancy is known in good time .


fn_spacy_tokens_for_baseline: Rivers in the Katmandu Valley , Nepal , are suffering from dangerously - high levels of pollution as a result of the introduction of chemical washing practises in the manufacture of ' Tibetan ' carpets for export to the West .

source_bert_toks: rivers in the kat ##man ##du valley , nepal , are suffering from dangerously - high levels of pollution as a result of the introduction of chemical washing pr ##act ##ises in the manufacture of ' tibetan ' carpets for export to the west .

reference_raw: The rivers in the Katmandu Valley, Nepal, suffer from dangerously high levels of pollution due to the introduction of chemical washing practices in the production of Tibetan carpets for export to the West.

reference_spacy_tokens: The rivers in the Katmandu Valley , Nepal , suffer from dangerously high levels of pollution due to the introduction of chemical washing practices in the production of Tibetan carpets for export to the West .


fn_spacy_tokens_for_baseline: Jamie is not the type to tuck himself in bed early .

source_bert_toks: jamie is not the type to tuck himself in bed early .

reference_raw: Jamie's not the type to get into bed early.

reference_spacy_tokens: Jamie 's not the type to get into bed early .


fn_spacy_tokens_for_baseline: He gestured at John 's lawyer , an absurdly young man who sat beside his client riffling through a pile of untidy notes as if expecting to find a legal instruction manual .

source_bert_toks: he gestured at john ' s lawyer , an absurd ##ly young man who sat beside his client riff ##ling through a pile of un ##ti ##dy notes as if expecting to find a legal instruction manual .

reference_raw: He pointed to John's lawyer, a preposterous young man sitting next to his client, rummaging through a pile of unfinished notes, as if expecting to find a handbook for legal instruction.

reference_spacy_tokens: He pointed to John 's lawyer , a preposterous young man sitting next to his client , rummaging through a pile of unfinished notes , as if expecting to find a handbook for legal instruction .


fn_spacy_tokens_for_baseline: ' I do n't think I can be ready to leave this evening , ' she answered primly .

source_bert_toks: ' i don ' t think i can be ready to leave this evening , ' she answered pri ##ml ##y .

reference_raw: "I don't think I'm ready to go tonight," she said stiffly.

reference_spacy_tokens: " I do n't think I 'm ready to go tonight , " she said stiffly .


fn_spacy_tokens_for_baseline: The simple fact that he was in her husband 's employ gave her an advantage over him .

source_bert_toks: the simple fact that he was in her husband ' s employ gave her an advantage over him .

reference_raw: The mere fact that he was working for her husband gave her an advantage over him.

reference_spacy_tokens: The mere fact that he was working for her husband gave her an advantage over him .


fn_spacy_tokens_for_baseline: They warn that the dam will upset the ecological balance in the Yangtze basin , with unforeseeable consequences .

source_bert_toks: they warn that the dam will upset the ecological balance in the yang ##tze basin , with un ##for ##ese ##ea ##ble consequences .

reference_raw: They warn that the dam will disturb the ecological balance of the Yangtze basin, with unforeseen consequences.

reference_spacy_tokens: They warn that the dam will disturb the ecological balance of the Yangtze basin , with unforeseen consequences .


fn_spacy_tokens_for_baseline: I first got suspicious about Furbys when I read their online instructions , which sounded like an excerpt from a pornographic version of G.B.

source_bert_toks: i first got suspicious about fur ##by ##s when i read their online instructions , which sounded like an excerpt from a pornographic version of g . b .

reference_raw: The first time I had my suspicions about the Furbys was when I read their online instructions, which sounded like an extract from a pornographic version of G.B.

reference_spacy_tokens: The first time I had my suspicions about the Furbys was when I read their online instructions , which sounded like an extract from a pornographic version of G.B.


fn_spacy_tokens_for_baseline: It seems likely that some legislators in New York State will demand a new public accountability from museums receiving public funds .

source_bert_toks: it seems likely that some legislators in new york state will demand a new public accountability from museums receiving public funds .

reference_raw: Some legislators in the state of New York are likely to demand new public responsibility from museums benefiting from public funds.

reference_spacy_tokens: Some legislators in the state of New York are likely to demand new public responsibility from museums benefiting from public funds .


fn_spacy_tokens_for_baseline: He felt no pity .

source_bert_toks: he felt no pity .

reference_raw: He didn't feel sorry for himself.

reference_spacy_tokens: He did n't feel sorry for himself .


fn_spacy_tokens_for_baseline: He pressed a button on the desk , and two guards came in .

source_bert_toks: he pressed a button on the desk , and two guards came in .

reference_raw: He pushed a button on the table and two guards entered.

reference_spacy_tokens: He pushed a button on the table and two guards entered .


fn_spacy_tokens_for_baseline: NEWRY and Mourne councillors have condemned an application for trust status by the local Health and Social Services Unit of Management .

source_bert_toks: new ##ry and mo ##urne councillors have condemned an application for trust status by the local health and social services unit of management .

reference_raw: The councillors of NEWRY and Mourne have denounced a request for trust from the local health and social services department.

reference_spacy_tokens: The councillors of NEWRY and Mourne have denounced a request for trust from the local health and social services department .


fn_spacy_tokens_for_baseline: She was rude to Larry Hagman , snubbed Joan Collins and poked fun at the skinny figure and revealing frocks favoured by Cher .

source_bert_toks: she was rude to larry ha ##gman , s ##nu ##bbed joan collins and poked fun at the skinny figure and revealing fr ##ocks favoured by cher .

reference_raw: She was unkind to Larry Hagman, snubbing Joan Collins, poking fun at the skinny figure, revealing the clothes that Cher favored.

reference_spacy_tokens: She was unkind to Larry Hagman , snubbing Joan Collins , poking fun at the skinny figure , revealing the clothes that Cher favored .


fn_spacy_tokens_for_baseline: We stayed a couple of nights in London , in a small hotel situated in the street extending from the top of St Martin 's Lane .

source_bert_toks: we stayed a couple of nights in london , in a small hotel situated in the street extending from the top of st martin ' s lane .

reference_raw: We stayed in London for a few nights, in a small hotel on the street that ran from the top of St. Martin's Street.

reference_spacy_tokens: We stayed in London for a few nights , in a small hotel on the street that ran from the top of St. Martin 's Street .


fn_spacy_tokens_for_baseline: Again and again he despaired at the truth .

source_bert_toks: again and again he despair ##ed at the truth .

reference_raw: Again and again he was desperate for the truth.

reference_spacy_tokens: Again and again he was desperate for the truth .


fn_spacy_tokens_for_baseline: The liberal - historians , on the other hand , tend to find themselves in a somewhat more tricky position .

source_bert_toks: the liberal - historians , on the other hand , tend to find themselves in a somewhat more tricky position .

reference_raw: Liberal historians, on the other hand, tend to find themselves in a more difficult position.

reference_spacy_tokens: Liberal historians , on the other hand , tend to find themselves in a more difficult position .


fn_spacy_tokens_for_baseline: He was dressed in the manner of the Thirties with a broad - lapelled jacket , wide cuffs and dark tie firmly attached with a gold clip to a gleaming white shirt .

source_bert_toks: he was dressed in the manner of the thirties with a broad - lap ##elled jacket , wide cuffs and dark tie firmly attached with a gold clip to a gleaming white shirt .

reference_raw: He was dressed like a thirty-year-old man in a wide-lapelled coat, wide cuffs, and a dark tie firmly attached to a gleaming white shirt with a gold clip.

reference_spacy_tokens: He was dressed like a thirty - year - old man in a wide - lapelled coat , wide cuffs , and a dark tie firmly attached to a gleaming white shirt with a gold clip .


fn_spacy_tokens_for_baseline: no no and they 're um they 're very smart dogs the circuses in Europe used to use them um for the acts they uh

source_bert_toks: no no and they ' re um they ' re very smart dogs the circus ##es in europe used to use them um for the acts they uh

reference_raw: No, no, and they're, uh, very clever dogs that the circuses in Europe used to use them, um, for their deeds

reference_spacy_tokens: No , no , and they 're , uh , very clever dogs that the circuses in Europe used to use them , um , for their deeds


fn_spacy_tokens_for_baseline: While the two strains of fusaria Iran requested are in fact dangerous to animal and human nervous systems , Schiefer contended that the toxins ( T-2 and related " trichothecene mycotoxins " ) produced by the fungi would not kill quickly enough to be an effective agent .

source_bert_toks: while the two strains of fu ##sari ##a iran requested are in fact dangerous to animal and human nervous systems , sc ##hi ##efe ##r contend ##ed that the toxin ##s ( t - 2 and related " tri ##cho ##the ##cene my ##cot ##ox ##ins " ) produced by the fungi would not kill quickly enough to be an effective agent .

reference_raw: Although the two types of Fusaria Iran applied for are in fact dangerous to the animal and human nervous system, Schiefer argued that the toxins (T-2 and associated "trichothecene mycotoxins" ) produced by the fungi would not kill quickly enough to be effective.

reference_spacy_tokens: Although the two types of Fusaria Iran applied for are in fact dangerous to the animal and human nervous system , Schiefer argued that the toxins ( T-2 and associated " trichothecene mycotoxins " ) produced by the fungi would not kill quickly enough to be effective .


fn_spacy_tokens_for_baseline: The city 's impact on the rock and pop music scene with the likes of U2 and Bob Geldof is well known -- there 's even a self - guided tour of their haunts .

source_bert_toks: the city ' s impact on the rock and pop music scene with the likes of u2 and bob gel ##do ##f is well known - - there ' s even a self - guided tour of their haunt ##s .

reference_raw: The impact of the town on rock and pop music scenes like U2 and Bob Geldof is well known - there is even a self-directed tour of their hauntings.

reference_spacy_tokens: The impact of the town on rock and pop music scenes like U2 and Bob Geldof is well known - there is even a self - directed tour of their hauntings .


fn_spacy_tokens_for_baseline: These tiles are exceptionally strong and durable , and blend in well in most surroundings .

source_bert_toks: these tiles are exceptionally strong and durable , and blend in well in most surroundings .

reference_raw: These tiles are exceptionally strong and resilient and blend well in most surroundings.

reference_spacy_tokens: These tiles are exceptionally strong and resilient and blend well in most surroundings .


fn_spacy_tokens_for_baseline: These kind of decisions are normally made by the teacher alone , but it is possible that involving the children in making them might be an extremely effective way of teaching them self - determination and discipline .

source_bert_toks: these kind of decisions are normally made by the teacher alone , but it is possible that involving the children in making them might be an extremely effective way of teaching them self - determination and discipline .

reference_raw: This kind of decision is usually made only by a schoolteacher, but it is possible that involving children in making it can be a very effective way to teach them self-determination and discipline.

reference_spacy_tokens: This kind of decision is usually made only by a schoolteacher , but it is possible that involving children in making it can be a very effective way to teach them self - determination and discipline .


fn_spacy_tokens_for_baseline: Sladen bent carefully back in his chair and frowned at the ceiling .

source_bert_toks: slade ##n bent carefully back in his chair and frowned at the ceiling .

reference_raw: Sladen leaned back in his chair, frowning at the ceiling.

reference_spacy_tokens: Sladen leaned back in his chair , frowning at the ceiling .


fn_spacy_tokens_for_baseline: By a sad coincidence Miss E.M. Ridge of the Junior School died on the same day whilst posting a letter on Woodsmoor Lane .

source_bert_toks: by a sad coincidence miss e . m . ridge of the junior school died on the same day whilst posting a letter on woods ##moor lane .

reference_raw: Unfortunately, Miss E.M. Ridge from junior school died the same day when she sent a letter to Woodsmoor Lane.

reference_spacy_tokens: Unfortunately , Miss E.M. Ridge from junior school died the same day when she sent a letter to Woodsmoor Lane .


fn_spacy_tokens_for_baseline: You are going to bloody well hang me anyway , for murders I never committed ! '

source_bert_toks: you are going to bloody well hang me anyway , for murders i never committed ! '

reference_raw: You're going to put me up for murders I've never committed!'

reference_spacy_tokens: You 're going to put me up for murders I 've never committed ! '


fn_spacy_tokens_for_baseline: Then we spot a tall , blonde woman striding up the street in our direction .

source_bert_toks: then we spot a tall , blonde woman st ##riding up the street in our direction .

reference_raw: Then we see a tall blond woman walking down the street toward us.

reference_spacy_tokens: Then we see a tall blond woman walking down the street toward us .


fn_spacy_tokens_for_baseline: Scott was so taken aback that Palmerston immediately withdrew his suggestion of a collaborator .

source_bert_toks: scott was so taken aback that palmer ##ston immediately withdrew his suggestion of a collaborator .

reference_raw: Scott was so shocked that Palmerston immediately withdrew his cooperation proposal.

reference_spacy_tokens: Scott was so shocked that Palmerston immediately withdrew his cooperation proposal .


fn_spacy_tokens_for_baseline: The sin of the world was purged by the waters of the flood .

source_bert_toks: the sin of the world was purge ##d by the waters of the flood .

reference_raw: The waters of the flood cleansed the sins of the world.

reference_spacy_tokens: The waters of the flood cleansed the sins of the world .


fn_spacy_tokens_for_baseline: Squadron Leader Archibald Liggat , of RAF Valley , receives a Queen 's Commendation for his exceptional diligence and professionalism as a Phantom pilot .

source_bert_toks: squadron leader archibald li ##gga ##t , of raf valley , receives a queen ' s commendation for his exceptional dil ##igen ##ce and professional ##ism as a phantom pilot .

reference_raw: The squadron leader, Archibald Liggat, of the RAF Valley, receives a queen's recommendation for his extraordinary diligence and professionalism as a Phantom pilot.

reference_spacy_tokens: The squadron leader , Archibald Liggat , of the RAF Valley , receives a queen 's recommendation for his extraordinary diligence and professionalism as a Phantom pilot .


fn_spacy_tokens_for_baseline: The neck was stretched out in front so the head hung down low , almost as low as the tiny hooves .

source_bert_toks: the neck was stretched out in front so the head hung down low , almost as low as the tiny hooves .

reference_raw: The neck was stretched out in front of him, so that the head dropped low, almost as low as the tiny hooves.

reference_spacy_tokens: The neck was stretched out in front of him , so that the head dropped low , almost as low as the tiny hooves .


fn_spacy_tokens_for_baseline: In a language such as Turkish , in which words composed of a relatively large number of basic grammatical units ( morphemes ) are common , this characteristic of words may seem less salient .

source_bert_toks: in a language such as turkish , in which words composed of a relatively large number of basic grammatical units ( mor ##ph ##eme ##s ) are common , this characteristic of words may seem less sal ##ient .

reference_raw: In a language such as Turkey, where words composed of a relatively large number of basic grammatical units (morphems) are common, this characteristic of words may appear to be less saline.

reference_spacy_tokens: In a language such as Turkey , where words composed of a relatively large number of basic grammatical units ( morphems ) are common , this characteristic of words may appear to be less saline .


fn_spacy_tokens_for_baseline: The smell of whisky mingled with the scent of jasmine growing against the house .

source_bert_toks: the smell of whisky mingled with the scent of jasmine growing against the house .

reference_raw: The smell of whiskey mixed with the smell of jasmine growing against the house.

reference_spacy_tokens: The smell of whiskey mixed with the smell of jasmine growing against the house .


fn_spacy_tokens_for_baseline: ' The first man closes the exterior hatch from the outside , we drain the conning tower , we do it all over again .

source_bert_toks: ' the first man closes the exterior hatch from the outside , we drain the con ##ning tower , we do it all over again .

reference_raw: The first man closes the outer hatch, we drain the conning tower, we do it again.

reference_spacy_tokens: The first man closes the outer hatch , we drain the conning tower , we do it again .


fn_spacy_tokens_for_baseline: He growled an apology , gave the poor girl a miserable parody of a smile and turned his attention to their patient .

source_bert_toks: he growled an apology , gave the poor girl a miserable parody of a smile and turned his attention to their patient .

reference_raw: He grunted an apology, gave the poor girl a pitiful parody of a smile, and turned his attention to the patient.

reference_spacy_tokens: He grunted an apology , gave the poor girl a pitiful parody of a smile , and turned his attention to the patient .


fn_spacy_tokens_for_baseline: He also struck him when Sweeney tried to escape on the way to the Bridewell .

source_bert_toks: he also struck him when sweeney tried to escape on the way to the bride ##well .

reference_raw: When Sweeney tried to escape on his way to the Bridewell, he hit him, too.

reference_spacy_tokens: When Sweeney tried to escape on his way to the Bridewell , he hit him , too .


fn_spacy_tokens_for_baseline: If you 'd come back telling me you 'd discovered somebody out of that cosy little coterie was actually telling the truth , that 'd be another matter . '

source_bert_toks: if you ' d come back telling me you ' d discovered somebody out of that co ##sy little cote ##rie was actually telling the truth , that ' d be another matter . '

reference_raw: If you came back and told me that you found out that someone in that cozy little bunker was actually telling the truth, that would be something else.'

reference_spacy_tokens: If you came back and told me that you found out that someone in that cozy little bunker was actually telling the truth , that would be something else . '


fn_spacy_tokens_for_baseline: He had not shown the slightest concern for her .

source_bert_toks: he had not shown the slightest concern for her .

reference_raw: He showed no interest in her.

reference_spacy_tokens: He showed no interest in her .


fn_spacy_tokens_for_baseline: I remembered that they had never flown in a light aircraft before today ; I shuddered to think of what could happen if they panicked .

source_bert_toks: i remembered that they had never flown in a light aircraft before today ; i shuddered to think of what could happen if they panicked .

reference_raw: I remembered that they had never flown in a light plane before, and I shivered at the thought of what might happen if they panicked.

reference_spacy_tokens: I remembered that they had never flown in a light plane before , and I shivered at the thought of what might happen if they panicked .


fn_spacy_tokens_for_baseline: However , DOD has no plans to help secure three other Russian nerve agent storage sites that store 65 percent of Russia 's declared nerve agent stockpile .

source_bert_toks: however , dod has no plans to help secure three other russian nerve agent storage sites that store 65 percent of russia ' s declared nerve agent stock ##pile .

reference_raw: However, the Ministry of Defence has no intention of assisting in the safekeeping of three other Russian nerve agent storage sites, which store 65 percent of Russia's declared supply of nerve agents.

reference_spacy_tokens: However , the Ministry of Defence has no intention of assisting in the safekeeping of three other Russian nerve agent storage sites , which store 65 percent of Russia 's declared supply of nerve agents .


fn_spacy_tokens_for_baseline: This I was able to do by securing the position of governess in his family .

source_bert_toks: this i was able to do by securing the position of govern ##ess in his family .

reference_raw: I was able to do that by safeguarding the position of the governess in his family.

reference_spacy_tokens: I was able to do that by safeguarding the position of the governess in his family .


fn_spacy_tokens_for_baseline: TIA DALMA : Same story , different versions , and all are true .

source_bert_toks: tia dal ##ma : same story , different versions , and all are true .

reference_raw: The same story, different versions, and all the truth.

reference_spacy_tokens: The same story , different versions , and all the truth .


fn_spacy_tokens_for_baseline: Once everything had been checked I filled the vat with water and switched the pump on .

source_bert_toks: once everything had been checked i filled the va ##t with water and switched the pump on .

reference_raw: Once everything was checked, I filled the tank with water and turned on the pump.

reference_spacy_tokens: Once everything was checked , I filled the tank with water and turned on the pump .


fn_spacy_tokens_for_baseline: This project is used to connect offices in the other islands to the main LASH office in Honolulu .

source_bert_toks: this project is used to connect offices in the other islands to the main lash office in honolulu .

reference_raw: The project is used to link the offices of the other Isles to the main LASH office in Honolulu.

reference_spacy_tokens: The project is used to link the offices of the other Isles to the main LASH office in Honolulu .


fn_spacy_tokens_for_baseline: Once , when I told her a lie about what I was doing , in order to evade hostile questioning , she said , severely , ' You 're growing too like your father . '

source_bert_toks: once , when i told her a lie about what i was doing , in order to evade hostile questioning , she said , severely , ' you ' re growing too like your father . '

reference_raw: One day, when I told her a liar about what I was doing to avoid hostile questions, she said sternly, "You're growing too much like your father."

reference_spacy_tokens: One day , when I told her a liar about what I was doing to avoid hostile questions , she said sternly , " You 're growing too much like your father . "


fn_spacy_tokens_for_baseline: Dispensing with longueurs ( the film runs 74 minutes , B - movie length ) , Kaurismaki traces the man 's unsuccessful search for work and inevitable lapse into petty crime with clipped , deadpan comedy .

source_bert_toks: di ##sp ##ens ##ing with long ##ue ##urs ( the film runs 74 minutes , b - movie length ) , ka ##uri ##sma ##ki traces the man ' s unsuccessful search for work and inevitable laps ##e into petty crime with clipped , dead ##pan comedy .

reference_raw: Dispensing with longueurs (the film runs for 74 minutes, B-movie length), Kaurismaki tracks the man's failed search for work and inevitably disappears into petty crime with a clipped, deadpan comedy.

reference_spacy_tokens: Dispensing with longueurs ( the film runs for 74 minutes , B - movie length ) , Kaurismaki tracks the man 's failed search for work and inevitably disappears into petty crime with a clipped , deadpan comedy .


fn_spacy_tokens_for_baseline: Yet the Discovery has a classy , Conran - designed interior , excellent seats and ride - comfort and a wonderful , rumbling V8 engine that emits just the same blue - blooded burble as a Range Rover .

source_bert_toks: yet the discovery has a class ##y , con ##ran - designed interior , excellent seats and ride - comfort and a wonderful , rumbling v8 engine that emi ##ts just the same blue - blooded bu ##rb ##le as a range rover .

reference_raw: But the Discovery has a classy, Conran-designed interior, excellent seats and riding comfort, and a beautiful, rumbling V8 engine that emits the same blue-blooded bubble as the Range Rover.

reference_spacy_tokens: But the Discovery has a classy , Conran - designed interior , excellent seats and riding comfort , and a beautiful , rumbling V8 engine that emits the same blue - blooded bubble as the Range Rover .


fn_spacy_tokens_for_baseline: On the rare occasions when he consented to do interviews , he usually sat silent and still , staring stone - faced at baffled journalists .

source_bert_toks: on the rare occasions when he consent ##ed to do interviews , he usually sat silent and still , staring stone - faced at baffled journalists .

reference_raw: On rare occasions, when he agreed to do interviews, he usually sat quietly and calmly, staring at the stunned journalists with his stone face.

reference_spacy_tokens: On rare occasions , when he agreed to do interviews , he usually sat quietly and calmly , staring at the stunned journalists with his stone face .


fn_spacy_tokens_for_baseline: Species like these are abundant in rocks of Ordovician age , often forming shelly bands .

source_bert_toks: species like these are abundant in rocks of or ##do ##vic ##ian age , often forming shelly bands .

reference_raw: Such species are rich in the rocks of Ordovician age, often forming shell bands.

reference_spacy_tokens: Such species are rich in the rocks of Ordovician age , often forming shell bands .


fn_spacy_tokens_for_baseline: Paul bit his lip as he jogged at his father 's shoulder along a trail that wound through fringes of jungle beside the La Nga River .

source_bert_toks: paul bit his lip as he jogged at his father ' s shoulder along a trail that wound through fringe ##s of jungle beside the la ng ##a river .

reference_raw: Paul bit his lip and trotted on his father's shoulder along the path that wound through the edges of the forest beside the La Nga River.

reference_spacy_tokens: Paul bit his lip and trotted on his father 's shoulder along the path that wound through the edges of the forest beside the La Nga River .


fn_spacy_tokens_for_baseline: ' He 's just phoned from the car to say that as far as he could tell Harry had nothing to do with it .

source_bert_toks: ' he ' s just phone ##d from the car to say that as far as he could tell harry had nothing to do with it .

reference_raw: 'He just called from the car to say that as far as he could tell, Harry had nothing to do with it.

reference_spacy_tokens: ' He just called from the car to say that as far as he could tell , Harry had nothing to do with it .


fn_spacy_tokens_for_baseline: When one day nobody could rouse him from his trailer , it was Lee Marvin who entered quietly and found a sombre , lonely , sad man .

source_bert_toks: when one day nobody could rouse him from his trailer , it was lee marvin who entered quietly and found a so ##mbre , lonely , sad man .

reference_raw: One day, when no one could wake him from his trailer, it was Lee Marvin who entered quietly and found a gloomy, lonely man.

reference_spacy_tokens: One day , when no one could wake him from his trailer , it was Lee Marvin who entered quietly and found a gloomy , lonely man .


fn_spacy_tokens_for_baseline: They 're liable to confiscate it for the further entertainment of customs officers . '

source_bert_toks: they ' re liable to con ##fi ##sca ##te it for the further entertainment of customs officers . '

reference_raw: They'll be able to impound it for further entertainment by customs officers.'

reference_spacy_tokens: They 'll be able to impound it for further entertainment by customs officers . '


fn_spacy_tokens_for_baseline: There , pit latrines inside homes take pride of place , their arched entrances lavishly embellished with stone carvings .

source_bert_toks: there , pit la ##tri ##nes inside homes take pride of place , their arched entrances lavish ##ly em ##bell ##ished with stone carvings .

reference_raw: There, the pit latrines in the houses are proud of their position, their arched entrances lavishly carved with stone carvings.

reference_spacy_tokens: There , the pit latrines in the houses are proud of their position , their arched entrances lavishly carved with stone carvings .


fn_spacy_tokens_for_baseline: Galileo was less successful in explaining why loose objects are not flung from the surface of a spinning earth .

source_bert_toks: galileo was less successful in explaining why loose objects are not flung from the surface of a spinning earth .

reference_raw: Galileo was less successful in explaining why loose objects were not thrown from the surface of the spinning earth.

reference_spacy_tokens: Galileo was less successful in explaining why loose objects were not thrown from the surface of the spinning earth .


fn_spacy_tokens_for_baseline: Pupils are able , through reading and responding to literature , to develop an understanding of and control over an ever - widening range of written forms .

source_bert_toks: pupils are able , through reading and responding to literature , to develop an understanding of and control over an ever - widening range of written forms .

reference_raw: By reading and responding to literature, pupils are able to develop a knowledge and control of an ever-widening range of written forms.

reference_spacy_tokens: By reading and responding to literature , pupils are able to develop a knowledge and control of an ever - widening range of written forms .


fn_spacy_tokens_for_baseline: During this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

source_bert_toks: during this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

reference_raw: During that time, the natives lived in caverns and hunted mammals that had gathered on the shore.

reference_spacy_tokens: During that time , the natives lived in caverns and hunted mammals that had gathered on the shore .


fn_spacy_tokens_for_baseline: QN : Does Russia have a stockpile of chemical weapons ?

source_bert_toks: q ##n : does russia have a stock ##pile of chemical weapons ?

reference_raw: QN: Does Russia have a supply of chemical weapons?

reference_spacy_tokens: QN : Does Russia have a supply of chemical weapons ?


fn_spacy_tokens_for_baseline: Quite frankly I deeply resent you implying that I would be involved with a thug like that .

source_bert_toks: quite frankly i deeply res ##ent you implying that i would be involved with a thug like that .

reference_raw: To tell you the truth, I deeply hate it when you suggest that I'd be involved with such a criminal.

reference_spacy_tokens: To tell you the truth , I deeply hate it when you suggest that I 'd be involved with such a criminal .


fn_spacy_tokens_for_baseline: Being a costly enterprise and having many uses to the modern state , research has at the same time come under increased scrutiny from the paymaster .

source_bert_toks: being a costly enterprise and having many uses to the modern state , research has at the same time come under increased scrutiny from the pay ##master .

reference_raw: Since it is a costly business and has many uses for the modern state, research is also subject to increased control by the paymaster.

reference_spacy_tokens: Since it is a costly business and has many uses for the modern state , research is also subject to increased control by the paymaster .


fn_spacy_tokens_for_baseline: Lloyd George , in particular , was an unfailing source of repellent fascination to him .

source_bert_toks: lloyd george , in particular , was an un ##fa ##iling source of rep ##elle ##nt fascination to him .

reference_raw: In particular, Lloyd George was an unfailing source of repulsive fascination.

reference_spacy_tokens: In particular , Lloyd George was an unfailing source of repulsive fascination .


fn_spacy_tokens_for_baseline: A mortar round fell here but did n't explode , the man explains , pointing to the corner of his backyard where he buried the explosive .

source_bert_toks: a mortar round fell here but didn ' t explode , the man explains , pointing to the corner of his backyard where he buried the explosive .

reference_raw: There was a mortar round, but it didn't explode, the man explained, pointing to the corner of his garden where he had hidden the explosive.

reference_spacy_tokens: There was a mortar round , but it did n't explode , the man explained , pointing to the corner of his garden where he had hidden the explosive .


fn_spacy_tokens_for_baseline: The traders , who were alleged to have defrauded thousands of investors by manipulating share prices , were arrested after a three - year undercover investigation .

source_bert_toks: the traders , who were alleged to have def ##ra ##uded thousands of investors by manipulating share prices , were arrested after a three - year undercover investigation .

reference_raw: Traders, allegedly defrauding thousands of investors by manipulating stock prices, were arrested after a three-year undercover investigation.

reference_spacy_tokens: Traders , allegedly defrauding thousands of investors by manipulating stock prices , were arrested after a three - year undercover investigation .


fn_spacy_tokens_for_baseline: It was a potentially dangerous operation involving 15 armed police officers , 2 of which had tracked the car in the force helicopter .

source_bert_toks: it was a potentially dangerous operation involving 15 armed police officers , 2 of which had tracked the car in the force helicopter .

reference_raw: It was a potentially dangerous operation involving 15 armed police officers, two of whom had followed the vehicle in a force helicopter.

reference_spacy_tokens: It was a potentially dangerous operation involving 15 armed police officers , two of whom had followed the vehicle in a force helicopter .


fn_spacy_tokens_for_baseline: This is played over nine holes in a beautiful area surrounding a large lake .

source_bert_toks: this is played over nine holes in a beautiful area surrounding a large lake .

reference_raw: It's played over nine holes in a beautiful area around a big lake.

reference_spacy_tokens: It 's played over nine holes in a beautiful area around a big lake .


fn_spacy_tokens_for_baseline: The man , who has not been named , was treated at hospital for gas inhalation then questioned .

source_bert_toks: the man , who has not been named , was treated at hospital for gas in ##hala ##tion then questioned .

reference_raw: A man who wasn't named was treated for gas inhaling in the hospital, then questioned.

reference_spacy_tokens: A man who was n't named was treated for gas inhaling in the hospital , then questioned .


fn_spacy_tokens_for_baseline: The pleasures of driving our GTi are equalled only by the irritations .

source_bert_toks: the pleasures of driving our gt ##i are equal ##led only by the irritation ##s .

reference_raw: The pleasures of driving our GTI are only compensated by irritation.

reference_spacy_tokens: The pleasures of driving our GTI are only compensated by irritation .


fn_spacy_tokens_for_baseline: Taylor J. held first that the Home Secretary did not knowingly flout the criteria , and secondly that he did not act unreasonably in granting the warrant .

source_bert_toks: taylor j . held first that the home secretary did not knowing ##ly fl ##out the criteria , and secondly that he did not act un ##rea ##son ##ably in granting the warrant .

reference_raw: Taylor J. took the view, first, that the Minister of the Interior had not knowingly rejected the criteria and, second, that he had not acted unreasonablely in granting the order.

reference_spacy_tokens: Taylor J. took the view , first , that the Minister of the Interior had not knowingly rejected the criteria and , second , that he had not acted unreasonablely in granting the order .


fn_spacy_tokens_for_baseline: Defying an agreement with the EU , Turkey has refused to open up its ports to Greek Cypriot shipping because its Turkish Cypriot brethren are barred from trading with Europe and the rest of the world .

source_bert_toks: def ##ying an agreement with the eu , turkey has refused to open up its ports to greek cypriot shipping because its turkish cypriot brethren are barred from trading with europe and the rest of the world .

reference_raw: In the absence of an agreement with the EU, Turkey refused to open its ports to Greek Cypriot shipping because its Turkish Cypriot brothers were prevented from trading with Europe and the rest of the world.

reference_spacy_tokens: In the absence of an agreement with the EU , Turkey refused to open its ports to Greek Cypriot shipping because its Turkish Cypriot brothers were prevented from trading with Europe and the rest of the world .


fn_spacy_tokens_for_baseline: Howson 's engineering expertise was invaluable ; so was his recognition that the disabled faced demoralization as well as hardship unless they secured employment .

source_bert_toks: how ##son ' s engineering expertise was in ##val ##ua ##ble ; so was his recognition that the disabled faced demo ##ral ##ization as well as hardship unless they secured employment .

reference_raw: Howson's technical skills were invaluable; he also recognized that the disabled were facing demoralisation and hardship if they did not secure employment.

reference_spacy_tokens: Howson 's technical skills were invaluable ; he also recognized that the disabled were facing demoralisation and hardship if they did not secure employment .


fn_spacy_tokens_for_baseline: K : ' I am disappointed because although I bought a freezer there is only one power point in the kitchen so we ca n't use it -- an extension lead would be dangerous with Chloe toddling about .

source_bert_toks: k : ' i am disappointed because although i bought a freeze ##r there is only one power point in the kitchen so we can ' t use it - - an extension lead would be dangerous with chloe todd ##ling about .

reference_raw: K: 'I'm disappointed, because even though I bought a freezer, there's only one power point in the kitchen, so we can't use it - an extension lead would be dangerous if Chloe were tossing around.

reference_spacy_tokens: K : ' I 'm disappointed , because even though I bought a freezer , there 's only one power point in the kitchen , so we ca n't use it - an extension lead would be dangerous if Chloe were tossing around .


fn_spacy_tokens_for_baseline: I 'm going to wear the brown velvet trousers and the medallion .

source_bert_toks: i ' m going to wear the brown velvet trousers and the medallion .

reference_raw: I'll wear brown velvet pants and a locket.

reference_spacy_tokens: I 'll wear brown velvet pants and a locket .


fn_spacy_tokens_for_baseline: Castro has swallowed his doubts and hired Valenzuela as a cook in his small restaurant .

source_bert_toks: castro has swallowed his doubts and hired vale ##nz ##uel ##a as a cook in his small restaurant .

reference_raw: Castro swallowed his doubts and recruited Valenzuela to cook in his little restaurant.

reference_spacy_tokens: Castro swallowed his doubts and recruited Valenzuela to cook in his little restaurant .


fn_spacy_tokens_for_baseline: The gold background and coloured pictures glitter and glow in the subdued light which filters through the tiny round - headed windows and gives a sensation of unreality and fairy - like mysticism .

source_bert_toks: the gold background and coloured pictures glitter and glow in the subdued light which filters through the tiny round - headed windows and gives a sensation of un ##real ##ity and fairy - like mystic ##ism .

reference_raw: The golden background and the colored images gleam and shine in the dim light that filters through the small, round-headed windows and creates a sense of unreality and fairy-tale mysticism.

reference_spacy_tokens: The golden background and the colored images gleam and shine in the dim light that filters through the small , round - headed windows and creates a sense of unreality and fairy - tale mysticism .


fn_spacy_tokens_for_baseline: US officials confirmed that they have evidence that Iran intends to acquire nuclear weapons .

source_bert_toks: us officials confirmed that they have evidence that iran intends to acquire nuclear weapons .

reference_raw: American officials have confirmed that they have proof of Iran's intention to acquire nuclear weapons.

reference_spacy_tokens: American officials have confirmed that they have proof of Iran 's intention to acquire nuclear weapons .


fn_spacy_tokens_for_baseline: Your grandmother would not have any demurring at meals .

source_bert_toks: your grandmother would not have any dem ##ur ##ring at meals .

reference_raw: Your grandma wouldn't have any contempt for food.

reference_spacy_tokens: Your grandma would n't have any contempt for food .


fn_spacy_tokens_for_baseline: It was not possible to ascertain directly how many halogen moieties had ended up on the football .

source_bert_toks: it was not possible to as ##cer ##tain directly how many halo ##gen moi ##eti ##es had ended up on the football .

reference_raw: It was impossible to determine directly how many halogen moieties had ended up in football.

reference_spacy_tokens: It was impossible to determine directly how many halogen moieties had ended up in football .


fn_spacy_tokens_for_baseline: When Jesus was born in about 4 b.c . , Joseph and Mary escaped Herod 's paranoia by fleeing into Egypt with the new - born infant .

source_bert_toks: when jesus was born in about 4 b . c . , joseph and mary escaped hero ##d ' s paranoia by fleeing into egypt with the new - born infant .

reference_raw: When Jesus was born around 4:00 p.m., Joseph and Mary escaped from Herod's paranoia by escaping to Egypt with a new-born child.

reference_spacy_tokens: When Jesus was born around 4:00 p.m. , Joseph and Mary escaped from Herod 's paranoia by escaping to Egypt with a new - born child .


fn_spacy_tokens_for_baseline: To attempt any close analysis of the social contexts in which African primary schools operate is obviously to court unacceptable generalisations but two points may , nevertheless , be worth making .

source_bert_toks: to attempt any close analysis of the social contexts in which african primary schools operate is obviously to court unacceptable general ##isation ##s but two points may , nevertheless , be worth making .

reference_raw: It is clear that trying to analyse in detail the social context in which African primary schools operate is an unacceptable generalisation, but two points may still be worthwhile.

reference_spacy_tokens: It is clear that trying to analyse in detail the social context in which African primary schools operate is an unacceptable generalisation , but two points may still be worthwhile .


fn_spacy_tokens_for_baseline: It follows growing concern among members of Britain 's intelligence and security hierarchy that if a CBRN attack took place in the City of London it would devastate Britain 's economy and severely damage the economies of Europe and America . ( Telegraph .co.uk , 25Jun06 , Sean Rayment ) ( Link )

source_bert_toks: it follows growing concern among members of britain ' s intelligence and security hierarchy that if a cb ##rn attack took place in the city of london it would dev ##ast ##ate britain ' s economy and severely damage the economies of europe and america . ( telegraph . co . uk , 25 ##jun ##0 ##6 , sean ray ##ment ) ( link )

reference_raw: There is a growing concern among members of the British Intelligence and Safety hierarchy that if a CBRN attack were to take place in London, it would destroy the British economy and seriously harm the European and American economies (Telegraph .co.uk, 25 June 2006, Sean Rayment) (Link)

reference_spacy_tokens: There is a growing concern among members of the British Intelligence and Safety hierarchy that if a CBRN attack were to take place in London , it would destroy the British economy and seriously harm the European and American economies ( Telegraph .co.uk , 25 June 2006 , Sean Rayment ) ( Link )


fn_spacy_tokens_for_baseline: Push over those fried tomatoes , will you , James ? '

source_bert_toks: push over those fried tomatoes , will you , james ? '

reference_raw: Pass the fried tomatoes, will you, James?'

reference_spacy_tokens: Pass the fried tomatoes , will you , James ? '


fn_spacy_tokens_for_baseline: Even on the top one where Rachel showed us our chambers , the air was warmed by sweetened braziers and the atmosphere was comforting with gleaming wainscoting , coloured cloths , woollen carpets , carved chests and chairs .

source_bert_toks: even on the top one where rachel showed us our chambers , the air was warmed by sweet ##ened bra ##zier ##s and the atmosphere was comforting with gleaming wai ##ns ##cot ##ing , coloured cloth ##s , wool ##len carpets , carved chests and chairs .

reference_raw: Even at the top of the room, where Rachel had shown us our rooms, the air was warmed with sweetened braziers, and the atmosphere was comforted by glittering wainscots, colored fabrics, woolen carpets, carved chests, and chairs.

reference_spacy_tokens: Even at the top of the room , where Rachel had shown us our rooms , the air was warmed with sweetened braziers , and the atmosphere was comforted by glittering wainscots , colored fabrics , woolen carpets , carved chests , and chairs .


fn_spacy_tokens_for_baseline: He built power by playing off left against right , searching for compromises .

source_bert_toks: he built power by playing off left against right , searching for compromise ##s .

reference_raw: He created power by playing left-to-right, looking for compromises.

reference_spacy_tokens: He created power by playing left - to - right , looking for compromises .


fn_spacy_tokens_for_baseline: It irritated her to think that she had n't been doing anything reckless like running to catch a bus ; but she had a private theory that an old person did n't break a hip because she fell , but fell because her hip snapped , after gradual erosion .

source_bert_toks: it irritated her to think that she hadn ' t been doing anything reckless like running to catch a bus ; but she had a private theory that an old person didn ' t break a hip because she fell , but fell because her hip snapped , after gradual erosion .

reference_raw: She was annoyed at the thought that she had done nothing as reckless as running to catch a bus; but she had a private theory that the old man had not broken his hip because he had fallen, but that he had fallen because his hip had broken as he gradually eroded.

reference_spacy_tokens: She was annoyed at the thought that she had done nothing as reckless as running to catch a bus ; but she had a private theory that the old man had not broken his hip because he had fallen , but that he had fallen because his hip had broken as he gradually eroded .


fn_spacy_tokens_for_baseline: If there is any doubt about being able to prove this point successfully the prosecution should consider other offences .

source_bert_toks: if there is any doubt about being able to prove this point successfully the prosecution should consider other offences .

reference_raw: If it is doubtful that the prosecution will be able to prove this point successfully, the prosecution should consider other offences.

reference_spacy_tokens: If it is doubtful that the prosecution will be able to prove this point successfully , the prosecution should consider other offences .


fn_spacy_tokens_for_baseline: I 'm not asking for a few soothing words to calm my conscience ; if I can , I want to help .

source_bert_toks: i ' m not asking for a few soothing words to calm my conscience ; if i can , i want to help .

reference_raw: I don't want a few reassuring words to calm my conscience; if I can, I'd like to help you.

reference_spacy_tokens: I do n't want a few reassuring words to calm my conscience ; if I can , I 'd like to help you .


fn_spacy_tokens_for_baseline: It 's not clear how the custom started .

source_bert_toks: it ' s not clear how the custom started .

reference_raw: It's unclear how the habit began.

reference_spacy_tokens: It 's unclear how the habit began .


fn_spacy_tokens_for_baseline: Taczek took oft his spectacles and a gleam twinkled in his face .

source_bert_toks: ta ##cz ##ek took of ##t his spectacle ##s and a gleam twinkle ##d in his face .

reference_raw: Taczek took off his glasses and his face gleamed.

reference_spacy_tokens: Taczek took off his glasses and his face gleamed .


fn_spacy_tokens_for_baseline: He criticised the system which allowed Laing to use the full disclosure of police documents to change his story four times .

source_bert_toks: he criticised the system which allowed lai ##ng to use the full disclosure of police documents to change his story four times .

reference_raw: He criticized the system that allowed Laing to use full access to police documents to change his story four times.

reference_spacy_tokens: He criticized the system that allowed Laing to use full access to police documents to change his story four times .


fn_spacy_tokens_for_baseline: Giving impartial advice untainted by personal prejudices has always been the aim of the Citizens Advice Bureaux .

source_bert_toks: giving imp ##art ##ial advice un ##tain ##ted by personal prejudice ##s has always been the aim of the citizens advice bureau ##x .

reference_raw: The purpose of the Citizens' Advice Bureau has always been to provide neutral advice without prejudice to personal prejudice.

reference_spacy_tokens: The purpose of the Citizens ' Advice Bureau has always been to provide neutral advice without prejudice to personal prejudice .


fn_spacy_tokens_for_baseline: Tajikistan can manufacture uranium oxide but can not enrich it to levels needed for reactors or weapons .

source_bert_toks: tajikistan can manufacture uranium oxide but can not en ##rich it to levels needed for reactors or weapons .

reference_raw: Tajikistan is capable of producing uranium oxide but cannot enrich it to the levels necessary for reactors or weapons.

reference_spacy_tokens: Tajikistan is capable of producing uranium oxide but can not enrich it to the levels necessary for reactors or weapons .


fn_spacy_tokens_for_baseline: There is mini - golf , and if you fancy exploring further afield , there are bicycles for hire .

source_bert_toks: there is mini - golf , and if you fancy exploring further afi ##eld , there are bicycles for hire .

reference_raw: There's a mini golf, and if you want to explore another field, there's a bike to rent.

reference_spacy_tokens: There 's a mini golf , and if you want to explore another field , there 's a bike to rent .


fn_spacy_tokens_for_baseline: Whereas most of the Heralds readers were Labour supporters , only two - thirds of the Mirror 's were .

source_bert_toks: whereas most of the herald ##s readers were labour supporters , only two - thirds of the mirror ' s were .

reference_raw: While most Herald readers were Labour fans, only two-thirds of the Mirror were.

reference_spacy_tokens: While most Herald readers were Labour fans , only two - thirds of the Mirror were .


fn_spacy_tokens_for_baseline: This brings together all your favourite WWF merchandise so you can select and shop at your leisure -and find plenty of Christmas gift ideas into the bargain .

source_bert_toks: this brings together all your favourite wwf merchandise so you can select and shop at your leisure - and find plenty of christmas gift ideas into the bargain .

reference_raw: This brings together all your favorite WWF goods so that you can choose and buy whatever you want - and find a lot of Christmas present ideas in the deal.

reference_spacy_tokens: This brings together all your favorite WWF goods so that you can choose and buy whatever you want - and find a lot of Christmas present ideas in the deal .


fn_spacy_tokens_for_baseline: The 31-year - old duchess partly blamed her marriage break - up on Andrew 's work in the Navy .

source_bert_toks: the 31 - year - old duchess partly blamed her marriage break - up on andrew ' s work in the navy .

reference_raw: The 31-year-old duchess partly blamed her marriage breakup for Andrew's Navy job.

reference_spacy_tokens: The 31-year - old duchess partly blamed her marriage breakup for Andrew 's Navy job .


fn_spacy_tokens_for_baseline: She waved a hand towards another detached house at the bottom of the garden .

source_bert_toks: she waved a hand towards another detached house at the bottom of the garden .

reference_raw: She gestured to another separate house at the bottom of the garden.

reference_spacy_tokens: She gestured to another separate house at the bottom of the garden .


fn_spacy_tokens_for_baseline: They had provided me with a small team of assistants and advisers , and a more agreeable collection of people one could not have found .

source_bert_toks: they had provided me with a small team of assistants and advisers , and a more agree ##able collection of people one could not have found .

reference_raw: They gave me a small team of assistants and advisors, and a more pleasant collection of people I couldn't find.

reference_spacy_tokens: They gave me a small team of assistants and advisors , and a more pleasant collection of people I could n't find .


fn_spacy_tokens_for_baseline: But it is increasingly costly to fund the high - risk and long - term research required to develop pharmaceutical products .

source_bert_toks: but it is increasingly costly to fund the high - risk and long - term research required to develop pharmaceutical products .

reference_raw: However, funding the high-risk and long-term research needed for the development of pharmaceutical products is increasingly expensive.

reference_spacy_tokens: However , funding the high - risk and long - term research needed for the development of pharmaceutical products is increasingly expensive .


fn_spacy_tokens_for_baseline: The software recognises various dialects of SQL and is positioned as a data access tool rather than 4GL or executive information system ( EIS ) , although it combines elements of each .

source_bert_toks: the software recognise ##s various dialects of sql and is positioned as a data access tool rather than 4 ##gl or executive information system ( e ##is ) , although it combines elements of each .

reference_raw: The software recognizes different SQL dialects and is classified as a data access device rather than a 4GL or Executive Information System (EIS) but combines the elements of each.

reference_spacy_tokens: The software recognizes different SQL dialects and is classified as a data access device rather than a 4GL or Executive Information System ( EIS ) but combines the elements of each .


fn_spacy_tokens_for_baseline: However , the end of the golden age was drawing near .

source_bert_toks: however , the end of the golden age was drawing near .

reference_raw: But the golden age was coming to an end.

reference_spacy_tokens: But the golden age was coming to an end .


fn_spacy_tokens_for_baseline: A few of the males may then mimic the female 's odour .

source_bert_toks: a few of the males may then mimic the female ' s o ##dou ##r .

reference_raw: Several males can then mimic the female's scent.

reference_spacy_tokens: Several males can then mimic the female 's scent .


fn_spacy_tokens_for_baseline: Children , boys and girls , were loading small carts to be dragged along by old horses .

source_bert_toks: children , boys and girls , were loading small carts to be dragged along by old horses .

reference_raw: The children, the boys and the girls were loading small wagons for the old horses to haul.

reference_spacy_tokens: The children , the boys and the girls were loading small wagons for the old horses to haul .


fn_spacy_tokens_for_baseline: I may be able to institute discreet enquiries .

source_bert_toks: i may be able to institute discreet en ##qui ##ries .

reference_raw: I might be able to institute an unobtrusive investigation.

reference_spacy_tokens: I might be able to institute an unobtrusive investigation .


fn_spacy_tokens_for_baseline: His wife at the time turned down requests for interviews , and neighbors in Fairfax , Va. , said they did n't know much about him or his family .

source_bert_toks: his wife at the time turned down requests for interviews , and neighbors in fairfax , va . , said they didn ' t know much about him or his family .

reference_raw: His wife had refused interview requests at the time, and his neighbours in Fairfax, Va, had said that they knew little about him or his family.

reference_spacy_tokens: His wife had refused interview requests at the time , and his neighbours in Fairfax , Va , had said that they knew little about him or his family .


fn_spacy_tokens_for_baseline: You must tell me what you want to take .

source_bert_toks: you must tell me what you want to take .

reference_raw: I need you to tell me what you're taking.

reference_spacy_tokens: I need you to tell me what you 're taking .


fn_spacy_tokens_for_baseline: Here , a group of young Muslim girls in new mirror - work costumes were sitting cross - legged under the watchful eye of their father ; each one wore a tinsel hairband plaited into her pigtails .

source_bert_toks: here , a group of young muslim girls in new mirror - work costumes were sitting cross - legged under the watch ##ful eye of their father ; each one wore a tin ##sel hair ##band pl ##ai ##ted into her pig ##tails .

reference_raw: Here, a group of young Muslim girls in their new mirror costumes sat cross-legged under their father's watchful eyes, each of them wearing a tinsel of hair plaited in their tails.

reference_spacy_tokens: Here , a group of young Muslim girls in their new mirror costumes sat cross - legged under their father 's watchful eyes , each of them wearing a tinsel of hair plaited in their tails .


fn_spacy_tokens_for_baseline: There are now more adventurous ways of teaching and examining art and design , with greater emphasis on the educative value of the subject , particularly in developing critical and aesthetic judgements .

source_bert_toks: there are now more adventurous ways of teaching and examining art and design , with greater emphasis on the ed ##uca ##tive value of the subject , particularly in developing critical and aesthetic judgement ##s .

reference_raw: There are now more adventurous ways to teach and study art and design, with a greater focus on the educational value of the subject, in particular in the development of critical and aesthetic judgments.

reference_spacy_tokens: There are now more adventurous ways to teach and study art and design , with a greater focus on the educational value of the subject , in particular in the development of critical and aesthetic judgments .


fn_spacy_tokens_for_baseline: ' I was a skinhead before you were born , ' he would bellow , and only she knew how it hurt him .

source_bert_toks: ' i was a skin ##head before you were born , ' he would bell ##ow , and only she knew how it hurt him .

reference_raw: "Before you were born, I was a skinhead," he shouted, and only she knew how much it hurt him.

reference_spacy_tokens: " Before you were born , I was a skinhead , " he shouted , and only she knew how much it hurt him .


fn_spacy_tokens_for_baseline: ' Telford -- of course -- I 'd forgotten her sister 's married name is Telford .

source_bert_toks: ' tel ##ford - - of course - - i ' d forgotten her sister ' s married name is tel ##ford .

reference_raw: 'Telford - of course - I forgot her sister's wedding name was Telford.

reference_spacy_tokens: ' Telford - of course - I forgot her sister 's wedding name was Telford .


fn_spacy_tokens_for_baseline: A dresser holds a collection of old tins that once contained pills for headaches , stomach and liver ailments , concocted by Tim 's great - grandfather , a manufacturing chemist who set up in business in the 1880s .

source_bert_toks: a dresser holds a collection of old tin ##s that once contained pills for headache ##s , stomach and liver ai ##lm ##ents , con ##co ##cted by tim ' s great - grandfather , a manufacturing chemist who set up in business in the 1880s .

reference_raw: There's a collection of old cans in the closet that used to contain painkillers, stomach and liver disease, made up by Tim's great-grandfather, a manufacturing chemist who started his business in the 1880s.

reference_spacy_tokens: There 's a collection of old cans in the closet that used to contain painkillers , stomach and liver disease , made up by Tim 's great - grandfather , a manufacturing chemist who started his business in the 1880s .


fn_spacy_tokens_for_baseline: ' Congress derided President Truman 's domestic program , passed significant legislation over his veto and generally dismissed his hope of extending the Roosevelt New Deal into the Truman Fair Deal . '

source_bert_toks: ' congress der ##ided president truman ' s domestic program , passed significant legislation over his veto and generally dismissed his hope of extending the roosevelt new deal into the truman fair deal . '

reference_raw: Congress derailed President Truman's domestic program, passed a major law on his veto, and generally rejected his hopes of extending Roosevelt's new deal to the Truman Fair.

reference_spacy_tokens: Congress derailed President Truman 's domestic program , passed a major law on his veto , and generally rejected his hopes of extending Roosevelt 's new deal to the Truman Fair .


fn_spacy_tokens_for_baseline: Not so much a merciful touch , more likely a measure to prevent suddenly terror - stricken passengers from attempting to escape into the crowd .

source_bert_toks: not so much a mer ##ciful touch , more likely a measure to prevent suddenly terror - stricken passengers from attempting to escape into the crowd .

reference_raw: It was not so much a merciful touch, but rather a measure to prevent the sudden horror-stricken passengers from trying to escape into the crowd.

reference_spacy_tokens: It was not so much a merciful touch , but rather a measure to prevent the sudden horror - stricken passengers from trying to escape into the crowd .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multinational corporations and investments in the European Union mean that they have a lot of opportunities in their homes.

reference_spacy_tokens: And young graduates do n't leave now - multinational corporations and investments in the European Union mean that they have a lot of opportunities in their homes .


fn_spacy_tokens_for_baseline: Portugal 's resulting near - monopoly of East - West trade understandably awakened the competitive instincts of other European powers .

source_bert_toks: portugal ' s resulting near - monopoly of east - west trade understand ##ably awakened the competitive instincts of other european powers .

reference_raw: The result of Portugal's near-monopolis of the East-West Trade was understandably aroused by the competitive instincts of other European powers.

reference_spacy_tokens: The result of Portugal 's near - monopolis of the East - West Trade was understandably aroused by the competitive instincts of other European powers .


fn_spacy_tokens_for_baseline: Lunch consisted of garbure , a thick vegetable soup , followed by veal a la forestiere and pot - au - chocolat for dessert .

source_bert_toks: lunch consisted of ga ##rb ##ure , a thick vegetable soup , followed by ve ##al a la forest ##iere and pot - au - cho ##cola ##t for dessert .

reference_raw: The lunch consisted of a garbure, a thick vegetable broth, followed by a veal la forestiere and a pot-au-chocolat for dessert.

reference_spacy_tokens: The lunch consisted of a garbure , a thick vegetable broth , followed by a veal la forestiere and a pot - au - chocolat for dessert .


fn_spacy_tokens_for_baseline: He 's old , but he 's used to doing what he 's told .

source_bert_toks: he ' s old , but he ' s used to doing what he ' s told .

reference_raw: He's old, but he's used to doing what he's supposed to do.

reference_spacy_tokens: He 's old , but he 's used to doing what he 's supposed to do .