fn_spacy_tokens_for_baseline: Liquidise a large , raw carrot to a smooth paste , or boil or steam the carrot then mash it thoroughly .

source_bert_toks: liquid ##ise a large , raw carrot to a smooth paste , or boil or steam the carrot then mas ##h it thoroughly .

reference_raw: Liquidise a large raw carrot into a smooth paste, or boil or smoke the carrot and then wash it thoroughly.

reference_spacy_tokens: Liquidise a large raw carrot into a smooth paste , or boil or smoke the carrot and then wash it thoroughly .


fn_spacy_tokens_for_baseline: We were dead lucky to get to bed without a belting on a Sunday . '

source_bert_toks: we were dead lucky to get to bed without a belt ##ing on a sunday . '

reference_raw: We were fortunate enough to go to bed on a Sunday without a belt.'

reference_spacy_tokens: We were fortunate enough to go to bed on a Sunday without a belt . '


fn_spacy_tokens_for_baseline: If two strange males meet , they box and wrestle , emitting a succession of sounds at between 40 000 and 70 000 hertz , each lasting less than seven - hundredths of a second .

source_bert_toks: if two strange males meet , they box and wrestle , emi ##tting a succession of sounds at between 40 000 and 70 000 her ##tz , each lasting less than seven - hundred ##ths of a second .

reference_raw: When two strange men meet, they fight and fight, emitting a series of noises of between 40,000 and 70,000 hertz, each of which lasts less than seven hundredths of a second.

reference_spacy_tokens: When two strange men meet , they fight and fight , emitting a series of noises of between 40,000 and 70,000 hertz , each of which lasts less than seven hundredths of a second .


fn_spacy_tokens_for_baseline: When his hand was on the knob she said :

source_bert_toks: when his hand was on the knob she said :

reference_raw: When he touched the button, she said:

reference_spacy_tokens: When he touched the button , she said :


fn_spacy_tokens_for_baseline: If Bootsy had a chin , it was not much in evidence and Matthew could see two distinct pimples beside his nose .

source_bert_toks: if boots ##y had a chin , it was not much in evidence and matthew could see two distinct pi ##mple ##s beside his nose .

reference_raw: If Bootsy had a beard, there wasn't much evidence, and Matthew saw two distinct pimples next to his nose.

reference_spacy_tokens: If Bootsy had a beard , there was n't much evidence , and Matthew saw two distinct pimples next to his nose .


fn_spacy_tokens_for_baseline: Even music fans who have n't dirtied their hands in their lives adore Bruce Springsteen for being America 's earnest , sincere , blue - collar rock ' n ' roll conscience in a tatty , checked shirt .

source_bert_toks: even music fans who haven ' t dirt ##ied their hands in their lives ad ##ore bruce springsteen for being america ' s earnest , sincere , blue - collar rock ' n ' roll conscience in a ta ##tty , checked shirt .

reference_raw: Even music fans who haven't dirtyed their hands in their lives love Bruce Springsteen because he's America's serious, honest, blue-collar rock 'n' roll conscience in a tattoo, checked shirt.

reference_spacy_tokens: Even music fans who have n't dirtyed their hands in their lives love Bruce Springsteen because he 's America 's serious , honest , blue - collar rock ' n ' roll conscience in a tattoo , checked shirt .


fn_spacy_tokens_for_baseline: Peter , born into a working - class family in Edinburgh , had barely known his mother , who died when he was still a baby .

source_bert_toks: peter , born into a working - class family in edinburgh , had barely known his mother , who died when he was still a baby .

reference_raw: Peter, who had become a working-class family in Edinburgh, barely knew his mother, who had died when he was a child.

reference_spacy_tokens: Peter , who had become a working - class family in Edinburgh , barely knew his mother , who had died when he was a child .


fn_spacy_tokens_for_baseline: But schools often under - use the talents and energies of their teachers , or fail to develop them in any consistent and systematic way .

source_bert_toks: but schools often under - use the talents and energies of their teachers , or fail to develop them in any consistent and systematic way .

reference_raw: But schools often do not use their teachers' talents and power, or do not develop them in a consistent and systematic manner.

reference_spacy_tokens: But schools often do not use their teachers ' talents and power , or do not develop them in a consistent and systematic manner .


fn_spacy_tokens_for_baseline: And you can manufacture bucketfuls of this marvellous stuff from nothing more than kitchen waste .

source_bert_toks: and you can manufacture bucket ##ful ##s of this marvel ##lous stuff from nothing more than kitchen waste .

reference_raw: And you can make buckets of this amazing stuff out of nothing but kitchen waste.

reference_spacy_tokens: And you can make buckets of this amazing stuff out of nothing but kitchen waste .


fn_spacy_tokens_for_baseline: MAKING toys is child 's play for Courtaulds employee Ted Richards -- and he ensures a perfect finish by using paint from International .

source_bert_toks: making toys is child ' s play for court ##au ##ld ##s employee ted richards - - and he ensures a perfect finish by using paint from international .

reference_raw: Making toys is a kid's game for an employee of the courtaulds, Ted Richards - and he ensures a perfect finish through the use of international paint.

reference_spacy_tokens: Making toys is a kid 's game for an employee of the courtaulds , Ted Richards - and he ensures a perfect finish through the use of international paint .


fn_spacy_tokens_for_baseline: She dared to open her eyes again and found him still there , close to her .

source_bert_toks: she dared to open her eyes again and found him still there , close to her .

reference_raw: She ventured to open her eyes again and found him still there, near her.

reference_spacy_tokens: She ventured to open her eyes again and found him still there , near her .


fn_spacy_tokens_for_baseline: METHOD : To make bread , place yeast in a bowl with 150ml of water .

source_bert_toks: method : to make bread , place yeast in a bowl with 150 ##ml of water .

reference_raw: METHOD: Place the yeast in a bowl containing 150 ml of water for the manufacture of sandwiches.

reference_spacy_tokens: METHOD : Place the yeast in a bowl containing 150 ml of water for the manufacture of sandwiches .


fn_spacy_tokens_for_baseline: Report by German intelligence on Iranian efforts to acquire production equipment for tabun and sarin , using three Indian companies as fronts .

source_bert_toks: report by german intelligence on iranian efforts to acquire production equipment for tab ##un and sar ##in , using three indian companies as fronts .

reference_raw: A report from the German Intelligence on Iran's attempts to acquire production equipment for tabun and sarin, using three Indian corporations as fronts.

reference_spacy_tokens: A report from the German Intelligence on Iran 's attempts to acquire production equipment for tabun and sarin , using three Indian corporations as fronts .


fn_spacy_tokens_for_baseline: The division has the important task of defeating any enemy breakthrough into the British Corps area and is equipped with the Army 's latest equipment , including the Warrior Armoured Infantry Fighting Vehicle .

source_bert_toks: the division has the important task of defeating any enemy breakthrough into the british corps area and is equipped with the army ' s latest equipment , including the warrior armoured infantry fighting vehicle .

reference_raw: The division has an important task of defeating any enemy breach into the British Corps area, and it is equipped with the most recent military facilities, including a combat vehicle armed with infantry.

reference_spacy_tokens: The division has an important task of defeating any enemy breach into the British Corps area , and it is equipped with the most recent military facilities , including a combat vehicle armed with infantry .


fn_spacy_tokens_for_baseline: If you buy all the trips , then we 'll give you a great voucher pack which will save you £ £ £ 's in discos and clubs around the resort .

source_bert_toks: if you buy all the trips , then we ' ll give you a great vo ##ucher pack which will save you £ ##£ ##£ ' s in disco ##s and clubs around the resort .

reference_raw: If you buy all these trips, we'll give you a great package of vouchers that will save you £4,000 in discos and clubs around the resort.

reference_spacy_tokens: If you buy all these trips , we 'll give you a great package of vouchers that will save you £ 4,000 in discos and clubs around the resort .


fn_spacy_tokens_for_baseline: Hoomey felt a compulsion to babble on about what had happened , stimulated by their dice with the law , but Nails , now it was over , seemed unmoved .

source_bert_toks: ho ##ome ##y felt a compulsion to ba ##bble on about what had happened , stimulated by their dice with the law , but nails , now it was over , seemed un ##mo ##ved .

reference_raw: Hoomey felt the urge to talk about what had happened, motivated by their dice by the law, but the Nails, when it was over, did not seem to move.

reference_spacy_tokens: Hoomey felt the urge to talk about what had happened , motivated by their dice by the law , but the Nails , when it was over , did not seem to move .


fn_spacy_tokens_for_baseline: By the early 1970s , North Korean engineers were using indigenous technology to expand the IRT- 2000 research reactor and Pyongyang began to acquire plutonium reprocessing technology from the Soviet Union .

source_bert_toks: by the early 1970s , north korean engineers were using indigenous technology to expand the ir ##t - 2000 research reactor and p ##yon ##gy ##ang began to acquire pluto ##nium rep ##ro ##ces ##sing technology from the soviet union .

reference_raw: In the early 1970s, North Korean engineers used native technology to expand the IRT-2000 research reactor, and Pyongyang began to acquire plutonium processing technology from the Soviet Union.

reference_spacy_tokens: In the early 1970s , North Korean engineers used native technology to expand the IRT-2000 research reactor , and Pyongyang began to acquire plutonium processing technology from the Soviet Union .


fn_spacy_tokens_for_baseline: During the later stages of accretion , at the very least , the outer 100 km or so of the Moon melted , large areas being molten at the same time .

source_bert_toks: during the later stages of acc ##ret ##ion , at the very least , the outer 100 km or so of the moon melted , large areas being molten at the same time .

reference_raw: During the later stages of accretion, at least the outer 100 km of the moon dissolved and large areas dissolved at the same time.

reference_spacy_tokens: During the later stages of accretion , at least the outer 100 km of the moon dissolved and large areas dissolved at the same time .


fn_spacy_tokens_for_baseline: My little boy honestly prefers a bag of nuts or fruit , and is n't partial to anything sweet or sugary .

source_bert_toks: my little boy honestly prefers a bag of nuts or fruit , and isn ' t partial to anything sweet or sugar ##y .

reference_raw: My little boy really prefers a sack of nuts or fruit, and he's not partial to anything sweet or sweet.

reference_spacy_tokens: My little boy really prefers a sack of nuts or fruit , and he 's not partial to anything sweet or sweet .


fn_spacy_tokens_for_baseline: His comic - opera face contorted , his moustache drooped and he gripped his rifle with both hands to motion us to open the back of the vehicle .

source_bert_toks: his comic - opera face con ##tort ##ed , his mo ##ust ##ache dr ##ooped and he gripped his rifle with both hands to motion us to open the back of the vehicle .

reference_raw: His comic-opera face twisted, his mustache bent, and he gripped the gun with both hands and gestured for us to open the back of the car.

reference_spacy_tokens: His comic - opera face twisted , his mustache bent , and he gripped the gun with both hands and gestured for us to open the back of the car .


fn_spacy_tokens_for_baseline: Corbett relaxed , the thoroughfare was busy as carts , traders and farmers trudged home .

source_bert_toks: corbett relaxed , the thorough ##fare was busy as carts , traders and farmers tr ##udged home .

reference_raw: Corbett relaxed, and the thoroughfare was busy as wagons, merchants, and peasants crept home.

reference_spacy_tokens: Corbett relaxed , and the thoroughfare was busy as wagons , merchants , and peasants crept home .


fn_spacy_tokens_for_baseline: Mayor of Winglebury ( fict . ) , a shady attorney whose muddled intervention averts a duel between Alexander Trott and Horace Hunter , but causes the former to be treated as a lunatic .

source_bert_toks: mayor of wing ##le ##bury ( fi ##ct . ) , a shady attorney whose mud ##dled intervention ave ##rts a duel between alexander tr ##ott and horace hunter , but causes the former to be treated as a lunatic .

reference_raw: The mayor of Winglebury (Fict), a shady lawyer whose muddled intervention averts a fight between Alexander Trott and Horace Hunter, but leads him to be treated like a madman.

reference_spacy_tokens: The mayor of Winglebury ( Fict ) , a shady lawyer whose muddled intervention averts a fight between Alexander Trott and Horace Hunter , but leads him to be treated like a madman .


fn_spacy_tokens_for_baseline: Above the scoop neckline of her peacock blue dress , an ill - defined rash of mottled pink broke out , then faded .

source_bert_toks: above the scoop neck ##line of her peacock blue dress , an ill - defined rash of mo ##ttle ##d pink broke out , then faded .

reference_raw: Over the neckline of her peacock-blue dress, an ill-defined rasp of mottled pink broke out, then faded.

reference_spacy_tokens: Over the neckline of her peacock - blue dress , an ill - defined rasp of mottled pink broke out , then faded .


fn_spacy_tokens_for_baseline: ' It seems terrible now , David , to think that you 've taken the blame for so long for something you did n't do .

source_bert_toks: ' it seems terrible now , david , to think that you ' ve taken the blame for so long for something you didn ' t do .

reference_raw: 'Now, David, it seems terrible to think you've been responsible for something you haven't done for so long.

reference_spacy_tokens: ' Now , David , it seems terrible to think you 've been responsible for something you have n't done for so long .


fn_spacy_tokens_for_baseline: Santorini ( Thira ) , the next major island north , was heavily influenced by Crete , and the settlements of Thira and Akrotiri thrived at this time .

source_bert_toks: santo ##rini ( th ##ira ) , the next major island north , was heavily influenced by crete , and the settlements of th ##ira and ak ##rot ##iri thrive ##d at this time .

reference_raw: Santorini (Thira), another large island to the north, was heavily influenced by Crete, and the settlements of Thira and Akrotiri were now prosperous.

reference_spacy_tokens: Santorini ( Thira ) , another large island to the north , was heavily influenced by Crete , and the settlements of Thira and Akrotiri were now prosperous .


fn_spacy_tokens_for_baseline: But even he needs help , for it is not easy to grab an insect or pluck a dangling fruit if you have a couple of half - grown babies on your back .

source_bert_toks: but even he needs help , for it is not easy to grab an insect or pl ##uck a dangling fruit if you have a couple of half - grown babies on your back .

reference_raw: But he needs help, too, because it's not easy to grab an insect or pluck a dangling fruit when you've got two half-grown kids on your back.

reference_spacy_tokens: But he needs help , too , because it 's not easy to grab an insect or pluck a dangling fruit when you 've got two half - grown kids on your back .


fn_spacy_tokens_for_baseline: As the fire lights the JPT rises and a hum of gradually increasing pitch and volume begins to pervade the area .

source_bert_toks: as the fire lights the jp ##t rises and a hum of gradually increasing pitch and volume begins to per ##va ##de the area .

reference_raw: As the fire ignites, the JPT rises, and a growl of pitch and volume begins to pervade the area.

reference_spacy_tokens: As the fire ignites , the JPT rises , and a growl of pitch and volume begins to pervade the area .


fn_spacy_tokens_for_baseline: I got dressed and they got slightly worse .

source_bert_toks: i got dressed and they got slightly worse .

reference_raw: I put on my clothes, and they got a little worse.

reference_spacy_tokens: I put on my clothes , and they got a little worse .


fn_spacy_tokens_for_baseline: Most Chicanos heard of her as children , read about her in literature , or learned of her from friends .

source_bert_toks: most chi ##cano ##s heard of her as children , read about her in literature , or learned of her from friends .

reference_raw: Most of the Chicanos had heard about her when she was a child, had seen her in literature, or had learned about her from friends.

reference_spacy_tokens: Most of the Chicanos had heard about her when she was a child , had seen her in literature , or had learned about her from friends .


fn_spacy_tokens_for_baseline: The individual responsible for this unacceptable behaviour shall remain nameless protect his listening and viewing ratings suffice it to say that his name suggests that he is capable of making a big splash .

source_bert_toks: the individual responsible for this unacceptable behaviour shall remain name ##less protect his listening and viewing ratings su ##ffi ##ce it to say that his name suggests that he is capable of making a big splash .

reference_raw: The person responsible for such unacceptable behaviour shall continue to protect his listening and viewing ratings without a name sufficient to indicate that his name indicates that he is capable of making a large splash.

reference_spacy_tokens: The person responsible for such unacceptable behaviour shall continue to protect his listening and viewing ratings without a name sufficient to indicate that his name indicates that he is capable of making a large splash .


fn_spacy_tokens_for_baseline: POLICE are today investigating a claim that a man was beaten unconscious and set alight by a gang of six or seven .

source_bert_toks: police are today investigating a claim that a man was beaten unconscious and set ali ##ght by a gang of six or seven .

reference_raw: Police are now investigating allegations that a man has been knocked unconscious and set on fire by a gang of six or seven.

reference_spacy_tokens: Police are now investigating allegations that a man has been knocked unconscious and set on fire by a gang of six or seven .


fn_spacy_tokens_for_baseline: The identities of the five U. S. military personnel killed in the massive blast in Kabul had not been released , but it is possible that at least one of the victims was a high - ranking officer .

source_bert_toks: the identities of the five u . s . military personnel killed in the massive blast in kabul had not been released , but it is possible that at least one of the victims was a high - ranking officer .

reference_raw: The identity of the five U.S. military personnel killed in a massive explosion in Kabul has not been released, but it's possible that at least one of the victims was a senior officer.

reference_spacy_tokens: The identity of the five U.S. military personnel killed in a massive explosion in Kabul has not been released , but it 's possible that at least one of the victims was a senior officer .


fn_spacy_tokens_for_baseline: The cuckoo 's zygodactyl toes , with two pointing forwards and two pointing back .

source_bert_toks: the cuckoo ' s z ##y ##go ##da ##ct ##yl toes , with two pointing forwards and two pointing back .

reference_raw: The zygodactyl tips of the cuckoo, two pointing forward and two pointing back.

reference_spacy_tokens: The zygodactyl tips of the cuckoo , two pointing forward and two pointing back .


fn_spacy_tokens_for_baseline: I 've g - I 've got pen and paper .

source_bert_toks: i ' ve g - i ' ve got pen and paper .

reference_raw: I have a pen and paper.

reference_spacy_tokens: I have a pen and paper .


fn_spacy_tokens_for_baseline: In a week of feverish detective work , he amassed a dossier on the publishing arrangements of Sting 's manager , Miles Copeland .

source_bert_toks: in a week of fever ##ish detective work , he amassed a dos ##sier on the publishing arrangements of sting ' s manager , miles copeland .

reference_raw: In a week of frantic detective work, he collected a file on Sting's manager, Miles Copeland.

reference_spacy_tokens: In a week of frantic detective work , he collected a file on Sting 's manager , Miles Copeland .


fn_spacy_tokens_for_baseline: Lt . Col . Pete Johnson of the Army 's 82nd Airborne Division told of a well - coordinated ambush , saying it culminated in an angry mob descending on the scene as a sole survivor managed to slip away .

source_bert_toks: lt . col . pete johnson of the army ' s 82 ##nd airborne division told of a well - coordinated ambush , saying it culminated in an angry mob descending on the scene as a sole survivor managed to slip away .

reference_raw: Lieutenant Colonel Pete Johnson of the 82nd Airborne Division of the Army told of a well-coordinated raid, claiming to have culminated in an angry crowd descending on the scene as the only survivor managed to escape.

reference_spacy_tokens: Lieutenant Colonel Pete Johnson of the 82nd Airborne Division of the Army told of a well - coordinated raid , claiming to have culminated in an angry crowd descending on the scene as the only survivor managed to escape .


fn_spacy_tokens_for_baseline: She had carefully thought out what she was going to say , but when , in the firelight , she looked into his dark - fringed eyes , she forgot her rehearsed words .

source_bert_toks: she had carefully thought out what she was going to say , but when , in the fire ##light , she looked into his dark - fringe ##d eyes , she forgot her re ##hear ##sed words .

reference_raw: She thought carefully what she was going to say, but when she looked into his dark-fringed eyes in the firelight, she forgot her practiced words.

reference_spacy_tokens: She thought carefully what she was going to say , but when she looked into his dark - fringed eyes in the firelight , she forgot her practiced words .


fn_spacy_tokens_for_baseline: Yet we did detect an easing off in harassment of Republicans and of itinerants .

source_bert_toks: yet we did detect an easing off in harassment of republicans and of it ##iner ##ants .

reference_raw: But we found a release in the harassment of Republicans and itinerants.

reference_spacy_tokens: But we found a release in the harassment of Republicans and itinerants .


fn_spacy_tokens_for_baseline: In the Supreme Court 's ruling , the normally conservative Sandra Day O'Connor , the only female justice , voted with the liberal minority ; the decisive vote proved to be that of David Souter , Bush 's only appointee to the Court , whom abortion rights advocates had long suspected of harbouring anti - abortionist views .

source_bert_toks: in the supreme court ' s ruling , the normally conservative sandra day o ' connor , the only female justice , voted with the liberal minority ; the decisive vote proved to be that of david so ##uter , bush ' s only appoint ##ee to the court , whom abortion rights advocates had long suspected of harbour ##ing anti - abortion ##ist views .

reference_raw: In the judgment of the Supreme Court, the normally conservative Sandra Day O'Connor, the only female justice, voted with a liberal minority; the decisive vote turned out to be David Souter, Bush's only judge, who had long suspected abortion rights advocates of harboring anti-abortionist opinions.

reference_spacy_tokens: In the judgment of the Supreme Court , the normally conservative Sandra Day O'Connor , the only female justice , voted with a liberal minority ; the decisive vote turned out to be David Souter , Bush 's only judge , who had long suspected abortion rights advocates of harboring anti - abortionist opinions .


fn_spacy_tokens_for_baseline: The InsP 3 released into the cytoplasm mobilizes calcium from internal stores , whereas DAG activates protein kinase C ( ref . 8) .

source_bert_toks: the ins ##p 3 released into the cy ##top ##las ##m mob ##ili ##zes calcium from internal stores , whereas da ##g activate ##s protein kinase c ( ref . 8 ) .

reference_raw: InsP 3 released into the cytoplasm mobilizes calcium from internal storage, while DAG initiates protein kinase C (see paragraph 8).

reference_spacy_tokens: InsP 3 released into the cytoplasm mobilizes calcium from internal storage , while DAG initiates protein kinase C ( see paragraph 8) .


fn_spacy_tokens_for_baseline: What galled local Tories , wrote the Nappy Happy Househusband , was that ' Labour 's blueprint for the town centre is proving so popular with shoppers and traders ' .

source_bert_toks: what gall ##ed local tori ##es , wrote the nap ##py happy house ##hus ##band , was that ' labour ' s blue ##print for the town centre is proving so popular with shop ##pers and traders ' .

reference_raw: What galvanized the local Tories and wrote the Nappy Happy Husband was that Labour's plan for the city center turned out to be so popular with shoppers and merchants.

reference_spacy_tokens: What galvanized the local Tories and wrote the Nappy Happy Husband was that Labour 's plan for the city center turned out to be so popular with shoppers and merchants .


fn_spacy_tokens_for_baseline: She 'd seized her friend excitedly by the arm .

source_bert_toks: she ' d seized her friend excitedly by the arm .

reference_raw: She grabbed her friend's arm excitedly.

reference_spacy_tokens: She grabbed her friend 's arm excitedly .


fn_spacy_tokens_for_baseline: The overnight explosion not only destroyed the chapel but also sparked a security alert in Dartmouth , Devon .

source_bert_toks: the overnight explosion not only destroyed the chapel but also sparked a security alert in dartmouth , devon .

reference_raw: The night explosion not only destroyed the church, but also triggered a security alarm in Dartmouth, Devon.

reference_spacy_tokens: The night explosion not only destroyed the church , but also triggered a security alarm in Dartmouth , Devon .


fn_spacy_tokens_for_baseline: Having detected all three proteins immunohistochemically in normal , benign and malignant breast epithelia , the quantitation of OPN , TSP-1 and TYRP-1 mRNA was achieved using LCM and qPCR .

source_bert_toks: having detected all three proteins im ##mun ##oh ##isto ##chemical ##ly in normal , benign and mali ##gnant breast ep ##ith ##elia , the quan ##ti ##tation of op ##n , ts ##p - 1 and ty ##rp - 1 mrna was achieved using lc ##m and q ##pc ##r .

reference_raw: The quantification of OPN, TSP-1 and TYRP-1 mRNA with LCM and qPCR was achieved after detection of all three proteins immunohistochemically in common, benign and malignant breast epithelia.

reference_spacy_tokens: The quantification of OPN , TSP-1 and TYRP-1 mRNA with LCM and qPCR was achieved after detection of all three proteins immunohistochemically in common , benign and malignant breast epithelia .


fn_spacy_tokens_for_baseline: I 'm so stupid that I started doing cocaine to try to understand him -- to get close to him and understand where he was coming from .

source_bert_toks: i ' m so stupid that i started doing cocaine to try to understand him - - to get close to him and understand where he was coming from .

reference_raw: I'm so dumb, I started making cocaine to try to understand him, to get close to him, to understand where he came from.

reference_spacy_tokens: I 'm so dumb , I started making cocaine to try to understand him , to get close to him , to understand where he came from .


fn_spacy_tokens_for_baseline: It was a struggle for bites in the Leeds Shimano Open on the Aire at Leeds where anglers had to dodge floating ice .

source_bert_toks: it was a struggle for bites in the leeds shi ##man ##o open on the air ##e at leeds where angle ##rs had to dodge floating ice .

reference_raw: It was a fight for bites at the Leeds Shimano Open in Leeds, where the anglers had to avoid the floating ice.

reference_spacy_tokens: It was a fight for bites at the Leeds Shimano Open in Leeds , where the anglers had to avoid the floating ice .


fn_spacy_tokens_for_baseline: For it will permit peaceful civilian use of nuclear power while avoiding the threat of proliferation and the possibility that terrorists might acquire a nuclear weapon or it might proliferate to some other irresponsible party and then endanger America or its allies .

source_bert_toks: for it will permit peaceful civilian use of nuclear power while avoiding the threat of proliferation and the possibility that terrorists might acquire a nuclear weapon or it might pro ##life ##rate to some other ir ##res ##pon ##sible party and then end ##anger america or its allies .

reference_raw: For it will allow peaceful civilian use of nuclear energy, while avoiding the threat of proliferation and the possibility that terrorists may acquire a nuclear weapon or proliferate to another irresponsible party, thereby jeopardising America or its allies.

reference_spacy_tokens: For it will allow peaceful civilian use of nuclear energy , while avoiding the threat of proliferation and the possibility that terrorists may acquire a nuclear weapon or proliferate to another irresponsible party , thereby jeopardising America or its allies .


fn_spacy_tokens_for_baseline: This letter is a direct breach of both the Government 's election manifesto promises and shows that the public are being misled .

source_bert_toks: this letter is a direct breach of both the government ' s election manifesto promises and shows that the public are being mis ##led .

reference_raw: This letter is a direct violation of the government's electoral manifesto promises and shows that the public has been misled.

reference_spacy_tokens: This letter is a direct violation of the government 's electoral manifesto promises and shows that the public has been misled .


fn_spacy_tokens_for_baseline: One of the crew spotted Ed 's body wedged inside a crevasse .

source_bert_toks: one of the crew spotted ed ' s body wedge ##d inside a cr ##eva ##sse .

reference_raw: One of the crew saw Ed's body wedged in a crack.

reference_spacy_tokens: One of the crew saw Ed 's body wedged in a crack .


fn_spacy_tokens_for_baseline: Henry kept banging into the wooden props that held up the mill floor ; it was like being in a coal - mine .

source_bert_toks: henry kept banging into the wooden props that held up the mill floor ; it was like being in a coal - mine .

reference_raw: Henry kept pounding on the wooden props that held the floor of the mill; it was like being in a coal mine.

reference_spacy_tokens: Henry kept pounding on the wooden props that held the floor of the mill ; it was like being in a coal mine .


fn_spacy_tokens_for_baseline: Iyad Sawalha , the target of an intensive Israeli manhunt in recent weeks , was tracked down to a cinderblock house at the edge of the maze - like casbah in the West Bank city of Jenin .

source_bert_toks: i ##yad saw ##al ##ha , the target of an intensive israeli man ##hun ##t in recent weeks , was tracked down to a cinder ##block house at the edge of the maze - like cas ##bah in the west bank city of jen ##in .

reference_raw: Iyad Sawalha, the target of an intense Israeli chase over the past few weeks, has been tracked to a cinder block house on the edge of a mazed casbah in Jenin's West Bank city.

reference_spacy_tokens: Iyad Sawalha , the target of an intense Israeli chase over the past few weeks , has been tracked to a cinder block house on the edge of a mazed casbah in Jenin 's West Bank city .


fn_spacy_tokens_for_baseline: Many people need our help .

source_bert_toks: many people need our help .

reference_raw: A lot of people want our help.

reference_spacy_tokens: A lot of people want our help .


fn_spacy_tokens_for_baseline: But there was no immediate fear of food shortage since two - month supplies are always stockpiled in the peninsula , said the officials who spoke on condition of anonymity .

source_bert_toks: but there was no immediate fear of food shortage since two - month supplies are always stock ##pile ##d in the peninsula , said the officials who spoke on condition of an ##ony ##mity .

reference_raw: But there was no immediate fear of food shortage, for the peninsula is always stocked for two months, said officials who spoke anonymously.

reference_spacy_tokens: But there was no immediate fear of food shortage , for the peninsula is always stocked for two months , said officials who spoke anonymously .


fn_spacy_tokens_for_baseline: The thump and fumes of the freezer plant 's heavy diesel generator were the only unwelcome intrusion .

source_bert_toks: the thump and fu ##mes of the freeze ##r plant ' s heavy diesel generator were the only un ##we ##lco ##me intrusion .

reference_raw: The only unwelcome intrusion was the crash and fumes of the heavy diesel generator in the freezer.

reference_spacy_tokens: The only unwelcome intrusion was the crash and fumes of the heavy diesel generator in the freezer .


fn_spacy_tokens_for_baseline: They felt that clear national guide - lines would perhaps help .

source_bert_toks: they felt that clear national guide - lines would perhaps help .

reference_raw: They thought clear national guidelines might help.

reference_spacy_tokens: They thought clear national guidelines might help .


fn_spacy_tokens_for_baseline: Only rarely does the leer of insincerity glow through the mask .

source_bert_toks: only rarely does the lee ##r of ins ##in ##cer ##ity glow through the mask .

reference_raw: The leer of insincerity rarely shines through the mask.

reference_spacy_tokens: The leer of insincerity rarely shines through the mask .


fn_spacy_tokens_for_baseline: In a sort of dream I remember being half - led , halfcarried to the carriage ; in the same state I was conveyed to the train .

source_bert_toks: in a sort of dream i remember being half - led , half ##car ##ried to the carriage ; in the same state i was conveyed to the train .

reference_raw: I remember in a dream that I was half-led, half-carried to a carriage; in the same condition I was taken to a train.

reference_spacy_tokens: I remember in a dream that I was half - led , half - carried to a carriage ; in the same condition I was taken to a train .


fn_spacy_tokens_for_baseline: The 1990s saw the rise of right - wing terrorism , including neo - Nazis and neo - Fascists in Europe and white supremacists and anti - government ( " Patriot " ) organizations in the United States .

source_bert_toks: the 1990s saw the rise of right - wing terrorism , including neo - nazis and neo - fascist ##s in europe and white su ##pre ##mac ##ists and anti - government ( " patriot " ) organizations in the united states .

reference_raw: The 1990s saw the rise of right-wing terrorism, among which neo-Nazis and neo-fascists in Europe, white supremacists and anti-Government ( Patriot) organizations in the United States.

reference_spacy_tokens: The 1990s saw the rise of right - wing terrorism , among which neo - Nazis and neo - fascists in Europe , white supremacists and anti - Government ( Patriot ) organizations in the United States .


fn_spacy_tokens_for_baseline: As the century progressed the tribunal network mushroomed , with an exponential growth rate most conveniently tracked in the successive editions of Robson 's book .

source_bert_toks: as the century progressed the tribunal network mushroom ##ed , with an exponential growth rate most convenient ##ly tracked in the successive editions of robson ' s book .

reference_raw: As the century progressed, the court network sponged, and the exponential growth rate was most conveniently monitored in the subsequent editions of Robson's book.

reference_spacy_tokens: As the century progressed , the court network sponged , and the exponential growth rate was most conveniently monitored in the subsequent editions of Robson 's book .


fn_spacy_tokens_for_baseline: The concession that the proposed Independent Television Commission can reject the highest bid in ' exceptional circumstances ' is seen as a recipe for protracted court challenges .

source_bert_toks: the concession that the proposed independent television commission can reject the highest bid in ' exceptional circumstances ' is seen as a recipe for pro ##tracted court challenges .

reference_raw: The fact that the proposed independent television committee may reject the highest bid in "extraordinary circumstances" is considered to be a recipe for long-term legal disputes.

reference_spacy_tokens: The fact that the proposed independent television committee may reject the highest bid in " extraordinary circumstances " is considered to be a recipe for long - term legal disputes .


fn_spacy_tokens_for_baseline: Iraq clears visit by Ohio official By Scott Montgomery

source_bert_toks: iraq clears visit by ohio official by scott montgomery

reference_raw: Iraq clears the visit of the Ohio clerk by Scott Montgomery


fn_spacy_tokens_for_baseline: Did anyone else get a copy of the mail order catalogue accompanied by a nice letter this morning , or was I specially chosen for the honour ?

source_bert_toks: did anyone else get a copy of the mail order catalogue accompanied by a nice letter this morning , or was i specially chosen for the honour ?

reference_raw: Did anyone else receive a copy of the mail order catalogue that was accompanied by a fine letter this morning, or was I specifically selected for honor?

reference_spacy_tokens: Did anyone else receive a copy of the mail order catalogue that was accompanied by a fine letter this morning , or was I specifically selected for honor ?


fn_spacy_tokens_for_baseline: Her throat stung with dryness .

source_bert_toks: her throat stung with dry ##ness .

reference_raw: Her throat throbbed with dryness.

reference_spacy_tokens: Her throat throbbed with dryness .


fn_spacy_tokens_for_baseline: By keeping the tidal mudflats , the conservationists argue , the development will be both more imaginative and environmentally sound .

source_bert_toks: by keeping the tidal mud ##fl ##ats , the conservation ##ists argue , the development will be both more imaginative and environmentally sound .

reference_raw: Protectors argue that if we keep the tidal mud flats, the development will be both more resourceful and environmentally sound.

reference_spacy_tokens: Protectors argue that if we keep the tidal mud flats , the development will be both more resourceful and environmentally sound .


fn_spacy_tokens_for_baseline: Besides the commitment in Korea , the United States made a firm treaty with Japan in 1951 to ensure that she remained in the Western camp .

source_bert_toks: besides the commitment in korea , the united states made a firm treaty with japan in 1951 to ensure that she remained in the western camp .

reference_raw: In addition to its commitment to Korea, the United States made a firm agreement with Japan in 1951 to keep it in the West Camp.

reference_spacy_tokens: In addition to its commitment to Korea , the United States made a firm agreement with Japan in 1951 to keep it in the West Camp .


fn_spacy_tokens_for_baseline: Early the following morning we loaded our equipment aboard , and left that ghostly cluster of space arcs embracing the reddened circle of standing stones .

source_bert_toks: early the following morning we loaded our equipment aboard , and left that ghostly cluster of space arcs embracing the red ##dened circle of standing stones .

reference_raw: The next morning we picked up our gear on board and left the ghostly cluster of space arcs surrounding the reddened circle of standing stones.

reference_spacy_tokens: The next morning we picked up our gear on board and left the ghostly cluster of space arcs surrounding the reddened circle of standing stones .


fn_spacy_tokens_for_baseline: She was a schoolteacher at the village school and has written a book about Scorton called , I think , ' Straws in the Wind ' .

source_bert_toks: she was a school ##teacher at the village school and has written a book about sc ##ort ##on called , i think , ' straw ##s in the wind ' .

reference_raw: She was a village school teacher, and she wrote a book about Scorton called, I think, "Straws in the Wind."

reference_spacy_tokens: She was a village school teacher , and she wrote a book about Scorton called , I think , " Straws in the Wind . "


fn_spacy_tokens_for_baseline: Four hundred years ago these crops brought British colonists to rule the land and African slaves to work it .

source_bert_toks: four hundred years ago these crops brought british colonists to rule the land and african slaves to work it .

reference_raw: Four hundred years earlier, these crops brought British colonists to rule the country and African slaves to work on it.

reference_spacy_tokens: Four hundred years earlier , these crops brought British colonists to rule the country and African slaves to work on it .


fn_spacy_tokens_for_baseline: Like the Ark , they hope they 'll succeed in providing a safe temporary refuge for abuse victims .

source_bert_toks: like the ark , they hope they ' ll succeed in providing a safe temporary refuge for abuse victims .

reference_raw: Like the Ark, they hope to be able to provide a safe temporary refuge for the victims of abuse.

reference_spacy_tokens: Like the Ark , they hope to be able to provide a safe temporary refuge for the victims of abuse .


fn_spacy_tokens_for_baseline: So , similarly , in the First World War , we assumed proudly as an accolade of honour the Kaiser 's ridicule of the first British Expeditionary Force as that ' contemptible little army ' .

source_bert_toks: so , similarly , in the first world war , we assumed proudly as an acc ##ola ##de of honour the kaiser ' s rid ##ic ##ule of the first british expeditionary force as that ' contempt ##ible little army ' .

reference_raw: And so, in the First World War, we proudly assumed that the Emperor's mockery of the First British Expeditionary Force was an accolade of honor.

reference_spacy_tokens: And so , in the First World War , we proudly assumed that the Emperor 's mockery of the First British Expeditionary Force was an accolade of honor .


fn_spacy_tokens_for_baseline: He was very fond of Anna , though she often maddened him .

source_bert_toks: he was very fond of anna , though she often madden ##ed him .

reference_raw: He loved Anna very much, though she often made him mad.

reference_spacy_tokens: He loved Anna very much , though she often made him mad .


fn_spacy_tokens_for_baseline: A smile of real pleasure spread over his mean face as he caught sight of her .

source_bert_toks: a smile of real pleasure spread over his mean face as he caught sight of her .

reference_raw: When he saw her, a smile of genuine pleasure spread across his evil face.

reference_spacy_tokens: When he saw her , a smile of genuine pleasure spread across his evil face .


fn_spacy_tokens_for_baseline: Such nurses need to benefit from an individual appraisal and assessment of their experience and skills so that re - entry becomes a natural progression for them rather than a hurdle to be jumped .

source_bert_toks: such nurses need to benefit from an individual app ##rai ##sal and assessment of their experience and skills so that re - entry becomes a natural progression for them rather than a hurdle to be jumped .

reference_raw: Such nurses must benefit from individual evaluation and evaluation of their experience and skills in order to make re-entry a natural progression for them rather than a hindrance to jumping.

reference_spacy_tokens: Such nurses must benefit from individual evaluation and evaluation of their experience and skills in order to make re - entry a natural progression for them rather than a hindrance to jumping .


fn_spacy_tokens_for_baseline: By January 1946 de Gaulle had been brought face to face with the reality that a basic incompatibility of outlook and temperament existed between himself and the members of the assembly .

source_bert_toks: by january 1946 de gaulle had been brought face to face with the reality that a basic inc ##omp ##ati ##bility of outlook and temperament existed between himself and the members of the assembly .

reference_raw: In January 1946 de Gaulle was confronted with the fact that he and the members of the Assembly were fundamentally incompatible with the outlook and temperament.

reference_spacy_tokens: In January 1946 de Gaulle was confronted with the fact that he and the members of the Assembly were fundamentally incompatible with the outlook and temperament .


fn_spacy_tokens_for_baseline: From the outset of a transformational - change effort , information must flow freely between and among the different parts of the organization .

source_bert_toks: from the outset of a transformation ##al - change effort , information must flow freely between and among the different parts of the organization .

reference_raw: From the beginning of the transformational change effort, information must flow freely between and between different parts of the organisation.

reference_spacy_tokens: From the beginning of the transformational change effort , information must flow freely between and between different parts of the organisation .


fn_spacy_tokens_for_baseline: He tends to mention antecedent events after subsequent ones , and causes after effects .

source_bert_toks: he tends to mention ant ##ece ##dent events after subsequent ones , and causes after effects .

reference_raw: It tends to refer to the precipitous events after the subsequent events, and causes them after the event.

reference_spacy_tokens: It tends to refer to the precipitous events after the subsequent events , and causes them after the event .


fn_spacy_tokens_for_baseline: Other party leaders who had not been privy to the ' election ' advised Sonia against accepting the post .

source_bert_toks: other party leaders who had not been privy to the ' election ' advised sonia against accepting the post .

reference_raw: Other party leaders who were not privy to the election recommended Sonia not to accept the post.

reference_spacy_tokens: Other party leaders who were not privy to the election recommended Sonia not to accept the post .


fn_spacy_tokens_for_baseline: Tens of thousands of East Berliners streamed to the West , unhindered for the first time since the Wall was put up 28 years ago .

source_bert_toks: tens of thousands of east berlin ##ers streamed to the west , un ##hin ##der ##ed for the first time since the wall was put up 28 years ago .

reference_raw: Tens of thousands of East Berliners had flown into the West, unhindered for the first time since the Wall was erected 28 years ago.

reference_spacy_tokens: Tens of thousands of East Berliners had flown into the West , unhindered for the first time since the Wall was erected 28 years ago .


fn_spacy_tokens_for_baseline: We are fully committed to reinvigorating the economy of west Cornwall .

source_bert_toks: we are fully committed to rein ##vi ##gor ##ating the economy of west cornwall .

reference_raw: We are fully committed to the recovery of Western Cornwall's economy.

reference_spacy_tokens: We are fully committed to the recovery of Western Cornwall 's economy .


fn_spacy_tokens_for_baseline: Ladies in Burberry raincoats can be intimidating in the nicest possible way .

source_bert_toks: ladies in bu ##rber ##ry rain ##coat ##s can be intimidating in the nice ##st possible way .

reference_raw: The ladies in Burberry's coats can be intimidating in the nicest possible way.

reference_spacy_tokens: The ladies in Burberry 's coats can be intimidating in the nicest possible way .


fn_spacy_tokens_for_baseline: It is my impression that the Department of Transport has not so far been sympathetic to the potential plight of some of the preserved railways in Scotland .

source_bert_toks: it is my impression that the department of transport has not so far been sympathetic to the potential plight of some of the preserved railways in scotland .

reference_raw: I am of the opinion that the Ministry of Transport has not yet sympathized with the possible situation of some of the preserved railroads in Scotland.

reference_spacy_tokens: I am of the opinion that the Ministry of Transport has not yet sympathized with the possible situation of some of the preserved railroads in Scotland .


fn_spacy_tokens_for_baseline: In 1984 , the European Commission of Human Rights reported , on the application of one Mark Rees , that the United Kingdom was in violation of Article 8 of the European Convention .

source_bert_toks: in 1984 , the european commission of human rights reported , on the application of one mark rees , that the united kingdom was in violation of article 8 of the european convention .

reference_raw: In 1984, the European Commission for Human Rights declared that the United Kingdom was in breach of Article 8 of the European Convention for the Protection of Human Rights with regard to the use of a single trade mark Rees.

reference_spacy_tokens: In 1984 , the European Commission for Human Rights declared that the United Kingdom was in breach of Article 8 of the European Convention for the Protection of Human Rights with regard to the use of a single trade mark Rees .


fn_spacy_tokens_for_baseline: Mr Harvey is devastated too .

source_bert_toks: mr harvey is devastated too .

reference_raw: Mr. Harvey's ruined, too.

reference_spacy_tokens: Mr. Harvey 's ruined , too .


fn_spacy_tokens_for_baseline: The PRC is reportedly providing Iranian nuclear experts with know - how and design information , some of which may be related to fissile material production and weapons development ( 6930 ) .

source_bert_toks: the prc is reportedly providing iranian nuclear experts with know - how and design information , some of which may be related to fis ##sil ##e material production and weapons development ( 69 ##30 ) .

reference_raw: The PRC allegedly provides know-how and design information to Iranian nuclear specialists, some of which may be related to the production of fissile materials and the development of weapons (6930).

reference_spacy_tokens: The PRC allegedly provides know - how and design information to Iranian nuclear specialists , some of which may be related to the production of fissile materials and the development of weapons ( 6930 ) .


fn_spacy_tokens_for_baseline: Down by the river the boys fish with rods cut straight from the surrounding forest and grill their catches on an open fire .

source_bert_toks: down by the river the boys fish with rods cut straight from the surrounding forest and grill their catches on an open fire .

reference_raw: Down by the river the boys fish with sticks cut straight out of the surrounding forest and barbecue their catches in the open fire.

reference_spacy_tokens: Down by the river the boys fish with sticks cut straight out of the surrounding forest and barbecue their catches in the open fire .


fn_spacy_tokens_for_baseline: The sound of corks popping at Number Ten Downing Street -- ' warm congratulation ' , ' another first for Britain ' -- echoes the click of particles at CERN .

source_bert_toks: the sound of cork ##s popping at number ten downing street - - ' warm cong ##rat ##ulation ' , ' another first for britain ' - - echoes the click of particles at ce ##rn .

reference_raw: The sound of corks popping on Number Ten Downing Street - 'warm congratulations' , 'other first for Britain' - echoes the crackling of particles in CERN.

reference_spacy_tokens: The sound of corks popping on Number Ten Downing Street - ' warm congratulations ' , ' other first for Britain ' - echoes the crackling of particles in CERN .


fn_spacy_tokens_for_baseline: A searching spot snaked across the deck towards him .

source_bert_toks: a searching spot snake ##d across the deck towards him .

reference_raw: A search point crept across the deck toward him.

reference_spacy_tokens: A search point crept across the deck toward him .


fn_spacy_tokens_for_baseline: Helicopters and police cruisers crisscrossed northern Bavaria on Thursday in search of more .

source_bert_toks: helicopters and police cruisers cr ##iss ##cross ##ed northern bavaria on thursday in search of more .

reference_raw: On Thursday, helicopters and police cruisers crossed North Bavaria in search of more.

reference_spacy_tokens: On Thursday , helicopters and police cruisers crossed North Bavaria in search of more .


fn_spacy_tokens_for_baseline: The most irritating assertion of the anti - downsizing lobby is that distributed open systems end up costing more because of all the hidden training and support costs .

source_bert_toks: the most irritating assertion of the anti - downs ##izing lobby is that distributed open systems end up costing more because of all the hidden training and support costs .

reference_raw: The most annoying statement of the anti-deployment lobby is that distributed open systems end up costing more because of all the hidden costs of training and support.

reference_spacy_tokens: The most annoying statement of the anti - deployment lobby is that distributed open systems end up costing more because of all the hidden costs of training and support .


fn_spacy_tokens_for_baseline: She sprawled awkwardly as one of the women lost control of her legs .

source_bert_toks: she sprawled awkwardly as one of the women lost control of her legs .

reference_raw: She stretched uncomfortably as one of the women lost control of her legs.

reference_spacy_tokens: She stretched uncomfortably as one of the women lost control of her legs .


fn_spacy_tokens_for_baseline: The Queen delighted in his preaching and made him Dean of Westminster .

source_bert_toks: the queen delighted in his preaching and made him dean of westminster .

reference_raw: The queen rejoiced in his sermon and made him the Dean of Westminster.

reference_spacy_tokens: The queen rejoiced in his sermon and made him the Dean of Westminster .


fn_spacy_tokens_for_baseline: Grass , which is sown with clover , provides rich pasture for cattle in summer and the clover is another plant which puts nitrogen into the soil .

source_bert_toks: grass , which is so ##wn with clover , provides rich pasture for cattle in summer and the clover is another plant which puts nitrogen into the soil .

reference_raw: The grass, sown by the clover, provides a rich pasture for cattle in the summer, and the clover is another plant that places nitrogen in the soil.

reference_spacy_tokens: The grass , sown by the clover , provides a rich pasture for cattle in the summer , and the clover is another plant that places nitrogen in the soil .


fn_spacy_tokens_for_baseline: She also uses studies of women 's habits of speech to suggest that women use a slightly different language .

source_bert_toks: she also uses studies of women ' s habits of speech to suggest that women use a slightly different language .

reference_raw: It also uses studies of female speech patterns to indicate that women use a slightly different language.

reference_spacy_tokens: It also uses studies of female speech patterns to indicate that women use a slightly different language .


fn_spacy_tokens_for_baseline: A Syria - EU trade accord hurdle was resolved in October with agreement on a WMD clause , subject to final approval by EU foreign ministers .

source_bert_toks: a syria - eu trade accord hurdle was resolved in october with agreement on a w ##md clause , subject to final approval by eu foreign ministers .

reference_raw: The Syria - EU Trade Agreement obstacle was resolved in October with an agreement on a weapons of mass destruction clause, subject to the final agreement of the EU Foreign Ministers.

reference_spacy_tokens: The Syria - EU Trade Agreement obstacle was resolved in October with an agreement on a weapons of mass destruction clause , subject to the final agreement of the EU Foreign Ministers .


fn_spacy_tokens_for_baseline: The teak paddles began to rotate , making little more than a whisper of sound as they gently scythed the warm air .

source_bert_toks: the tea ##k paddle ##s began to rotate , making little more than a whisper of sound as they gently sc ##ythe ##d the warm air .

reference_raw: The teak paddles began to turn, making little more than a whisper as they gently scythed the warm air.

reference_spacy_tokens: The teak paddles began to turn , making little more than a whisper as they gently scythed the warm air .


fn_spacy_tokens_for_baseline: Even one of Sanson 's brothers , the executioner of Herault , yielded to the temptation , frequently being so drunk that executions had to be postponed .

source_bert_toks: even one of sans ##on ' s brothers , the execution ##er of her ##ault , yielded to the temptation , frequently being so drunk that executions had to be postponed .

reference_raw: Even one of Sanson's brothers, the Herault Executor, had given in to temptation, and was often so drunk that executions had to be postponed.

reference_spacy_tokens: Even one of Sanson 's brothers , the Herault Executor , had given in to temptation , and was often so drunk that executions had to be postponed .


fn_spacy_tokens_for_baseline: She breathed in his familiar odour of best bitter and Woodbines and snuggled against him , safe and secure .

source_bert_toks: she breathed in his familiar o ##dou ##r of best bitter and wood ##bine ##s and snuggled against him , safe and secure .

reference_raw: She took a deep breath in the familiar smell of the best of the bitter and the best of the Woodbines and hugged him, safe and secure.

reference_spacy_tokens: She took a deep breath in the familiar smell of the best of the bitter and the best of the Woodbines and hugged him , safe and secure .


fn_spacy_tokens_for_baseline: According to the National Council of Resistance of Iran , Iran has purchased dual - use equipment using the science and technology center at Amir Kabir University as a cover .

source_bert_toks: according to the national council of resistance of iran , iran has purchased dual - use equipment using the science and technology center at amir ka ##bir university as a cover .

reference_raw: According to the National Council of Resistance of Iran, Iran bought dual-use equipment using the Science and Technology Centre at the University of Amir Kabir as a cover.

reference_spacy_tokens: According to the National Council of Resistance of Iran , Iran bought dual - use equipment using the Science and Technology Centre at the University of Amir Kabir as a cover .


fn_spacy_tokens_for_baseline: She shied , she reared , went backwards , stopped dead from a canter , saw a ghost in every gateway .

source_bert_toks: she shi ##ed , she reared , went backwards , stopped dead from a can ##ter , saw a ghost in every gateway .

reference_raw: She shivered, reared, walked back, stopped dead from a trot, saw a ghost in every gate.

reference_spacy_tokens: She shivered , reared , walked back , stopped dead from a trot , saw a ghost in every gate .


fn_spacy_tokens_for_baseline: ' Sad ? ' they both exclaimed together .

source_bert_toks: ' sad ? ' they both exclaimed together .

reference_raw: 'Sad?' they cried together.

reference_spacy_tokens: ' Sad ? ' they cried together .


fn_spacy_tokens_for_baseline: Endill and Mould sneaked to the workshop and without any problems pushed the catapult base through the corridors and onto the grass outside .

source_bert_toks: end ##ill and mo ##uld sneak ##ed to the workshop and without any problems pushed the cat ##ap ##ult base through the corridors and onto the grass outside .

reference_raw: Endill and Mould crept into the workshop and, with no difficulty, pushed the base of the catapult through the corridors and out onto the grass.

reference_spacy_tokens: Endill and Mould crept into the workshop and , with no difficulty , pushed the base of the catapult through the corridors and out onto the grass .


fn_spacy_tokens_for_baseline: Grate nutmeg over this , and strew a few coloured comfits on the top if you choose . '

source_bert_toks: gr ##ate nut ##me ##g over this , and st ##rew a few coloured com ##fi ##ts on the top if you choose . '

reference_raw: Grate the nutmeg over it, and add a few colored comforts to the top if you want.'

reference_spacy_tokens: Grate the nutmeg over it , and add a few colored comforts to the top if you want . '


fn_spacy_tokens_for_baseline: As I 've already explained , I felt absolutely no lust whatsoever for Alison Kraemer .

source_bert_toks: as i ' ve already explained , i felt absolutely no lust whatsoever for alison k ##rae ##mer .

reference_raw: As I explained, I had no desire for Alison Kraemer at all.

reference_spacy_tokens: As I explained , I had no desire for Alison Kraemer at all .


fn_spacy_tokens_for_baseline: Her scorn stung him at last .

source_bert_toks: her sc ##orn stung him at last .

reference_raw: She finally stabbed him with contempt.

reference_spacy_tokens: She finally stabbed him with contempt .


fn_spacy_tokens_for_baseline: The great landscape of lights glitters and shimmers in the warm evening air .

source_bert_toks: the great landscape of lights glitter ##s and shi ##mmer ##s in the warm evening air .

reference_raw: The great landscape of light glitters and glitters in the warm evening air.

reference_spacy_tokens: The great landscape of light glitters and glitters in the warm evening air .


fn_spacy_tokens_for_baseline: Border clashes , some serious , were frequent during 1990 and early 1991 .

source_bert_toks: border clashes , some serious , were frequent during 1990 and early 1991 .

reference_raw: Border conflicts, some serious, were common in 1990 and early 1991.

reference_spacy_tokens: Border conflicts , some serious , were common in 1990 and early 1991 .


fn_spacy_tokens_for_baseline: The man had positively cooed at them , going to quite a bit of trouble to prove that he had not been involved in the attack .

source_bert_toks: the man had positively co ##oed at them , going to quite a bit of trouble to prove that he had not been involved in the attack .

reference_raw: The man comforted them and went to a lot of trouble to prove he wasn't involved in the attack.

reference_spacy_tokens: The man comforted them and went to a lot of trouble to prove he was n't involved in the attack .


fn_spacy_tokens_for_baseline: Some films have to be shot on location : you can not create a moving ' face ' out of several thousand people for a British Airways commercial in any other way .

source_bert_toks: some films have to be shot on location : you can not create a moving ' face ' out of several thousand people for a british airways commercial in any other way .

reference_raw: Some films have to be filmed on the spot: you can't create a moving face from a few thousand people to a British Airways commercial in any other way.

reference_spacy_tokens: Some films have to be filmed on the spot : you ca n't create a moving face from a few thousand people to a British Airways commercial in any other way .


fn_spacy_tokens_for_baseline: They unwound his sash and stripped away his sodden garments .

source_bert_toks: they un ##wo ##und his sash and stripped away his so ##dden garments .

reference_raw: They unwound his sash and stripped off his wet clothes.

reference_spacy_tokens: They unwound his sash and stripped off his wet clothes .


fn_spacy_tokens_for_baseline: Once viewed by parents as " a curse , " Chinese women are now significantly contributing to the economic well being of poor rural areas and gaining new respect in the process .

source_bert_toks: once viewed by parents as " a curse , " chinese women are now significantly contributing to the economic well being of poor rural areas and gaining new respect in the process .

reference_raw: Once viewed by parents as a "curse", Chinese women now make a significant contribution to the economic well-being of bad rural areas and gain new respect for the process.

reference_spacy_tokens: Once viewed by parents as a " curse " , Chinese women now make a significant contribution to the economic well - being of bad rural areas and gain new respect for the process .


fn_spacy_tokens_for_baseline: After a few enquiries at Brigade H.Q I presented myself outside the big house at 2 p.m. wearing kilt , polished boots ( which took some doing ) and , of course , carrying the bagpipes .

source_bert_toks: after a few en ##qui ##ries at brigade h . q i presented myself outside the big house at 2 p . m . wearing ki ##lt , polished boots ( which took some doing ) and , of course , carrying the bag ##pipe ##s .

reference_raw: After several interviews at Brigade HQ, I presented myself in front of the big house at two o'clock in the afternoon, wearing kilted, polished shoes (which took some work) and, of course, carrying bagpipes.

reference_spacy_tokens: After several interviews at Brigade HQ , I presented myself in front of the big house at two o'clock in the afternoon , wearing kilted , polished shoes ( which took some work ) and , of course , carrying bagpipes .


fn_spacy_tokens_for_baseline: In a speech in Johannesburg on Feb. 8 , he warned that the ANC would organize a wave of ' mass action ' , aimed at making investment impossible , should the EC or the USA lift sanctions .

source_bert_toks: in a speech in johannesburg on feb . 8 , he warned that the an ##c would organize a wave of ' mass action ' , aimed at making investment impossible , should the ec or the usa lift sanctions .

reference_raw: In his speech in Johannesburg on February 8, he warned that if the EC or the US lifts sanctions, the ANC would organise a series of mass actions to make investment impossible.

reference_spacy_tokens: In his speech in Johannesburg on February 8 , he warned that if the EC or the US lifts sanctions , the ANC would organise a series of mass actions to make investment impossible .


fn_spacy_tokens_for_baseline: According to most analysts , the visit underlined Keating 's intention to shift Australia 's external focus towards greater economic and political co - operation with Asia .

source_bert_toks: according to most analysts , the visit under ##lined keating ' s intention to shift australia ' s external focus towards greater economic and political co - operation with asia .

reference_raw: According to most analysts, the visit highlighted Keating's intention to shift Australia's external focus to greater economic and political cooperation with Asia.

reference_spacy_tokens: According to most analysts , the visit highlighted Keating 's intention to shift Australia 's external focus to greater economic and political cooperation with Asia .


fn_spacy_tokens_for_baseline: Whatever breakdown is chosen , the course content must address all the ensuing topics .

source_bert_toks: whatever breakdown is chosen , the course content must address all the ensuing topics .

reference_raw: Whatever the breakdown is selected, the content of the course must cover all the following topics.

reference_spacy_tokens: Whatever the breakdown is selected , the content of the course must cover all the following topics .


fn_spacy_tokens_for_baseline: Later in the day a suicide bomber detonated his explosives inside the city 's hospital as Sunni Muslim parliament member Mutasher Samarrai visited .

source_bert_toks: later in the day a suicide bomber detonated his explosives inside the city ' s hospital as sunni muslim parliament member mu ##tas ##her sam ##ar ##rai visited .

reference_raw: Later that day, when Sunni Muslim Member Mutasher Samarrai visited, a suicide bomber blew up his explosives inside the city hospital.

reference_spacy_tokens: Later that day , when Sunni Muslim Member Mutasher Samarrai visited , a suicide bomber blew up his explosives inside the city hospital .


fn_spacy_tokens_for_baseline: Immunoprecipitates were treated with 1.0 % deoxycholate and the released material assayed for DRTF1 / E2F activity in gel retardation .

source_bert_toks: im ##mun ##op ##re ##ci ##pit ##ates were treated with 1 . 0 % de ##ox ##ych ##olate and the released material ass ##ay ##ed for dr ##tf ##1 / e ##2 ##f activity in gel re ##tar ##dation .

reference_raw: Immunoprecipitates were treated with 1.0% deoxycholate and released material tested for DRTF1/E2F activity in gel retardation.

reference_spacy_tokens: Immunoprecipitates were treated with 1.0 % deoxycholate and released material tested for DRTF1 / E2F activity in gel retardation .


fn_spacy_tokens_for_baseline: Subjectively , we saw no evidence of coexpression of fiber types I and IIa , but owing to the nature of antibody BF-35 , which stains all except pure IIx fibers , we are unable to rule out the coexpression of IIx with any other isoform .

source_bert_toks: subjective ##ly , we saw no evidence of coe ##x ##press ##ion of fiber types i and ii ##a , but owing to the nature of antibody bf - 35 , which stains all except pure ii ##x fibers , we are unable to rule out the coe ##x ##press ##ion of ii ##x with any other iso ##form .

reference_raw: Subjectively, we did not see any evidence of co-expression of types I and IIa, but because of the nature of the BF-35 antibody, which stains all but pure IIx fibres, we cannot exclude the co-expression of IIx with other isoforms.

reference_spacy_tokens: Subjectively , we did not see any evidence of co - expression of types I and IIa , but because of the nature of the BF-35 antibody , which stains all but pure IIx fibres , we can not exclude the co - expression of IIx with other isoforms .


fn_spacy_tokens_for_baseline: Recent business projections for Las Vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

source_bert_toks: recent business projections for las vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

reference_raw: The latest commercial projections for Las Vegas foresee challenges; tourism revenues need to increase significantly in order to maintain what has already been built, while actual figures show that visitation is stable or declining.

reference_spacy_tokens: The latest commercial projections for Las Vegas foresee challenges ; tourism revenues need to increase significantly in order to maintain what has already been built , while actual figures show that visitation is stable or declining .


fn_spacy_tokens_for_baseline: To those of us with vertigo , it fortunately reveals that the southern side of the ridge is not nearly as precipitous as the northern .

source_bert_toks: to those of us with vertigo , it fortunately reveals that the southern side of the ridge is not nearly as pre ##ci ##pit ##ous as the northern .

reference_raw: For those of us with dizziness, it is fortunate that the south side of the ridge is not nearly as precipitous as the north.

reference_spacy_tokens: For those of us with dizziness , it is fortunate that the south side of the ridge is not nearly as precipitous as the north .


fn_spacy_tokens_for_baseline: I very much welcome the fact that the Security Council authorised the dispatch of a preliminary team .

source_bert_toks: i very much welcome the fact that the security council authorised the dispatch of a preliminary team .

reference_raw: I very much welcome the fact that the Security Council has authorized a preliminary team to be dispatched.

reference_spacy_tokens: I very much welcome the fact that the Security Council has authorized a preliminary team to be dispatched .


fn_spacy_tokens_for_baseline: Kali and Hades had been plucked from their midst as though by a giant hand and flung several feet away , almost cut in half by the point - blank blast of sawn - off twelve - bores .

source_bert_toks: kali and hades had been plucked from their midst as though by a giant hand and flung several feet away , almost cut in half by the point - blank blast of saw ##n - off twelve - bore ##s .

reference_raw: Kali and Hades were pulled out of their midst, as if by a giant hand, and flung a few feet away, nearly half-cut by a point-blank blast of sawn-off twelve-bores.

reference_spacy_tokens: Kali and Hades were pulled out of their midst , as if by a giant hand , and flung a few feet away , nearly half - cut by a point - blank blast of sawn - off twelve - bores .


fn_spacy_tokens_for_baseline: The father of a six - week old baby told Valerie Yule , ' We know other parents who smack their babies to keep them quiet .

source_bert_toks: the father of a six - week old baby told valerie yu ##le , ' we know other parents who smack their babies to keep them quiet .

reference_raw: The six-week-old's dad said to Valerie Yule, "We know other parents who slap their kids to keep them quiet.

reference_spacy_tokens: The six - week - old 's dad said to Valerie Yule , " We know other parents who slap their kids to keep them quiet .


fn_spacy_tokens_for_baseline: RUDY FRASCA 's Spitfire XVIII TP280 / G - BTXE ( FP October , p 61 ) has been crated and shipped to Champaine , Illinois , home of the owner 's Frasca Flight Simulators .

source_bert_toks: rudy fra ##sca ' s spitfire xvi ##ii t ##p ##28 ##0 / g - bt ##x ##e ( f ##p october , p 61 ) has been crate ##d and shipped to champ ##aine , illinois , home of the owner ' s fra ##sca flight simulator ##s .

reference_raw: RUDY FRASCA Spitfire XVII TP280/G-BTXE (FP October, p 61) was boxed and shipped to Champaine, illinois, home of the owner of the Frasca flight simulators.

reference_spacy_tokens: RUDY FRASCA Spitfire XVII TP280 / G - BTXE ( FP October , p 61 ) was boxed and shipped to Champaine , illinois , home of the owner of the Frasca flight simulators .


fn_spacy_tokens_for_baseline: It 's a chemical that actually dries up the air , but although we 've used tons of the stuff it has n't had much effect .

source_bert_toks: it ' s a chemical that actually dr ##ies up the air , but although we ' ve used tons of the stuff it hasn ' t had much effect .

reference_raw: It's a chemical that's actually dried up in the air, but even though we used a lot of stuff, it didn't have much effect.

reference_spacy_tokens: It 's a chemical that 's actually dried up in the air , but even though we used a lot of stuff , it did n't have much effect .


fn_spacy_tokens_for_baseline: Punishment would consequently also dwindle in importance as the division of labour progresses , and punitive law be replaced by ' restitutive law ' which requires lawbreakers to make reparation to their victims rather than suffer retributive punishment .

source_bert_toks: punishment would consequently also d ##wind ##le in importance as the division of labour progresses , and pun ##itive law be replaced by ' rest ##it ##utive law ' which requires law ##breakers to make rep ##arat ##ion to their victims rather than suffer re ##tri ##bu ##tive punishment .

reference_raw: Punishment would therefore also be less important as the division of labor progresses, and criminal law would be replaced by "restitutive law", which requires lawbreakers to pay compensation to their victims rather than suffer retribution.

reference_spacy_tokens: Punishment would therefore also be less important as the division of labor progresses , and criminal law would be replaced by " restitutive law " , which requires lawbreakers to pay compensation to their victims rather than suffer retribution .


fn_spacy_tokens_for_baseline: Bavaria 's conservatives are losing their state premier and the opposition Social Democrats their leader .

source_bert_toks: bavaria ' s conservatives are losing their state premier and the opposition social democrats their leader .

reference_raw: The Bavarian Conservatives lose their prime minister, and the opposition Social Democrats become leaders.

reference_spacy_tokens: The Bavarian Conservatives lose their prime minister , and the opposition Social Democrats become leaders .


fn_spacy_tokens_for_baseline: Growth has been inhibited by lack of access to many of the critical technologies , despite the use of plant construction firms as intermediaries .

source_bert_toks: growth has been inhibit ##ed by lack of access to many of the critical technologies , despite the use of plant construction firms as inter ##media ##ries .

reference_raw: Growth was hampered by the lack of access to many critical technologies, despite the use of plant-building companies as intermediaries.

reference_spacy_tokens: Growth was hampered by the lack of access to many critical technologies , despite the use of plant - building companies as intermediaries .


fn_spacy_tokens_for_baseline: This has n't grown so well this year compared to previous summers , probably because of the lack of really bright sunshine .

source_bert_toks: this hasn ' t grown so well this year compared to previous summers , probably because of the lack of really bright sunshine .

reference_raw: Compared to previous summers, it didn't get much better this year, probably due to the lack of really clear sunlight.

reference_spacy_tokens: Compared to previous summers , it did n't get much better this year , probably due to the lack of really clear sunlight .


fn_spacy_tokens_for_baseline: Bruno , twice beaten in world heavyweight title fights , against Tim Witherspoon in 1986 , and this year by Mike Tyson , receives the MBE for his services to boxing .

source_bert_toks: bruno , twice beaten in world heavyweight title fights , against tim with ##ers ##poo ##n in 1986 , and this year by mike tyson , receives the mbe for his services to boxing .

reference_raw: Bruno, twice defeated in the World Heavy Weight Championships, against Tim Witherspoon in 1986, and this year by Mike Tyson, receives an MBE for his boxing services.

reference_spacy_tokens: Bruno , twice defeated in the World Heavy Weight Championships , against Tim Witherspoon in 1986 , and this year by Mike Tyson , receives an MBE for his boxing services .


fn_spacy_tokens_for_baseline: Gorbachev 's address was greeted with barely five seconds of perfunctory applause , contrasting sharply with the thunderous standing ovations accorded to party leaders at previous congresses .

source_bert_toks: go ##rba ##chev ' s address was greeted with barely five seconds of per ##fu ##nc ##tory applause , contrasting sharply with the thunder ##ous standing o ##vation ##s accord ##ed to party leaders at previous congresses .

reference_raw: Gorbachev's speech was greeted with barely five seconds of perfunctory applause, which contrasted sharply with the thunderous standing ovations accorded to party leaders in previous congresses.

reference_spacy_tokens: Gorbachev 's speech was greeted with barely five seconds of perfunctory applause , which contrasted sharply with the thunderous standing ovations accorded to party leaders in previous congresses .


fn_spacy_tokens_for_baseline: ' Rather Red than Dead ' became its slogan , and protest marches from Aldermaston Atomic Weapons Research Establishment to Westminster became a way of life for many church - goers , left - wing intellectuals , pacifists and liberal moralists .

source_bert_toks: ' rather red than dead ' became its slogan , and protest marches from al ##der ##mas ##ton atomic weapons research establishment to westminster became a way of life for many church - go ##ers , left - wing intellectuals , pac ##if ##ists and liberal moral ##ists .

reference_raw: "Red rather than dead" became his slogan, and protests from the Aldermaston nuclear research facility to Westminster became the way of life for many church-goers, left-wing intellectuals, pacifists, and liberal moralists.

reference_spacy_tokens: " Red rather than dead " became his slogan , and protests from the Aldermaston nuclear research facility to Westminster became the way of life for many church - goers , left - wing intellectuals , pacifists , and liberal moralists .


fn_spacy_tokens_for_baseline: The noise of the thunder shook the house , and the little panes of glass rattled in the window frames .

source_bert_toks: the noise of the thunder shook the house , and the little pan ##es of glass rattled in the window frames .

reference_raw: The sound of thunder shook the house, and small panels of glass clattered in the window frames.

reference_spacy_tokens: The sound of thunder shook the house , and small panels of glass clattered in the window frames .


fn_spacy_tokens_for_baseline: With a little nod , she hurried inside and up to her room .

source_bert_toks: with a little nod , she hurried inside and up to her room .

reference_raw: She nodded slightly and rushed in and into her room.

reference_spacy_tokens: She nodded slightly and rushed in and into her room .


fn_spacy_tokens_for_baseline: Far above in the belfry , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

source_bert_toks: far above in the bel ##fr ##y , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

reference_raw: Far above the bells, the great bronze bells on the wheels swing madly over the top of the bell, starting and ending, surprisingly, in the inverted or mouth-up position.

reference_spacy_tokens: Far above the bells , the great bronze bells on the wheels swing madly over the top of the bell , starting and ending , surprisingly , in the inverted or mouth - up position .


fn_spacy_tokens_for_baseline: He took off the phoney glasses and tweed hat and threw them to one side .

source_bert_toks: he took off the phone ##y glasses and tweed hat and threw them to one side .

reference_raw: He removed his phoney spectacles and tweed hat and tossed them aside.

reference_spacy_tokens: He removed his phoney spectacles and tweed hat and tossed them aside .


fn_spacy_tokens_for_baseline: In December 2002 , Spanish and American naval forces intercepted a North Korean ship loaded with Scud missiles , but then allowed the ship to proceed to deliver the missiles to Yemen .

source_bert_toks: in december 2002 , spanish and american naval forces intercepted a north korean ship loaded with sc ##ud missiles , but then allowed the ship to proceed to deliver the missiles to yemen .

reference_raw: In December 2002, the Spanish and U.S. Navy intercepted a North Korean ship full of Scud missiles, then allowed it to continue to deliver the missiles to Yemen.

reference_spacy_tokens: In December 2002 , the Spanish and U.S. Navy intercepted a North Korean ship full of Scud missiles , then allowed it to continue to deliver the missiles to Yemen .


fn_spacy_tokens_for_baseline: Police discovered the Mini van in the warehouse in the nearby City Walls Road while carrying out a systematic search of the whole city .

source_bert_toks: police discovered the mini van in the warehouse in the nearby city walls road while carrying out a systematic search of the whole city .

reference_raw: Police found a Mini van in a warehouse near City Walls Road while systematically searching the city.

reference_spacy_tokens: Police found a Mini van in a warehouse near City Walls Road while systematically searching the city .


fn_spacy_tokens_for_baseline: And the Darlington to Hartlepool railway line is not the Wild West nor did Wednesday see it produce a huge number of train robbers .

source_bert_toks: and the darlington to hart ##le ##pool railway line is not the wild west nor did wednesday see it produce a huge number of train robbers .

reference_raw: And Darlington to Hartlepool isn't the Wild West, and Wednesday didn't see that it produces a lot of train thieves.

reference_spacy_tokens: And Darlington to Hartlepool is n't the Wild West , and Wednesday did n't see that it produces a lot of train thieves .


fn_spacy_tokens_for_baseline: But perhaps I am shirking my responsibilities by being here , in the police force . '

source_bert_toks: but perhaps i am shi ##rkin ##g my responsibilities by being here , in the police force . '

reference_raw: But maybe I'm shaking my responsibilities when I'm here with the police.'

reference_spacy_tokens: But maybe I 'm shaking my responsibilities when I 'm here with the police . '


fn_spacy_tokens_for_baseline: A film of moisture glistened across his forehead as he sweated under the lights and he dabbed at it with a handkerchief .

source_bert_toks: a film of moisture g ##list ##ened across his forehead as he sweat ##ed under the lights and he da ##bbed at it with a handkerchief .

reference_raw: As he sweated under the lights, a film of moisture gleamed on his forehead, and he dabbed at it with a handkerchief.

reference_spacy_tokens: As he sweated under the lights , a film of moisture gleamed on his forehead , and he dabbed at it with a handkerchief .


fn_spacy_tokens_for_baseline: A superb choice for the discerning holidaymaker .

source_bert_toks: a superb choice for the disc ##ern ##ing holiday ##maker .

reference_raw: Great choice for a recognizable holidaymaker.

reference_spacy_tokens: Great choice for a recognizable holidaymaker .


fn_spacy_tokens_for_baseline: For example , they may purchase raw or milled uranium ore from abroad , and then use indigenous facilities to enrich it to weapons - grade material .

source_bert_toks: for example , they may purchase raw or mill ##ed uranium ore from abroad , and then use indigenous facilities to en ##rich it to weapons - grade material .

reference_raw: For example, they can buy raw or milled ore from abroad and then use domestic facilities to enrich it for weapons-grade materials.

reference_spacy_tokens: For example , they can buy raw or milled ore from abroad and then use domestic facilities to enrich it for weapons - grade materials .


fn_spacy_tokens_for_baseline: Indeed , an old person living alone may need nearly as much physical care as those in shared households and this may require quite a high level of family organisation and planning , in which a woman is usually at the centre .

source_bert_toks: indeed , an old person living alone may need nearly as much physical care as those in shared households and this may require quite a high level of family organisation and planning , in which a woman is usually at the centre .

reference_raw: In fact, an elderly person who lives alone may need almost as much physical care as in a common household, which may require quite a high level of family organisation and planning, where the female is usually in the centre.

reference_spacy_tokens: In fact , an elderly person who lives alone may need almost as much physical care as in a common household , which may require quite a high level of family organisation and planning , where the female is usually in the centre .


fn_spacy_tokens_for_baseline: In this respect , at least , John Eliot Gardiner 's recording on Archiv far outshines the present one .

source_bert_toks: in this respect , at least , john eliot gardiner ' s recording on arch ##iv far outs ##hine ##s the present one .

reference_raw: In that regard, at least the recording of John Eliot Gardiner on Archiv far outsmarts this one.

reference_spacy_tokens: In that regard , at least the recording of John Eliot Gardiner on Archiv far outsmarts this one .


fn_spacy_tokens_for_baseline: For example , where a residential property has been purchased for investment purposes the bank / organisation may wish to notify its interest to the insurer .

source_bert_toks: for example , where a residential property has been purchased for investment purposes the bank / organisation may wish to not ##ify its interest to the ins ##urer .

reference_raw: For example, if a residential property is purchased for investment purposes, the bank/organisation may wish to inform the insurer of its interest.

reference_spacy_tokens: For example , if a residential property is purchased for investment purposes , the bank / organisation may wish to inform the insurer of its interest .


fn_spacy_tokens_for_baseline: They were there to study migrating birds , information the military would use to determine if chemicals and diseases could be transported across borders and so be used as vectors by -- or against -- an enemy .

source_bert_toks: they were there to study migrating birds , information the military would use to determine if chemicals and diseases could be transported across borders and so be used as vectors by - - or against - - an enemy .

reference_raw: They were there to examine the migration of birds, information that the military would use to determine whether chemicals and diseases could be transported across borders, so that they could be used as vectors by - or against - the enemy.

reference_spacy_tokens: They were there to examine the migration of birds , information that the military would use to determine whether chemicals and diseases could be transported across borders , so that they could be used as vectors by - or against - the enemy .


fn_spacy_tokens_for_baseline: Most German manufacturers have their ' house bank ' , often a major shareholder and locked into an enduring relationship .

source_bert_toks: most german manufacturers have their ' house bank ' , often a major shareholder and locked into an enduring relationship .

reference_raw: The majority of German producers have a "house bank" , which is often the main shareholder and is locked in a permanent relationship.

reference_spacy_tokens: The majority of German producers have a " house bank " , which is often the main shareholder and is locked in a permanent relationship .


fn_spacy_tokens_for_baseline: Fran jumped as though she had been burnt , the papers rustling on the desk .

source_bert_toks: fran jumped as though she had been burnt , the papers rustling on the desk .

reference_raw: Fran jumped as if she'd been burned, and the papers rattled on the table.

reference_spacy_tokens: Fran jumped as if she 'd been burned , and the papers rattled on the table .


fn_spacy_tokens_for_baseline: Warm the remaining milk and stir into the melted chocolate .

source_bert_toks: warm the remaining milk and stir into the melted chocolate .

reference_raw: Warm the remaining milk and mix into dissolved chocolate.

reference_spacy_tokens: Warm the remaining milk and mix into dissolved chocolate .


fn_spacy_tokens_for_baseline: Cu -Ni sulphide mineralisation was discovered near Huntly ( Littlemill zone ) and Ellon ( Arthrath - Dudwick zone ) in Caledonian norites contaminated by pyritic and graphitic Dalradian sediments .

source_bert_toks: cu - ni sul ##phi ##de mineral ##isation was discovered near hunt ##ly ( little ##mill zone ) and el ##lon ( art ##hra ##th - du ##d ##wick zone ) in caledonian nor ##ites contaminated by p ##yr ##itic and graph ##itic dal ##rad ##ian sediments .

reference_raw: The mineralisation of Cu-Ni sulphide has been detected in the vicinity of Huntly (Littlemill area) and Ellon (Arthrath-Dudwick area) in Caledonian norites contaminated with pyritic and graphitic Dalradian sediments.

reference_spacy_tokens: The mineralisation of Cu - Ni sulphide has been detected in the vicinity of Huntly ( Littlemill area ) and Ellon ( Arthrath - Dudwick area ) in Caledonian norites contaminated with pyritic and graphitic Dalradian sediments .


fn_spacy_tokens_for_baseline: Tropical waterlilies have been admired for generations due to their exquisite blooms and overall beauty .

source_bert_toks: tropical water ##li ##lies have been admired for generations due to their exquisite blooms and overall beauty .

reference_raw: Tropical waterlies have been admirable for generations because of their beautiful flowers and their overall beauty.

reference_spacy_tokens: Tropical waterlies have been admirable for generations because of their beautiful flowers and their overall beauty .


fn_spacy_tokens_for_baseline: Dew member Dr Robert Upshall , who started the drive for support from seven Darlington 's worldwide , welcomed the news saying : ' Their mayor remarks on their regret for destroying their heritage .

source_bert_toks: dew member dr robert ups ##hall , who started the drive for support from seven darlington ' s worldwide , welcomed the news saying : ' their mayor remarks on their regret for destroying their heritage .

reference_raw: The dew member, Dr. Robert Upshall, who had begun his journey for support from the world's seven Darlingtons, welcomed the news that said, "Their mayor is sorry for the destruction of their legacy.

reference_spacy_tokens: The dew member , Dr. Robert Upshall , who had begun his journey for support from the world 's seven Darlingtons , welcomed the news that said , " Their mayor is sorry for the destruction of their legacy .


fn_spacy_tokens_for_baseline: round deep tins -12 cm ( 5 in ) ranging up to 27 cm ( 11 in )

source_bert_toks: round deep tin ##s - 12 ##cm ( 5 ##in ) ranging up to 27 cm ( 11 ##in )

reference_raw: Round deep cans -12 cm (5in) between 27 cm (11in)

reference_spacy_tokens: Round deep cans -12 cm ( 5 in ) between 27 cm ( 11 in )


fn_spacy_tokens_for_baseline: Training was most likely carried out under the direction of Abdul Qadeer Khan , former director of the Engineering Research Laboratories , later renamed the Dr. A.Q. Khan Research Laboratories ( Kahuta ) , where Pakistan 's nuclear weapons research and enrichment takes place .

source_bert_toks: training was most likely carried out under the direction of abdul q ##ade ##er khan , former director of the engineering research laboratories , later renamed the dr . a . q . khan research laboratories ( ka ##hu ##ta ) , where pakistan ' s nuclear weapons research and enrichment takes place .

reference_raw: The training was most likely carried out under the direction of Abdul Qadeer Khan, the former director of the Engineering Science Laboratories, who later renamed Dr. A.Q. Khan, the Kahuta, where Pakistan's nuclear-weapons exploration and enrichment took place.

reference_spacy_tokens: The training was most likely carried out under the direction of Abdul Qadeer Khan , the former director of the Engineering Science Laboratories , who later renamed Dr. A.Q. Khan , the Kahuta , where Pakistan 's nuclear - weapons exploration and enrichment took place .


fn_spacy_tokens_for_baseline: The watchman stepped back from the wicket - gate .

source_bert_toks: the watch ##man stepped back from the wicket - gate .

reference_raw: The guard backed away from the gate.

reference_spacy_tokens: The guard backed away from the gate .


fn_spacy_tokens_for_baseline: Both men say they and other rebel leaders will be targeted for death if Kadafi prevails .

source_bert_toks: both men say they and other rebel leaders will be targeted for death if ka ##da ##fi pre ##va ##ils .

reference_raw: Both men say that if Kadafi wins, they and other rebel leaders will be put to death.

reference_spacy_tokens: Both men say that if Kadafi wins , they and other rebel leaders will be put to death .


fn_spacy_tokens_for_baseline: Shoving the letter inside her book Emily had humped her bicycle down the steps and hurriedly pedalled off towards Kensington High Street .

source_bert_toks: shoving the letter inside her book emily had hum ##ped her bicycle down the steps and hurriedly pedal ##led off towards kensington high street .

reference_raw: Emily slipped the letter into her book, humped her bike down the stairs, and hurried to Kensington High Street.

reference_spacy_tokens: Emily slipped the letter into her book , humped her bike down the stairs , and hurried to Kensington High Street .


fn_spacy_tokens_for_baseline: Some of the money was in a bag fastened to her walking frame .

source_bert_toks: some of the money was in a bag fastened to her walking frame .

reference_raw: Some of the money was in a bag attached to her walking frame.

reference_spacy_tokens: Some of the money was in a bag attached to her walking frame .


fn_spacy_tokens_for_baseline: The greatest sin in the world is to have sex when you do n't want it .

source_bert_toks: the greatest sin in the world is to have sex when you don ' t want it .

reference_raw: If you don't want to have sex, it's the biggest crime in the world.

reference_spacy_tokens: If you do n't want to have sex , it 's the biggest crime in the world .


fn_spacy_tokens_for_baseline: Ludens detached from the windscreen a note from Jack which read Bon voyage .

source_bert_toks: lu ##den ##s detached from the winds ##creen a note from jack which read bon voyage .

reference_raw: Ludens removed a note from Jack's windshield that read Bon Travel.

reference_spacy_tokens: Ludens removed a note from Jack 's windshield that read Bon Travel .


fn_spacy_tokens_for_baseline: And when they died and the fleas had finished feasting on their blood , which was by then putrid and crawling with the bacilli , the fleas looked round for another host , and if they could not find another rat , or any small hairy creature to their liking , they settled for the next best thing , which was usually human .

source_bert_toks: and when they died and the flea ##s had finished feast ##ing on their blood , which was by then put ##rid and crawling with the ba ##ci ##lli , the flea ##s looked round for another host , and if they could not find another rat , or any small hairy creature to their liking , they settled for the next best thing , which was usually human .

reference_raw: And when they died, and the fleas finished feeding on their blood, which was then putrid and stuffed with bacilli, the fleas looked around for another host, and when they couldn't find another rat or some little furry creature they liked, they settled for the next best thing that was usually human.

reference_spacy_tokens: And when they died , and the fleas finished feeding on their blood , which was then putrid and stuffed with bacilli , the fleas looked around for another host , and when they could n't find another rat or some little furry creature they liked , they settled for the next best thing that was usually human .


fn_spacy_tokens_for_baseline: It was attractive but fantastic in its assumption that such employment could be provided in an age of widespread rural underemployment heightened by occasionally severe local unemployment .

source_bert_toks: it was attractive but fantastic in its assumption that such employment could be provided in an age of widespread rural under ##em ##pl ##oy ##ment heightened by occasionally severe local unemployment .

reference_raw: It was attractive, but fanciful, to assume that such employment could be provided in an age of widespread rural unemployment, exacerbated by sometimes serious local unemployment.

reference_spacy_tokens: It was attractive , but fanciful , to assume that such employment could be provided in an age of widespread rural unemployment , exacerbated by sometimes serious local unemployment .