fn_spacy_tokens_for_baseline: The jug and the bowl were chained to the table .

source_bert_toks: the jug and the bowl were chained to the table .

reference_raw: A pitcher and a bowl were handcuffed to the table.

reference_spacy_tokens: A pitcher and a bowl were handcuffed to the table .


fn_spacy_tokens_for_baseline: A magnificent example of the ' Paxford says ' routine is provided when Maureen and Minto have been into Oxford to get two wireless sets on approval .

source_bert_toks: a magnificent example of the ' pa ##x ##ford says ' routine is provided when maureen and mint ##o have been into oxford to get two wireless sets on approval .

reference_raw: When Maureen and Minto went to Oxford to get two wireless sets for approval, there was an excellent example of the "Paxford Says" routine.

reference_spacy_tokens: When Maureen and Minto went to Oxford to get two wireless sets for approval , there was an excellent example of the " Paxford Says " routine .


fn_spacy_tokens_for_baseline: He was smiling at her , his brown eyes twinkling with amusement .

source_bert_toks: he was smiling at her , his brown eyes twin ##kling with amusement .

reference_raw: He smiled at her, his brown eyes glittering with amusement.

reference_spacy_tokens: He smiled at her , his brown eyes glittering with amusement .


fn_spacy_tokens_for_baseline: To create a strong sense of place , the surroundings must be all of a piece ; space , mass , shapes , and materials must reflect the same sensibility .

source_bert_toks: to create a strong sense of place , the surroundings must be all of a piece ; space , mass , shapes , and materials must reflect the same sen ##sibility .

reference_raw: In order to create a strong feeling of place, the environment must be a whole; space, mass, shape, and material must reflect the same sensitivity.

reference_spacy_tokens: In order to create a strong feeling of place , the environment must be a whole ; space , mass , shape , and material must reflect the same sensitivity .


fn_spacy_tokens_for_baseline: President : Saddam Hussein has dominated Iraqi politics since the late 1970s with a small clique of relatives and supporters from his home town of Takrit in northern Iraq .

source_bert_toks: president : saddam hussein has dominated iraqi politics since the late 1970s with a small cl ##ique of relatives and supporters from his home town of tak ##rit in northern iraq .

reference_raw: President: Since the end of the 1970s, Saddam Hussein has dominated Iraqi politics with a small cluster of relatives and supporters from his hometown of Takrit in Northern Iraq.

reference_spacy_tokens: President : Since the end of the 1970s , Saddam Hussein has dominated Iraqi politics with a small cluster of relatives and supporters from his hometown of Takrit in Northern Iraq .


fn_spacy_tokens_for_baseline: Hoffmann landed prettily -- he was getting to like this machine -- and taxied behind a small truck in which an airman held up a board reading FOLLOW ME , until they got to a Heinkel 111 whose propellers were already spinning .

source_bert_toks: hoffmann landed pre ##tti ##ly - - he was getting to like this machine - - and taxi ##ed behind a small truck in which an air ##man held up a board reading follow me , until they got to a he ##ink ##el 111 whose propellers were already spinning .

reference_raw: Hoffmann landed nicely - he was beginning to like the machine - and took a cab behind a small truck in which an airman held up a board reading FOLLOW ME until they reached the Heinkel 111, whose propellers were already spinning.

reference_spacy_tokens: Hoffmann landed nicely - he was beginning to like the machine - and took a cab behind a small truck in which an airman held up a board reading FOLLOW ME until they reached the Heinkel 111 , whose propellers were already spinning .


fn_spacy_tokens_for_baseline: She had dabbed powder over her lipstick to rob it of its bright crimson lustre , and she had forgotten the little pink patches of rouge that gave her cheeks their rosy healthy glow .

source_bert_toks: she had da ##bbed powder over her lipstick to rob it of its bright crimson lust ##re , and she had forgotten the little pink patches of rouge that gave her cheeks their rosy healthy glow .

reference_raw: She dabbed dust on her lipstick to rob it of its bright crimson lustre, and she forgot the little pink spots of ruby that gave her a pink, healthy glow to her cheeks.

reference_spacy_tokens: She dabbed dust on her lipstick to rob it of its bright crimson lustre , and she forgot the little pink spots of ruby that gave her a pink , healthy glow to her cheeks .


fn_spacy_tokens_for_baseline: THIS year had more than its fair share of depressing news , but one TV programme managed to make light of it all .

source_bert_toks: this year had more than its fair share of de ##pressing news , but one tv programme managed to make light of it all .

reference_raw: This year had more than a fair share of the oppressive news, but one television program was able to make the whole thing clear.

reference_spacy_tokens: This year had more than a fair share of the oppressive news , but one television program was able to make the whole thing clear .


fn_spacy_tokens_for_baseline: Redundant handles scrape along the ground like entrails and get tangled up in pushchair wheels and unsuspecting dogs ' legs .

source_bert_toks: redundant handles scrape along the ground like en ##tra ##ils and get tangled up in push ##chai ##r wheels and un ##sus ##pe ##cting dogs ' legs .

reference_raw: Redundant handles scratch the ground like guts and get tangled up in push-chair wheels and unsuspecting dog legs.

reference_spacy_tokens: Redundant handles scratch the ground like guts and get tangled up in push - chair wheels and unsuspecting dog legs .


fn_spacy_tokens_for_baseline: He expects profits to dip this year from the estimated £ 580 m in the year just ended but reach £ 645 m next year .

source_bert_toks: he expects profits to dip this year from the estimated £5 ##80 ##m in the year just ended but reach £ ##64 ##5 ##m next year .

reference_raw: It expects that this year's profits will sink from the estimated £580 million of the year just ended, but it will reach £645 million next year.

reference_spacy_tokens: It expects that this year 's profits will sink from the estimated £ 580 million of the year just ended , but it will reach £ 645 million next year .


fn_spacy_tokens_for_baseline: A real love song is infinitely more appropriate for Christmas than a trashy song cooked up as a commercial gimmick .

source_bert_toks: a real love song is infinitely more appropriate for christmas than a trash ##y song cooked up as a commercial gi ##mm ##ick .

reference_raw: A true love song is infinitely more suitable for Christmas than a garbage song made up like a commercial trick.

reference_spacy_tokens: A true love song is infinitely more suitable for Christmas than a garbage song made up like a commercial trick .


fn_spacy_tokens_for_baseline: Chen Jia Ci , the Chen Family Institute ( open daily 8:30 am - 5 pm ) , was built in the late 19th century to promote arts and crafts .

source_bert_toks: chen jia ci , the chen family institute ( open daily 8 : 30 am - 5 pm ) , was built in the late 19th century to promote arts and crafts .

reference_raw: Chen Jia Ci, the Chen Family Institute (open daily at 8:30 - 5 p.m.), was built at the end of the 19th century for the promotion of arts and crafts.

reference_spacy_tokens: Chen Jia Ci , the Chen Family Institute ( open daily at 8:30 - 5 p.m. ) , was built at the end of the 19th century for the promotion of arts and crafts .


fn_spacy_tokens_for_baseline: In accordance with section 605 ( b ) ( 5 ) , the Commission notes that the proposed Rule and Order does not duplicate , overlap or conflict with any other relevant federal rule .

source_bert_toks: in accordance with section 60 ##5 ( b ) ( 5 ) , the commission notes that the proposed rule and order does not duplicate , overlap or conflict with any other relevant federal rule .

reference_raw: In accordance with Article 605(b)(5), the Commission notes that the proposed regulation does not duplicate, overlap or conflict with any other relevant federal rule.

reference_spacy_tokens: In accordance with Article 605(b)(5 ) , the Commission notes that the proposed regulation does not duplicate , overlap or conflict with any other relevant federal rule .


fn_spacy_tokens_for_baseline: It is functional , and gives very encouraging results .

source_bert_toks: it is functional , and gives very encouraging results .

reference_raw: It's operational, and it produces very encouraging results.

reference_spacy_tokens: It 's operational , and it produces very encouraging results .


fn_spacy_tokens_for_baseline: Engines roaring , it swooped in to land , braking hard as its wheels touched the wide runway which was crossed halfway along by the single road connecting the British colony to the Spanish mainland .

source_bert_toks: engines roaring , it sw ##ooped in to land , braking hard as its wheels touched the wide runway which was crossed halfway along by the single road connecting the british colony to the spanish mainland .

reference_raw: The engines roared and he swooped down, braked hard as his wheels touched a wide track that was halfway along a single road linking the British colony to the Spanish mainland.

reference_spacy_tokens: The engines roared and he swooped down , braked hard as his wheels touched a wide track that was halfway along a single road linking the British colony to the Spanish mainland .


fn_spacy_tokens_for_baseline: The Faroe Islands , halfway between Scotland and Iceland in the stormy North Atlantic Ocean , were colonised some 1000 years ago by the Vikings .

source_bert_toks: the far ##oe islands , halfway between scotland and iceland in the stormy north atlantic ocean , were colon ##ised some 1000 years ago by the vikings .

reference_raw: The Faroe Islands, halfway between Scotland and Iceland, were colonized about a thousand years ago by the Vikings in the turbulent North Atlantic Ocean.

reference_spacy_tokens: The Faroe Islands , halfway between Scotland and Iceland , were colonized about a thousand years ago by the Vikings in the turbulent North Atlantic Ocean .


fn_spacy_tokens_for_baseline: All I can tell you about him is that he was an ensign flying a Catalina aircraft in England thirty - two years ago . '

source_bert_toks: all i can tell you about him is that he was an ensign flying a catalina aircraft in england thirty - two years ago . '

reference_raw: All I can tell you about him is that thirty-two years ago he was an ensign on a Catalina plane in England.'

reference_spacy_tokens: All I can tell you about him is that thirty - two years ago he was an ensign on a Catalina plane in England . '


fn_spacy_tokens_for_baseline: Salvation , finally , appeared out of the blue one night in the shape of up - and - coming young trainer Nigel Twiston - Davies .

source_bert_toks: salvation , finally , appeared out of the blue one night in the shape of up - and - coming young trainer nigel twist ##on - davies .

reference_raw: Salvation finally appeared out of the blue one night in the form of an upcoming young coach, Nigel Twiston-Davies.

reference_spacy_tokens: Salvation finally appeared out of the blue one night in the form of an upcoming young coach , Nigel Twiston - Davies .


fn_spacy_tokens_for_baseline: Regarding the strikes , disputes and restrictive practices which had plagued the Dublin plant , these were all unfortunate legacies of the British system which had been foisted upon the Irish since before the First World War .

source_bert_toks: regarding the strikes , disputes and restrictive practices which had plagued the dublin plant , these were all unfortunate leg ##acies of the british system which had been f ##ois ##ted upon the irish since before the first world war .

reference_raw: As for the strikes, litigations and restrictive practices that had plagued the Dublin plant, these were all the unfortunate legacies of the British system that had been encroached on the Irish since before World War I.

reference_spacy_tokens: As for the strikes , litigations and restrictive practices that had plagued the Dublin plant , these were all the unfortunate legacies of the British system that had been encroached on the Irish since before World War I.


fn_spacy_tokens_for_baseline: ' Get on ! ' rasped someone .

source_bert_toks: ' get on ! ' rasped someone .

reference_raw: 'Come on!' someone snapped.

reference_spacy_tokens: ' Come on ! ' someone snapped .


fn_spacy_tokens_for_baseline: It proposed a raft of new taxes and incentives to promote ecological economics .

source_bert_toks: it proposed a raft of new taxes and incentives to promote ecological economics .

reference_raw: It suggested a raft of new taxes and incentives to promote the green economy.

reference_spacy_tokens: It suggested a raft of new taxes and incentives to promote the green economy .


fn_spacy_tokens_for_baseline: FCC regulations may require the new Viacom to sell a few of its TV stations -- because there 's a rule saying one company ca n't own stations that serve more than 35 percent of the United States -- and to either spin off or fold in the still - struggling UPN .

source_bert_toks: fcc regulations may require the new via ##com to sell a few of its tv stations - - because there ' s a rule saying one company can ' t own stations that serve more than 35 percent of the united states - - and to either spin off or fold in the still - struggling up ##n .

reference_raw: The FCC regulations may require the new Viacom to sell several of its television stations - because there is a rule that one company cannot own a station that serves more than 35 percent of the United States - and that it can either rotate or rotate in a still-struggling UPN.

reference_spacy_tokens: The FCC regulations may require the new Viacom to sell several of its television stations - because there is a rule that one company can not own a station that serves more than 35 percent of the United States - and that it can either rotate or rotate in a still - struggling UPN .


fn_spacy_tokens_for_baseline: On certain points this had meant that the Palestinian delegation complied in form but not in substance with Israeli preconditions .

source_bert_toks: on certain points this had meant that the palestinian delegation complied in form but not in substance with israeli pre ##con ##dition ##s .

reference_raw: In some respects, this meant that the Palestinian delegation was fulfilling Israeli prerogatives in form, but not in substance.

reference_spacy_tokens: In some respects , this meant that the Palestinian delegation was fulfilling Israeli prerogatives in form , but not in substance .


fn_spacy_tokens_for_baseline: By speaking out about envy between women , comedy can play a part in helping us to heal it in ourselves .

source_bert_toks: by speaking out about envy between women , comedy can play a part in helping us to heal it in ourselves .

reference_raw: By speaking of jealousy among women, comedy can play a role in helping us heal ourselves.

reference_spacy_tokens: By speaking of jealousy among women , comedy can play a role in helping us heal ourselves .


fn_spacy_tokens_for_baseline: This experiment was carried out in a dedicated growth room with walls well masked with charcoal - grey cartridge paper .

source_bert_toks: this experiment was carried out in a dedicated growth room with walls well masked with charcoal - grey cartridge paper .

reference_raw: The experiment was carried out in a special growth room with walls well covered with charcoal-grey shellpaper.

reference_spacy_tokens: The experiment was carried out in a special growth room with walls well covered with charcoal - grey shellpaper .


fn_spacy_tokens_for_baseline: She has a dark look , the bad girl child who will gobble you up . '

source_bert_toks: she has a dark look , the bad girl child who will go ##bble you up . '

reference_raw: He's got a dark look, a bad little girl who'll eat you up.'

reference_spacy_tokens: He 's got a dark look , a bad little girl who 'll eat you up . '


fn_spacy_tokens_for_baseline: Martha scented a fresh aroma of cleanliness and toiletries as her mother kissed her .

source_bert_toks: martha scented a fresh aroma of clean ##liness and toilet ##ries as her mother kissed her .

reference_raw: When her mother kissed her, Martha smelled a new smell of cleanliness and toiletries.

reference_spacy_tokens: When her mother kissed her , Martha smelled a new smell of cleanliness and toiletries .


fn_spacy_tokens_for_baseline: The South African experience demonstrates that at least under some conditions , unilateral disarmament is not only possible , but can improve a nation 's security .

source_bert_toks: the south african experience demonstrates that at least under some conditions , un ##ila ##tera ##l di ##sar ##mament is not only possible , but can improve a nation ' s security .

reference_raw: Experience in South Africa shows that unilateral disarmament is not only possible under certain circumstances, but can also improve national security.

reference_spacy_tokens: Experience in South Africa shows that unilateral disarmament is not only possible under certain circumstances , but can also improve national security .


fn_spacy_tokens_for_baseline: Even though Mr. Darcy is deeply offended by Elizabeth 's low rank in society and that of her family 's behaviour , especially Mrs. Bennet and her younger daughters , Darcy still proposes to Elizabeth .

source_bert_toks: even though mr . darcy is deeply offended by elizabeth ' s low rank in society and that of her family ' s behaviour , especially mrs . ben ##net and her younger daughters , darcy still proposes to elizabeth .

reference_raw: Although Mr. Darcy is deeply insulted by Elizabeth's low rank in society and the behavior of her family, especially Mrs. Bennet and her younger daughters, Darcy is still proposing to Elizabeth.

reference_spacy_tokens: Although Mr. Darcy is deeply insulted by Elizabeth 's low rank in society and the behavior of her family , especially Mrs. Bennet and her younger daughters , Darcy is still proposing to Elizabeth .


fn_spacy_tokens_for_baseline: On the outer rim of the solar system , where the planets roll , lax , dark and lifeless , appeared nine small white points of light which were definitely not registered upon any directory of the heavens .

source_bert_toks: on the outer rim of the solar system , where the planets roll , lax , dark and lifeless , appeared nine small white points of light which were definitely not registered upon any directory of the heavens .

reference_raw: On the outskirts of the solar system, where the planets were rolling, lax, dark and lifeless, there were nine tiny white spots of light that were definitely not registered in any directory in the sky.

reference_spacy_tokens: On the outskirts of the solar system , where the planets were rolling , lax , dark and lifeless , there were nine tiny white spots of light that were definitely not registered in any directory in the sky .


fn_spacy_tokens_for_baseline: He recalled how as a five - year - old he had ridden on the back of a huge sow , beating it with a twig as the men stood around and laughed and the women sharpened the knives .

source_bert_toks: he recalled how as a five - year - old he had ridden on the back of a huge so ##w , beating it with a t ##wig as the men stood around and laughed and the women sharpened the knives .

reference_raw: He remembered how he had ridden, like a five-year-old, on the back of a huge sow, and he had beaten it with a stick while the men stood around laughing and the women were sharping their knives.

reference_spacy_tokens: He remembered how he had ridden , like a five - year - old , on the back of a huge sow , and he had beaten it with a stick while the men stood around laughing and the women were sharping their knives .


fn_spacy_tokens_for_baseline: Turkey and Syria maintain healthy trade and diplomatic relations and sending security and trade officials could be seen as a veiled warning to Syria .

source_bert_toks: turkey and syria maintain healthy trade and diplomatic relations and sending security and trade officials could be seen as a veil ##ed warning to syria .

reference_raw: Turkey and Syria maintain healthy trade and diplomatic relations, and sending security and trade officials could be seen as a veiled alert to Syria.

reference_spacy_tokens: Turkey and Syria maintain healthy trade and diplomatic relations , and sending security and trade officials could be seen as a veiled alert to Syria .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali gunmen who hijacked the United Nations - a chartered vessel carrying a meal aid to victims of tsunamis released the ship after holding it for more than two months.

reference_spacy_tokens: According to the United Nations , Somali gunmen who hijacked the United Nations - a chartered vessel carrying a meal aid to victims of tsunamis released the ship after holding it for more than two months .


fn_spacy_tokens_for_baseline: Israel has lost a lot of their you know value to the US in being you know the foothold of capitalism

source_bert_toks: israel has lost a lot of their you know value to the us in being you know the foot ##hold of capitalism

reference_raw: Israel has forfeited a great deal of its value to the United States because you know the basis of capitalism.

reference_spacy_tokens: Israel has forfeited a great deal of its value to the United States because you know the basis of capitalism .


fn_spacy_tokens_for_baseline: A moment or two later a man who , from his lanky form and fine - boned features , could only be her fiance , Lord Woodleigh , emerged , evidently doing his best to overcome a certain reluctance .

source_bert_toks: a moment or two later a man who , from his lan ##ky form and fine - bone ##d features , could only be her fiance , lord wood ##leigh , emerged , evidently doing his best to overcome a certain reluctance .

reference_raw: A moment or two later, a man who, from his slender body and fine-boned features, could only be her fiancé, Lord Woodleigh, appeared, apparently doing his best to overcome a certain reluctance.

reference_spacy_tokens: A moment or two later , a man who , from his slender body and fine - boned features , could only be her fiance , Lord Woodleigh , appeared , apparently doing his best to overcome a certain reluctance .


fn_spacy_tokens_for_baseline: The bookie 's head bobbed .

source_bert_toks: the book ##ie ' s head bobbed .

reference_raw: The bookie shook his head.

reference_spacy_tokens: The bookie shook his head .


fn_spacy_tokens_for_baseline: Lord MacLean told MacIver , who drove the lorry after the robbery : ' You may not have occupied a principal role , but you played an essential one .

source_bert_toks: lord maclean told mac ##iver , who drove the lo ##rry after the robbery : ' you may not have occupied a principal role , but you played an essential one .

reference_raw: Lord MacLean said to MacIver, who was in charge of the truck after the robbery: 'You may not have played the main role, but you played the most important role.

reference_spacy_tokens: Lord MacLean said to MacIver , who was in charge of the truck after the robbery : ' You may not have played the main role , but you played the most important role .


fn_spacy_tokens_for_baseline: Part of the impetus had been the growing frustration felt by women in the voluntary work committees that they and the issues which concerned them tended to be elbowed aside by men .

source_bert_toks: part of the impetus had been the growing frustration felt by women in the voluntary work committees that they and the issues which concerned them tended to be elbow ##ed aside by men .

reference_raw: Part of the impulse was the growing frustration of women on the voluntary work committees that they and the issues that concerned them tended to be pushed aside by men.

reference_spacy_tokens: Part of the impulse was the growing frustration of women on the voluntary work committees that they and the issues that concerned them tended to be pushed aside by men .


fn_spacy_tokens_for_baseline: ' No , it 'll be a night out I would guess , although I 'm for home myself first , to get some shuteye .

source_bert_toks: ' no , it ' ll be a night out i would guess , although i ' m for home myself first , to get some shut ##eye .

reference_raw: 'No, it's going to be a night out, I'd say, even though it's up to me to get a closet first.

reference_spacy_tokens: ' No , it 's going to be a night out , I 'd say , even though it 's up to me to get a closet first .


fn_spacy_tokens_for_baseline: It takes as long as it does for a dog to douse a tree trunk .

source_bert_toks: it takes as long as it does for a dog to do ##use a tree trunk .

reference_raw: It takes as long as it takes a dog to use the trunk of a tree.

reference_spacy_tokens: It takes as long as it takes a dog to use the trunk of a tree .


fn_spacy_tokens_for_baseline: I 'll show you the cloakroom . "

source_bert_toks: i ' ll show you the cloak ##room . "

reference_raw: Let me show you the camouflage room.

reference_spacy_tokens: Let me show you the camouflage room .


fn_spacy_tokens_for_baseline: The meetings in Pakistan were the first face - to - face talks that involved all the warring groups , including ousted President Burhanuddin Rabbani 's faction that is allied with Dostum .

source_bert_toks: the meetings in pakistan were the first face - to - face talks that involved all the warring groups , including ousted president bu ##rh ##anu ##ddin ra ##bba ##ni ' s faction that is allied with dos ##tum .

reference_raw: Meetings in Pakistan were the first face-to-face talks involving all combat groups, including the ousted faction of President Burhanuddin Rabbani, an ally of Dostum.

reference_spacy_tokens: Meetings in Pakistan were the first face - to - face talks involving all combat groups , including the ousted faction of President Burhanuddin Rabbani , an ally of Dostum .


fn_spacy_tokens_for_baseline: A cloud occludes the mountain 's foot

source_bert_toks: a cloud o ##cc ##lu ##des the mountain ' s foot

reference_raw: The mountain's foot is surrounded by a cloud

reference_spacy_tokens: The mountain 's foot is surrounded by a cloud


fn_spacy_tokens_for_baseline: The voice came from an oblong metal plaque like a dulled mirror which formed part of the surface of the right - hand wall .

source_bert_toks: the voice came from an ob ##long metal plaque like a dull ##ed mirror which formed part of the surface of the right - hand wall .

reference_raw: The voice came from a long metal plate, like a dulled mirror that was part of the right-hand wall.

reference_spacy_tokens: The voice came from a long metal plate , like a dulled mirror that was part of the right - hand wall .


fn_spacy_tokens_for_baseline: Again , I do not have all of the information for July and August , so I can not give you any numbers .

source_bert_toks: again , i do not have all of the information for july and august , so i can not give you any numbers .

reference_raw: Once again, I don't have all the information for July and August, and I can't give you any numbers.

reference_spacy_tokens: Once again , I do n't have all the information for July and August , and I ca n't give you any numbers .


fn_spacy_tokens_for_baseline: I 'm terrible with prices .

source_bert_toks: i ' m terrible with prices .

reference_raw: I'm awful at prices.

reference_spacy_tokens: I 'm awful at prices .


fn_spacy_tokens_for_baseline: A gasifier is a furnace which is bolted to a vehicle , and produces a combustible gas by burning biomass in a restricted air supply ; the gas replaces petrol or diesel .

source_bert_toks: a gas ##ifier is a furnace which is bolted to a vehicle , and produces a comb ##ust ##ible gas by burning biomass in a restricted air supply ; the gas replaces petrol or diesel .

reference_raw: The gasifier is a kiln that is fastened to the vehicle and produces a flammable gas by burning biomass in a limited air supply; the gas replaces petrol or diesel.

reference_spacy_tokens: The gasifier is a kiln that is fastened to the vehicle and produces a flammable gas by burning biomass in a limited air supply ; the gas replaces petrol or diesel .


fn_spacy_tokens_for_baseline: ' My donation for the wine . '

source_bert_toks: ' my donation for the wine . '

reference_raw: "My gift for wine."

reference_spacy_tokens: " My gift for wine . "


fn_spacy_tokens_for_baseline: No , if they find one cure for it .

source_bert_toks: no , if they find one cure for it .

reference_raw: Not if they can find one medicine.

reference_spacy_tokens: Not if they can find one medicine .


fn_spacy_tokens_for_baseline: Those groups and individuals most likely to engage in terrorism with chemical or biological weapons lie at the intersection of three attributes : ( 1 ) motivation , ( 2 ) organizational structure , and ( 3 ) technical capability .

source_bert_toks: those groups and individuals most likely to engage in terrorism with chemical or biological weapons lie at the intersection of three attributes : ( 1 ) motivation , ( 2 ) organizational structure , and ( 3 ) technical capability .

reference_raw: These groups and individuals most likely to engage in terrorism with chemical or biological weapons are at the crossroads of three attributes: (1) motivation, (2) organisational structure, and (3) technical capabilities.

reference_spacy_tokens: These groups and individuals most likely to engage in terrorism with chemical or biological weapons are at the crossroads of three attributes : ( 1 ) motivation , ( 2 ) organisational structure , and ( 3 ) technical capabilities .


fn_spacy_tokens_for_baseline: A raging snow blizzard envelops a unit within 18 " , and the driving ice - laden winds bring the unit to a halt .

source_bert_toks: a raging snow blizzard en ##vel ##ops a unit within 18 " , and the driving ice - laden winds bring the unit to a halt .

reference_raw: The raging snowstorm envelops the unit within 18", and the driving winds of the ice-laden winds stop the unit.

reference_spacy_tokens: The raging snowstorm envelops the unit within 18 " , and the driving winds of the ice - laden winds stop the unit .


fn_spacy_tokens_for_baseline: These are likely to be of great importance when prescribing the remedy for a patient .

source_bert_toks: these are likely to be of great importance when pre ##sc ##ri ##bing the remedy for a patient .

reference_raw: They are likely to be very important when prescribing the medicine for the patient.

reference_spacy_tokens: They are likely to be very important when prescribing the medicine for the patient .


fn_spacy_tokens_for_baseline: But the kaiser pleased the tsar by vetoing Prince Alexander 's return to the Bulgarian throne .

source_bert_toks: but the kaiser pleased the tsar by veto ##ing prince alexander ' s return to the bulgarian throne .

reference_raw: But the Emperor delighted the Czar by vetoing the return of Prince Alexander to the Bulgarian throne.

reference_spacy_tokens: But the Emperor delighted the Czar by vetoing the return of Prince Alexander to the Bulgarian throne .


fn_spacy_tokens_for_baseline: Corbett and Thomas were now riding across open meadowland and the poet pointed to three hills , black and stark against the summer - blue sky .

source_bert_toks: corbett and thomas were now riding across open meadow ##land and the poet pointed to three hills , black and stark against the summer - blue sky .

reference_raw: Corbett and Thomas were now riding across open meadows, and the poet pointed to three hills, black and stark against the summer blue sky.

reference_spacy_tokens: Corbett and Thomas were now riding across open meadows , and the poet pointed to three hills , black and stark against the summer blue sky .


fn_spacy_tokens_for_baseline: A man , who had tried to force his way past the tipstaffs , was being violently ejected , and , as he disappeared , he waved a paper toward Mr. Thorndike .

source_bert_toks: a man , who had tried to force his way past the tips ##taff ##s , was being violently ejected , and , as he disappeared , he waved a paper toward mr . thorn ##di ##ke .

reference_raw: One of the men who had tried to force his way past the tipstaffs had been ejected violently, and when he was gone, he waved a newspaper at Mr. Thorndike.

reference_spacy_tokens: One of the men who had tried to force his way past the tipstaffs had been ejected violently , and when he was gone , he waved a newspaper at Mr. Thorndike .


fn_spacy_tokens_for_baseline: It was amazing how people did rally round at times like this .

source_bert_toks: it was amazing how people did rally round at times like this .

reference_raw: It was wonderful how people gathered around at a time like this.

reference_spacy_tokens: It was wonderful how people gathered around at a time like this .


fn_spacy_tokens_for_baseline: Then she unzipped her handbag , took out the cassette and placed it on top of the envelope .

source_bert_toks: then she un ##zi ##pped her hand ##bag , took out the cassette and placed it on top of the envelope .

reference_raw: Then she opened her purse, took out the tape, and placed it on the cover.

reference_spacy_tokens: Then she opened her purse , took out the tape , and placed it on the cover .


fn_spacy_tokens_for_baseline: But missing the summit of a tower means you ca n't leave your name and a message to the future in the route book , usually found in a flag - like tin box on the top .

source_bert_toks: but missing the summit of a tower means you can ' t leave your name and a message to the future in the route book , usually found in a flag - like tin box on the top .

reference_raw: But missing the top of the tower means you can't leave your name and a message for the future in the routing book, which is usually found in a flag-shaped tin box at the top.

reference_spacy_tokens: But missing the top of the tower means you ca n't leave your name and a message for the future in the routing book , which is usually found in a flag - shaped tin box at the top .


fn_spacy_tokens_for_baseline: The rector felt a little inner agitation at this news , but did his best to look disappointed at Ella 's temporary absence .

source_bert_toks: the rector felt a little inner agitation at this news , but did his best to look disappointed at ella ' s temporary absence .

reference_raw: The rector was a little excited about the news, but he did his best to look disappointed by Ella's temporary absence.

reference_spacy_tokens: The rector was a little excited about the news , but he did his best to look disappointed by Ella 's temporary absence .


fn_spacy_tokens_for_baseline: He 's garnered the accolades and the money that have come his way by being good at his job , by knowing his strengths , and by a modicum of luck .

source_bert_toks: he ' s garnered the accolades and the money that have come his way by being good at his job , by knowing his strengths , and by a mod ##icum of luck .

reference_raw: He had garnered the accolades and the money that had come to him because he was good at his work, because he knew his strength, and because he was lucky.

reference_spacy_tokens: He had garnered the accolades and the money that had come to him because he was good at his work , because he knew his strength , and because he was lucky .


fn_spacy_tokens_for_baseline: A rosette of tomato garnished a slice of green and pink asparagus and smoked - salmon terrine topped with a teaspoonful of dill mayonnaise and a tiny crescent of puff pastry .

source_bert_toks: a rose ##tte of tomato ga ##rn ##ished a slice of green and pink as ##para ##gus and smoked - salmon terri ##ne topped with a tea ##sp ##oon ##ful of dil ##l mayo ##nna ##ise and a tiny crescent of puff pastry .

reference_raw: A rosette of tomato painted a piece of green and pink asparagus and a smoky salmon terrine with a spoonful of dill mayonnaise and a tiny crescent of puffy pastry.

reference_spacy_tokens: A rosette of tomato painted a piece of green and pink asparagus and a smoky salmon terrine with a spoonful of dill mayonnaise and a tiny crescent of puffy pastry .


fn_spacy_tokens_for_baseline: Of his attempts to realize this experience over again in his post - Siberian fiction , the bald Epilogue to Crime and Punishment is an early and unpromising instance .

source_bert_toks: of his attempts to realize this experience over again in his post - siberian fiction , the bald epilogue to crime and punishment is an early and un ##promising instance .

reference_raw: Of his attempts to re-examine this experience in his post-Siberian fiction, the bald episode of crime and punishment is an early and unpromising example.

reference_spacy_tokens: Of his attempts to re - examine this experience in his post - Siberian fiction , the bald episode of crime and punishment is an early and unpromising example .


fn_spacy_tokens_for_baseline: Her face was always carefully rouged , her mouth daubed generously with salve .

source_bert_toks: her face was always carefully rouge ##d , her mouth da ##ub ##ed generous ##ly with sal ##ve .

reference_raw: Her face was always carefully raised, and her mouth was generously dubbed with salves.

reference_spacy_tokens: Her face was always carefully raised , and her mouth was generously dubbed with salves .


fn_spacy_tokens_for_baseline: 1:11 a.m. RD : Building on the corner severely damaged , so an old lady and her very old mother are in the guest room .

source_bert_toks: 1 : 11 a . m . rd : building on the corner severely damaged , so an old lady and her very old mother are in the guest room .

reference_raw: 1:11 a.m. RD: The building on the corner is badly damaged, so the old lady and her very old mother are in the visitor's room.

reference_spacy_tokens: 1:11 a.m. RD : The building on the corner is badly damaged , so the old lady and her very old mother are in the visitor 's room .


fn_spacy_tokens_for_baseline: A question asking pupils to interpret a 2-D depiction of a 3-D situation was included in the GT4 reference test and reported earlier ( p.40 ) .

source_bert_toks: a question asking pupils to interpret a 2 - d depiction of a 3 - d situation was included in the gt ##4 reference test and reported earlier ( p . 40 ) .

reference_raw: The question asking pupils to interpret the 2-D representation of the 3-D situation was included in the GT4 reference test and reported earlier (p.40).

reference_spacy_tokens: The question asking pupils to interpret the 2-D representation of the 3-D situation was included in the GT4 reference test and reported earlier ( p.40 ) .


fn_spacy_tokens_for_baseline: The rich sculptural effects on the facade mix Eastern and Western symbols : familiar saints , Chinese dragons , and a Portuguese caravel .

source_bert_toks: the rich sc ##ul ##pt ##ural effects on the facade mix eastern and western symbols : familiar saints , chinese dragons , and a portuguese cara ##vel .

reference_raw: The rich sculptural effects of the facade combine the Eastern and Western symbols: the familiar saints, the Chinese dragons, and the Portuguese caravel.

reference_spacy_tokens: The rich sculptural effects of the facade combine the Eastern and Western symbols : the familiar saints , the Chinese dragons , and the Portuguese caravel .


fn_spacy_tokens_for_baseline: It is unfortunate that recent re - building has destroyed the loft .

source_bert_toks: it is unfortunate that recent re - building has destroyed the loft .

reference_raw: Unfortunately, the recent rebuilding destroyed the attic.

reference_spacy_tokens: Unfortunately , the recent rebuilding destroyed the attic .


fn_spacy_tokens_for_baseline: A trial date had finally been set for 17 June 1991 , but given the obvious flimsiness of the case , he was still concerned that somebody within the DEA might be tempted into direct action .

source_bert_toks: a trial date had finally been set for 17 june 1991 , but given the obvious fl ##im ##sin ##ess of the case , he was still concerned that somebody within the dea might be tempted into direct action .

reference_raw: Finally, the trial date was set for 17 June 1991, but given the obvious flimsy of the case, he was still concerned that someone in the DEA might be tempted to act directly.

reference_spacy_tokens: Finally , the trial date was set for 17 June 1991 , but given the obvious flimsy of the case , he was still concerned that someone in the DEA might be tempted to act directly .


fn_spacy_tokens_for_baseline: On the 14th of February 1826 Knott and Taylor partnered in a 21 year lease ( from the Rt .

source_bert_toks: on the 14th of february 1826 knot ##t and taylor partnered in a 21 year lease ( from the rt .

reference_raw: On February 14, 1826, Knott and Taylor entered into a 21-year lease (from RT.

reference_spacy_tokens: On February 14 , 1826 , Knott and Taylor entered into a 21-year lease ( from RT .


fn_spacy_tokens_for_baseline: I 'm not going to advise the trustees to release the inheritance even if you do continue , so you may as well get rid of her .

source_bert_toks: i ' m not going to advise the trustees to release the inheritance even if you do continue , so you may as well get rid of her .

reference_raw: I won't tell the trustees to release the inheritance even if you continue, so you can get rid of it.

reference_spacy_tokens: I wo n't tell the trustees to release the inheritance even if you continue , so you can get rid of it .


fn_spacy_tokens_for_baseline: Suddenly the night had erupted into a confusion of fire , noise and light , as first the house had erupted in flames and then five heavy vehicles had come roaring up the twisting driveway , headlights blazing .

source_bert_toks: suddenly the night had erupted into a confusion of fire , noise and light , as first the house had erupted in flames and then five heavy vehicles had come roaring up the twisting driveway , headlights blazing .

reference_raw: Suddenly the night erupted into a confusion of fire, noise, and light, as the house first exploded into flames, and then five heavy vehicles roared up the winding driveway, their headlights blazing.

reference_spacy_tokens: Suddenly the night erupted into a confusion of fire , noise , and light , as the house first exploded into flames , and then five heavy vehicles roared up the winding driveway , their headlights blazing .


fn_spacy_tokens_for_baseline: The patrol dismounted from their vehicles and , having informed the battalion operations room of their find , deployed around the bank to await the arrival of the RUC .

source_bert_toks: the patrol dismounted from their vehicles and , having informed the battalion operations room of their find , deployed around the bank to await the arrival of the ru ##c .

reference_raw: The patrol had disembarked from their vehicles and, after informing the battalion's operations room of their discovery, had been stationed around the bank to await the arrival of the RUC.

reference_spacy_tokens: The patrol had disembarked from their vehicles and , after informing the battalion 's operations room of their discovery , had been stationed around the bank to await the arrival of the RUC .


fn_spacy_tokens_for_baseline: She swaggered out of the door like a Mississippi gambler .

source_bert_toks: she sw ##agger ##ed out of the door like a mississippi gamble ##r .

reference_raw: She swam out the door like a Mississippi player.

reference_spacy_tokens: She swam out the door like a Mississippi player .


fn_spacy_tokens_for_baseline: HONG Kong will not buckle at the knees over disagreements with China , its governor Chris Patten vowed yesterday .

source_bert_toks: hong kong will not buckle at the knees over disagreements with china , its governor chris pat ##ten vowed yesterday .

reference_raw: Hong Kong won't be knee-deep because of a disagreement with China, which was promised last night by its President Chris Patten.

reference_spacy_tokens: Hong Kong wo n't be knee - deep because of a disagreement with China , which was promised last night by its President Chris Patten .


fn_spacy_tokens_for_baseline: Lazarsfeld 's contribution to the development of variable analysis was pivotal both as thinker and as teacher .

source_bert_toks: la ##zar ##sf ##eld ' s contribution to the development of variable analysis was pivotal both as think ##er and as teacher .

reference_raw: The contribution of Lazarsfeld to developing variable analysis was crucial both as a thinker and as a teacher.

reference_spacy_tokens: The contribution of Lazarsfeld to developing variable analysis was crucial both as a thinker and as a teacher .


fn_spacy_tokens_for_baseline: The posse of television trucks obscured the view for many , but Schumacher had been careful to ensure that his speaker system would at least enable them to hear if not to see .

source_bert_toks: the posse of television trucks obscured the view for many , but schumacher had been careful to ensure that his speaker system would at least enable them to hear if not to see .

reference_raw: The pose of the TV trucks obscured the view for many, but Schumacher was careful to make sure that the speaker system would at least let them hear it if they didn't see it.

reference_spacy_tokens: The pose of the TV trucks obscured the view for many , but Schumacher was careful to make sure that the speaker system would at least let them hear it if they did n't see it .


fn_spacy_tokens_for_baseline: Many people dislike its close connection to industrialisation , and would concur with George Gissing 's abhorrence of machinery , expressed in 1895 in his novel , Eve 's Ransom .

source_bert_toks: many people dislike its close connection to industrial ##isation , and would con ##cu ##r with george gi ##ssing ' s ab ##hor ##rence of machinery , expressed in 1895 in his novel , eve ' s ransom .

reference_raw: Many people don't like its close association with industrialization, and would agree with George Gissing's abomination of machinery, expressed in 1895 in his novel, Eva's Ransom.

reference_spacy_tokens: Many people do n't like its close association with industrialization , and would agree with George Gissing 's abomination of machinery , expressed in 1895 in his novel , Eva 's Ransom .


fn_spacy_tokens_for_baseline: ( NYT_ENG _ 20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for a lung ailment that he contracted on Robben Island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

source_bert_toks: ( ny ##t _ eng _ 2013 ##0 ##6 ##25 . 00 ##44 ) meanwhile , in pretoria , doctors continued to treat mandela for a lung ai ##lm ##ent that he contracted on robb ##en island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

reference_raw: (NYT_ENG_20130625.0044) Meanwhile, in Pretoria, doctors continued to treat Mandela for the lung disease he had contracted on Robben Island, the infamous apartheid-era prison where he had spent most of his 27 years in prison until his release in 1990.

reference_spacy_tokens: ( NYT_ENG_20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for the lung disease he had contracted on Robben Island , the infamous apartheid - era prison where he had spent most of his 27 years in prison until his release in 1990 .


fn_spacy_tokens_for_baseline: As long as the basic construction of NiCad batteries has n't changed , I can see no justification for complete discharge and agree that it stands a good chance of being harmful .

source_bert_toks: as long as the basic construction of nic ##ad batteries hasn ' t changed , i can see no justification for complete discharge and agree that it stands a good chance of being harmful .

reference_raw: As long as the basic construction of the NiCad batteries is unchanged, I see no reason for a full discharge, and I agree that there is a good chance of harm.

reference_spacy_tokens: As long as the basic construction of the NiCad batteries is unchanged , I see no reason for a full discharge , and I agree that there is a good chance of harm .


fn_spacy_tokens_for_baseline: -- Debt securities may be retired prior to maturity if they have a call feature or if they are eligible for redemption by the holder on demand .

source_bert_toks: - - debt securities may be retired prior to maturity if they have a call feature or if they are eligible for redemption by the holder on demand .

reference_raw: -- Debt securities can be retired before the due date if they have a call feature or are eligible to be redeemed by the holder on demand.

reference_spacy_tokens: -- Debt securities can be retired before the due date if they have a call feature or are eligible to be redeemed by the holder on demand .


fn_spacy_tokens_for_baseline: He crossed the glade without hesitation and plunged up the path after the horses .

source_bert_toks: he crossed the glad ##e without hesitation and plunged up the path after the horses .

reference_raw: Without hesitation he crossed the clearing and plunged down the trail behind the horses.

reference_spacy_tokens: Without hesitation he crossed the clearing and plunged down the trail behind the horses .


fn_spacy_tokens_for_baseline: ' The women are occupying the cabin indefinitely to ensure that the plight of the pit remains in the public domain , ' said a spokeswoman late last night .

source_bert_toks: ' the women are occupying the cabin indefinitely to ensure that the plight of the pit remains in the public domain , ' said a spoke ##sw ##oman late last night .

reference_raw: "Women occupy the hut indefinitely to make sure the problem of the pit stays in the public domain," the spokesman said late last night.

reference_spacy_tokens: " Women occupy the hut indefinitely to make sure the problem of the pit stays in the public domain , " the spokesman said late last night .


fn_spacy_tokens_for_baseline: Killion put down his glass and used the Frenchman 's necktie as a towel to mop his face .

source_bert_toks: kill ##ion put down his glass and used the frenchman ' s neck ##tie as a towel to mo ##p his face .

reference_raw: Killion put down his glass and wiped his face with the Frenchman's tie as a towel.

reference_spacy_tokens: Killion put down his glass and wiped his face with the Frenchman 's tie as a towel .


fn_spacy_tokens_for_baseline: The decision to abandon the Pavillon de Flore as a permanent exhibition space goes back to an official report drawn up before I.M. Pei started work on renovating the Museum and building his pyramid .

source_bert_toks: the decision to abandon the pa ##vill ##on de fl ##ore as a permanent exhibition space goes back to an official report drawn up before i . m . pei started work on reno ##vating the museum and building his pyramid .

reference_raw: The decision to leave the Pavillon de Flore as a permanent exhibition site goes back to the official report drawn up before I.M. Pei began to work on the renovation of the museum and the construction of it.

reference_spacy_tokens: The decision to leave the Pavillon de Flore as a permanent exhibition site goes back to the official report drawn up before I.M. Pei began to work on the renovation of the museum and the construction of it .


fn_spacy_tokens_for_baseline: Massive tidal waves swept over Crete , and other parts of the Mediterranean , smashing buildings and drowning many thousands of people .

source_bert_toks: massive tidal waves swept over crete , and other parts of the mediterranean , smashing buildings and drowning many thousands of people .

reference_raw: Huge tidal waves swept over Crete and other parts of the Mediterranean, smashing buildings and drowning thousands of people.

reference_spacy_tokens: Huge tidal waves swept over Crete and other parts of the Mediterranean , smashing buildings and drowning thousands of people .


fn_spacy_tokens_for_baseline: Alexei felt Siban 's wrist bones grate together under his hand , and he eased the pressure he was exerting , ashamed at his use of force against an old man .

source_bert_toks: alexei felt si ##ban ' s wrist bones gr ##ate together under his hand , and he eased the pressure he was ex ##ert ##ing , ashamed at his use of force against an old man .

reference_raw: Alexei felt Siban's wristbones tighten under his arm, and he eased the pressure he was exerting, ashamed of his use of force against the old man.

reference_spacy_tokens: Alexei felt Siban 's wristbones tighten under his arm , and he eased the pressure he was exerting , ashamed of his use of force against the old man .


fn_spacy_tokens_for_baseline: In that vast space Jandl 's sound poetry proved effective , but a nervous Fainlight read ' The Spider ' about a bad mescaline trip , and flipped under unwelcome support from Vinkenoog .

source_bert_toks: in that vast space jan ##dl ' s sound poetry proved effective , but a nervous fai ##nl ##ight read ' the spider ' about a bad me ##sca ##line trip , and flipped under un ##we ##lco ##me support from vin ##ken ##oo ##g .

reference_raw: The sound poetry of Jandl had proved effective in this vast space, but the nervous Fainlight had read "Spider" about the wrong mescaline journey, and had turned under the unwelcome support of Vinkenoog.

reference_spacy_tokens: The sound poetry of Jandl had proved effective in this vast space , but the nervous Fainlight had read " Spider " about the wrong mescaline journey , and had turned under the unwelcome support of Vinkenoog .


fn_spacy_tokens_for_baseline: When conditions are very favourable a mass of trailing stems are produced .

source_bert_toks: when conditions are very favourable a mass of trailing stems are produced .

reference_raw: When conditions are very favourable, the weight of the trailing stems is produced.

reference_spacy_tokens: When conditions are very favourable , the weight of the trailing stems is produced .


fn_spacy_tokens_for_baseline: I became conscious of where I was and what I was doing so I quickly stood up and dried my eyes .

source_bert_toks: i became conscious of where i was and what i was doing so i quickly stood up and dried my eyes .

reference_raw: I realized where I was and what I was doing, so I got up quickly and dried my eyes.

reference_spacy_tokens: I realized where I was and what I was doing , so I got up quickly and dried my eyes .


fn_spacy_tokens_for_baseline: The first two years provide the groundwork for the pupils to make a realistic choice of Art as a special subject in S3 if they are so minded .

source_bert_toks: the first two years provide the ground ##work for the pupils to make a realistic choice of art as a special subject in s ##3 if they are so minded .

reference_raw: The first two years provide the basis for students to make a realistic choice of art as a specific S3 subject, if that is the case.

reference_spacy_tokens: The first two years provide the basis for students to make a realistic choice of art as a specific S3 subject , if that is the case .


fn_spacy_tokens_for_baseline: Karen reported the theft the police and the ranger , and spent hours driving around the roads looking for Tang .

source_bert_toks: karen reported the theft the police and the ranger , and spent hours driving around the roads looking for tang .

reference_raw: Karen reported the robbery to the police and the Ranger, and spent hours wandering the streets looking for Tang.

reference_spacy_tokens: Karen reported the robbery to the police and the Ranger , and spent hours wandering the streets looking for Tang .


fn_spacy_tokens_for_baseline: Bombs were placed in the fuel depot at the airport last month , and a small power station nearby was blown up .

source_bert_toks: bombs were placed in the fuel depot at the airport last month , and a small power station nearby was blown up .

reference_raw: The bombs were placed in a fuel storage facility at the airport last month, and a small power station nearby blew up.

reference_spacy_tokens: The bombs were placed in a fuel storage facility at the airport last month , and a small power station nearby blew up .


fn_spacy_tokens_for_baseline: ' Do n't Daddy , do n't ; you 'll mess up my dress . '

source_bert_toks: ' don ' t daddy , don ' t ; you ' ll mess up my dress . '

reference_raw: "No, Dad, no, you're ruining my dress."

reference_spacy_tokens: " No , Dad , no , you 're ruining my dress . "


fn_spacy_tokens_for_baseline: I 'll get even with her .

source_bert_toks: i ' ll get even with her .

reference_raw: I'm going to take care of her.

reference_spacy_tokens: I 'm going to take care of her .


fn_spacy_tokens_for_baseline: There were barrelsful of butter and platters of fruit and great sides of bacon and ham and sizzling sausages .

source_bert_toks: there were barrels ##ful of butter and platt ##ers of fruit and great sides of bacon and ham and si ##zzling sausage ##s .

reference_raw: There were barrels of butter and trays of fruit, and large sides of bacon and ham and hissing sausages.

reference_spacy_tokens: There were barrels of butter and trays of fruit , and large sides of bacon and ham and hissing sausages .


fn_spacy_tokens_for_baseline: The atmosphere was thawing a little ; but Paul was not prepared to grovel .

source_bert_toks: the atmosphere was tha ##wing a little ; but paul was not prepared to grove ##l .

reference_raw: The atmosphere melted a little, but Paul wasn't ready to crawl.

reference_spacy_tokens: The atmosphere melted a little , but Paul was n't ready to crawl .


fn_spacy_tokens_for_baseline: Volcanos , earthquakes , landslides , explosions and raging infernos have engulfed whole communities leaving a trail of death and destruction in their wake .

source_bert_toks: volcano ##s , earthquakes , landslide ##s , explosions and raging inferno ##s have engulfed whole communities leaving a trail of death and destruction in their wake .

reference_raw: Volcanos, earthquakes, landslides, explosions and raging hells have engulfed entire communities, leaving a trail of death and destruction behind them.

reference_spacy_tokens: Volcanos , earthquakes , landslides , explosions and raging hells have engulfed entire communities , leaving a trail of death and destruction behind them .


fn_spacy_tokens_for_baseline: I showed Kubrick the script of Spartacus .

source_bert_toks: i showed ku ##brick the script of sparta ##cus .

reference_raw: I showed Kubrick Spartacus' scenario.

reference_spacy_tokens: I showed Kubrick Spartacus ' scenario .


fn_spacy_tokens_for_baseline: It was performance that drew applause from a press corps relieved to be approaching the end of at least the first election campaign this year , and brought smiles to previously glum ministerial faces .

source_bert_toks: it was performance that drew applause from a press corps relieved to be approaching the end of at least the first election campaign this year , and brought smiles to previously g ##lum ministerial faces .

reference_raw: It was a show that brought applause from the press, relieved to be nearing the end of at least the first election campaign this year, and brought smiles to the faces of the former grim ministers.

reference_spacy_tokens: It was a show that brought applause from the press , relieved to be nearing the end of at least the first election campaign this year , and brought smiles to the faces of the former grim ministers .


fn_spacy_tokens_for_baseline: This enormous , modern version of a traditional Chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4,700 people .

source_bert_toks: this enormous , modern version of a traditional chinese building , with sweeping blue tile roofs , contains an auditorium big enough to seat 4 , 700 people .

reference_raw: This huge, modern version of the traditional Chinese building, with sweeping blue tile roofs, contains an auditorium of sufficient size to accommodate 4,700 people.

reference_spacy_tokens: This huge , modern version of the traditional Chinese building , with sweeping blue tile roofs , contains an auditorium of sufficient size to accommodate 4,700 people .


fn_spacy_tokens_for_baseline: So , if a laser is shone directly into a gas the motion of the atoms relative to the laser will broaden considerably the range of frequencies absorbed .

source_bert_toks: so , if a laser is shone directly into a gas the motion of the atoms relative to the laser will broad ##en considerably the range of frequencies absorbed .

reference_raw: So if the laser beams directly into the gas, the movement of the atoms relative to the laser will significantly increase the frequency range absorbed.

reference_spacy_tokens: So if the laser beams directly into the gas , the movement of the atoms relative to the laser will significantly increase the frequency range absorbed .


fn_spacy_tokens_for_baseline: I will reaffirm that I can not condone the use of cannabis , nor for that matter daily watching more than 5 hours of TV .

source_bert_toks: i will re ##af ##firm that i can not condo ##ne the use of cannabis , nor for that matter daily watching more than 5 hours of tv .

reference_raw: I'll confirm that I can't forgive the use of cannabis or watch more than five hours of television every day for this matter.

reference_spacy_tokens: I 'll confirm that I ca n't forgive the use of cannabis or watch more than five hours of television every day for this matter .


fn_spacy_tokens_for_baseline: A task which involved organising all the Sunday services , Sunday school and several weeknight activities .

source_bert_toks: a task which involved organising all the sunday services , sunday school and several week ##night activities .

reference_raw: A task involving the organisation of all Sunday services, Sunday school and several weekly activities.

reference_spacy_tokens: A task involving the organisation of all Sunday services , Sunday school and several weekly activities .


fn_spacy_tokens_for_baseline: Although the hero met his death within the first 30 pages of the trilogy , the vast and mysterious intricacies of his ' Seldon Plan ' still amazed the reader after 700 .

source_bert_toks: although the hero met his death within the first 30 pages of the trilogy , the vast and mysterious int ##rica ##cies of his ' se ##ldon plan ' still amazed the reader after 700 .

reference_raw: Even though the hero had met his death in the first thirty pages of the triology, the vast and mysterious intricacies of his "Seldon Plan" still stunned the reader after 700.

reference_spacy_tokens: Even though the hero had met his death in the first thirty pages of the triology , the vast and mysterious intricacies of his " Seldon Plan " still stunned the reader after 700 .


fn_spacy_tokens_for_baseline: Do you sometimes feel you will never become the weight you desire ?

source_bert_toks: do you sometimes feel you will never become the weight you desire ?

reference_raw: Do you ever feel like you'll never be the weight you want to be?

reference_spacy_tokens: Do you ever feel like you 'll never be the weight you want to be ?


fn_spacy_tokens_for_baseline: As size increases , there is a tendency towards greater depersonalization coupled with a decrease in lateral and vertical communication .

source_bert_toks: as size increases , there is a tendency towards greater de ##personal ##ization coupled with a decrease in lateral and vertical communication .

reference_raw: As the size grows, there is a trend for greater depersonalisation, coupled with a reduction in lateral and vertical communication.

reference_spacy_tokens: As the size grows , there is a trend for greater depersonalisation , coupled with a reduction in lateral and vertical communication .


fn_spacy_tokens_for_baseline: Daniel Galvin in London has come up with a treatment that takes only thirty minutes and rather than causing a dramatic change , it softly camouflages grey hair with a subtle , natural - looking colour .

source_bert_toks: daniel gal ##vin in london has come up with a treatment that takes only thirty minutes and rather than causing a dramatic change , it softly camouflage ##s grey hair with a subtle , natural - looking colour .

reference_raw: Daniel Galvin in London came up with a treatment that lasts only thirty minutes, and instead of making a dramatic change, he gently masks his gray hair with a gentle, natural-looking color.

reference_spacy_tokens: Daniel Galvin in London came up with a treatment that lasts only thirty minutes , and instead of making a dramatic change , he gently masks his gray hair with a gentle , natural - looking color .


fn_spacy_tokens_for_baseline: It was crammed with notebooks filled with Parkin 's bold scribble as well as copies of various scripts in loose folders .

source_bert_toks: it was cr ##ammed with notebook ##s filled with park ##in ' s bold sc ##ri ##bble as well as copies of various scripts in loose folder ##s .

reference_raw: It was stuffed with notebooks full of Parkin's bold scripts and copies of various scripts in loose folders.

reference_spacy_tokens: It was stuffed with notebooks full of Parkin 's bold scripts and copies of various scripts in loose folders .


fn_spacy_tokens_for_baseline: Many hundreds of rebels swarmed across the roof of a rose - red plate - district , heading for a tree of administrative towers .

source_bert_toks: many hundreds of rebels swarm ##ed across the roof of a rose - red plate - district , heading for a tree of administrative towers .

reference_raw: Hundreds of insurgents swept over the roof of the rose-red platform, heading for the tree of administrative towers.

reference_spacy_tokens: Hundreds of insurgents swept over the roof of the rose - red platform , heading for the tree of administrative towers .


fn_spacy_tokens_for_baseline: North Korea has not conducted a nuclear test , but in early May 2005 , press reports indicated that U.S. satellite imagery had detected signs that North Korea could be preparing for a nuclear test to be conducted in June .

source_bert_toks: north korea has not conducted a nuclear test , but in early may 2005 , press reports indicated that u . s . satellite imagery had detected signs that north korea could be preparing for a nuclear test to be conducted in june .

reference_raw: North Korea did not perform a nuclear test, but at the beginning of May 2005 press reports showed that US satellite imagery showed signs that North Korea might be preparing for a nuclear test in June.

reference_spacy_tokens: North Korea did not perform a nuclear test , but at the beginning of May 2005 press reports showed that US satellite imagery showed signs that North Korea might be preparing for a nuclear test in June .


fn_spacy_tokens_for_baseline: Dublin theater is legendary , and no visitor should miss seeing a performance at the Abbey Theatre or Gate Theatre .

source_bert_toks: dublin theater is legendary , and no visitor should miss seeing a performance at the abbey theatre or gate theatre .

reference_raw: The Dublin Theater is legendary, and no visitor should be allowed to see a performance at the Abbey Theatre or the Gate Theatre.

reference_spacy_tokens: The Dublin Theater is legendary , and no visitor should be allowed to see a performance at the Abbey Theatre or the Gate Theatre .


fn_spacy_tokens_for_baseline: Reflecting the Arkells association with its railway past and the wise cracking brandy smugglers , who conned the excise men by trying to rake the moon 's reflection from a pond .

source_bert_toks: reflecting the ark ##ell ##s association with its railway past and the wise cracking brandy smug ##glers , who con ##ned the ex ##cise men by trying to rake the moon ' s reflection from a pond .

reference_raw: It reflects the Arkells association with its railroad past and the wisely cracking brandy runners who conned the excisables by trying to rake the moon's reflection out of the pond.

reference_spacy_tokens: It reflects the Arkells association with its railroad past and the wisely cracking brandy runners who conned the excisables by trying to rake the moon 's reflection out of the pond .


fn_spacy_tokens_for_baseline: On reaching Carlisle Square , at the city end of Craigavon Bridge , they were jeered by a crowd of loyalists , but stewards lining the square prevented any clash .

source_bert_toks: on reaching carlisle square , at the city end of craig ##av ##on bridge , they were je ##ered by a crowd of loyalists , but steward ##s lining the square prevented any clash .

reference_raw: When they reached Carlisle Square, at the end of Craigavon Bridge, a crowd of loyalists laughed at them, but the stewards who lined the square prevented any confrontation.

reference_spacy_tokens: When they reached Carlisle Square , at the end of Craigavon Bridge , a crowd of loyalists laughed at them , but the stewards who lined the square prevented any confrontation .


fn_spacy_tokens_for_baseline: ' I do n't know whether you 're being considerate , crafty , or just plain calculating . '

source_bert_toks: ' i don ' t know whether you ' re being consider ##ate , craft ##y , or just plain calculating . '

reference_raw: "I don't know if you're being thoughtful, cunning, or simply calculating."

reference_spacy_tokens: " I do n't know if you 're being thoughtful , cunning , or simply calculating . "


fn_spacy_tokens_for_baseline: There are no jokes in two new novels by black women writers .

source_bert_toks: there are no jokes in two new novels by black women writers .

reference_raw: There are no jokes in two new books by black writers.

reference_spacy_tokens: There are no jokes in two new books by black writers .


fn_spacy_tokens_for_baseline: The top Shire Horse from William Tudor Jones , of Llanfihangel - y - Pennant , Tywyn , lined up with the supreme champions in the cattle and sheep sections to compete for the show 's super supreme title .

source_bert_toks: the top shire horse from william tudor jones , of ll ##an ##fi ##hang ##el - y - pennant , ty ##wyn , lined up with the supreme champions in the cattle and sheep sections to compete for the show ' s super supreme title .

reference_raw: The highest Shire Horse of William Tudor Jones, Llanfihangel-y-Pennant, Tywyn, was lined up with the highest champions of the cattle and sheep section to compete for the super-high title of the show.

reference_spacy_tokens: The highest Shire Horse of William Tudor Jones , Llanfihangel - y - Pennant , Tywyn , was lined up with the highest champions of the cattle and sheep section to compete for the super - high title of the show .


fn_spacy_tokens_for_baseline: Perhaps because Jerusalem was in neutral territory not allotted to any of the twelve rival tribes of Israel , David made it the capital of his newly formed kingdom and brought the most talented artisans , dedicated priests , magical poets and musicians , and the most formidable soldiers from each of the tribes to live in his city .

source_bert_toks: perhaps because jerusalem was in neutral territory not allotted to any of the twelve rival tribes of israel , david made it the capital of his newly formed kingdom and brought the most talented artisans , dedicated priests , magical poets and musicians , and the most formidable soldiers from each of the tribes to live in his city .

reference_raw: Perhaps because Jerusalem was in neutral territory, not allocated to any of the twelve rival tribes of Israel, David had made it the capital of his newly created kingdom and had brought the most gifted craftsmen, dedicated priests, magical poets and musicians, and the most fearsome soldiers of all tribes to live in his city.

reference_spacy_tokens: Perhaps because Jerusalem was in neutral territory , not allocated to any of the twelve rival tribes of Israel , David had made it the capital of his newly created kingdom and had brought the most gifted craftsmen , dedicated priests , magical poets and musicians , and the most fearsome soldiers of all tribes to live in his city .


fn_spacy_tokens_for_baseline: The State of Israel was declared during this difficult time .

source_bert_toks: the state of israel was declared during this difficult time .

reference_raw: During this difficult period, the State of Israel has been declared.

reference_spacy_tokens: During this difficult period , the State of Israel has been declared .


fn_spacy_tokens_for_baseline: It is likely that these perceptions of health reflect expectations that a high degree of ill health and discomfort should be accepted in old age .

source_bert_toks: it is likely that these perceptions of health reflect expectations that a high degree of ill health and discomfort should be accepted in old age .

reference_raw: These perceptions of health are likely to reflect the expectation that a high level of ill health and discomfort should be recognised in the old age.

reference_spacy_tokens: These perceptions of health are likely to reflect the expectation that a high level of ill health and discomfort should be recognised in the old age .


fn_spacy_tokens_for_baseline: Cornered , he resorted to patting her on the shoulder , while across his face flitted the craven smile of a man dealing with an unpredictable pet that yet might turn on him .

source_bert_toks: cornered , he resort ##ed to patting her on the shoulder , while across his face fl ##itte ##d the craven smile of a man dealing with an unpredictable pet that yet might turn on him .

reference_raw: He turned to pat her on the shoulder, and across his face flashed the craven smile of a man dealing with an unpredictable pet who might turn on him.

reference_spacy_tokens: He turned to pat her on the shoulder , and across his face flashed the craven smile of a man dealing with an unpredictable pet who might turn on him .


fn_spacy_tokens_for_baseline: The aim of a letter before action ( LBA ) is to obtain payment from a slow payer without recourse to court proceedings .

source_bert_toks: the aim of a letter before action ( lb ##a ) is to obtain payment from a slow pay ##er without rec ##ours ##e to court proceedings .

reference_raw: The purpose of the pre-litigation letter (LBA) is to obtain payment from the slow payer without recourse to court proceedings.

reference_spacy_tokens: The purpose of the pre - litigation letter ( LBA ) is to obtain payment from the slow payer without recourse to court proceedings .


fn_spacy_tokens_for_baseline: They are lauded for stimulating the Japanese economy through a recent ¥ 13 trillion ( $ 116 billion ) supplementary budget and for ' rescuing ' the stockmarket .

source_bert_toks: they are lauded for stimulating the japanese economy through a recent ¥ ##13 trillion ( $ 116 billion ) supplementary budget and for ' rescuing ' the stock ##market .

reference_raw: They commend the Japanese economy with a recent $13 trillion (116 billion) additional budget and a "rescue" stock market.

reference_spacy_tokens: They commend the Japanese economy with a recent $ 13 trillion ( 116 billion ) additional budget and a " rescue " stock market .


fn_spacy_tokens_for_baseline: There she lived in the school house and had charge of a little brood of no more than eight or nine children .

source_bert_toks: there she lived in the school house and had charge of a little brood of no more than eight or nine children .

reference_raw: That's where she lived in the school house, and she had a small contemplation with no more than eight or nine children.

reference_spacy_tokens: That 's where she lived in the school house , and she had a small contemplation with no more than eight or nine children .


fn_spacy_tokens_for_baseline: The Lord Chancellor 's proposals would mean that legal aid would no longer be affordable for between 12 to 14 million adults .

source_bert_toks: the lord chancellor ' s proposals would mean that legal aid would no longer be affordable for between 12 to 14 million adults .

reference_raw: The Lord Chancellor's proposals would mean that legal aid for between 12 and 14 million adults would no longer be available.

reference_spacy_tokens: The Lord Chancellor 's proposals would mean that legal aid for between 12 and 14 million adults would no longer be available .


fn_spacy_tokens_for_baseline: THE fighting on the ground may be nothing compared with the fighting over who pays the bill .

source_bert_toks: the fighting on the ground may be nothing compared with the fighting over who pays the bill .

reference_raw: A battle on the ground can be nothing compared to a battle over who pays the bill.

reference_spacy_tokens: A battle on the ground can be nothing compared to a battle over who pays the bill .


fn_spacy_tokens_for_baseline: Carrie and Fred worked hard all day , aided by the vociferous Bessie Chandler , whose tales about the trials and tribulations of her friends in the buildings where she lived became painful ongoing sagas .

source_bert_toks: carrie and fred worked hard all day , aided by the vo ##ci ##fer ##ous bessie chandler , whose tales about the trials and tri ##bula ##tions of her friends in the buildings where she lived became painful ongoing saga ##s .

reference_raw: Carrie and Fred worked hard all day, with the help of the vociferous Bessie Chandler, whose stories about the experiments and tribulations of her friends in the buildings where she lived had become painfully continual sagas.

reference_spacy_tokens: Carrie and Fred worked hard all day , with the help of the vociferous Bessie Chandler , whose stories about the experiments and tribulations of her friends in the buildings where she lived had become painfully continual sagas .


fn_spacy_tokens_for_baseline: The drug lords who claimed responsibility said they would blow up the Bogota newspaper 's offices if it continued to distribute in Medellin .

source_bert_toks: the drug lords who claimed responsibility said they would blow up the bogota newspaper ' s offices if it continued to distribute in med ##elli ##n .

reference_raw: The drug lords who claimed responsibility said they'd blow up the offices of the Bogota newspapers if it continued to spread in Medellin.

reference_spacy_tokens: The drug lords who claimed responsibility said they 'd blow up the offices of the Bogota newspapers if it continued to spread in Medellin .


fn_spacy_tokens_for_baseline: More often than not it is the ' feeder that becomes stuck when the barbel charge through a thick weedbed or the like .

source_bert_toks: more often than not it is the ' feeder that becomes stuck when the bar ##bel charge through a thick weed ##bed or the like .

reference_raw: More often than not, it's a feeder that gets caught when a barbel goes through a thick weed or something.

reference_spacy_tokens: More often than not , it 's a feeder that gets caught when a barbel goes through a thick weed or something .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key question is how the US deployment of ballistic missile defense (formerly known as theatrical and national missile defense) will affect the pace and extent of Chinese policy modernisation.

reference_spacy_tokens: The key question is how the US deployment of ballistic missile defense ( formerly known as theatrical and national missile defense ) will affect the pace and extent of Chinese policy modernisation .


fn_spacy_tokens_for_baseline: The largest of the Amirantes group of islands , Des Roches is situated 120 miles southwest of Mahe and just under an hour by plane .

source_bert_toks: the largest of the amir ##antes group of islands , des roche ##s is situated 120 miles southwest of ma ##he and just under an hour by plane .

reference_raw: Des Roches, the largest of the Amirante group of islands, is located 120 miles south-west of Mahe and less than an hour by plane.

reference_spacy_tokens: Des Roches , the largest of the Amirante group of islands , is located 120 miles south - west of Mahe and less than an hour by plane .


fn_spacy_tokens_for_baseline: The south landing is approachable by small boat on good days but is studded with hazardous weed - covered rocks , and strong cross tides at the approach add to the dangers .

source_bert_toks: the south landing is approach ##able by small boat on good days but is stud ##ded with hazardous weed - covered rocks , and strong cross tides at the approach add to the dangers .

reference_raw: The southern landing can be approached by a small ship on good days, but it is littered with dangerous weed-covered rocks, and strong cross tides are added to the dangers.

reference_spacy_tokens: The southern landing can be approached by a small ship on good days , but it is littered with dangerous weed - covered rocks , and strong cross tides are added to the dangers .


fn_spacy_tokens_for_baseline: The oak door clunked shut , and Jennifer realized that she had forgotten to curtsy , so she managed an awkward one without toppling over .

source_bert_toks: the oak door cl ##unk ##ed shut , and jennifer realized that she had forgotten to curt ##sy , so she managed an awkward one without top ##pling over .

reference_raw: The oak door slammed shut, and Jennifer realized she'd forgotten to bow, so she managed the awkward one without falling over.

reference_spacy_tokens: The oak door slammed shut , and Jennifer realized she 'd forgotten to bow , so she managed the awkward one without falling over .


fn_spacy_tokens_for_baseline: What right had I to tarnish the reputation of an acknowledged war hero and needlessly distress his family ?

source_bert_toks: what right had i to tar ##nish the reputation of an acknowledged war hero and needles ##sl ##y distress his family ?

reference_raw: What right do I have to tarnish the reputation of a respected war hero and unnecessarily trouble his family?

reference_spacy_tokens: What right do I have to tarnish the reputation of a respected war hero and unnecessarily trouble his family ?


fn_spacy_tokens_for_baseline: The anger in her voice took him aback .

source_bert_toks: the anger in her voice took him aback .

reference_raw: The rage in her voice startled him.

reference_spacy_tokens: The rage in her voice startled him .


fn_spacy_tokens_for_baseline: Many governments are very strict about imposing restrictions on the importation of foodstuffs which contain excessive concentrations of heavy metals .

source_bert_toks: many governments are very strict about imposing restrictions on the import ##ation of foods ##tu ##ffs which contain excessive concentrations of heavy metals .

reference_raw: Many governments are very strict about imposing restrictions on food imports that contain excessive concentrations of heavy metals.

reference_spacy_tokens: Many governments are very strict about imposing restrictions on food imports that contain excessive concentrations of heavy metals .


fn_spacy_tokens_for_baseline: You are positive he had made no connections with any of the Irish organizations ? '

source_bert_toks: you are positive he had made no connections with any of the irish organizations ? '

reference_raw: Are you sure he hasn't contacted any Irish organizations?'

reference_spacy_tokens: Are you sure he has n't contacted any Irish organizations ? '


fn_spacy_tokens_for_baseline: Skilled negotiators ask at least twice as many questions as the less skilled .

source_bert_toks: skilled ne ##go ##tia ##tors ask at least twice as many questions as the less skilled .

reference_raw: The experienced negotiators ask at least twice as many questions as the less qualified ones.

reference_spacy_tokens: The experienced negotiators ask at least twice as many questions as the less qualified ones .


fn_spacy_tokens_for_baseline: In what is now the Southwestern United States , they also created ovens made of adobe called hornos in which to bake items such as breads made from cornmeal and in other parts of America , made ovens out of dug pits .

source_bert_toks: in what is now the southwestern united states , they also created oven ##s made of adobe called horn ##os in which to ba ##ke items such as bread ##s made from corn ##me ##al and in other parts of america , made oven ##s out of dug pits .

reference_raw: In what is now the Southwestern United States, they have also created furnaces made of adobes called hornos, in which to bake items like cornmeal bread and other parts of the United States of America, made furnaces from dug-in pits.

reference_spacy_tokens: In what is now the Southwestern United States , they have also created furnaces made of adobes called hornos , in which to bake items like cornmeal bread and other parts of the United States of America , made furnaces from dug - in pits .


fn_spacy_tokens_for_baseline: THOSE three major eclipses can be held responsible for the tremendous highs and lows in your love life this year .

source_bert_toks: those three major eclipse ##s can be held responsible for the tremendous highs and low ##s in your love life this year .

reference_raw: Three major eclipses may be responsible for the great heights and lows of your love life this year.

reference_spacy_tokens: Three major eclipses may be responsible for the great heights and lows of your love life this year .


fn_spacy_tokens_for_baseline: The Immigration man was loath to let them go , but the instructions on the register were clear .

source_bert_toks: the immigration man was lo ##ath to let them go , but the instructions on the register were clear .

reference_raw: The immigration man hated to let them go, but the instructions on the register were clear.

reference_spacy_tokens: The immigration man hated to let them go , but the instructions on the register were clear .


fn_spacy_tokens_for_baseline: The problem is that our managerial hierarchies are so badly designed as to defeat the best efforts even of psychologically insightful individuals .

source_bert_toks: the problem is that our managerial hi ##era ##rch ##ies are so badly designed as to defeat the best efforts even of psychological ##ly insight ##ful individuals .

reference_raw: The problem is that our management hierarchy is so badly designed that it defeats the best efforts of psychologically intelligent individuals.

reference_spacy_tokens: The problem is that our management hierarchy is so badly designed that it defeats the best efforts of psychologically intelligent individuals .


fn_spacy_tokens_for_baseline: The popularity of Wade 's sculpture was probably due not only to the fact that it was always comprehensible but that it was both ennobling and restrained in equal measure .

source_bert_toks: the popularity of wade ' s sculpture was probably due not only to the fact that it was always com ##pre ##hen ##sible but that it was both en ##nob ##ling and restrained in equal measure .

reference_raw: The popularity of Wade's statue was probably due not only to the fact that it was always understandable, but also to the fact that it was both ennobled and held back in the same way.

reference_spacy_tokens: The popularity of Wade 's statue was probably due not only to the fact that it was always understandable , but also to the fact that it was both ennobled and held back in the same way .


fn_spacy_tokens_for_baseline: It swerved , dipped and smacked the bar .

source_bert_toks: it sw ##erved , dipped and smacked the bar .

reference_raw: He turned, dipped, and hit the bar.

reference_spacy_tokens: He turned , dipped , and hit the bar .


fn_spacy_tokens_for_baseline: The Department of Homeland Security ( DHS ) recently completed a study , conducted in response to a request I [ Carl Levin ] made with Senator Debbie Stabenow and Rep. John Dingell that bluntly acknowledges the security risk these trucks pose .

source_bert_toks: the department of homeland security ( dh ##s ) recently completed a study , conducted in response to a request i [ carl levin ] made with senator debbie stab ##eno ##w and rep . john ding ##ell that blunt ##ly acknowledges the security risk these trucks pose .

reference_raw: The Department of Homeland Security (DHS) has recently completed a survey, carried out in response to a request from Senator Debbie Stabenow and Deputy John Dingell that I [Carl Levin] has bluntly acknowledged the security risks posed by these trucks.

reference_spacy_tokens: The Department of Homeland Security ( DHS ) has recently completed a survey , carried out in response to a request from Senator Debbie Stabenow and Deputy John Dingell that I [ Carl Levin ] has bluntly acknowledged the security risks posed by these trucks .


fn_spacy_tokens_for_baseline: In many orders of insects , each transverse nerve is also connected in various ways with the so - called perisympathetic system , consisting of neurohaemal organs that release the products of neurosecretory cells in the ventral ganglia ( Raabe , 2972 ) .

source_bert_toks: in many orders of insects , each transverse nerve is also connected in various ways with the so - called per ##is ##ym ##path ##etic system , consisting of ne ##uro ##hae ##mal organs that release the products of ne ##uro ##se ##cre ##tory cells in the ventral gang ##lia ( ra ##abe , 297 ##2 ) .

reference_raw: In many sequences of insects, each transverse nerve is also linked to a so-called perisympathetic system consisting of neurohaemal organs that release the products of neurosecretory cells in the ventral ganglia (Raabe, 2972).

reference_spacy_tokens: In many sequences of insects , each transverse nerve is also linked to a so - called perisympathetic system consisting of neurohaemal organs that release the products of neurosecretory cells in the ventral ganglia ( Raabe , 2972 ) .


fn_spacy_tokens_for_baseline: She 's a chatterbox an ' it gets on the customers ' nerves .

source_bert_toks: she ' s a chatter ##box an ' it gets on the customers ' nerves .

reference_raw: It's a chat box, and it's getting on the customers' nerves.

reference_spacy_tokens: It 's a chat box , and it 's getting on the customers ' nerves .


fn_spacy_tokens_for_baseline: Fetal growth is actively constrained by maternal size .

source_bert_toks: fetal growth is actively constrained by maternal size .

reference_raw: The growth of the foetus is actively limited by the size of the mother.

reference_spacy_tokens: The growth of the foetus is actively limited by the size of the mother .


fn_spacy_tokens_for_baseline: ' Bastard ! ' cried Bernard , belabouring Jed with his fists , splattering cheap red wine over books and walls .

source_bert_toks: ' bastard ! ' cried bernard , bela ##bour ##ing jed with his fists , sp ##lat ##tering cheap red wine over books and walls .

reference_raw: 'Bastard!' shouted Bernard, slapping Jed with his fists and splashing cheap red wine over the books and walls.

reference_spacy_tokens: ' Bastard ! ' shouted Bernard , slapping Jed with his fists and splashing cheap red wine over the books and walls .


fn_spacy_tokens_for_baseline: When he lifted his arm there was the greasy feel and faint shower of sparks that betokened a localised magical field .

source_bert_toks: when he lifted his arm there was the greasy feel and faint shower of sparks that bet ##oke ##ned a local ##ised magical field .

reference_raw: As he raised his hand, there was a greasy sensation and a faint shower of sparks that marked a localized field of magic.

reference_spacy_tokens: As he raised his hand , there was a greasy sensation and a faint shower of sparks that marked a localized field of magic .


fn_spacy_tokens_for_baseline: The ribbon in her hair was loose and dangling , her hair itself all over the place , her frock covered with bits and pieces .

source_bert_toks: the ribbon in her hair was loose and dangling , her hair itself all over the place , her fr ##ock covered with bits and pieces .

reference_raw: The tape in her hair was loose and dangling, and her hair was everywhere, and her dress was covered with bits and pieces.

reference_spacy_tokens: The tape in her hair was loose and dangling , and her hair was everywhere , and her dress was covered with bits and pieces .


fn_spacy_tokens_for_baseline: for a night or two to have somewhere that they know they can at least kip on the floor .

source_bert_toks: for a night or two to have somewhere that they know they can at least ki ##p on the floor .

reference_raw: for a night or two, so they'd have a place where they knew they could at least knock on the floor.

reference_spacy_tokens: for a night or two , so they 'd have a place where they knew they could at least knock on the floor .


fn_spacy_tokens_for_baseline: Angry with herself for reacting to him , she peeled off her wet swimsuit and vigorously began to towel her body .

source_bert_toks: angry with herself for reacting to him , she peeled off her wet swim ##suit and vigorously began to towel her body .

reference_raw: Angry at herself for reacting to him, she stripped off her wet bathing suit and began to towel her body vigorously.

reference_spacy_tokens: Angry at herself for reacting to him , she stripped off her wet bathing suit and began to towel her body vigorously .


fn_spacy_tokens_for_baseline: The twins have gone their separate ways and become estranged : Jip is a nuclear physicist at NASA and Zab is a Euro - MP in Aachen , which has become the new seat of the European Parliament .

source_bert_toks: the twins have gone their separate ways and become estranged : ji ##p is a nuclear physicist at nasa and za ##b is a euro - mp in aachen , which has become the new seat of the european parliament .

reference_raw: The twins went their separate ways and became aliens: Jip is a nuclear physicist at NASA, and Zab is a Euro-MP in Aachen, which has become the new seat of the European Parliament.

reference_spacy_tokens: The twins went their separate ways and became aliens : Jip is a nuclear physicist at NASA , and Zab is a Euro - MP in Aachen , which has become the new seat of the European Parliament .


fn_spacy_tokens_for_baseline: He affixed a small jewellers ' eyeglass to his eye , and peered in at the device 's workings more closely .

source_bert_toks: he af ##fixed a small jewel ##lers ' eye ##glass to his eye , and peered in at the device ' s workings more closely .

reference_raw: He put a small jeweller's eyeglass to his eye and looked more closely at the work of the device.

reference_spacy_tokens: He put a small jeweller 's eyeglass to his eye and looked more closely at the work of the device .


fn_spacy_tokens_for_baseline: Again , a bundle of drinking straws glued together provides a realistic model .

source_bert_toks: again , a bundle of drinking straw ##s glued together provides a realistic model .

reference_raw: Once again, a bundle of drinking straws stuck together provides a realistic model.

reference_spacy_tokens: Once again , a bundle of drinking straws stuck together provides a realistic model .


fn_spacy_tokens_for_baseline: SAVING the punchline till last , just about the best joke of a pretty unfunny decade comes in its dying days .

source_bert_toks: saving the punch ##line till last , just about the best joke of a pretty un ##fu ##nn ##y decade comes in its dying days .

reference_raw: Searching the punch line until the end, only the best joke of a rather funny decade comes in his dying days.

reference_spacy_tokens: Searching the punch line until the end , only the best joke of a rather funny decade comes in his dying days .


fn_spacy_tokens_for_baseline: She was dressed in a grey shift that was loosely belted round her waist .

source_bert_toks: she was dressed in a grey shift that was loosely belt ##ed round her waist .

reference_raw: She was dressed in a gray dress that was loosely belted around her waist.

reference_spacy_tokens: She was dressed in a gray dress that was loosely belted around her waist .


fn_spacy_tokens_for_baseline: They stood on the steps and waved , as Chignell wheeled him away , and Breeze called out , ' Happy New Year ! '

source_bert_toks: they stood on the steps and waved , as chi ##gne ##ll wheeled him away , and breeze called out , ' happy new year ! '

reference_raw: They were standing on the stairs, waving as Chignell turned him away, and Breeze shouted, "Happy New Year!"

reference_spacy_tokens: They were standing on the stairs , waving as Chignell turned him away , and Breeze shouted , " Happy New Year ! "


fn_spacy_tokens_for_baseline: The dirty floor was smeared with thin sticky black lines that Mitchell knew would shine red in stronger light .

source_bert_toks: the dirty floor was smeared with thin sticky black lines that mitchell knew would shine red in stronger light .

reference_raw: The dirty floor was stained with thin, sticky black lines Mitchell knew would shine red in the brighter light.

reference_spacy_tokens: The dirty floor was stained with thin , sticky black lines Mitchell knew would shine red in the brighter light .


fn_spacy_tokens_for_baseline: We were living at Southport and we were being bathed by mother before the kitchen fire , and I was getting undressed and being helped with the buttons by the housemaid .

source_bert_toks: we were living at southport and we were being bathed by mother before the kitchen fire , and i was getting und ##ressed and being helped with the buttons by the house ##maid .

reference_raw: We lived in Southport and my mother bathed us before the kitchen fire, and I got naked and the maid helped me with the buttons.

reference_spacy_tokens: We lived in Southport and my mother bathed us before the kitchen fire , and I got naked and the maid helped me with the buttons .


fn_spacy_tokens_for_baseline: Investors of public - sector funds , mainly trust banks , have taken exhaustive measures to prevent share prices from sliding during the extended vacation .

source_bert_toks: investors of public - sector funds , mainly trust banks , have taken exhaust ##ive measures to prevent share prices from sliding during the extended vacation .

reference_raw: Investors of public sector funds, in particular trust banks, have taken comprehensive measures to prevent stock prices from slipping during the extended holiday period.

reference_spacy_tokens: Investors of public sector funds , in particular trust banks , have taken comprehensive measures to prevent stock prices from slipping during the extended holiday period .