fn_spacy_tokens_for_baseline: Equally , do not be discouraged by hostile letters to the editor or even hostile editorials .

source_bert_toks: equally , do not be discouraged by hostile letters to the editor or even hostile editorial ##s .

reference_raw: Similarly, do not be deterred by hostile letters to editors or even hostile editors.

reference_spacy_tokens: Similarly , do not be deterred by hostile letters to editors or even hostile editors .


fn_spacy_tokens_for_baseline: I lay rigid , willing myself into the exhausted stupor that I knew was there waiting to engulf me again .

source_bert_toks: i lay rigid , willing myself into the exhausted stu ##por that i knew was there waiting to eng ##ulf me again .

reference_raw: I lay stiff, willing to go into the fatigue I knew was waiting for me to swallow me again.

reference_spacy_tokens: I lay stiff , willing to go into the fatigue I knew was waiting for me to swallow me again .


fn_spacy_tokens_for_baseline: As Brown moves round the larders , the Psion Organiser presents him with a series of ingredient names , in a preset order .

source_bert_toks: as brown moves round the la ##rder ##s , the psi ##on organise ##r presents him with a series of ingredient names , in a pre ##set order .

reference_raw: As Brown circles the pantry, the Psion Organiser presents him with a series of ingredient names, in a predefined order.

reference_spacy_tokens: As Brown circles the pantry , the Psion Organiser presents him with a series of ingredient names , in a predefined order .


fn_spacy_tokens_for_baseline: then carved him in slices .

source_bert_toks: then carved him in slices .

reference_raw: and then cut it in slices.

reference_spacy_tokens: and then cut it in slices .


fn_spacy_tokens_for_baseline: I 'm trying to flap my arms like a duck and quack at the same time .

source_bert_toks: i ' m trying to flap my arms like a duck and qu ##ack at the same time .

reference_raw: I try to swing my arms like a duck and a charlatan.

reference_spacy_tokens: I try to swing my arms like a duck and a charlatan .


fn_spacy_tokens_for_baseline: We were expecting that the Baathists were going to sabotage our work .

source_bert_toks: we were expecting that the ba ##athi ##sts were going to sabotage our work .

reference_raw: We expected the Baathists to destroy our work.

reference_spacy_tokens: We expected the Baathists to destroy our work .


fn_spacy_tokens_for_baseline: Those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

source_bert_toks: those whose fate was to die on some far foreign field could not have wanted a more peaceful , lovely graveyard .

reference_raw: Those whose fate was to die in a distant foreign field couldn't want a more peaceful, beautiful cemetery.

reference_spacy_tokens: Those whose fate was to die in a distant foreign field could n't want a more peaceful , beautiful cemetery .


fn_spacy_tokens_for_baseline: What a contrast with the rattled and untrustworthy gamblers at Number 10 and Number 11 Downing Street .

source_bert_toks: what a contrast with the rattled and un ##trust ##worthy gamble ##rs at number 10 and number 11 downing street .

reference_raw: What a contrast to the rumbling and unreliable players on number 10 and number 11 Downing Street.

reference_spacy_tokens: What a contrast to the rumbling and unreliable players on number 10 and number 11 Downing Street .


fn_spacy_tokens_for_baseline: Witnesses willing to be paid for their services would parade outside courthouses .

source_bert_toks: witnesses willing to be paid for their services would parade outside courthouse ##s .

reference_raw: Witnesses who are willing to be paid for their services will show up in front of the courthouse.

reference_spacy_tokens: Witnesses who are willing to be paid for their services will show up in front of the courthouse .


fn_spacy_tokens_for_baseline: The leaders , men - at - arms and levies of the lords and knights chafed sorely at this delay , none more so than Will Douglas .

source_bert_toks: the leaders , men - at - arms and levi ##es of the lords and knights cha ##fed sore ##ly at this delay , none more so than will douglas .

reference_raw: Leaders, men-at-arms, and royalties of lords and knights chaffed at this delay, no more than Will Douglas.

reference_spacy_tokens: Leaders , men - at - arms , and royalties of lords and knights chaffed at this delay , no more than Will Douglas .


fn_spacy_tokens_for_baseline: ' And they say they care about those below ' , said the commentary , as the monkey urinated against a wall .

source_bert_toks: ' and they say they care about those below ' , said the commentary , as the monkey ur ##inated against a wall .

reference_raw: 'And they say they care about the people down there,' said the commentary, as the monkey peed against the wall.

reference_spacy_tokens: ' And they say they care about the people down there , ' said the commentary , as the monkey peed against the wall .


fn_spacy_tokens_for_baseline: Closing my eyes , thinking that it might be either the sun or the Pernod , I waited a few seconds and chanced another look .

source_bert_toks: closing my eyes , thinking that it might be either the sun or the per ##no ##d , i waited a few seconds and chance ##d another look .

reference_raw: I closed my eyes, thinking it might be the sun or the Pernod, and waited a few seconds, hoping for another look.

reference_spacy_tokens: I closed my eyes , thinking it might be the sun or the Pernod , and waited a few seconds , hoping for another look .


fn_spacy_tokens_for_baseline: Second to Henry Yevele , Wynford was an architect of genius who transformed and unified English building .

source_bert_toks: second to henry ye ##vel ##e , w ##yn ##ford was an architect of genius who transformed and unified english building .

reference_raw: Second to Henry Yevele, Wynford was a genius architect who transformed and united the English building.

reference_spacy_tokens: Second to Henry Yevele , Wynford was a genius architect who transformed and united the English building .


fn_spacy_tokens_for_baseline: As Therese untied the boat , Flavia said , ' I would like to come back here . '

source_bert_toks: as therese un ##tie ##d the boat , fl ##avia said , ' i would like to come back here . '

reference_raw: When Theresa unbuckled the ship, Flavia said, "I'd like to get back here."

reference_spacy_tokens: When Theresa unbuckled the ship , Flavia said , " I 'd like to get back here . "


fn_spacy_tokens_for_baseline: She gobbled and gabbled in the mornings -- that was to do with her teeth , not very pretty either .

source_bert_toks: she go ##bbled and ga ##bbled in the mornings - - that was to do with her teeth , not very pretty either .

reference_raw: In the morning she chewed and gabbled - it had something to do with her teeth, and it wasn't very pretty either.

reference_spacy_tokens: In the morning she chewed and gabbled - it had something to do with her teeth , and it was n't very pretty either .


fn_spacy_tokens_for_baseline: His knife clinked to the floor .

source_bert_toks: his knife cl ##ink ##ed to the floor .

reference_raw: The knife clicked on the floor.

reference_spacy_tokens: The knife clicked on the floor .


fn_spacy_tokens_for_baseline: The night before they reached the tributary of the Baleh river they sought , Balbindor overheard a significant exchange between father and son .

source_bert_toks: the night before they reached the tributary of the bal ##eh river they sought , bal ##bin ##dor overheard a significant exchange between father and son .

reference_raw: On the night before they reached the tributary of the Baleh River they were looking for, Balbindor heard an important conversation between his father and his son.

reference_spacy_tokens: On the night before they reached the tributary of the Baleh River they were looking for , Balbindor heard an important conversation between his father and his son .


fn_spacy_tokens_for_baseline: Interdigestive motor complexes are absent , postprandial antral motor activity is decreased , gastric emptying of radioopaque is delayed , and gall gladder contraction is reduced .

source_bert_toks: inter ##di ##ges ##tive motor complexes are absent , post ##pr ##and ##ial ant ##ral motor activity is decreased , gas ##tric empty ##ing of radio ##opa ##que is delayed , and gall glad ##der contraction is reduced .

reference_raw: Interdigestive motor complexes are missing, postprandial antral motor activity is reduced, radioopaque gastric discharge is delayed, and gall gladder contraction is reduced.

reference_spacy_tokens: Interdigestive motor complexes are missing , postprandial antral motor activity is reduced , radioopaque gastric discharge is delayed , and gall gladder contraction is reduced .


fn_spacy_tokens_for_baseline: Unlike some countries , where a person may be declared clinically dead when the brain stops functioning , Indian doctors are only allowed to certify death when the heart has stopped beating .

source_bert_toks: unlike some countries , where a person may be declared clinical ##ly dead when the brain stops functioning , indian doctors are only allowed to ce ##rti ##fy death when the heart has stopped beating .

reference_raw: Unlike in some countries where a person can be declared clinically dead if the brain stops working, Indian doctors can only confirm death if the heart stops beating.

reference_spacy_tokens: Unlike in some countries where a person can be declared clinically dead if the brain stops working , Indian doctors can only confirm death if the heart stops beating .


fn_spacy_tokens_for_baseline: 1- Kiosks should be placed at entrance gates to check visitors when approaching the building .

source_bert_toks: 1 - ki ##os ##ks should be placed at entrance gates to check visitors when approaching the building .

reference_raw: 1-Kiosks should be placed at the entrance gate for inspection of visitors as they approach the building.

reference_spacy_tokens: 1-Kiosks should be placed at the entrance gate for inspection of visitors as they approach the building .


fn_spacy_tokens_for_baseline: This engrossing spectacle fascinates the predator who may eventually devour the tail , although it has little nutritional value .

source_bert_toks: this eng ##ross ##ing spectacle fa ##sc ##inates the predator who may eventually dev ##our the tail , although it has little nutritional value .

reference_raw: This encroaching spectacle fascinates a predator who can eventually eat a tail, even if it has little nutritional value.

reference_spacy_tokens: This encroaching spectacle fascinates a predator who can eventually eat a tail , even if it has little nutritional value .


fn_spacy_tokens_for_baseline: Once the coffin had received its primary lining and edged frill , two rectangular sheets -- both the length and width of the coffin -- were tacked to the base at its sides .

source_bert_toks: once the coffin had received its primary lining and edged fr ##ill , two rectangular sheets - - both the length and width of the coffin - - were tack ##ed to the base at its sides .

reference_raw: As soon as the coffin received its primary lining and edged frill, two rectangular sheets - the length and width of the coffin - were attached to the base at its sides.

reference_spacy_tokens: As soon as the coffin received its primary lining and edged frill , two rectangular sheets - the length and width of the coffin - were attached to the base at its sides .


fn_spacy_tokens_for_baseline: She heard his cry , perhaps the battle cry of his northern forefathers when they prepared to attack .

source_bert_toks: she heard his cry , perhaps the battle cry of his northern fore ##fat ##hers when they prepared to attack .

reference_raw: She could hear his screams, perhaps the battle cries of his northern ancestors as they prepared to attack.

reference_spacy_tokens: She could hear his screams , perhaps the battle cries of his northern ancestors as they prepared to attack .


fn_spacy_tokens_for_baseline: During the second number , he draped himself in the Union Jack , presumably in an attempt to endear himself to the bulldog breed .

source_bert_toks: during the second number , he draped himself in the union jack , presumably in an attempt to end ##ear himself to the bulldog breed .

reference_raw: During the second number, he hung himself in Union Jack, probably trying to get close to the bulldog breed.

reference_spacy_tokens: During the second number , he hung himself in Union Jack , probably trying to get close to the bulldog breed .


fn_spacy_tokens_for_baseline: In a different context , feminists have worked within trade unions to mobilise grievance procedures to protect women who complain of sexual harassment , either by their bosses or by fellow workers .

source_bert_toks: in a different context , feminist ##s have worked within trade unions to mob ##ilis ##e gr ##ie ##vance procedures to protect women who complain of sexual harassment , either by their bosses or by fellow workers .

reference_raw: In another context, feminists work in trade unions to mobilize complaints procedures for the protection of women who complain of sexual assault, either from their bosses or from their colleagues.

reference_spacy_tokens: In another context , feminists work in trade unions to mobilize complaints procedures for the protection of women who complain of sexual assault , either from their bosses or from their colleagues .


fn_spacy_tokens_for_baseline: In this last programme in our short series on the boundaries of science , we 're going to look at one aspect of that most baffling and intriguing subject , the origin of life .

source_bert_toks: in this last programme in our short series on the boundaries of science , we ' re going to look at one aspect of that most ba ##ff ##ling and intriguing subject , the origin of life .

reference_raw: In the last program of our short series on the frontiers of science, we will look at one aspect of this most confusing and interesting subject, the origin of life.

reference_spacy_tokens: In the last program of our short series on the frontiers of science , we will look at one aspect of this most confusing and interesting subject , the origin of life .


fn_spacy_tokens_for_baseline: Little assembled a squad of 20 professionals , many on terms which would make Hartlepool blanch .

source_bert_toks: little assembled a squad of 20 professionals , many on terms which would make hart ##le ##pool blanc ##h .

reference_raw: Little had assembled a team of twenty professionals, many under conditions that would have made Hartlepool blanch.

reference_spacy_tokens: Little had assembled a team of twenty professionals , many under conditions that would have made Hartlepool blanch .


fn_spacy_tokens_for_baseline: Although Jackson 's conclusions are " mostly solid , " the Times writes , his conclusion that Microsoft 's integration of its browser into Windows provides no technical efficiency or consumer benefit is weak -- especially because it flies in the face of an appeals court ruling last year .

source_bert_toks: although jackson ' s conclusions are " mostly solid , " the times writes , his conclusion that microsoft ' s integration of its browser into windows provides no technical efficiency or consumer benefit is weak - - especially because it flies in the face of an appeals court ruling last year .

reference_raw: Although Jackson's conclusions are "mostly solid," the Times writes, its conclusion that Microsoft's integration of its browser into Windows does not provide any technical efficiency or benefits for consumers is weak - especially since it is in the face of an appeal court ruling last year.

reference_spacy_tokens: Although Jackson 's conclusions are " mostly solid , " the Times writes , its conclusion that Microsoft 's integration of its browser into Windows does not provide any technical efficiency or benefits for consumers is weak - especially since it is in the face of an appeal court ruling last year .


fn_spacy_tokens_for_baseline: She continues : ' The people who created Guede ' needed a spirit which could burlesque the society that crushed him , so Guede ' eats roasted peanuts and parched corn like his devotees .

source_bert_toks: she continues : ' the people who created gu ##ede ' needed a spirit which could bu ##rle ##sque the society that crushed him , so gu ##ede ' eats roasted peanuts and parc ##hed corn like his devotees .

reference_raw: He goes on, "The people who made Guede need a ghost that can bury the company that crushed him, so Guede eats roasted nuts and parched corn like his devouts.

reference_spacy_tokens: He goes on , " The people who made Guede need a ghost that can bury the company that crushed him , so Guede eats roasted nuts and parched corn like his devouts .


fn_spacy_tokens_for_baseline: The more usual victims are a white cock , which is plucked in pieces alive , or a black goat , whose throat is cut and body burned . '

source_bert_toks: the more usual victims are a white cock , which is plucked in pieces alive , or a black goat , whose throat is cut and body burned . '

reference_raw: The most common victim is a white bird that's torn to pieces alive, or a black goat whose throat is slit and whose body is burned.

reference_spacy_tokens: The most common victim is a white bird that 's torn to pieces alive , or a black goat whose throat is slit and whose body is burned .


fn_spacy_tokens_for_baseline: To stay with yellow for a moment : we noted a paring - down to the bare bones of yellow water in a yellow glass when Raskolnikov comes to after fainting on his first visit to the police station .

source_bert_toks: to stay with yellow for a moment : we noted a par ##ing - down to the bare bones of yellow water in a yellow glass when ras ##ko ##ln ##iko ##v comes to after faint ##ing on his first visit to the police station .

reference_raw: To remain yellow for a while: when Raskolnikov woke up after his first visit to the police station, we noticed the paring-down to the bare bones of the yellow water in the yellow glass.

reference_spacy_tokens: To remain yellow for a while : when Raskolnikov woke up after his first visit to the police station , we noticed the paring - down to the bare bones of the yellow water in the yellow glass .


fn_spacy_tokens_for_baseline: They keep busy 24 hours a day , but if you want a change of scene there are always more gambling opportunities available .

source_bert_toks: they keep busy 24 hours a day , but if you want a change of scene there are always more gambling opportunities available .

reference_raw: They're busy 24 hours a day, but if you want to change the scene, there's always more chance of gambling.

reference_spacy_tokens: They 're busy 24 hours a day , but if you want to change the scene , there 's always more chance of gambling .


fn_spacy_tokens_for_baseline: The traditionalism and sluggishness of the decision processes in the public sector is noted repeatedly .

source_bert_toks: the traditional ##ism and slug ##gis ##hn ##ess of the decision processes in the public sector is noted repeatedly .

reference_raw: The tradition and slowness of the decision-making process in the public sector has been repeatedly noted.

reference_spacy_tokens: The tradition and slowness of the decision - making process in the public sector has been repeatedly noted .


fn_spacy_tokens_for_baseline: The effect of obesity was considered but , although mean levels of triglyceride were increased by 28 per cent in obese subjects , the levels were still increased in lean diabetics with macrovascular disease compared to lean controls .

source_bert_toks: the effect of obesity was considered but , although mean levels of tri ##gly ##cer ##ide were increased by 28 per cent in obe ##se subjects , the levels were still increased in lean dia ##bet ##ics with macro ##vas ##cular disease compared to lean controls .

reference_raw: The effect of obesity was considered, but although the mean triglyceride levels were increased by 28% in obesity patients, the level was still higher in lean diabetics with macrovascular disease compared to lean controls.

reference_spacy_tokens: The effect of obesity was considered , but although the mean triglyceride levels were increased by 28 % in obesity patients , the level was still higher in lean diabetics with macrovascular disease compared to lean controls .


fn_spacy_tokens_for_baseline: Mr Clinton himself was due to call Ross Perot yesterday , courting the maverick businessman who earned 20 % of the vote in the November election .

source_bert_toks: mr clinton himself was due to call ross per ##ot yesterday , court ##ing the maverick businessman who earned 20 % of the vote in the november election .

reference_raw: Mr. Clinton himself was supposed to call Ross Perot yesterday and judge a Maverick businessman who earned 20% of the vote in the November election.

reference_spacy_tokens: Mr. Clinton himself was supposed to call Ross Perot yesterday and judge a Maverick businessman who earned 20 % of the vote in the November election .


fn_spacy_tokens_for_baseline: He then sets out to scourge the thronging temples of moneychangers and idolators .

source_bert_toks: he then sets out to sc ##our ##ge the th ##rong ##ing temples of money ##chang ##ers and idol ##ators .

reference_raw: Then he sets out to search the throbbing temples of money-changers and idolators.

reference_spacy_tokens: Then he sets out to search the throbbing temples of money - changers and idolators .


fn_spacy_tokens_for_baseline: The therapist had understood , had agreed that poor Mrs Skipton should have a telephone , had thrown up her muscle - roped arms in dismay on hearing of Mr Skipton 's frugality .

source_bert_toks: the therapist had understood , had agreed that poor mrs skip ##ton should have a telephone , had thrown up her muscle - rope ##d arms in dismay on hearing of mr skip ##ton ' s fr ##uga ##lity .

reference_raw: The therapist understood, agreed that poor Mrs. Skipton should be on the phone, and threw up her muscular arms in dismay when she heard that Mr. Skipton was being rude.

reference_spacy_tokens: The therapist understood , agreed that poor Mrs. Skipton should be on the phone , and threw up her muscular arms in dismay when she heard that Mr. Skipton was being rude .


fn_spacy_tokens_for_baseline: The tormented partners have had to put off their divorce actions as they ca n't sell their homes .

source_bert_toks: the tormented partners have had to put off their divorce actions as they can ' t sell their homes .

reference_raw: The tortured partners had to postpone their divorce proceedings because they couldn't sell their homes.

reference_spacy_tokens: The tortured partners had to postpone their divorce proceedings because they could n't sell their homes .


fn_spacy_tokens_for_baseline: Kim Il Sung appreciated Soviet and Chinese support during the Korean War , but he had expected more , particularly from the Soviets , and he was dissatisfied that the war had ended in a stalemate .

source_bert_toks: kim il sung appreciated soviet and chinese support during the korean war , but he had expected more , particularly from the soviets , and he was dissatisfied that the war had ended in a stale ##mate .

reference_raw: Kim Il Sung appreciated the support of the Soviets and the Chinese during the Korean War, but he expected more, especially from the Soviets, and was disappointed that the war had ended in a stalemate.

reference_spacy_tokens: Kim Il Sung appreciated the support of the Soviets and the Chinese during the Korean War , but he expected more , especially from the Soviets , and was disappointed that the war had ended in a stalemate .


fn_spacy_tokens_for_baseline: The shop gloomed behind its blinds and the parakeet drowsed .

source_bert_toks: the shop gloom ##ed behind its blinds and the para ##kee ##t dr ##ows ##ed .

reference_raw: The shop darkened behind its blinds, and the parrot fell asleep.

reference_spacy_tokens: The shop darkened behind its blinds , and the parrot fell asleep .


fn_spacy_tokens_for_baseline: She quieted the children , offered me another coffee , then said , ' Come , Um Yusef .

source_bert_toks: she quiet ##ed the children , offered me another coffee , then said , ' come , um yu ##sef .

reference_raw: She calmed the kids down, offered me another cup of coffee, and said, "Come on, Um Yusef.

reference_spacy_tokens: She calmed the kids down , offered me another cup of coffee , and said , " Come on , Um Yusef .


fn_spacy_tokens_for_baseline: ' Unless you know how to use it , ' she sighed , ' a Scrabble game is just a boxful of junk . '

source_bert_toks: ' unless you know how to use it , ' she sighed , ' a sc ##ra ##bble game is just a box ##ful of junk . '

reference_raw: 'If you don't know how to use it,' she sighed, 'the Scrabble game is a box full of junk.'

reference_spacy_tokens: ' If you do n't know how to use it , ' she sighed , ' the Scrabble game is a box full of junk . '


fn_spacy_tokens_for_baseline: In that respect , the contagion of American fundamentalism certainly augurs ill .

source_bert_toks: in that respect , the con ##tag ##ion of american fundamental ##ism certainly aug ##urs ill .

reference_raw: In this respect, the outbreak of American fundamentalism is definitely August III.

reference_spacy_tokens: In this respect , the outbreak of American fundamentalism is definitely August III .


fn_spacy_tokens_for_baseline: Before long he became part - time Bursar , and on his retirement from teaching in the late 1950s he had taken on the post full - time .

source_bert_toks: before long he became part - time bu ##rsa ##r , and on his retirement from teaching in the late 1950s he had taken on the post full - time .

reference_raw: Soon he became a part-time Bursar and retired from teaching in the late 1950s.

reference_spacy_tokens: Soon he became a part - time Bursar and retired from teaching in the late 1950s .


fn_spacy_tokens_for_baseline: Prospective studies in Pima Indians indicate that ' thrifty ' lower metabolic rates in humans may favour weight gain .

source_bert_toks: prospective studies in pi ##ma indians indicate that ' th ##rift ##y ' lower metabolic rates in humans may favour weight gain .

reference_raw: Prospective studies in Pima Indians suggest that lower metabolic rates in humans may favour weight gain.

reference_spacy_tokens: Prospective studies in Pima Indians suggest that lower metabolic rates in humans may favour weight gain .


fn_spacy_tokens_for_baseline: 2- Preserving Islamic morals and avoiding means of corruption and bad companions , through verification and confirmation of news . ( T.C : Koranic verse ) To observe good conduct and filial piety even if they were infidels .

source_bert_toks: 2 - preserving islamic morals and avoiding means of corruption and bad companions , through verification and confirmation of news . ( t . c : ko ##rani ##c verse ) to observe good conduct and fi ##lia ##l pie ##ty even if they were in ##fide ##ls .

reference_raw: 2- Preserving Islamic morals and avoiding the resources of corruption and evil companions by verifying and confirming news. (T.C.: Koranic verse) Observing good behavior and filial piety, even if they were infidels.

reference_spacy_tokens: 2- Preserving Islamic morals and avoiding the resources of corruption and evil companions by verifying and confirming news . ( T.C. : Koranic verse ) Observing good behavior and filial piety , even if they were infidels .


fn_spacy_tokens_for_baseline: ' Got to observe strict ARP , you see , Miss , though here we are gettin ' on for five months of war and not a peep out of a Jerry plane .

source_bert_toks: ' got to observe strict ar ##p , you see , miss , though here we are get ##tin ' on for five months of war and not a pee ##p out of a jerry plane .

reference_raw: 'I have to follow a strict ARP, you know, miss, even though we're here for five months of war and not looking out of Jerry's plane.

reference_spacy_tokens: ' I have to follow a strict ARP , you know , miss , even though we 're here for five months of war and not looking out of Jerry 's plane .


fn_spacy_tokens_for_baseline: Dubai 01 - 82 ( AFP ) - Crown Prince of Dubai Al Sheikh Mohammed bin Rashid Al Maktoom crown prince of Dubai launched today , i.e. on Saturday , an electronics free e - trade zone which has been named " Dubai Internet City "

source_bert_toks: dubai 01 - 82 ( af ##p ) - crown prince of dubai al sheikh mohammed bin rashid al ma ##kt ##oom crown prince of dubai launched today , i . e . on saturday , an electronics free e - trade zone which has been named " dubai internet city "

reference_raw: Dubai 01-82 (AFP) - Crown Prince of Dubai Al Sheikh Mohammed bin Rashid Al Maktoom Crown Prince of Dubai launched today, i.e. on Saturday, an electronics free electronics trading zone called Dubai Internet City.

reference_spacy_tokens: Dubai 01 - 82 ( AFP ) - Crown Prince of Dubai Al Sheikh Mohammed bin Rashid Al Maktoom Crown Prince of Dubai launched today , i.e. on Saturday , an electronics free electronics trading zone called Dubai Internet City .


fn_spacy_tokens_for_baseline: The rooms had been comfortable and not overcrowded .

source_bert_toks: the rooms had been comfortable and not over ##crow ##ded .

reference_raw: The rooms were comfortable and not crowded.

reference_spacy_tokens: The rooms were comfortable and not crowded .


fn_spacy_tokens_for_baseline: ' But you did , ' reasoned Betty .

source_bert_toks: ' but you did , ' reasoned betty .

reference_raw: 'Yes,' said Betty.

reference_spacy_tokens: ' Yes , ' said Betty .


fn_spacy_tokens_for_baseline: Very fine he and his men looked in their feathered bonnets with the pipes playing .

source_bert_toks: very fine he and his men looked in their feather ##ed bonnet ##s with the pipes playing .

reference_raw: He and his men looked very well in their feathered hats, their pipes playing.

reference_spacy_tokens: He and his men looked very well in their feathered hats , their pipes playing .


fn_spacy_tokens_for_baseline: There is a total of 12,800 Buddha statues here , plus the remains of the monastery 's founder embalmed in gold leaf .

source_bert_toks: there is a total of 12 , 800 buddha statues here , plus the remains of the monastery ' s founder em ##bal ##med in gold leaf .

reference_raw: There are 12,800 statues of Buddha, plus the remains of the founder of the convent embalmed with gold leaves.

reference_spacy_tokens: There are 12,800 statues of Buddha , plus the remains of the founder of the convent embalmed with gold leaves .


fn_spacy_tokens_for_baseline: In an effort to provide yet one more thing to bet on , players are imported from Spain to take part in this lightning - fast Basque ball game .

source_bert_toks: in an effort to provide yet one more thing to bet on , players are imported from spain to take part in this lightning - fast basque ball game .

reference_raw: In an effort to make another bet, the players are imported from Spain to participate in the lightning game - a quick basque ball game.

reference_spacy_tokens: In an effort to make another bet , the players are imported from Spain to participate in the lightning game - a quick basque ball game .


fn_spacy_tokens_for_baseline: Ferrari technicians were keeping mum about the new racer 's absence .

source_bert_toks: ferrari technicians were keeping mum about the new racer ' s absence .

reference_raw: The Ferrari technicians kept their mother informed of the absence of the new racer.

reference_spacy_tokens: The Ferrari technicians kept their mother informed of the absence of the new racer .


fn_spacy_tokens_for_baseline: And the ninteen hour plane ride .

source_bert_toks: and the ni ##nte ##en hour plane ride .

reference_raw: And a nine-hour flight.

reference_spacy_tokens: And a nine - hour flight .


fn_spacy_tokens_for_baseline: Local trading inspectors said they were testing similar skirts to find out what caused the garment to combust .

source_bert_toks: local trading inspectors said they were testing similar skirts to find out what caused the garment to comb ##ust .

reference_raw: The local business inspectors said they were testing similar skirts to see what caused the clothing to burn.

reference_spacy_tokens: The local business inspectors said they were testing similar skirts to see what caused the clothing to burn .


fn_spacy_tokens_for_baseline: ' Kingbee go down , now ' -- the alert from the pilot that he was going in under fire -- were the sweetest words an SOG team could hear , Meyer recalled .

source_bert_toks: ' king ##bee go down , now ' - - the alert from the pilot that he was going in under fire - - were the sweet ##est words an so ##g team could hear , meyer recalled .

reference_raw: "Kingbee's going down, now," Meyer remembered, "the pilot's warning that he was going under fire was the sweetest word the SOG team had ever heard.

reference_spacy_tokens: " Kingbee 's going down , now , " Meyer remembered , " the pilot 's warning that he was going under fire was the sweetest word the SOG team had ever heard .


fn_spacy_tokens_for_baseline: Noriega is close to Castro and may once have been his agent .

source_bert_toks: nor ##ieg ##a is close to castro and may once have been his agent .

reference_raw: Noriega's near Castro, and he might once have been his agent.

reference_spacy_tokens: Noriega 's near Castro , and he might once have been his agent .


fn_spacy_tokens_for_baseline: ' But it 's been a complicated situation ; we 've had to cancel or reschedule gigs with Cozy 's band because of Brian 's thing , and there was a further complication & hellip ;

source_bert_toks: ' but it ' s been a complicated situation ; we ' ve had to cancel or res ##ched ##ule gigs with cozy ' s band because of brian ' s thing , and there was a further com ##plication & hell ##ip ;

reference_raw: 'But it was a complicated situation; we had to cancel or change the concerts with Cozy's band because of Brian's business, and there was another complication of &Hellip;

reference_spacy_tokens: ' But it was a complicated situation ; we had to cancel or change the concerts with Cozy 's band because of Brian 's business , and there was another complication of & Hellip ;


fn_spacy_tokens_for_baseline: The first of these , the preparation of lessons in sequence will obviously deal with the formulation of learning objectives which can be realised in a particular unit of work .

source_bert_toks: the first of these , the preparation of lessons in sequence will obviously deal with the formulation of learning objectives which can be realised in a particular unit of work .

reference_raw: The first is that the preparation of lessons in a sequence will clearly address the definition of learning objectives that can be achieved in a particular unit of work.

reference_spacy_tokens: The first is that the preparation of lessons in a sequence will clearly address the definition of learning objectives that can be achieved in a particular unit of work .


fn_spacy_tokens_for_baseline: There is water - skiing , wind - surfing , sailing and many excursion options by day , and a myriad of lively cafes and restaurants for the evenings .

source_bert_toks: there is water - skiing , wind - surfing , sailing and many excursion options by day , and a myriad of lively cafes and restaurants for the evenings .

reference_raw: There are water-skiing, wind-surfing, sailing, and many daily trips, and a number of lively coffee shops and restaurants.

reference_spacy_tokens: There are water - skiing , wind - surfing , sailing , and many daily trips , and a number of lively coffee shops and restaurants .


fn_spacy_tokens_for_baseline: My mother works in occupational therapy and she said she was going to take time off work to go and see it , it sounded as if they have done wonders -- oh ! "

source_bert_toks: my mother works in occupational therapy and she said she was going to take time off work to go and see it , it sounded as if they have done wonders - - oh ! "

reference_raw: My mother's working in professional therapy, and she said she'd take a break to look at it, it sounded like they'd done miracles -- oh!

reference_spacy_tokens: My mother 's working in professional therapy , and she said she 'd take a break to look at it , it sounded like they 'd done miracles -- oh !


fn_spacy_tokens_for_baseline: When she emerged , looking tired and exasperated , he made various consoling remarks , most of which she seemed not to hear .

source_bert_toks: when she emerged , looking tired and exasperated , he made various con ##sol ##ing remarks , most of which she seemed not to hear .

reference_raw: When she came out, looking tired and irritated, he made a number of comforting remarks, most of which she didn't seem to hear.

reference_spacy_tokens: When she came out , looking tired and irritated , he made a number of comforting remarks , most of which she did n't seem to hear .


fn_spacy_tokens_for_baseline: Dampen the pastry edges , seal together lengthwise and then seal both ends .

source_bert_toks: damp ##en the pastry edges , seal together length ##wise and then seal both ends .

reference_raw: Impair the edges of the pastry, seal them together long enough, then seal both ends.

reference_spacy_tokens: Impair the edges of the pastry , seal them together long enough , then seal both ends .


fn_spacy_tokens_for_baseline: ( If he won , he would clear them off Oualie -- how he coveted that island 's green streams and slopes ! )

source_bert_toks: ( if he won , he would clear them off ou ##ali ##e - - how he coveted that island ' s green streams and slopes ! )

reference_raw: (If he wins, he'll clean them out of Oualia - how he longed for the green streams and slopes of the island!)

reference_spacy_tokens: ( If he wins , he 'll clean them out of Oualia - how he longed for the green streams and slopes of the island ! )


fn_spacy_tokens_for_baseline: The car gave a roar , then slowly moved out of the garage ; the dim side - lights showed a pale flicker on the back of the house , then swung around for an instant on to the gardens .

source_bert_toks: the car gave a roar , then slowly moved out of the garage ; the dim side - lights showed a pale flicker on the back of the house , then swung around for an instant on to the gardens .

reference_raw: The car roared, then slowly left the parking lot; the dim sidelights showed a pale flicker in the back of the house, then turned to the gardens for a moment.

reference_spacy_tokens: The car roared , then slowly left the parking lot ; the dim sidelights showed a pale flicker in the back of the house , then turned to the gardens for a moment .


fn_spacy_tokens_for_baseline: The Western District is one of Hong Kong 's oldest neighborhoods , and its narrow streets hold a collection of fascinating traditional shops and enterprises .

source_bert_toks: the western district is one of hong kong ' s oldest neighborhoods , and its narrow streets hold a collection of fascinating traditional shops and enterprises .

reference_raw: The western district is one of the oldest districts in Hong Kong, with a collection of fascinating traditional shops and businesses in its small streets.

reference_spacy_tokens: The western district is one of the oldest districts in Hong Kong , with a collection of fascinating traditional shops and businesses in its small streets .


fn_spacy_tokens_for_baseline: The rise and rise of the young conservatives and the ' new Right ' are proof positive of that .

source_bert_toks: the rise and rise of the young conservatives and the ' new right ' are proof positive of that .

reference_raw: The rise and rise of the young conservatories and the "new right" prove positive.

reference_spacy_tokens: The rise and rise of the young conservatories and the " new right " prove positive .


fn_spacy_tokens_for_baseline: I remember , too , her strangely spaced cheekbones and severely cut hair .

source_bert_toks: i remember , too , her strangely spaced cheekbones and severely cut hair .

reference_raw: I also remember her strangely sprawled cheekbones and severely sliced hair.

reference_spacy_tokens: I also remember her strangely sprawled cheekbones and severely sliced hair .


fn_spacy_tokens_for_baseline: Indian fielders were pelted with stones and oranges and police retaliated with tear - gas .

source_bert_toks: indian fielder ##s were pe ##lt ##ed with stones and orange ##s and police re ##tal ##iated with tear - gas .

reference_raw: The Indian fielders were littered with rocks and oranges, and the police were retaliated with tear gas.

reference_spacy_tokens: The Indian fielders were littered with rocks and oranges , and the police were retaliated with tear gas .


fn_spacy_tokens_for_baseline: Bone the legs and mince the leg meat , pork fat and 4 oz of the duck livers through the coarse plate of the mincer .

source_bert_toks: bone the legs and min ##ce the leg meat , pork fat and 4 ##oz of the duck liver ##s through the coarse plate of the min ##cer .

reference_raw: Bone the legs and cut the leg meat, pork fat and four dozen duck livers through a rough plate of mincers.

reference_spacy_tokens: Bone the legs and cut the leg meat , pork fat and four dozen duck livers through a rough plate of mincers .


fn_spacy_tokens_for_baseline: Pickett , who was shot in the knee by the Secret Service after allegedly firing two shots outside the White House , used crutches to walk into the court .

source_bert_toks: picket ##t , who was shot in the knee by the secret service after allegedly firing two shots outside the white house , used cr ##ut ##ches to walk into the court .

reference_raw: Pickett, who was shot in the knee by the Secret Service after allegedly shooting two shots in front of the White House, used his crutches to enter the courtroom.

reference_spacy_tokens: Pickett , who was shot in the knee by the Secret Service after allegedly shooting two shots in front of the White House , used his crutches to enter the courtroom .


fn_spacy_tokens_for_baseline: Right : With an unusual hoop - back Regency design , the Greenwich armchair from Barnsley House 's Winterthur collection is a must for those looking for sturdy yet stylish garden furniture .

source_bert_toks: right : with an unusual hoop - back regency design , the greenwich armchair from barnsley house ' s winter ##th ##ur collection is a must for those looking for sturdy yet st ##yl ##ish garden furniture .

reference_raw: The Greenwich chair of the Barnsley House Winterthur Collective is a must for those who seek sturdy but stylish garden furniture.

reference_spacy_tokens: The Greenwich chair of the Barnsley House Winterthur Collective is a must for those who seek sturdy but stylish garden furniture .


fn_spacy_tokens_for_baseline: He spread an artist 's folio before her , untied the ribbons with delicate fingers , and invited her to lay it open .

source_bert_toks: he spread an artist ' s f ##olio before her , un ##tie ##d the ribbons with delicate fingers , and invited her to lay it open .

reference_raw: He spread the artist's folio in front of her, loosened the ribbons with delicate fingers, and asked her to open it.

reference_spacy_tokens: He spread the artist 's folio in front of her , loosened the ribbons with delicate fingers , and asked her to open it .


fn_spacy_tokens_for_baseline: It 's good to gladden the eye with a dish full of colour . '

source_bert_toks: it ' s good to glad ##den the eye with a dish full of colour . '

reference_raw: It's a good thing you're glad to have an eye with a bowl full of color.'

reference_spacy_tokens: It 's a good thing you 're glad to have an eye with a bowl full of color . '


fn_spacy_tokens_for_baseline: However , sometimes it seems that the city produced artists of this stature by accident , even against its will .

source_bert_toks: however , sometimes it seems that the city produced artists of this stature by accident , even against its will .

reference_raw: At times, however, the city seems to have created artists of this stature by accident, even against its will.

reference_spacy_tokens: At times , however , the city seems to have created artists of this stature by accident , even against its will .


fn_spacy_tokens_for_baseline: Inflammatory proclamations had already been pasted on the cathedral in Riga .

source_bert_toks: inflammatory proclamation ##s had already been paste ##d on the cathedral in riga .

reference_raw: Inflammatory statements have already been inserted into the Riga cathedral.

reference_spacy_tokens: Inflammatory statements have already been inserted into the Riga cathedral .


fn_spacy_tokens_for_baseline: The Temple is located in the Gaean Vale , a long and beautiful valley , lined with wild apple trees and nourished by waterfalls and clear springs .

source_bert_toks: the temple is located in the ga ##ean vale , a long and beautiful valley , lined with wild apple trees and no ##uri ##shed by waterfalls and clear springs .

reference_raw: The temple is situated in the Gaean Valley, a long and beautiful valley, surrounded by wild apple trees and fed by waterfalls and clear springs.

reference_spacy_tokens: The temple is situated in the Gaean Valley , a long and beautiful valley , surrounded by wild apple trees and fed by waterfalls and clear springs .


fn_spacy_tokens_for_baseline: The food , the truckloads of champagne , accommodation , fees for the gala stars and 800 musicians , and air fares for many of the guests add up to a bill of millions for the weekend .

source_bert_toks: the food , the truck ##load ##s of champagne , accommodation , fees for the gala stars and 800 musicians , and air fares for many of the guests add up to a bill of millions for the weekend .

reference_raw: Food, a load of champagne, accommodation, fees for gala stars and 800 musicians, and air fares for many guests add up to a million dollars this weekend.

reference_spacy_tokens: Food , a load of champagne , accommodation , fees for gala stars and 800 musicians , and air fares for many guests add up to a million dollars this weekend .


fn_spacy_tokens_for_baseline: People would gang together to destroy him .

source_bert_toks: people would gang together to destroy him .

reference_raw: People would go out of their way to destroy it.

reference_spacy_tokens: People would go out of their way to destroy it .


fn_spacy_tokens_for_baseline: The United States called the groups it supported " freedom fighters " ( such as the contras in Nicaragua and the mujahideen in Afghanistan ) , while labeling the groups supported by the Soviet Union as " terrorists " ( such as the Palestinian Liberation Organization ) .

source_bert_toks: the united states called the groups it supported " freedom fighters " ( such as the contra ##s in nicaragua and the mu ##jah ##ide ##en in afghanistan ) , while labeling the groups supported by the soviet union as " terrorists " ( such as the palestinian liberation organization ) .

reference_raw: The United States referred to groups that it supported "Freedom Fighters" (such as the Contras in Nicaragua and the Mujahideen in Afghanistan) and referred to groups supported by the Soviet Union as "Terrorists" (such as the Palestinian Liberation Organisation).

reference_spacy_tokens: The United States referred to groups that it supported " Freedom Fighters " ( such as the Contras in Nicaragua and the Mujahideen in Afghanistan ) and referred to groups supported by the Soviet Union as " Terrorists " ( such as the Palestinian Liberation Organisation ) .


fn_spacy_tokens_for_baseline: For instance , when I was first in Britain , I saw all the sights , I could travel on the tube and no - one recognised me .

source_bert_toks: for instance , when i was first in britain , i saw all the sights , i could travel on the tube and no - one recognised me .

reference_raw: For example, when I was in Britain for the first time, I looked at all the sights, I could travel in the tunnel, and no one would recognize me.

reference_spacy_tokens: For example , when I was in Britain for the first time , I looked at all the sights , I could travel in the tunnel , and no one would recognize me .


fn_spacy_tokens_for_baseline: Everything he wore had to be thick , because he tore his clothes , destroyed them .

source_bert_toks: everything he wore had to be thick , because he tore his clothes , destroyed them .

reference_raw: Everything he wore must have been thick, for he ripped off his clothes and destroyed them.

reference_spacy_tokens: Everything he wore must have been thick , for he ripped off his clothes and destroyed them .


fn_spacy_tokens_for_baseline: You can build an appetite for dinner by making your way from the beach to the restaurant .

source_bert_toks: you can build an appetite for dinner by making your way from the beach to the restaurant .

reference_raw: If you go from the beach to the restaurant, you can build a taste for dinner.

reference_spacy_tokens: If you go from the beach to the restaurant , you can build a taste for dinner .


fn_spacy_tokens_for_baseline: He said he also issued warnings before President Bush 's January 28 , 2003 , State of the Union speech that included Bush statements about Iraq 's mobile labs " designed to produce germ warfare agents . " ( CNN , 25Jun06 , Reuters ) ( Link )

source_bert_toks: he said he also issued warnings before president bush ' s january 28 , 2003 , state of the union speech that included bush statements about iraq ' s mobile labs " designed to produce ge ##rm warfare agents . " ( cnn , 25 ##jun ##0 ##6 , reuters ) ( link )

reference_raw: He also announced that he had issued a warning before President Bush's January 28, 2003 State of the Union speech, which included Bush's statements on Iraq's mobile laboratories "designed for the production of germ warfare agents." (CNN, 25 June 2006, Reuters)

reference_spacy_tokens: He also announced that he had issued a warning before President Bush 's January 28 , 2003 State of the Union speech , which included Bush 's statements on Iraq 's mobile laboratories " designed for the production of germ warfare agents . " ( CNN , 25 June 2006 , Reuters )


fn_spacy_tokens_for_baseline: George Gardiner and Alfred Sherman sat in an anteroom ready at an instant to do her bidding .

source_bert_toks: george gardiner and alfred sherman sat in an ant ##ero ##om ready at an instant to do her bidding .

reference_raw: George Gardiner and Alfred Sherman were sitting in the front room, ready to do their bidding at once.

reference_spacy_tokens: George Gardiner and Alfred Sherman were sitting in the front room , ready to do their bidding at once .


fn_spacy_tokens_for_baseline: Clients needing compression hosiery are measured accurately and given education .

source_bert_toks: clients needing compression ho ##sier ##y are measured accurately and given education .

reference_raw: Clients in need of compression hosiers shall be accurately measured and educated.

reference_spacy_tokens: Clients in need of compression hosiers shall be accurately measured and educated .


fn_spacy_tokens_for_baseline: Negotiations between Israel and the Palestinian authority have finally resumed .

source_bert_toks: negotiations between israel and the palestinian authority have finally resumed .

reference_raw: Finally, negotiations between Israel and the Palestinian Authority continued.

reference_spacy_tokens: Finally , negotiations between Israel and the Palestinian Authority continued .


fn_spacy_tokens_for_baseline: There 's a glut now , ' said one rueful farmer .

source_bert_toks: there ' s a g ##lu ##t now , ' said one rue ##ful farmer .

reference_raw: Now there's glut," one sad farmer said.

reference_spacy_tokens: Now there 's glut , " one sad farmer said .


fn_spacy_tokens_for_baseline: Her arm was stinging and as she looked down she was surprised to see that she had also grazed the skin there .

source_bert_toks: her arm was stinging and as she looked down she was surprised to see that she had also grazed the skin there .

reference_raw: Her hand was stinging, and when she looked down, she was surprised to see that she had also scratched her skin.

reference_spacy_tokens: Her hand was stinging , and when she looked down , she was surprised to see that she had also scratched her skin .


fn_spacy_tokens_for_baseline: Requirements of joining AL QAEDA : 1 - Abiding by AL QAEDA rules , its beliefs and objectives as previously mentioned 2 - Obedience to the leaders in charge as much as possible , without disobeying Islamic rules 3 - No connection between AL QAEDA membership and any other Islamic group 4 - Maintain secrecy in work - related issues 5- Physically healthy ( except in administrative work ) 6- The candidate should not be in question when it comes to religion , integrity or his morality 7- Reciting the pledge of AL - QAEDA .

source_bert_toks: requirements of joining al qaeda : 1 - ab ##idi ##ng by al qaeda rules , its beliefs and objectives as previously mentioned 2 - obedience to the leaders in charge as much as possible , without di ##so ##bey ##ing islamic rules 3 - no connection between al qaeda membership and any other islamic group 4 - maintain secrecy in work - related issues 5 - physically healthy ( except in administrative work ) 6 - the candidate should not be in question when it comes to religion , integrity or his morality 7 - rec ##iting the pledge of al - qaeda .

reference_raw: Requests for membership of AL QAEDA: 1 - Abiding by the rules of the AL QAEDA, its beliefs and objectives as set out above 2 - Obedience to the leaders responsible, as far as possible, without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work-related matters 5- Physically sound (excluding administrative work) 6- in terms of religion, integrity or morality 7-Reciting AL-QAEDA's promise.

reference_spacy_tokens: Requests for membership of AL QAEDA : 1 - Abiding by the rules of the AL QAEDA , its beliefs and objectives as set out above 2 - Obedience to the leaders responsible , as far as possible , without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work - related matters 5- Physically sound ( excluding administrative work ) 6- in terms of religion , integrity or morality 7-Reciting AL - QAEDA 's promise .


fn_spacy_tokens_for_baseline: The police filed into the office .

source_bert_toks: the police filed into the office .

reference_raw: The police entered the office.

reference_spacy_tokens: The police entered the office .


fn_spacy_tokens_for_baseline: When overcome with grief , men rend their clothes .

source_bert_toks: when overcome with grief , men ren ##d their clothes .

reference_raw: When overcome by grief, men change their clothes.

reference_spacy_tokens: When overcome by grief , men change their clothes .


fn_spacy_tokens_for_baseline: You can tell'em a mile off .

source_bert_toks: you can tell ' em a mile off .

reference_raw: You can say it's a mile away.

reference_spacy_tokens: You can say it 's a mile away .


fn_spacy_tokens_for_baseline: And the Germans have always been excellent at map - reading .

source_bert_toks: and the germans have always been excellent at map - reading .

reference_raw: And the Germans were always good at reading maps.

reference_spacy_tokens: And the Germans were always good at reading maps .


fn_spacy_tokens_for_baseline: The chef makes tasty bread rolls and grows his own herbs .

source_bert_toks: the chef makes ta ##sty bread rolls and grows his own herbs .

reference_raw: The cook makes a delicious bread-roll and grows his own herbs.

reference_spacy_tokens: The cook makes a delicious bread - roll and grows his own herbs .


fn_spacy_tokens_for_baseline: Well - housed and fed with no money worries and a properly clean and organised environment for their infants , away from men who battered or abused them , they and their children could flourish .

source_bert_toks: well - housed and fed with no money worries and a properly clean and organised environment for their infants , away from men who battered or abused them , they and their children could flourish .

reference_raw: Well-housed and well-fed, with no money to worry about, and a properly clean and organized environment for their children, away from the men who had beaten or abused them, they and their children could thrive.

reference_spacy_tokens: Well - housed and well - fed , with no money to worry about , and a properly clean and organized environment for their children , away from the men who had beaten or abused them , they and their children could thrive .


fn_spacy_tokens_for_baseline: ' You know what I mean , anyway , ' he hazarded , giving up , and added ' As the challenged parties my lords Lio!rt and Liartes have choice of weapons . '

source_bert_toks: ' you know what i mean , anyway , ' he hazard ##ed , giving up , and added ' as the challenged parties my lords li ##o ! rt and liar ##tes have choice of weapons . '

reference_raw: 'At least you know what I mean,' he risked, giving up and adding, 'as the contested parties, my Lords Lio!rt and Liartes choose weapons.'

reference_spacy_tokens: ' At least you know what I mean , ' he risked , giving up and adding , ' as the contested parties , my Lords Lio!rt and Liartes choose weapons . '


fn_spacy_tokens_for_baseline: However , you are not likely to find bargains , and you should be aware that unless you are an expert , you can end up with a fake .

source_bert_toks: however , you are not likely to find bargain ##s , and you should be aware that unless you are an expert , you can end up with a fake .

reference_raw: But you probably won't find a deal, and you should know that if you're not an expert, you can end up with a fake.

reference_spacy_tokens: But you probably wo n't find a deal , and you should know that if you 're not an expert , you can end up with a fake .


fn_spacy_tokens_for_baseline: Although information on WMD programs for many countries is often limited , when it comes to assessing Iran 's alleged CW program , one must sift through a mountain of information , much of which is long on allegation and short on specific , corroborated evidence .

source_bert_toks: although information on w ##md programs for many countries is often limited , when it comes to assessing iran ' s alleged cw program , one must si ##ft through a mountain of information , much of which is long on all ##ega ##tion and short on specific , co ##rro ##bor ##ated evidence .

reference_raw: Although information on weapons of mass destruction programs is often limited in many countries, when it comes to the assessment of Iran's supposed CW program, it is necessary to sift through a mountain of information, most of which are long on allegations and lack of concrete, confirmed evidence.

reference_spacy_tokens: Although information on weapons of mass destruction programs is often limited in many countries , when it comes to the assessment of Iran 's supposed CW program , it is necessary to sift through a mountain of information , most of which are long on allegations and lack of concrete , confirmed evidence .


fn_spacy_tokens_for_baseline: Some 40 of the victim 's friends dragged Anunciacao from his bed the night after the crime and bludgeoned him to death with bricks and clubs .

source_bert_toks: some 40 of the victim ' s friends dragged an ##un ##cia ##cao from his bed the night after the crime and blu ##dge ##oned him to death with bricks and clubs .

reference_raw: The night after the crime, about 40 of the victim's friends dragged Anunciacao out of bed and beat him to death with bricks and clubs.

reference_spacy_tokens: The night after the crime , about 40 of the victim 's friends dragged Anunciacao out of bed and beat him to death with bricks and clubs .


fn_spacy_tokens_for_baseline: I 've got a small place near by on another cay .

source_bert_toks: i ' ve got a small place near by on another ca ##y .

reference_raw: I've got a little spot nearby on the next one.

reference_spacy_tokens: I 've got a little spot nearby on the next one .


fn_spacy_tokens_for_baseline: Winning it without a coherent message will be impossible .

source_bert_toks: winning it without a coherent message will be impossible .

reference_raw: Victory without a coherent message will be impossible.

reference_spacy_tokens: Victory without a coherent message will be impossible .


fn_spacy_tokens_for_baseline: And he really , and he really did belt him one .

source_bert_toks: and he really , and he really did belt him one .

reference_raw: And he really did, and he really taped one of them.

reference_spacy_tokens: And he really did , and he really taped one of them .


fn_spacy_tokens_for_baseline: All patients received aspirin ( 162 mg daily ) and the first dose was chewed for rapid and full antithrombotic effect .

source_bert_toks: all patients received as ##pi ##rin ( 162 mg daily ) and the first dose was chewed for rapid and full anti ##th ##rom ##bot ##ic effect .

reference_raw: All patients received aspirin (162 mg daily) and the first dose was taken with rapid and complete antithrombotic effect.

reference_spacy_tokens: All patients received aspirin ( 162 mg daily ) and the first dose was taken with rapid and complete antithrombotic effect .


fn_spacy_tokens_for_baseline: Serious concerns remain about China 's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the production of chemical weapons .

source_bert_toks: serious concerns remain about china ' s proliferation of ballistic missile technology and its ability to control chemical items that could be used in the production of chemical weapons .

reference_raw: There are still serious concerns about China's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the manufacture of chemical weapons.

reference_spacy_tokens: There are still serious concerns about China 's proliferation of ballistic missile technology and its ability to control chemical items that could be used in the manufacture of chemical weapons .


fn_spacy_tokens_for_baseline: ' Like one of the summer hailstorms which come without warning and strip the fruit from the vines .

source_bert_toks: ' like one of the summer hail ##storm ##s which come without warning and strip the fruit from the vines .

reference_raw: Like one of those summer hails that comes without warning and strips the fruit from the vines.

reference_spacy_tokens: Like one of those summer hails that comes without warning and strips the fruit from the vines .


fn_spacy_tokens_for_baseline: This busy , modern European city sits on a thousand years of history -- history is present everywhere , from elegant Merrion Square to the bullet holes on the General Post Office .

source_bert_toks: this busy , modern european city sits on a thousand years of history - - history is present everywhere , from elegant mer ##rion square to the bullet holes on the general post office .

reference_raw: This busy, modern European city sits on thousands of years of history - history is everywhere, from the elegant Merrion Square to the bullet holes in the General Post.

reference_spacy_tokens: This busy , modern European city sits on thousands of years of history - history is everywhere , from the elegant Merrion Square to the bullet holes in the General Post .


fn_spacy_tokens_for_baseline: The baby was voluble : he snuffled and sighed and grunted and bawled .

source_bert_toks: the baby was vol ##ub ##le : he s ##nu ##ffled and sighed and grunted and ba ##wled .

reference_raw: The child was sensual: he sniffed and sighed and grunted and grunted.

reference_spacy_tokens: The child was sensual : he sniffed and sighed and grunted and grunted .


fn_spacy_tokens_for_baseline: The descendants of Lingulella , slightly larger and called Lingula , are found today in , among other places , the coastal waters of Japan , burrowing in the sand and mud of estuaries .

source_bert_toks: the descendants of ling ##ule ##lla , slightly larger and called ling ##ula , are found today in , among other places , the coastal waters of japan , burr ##owing in the sand and mud of est ##uaries .

reference_raw: The descendants of Lingulella, slightly larger and called Lingula, are now found, among other places, in the coastal waters of Japan, buried in the sand and mud of the estuaries.

reference_spacy_tokens: The descendants of Lingulella , slightly larger and called Lingula , are now found , among other places , in the coastal waters of Japan , buried in the sand and mud of the estuaries .


fn_spacy_tokens_for_baseline: If he is competent and conscientious , he serves us well .

source_bert_toks: if he is competent and con ##sc ##ient ##ious , he serves us well .

reference_raw: If he's capable and conscientious, he'll serve us well.

reference_spacy_tokens: If he 's capable and conscientious , he 'll serve us well .


fn_spacy_tokens_for_baseline: It probably did not help Lendl 's mood that the net posts were adorned , in large letters , with the words ' ATP Tour ' .

source_bert_toks: it probably did not help lend ##l ' s mood that the net posts were adorned , in large letters , with the words ' atp tour ' .

reference_raw: It probably didn't help Lendl's mood that the nets were decorated with the words "ATP Tour" in large letters.

reference_spacy_tokens: It probably did n't help Lendl 's mood that the nets were decorated with the words " ATP Tour " in large letters .


fn_spacy_tokens_for_baseline: His two thumbs rotated about one another as they always did when he was agitated and looking for a way to strike .

source_bert_toks: his two thumbs rotated about one another as they always did when he was agitated and looking for a way to strike .

reference_raw: He turned his thumbs around each other, as he always did when he was upset, trying to find a way to strike.

reference_spacy_tokens: He turned his thumbs around each other , as he always did when he was upset , trying to find a way to strike .


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid, but the potential agreement still lacked the key element to verify that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid , but the potential agreement still lacked the key element to verify that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: As a family holiday destination , Bournemouth is without equal .

source_bert_toks: as a family holiday destination , bournemouth is without equal .

reference_raw: As a family holiday destination, Bournemouth has no equal.

reference_spacy_tokens: As a family holiday destination , Bournemouth has no equal .


fn_spacy_tokens_for_baseline: From the monastery , hikers enjoy the two - hour cross - country trek down to Silvermine Bay , but the authorities have warned walkers to be on the lookout for snakes , which can be plentiful in the Lantau hinterland , especially in summer .

source_bert_toks: from the monastery , hike ##rs enjoy the two - hour cross - country trek down to silver ##mine bay , but the authorities have warned walkers to be on the lookout for snakes , which can be pl ##ent ##iful in the lan ##ta ##u hint ##erland , especially in summer .

reference_raw: From the convent, tourists enjoy a two-hour cross-country trip to Silvermine Bay, but the authorities warned the pedestrians to keep an eye on the snakes, which could be abundant in the Land of Lantau, especially in the summer.

reference_spacy_tokens: From the convent , tourists enjoy a two - hour cross - country trip to Silvermine Bay , but the authorities warned the pedestrians to keep an eye on the snakes , which could be abundant in the Land of Lantau , especially in the summer .


fn_spacy_tokens_for_baseline: Perhaps they were all at this well - attended W.I. meeting , where not only hats , but coats and fur stoles seems to have been the thing .

source_bert_toks: perhaps they were all at this well - attended w . i . meeting , where not only hats , but coats and fur stole ##s seems to have been the thing .

reference_raw: Maybe everyone was at this well-managed W.I. meeting, where it didn't just look like hats, but coats and fur-stealing.

reference_spacy_tokens: Maybe everyone was at this well - managed W.I. meeting , where it did n't just look like hats , but coats and fur - stealing .


fn_spacy_tokens_for_baseline: She closed her eyes in dread .

source_bert_toks: she closed her eyes in dread .

reference_raw: She shut her eyes in horror.

reference_spacy_tokens: She shut her eyes in horror .


fn_spacy_tokens_for_baseline: But as I drew nearer the crag became smaller still , the stature of the brightly garbed climbers , who were smaller still , creating the optical illusion .

source_bert_toks: but as i drew nearer the cr ##ag became smaller still , the stature of the brightly ga ##rb ##ed climb ##ers , who were smaller still , creating the optical illusion .

reference_raw: But as I approached, the rock grew smaller and smaller, the shape of the brightly dressed climbers, still smaller, creating an optical illusion.

reference_spacy_tokens: But as I approached , the rock grew smaller and smaller , the shape of the brightly dressed climbers , still smaller , creating an optical illusion .


fn_spacy_tokens_for_baseline: By the end of ' The Daleks ' the Doctor Who office was regularly receiving a sackful of mail per day , sometimes two sackfuls .

source_bert_toks: by the end of ' the dale ##ks ' the doctor who office was regularly receiving a sack ##ful of mail per day , sometimes two sack ##ful ##s .

reference_raw: By the end of "Daleks", Doctor Who's office received a bag full of mail a day, sometimes two sacks.

reference_spacy_tokens: By the end of " Daleks " , Doctor Who 's office received a bag full of mail a day , sometimes two sacks .


fn_spacy_tokens_for_baseline: He in turn had friends among the indoor servants who unite in their fear and dislike of their master .

source_bert_toks: he in turn had friends among the indoor servants who unite in their fear and dislike of their master .

reference_raw: On the other hand, he had friends among the servants at home, uniting in their dread and displeasure of their master.

reference_spacy_tokens: On the other hand , he had friends among the servants at home , uniting in their dread and displeasure of their master .


fn_spacy_tokens_for_baseline: Her parents separated and later divorced and she says the ' family split into two ' .

source_bert_toks: her parents separated and later divorced and she says the ' family split into two ' .

reference_raw: Her parents split up and then divorced, and she said, "Family divided into two."

reference_spacy_tokens: Her parents split up and then divorced , and she said , " Family divided into two . "


fn_spacy_tokens_for_baseline: The production , which reportedly cost dlrs 10 million , looked terrific though , with the rural settings by Andrew Jackness evoking the sugar cane and sunsets of the Louisiana bayou .

source_bert_toks: the production , which reportedly cost dl ##rs 10 million , looked terrific though , with the rural settings by andrew jack ##ness ev ##oki ##ng the sugar cane and sunset ##s of the louisiana bayou .

reference_raw: But the production, which supposedly cost DLR 10 million, looked amazing when Andrew Jackness' rural settings evoked the sugar cane and the sunsets of the Louisiana Bay.

reference_spacy_tokens: But the production , which supposedly cost DLR 10 million , looked amazing when Andrew Jackness ' rural settings evoked the sugar cane and the sunsets of the Louisiana Bay .


fn_spacy_tokens_for_baseline: The real Lily sat opposite , her too brightly - coloured hair set in stiff waves about her faded face .

source_bert_toks: the real lily sat opposite , her too brightly - coloured hair set in stiff waves about her faded face .

reference_raw: The real Lily was sitting across from her, her hair too brightly colored in stiff ripples around her faded face.

reference_spacy_tokens: The real Lily was sitting across from her , her hair too brightly colored in stiff ripples around her faded face .


fn_spacy_tokens_for_baseline: However , he again refused to wear his uniform and was forcibly dressed and handcuffed to the cell bars .

source_bert_toks: however , he again refused to wear his uniform and was forcibly dressed and hand ##cu ##ffed to the cell bars .

reference_raw: He refused to wear his uniform again, however, and was forcibly dressed and chained to the bars of his cell.

reference_spacy_tokens: He refused to wear his uniform again , however , and was forcibly dressed and chained to the bars of his cell .


fn_spacy_tokens_for_baseline: Then came another political bust - up and the catastrophe of 1921 - 22 , when a Greek army tried to march on Ankara and was roundly beaten by the new Turkey of Kemal Ataturk .

source_bert_toks: then came another political bust - up and the catastrophe of 1921 - 22 , when a greek army tried to march on ankara and was round ##ly beaten by the new turkey of ke ##mal ata ##tur ##k .

reference_raw: Then came another political bust and disaster of 1921-22, when the Greek army tried to march on Ankara and was beaten round by the new Turkey of Kemal Ataturk.

reference_spacy_tokens: Then came another political bust and disaster of 1921 - 22 , when the Greek army tried to march on Ankara and was beaten round by the new Turkey of Kemal Ataturk .


fn_spacy_tokens_for_baseline: Iraq has claimed that over 1.2 million people , mostly children and the elderly , have died during the last 10 years , and blames the deaths on shortages of food , medicine and other essential supplies .

source_bert_toks: iraq has claimed that over 1 . 2 million people , mostly children and the elderly , have died during the last 10 years , and blame ##s the deaths on shortages of food , medicine and other essential supplies .

reference_raw: Iraq claims that over 1.2 million people, mostly children and older people, have died in the past 10 years and blames their deaths for lack of food, medicine and other basic supplies.

reference_spacy_tokens: Iraq claims that over 1.2 million people , mostly children and older people , have died in the past 10 years and blames their deaths for lack of food , medicine and other basic supplies .


fn_spacy_tokens_for_baseline: The Keeper waited while the other Man closed the door behind him and then set the cage on the ground and let Minch free .

source_bert_toks: the keeper waited while the other man closed the door behind him and then set the cage on the ground and let min ##ch free .

reference_raw: The Keeper waited until the second man closed the door behind him, then laid the cage on the floor and released Minch.

reference_spacy_tokens: The Keeper waited until the second man closed the door behind him , then laid the cage on the floor and released Minch .


fn_spacy_tokens_for_baseline: He says they picked it up on the radar and had to take evasive action .

source_bert_toks: he says they picked it up on the radar and had to take eva ##sive action .

reference_raw: He said they picked him up on the radar and had to avoid it.

reference_spacy_tokens: He said they picked him up on the radar and had to avoid it .


fn_spacy_tokens_for_baseline: Following this debacle , the Ottomans then allied themselves to Germany in the World War I , losing more territory with the defeat of the Germans in that war .

source_bert_toks: following this de ##ba ##cle , the ottomans then allied themselves to germany in the world war i , losing more territory with the defeat of the germans in that war .

reference_raw: After this debacle, the Ottomans then joined Germany in the First World War, and lost more territory by defeating Germany in that war.

reference_spacy_tokens: After this debacle , the Ottomans then joined Germany in the First World War , and lost more territory by defeating Germany in that war .


fn_spacy_tokens_for_baseline: They see social security staff as biased and prejudiced against the poor and only too ready to evade their responsibility to help .

source_bert_toks: they see social security staff as biased and prejudice ##d against the poor and only too ready to evade their responsibility to help .

reference_raw: They see social security workers as prejudiced and prejudiced against the poor and simply too prepared to avoid their responsibility for help.

reference_spacy_tokens: They see social security workers as prejudiced and prejudiced against the poor and simply too prepared to avoid their responsibility for help .


fn_spacy_tokens_for_baseline: The rapist and child killer she sees as her friend , her traumatised father , her sad , sick mother or the police who are trying to trace her ?

source_bert_toks: the rap ##ist and child killer she sees as her friend , her trauma ##tis ##ed father , her sad , sick mother or the police who are trying to trace her ?

reference_raw: A violent and child-killer he sees as a friend, a traumatized father, a sad, sick mother, or a police officer trying to track her down?

reference_spacy_tokens: A violent and child - killer he sees as a friend , a traumatized father , a sad , sick mother , or a police officer trying to track her down ?


fn_spacy_tokens_for_baseline: He fixed bail for appeal but said McGuigan was not to be released pending appeal .

source_bert_toks: he fixed bail for appeal but said mc ##gui ##gan was not to be released pending appeal .

reference_raw: He set bail for the appeal, but he said that McGuigan would not be released until the appeal was filed.

reference_spacy_tokens: He set bail for the appeal , but he said that McGuigan would not be released until the appeal was filed .


fn_spacy_tokens_for_baseline: The disease is caused by the species of bacterium called Leptospira icterohaemorrhagiae , present in the kidneys of the brown rat and voided in the urine .

source_bert_toks: the disease is caused by the species of bacterium called le ##pt ##os ##pi ##ra ict ##ero ##hae ##mo ##rr ##ha ##gia ##e , present in the kidney ##s of the brown rat and void ##ed in the urine .

reference_raw: The disease is caused by a type of bacteria called Leptospira icterohaemorrhagiae, which is present in the kidneys of a brown rat and is excreted in the urine.

reference_spacy_tokens: The disease is caused by a type of bacteria called Leptospira icterohaemorrhagiae , which is present in the kidneys of a brown rat and is excreted in the urine .


fn_spacy_tokens_for_baseline: She heard the clink of the dishes being taken away , then , from the corner of her eye , glimpsed movement as Nathan leaned forward .

source_bert_toks: she heard the cl ##ink of the dishes being taken away , then , from the corner of her eye , glimpse ##d movement as nathan leaned forward .

reference_raw: She heard the sound of the dishes being taken from her, and from the corner of her eye she saw a movement as Nathan leaned forward.

reference_spacy_tokens: She heard the sound of the dishes being taken from her , and from the corner of her eye she saw a movement as Nathan leaned forward .


fn_spacy_tokens_for_baseline: And she can not wait for her wedding blessing in December next year -- on her fourth anniversary .

source_bert_toks: and she can not wait for her wedding blessing in december next year - - on her fourth anniversary .

reference_raw: And he can't wait to get married next December on his fourth anniversary.

reference_spacy_tokens: And he ca n't wait to get married next December on his fourth anniversary .


fn_spacy_tokens_for_baseline: Things started to go wrong when Stuart became increasingly dissatisfied at work .

source_bert_toks: things started to go wrong when stuart became increasingly dissatisfied at work .

reference_raw: Things started to go wrong when Stuart got more and more unhappy at work.

reference_spacy_tokens: Things started to go wrong when Stuart got more and more unhappy at work .


fn_spacy_tokens_for_baseline: The flat cart was none too clean but Granny did n't seem to mind and was only anxious for the horse to be hitched to it .

source_bert_toks: the flat cart was none too clean but granny didn ' t seem to mind and was only anxious for the horse to be hitch ##ed to it .

reference_raw: The flat cart wasn't much of a clean one, but Granny didn't seem to mind, and she just couldn't wait to catch the horse.

reference_spacy_tokens: The flat cart was n't much of a clean one , but Granny did n't seem to mind , and she just could n't wait to catch the horse .


fn_spacy_tokens_for_baseline: But Matta was gazing at him , and his grin was wider , more gleeful .

source_bert_toks: but matt ##a was gazing at him , and his grin was wider , more glee ##ful .

reference_raw: But Matta stared at him, and his smile grew wider and more cheerful.

reference_spacy_tokens: But Matta stared at him , and his smile grew wider and more cheerful .


fn_spacy_tokens_for_baseline: With father 's leave he was confirmed in the Church of England at school .

source_bert_toks: with father ' s leave he was confirmed in the church of england at school .

reference_raw: With his father's permission, he was certified in the English Church at school.

reference_spacy_tokens: With his father 's permission , he was certified in the English Church at school .


fn_spacy_tokens_for_baseline: Therapeutics may lag behind , possibly for decades , so I will abstain from discussing these aspects here .

source_bert_toks: therapeutic ##s may la ##g behind , possibly for decades , so i will abs ##tain from discussing these aspects here .

reference_raw: Therapeutics may be delayed, perhaps for decades, so I shall refrain from discussing these aspects here.

reference_spacy_tokens: Therapeutics may be delayed , perhaps for decades , so I shall refrain from discussing these aspects here .


fn_spacy_tokens_for_baseline: The crowd noise hushed .

source_bert_toks: the crowd noise hushed .

reference_raw: The crowd's noise was quiet.

reference_spacy_tokens: The crowd 's noise was quiet .


fn_spacy_tokens_for_baseline: It was part of the economy drive in preparation for Hate Week .

source_bert_toks: it was part of the economy drive in preparation for hate week .

reference_raw: It was part of the economic drive to prepare for Hate Week.

reference_spacy_tokens: It was part of the economic drive to prepare for Hate Week .


fn_spacy_tokens_for_baseline: He got up , put the plates of food in the range oven to keep them hot , then went down to see if Mrs Beavis could help .

source_bert_toks: he got up , put the plates of food in the range oven to keep them hot , then went down to see if mrs bea ##vis could help .

reference_raw: He got up, put the plates of food in the radio oven to keep them warm, and went downstairs to see if Mrs. Beavis would be able to help.

reference_spacy_tokens: He got up , put the plates of food in the radio oven to keep them warm , and went downstairs to see if Mrs. Beavis would be able to help .


fn_spacy_tokens_for_baseline: Which is why she suggests you enlist a straight friend of the groom to help you plan the party .

source_bert_toks: which is why she suggests you enlist a straight friend of the groom to help you plan the party .

reference_raw: That's why he's proposing that you join the groom's heterosexual friend to help you schedule the party.

reference_spacy_tokens: That 's why he 's proposing that you join the groom 's heterosexual friend to help you schedule the party .


fn_spacy_tokens_for_baseline: ' We shall all have a jolly time . '

source_bert_toks: ' we shall all have a jolly time . '

reference_raw: "We'll all enjoy it."

reference_spacy_tokens: " We 'll all enjoy it . "


fn_spacy_tokens_for_baseline: ' Do n't fib , darling .

source_bert_toks: ' don ' t fi ##b , darling .

reference_raw: 'Don't fiddle, my dear.

reference_spacy_tokens: ' Do n't fiddle , my dear .


fn_spacy_tokens_for_baseline: ' These shipments of highly enriched uranium spent fuel are part of NNSA 's efforts to make sure this type of material does n't fall into the wrong hands , ' NNSA Administrator Linton F. Brooks said in an April 20 press release .

source_bert_toks: ' these shipments of highly enriched uranium spent fuel are part of n ##ns ##a ' s efforts to make sure this type of material doesn ' t fall into the wrong hands , ' n ##ns ##a administrator lin ##ton f . brooks said in an april 20 press release .

reference_raw: 'These consignments of highly enriched uranium spent fuel are part of NNSA's efforts to ensure that this type of material does not fall into the wrong hands,' said NNSA administrator Linton F. Brooks in his April 20th press release.

reference_spacy_tokens: ' These consignments of highly enriched uranium spent fuel are part of NNSA 's efforts to ensure that this type of material does not fall into the wrong hands , ' said NNSA administrator Linton F. Brooks in his April 20th press release .


fn_spacy_tokens_for_baseline: And I 've asked them to bring a boatload of garlands -- '

source_bert_toks: and i ' ve asked them to bring a boat ##load of garland ##s - - '

reference_raw: And I asked them to bring a load of garlands --'

reference_spacy_tokens: And I asked them to bring a load of garlands -- '


fn_spacy_tokens_for_baseline: He thought of Jazz being presented with a cross - eyed , spotty , knock - kneed , gook - speaking bride from the Punjab and having to go along with that .

source_bert_toks: he thought of jazz being presented with a cross - eyed , spot ##ty , knock - knee ##d , goo ##k - speaking bride from the punjab and having to go along with that .

reference_raw: He thought of Jazz being introduced to the Punjab's cross-eyed, spotty, knock-knitted, gook-speaking bride, and he had to agree to it.

reference_spacy_tokens: He thought of Jazz being introduced to the Punjab 's cross - eyed , spotty , knock - knitted , gook - speaking bride , and he had to agree to it .


fn_spacy_tokens_for_baseline: When mistakes are made a full apology is often less damaging than a grudging admission that events have not gone as planned .

source_bert_toks: when mistakes are made a full apology is often less damaging than a gr ##ud ##ging admission that events have not gone as planned .

reference_raw: When errors are made, a complete apology is often less damaging than a reluctant admittance that the events did not go according to plan.

reference_spacy_tokens: When errors are made , a complete apology is often less damaging than a reluctant admittance that the events did not go according to plan .


fn_spacy_tokens_for_baseline: His voice was low and controlled , but his hands were clenched at his sides and his glittering eyes would have frozen hell - fire .

source_bert_toks: his voice was low and controlled , but his hands were clenched at his sides and his glittering eyes would have frozen hell - fire .

reference_raw: His voice was low and controlled, but his hands were clasped on his hips, and his gleaming eyes would freeze the fire of hell.

reference_spacy_tokens: His voice was low and controlled , but his hands were clasped on his hips , and his gleaming eyes would freeze the fire of hell .


fn_spacy_tokens_for_baseline: To give a period look , the bath and basin have been panelled and the walls tiled just up to dado height .

source_bert_toks: to give a period look , the bath and basin have been panel ##led and the walls tiled just up to dad ##o height .

reference_raw: In order to look at the period, the bath and the basin were lined up, and the walls were tiled to pado height.

reference_spacy_tokens: In order to look at the period , the bath and the basin were lined up , and the walls were tiled to pado height .


fn_spacy_tokens_for_baseline: Also , most prey can only flee fast in a forward direction , so attacking the head is the best way of hampering their escape .

source_bert_toks: also , most prey can only flee fast in a forward direction , so attacking the head is the best way of ham ##per ##ing their escape .

reference_raw: Most prey can also run fast in the front, so attacking the head is the best way to stop them from escaping.

reference_spacy_tokens: Most prey can also run fast in the front , so attacking the head is the best way to stop them from escaping .


fn_spacy_tokens_for_baseline: ONE allowance which looks almost certain to disappear altogether at some point in the not - too - distant future , judging from its treatment in the Budget , is the married couple 's allowance , or MCA .

source_bert_toks: one allowance which looks almost certain to disappear altogether at some point in the not - too - distant future , judging from its treatment in the budget , is the married couple ' s allowance , or mca .

reference_raw: The single allowance, which seems almost certain to disappear at a certain point in the not-too-distant future, is a marriage allowance or an MCA.

reference_spacy_tokens: The single allowance , which seems almost certain to disappear at a certain point in the not - too - distant future , is a marriage allowance or an MCA .


fn_spacy_tokens_for_baseline: In addition , operating results were hit by an increase in loan and real estate loss reserves .

source_bert_toks: in addition , operating results were hit by an increase in loan and real estate loss reserves .

reference_raw: Moreover, the operating results were affected by an increase in loan and property loss reserves.

reference_spacy_tokens: Moreover , the operating results were affected by an increase in loan and property loss reserves .


fn_spacy_tokens_for_baseline: Policy E two as proposed is a very common form of phrasing used by planning authorities to circumvent the Government objection to presumption against policies .

source_bert_toks: policy e two as proposed is a very common form of ph ##ras ##ing used by planning authorities to ci ##rc ##um ##vent the government objection to pre ##sum ##ption against policies .

reference_raw: Policy E-2, as proposed, is a very common form of phasing used by the planning authorities to circumvent the government's objections to the presumption of policy.

reference_spacy_tokens: Policy E-2 , as proposed , is a very common form of phasing used by the planning authorities to circumvent the government 's objections to the presumption of policy .


fn_spacy_tokens_for_baseline: The Knightley Way skirts its western edge and many footpaths meander through the trees .

source_bert_toks: the knight ##ley way skirts its western edge and many foot ##path ##s mean ##der through the trees .

reference_raw: The Knightley Way skirts its western rim, and many paths cross the trees.

reference_spacy_tokens: The Knightley Way skirts its western rim , and many paths cross the trees .


fn_spacy_tokens_for_baseline: ' Just the job , ' thought the enthusiastic Gary , and thus became the first person in history to attempt to convert a quartet of Jehovah 's Witness .

source_bert_toks: ' just the job , ' thought the enthusiastic gary , and thus became the first person in history to attempt to convert a quartet of je ##ho ##vah ' s witness .

reference_raw: "Just a job," Gary thought excitedly, and became the first person in history to try to convert a quarter of Jehovah's Witness.

reference_spacy_tokens: " Just a job , " Gary thought excitedly , and became the first person in history to try to convert a quarter of Jehovah 's Witness .


fn_spacy_tokens_for_baseline: In general , Boswell 's Life of Johnson provides an immortal Pepysian and aromatic sweep of eighteenth - century literary society , recounted in Boswell 's lovely candour and flawedness .

source_bert_toks: in general , bo ##swell ' s life of johnson provides an immortal pep ##ys ##ian and aromatic sweep of eighteenth - century literary society , recounted in bo ##swell ' s lovely can ##dou ##r and flawed ##ness .

reference_raw: Generally speaking, Boswell's Life of Johnson provides an immortal Pepysian and aromatic sweep of 18th-century literary society, recounted in Boswell's beautiful honesty and flawedness.

reference_spacy_tokens: Generally speaking , Boswell 's Life of Johnson provides an immortal Pepysian and aromatic sweep of 18th - century literary society , recounted in Boswell 's beautiful honesty and flawedness .


fn_spacy_tokens_for_baseline: He yanked down with his hand and lifted his head , biting a chunk out of the glass , then turned the rim and bit again , splintering the glass almost to its stem .

source_bert_toks: he yanked down with his hand and lifted his head , biting a chunk out of the glass , then turned the rim and bit again , splinter ##ing the glass almost to its stem .

reference_raw: He reached down with his hand and lifted his head, biting a piece of glass, then turned the edge and bit again, shattering the glass almost to the stem.

reference_spacy_tokens: He reached down with his hand and lifted his head , biting a piece of glass , then turned the edge and bit again , shattering the glass almost to the stem .


fn_spacy_tokens_for_baseline: He received this innocent information with a scowl .

source_bert_toks: he received this innocent information with a scowl .

reference_raw: With a frown, he received this innocent information.

reference_spacy_tokens: With a frown , he received this innocent information .


fn_spacy_tokens_for_baseline: He made out a case for dressing down rather than up .

source_bert_toks: he made out a case for dressing down rather than up .

reference_raw: He made an example of dressing up instead of upstairs.

reference_spacy_tokens: He made an example of dressing up instead of upstairs .


fn_spacy_tokens_for_baseline: The Pentagon reported Thursday shifting of tanks and artillery and other " really preparatory moves " by Saddam Hussein 's armed forces after the defection to Jordan .

source_bert_toks: the pentagon reported thursday shifting of tanks and artillery and other " really preparatory moves " by saddam hussein ' s armed forces after the defect ##ion to jordan .

reference_raw: On Thursday, the Pentagon announced that Saddam Hussein's armed forces had moved tanks and artillery and other "real preparations" after the defection to Jordan.

reference_spacy_tokens: On Thursday , the Pentagon announced that Saddam Hussein 's armed forces had moved tanks and artillery and other " real preparations " after the defection to Jordan .


fn_spacy_tokens_for_baseline: Farther out , both north and south , are the sweeping curves of the Royal and Grand Canals .

source_bert_toks: farther out , both north and south , are the sweeping curves of the royal and grand canals .

reference_raw: Farther north and north are the sweeping curves of the Royal and Grand Canals.

reference_spacy_tokens: Farther north and north are the sweeping curves of the Royal and Grand Canals .


fn_spacy_tokens_for_baseline: In any event , it is important that the dog stands still while it is being groomed .

source_bert_toks: in any event , it is important that the dog stands still while it is being groom ##ed .

reference_raw: In any case, it is important for the dog to stand still while it is rearranged.

reference_spacy_tokens: In any case , it is important for the dog to stand still while it is rearranged .


fn_spacy_tokens_for_baseline: The other two in the party were an Australian and an Englishman , both in their mid - twenties and both stiffly uncommunicative .

source_bert_toks: the other two in the party were an australian and an englishman , both in their mid - twenties and both stiffly un ##com ##mun ##icative .

reference_raw: The other two were Australian and English, both in their mid-twenties and both stiffly uncommunicated.

reference_spacy_tokens: The other two were Australian and English , both in their mid - twenties and both stiffly uncommunicated .


fn_spacy_tokens_for_baseline: No matter how much Norse manure you splatter on to them , they 've a habit of coming up smelling of roses .

source_bert_toks: no matter how much norse man ##ure you sp ##lat ##ter on to them , they ' ve a habit of coming up smelling of roses .

reference_raw: No matter how much Norwegian manure you spray on them, they tend to come up smelling of roses.

reference_spacy_tokens: No matter how much Norwegian manure you spray on them , they tend to come up smelling of roses .


fn_spacy_tokens_for_baseline: And he thought again , ' Maybe she has rich kinsfolk who will come presently with gold and marriage - gifts . '

source_bert_toks: and he thought again , ' maybe she has rich kin ##sf ##ol ##k who will come presently with gold and marriage - gifts . '

reference_raw: And he thought again, "Maybe he's got rich relatives who'll be here soon with gold and wedding gifts."

reference_spacy_tokens: And he thought again , " Maybe he 's got rich relatives who 'll be here soon with gold and wedding gifts . "


fn_spacy_tokens_for_baseline: Mix together the chopped apricots , figs , dates , banana chips and raisins in a bowl .

source_bert_toks: mix together the chopped apr ##ico ##ts , fig ##s , dates , banana chips and rai ##sin ##s in a bowl .

reference_raw: Mix sliced apricots, figs, data, banana chips and raisins in a bowl.

reference_spacy_tokens: Mix sliced apricots , figs , data , banana chips and raisins in a bowl .


fn_spacy_tokens_for_baseline: Following this period of Soviet - led assistance , North Korea made substantive gains in the area of chemical warfare .

source_bert_toks: following this period of soviet - led assistance , north korea made substantive gains in the area of chemical warfare .

reference_raw: After that period of Soviet-led aid, North Korea made substantial profits in the field of chemical warfare.

reference_spacy_tokens: After that period of Soviet - led aid , North Korea made substantial profits in the field of chemical warfare .