fn_spacy_tokens_for_baseline: MELBOURNE , Australia ( AP ) --- The crows on the roof cawed like crazed ducks , the blowflies made a nuisance of themselves , and the searing sun turned the Australian Open courts into green griddles .

source_bert_toks: melbourne , australia ( ap ) - - - the crows on the roof ca ##wed like crazed ducks , the blow ##flies made a nu ##isance of themselves , and the searing sun turned the australian open courts into green grid ##dles .

reference_raw: MELBOURNE, Australia (AP) -- the crows on the roof caved like mad ducks, the blowflies made themselves uncomfortable, and the burning sun turned the Australian Open Courts into green griddles.

reference_spacy_tokens: MELBOURNE , Australia ( AP ) -- the crows on the roof caved like mad ducks , the blowflies made themselves uncomfortable , and the burning sun turned the Australian Open Courts into green griddles .


fn_spacy_tokens_for_baseline: The firm now employs 640 people in the manufacture of frozen foods and ready meals , and its six month pre - tax profits to October 31 were £ 1.7 m .

source_bert_toks: the firm now employs 640 people in the manufacture of frozen foods and ready meals , and its six month pre - tax profits to october 31 were £1 . 7 ##m .

reference_raw: The company now hires 640 people to produce frozen foods and prepared foods, with a profit of £1.7 million for six months before tax until the 31st of October.

reference_spacy_tokens: The company now hires 640 people to produce frozen foods and prepared foods , with a profit of £ 1.7 million for six months before tax until the 31st of October .


fn_spacy_tokens_for_baseline: ' Congratulations , both of you , ' Belinda said sincerely , then Andrew proposed a rambling , outrageous toast and drank a long gulp of champagne with pretended sophistication .

source_bert_toks: ' congratulations , both of you , ' belinda said sincerely , then andrew proposed a ram ##bling , outrageous toast and drank a long gulp of champagne with pretended so ##phi ##stic ##ation .

reference_raw: 'Congratulations, both of you,' Belinda said sincerely, then Andrew suggested a rambling, indignant toast and took a long swallow of champagne with feigned sophistication.

reference_spacy_tokens: ' Congratulations , both of you , ' Belinda said sincerely , then Andrew suggested a rambling , indignant toast and took a long swallow of champagne with feigned sophistication .


fn_spacy_tokens_for_baseline: An expert on Oriental destinations , Mr Collins labelled Angkor the greatest tourist asset in South - east Asia , and the keystone of its future development .

source_bert_toks: an expert on oriental destinations , mr collins labelled ang ##kor the greatest tourist asset in south - east asia , and the keystone of its future development .

reference_raw: Mr. Collins, an expert on Oriental destinations, identified Angkor as the largest tourist asset in Southeast Asia and the keystone of its future development.

reference_spacy_tokens: Mr. Collins , an expert on Oriental destinations , identified Angkor as the largest tourist asset in Southeast Asia and the keystone of its future development .


fn_spacy_tokens_for_baseline: The name of the plant describes its historical use by the ladies of Venice who used the plant in the belief that its property of dilating the pupil of the eye converted them into lustrous wide - eyed beauties .

source_bert_toks: the name of the plant describes its historical use by the ladies of venice who used the plant in the belief that its property of dil ##ating the pupil of the eye converted them into lust ##rous wide - eyed beau ##ties .

reference_raw: The name of the plant describes its historical use by the ladies of Venice who used it in the belief that its property of dilation of the pupil of the eye transformed it into lustrous, wide-eyed beauty.

reference_spacy_tokens: The name of the plant describes its historical use by the ladies of Venice who used it in the belief that its property of dilation of the pupil of the eye transformed it into lustrous , wide - eyed beauty .


fn_spacy_tokens_for_baseline: The Byzantine Empire and the Coming of Christianity

source_bert_toks: the byzantine empire and the coming of christianity

reference_raw: Byzantine Imperium and the coming of Christianity


fn_spacy_tokens_for_baseline: Nor do I accept that such feelings are a sign of weakness , provided that they are accompanied by an inner toughness where necessary and justified . '

source_bert_toks: nor do i accept that such feelings are a sign of weakness , provided that they are accompanied by an inner tough ##ness where necessary and justified . '

reference_raw: I also do not accept that such feelings are a sign of weakness, provided that they are accompanied by internal hardness, if necessary and justified.'

reference_spacy_tokens: I also do not accept that such feelings are a sign of weakness , provided that they are accompanied by internal hardness , if necessary and justified . '


fn_spacy_tokens_for_baseline: Mo Johnston , playing only his second game after a two - month absence , scored in the 63rd minute to cancel out Mark Wright 's towering header a minute earlier .

source_bert_toks: mo johnston , playing only his second game after a two - month absence , scored in the 63 ##rd minute to cancel out mark wright ' s towering header a minute earlier .

reference_raw: Mo Johnston, who had only played his second game after two months off, had scored in the 63rd minute to cancel Mark Wright's towering header a minute earlier.

reference_spacy_tokens: Mo Johnston , who had only played his second game after two months off , had scored in the 63rd minute to cancel Mark Wright 's towering header a minute earlier .


fn_spacy_tokens_for_baseline: Such studies do not give a true reflection of population needs , nor may the clinical indices used to predict survival or estimates of prognosis be applicable in the wider population of patients with severe acute renal failure .

source_bert_toks: such studies do not give a true reflection of population needs , nor may the clinical indices used to predict survival or estimates of pro ##gno ##sis be applicable in the wider population of patients with severe acute renal failure .

reference_raw: These studies do not reflect the needs of patients and the clinical indices used to predict survival or predictions of prognosis should not be used in the wider group of patients with severe acute renal failure.

reference_spacy_tokens: These studies do not reflect the needs of patients and the clinical indices used to predict survival or predictions of prognosis should not be used in the wider group of patients with severe acute renal failure .


fn_spacy_tokens_for_baseline: ' Open up , ' he commanded , and fed her again .

source_bert_toks: ' open up , ' he commanded , and fed her again .

reference_raw: 'Open the door,' he ordered, feeding her again.

reference_spacy_tokens: ' Open the door , ' he ordered , feeding her again .


fn_spacy_tokens_for_baseline: Leonardo forges a love letter from Emilia , and bribes a servant to deliver it to Eustathius along with Emilia 's stolen glove .

source_bert_toks: leonardo forge ##s a love letter from emilia , and bribes a servant to deliver it to eu ##sta ##thi ##us along with emilia ' s stolen glove .

reference_raw: Leonardo faked Emilia's love letter and bribed the servant to deliver it to Eustathius, along with Emilia's stolen glove.

reference_spacy_tokens: Leonardo faked Emilia 's love letter and bribed the servant to deliver it to Eustathius , along with Emilia 's stolen glove .


fn_spacy_tokens_for_baseline: Usually they are fat , but not too fat to tie children 's shoes .

source_bert_toks: usually they are fat , but not too fat to tie children ' s shoes .

reference_raw: They're usually fat, but they're not too fat to put on children's shoes.

reference_spacy_tokens: They 're usually fat , but they 're not too fat to put on children 's shoes .


fn_spacy_tokens_for_baseline: In the name of Allah , Most Gracious , Most Merciful . ( T.C : verse from the Koran )

source_bert_toks: in the name of allah , most gr ##acious , most mer ##ciful . ( t . c : verse from the ko ##ran )

reference_raw: In the name of Allah, Most Graceful, Most Merciful.

reference_spacy_tokens: In the name of Allah , Most Graceful , Most Merciful .


fn_spacy_tokens_for_baseline: The president of Serbia , Slobodan Milosevic , was on Aug. 27 apparently prevented by Panic from addressing the conference .

source_bert_toks: the president of serbia , sl ##ob ##oda ##n milos ##evic , was on aug . 27 apparently prevented by panic from addressing the conference .

reference_raw: Serbia's chairman, Slobodan Milosevic, was on August 27, apparently prevented from attending the conference by Panic.

reference_spacy_tokens: Serbia 's chairman , Slobodan Milosevic , was on August 27 , apparently prevented from attending the conference by Panic .


fn_spacy_tokens_for_baseline: Mrs Spence is a former legal secretary who is considering an appeal against an industrial tribunal decision which went against her last week .

source_bert_toks: mrs spence is a former legal secretary who is considering an appeal against an industrial tribunal decision which went against her last week .

reference_raw: Ms Spence is an ex-jurisdictor who is considering a challenge to the decision of the industrial court that was brought against her last week.

reference_spacy_tokens: Ms Spence is an ex - jurisdictor who is considering a challenge to the decision of the industrial court that was brought against her last week .


fn_spacy_tokens_for_baseline: In 1983 , the IAEA assisted Syria in establishing an analytical laboratory that was equipped with systems for atomic spectrometry and various other experiments .

source_bert_toks: in 1983 , the ia ##ea assisted syria in establishing an analytical laboratory that was equipped with systems for atomic spec ##trom ##et ##ry and various other experiments .

reference_raw: In 1983, the IAEA assisted Syria in setting up an analytical lab equipped with atomic spectrometry systems and various other experiments.

reference_spacy_tokens: In 1983 , the IAEA assisted Syria in setting up an analytical lab equipped with atomic spectrometry systems and various other experiments .


fn_spacy_tokens_for_baseline: Mark flaps a hand at Babur , shooing him away .

source_bert_toks: mark flaps a hand at babu ##r , sho ##oin ##g him away .

reference_raw: Mark waved his hand at Babur and pushed him away.

reference_spacy_tokens: Mark waved his hand at Babur and pushed him away .


fn_spacy_tokens_for_baseline: And would you go for a bus ride followed by a longish walk to take the fatal dose in a little hut in the middle of nowhere ? '

source_bert_toks: and would you go for a bus ride followed by a long ##ish walk to take the fatal dose in a little hut in the middle of nowhere ? '

reference_raw: And would you go for a bus ride, followed by a long walk, and take a fatal dose in a small hut in the middle of the night?'

reference_spacy_tokens: And would you go for a bus ride , followed by a long walk , and take a fatal dose in a small hut in the middle of the night ? '


fn_spacy_tokens_for_baseline: Blues veterans Jimmie Rodgers and Otis Rush both created their own blues magic and surprise guest Buddy Guy stunned the audience with some of his best and most fiery playing to date .

source_bert_toks: blues veterans jimmie rodgers and otis rush both created their own blues magic and surprise guest buddy guy stunned the audience with some of his best and most fiery playing to date .

reference_raw: Blues veterans Jimmie Rodgers and Otis Rush had created their own blues magic, and surprise guest Buddy Guy had knocked out the audience with one of the best and most fiery plays he'd ever played.

reference_spacy_tokens: Blues veterans Jimmie Rodgers and Otis Rush had created their own blues magic , and surprise guest Buddy Guy had knocked out the audience with one of the best and most fiery plays he 'd ever played .


fn_spacy_tokens_for_baseline: At junctions the tables were enlarged to cover the whole area of the intersection , permitting crossing by pedestrians and buggies without change of level .

source_bert_toks: at junctions the tables were enlarged to cover the whole area of the intersection , permitting crossing by pedestrians and bug ##gies without change of level .

reference_raw: At intersections, the tables were extended to cover the entire area of the crossroads, allowing pedestrians and buggies to cross without changing their level.

reference_spacy_tokens: At intersections , the tables were extended to cover the entire area of the crossroads , allowing pedestrians and buggies to cross without changing their level .


fn_spacy_tokens_for_baseline: Major Suppliers / Major Exporters The following summary lists key Iranian imports within the realm of its CW program .

source_bert_toks: major suppliers / major export ##ers the following summary lists key iranian imports within the realm of its cw program .

reference_raw: Major Suppliers/Major Exporters The following summary lists the key Iranian exports in the realm of its CW programme.

reference_spacy_tokens: Major Suppliers / Major Exporters The following summary lists the key Iranian exports in the realm of its CW programme .


fn_spacy_tokens_for_baseline: Authorities at first said no foul play was involved in the blast but later determined that explosives had been used .

source_bert_toks: authorities at first said no foul play was involved in the blast but later determined that explosives had been used .

reference_raw: The authorities said at first that no foul play was involved in the explosion, but later they decided that the explosives had been used.

reference_spacy_tokens: The authorities said at first that no foul play was involved in the explosion , but later they decided that the explosives had been used .


fn_spacy_tokens_for_baseline: The next remark was hissed directly into Robert 's ear , and Robert felt his neck lightly sprayed with saliva .

source_bert_toks: the next remark was hissed directly into robert ' s ear , and robert felt his neck lightly sprayed with saliva .

reference_raw: The next remark was hissed directly into Robert's ear, and Robert felt a slight splash of saliva in his throat.

reference_spacy_tokens: The next remark was hissed directly into Robert 's ear , and Robert felt a slight splash of saliva in his throat .


fn_spacy_tokens_for_baseline: If only we humans were less ambitious , and more tolerant of one another , then there would n't be a need for arms at all , and every mother 's child would be safe .

source_bert_toks: if only we humans were less ambitious , and more tolerant of one another , then there wouldn ' t be a need for arms at all , and every mother ' s child would be safe .

reference_raw: If we humans were less ambitious and more tolerable to each other, there would be no need for weapons, and every mother's child would be safe.

reference_spacy_tokens: If we humans were less ambitious and more tolerable to each other , there would be no need for weapons , and every mother 's child would be safe .


fn_spacy_tokens_for_baseline: So they tied him with chains but the demonic powers were so great in his life that he snapped them like new cords .

source_bert_toks: so they tied him with chains but the demonic powers were so great in his life that he snapped them like new cords .

reference_raw: So he was chained, but the demonic power was so great in his life that he broke it like a new rope.

reference_spacy_tokens: So he was chained , but the demonic power was so great in his life that he broke it like a new rope .


fn_spacy_tokens_for_baseline: She has never used a great deal of make - up .

source_bert_toks: she has never used a great deal of make - up .

reference_raw: She never used much makeup.

reference_spacy_tokens: She never used much makeup .


fn_spacy_tokens_for_baseline: Access to ticketing and baggage claim areas typically does n't require passing through a checkpoint or showing identification .

source_bert_toks: access to ticket ##ing and baggage claim areas typically doesn ' t require passing through a checkpoint or showing identification .

reference_raw: As a general rule, it is not necessary to pass through a checkpoint or to show identification.

reference_spacy_tokens: As a general rule , it is not necessary to pass through a checkpoint or to show identification .


fn_spacy_tokens_for_baseline: ' Yesterday , before the Justices , ' the young man squeaked in reply , his voice surprisingly high .

source_bert_toks: ' yesterday , before the justices , ' the young man squeak ##ed in reply , his voice surprisingly high .

reference_raw: "Last night in front of the Justices," the young man squealed in response, his voice surprisingly high.

reference_spacy_tokens: " Last night in front of the Justices , " the young man squealed in response , his voice surprisingly high .


fn_spacy_tokens_for_baseline: Dice the butter and rub into the flour until it resembles fine breadcrumbs .

source_bert_toks: dice the butter and rub into the flour until it resembles fine bread ##cr ##umb ##s .

reference_raw: Cut the butter and rub it into the flour until it resembles fine crumbs.

reference_spacy_tokens: Cut the butter and rub it into the flour until it resembles fine crumbs .


fn_spacy_tokens_for_baseline: To prove not just a mutual love of music but a mutual love of each other Kylie and Dannii sang a duet together at an Australian anti - drugs concert -- the song they sang was appropriately called ' Sisters " .

source_bert_toks: to prove not just a mutual love of music but a mutual love of each other kylie and dan ##ni ##i sang a duet together at an australian anti - drugs concert - - the song they sang was appropriately called ' sisters " .

reference_raw: To prove not only that they love each other's music, but that they love each other, Kylie and Dannii sang a duet together at an Australian drug concert - the song they sang was appropriately called "Sisters".

reference_spacy_tokens: To prove not only that they love each other 's music , but that they love each other , Kylie and Dannii sang a duet together at an Australian drug concert - the song they sang was appropriately called " Sisters " .


fn_spacy_tokens_for_baseline: Sandra stood there , her eyes rolling with fear , her complexion pasty under all that make - up .

source_bert_toks: sandra stood there , her eyes rolling with fear , her complexion past ##y under all that make - up .

reference_raw: Sandra stood there, her eyes flickering with fear, her skin pasty beneath the make-up.

reference_spacy_tokens: Sandra stood there , her eyes flickering with fear , her skin pasty beneath the make - up .


fn_spacy_tokens_for_baseline: Bridges link Macau with its two islands .

source_bert_toks: bridges link macau with its two islands .

reference_raw: The bridges connect Macau to its two islands.

reference_spacy_tokens: The bridges connect Macau to its two islands .


fn_spacy_tokens_for_baseline: You do n't often get to meet a gentleman these nights .

source_bert_toks: you don ' t often get to meet a gentleman these nights .

reference_raw: You don't often meet a man these days.

reference_spacy_tokens: You do n't often meet a man these days .


fn_spacy_tokens_for_baseline: In 1989 - 90 , Pipe utilised 149 horses to win those 224 races ; last season 179 horses were pressed into action to achieve the record .

source_bert_toks: in 1989 - 90 , pipe ut ##ilised 149 horses to win those 224 races ; last season 179 horses were pressed into action to achieve the record .

reference_raw: In 1989-90, Pipe used 149 horses to win the 224 races; in the last season, 179 horses were pushed into action to achieve a record.

reference_spacy_tokens: In 1989 - 90 , Pipe used 149 horses to win the 224 races ; in the last season , 179 horses were pushed into action to achieve a record .


fn_spacy_tokens_for_baseline: His shoulders lifted and fell in a huge exhalation of breath .

source_bert_toks: his shoulders lifted and fell in a huge ex ##hala ##tion of breath .

reference_raw: He lifted his shoulders and let out a great breath.

reference_spacy_tokens: He lifted his shoulders and let out a great breath .


fn_spacy_tokens_for_baseline: Sartori had been indulgent for the weeks they 'd been together .

source_bert_toks: sar ##tori had been ind ##ul ##gent for the weeks they ' d been together .

reference_raw: Sartori had been condescending for the weeks they had spent together.

reference_spacy_tokens: Sartori had been condescending for the weeks they had spent together .


fn_spacy_tokens_for_baseline: For reaction to the new car , we took it to the MG Car Club 's headquarters on the site of the old factory in Abingdon .

source_bert_toks: for reaction to the new car , we took it to the mg car club ' s headquarters on the site of the old factory in ab ##ingdon .

reference_raw: In response to a new car, we drove it to the headquarters of the MG Car Club at the site of an old factory in Abingdon.

reference_spacy_tokens: In response to a new car , we drove it to the headquarters of the MG Car Club at the site of an old factory in Abingdon .


fn_spacy_tokens_for_baseline: Saddlers manager Kenny Hibbitt said : ' I always knew he had quality and he 's made a tremendous start to his career . '

source_bert_toks: saddle ##rs manager kenny hi ##bb ##itt said : ' i always knew he had quality and he ' s made a tremendous start to his career . '

reference_raw: The saddler manager, Kenny Hibbitt, said, "I've always known that he's good and that he's made a huge start in his career."

reference_spacy_tokens: The saddler manager , Kenny Hibbitt , said , " I 've always known that he 's good and that he 's made a huge start in his career . "


fn_spacy_tokens_for_baseline: This consists of a compact portable reader , a wallet of microfiches and the paper version of the index .

source_bert_toks: this consists of a compact portable reader , a wallet of micro ##fi ##ches and the paper version of the index .

reference_raw: It consists of a compact portable reader, a purse of microfiches and a paper version of an index.

reference_spacy_tokens: It consists of a compact portable reader , a purse of microfiches and a paper version of an index .


fn_spacy_tokens_for_baseline: Aunt Kit never wrote , it would have shamed her to write my married name on the envelope , but she knitted for the baby , strange , holey garments that stretched to a huge size when I washed them , big enough for a prize boxer .

source_bert_toks: aunt kit never wrote , it would have shame ##d her to write my married name on the envelope , but she knit ##ted for the baby , strange , hole ##y garments that stretched to a huge size when i washed them , big enough for a prize boxer .

reference_raw: Aunt Kit didn't write, she'd be ashamed to write my husband's name on an envelope, but she was knitting for a child, a strange, holy dress that stretched out to a large extent when I washed it, big enough for a prize boxer.

reference_spacy_tokens: Aunt Kit did n't write , she 'd be ashamed to write my husband 's name on an envelope , but she was knitting for a child , a strange , holy dress that stretched out to a large extent when I washed it , big enough for a prize boxer .


fn_spacy_tokens_for_baseline: Working with the Secret Service station at the American Embassy in Athens , DEA Nicosia now regularly employed huge sums of counterfeit US currency to make drug buys in Europe , the US and Mexico . '

source_bert_toks: working with the secret service station at the american embassy in athens , dea nico ##sia now regularly employed huge sums of counter ##feit us currency to make drug buys in europe , the us and mexico . '

reference_raw: DEA Nicosia, working with a Secret Service station at the American Embassy in Athens, now regularly uses large amounts of fake U.S. currency to buy drugs in Europe, the United States, and Mexico.'

reference_spacy_tokens: DEA Nicosia , working with a Secret Service station at the American Embassy in Athens , now regularly uses large amounts of fake U.S. currency to buy drugs in Europe , the United States , and Mexico . '


fn_spacy_tokens_for_baseline: The immunity enjoyed by clownfish from the venomous tentacles of the anemone has only recently become properly understood .

source_bert_toks: the immunity enjoyed by clown ##fish from the venom ##ous tentacles of the an ##emon ##e has only recently become properly understood .

reference_raw: The immunity of clownfish from the poisonous tendrils of anemone has only recently been properly understood.

reference_spacy_tokens: The immunity of clownfish from the poisonous tendrils of anemone has only recently been properly understood .


fn_spacy_tokens_for_baseline: The new technology element does n't exactly creep in in this business either ; personal computers , laser printers , document scanners and the like are vital elements of the system .

source_bert_toks: the new technology element doesn ' t exactly creep in in this business either ; personal computers , laser printers , document scanner ##s and the like are vital elements of the system .

reference_raw: Even in this business, the new technological element does not exactly creep into it; personal computers, laser printers, document scanners, etc. are vital elements of the system.

reference_spacy_tokens: Even in this business , the new technological element does not exactly creep into it ; personal computers , laser printers , document scanners , etc . are vital elements of the system .


fn_spacy_tokens_for_baseline: The main functions of money are distinguished as : a medium of exchange ; a unit of account ; a store of value ; and , occasionally , a standard of deferred payment .

source_bert_toks: the main functions of money are distinguished as : a medium of exchange ; a unit of account ; a store of value ; and , occasionally , a standard of def ##erre ##d payment .

reference_raw: The main features of the money are defined as: the medium of exchange; the unit of account; the stock of value; and, occasionally, the standard of deferred payment.

reference_spacy_tokens: The main features of the money are defined as : the medium of exchange ; the unit of account ; the stock of value ; and , occasionally , the standard of deferred payment .


fn_spacy_tokens_for_baseline: He stripped off his shirt and capered from outstretched dagger to outstretched dagger , displaying himself like the leper healed by Jesus showing himself to the High Priests .

source_bert_toks: he stripped off his shirt and cape ##red from outstretched dagger to outstretched dagger , displaying himself like the le ##per healed by jesus showing himself to the high priests .

reference_raw: He stripped off his shirt and went from outstretched dagger to outstretched dagger, showing himself as a leper healed by Jesus showing himself to the High Priests.

reference_spacy_tokens: He stripped off his shirt and went from outstretched dagger to outstretched dagger , showing himself as a leper healed by Jesus showing himself to the High Priests .


fn_spacy_tokens_for_baseline: Thus the primary motivation of professionals is public service rather than personal gain : doctors are concerned primarily with the health of their patients rather than with lining their own pockets .

source_bert_toks: thus the primary motivation of professionals is public service rather than personal gain : doctors are concerned primarily with the health of their patients rather than with lining their own pockets .

reference_raw: The main motive for professionals is therefore public service rather than personal gain: doctors are more concerned with the health of their patients than with their own pockets.

reference_spacy_tokens: The main motive for professionals is therefore public service rather than personal gain : doctors are more concerned with the health of their patients than with their own pockets .


fn_spacy_tokens_for_baseline: When the islands were first settled , the population began to increase rapidly and the number of inhabitants soon exceeded the resources , prompting emigration to other Portuguese lands .

source_bert_toks: when the islands were first settled , the population began to increase rapidly and the number of inhabitants soon exceeded the resources , prompting emigration to other portuguese lands .

reference_raw: When the islands were first settled, the population began to grow rapidly, and the population soon exceeded the resources, which prompted immigration to other Portuguese countries.

reference_spacy_tokens: When the islands were first settled , the population began to grow rapidly , and the population soon exceeded the resources , which prompted immigration to other Portuguese countries .


fn_spacy_tokens_for_baseline: As it is , however , his army has been annihilated and the fugitives will probably be slaughtered by peasants before they can reach a place of safety .

source_bert_toks: as it is , however , his army has been ann ##ih ##ila ##ted and the fugitive ##s will probably be slaughtered by peasants before they can reach a place of safety .

reference_raw: But since his army has been destroyed, the refugees are likely to be killed by peasants before they reach a safe place.

reference_spacy_tokens: But since his army has been destroyed , the refugees are likely to be killed by peasants before they reach a safe place .


fn_spacy_tokens_for_baseline: His successor , President Endara , says he wants him extradited to Panama for his alleged part in the 1985 beheading of the politician Hugo Spadafora .

source_bert_toks: his successor , president end ##ara , says he wants him extra ##dit ##ed to panama for his alleged part in the 1985 be ##head ##ing of the politician hugo spa ##da ##for ##a .

reference_raw: His successor, President Endara, says he wants to extradite him to Panama for his alleged role in the execution of politician Hugo Spadafora in 1985.

reference_spacy_tokens: His successor , President Endara , says he wants to extradite him to Panama for his alleged role in the execution of politician Hugo Spadafora in 1985 .


fn_spacy_tokens_for_baseline: Frantically Isabel gathered her wits , trying to suppress the sudden queasiness in the pit of her stomach .

source_bert_toks: frantically isabel gathered her wits , trying to suppress the sudden que ##asi ##ness in the pit of her stomach .

reference_raw: Frantically, Isabel gathered her wits and tried to suppress the sudden discomfort in the pit of her stomach.

reference_spacy_tokens: Frantically , Isabel gathered her wits and tried to suppress the sudden discomfort in the pit of her stomach .


fn_spacy_tokens_for_baseline: The Central Criminal Court , the Old Bailey , is situated in the heart of the City of London .

source_bert_toks: the central criminal court , the old bailey , is situated in the heart of the city of london .

reference_raw: The Central Criminal Court, the Old Bailey, is located in London.

reference_spacy_tokens: The Central Criminal Court , the Old Bailey , is located in London .


fn_spacy_tokens_for_baseline: As they crossed in front of the Queensway Tunnel for the final sprint up William Brown Street , 23-year - old Nadobenko was going so fast he mounted the kerb and bounced back but still had the strength to cross the line in first place .

source_bert_toks: as they crossed in front of the queens ##way tunnel for the final sprint up william brown street , 23 - year - old nad ##obe ##nko was going so fast he mounted the ke ##rb and bounced back but still had the strength to cross the line in first place .

reference_raw: As they crossed the Queensway Tunnel for the last run on William Brown Street, twenty-three-year-old Nadobenko was moving so fast that he mounted the kerb and bounced back, but he still had the strength to cross the border.

reference_spacy_tokens: As they crossed the Queensway Tunnel for the last run on William Brown Street , twenty - three - year - old Nadobenko was moving so fast that he mounted the kerb and bounced back , but he still had the strength to cross the border .


fn_spacy_tokens_for_baseline: Keg beers -- so called because they are kept in sealed and pressurised containers called kegs -- are therefore injected with carbon dioxide and connected to cylinders of CO 2 ; in the pub cellar .

source_bert_toks: ke ##g beers - - so called because they are kept in sealed and press ##uri ##sed containers called ke ##gs - - are therefore injected with carbon dioxide and connected to cylinders of co 2 ; in the pub cellar .

reference_raw: The keg beer, so called because it is stored in sealed and pressure containers called kegs, is therefore injected with carbon dioxide and connected to the CO 2 bottles; in the inn cellar.

reference_spacy_tokens: The keg beer , so called because it is stored in sealed and pressure containers called kegs , is therefore injected with carbon dioxide and connected to the CO 2 bottles ; in the inn cellar .


fn_spacy_tokens_for_baseline: I chained my bicycle to the railings and climbed the north - facing steps , slimy with moss , where the puddles never dried .

source_bert_toks: i chained my bicycle to the railing ##s and climbed the north - facing steps , slim ##y with moss , where the puddle ##s never dried .

reference_raw: I strapped my bike to the railings and climbed the north-facing steps, slimy with moss, where the puddles never dried.

reference_spacy_tokens: I strapped my bike to the railings and climbed the north - facing steps , slimy with moss , where the puddles never dried .


fn_spacy_tokens_for_baseline: Both sides underlined their well - established positions on BBC radio yesterday .

source_bert_toks: both sides under ##lined their well - established positions on bbc radio yesterday .

reference_raw: Both parties emphasized their well-established position on the BBC radio yesterday.

reference_spacy_tokens: Both parties emphasized their well - established position on the BBC radio yesterday .


fn_spacy_tokens_for_baseline: In a good gradation , new material would strengthen the old by the process of facilitation .

source_bert_toks: in a good gr ##ada ##tion , new material would strengthen the old by the process of fa ##ci ##lita ##tion .

reference_raw: In a good grade, new materials would reinforce the old by facilitating the process.

reference_spacy_tokens: In a good grade , new materials would reinforce the old by facilitating the process .


fn_spacy_tokens_for_baseline: The individual concerned would pick up his P45 tax form from the accounts department and slink off .

source_bert_toks: the individual concerned would pick up his p ##45 tax form from the accounts department and sl ##ink off .

reference_raw: The person concerned will take his P45 tax form out of the accounts department and slip away.

reference_spacy_tokens: The person concerned will take his P45 tax form out of the accounts department and slip away .


fn_spacy_tokens_for_baseline: Ships laden with nutmeg or cinnamon , cloves or coriander once battled the Seven Seas to bring home their precious cargo .

source_bert_toks: ships laden with nut ##me ##g or cinnamon , cl ##ove ##s or co ##rian ##der once battled the seven seas to bring home their precious cargo .

reference_raw: Ships loaded with nutmeg or cinnamon, cloves or coriander had once fought the Seven Seas to bring their precious cargo home.

reference_spacy_tokens: Ships loaded with nutmeg or cinnamon , cloves or coriander had once fought the Seven Seas to bring their precious cargo home .


fn_spacy_tokens_for_baseline: But he would never actually touch her , Maria decided , directing a quick look at the resolute line of chin and jaw and the arrogant curve of his nose .

source_bert_toks: but he would never actually touch her , maria decided , directing a quick look at the res ##ol ##ute line of chin and jaw and the arrogant curve of his nose .

reference_raw: But he'd never really touch her, Maria decided, directing a quick glance at the resolute line of chin and jaw and the arrogant curvature of his nose.

reference_spacy_tokens: But he 'd never really touch her , Maria decided , directing a quick glance at the resolute line of chin and jaw and the arrogant curvature of his nose .


fn_spacy_tokens_for_baseline: Thus Fisherian models could account for their initial elaboration , but good genes models probably could not .

source_bert_toks: thus fisher ##ian models could account for their initial el ##ab ##oration , but good genes models probably could not .

reference_raw: So the Fisher models could explain their initial work, but the good gene models probably couldn't.

reference_spacy_tokens: So the Fisher models could explain their initial work , but the good gene models probably could n't .


fn_spacy_tokens_for_baseline: Tor Edgar is a giant man peering out shyly from behind glasses bequeathed by John Lennon .

source_bert_toks: tor edgar is a giant man peering out shy ##ly from behind glasses bequeathed by john lennon .

reference_raw: Tor Edgar is a huge man who looks shyly out from behind the spectacles John Lennon left behind.

reference_spacy_tokens: Tor Edgar is a huge man who looks shyly out from behind the spectacles John Lennon left behind .


fn_spacy_tokens_for_baseline: She twirled around the room but Mary was n't interested and returned upstairs with her friends to complete dressing .

source_bert_toks: she t ##wi ##rled around the room but mary wasn ' t interested and returned upstairs with her friends to complete dressing .

reference_raw: She turned around the room, but Mary didn't care, and went upstairs with her friends to finish dressing.

reference_spacy_tokens: She turned around the room , but Mary did n't care , and went upstairs with her friends to finish dressing .


fn_spacy_tokens_for_baseline: An authoritative source avers that his inamorata , Ms Mandy Smith , the former spouse of Mr William Wyman , is not in sufficiently robust form to ' make love ' .

source_bert_toks: an authoritative source ave ##rs that his ina ##mora ##ta , ms mandy smith , the former spouse of mr william w ##yman , is not in sufficiently robust form to ' make love ' .

reference_raw: The authoritative source averts the fact that his inamorata, Mr. Mandy Smith, former husband of Mr. William Wyman, is not strong enough to 'make love'.

reference_spacy_tokens: The authoritative source averts the fact that his inamorata , Mr. Mandy Smith , former husband of Mr. William Wyman , is not strong enough to ' make love ' .


fn_spacy_tokens_for_baseline: But these are the trivia of what he left me and my sister .

source_bert_toks: but these are the tri ##via of what he left me and my sister .

reference_raw: But that's a little bit of what he gave me and my sister.

reference_spacy_tokens: But that 's a little bit of what he gave me and my sister .


fn_spacy_tokens_for_baseline: ' We mourn , weep and express a sense of loss for Stephen , ' said Fr Burke who said the congregation should give thanks for Ft Lt McNally 's life .

source_bert_toks: ' we mo ##urn , weep and express a sense of loss for stephen , ' said fr burke who said the congregation should give thanks for ft lt mc ##nally ' s life .

reference_raw: 'We grieve, weep, and we express a sense of loss for Stephen,' said Fr Burke, who said that the congregation should thank Lieutenant McNally for the life of Lieutenant McNally.

reference_spacy_tokens: ' We grieve , weep , and we express a sense of loss for Stephen , ' said Fr Burke , who said that the congregation should thank Lieutenant McNally for the life of Lieutenant McNally .


fn_spacy_tokens_for_baseline: He was a tall , rangy , large - featured man with a mobile , wide - mouthed face of agreeable ugliness and iron - grey hair which fell in heavy swathes over parchment - coloured skin .

source_bert_toks: he was a tall , rang ##y , large - featured man with a mobile , wide - mouthed face of agree ##able u ##gli ##ness and iron - grey hair which fell in heavy swat ##hes over parchment - coloured skin .

reference_raw: He was a tall, ranged, long-featured man with a mobile, wide-mouthed face of pleasant ugliness and iron-grey hair that fell heavily across the parchment-colored skin.

reference_spacy_tokens: He was a tall , ranged , long - featured man with a mobile , wide - mouthed face of pleasant ugliness and iron - grey hair that fell heavily across the parchment - colored skin .


fn_spacy_tokens_for_baseline: I had n't brought my ID because I was n't driving .

source_bert_toks: i hadn ' t brought my id because i wasn ' t driving .

reference_raw: I didn't bring my I.D. 'cause I didn't drive.

reference_spacy_tokens: I did n't bring my I.D. 'cause I did n't drive .


fn_spacy_tokens_for_baseline: Sunday 's firefight between rebel factions may be a prelude to wider bloodletting if Kadafi falls .

source_bert_toks: sunday ' s fire ##fight between rebel factions may be a prelude to wider blood ##lett ##ing if ka ##da ##fi falls .

reference_raw: Sunday's fire between rebel factions may be a prelude to wider bloodshed if Kadafi falls.

reference_spacy_tokens: Sunday 's fire between rebel factions may be a prelude to wider bloodshed if Kadafi falls .


fn_spacy_tokens_for_baseline: Container - grown evergreens , such as bays ( Laurus nobilis ) are especially vulnerable because the root - ball may freeze solid .

source_bert_toks: container - grown evergreen ##s , such as bays ( lau ##rus no ##bilis ) are especially vulnerable because the root - ball may freeze solid .

reference_raw: The container-grown evergreens, such as the bays (Laurus nobilis), are particularly vulnerable, as the root ball can stiffen.

reference_spacy_tokens: The container - grown evergreens , such as the bays ( Laurus nobilis ) , are particularly vulnerable , as the root ball can stiffen .


fn_spacy_tokens_for_baseline: Now the cottage displays its original circular brick bread oven which , at Withern , had been hidden behind a Victorian cast - iron fireplace .

source_bert_toks: now the cottage displays its original circular brick bread oven which , at with ##ern , had been hidden behind a victorian cast - iron fireplace .

reference_raw: The cottage now displays its original round brick bread oven, which, in Withern, was hidden behind a Victorian cast-iron fire.

reference_spacy_tokens: The cottage now displays its original round brick bread oven , which , in Withern , was hidden behind a Victorian cast - iron fire .


fn_spacy_tokens_for_baseline: Place the pastry cases on baking sheets .

source_bert_toks: place the pastry cases on baking sheets .

reference_raw: Put the baking boxes on the baking sheets.

reference_spacy_tokens: Put the baking boxes on the baking sheets .


fn_spacy_tokens_for_baseline: The room was very dim , he saw that she had suspended a shawl over the light , so that it shone dappled on walls and ceiling above .

source_bert_toks: the room was very dim , he saw that she had suspended a shaw ##l over the light , so that it shone da ##pp ##led on walls and ceiling above .

reference_raw: The room was very dark, and he could see that she had hung a scarf over the light, so that it was dazzling on the walls and ceiling above him.

reference_spacy_tokens: The room was very dark , and he could see that she had hung a scarf over the light , so that it was dazzling on the walls and ceiling above him .


fn_spacy_tokens_for_baseline: The Cutty Sark was launched in 1869 and was built for speed so that she could compete with other clipper ships in the China tea trade .

source_bert_toks: the cut ##ty sar ##k was launched in 1869 and was built for speed so that she could compete with other clip ##per ships in the china tea trade .

reference_raw: Cutty Sark started in 1869 and was built for speed to compete with other scissors in China's tea trade.

reference_spacy_tokens: Cutty Sark started in 1869 and was built for speed to compete with other scissors in China 's tea trade .


fn_spacy_tokens_for_baseline: They were a long way off still , but heading this way .

source_bert_toks: they were a long way off still , but heading this way .

reference_raw: They were still far away, but they were going in that direction.

reference_spacy_tokens: They were still far away , but they were going in that direction .


fn_spacy_tokens_for_baseline: To the amusement of the audience , he quizzed several of the real passenger owners .

source_bert_toks: to the amusement of the audience , he quiz ##zed several of the real passenger owners .

reference_raw: To the amusement of the audience, he questioned several actual passenger owners.

reference_spacy_tokens: To the amusement of the audience , he questioned several actual passenger owners .


fn_spacy_tokens_for_baseline: Perhaps he could exchange it for something more portable .

source_bert_toks: perhaps he could exchange it for something more portable .

reference_raw: Maybe he can trade it for something more transferable.

reference_spacy_tokens: Maybe he can trade it for something more transferable .


fn_spacy_tokens_for_baseline: After 17 years of mending fences , rounding up strays , nurturing fragile prairie grass and tending 220 cows and calves , Wadlow has called it quits .

source_bert_toks: after 17 years of men ##ding fences , rounding up stray ##s , nur ##turing fragile prairie grass and tending 220 cows and calves , wa ##dlow has called it quit ##s .

reference_raw: After 17 years of repairing fences, gathering strays, feeding fragile prairie grass and tending 220 cows and calves, Wadlow called it quitting.

reference_spacy_tokens: After 17 years of repairing fences , gathering strays , feeding fragile prairie grass and tending 220 cows and calves , Wadlow called it quitting .


fn_spacy_tokens_for_baseline: It had n't hurt before .

source_bert_toks: it hadn ' t hurt before .

reference_raw: It's never done any harm before.

reference_spacy_tokens: It 's never done any harm before .


fn_spacy_tokens_for_baseline: He held his breath .

source_bert_toks: he held his breath .

reference_raw: He gasped.

reference_spacy_tokens: He gasped .


fn_spacy_tokens_for_baseline: She could see a flicker of fire , Wynne - Jones 's fire .

source_bert_toks: she could see a flicker of fire , wynn ##e - jones ' s fire .

reference_raw: She saw the flash of fire, the fire of Wynne-Jones.

reference_spacy_tokens: She saw the flash of fire , the fire of Wynne - Jones .


fn_spacy_tokens_for_baseline: There was just a touch of sarcasm in her voice , which cut like a razor , and she knew she 'd drawn blood when he stared coldly back at her , the smile fading from his face .

source_bert_toks: there was just a touch of sarcasm in her voice , which cut like a razor , and she knew she ' d drawn blood when he stared coldly back at her , the smile fading from his face .

reference_raw: There was only a hint of sarcasm in her voice that cut like a razor, and she knew that she had drawn blood when he looked at her coolly, and the smile faded from his face.

reference_spacy_tokens: There was only a hint of sarcasm in her voice that cut like a razor , and she knew that she had drawn blood when he looked at her coolly , and the smile faded from his face .


fn_spacy_tokens_for_baseline: These have only one centimetre of padding and leave the thumb free to fold in safely .

source_bert_toks: these have only one cent ##ime ##tre of pad ##ding and leave the thumb free to fold in safely .

reference_raw: They've only got an inch of padding and leave their thumbs free to fold in safely.

reference_spacy_tokens: They 've only got an inch of padding and leave their thumbs free to fold in safely .


fn_spacy_tokens_for_baseline: An enormous bowl of mussels cooked in a delicious liquor with celery , onion , parsley and plenty of black pepper can be had for about £ 4 .

source_bert_toks: an enormous bowl of mu ##ssel ##s cooked in a delicious liquor with ce ##ler ##y , onion , par ##sley and plenty of black pepper can be had for about £ ##4 .

reference_raw: A large bowl of mussels, cooked in delicious liquor with celery, onion, parsley, and a lot of black paprika, can be used for about four pounds.

reference_spacy_tokens: A large bowl of mussels , cooked in delicious liquor with celery , onion , parsley , and a lot of black paprika , can be used for about four pounds .


fn_spacy_tokens_for_baseline: And in every case a perceptive manager should be able to discern a clear pattern .

source_bert_toks: and in every case a per ##ceptive manager should be able to disc ##ern a clear pattern .

reference_raw: And in any case, a perceptive manager should be able to make out a clear pattern.

reference_spacy_tokens: And in any case , a perceptive manager should be able to make out a clear pattern .


fn_spacy_tokens_for_baseline: The party 's chairperson , Alan Warren , who is standing as a local government candidate in the Castle ward , has hit out at planning restrictions on commercial development in the north of the city .

source_bert_toks: the party ' s chairperson , alan warren , who is standing as a local government candidate in the castle ward , has hit out at planning restrictions on commercial development in the north of the city .

reference_raw: Chairman of the party, Alan Warren, who stands as a local government candidate in the Castle Ward, has been hit by planning restrictions on business development in the north of town.

reference_spacy_tokens: Chairman of the party , Alan Warren , who stands as a local government candidate in the Castle Ward , has been hit by planning restrictions on business development in the north of town .


fn_spacy_tokens_for_baseline: She pondered for a while , then , as the traffic towards Seabourne became heavier , she abandoned the subject and concentrated on her driving .

source_bert_toks: she pondered for a while , then , as the traffic towards sea ##bourne became heavier , she abandoned the subject and concentrated on her driving .

reference_raw: She thought for a moment, then, as the traffic to Seabourne became more difficult, she left the subject and concentrated on driving.

reference_spacy_tokens: She thought for a moment , then , as the traffic to Seabourne became more difficult , she left the subject and concentrated on driving .


fn_spacy_tokens_for_baseline: At the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

source_bert_toks: at the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

reference_raw: At the same time, it has a highly advanced biotechnology infrastructure, including leading research facilities and trained personnel.

reference_spacy_tokens: At the same time , it has a highly advanced biotechnology infrastructure , including leading research facilities and trained personnel .


fn_spacy_tokens_for_baseline: Like his compatriot Nelson Piquet , Emerson in the cockpit is a somnolent cat .

source_bert_toks: like his com ##pa ##tri ##ot nelson pi ##quet , emerson in the cockpit is a so ##m ##no ##lent cat .

reference_raw: Like his countryman Nelson Piquet, Emerson is a sleepy cat in the cockpit.

reference_spacy_tokens: Like his countryman Nelson Piquet , Emerson is a sleepy cat in the cockpit .


fn_spacy_tokens_for_baseline: Throughout Europe vested interests in the medical profession , supported by opposition parties hungry for votes and journalists eager for copy , have mounted vigorous protests in favour of the status quo .

source_bert_toks: throughout europe vested interests in the medical profession , supported by opposition parties hungry for votes and journalists eager for copy , have mounted vigorous protests in favour of the status quo .

reference_raw: Throughout Europe, vested interests in the medical profession, supported by opposition parties eager to vote, and journalists eager to copy, have put forward vigorous protests in favour of the status quo.

reference_spacy_tokens: Throughout Europe , vested interests in the medical profession , supported by opposition parties eager to vote , and journalists eager to copy , have put forward vigorous protests in favour of the status quo .


fn_spacy_tokens_for_baseline: By the summer of 1322 Edward felt secure enough at home to embark on a final solution of the Scottish problem .

source_bert_toks: by the summer of 132 ##2 edward felt secure enough at home to embark on a final solution of the scottish problem .

reference_raw: By the summer of 1322, Edward felt safe enough at home to embark on a final solution to the Scottish problem.

reference_spacy_tokens: By the summer of 1322 , Edward felt safe enough at home to embark on a final solution to the Scottish problem .


fn_spacy_tokens_for_baseline: She tossed her luxuriant dark hair , which fell to her waist from a demure white lace cap tied under her chin with a satin bow .

source_bert_toks: she tossed her lux ##urian ##t dark hair , which fell to her waist from a dem ##ure white lace cap tied under her chin with a satin bow .

reference_raw: She threw back her luxurious dark hair, which had fallen to her waist from a demure white lace cap that had been tied under her chin with a satin bow.

reference_spacy_tokens: She threw back her luxurious dark hair , which had fallen to her waist from a demure white lace cap that had been tied under her chin with a satin bow .


fn_spacy_tokens_for_baseline: Instead he pulled off his green boxer shorts , given to him by Maisie last Christmas , and farted in what he hoped was a reasonably light - hearted way .

source_bert_toks: instead he pulled off his green boxer shorts , given to him by mai ##sie last christmas , and far ##ted in what he hoped was a reasonably light - hearted way .

reference_raw: Instead, he removed the green boxer shorts Maisie had given him last Christmas, and farted in what he hoped was a reasonably light-hearted way.

reference_spacy_tokens: Instead , he removed the green boxer shorts Maisie had given him last Christmas , and farted in what he hoped was a reasonably light - hearted way .


fn_spacy_tokens_for_baseline: It is shocking that that ethos should exist now .

source_bert_toks: it is shocking that that et ##hos should exist now .

reference_raw: It's surprising that the ethos should exist now.

reference_spacy_tokens: It 's surprising that the ethos should exist now .


fn_spacy_tokens_for_baseline: He grimaced in exasperation .

source_bert_toks: he grimaced in ex ##as ##peration .

reference_raw: He grinned irritably.

reference_spacy_tokens: He grinned irritably .


fn_spacy_tokens_for_baseline: British social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

source_bert_toks: british social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

reference_raw: British social habits are still obvious in the sort of polite service you get in hotels and in the long rows of people waiting for buses at the rush hour.

reference_spacy_tokens: British social habits are still obvious in the sort of polite service you get in hotels and in the long rows of people waiting for buses at the rush hour .


fn_spacy_tokens_for_baseline: Commenting on his sexual abstinence Erik Erikson writes : ' It is of importance here that he gave up sexual intimacy for a wider communal intimacy and not just because sexuality seemed immoral in any Calvinistic sense .

source_bert_toks: commenting on his sexual abs ##tine ##nce erik erik ##son writes : ' it is of importance here that he gave up sexual intimacy for a wider communal intimacy and not just because sexuality seemed im ##moral in any calvin ##istic sense .

reference_raw: Commenting on his sexual abstention, Eric Erikson writes, "It is important here that he renounced sexual intimacy for a wider community intimacy, not just because sexuality seemed immoral in any Calvinistic sense.

reference_spacy_tokens: Commenting on his sexual abstention , Eric Erikson writes , " It is important here that he renounced sexual intimacy for a wider community intimacy , not just because sexuality seemed immoral in any Calvinistic sense .


fn_spacy_tokens_for_baseline: They have been the nucleus of several hundred self - employed artisans manufacturing these bicycle attachments who can be seen on open sites across Nairobi .

source_bert_toks: they have been the nucleus of several hundred self - employed artisans manufacturing these bicycle attachment ##s who can be seen on open sites across nairobi .

reference_raw: They are the core of several hundred self-employed craftsmen who manufacture these bicycle accessories, which can be seen in open spaces throughout Nairobi.

reference_spacy_tokens: They are the core of several hundred self - employed craftsmen who manufacture these bicycle accessories , which can be seen in open spaces throughout Nairobi .


fn_spacy_tokens_for_baseline: Despite describing a happy childhood , she told her therapist about how she had been brought up in a family where she felt unappreciated and undervalued .

source_bert_toks: despite describing a happy childhood , she told her therapist about how she had been brought up in a family where she felt una ##pp ##re ##cia ##ted and under ##val ##ue ##d .

reference_raw: Even though she described a happy childhood, she told her therapy how she had been raised in a family where she felt unappreciated and undervalued.

reference_spacy_tokens: Even though she described a happy childhood , she told her therapy how she had been raised in a family where she felt unappreciated and undervalued .


fn_spacy_tokens_for_baseline: She felt pleased -- not wanting to have anything to do with the squabbles of these upper - class money - grubbers .

source_bert_toks: she felt pleased - - not wanting to have anything to do with the sq ##ua ##bble ##s of these upper - class money - gr ##ub ##bers .

reference_raw: She was glad - she didn't want to have anything to do with the grumbles of those top-class money-grubbers.

reference_spacy_tokens: She was glad - she did n't want to have anything to do with the grumbles of those top - class money - grubbers .


fn_spacy_tokens_for_baseline: The hydrogen could accumulate during a launch and spark a serious explosion .

source_bert_toks: the hydrogen could accumulate during a launch and spark a serious explosion .

reference_raw: Hydrogen can accumulate during launch and ignite a severe explosion.

reference_spacy_tokens: Hydrogen can accumulate during launch and ignite a severe explosion .


fn_spacy_tokens_for_baseline: The reserve takes in part of the Minsmere levels which were flooded during the Second World War to counter possible invasion .

source_bert_toks: the reserve takes in part of the min ##sm ##ere levels which were flooded during the second world war to counter possible invasion .

reference_raw: In order to counter possible invasions, the reserve takes part of the Minsmere levels that were inundated during World War Il.

reference_spacy_tokens: In order to counter possible invasions , the reserve takes part of the Minsmere levels that were inundated during World War Il .


fn_spacy_tokens_for_baseline: King Hassan of Morocco had pressed for the summit -- already twice postponed -- to be deferred until late April when recent developments might be analyzed with ' total objectivity ' .

source_bert_toks: king hassan of morocco had pressed for the summit - - already twice postponed - - to be def ##erre ##d until late april when recent developments might be analyzed with ' total object ##ivity ' .

reference_raw: King Hassan of Morocco has urged the summit - already twice postponed - to be postponed until the end of April, when recent events can be analysed with complete objectivity.

reference_spacy_tokens: King Hassan of Morocco has urged the summit - already twice postponed - to be postponed until the end of April , when recent events can be analysed with complete objectivity .


fn_spacy_tokens_for_baseline: If he took the short cut across the beck , he would arrive there in a fraction of the time .

source_bert_toks: if he took the short cut across the beck , he would arrive there in a fraction of the time .

reference_raw: If he took a short cut across the deck, he'd be there in a fraction.

reference_spacy_tokens: If he took a short cut across the deck , he 'd be there in a fraction .


fn_spacy_tokens_for_baseline: The Administration is threatening to withhold payments and even cancel the $ 3,900 m contract to modernise the US air traffic control system if IBM does not fix the problems quickly .

source_bert_toks: the administration is threatening to with ##hold payments and even cancel the $ 3 , 900 ##m contract to modern ##ise the us air traffic control system if ibm does not fix the problems quickly .

reference_raw: The government threatens to withhold payments and even cancel a $3,900 million contract to modernise the U.S. air traffic control system unless IBM resolves the problem quickly.

reference_spacy_tokens: The government threatens to withhold payments and even cancel a $ 3,900 million contract to modernise the U.S. air traffic control system unless IBM resolves the problem quickly .


fn_spacy_tokens_for_baseline: But evidence consistent with Wagner 's account has come from experiments using the flavour - aversion procedure .

source_bert_toks: but evidence consistent with wagner ' s account has come from experiments using the flavour - ave ##rs ##ion procedure .

reference_raw: But the evidence that matches Wagner's description came from experiments using a taste-aversion process.

reference_spacy_tokens: But the evidence that matches Wagner 's description came from experiments using a taste - aversion process .


fn_spacy_tokens_for_baseline: Messily directed by John Schlesinger , it fails to evoke admiration or sympathy for its characters .

source_bert_toks: mess ##ily directed by john sc ##hl ##es ##inger , it fails to ev ##oke admiration or sympathy for its characters .

reference_raw: Messily directed by John Schlesinger, he does not evoke admiration or compassion for his character.

reference_spacy_tokens: Messily directed by John Schlesinger , he does not evoke admiration or compassion for his character .


fn_spacy_tokens_for_baseline: Derek who was accompanied by his wife , Lorna , daughters Charlotte and Emma , and his parents , nearly did n't make it to the ceremony .

source_bert_toks: derek who was accompanied by his wife , lo ##rna , daughters charlotte and emma , and his parents , nearly didn ' t make it to the ceremony .

reference_raw: Derek, accompanied by his wife, Lorna, daughters Charlotte, Emma, and his parents, almost missed the ceremony.

reference_spacy_tokens: Derek , accompanied by his wife , Lorna , daughters Charlotte , Emma , and his parents , almost missed the ceremony .


fn_spacy_tokens_for_baseline: A pesticide which has long been thought to cause sickness and death in farm workers has been subjected to a partial ban following an agreement between the manufacturers and the US Environmental Protection Agency .

source_bert_toks: a pest ##icide which has long been thought to cause sickness and death in farm workers has been subjected to a partial ban following an agreement between the manufacturers and the us environmental protection agency .

reference_raw: A pesticide that has long been considered to cause disease and death in farm workers is subject to a partial prohibition following an agreement between producers and the United States Environmental Protection Agency.

reference_spacy_tokens: A pesticide that has long been considered to cause disease and death in farm workers is subject to a partial prohibition following an agreement between producers and the United States Environmental Protection Agency .


fn_spacy_tokens_for_baseline: This information has been taken from the Advance Data Capture file and whilst it is not 100 % correct I hope it will suffice for your purposes .

source_bert_toks: this information has been taken from the advance data capture file and whilst it is not 100 % correct i hope it will su ##ffi ##ce for your purposes .

reference_raw: This information has been extracted from the Advance Data Capture file, and while it is not 100% correct, I hope it will be sufficient for your purposes.

reference_spacy_tokens: This information has been extracted from the Advance Data Capture file , and while it is not 100 % correct , I hope it will be sufficient for your purposes .


fn_spacy_tokens_for_baseline: But do n't add oil to baths if you have spots : try adding powdered seaweed to the water as it 's good for drawing out impurities .

source_bert_toks: but don ' t add oil to baths if you have spots : try adding powder ##ed sea ##weed to the water as it ' s good for drawing out imp ##urities .

reference_raw: But do not add oil to the baths if you have stains: try to add dusty seaweed to the water because it is good for the extraction of impurities.

reference_spacy_tokens: But do not add oil to the baths if you have stains : try to add dusty seaweed to the water because it is good for the extraction of impurities .


fn_spacy_tokens_for_baseline: Several rebels said at least one jet fighter also attacked their positions .

source_bert_toks: several rebels said at least one jet fighter also attacked their positions .

reference_raw: Several of the rebels said that at least one of the fighters was attacking their posts.

reference_spacy_tokens: Several of the rebels said that at least one of the fighters was attacking their posts .


fn_spacy_tokens_for_baseline: If they had a communicable disease and it entailed investigating the vagina to find out , then I suppose the doctor is entitled to do that .

source_bert_toks: if they had a com ##mun ##ica ##ble disease and it en ##tail ##ed investigating the va ##gina to find out , then i suppose the doctor is entitled to do that .

reference_raw: If they had a communicable disease, and that involved examining the vagina to find out, then I think the doctor has the right to do it.

reference_spacy_tokens: If they had a communicable disease , and that involved examining the vagina to find out , then I think the doctor has the right to do it .


fn_spacy_tokens_for_baseline: Her betrothed leapt back to his feet , his hand going to the knife at his belt , but Cranston just dismissed him with a contemptuous flicker of his eyes .

source_bert_toks: her bet ##rot ##hed leapt back to his feet , his hand going to the knife at his belt , but cr ##ans ##ton just dismissed him with a contempt ##uous flicker of his eyes .

reference_raw: Her engagement jumped back to his feet, and his hand went to the knife at his belt, but Cranston dismissed him with a scornful flash.

reference_spacy_tokens: Her engagement jumped back to his feet , and his hand went to the knife at his belt , but Cranston dismissed him with a scornful flash .


fn_spacy_tokens_for_baseline: In 1970 , the government ratified the NPT and its obligations went into force .

source_bert_toks: in 1970 , the government ratified the np ##t and its obligations went into force .

reference_raw: The government ratified the NPT in 1970 and its obligations entered into force.

reference_spacy_tokens: The government ratified the NPT in 1970 and its obligations entered into force .


fn_spacy_tokens_for_baseline: Nigeria 's rainforests have been so exploited for logs that the country now imports more hardwood than it exports .

source_bert_toks: nigeria ' s rainforest ##s have been so exploited for logs that the country now imports more hardwood than it exports .

reference_raw: The rain forests of Nigeria were so used for logs that the country is now importing more hardwood than it is exporting.

reference_spacy_tokens: The rain forests of Nigeria were so used for logs that the country is now importing more hardwood than it is exporting .


fn_spacy_tokens_for_baseline: All the time Midnight was silently pulling on his white stockings and buckling his shoes .

source_bert_toks: all the time midnight was silently pulling on his white stockings and buck ##ling his shoes .

reference_raw: Midnight was still pulling on his white stockings and fastening his boots.

reference_spacy_tokens: Midnight was still pulling on his white stockings and fastening his boots .


fn_spacy_tokens_for_baseline: It all makes many believe that over the coming months share prices will drop below the levels at which they opened 1991 .

source_bert_toks: it all makes many believe that over the coming months share prices will drop below the levels at which they opened 1991 .

reference_raw: All of this leads many to believe that in the coming months, share prices will fall below the level at which they started in 1991.

reference_spacy_tokens: All of this leads many to believe that in the coming months , share prices will fall below the level at which they started in 1991 .


fn_spacy_tokens_for_baseline: I see myself sprawled in a chair , setting them at ease in a trice , and passing on the acquired wisdom of my life .

source_bert_toks: i see myself sprawled in a chair , setting them at ease in a tri ##ce , and passing on the acquired wisdom of my life .

reference_raw: I see myself sitting in a chair, resting them in a trice, and passing on the wisdom of my life.

reference_spacy_tokens: I see myself sitting in a chair , resting them in a trice , and passing on the wisdom of my life .


fn_spacy_tokens_for_baseline: By no means the most beguiling feature about this outstanding car , but a unique offer that could be a trend setter .

source_bert_toks: by no means the most beg ##uil ##ing feature about this outstanding car , but a unique offer that could be a trend set ##ter .

reference_raw: The most fascinating feature of this excellent car is not in any way, but a unique offer, which could be a trend-setter.

reference_spacy_tokens: The most fascinating feature of this excellent car is not in any way , but a unique offer , which could be a trend - setter .


fn_spacy_tokens_for_baseline: The second incident precipitated his departure from the Catholic church at the age of fourteen .

source_bert_toks: the second incident pre ##ci ##pit ##ated his departure from the catholic church at the age of fourteen .

reference_raw: The second incident prompted his departure from the Catholic Church when he was fourteen.

reference_spacy_tokens: The second incident prompted his departure from the Catholic Church when he was fourteen .


fn_spacy_tokens_for_baseline: It was a way of life devoted to cultured consumption , culture as the means of conspicuous consumption and consumption as the use of culture to secure class status .

source_bert_toks: it was a way of life devoted to culture ##d consumption , culture as the means of conspicuous consumption and consumption as the use of culture to secure class status .

reference_raw: It was a way of life devoted to cultured consumption, culture as a means of perceptive consumption and consumption as a way of using culture to ensure the status of the class.

reference_spacy_tokens: It was a way of life devoted to cultured consumption , culture as a means of perceptive consumption and consumption as a way of using culture to ensure the status of the class .


fn_spacy_tokens_for_baseline: The actors impersonate the totem animal , thus identifying and promoting a resonant connection with it .

source_bert_toks: the actors imp ##erson ##ate the to ##tem animal , thus identifying and promoting a res ##ona ##nt connection with it .

reference_raw: Actors imitate a totem animal, thus identifying and promoting a resonant link with it.

reference_spacy_tokens: Actors imitate a totem animal , thus identifying and promoting a resonant link with it .


fn_spacy_tokens_for_baseline: Then the young woman laughed merrily , her voice strengthening after what must have been years of silence , and the whole strange cellar rang with that laughter , and the glass fragments tinkled like broken bells .

source_bert_toks: then the young woman laughed mer ##rily , her voice strengthening after what must have been years of silence , and the whole strange cellar rang with that laughter , and the glass fragments tin ##kled like broken bells .

reference_raw: Then the girl laughed cheerfully, her voice deepening after what must have been years of silence, and the whole strange cellar rang with that laugh, and glass fragments rang like broken bells.

reference_spacy_tokens: Then the girl laughed cheerfully , her voice deepening after what must have been years of silence , and the whole strange cellar rang with that laugh , and glass fragments rang like broken bells .


fn_spacy_tokens_for_baseline: This will need topdressing each year in spring , together with the addition of a little slow - acting organic fertilizer -- herbs are much more aromatic when grown ' hard ' with little nutrient .

source_bert_toks: this will need top ##dre ##ssing each year in spring , together with the addition of a little slow - acting organic fe ##rti ##lizer - - herbs are much more aromatic when grown ' hard ' with little nutrient .

reference_raw: This will have to be improved every year in the spring, along with the addition of a small, slow-acting organic fertiliser - herbs are much more flavoured when they grow hard and have little nutrients.

reference_spacy_tokens: This will have to be improved every year in the spring , along with the addition of a small , slow - acting organic fertiliser - herbs are much more flavoured when they grow hard and have little nutrients .


fn_spacy_tokens_for_baseline: Against this background of a bustling , potentially violent and effectively unpoliced street life , we can point to a wide variety of other kinds of rowdyism and misbehaviour at this time in history .

source_bert_toks: against this background of a bust ##ling , potentially violent and effectively un ##pol ##ice ##d street life , we can point to a wide variety of other kinds of row ##dy ##ism and mis ##be ##ha ##vio ##ur at this time in history .

reference_raw: In this context of busy, potentially violent and effectively unpoliced street life, we can point to a wide range of other types of rowdyism and misbehavior at this time in history.

reference_spacy_tokens: In this context of busy , potentially violent and effectively unpoliced street life , we can point to a wide range of other types of rowdyism and misbehavior at this time in history .


fn_spacy_tokens_for_baseline: Indeed , the LAT and NYT s quote Mikhail Gorbachev from an interview in an Italian paper saying that Yeltsin did not want to resign but was pushed out by a trio of this inner circle including his daughter .

source_bert_toks: indeed , the la ##t and ny ##t s quote mikhail go ##rba ##chev from an interview in an italian paper saying that ye ##lts ##in did not want to resign but was pushed out by a trio of this inner circle including his daughter .

reference_raw: In fact, the LAT and NYT quote Mikhail Gorbachev from an interview in an Italian newspaper that said Yeltsin didn't want to resign, but was pushed out by a trio of the inner circle, including his daughter.

reference_spacy_tokens: In fact , the LAT and NYT quote Mikhail Gorbachev from an interview in an Italian newspaper that said Yeltsin did n't want to resign , but was pushed out by a trio of the inner circle , including his daughter .


fn_spacy_tokens_for_baseline: U.S. officials have identified Raznatovic as a possible war criminal , although he has not been indicted by a war crimes tribunal .

source_bert_toks: u . s . officials have identified ra ##z ##nat ##ovic as a possible war criminal , although he has not been indicted by a war crimes tribunal .

reference_raw: American officials have identified Raznatovic as a potential war criminal, even though he has not been prosecuted by the War Crimes Tribunal.

reference_spacy_tokens: American officials have identified Raznatovic as a potential war criminal , even though he has not been prosecuted by the War Crimes Tribunal .


fn_spacy_tokens_for_baseline: They could become a den for juvenile delinquents .

source_bert_toks: they could become a den for juvenile del ##in ##quent ##s .

reference_raw: They could become a den for juvenile offenders.

reference_spacy_tokens: They could become a den for juvenile offenders .


fn_spacy_tokens_for_baseline: I wonder if that means geography is destiny , and it 's still location , location , location .

source_bert_toks: i wonder if that means geography is destiny , and it ' s still location , location , location .

reference_raw: I'd like to know if it means that geography is fate, and it's still a place, a place, a place.

reference_spacy_tokens: I 'd like to know if it means that geography is fate , and it 's still a place , a place , a place .


fn_spacy_tokens_for_baseline: This is something that has intrigued thousands of viewers .

source_bert_toks: this is something that has intrigued thousands of viewers .

reference_raw: It's something that's attracted thousands of viewers.

reference_spacy_tokens: It 's something that 's attracted thousands of viewers .


fn_spacy_tokens_for_baseline: The Counter - Reformation crushed the spirit of Protestantism in Slovenia , but it did not completely suppress the influence of Trubar and his contemporary Slovene writers .

source_bert_toks: the counter - reformation crushed the spirit of protestant ##ism in slovenia , but it did not completely suppress the influence of tr ##uba ##r and his contemporary slovene writers .

reference_raw: The counter-reformation shattered the spirit of protest in Slovenia, but did not completely suppress the influence of Trubar and his modern Slovenian authors.

reference_spacy_tokens: The counter - reformation shattered the spirit of protest in Slovenia , but did not completely suppress the influence of Trubar and his modern Slovenian authors .


fn_spacy_tokens_for_baseline: QN : Does Trump support W 's decision to go to war ?

source_bert_toks: q ##n : does trump support w ' s decision to go to war ?

reference_raw: QN: Does Trump support the choice of W to go to war?

reference_spacy_tokens: QN : Does Trump support the choice of W to go to war ?


fn_spacy_tokens_for_baseline: Exciting , mysterious , glamorous - these words have described Hong Kong for at least a century .

source_bert_toks: exciting , mysterious , g ##lam ##orous - these words have described hong kong for at least a century .

reference_raw: Exciting, mysterious, charming - these words have described Hong Kong for a hundred years.

reference_spacy_tokens: Exciting , mysterious , charming - these words have described Hong Kong for a hundred years .


fn_spacy_tokens_for_baseline: He tittered nervously as he tried to see through the glare of the flames .

source_bert_toks: he ti ##ttered nervously as he tried to see through the glare of the flames .

reference_raw: He twitched nervously, trying to see through the firelight.

reference_spacy_tokens: He twitched nervously , trying to see through the firelight .


fn_spacy_tokens_for_baseline: You will know this already , I suppose , but the point of a good fight , the way you relieve the tension , is not just in hitting someone : you got to get hit yourself .

source_bert_toks: you will know this already , i suppose , but the point of a good fight , the way you relieve the tension , is not just in hitting someone : you got to get hit yourself .

reference_raw: I think you'll know that by now, but the point of a good fight, the way you relieve the tension, is not just to hit someone: you have to be hit.

reference_spacy_tokens: I think you 'll know that by now , but the point of a good fight , the way you relieve the tension , is not just to hit someone : you have to be hit .


fn_spacy_tokens_for_baseline: I never go north of the Liffey , " one man remarked .

source_bert_toks: i never go north of the li ##ffey , " one man remarked .

reference_raw: I don't go north of Liffey,' said one of the men.

reference_spacy_tokens: I do n't go north of Liffey , ' said one of the men .


fn_spacy_tokens_for_baseline: Mary Moore , 17 , of Chatham , Kent , was starved of oxygen after doctors failed to diagnose her presence in the womb .

source_bert_toks: mary moore , 17 , of chatham , kent , was starved of oxygen after doctors failed to dia ##gno ##se her presence in the womb .

reference_raw: Mary Moore, 17, of Chatham, Kent, was hungry for oxygen after the doctors failed to diagnose her presence in the uterus.

reference_spacy_tokens: Mary Moore , 17 , of Chatham , Kent , was hungry for oxygen after the doctors failed to diagnose her presence in the uterus .


fn_spacy_tokens_for_baseline: At first , she was utterly bewildered when he burst out laughing .

source_bert_toks: at first , she was utterly bewildered when he burst out laughing .

reference_raw: At first she was completely confused when he burst out laughing.

reference_spacy_tokens: At first she was completely confused when he burst out laughing .


fn_spacy_tokens_for_baseline: This ill - advised conceit casts a pall on the piece from the outset , and it does n't help that the skits ( rewritten and reconstructed ) are crushingly unfunny .

source_bert_toks: this ill - advised con ##ce ##it casts a pal ##l on the piece from the outset , and it doesn ' t help that the ski ##ts ( re ##written and reconstructed ) are crushing ##ly un ##fu ##nn ##y .

reference_raw: This misconduct casts a pall on a piece from the start, and it doesn't help that skits (rewrote and reconstructed) are crushingly unfunny.

reference_spacy_tokens: This misconduct casts a pall on a piece from the start , and it does n't help that skits ( rewrote and reconstructed ) are crushingly unfunny .


fn_spacy_tokens_for_baseline: -- She tried to shut them out but it was as if one memory had set free another : they came clamouring now to torment and bewilder her .

source_bert_toks: - - she tried to shut them out but it was as if one memory had set free another : they came cl ##amo ##uring now to torment and be ##wil ##der her .

reference_raw: She tried to shut them down, but it was as if one memory had freed another: now they were clamoring to torture and confuse her.

reference_spacy_tokens: She tried to shut them down , but it was as if one memory had freed another : now they were clamoring to torture and confuse her .


fn_spacy_tokens_for_baseline: But one runnel of sweat began to trickle down his forehead from under his headdress .

source_bert_toks: but one run ##nel of sweat began to trickle down his forehead from under his head ##dre ##ss .

reference_raw: But a runnel of sweat began to trickle down his forehead from under his headband.

reference_spacy_tokens: But a runnel of sweat began to trickle down his forehead from under his headband .


fn_spacy_tokens_for_baseline: She finally found her voice , screaming as she bolted from the hideous life - form that was shaping even as she watched into the form , the outward appearance of a dead human .

source_bert_toks: she finally found her voice , screaming as she bolted from the hideous life - form that was shaping even as she watched into the form , the outward appearance of a dead human .

reference_raw: At last she found her voice, screaming as she ran away from the hideous life-form that shaped before she could see the shape of a dead man.

reference_spacy_tokens: At last she found her voice , screaming as she ran away from the hideous life - form that shaped before she could see the shape of a dead man .


fn_spacy_tokens_for_baseline: For example , if you are consuming lots of cups of coffee or tea , cola drinks , or refined sweet foods , you may find the first week of the diet quite a challenge !

source_bert_toks: for example , if you are consuming lots of cups of coffee or tea , cola drinks , or refined sweet foods , you may find the first week of the diet quite a challenge !

reference_raw: For example, if you eat a lot of coffee, tea, cola beverages, or refined candy, you might find the first week of your diet a challenge!

reference_spacy_tokens: For example , if you eat a lot of coffee , tea , cola beverages , or refined candy , you might find the first week of your diet a challenge !


fn_spacy_tokens_for_baseline: And now a shabby mischance had destroyed it , knocked down the precarious walls of my prison , I still sat on in the wreckage and kept my eyes closed , safe behind broken bars .

source_bert_toks: and now a sha ##bby mis ##chan ##ce had destroyed it , knocked down the pre ##car ##ious walls of my prison , i still sat on in the wreckage and kept my eyes closed , safe behind broken bars .

reference_raw: And now it was destroyed by a shabby accident, knocking down the uncertain walls of my prison, and I was still sitting in the ruins, keeping my eyes closed, safe behind broken bars.

reference_spacy_tokens: And now it was destroyed by a shabby accident , knocking down the uncertain walls of my prison , and I was still sitting in the ruins , keeping my eyes closed , safe behind broken bars .


fn_spacy_tokens_for_baseline: Defendants would , however , plead guilty to lesser offences such as assault , assault and battery and assault with intent to commit rape which carry low penalties .

source_bert_toks: defendants would , however , plead guilty to lesser offences such as assault , assault and battery and assault with intent to commit rape which carry low penalties .

reference_raw: However, the defendants would plead guilty to minor offences, such as attack, attack, battery, and attack with intent to commit rape with low sanctions.

reference_spacy_tokens: However , the defendants would plead guilty to minor offences , such as attack , attack , battery , and attack with intent to commit rape with low sanctions .


fn_spacy_tokens_for_baseline: The house , one of the oldest on Bermuda , was built around 1725 on land bought by John Trimingham II .

source_bert_toks: the house , one of the oldest on bermuda , was built around 1725 on land bought by john trim ##ingham ii .

reference_raw: The house, one of the oldest in Bermuda, was built around 1725 on a property purchased by John Trimingham II.

reference_spacy_tokens: The house , one of the oldest in Bermuda , was built around 1725 on a property purchased by John Trimingham II .


fn_spacy_tokens_for_baseline: ' I 'm sorry , ' he said in a voice that was more masculine than his flabby , characterless appearance .

source_bert_toks: ' i ' m sorry , ' he said in a voice that was more masculine than his fl ##ab ##by , character ##less appearance .

reference_raw: 'I'm sorry,' he said, his voice more masculine than his limp, uncharacteristic look.

reference_spacy_tokens: ' I 'm sorry , ' he said , his voice more masculine than his limp , uncharacteristic look .


fn_spacy_tokens_for_baseline: Where the fraud is perpetrated by an operated transsexual , the innocent party will have the same remedy until the expiration of three years .

source_bert_toks: where the fraud is per ##pet ##rated by an operated trans ##se ##x ##ual , the innocent party will have the same remedy until the ex ##piration of three years .

reference_raw: If the fraud is committed by an operating transsexual, the innocent party will have the same legal remedy until the end of three years.

reference_spacy_tokens: If the fraud is committed by an operating transsexual , the innocent party will have the same legal remedy until the end of three years .


fn_spacy_tokens_for_baseline: He sent her some of his notes of what he had seen in their walks and frequently let her see his ' papers ' before they were copied out for the editors .

source_bert_toks: he sent her some of his notes of what he had seen in their walks and frequently let her see his ' papers ' before they were copied out for the editors .

reference_raw: He sent her a few notes of what he had seen during their walks, often allowing her to look at his "papers" before they were duplicated to the editors.

reference_spacy_tokens: He sent her a few notes of what he had seen during their walks , often allowing her to look at his " papers " before they were duplicated to the editors .


fn_spacy_tokens_for_baseline: Estimates vary on how soon North Korea could begin operating a uranium enrichment plant , but North Korea probably could not produce significant quantities of weapons - grade HEU until the end of the decade .

source_bert_toks: estimates vary on how soon north korea could begin operating a uranium enrichment plant , but north korea probably could not produce significant quantities of weapons - grade he ##u until the end of the decade .

reference_raw: Estimates vary as soon as North Korea can start running a uranium enrichment plant, but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade.

reference_spacy_tokens: Estimates vary as soon as North Korea can start running a uranium enrichment plant , but it is likely that North Korea will not be able to produce significant quantities of HEU weapons by the end of the decade .


fn_spacy_tokens_for_baseline: Appearance money is officially frowned upon by the European Tour but the creases in the foreheads of the officers have not been discerned by the Spaniard .

source_bert_toks: appearance money is officially frowned upon by the european tour but the cr ##ease ##s in the forehead ##s of the officers have not been disc ##ern ##ed by the span ##iard .

reference_raw: The European Tour officially frowns on the appearance of money, but the creases in the officers' brows have not been recognized by the Spanish.

reference_spacy_tokens: The European Tour officially frowns on the appearance of money , but the creases in the officers ' brows have not been recognized by the Spanish .


fn_spacy_tokens_for_baseline: The presence of these facilities confirms Iran 's growing determination to achieve a full nuclear fuel cycle .

source_bert_toks: the presence of these facilities confirms iran ' s growing determination to achieve a full nuclear fuel cycle .

reference_raw: The presence of such facilities demonstrates Iran's increasing commitment to the full nuclear fuel cycle.

reference_spacy_tokens: The presence of such facilities demonstrates Iran 's increasing commitment to the full nuclear fuel cycle .


fn_spacy_tokens_for_baseline: This muscle leaves a conspicuous scar on the inside of the shell , an impression which is easily preserved in the fossil state .

source_bert_toks: this muscle leaves a conspicuous scar on the inside of the shell , an impression which is easily preserved in the fossil state .

reference_raw: This muscle leaves a conspicuous scar on the interior of the shell, an impression that can be easily preserved in a fossil state.

reference_spacy_tokens: This muscle leaves a conspicuous scar on the interior of the shell , an impression that can be easily preserved in a fossil state .


fn_spacy_tokens_for_baseline: More than 100 were homeless .

source_bert_toks: more than 100 were homeless .

reference_raw: Over a hundred people were homeless.

reference_spacy_tokens: Over a hundred people were homeless .


fn_spacy_tokens_for_baseline: Joachim eventually broke away from the Cistercians and retired to a lonely spot in Calabria where disciples gathered around him and he was given papal permission to found his own congregation .

source_bert_toks: joachim eventually broke away from the cis ##ter ##cian ##s and retired to a lonely spot in calabria where disciples gathered around him and he was given papal permission to found his own congregation .

reference_raw: Joachim finally broke away from the Cistercians and went to a lonely place in Calabria, where the pupils gathered around him and gave the papal permission to find his own congregation.

reference_spacy_tokens: Joachim finally broke away from the Cistercians and went to a lonely place in Calabria , where the pupils gathered around him and gave the papal permission to find his own congregation .


fn_spacy_tokens_for_baseline: They will be secure enough about their own capabilities and limitations to take the lead in talking in ways which the old lags will continue to denigrate for a while as ' weak ' or ' idealistic ' .

source_bert_toks: they will be secure enough about their own capabilities and limitations to take the lead in talking in ways which the old la ##gs will continue to den ##ig ##rate for a while as ' weak ' or ' ideal ##istic ' .

reference_raw: They would be safe enough in terms of their own abilities and limitations to take the lead in speaking in a way that the old lags would continue to deny for a while as 'weak' or 'idealistic'.

reference_spacy_tokens: They would be safe enough in terms of their own abilities and limitations to take the lead in speaking in a way that the old lags would continue to deny for a while as ' weak ' or ' idealistic ' .


fn_spacy_tokens_for_baseline: I think we know what we 're going to speak about .

source_bert_toks: i think we know what we ' re going to speak about .

reference_raw: We know what we're talking about.

reference_spacy_tokens: We know what we 're talking about .


fn_spacy_tokens_for_baseline: Analytic tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country 's nuclear infrastructure .

source_bert_toks: analytic tools include examining statements and articles in the news media , government reports including un ##class ##ified intelligence estimates , interviewing insider ##s who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country ' s nuclear infrastructure .

reference_raw: The analytical tools include examining statements and articles in the news media, government reports, including unclassified intelligence forecasts, interviewing insiders who had access to classified information, reviewing secondary sources, such as analysts' reports, and making scientific calculations based on the best available information on the nuclear infrastructure of a country.

reference_spacy_tokens: The analytical tools include examining statements and articles in the news media , government reports , including unclassified intelligence forecasts , interviewing insiders who had access to classified information , reviewing secondary sources , such as analysts ' reports , and making scientific calculations based on the best available information on the nuclear infrastructure of a country .


fn_spacy_tokens_for_baseline: It was true that Conchis was a recluse and never came to the village , but that he had been a collaborationist was a lie .

source_bert_toks: it was true that con ##chi ##s was a rec ##lus ##e and never came to the village , but that he had been a collaboration ##ist was a lie .

reference_raw: It was true that Conchis was a solitary man who had never come to the village, but the fact that he was a co-operator was a lie.

reference_spacy_tokens: It was true that Conchis was a solitary man who had never come to the village , but the fact that he was a co - operator was a lie .


fn_spacy_tokens_for_baseline: He put the syringe in her hand .

source_bert_toks: he put the sy ##ring ##e in her hand .

reference_raw: He slipped the needle into her hand.

reference_spacy_tokens: He slipped the needle into her hand .


fn_spacy_tokens_for_baseline: He was speared to death six years later by a Masai whose favourite bullock he insisted on requisitioning for a government destocking programme .

source_bert_toks: he was spear ##ed to death six years later by a mas ##ai whose favourite bullock he insisted on re ##qui ##sit ##ion ##ing for a government des ##tock ##ing programme .

reference_raw: Six years later, he was stabbed to death by a Masai whose favorite bullock he insisted on requesting a government destocking program.

reference_spacy_tokens: Six years later , he was stabbed to death by a Masai whose favorite bullock he insisted on requesting a government destocking program .


fn_spacy_tokens_for_baseline: The more resentful and unforgiving Willie Morgan , was taken to court and then had to terminate a lucrative six year contract after only nine months .

source_bert_toks: the more res ##ent ##ful and un ##for ##giving willie morgan , was taken to court and then had to terminate a lucrative six year contract after only nine months .

reference_raw: The more grumpy and unforgivable Willie Morgan was brought to court, and after only nine months he had to terminate his lucrative six-year contract.

reference_spacy_tokens: The more grumpy and unforgivable Willie Morgan was brought to court , and after only nine months he had to terminate his lucrative six - year contract .


fn_spacy_tokens_for_baseline: Yet in the past decade more than 50,000 people have died in the fighting between the security forces , separatist Tamil guerrillas and a now - faded nationalist revolt ; and prominent politicians and soldiers are murdered with monotonous regularity .

source_bert_toks: yet in the past decade more than 50 , 000 people have died in the fighting between the security forces , sep ##arat ##ist tamil guerrillas and a now - faded nationalist revolt ; and prominent politicians and soldiers are murdered with mono ##ton ##ous regular ##ity .

reference_raw: But in the last decade, over 50,000 people have died fighting the security forces, the separatist Tamil guerrillas, and the now-faded nationalist rebellion, and prominent politicians and soldiers have been assassinated with monotonous regularity.

reference_spacy_tokens: But in the last decade , over 50,000 people have died fighting the security forces , the separatist Tamil guerrillas , and the now - faded nationalist rebellion , and prominent politicians and soldiers have been assassinated with monotonous regularity .


fn_spacy_tokens_for_baseline: Strapping himself into the vacated chair , he entreated Rogal Dorn to guide him -- then emptied his mind of all but titanic tech thoughts .

source_bert_toks: strap ##ping himself into the vacated chair , he en ##tre ##ated ro ##gal do ##rn to guide him - - then emptied his mind of all but titanic tech thoughts .

reference_raw: He sat back in the empty chair, encumbered Rogal Dorn to guide him, then emptied his mind of all but titanic technical thoughts.

reference_spacy_tokens: He sat back in the empty chair , encumbered Rogal Dorn to guide him , then emptied his mind of all but titanic technical thoughts .


fn_spacy_tokens_for_baseline: It showed the east facade of the house .

source_bert_toks: it showed the east facade of the house .

reference_raw: It showed the eastern front of the house.

reference_spacy_tokens: It showed the eastern front of the house .