fn_spacy_tokens_for_baseline: Leitenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told UPI that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

source_bert_toks: lei ##tenberg , who has worked on arms control and chemical and biological weapons issues for 40 years , told up ##i that " a best case scenario " might kill most of the inhabitants of a subway car , but added " every calculation ( one can make about casualties ) relies on a whole series of assumptions . "

reference_raw: Leitenberg, who's been working on weapons control and chemical and biological weapons issues for 40 years, told UPI that "the best-case scenario" could kill most people in a subway car, but added "any calculation (the best-case scenario) depends on a number of assumptions."

reference_spacy_tokens: Leitenberg , who 's been working on weapons control and chemical and biological weapons issues for 40 years , told UPI that " the best - case scenario " could kill most people in a subway car , but added " any calculation ( the best - case scenario ) depends on a number of assumptions . "


fn_spacy_tokens_for_baseline: Emerging from a concealing butte , Ollokot , wearing a sash and riding a magnificent cream - coloured mount , led fifty warriors in a frontal assault against Theller .

source_bert_toks: emerging from a conceal ##ing butte , ol ##lok ##ot , wearing a sash and riding a magnificent cream - coloured mount , led fifty warriors in a frontal assault against the ##ller .

reference_raw: Ollokot, wearing a sash and riding a magnificent cream-colored horse, emerged from the hidden butt, led fifty warriors into a frontal attack on Theller.

reference_spacy_tokens: Ollokot , wearing a sash and riding a magnificent cream - colored horse , emerged from the hidden butt , led fifty warriors into a frontal attack on Theller .


fn_spacy_tokens_for_baseline: Marine commanders have also thrown the SWAT team into action in raids across northern Babil province , a push to flush insurgents and criminals out of their strongholds .

source_bert_toks: marine commanders have also thrown the swat team into action in raids across northern ba ##bil province , a push to flush insurgents and criminals out of their stronghold ##s .

reference_raw: The Marine commanders also threw the SWAT team into action in raids across the northern Babil province, pushing the rebels and criminals out of their fortresses.

reference_spacy_tokens: The Marine commanders also threw the SWAT team into action in raids across the northern Babil province , pushing the rebels and criminals out of their fortresses .


fn_spacy_tokens_for_baseline: Simultaneously , the His15 and Arg17 side chains of HPr would separate and the active centre would take on the strained open conformation ( Fig . 2 a ) , ready for the next cycle ; formation of hydrogen bonds to His15 and Arg17 would help to stabilize the open conformation and the protein would be in an overall energy minimum .

source_bert_toks: simultaneously , the his ##15 and ar ##g ##17 side chains of hp ##r would separate and the active centre would take on the strained open conform ##ation ( fig . 2 a ) , ready for the next cycle ; formation of hydrogen bonds to his ##15 and ar ##g ##17 would help to stabilize the open conform ##ation and the protein would be in an overall energy minimum .

reference_raw: At the same time, the HPr H15 and Arg17 side-chains would be decoupled and the active centre would assume a strained open conformation (Fig. 2a), ready for the next cycle; the formation of HPr-15 and Arg17 hydrogen bonds would help stabilise the open conformation and the protein would be at an overall energy minimum.

reference_spacy_tokens: At the same time , the HPr H15 and Arg17 side - chains would be decoupled and the active centre would assume a strained open conformation ( Fig . 2a ) , ready for the next cycle ; the formation of HPr-15 and Arg17 hydrogen bonds would help stabilise the open conformation and the protein would be at an overall energy minimum .


fn_spacy_tokens_for_baseline: ' How terribly unhygienic , ' she gurgled .

source_bert_toks: ' how terribly un ##hy ##gie ##nic , ' she gu ##rg ##led .

reference_raw: 'How terribly unhygienic,' she said.

reference_spacy_tokens: ' How terribly unhygienic , ' she said .


fn_spacy_tokens_for_baseline: Later , apparently unseen by others , she dances through the betrothal party at which he is confronted by Madge , the Witch , who foretells that he will never marry .

source_bert_toks: later , apparently unseen by others , she dances through the bet ##rot ##hal party at which he is confronted by mad ##ge , the witch , who fore ##tell ##s that he will never marry .

reference_raw: Later, apparently invisible to others, he dances through the engagement party where he faces Madge, the witch, who predicts he'll never get married.

reference_spacy_tokens: Later , apparently invisible to others , he dances through the engagement party where he faces Madge , the witch , who predicts he 'll never get married .


fn_spacy_tokens_for_baseline: ' Still , they 'll be protected from sleet and hail , enclosed like the H12 . '

source_bert_toks: ' still , they ' ll be protected from sl ##eet and hail , enclosed like the h ##12 . '

reference_raw: "Still, they'll be protected from sleek and hail, surrounded like an H12."

reference_spacy_tokens: " Still , they 'll be protected from sleek and hail , surrounded like an H12 . "


fn_spacy_tokens_for_baseline: Although the islands saw little action , as the war went on they could see that Athens was slowly losing its power .

source_bert_toks: although the islands saw little action , as the war went on they could see that athens was slowly losing its power .

reference_raw: Though the islands saw little activity, as the war continued, they saw that Athens was slowly losing power.

reference_spacy_tokens: Though the islands saw little activity , as the war continued , they saw that Athens was slowly losing power .


fn_spacy_tokens_for_baseline: She had cream silk stockings and cream satin slippers with waisted heels and bows of stiff cream ribbon on the toes .

source_bert_toks: she had cream silk stockings and cream satin slip ##pers with waist ##ed heels and bows of stiff cream ribbon on the toes .

reference_raw: She wore cream silk stockings and cream satin shoes with waist-length heels and stiff cream ribbon bows on her toes.

reference_spacy_tokens: She wore cream silk stockings and cream satin shoes with waist - length heels and stiff cream ribbon bows on her toes .


fn_spacy_tokens_for_baseline: Instinctively drawing in his limbs and curling his long back , the Perk sailed out of her grasp and over the edge of the steps like a furry stone in a leather jerkin .

source_bert_toks: instinctively drawing in his limbs and curling his long back , the per ##k sailed out of her grasp and over the edge of the steps like a furry stone in a leather jerk ##in .

reference_raw: Instinctively he drew on his limbs and curled his long back, and the Perk flew from her grasp to the edge of the stairs like a furry stone in a leather jacket.

reference_spacy_tokens: Instinctively he drew on his limbs and curled his long back , and the Perk flew from her grasp to the edge of the stairs like a furry stone in a leather jacket .


fn_spacy_tokens_for_baseline: ' If I tread too presumptuously into sacred places , reprove me , ' entreated the earl , with the submissive sweetness of a brand - new novice .

source_bert_toks: ' if i tread too pre ##sum ##pt ##uously into sacred places , rep ##rove me , ' en ##tre ##ated the earl , with the sub ##missive sweetness of a brand - new novice .

reference_raw: 'If I walk too boldly in holy places, reprove me,' said the Count, with the submissive sweetness of a new novice.

reference_spacy_tokens: ' If I walk too boldly in holy places , reprove me , ' said the Count , with the submissive sweetness of a new novice .


fn_spacy_tokens_for_baseline: It was a 14-year - old from R Street who got his crew of six together and ran their drug block killing another 14-year - old and his crew from a block away .

source_bert_toks: it was a 14 - year - old from r street who got his crew of six together and ran their drug block killing another 14 - year - old and his crew from a block away .

reference_raw: He was a 14-year-old on R Street who put his six-year-old crew together and ran a drug block and murdered another 14-year-old and his crew a block away.

reference_spacy_tokens: He was a 14-year - old on R Street who put his six - year - old crew together and ran a drug block and murdered another 14-year - old and his crew a block away .


fn_spacy_tokens_for_baseline: In an expression of community sympathy many local children in South Ronaldsay made and sent cards to the four devastated mothers .

source_bert_toks: in an expression of community sympathy many local children in south ronald ##say made and sent cards to the four devastated mothers .

reference_raw: In an expression of community sympathy, many of the local kids in South Ronaldsay made and sent cards to four ruined mothers.

reference_spacy_tokens: In an expression of community sympathy , many of the local kids in South Ronaldsay made and sent cards to four ruined mothers .


fn_spacy_tokens_for_baseline: Killion reached up in a panic : he 'd forgotten to cock his gun .

source_bert_toks: kill ##ion reached up in a panic : he ' d forgotten to cock his gun .

reference_raw: Killion raised his hand in panic: he had failed to raise his weapon.

reference_spacy_tokens: Killion raised his hand in panic : he had failed to raise his weapon .


fn_spacy_tokens_for_baseline: Lady Weighall was also responsible for laying out Jubilee Park , opposite Petwood , and later gifting it to the authorities .

source_bert_toks: lady weigh ##all was also responsible for laying out jubilee park , opposite pet ##wood , and later gift ##ing it to the authorities .

reference_raw: Lady Weighall was also responsible for setting up Jubilee Park across from Petwood, and then handing it over to the authorities.

reference_spacy_tokens: Lady Weighall was also responsible for setting up Jubilee Park across from Petwood , and then handing it over to the authorities .


fn_spacy_tokens_for_baseline: The deputy leader of the parliamentary FKgP faction , Sandor Olah , was expelled from the party on Nov. 1 for opposing the move to expel the ministers , and two other deputies were expelled .

source_bert_toks: the deputy leader of the parliamentary fk ##gp faction , sand ##or ol ##ah , was expelled from the party on nov . 1 for opposing the move to ex ##pel the ministers , and two other deputies were expelled .

reference_raw: The second-in-command of the FKGP faction, Sandor Olah, was disqualified from the party on November 1 because he objected to the removal of the ministers, and two other representatives were disqualified.

reference_spacy_tokens: The second - in - command of the FKGP faction , Sandor Olah , was disqualified from the party on November 1 because he objected to the removal of the ministers , and two other representatives were disqualified .


fn_spacy_tokens_for_baseline: The rest of the LASMO team felt that the entire trip was equally successful .

source_bert_toks: the rest of the las ##mo team felt that the entire trip was equally successful .

reference_raw: The remainder of the LASMO team felt that the trip had been just as successful.

reference_spacy_tokens: The remainder of the LASMO team felt that the trip had been just as successful .


fn_spacy_tokens_for_baseline: Michael Stein was trying unsuccessfully to calm an irate customer who was arguing about his bill .

source_bert_toks: michael stein was trying unsuccessfully to calm an ira ##te customer who was arguing about his bill .

reference_raw: Michael Stein tried unsuccessfully to calm the angry customer who was arguing about the bill.

reference_spacy_tokens: Michael Stein tried unsuccessfully to calm the angry customer who was arguing about the bill .


fn_spacy_tokens_for_baseline: Received by the king and queen as she made her entrance , she curtsied deeply , and waited with bated breath for what would happen next .

source_bert_toks: received by the king and queen as she made her entrance , she curt ##sie ##d deeply , and waited with bat ##ed breath for what would happen next .

reference_raw: Received by the King and the Queen as she entered, she bowed deeply and waited with batted breath for what was to happen next.

reference_spacy_tokens: Received by the King and the Queen as she entered , she bowed deeply and waited with batted breath for what was to happen next .


fn_spacy_tokens_for_baseline: They built many impressive churches during the term of the first Latin Kingdom of Jerusalem , but in 1187 they were driven out by Muslim forces under the great warrior Saladin .

source_bert_toks: they built many impressive churches during the term of the first latin kingdom of jerusalem , but in 118 ##7 they were driven out by muslim forces under the great warrior salad ##in .

reference_raw: During the period of the first Latin kingdom of Jerusalem, they built many impressive churches, but in 1177 they were expelled by Muslim forces under the great warrior Saladin.

reference_spacy_tokens: During the period of the first Latin kingdom of Jerusalem , they built many impressive churches , but in 1177 they were expelled by Muslim forces under the great warrior Saladin .


fn_spacy_tokens_for_baseline: ' There 's a lot of smart sensors that take away the ( guesswork ) of the soldiers , ' said Bruce Baldwin , the U.S. Army Chemical School 's lead trainer for new systems . " ( The Olympian Online , 20Apr06 , Christian Hill ) ( Link )

source_bert_toks: ' there ' s a lot of smart sensors that take away the ( guess ##work ) of the soldiers , ' said bruce baldwin , the u . s . army chemical school ' s lead trainer for new systems . " ( the olympian online , 20 ##ap ##r ##0 ##6 , christian hill ) ( link )

reference_raw: 'There are many intelligent sensors that take away the (guesswork) soldiers,' said Bruce Baldwin, the main trainer of the United States Army Chemicals School for New Systems.' (Olympian Online, 20 April 2006, Christian Hill)

reference_spacy_tokens: ' There are many intelligent sensors that take away the ( guesswork ) soldiers , ' said Bruce Baldwin , the main trainer of the United States Army Chemicals School for New Systems . ' ( Olympian Online , 20 April 2006 , Christian Hill )


fn_spacy_tokens_for_baseline: Emergency crews said they were hopeful that they would be able to control the fire .

source_bert_toks: emergency crews said they were hopeful that they would be able to control the fire .

reference_raw: The emergency crews said they were hoping to control the fire.

reference_spacy_tokens: The emergency crews said they were hoping to control the fire .


fn_spacy_tokens_for_baseline: The plantation director was standing on an upturned crate that had been placed in position for him beneath the light , and despite the early hour he was already wearing his customary pitch helmet , the sleeves of his bush shirt were rolled high on his brown muscular arms and he was bare - legged in shorts , heavy jungle boots and short thick socks .

source_bert_toks: the plantation director was standing on an up ##turn ##ed crate that had been placed in position for him beneath the light , and despite the early hour he was already wearing his customary pitch helmet , the sleeves of his bush shirt were rolled high on his brown muscular arms and he was bare - legged in shorts , heavy jungle boots and short thick socks .

reference_raw: The plantation director stood on an overturned box, which he had placed under the light, and despite the early hours of his usual pitch helmet, the sleeves of his bush shirt were rolled high on his brown, muscular arms, and he was bare-footed in shorts, heavy jungle boots, and short, thick socks.

reference_spacy_tokens: The plantation director stood on an overturned box , which he had placed under the light , and despite the early hours of his usual pitch helmet , the sleeves of his bush shirt were rolled high on his brown , muscular arms , and he was bare - footed in shorts , heavy jungle boots , and short , thick socks .


fn_spacy_tokens_for_baseline: The article on women 's magazines was spiked .

source_bert_toks: the article on women ' s magazines was spiked .

reference_raw: The article on women's journals has been nailed.

reference_spacy_tokens: The article on women 's journals has been nailed .


fn_spacy_tokens_for_baseline: Ranulf smacked his lips and placed his tankard on the table .

source_bert_toks: ran ##ulf smacked his lips and placed his tank ##ard on the table .

reference_raw: Ranulf slapped his lips and laid his tankard on the table.

reference_spacy_tokens: Ranulf slapped his lips and laid his tankard on the table .


fn_spacy_tokens_for_baseline: This is fulfilled through humbleness and flexibility towards the brothers and the rest of the Muslims , good manners , rejection of disputes , and mutual agreement and settlement of differences . ( TC : Koranic verse ) .

source_bert_toks: this is fulfilled through humble ##ness and flexibility towards the brothers and the rest of the muslims , good manners , rejection of disputes , and mutual agreement and settlement of differences . ( tc : ko ##rani ##c verse ) .

reference_raw: This is achieved through modesty and flexibility vis-à-vis brothers and other Muslims, good manners, denial of disputes, mutual agreement and settlement of differences.

reference_spacy_tokens: This is achieved through modesty and flexibility vis - a - vis brothers and other Muslims , good manners , denial of disputes , mutual agreement and settlement of differences .


fn_spacy_tokens_for_baseline: ' The assessment going into it was that it 's highly unlikely that 's he 's going to be taken alive , but if he decided to lay down his arms , he would have been taken captive .

source_bert_toks: ' the assessment going into it was that it ' s highly unlikely that ' s he ' s going to be taken alive , but if he decided to lay down his arms , he would have been taken captive .

reference_raw: The evaluation was that it was highly unlikely that he would be taken alive, but if he chose to lay down his arms, he would be captured.

reference_spacy_tokens: The evaluation was that it was highly unlikely that he would be taken alive , but if he chose to lay down his arms , he would be captured .


fn_spacy_tokens_for_baseline: Experts in commons legislation do not see how a future purchaser could exploit timber , withdraw public access or charge for access on Newtown Common .

source_bert_toks: experts in commons legislation do not see how a future purchase ##r could exploit timber , withdraw public access or charge for access on newtown common .

reference_raw: Professionals in the field of common law do not understand how the future buyer could use wood, withdraw public access or charge for access to Newtown Common.

reference_spacy_tokens: Professionals in the field of common law do not understand how the future buyer could use wood , withdraw public access or charge for access to Newtown Common .


fn_spacy_tokens_for_baseline: 2 Meanwhile , grill the bacon chops for 3 - 4 minutes on each side , cut into chunks and set aside .

source_bert_toks: 2 meanwhile , grill the bacon chop ##s for 3 - 4 minutes on each side , cut into chunks and set aside .

reference_raw: 2 In the meantime, barbecue the bacon chops for three or four minutes on either side, cut into pieces and set aside.

reference_spacy_tokens: 2 In the meantime , barbecue the bacon chops for three or four minutes on either side , cut into pieces and set aside .


fn_spacy_tokens_for_baseline: Dolphins emit rapid trains of high - pitched clicks , some audible to us , some ultrasonic .

source_bert_toks: dolphins emi ##t rapid trains of high - pitched clicks , some audible to us , some ultra ##sonic .

reference_raw: The dolphins send fast trains with high-pitched snaps, some audible, some ultrasound.

reference_spacy_tokens: The dolphins send fast trains with high - pitched snaps , some audible , some ultrasound .


fn_spacy_tokens_for_baseline: Up to 40 fire engines , buses , coaches and lorries will snake around Darlington in the first vintage rally of its type to be held in the town .

source_bert_toks: up to 40 fire engines , buses , coaches and lo ##rries will snake around darlington in the first vintage rally of its type to be held in the town .

reference_raw: Up to 40 fire engines, buses, coaches, and trucks will be snailing around Darlington at the first vintage rally of its kind that will take place in the city.

reference_spacy_tokens: Up to 40 fire engines , buses , coaches , and trucks will be snailing around Darlington at the first vintage rally of its kind that will take place in the city .


fn_spacy_tokens_for_baseline: Lebed has logged more miles than most candidates , crisscrossing the country with a simple but strong message .

source_bert_toks: le ##bed has logged more miles than most candidates , cr ##iss ##cross ##ing the country with a simple but strong message .

reference_raw: Lebed logged more miles than most candidates and crossed the country with a simple but powerful message.

reference_spacy_tokens: Lebed logged more miles than most candidates and crossed the country with a simple but powerful message .


fn_spacy_tokens_for_baseline: Her working gear comprised an oversized boat - necked T - shirt which had a habit of slipping off one shoulder , frayed denim shorts and flip - flops .

source_bert_toks: her working gear comprised an oversized boat - neck ##ed t - shirt which had a habit of slipping off one shoulder , fray ##ed denim shorts and flip - flop ##s .

reference_raw: Her work gear consisted of a high-necked shirt with a habit of sliding off one shoulder, fraying denim shorts and flip-flops.

reference_spacy_tokens: Her work gear consisted of a high - necked shirt with a habit of sliding off one shoulder , fraying denim shorts and flip - flops .


fn_spacy_tokens_for_baseline: North Korea established a nuclear energy research complex at Yongbyon in 1964 and set up a Soviet research reactor at the site in mid-2002 .

source_bert_toks: north korea established a nuclear energy research complex at yong ##by ##on in 1964 and set up a soviet research reactor at the site in mid - 2002 .

reference_raw: In 1964, North Korea set up a nuclear research complex in Yongbyon and set up a Soviet research plant in mid-2002.

reference_spacy_tokens: In 1964 , North Korea set up a nuclear research complex in Yongbyon and set up a Soviet research plant in mid-2002 .


fn_spacy_tokens_for_baseline: The brown egg struck the wall behind Delaney 's head with a clang and whirled back to bounce on the top of the radio bench .

source_bert_toks: the brown egg struck the wall behind delaney ' s head with a clan ##g and whirled back to bounce on the top of the radio bench .

reference_raw: The brown egg thumped against the wall behind Delaney's head and whirled back to bounce on the top of the radio bench.

reference_spacy_tokens: The brown egg thumped against the wall behind Delaney 's head and whirled back to bounce on the top of the radio bench .


fn_spacy_tokens_for_baseline: She sensed rather than heard the involuntary grunt of pain this movement caused but his voice remained unruffled .

source_bert_toks: she sensed rather than heard the involuntary grunt of pain this movement caused but his voice remained un ##ruff ##led .

reference_raw: She felt, rather than heard, the involuntary grunt of pain that the movement had caused, but his voice remained undisturbed.

reference_spacy_tokens: She felt , rather than heard , the involuntary grunt of pain that the movement had caused , but his voice remained undisturbed .


fn_spacy_tokens_for_baseline: The assessment of need at point of referral will be undertaken by the social worker on duty , or by the Home Help Organiser if a home help is requested .

source_bert_toks: the assessment of need at point of refer ##ral will be undertaken by the social worker on duty , or by the home help organise ##r if a home help is requested .

reference_raw: The evaluation of the need at the place of referral shall be carried out by the social worker on duty or by the home help organiser if home assistance is required.

reference_spacy_tokens: The evaluation of the need at the place of referral shall be carried out by the social worker on duty or by the home help organiser if home assistance is required .


fn_spacy_tokens_for_baseline: She did n't eat much anyway , and looked thin and anorexic , even through her baggy clothes .

source_bert_toks: she didn ' t eat much anyway , and looked thin and an ##ore ##xi ##c , even through her bag ##gy clothes .

reference_raw: She didn't eat much anyway, and she looked thin and anorexic even in her baggy dress.

reference_spacy_tokens: She did n't eat much anyway , and she looked thin and anorexic even in her baggy dress .


fn_spacy_tokens_for_baseline: ' Oh , we 're just having a slurp . '

source_bert_toks: ' oh , we ' re just having a sl ##ur ##p . '

reference_raw: "Oh, we're just drinking."

reference_spacy_tokens: " Oh , we 're just drinking . "


fn_spacy_tokens_for_baseline: The left also is critical of the style of the Socialist government -- a remarkable parallel to the situation in Britain .

source_bert_toks: the left also is critical of the style of the socialist government - - a remarkable parallel to the situation in britain .

reference_raw: The left also criticizes the style of the socialist government - a remarkable similarity to the situation in Britain.

reference_spacy_tokens: The left also criticizes the style of the socialist government - a remarkable similarity to the situation in Britain .


fn_spacy_tokens_for_baseline: Ric himself likes to grow some of the more unusual varieties , such as the Chinese leaf vegetables or mange - tout peas .

source_bert_toks: ric himself likes to grow some of the more unusual varieties , such as the chinese leaf vegetables or man ##ge - to ##ut peas .

reference_raw: Ric himself likes to grow some of the more unusual varieties, such as Chinese leaf vegetables or mange-touched pears.

reference_spacy_tokens: Ric himself likes to grow some of the more unusual varieties , such as Chinese leaf vegetables or mange - touched pears .


fn_spacy_tokens_for_baseline: Methane from the sewage treatment plant in Amsterdam East may be used similarly and the biological residue will be reprocessed into compost for farms and gardens .

source_bert_toks: methane from the sewage treatment plant in amsterdam east may be used similarly and the biological residue will be rep ##ro ##ces ##sed into com ##post for farms and gardens .

reference_raw: Methane from the waste water treatment plant in the east of Amsterdam can be used in the same way and the bioresidue will be converted into compost for farms and gardens.

reference_spacy_tokens: Methane from the waste water treatment plant in the east of Amsterdam can be used in the same way and the bioresidue will be converted into compost for farms and gardens .


fn_spacy_tokens_for_baseline: The sub - contractor will normally make a request for interim payment and raise a tax invoice for VAT purposes on completion of the work .

source_bert_toks: the sub - contractor will normally make a request for interim payment and raise a tax in ##vo ##ice for va ##t purposes on completion of the work .

reference_raw: When the work is completed, the subcontractor will normally submit an application for interim payment and raise a tax invoice for VAT purposes.

reference_spacy_tokens: When the work is completed , the subcontractor will normally submit an application for interim payment and raise a tax invoice for VAT purposes .


fn_spacy_tokens_for_baseline: ' December , which should have been awful , was almost hectic in some places , ' Hill says .

source_bert_toks: ' december , which should have been awful , was almost he ##ctic in some places , ' hill says .

reference_raw: 'December, which was supposed to be terrible, was almost hectical in some places,' Hill says.

reference_spacy_tokens: ' December , which was supposed to be terrible , was almost hectical in some places , ' Hill says .


fn_spacy_tokens_for_baseline: ' One day we 'll visit America , ' murmured David , holding her close .

source_bert_toks: ' one day we ' ll visit america , ' murmured david , holding her close .

reference_raw: "We'll visit America one day," David whispered, holding her close.

reference_spacy_tokens: " We 'll visit America one day , " David whispered , holding her close .


fn_spacy_tokens_for_baseline: ' How bright those fires shine in the darkness !

source_bert_toks: ' how bright those fires shine in the darkness !

reference_raw: 'How bright those fires are in the dark!

reference_spacy_tokens: ' How bright those fires are in the dark !


fn_spacy_tokens_for_baseline: We read of Wellington 's distress at the terrible losses at Badajoz echoed in later years at Waterloo .

source_bert_toks: we read of wellington ' s distress at the terrible losses at bad ##aj ##oz echoed in later years at waterloo .

reference_raw: We read about Wellington's anxiety at the terrible loss of Badajoz echoed in Waterloo in later years.

reference_spacy_tokens: We read about Wellington 's anxiety at the terrible loss of Badajoz echoed in Waterloo in later years .


fn_spacy_tokens_for_baseline: This seems , however , to be a rather weak attempt to soften the harshness of the saying .

source_bert_toks: this seems , however , to be a rather weak attempt to soft ##en the harsh ##ness of the saying .

reference_raw: But this seems to be a rather small attempt to soften the harshness of the saying.

reference_spacy_tokens: But this seems to be a rather small attempt to soften the harshness of the saying .


fn_spacy_tokens_for_baseline: The party reiterated its opposition to the state treaty on German economic and monetary union and opposed premature all - German elections .

source_bert_toks: the party reiterated its opposition to the state treaty on german economic and monetary union and opposed premature all - german elections .

reference_raw: The party reaffirmed its opposition to the State Treaty on the German Economic and Monetary Union and opposed early German elections.

reference_spacy_tokens: The party reaffirmed its opposition to the State Treaty on the German Economic and Monetary Union and opposed early German elections .


fn_spacy_tokens_for_baseline: TEHRAN Police on Saturday arrested dozens of militants who smashed their way into university dormitories and beat up sleeping students in a wave of violence aimed at putting down protests against Iran 's Islamic government .

source_bert_toks: tehran police on saturday arrested dozens of militants who smashed their way into university dorm ##itor ##ies and beat up sleeping students in a wave of violence aimed at putting down protests against iran ' s islamic government .

reference_raw: On Saturday, the TEHRAN police arrested dozens of militants who broke into college dormitories and beat up sleeping students in a wave of violence aimed at suppressing opposition to the Islamic Government of Iran.

reference_spacy_tokens: On Saturday , the TEHRAN police arrested dozens of militants who broke into college dormitories and beat up sleeping students in a wave of violence aimed at suppressing opposition to the Islamic Government of Iran .


fn_spacy_tokens_for_baseline: Building upon the foundations established during the war , Iran 's missile and long - range artillery rocket programs were reorganized during the late 1980s and have developed along two broad paths -- solid - fueled and liquid - fueled systems .

source_bert_toks: building upon the foundations established during the war , iran ' s missile and long - range artillery rocket programs were reorganized during the late 1980s and have developed along two broad paths - - solid - fueled and liquid - fueled systems .

reference_raw: On the basis of the foundations set up during the war, Iran's missile and long-range artillery rocket programs were reorganized in the late 1980s and developed on two broad paths - solid - fuelled and liquid - fuelled systems.

reference_spacy_tokens: On the basis of the foundations set up during the war , Iran 's missile and long - range artillery rocket programs were reorganized in the late 1980s and developed on two broad paths - solid - fuelled and liquid - fuelled systems .


fn_spacy_tokens_for_baseline: The President turned pale , vomited into the lap of Miyazawa and then collapsed to the floor .

source_bert_toks: the president turned pale , vomit ##ed into the lap of mi ##ya ##zawa and then collapsed to the floor .

reference_raw: The President turned pale, threw up in Miyazawa's lap, then collapsed to the floor.

reference_spacy_tokens: The President turned pale , threw up in Miyazawa 's lap , then collapsed to the floor .


fn_spacy_tokens_for_baseline: The Soviet Union , traditionally an ally of Iraq , had also indicated an interest in cooperating with Iran .

source_bert_toks: the soviet union , traditionally an ally of iraq , had also indicated an interest in cooper ##ating with iran .

reference_raw: The Soviet Union, traditionally Iraq's ally, has also expressed an interest in co-operation with Iran.

reference_spacy_tokens: The Soviet Union , traditionally Iraq 's ally , has also expressed an interest in co - operation with Iran .


fn_spacy_tokens_for_baseline: DEC /Fujitsu discussions are now rumoured as ' over ' -- Fujitsu is not dumping Sparc , but would have loved to go to Alpha instead -- two to three years ago .

source_bert_toks: dec / fuji ##tsu discussions are now rum ##oured as ' over ' - - fuji ##tsu is not dumping spa ##rc , but would have loved to go to alpha instead - - two to three years ago .

reference_raw: DEC/Fujitsu talks are now said to be 'over' - Fujitsu doesn't dump Sparc, but he'd like to go to Alpha instead - two or three years ago.

reference_spacy_tokens: DEC / Fujitsu talks are now said to be ' over ' - Fujitsu does n't dump Sparc , but he 'd like to go to Alpha instead - two or three years ago .


fn_spacy_tokens_for_baseline: ' I 'm glad for you , my lord , but I expect that as you 're so rich you could have had any woman you wanted .

source_bert_toks: ' i ' m glad for you , my lord , but i expect that as you ' re so rich you could have had any woman you wanted .

reference_raw: 'I'm happy for you, sir, but I suppose, since you're so rich, you can have any woman you want.

reference_spacy_tokens: ' I 'm happy for you , sir , but I suppose , since you 're so rich , you can have any woman you want .


fn_spacy_tokens_for_baseline: Chrysler 's vice - president of Internal Operations , Joey Cappy , claims Chrysler is in a " strong cash position " and will spend £ 8.25 billion on new products over the next five years .

source_bert_toks: chrysler ' s vice - president of internal operations , joey cap ##py , claims chrysler is in a " strong cash position " and will spend £ ##8 . 25 billion on new products over the next five years .

reference_raw: Chrysler's vice president of internal operations, Joey Cappy, claims that Chrysler is in a "strong cash position" and will spend £8.25 billion on new products for the next five years.

reference_spacy_tokens: Chrysler 's vice president of internal operations , Joey Cappy , claims that Chrysler is in a " strong cash position " and will spend £ 8.25 billion on new products for the next five years .


fn_spacy_tokens_for_baseline: The wall lights in the great stone walls were bedecked with pink silk shades .

source_bert_toks: the wall lights in the great stone walls were bed ##eck ##ed with pink silk shades .

reference_raw: The lights of the walls of the great stone walls were bedded with pink silk.

reference_spacy_tokens: The lights of the walls of the great stone walls were bedded with pink silk .


fn_spacy_tokens_for_baseline: Thus opponents of the ordination of women might plausibly say ( as Barth would seem to ) that fundamental to the scripture is male headship .

source_bert_toks: thus opponents of the ordination of women might pl ##aus ##ibly say ( as bart ##h would seem to ) that fundamental to the scripture is male heads ##hip .

reference_raw: Thus, adversaries of women's order could reasonably claim (as Barth seems) that the basic element of the scripture is male leadership.

reference_spacy_tokens: Thus , adversaries of women 's order could reasonably claim ( as Barth seems ) that the basic element of the scripture is male leadership .


fn_spacy_tokens_for_baseline: In the early Middle Ages , Canton had a significant Muslim population as a result of its trade with the Middle East .

source_bert_toks: in the early middle ages , canton had a significant muslim population as a result of its trade with the middle east .

reference_raw: In the early Middle Ages, due to its trade with the Middle East, Canton had a sizeable Moslem population.

reference_spacy_tokens: In the early Middle Ages , due to its trade with the Middle East , Canton had a sizeable Moslem population .


fn_spacy_tokens_for_baseline: The choice of research topic is not made in a vacuum , but is influenced both by the researcher and by the context in which the research is to be done .

source_bert_toks: the choice of research topic is not made in a vacuum , but is influenced both by the researcher and by the context in which the research is to be done .

reference_raw: The choice of the subject of research is not made in a vacuum, but is influenced both by the researcher and by the context in which the research is to be carried out.

reference_spacy_tokens: The choice of the subject of research is not made in a vacuum , but is influenced both by the researcher and by the context in which the research is to be carried out .


fn_spacy_tokens_for_baseline: And there was her key , its gun - metal grey shaft rusted brown but the handle still gleaming .

source_bert_toks: and there was her key , its gun - metal grey shaft rust ##ed brown but the handle still gleaming .

reference_raw: And there was the key, the gray shaft of the gun-metal rusty brown, but the handle still gleamed.

reference_spacy_tokens: And there was the key , the gray shaft of the gun - metal rusty brown , but the handle still gleamed .


fn_spacy_tokens_for_baseline: yeah something to cover them and keep them warm

reference_raw: yeah something to cover them up and keep them hot


fn_spacy_tokens_for_baseline: A BOY was ' almost killed ' after being savaged by a rottweiler while playing with his pals in the street .

source_bert_toks: a boy was ' almost killed ' after being savage ##d by a rot ##t ##weiler while playing with his pal ##s in the street .

reference_raw: The boy was "almost killed" after being savaged by a rottweiler while playing with his friends on the street.

reference_spacy_tokens: The boy was " almost killed " after being savaged by a rottweiler while playing with his friends on the street .


fn_spacy_tokens_for_baseline: He unfastened the laces of his coat and yawned .

source_bert_toks: he un ##fast ##ened the lace ##s of his coat and yawned .

reference_raw: He unbuttoned his coat and yawned.

reference_spacy_tokens: He unbuttoned his coat and yawned .


fn_spacy_tokens_for_baseline: Page 40 tells you more about the lively village and things to do there -- yacht instruction , windsurf holidays , casual sailing , child ' Minders ' and so on .

source_bert_toks: page 40 tells you more about the lively village and things to do there - - yacht instruction , winds ##ur ##f holidays , casual sailing , child ' mind ##ers ' and so on .

reference_raw: Page 40 tells you more about the living village and what to do there - yacht instructions, windsurf holidays, casual sailing, baby "minders" and so on.

reference_spacy_tokens: Page 40 tells you more about the living village and what to do there - yacht instructions , windsurf holidays , casual sailing , baby " minders " and so on .


fn_spacy_tokens_for_baseline: Sharpe urged his horse down the rutted lane that dropped into a shallow valley before climbing between two unhedged pastures .

source_bert_toks: sharpe urged his horse down the ru ##tted lane that dropped into a shallow valley before climbing between two un ##hed ##ged pastures .

reference_raw: Sharpe urged his horse down a rutted lane that fell into a shallow valley before climbing between two unhedged pastures.

reference_spacy_tokens: Sharpe urged his horse down a rutted lane that fell into a shallow valley before climbing between two unhedged pastures .


fn_spacy_tokens_for_baseline: For the most part , the book consists of a rewriting of history , from the dawn of time , with the purpose of demonstrating two main themes : the " fact " that women were responsible for all the important contributions to the advancement of civilization ( as the development of agriculture , for instance ) , often despite the arrogance and stupidity of men ; and the " fact " that women have long been subjected to domination by men .

source_bert_toks: for the most part , the book consists of a re ##writing of history , from the dawn of time , with the purpose of demonstrating two main themes : the " fact " that women were responsible for all the important contributions to the advancement of civilization ( as the development of agriculture , for instance ) , often despite the arrogance and stupidity of men ; and the " fact " that women have long been subjected to domination by men .

reference_raw: The book consists, to a large extent, of a rewrite of the past since the beginning of time, in order to demonstrate two main themes: the fact that women are responsible for all the important contributions to the development of civilization (for example, the development of agriculture), often in spite of the arrogance and stupidity of men, and the fact that women have long been under the control of men.

reference_spacy_tokens: The book consists , to a large extent , of a rewrite of the past since the beginning of time , in order to demonstrate two main themes : the fact that women are responsible for all the important contributions to the development of civilization ( for example , the development of agriculture ) , often in spite of the arrogance and stupidity of men , and the fact that women have long been under the control of men .


fn_spacy_tokens_for_baseline: The daughter of an Indian labourer , Mrs Swami was deserted by her husband and had to support four children on her own .

source_bert_toks: the daughter of an indian labour ##er , mrs swami was deserted by her husband and had to support four children on her own .

reference_raw: The daughter of an Indian worker, Mrs. Swami, had been abandoned by her husband and had to support four children alone.

reference_spacy_tokens: The daughter of an Indian worker , Mrs. Swami , had been abandoned by her husband and had to support four children alone .


fn_spacy_tokens_for_baseline: Such issues can only be resolved at local level .

source_bert_toks: such issues can only be resolved at local level .

reference_raw: These issues can only be addressed at local level.

reference_spacy_tokens: These issues can only be addressed at local level .


fn_spacy_tokens_for_baseline: As it happened , the entire episode was resolved after The Smiths decided to repoen communications with the label and a somewhat confused Easterhouse were invited back on to the Scottish tour .

source_bert_toks: as it happened , the entire episode was resolved after the smith ##s decided to rep ##oe ##n communications with the label and a somewhat confused easter ##house were invited back on to the scottish tour .

reference_raw: As it happened, the whole episode had been resolved after the Smiths had decided to repeat the communication with the label, and the somewhat confused Easterhouse had been invited back to the Scottish tour.

reference_spacy_tokens: As it happened , the whole episode had been resolved after the Smiths had decided to repeat the communication with the label , and the somewhat confused Easterhouse had been invited back to the Scottish tour .


fn_spacy_tokens_for_baseline: I do n't handle stolen property , and damn you for suggesting I do !

source_bert_toks: i don ' t handle stolen property , and damn you for suggesting i do !

reference_raw: I'm not dealing with stolen property, and to hell with you for implying that I am!

reference_spacy_tokens: I 'm not dealing with stolen property , and to hell with you for implying that I am !


fn_spacy_tokens_for_baseline: The new father will by that time have realized more fully the extent of his wife 's preoccupation with the baby and resent its unexpected effects on their relationship .

source_bert_toks: the new father will by that time have realized more fully the extent of his wife ' s pre ##oc ##cup ##ation with the baby and res ##ent its unexpected effects on their relationship .

reference_raw: By that time, the new father would be more aware of the extent of his wife's involvement with the child, and would not like its unexpected effect on their relationship.

reference_spacy_tokens: By that time , the new father would be more aware of the extent of his wife 's involvement with the child , and would not like its unexpected effect on their relationship .


fn_spacy_tokens_for_baseline: Partly as a result of the shortcomings in the Nuclear Non - Proliferation Treaty ( NPT ) safeguards system -- which allowed the rapid development of the Iraqi nuclear program in the 1970s and North Korea 's in the 1990s to go largely undetected -- and partly by assessing Iran 's intentions , the international community and the International Atomic Energy Agency ( IAEA ) have increased their scrutiny of Iran 's activities over the last several years .

source_bert_toks: partly as a result of the short ##coming ##s in the nuclear non - proliferation treaty ( np ##t ) safeguard ##s system - - which allowed the rapid development of the iraqi nuclear program in the 1970s and north korea ' s in the 1990s to go largely und ##ete ##cted - - and partly by assessing iran ' s intentions , the international community and the international atomic energy agency ( ia ##ea ) have increased their scrutiny of iran ' s activities over the last several years .

reference_raw: Partly due to shortcomings in the Nuclear Non-Proliferation Treaty (NPT) safeguards system, which enabled the rapid development of the Iraqi nuclear programme in the 1970s and the 1990s to be largely undetected, and partly through the assessment of Iran's intentions, the international community and the International Atomic Energy Agency (IAEA) have increased their control over Iran's activities over the past few years.

reference_spacy_tokens: Partly due to shortcomings in the Nuclear Non - Proliferation Treaty ( NPT ) safeguards system , which enabled the rapid development of the Iraqi nuclear programme in the 1970s and the 1990s to be largely undetected , and partly through the assessment of Iran 's intentions , the international community and the International Atomic Energy Agency ( IAEA ) have increased their control over Iran 's activities over the past few years .


fn_spacy_tokens_for_baseline: Even his kindness was repellent .

source_bert_toks: even his kindness was rep ##elle ##nt .

reference_raw: Even his kindness was repulsive.

reference_spacy_tokens: Even his kindness was repulsive .


fn_spacy_tokens_for_baseline: At least 76 people were injured , and others were buried in the rubble .

source_bert_toks: at least 76 people were injured , and others were buried in the rubble .

reference_raw: At least 76 people have been wounded, and more have been dumped in the rubble.

reference_spacy_tokens: At least 76 people have been wounded , and more have been dumped in the rubble .


fn_spacy_tokens_for_baseline: Reports speculate Iran may be developing centrifuge facilities to enrich uranium at sites such as Moallem Kalayah and Karaj ; however , those providing the reports left during the reign of former Shah Reza Pahlavi .

source_bert_toks: reports spec ##ulate iran may be developing cent ##ri ##fu ##ge facilities to en ##rich uranium at sites such as mo ##alle ##m kala ##yah and kara ##j ; however , those providing the reports left during the reign of former shah reza pa ##hl ##avi .

reference_raw: Reports speculate that Iran may be developing centrifuge facilities for uranium enrichment in locations such as Moallem Kalayah and Karaj; however, those that provide the reports that remained during the reign of the former Shah Reza Pahlavi.

reference_spacy_tokens: Reports speculate that Iran may be developing centrifuge facilities for uranium enrichment in locations such as Moallem Kalayah and Karaj ; however , those that provide the reports that remained during the reign of the former Shah Reza Pahlavi .


fn_spacy_tokens_for_baseline: anything else you wanted to add

source_bert_toks: anything else you wanted to add

reference_raw: anything else you'd like to say

reference_spacy_tokens: anything else you 'd like to say


fn_spacy_tokens_for_baseline: Standing in their midst , beaming out at the camera , her arms linked with two guests , was the plump figure of Madame Melasse , the former proprietress .

source_bert_toks: standing in their midst , beaming out at the camera , her arms linked with two guests , was the plump figure of madame mel ##asse , the former prop ##rie ##tres ##s .

reference_raw: Standing between them, beaming at the camera, her hands connected to two guests, was Madame Melasse's pudgy figure, the former owner.

reference_spacy_tokens: Standing between them , beaming at the camera , her hands connected to two guests , was Madame Melasse 's pudgy figure , the former owner .


fn_spacy_tokens_for_baseline: A magnificent crowd of 83 witnessed the ceremony , 32 of them staying for the match .

source_bert_toks: a magnificent crowd of 83 witnessed the ceremony , 32 of them staying for the match .

reference_raw: The ceremony was witnessed by a magnificent mob of 83, 32 of them staying for the game.

reference_spacy_tokens: The ceremony was witnessed by a magnificent mob of 83 , 32 of them staying for the game .


fn_spacy_tokens_for_baseline: Michael Newman argues that the Labour party adopted the view that fascism only emerged where parliamentary democracy was not well established .

source_bert_toks: michael newman argues that the labour party adopted the view that fascism only emerged where parliamentary democracy was not well established .

reference_raw: According to Michael Newman, the Labour Party took the view that fascism only appeared when parliamentary democracy was not well established.

reference_spacy_tokens: According to Michael Newman , the Labour Party took the view that fascism only appeared when parliamentary democracy was not well established .


fn_spacy_tokens_for_baseline: As a multi - lingual movement the human rights message can be conveyed via dozens of reports , books and audio - visual materials to audiences from Japan to Nigeria .

source_bert_toks: as a multi - ling ##ual movement the human rights message can be conveyed via dozens of reports , books and audio - visual materials to audiences from japan to nigeria .

reference_raw: As a multilingual movement, human rights messages can be transmitted to audiences from Japan to Nigeria through dozens of reports, books and audiovisual material.

reference_spacy_tokens: As a multilingual movement , human rights messages can be transmitted to audiences from Japan to Nigeria through dozens of reports , books and audiovisual material .


fn_spacy_tokens_for_baseline: His half - brother had been called in to act as best man in place of his real brother who had vanished to Spain .

source_bert_toks: his half - brother had been called in to act as best man in place of his real brother who had vanished to spain .

reference_raw: His half-brother had been summoned to act as a witness instead of his true brother, who had disappeared into Spain.

reference_spacy_tokens: His half - brother had been summoned to act as a witness instead of his true brother , who had disappeared into Spain .


fn_spacy_tokens_for_baseline: We may put aside this idea of Baynes 's that Garcia 's servants were concerned in the matter .

source_bert_toks: we may put aside this idea of bay ##nes ' s that garcia ' s servants were concerned in the matter .

reference_raw: We can put aside the thought of Baynes that Garcia's servants were worried about this.

reference_spacy_tokens: We can put aside the thought of Baynes that Garcia 's servants were worried about this .


fn_spacy_tokens_for_baseline: All in all , for a relatively primitive system , it is not too bad ; but you would have to be in love with your computer to use it in preference to a far more complete books of synonyms available ( especially The Synonym Finder , Rodale in the U.S. and Canada , Longman elsewhere , which offers more than 800,000 synonyms , more than three times the number listed in any other synonym book ) .

source_bert_toks: all in all , for a relatively primitive system , it is not too bad ; but you would have to be in love with your computer to use it in preference to a far more complete books of synonym ##s available ( especially the synonym find ##er , rod ##ale in the u . s . and canada , long ##man elsewhere , which offers more than 800 , 000 synonym ##s , more than three times the number listed in any other synonym book ) .

reference_raw: On the whole, for a relatively primitive system, it's not that bad; but you'd have to love your computer to use it instead of a much more complete book of synonyms available (in particular, the Synonym Finder, Rodale in the United States and Canada, Longman elsewhere, offering more than 800,000 synonyms, more than three times as many as those in any other synonym book).

reference_spacy_tokens: On the whole , for a relatively primitive system , it 's not that bad ; but you 'd have to love your computer to use it instead of a much more complete book of synonyms available ( in particular , the Synonym Finder , Rodale in the United States and Canada , Longman elsewhere , offering more than 800,000 synonyms , more than three times as many as those in any other synonym book ) .


fn_spacy_tokens_for_baseline: His hands were manacled behind his back except when he ate or slept .

source_bert_toks: his hands were mana ##cle ##d behind his back except when he ate or slept .

reference_raw: His hands were handcuffed behind his back, except when he ate or slept.

reference_spacy_tokens: His hands were handcuffed behind his back , except when he ate or slept .


fn_spacy_tokens_for_baseline: ' You 're a quiet'un .

source_bert_toks: ' you ' re a quiet ' un .

reference_raw: 'You are silent'un.

reference_spacy_tokens: ' You are silent'un .


fn_spacy_tokens_for_baseline: She 's absolutely wonderful with the children .

source_bert_toks: she ' s absolutely wonderful with the children .

reference_raw: She's absolutely gorgeous with kids.

reference_spacy_tokens: She 's absolutely gorgeous with kids .


fn_spacy_tokens_for_baseline: Niki had his way -- in part -- and the engine was tried out in the last four races of 1983 : with mixed results .

source_bert_toks: nik ##i had his way - - in part - - and the engine was tried out in the last four races of 1983 : with mixed results .

reference_raw: Niki had his way - partly - and the engine had been tested in the last four races of 1983: mixed results.

reference_spacy_tokens: Niki had his way - partly - and the engine had been tested in the last four races of 1983 : mixed results .


fn_spacy_tokens_for_baseline: This has the advantage of apparently allowing storage of digested slurries without regeneration of offensive odours .

source_bert_toks: this has the advantage of apparently allowing storage of digest ##ed sl ##ur ##ries without regeneration of offensive o ##dou ##rs .

reference_raw: This has the advantage of apparently allowing the storage of digested slurries without the regeneration of insulting odors.

reference_spacy_tokens: This has the advantage of apparently allowing the storage of digested slurries without the regeneration of insulting odors .


fn_spacy_tokens_for_baseline: Two French ships were waiting at Montrose .

source_bert_toks: two french ships were waiting at montrose .

reference_raw: Two French ships awaited him in Montrose.

reference_spacy_tokens: Two French ships awaited him in Montrose .


fn_spacy_tokens_for_baseline: Among the ponds is one inhabited by turtles : Visitors toss in coins in the hope of bouncing one off a turtle 's head , a sure way of achieving good fortune .

source_bert_toks: among the ponds is one inhabited by turtles : visitors toss in coins in the hope of bouncing one off a turtle ' s head , a sure way of achieving good fortune .

reference_raw: There is one inhabited by tortoises among the ponds: Visitors throw coins in the hope of bouncing one off the head of a tortoise, a sure means of happiness.

reference_spacy_tokens: There is one inhabited by tortoises among the ponds : Visitors throw coins in the hope of bouncing one off the head of a tortoise , a sure means of happiness .


fn_spacy_tokens_for_baseline: But I enjoy knowing that the first sun in the world will warm you here in these islands .

source_bert_toks: but i enjoy knowing that the first sun in the world will warm you here in these islands .

reference_raw: But I like to know that the world's first sun will heat you up here on these islands.

reference_spacy_tokens: But I like to know that the world 's first sun will heat you up here on these islands .


fn_spacy_tokens_for_baseline: Leon hauled the heavy album from its position .

source_bert_toks: leon hauled the heavy album from its position .

reference_raw: Leon pulled the heavy album out of place.

reference_spacy_tokens: Leon pulled the heavy album out of place .


fn_spacy_tokens_for_baseline: Even during the recession , trade has grown through keen pricing and friendly personal service .

source_bert_toks: even during the recession , trade has grown through keen pricing and friendly personal service .

reference_raw: Even during the recession, trade grew with high prices and accommodating personal services.

reference_spacy_tokens: Even during the recession , trade grew with high prices and accommodating personal services .


fn_spacy_tokens_for_baseline: At first the track was lined with bright terraces of beehives , their owners in makeshift tents busily extracting the honey for which Thassos is famous .

source_bert_toks: at first the track was lined with bright terraces of bee ##hi ##ves , their owners in makeshift tents bus ##ily extract ##ing the honey for which tha ##sso ##s is famous .

reference_raw: At first, the track was lined with bright beehive terraces, and the owners of the makeshift tents were busy picking up the gold that Thassos was famous for.

reference_spacy_tokens: At first , the track was lined with bright beehive terraces , and the owners of the makeshift tents were busy picking up the gold that Thassos was famous for .


fn_spacy_tokens_for_baseline: That you 're not sort of , Oh just I 'll memorize this lot .

source_bert_toks: that you ' re not sort of , oh just i ' ll memo ##rize this lot .

reference_raw: That you're not a little, Oh, I'm just gonna remember this lot.

reference_spacy_tokens: That you 're not a little , Oh , I 'm just gon na remember this lot .


fn_spacy_tokens_for_baseline: Both those statements were momentous for the Royal Family but the historical impact of Charles and Diana 's separation is likely to be greater .

source_bert_toks: both those statements were moment ##ous for the royal family but the historical impact of charles and diana ' s separation is likely to be greater .

reference_raw: Both were important to the royal family, but the historical impact of Charles and Diana's segregation is likely to be greater.

reference_spacy_tokens: Both were important to the royal family , but the historical impact of Charles and Diana 's segregation is likely to be greater .


fn_spacy_tokens_for_baseline: The Brigadier had heard the faint tinkle of sheepbells and the distant bark of the younger dog .

source_bert_toks: the brigadier had heard the faint tin ##kle of sheep ##bell ##s and the distant bark of the younger dog .

reference_raw: The brigadier could hear the faint tingling of sheep bells and the distant barking of a young dog.

reference_spacy_tokens: The brigadier could hear the faint tingling of sheep bells and the distant barking of a young dog .


fn_spacy_tokens_for_baseline: Hundreds of others had tried to design metal skis but had failed .

source_bert_toks: hundreds of others had tried to design metal ski ##s but had failed .

reference_raw: Hundreds of others tried to design metal skis, but it didn't work.

reference_spacy_tokens: Hundreds of others tried to design metal skis , but it did n't work .


fn_spacy_tokens_for_baseline: Rune had already demonstrated to her that he was far from cold - blooded .

source_bert_toks: rune had already demonstrated to her that he was far from cold - blooded .

reference_raw: Rune had already shown her that he was far from cold-blooded.

reference_spacy_tokens: Rune had already shown her that he was far from cold - blooded .


fn_spacy_tokens_for_baseline: Consequently a great deal of fulling , spinning , weaving and dyeing was carried out at domestic level , with plants probably being deliberately cultivated to provide dyes .

source_bert_toks: consequently a great deal of full ##ing , spinning , weaving and dye ##ing was carried out at domestic level , with plants probably being deliberately cultivated to provide dye ##s .

reference_raw: As a result, large quantities of filling, spinning, weaving and dyeing have been carried out at national level, and plants are likely to be intentionally grown to produce dyes.

reference_spacy_tokens: As a result , large quantities of filling , spinning , weaving and dyeing have been carried out at national level , and plants are likely to be intentionally grown to produce dyes .


fn_spacy_tokens_for_baseline: There was a pile of really filthy - looking blankets on the bed , they got me some sheets and a towel , and I managed to get an extra pillow because of my asthma .

source_bert_toks: there was a pile of really filthy - looking blankets on the bed , they got me some sheets and a towel , and i managed to get an extra pillow because of my asthma .

reference_raw: There were a bunch of really dirty-looking blankets on the bed, and they gave me some blankets and a towel, and I was able to get an extra pillow for my asthma.

reference_spacy_tokens: There were a bunch of really dirty - looking blankets on the bed , and they gave me some blankets and a towel , and I was able to get an extra pillow for my asthma .


fn_spacy_tokens_for_baseline: For himself he built a hotel on the corner of the ancient Coal Road West Auckland Road and called it the Alma .

source_bert_toks: for himself he built a hotel on the corner of the ancient coal road west auckland road and called it the alma .

reference_raw: He built himself a motel on the corner of the old Coal Road West Auckland Road and called it Alma.

reference_spacy_tokens: He built himself a motel on the corner of the old Coal Road West Auckland Road and called it Alma .


fn_spacy_tokens_for_baseline: There were only shelves and drawers in the Nannie cupboard , so she was obliged to hang it by the loops of its sash from a hook on the back of the door .

source_bert_toks: there were only shelves and drawers in the nan ##nie cupboard , so she was obliged to hang it by the loops of its sash from a hook on the back of the door .

reference_raw: There were only shelves and drawers in Nannie's closet, so she had to put it on a hook at the back of the door with the loops of her sash.

reference_spacy_tokens: There were only shelves and drawers in Nannie 's closet , so she had to put it on a hook at the back of the door with the loops of her sash .


fn_spacy_tokens_for_baseline: ' You have endured ordeal , Cadets , ' rumbled the Sergeant .

source_bert_toks: ' you have endured ordeal , cadets , ' rumbled the sergeant .

reference_raw: 'You've endured suffering, Cadets,' the sergeant growled.

reference_spacy_tokens: ' You 've endured suffering , Cadets , ' the sergeant growled .


fn_spacy_tokens_for_baseline: There was one with a monkey in too , crammed in this little shell with the side cut away so you could see in .

source_bert_toks: there was one with a monkey in too , cr ##ammed in this little shell with the side cut away so you could see in .

reference_raw: There was one with a monkey in it, stuffed in a small shell with a side cut off so you could see inside.

reference_spacy_tokens: There was one with a monkey in it , stuffed in a small shell with a side cut off so you could see inside .


fn_spacy_tokens_for_baseline: Brandishing a handgun , he forced the 23-year - old boyfriend into the boot , where he bound and gagged him before dragging the terrified woman into his own vehicle .

source_bert_toks: brand ##ishing a handgun , he forced the 23 - year - old boyfriend into the boot , where he bound and gag ##ged him before dragging the terrified woman into his own vehicle .

reference_raw: He brandished his gun and forced his twenty-three-year-old friend into his shoe, where he bound it and gagged it before dragging the frightened woman into his car.

reference_spacy_tokens: He brandished his gun and forced his twenty - three - year - old friend into his shoe , where he bound it and gagged it before dragging the frightened woman into his car .


fn_spacy_tokens_for_baseline: Somewhere high up in the cloudless sky , hidden by the leafy canopy , an aeroplane droned lazily , the sound mirrored closer at hand by the drowsy noise of insects .

source_bert_toks: somewhere high up in the cloud ##less sky , hidden by the leaf ##y canopy , an aero ##plane drone ##d la ##zily , the sound mirrored closer at hand by the dr ##ows ##y noise of insects .

reference_raw: Somewhere high in the cloudless sky, hidden by a leafy canopy, the aircraft drooled lazily, the sound more closely mirrored by the sleepy sound of insects.

reference_spacy_tokens: Somewhere high in the cloudless sky , hidden by a leafy canopy , the aircraft drooled lazily , the sound more closely mirrored by the sleepy sound of insects .


fn_spacy_tokens_for_baseline: The wardrobe had provided her with a vest of padded cotton , but for some reason she would n't wear it .

source_bert_toks: the wardrobe had provided her with a vest of padded cotton , but for some reason she wouldn ' t wear it .

reference_raw: The closet provided her with a coat of stuffed cotton, but for some reason she didn't want to wear it.

reference_spacy_tokens: The closet provided her with a coat of stuffed cotton , but for some reason she did n't want to wear it .


fn_spacy_tokens_for_baseline: In early 1905 , the route between Los Angeles and Salt Lake City was completed , and train tracks bore right down the center of the Las Vegas Valley .

source_bert_toks: in early 1905 , the route between los angeles and salt lake city was completed , and train tracks bore right down the center of the las vegas valley .

reference_raw: The route between L.A. and Salt Lake City was completed at the beginning of 1905, and the train tracks were in the middle of the Las Vegas Valley.

reference_spacy_tokens: The route between L.A. and Salt Lake City was completed at the beginning of 1905 , and the train tracks were in the middle of the Las Vegas Valley .


fn_spacy_tokens_for_baseline: The total work force equals 150 , it was noted that the workers all looked rather miserable and depressed and the working atmosphere was not at all pleasant .

source_bert_toks: the total work force equals 150 , it was noted that the workers all looked rather miserable and depressed and the working atmosphere was not at all pleasant .

reference_raw: The total number of workers was 150, it was noted that all workers looked rather unhappy and depressed, and the working environment was not comfortable at all.

reference_spacy_tokens: The total number of workers was 150 , it was noted that all workers looked rather unhappy and depressed , and the working environment was not comfortable at all .


fn_spacy_tokens_for_baseline: They had arrived during his absence and he had scanned them quickly .

source_bert_toks: they had arrived during his absence and he had scanned them quickly .

reference_raw: They arrived in his absence, and he examined them quickly.

reference_spacy_tokens: They arrived in his absence , and he examined them quickly .


fn_spacy_tokens_for_baseline: Two important oil discoveries in the Espinal block , Purificacion and Venganza , will be appraised in 1992 .

source_bert_toks: two important oil discoveries in the es ##pina ##l block , pu ##ri ##fi ##ca ##cion and ve ##nga ##nza , will be app ##rai ##sed in 1992 .

reference_raw: The two major oil findings in the Espinal block, Purification and Venganza, will be assessed in 1992.

reference_spacy_tokens: The two major oil findings in the Espinal block , Purification and Venganza , will be assessed in 1992 .


fn_spacy_tokens_for_baseline: Divide the mixture between the tins and bake in a preheated oven at 350F/175C / gas 4 for 20 - 25 minutes .

source_bert_toks: divide the mixture between the tin ##s and ba ##ke in a pre ##hea ##ted oven at 350 ##f / 175 ##c / gas 4 for 20 - 25 minutes .

reference_raw: Split the mixture between cans and bake in a preheated oven at 350F/175C/gas 4 for 20 to 25 minutes.

reference_spacy_tokens: Split the mixture between cans and bake in a preheated oven at 350F/175C / gas 4 for 20 to 25 minutes .


fn_spacy_tokens_for_baseline: Choosing a black over a better - qualified white is still racial preference , even if they both are " qualified " in the absolute sense .

source_bert_toks: choosing a black over a better - qualified white is still racial preference , even if they both are " qualified " in the absolute sense .

reference_raw: Choosing a black over a better-qualified white is still a racial preference, even if both are "qualified" in absolute terms.

reference_spacy_tokens: Choosing a black over a better - qualified white is still a racial preference , even if both are " qualified " in absolute terms .


fn_spacy_tokens_for_baseline: It was n't purely coincidental that she happened to be carrying the details of previous work experience , for she 'd expected that the secretarial agency might want to see them .

source_bert_toks: it wasn ' t purely coincide ##ntal that she happened to be carrying the details of previous work experience , for she ' d expected that the secret ##aria ##l agency might want to see them .

reference_raw: It was not entirely a coincidence that she had been carrying the details of her previous work experience, since she had expected the secretary's office to want to see them.

reference_spacy_tokens: It was not entirely a coincidence that she had been carrying the details of her previous work experience , since she had expected the secretary 's office to want to see them .


fn_spacy_tokens_for_baseline: In 1641 there was a Catholic rebellion against the Protestants of Ulster , and English authority over the island was shaken .

source_bert_toks: in 1641 there was a catholic rebellion against the protestants of ulster , and english authority over the island was shaken .

reference_raw: In 1641, there was a Catholic uprising against the Protestants of Ulster, and the government of England over the island was shaken.

reference_spacy_tokens: In 1641 , there was a Catholic uprising against the Protestants of Ulster , and the government of England over the island was shaken .


fn_spacy_tokens_for_baseline: Admitting that 17 people were wrongly imprisoned is something whose electoral consequences , if any , are difficult to calculate .

source_bert_toks: admitting that 17 people were wrongly imprisoned is something whose electoral consequences , if any , are difficult to calculate .

reference_raw: Admitting that 17 people have been wrongly arrested is something whose electoral consequences, if any, are difficult to calculate.

reference_spacy_tokens: Admitting that 17 people have been wrongly arrested is something whose electoral consequences , if any , are difficult to calculate .


fn_spacy_tokens_for_baseline: The growth that has characterized Las Vegas for nearly a century may be facing a roadblock .

source_bert_toks: the growth that has characterized las vegas for nearly a century may be facing a road ##block .

reference_raw: The growth that has marked Las Vegas for almost a hundred years may face a roadblock.

reference_spacy_tokens: The growth that has marked Las Vegas for almost a hundred years may face a roadblock .


fn_spacy_tokens_for_baseline: FORD 'S ageing and ramshackle Dagenham site in Essex , once the jewel in the company 's overseas operations , enters the 1990s with its very survival uncertain .

source_bert_toks: ford ' s age ##ing and rams ##ha ##ckle da ##gen ##ham site in essex , once the jewel in the company ' s overseas operations , enters the 1990s with its very survival uncertain .

reference_raw: FORD's aging and ravaging Dagenham site in Essex, once a jewel in the company's overseas operations, comes into the 1990s with very uncertain survival.

reference_spacy_tokens: FORD 's aging and ravaging Dagenham site in Essex , once a jewel in the company 's overseas operations , comes into the 1990s with very uncertain survival .


fn_spacy_tokens_for_baseline: Chancellor Kohl can intimidate mavericks in his Christian Democrat party by threatening to move their names down on the electoral list , exposing them to the risk of defeat at the polls .

source_bert_toks: chancellor ko ##hl can int ##imi ##date mavericks in his christian democrat party by threatening to move their names down on the electoral list , exposing them to the risk of defeat at the polls .

reference_raw: Chancellor Kohl can scare the Mavericks of his Christian Democrat Party by threatening to put their names on the electoral list and putting them at risk of losing the election.

reference_spacy_tokens: Chancellor Kohl can scare the Mavericks of his Christian Democrat Party by threatening to put their names on the electoral list and putting them at risk of losing the election .


fn_spacy_tokens_for_baseline: The speaker of the Iranian parliament publicly stated in 1988 that " ... we should fully equip ourselves in defensive and offensive use of chemical , bacteriological , and radiological weapons . "

source_bert_toks: the speaker of the iranian parliament publicly stated in 1988 that " . . . we should fully e ##qui ##p ourselves in defensive and offensive use of chemical , ba ##cter ##iol ##ogical , and radio ##logical weapons . "

reference_raw: In 1988, a spokesman from the Iranian Parliament publicly said, "...we should fully prepare for defensive and offensive use of chemical, bacteriological and radiological weapons."

reference_spacy_tokens: In 1988 , a spokesman from the Iranian Parliament publicly said , " ... we should fully prepare for defensive and offensive use of chemical , bacteriological and radiological weapons . "


fn_spacy_tokens_for_baseline: Relatives often carry enormous personal burdens , for example , the grief of losing a child 's expected bright future , or the tragic decline into senility of a loved companion .

source_bert_toks: relatives often carry enormous personal burden ##s , for example , the grief of losing a child ' s expected bright future , or the tragic decline into sen ##ility of a loved companion .

reference_raw: Relatives often carry enormous personal burdens, such as the mourning of the loss of the expected bright future of a child, or the tragic decline in the senility of a beloved companion.

reference_spacy_tokens: Relatives often carry enormous personal burdens , such as the mourning of the loss of the expected bright future of a child , or the tragic decline in the senility of a beloved companion .


fn_spacy_tokens_for_baseline: Or what about this constructive comment penned by a biologist reviewing a grant proposal .

source_bert_toks: or what about this constructive comment penned by a biologist reviewing a grant proposal .

reference_raw: Or what about this constructive comment, which was sanctioned by a biologist reviewing a grant proposal.

reference_spacy_tokens: Or what about this constructive comment , which was sanctioned by a biologist reviewing a grant proposal .


fn_spacy_tokens_for_baseline: The e - commerce free zone is situated in north Dubai , near the industrial free zone in Jebel Ali , the top regional and tenth international leading area in container transit .

source_bert_toks: the e - commerce free zone is situated in north dubai , near the industrial free zone in je ##bel ali , the top regional and tenth international leading area in container transit .

reference_raw: The e-commerce free zone is located in Northern Dubai, close to the industrial free zone of Jebel Ali, the highest regional and tenth international lead zone in container transit.

reference_spacy_tokens: The e - commerce free zone is located in Northern Dubai , close to the industrial free zone of Jebel Ali , the highest regional and tenth international lead zone in container transit .


fn_spacy_tokens_for_baseline: Alternatively you can telephone our Customer Relations Department on 0742 528788 .

reference_raw: You can also call our customer relations department at 0742 528788.

reference_spacy_tokens: You can also call our customer relations department at 0742 528788 .


fn_spacy_tokens_for_baseline: At the next table sit two fine specimens of Mancunian youth .

source_bert_toks: at the next table sit two fine specimens of man ##cu ##nian youth .

reference_raw: There are two fine samples of Mancunian youth at the next table.

reference_spacy_tokens: There are two fine samples of Mancunian youth at the next table .


fn_spacy_tokens_for_baseline: In the early years , this was less to do with protests from the outside than with poor decision - making and technical incompetence on the inside .

source_bert_toks: in the early years , this was less to do with protests from the outside than with poor decision - making and technical inc ##omp ##ete ##nce on the inside .

reference_raw: In the early years, it had less to do with outside protests than with poor decision-making and technical incompetency on the inside.

reference_spacy_tokens: In the early years , it had less to do with outside protests than with poor decision - making and technical incompetency on the inside .


fn_spacy_tokens_for_baseline: She tilted her chin at him .

source_bert_toks: she tilted her chin at him .

reference_raw: She cocked her jaw at him.

reference_spacy_tokens: She cocked her jaw at him .


fn_spacy_tokens_for_baseline: Amanda Pennington , with her long , black maenad 's hair and round blue eyes , was the girl he adored .

source_bert_toks: amanda penn ##ington , with her long , black mae ##nad ' s hair and round blue eyes , was the girl he adored .

reference_raw: The girl he loved was Amanda Pennington, with her long black maenad hair and round blue eyes.

reference_spacy_tokens: The girl he loved was Amanda Pennington , with her long black maenad hair and round blue eyes .


fn_spacy_tokens_for_baseline: A child born to a teenage mother is twice a slikely to die in infancy as a child born to a mother aged between 25 and 29 .

source_bert_toks: a child born to a teenage mother is twice a sl ##ike ##ly to die in infancy as a child born to a mother aged between 25 and 29 .

reference_raw: The birth of a child to a teenage mother is twice as likely to die in childbirth as the birth of a mother between 25 and 29 years old.

reference_spacy_tokens: The birth of a child to a teenage mother is twice as likely to die in childbirth as the birth of a mother between 25 and 29 years old .


fn_spacy_tokens_for_baseline: I can only liken this to a trance - like state which neither drains you of energy nor leaves you feeling elated afterwards . '

source_bert_toks: i can only like ##n this to a trance - like state which neither drains you of energy nor leaves you feeling el ##ated afterwards . '

reference_raw: I can only put it in a trance-like state that doesn't drain you of power or make you feel elated afterward.'

reference_spacy_tokens: I can only put it in a trance - like state that does n't drain you of power or make you feel elated afterward . '


fn_spacy_tokens_for_baseline: ' Ask the waiter with the dent in his forehead to give you a bucketful of ice cubes and three or four napkins .

source_bert_toks: ' ask the waiter with the dent in his forehead to give you a bucket ##ful of ice cube ##s and three or four napkin ##s .

reference_raw: Ask a waiter with a dent in his forehead for a bucket full of ice cubes and three or four napkins.

reference_spacy_tokens: Ask a waiter with a dent in his forehead for a bucket full of ice cubes and three or four napkins .


fn_spacy_tokens_for_baseline: Pushing the wheelbarrow should have been child 's play , but I still could not get the hang of it .

source_bert_toks: pushing the wheel ##bar ##row should have been child ' s play , but i still could not get the hang of it .

reference_raw: Pushing a wheelbarrow was supposed to be a kid's game, but I still couldn't figure it out.

reference_spacy_tokens: Pushing a wheelbarrow was supposed to be a kid 's game , but I still could n't figure it out .


fn_spacy_tokens_for_baseline: A population density of 35 per square mile gives less than 1,000 possible contacts within three miles to any individual : a density of 10,000 per square mile gives him 280,000 possible contacts in the same radius .

source_bert_toks: a population density of 35 per square mile gives less than 1 , 000 possible contacts within three miles to any individual : a density of 10 , 000 per square mile gives him 280 , 000 possible contacts in the same radius .

reference_raw: A population density of 35 per square mile gives each individual less than 1,000 possible contacts in three miles: a density of 10,000 per square mile gives him 280,000 possible contacts in the same radius.

reference_spacy_tokens: A population density of 35 per square mile gives each individual less than 1,000 possible contacts in three miles : a density of 10,000 per square mile gives him 280,000 possible contacts in the same radius .


fn_spacy_tokens_for_baseline: This is a fact -- though , in view of all the feathers that are ruffled by this fact , it is not surprising that one hears so little about it .

source_bert_toks: this is a fact - - though , in view of all the feathers that are ru ##ffled by this fact , it is not surprising that one hears so little about it .

reference_raw: That's a fact-though, given all the feathers that are ruffled by that fact, it's no wonder you've heard so little about it.

reference_spacy_tokens: That 's a fact - though , given all the feathers that are ruffled by that fact , it 's no wonder you 've heard so little about it .


fn_spacy_tokens_for_baseline: He was handcuffed and taken to a locker room where he was chained to a metal grille by the arms and legs .

source_bert_toks: he was hand ##cu ##ffed and taken to a locker room where he was chained to a metal grille by the arms and legs .

reference_raw: They cuffed him and took him to the dressing room, where his arms and legs chained him to a metal grill.

reference_spacy_tokens: They cuffed him and took him to the dressing room , where his arms and legs chained him to a metal grill .


fn_spacy_tokens_for_baseline: Georg 's mouth firmed into a thin , disapproving line .

source_bert_toks: georg ' s mouth firm ##ed into a thin , di ##sa ##pp ##roving line .

reference_raw: George's lips tightened in a thin, disapproving line.

reference_spacy_tokens: George 's lips tightened in a thin , disapproving line .


fn_spacy_tokens_for_baseline: Florin Raducioiu scored all four goals as Romania retained second place in group four with a 4 - 0 victory over the Faroe Islands .

source_bert_toks: fl ##orin ra ##du ##cio ##iu scored all four goals as romania retained second place in group four with a 4 - 0 victory over the far ##oe islands .

reference_raw: Florin Raducioiu scored all four targets, while Romania maintained second place in group four with a 4-0 win over the Faroe Islands.

reference_spacy_tokens: Florin Raducioiu scored all four targets , while Romania maintained second place in group four with a 4 - 0 win over the Faroe Islands .


fn_spacy_tokens_for_baseline: Alan Bond 's last project was shelved by the Government five years ago .

source_bert_toks: alan bond ' s last project was she ##lved by the government five years ago .

reference_raw: The government covered Alan Bond's last project five years ago.

reference_spacy_tokens: The government covered Alan Bond 's last project five years ago .


fn_spacy_tokens_for_baseline: He called on the RUC to ' make an example ' of the gang by taking tough action to bring them before the courts . '

source_bert_toks: he called on the ru ##c to ' make an example ' of the gang by taking tough action to bring them before the courts . '

reference_raw: He called on the RUC to "exemplify" the mob by taking hard action to bring them to court."

reference_spacy_tokens: He called on the RUC to " exemplify " the mob by taking hard action to bring them to court . "


fn_spacy_tokens_for_baseline: In 431 b.c . , Athens began a war with its neighbor and league member Sparta .

source_bert_toks: in 43 ##1 b . c . , athens began a war with its neighbor and league member sparta .

reference_raw: At 431 B.C., Athens began a war with Sparta's neighbours and members of the Union.

reference_spacy_tokens: At 431 B.C. , Athens began a war with Sparta 's neighbours and members of the Union .


fn_spacy_tokens_for_baseline: Goya 's life , on the other hand , coincides with the decline and ultimate collapse of the Empire ; Spanish rule in America had been overthrown by the time of his death in 1828 .

source_bert_toks: go ##ya ' s life , on the other hand , coincide ##s with the decline and ultimate collapse of the empire ; spanish rule in america had been overthrow ##n by the time of his death in 1828 .

reference_raw: Goya's life, on the other hand, coincided with the collapse and the final collapse of the Empire; the Spanish government in America was defeated before he died in 1828.

reference_spacy_tokens: Goya 's life , on the other hand , coincided with the collapse and the final collapse of the Empire ; the Spanish government in America was defeated before he died in 1828 .


fn_spacy_tokens_for_baseline: One member of the strike committee forecast yesterday : ' If this happens , there will be nationwide outrage .

source_bert_toks: one member of the strike committee forecast yesterday : ' if this happens , there will be nationwide outrage .

reference_raw: Yesterday, a member of the strike committee predicted, "If that happens, there will be a national indignation.

reference_spacy_tokens: Yesterday , a member of the strike committee predicted , " If that happens , there will be a national indignation .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key question is how the US deployment of ballistic missile defense (formerly known as theatrical and national missile defense) will affect the rate and extent of Chinese strategic modernisation.

reference_spacy_tokens: The key question is how the US deployment of ballistic missile defense ( formerly known as theatrical and national missile defense ) will affect the rate and extent of Chinese strategic modernisation .


fn_spacy_tokens_for_baseline: A small , dapper , decisive man who wore a trilby and glasses , the canon lived in the next village and had a passion for small neat things like himself .

source_bert_toks: a small , da ##pper , decisive man who wore a tri ##lby and glasses , the canon lived in the next village and had a passion for small neat things like himself .

reference_raw: A small, dapper, determined man with a trilby and goggles, the canon lived in the next village and had a passion for little neat things like him.

reference_spacy_tokens: A small , dapper , determined man with a trilby and goggles , the canon lived in the next village and had a passion for little neat things like him .


fn_spacy_tokens_for_baseline: The main complaint was that Microsoft offered large discounts to PC makers who agreed to pay for a copy of MS - DOS or Windows for every machine they sold , whether or not it was actually loaded with one .

source_bert_toks: the main complaint was that microsoft offered large discount ##s to pc makers who agreed to pay for a copy of ms - dos or windows for every machine they sold , whether or not it was actually loaded with one .

reference_raw: The main complaint was that Microsoft offered large discounts to computer manufacturers who agreed to pay for a copy of MS-DOS or Windows for each machine they sold, whether or not it actually had one.

reference_spacy_tokens: The main complaint was that Microsoft offered large discounts to computer manufacturers who agreed to pay for a copy of MS - DOS or Windows for each machine they sold , whether or not it actually had one .


fn_spacy_tokens_for_baseline: On the Beagle voyage , Darwin had discovered evidence for the ' law of succession of types ' by unearthing South American fossils related to the unique modern inhabitants of that continent .

source_bert_toks: on the bea ##gle voyage , darwin had discovered evidence for the ' law of succession of types ' by une ##arth ##ing south american fossils related to the unique modern inhabitants of that continent .

reference_raw: On the Beagle voyage, Darwin found evidence of 'the law of succession of species' by unearthing South American fossils associated with the unique modern inhabitants of this continent.

reference_spacy_tokens: On the Beagle voyage , Darwin found evidence of ' the law of succession of species ' by unearthing South American fossils associated with the unique modern inhabitants of this continent .


fn_spacy_tokens_for_baseline: Fagin took what Sikes gave him , then stared at the robber for a long time without speaking .

source_bert_toks: fa ##gin took what si ##kes gave him , then stared at the robber for a long time without speaking .

reference_raw: Fagin took what Sikes had given him and stared at the thief for a long time without speaking.

reference_spacy_tokens: Fagin took what Sikes had given him and stared at the thief for a long time without speaking .


fn_spacy_tokens_for_baseline: The two other functions of a king he shirked : he did not lead his armies to war , anyway in his later years , and he did not provide an heir .

source_bert_toks: the two other functions of a king he shi ##rked : he did not lead his armies to war , anyway in his later years , and he did not provide an heir .

reference_raw: He shuddered at the other two functions of the King: he had not led his armies to war, at least in later years, and had not given them an heir.

reference_spacy_tokens: He shuddered at the other two functions of the King : he had not led his armies to war , at least in later years , and had not given them an heir .


fn_spacy_tokens_for_baseline: The official news agency , Xinhua , stated that he had been released because he had shown repentance .

source_bert_toks: the official news agency , xi ##nh ##ua , stated that he had been released because he had shown rep ##ent ##ance .

reference_raw: The official news agency, Xinhua, said he'd been released because he'd shown penance.

reference_spacy_tokens: The official news agency , Xinhua , said he 'd been released because he 'd shown penance .


fn_spacy_tokens_for_baseline: She tore off the ring with nimble fingers .

source_bert_toks: she tore off the ring with ni ##mble fingers .

reference_raw: With quick fingers, she tore off the circle.

reference_spacy_tokens: With quick fingers , she tore off the circle .


fn_spacy_tokens_for_baseline: Lady Kitty 's wardrobes were crammed with clothes , and she would give those for which she had no further use to someone with little money -- in exchange for some of their coupons , of course .

source_bert_toks: lady kitty ' s wardrobe ##s were cr ##ammed with clothes , and she would give those for which she had no further use to someone with little money - - in exchange for some of their coup ##ons , of course .

reference_raw: Lady Kitty's wardrobes were stuffed with clothes, and she would give the ones she didn't use to someone who didn't have much money in exchange for a few coupons, of course.

reference_spacy_tokens: Lady Kitty 's wardrobes were stuffed with clothes , and she would give the ones she did n't use to someone who did n't have much money in exchange for a few coupons , of course .


fn_spacy_tokens_for_baseline: ' Amotju was so slim and tall , and you are built more like a warrior or a boatman than a scribe . '

source_bert_toks: ' am ##ot ##ju was so slim and tall , and you are built more like a warrior or a boat ##man than a scribe . '

reference_raw: "Amotju was so thin and high, and you were built more like a warrior or a sailor than a scribe."

reference_spacy_tokens: " Amotju was so thin and high , and you were built more like a warrior or a sailor than a scribe . "


fn_spacy_tokens_for_baseline: We have been addressing two audiences throughout the debate -- the outside audience , whom the Opposition want to convince that this is a shock horror experience , and the audience in the House .

source_bert_toks: we have been addressing two audiences throughout the debate - - the outside audience , whom the opposition want to convince that this is a shock horror experience , and the audience in the house .

reference_raw: Throughout the debate, we've been talking to two audiences, an external audience that the opposition wants to convince that this is a shocking experience, and an audience in the House.

reference_spacy_tokens: Throughout the debate , we 've been talking to two audiences , an external audience that the opposition wants to convince that this is a shocking experience , and an audience in the House .


fn_spacy_tokens_for_baseline: But she did not pause to listen for an answer .

source_bert_toks: but she did not pause to listen for an answer .

reference_raw: But she didn't stop to hear the answer.

reference_spacy_tokens: But she did n't stop to hear the answer .


fn_spacy_tokens_for_baseline: I lift another heap of pages out of the file and something falls out on my knees .

source_bert_toks: i lift another heap of pages out of the file and something falls out on my knees .

reference_raw: I pick up a pile of pages from the file and something drops to my knees.

reference_spacy_tokens: I pick up a pile of pages from the file and something drops to my knees .


fn_spacy_tokens_for_baseline: She rolled up her pyjamas and stuffed them under her pillow , before quickly pulling the bedclothes to .

source_bert_toks: she rolled up her p ##y ##ja ##mas and stuffed them under her pillow , before quickly pulling the bed ##cloth ##es to .

reference_raw: She rolled up her pajamas and tucked them under her pillow, then quickly pulled the bedclothes away.

reference_spacy_tokens: She rolled up her pajamas and tucked them under her pillow , then quickly pulled the bedclothes away .


fn_spacy_tokens_for_baseline: Yet although small terrorist cells may be more motivated to use CBW and harder for counterterrorism authorities to interdict , they may lack the technical and financial resources needed to produce and deliver CBW agents .

source_bert_toks: yet although small terrorist cells may be more motivated to use cb ##w and harder for counter ##ter ##ror ##ism authorities to inter ##dict , they may lack the technical and financial resources needed to produce and deliver cb ##w agents .

reference_raw: However, while small terrorist cells may be more motivated to use CBW and more difficult for counter-terrorism authorities to intervene, they may lack the technical and financial resources necessary for the production and delivery of CBW agents.

reference_spacy_tokens: However , while small terrorist cells may be more motivated to use CBW and more difficult for counter - terrorism authorities to intervene , they may lack the technical and financial resources necessary for the production and delivery of CBW agents .


fn_spacy_tokens_for_baseline: He did research on the detection of foetal abnormalities at St Bartholomew 's , then moved to the Royal Free Hospital and began his crusade to offer women a more holistic approach to giving birth .

source_bert_toks: he did research on the detection of foe ##tal abnormalities at st bartholomew ' s , then moved to the royal free hospital and began his crusade to offer women a more ho ##listic approach to giving birth .

reference_raw: He studied the detection of foetal abnormalities at St. Bartholomew's, then moved to the Royal Free Hospital and began his campaign to offer women a more holistic approach to childbirth.

reference_spacy_tokens: He studied the detection of foetal abnormalities at St. Bartholomew 's , then moved to the Royal Free Hospital and began his campaign to offer women a more holistic approach to childbirth .


fn_spacy_tokens_for_baseline: She stepped up into the carriage and sat beside him .

source_bert_toks: she stepped up into the carriage and sat beside him .

reference_raw: She got into the carriage and sat down beside him.

reference_spacy_tokens: She got into the carriage and sat down beside him .


fn_spacy_tokens_for_baseline: You should fit this to the collar formed by the chain .

source_bert_toks: you should fit this to the collar formed by the chain .

reference_raw: You'd better fit it to the collar that's made up of a string.

reference_spacy_tokens: You 'd better fit it to the collar that 's made up of a string .