fn_spacy_tokens_for_baseline: Even in the wake of successful suits that challenged the protectionist laws that wholesalers originally pushed , the state retained extraordinarily broad authority to maintain a robust system of alcohol controls .

source_bert_toks: even in the wake of successful suits that challenged the protection ##ist laws that wholesale ##rs originally pushed , the state retained extra ##ord ##ina ##rily broad authority to maintain a robust system of alcohol controls .

reference_raw: Even after successful suits challenging the protectionist laws originally advocated by wholesalers, the State maintained an extremely broad power to maintain a robust system of alcohol checks.

reference_spacy_tokens: Even after successful suits challenging the protectionist laws originally advocated by wholesalers , the State maintained an extremely broad power to maintain a robust system of alcohol checks .


fn_spacy_tokens_for_baseline: Several people said that they had been asked to lecture to a wide range of students and colleagues on the subject of their particular disability , or disability in general .

source_bert_toks: several people said that they had been asked to lecture to a wide range of students and colleagues on the subject of their particular disability , or disability in general .

reference_raw: Some people said they were asked to teach a wide range of students and colleagues about their specific disability or disability in general.

reference_spacy_tokens: Some people said they were asked to teach a wide range of students and colleagues about their specific disability or disability in general .


fn_spacy_tokens_for_baseline: Conscious of being looked at she swung her legs and smiled faintly , twitching her shoulders and arching her neck .

source_bert_toks: conscious of being looked at she swung her legs and smiled faintly , twitching her shoulders and arching her neck .

reference_raw: Conscious that someone was looking at her, she turned her legs and smiled faintly, twitching her shoulders and arching her neck.

reference_spacy_tokens: Conscious that someone was looking at her , she turned her legs and smiled faintly , twitching her shoulders and arching her neck .


fn_spacy_tokens_for_baseline: Byron rocks away , very hairy , very clean , wringing his hands , like an impeccable spider in his green fatigues .

source_bert_toks: byron rocks away , very hairy , very clean , wr ##inging his hands , like an imp ##ec ##cable spider in his green fatigue ##s .

reference_raw: Byron rocks away, very hairy, very clean, twisting his hands like a perfect spider in a green fatigue.

reference_spacy_tokens: Byron rocks away , very hairy , very clean , twisting his hands like a perfect spider in a green fatigue .


fn_spacy_tokens_for_baseline: Fierce artillery duels and machinegun attacks -- pitting Muslims and Croats loyal to the Bosnian government against Serb units -- were also reported in northern Bosnia and in western regions near Mostar and Kupres .

source_bert_toks: fierce artillery duel ##s and machine ##gun attacks - - pitt ##ing muslims and croats loyal to the bosnian government against serb units - - were also reported in northern bosnia and in western regions near most ##ar and ku ##pres .

reference_raw: Fierce gunfights and machine-gun attacks - the pitting of Muslims and Croats loyal to the Bosnian government against Serbian troops - have also been reported in the north of Bosnia and the west of Mostar and Kupres.

reference_spacy_tokens: Fierce gunfights and machine - gun attacks - the pitting of Muslims and Croats loyal to the Bosnian government against Serbian troops - have also been reported in the north of Bosnia and the west of Mostar and Kupres .


fn_spacy_tokens_for_baseline: Now , unless she could rescue herself , she had not even a place on the outside of Mrs Browning 's life and what troubled her most was that she cared .

source_bert_toks: now , unless she could rescue herself , she had not even a place on the outside of mrs browning ' s life and what troubled her most was that she cared .

reference_raw: Now, if she couldn't save herself, she had no place outside Mrs. Browning's life, and what bothered her most was that she cared.

reference_spacy_tokens: Now , if she could n't save herself , she had no place outside Mrs. Browning 's life , and what bothered her most was that she cared .


fn_spacy_tokens_for_baseline: With such a long stretch of coast to cover and so many historic towns to visit inland , the Costa Blanca may seem difficult to navigate - particularly if you do n't have a car .

source_bert_toks: with such a long stretch of coast to cover and so many historic towns to visit inland , the costa blanca may seem difficult to navigate - particularly if you don ' t have a car .

reference_raw: The Costa Blanca can be difficult to navigate, especially if you don't have a car, with so many historical cities to visit inland.

reference_spacy_tokens: The Costa Blanca can be difficult to navigate , especially if you do n't have a car , with so many historical cities to visit inland .


fn_spacy_tokens_for_baseline: And if I feel like it , I wo n't just screw up your life with that stupid , lame bitch , I 'll make her part of the deal .

source_bert_toks: and if i feel like it , i won ' t just screw up your life with that stupid , lame bitch , i ' ll make her part of the deal .

reference_raw: And if I want to, I'm not gonna ruin your life with that stupid, pathetic bitch, I'm gonna make her part of the deal.

reference_spacy_tokens: And if I want to , I 'm not gon na ruin your life with that stupid , pathetic bitch , I 'm gon na make her part of the deal .


fn_spacy_tokens_for_baseline: All of us had sores and infections on our hands and arms from the cold and the dirt .

source_bert_toks: all of us had sore ##s and infections on our hands and arms from the cold and the dirt .

reference_raw: We all had pains and infections from the cold and the dirt on our hands and arms.

reference_spacy_tokens: We all had pains and infections from the cold and the dirt on our hands and arms .


fn_spacy_tokens_for_baseline: They did not speak of permanent hostilities between sections or lineages , but they did speak of peaces between lineages .

source_bert_toks: they did not speak of permanent hostilities between sections or lineage ##s , but they did speak of peace ##s between lineage ##s .

reference_raw: They didn't talk about permanent enmity between the sections and the lineages, but talked about peace between the lineages.

reference_spacy_tokens: They did n't talk about permanent enmity between the sections and the lineages , but talked about peace between the lineages .


fn_spacy_tokens_for_baseline: River Trolls live in marshlands or bogs , and beside untamed rivers where the banks are broad and muddy .

source_bert_toks: river trolls live in marsh ##lands or bog ##s , and beside un ##tam ##ed rivers where the banks are broad and muddy .

reference_raw: River trolls live in swamps or swamps, and beside untamed rivers where the shores are wide and muddy.

reference_spacy_tokens: River trolls live in swamps or swamps , and beside untamed rivers where the shores are wide and muddy .


fn_spacy_tokens_for_baseline: It was an intriguing place , full of photos of early explorers and of Roald Amundsen , who left Tromsø for his Arctic nemesis .

source_bert_toks: it was an intriguing place , full of photos of early explorers and of ro ##ald am ##unds ##en , who left tr ##oms ##ø for his arctic nemesis .

reference_raw: It was an interesting place, filled with photographs of early explorers and Roald Amundsen, who had left Tromsö for his arctic nemesis.

reference_spacy_tokens: It was an interesting place , filled with photographs of early explorers and Roald Amundsen , who had left Tromso for his arctic nemesis .


fn_spacy_tokens_for_baseline: Standards of modesty are applied indiscriminately to sexual and defaecatory concepts .

source_bert_toks: standards of modest ##y are applied ind ##is ##cr ##imi ##nate ##ly to sexual and def ##ae ##cat ##ory concepts .

reference_raw: The standards of modesty are applicable without distinction to sexual and defaecatory concepts.

reference_spacy_tokens: The standards of modesty are applicable without distinction to sexual and defaecatory concepts .


fn_spacy_tokens_for_baseline: He hated verbal theories , he did n't read much , he 'd never travelled outside the states , he punched people up , and when he was drunk at parties he pissed into the fireplace .

source_bert_toks: he hated verbal theories , he didn ' t read much , he ' d never travelled outside the states , he punched people up , and when he was drunk at parties he pissed into the fireplace .

reference_raw: He hated verbal theories, he didn't read much, he didn't travel out of the country, he hit people, and when he got drunk at parties, he peed in the fireplace.

reference_spacy_tokens: He hated verbal theories , he did n't read much , he did n't travel out of the country , he hit people , and when he got drunk at parties , he peed in the fireplace .


fn_spacy_tokens_for_baseline: Despite the stimulating atmosphere of work , the cares of family responsibility rather than the enjoyment of work were sometimes foremost when we asked for a description of the day .

source_bert_toks: despite the stimulating atmosphere of work , the cares of family responsibility rather than the enjoyment of work were sometimes foremost when we asked for a description of the day .

reference_raw: Despite the stimulant atmosphere of work, care for family responsibilities, rather than enjoying work, sometimes took precedence when we asked for a description of the day.

reference_spacy_tokens: Despite the stimulant atmosphere of work , care for family responsibilities , rather than enjoying work , sometimes took precedence when we asked for a description of the day .


fn_spacy_tokens_for_baseline: The bank had made no secret of their dismay over Virgin 's venture into airlines .

source_bert_toks: the bank had made no secret of their dismay over virgin ' s venture into airlines .

reference_raw: The bank made no secret of their fear of Virginia's business with the airlines.

reference_spacy_tokens: The bank made no secret of their fear of Virginia 's business with the airlines .


fn_spacy_tokens_for_baseline: He rammed his cap down hard

source_bert_toks: he rammed his cap down hard

reference_raw: He slammed his hat down hard.

reference_spacy_tokens: He slammed his hat down hard .


fn_spacy_tokens_for_baseline: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras , but Iranian officials were " not allowing the IAEA to install the cameras inside the cascade halls in Natanz and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

source_bert_toks: the nuclear agency had hoped to monitor the larger cent ##ri ##fu ##ge cascade with cameras , but iranian officials were " not allowing the ia ##ea to install the cameras inside the cascade halls in nat ##an ##z and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

reference_raw: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras, but Iranian officials had "not allowed the IAEA to install cameras in the Natanz cascade halls and caused further delays in the inspectors' activities," a diplomat who had been closely monitoring the agency had said yesterday.

reference_spacy_tokens: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras , but Iranian officials had " not allowed the IAEA to install cameras in the Natanz cascade halls and caused further delays in the inspectors ' activities , " a diplomat who had been closely monitoring the agency had said yesterday .


fn_spacy_tokens_for_baseline: Connon continued to sort through the objects before him .

source_bert_toks: con ##non continued to sort through the objects before him .

reference_raw: Connon continued to work through the objects in front of him.

reference_spacy_tokens: Connon continued to work through the objects in front of him .


fn_spacy_tokens_for_baseline: As she entered the narrow lane , the soot - blackened buildings seemed to close in on her threateningly .

source_bert_toks: as she entered the narrow lane , the soo ##t - blackened buildings seemed to close in on her threatening ##ly .

reference_raw: The soot-blackened buildings seemed to be closing in threateningly as she entered the narrow street.

reference_spacy_tokens: The soot - blackened buildings seemed to be closing in threateningly as she entered the narrow street .


fn_spacy_tokens_for_baseline: ' Oh , do n't despair yet .

source_bert_toks: ' oh , don ' t despair yet .

reference_raw: 'Oh, don't worry about it yet.

reference_spacy_tokens: ' Oh , do n't worry about it yet .


fn_spacy_tokens_for_baseline: Phases of the moon are tricky to explain .

source_bert_toks: phases of the moon are tricky to explain .

reference_raw: The phases of the moon are difficult to explain.

reference_spacy_tokens: The phases of the moon are difficult to explain .


fn_spacy_tokens_for_baseline: She plucked her jacket from the chair .

source_bert_toks: she plucked her jacket from the chair .

reference_raw: She pulled her coat out of her chair.

reference_spacy_tokens: She pulled her coat out of her chair .


fn_spacy_tokens_for_baseline: He 's supposed to be smart .

source_bert_toks: he ' s supposed to be smart .

reference_raw: He should be clever.

reference_spacy_tokens: He should be clever .


fn_spacy_tokens_for_baseline: They 're used to perceiving old Ted as a loser . '

source_bert_toks: they ' re used to per ##ce ##iving old ted as a loser . '

reference_raw: They're used to seeing old Ted as a loser.'

reference_spacy_tokens: They 're used to seeing old Ted as a loser . '


fn_spacy_tokens_for_baseline: A fine Greek revivalist station , not unlike that at Monkwearmouth in Northumbria , was built in Hamilton , Ontario , in 1930 .

source_bert_toks: a fine greek revival ##ist station , not unlike that at monk ##wear ##mouth in north ##umb ##ria , was built in hamilton , ontario , in 1930 .

reference_raw: In 1930, Hamilton, Ontario, built a fine Greek revivalist station, no different from the one in Monkwearmouth, Northumbria.

reference_spacy_tokens: In 1930 , Hamilton , Ontario , built a fine Greek revivalist station , no different from the one in Monkwearmouth , Northumbria .


fn_spacy_tokens_for_baseline: Each fingernail grows about an half inch every three months , and toenails about a third of that rate .

source_bert_toks: each finger ##nail grows about an half inch every three months , and toe ##nail ##s about a third of that rate .

reference_raw: Every three months, each nail grows about half an inch and toenails about a third of the rate.

reference_spacy_tokens: Every three months , each nail grows about half an inch and toenails about a third of the rate .


fn_spacy_tokens_for_baseline: Increasingly , health experts and researchers are naming the nation 's penchant for large portions and " supersizing " as a leading cause of obesity .

source_bert_toks: increasingly , health experts and researchers are naming the nation ' s pen ##chan ##t for large portions and " super ##si ##zing " as a leading cause of obesity .

reference_raw: Health professionals and researchers are increasingly calling the nation's fondness for large parts and "supervising" a major cause of obesity.

reference_spacy_tokens: Health professionals and researchers are increasingly calling the nation 's fondness for large parts and " supervising " a major cause of obesity .


fn_spacy_tokens_for_baseline: Observers of the case pointed out that the court apparently ignored ' irrationality ' even though the child 's education was affected by the lengthy and difficult journeys .

source_bert_toks: observers of the case pointed out that the court apparently ignored ' irrational ##ity ' even though the child ' s education was affected by the lengthy and difficult journeys .

reference_raw: The observers of the case pointed out that the court had apparently ignored "irrationality", although the child's education had been influenced by long and difficult journeys.

reference_spacy_tokens: The observers of the case pointed out that the court had apparently ignored " irrationality " , although the child 's education had been influenced by long and difficult journeys .


fn_spacy_tokens_for_baseline: The climate here can best be described as " changeable " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city 's magic .

source_bert_toks: the climate here can best be described as " change ##able " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city ' s magic .

reference_raw: The climate here is best described as "changeable", but the sudden shift from light to darkness, sun to shower, is part of the town's magic.

reference_spacy_tokens: The climate here is best described as " changeable " , but the sudden shift from light to darkness , sun to shower , is part of the town 's magic .


fn_spacy_tokens_for_baseline: Federal , state and local governments are freezing or withdrawing much - needed funding sources for people who are truly in need .

source_bert_toks: federal , state and local governments are freezing or withdrawing much - needed funding sources for people who are truly in need .

reference_raw: Federal, national and local governments freeze or withdraw a much-needed source of funding for people who really need it.

reference_spacy_tokens: Federal , national and local governments freeze or withdraw a much - needed source of funding for people who really need it .


fn_spacy_tokens_for_baseline: Protect your home with a durable exterior masonry paint .

source_bert_toks: protect your home with a durable exterior masonry paint .

reference_raw: Protect your house with permanent outer masonry paint.

reference_spacy_tokens: Protect your house with permanent outer masonry paint .


fn_spacy_tokens_for_baseline: Self - access is designed to help EFL and ESL teachers with the practicalities of setting up and managing self - access study facilities and so enable learning to take place independently of teaching .

source_bert_toks: self - access is designed to help e ##fl and es ##l teachers with the practical ##ities of setting up and managing self - access study facilities and so enable learning to take place independently of teaching .

reference_raw: Self-access is designed to help EFL and ESL educators to set up and manage self-access learning facilities, thereby enabling learning to take place independently of teaching.

reference_spacy_tokens: Self - access is designed to help EFL and ESL educators to set up and manage self - access learning facilities , thereby enabling learning to take place independently of teaching .


fn_spacy_tokens_for_baseline: One of Dana 's reactions was very characteristic : he bent double with laughter at something he had said that made all the others laugh , too .

source_bert_toks: one of dana ' s reactions was very characteristic : he bent double with laughter at something he had said that made all the others laugh , too .

reference_raw: One of Dana's reactions was very characteristic: he stooped twice and laughed at something he said that made everyone else laugh.

reference_spacy_tokens: One of Dana 's reactions was very characteristic : he stooped twice and laughed at something he said that made everyone else laugh .


fn_spacy_tokens_for_baseline: The U.S. government says it wants to ensure that Iraq is not buying items that appear to be humanitarian in nature but that could be used for making weapons .

source_bert_toks: the u . s . government says it wants to ensure that iraq is not buying items that appear to be humanitarian in nature but that could be used for making weapons .

reference_raw: The US government says it wants to make sure that Iraq doesn't buy items that look humanitarian in nature, but that can be used to make weapons.

reference_spacy_tokens: The US government says it wants to make sure that Iraq does n't buy items that look humanitarian in nature , but that can be used to make weapons .


fn_spacy_tokens_for_baseline: However , there are a number of operating research facilities in Syria , including the Der Al - Hadjar Nuclear Research Center near Damascus , a nuclear analysis laboratory , and the Scientific Research Institute ( SRI ) in Damascus .

source_bert_toks: however , there are a number of operating research facilities in syria , including the der al - had ##jar nuclear research center near damascus , a nuclear analysis laboratory , and the scientific research institute ( sri ) in damascus .

reference_raw: However, there are a number of operational research facilities in Syria, including the Der Al-Hadjar nuclear research centre in the vicinity of Damascus, a nuclear analysis laboratory and a scientific research institute in Damascus.

reference_spacy_tokens: However , there are a number of operational research facilities in Syria , including the Der Al - Hadjar nuclear research centre in the vicinity of Damascus , a nuclear analysis laboratory and a scientific research institute in Damascus .


fn_spacy_tokens_for_baseline: Life became so stressful that when I was making The Power Game the doctor put me on Mogadon and I became hooked for a while .

source_bert_toks: life became so stress ##ful that when i was making the power game the doctor put me on mo ##ga ##don and i became hooked for a while .

reference_raw: Life was so stressful that when I did the Power Game, the doctor put me on Mogadon, and for a while, I became addicted.

reference_spacy_tokens: Life was so stressful that when I did the Power Game , the doctor put me on Mogadon , and for a while , I became addicted .


fn_spacy_tokens_for_baseline: On very special nights he was allowed to stand beside her hot tub in a steamy bathroom heated by a small portable fire and smelling of sweet herbs .

source_bert_toks: on very special nights he was allowed to stand beside her hot tub in a steam ##y bathroom heated by a small portable fire and smelling of sweet herbs .

reference_raw: On very special nights he could stand next to her hot tub in a steamy bathroom heated by a small portable fire and smelling of sweet plants.

reference_spacy_tokens: On very special nights he could stand next to her hot tub in a steamy bathroom heated by a small portable fire and smelling of sweet plants .


fn_spacy_tokens_for_baseline: People in swimsuits or shorts and tops strolled at liberty on the wide sands .

source_bert_toks: people in swim ##suit ##s or shorts and tops strolled at liberty on the wide sands .

reference_raw: People in bathing suits or shorts and tops walked free on the broad sands.

reference_spacy_tokens: People in bathing suits or shorts and tops walked free on the broad sands .


fn_spacy_tokens_for_baseline: However , as he posted his letter on Monday , he has been caught in the suspension trap , and it could be at least a month , before there is any prospect of seeing his money .

source_bert_toks: however , as he posted his letter on monday , he has been caught in the suspension trap , and it could be at least a month , before there is any prospect of seeing his money .

reference_raw: But when he sent his letter on Monday, he was trapped in a suspension trap, and it could take at least a month to see his money.

reference_spacy_tokens: But when he sent his letter on Monday , he was trapped in a suspension trap , and it could take at least a month to see his money .


fn_spacy_tokens_for_baseline: If she did n't move suddenly , nobody could spot anything unusual .

source_bert_toks: if she didn ' t move suddenly , nobody could spot anything unusual .

reference_raw: If she did not move suddenly, no one would notice anything out of the ordinary.

reference_spacy_tokens: If she did not move suddenly , no one would notice anything out of the ordinary .


fn_spacy_tokens_for_baseline: Meanwhile the Midland 's board was only allowed sketchy details about the breakneck expansion .

source_bert_toks: meanwhile the midland ' s board was only allowed sketch ##y details about the break ##neck expansion .

reference_raw: In the meantime, only sketchy details of the breakthrough expansion were allowed to the Midland Council.

reference_spacy_tokens: In the meantime , only sketchy details of the breakthrough expansion were allowed to the Midland Council .


fn_spacy_tokens_for_baseline: Oliver 's sister , Philippa ( ' Pippa ' ) , became her lifelong collaborator on many feminist issues .

source_bert_toks: oliver ' s sister , philipp ##a ( ' pip ##pa ' ) , became her lifelong collaborator on many feminist issues .

reference_raw: Oliver's sister, Philippa, became her lifelong co-worker on a number of feminist issues.

reference_spacy_tokens: Oliver 's sister , Philippa , became her lifelong co - worker on a number of feminist issues .


fn_spacy_tokens_for_baseline: Today it was a cold fish mayonnaise with lettuce and french dressing in a little bottle , brown rolls , and a special goatsmilk cheese obtainable only at one particular shop in Soho .

source_bert_toks: today it was a cold fish mayo ##nna ##ise with let ##tu ##ce and french dressing in a little bottle , brown rolls , and a special goats ##mi ##lk cheese obtain ##able only at one particular shop in soho .

reference_raw: Today it was a cold fish mayonnaise with salad and French bandages in a small bottle, brown rolls, and a special goatsmilk cheese, which can only be obtained in one particular store in Soho.

reference_spacy_tokens: Today it was a cold fish mayonnaise with salad and French bandages in a small bottle , brown rolls , and a special goatsmilk cheese , which can only be obtained in one particular store in Soho .


fn_spacy_tokens_for_baseline: Resistance was prolonged from December to February 1947 when at length Sukarno secured approval for the change by putting his position to the test : if they refused , they must find a new president .

source_bert_toks: resistance was prolonged from december to february 1947 when at length su ##kar ##no secured approval for the change by putting his position to the test : if they refused , they must find a new president .

reference_raw: The resistance was extended from December to February 1947 when Sukarno finally agreed to the change by putting his position on the test: if he refused, he would have to find a new president.

reference_spacy_tokens: The resistance was extended from December to February 1947 when Sukarno finally agreed to the change by putting his position on the test : if he refused , he would have to find a new president .


fn_spacy_tokens_for_baseline: She sometimes wore white shoes .

source_bert_toks: she sometimes wore white shoes .

reference_raw: Sometimes she wore white boots.

reference_spacy_tokens: Sometimes she wore white boots .


fn_spacy_tokens_for_baseline: The universities attract students from all over the world , and this influx helps to make Dublin a busy , buzzing international city .

source_bert_toks: the universities attract students from all over the world , and this influx helps to make dublin a busy , buzzing international city .

reference_raw: Colleges attract students from around the world, and this influx helps make Dublin a busy, buzzing international city.

reference_spacy_tokens: Colleges attract students from around the world , and this influx helps make Dublin a busy , buzzing international city .


fn_spacy_tokens_for_baseline: Therefore we examined the ability of 3T3 cells ( a murine fibroblast cell line ) to substitute for fetal mesenchyme .

source_bert_toks: therefore we examined the ability of 3 ##t ##3 cells ( a mu ##rine fi ##bro ##bla ##st cell line ) to substitute for fetal me ##sen ##chy ##me .

reference_raw: We therefore examined the ability of 3T3 cells (murine fibroblast cell line) to replace fetal mesenchyme.

reference_spacy_tokens: We therefore examined the ability of 3T3 cells ( murine fibroblast cell line ) to replace fetal mesenchyme .


fn_spacy_tokens_for_baseline: They blended together from the first and there can be no doubt that Harry 's forceful play on the right wing was one of the prime reasons why Simpson was able to crack in so many goals .

source_bert_toks: they blended together from the first and there can be no doubt that harry ' s forceful play on the right wing was one of the prime reasons why simpson was able to crack in so many goals .

reference_raw: They had merged from the first, and there was no doubt that Harry's violent play on the right wing was one of the main reasons why Simpson had been able to break so many goals.

reference_spacy_tokens: They had merged from the first , and there was no doubt that Harry 's violent play on the right wing was one of the main reasons why Simpson had been able to break so many goals .


fn_spacy_tokens_for_baseline: To her it was indicative of how he 'd come to view their relationship .

source_bert_toks: to her it was indicative of how he ' d come to view their relationship .

reference_raw: It told her how he had come to see their relationship.

reference_spacy_tokens: It told her how he had come to see their relationship .


fn_spacy_tokens_for_baseline: Their response is authoritarian .

source_bert_toks: their response is authoritarian .

reference_raw: Their reaction is authoritative.

reference_spacy_tokens: Their reaction is authoritative .


fn_spacy_tokens_for_baseline: At the moment Italians only eat 5,000 tonnes of lamb a year .

source_bert_toks: at the moment italians only eat 5 , 000 tonnes of lamb a year .

reference_raw: At this point, the Italians only eat 5,000 tons of sheep a year.

reference_spacy_tokens: At this point , the Italians only eat 5,000 tons of sheep a year .


fn_spacy_tokens_for_baseline: Excited by the idea , and by at last doing something positive , Mungo put on his shirt and trousers over his pyjamas , and added two sweaters for good measure .

source_bert_toks: excited by the idea , and by at last doing something positive , mu ##ngo put on his shirt and trousers over his p ##y ##ja ##mas , and added two sweater ##s for good measure .

reference_raw: Excited by the thought, and finally doing something positive, Mungo slipped on his shirt and pants over his pajamas and added two sweaters to measure them well.

reference_spacy_tokens: Excited by the thought , and finally doing something positive , Mungo slipped on his shirt and pants over his pajamas and added two sweaters to measure them well .


fn_spacy_tokens_for_baseline: The minor Aegean Islands were taken by various powerful European noblemen , many of whom were Genoese or Venetian , such as Marco Sanudo on Naxos .

source_bert_toks: the minor aegean islands were taken by various powerful european noble ##men , many of whom were gen ##oese or venetian , such as marco san ##ud ##o on na ##x ##os .

reference_raw: The smaller Aegean islands were conquered by a number of powerful European nobles, many of whom were Genoese or Venetian, such as Marco Sanudo in Naxos.

reference_spacy_tokens: The smaller Aegean islands were conquered by a number of powerful European nobles , many of whom were Genoese or Venetian , such as Marco Sanudo in Naxos .


fn_spacy_tokens_for_baseline: They should see to it that their kids do n't play truant ; they should make certain that the children spend enough time doing homework ; they should scrutinize the report card .

source_bert_toks: they should see to it that their kids don ' t play tr ##uan ##t ; they should make certain that the children spend enough time doing homework ; they should sc ##rut ##ini ##ze the report card .

reference_raw: They should make sure that their children don't play truant; they should make sure that their children spend a lot of time doing their homework; they should check the report card.

reference_spacy_tokens: They should make sure that their children do n't play truant ; they should make sure that their children spend a lot of time doing their homework ; they should check the report card .


fn_spacy_tokens_for_baseline: There 's a reception area where they can sit and talk and the girls sit in there too and help the conversation along . '

source_bert_toks: there ' s a reception area where they can sit and talk and the girls sit in there too and help the conversation along . '

reference_raw: "There's a reception area where they'll be able to hang out and talk, and the girls will be there, too, and they'll be able to help the conversation with you."

reference_spacy_tokens: " There 's a reception area where they 'll be able to hang out and talk , and the girls will be there , too , and they 'll be able to help the conversation with you . "


fn_spacy_tokens_for_baseline: " Sometimes I 've thought I 'll never forget what happened . it all comes back and I feel guilty , or . or dirty , or humiliated and bitter .

source_bert_toks: " sometimes i ' ve thought i ' ll never forget what happened . it all comes back and i feel guilty , or . or dirty , or humiliated and bitter .

reference_raw: "Sometimes I don't think I'll ever forget what happened... it all comes back to me, and I feel guilty, or... or dirty, or embarrassed and bitter. "

reference_spacy_tokens: " Sometimes I do n't think I 'll ever forget what happened ... it all comes back to me , and I feel guilty , or ... or dirty , or embarrassed and bitter . "


fn_spacy_tokens_for_baseline: She pressed her forefinger into her left temple to ease the escalating migraine that threatened .

source_bert_toks: she pressed her fore ##finger into her left temple to ease the es ##cala ##ting mig ##raine that threatened .

reference_raw: To ease the escalating migraine that threatened her, she pressed her forefinger against her left cheek.

reference_spacy_tokens: To ease the escalating migraine that threatened her , she pressed her forefinger against her left cheek .


fn_spacy_tokens_for_baseline: He regarded Lexandro musingly as a brother might a sister whose honour he must protect -- a sentiment which Lexandro had purged from his own soul , though he recognized the symptoms .

source_bert_toks: he regarded lex ##and ##ro mu ##sing ##ly as a brother might a sister whose honour he must protect - - a sentiment which lex ##and ##ro had purge ##d from his own soul , though he recognized the symptoms .

reference_raw: He regarded Lexandro thoughtfully as a brother who might have been a sister whose honor he had to protect-a sentiment that Lexandro had cleansed from his soul, though he recognized the symptoms.

reference_spacy_tokens: He regarded Lexandro thoughtfully as a brother who might have been a sister whose honor he had to protect - a sentiment that Lexandro had cleansed from his soul , though he recognized the symptoms .


fn_spacy_tokens_for_baseline: Mr Hale won three awards , including the Queen 's Commendation for Brave Conduct , after he made six journeys into the blazing inferno to help save lives .

source_bert_toks: mr hale won three awards , including the queen ' s commendation for brave conduct , after he made six journeys into the blazing inferno to help save lives .

reference_raw: Mr. Hale won three awards, including the Queen's Honor for Brave Behavior, after six trips to the burning hell to help save lives.

reference_spacy_tokens: Mr. Hale won three awards , including the Queen 's Honor for Brave Behavior , after six trips to the burning hell to help save lives .


fn_spacy_tokens_for_baseline: This glider looked sturdy enough , but he could n't be certain that it would return to the ground safely .

source_bert_toks: this glider looked sturdy enough , but he couldn ' t be certain that it would return to the ground safely .

reference_raw: The skimmer looked strong enough, but he wasn't sure it would return safely to the ground.

reference_spacy_tokens: The skimmer looked strong enough , but he was n't sure it would return safely to the ground .


fn_spacy_tokens_for_baseline: His body tilted to horizontal , legs and arms hanging like a spider from a strand .

source_bert_toks: his body tilted to horizontal , legs and arms hanging like a spider from a strand .

reference_raw: His body bent horizontally, his legs and arms dangling like a spider from a strand.

reference_spacy_tokens: His body bent horizontally , his legs and arms dangling like a spider from a strand .


fn_spacy_tokens_for_baseline: We pay attention to those salient features which are constitutive of the type of genre , and expect that the peripheral features will be as they have been in the past .

source_bert_toks: we pay attention to those sal ##ient features which are con ##sti ##tu ##tive of the type of genre , and expect that the peripheral features will be as they have been in the past .

reference_raw: We pay attention to these salty features that are constitutive to the type of genre, and we expect the peripherals to be the same as before.

reference_spacy_tokens: We pay attention to these salty features that are constitutive to the type of genre , and we expect the peripherals to be the same as before .


fn_spacy_tokens_for_baseline: The leaves are used in Middle Eastern and Greek cooking for their slightly spicy flavour and pungent scent .

source_bert_toks: the leaves are used in middle eastern and greek cooking for their slightly spicy flavour and pun ##gent scent .

reference_raw: The leaves are used in the Middle East and in Greek cooking for their slightly spicy taste and pungent aroma.

reference_spacy_tokens: The leaves are used in the Middle East and in Greek cooking for their slightly spicy taste and pungent aroma .


fn_spacy_tokens_for_baseline: ' I ripped the locket from his sanguined throat and tucked it into the pocket of the maid where she slept .

source_bert_toks: ' i ripped the locke ##t from his sang ##uin ##ed throat and tucked it into the pocket of the maid where she slept .

reference_raw: I tore the medallion out of his sanguined neck and put it in the maid's pocket where she slept.

reference_spacy_tokens: I tore the medallion out of his sanguined neck and put it in the maid 's pocket where she slept .


fn_spacy_tokens_for_baseline: The unholy triumvirate of developer , planner and architect had maimed it forever in the sixties and seventies .

source_bert_toks: the un ##hol ##y tri ##um ##vira ##te of developer , planner and architect had mai ##med it forever in the sixties and seventies .

reference_raw: In the '60s and '70s, the unholy triumvirate of developers, planners, and architects crippled him forever.

reference_spacy_tokens: In the ' 60s and ' 70s , the unholy triumvirate of developers , planners , and architects crippled him forever .


fn_spacy_tokens_for_baseline: And he was chatting away to them .

source_bert_toks: and he was chatting away to them .

reference_raw: And he talked to them.

reference_spacy_tokens: And he talked to them .


fn_spacy_tokens_for_baseline: Not until she had been sitting there for several minutes did Isabel realise that no sound at all had come from her torn and bleeding lips .

source_bert_toks: not until she had been sitting there for several minutes did isabel realise that no sound at all had come from her torn and bleeding lips .

reference_raw: It wasn't until she sat there for a few minutes that Isabel realized that there was no sound from her torn, bleeding mouth.

reference_spacy_tokens: It was n't until she sat there for a few minutes that Isabel realized that there was no sound from her torn , bleeding mouth .


fn_spacy_tokens_for_baseline: Anne chuckled and looked only a little abashed .

source_bert_toks: anne chuckled and looked only a little aba ##shed .

reference_raw: Anne laughed and looked a little embarrassed.

reference_spacy_tokens: Anne laughed and looked a little embarrassed .


fn_spacy_tokens_for_baseline: ' An aftermath of the way you mauled me .

source_bert_toks: ' an aftermath of the way you ma ##uled me .

reference_raw: 'Affects the way you've mailed me.

reference_spacy_tokens: ' Affects the way you 've mailed me .


fn_spacy_tokens_for_baseline: It must be noted that , while there is great similarity of language in many passages recorded in all three Gospels , there are differences .

source_bert_toks: it must be noted that , while there is great similarity of language in many passages recorded in all three gospels , there are differences .

reference_raw: It should be noted that, although many passages recorded in all three Gospels are very similar in language, there are differences.

reference_spacy_tokens: It should be noted that , although many passages recorded in all three Gospels are very similar in language , there are differences .


fn_spacy_tokens_for_baseline: It was Leckey 's first NI championship win of the season and came too late to threaten Emerson 's position .

source_bert_toks: it was le ##ckey ' s first ni championship win of the season and came too late to threaten emerson ' s position .

reference_raw: This was Leckey's first victory in the NI championship of the season, and it was too late to jeopardize Emerson's position.

reference_spacy_tokens: This was Leckey 's first victory in the NI championship of the season , and it was too late to jeopardize Emerson 's position .


fn_spacy_tokens_for_baseline: She turned herself sideways to the audience , tipped the boater low down over her nose , stuck her hands in the pockets of her jacket and crossed one foot over another .

source_bert_toks: she turned herself sideways to the audience , tipped the boat ##er low down over her nose , stuck her hands in the pockets of her jacket and crossed one foot over another .

reference_raw: She turned to the audience, tipped the boat low over her nose, put her hands in the pockets of her jacket, and folded one leg over the other.

reference_spacy_tokens: She turned to the audience , tipped the boat low over her nose , put her hands in the pockets of her jacket , and folded one leg over the other .


fn_spacy_tokens_for_baseline: I was familiar with the view that the priesthood is beyond shock , being entirely cognisant of the whole sum of human folly and evil from the outpourings of the penitent , but I was n't convinced .

source_bert_toks: i was familiar with the view that the priesthood is beyond shock , being entirely co ##gni ##sant of the whole sum of human folly and evil from the out ##pour ##ings of the pen ##ite ##nt , but i wasn ' t convinced .

reference_raw: I was familiar with the idea that the priesthood was beyond shock, that it was entirely cognizable of the sum of human folly and evil from the outbursts of the penitent, but I was not convinced.

reference_spacy_tokens: I was familiar with the idea that the priesthood was beyond shock , that it was entirely cognizable of the sum of human folly and evil from the outbursts of the penitent , but I was not convinced .


fn_spacy_tokens_for_baseline: They gave a sensible guide to what glass was necessary in various sizes of tank .

source_bert_toks: they gave a sensible guide to what glass was necessary in various sizes of tank .

reference_raw: They gave a reasonable indication of what glass was needed in the different sizes of the container.

reference_spacy_tokens: They gave a reasonable indication of what glass was needed in the different sizes of the container .


fn_spacy_tokens_for_baseline: If firms are to collude tacitly , they must somehow choose prices and outputs which are sustainable by a credible punishment strategy that also has to be tacitly agreed upon .

source_bert_toks: if firms are to col ##lu ##de ta ##cit ##ly , they must somehow choose prices and outputs which are sustainable by a credible punishment strategy that also has to be ta ##cit ##ly agreed upon .

reference_raw: If companies are to collide tacitly, they must somehow select prices and outputs that are sustainable through a credible punishment strategy that must also be tacitly agreed upon.

reference_spacy_tokens: If companies are to collide tacitly , they must somehow select prices and outputs that are sustainable through a credible punishment strategy that must also be tacitly agreed upon .


fn_spacy_tokens_for_baseline: Barking ferociously , the big Great Dane rushed from the rear of the house , skidded around the corner and hurled herself at the gate with such force that it creaked under the impact .

source_bert_toks: barking ferocious ##ly , the big great dane rushed from the rear of the house , ski ##dded around the corner and hurled herself at the gate with such force that it creaked under the impact .

reference_raw: The Great Dane snapped wildly out of the back of the house, skidded around the corner, and flung herself against the gate with such force that it creaked under the impact.

reference_spacy_tokens: The Great Dane snapped wildly out of the back of the house , skidded around the corner , and flung herself against the gate with such force that it creaked under the impact .


fn_spacy_tokens_for_baseline: He claimed that his Socialist opponents had used corruption allegations to hound him from office , and that fellow right - wing politicians in Paris had abandoned him ( many of Medecin 's close political friends had been alienated by his decision in 1989 to leave the Gaullist Rally for the Republic and join the far right National Centre of Independents and Peasants ) .

source_bert_toks: he claimed that his socialist opponents had used corruption allegations to hound him from office , and that fellow right - wing politicians in paris had abandoned him ( many of med ##ecin ' s close political friends had been alien ##ated by his decision in 1989 to leave the gaul ##list rally for the republic and join the far right national centre of independents and peasants ) .

reference_raw: He claimed that his socialist adversaries had used corruption charges to get him out of office, and that his fellow right-wing politicians in Paris had left him (many of Medecin's close political friends had been estranged by his decision in 1989 to leave the Gaullist Rally for the Republic and join the far-right National Center for Independents and Peasants).

reference_spacy_tokens: He claimed that his socialist adversaries had used corruption charges to get him out of office , and that his fellow right - wing politicians in Paris had left him ( many of Medecin 's close political friends had been estranged by his decision in 1989 to leave the Gaullist Rally for the Republic and join the far - right National Center for Independents and Peasants ) .


fn_spacy_tokens_for_baseline: Great flukes slapped the ocean with a sound like thunder .

source_bert_toks: great flu ##kes slapped the ocean with a sound like thunder .

reference_raw: The great flakes struck the ocean with a sound like thunder.

reference_spacy_tokens: The great flakes struck the ocean with a sound like thunder .


fn_spacy_tokens_for_baseline: In October 2002 , the U.S. State Department informed North Korea that the U.S. was aware of this program , which is a violation of Pyongyang 's nonproliferation commitments .

source_bert_toks: in october 2002 , the u . s . state department informed north korea that the u . s . was aware of this program , which is a violation of p ##yon ##gy ##ang ' s non ##pro ##life ##ration commitments .

reference_raw: In October 2002, the United States States announced to North Korea that the United States was aware of this programme, in violation of Pyongyang's non-proliferation obligations.

reference_spacy_tokens: In October 2002 , the United States States announced to North Korea that the United States was aware of this programme , in violation of Pyongyang 's non - proliferation obligations .


fn_spacy_tokens_for_baseline: some proteins form an integral part of the membrane and are exposed to both the exterior and interior surface of the cell .

reference_raw: certain proteins form an integral part of the membrane and are exposed to the outer and inner surface of the cell.

reference_spacy_tokens: certain proteins form an integral part of the membrane and are exposed to the outer and inner surface of the cell .


fn_spacy_tokens_for_baseline: ' Nineteen eighty three , ' he growled into the open firebox , ' would be the watershed ! '

source_bert_toks: ' nineteen eighty three , ' he growled into the open fire ##box , ' would be the watershed ! '

reference_raw: 'Nineteen-eighty-three,' he snarled into the open fire-box, 'would be a watershed!'

reference_spacy_tokens: ' Nineteen - eighty - three , ' he snarled into the open fire - box , ' would be a watershed ! '


fn_spacy_tokens_for_baseline: At Baiyunguan the first courtyard features the Wind Containing Bridge , where visitors attempt to ensure their good fortune by striking a 17th - century copper bell with coins .

source_bert_toks: at bai ##yu ##ng ##uan the first courtyard features the wind containing bridge , where visitors attempt to ensure their good fortune by striking a 17th - century copper bell with coins .

reference_raw: The first courtyard in Baiyunguan is the Wind Containing Bridge, where visitors try to secure their happiness by hitting a 17th-century copper bell with coins.

reference_spacy_tokens: The first courtyard in Baiyunguan is the Wind Containing Bridge , where visitors try to secure their happiness by hitting a 17th - century copper bell with coins .


fn_spacy_tokens_for_baseline: At junctions with a stop sign and a solid white line across your approach , you must stop at the line , wait for a safe gap in the traffic before you move .

source_bert_toks: at junctions with a stop sign and a solid white line across your approach , you must stop at the line , wait for a safe gap in the traffic before you move .

reference_raw: At intersections with a halt sign and a solid white line on the other side of the line, you have to stand by the line and wait for a safe break in the traffic before you move.

reference_spacy_tokens: At intersections with a halt sign and a solid white line on the other side of the line , you have to stand by the line and wait for a safe break in the traffic before you move .


fn_spacy_tokens_for_baseline: The Horror Film Specialist was surrounded by an admiring coterie of lesser horror film specialists and most of their conversation referred back to previous triumphs .

source_bert_toks: the horror film specialist was surrounded by an admiring cote ##rie of lesser horror film specialists and most of their conversation referred back to previous triumph ##s .

reference_raw: The Horror Film Specialist was surrounded by an admiring cotery of lesser horror film specialists, and most of the conversation referred to previous triumphs.

reference_spacy_tokens: The Horror Film Specialist was surrounded by an admiring cotery of lesser horror film specialists , and most of the conversation referred to previous triumphs .


fn_spacy_tokens_for_baseline: Paula Grey , a raven haired girl in her early thirties with strong bone structure , had just entered the office .

source_bert_toks: paula grey , a raven haired girl in her early thirties with strong bone structure , had just entered the office .

reference_raw: Paula Grey, a raven-haired girl in her early thirties with a strong bone structure, had just entered the room.

reference_spacy_tokens: Paula Grey , a raven - haired girl in her early thirties with a strong bone structure , had just entered the room .


fn_spacy_tokens_for_baseline: Striking out in search of food , the herd trampled crops , damaged buildings , and terrified the settlers .

source_bert_toks: striking out in search of food , the herd tram ##pled crops , damaged buildings , and terrified the settlers .

reference_raw: They went out looking for food, the herd trampled the crops, damaged the buildings, and frightened the settlers.

reference_spacy_tokens: They went out looking for food , the herd trampled the crops , damaged the buildings , and frightened the settlers .


fn_spacy_tokens_for_baseline: ' Tis a wild wolves ' moon that stares at me

source_bert_toks: ' tis a wild wolves ' moon that stares at me

reference_raw: 'It's the moon of the Wild Wolves looking at me

reference_spacy_tokens: ' It 's the moon of the Wild Wolves looking at me


fn_spacy_tokens_for_baseline: The sun was rising behind the rainclouds .

source_bert_toks: the sun was rising behind the rain ##cl ##oud ##s .

reference_raw: The sun was coming up behind the clouds.

reference_spacy_tokens: The sun was coming up behind the clouds .


fn_spacy_tokens_for_baseline: A persistent critic of profligate government , he now has his chance to trim the deficit .

source_bert_toks: a persistent critic of prof ##liga ##te government , he now has his chance to trim the deficit .

reference_raw: A persistent criticism of the profligate government now has a chance to narrow the deficit.

reference_spacy_tokens: A persistent criticism of the profligate government now has a chance to narrow the deficit .


fn_spacy_tokens_for_baseline: Bull - baiting , where a bull was tethered to a ring and goaded by dogs and sticks , was relatively common , but letting the bull roam through the streets was nearer to Spanish than English custom .

source_bert_toks: bull - bait ##ing , where a bull was te ##ther ##ed to a ring and goa ##ded by dogs and sticks , was relatively common , but letting the bull roam through the streets was nearer to spanish than english custom .

reference_raw: Bull-baiting, where the bull was chained to a ring and covered with dogs and sticks, was relatively common, but allowing the bull to wander the streets was closer to Spanish than English custom.

reference_spacy_tokens: Bull - baiting , where the bull was chained to a ring and covered with dogs and sticks , was relatively common , but allowing the bull to wander the streets was closer to Spanish than English custom .


fn_spacy_tokens_for_baseline: However , the questions and answers relating to the officers ' comments on what they had observed during surveillance might well have been edited out .

source_bert_toks: however , the questions and answers relating to the officers ' comments on what they had observed during surveillance might well have been edited out .

reference_raw: However, the questions and replies concerning the comments made by the officers on what they had observed in the course of the surveillance could be edited.

reference_spacy_tokens: However , the questions and replies concerning the comments made by the officers on what they had observed in the course of the surveillance could be edited .


fn_spacy_tokens_for_baseline: More than 25,000 people live here , mostly by fishing , but there are also ex - pats , attracted by its laid - back Mediterranean ambience .

source_bert_toks: more than 25 , 000 people live here , mostly by fishing , but there are also ex - pat ##s , attracted by its laid - back mediterranean am ##bie ##nce .

reference_raw: There are more than 25,000 people, mostly fishing, but there are ex-pats, attracted by the lack of ambience in the Mediterranean.

reference_spacy_tokens: There are more than 25,000 people , mostly fishing , but there are ex - pats , attracted by the lack of ambience in the Mediterranean .


fn_spacy_tokens_for_baseline: There will also be talk of a return by Boycott , who has always been open in admitting that he would like to be either cricket chairman or team manager .

source_bert_toks: there will also be talk of a return by boycott , who has always been open in admitting that he would like to be either cricket chairman or team manager .

reference_raw: There will also be talk of Boycott's return, who has always admitted to himself that he would like to be a cricket chairman or a team manager.

reference_spacy_tokens: There will also be talk of Boycott 's return , who has always admitted to himself that he would like to be a cricket chairman or a team manager .


fn_spacy_tokens_for_baseline: Z Company were just returning from a fortnight 's well - earned leave while , as always , HQ Company were administering , paying , feeding , clothing and transporting the rest of the battalion .

source_bert_toks: z company were just returning from a fort ##night ' s well - earned leave while , as always , hq company were administering , paying , feeding , clothing and transporting the rest of the battalion .

reference_raw: The Z Company had just come back from a well-deserved two-week vacation while the HQ Company, as usual, managed, paid, fed, dressed, and transported the rest of the battalion.

reference_spacy_tokens: The Z Company had just come back from a well - deserved two - week vacation while the HQ Company , as usual , managed , paid , fed , dressed , and transported the rest of the battalion .


fn_spacy_tokens_for_baseline: A few weeks after Hussein 's capture , a suicide bomber plowed his vehicle into Nabil , a restaurant along Baghdad 's upscale Arasat Street popular with foreigners .

source_bert_toks: a few weeks after hussein ' s capture , a suicide bomber pl ##owed his vehicle into na ##bil , a restaurant along baghdad ' s upscale ara ##sat street popular with foreigners .

reference_raw: A few weeks after Hussein's captivity, a suicide bomber ploughed his car into Nabil, a restaurant on Baghdad's upscale Arasat Street, popular with strangers.

reference_spacy_tokens: A few weeks after Hussein 's captivity , a suicide bomber ploughed his car into Nabil , a restaurant on Baghdad 's upscale Arasat Street , popular with strangers .


fn_spacy_tokens_for_baseline: To her , it was somehow disrespectful to talk to Cabinet ministers in a sweater .

source_bert_toks: to her , it was somehow di ##sr ##es ##pe ##ct ##ful to talk to cabinet ministers in a sweater .

reference_raw: It was kind of rude for her to talk to cabinet ministers in sweaters.

reference_spacy_tokens: It was kind of rude for her to talk to cabinet ministers in sweaters .


fn_spacy_tokens_for_baseline: Hugo glanced at his watch , and decided to press on for another half - hour .

source_bert_toks: hugo glanced at his watch , and decided to press on for another half - hour .

reference_raw: Hugo looked at his wristwatch and decided to wait another half hour.

reference_spacy_tokens: Hugo looked at his wristwatch and decided to wait another half hour .


fn_spacy_tokens_for_baseline: Add pva adhesive to the mixing water for the repair mortar , 1 part adhesive to 5 parts water .

source_bert_toks: add pv ##a ad ##hesive to the mixing water for the repair mortar , 1 part ad ##hesive to 5 parts water .

reference_raw: Add pva glue to the mixing water for the repair mortar, 1 part glued to 5 parts water.

reference_spacy_tokens: Add pva glue to the mixing water for the repair mortar , 1 part glued to 5 parts water .


fn_spacy_tokens_for_baseline: The astonishing question , asked in an ordinary conversational tone , made her gasp .

source_bert_toks: the astonishing question , asked in an ordinary conversation ##al tone , made her gasp .

reference_raw: The startling question, asked in a normal conversational tone, made her gasp.

reference_spacy_tokens: The startling question , asked in a normal conversational tone , made her gasp .


fn_spacy_tokens_for_baseline: The offensive Wednesday was believed to be Turkey 's largest cross - border ground operation into Iraqi territory since a 2008 onslaught against the PKK .

source_bert_toks: the offensive wednesday was believed to be turkey ' s largest cross - border ground operation into iraqi territory since a 2008 onslaught against the p ##kk .

reference_raw: Since the 2008 attack on the PKK, the attack on Wednesday was believed to be Turkey's largest cross-border ground traffic in Iraq.

reference_spacy_tokens: Since the 2008 attack on the PKK , the attack on Wednesday was believed to be Turkey 's largest cross - border ground traffic in Iraq .


fn_spacy_tokens_for_baseline: No evidence obtained to date suggests that Al Qa'ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

source_bert_toks: no evidence obtained to date suggests that al q ##a ' ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

reference_raw: There is no evidence gathered so far that Al Qa'ida was in fact able to manufacture a significant amount of chemical or biological agents or to develop an efficient means of delivery, but the intention to do so is clear.

reference_spacy_tokens: There is no evidence gathered so far that Al Qa'ida was in fact able to manufacture a significant amount of chemical or biological agents or to develop an efficient means of delivery , but the intention to do so is clear .


fn_spacy_tokens_for_baseline: Airfields have been constructed on a number of the islands , and road systems have been expanded and improved .

source_bert_toks: airfields have been constructed on a number of the islands , and road systems have been expanded and improved .

reference_raw: Airfields have been built on many isles and road systems have been expanded and improved.

reference_spacy_tokens: Airfields have been built on many isles and road systems have been expanded and improved .


fn_spacy_tokens_for_baseline: They then set their sights on the islands of the Knights of St. John and , after an unsuccessful siege in 1480 , they finally ejected the knights from the Dodecanese in 1522 .

source_bert_toks: they then set their sights on the islands of the knights of st . john and , after an unsuccessful siege in 148 ##0 , they finally ejected the knights from the dod ##eca ##nese in 152 ##2 .

reference_raw: Then they set their sights on the islands of St. John's Knights and, after a failed siege in 1480, finally ejected the Knights from the Dodecanese in 1522.

reference_spacy_tokens: Then they set their sights on the islands of St. John 's Knights and , after a failed siege in 1480 , finally ejected the Knights from the Dodecanese in 1522 .


fn_spacy_tokens_for_baseline: ' Thank you , ' he tried to say , but it emerged as a blubbery burble .

source_bert_toks: ' thank you , ' he tried to say , but it emerged as a blu ##bber ##y bu ##rb ##le .

reference_raw: 'Thank you,' he said, but it came out like a bubble.

reference_spacy_tokens: ' Thank you , ' he said , but it came out like a bubble .


fn_spacy_tokens_for_baseline: A baffled Civil Guard spokesman said last night : ' We have no leads to go on .

source_bert_toks: a baffled civil guard spokesman said last night : ' we have no leads to go on .

reference_raw: Last night, a confused spokesman from the Civil Guard said, "We have no clue.

reference_spacy_tokens: Last night , a confused spokesman from the Civil Guard said , " We have no clue .


fn_spacy_tokens_for_baseline: White fish and shellfish are easily obtainable fresh , and lance fish , shellfish meat and mysis shrimp are popular frozen foods .

source_bert_toks: white fish and shell ##fish are easily obtain ##able fresh , and lance fish , shell ##fish meat and my ##sis shrimp are popular frozen foods .

reference_raw: White fish and molluscs are easy to obtain fresh, and lance fish, mollusc meat and mysis prawns are popular frozen foods.

reference_spacy_tokens: White fish and molluscs are easy to obtain fresh , and lance fish , mollusc meat and mysis prawns are popular frozen foods .


fn_spacy_tokens_for_baseline: As if someone else had strictly forbidden him to speak .

source_bert_toks: as if someone else had strictly forbidden him to speak .

reference_raw: It's like someone else has strictly banned him from speaking.

reference_spacy_tokens: It 's like someone else has strictly banned him from speaking .


fn_spacy_tokens_for_baseline: With temperatures in the high 30 degree Celsius range and winds around 50 km / h ( 31 Mph ) , fire fighters are bracing for the worst in the Blue Mountains over the next few days .

source_bert_toks: with temperatures in the high 30 degree ce ##ls ##ius range and winds around 50 km / h ( 31 mph ) , fire fighters are bracing for the worst in the blue mountains over the next few days .

reference_raw: The firefighters in the Blue Mountains are preparing for the worst in the next few days, with a high 30 degrees Celsius and a wind of about 50 km/h (31 Mph).

reference_spacy_tokens: The firefighters in the Blue Mountains are preparing for the worst in the next few days , with a high 30 degrees Celsius and a wind of about 50 km / h ( 31 Mph ) .


fn_spacy_tokens_for_baseline: A trolley was heaped with beer cans and plates of half - eaten burgers .

source_bert_toks: a trolley was heap ##ed with beer cans and plates of half - eaten burger ##s .

reference_raw: The cart was piled with beer cans and plates of half-eaten burgers.

reference_spacy_tokens: The cart was piled with beer cans and plates of half - eaten burgers .


fn_spacy_tokens_for_baseline: She had always imagined drug - pushing to be a male - dominated business and had been surprised when the prim - looking blonde in a navy blue duffel coat had approached her .

source_bert_toks: she had always imagined drug - pushing to be a male - dominated business and had been surprised when the pri ##m - looking blonde in a navy blue duff ##el coat had approached her .

reference_raw: She'd always imagined that drug-pushing was a man-dominated business, and she'd been surprised to see a prim-looking blonde in a navy-blue duffel overcoat approach her.

reference_spacy_tokens: She 'd always imagined that drug - pushing was a man - dominated business , and she 'd been surprised to see a prim - looking blonde in a navy - blue duffel overcoat approach her .


fn_spacy_tokens_for_baseline: Most of the recent models of Jupiter have incorporated this feature .

source_bert_toks: most of the recent models of jupiter have incorporated this feature .

reference_raw: Most of Jupiter's recent models have included this feature.

reference_spacy_tokens: Most of Jupiter 's recent models have included this feature .


fn_spacy_tokens_for_baseline: Patsy , shrieking with laughter , chased him down the stairs .

source_bert_toks: patsy , shriek ##ing with laughter , chased him down the stairs .

reference_raw: Screaming with laughter, Patsy followed him down the stairs.

reference_spacy_tokens: Screaming with laughter , Patsy followed him down the stairs .


fn_spacy_tokens_for_baseline: Before war broke out in 1994 , the factories in the town manufactured cotton , fertilizers , food and building materials .

source_bert_toks: before war broke out in 1994 , the factories in the town manufactured cotton , fe ##rti ##lizer ##s , food and building materials .

reference_raw: Before the war began in 1994, factories in the city produced cotton, fertilisers, food and building materials.

reference_spacy_tokens: Before the war began in 1994 , factories in the city produced cotton , fertilisers , food and building materials .


fn_spacy_tokens_for_baseline: Further work is going on in terms of market augmentation to clarify things for consumers . '

source_bert_toks: further work is going on in terms of market aug ##ment ##ation to clarify things for consumers . '

reference_raw: Further work is being done to improve the market and to clarify things for consumers.'

reference_spacy_tokens: Further work is being done to improve the market and to clarify things for consumers . '


fn_spacy_tokens_for_baseline: Civilians no longer were dying , and the destruction of homes and shops had stopped .

source_bert_toks: civilians no longer were dying , and the destruction of homes and shops had stopped .

reference_raw: The civilians were no longer dying, and the devastation of homes and shops had ceased.

reference_spacy_tokens: The civilians were no longer dying , and the devastation of homes and shops had ceased .


fn_spacy_tokens_for_baseline: Hostas love moist clay but suffer very badly from slugs which are always more abundant than on lighter soils .

source_bert_toks: host ##as love moist clay but suffer very badly from slug ##s which are always more abundant than on lighter soils .

reference_raw: Hostas love wet clay, but suffer very badly from bullets that are always richer than on lighter soils.

reference_spacy_tokens: Hostas love wet clay , but suffer very badly from bullets that are always richer than on lighter soils .


fn_spacy_tokens_for_baseline: After an hour the ship emerged from the jungle , and the Shermans found themselves gazing across an open alluvial plain dotted with isolated clumps of palm .

source_bert_toks: after an hour the ship emerged from the jungle , and the sherman ##s found themselves gazing across an open all ##u ##vial plain dotted with isolated cl ##ump ##s of palm .

reference_raw: An hour later, the ship emerged from the forest, and the Shermans found themselves staring across the open aluvial plain, dotted with isolated clusters of palms.

reference_spacy_tokens: An hour later , the ship emerged from the forest , and the Shermans found themselves staring across the open aluvial plain , dotted with isolated clusters of palms .


fn_spacy_tokens_for_baseline: ' I 'll phone them right now .

source_bert_toks: ' i ' ll phone them right now .

reference_raw: 'I'll call them right away.

reference_spacy_tokens: ' I 'll call them right away .


fn_spacy_tokens_for_baseline: I WAS sad and also slightly amused to read the recent letter from a reader about the skilled worker only being offered £ 3 an hour .

source_bert_toks: i was sad and also slightly amused to read the recent letter from a reader about the skilled worker only being offered £3 an hour .

reference_raw: I was sorry, and a little amused, to read a recent letter from a reader that a qualified worker was offered only three pounds an hour.

reference_spacy_tokens: I was sorry , and a little amused , to read a recent letter from a reader that a qualified worker was offered only three pounds an hour .


fn_spacy_tokens_for_baseline: Both men were banned from Switzerland for 10 years but only SFr85,000 of their money was confiscated .

source_bert_toks: both men were banned from switzerland for 10 years but only sf ##r ##85 , 000 of their money was confiscated .

reference_raw: Both men have been banned from Switzerland for 10 years, but only SFR85,000 of their money has been impounded.

reference_spacy_tokens: Both men have been banned from Switzerland for 10 years , but only SFR85,000 of their money has been impounded .


fn_spacy_tokens_for_baseline: The most sumptuous of all the decorations was undoubtedly a huge Chinese Ming - dynasty celadon porcelain vase embellished with elaborate and highly wrought ormolu mounts incorporating ring - toothed lions ' heads of around 1760 .

source_bert_toks: the most sum ##pt ##uous of all the decorations was undoubtedly a huge chinese ming - dynasty ce ##lad ##on porcelain vase em ##bell ##ished with elaborate and highly wrought or ##mo ##lu mounts incorporating ring - tooth ##ed lions ' heads of around 1760 .

reference_raw: The most succinct of all decorations was no doubt a large Chinese Ming-dynasty celadon porcelain vase, embossed in elaborate and highly wrought ormolu mounts containing the heads of the ring-toothed lions of about 1760.

reference_spacy_tokens: The most succinct of all decorations was no doubt a large Chinese Ming - dynasty celadon porcelain vase , embossed in elaborate and highly wrought ormolu mounts containing the heads of the ring - toothed lions of about 1760 .


fn_spacy_tokens_for_baseline: The unit has also provided input into monthly caseworkers ' meetings .

source_bert_toks: the unit has also provided input into monthly case ##work ##ers ' meetings .

reference_raw: The unit also provided information to the meetings of the case-workers in the month.

reference_spacy_tokens: The unit also provided information to the meetings of the case - workers in the month .


fn_spacy_tokens_for_baseline: They clapped in chorus .

source_bert_toks: they clapped in chorus .

reference_raw: They applauded in the choir.

reference_spacy_tokens: They applauded in the choir .


fn_spacy_tokens_for_baseline: All of the six elements discovered by the Darmstadt center are unstable under the natural conditions on earth .

source_bert_toks: all of the six elements discovered by the darmstadt center are unstable under the natural conditions on earth .

reference_raw: All six elements found at the Darmstadt Center are unstable under Earth's natural conditions.

reference_spacy_tokens: All six elements found at the Darmstadt Center are unstable under Earth 's natural conditions .


fn_spacy_tokens_for_baseline: The U.S. State Department defines terrorism differently , as : " Premeditated , politically motivated violence perpetrated against noncombatant targets by sub - national groups or clandestine agents , usually intended to influence an audience . "

source_bert_toks: the u . s . state department defines terrorism differently , as : " prem ##ed ##itated , politically motivated violence per ##pet ##rated against non ##comb ##ata ##nt targets by sub - national groups or clandestine agents , usually intended to influence an audience . "

reference_raw: The U.S. State Department defines terrorism in a different way, as follows: "Premeditated, politically motivated violence committed against non-combatant targets by sub-national groups or secret agents, usually intended to affect the audience."

reference_spacy_tokens: The U.S. State Department defines terrorism in a different way , as follows : " Premeditated , politically motivated violence committed against non - combatant targets by sub - national groups or secret agents , usually intended to affect the audience . "


fn_spacy_tokens_for_baseline: Town 's fans are angry at losing the club 's leading scorer .

source_bert_toks: town ' s fans are angry at losing the club ' s leading scorer .

reference_raw: Town fans are pissed that they've lost the club's leading scorer.

reference_spacy_tokens: Town fans are pissed that they 've lost the club 's leading scorer .


fn_spacy_tokens_for_baseline: She drew back the curtains and the sun streamed into the room .

source_bert_toks: she drew back the curtains and the sun streamed into the room .

reference_raw: She pulled back the curtains and the sun poured into the room.

reference_spacy_tokens: She pulled back the curtains and the sun poured into the room .


fn_spacy_tokens_for_baseline: If one did so now , that would unleash some of the most horrible massacres in the other states of what was Yugoslavia .

source_bert_toks: if one did so now , that would un ##lea ##sh some of the most horrible massacre ##s in the other states of what was yugoslavia .

reference_raw: If one had done so now, it would have unleashed some of the worst massacres in the other countries of Yugoslavia.

reference_spacy_tokens: If one had done so now , it would have unleashed some of the worst massacres in the other countries of Yugoslavia .


fn_spacy_tokens_for_baseline: But once you begin to look underneath this initial veneer of a " do - nothing - in - the - tropics " holiday , it 's like peeling the layers of an onion .

source_bert_toks: but once you begin to look underneath this initial ve ##neer of a " do - nothing - in - the - tr ##op ##ics " holiday , it ' s like peeling the layers of an onion .

reference_raw: But when you start looking under this first veneer of "do-nothing-in-the-tropics" holiday, it's as if you're peeling off layers of onions.

reference_spacy_tokens: But when you start looking under this first veneer of " do - nothing - in - the - tropics " holiday , it 's as if you 're peeling off layers of onions .


fn_spacy_tokens_for_baseline: He quickly shuffled forward on his knees to keep up .

source_bert_toks: he quickly shuffled forward on his knees to keep up .

reference_raw: Quickly, he moved forward on his knees to keep up.

reference_spacy_tokens: Quickly , he moved forward on his knees to keep up .


fn_spacy_tokens_for_baseline: Our research on this topic is much less complete .

source_bert_toks: our research on this topic is much less complete .

reference_raw: Our research on the subject is far less comprehensive.

reference_spacy_tokens: Our research on the subject is far less comprehensive .


fn_spacy_tokens_for_baseline: Janine conquered her fear before I did .

source_bert_toks: jan ##ine conquered her fear before i did .

reference_raw: Janine overcame her fear before me.

reference_spacy_tokens: Janine overcame her fear before me .


fn_spacy_tokens_for_baseline: Outside Caspar was giving short barks and whining .

source_bert_toks: outside cas ##par was giving short bark ##s and w ##hini ##ng .

reference_raw: Outside, Caspar snapped and whined.

reference_spacy_tokens: Outside , Caspar snapped and whined .


fn_spacy_tokens_for_baseline: The passengers on a plane arriving from Istanbul were set on by the pickets at Tegel airport yesterday .

source_bert_toks: the passengers on a plane arriving from istanbul were set on by the picket ##s at te ##gel airport yesterday .

reference_raw: Passengers arriving from Istanbul were on patrol at Tegel Airport yesterday.

reference_spacy_tokens: Passengers arriving from Istanbul were on patrol at Tegel Airport yesterday .


fn_spacy_tokens_for_baseline: Er , there 's a suggestion that he had mild epilepsy , and they tried to keep it quite , and his father tutored him at home .

source_bert_toks: er , there ' s a suggestion that he had mild ep ##ile ##psy , and they tried to keep it quite , and his father tutor ##ed him at home .

reference_raw: Er, there's a suggestion that he had a mild epilepsy, and they tried to keep it clean, and his father taught him at home.

reference_spacy_tokens: Er , there 's a suggestion that he had a mild epilepsy , and they tried to keep it clean , and his father taught him at home .


fn_spacy_tokens_for_baseline: She felt cold , although the central heating had been on all morning , and took a large brown woollen shawl out of a drawer and wrapped it round her as she sat in the beanbag and listened .

source_bert_toks: she felt cold , although the central heating had been on all morning , and took a large brown wool ##len shaw ##l out of a drawer and wrapped it round her as she sat in the bean ##bag and listened .

reference_raw: She felt cold, though the central heat had been on all morning, and she took a large brown woollen scarf from a drawer and wrapped it around her as she sat in a bean bag and listened to it.

reference_spacy_tokens: She felt cold , though the central heat had been on all morning , and she took a large brown woollen scarf from a drawer and wrapped it around her as she sat in a bean bag and listened to it .


fn_spacy_tokens_for_baseline: Their furs were too thick and they could feel very little of each other , but Tallis unfastened his cloak and quickly kissed the cold , taut skin of his throat .

source_bert_toks: their fur ##s were too thick and they could feel very little of each other , but tall ##is un ##fast ##ened his cloak and quickly kissed the cold , taut skin of his throat .

reference_raw: Their furs were too thick to feel much of each other, but Tallis unbuttoned his cloak and kissed quickly the cold, taut skin of his neck.

reference_spacy_tokens: Their furs were too thick to feel much of each other , but Tallis unbuttoned his cloak and kissed quickly the cold , taut skin of his neck .


fn_spacy_tokens_for_baseline: My feeling is , however , that foul play has taken place and that this man is very likely dead .

source_bert_toks: my feeling is , however , that foul play has taken place and that this man is very likely dead .

reference_raw: But I feel like there's been a bad game and the man's probably dead.

reference_spacy_tokens: But I feel like there 's been a bad game and the man 's probably dead .


fn_spacy_tokens_for_baseline: It also fails to substantiate the claim that death - causing acts or omissions in these situations of known danger should fall within the law of manslaughter rather than some other offence .

source_bert_toks: it also fails to sub ##stan ##tia ##te the claim that death - causing acts or om ##iss ##ions in these situations of known danger should fall within the law of mans ##lau ##ght ##er rather than some other offence .

reference_raw: Nor does it support the argument that acts or omissions caused by death in such situations of known danger should be governed by the law of killing and not by any other offence.

reference_spacy_tokens: Nor does it support the argument that acts or omissions caused by death in such situations of known danger should be governed by the law of killing and not by any other offence .


fn_spacy_tokens_for_baseline: When I lived in southern France I used to sit out on the porch and watch the sun go down across the valley .

source_bert_toks: when i lived in southern france i used to sit out on the porch and watch the sun go down across the valley .

reference_raw: When I lived in southern France, I sat on the veranda and watched the sun set across the valley.

reference_spacy_tokens: When I lived in southern France , I sat on the veranda and watched the sun set across the valley .


fn_spacy_tokens_for_baseline: She flounced out of the little shop , hoping he 'd follow her .

source_bert_toks: she fl ##oun ##ced out of the little shop , hoping he ' d follow her .

reference_raw: She flew out of the small store, hoping he would follow her.

reference_spacy_tokens: She flew out of the small store , hoping he would follow her .


fn_spacy_tokens_for_baseline: All ICBMs were transferred to Russia for dismantlement by September 1996 and missile silos and silo structures were destroyed under the U.S. Department of Defense Cooperative Threat Reduction ( CTR ) program by September 1999 .

source_bert_toks: all ic ##bm ##s were transferred to russia for di ##sman ##tlement by september 1996 and missile si ##los and si ##lo structures were destroyed under the u . s . department of defense cooperative threat reduction ( ct ##r ) program by september 1999 .

reference_raw: In September 1996, all ICBMs were transferred to Russia to be dismantled and missile silos and silos were destroyed by the United States Department of Defense Cooperative Threat Reduction Programme (CTR) in September 1999.

reference_spacy_tokens: In September 1996 , all ICBMs were transferred to Russia to be dismantled and missile silos and silos were destroyed by the United States Department of Defense Cooperative Threat Reduction Programme ( CTR ) in September 1999 .


fn_spacy_tokens_for_baseline: China transferred 36 DF-3 medium - range missiles to Saudi Arabia in 1988 , and supplied Pakistan with 34 M-11 short - range missiles in 1992 .

source_bert_toks: china transferred 36 d ##f - 3 medium - range missiles to saudi arabia in 1988 , and supplied pakistan with 34 m - 11 short - range missiles in 1992 .

reference_raw: In 1988, China moved 36 DF-3 medium-range missiles to Saudi Arabia and supplied 34 M-11 short-range missiles to Pakistan in 1992.

reference_spacy_tokens: In 1988 , China moved 36 DF-3 medium - range missiles to Saudi Arabia and supplied 34 M-11 short - range missiles to Pakistan in 1992 .


fn_spacy_tokens_for_baseline: Dr Frome slapped himself violently on the thigh .

source_bert_toks: dr from ##e slapped himself violently on the thigh .

reference_raw: Dr. Frome hit his thigh violently.

reference_spacy_tokens: Dr. Frome hit his thigh violently .


fn_spacy_tokens_for_baseline: He was about to ask her what in the world she was doing in the East End when he was reproached by an angry Sally - Anne .

source_bert_toks: he was about to ask her what in the world she was doing in the east end when he was rep ##ro ##ache ##d by an angry sally - anne .

reference_raw: He was about to ask her what the hell she was doing in the East End when an angry Sally-Anne blamed him.

reference_spacy_tokens: He was about to ask her what the hell she was doing in the East End when an angry Sally - Anne blamed him .


fn_spacy_tokens_for_baseline: It is just as likely that the market , left to itself , would not finance or build nuclear - power stations , not because of the greens but because of their poor rate of return .

source_bert_toks: it is just as likely that the market , left to itself , would not finance or build nuclear - power stations , not because of the greens but because of their poor rate of return .

reference_raw: It is equally probable that the market, left to itself, will not finance or build nuclear power plants, not because of the greens, but because of their low rate of return.

reference_spacy_tokens: It is equally probable that the market , left to itself , will not finance or build nuclear power plants , not because of the greens , but because of their low rate of return .


fn_spacy_tokens_for_baseline: Perhaps she still yearned for him , he thought with a pang of anxiety .

source_bert_toks: perhaps she still year ##ned for him , he thought with a pang of anxiety .

reference_raw: Perhaps she still longed for him, he thought anxiously.

reference_spacy_tokens: Perhaps she still longed for him , he thought anxiously .


fn_spacy_tokens_for_baseline: The road around the reservoir gives good views and woodland trails are always open .

source_bert_toks: the road around the reservoir gives good views and woodland trails are always open .

reference_raw: The road around the tank gives you a good view, and the forest paths are always open.

reference_spacy_tokens: The road around the tank gives you a good view , and the forest paths are always open .


fn_spacy_tokens_for_baseline: It is an immense brick church , dominating the town , with its octagonal tower and steeple and tall west facade , nave and choir ( 555 ) .

source_bert_toks: it is an immense brick church , dominating the town , with its octagonal tower and steep ##le and tall west facade , nave and choir ( 555 ) .

reference_raw: It is a huge brick church that dominates the city, with an octagonal tower and a steeple and a high western facade, a nave and a chorus (555).

reference_spacy_tokens: It is a huge brick church that dominates the city , with an octagonal tower and a steeple and a high western facade , a nave and a chorus ( 555 ) .


fn_spacy_tokens_for_baseline: Throughout the entire 50 minutes of grilling on low heat , Judd Lander sits nervously , looking around for more people to ask questions .

source_bert_toks: throughout the entire 50 minutes of grill ##ing on low heat , judd land ##er sits nervously , looking around for more people to ask questions .

reference_raw: Throughout the 50-minute barbecue at low temperatures, Judd Lander sits nervously, staring around for more people to ask questions.

reference_spacy_tokens: Throughout the 50-minute barbecue at low temperatures , Judd Lander sits nervously , staring around for more people to ask questions .


fn_spacy_tokens_for_baseline: 2- The thickness of the fence should be 60 cm and the distance between it and the building should be 2 meters .

source_bert_toks: 2 - the thickness of the fence should be 60 cm and the distance between it and the building should be 2 meters .

reference_raw: 2- The fence thickness should be 60 cm and the distance between it and the building should be 2 metres.

reference_spacy_tokens: 2- The fence thickness should be 60 cm and the distance between it and the building should be 2 metres .


fn_spacy_tokens_for_baseline: An administration official , briefing reporters on the condition of anonymity , rattled off a list of U.N. agencies and programs that the administration believes have outlived their usefulness .

source_bert_toks: an administration official , briefing reporters on the condition of an ##ony ##mity , rattled off a list of u . n . agencies and programs that the administration believes have out ##li ##ved their useful ##ness .

reference_raw: The government official, who had briefed reporters on the condition of anonymity, had scrapped off a list of UN agencies and programs the government believed to have survived their usefulness.

reference_spacy_tokens: The government official , who had briefed reporters on the condition of anonymity , had scrapped off a list of UN agencies and programs the government believed to have survived their usefulness .


fn_spacy_tokens_for_baseline: Dublin has international restaurants galore , and the New Irish Cuisine is built upon fresh products of Ireland 's seas , rivers , and farms .

source_bert_toks: dublin has international restaurants gal ##ore , and the new irish cuisine is built upon fresh products of ireland ' s seas , rivers , and farms .

reference_raw: There is a galore of international restaurants in Dublin, and the new Irish cuisine is based on fresh products from Irish seas, rivers and farms.

reference_spacy_tokens: There is a galore of international restaurants in Dublin , and the new Irish cuisine is based on fresh products from Irish seas , rivers and farms .


fn_spacy_tokens_for_baseline: Over 2800 private sector dwellings were built between 1931 and 1940 .

source_bert_toks: over 280 ##0 private sector dwellings were built between 1931 and 1940 .

reference_raw: Between 1931 and 1940, more than 2,800 private-sector housing was built.

reference_spacy_tokens: Between 1931 and 1940 , more than 2,800 private - sector housing was built .


fn_spacy_tokens_for_baseline: Tanjug had alleged on Dec. 16 that four brothers who were members of Albania 's ethnic - Greek minority had been tortured and killed in October 1989 for trying to flee the country .

source_bert_toks: tan ##ju ##g had alleged on dec . 16 that four brothers who were members of albania ' s ethnic - greek minority had been tortured and killed in october 1989 for trying to flee the country .

reference_raw: On December 16, Tanjug claimed that four brothers belonging to the Albanian ethnic Greek minority were tortured and killed in October 1989 for fleeing the country.

reference_spacy_tokens: On December 16 , Tanjug claimed that four brothers belonging to the Albanian ethnic Greek minority were tortured and killed in October 1989 for fleeing the country .


fn_spacy_tokens_for_baseline: Had the kidnappers been tracked too clumsily and killed the boy as they fled ?

source_bert_toks: had the kidnap ##pers been tracked too cl ##ums ##ily and killed the boy as they fled ?

reference_raw: Were the kidnappers followed awkwardly and killed the boy on the run?

reference_spacy_tokens: Were the kidnappers followed awkwardly and killed the boy on the run ?


fn_spacy_tokens_for_baseline: The temperature had risen so high that the uranium fuel , and the graphite surrounding it , was literally burning .

source_bert_toks: the temperature had risen so high that the uranium fuel , and the graph ##ite surrounding it , was literally burning .

reference_raw: The temperature was so high that the uranium fuel and the graphite around it were literally on fire.

reference_spacy_tokens: The temperature was so high that the uranium fuel and the graphite around it were literally on fire .


fn_spacy_tokens_for_baseline: However , the Russian Foreign Ministry spokesman refuted the Minatom statement and denied that any discussion had taken place .

source_bert_toks: however , the russian foreign ministry spokesman ref ##uted the mina ##tom statement and denied that any discussion had taken place .

reference_raw: But the spokesman of the Russian Foreign Ministry denied the Minatom statement, denying that there had been any discussion.

reference_spacy_tokens: But the spokesman of the Russian Foreign Ministry denied the Minatom statement , denying that there had been any discussion .


fn_spacy_tokens_for_baseline: Asthma is currently treated with two different drugs taken by inhalation .

source_bert_toks: asthma is currently treated with two different drugs taken by in ##hala ##tion .

reference_raw: Asthma is currently being treated with two different inhaled medicines.

reference_spacy_tokens: Asthma is currently being treated with two different inhaled medicines .


fn_spacy_tokens_for_baseline: Through their work jewellery ceased to be something merely ornamental but attained a level of artistic and symbolic importance it has rarely equalled since .

source_bert_toks: through their work jewellery ceased to be something merely ornamental but attained a level of artistic and symbolic importance it has rarely equal ##led since .

reference_raw: Through their work, jewellery was no longer merely ornamental, but it had achieved a level of artistic and symbolic importance that had rarely been the same since.

reference_spacy_tokens: Through their work , jewellery was no longer merely ornamental , but it had achieved a level of artistic and symbolic importance that had rarely been the same since .


fn_spacy_tokens_for_baseline: Reverence for the countryside and Buddha , dignity and pride run deep in this intensely respectful country .

source_bert_toks: rev ##erence for the countryside and buddha , dignity and pride run deep in this intensely respectful country .

reference_raw: Respect for the countryside and Buddha, dignity and pride run deep in this highly respectable land.

reference_spacy_tokens: Respect for the countryside and Buddha , dignity and pride run deep in this highly respectable land .


fn_spacy_tokens_for_baseline: ' Well , I 'm in a respectable dress , ' she countered coolly .

source_bert_toks: ' well , i ' m in a respectable dress , ' she countered cool ##ly .

reference_raw: "Well, I'm wearing a decent dress," she said coldly.

reference_spacy_tokens: " Well , I 'm wearing a decent dress , " she said coldly .


fn_spacy_tokens_for_baseline: Portugal 's very precarious foothold on the Asian coast ended in 1999 with a formal handover to China .

source_bert_toks: portugal ' s very pre ##car ##ious foot ##hold on the asian coast ended in 1999 with a formal hand ##over to china .

reference_raw: Portugal's very uncertain foothold on the Asian coast wound up with a formal handover to China in 1999.

reference_spacy_tokens: Portugal 's very uncertain foothold on the Asian coast wound up with a formal handover to China in 1999 .


fn_spacy_tokens_for_baseline: In some panic Coetzee contacted his former police superiors .

source_bert_toks: in some panic coe ##tze ##e contacted his former police superiors .

reference_raw: In some sort of panic, Coetzee reached out to his former police officers.

reference_spacy_tokens: In some sort of panic , Coetzee reached out to his former police officers .


fn_spacy_tokens_for_baseline: Remember that you are not alone in experiencing discouragement .

source_bert_toks: remember that you are not alone in experiencing discourage ##ment .

reference_raw: Remember, you're not the only one who experiences deterrence.

reference_spacy_tokens: Remember , you 're not the only one who experiences deterrence .


fn_spacy_tokens_for_baseline: A councillor who 's facing a legal bill of a third of a million pounds after a failed libel case has lodged an appeal against having to pay .

source_bert_toks: a councillor who ' s facing a legal bill of a third of a million pounds after a failed libel case has lodged an appeal against having to pay .

reference_raw: The councillor, facing a legal bill of one-third of a million pounds after a failed libel case, filed a complaint against the need to pay.

reference_spacy_tokens: The councillor , facing a legal bill of one - third of a million pounds after a failed libel case , filed a complaint against the need to pay .


fn_spacy_tokens_for_baseline: She collected the money for his drink , and got away from him as fast as she could .

source_bert_toks: she collected the money for his drink , and got away from him as fast as she could .

reference_raw: She picked up his drink money and left him as quickly as she could.

reference_spacy_tokens: She picked up his drink money and left him as quickly as she could .


fn_spacy_tokens_for_baseline: The convention was adopted by the UN General Assembly in April last year on Russia 's initiative .

source_bert_toks: the convention was adopted by the un general assembly in april last year on russia ' s initiative .

reference_raw: On the initiative of Russia, the Convention was approved by the United Nations General Assembly last April.

reference_spacy_tokens: On the initiative of Russia , the Convention was approved by the United Nations General Assembly last April .


fn_spacy_tokens_for_baseline: Furthermore , the trial in Norway was conducted during a period of consistent decrease in the prevalence of smoking among young people in the country and while a comprehensive tobacco control programme was being introduced .

source_bert_toks: furthermore , the trial in norway was conducted during a period of consistent decrease in the prevalence of smoking among young people in the country and while a comprehensive tobacco control programme was being introduced .

reference_raw: In addition, a study was carried out in Norway during a period of continuous reduction in the prevalence of smoking among young people in the country and during the implementation of a comprehensive tobacco control programme.

reference_spacy_tokens: In addition , a study was carried out in Norway during a period of continuous reduction in the prevalence of smoking among young people in the country and during the implementation of a comprehensive tobacco control programme .


fn_spacy_tokens_for_baseline: What was in the bottle that he had thus publicly drained to the last drop ?

source_bert_toks: what was in the bottle that he had thus publicly drained to the last drop ?

reference_raw: What was in the bottle he had so publicly emptied to the last drop?

reference_spacy_tokens: What was in the bottle he had so publicly emptied to the last drop ?


fn_spacy_tokens_for_baseline: A rapist ( Judd Hirsch ) sues his victim ( Veronica Hamel ) for libel .

source_bert_toks: a rap ##ist ( judd hirsch ) sue ##s his victim ( veronica ham ##el ) for libel .

reference_raw: The violent man (Judd Hirsch) is suing his victim (Veronica Hamel) for libel.

reference_spacy_tokens: The violent man ( Judd Hirsch ) is suing his victim ( Veronica Hamel ) for libel .


fn_spacy_tokens_for_baseline: They lay on deckbeds on the main deck sipping champagne under the blue awning .

source_bert_toks: they lay on deck ##bed ##s on the main deck sipping champagne under the blue aw ##ning .

reference_raw: They lay on deck beds on the main deck, drinking champagne under the blue awning.

reference_spacy_tokens: They lay on deck beds on the main deck , drinking champagne under the blue awning .


fn_spacy_tokens_for_baseline: ABOVE : Port Mill , showing its proximity to the canal basin .

source_bert_toks: above : port mill , showing its proximity to the canal basin .

reference_raw: Port Mill, showing its closeness to the canal basin.

reference_spacy_tokens: Port Mill , showing its closeness to the canal basin .