fn_spacy_tokens_for_baseline: The Assyrian poem The Epic of Gilgamesh is regularly punctuated by dreams , both of the hero and his great friend Enkidu .

source_bert_toks: the assyrian poem the epic of gil ##games ##h is regularly pun ##ctuated by dreams , both of the hero and his great friend en ##ki ##du .

reference_raw: The Assyrian poem The Gilgamesh episode is regularly punctuated by dreams of both the hero and his great friend Enkidu.

reference_spacy_tokens: The Assyrian poem The Gilgamesh episode is regularly punctuated by dreams of both the hero and his great friend Enkidu .


fn_spacy_tokens_for_baseline: It was the second time witnesses had failed to turn up for Tapping 's trial .

source_bert_toks: it was the second time witnesses had failed to turn up for tapping ' s trial .

reference_raw: This was the second one the witnesses didn't show up for Tapping's trial.

reference_spacy_tokens: This was the second one the witnesses did n't show up for Tapping 's trial .


fn_spacy_tokens_for_baseline: The young man pulled on his hood .

source_bert_toks: the young man pulled on his hood .

reference_raw: The young man pulled on his cape.

reference_spacy_tokens: The young man pulled on his cape .


fn_spacy_tokens_for_baseline: When they closed the wedding chapels , brothels , and even the 24-hour casinos in Nevada early this month , I knew that disaster had truly struck .

source_bert_toks: when they closed the wedding chapels , brothel ##s , and even the 24 - hour casinos in nevada early this month , i knew that disaster had truly struck .

reference_raw: When the wedding chapels, whorehouses, and even 24-hour casinos in Nevada were closed at the beginning of the month, I knew that disaster had really hit me.

reference_spacy_tokens: When the wedding chapels , whorehouses , and even 24-hour casinos in Nevada were closed at the beginning of the month , I knew that disaster had really hit me .


fn_spacy_tokens_for_baseline: Modern Yugoslavia sat athwart fault lines of European history : the fourth - century division of the Roman empire , the 11th - century division of Christendom , the 17th - century border between the Ottoman and Habsburg empires .

source_bert_toks: modern yugoslavia sat at ##hwa ##rt fault lines of european history : the fourth - century division of the roman empire , the 11th - century division of christ ##end ##om , the 17th - century border between the ottoman and habsburg empires .

reference_raw: Modern Yugoslavia sat on the fault lines of European history: the fourth-century division of the Roman Empire, the 11th-century division of Christianity, the 17th-century border between the Ottoman and Habsburg empires.

reference_spacy_tokens: Modern Yugoslavia sat on the fault lines of European history : the fourth - century division of the Roman Empire , the 11th - century division of Christianity , the 17th - century border between the Ottoman and Habsburg empires .


fn_spacy_tokens_for_baseline: ' I seem to have sprained my ankle as I fell .

source_bert_toks: ' i seem to have sp ##rained my ankle as i fell .

reference_raw: 'Looks like I twisted my ankle when I fell.

reference_spacy_tokens: ' Looks like I twisted my ankle when I fell .


fn_spacy_tokens_for_baseline: I would like to reassure Ian McLaren ( Points of View , today ) that garden birds on the West Coast are thriving .

source_bert_toks: i would like to reassure ian mclaren ( points of view , today ) that garden birds on the west coast are thriving .

reference_raw: I'd like to assure Ian McLaren that the West Coast gardeners are prospering.

reference_spacy_tokens: I 'd like to assure Ian McLaren that the West Coast gardeners are prospering .


fn_spacy_tokens_for_baseline: This was not the operations room of a naval warship or a secret room in the White House but my modest office above a restaurant in north London .

source_bert_toks: this was not the operations room of a naval warship or a secret room in the white house but my modest office above a restaurant in north london .

reference_raw: This was not the naval warship's operating room or the White House's hidden room, but my humble office above the North London restaurant.

reference_spacy_tokens: This was not the naval warship 's operating room or the White House 's hidden room , but my humble office above the North London restaurant .


fn_spacy_tokens_for_baseline: The boards of both organizations eschewed impact litigation in favor of the 1960s model of providing direct client services .

source_bert_toks: the boards of both organizations es ##che ##wed impact litigation in favor of the 1960s model of providing direct client services .

reference_raw: The councils of both organisations eschewed an impact litigation in favour of the model of the provision of direct client services in the 1960s.

reference_spacy_tokens: The councils of both organisations eschewed an impact litigation in favour of the model of the provision of direct client services in the 1960s .


fn_spacy_tokens_for_baseline: Tawno Smith surveyed the new decor with only a partial satisfaction .

source_bert_toks: ta ##wn ##o smith surveyed the new decor with only a partial satisfaction .

reference_raw: Tawno Smith studied the new decor with only partial satisfaction.

reference_spacy_tokens: Tawno Smith studied the new decor with only partial satisfaction .


fn_spacy_tokens_for_baseline: Their possessing familiars are sharp - tongued vipers which berate the women 's husbands in a fashion that no self - respecting man could tolerate directly from his wife .

source_bert_toks: their possessing familiar ##s are sharp - tongue ##d viper ##s which be ##rate the women ' s husbands in a fashion that no self - respecting man could tolerate directly from his wife .

reference_raw: Their own familiarity is a sharp-tongued viper that berthes women's husbands in a way that no self-respecting man can tolerate directly from his wife.

reference_spacy_tokens: Their own familiarity is a sharp - tongued viper that berthes women 's husbands in a way that no self - respecting man can tolerate directly from his wife .


fn_spacy_tokens_for_baseline: As I slept off the last of my baggitis , sweet visions of castles , fountains and autumn leaves drifted through my dreams .

source_bert_toks: as i slept off the last of my bag ##git ##is , sweet visions of castles , fountains and autumn leaves drifted through my dreams .

reference_raw: As I slept from my last baggitis, my dreams were filled with sweet visions of castles, fountains, and autumn leaves.

reference_spacy_tokens: As I slept from my last baggitis , my dreams were filled with sweet visions of castles , fountains , and autumn leaves .


fn_spacy_tokens_for_baseline: The ground shakes , a slight wind ripples and mushroom clouds rise from massive controlled explosions of 2,000 pounds or more of captured weapon caches from Saddam Hussein 's forces .

source_bert_toks: the ground shakes , a slight wind ripple ##s and mushroom clouds rise from massive controlled explosions of 2 , 000 pounds or more of captured weapon cache ##s from saddam hussein ' s forces .

reference_raw: The ground trembles, a slight wind ripples, and mushroom clouds rise from massive controlled blasts of two thousand pounds or more of Saddam Hussein's captured weapons caches.

reference_spacy_tokens: The ground trembles , a slight wind ripples , and mushroom clouds rise from massive controlled blasts of two thousand pounds or more of Saddam Hussein 's captured weapons caches .


fn_spacy_tokens_for_baseline: Yet I recently visited a hi - tech company which was fully conversant with activity - based costing yet did not do it on a regular annual basis .

source_bert_toks: yet i recently visited a hi - tech company which was fully con ##vers ##ant with activity - based costing yet did not do it on a regular annual basis .

reference_raw: However, I recently visited a high-tech company that was fully converging on the cost of activities, but did not do so regularly every year.

reference_spacy_tokens: However , I recently visited a high - tech company that was fully converging on the cost of activities , but did not do so regularly every year .


fn_spacy_tokens_for_baseline: Ambito referred to Maradona in a front - page article last week as " a big mouth . "

source_bert_toks: am ##bit ##o referred to mara ##don ##a in a front - page article last week as " a big mouth . "

reference_raw: In the front page article last week, Ambito referred to Maradona as "a big kiss."

reference_spacy_tokens: In the front page article last week , Ambito referred to Maradona as " a big kiss . "


fn_spacy_tokens_for_baseline: Mettwurst is similar to Teewurst but is always made from a mixture of pork and beef , is very smoky and often contains paprika to give it a more spicy flavour .

source_bert_toks: met ##t ##wu ##rst is similar to tee ##wu ##rst but is always made from a mixture of pork and beef , is very smoky and often contains pa ##pr ##ika to give it a more spicy flavour .

reference_raw: Mettwurst is similar to Teewurst, but it is always made of a mixture of pork and beef, is very smoky and often contains peppers which give it a sharper taste.

reference_spacy_tokens: Mettwurst is similar to Teewurst , but it is always made of a mixture of pork and beef , is very smoky and often contains peppers which give it a sharper taste .


fn_spacy_tokens_for_baseline: The first quarter figures showed that problems remain in its key consumer electronics market , which used to account for about half the group 's total revenue .

source_bert_toks: the first quarter figures showed that problems remain in its key consumer electronics market , which used to account for about half the group ' s total revenue .

reference_raw: Figures in the first quarter indicate that problems persist in the main consumer electronics market, which used to account for about half of the total income of the group.

reference_spacy_tokens: Figures in the first quarter indicate that problems persist in the main consumer electronics market , which used to account for about half of the total income of the group .


fn_spacy_tokens_for_baseline: His anxiety mounted as telexes were left unanswered and calls blocked by Martin Huckerby , another Wapping refusenik whom Sutton had recruited as the paper 's managing editor .

source_bert_toks: his anxiety mounted as tel ##ex ##es were left una ##ns ##wer ##ed and calls blocked by martin hu ##cker ##by , another wa ##pping refuse ##nik whom sutton had recruited as the paper ' s managing editor .

reference_raw: His anxiety increased as telexes were left unanswered, and calls were blocked by Martin Huckerby, another Wapping refusenik that Sutton had recruited as the editor of the newspaper.

reference_spacy_tokens: His anxiety increased as telexes were left unanswered , and calls were blocked by Martin Huckerby , another Wapping refusenik that Sutton had recruited as the editor of the newspaper .


fn_spacy_tokens_for_baseline: She could be no more than six weeks pregnant but she had put on the sloppiest sweater she could find and she pulled it down self - consciously now .

source_bert_toks: she could be no more than six weeks pregnant but she had put on the sl ##op ##pies ##t sweater she could find and she pulled it down self - consciously now .

reference_raw: She couldn't have been more than six weeks pregnant, but she'd put on the slipper she'd found, and now she'd pulled it down with self-consciousness.

reference_spacy_tokens: She could n't have been more than six weeks pregnant , but she 'd put on the slipper she 'd found , and now she 'd pulled it down with self - consciousness .


fn_spacy_tokens_for_baseline: The first 24 hours are the most critical . "

source_bert_toks: the first 24 hours are the most critical . "

reference_raw: The first 24 hours are the most important ones.

reference_spacy_tokens: The first 24 hours are the most important ones .


fn_spacy_tokens_for_baseline: The faithful pushed past him , round him , and over him as if he were invisible , a stage property in their way .

source_bert_toks: the faithful pushed past him , round him , and over him as if he were invisible , a stage property in their way .

reference_raw: The believers pushed past him, around him, and above him as if he were invisible, a stage property in their path.

reference_spacy_tokens: The believers pushed past him , around him , and above him as if he were invisible , a stage property in their path .


fn_spacy_tokens_for_baseline: Negotiations between Israel and the Palestinian authority have finally resumed .

source_bert_toks: negotiations between israel and the palestinian authority have finally resumed .

reference_raw: Finally, discussions between Israel and the Palestinian Authority continued.

reference_spacy_tokens: Finally , discussions between Israel and the Palestinian Authority continued .


fn_spacy_tokens_for_baseline: IOP is increased during the dark period of the day

source_bert_toks: io ##p is increased during the dark period of the day

reference_raw: The IOP increases during the dusk period of the day


fn_spacy_tokens_for_baseline: Yet can we really take it for granted that parents are so utterly changeless in their behaviour and attitudes to their children ?

source_bert_toks: yet can we really take it for granted that parents are so utterly change ##less in their behaviour and attitudes to their children ?

reference_raw: But can we really take it for granted that the mother and father are so completely unchanging in their behavior and attitude towards their children?

reference_spacy_tokens: But can we really take it for granted that the mother and father are so completely unchanging in their behavior and attitude towards their children ?


fn_spacy_tokens_for_baseline: It is indeed the room which interests them -- the room , the space , into which a Trans - Siberian stowaway may be fitted .

source_bert_toks: it is indeed the room which interests them - - the room , the space , into which a trans - siberian st ##owa ##way may be fitted .

reference_raw: They really care about the room, the room, the space in which a Trans-Siberian stowaway can be installed.

reference_spacy_tokens: They really care about the room , the room , the space in which a Trans - Siberian stowaway can be installed .


fn_spacy_tokens_for_baseline: As he left that all - too - familiar graveyard and tramped home through the snow , Charles the Cheesemonger must have thought that the century was drawing to an unpropitious end indeed .

source_bert_toks: as he left that all - too - familiar graveyard and tram ##ped home through the snow , charles the cheese ##mon ##ger must have thought that the century was drawing to an un ##pro ##pit ##ious end indeed .

reference_raw: When he left the all-too-familiar cemetery and walked home in the snow, Charles the Cheesemonger must have thought that the century had indeed come to an unseemly end.

reference_spacy_tokens: When he left the all - too - familiar cemetery and walked home in the snow , Charles the Cheesemonger must have thought that the century had indeed come to an unseemly end .


fn_spacy_tokens_for_baseline: Hamish took off his war bonnet and scratched his head .

source_bert_toks: hamish took off his war bonnet and scratched his head .

reference_raw: Hamish removed his war hood and scratched his head.

reference_spacy_tokens: Hamish removed his war hood and scratched his head .


fn_spacy_tokens_for_baseline: He talked about the murder victim sprawled across the pavement , and then wandered off into a conversation about a comedian called Ken Dodd .

source_bert_toks: he talked about the murder victim sprawled across the pavement , and then wandered off into a conversation about a comedian called ken dodd .

reference_raw: He talked about the murder victim lying on the sidewalk, then went off to talk about a comedian named Ken Dodd.

reference_spacy_tokens: He talked about the murder victim lying on the sidewalk , then went off to talk about a comedian named Ken Dodd .


fn_spacy_tokens_for_baseline: I can promise that the Department will take vigorous action where there are good cases .

source_bert_toks: i can promise that the department will take vigorous action where there are good cases .

reference_raw: I can promise the department will take decisive action when there's a good case.

reference_spacy_tokens: I can promise the department will take decisive action when there 's a good case .


fn_spacy_tokens_for_baseline: The programme was filmed in front of a live audience who had to clap , laugh and commiserate in all the appropriate places .

source_bert_toks: the programme was filmed in front of a live audience who had to clap , laugh and com ##mise ##rate in all the appropriate places .

reference_raw: The program was recorded in front of a live audience who had to applaud, laugh and commiserate in all appropriate places.

reference_spacy_tokens: The program was recorded in front of a live audience who had to applaud , laugh and commiserate in all appropriate places .


fn_spacy_tokens_for_baseline: Leonie hunched on the bedside chair and lapped up comics , while Therese dozed .

source_bert_toks: leon ##ie hunched on the bedside chair and lap ##ped up comics , while therese do ##zed .

reference_raw: Leonie crouched in a bedside chair, lapping comics while Theresa dozed.

reference_spacy_tokens: Leonie crouched in a bedside chair , lapping comics while Theresa dozed .


fn_spacy_tokens_for_baseline: Unfortunately , perhaps , it does n't work that way as most younger teens show a commendable desire to make up their own minds on subjects such as this .

source_bert_toks: unfortunately , perhaps , it doesn ' t work that way as most younger teens show a com ##men ##dable desire to make up their own minds on subjects such as this .

reference_raw: Sadly, it may not work that way, since most young teenagers have a laudable desire to make up their minds about things like this.

reference_spacy_tokens: Sadly , it may not work that way , since most young teenagers have a laudable desire to make up their minds about things like this .


fn_spacy_tokens_for_baseline: I certainly felt sad , as I pictured the French girl standing in the middle of the field waving goodbye .

source_bert_toks: i certainly felt sad , as i pictured the french girl standing in the middle of the field waving goodbye .

reference_raw: I'm sure I was sad when I pictured a French girl standing in the center of a field waving good-bye.

reference_spacy_tokens: I 'm sure I was sad when I pictured a French girl standing in the center of a field waving good - bye .


fn_spacy_tokens_for_baseline: A MAN has to be either rich or crazy to make films in Latin America these days .

source_bert_toks: a man has to be either rich or crazy to make films in latin america these days .

reference_raw: Man must be either rich or insane to make movies in Latin America these days.

reference_spacy_tokens: Man must be either rich or insane to make movies in Latin America these days .


fn_spacy_tokens_for_baseline: Littered with well - played character parts , the show leaves a lasting comic impression and the dazzling vocabulary of alchemical mumbo - jumbo is in itself a feast .

source_bert_toks: littered with well - played character parts , the show leaves a lasting comic impression and the dazzling vocabulary of al ##chemical mum ##bo - ju ##mbo is in itself a feast .

reference_raw: Littered with well-played character parts, the show leaves a permanent comic impression, and the dazzling vocabulary of alchemical mumbo-jumbo is itself a banquet.

reference_spacy_tokens: Littered with well - played character parts , the show leaves a permanent comic impression , and the dazzling vocabulary of alchemical mumbo - jumbo is itself a banquet .


fn_spacy_tokens_for_baseline: In case anything went wrong , I was prepared to make a dash for Armstrong .

source_bert_toks: in case anything went wrong , i was prepared to make a dash for armstrong .

reference_raw: In case something went wrong, I was ready to do something for Armstrong.

reference_spacy_tokens: In case something went wrong , I was ready to do something for Armstrong .


fn_spacy_tokens_for_baseline: Another new type of terrorist organization focuses on a single , hotly disputed issue such as abortion , animal rights , environmental protection , or genetic engineering .

source_bert_toks: another new type of terrorist organization focuses on a single , hot ##ly disputed issue such as abortion , animal rights , environmental protection , or genetic engineering .

reference_raw: Another new type of terrorist organisation focuses on a single, hotly questioned issue, such as abortion, animal rights, protecting the environment or genetic engineering.

reference_spacy_tokens: Another new type of terrorist organisation focuses on a single , hotly questioned issue , such as abortion , animal rights , protecting the environment or genetic engineering .


fn_spacy_tokens_for_baseline: 3 ) Republican congressional representatives , because of their belief in a minimalist state , are less willing to engage in local benefit - seeking than are Democratic members of Congress .

source_bert_toks: 3 ) republican congressional representatives , because of their belief in a minimal ##ist state , are less willing to engage in local benefit - seeking than are democratic members of congress .

reference_raw: (3) Representatives of the Republican Congress, because of their belief in a minimalist state, are less willing to participate in the search for regional benefits than the Democratic members of Congress.

reference_spacy_tokens: ( 3 ) Representatives of the Republican Congress , because of their belief in a minimalist state , are less willing to participate in the search for regional benefits than the Democratic members of Congress .


fn_spacy_tokens_for_baseline: Intelligence was also a critical factor for Bray who interpreted adaptability as ' a trained intelligence ' .

source_bert_toks: intelligence was also a critical factor for bray who interpreted adapt ##ability as ' a trained intelligence ' .

reference_raw: Intelligence was also a critical factor for Bray, who understood adaptability as "trained intelligence."

reference_spacy_tokens: Intelligence was also a critical factor for Bray , who understood adaptability as " trained intelligence . "


fn_spacy_tokens_for_baseline: It would probably be better to drop in at The Times ' party , see who he could find to have dinner with and take pot luck in a town not noted for its restaurants .

source_bert_toks: it would probably be better to drop in at the times ' party , see who he could find to have dinner with and take pot luck in a town not noted for its restaurants .

reference_raw: I think it'd be better if we stopped by the Times party, saw who he could find for dinner with, and took pot luck in a city that wasn't registered to the restaurants.

reference_spacy_tokens: I think it 'd be better if we stopped by the Times party , saw who he could find for dinner with , and took pot luck in a city that was n't registered to the restaurants .


fn_spacy_tokens_for_baseline: Iain dipped into his briefcase and pulled out a photograph .

source_bert_toks: iain dipped into his briefcase and pulled out a photograph .

reference_raw: Iain dipped into his suitcase and took out a photograph.

reference_spacy_tokens: Iain dipped into his suitcase and took out a photograph .


fn_spacy_tokens_for_baseline: The woman gave a nervous start , her hands jerking in a little , agitated movement .

source_bert_toks: the woman gave a nervous start , her hands jerking in a little , agitated movement .

reference_raw: The woman started nervously, her hands twitching slightly, excitedly.

reference_spacy_tokens: The woman started nervously , her hands twitching slightly , excitedly .


fn_spacy_tokens_for_baseline: Martha replied , and left her twin sister blinking in astonishment at a possibility that had n't occurred to her before , but which was now enticingly attractive .

source_bert_toks: martha replied , and left her twin sister blinking in astonishment at a possibility that hadn ' t occurred to her before , but which was now en ##tic ##ingly attractive .

reference_raw: Martha answered, leaving her twin twin twinkling in surprise at the possibility she had never thought of before, but which was now temptingly attractive.

reference_spacy_tokens: Martha answered , leaving her twin twin twinkling in surprise at the possibility she had never thought of before , but which was now temptingly attractive .


fn_spacy_tokens_for_baseline: ' I was trapped into it ! ' blustered the tenor .

source_bert_toks: ' i was trapped into it ! ' blu ##stered the tenor .

reference_raw: 'I've been trapped in it!' said the tenor.

reference_spacy_tokens: ' I 've been trapped in it ! ' said the tenor .


fn_spacy_tokens_for_baseline: Following a recent conference , the investigators are initiating a programme on European unemployment coordinated by R Layard and J Dreze ( from Louvain ) .

source_bert_toks: following a recent conference , the investigators are initiating a programme on european unemployment coordinated by r lay ##ard and j dr ##ez ##e ( from lou ##va ##in ) .

reference_raw: After a recent conference, researchers are launching a European Unemployment Programme coordinated by R Layard and J Dreze (from Louvain).

reference_spacy_tokens: After a recent conference , researchers are launching a European Unemployment Programme coordinated by R Layard and J Dreze ( from Louvain ) .


fn_spacy_tokens_for_baseline: The distributions of cells in G1 , S and G2 / M , in the presence or absence of C / EBP ? expression , were similar for cells grown for 24 ( reported here ) , 48 or 72 hours ( data not shown ) prior to nocodazole addition .

source_bert_toks: the distributions of cells in g ##1 , s and g ##2 / m , in the presence or absence of c / e ##b ##p ? expression , were similar for cells grown for 24 ( reported here ) , 48 or 72 hours ( data not shown ) prior to no ##co ##da ##zo ##le addition .

reference_raw: Cell distribution in G1, S and G2/M, with or without C/EBP? expression, was similar for cells grown for 24 (reported here), 48 or 72 hours (not reported) before addition of nocodazole.

reference_spacy_tokens: Cell distribution in G1 , S and G2 / M , with or without C / EBP ? expression , was similar for cells grown for 24 ( reported here ) , 48 or 72 hours ( not reported ) before addition of nocodazole .


fn_spacy_tokens_for_baseline: Even money , I 'd go for a nice simple runaway wife or daughter . '

source_bert_toks: even money , i ' d go for a nice simple runaway wife or daughter . '

reference_raw: "Even if I had money, I would have gone after a pretty simple runaway woman or a daughter."

reference_spacy_tokens: " Even if I had money , I would have gone after a pretty simple runaway woman or a daughter . "


fn_spacy_tokens_for_baseline: and have everybody meet someplace where they do not really know

reference_raw: and have everyone come to a place where they don't really know

reference_spacy_tokens: and have everyone come to a place where they do n't really know


fn_spacy_tokens_for_baseline: Still , a certain chiaroscuro grimness attached to their surreal exchange and cries out for some brainless , comic intervention .

source_bert_toks: still , a certain chi ##aro ##scu ##ro grim ##ness attached to their surreal exchange and cries out for some brain ##less , comic intervention .

reference_raw: Yet there was a certain chiaroscuro gloom attached to their surreal exchange, shouting for some kind of mindless, comical intervention.

reference_spacy_tokens: Yet there was a certain chiaroscuro gloom attached to their surreal exchange , shouting for some kind of mindless , comical intervention .


fn_spacy_tokens_for_baseline: Macmillan has won copyright infringement claims against Thomas Reed Publications Ltd and its distributor , Barnacle Marine Ltd.

source_bert_toks: macmillan has won copyright infringement claims against thomas reed publications ltd and its distributor , barn ##acle marine ltd .

reference_raw: Macmillan received claims for copyright violations against Thomas Reed Publications Ltd and its distributor, Barnacle Marine Ltd.

reference_spacy_tokens: Macmillan received claims for copyright violations against Thomas Reed Publications Ltd and its distributor , Barnacle Marine Ltd.


fn_spacy_tokens_for_baseline: The housekeeper showed them into an antechamber bleak as a dentist 's waiting - room .

source_bert_toks: the housekeeper showed them into an ant ##ech ##am ##ber bleak as a dentist ' s waiting - room .

reference_raw: The housekeeper showed them to the anteroom as bleak as a dentist's waiting room.

reference_spacy_tokens: The housekeeper showed them to the anteroom as bleak as a dentist 's waiting room .


fn_spacy_tokens_for_baseline: In 1959 , North Korea and the USSR signed an agreement on the peaceful use of nuclear energy that included a provision for Soviet help to establishment a nuclear research complex in Yo ( ngbyo ( n - kun , North P'yo ( ng'an Province .

source_bert_toks: in 1959 , north korea and the ussr signed an agreement on the peaceful use of nuclear energy that included a provision for soviet help to establishment a nuclear research complex in yo ( ng ##by ##o ( n - kun , north p ' yo ( ng ' an province .

reference_raw: In 1959, North Korea and the Soviet Union signed an agreement on the peaceful use of nuclear energy, including a provision for the Soviets to help set up a nuclear research complex in Yo (N-Kun, North P'yo).

reference_spacy_tokens: In 1959 , North Korea and the Soviet Union signed an agreement on the peaceful use of nuclear energy , including a provision for the Soviets to help set up a nuclear research complex in Yo ( N - Kun , North P'yo ) .


fn_spacy_tokens_for_baseline: The study was testing whether a belief in unlimited , malleable self - control would result in most resolutions , and indeed , this is what was found .

source_bert_toks: the study was testing whether a belief in unlimited , mall ##ea ##ble self - control would result in most resolutions , and indeed , this is what was found .

reference_raw: The study examined whether the belief in unrestricted and malleable self-control would lead to most resolutions, and this was indeed the case.

reference_spacy_tokens: The study examined whether the belief in unrestricted and malleable self - control would lead to most resolutions , and this was indeed the case .


fn_spacy_tokens_for_baseline: He said the children make effective fighters because they are easily influenced , do n't experience fear in the same way as adults and do n't draw as much scrutiny from U. S. forces .

source_bert_toks: he said the children make effective fighters because they are easily influenced , don ' t experience fear in the same way as adults and don ' t draw as much scrutiny from u . s . forces .

reference_raw: He said that children make effective warriors because they're easy to influence, they don't experience fear the way adults do, and they don't draw that much attention from American forces.

reference_spacy_tokens: He said that children make effective warriors because they 're easy to influence , they do n't experience fear the way adults do , and they do n't draw that much attention from American forces .


fn_spacy_tokens_for_baseline: At least if a guy from a local station gets a prominent network job , it reflects well on that station . '

source_bert_toks: at least if a guy from a local station gets a prominent network job , it reflects well on that station . '

reference_raw: At least when a man from a local station gets a high-profile network job, he's a good reflection of the station.'

reference_spacy_tokens: At least when a man from a local station gets a high - profile network job , he 's a good reflection of the station . '


fn_spacy_tokens_for_baseline: We men like to win , and it is quite improper for the servant to be so impudent to the Master as not to allow him to win . '

source_bert_toks: we men like to win , and it is quite improper for the servant to be so imp ##ude ##nt to the master as not to allow him to win . '

reference_raw: We men like to win, and it's not fair for a servant to be so insolent to the Master that he won't win.'

reference_spacy_tokens: We men like to win , and it 's not fair for a servant to be so insolent to the Master that he wo n't win . '


fn_spacy_tokens_for_baseline: The south , with a semi - tropical climate , contains much fertile land for growing coffee , citrus fruits , cereals and soya beans and for raising cattle .

source_bert_toks: the south , with a semi - tropical climate , contains much fertile land for growing coffee , citrus fruits , cereal ##s and soy ##a beans and for raising cattle .

reference_raw: In the south, with a semitropical climate, there is much fertile land for the cultivation of coffee, citrus, cereals and soya beans and cattle.

reference_spacy_tokens: In the south , with a semitropical climate , there is much fertile land for the cultivation of coffee , citrus , cereals and soya beans and cattle .


fn_spacy_tokens_for_baseline: FBI letterhead memorandum , Zacarias Moussaoui , Aug. 21 , 2001 ; CIA cable , subjects involved in suspicious 747 flight training , Aug. 24 , 2001 ; CIA cable , " Zacarias Moussaoui and Husayn'Ali Hasan Ali - Attas , " Aug.

source_bert_toks: fbi letter ##head memorandum , zac ##aria ##s mo ##uss ##ao ##ui , aug . 21 , 2001 ; cia cable , subjects involved in suspicious 747 flight training , aug . 24 , 2001 ; cia cable , " zac ##aria ##s mo ##uss ##ao ##ui and hu ##say ##n ' ali hasan ali - at ##tas , " aug .

reference_raw: FBI letterhead, Zacarias Moussaoui, August 21, 2001; CIA cable, suspect 747 flight training, August 24, 2001; CIA cable, Zacarias Moussaui and Husayn'Ali Hasan Ali-Attas.

reference_spacy_tokens: FBI letterhead , Zacarias Moussaoui , August 21 , 2001 ; CIA cable , suspect 747 flight training , August 24 , 2001 ; CIA cable , Zacarias Moussaui and Husayn'Ali Hasan Ali - Attas .


fn_spacy_tokens_for_baseline: It survived the Great Fire intact and between 1621 and 1638 was the headquarters of the East India Company .

source_bert_toks: it survived the great fire intact and between 1621 and 1638 was the headquarters of the east india company .

reference_raw: Survival of the Great Fire untouched, and from 1621 to 1638 was the headquarters of the East India Company.

reference_spacy_tokens: Survival of the Great Fire untouched , and from 1621 to 1638 was the headquarters of the East India Company .


fn_spacy_tokens_for_baseline: Before opening the file he added his initials to the readership list gummed to the top right corner .

source_bert_toks: before opening the file he added his initials to the readers ##hip list gum ##med to the top right corner .

reference_raw: Before he opened the file, he added his initials to the list of readers chewed into the upper right-hand corner.

reference_spacy_tokens: Before he opened the file , he added his initials to the list of readers chewed into the upper right - hand corner .


fn_spacy_tokens_for_baseline: Redirect the stressful tension or release it , and you increase your ability .

source_bert_toks: red ##ire ##ct the stress ##ful tension or release it , and you increase your ability .

reference_raw: Redirect stress or release, and you'll increase your ability.

reference_spacy_tokens: Redirect stress or release , and you 'll increase your ability .


fn_spacy_tokens_for_baseline: She stared past her father at him .

source_bert_toks: she stared past her father at him .

reference_raw: She looked at him past her father.

reference_spacy_tokens: She looked at him past her father .


fn_spacy_tokens_for_baseline: Saddam 's nightly appearances on television are now greeted , at least in private , with ribald commentary .

source_bert_toks: saddam ' s nightly appearances on television are now greeted , at least in private , with rib ##ald commentary .

reference_raw: Saddam's nocturnal appearance on TV is now greeted, at least privately, with a ribald commentary.

reference_spacy_tokens: Saddam 's nocturnal appearance on TV is now greeted , at least privately , with a ribald commentary .


fn_spacy_tokens_for_baseline: Major Vanavskaya put down the phone and scowled .

source_bert_toks: major van ##avs ##kaya put down the phone and scowled .

reference_raw: Major Vanavskaya put down the phone and frowned.

reference_spacy_tokens: Major Vanavskaya put down the phone and frowned .


fn_spacy_tokens_for_baseline: The Mac may be indispensable for the process of design work , but there is a dangerous temptation to think that desktop publishing makes designing on screen a piece of cake .

source_bert_toks: the mac may be ind ##is ##pen ##sable for the process of design work , but there is a dangerous temptation to think that desktop publishing makes designing on screen a piece of cake .

reference_raw: Mac may be essential to the design process, but there is a dangerous temptation to think that desktop publishing makes design on the screen a slice of cake.

reference_spacy_tokens: Mac may be essential to the design process , but there is a dangerous temptation to think that desktop publishing makes design on the screen a slice of cake .


fn_spacy_tokens_for_baseline: Disgusting -- I 'll report you to the authorities -- perverts !

source_bert_toks: disgusting - - i ' ll report you to the authorities - - per ##vert ##s !

reference_raw: Disgusting - I'll notify you to the authorities - perverts!

reference_spacy_tokens: Disgusting - I 'll notify you to the authorities - perverts !


fn_spacy_tokens_for_baseline: Ruth nibbled at her coloured pencil .

source_bert_toks: ruth ni ##bbled at her coloured pencil .

reference_raw: Ruth bit her colored pencil.

reference_spacy_tokens: Ruth bit her colored pencil .


fn_spacy_tokens_for_baseline: What did he know of the pains and penalties of being a female ?

source_bert_toks: what did he know of the pains and penalties of being a female ?

reference_raw: What did he know about the pain and punishment of being a woman?

reference_spacy_tokens: What did he know about the pain and punishment of being a woman ?


fn_spacy_tokens_for_baseline: The Comecon countries of Europe other than the USSR -- Bulgaria , Czechoslovakia , the GDR , Hungary , Poland and Romania -- are part of Russia 's bulwark against the capitalist West .

source_bert_toks: the come ##con countries of europe other than the ussr - - bulgaria , czechoslovakia , the g ##dr , hungary , poland and romania - - are part of russia ' s bu ##l ##wark against the capitalist west .

reference_raw: Comecon countries other than the USSR - Bulgaria, Czechoslovakia, the Czech Republic, Hungary, Poland, and Romania - are part of Russia's campaign against the capitalist West.

reference_spacy_tokens: Comecon countries other than the USSR - Bulgaria , Czechoslovakia , the Czech Republic , Hungary , Poland , and Romania - are part of Russia 's campaign against the capitalist West .


fn_spacy_tokens_for_baseline: In the study by Chacin et al quoted earlier the stimulatory action of ethanol persisted even in calcium free solutions implying that extracellular calcium is not essential for its action .

source_bert_toks: in the study by cha ##cin et al quoted earlier the st ##im ##ulator ##y action of ethanol persisted even in calcium free solutions implying that extra ##cellular calcium is not essential for its action .

reference_raw: In the Chacin et al study cited above, the stimulation of ethanol continued even in calcium-free solutions, suggesting that extracellular calcium is not necessary for its action.

reference_spacy_tokens: In the Chacin et al study cited above , the stimulation of ethanol continued even in calcium - free solutions , suggesting that extracellular calcium is not necessary for its action .


fn_spacy_tokens_for_baseline: The distinctive features of the novel as a genre are three - fold : it is written , it is fictional , and its principle device is that of narrative .

source_bert_toks: the distinctive features of the novel as a genre are three - fold : it is written , it is fictional , and its principle device is that of narrative .

reference_raw: The characteristics of a novel as a genre are threefold: it is written, fictional, and its principal device is narrative.

reference_spacy_tokens: The characteristics of a novel as a genre are threefold : it is written , fictional , and its principal device is narrative .


fn_spacy_tokens_for_baseline: We 're off rafting with a group of lads from Gloucestershire way . they 're here as part of the National Boys Club activity day .

source_bert_toks: we ' re off raft ##ing with a group of lads from gloucestershire way . they ' re here as part of the national boys club activity day .

reference_raw: We're going to hang out with a bunch of guys from Gloucestershire, and they're here as part of the National Boys Club Activity Day.

reference_spacy_tokens: We 're going to hang out with a bunch of guys from Gloucestershire , and they 're here as part of the National Boys Club Activity Day .


fn_spacy_tokens_for_baseline: The MP vigorously denied assault and said he had been struck by the officer .

source_bert_toks: the mp vigorously denied assault and said he had been struck by the officer .

reference_raw: The MP vigorously refused to attack and said he was hit by an officer.

reference_spacy_tokens: The MP vigorously refused to attack and said he was hit by an officer .


fn_spacy_tokens_for_baseline: The butler bowed slightly and retired , and although his face was expressionless , Katherine could almost feel his displeasure towards the man who now stepped into the room .

source_bert_toks: the butler bowed slightly and retired , and although his face was expression ##less , katherine could almost feel his displeasure towards the man who now stepped into the room .

reference_raw: The butler bowed slightly and retired, and though his face was expressionless, Katherine could almost feel his resentment toward the man who was now entering the room.

reference_spacy_tokens: The butler bowed slightly and retired , and though his face was expressionless , Katherine could almost feel his resentment toward the man who was now entering the room .


fn_spacy_tokens_for_baseline: The thought of Guy walking into the stable as calmly as you please , asking for his horse and riding out in full view of the entire garrison was utterly nerve - racking .

source_bert_toks: the thought of guy walking into the stable as calmly as you please , asking for his horse and riding out in full view of the entire garrison was utterly nerve - rack ##ing .

reference_raw: The thought of Guy entering the stables as calmly as you like, asking for a horse and riding out in full view of the entire crew was quite nerve-rashing.

reference_spacy_tokens: The thought of Guy entering the stables as calmly as you like , asking for a horse and riding out in full view of the entire crew was quite nerve - rashing .


fn_spacy_tokens_for_baseline: Nobody was in any danger from the horse but the plaintiff entered the field and tried to calm the horse and was injured .

source_bert_toks: nobody was in any danger from the horse but the plaintiff entered the field and tried to calm the horse and was injured .

reference_raw: No one was in danger from the horse, but the prosecutor stepped into the field and tried to steady the horse and was wounded.

reference_spacy_tokens: No one was in danger from the horse , but the prosecutor stepped into the field and tried to steady the horse and was wounded .


fn_spacy_tokens_for_baseline: The voters delivered Mr. Gonzalez a third mandate for his successes .

source_bert_toks: the voters delivered mr . gonzalez a third mandate for his successes .

reference_raw: The voters have given him the third mandate for his achievements.

reference_spacy_tokens: The voters have given him the third mandate for his achievements .


fn_spacy_tokens_for_baseline: Each segment of the input word has a set of possible character combinations with a probability score to indicate how close the character matched the character stored in the database .

source_bert_toks: each segment of the input word has a set of possible character combinations with a probability score to indicate how close the character matched the character stored in the database .

reference_raw: Each section of the input word has a set of possible character combinations with a probability score indicating how close the character corresponds to the character stored in the database.

reference_spacy_tokens: Each section of the input word has a set of possible character combinations with a probability score indicating how close the character corresponds to the character stored in the database .


fn_spacy_tokens_for_baseline: There is a sort of joy in persuading the English you are the right person for them by dancing like a stoned Russian .

source_bert_toks: there is a sort of joy in per ##su ##ading the english you are the right person for them by dancing like a stone ##d russian .

reference_raw: There's a certain joy in convincing the English that you're the right person for them to dance like a rocky Russian.

reference_spacy_tokens: There 's a certain joy in convincing the English that you 're the right person for them to dance like a rocky Russian .


fn_spacy_tokens_for_baseline: Royalbion 's most important guests were at the hospitality unit today , hoping for a smile from the Princess .

source_bert_toks: royal ##bio ##n ' s most important guests were at the hospitality unit today , hoping for a smile from the princess .

reference_raw: Royalbion's most important guests were at the hospital today, hoping the princess would laugh.

reference_spacy_tokens: Royalbion 's most important guests were at the hospital today , hoping the princess would laugh .


fn_spacy_tokens_for_baseline: We ate on the boat and landed at Ramsgate at 6.30pm British time .

source_bert_toks: we ate on the boat and landed at rams ##gate at 6 . 30 ##pm british time .

reference_raw: At 6:30 p.m. British time, we had a meal on the boat and landed at Ramsgate.

reference_spacy_tokens: At 6:30 p.m. British time , we had a meal on the boat and landed at Ramsgate .


fn_spacy_tokens_for_baseline: Tedious though this point may be , it is particularly in need of emphasis today , when the value of research is so often judged only by expected and short - term practical applications .

source_bert_toks: ted ##ious though this point may be , it is particularly in need of emphasis today , when the value of research is so often judged only by expected and short - term practical applications .

reference_raw: Tedious as this may be, it is particularly important to emphasise today that the value of research is so often assessed only on the basis of expected and short-term practical applications.

reference_spacy_tokens: Tedious as this may be , it is particularly important to emphasise today that the value of research is so often assessed only on the basis of expected and short - term practical applications .


fn_spacy_tokens_for_baseline: This is evidenced by the fact that most candidates seem well drilled to answer objective - test ( multiple - choice ) questions , but are weaker in the written test .

source_bert_toks: this is evidenced by the fact that most candidates seem well drilled to answer objective - test ( multiple - choice ) questions , but are weaker in the written test .

reference_raw: This is illustrated by the fact that most candidates appear well-trained to respond to objective (multiple-choice) questions, but are weaker in the written test.

reference_spacy_tokens: This is illustrated by the fact that most candidates appear well - trained to respond to objective ( multiple - choice ) questions , but are weaker in the written test .


fn_spacy_tokens_for_baseline: What happened to your post that appeared in my RSS reader yesterday ?

source_bert_toks: what happened to your post that appeared in my rs ##s reader yesterday ?

reference_raw: What happened to your position on my RSS reader last night?

reference_spacy_tokens: What happened to your position on my RSS reader last night ?


fn_spacy_tokens_for_baseline: During the past few years , ZrO 2 has been introduced to dentistry [ 14 15]. The partially stabilized ZrO 2 has a fracture toughness twice that of A 2 O 3 [ 16 ] suggesting that ZrO 2 based copings could become a major competitor to Procera in the future .

source_bert_toks: during the past few years , z ##ro 2 has been introduced to dentistry [ 14 15 ] . the partially stabilized z ##ro 2 has a fracture tough ##ness twice that of a 2 o 3 [ 16 ] suggesting that z ##ro 2 based coping ##s could become a major competitor to pro ##cera in the future .

reference_raw: Over the last few years, Zro 2 has been introduced into dentistry [14 15]. Partially stabilised Zro 2 has a fracture hardness twice that of A 2 O 3 [16], indicating that Zro 2-based coping could become the main competitor of Procera in the future.

reference_spacy_tokens: Over the last few years , Zro 2 has been introduced into dentistry [ 14 15]. Partially stabilised Zro 2 has a fracture hardness twice that of A 2 O 3 [ 16 ] , indicating that Zro 2-based coping could become the main competitor of Procera in the future .


fn_spacy_tokens_for_baseline: This lets you get at the information without having to understand anything about databases and without having to wade through reams of data .

source_bert_toks: this lets you get at the information without having to understand anything about databases and without having to wade through re ##ams of data .

reference_raw: This allows you to access information without needing to know anything about databases and without needing to wade through data reams.

reference_spacy_tokens: This allows you to access information without needing to know anything about databases and without needing to wade through data reams .


fn_spacy_tokens_for_baseline: Just six minutes away is the beautiful picturesque old village of Altea where a lovely old church stands on the top of a hill .

source_bert_toks: just six minutes away is the beautiful picturesque old village of alt ##ea where a lovely old church stands on the top of a hill .

reference_raw: Only six minutes away is the beautiful old village of Altea, where there is a beautiful old church on a hilltop.

reference_spacy_tokens: Only six minutes away is the beautiful old village of Altea , where there is a beautiful old church on a hilltop .


fn_spacy_tokens_for_baseline: Waterways provide the main thoroughfare in the Upper Mazaruni and many of these are already blocked .

source_bert_toks: waterways provide the main thorough ##fare in the upper ma ##zar ##uni and many of these are already blocked .

reference_raw: Waterways provide the main roads in the Upper Mazaruni, many of which are already blocked.

reference_spacy_tokens: Waterways provide the main roads in the Upper Mazaruni , many of which are already blocked .


fn_spacy_tokens_for_baseline: In 1985 he was made Head Gardener of Killerton , an arboretum famous for its rare trees and shrubs .

source_bert_toks: in 1985 he was made head gardener of killer ##ton , an arboretum famous for its rare trees and shrubs .

reference_raw: In 1985, he became the leader of the Garden of Killerton, an arboretum known for its precious trees and bushes.

reference_spacy_tokens: In 1985 , he became the leader of the Garden of Killerton , an arboretum known for its precious trees and bushes .


fn_spacy_tokens_for_baseline: We sang songs and ate foam - tasting cinnamon pastries at gaudy roadstops , in places shaped like bugs with high modern bridges above the road .

source_bert_toks: we sang songs and ate foam - tasting cinnamon past ##ries at ga ##udy roads ##tops , in places shaped like bugs with high modern bridges above the road .

reference_raw: We sang songs and ate foam-tasting cinnamon cakes on gaudy roadstops in places like insects with high-tech bridges above the road.

reference_spacy_tokens: We sang songs and ate foam - tasting cinnamon cakes on gaudy roadstops in places like insects with high - tech bridges above the road .


fn_spacy_tokens_for_baseline: I met a man here once who had made an annual pilgrimage to this spot for forty years .

source_bert_toks: i met a man here once who had made an annual pilgrimage to this spot for forty years .

reference_raw: I met a man here once who'd travelled this place every year for 40 years.

reference_spacy_tokens: I met a man here once who 'd travelled this place every year for 40 years .


fn_spacy_tokens_for_baseline: It is in contrast to another leitmotif that marks the entrances of Carabosse , the wicked fairy .

source_bert_toks: it is in contrast to another lei ##tm ##ot ##if that marks the entrances of cara ##bos ##se , the wicked fairy .

reference_raw: Unlike other leitmotifs, it marks the entrances of Carabosse, the evil fairy.

reference_spacy_tokens: Unlike other leitmotifs , it marks the entrances of Carabosse , the evil fairy .


fn_spacy_tokens_for_baseline: Denmark 's easternmost island on an ancient Baltic trade route has a splendid rich heritage and Mediterranean warmth .

source_bert_toks: denmark ' s eastern ##most island on an ancient baltic trade route has a splendid rich heritage and mediterranean warmth .

reference_raw: The eastmost island of Denmark on the old Baltic trade route has a wonderful wealth of heritage and Mediterranean warmth.

reference_spacy_tokens: The eastmost island of Denmark on the old Baltic trade route has a wonderful wealth of heritage and Mediterranean warmth .


fn_spacy_tokens_for_baseline: He said that in fact the gulden was very healthy , that no cunning ploy against Polish business had been intended , and that everything would be well again within two months .

source_bert_toks: he said that in fact the gu ##lden was very healthy , that no cunning pl ##oy against polish business had been intended , and that everything would be well again within two months .

reference_raw: He said that the gulden was actually very healthy, that no clever trick against the Polish business was meant to be, and that in two months everything would be all right again.

reference_spacy_tokens: He said that the gulden was actually very healthy , that no clever trick against the Polish business was meant to be , and that in two months everything would be all right again .


fn_spacy_tokens_for_baseline: If parents are dissatisfied with a school , they should have the option of switching to another .

source_bert_toks: if parents are dissatisfied with a school , they should have the option of switching to another .

reference_raw: Parents should be able to switch to another if they are not satisfied with a college.

reference_spacy_tokens: Parents should be able to switch to another if they are not satisfied with a college .


fn_spacy_tokens_for_baseline: You 've each won the first prize in our June competition of a Rohan Shearwater Gore - Tex jacket and pair of the company 's famous walking trousers , Rohan bags .

source_bert_toks: you ' ve each won the first prize in our june competition of a rohan shear ##water gore - tex jacket and pair of the company ' s famous walking trousers , rohan bags .

reference_raw: Each of you won the first prize in our June competition for the Rohan Shearwater Gore-Tex jacket and the company's famous walking pants, the Rohan bags.

reference_spacy_tokens: Each of you won the first prize in our June competition for the Rohan Shearwater Gore - Tex jacket and the company 's famous walking pants , the Rohan bags .


fn_spacy_tokens_for_baseline: Training will also be provided ( 2223 , 2239 , 2338 ) .

reference_raw: Education will also be provided (2223, 2239, 2338).

reference_spacy_tokens: Education will also be provided ( 2223 , 2239 , 2338 ) .


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid, but the potential agreement still lacked the key element to confirm that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid , but the potential agreement still lacked the key element to confirm that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: Shabba Rank 's gruff growl has graced over 50 reggae single hits since 1987 , with more than one record a week often hitting the charts .

source_bert_toks: sha ##bba rank ' s gruff growl has grace ##d over 50 reggae single hits since 1987 , with more than one record a week often hitting the charts .

reference_raw: Since 1987, Shabba Rank's gruff grumble has graced more than 50 reggae single hits, and more than one record a week often hits the charts.

reference_spacy_tokens: Since 1987 , Shabba Rank 's gruff grumble has graced more than 50 reggae single hits , and more than one record a week often hits the charts .


fn_spacy_tokens_for_baseline: Mr Barnett has also described how the public school ethos that emerged in the latter half of the last century was suffused by a contempt for technology and ' trade ' .

source_bert_toks: mr barnett has also described how the public school et ##hos that emerged in the latter half of the last century was su ##ff ##used by a contempt for technology and ' trade ' .

reference_raw: Mr Barnett also described how the public school ethos that emerged in the second half of the last century were smothered by a contempt for technology and trade.

reference_spacy_tokens: Mr Barnett also described how the public school ethos that emerged in the second half of the last century were smothered by a contempt for technology and trade .


fn_spacy_tokens_for_baseline: Switching on the bedside light , I got out of bed and fumbled into my bathrobe .

source_bert_toks: switching on the bedside light , i got out of bed and fumbled into my bath ##ro ##be .

reference_raw: I turned on the night light, got out of bed, and fumbled in my robe.

reference_spacy_tokens: I turned on the night light , got out of bed , and fumbled in my robe .


fn_spacy_tokens_for_baseline: After about 650 b.c . , Greek traders entered the competition to exploit Spain 's rich mineral deposits and fertile land .

source_bert_toks: after about 650 b . c . , greek traders entered the competition to exploit spain ' s rich mineral deposits and fertile land .

reference_raw: After approximately 650 b.c., Greek traders entered the competition to exploit the rich mineral deposits and fertile soils of Spain.

reference_spacy_tokens: After approximately 650 b.c . , Greek traders entered the competition to exploit the rich mineral deposits and fertile soils of Spain .


fn_spacy_tokens_for_baseline: Some 750,000 black peasant farmers shared 15,000,000 hectares of largely poor quality ' communal ' land which was being placed under ever increasing pressure by Zimbabwe 's 3.5 per cent annual population growth .

source_bert_toks: some 750 , 000 black peasant farmers shared 15 , 000 , 000 hectares of largely poor quality ' communal ' land which was being placed under ever increasing pressure by zimbabwe ' s 3 . 5 per cent annual population growth .

reference_raw: Some 750,000 black farmers shared 15 000 000 ha of predominantly poor-quality communal land, which was under ever-increasing pressure from Zimbabwe's 3.5% annual population growth.

reference_spacy_tokens: Some 750,000 black farmers shared 15 000 000 ha of predominantly poor - quality communal land , which was under ever - increasing pressure from Zimbabwe 's 3.5 % annual population growth .


fn_spacy_tokens_for_baseline: The Weighted Index advanced 14.82 points to 7,656.85 .

reference_raw: The weighted index went up 14.82 points to 7.656.85.

reference_spacy_tokens: The weighted index went up 14.82 points to 7.656.85 .


fn_spacy_tokens_for_baseline: They simplified the house , knocking down walls , adding bathrooms , and opening it up to the cool summer breezes from the sea .

source_bert_toks: they simplified the house , knocking down walls , adding bathrooms , and opening it up to the cool summer breeze ##s from the sea .

reference_raw: They simplified the house, knocked down the walls, added toilets, and opened it to the cool summer breeze from the sea.

reference_spacy_tokens: They simplified the house , knocked down the walls , added toilets , and opened it to the cool summer breeze from the sea .


fn_spacy_tokens_for_baseline: He had been able to charm more than a few elderly ladies in his time .

source_bert_toks: he had been able to charm more than a few elderly ladies in his time .

reference_raw: In his time, he had been able to enchant more than a few old ladies.

reference_spacy_tokens: In his time , he had been able to enchant more than a few old ladies .


fn_spacy_tokens_for_baseline: He would doubtless suffer this blow to his esteem in a First Folio or a 1532 Chaucer , given half a chance , but in lesser books the wound is too serious .

source_bert_toks: he would doubt ##less suffer this blow to his esteem in a first f ##olio or a 153 ##2 cha ##uce ##r , given half a chance , but in lesser books the wound is too serious .

reference_raw: In the First Folio, or in the 1532 Chaucer, he would undoubtedly have suffered such a blow to his respect, but in the smaller books, the wound was too serious.

reference_spacy_tokens: In the First Folio , or in the 1532 Chaucer , he would undoubtedly have suffered such a blow to his respect , but in the smaller books , the wound was too serious .


fn_spacy_tokens_for_baseline: On Jan. 31 , 1990 , a martial law court in Diyarbakir sentenced Mehmet Ozun to death for murder and for membership of an ' illegal organization ' .

source_bert_toks: on jan . 31 , 1990 , a martial law court in di ##yar ##ba ##kir sentenced me ##hm ##et oz ##un to death for murder and for membership of an ' illegal organization ' .

reference_raw: On January 31, 1990, a court martial in Diyarbakir condemned Mehmet Ozun to death for murder and membership of an illegal organization.

reference_spacy_tokens: On January 31 , 1990 , a court martial in Diyarbakir condemned Mehmet Ozun to death for murder and membership of an illegal organization .


fn_spacy_tokens_for_baseline: We were squatting cross - legged on the floor of the mission house at Nyaung - ngu , half a dozen priests and a dozen men and women teachers .

source_bert_toks: we were squat ##ting cross - legged on the floor of the mission house at ny ##au ##ng - ng ##u , half a dozen priests and a dozen men and women teachers .

reference_raw: We crouched cross-legged on the floor of the Nyaung-ng Mission House, half a dozen priests and a dozen teachers of men and women.

reference_spacy_tokens: We crouched cross - legged on the floor of the Nyaung - ng Mission House , half a dozen priests and a dozen teachers of men and women .


fn_spacy_tokens_for_baseline: Shenzhen is easy to reach - the KCR commuter train runs throughout the day , the trip taking about 40 minutes .

source_bert_toks: shenzhen is easy to reach - the kc ##r commuter train runs throughout the day , the trip taking about 40 minutes .

reference_raw: It's easy to get to Shenzhen - the KCR commuter is running all day, and the trip takes about 40 minutes.

reference_spacy_tokens: It 's easy to get to Shenzhen - the KCR commuter is running all day , and the trip takes about 40 minutes .


fn_spacy_tokens_for_baseline: In the approach of the ' no meaning ' theist , as I have outlined it above , we can now observe a pursuit of religious certainty that undermines faith .

source_bert_toks: in the approach of the ' no meaning ' the ##ist , as i have outlined it above , we can now observe a pursuit of religious certainty that undermine ##s faith .

reference_raw: In the approach of "no meaning" theist, as I have outlined above, we can now observe a search for religious certainty that undermines faith.

reference_spacy_tokens: In the approach of " no meaning " theist , as I have outlined above , we can now observe a search for religious certainty that undermines faith .


fn_spacy_tokens_for_baseline: He wetted his lips in a theatrical way and a glimmer of humour flickered in his eyes .

source_bert_toks: he wet ##ted his lips in a theatrical way and a g ##lim ##mer of humour flickered in his eyes .

reference_raw: He moistened his lips theatrically, and there was a flash of humor in his eyes.

reference_spacy_tokens: He moistened his lips theatrically , and there was a flash of humor in his eyes .


fn_spacy_tokens_for_baseline: While Therese watched , Leonie hung her few clothes in the wardrobe .

source_bert_toks: while therese watched , leon ##ie hung her few clothes in the wardrobe .

reference_raw: While Theresa watched, Leonie draped a few of her clothes in the closet.

reference_spacy_tokens: While Theresa watched , Leonie draped a few of her clothes in the closet .


fn_spacy_tokens_for_baseline: ' There are twelve of his ' Wares billeted in the Circle , ' Ratagan rumbled thoughtfully .

source_bert_toks: ' there are twelve of his ' ware ##s bill ##ete ##d in the circle , ' rat ##aga ##n rumbled thoughtfully .

reference_raw: 'There are twelve of his 'wares in the Circle,' Ratagan said thoughtfully.

reference_spacy_tokens: ' There are twelve of his ' wares in the Circle , ' Ratagan said thoughtfully .


fn_spacy_tokens_for_baseline: ' May -- ' he started to say , but I crammed a cushion into his mouth before he could finish .

source_bert_toks: ' may - - ' he started to say , but i cr ##ammed a cushion into his mouth before he could finish .

reference_raw: "May-" he started to say, but before he could finish, I stuffed the pillow in his mouth.

reference_spacy_tokens: " May- " he started to say , but before he could finish , I stuffed the pillow in his mouth .


fn_spacy_tokens_for_baseline: They 've also got two watches , a ring , a Barclaycard , two bottles of spirits , 100 rounds of ammunition , a Smith & Wesson 9 mm semi - automatic pistol , and a King Cobra .357 Magnum handgun .

source_bert_toks: they ' ve also got two watches , a ring , a barclay ##card , two bottles of spirits , 100 rounds of ammunition , a smith & wes ##son 9 ##mm semi - automatic pistol , and a king cobra . 357 magnum handgun .

reference_raw: They also have two watches, a ring, a barclaycard, two bottles of alcohol, 100 rounds of ammunition, a Smith & Wesson 9mm semi-automatic pistol, and a King Cobra .357 Magnum pistol.

reference_spacy_tokens: They also have two watches , a ring , a barclaycard , two bottles of alcohol , 100 rounds of ammunition , a Smith & Wesson 9 mm semi - automatic pistol , and a King Cobra .357 Magnum pistol .


fn_spacy_tokens_for_baseline: He looked offended but I guessed his idea of discretion was swapping his length of lead pipe for a rubber truncheon .

source_bert_toks: he looked offended but i guessed his idea of discretion was swap ##ping his length of lead pipe for a rubber tr ##un ##cheon .

reference_raw: He looked insulted, but I guessed that his idea of discretion was to trade the length of the lead pipe for a rubber truncheon.

reference_spacy_tokens: He looked insulted , but I guessed that his idea of discretion was to trade the length of the lead pipe for a rubber truncheon .


fn_spacy_tokens_for_baseline: Our assailants were now shooting fire arrows and these were already causing havoc amongst the defenders .

source_bert_toks: our ass ##ail ##ants were now shooting fire arrows and these were already causing havoc amongst the defenders .

reference_raw: Our attackers were firing fire arrows now, and they were already causing havoc among the defenders.

reference_spacy_tokens: Our attackers were firing fire arrows now , and they were already causing havoc among the defenders .


fn_spacy_tokens_for_baseline: Currently , its growing biotechnology industry does have the potential to divert dual - use agents for illicit warfare purposes .

source_bert_toks: currently , its growing biotechnology industry does have the potential to divert dual - use agents for illicit warfare purposes .

reference_raw: At present, its growing biotech industry has the potential to divert dual-use agents for illicit war purposes.

reference_spacy_tokens: At present , its growing biotech industry has the potential to divert dual - use agents for illicit war purposes .


fn_spacy_tokens_for_baseline: Now the resurrection ( an event of another order ) is however the resurrection of the man who died ( a normal event in our world ) .

source_bert_toks: now the resurrection ( an event of another order ) is however the resurrection of the man who died ( a normal event in our world ) .

reference_raw: But now rebirth (an event of a different order) is the rebirth of a man who has died (a normal event in our world).

reference_spacy_tokens: But now rebirth ( an event of a different order ) is the rebirth of a man who has died ( a normal event in our world ) .


fn_spacy_tokens_for_baseline: The bailiffs say the driver became abusive , and they could n't calm him .

source_bert_toks: the bail ##iff ##s say the driver became abusive , and they couldn ' t calm him .

reference_raw: Bailiffs say the driver got violent and couldn't calm him down.

reference_spacy_tokens: Bailiffs say the driver got violent and could n't calm him down .


fn_spacy_tokens_for_baseline: It was my fourth and my belly was still growling .

source_bert_toks: it was my fourth and my belly was still growling .

reference_raw: I was four, and my stomach was still snarling.

reference_spacy_tokens: I was four , and my stomach was still snarling .


fn_spacy_tokens_for_baseline: The effect was instant -- McSwegan tasting the glory of scoring his first goal for Rangers , in such a vital match .

source_bert_toks: the effect was instant - - mc ##sw ##egan tasting the glory of scoring his first goal for rangers , in such a vital match .

reference_raw: The effect was instantaneous, McSwegan enjoying the glory of scored his first goal for the Rangers in such a vital match.

reference_spacy_tokens: The effect was instantaneous , McSwegan enjoying the glory of scored his first goal for the Rangers in such a vital match .


fn_spacy_tokens_for_baseline: Water oozed from their ceilings and plip - plopped into rank pools .

source_bert_toks: water o ##oz ##ed from their ceilings and pl ##ip - pl ##opped into rank pools .

reference_raw: Water poured out of the ceilings and plucked into the ranked pools.

reference_spacy_tokens: Water poured out of the ceilings and plucked into the ranked pools .


fn_spacy_tokens_for_baseline: Martin Richmond , from Chalford in Gloucestershire , and a friend from London , pedalled through the Himalyas to establish what they believed was a new world altitude cycling record .

source_bert_toks: martin richmond , from cha ##lford in gloucestershire , and a friend from london , pedal ##led through the him ##aly ##as to establish what they believed was a new world altitude cycling record .

reference_raw: Martin Richmond, from Chalford in Gloucestershire, and a friend from London, peddled through the Himalyas to find out what they believed to be a new world-wide cycling record.

reference_spacy_tokens: Martin Richmond , from Chalford in Gloucestershire , and a friend from London , peddled through the Himalyas to find out what they believed to be a new world - wide cycling record .


fn_spacy_tokens_for_baseline: As he argued it , he had no option but to skulk in alleys .

source_bert_toks: as he argued it , he had no option but to sk ##ul ##k in alley ##s .

reference_raw: As he argued, he had no choice but to duck in the alleys.

reference_spacy_tokens: As he argued , he had no choice but to duck in the alleys .


fn_spacy_tokens_for_baseline: ' The acquisition of such a high quality contemporary sculpture can only enhance the city 's reputation as a centre for modern , as well as historic , artistic and cultural works .

source_bert_toks: ' the acquisition of such a high quality contemporary sculpture can only enhance the city ' s reputation as a centre for modern , as well as historic , artistic and cultural works .

reference_raw: The acquisition of such high-quality modern statues can only improve the reputation of the city as a centre of modern, historical, artistic and cultural works.

reference_spacy_tokens: The acquisition of such high - quality modern statues can only improve the reputation of the city as a centre of modern , historical , artistic and cultural works .


fn_spacy_tokens_for_baseline: Aetna Life and Casualty Co. 's third - quarter net income fell 22 % to $ 182.6 million , or $ 1.63 a share , reflecting the damages from Hurricane Hugo and lower results for some of the company 's major divisions .

source_bert_toks: ae ##t ##na life and casualty co . ' s third - quarter net income fell 22 % to $ 182 . 6 million , or $ 1 . 63 a share , reflecting the damages from hurricane hugo and lower results for some of the company ' s major divisions .

reference_raw: Aetna Life and Casualty Co.'s third-quarter net revenue fell from 22% to 182.6 million dollars, or $1.63 a share, reflecting the damage suffered by Hurricane Hugo and lowering the results of some of the major divisions of the company.

reference_spacy_tokens: Aetna Life and Casualty Co. 's third - quarter net revenue fell from 22 % to 182.6 million dollars , or $ 1.63 a share , reflecting the damage suffered by Hurricane Hugo and lowering the results of some of the major divisions of the company .


fn_spacy_tokens_for_baseline: They were young and giggly and hardly ever out of each other 's sight .

source_bert_toks: they were young and gig ##gly and hardly ever out of each other ' s sight .

reference_raw: They were young and giggling, and barely ever out of each other's eyes.

reference_spacy_tokens: They were young and giggling , and barely ever out of each other 's eyes .


fn_spacy_tokens_for_baseline: Quick as she was , Feargal was quicker and swerved swiftly to one side .

source_bert_toks: quick as she was , fear ##gal was quicker and sw ##erved swiftly to one side .

reference_raw: As fast as she was, Feargal was faster, turning quickly to one side.

reference_spacy_tokens: As fast as she was , Feargal was faster , turning quickly to one side .


fn_spacy_tokens_for_baseline: The Great Depression of 1929 sharpened the mood of rebellion when a catastrophic fall in the price of rice spread hardship and even starvation to many parts of Indochina .

source_bert_toks: the great depression of 1929 sharpened the mood of rebellion when a catastrophic fall in the price of rice spread hardship and even starvation to many parts of indochina .

reference_raw: The Great Depression of 1929 sharpened the mood of rebellion when a catastrophic decline in the price of rice spread hardship and even hunger to many parts of Indochina.

reference_spacy_tokens: The Great Depression of 1929 sharpened the mood of rebellion when a catastrophic decline in the price of rice spread hardship and even hunger to many parts of Indochina .


fn_spacy_tokens_for_baseline: Then Coventry drove Lily and Stephen home to number two , The Parade .

source_bert_toks: then coventry drove lily and stephen home to number two , the parade .

reference_raw: Then Coventry took Lily and Stephen home to Parade number two.

reference_spacy_tokens: Then Coventry took Lily and Stephen home to Parade number two .


fn_spacy_tokens_for_baseline: The Australian 's withdrawal from a three year contract immediately shifted a considerable burden back onto Jarvis , but the former England seamer is not lacking in confidence about his prospects .

source_bert_toks: the australian ' s withdrawal from a three year contract immediately shifted a considerable burden back onto jarvis , but the former england seam ##er is not lacking in confidence about his prospects .

reference_raw: The Australian's removal from the three-year contract immediately shifted a significant burden on Jarvis, but the former English seaman does not lack confidence in his prospects.

reference_spacy_tokens: The Australian 's removal from the three - year contract immediately shifted a significant burden on Jarvis , but the former English seaman does not lack confidence in his prospects .


fn_spacy_tokens_for_baseline: ' His plea of guilty is the only means by which he can express his contrition today and acknowledging it must be a lengthy prison sentence which he now faces . '

source_bert_toks: ' his plea of guilty is the only means by which he can express his con ##tri ##tion today and acknowledging it must be a lengthy prison sentence which he now faces . '

reference_raw: "His plea of guilt is the only way he can express his condolences today and admit that it must be a long prison sentence he's facing."

reference_spacy_tokens: " His plea of guilt is the only way he can express his condolences today and admit that it must be a long prison sentence he 's facing . "


fn_spacy_tokens_for_baseline: Michael Campbell , director general of RGDATA , the small grocers ' association , said his members felt utterly powerless when faced with naked violence .

source_bert_toks: michael campbell , director general of r ##g ##da ##ta , the small gr ##oc ##ers ' association , said his members felt utterly powerless when faced with naked violence .

reference_raw: Michael Campbell, Director-General of RGDATA, a small food association, said that his members felt utterly helpless in the face of naked violence.

reference_spacy_tokens: Michael Campbell , Director - General of RGDATA , a small food association , said that his members felt utterly helpless in the face of naked violence .


fn_spacy_tokens_for_baseline: Omally gestured towards the shrouded video machine , which was even now receiving the attention of a green - haired youth with a large nose and a pair of wire - cutters .

source_bert_toks: om ##ally gestured towards the sh ##roud ##ed video machine , which was even now receiving the attention of a green - haired youth with a large nose and a pair of wire - cutter ##s .

reference_raw: Omally pointed to the cloaked video machine, which was now receiving the attention of a green-haired young man with a large nose and two wire cutters.

reference_spacy_tokens: Omally pointed to the cloaked video machine , which was now receiving the attention of a green - haired young man with a large nose and two wire cutters .


fn_spacy_tokens_for_baseline: As people bustled around him the Doctor had harangued them frantically with all the strength that was left to him .

source_bert_toks: as people bust ##led around him the doctor had hara ##ng ##ue ##d them frantically with all the strength that was left to him .

reference_raw: As the people swarmed around him, the Doctor tortured them frantically with all the strength he had left.

reference_spacy_tokens: As the people swarmed around him , the Doctor tortured them frantically with all the strength he had left .


fn_spacy_tokens_for_baseline: However , critics argue that Pyongyang 's behavior is inconsistent and that this evidence is not credible .

source_bert_toks: however , critics argue that p ##yon ##gy ##ang ' s behavior is inconsistent and that this evidence is not credible .

reference_raw: The critics argue, however, that the behaviour of Pyongyang is inconsistent and that the evidence is unreliable.

reference_spacy_tokens: The critics argue , however , that the behaviour of Pyongyang is inconsistent and that the evidence is unreliable .


fn_spacy_tokens_for_baseline: In other harem - forming species the takeover by another male or males is commonly followed by either the killing or complete ejection of the old owner and by the slaughter of babies and infants ( Hrdy 1974 ) .

source_bert_toks: in other hare ##m - forming species the takeover by another male or males is commonly followed by either the killing or complete e ##ject ##ion of the old owner and by the slaughter of babies and infants ( hr ##dy 1974 ) .

reference_raw: In other species of harem-forming, the takeover of another male or male is usually followed by the killing or complete removal of the old owner and the slaughter of children and children (Hrd 1974).

reference_spacy_tokens: In other species of harem - forming , the takeover of another male or male is usually followed by the killing or complete removal of the old owner and the slaughter of children and children ( Hrd 1974 ) .


fn_spacy_tokens_for_baseline: The other two Zimbalan bodyguards immediately drew their snub - nosed Smith & Wesson.38s and sprinted after the fleeing gunman .

source_bert_toks: the other two z ##im ##bala ##n bodyguards immediately drew their s ##nu ##b - nosed smith & wes ##son . 38 ##s and sprinted after the fleeing gun ##man .

reference_raw: The other two Zimbalan bodyguards immediately pulled out their snub-nosed Smith & Wesson.38s and ran after the fleeing shooter.

reference_spacy_tokens: The other two Zimbalan bodyguards immediately pulled out their snub - nosed Smith & Wesson.38s and ran after the fleeing shooter .


fn_spacy_tokens_for_baseline: The noise of their hooves boomed as they came closer .

source_bert_toks: the noise of their hooves boomed as they came closer .

reference_raw: As they approached, the sound of their hoofs boomed.

reference_spacy_tokens: As they approached , the sound of their hoofs boomed .


fn_spacy_tokens_for_baseline: On Friday nights in Jewish households , the lady of the house performs the sacred ritual of lighting two candles and requesting through prayer that the presence of the Lord should bless the gathered family .

source_bert_toks: on friday nights in jewish households , the lady of the house performs the sacred ritual of lighting two candles and requesting through prayer that the presence of the lord should bless the gathered family .

reference_raw: On Friday nights in Jewish homes, the lady of the house performs a holy rite of lighting two candles and praying for God's presence to bless the assembled family.

reference_spacy_tokens: On Friday nights in Jewish homes , the lady of the house performs a holy rite of lighting two candles and praying for God 's presence to bless the assembled family .


fn_spacy_tokens_for_baseline: Spokesman Graham Menzies said : ' Julie was very much loved by all of us . '

source_bert_toks: spokesman graham men ##zie ##s said : ' julie was very much loved by all of us . '

reference_raw: Speaker Graham Menzies said, "We all liked Julie very much."

reference_spacy_tokens: Speaker Graham Menzies said , " We all liked Julie very much . "


fn_spacy_tokens_for_baseline: Experience convinced her that the man who was drunk would lecture them on the futility of dying , a theme prompted by the first mention of hospices .

source_bert_toks: experience convinced her that the man who was drunk would lecture them on the fu ##tility of dying , a theme prompted by the first mention of hospice ##s .

reference_raw: Experience had convinced her that a man who had been intoxicated would lecture them on the futility of death, a subject prompted by the first mention of hospices.

reference_spacy_tokens: Experience had convinced her that a man who had been intoxicated would lecture them on the futility of death , a subject prompted by the first mention of hospices .


fn_spacy_tokens_for_baseline: The lunch itself was held in a huge room and there was a constant babble of noise .

source_bert_toks: the lunch itself was held in a huge room and there was a constant ba ##bble of noise .

reference_raw: The lunch itself was held in a large room, and there was a steady murmur of noise.

reference_spacy_tokens: The lunch itself was held in a large room , and there was a steady murmur of noise .


fn_spacy_tokens_for_baseline: True , there were some things he did n't like about the Khedive 's regime , the patronage , the corruption , the inefficiency .

source_bert_toks: true , there were some things he didn ' t like about the k ##hed ##ive ' s regime , the patronage , the corruption , the in ##ef ##fi ##ciency .

reference_raw: True, there were things he didn't like about the Khedive system, patronage, corruption, incompetence.

reference_spacy_tokens: True , there were things he did n't like about the Khedive system , patronage , corruption , incompetence .


fn_spacy_tokens_for_baseline: Furthermore , its integration with other desktop applications allows it to be used as a powerful document transmission system .

source_bert_toks: furthermore , its integration with other desktop applications allows it to be used as a powerful document transmission system .

reference_raw: In addition, its integration with other desktop applications makes it possible to use it as a powerful document transmission system.

reference_spacy_tokens: In addition , its integration with other desktop applications makes it possible to use it as a powerful document transmission system .


fn_spacy_tokens_for_baseline: Law of Probability Dispersal : Whatever it is that hits the fan will not be evenly distributed .

source_bert_toks: law of probability dispersal : whatever it is that hits the fan will not be evenly distributed .

reference_raw: The Law of Probability Dispersal: Anything that strikes a fan will not be evenly distributed.

reference_spacy_tokens: The Law of Probability Dispersal : Anything that strikes a fan will not be evenly distributed .


fn_spacy_tokens_for_baseline: Opening the glazed hatch above her head to allow the cool night air into the small cabin , Polly threw off her tracksuit , pulled on a clean thigh - length baggy T - shirt , and slid into her sleeping - bag .

source_bert_toks: opening the glazed hatch above her head to allow the cool night air into the small cabin , polly threw off her tracks ##uit , pulled on a clean thigh - length bag ##gy t - shirt , and slid into her sleeping - bag .

reference_raw: Polly opened the glass hatch above her head to allow cool night air into the little cabin, dropped off her track suit, pulled on a clean thigh-length baggy shirt, and slipped into her sleeping bag.

reference_spacy_tokens: Polly opened the glass hatch above her head to allow cool night air into the little cabin , dropped off her track suit , pulled on a clean thigh - length baggy shirt , and slipped into her sleeping bag .


fn_spacy_tokens_for_baseline: Lebna Dengel conducted state business inside his great white tent , sitting on a platform , dressed in rich robes and with his face partly veiled with blue taffeta .

source_bert_toks: le ##bn ##a deng ##el conducted state business inside his great white tent , sitting on a platform , dressed in rich robes and with his face partly veil ##ed with blue ta ##ffe ##ta .

reference_raw: Lebna Dengel was doing state business in his big white tent, sitting on the platform, dressed in rich robes, his face partially covered with blue taffeta.

reference_spacy_tokens: Lebna Dengel was doing state business in his big white tent , sitting on the platform , dressed in rich robes , his face partially covered with blue taffeta .


fn_spacy_tokens_for_baseline: ' Come now , Burney , ' he trumpeted .

source_bert_toks: ' come now , burn ##ey , ' he trumpet ##ed .

reference_raw: 'Come on, Burney,' he said.

reference_spacy_tokens: ' Come on , Burney , ' he said .


fn_spacy_tokens_for_baseline: Voters flocked to the polls , despite drizzle , rain and snow , in record numbers .

source_bert_toks: voters flock ##ed to the polls , despite dr ##iz ##zle , rain and snow , in record numbers .

reference_raw: The voters came to the polls in record numbers, despite the drizzle, the rain, and the snow.

reference_spacy_tokens: The voters came to the polls in record numbers , despite the drizzle , the rain , and the snow .


fn_spacy_tokens_for_baseline: The CLI command file shown below would redirect printer output to a file called ' pfile ' .

source_bert_toks: the cl ##i command file shown below would red ##ire ##ct printer output to a file called ' p ##fi ##le ' .

reference_raw: The CLI command file below will reroute the output of the printer to the file called "pfile".

reference_spacy_tokens: The CLI command file below will reroute the output of the printer to the file called " pfile " .


fn_spacy_tokens_for_baseline: I had developed a deft hand at writing bills and counterfeiting other people 's signatures , my master 's included .

source_bert_toks: i had developed a def ##t hand at writing bills and counter ##feit ##ing other people ' s signatures , my master ' s included .

reference_raw: I've developed a skillful hand in writing bills and forging other people's signatures, including my master.

reference_spacy_tokens: I 've developed a skillful hand in writing bills and forging other people 's signatures , including my master .


fn_spacy_tokens_for_baseline: They understood that neutralism and non - alignment could impede or restrain the development of close military relations between many newly independent states and the Western powers .

source_bert_toks: they understood that neutral ##ism and non - alignment could imp ##ede or restrain the development of close military relations between many newly independent states and the western powers .

reference_raw: They understood that neutralism and non-alignment could hinder or hinder the development of close military relations between many new independent states and Western powers.

reference_spacy_tokens: They understood that neutralism and non - alignment could hinder or hinder the development of close military relations between many new independent states and Western powers .


fn_spacy_tokens_for_baseline: ' He did n't seem too delighted to see you , ' said Betty .

source_bert_toks: ' he didn ' t seem too delighted to see you , ' said betty .

reference_raw: "He didn't seem very happy to see you," Betty said.

reference_spacy_tokens: " He did n't seem very happy to see you , " Betty said .


fn_spacy_tokens_for_baseline: Instead , she crouched over the radio , listening , like all the others , as the news bulletin began .

source_bert_toks: instead , she crouched over the radio , listening , like all the others , as the news bulletin began .

reference_raw: Instead, she crouched over the radio and listened, like everyone else, to the start of the newsletter.

reference_spacy_tokens: Instead , she crouched over the radio and listened , like everyone else , to the start of the newsletter .


fn_spacy_tokens_for_baseline: Rabuka , who in May 1987 had ousted the civilian government elected one month earlier , was appointed Prime Minister on June 2 and named a coalition government on the following day .

source_bert_toks: ra ##bu ##ka , who in may 1987 had ousted the civilian government elected one month earlier , was appointed prime minister on june 2 and named a coalition government on the following day .

reference_raw: Rabuka, who had been elected a month earlier in May 1987, was appointed Prime Minister on June 2 and appointed a coalition government on the following day.

reference_spacy_tokens: Rabuka , who had been elected a month earlier in May 1987 , was appointed Prime Minister on June 2 and appointed a coalition government on the following day .


fn_spacy_tokens_for_baseline: North Korea pulls out of nuclear arms treaty

source_bert_toks: north korea pulls out of nuclear arms treaty

reference_raw: North Korea is withdrawing from the Nuclear Arms Treaty


fn_spacy_tokens_for_baseline: ' So now you go and tramp the streets changing your traveller 's cheques into cash and then into traveller 's cheques signed Winterbotham .

source_bert_toks: ' so now you go and tram ##p the streets changing your traveller ' s che ##ques into cash and then into traveller ' s che ##ques signed winter ##bot ##ham .

reference_raw: 'So now you're going to walk down the street and turn your traveller's checks into cash, and then you're going to traveller's checks signed by Winterbotham.

reference_spacy_tokens: ' So now you 're going to walk down the street and turn your traveller 's checks into cash , and then you 're going to traveller 's checks signed by Winterbotham .


fn_spacy_tokens_for_baseline: Soak your feet in the solution for at least 15 minutes twice a day , pat dry and sprinkle your feet and the inside of your shoes with a little arrowroot powder .

source_bert_toks: so ##ak your feet in the solution for at least 15 minutes twice a day , pat dry and sp ##rin ##kle your feet and the inside of your shoes with a little arrow ##ro ##ot powder .

reference_raw: Dip your feet in the solution for at least 15 minutes twice a day, pat dry and spray some arrowroot powder on your feet and the insides of your boots.

reference_spacy_tokens: Dip your feet in the solution for at least 15 minutes twice a day , pat dry and spray some arrowroot powder on your feet and the insides of your boots .


fn_spacy_tokens_for_baseline: Like other folklore genres , riddles serve a function , helping children learn to interpret facts and form an opinion .

source_bert_toks: like other folklore genres , riddle ##s serve a function , helping children learn to interpret facts and form an opinion .

reference_raw: Like other folklore genres, puzzles work, helping children learn how to interpret facts and form opinions.

reference_spacy_tokens: Like other folklore genres , puzzles work , helping children learn how to interpret facts and form opinions .


fn_spacy_tokens_for_baseline: She strongly encouraged her husband and other preachers of the Gospel in their soul - winning endeavours .

source_bert_toks: she strongly encouraged her husband and other preacher ##s of the gospel in their soul - winning endeavour ##s .

reference_raw: She strongly encouraged her husband and other Gospel preachers in their spirit-winning efforts.

reference_spacy_tokens: She strongly encouraged her husband and other Gospel preachers in their spirit - winning efforts .


fn_spacy_tokens_for_baseline: Armed combatants have been utilizing stealthier means of assault , such as roadside bombs and rocket and mortar attacks , which generally give insurgents a better chance to escape .

source_bert_toks: armed combatants have been utilizing stealth ##ier means of assault , such as roadside bombs and rocket and mortar attacks , which generally give insurgents a better chance to escape .

reference_raw: Armed fighters use stealthier means of attack, such as roadside bombs and missile and mortar attacks, which generally give the rebels a better chance of escape.

reference_spacy_tokens: Armed fighters use stealthier means of attack , such as roadside bombs and missile and mortar attacks , which generally give the rebels a better chance of escape .


fn_spacy_tokens_for_baseline: An awareness of the way in which the reasons for erosion are connected has implied the necessity for inter - disciplinary study .

source_bert_toks: an awareness of the way in which the reasons for erosion are connected has implied the necessity for inter - disciplinary study .

reference_raw: Awareness of how the causes of erosion are linked implies the need for interdisciplinary studies.

reference_spacy_tokens: Awareness of how the causes of erosion are linked implies the need for interdisciplinary studies .


fn_spacy_tokens_for_baseline: Although this excess seems to be a constant feature of all studies of acute renal failure , it has not been commented on before .

source_bert_toks: although this excess seems to be a constant feature of all studies of acute renal failure , it has not been commented on before .

reference_raw: Although this excess appears to be a constant feature of all acute renal failure studies, it has not been mentioned before.

reference_spacy_tokens: Although this excess appears to be a constant feature of all acute renal failure studies , it has not been mentioned before .


fn_spacy_tokens_for_baseline: His jotting pad was covered with hot - air balloons , intricately patterned and decorated ; part of his mind had obviously been with his private passion .

source_bert_toks: his jo ##tting pad was covered with hot - air balloons , intricate ##ly patterned and decorated ; part of his mind had obviously been with his private passion .

reference_raw: The pad was covered with hot-air balloons, intricately shaped and adorned; a part of his mind was clearly a personal passion.

reference_spacy_tokens: The pad was covered with hot - air balloons , intricately shaped and adorned ; a part of his mind was clearly a personal passion .


fn_spacy_tokens_for_baseline: In the end I threw my yoghurt pot full of glue at her and said the ' f ' word I 'd learnt from Auntie .

source_bert_toks: in the end i threw my yo ##gh ##urt pot full of glue at her and said the ' f ' word i ' d learnt from aunt ##ie .

reference_raw: Finally, I threw my yogurt kettle full of glue at her and said the "f" word I learned from my aunt.

reference_spacy_tokens: Finally , I threw my yogurt kettle full of glue at her and said the " f " word I learned from my aunt .


fn_spacy_tokens_for_baseline: Daisy took another swig out of her bottle .

source_bert_toks: daisy took another sw ##ig out of her bottle .

reference_raw: Daisy took another swig from the flask.

reference_spacy_tokens: Daisy took another swig from the flask .


fn_spacy_tokens_for_baseline: For sole traders , as well as individuals in financial difficulties , an IVA can be a successful conclusion to financial embarrassment .

source_bert_toks: for sole traders , as well as individuals in financial difficulties , an iv ##a can be a successful conclusion to financial embarrassment .

reference_raw: For single traders and persons in financial difficulties, the IVA can be a successful conclusion to financial embarrassment.

reference_spacy_tokens: For single traders and persons in financial difficulties , the IVA can be a successful conclusion to financial embarrassment .


fn_spacy_tokens_for_baseline: In the latest quarter , Aetna had a $ 23 million loss on its auto / homeowners line , compared with earnings of $ 33 million last year .

source_bert_toks: in the latest quarter , ae ##t ##na had a $ 23 million loss on its auto / home ##own ##ers line , compared with earnings of $ 33 million last year .

reference_raw: In the last quarter, Aetna had a $23 million loss on its auto/homeowner line, against a $33 million profit last year.

reference_spacy_tokens: In the last quarter , Aetna had a $ 23 million loss on its auto / homeowner line , against a $ 33 million profit last year .