fn_spacy_tokens_for_baseline: I gazed upwards and could see a few stars twinkling in the sky , one seemed much brighter than the others .

source_bert_toks: i gazed upwards and could see a few stars twin ##kling in the sky , one seemed much brighter than the others .

reference_raw: I looked up and saw a few stars flashing in the sky, one of which seemed a lot brighter than the other.

reference_spacy_tokens: I looked up and saw a few stars flashing in the sky , one of which seemed a lot brighter than the other .


fn_spacy_tokens_for_baseline: As she taxied in to the small civilian terminal , Adam watched the three fighter planes ease their pointed noses skyward and climb at over thirty thousand feet a minute .

source_bert_toks: as she taxi ##ed in to the small civilian terminal , adam watched the three fighter planes ease their pointed noses sky ##ward and climb at over thirty thousand feet a minute .

reference_raw: As she rode into the small civilian terminal, Adam watched the three fighters lift their pointed noses skyward and climb at more than thirty thousand feet per minute.

reference_spacy_tokens: As she rode into the small civilian terminal , Adam watched the three fighters lift their pointed noses skyward and climb at more than thirty thousand feet per minute .


fn_spacy_tokens_for_baseline: The statement of light had become a depressing and , at times , boring mess of discontent .

source_bert_toks: the statement of light had become a de ##pressing and , at times , boring mess of discontent .

reference_raw: The statement of light became a gloomy and sometimes dull mess of dissatisfaction.

reference_spacy_tokens: The statement of light became a gloomy and sometimes dull mess of dissatisfaction .


fn_spacy_tokens_for_baseline: ' What makes you think that could be the case ? ' he rasped irritably .

source_bert_toks: ' what makes you think that could be the case ? ' he rasped ir ##rita ##bly .

reference_raw: "Why do you think that might be the case?" he demanded indignantly.

reference_spacy_tokens: " Why do you think that might be the case ? " he demanded indignantly .


fn_spacy_tokens_for_baseline: A secretariat to co - ordinate the exchange of data and opinions is also proposed .

source_bert_toks: a secretariat to co - or ##dina ##te the exchange of data and opinions is also proposed .

reference_raw: There is also a proposal for a Secretariat to coordinate the exchange of data and opinions.

reference_spacy_tokens: There is also a proposal for a Secretariat to coordinate the exchange of data and opinions .


fn_spacy_tokens_for_baseline: As part of a national overhaul of the Legal Services Corp. , the nine legal aid groups in Texas are being folded into three , creating huge agencies handling cases in dozens of counties .

source_bert_toks: as part of a national overhaul of the legal services corp . , the nine legal aid groups in texas are being folded into three , creating huge agencies handling cases in dozens of counties .

reference_raw: As part of the national review of the Legal Services Corp., nine legal aid groups in Texas are grouped into three, creating large agencies dealing with cases in dozens of counties.

reference_spacy_tokens: As part of the national review of the Legal Services Corp. , nine legal aid groups in Texas are grouped into three , creating large agencies dealing with cases in dozens of counties .


fn_spacy_tokens_for_baseline: The union complied with the order and paid the costs of the action .

source_bert_toks: the union complied with the order and paid the costs of the action .

reference_raw: The trade union followed the order and was ordered to pay the costs.

reference_spacy_tokens: The trade union followed the order and was ordered to pay the costs .


fn_spacy_tokens_for_baseline: Many other parts of the United Kingdom view our progress with some envy .

source_bert_toks: many other parts of the united kingdom view our progress with some envy .

reference_raw: Many other parts of the UK view our progress with a certain jealousy.

reference_spacy_tokens: Many other parts of the UK view our progress with a certain jealousy .


fn_spacy_tokens_for_baseline: She sat down on the grass and stayed for a while , talking and laughing with the children in the quiet , sunny garden .

source_bert_toks: she sat down on the grass and stayed for a while , talking and laughing with the children in the quiet , sunny garden .

reference_raw: She sat down on the grass and stayed for a while, talking and laughing with the children in the quiet, sunlit garden.

reference_spacy_tokens: She sat down on the grass and stayed for a while , talking and laughing with the children in the quiet , sunlit garden .


fn_spacy_tokens_for_baseline: It was in excellent condition , was only a year old and cost me £ 85 .

source_bert_toks: it was in excellent condition , was only a year old and cost me £ ##85 .

reference_raw: He was in great shape, he was only a year old, and he cost me £85.

reference_spacy_tokens: He was in great shape , he was only a year old , and he cost me £ 85 .


fn_spacy_tokens_for_baseline: Lear is offended by Oswald 's negligence ( I.iv.47ff . ) , and his new servant ( Kent , returned in disguise ) shows his loyalty by tripping up this ' clotpoll ' .

source_bert_toks: lear is offended by oswald ' s negligence ( i . iv . 47 ##ff . ) , and his new servant ( kent , returned in disguise ) shows his loyalty by trip ##ping up this ' cl ##ot ##pol ##l ' .

reference_raw: Lear is insulted by Oswald's negligence (I.iv.47ff.) and his new servant (Kent, returned in disguise) demonstrates his loyalty by tripping the 'clotpoll'.

reference_spacy_tokens: Lear is insulted by Oswald 's negligence ( I.iv.47ff . ) and his new servant ( Kent , returned in disguise ) demonstrates his loyalty by tripping the ' clotpoll ' .


fn_spacy_tokens_for_baseline: Where will we draw the outer boundaries of this Europe ?

source_bert_toks: where will we draw the outer boundaries of this europe ?

reference_raw: Where do we draw the external borders of Europe?

reference_spacy_tokens: Where do we draw the external borders of Europe ?


fn_spacy_tokens_for_baseline: ' Well , my grandfather erected it ; and of an evening he would be very busy sharpening up chopping hooks and one thing and another .

source_bert_toks: ' well , my grandfather erected it ; and of an evening he would be very busy sharpe ##ning up chop ##ping hooks and one thing and another .

reference_raw: 'Well, my grandfather built it, and he'd have a lot of work to do at night cutting hooks and one thing and the other.

reference_spacy_tokens: ' Well , my grandfather built it , and he 'd have a lot of work to do at night cutting hooks and one thing and the other .


fn_spacy_tokens_for_baseline: Brindel said his crew was activating anti - missile defenses in the seconds after a lookout spotted an incoming projectile and phoned his warning to the ship 's Combat Information Center .

source_bert_toks: br ##ind ##el said his crew was act ##ivating anti - missile defenses in the seconds after a lookout spotted an incoming projectile and phone ##d his warning to the ship ' s combat information center .

reference_raw: Brindel said that his crew had activated anti-missile defenses within seconds of a patrol noticing the incoming projectile and calling the ship's Combat Information Center.

reference_spacy_tokens: Brindel said that his crew had activated anti - missile defenses within seconds of a patrol noticing the incoming projectile and calling the ship 's Combat Information Center .


fn_spacy_tokens_for_baseline: But to continue this work we need your donation today .

source_bert_toks: but to continue this work we need your donation today .

reference_raw: But in order to get on with this job, we need your gift today.

reference_spacy_tokens: But in order to get on with this job , we need your gift today .


fn_spacy_tokens_for_baseline: But getting rid of the TV and keeping the bedroom for sex could be the best cure of all .

source_bert_toks: but getting rid of the tv and keeping the bedroom for sex could be the best cure of all .

reference_raw: But getting rid of the TV and keeping the bedroom for sex might be the best medicine ever.

reference_spacy_tokens: But getting rid of the TV and keeping the bedroom for sex might be the best medicine ever .


fn_spacy_tokens_for_baseline: By the time Carrie had completed her task the wind had increased in strength from the north and a fierce blizzard was setting in .

source_bert_toks: by the time carrie had completed her task the wind had increased in strength from the north and a fierce blizzard was setting in .

reference_raw: By the time Carrie had finished her task, the wind had grown stronger from the north, and the storm was coming.

reference_spacy_tokens: By the time Carrie had finished her task , the wind had grown stronger from the north , and the storm was coming .


fn_spacy_tokens_for_baseline: Still , encrypting corporate communications is only a partial remedy .

source_bert_toks: still , en ##cr ##yp ##ting corporate communications is only a partial remedy .

reference_raw: However, the encryption of corporate communications is only part of the cure.

reference_spacy_tokens: However , the encryption of corporate communications is only part of the cure .


fn_spacy_tokens_for_baseline: Even at the end of 1857 , however , depicting the tsar as a committed reformer is unwise .

source_bert_toks: even at the end of 1857 , however , depicting the tsar as a committed reformer is un ##wise .

reference_raw: But even at the end of 1857, it would not be wise to describe the tzar as a dedicated reformer.

reference_spacy_tokens: But even at the end of 1857 , it would not be wise to describe the tzar as a dedicated reformer .


fn_spacy_tokens_for_baseline: At that hour a cab would be ages getting through the twisting streets of the old city and across the Thames to Rotherhithe .

source_bert_toks: at that hour a cab would be ages getting through the twisting streets of the old city and across the thames to roth ##er ##hit ##he .

reference_raw: At that hour, a taxi would take forever to get through the winding streets of the old city and through the Thames to Rotherhithe.

reference_spacy_tokens: At that hour , a taxi would take forever to get through the winding streets of the old city and through the Thames to Rotherhithe .


fn_spacy_tokens_for_baseline: He dismounted to lead his mare across .

source_bert_toks: he dismounted to lead his mare across .

reference_raw: He got off his horse and led his mare to the other side.

reference_spacy_tokens: He got off his horse and led his mare to the other side .


fn_spacy_tokens_for_baseline: He batted at the pivotal position of number three and fully justified the captain 's faith in him .

source_bert_toks: he batted at the pivotal position of number three and fully justified the captain ' s faith in him .

reference_raw: He hit the key position of number three and fully justified the captain's belief in him.

reference_spacy_tokens: He hit the key position of number three and fully justified the captain 's belief in him .


fn_spacy_tokens_for_baseline: Ideal for small gardens , the weeping cotoneaster hybridus Pendulus has a striking leaf and outline , and produces a mass of brilliant red fruit .

source_bert_toks: ideal for small gardens , the weeping cot ##one ##aster hybrid ##us pen ##du ##lus has a striking leaf and outline , and produces a mass of brilliant red fruit .

reference_raw: Ideal for small gardens, the sobbing cotoneaster hybridus Pendulus has a striking leaf and shape, and produces a lot of bright red fruit.

reference_spacy_tokens: Ideal for small gardens , the sobbing cotoneaster hybridus Pendulus has a striking leaf and shape , and produces a lot of bright red fruit .


fn_spacy_tokens_for_baseline: Although rainfall has now returned to normal , Georgia 's leaders remain keenly conscious that water is a scarce commodity , to be carefully managed .

source_bert_toks: although rainfall has now returned to normal , georgia ' s leaders remain keen ##ly conscious that water is a scarce commodity , to be carefully managed .

reference_raw: Although the rainfall has now returned to normal, Georgian leaders remain keenly aware that water is a scarce commodity and that it should be carefully managed.

reference_spacy_tokens: Although the rainfall has now returned to normal , Georgian leaders remain keenly aware that water is a scarce commodity and that it should be carefully managed .


fn_spacy_tokens_for_baseline: That enabled a considerable amount of groundwork for the valuation exercise to be undertaken over the summer .

source_bert_toks: that enabled a considerable amount of ground ##work for the valuation exercise to be undertaken over the summer .

reference_raw: This made it possible to carry out a considerable amount of the basis for the valuation exercise during the summer.

reference_spacy_tokens: This made it possible to carry out a considerable amount of the basis for the valuation exercise during the summer .


fn_spacy_tokens_for_baseline: Mr McGilvray said he would be opening a depot in Cambuslang in the next fortnight where he would be employing as many as 18 former Lilley personnel .

source_bert_toks: mr mc ##gil ##vr ##ay said he would be opening a depot in cam ##bus ##lang in the next fort ##night where he would be employing as many as 18 former lille ##y personnel .

reference_raw: Mr. McGilvray said he was going to open a warehouse in Cambuslang in the next two weeks, where he was going to employ up to 18 ex-Lilley personnel.

reference_spacy_tokens: Mr. McGilvray said he was going to open a warehouse in Cambuslang in the next two weeks , where he was going to employ up to 18 ex - Lilley personnel .


fn_spacy_tokens_for_baseline: They quieted down as Judy stood on the dais to introduce Lili , then looked expectantly towards the door , outside which Lili was slowly counting to ten before making her entrance .

source_bert_toks: they quiet ##ed down as judy stood on the dai ##s to introduce lil ##i , then looked expect ##antly towards the door , outside which lil ##i was slowly counting to ten before making her entrance .

reference_raw: They paused as Judy stood on the platform to introduce Lili, then looked expectantly at the door behind which Lili was counting to ten before she entered.

reference_spacy_tokens: They paused as Judy stood on the platform to introduce Lili , then looked expectantly at the door behind which Lili was counting to ten before she entered .


fn_spacy_tokens_for_baseline: I think of some people who keenly desire a rational faith .

source_bert_toks: i think of some people who keen ##ly desire a rational faith .

reference_raw: I'm thinking about some people who are eager to have a rational faith.

reference_spacy_tokens: I 'm thinking about some people who are eager to have a rational faith .


fn_spacy_tokens_for_baseline: Historians of publishing have also detected some tendency towards specialisation amongst publishers by the 1780s and 1790s and this may have helped the appearance of antislavery writing .

source_bert_toks: historians of publishing have also detected some tendency towards special ##isation amongst publishers by the 1780 ##s and 1790 ##s and this may have helped the appearance of anti ##sl ##aver ##y writing .

reference_raw: In the 1780s and 1790s, publication historians also found a trend towards specialisation among publishers, which may have contributed to the emergence of anti-slavery writing.

reference_spacy_tokens: In the 1780s and 1790s , publication historians also found a trend towards specialisation among publishers , which may have contributed to the emergence of anti - slavery writing .


fn_spacy_tokens_for_baseline: They parked the vehicles and camouflaged themselves for the night , before settling down to cook .

source_bert_toks: they parked the vehicles and camouflage ##d themselves for the night , before settling down to cook .

reference_raw: They parked the cars and cloaked themselves for the night before settling in to cook.

reference_spacy_tokens: They parked the cars and cloaked themselves for the night before settling in to cook .


fn_spacy_tokens_for_baseline: In the warren of lanes and alleys , barefoot traders sit cross - legged in tiny shops crammed with strange goods .

source_bert_toks: in the warren of lanes and alley ##s , barefoot traders sit cross - legged in tiny shops cr ##ammed with strange goods .

reference_raw: In the corridors of streets and alleys, barefoot merchants sit cross-legged in small shops filled with strange merchandise.

reference_spacy_tokens: In the corridors of streets and alleys , barefoot merchants sit cross - legged in small shops filled with strange merchandise .


fn_spacy_tokens_for_baseline: With variations , this very simple shape is widely used in kite workshops as a project that produces results , both in the flight performance and in the degree of satisfaction it gives to the constructor .

source_bert_toks: with variations , this very simple shape is widely used in kite workshops as a project that produces results , both in the flight performance and in the degree of satisfaction it gives to the construct ##or .

reference_raw: With variations, this very simple shape is widely used in dragon workshops as a project which produces results both in flight performance and in the level of satisfaction it provides to the constructor.

reference_spacy_tokens: With variations , this very simple shape is widely used in dragon workshops as a project which produces results both in flight performance and in the level of satisfaction it provides to the constructor .


fn_spacy_tokens_for_baseline: A grin flitted across her face .

source_bert_toks: a grin fl ##itte ##d across her face .

reference_raw: A smile crossed her face.

reference_spacy_tokens: A smile crossed her face .


fn_spacy_tokens_for_baseline: But American aims went beyond the mere exclusion of Free France from this particular theatre of operations .

source_bert_toks: but american aims went beyond the mere exclusion of free france from this particular theatre of operations .

reference_raw: But American goals went beyond the mere exclusion of Free France from this particular theater of operations.

reference_spacy_tokens: But American goals went beyond the mere exclusion of Free France from this particular theater of operations .


fn_spacy_tokens_for_baseline: While she is lauded in London intellectual circles , she is less well - known to the general public .

source_bert_toks: while she is lauded in london intellectual circles , she is less well - known to the general public .

reference_raw: Although praised by the intellectual circles of London, it is less well known to the general public.

reference_spacy_tokens: Although praised by the intellectual circles of London , it is less well known to the general public .


fn_spacy_tokens_for_baseline: It is no wonder that so many of the small northern birds have to raise large broods of young , just to maintain the status quo of the population .

source_bert_toks: it is no wonder that so many of the small northern birds have to raise large brood ##s of young , just to maintain the status quo of the population .

reference_raw: It is no wonder that so many of the little northern birds have to raise large flocks of young people in order to maintain the status quo of the population.

reference_spacy_tokens: It is no wonder that so many of the little northern birds have to raise large flocks of young people in order to maintain the status quo of the population .


fn_spacy_tokens_for_baseline: They parted nine years ago and the split distressed him so much he vowed not to get seriously involved with another woman for a very long time .

source_bert_toks: they parted nine years ago and the split distressed him so much he vowed not to get seriously involved with another woman for a very long time .

reference_raw: They broke up nine years ago, and he was so upset about the split that he swore he wouldn't get serious with another woman for a long time.

reference_spacy_tokens: They broke up nine years ago , and he was so upset about the split that he swore he would n't get serious with another woman for a long time .


fn_spacy_tokens_for_baseline: Driving back , she managed to keep her anger in control .

source_bert_toks: driving back , she managed to keep her anger in control .

reference_raw: She drove back and managed to control her rage.

reference_spacy_tokens: She drove back and managed to control her rage .


fn_spacy_tokens_for_baseline: The Trades Union Congress weighed in with a Green Charter , which included the right to hold ' green strikes ' over issues like the importation of toxic wastes .

source_bert_toks: the trades union congress weighed in with a green charter , which included the right to hold ' green strikes ' over issues like the import ##ation of toxic waste ##s .

reference_raw: The Trade Union Congress considered the Green Charter, which included the right to hold "green strikes" on issues such as the import of toxic waste.

reference_spacy_tokens: The Trade Union Congress considered the Green Charter , which included the right to hold " green strikes " on issues such as the import of toxic waste .


fn_spacy_tokens_for_baseline: She had her first meeting this morning with a textiles importer called Colin Weatherhead , who had promised to show her a range of fabrics he was positive she was going to love .

source_bert_toks: she had her first meeting this morning with a textiles import ##er called colin weather ##head , who had promised to show her a range of fabrics he was positive she was going to love .

reference_raw: Her first meeting this morning was with a textile importer named Colin Weatherhead, who promised to show her a number of fabrics that he was sure she would love.

reference_spacy_tokens: Her first meeting this morning was with a textile importer named Colin Weatherhead , who promised to show her a number of fabrics that he was sure she would love .


fn_spacy_tokens_for_baseline: Just to confuse us further , the ' opening party ' takes place tonight , with Bleach and Smashing Orange cutting the proverbial ribbon to start proceedings a day after they 've , erm , started .

source_bert_toks: just to confuse us further , the ' opening party ' takes place tonight , with b ##lea ##ch and smashing orange cutting the prove ##rb ##ial ribbon to start proceedings a day after they ' ve , er ##m , started .

reference_raw: For the sake of further confusion, there's a "opening party" tonight, with Bleach and Smashing Orange cutting off the proverbial tape and starting the proceedings the day after they, uh, started.

reference_spacy_tokens: For the sake of further confusion , there 's a " opening party " tonight , with Bleach and Smashing Orange cutting off the proverbial tape and starting the proceedings the day after they , uh , started .


fn_spacy_tokens_for_baseline: ' I 'll tell you something , ' gabbles Robert enthusiastically , ' There 's no - one out there now whose doorstep I 'd be willing to kip on just to get their autograph .

source_bert_toks: ' i ' ll tell you something , ' ga ##bble ##s robert enthusiastically , ' there ' s no - one out there now whose doorstep i ' d be willing to ki ##p on just to get their auto ##graph .

reference_raw: "Let me tell you something," Robert says excitedly, "there's no one out there whose door I'd like to knock on just to get their autograph.

reference_spacy_tokens: " Let me tell you something , " Robert says excitedly , " there 's no one out there whose door I 'd like to knock on just to get their autograph .


fn_spacy_tokens_for_baseline: In the interim there existed a period of extraordinary cross - fertilization between Christian and Arabic cultures .

source_bert_toks: in the interim there existed a period of extraordinary cross - fe ##rti ##lization between christian and arabic cultures .

reference_raw: In the meantime, there was a period of extreme cross-fertilisation between Christian and Arab cultures.

reference_spacy_tokens: In the meantime , there was a period of extreme cross - fertilisation between Christian and Arab cultures .


fn_spacy_tokens_for_baseline: Franks peeled off his surgical gloves .

source_bert_toks: franks peeled off his surgical gloves .

reference_raw: Franks took off his surgical gloves.

reference_spacy_tokens: Franks took off his surgical gloves .


fn_spacy_tokens_for_baseline: Few of them improve , and even fewer recover , many behave like members of cults , obeying their doctor without question , paying huge sums of money , and becoming estranged from their families .

source_bert_toks: few of them improve , and even fewer recover , many behave like members of cult ##s , obey ##ing their doctor without question , paying huge sums of money , and becoming estranged from their families .

reference_raw: Few improve, and even less recover, many act like cult members, obey their doctor without question, pay huge sums of money, and get separated from their families.

reference_spacy_tokens: Few improve , and even less recover , many act like cult members , obey their doctor without question , pay huge sums of money , and get separated from their families .


fn_spacy_tokens_for_baseline: So I carried it carefully like this , arm round the waist you see and off I went up the road for about forty fifty yards and put one in .

source_bert_toks: so i carried it carefully like this , arm round the waist you see and off i went up the road for about forty fifty yards and put one in .

reference_raw: So I carried it with care, my arm around the waist you're looking at, and I walked down the road for about forty-fifty yards, and I put one in.

reference_spacy_tokens: So I carried it with care , my arm around the waist you 're looking at , and I walked down the road for about forty - fifty yards , and I put one in .


fn_spacy_tokens_for_baseline: Early this March , this armoured car was quietly transported to the Artillery Museum , and the exhibition stands were dismantled .

source_bert_toks: early this march , this armoured car was quietly transported to the artillery museum , and the exhibition stands were dismantled .

reference_raw: At the beginning of March, this armored car was quietly taken to the Museum of Artillery, and the exhibition stands were dismantled.

reference_spacy_tokens: At the beginning of March , this armored car was quietly taken to the Museum of Artillery , and the exhibition stands were dismantled .


fn_spacy_tokens_for_baseline: What we learned from Muslim scholars is that robbing the religion from Muslims , is greater than robbing their honor and land .

source_bert_toks: what we learned from muslim scholars is that robb ##ing the religion from muslims , is greater than robb ##ing their honor and land .

reference_raw: We found out from Muslim scholars that robbing Muslims of religion is more important than stealing their honor and their country.

reference_spacy_tokens: We found out from Muslim scholars that robbing Muslims of religion is more important than stealing their honor and their country .


fn_spacy_tokens_for_baseline: Add dried fruits like sultanas , dried dates , figs , apricots , and also chopped nuts .

source_bert_toks: add dried fruits like sultan ##as , dried dates , fig ##s , apr ##ico ##ts , and also chopped nuts .

reference_raw: Add dried fruits such as sultanas, dried dates, figs, apricots, as well as sliced peanuts.

reference_spacy_tokens: Add dried fruits such as sultanas , dried dates , figs , apricots , as well as sliced peanuts .


fn_spacy_tokens_for_baseline: Analytic tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country 's nuclear infrastructure .

source_bert_toks: analytic tools include examining statements and articles in the news media , government reports including un ##class ##ified intelligence estimates , interviewing insider ##s who have had access to information about the clandestine program , reviewing secondary sources such as reports by analysts , and making scientific calculations based on the best available information about a country ' s nuclear infrastructure .

reference_raw: The analytical tools include examining statements and articles in the news media, government reports including unclassified intelligence estimates, interviewing insiders who had access to classified information, reviewing secondary resources such as analysts' reports, and making scientific calculations based on the best available information on the nuclear infrastructure of a country.

reference_spacy_tokens: The analytical tools include examining statements and articles in the news media , government reports including unclassified intelligence estimates , interviewing insiders who had access to classified information , reviewing secondary resources such as analysts ' reports , and making scientific calculations based on the best available information on the nuclear infrastructure of a country .


fn_spacy_tokens_for_baseline: Likewise , according to this theory , as we are all stress - prone , we are bound to get stressed when we find ourselves working somewhere where there is a high stress - count .

source_bert_toks: likewise , according to this theory , as we are all stress - prone , we are bound to get stressed when we find ourselves working somewhere where there is a high stress - count .

reference_raw: Similarly, according to this theory, since we're all pressure-prone, we're bound to be under pressure if we find ourselves working somewhere where there's a high-stress count.

reference_spacy_tokens: Similarly , according to this theory , since we 're all pressure - prone , we 're bound to be under pressure if we find ourselves working somewhere where there 's a high - stress count .


fn_spacy_tokens_for_baseline: He said he would pay particular attention to what happens to food and medicine entering the country under the U.N. oil - for - food program .

source_bert_toks: he said he would pay particular attention to what happens to food and medicine entering the country under the u . n . oil - for - food program .

reference_raw: He said he'd pay particular attention to what happens to food and drugs entering the country under the UN oil-for-food program.

reference_spacy_tokens: He said he 'd pay particular attention to what happens to food and drugs entering the country under the UN oil - for - food program .


fn_spacy_tokens_for_baseline: At the time she was lodging with two ladies who had lost their brother in the First World War .

source_bert_toks: at the time she was lodging with two ladies who had lost their brother in the first world war .

reference_raw: She was living with two women who lost their brother during World War I.


fn_spacy_tokens_for_baseline: He starts out with a full clip of ammo , but watch out ( Beadle 's about ) , it 's limited -- make sure you hit'im first time .

source_bert_toks: he starts out with a full clip of am ##mo , but watch out ( bea ##dle ' s about ) , it ' s limited - - make sure you hit ' im first time .

reference_raw: It starts with a full clip of ammunition, but be careful (Beadle's about), it's limited - make sure you hit it the first time.

reference_spacy_tokens: It starts with a full clip of ammunition , but be careful ( Beadle 's about ) , it 's limited - make sure you hit it the first time .


fn_spacy_tokens_for_baseline: Promenading the catwalk , Caroline had felt their blazing heat .

source_bert_toks: prom ##ena ##ding the cat ##walk , caroline had felt their blazing heat .

reference_raw: As Caroline walked along the walkway, she could feel their hot heat.

reference_spacy_tokens: As Caroline walked along the walkway , she could feel their hot heat .


fn_spacy_tokens_for_baseline: Unlike the passageways in the superstructure the area they were moving down was more unnerving , especially in the reduced visibility .

source_bert_toks: unlike the passageway ##s in the superstructure the area they were moving down was more un ##ner ##ving , especially in the reduced visibility .

reference_raw: Unlike the corridors in the superstructure, the area they were moving down was more disturbing, especially in view of the reduced visibility.

reference_spacy_tokens: Unlike the corridors in the superstructure , the area they were moving down was more disturbing , especially in view of the reduced visibility .


fn_spacy_tokens_for_baseline: The Vets in question are war veterans stationed along the Florida Keys , employed by the United States Government to build a railway track .

source_bert_toks: the vet ##s in question are war veterans stationed along the florida keys , employed by the united states government to build a railway track .

reference_raw: The veterans concerned are war veterans stationed along the Florida Keys, who are employed by the U.S. government to build a railway line.

reference_spacy_tokens: The veterans concerned are war veterans stationed along the Florida Keys , who are employed by the U.S. government to build a railway line .


fn_spacy_tokens_for_baseline: He was determined to torment her in any way he could .

source_bert_toks: he was determined to torment her in any way he could .

reference_raw: He was determined to torture her in any way he could.

reference_spacy_tokens: He was determined to torture her in any way he could .


fn_spacy_tokens_for_baseline: It is regrettable that the Ordnance Survey has capitulated to metrication by indicating altitudes in foreign metres on current maps and abandoning good old British feet .

source_bert_toks: it is regret ##table that the ordnance survey has cap ##it ##ulated to metric ##ation by indicating altitudes in foreign metres on current maps and abandoning good old british feet .

reference_raw: It is regrettable that the Ordnance Survey has surrendered to metrics by showing altitudes in foreign meters on existing maps and abandoning good old British feet.

reference_spacy_tokens: It is regrettable that the Ordnance Survey has surrendered to metrics by showing altitudes in foreign meters on existing maps and abandoning good old British feet .


fn_spacy_tokens_for_baseline: She chilled , remembering .

source_bert_toks: she chilled , remembering .

reference_raw: She froze, remembering.

reference_spacy_tokens: She froze , remembering .


fn_spacy_tokens_for_baseline: I always said that Halliwell was too timid by half .

source_bert_toks: i always said that hall ##i ##well was too tim ##id by half .

reference_raw: I always said Halliwell was half shy.

reference_spacy_tokens: I always said Halliwell was half shy .


fn_spacy_tokens_for_baseline: ' It is partly our fault -- we prevailed upon her to take Landor . '

source_bert_toks: ' it is partly our fault - - we prevailed upon her to take land ##or . '

reference_raw: 'It's partly our fault - we won over Landor.'

reference_spacy_tokens: ' It 's partly our fault - we won over Landor . '


fn_spacy_tokens_for_baseline: Uzenski was among three Marines killed in a firefight Monday after being ambushed in southern Afghanistan 's Helmand province , on the Pakistani border .

source_bert_toks: u ##zen ##ski was among three marines killed in a fire ##fight monday after being ambushed in southern afghanistan ' s helm ##and province , on the pakistani border .

reference_raw: Uzenski was one of three Marines killed in a firefight on Monday after he was attacked in the Helmand Province of South Afghanistan on the Pakistani border.

reference_spacy_tokens: Uzenski was one of three Marines killed in a firefight on Monday after he was attacked in the Helmand Province of South Afghanistan on the Pakistani border .


fn_spacy_tokens_for_baseline: Two hours later , when he had finished , Manville began to double - check it , by re - translating it all back into English .

source_bert_toks: two hours later , when he had finished , man ##ville began to double - check it , by re - translating it all back into english .

reference_raw: Two hours later, when he was done, Manville began to check and translate everything back into English.

reference_spacy_tokens: Two hours later , when he was done , Manville began to check and translate everything back into English .


fn_spacy_tokens_for_baseline: There are thousands more .

source_bert_toks: there are thousands more .

reference_raw: Thousands of others.

reference_spacy_tokens: Thousands of others .


fn_spacy_tokens_for_baseline: In interviewing pupils and parents Roger is not constrained by the need to ensure that ' acceptance ' of a place is conditional upon a future wish to leave .

source_bert_toks: in interviewing pupils and parents roger is not constrained by the need to ensure that ' acceptance ' of a place is conditional upon a future wish to leave .

reference_raw: When interviewing students and parents, Roger is not limited by the need to ensure that the "acceptance" of the place is conditional on a future wish to leave.

reference_spacy_tokens: When interviewing students and parents , Roger is not limited by the need to ensure that the " acceptance " of the place is conditional on a future wish to leave .


fn_spacy_tokens_for_baseline: The site of the ' 1066 ' Battle of Hastings , this charming medieval town which is dominated by the magnificent Battle Abbey .

source_bert_toks: the site of the ' 106 ##6 ' battle of hastings , this charming medieval town which is dominated by the magnificent battle abbey .

reference_raw: The place of the Battle of Hastings of '1066, this charming medieval city dominated by the glorious Battle Abbey.

reference_spacy_tokens: The place of the Battle of Hastings of ' 1066 , this charming medieval city dominated by the glorious Battle Abbey .


fn_spacy_tokens_for_baseline: It did mean that keeping the Seayak on a bearing in a big sea was a somewhat tiring and frustrating battle .

source_bert_toks: it did mean that keeping the sea ##ya ##k on a bearing in a big sea was a somewhat ti ##ring and frustrating battle .

reference_raw: It meant that keeping the Seayak on course in the great sea was a rather boring and frustrating battle.

reference_spacy_tokens: It meant that keeping the Seayak on course in the great sea was a rather boring and frustrating battle .


fn_spacy_tokens_for_baseline: The procession will meander through downtown Atlanta and past City Hall before ending at Atlanta -Fulton County Stadium .

source_bert_toks: the procession will mean ##der through downtown atlanta and past city hall before ending at atlanta - fulton county stadium .

reference_raw: The procession will pass through the center of Atlanta and around the city hall before it ends at the Atlanta-Fulton County Stadium.

reference_spacy_tokens: The procession will pass through the center of Atlanta and around the city hall before it ends at the Atlanta - Fulton County Stadium .


fn_spacy_tokens_for_baseline: Dr Irving said a snatcher 's emotional crisis could stem from infertility , the loss of a baby or a craving to be loved .

source_bert_toks: dr irving said a snatch ##er ' s emotional crisis could stem from in ##fer ##tility , the loss of a baby or a craving to be loved .

reference_raw: Dr. Irving said that the emotional crisis of a thief could be the result of infertility, the loss of a child, or the desire to be loved.

reference_spacy_tokens: Dr. Irving said that the emotional crisis of a thief could be the result of infertility , the loss of a child , or the desire to be loved .


fn_spacy_tokens_for_baseline: When he saw this he was further enraged and started towards the seer with an axe .

source_bert_toks: when he saw this he was further enraged and started towards the see ##r with an axe .

reference_raw: Seeing this, he was still angry and headed for the seer with his axe.

reference_spacy_tokens: Seeing this , he was still angry and headed for the seer with his axe .


fn_spacy_tokens_for_baseline: Charles and Diana frequently visited their brother John 's lichen - covered grave in the Sandringham churchyard and mused about what he would have been like and whether they would have been born if he had lived .

source_bert_toks: charles and diana frequently visited their brother john ' s li ##chen - covered grave in the sand ##ring ##ham churchyard and mused about what he would have been like and whether they would have been born if he had lived .

reference_raw: Charles and Diana often visited their brother John's lichen-covered grave in the Sandringham churchyard, wondering how he would be and if they would be born if he lived.

reference_spacy_tokens: Charles and Diana often visited their brother John 's lichen - covered grave in the Sandringham churchyard , wondering how he would be and if they would be born if he lived .


fn_spacy_tokens_for_baseline: This is why man sees only blurred images under water unless he wears air - filled goggles .

source_bert_toks: this is why man sees only blurred images under water unless he wears air - filled go ##ggles .

reference_raw: That's why you only see blurred images underwater if you don't wear air-filled glasses.

reference_spacy_tokens: That 's why you only see blurred images underwater if you do n't wear air - filled glasses .


fn_spacy_tokens_for_baseline: They dated , they rowed and they finally got married .

source_bert_toks: they dated , they rowe ##d and they finally got married .

reference_raw: They were going out, rowing, and finally getting married.

reference_spacy_tokens: They were going out , rowing , and finally getting married .


fn_spacy_tokens_for_baseline: ' And so you signed on with International Models ? '

source_bert_toks: ' and so you signed on with international models ? '

reference_raw: "So you've logged in to international models?"

reference_spacy_tokens: " So you 've logged in to international models ? "


fn_spacy_tokens_for_baseline: Suleiman the Magnificent rebuilt the walls and gates in the form they retain to this day .

source_bert_toks: sul ##eim ##an the magnificent rebuilt the walls and gates in the form they retain to this day .

reference_raw: Suleiman the Magnificent has reconstructed the barriers and gates in the form they've been keeping to this day.

reference_spacy_tokens: Suleiman the Magnificent has reconstructed the barriers and gates in the form they 've been keeping to this day .


fn_spacy_tokens_for_baseline: Whole cities have been created in the New Territories , although the unimaginative architecture of these towns has been criticized .

source_bert_toks: whole cities have been created in the new territories , although the un ##ima ##gina ##tive architecture of these towns has been criticized .

reference_raw: All cities were created in the new territories, but the unimaginative architecture of these cities was criticized.

reference_spacy_tokens: All cities were created in the new territories , but the unimaginative architecture of these cities was criticized .


fn_spacy_tokens_for_baseline: The secret of the Eternal City 's magic is that it lives and relishes all its ages simultaneously .

source_bert_toks: the secret of the eternal city ' s magic is that it lives and re ##lish ##es all its ages simultaneously .

reference_raw: The secret of the magic of the Eternal City is that it survives and enjoys all its ages at once.

reference_spacy_tokens: The secret of the magic of the Eternal City is that it survives and enjoys all its ages at once .


fn_spacy_tokens_for_baseline: Do n't dwell only on the horrors and dreadful effects of drugs .

source_bert_toks: don ' t dwell only on the horrors and dreadful effects of drugs .

reference_raw: Don't just worry about the horrors and the terrible effects of drugs.

reference_spacy_tokens: Do n't just worry about the horrors and the terrible effects of drugs .


fn_spacy_tokens_for_baseline: Finely crush the biscuits .

source_bert_toks: finely crush the biscuits .

reference_raw: Smash the cookies nicely.

reference_spacy_tokens: Smash the cookies nicely .


fn_spacy_tokens_for_baseline: The ghost of Stalin had to be exorcised before Nizan could be rehabilitated .

source_bert_toks: the ghost of stalin had to be ex ##or ##cise ##d before ni ##zan could be rehab ##ili ##tated .

reference_raw: Stalin's spirit must be exorcised before Nizan can be restored.

reference_spacy_tokens: Stalin 's spirit must be exorcised before Nizan can be restored .


fn_spacy_tokens_for_baseline: A year later the student can not conceive why he had such difficulty and suspicion about the nature of vectors .

source_bert_toks: a year later the student can not con ##ce ##ive why he had such difficulty and suspicion about the nature of vectors .

reference_raw: A year later, a student cannot imagine why he had such troubles and suspicions about the nature of vectors.

reference_spacy_tokens: A year later , a student can not imagine why he had such troubles and suspicions about the nature of vectors .


fn_spacy_tokens_for_baseline: Young Killifish are prone to velvet disease and Gold Australe are not exempt from this problem .

source_bert_toks: young kill ##if ##ish are prone to velvet disease and gold aus ##tral ##e are not exempt from this problem .

reference_raw: Young Killifish are susceptible to velvet disease, and gold Australia is not exempted from this problem.

reference_spacy_tokens: Young Killifish are susceptible to velvet disease , and gold Australia is not exempted from this problem .


fn_spacy_tokens_for_baseline: It was in consequence of that wish that Jennie Lee asked me if I would chair a committee on London Orchestras , which in fact I did , and whose findings I describe later .

source_bert_toks: it was in consequence of that wish that jennie lee asked me if i would chair a committee on london orchestras , which in fact i did , and whose findings i describe later .

reference_raw: As a result of this wish, Jennie Lee asked me to preside over the London Orchestra Committee, which I actually did, and whose findings I will describe later.

reference_spacy_tokens: As a result of this wish , Jennie Lee asked me to preside over the London Orchestra Committee , which I actually did , and whose findings I will describe later .


fn_spacy_tokens_for_baseline: Sadly , it seems that he has failed to grasp the relationship between the district council and the board .

source_bert_toks: sadly , it seems that he has failed to grasp the relationship between the district council and the board .

reference_raw: Unfortunately, he doesn't seem to understand the relationship between the county council and the board.

reference_spacy_tokens: Unfortunately , he does n't seem to understand the relationship between the county council and the board .


fn_spacy_tokens_for_baseline: If you do spin out , try recovering by sharply bearing away using footsteering .

source_bert_toks: if you do spin out , try recovering by sharply bearing away using foot ##ste ##ering .

reference_raw: If you turn around, try to regain your senses by taking a sharp turn with footsteering.

reference_spacy_tokens: If you turn around , try to regain your senses by taking a sharp turn with footsteering .


fn_spacy_tokens_for_baseline: The falling leaf inaugurates The reign of her confusion ; The pounding wave reverberates The dirge of her illusion ; And home , where passion lived and died , Becomes a place where she can hide , While all the town and harbor side Vibrate with her seclusion .

source_bert_toks: the falling leaf ina ##ug ##ura ##tes the reign of her confusion ; the pounding wave rev ##er ##ber ##ates the dir ##ge of her illusion ; and home , where passion lived and died , becomes a place where she can hide , while all the town and harbor side vi ##brate with her sec ##lusion .

reference_raw: The falling leaves inaugurate the reign of her confusion; the throbbing wave echoes the dirge of her illusion; and home, where passion dwells and dies, becomes a place where she can hide, while the whole city and port side vibrates with her seclusion.

reference_spacy_tokens: The falling leaves inaugurate the reign of her confusion ; the throbbing wave echoes the dirge of her illusion ; and home , where passion dwells and dies , becomes a place where she can hide , while the whole city and port side vibrates with her seclusion .


fn_spacy_tokens_for_baseline: One way of doing this was to tie the ankles together and to pinion the arms against the side of the corpse with the waist - band of the shroud .

source_bert_toks: one way of doing this was to tie the ankles together and to pin ##ion the arms against the side of the corpse with the waist - band of the sh ##roud .

reference_raw: One way to do that was to tie the ankles together and pin the arms to the side of the body with the waistband of the shroud.

reference_spacy_tokens: One way to do that was to tie the ankles together and pin the arms to the side of the body with the waistband of the shroud .


fn_spacy_tokens_for_baseline: Faced with a family mutiny , he decided to pack it in and sell up .

source_bert_toks: faced with a family mutiny , he decided to pack it in and sell up .

reference_raw: In the face of a family rebellion, he decided to pack it up and sell it.

reference_spacy_tokens: In the face of a family rebellion , he decided to pack it up and sell it .


fn_spacy_tokens_for_baseline: It had been four months altogether before he returned to the Works , by which time Andrew Jones had been installed in the showrooms as assistant salesman .

source_bert_toks: it had been four months altogether before he returned to the works , by which time andrew jones had been installed in the show ##rooms as assistant salesman .

reference_raw: It took him four months to get back to the Works, and by the time Andrew Jones was installed in the showroom as a sales assistant.

reference_spacy_tokens: It took him four months to get back to the Works , and by the time Andrew Jones was installed in the showroom as a sales assistant .


fn_spacy_tokens_for_baseline: The only benefit of the invasive strategy was revealed by exercise tolerance tests performed at 42 days and these suggest that there may be fewer patients with positive exercise tests in the invasive group .

source_bert_toks: the only benefit of the invasive strategy was revealed by exercise tolerance tests performed at 42 days and these suggest that there may be fewer patients with positive exercise tests in the invasive group .

reference_raw: The only benefit of the invasive strategy has been demonstrated by exercise tolerance tests carried out at 42 days, which indicate that in the invasive group there may be fewer patients with positive exercise tests.

reference_spacy_tokens: The only benefit of the invasive strategy has been demonstrated by exercise tolerance tests carried out at 42 days , which indicate that in the invasive group there may be fewer patients with positive exercise tests .


fn_spacy_tokens_for_baseline: THE OTHER reason for tuning into Moran 's Manson opera is to hear how he has deformed the music of The Beatles to fit inside the mad brain of Charlie .

source_bert_toks: the other reason for tuning into moran ' s manson opera is to hear how he has def ##or ##med the music of the beatles to fit inside the mad brain of charlie .

reference_raw: Another reason to tune in to Moran's Manson opera is to hear how he's mutilated the Beatles' music to fit into Charlie's crazy brain.

reference_spacy_tokens: Another reason to tune in to Moran 's Manson opera is to hear how he 's mutilated the Beatles ' music to fit into Charlie 's crazy brain .


fn_spacy_tokens_for_baseline: If it was n't for Mike I 'd be off but I 'm afraid he might start snorting coke if I turn my back .

source_bert_toks: if it wasn ' t for mike i ' d be off but i ' m afraid he might start snort ##ing coke if i turn my back .

reference_raw: If it wasn't for Mike, I'd be out, but I'm afraid if I turned my back on him, he'd start snorting cocaine.

reference_spacy_tokens: If it was n't for Mike , I 'd be out , but I 'm afraid if I turned my back on him , he 'd start snorting cocaine .


fn_spacy_tokens_for_baseline: The result of all this has been a rapid rise in in registered unemployment er nevertheless and a steep rise in in long term unemployment .

source_bert_toks: the result of all this has been a rapid rise in in registered unemployment er nevertheless and a steep rise in in long term unemployment .

reference_raw: However, the result was a rapid increase in registered unemployment, er, and a sharp increase in long-term unemployment.

reference_spacy_tokens: However , the result was a rapid increase in registered unemployment , er , and a sharp increase in long - term unemployment .


fn_spacy_tokens_for_baseline: The FBI expanded its painstaking search for evidence to an area surrounding the gulch where the Amtrak Sunset Limited lurched off a damaged track and asked the public for help finding the culprit .

source_bert_toks: the fbi expanded its pains ##taking search for evidence to an area surrounding the gu ##lch where the amtrak sunset limited lurched off a damaged track and asked the public for help finding the cu ##lp ##rit .

reference_raw: The FBI extended its painful search for evidence to the area around the gully where the Amtrak Sunset Limited stumbled off the damaged track and asked the public to help find the perpetrator.

reference_spacy_tokens: The FBI extended its painful search for evidence to the area around the gully where the Amtrak Sunset Limited stumbled off the damaged track and asked the public to help find the perpetrator .


fn_spacy_tokens_for_baseline: The NFPD maintains facilities in Yazd province to explore and exploit uranium deposits .

source_bert_toks: the n ##fp ##d maintains facilities in ya ##zd province to explore and exploit uranium deposits .

reference_raw: The NFPD maintains facilities for the exploration and exploitation of uranium deposits in Yazd Provincial.

reference_spacy_tokens: The NFPD maintains facilities for the exploration and exploitation of uranium deposits in Yazd Provincial .


fn_spacy_tokens_for_baseline: Unknowingly , he laughed , and found himself as conspicuous as though he had appeared suddenly in his night - clothes .

source_bert_toks: un ##k ##now ##ingly , he laughed , and found himself as conspicuous as though he had appeared suddenly in his night - clothes .

reference_raw: He laughed unconsciously, and found himself as obvious as if he had suddenly emerged in his nightclothes.

reference_spacy_tokens: He laughed unconsciously , and found himself as obvious as if he had suddenly emerged in his nightclothes .


fn_spacy_tokens_for_baseline: Meanwhile fellow travellers can only admire the hardiness of the last great explorer , now 83 .

source_bert_toks: meanwhile fellow travellers can only admire the hardin ##ess of the last great explorer , now 83 .

reference_raw: In the meantime, fellow travelers can only admire the hardship of the last great explorer, now 83.

reference_spacy_tokens: In the meantime , fellow travelers can only admire the hardship of the last great explorer , now 83 .


fn_spacy_tokens_for_baseline: He offended the king in some way and was summarily hanged , appearing since as a shaggy man , wearing a great set of stag 's horns and blowing a trumpet .

source_bert_toks: he offended the king in some way and was sum ##mar ##ily hanged , appearing since as a shaggy man , wearing a great set of st ##ag ' s horns and blowing a trumpet .

reference_raw: In some way he insulted the King and was hanged summarily, appearing as a shaggy man, wearing a large set of deer horns and blowing a trumpet.

reference_spacy_tokens: In some way he insulted the King and was hanged summarily , appearing as a shaggy man , wearing a large set of deer horns and blowing a trumpet .


fn_spacy_tokens_for_baseline: There was a thick concrete wall which we were all going to hide behind and we had our helmets on in case any car parts came raining down out of the sky .

source_bert_toks: there was a thick concrete wall which we were all going to hide behind and we had our helmets on in case any car parts came raining down out of the sky .

reference_raw: There was a heavy concrete wall that we all wanted to hide behind, and we had helmets on in case car parts rained down from the sky.

reference_spacy_tokens: There was a heavy concrete wall that we all wanted to hide behind , and we had helmets on in case car parts rained down from the sky .


fn_spacy_tokens_for_baseline: Before her illness , Rose was a very sociable person , enjoying a full life with her husband Sid , who had retired two years previously .

source_bert_toks: before her illness , rose was a very soc ##iable person , enjoying a full life with her husband sid , who had retired two years previously .

reference_raw: Before she was ill, Rose was a very social person, enjoying the full life of her husband, Sid, who had retired two years ago.

reference_spacy_tokens: Before she was ill , Rose was a very social person , enjoying the full life of her husband , Sid , who had retired two years ago .


fn_spacy_tokens_for_baseline: Racing commences at 11 am on Friday and half an hour earlier on the Saturday .

source_bert_toks: racing commence ##s at 11 ##am on friday and half an hour earlier on the saturday .

reference_raw: The race starts at 11:00 on Friday and a half-hour early on Saturday.

reference_spacy_tokens: The race starts at 11:00 on Friday and a half - hour early on Saturday .


fn_spacy_tokens_for_baseline: Sven Hjerson 's lugubrious face lit up in a brief smile .

source_bert_toks: sven h ##jer ##son ' s lu ##gu ##bri ##ous face lit up in a brief smile .

reference_raw: Sven Hjerson's luxurious face lit up with a brief smile.

reference_spacy_tokens: Sven Hjerson 's luxurious face lit up with a brief smile .


fn_spacy_tokens_for_baseline: Maybe forty , I judged , with regular features , no make - up and a slim wiry figure in shirt , sweater and jeans .

source_bert_toks: maybe forty , i judged , with regular features , no make - up and a slim wi ##ry figure in shirt , sweater and jeans .

reference_raw: Forty, I thought, with normal features, no makeup, and a slender, wiry figure in shirts, sweaters, and jeans.

reference_spacy_tokens: Forty , I thought , with normal features , no makeup , and a slender , wiry figure in shirts , sweaters , and jeans .


fn_spacy_tokens_for_baseline: And I 'm mad at you , you 've no ambition .

source_bert_toks: and i ' m mad at you , you ' ve no ambition .

reference_raw: And I'm angry with you, and you're not ambitious.

reference_spacy_tokens: And I 'm angry with you , and you 're not ambitious .


fn_spacy_tokens_for_baseline: The party still retained something of its pre - war sleekness ; elderly gentlemen in Trumper 's haircuts , wearing cream silk shirts and Brigade or Old Etonian ties .

source_bert_toks: the party still retained something of its pre - war sleek ##ness ; elderly gentlemen in trump ##er ' s hair ##cut ##s , wearing cream silk shirts and brigade or old eton ##ian ties .

reference_raw: The party still had some pre-war grace; older men in Trumper's haircuts, wearing cream silk shirts and brigade or old Etonian ties.

reference_spacy_tokens: The party still had some pre - war grace ; older men in Trumper 's haircuts , wearing cream silk shirts and brigade or old Etonian ties .


fn_spacy_tokens_for_baseline: At least 58 people died and more than 100 others were injured in Bangkok on Sept. 24 when a truck carrying two tanks of liquefied petroleum gas ( LPG ) crashed and exploded .

source_bert_toks: at least 58 people died and more than 100 others were injured in bangkok on sept . 24 when a truck carrying two tanks of li ##que ##fied petroleum gas ( lp ##g ) crashed and exploded .

reference_raw: At least 58 people died and more than 100 others were injured in Bangkok on September 24 when a truck carrying two tanks of liquid oil gas (LPG) crashed and exploded.

reference_spacy_tokens: At least 58 people died and more than 100 others were injured in Bangkok on September 24 when a truck carrying two tanks of liquid oil gas ( LPG ) crashed and exploded .


fn_spacy_tokens_for_baseline: She termed people fair or dark , and there was scarcely one of the valley 's many - hued inhabitants whom she did not classify by colour .

source_bert_toks: she termed people fair or dark , and there was scarcely one of the valley ' s many - hue ##d inhabitants whom she did not classify by colour .

reference_raw: She called people fair or dark, and there was hardly one of the many-hued people in the valley that she didn't classify by color.

reference_spacy_tokens: She called people fair or dark , and there was hardly one of the many - hued people in the valley that she did n't classify by color .


fn_spacy_tokens_for_baseline: Japan 's strength in Asia and her existence as a powerful member of the Western camp mean that Japan 's relations with Asia are no longer the mirror - image of those with the West .

source_bert_toks: japan ' s strength in asia and her existence as a powerful member of the western camp mean that japan ' s relations with asia are no longer the mirror - image of those with the west .

reference_raw: Japan's power in Asia and its existence as a powerful member of the Western Camp mean that Japan's relationship with Asia is no longer a mirror image of Westerners.

reference_spacy_tokens: Japan 's power in Asia and its existence as a powerful member of the Western Camp mean that Japan 's relationship with Asia is no longer a mirror image of Westerners .


fn_spacy_tokens_for_baseline: For the next few days Ajdabiya was extremely unsettled , and men showed all the conventional signs of being in crisis , and on the verge of further violent action .

source_bert_toks: for the next few days aj ##da ##bi ##ya was extremely un ##sett ##led , and men showed all the conventional signs of being in crisis , and on the verge of further violent action .

reference_raw: For the next few days, Ajdabiya was very concerned, and men showed all the usual signs of crisis and on the verge of further violence.

reference_spacy_tokens: For the next few days , Ajdabiya was very concerned , and men showed all the usual signs of crisis and on the verge of further violence .


fn_spacy_tokens_for_baseline: At night , however , he slept alone , and the avenger might find him .

source_bert_toks: at night , however , he slept alone , and the avenge ##r might find him .

reference_raw: But he was asleep alone at night, and the Avenger might find him.

reference_spacy_tokens: But he was asleep alone at night , and the Avenger might find him .


fn_spacy_tokens_for_baseline: And it was her Dad 's face that she saw , briefly superimposed on Simon 's , as he slid helplessly down the slimy walls .

source_bert_toks: and it was her dad ' s face that she saw , briefly super ##im ##posed on simon ' s , as he slid helplessly down the slim ##y walls .

reference_raw: And it was her father's face she saw, briefly imprinted on Simon's, as he slipped helplessly down the slimy walls.

reference_spacy_tokens: And it was her father 's face she saw , briefly imprinted on Simon 's , as he slipped helplessly down the slimy walls .


fn_spacy_tokens_for_baseline: um living in Arizona but and cruise control and tinted windows that 's about it i mean it 's got to have those things otherwise i do n't care

source_bert_toks: um living in arizona but and cruise control and tinted windows that ' s about it i mean it ' s got to have those things otherwise i don ' t care

reference_raw: Um, live in Arizona, but, uh, cruise control and tinted glass, which means it has to have these things, or I don't care.

reference_spacy_tokens: Um , live in Arizona , but , uh , cruise control and tinted glass , which means it has to have these things , or I do n't care .


fn_spacy_tokens_for_baseline: The Hamhung Chemical Engineering College is responsible for much of the training of the Korean People 's Army in CW defense .

source_bert_toks: the ham ##hun ##g chemical engineering college is responsible for much of the training of the korean people ' s army in cw defense .

reference_raw: Hamhung Chemical Engineering College is responsible for most of the training of the Korean People's Army in the defense of the Czech Republic.

reference_spacy_tokens: Hamhung Chemical Engineering College is responsible for most of the training of the Korean People 's Army in the defense of the Czech Republic .


fn_spacy_tokens_for_baseline: ' It was gone , Eric , ' he had explained , his eyes fidgeting to every part of Colonel Windsor 's crammed office as if seeking some corner which would not awaken images of once familiar surroundings .

source_bert_toks: ' it was gone , eric , ' he had explained , his eyes fi ##dget ##ing to every part of colonel windsor ' s cr ##ammed office as if seeking some corner which would not awake ##n images of once familiar surroundings .

reference_raw: 'He's gone, Eric,' he said, his eyes darting to every corner of Colonel Windsor's crowded office, as if he were looking for a corner that wouldn't wake up the images of a once-familiar environment.

reference_spacy_tokens: ' He 's gone , Eric , ' he said , his eyes darting to every corner of Colonel Windsor 's crowded office , as if he were looking for a corner that would n't wake up the images of a once - familiar environment .


fn_spacy_tokens_for_baseline: Tours of the village of Accompong and the Native Arawak cave drawings nearby can be arranged through the Jamaica Tourist Board .

source_bert_toks: tours of the village of acc ##omp ##ong and the native ara ##wa ##k cave drawings nearby can be arranged through the jamaica tourist board .

reference_raw: Tours of the village of Accompong and the nearby drawings of the native Arawak caves can be organized through the Jamaica Tourist Council.

reference_spacy_tokens: Tours of the village of Accompong and the nearby drawings of the native Arawak caves can be organized through the Jamaica Tourist Council .


fn_spacy_tokens_for_baseline: Portugal 's very precarious foothold on the Asian coast ended in 1999 with a formal handover to China .

source_bert_toks: portugal ' s very pre ##car ##ious foot ##hold on the asian coast ended in 1999 with a formal hand ##over to china .

reference_raw: Portugal's very uncertain foothold on the Asian shore ended in 1999 with a formal handover to China.

reference_spacy_tokens: Portugal 's very uncertain foothold on the Asian shore ended in 1999 with a formal handover to China .


fn_spacy_tokens_for_baseline: We lie out on the stones and talk ,

source_bert_toks: we lie out on the stones and talk ,

reference_raw: Let's lay on the rocks and talk,

reference_spacy_tokens: Let 's lay on the rocks and talk ,


fn_spacy_tokens_for_baseline: While the kettle is boiling he scans the front page .

source_bert_toks: while the kettle is boiling he scans the front page .

reference_raw: As the kettle boils, she looks at the front page.

reference_spacy_tokens: As the kettle boils , she looks at the front page .


fn_spacy_tokens_for_baseline: At Hyde Park Corner a tiny youngish man was followed onto the train by a large stocky man a sadistic smirk emerging from the corners of his mouth .

source_bert_toks: at hyde park corner a tiny young ##ish man was followed onto the train by a large stock ##y man a sad ##istic smirk emerging from the corners of his mouth .

reference_raw: A small young man in the corner of Hyde Park was followed to the train by a big, stocky man with a sadistic smile coming out of the corners of his mouth.

reference_spacy_tokens: A small young man in the corner of Hyde Park was followed to the train by a big , stocky man with a sadistic smile coming out of the corners of his mouth .


fn_spacy_tokens_for_baseline: But the argument against further reform is that stability above all is what the country needs .

source_bert_toks: but the argument against further reform is that stability above all is what the country needs .

reference_raw: But the fight against further reform is that stability is what the country needs in the first place.

reference_spacy_tokens: But the fight against further reform is that stability is what the country needs in the first place .


fn_spacy_tokens_for_baseline: An avalanche of mud cascaded into the waste - paper basket .

source_bert_toks: an avalanche of mud cascade ##d into the waste - paper basket .

reference_raw: An avalanche of mud poured into a basket of waste paper.

reference_spacy_tokens: An avalanche of mud poured into a basket of waste paper .


fn_spacy_tokens_for_baseline: Soup kitchens were opened to feed the destitute ; in Chicago people waited at the back doors of restaurants for left - over food .

source_bert_toks: soup kitchens were opened to feed the des ##ti ##tute ; in chicago people waited at the back doors of restaurants for left - over food .

reference_raw: The soup kitchens were open to feed the poor; in Chicago people were waiting at the rear door of the restaurants for the rest of the food.

reference_spacy_tokens: The soup kitchens were open to feed the poor ; in Chicago people were waiting at the rear door of the restaurants for the rest of the food .


fn_spacy_tokens_for_baseline: There were similar jubilant scenes in refugee camps in Lebanon .

source_bert_toks: there were similar ju ##bil ##ant scenes in refugee camps in lebanon .

reference_raw: The refugee camps in Lebanon had similar cheering scenes.

reference_spacy_tokens: The refugee camps in Lebanon had similar cheering scenes .


fn_spacy_tokens_for_baseline: No doubt those shiny - elbowed clerks in the Home Office prefer it so .

source_bert_toks: no doubt those shiny - elbow ##ed clerks in the home office prefer it so .

reference_raw: There's no doubt that the shiny-elbowed officials at the Home Office prefer it that way.

reference_spacy_tokens: There 's no doubt that the shiny - elbowed officials at the Home Office prefer it that way .


fn_spacy_tokens_for_baseline: Usually Artai behaved like a fractious child , his temper uncertain , his demeanour abrupt and discourteous .

source_bert_toks: usually art ##ai behaved like a fra ##ct ##ious child , his temper uncertain , his dem ##ean ##our abrupt and disco ##urt ##eous .

reference_raw: Artai usually behaved like a frail child, his temper uncertain, his manner sudden and rude.

reference_spacy_tokens: Artai usually behaved like a frail child , his temper uncertain , his manner sudden and rude .


fn_spacy_tokens_for_baseline: Yet the best the far - left could do was not enough to deter the biggest voting bloc -- nearly 40 % -- from endorsing the direction Spain is taking .

source_bert_toks: yet the best the far - left could do was not enough to deter the biggest voting bloc - - nearly 40 % - - from end ##ors ##ing the direction spain is taking .

reference_raw: But the best the far left could do was not enough to deter the largest voting block - almost 40% - from supporting the direction Spain is taking.

reference_spacy_tokens: But the best the far left could do was not enough to deter the largest voting block - almost 40 % - from supporting the direction Spain is taking .


fn_spacy_tokens_for_baseline: Freelance cameraman Andy Styczynski , 32 , spotted the elusive bachelor at the wheel of a white Rover Montego -- and chased after him in a VW Golf GTi .

source_bert_toks: freelance camera ##man andy st ##y ##cz ##yn ##ski , 32 , spotted the elusive bachelor at the wheel of a white rover monte ##go - - and chased after him in a v ##w golf gt ##i .

reference_raw: Freelance cameraman Andy Styczynski, thirty-two years old, saw the elusive young man behind the wheel of a white Rover Montego, and chased him in a VW Golf GTi.

reference_spacy_tokens: Freelance cameraman Andy Styczynski , thirty - two years old , saw the elusive young man behind the wheel of a white Rover Montego , and chased him in a VW Golf GTi .


fn_spacy_tokens_for_baseline: The X - ray image produced is nothing more than a large amorphous black mass . I fear that for every trash truck caught carrying contraband into Michigan , many more get through undetected with drugs , medical waste or other illegal material .

source_bert_toks: the x - ray image produced is nothing more than a large amor ##ph ##ous black mass . i fear that for every trash truck caught carrying contra ##band into michigan , many more get through und ##ete ##cted with drugs , medical waste or other illegal material .

reference_raw: The X-ray image produced is nothing more than a mass of amorphous black matter. I'm afraid that for every garbage truck caught carrying contra-band to Michigan, a lot of others will pass undetected by drugs, medical waste, or other illegal materials.

reference_spacy_tokens: The X - ray image produced is nothing more than a mass of amorphous black matter . I 'm afraid that for every garbage truck caught carrying contra - band to Michigan , a lot of others will pass undetected by drugs , medical waste , or other illegal materials .


fn_spacy_tokens_for_baseline: The officer in charge of the Masai Extra - Territorial District , as the reserve was now called , recommended further efforts to abolish the manyatta system , whose demise had been frequently , but prematurely , announced since 1922 .

source_bert_toks: the officer in charge of the mas ##ai extra - territorial district , as the reserve was now called , recommended further efforts to ab ##olis ##h the many ##att ##a system , whose demise had been frequently , but prematurely , announced since 1922 .

reference_raw: The officer in charge of the Masai extra-territorial district, as the reserve was now called, recommended that further efforts be made to abolish the manyatta system, whose death was often, but prematurely, announced since 1922.

reference_spacy_tokens: The officer in charge of the Masai extra - territorial district , as the reserve was now called , recommended that further efforts be made to abolish the manyatta system , whose death was often , but prematurely , announced since 1922 .


fn_spacy_tokens_for_baseline: Cornelius turned to his kidnapper .

source_bert_toks: cornelius turned to his kidnap ##per .

reference_raw: Cornelius turned to the abductor.

reference_spacy_tokens: Cornelius turned to the abductor .


fn_spacy_tokens_for_baseline: It appears to have rather generalized habits , feeding on everything from worms to clams , which it can crush with its powerful appendages , using the bases of its legs like nutcrackers .

source_bert_toks: it appears to have rather generalized habits , feeding on everything from worms to cl ##ams , which it can crush with its powerful app ##end ##ages , using the bases of its legs like nut ##cr ##acker ##s .

reference_raw: He seems to have a rather generalized habit of feeding on everything from worms to clams, which he can smash with his powerful appendages and use the bases of his legs like nutcrackers.

reference_spacy_tokens: He seems to have a rather generalized habit of feeding on everything from worms to clams , which he can smash with his powerful appendages and use the bases of his legs like nutcrackers .


fn_spacy_tokens_for_baseline: By now he was concerned with practical details : ' You might scout around for mesh stockings !

source_bert_toks: by now he was concerned with practical details : ' you might scout around for mesh stockings !

reference_raw: He was already interested in practical details: 'You could look around for mesh stockings!

reference_spacy_tokens: He was already interested in practical details : ' You could look around for mesh stockings !


fn_spacy_tokens_for_baseline: 1- Preserving the unity of AL QAEDA is an important and legitimate goal , which occurs by fearing God in private as well as in public . ( Surat 65 , 5 ) .

source_bert_toks: 1 - preserving the unity of al qaeda is an important and legitimate goal , which occurs by fearing god in private as well as in public . ( sur ##at 65 , 5 ) .

reference_raw: 1- Maintaining the unity of AL QAEDA is an important and justified objective that is achieved by fearing God both in private and in public (Surat 65, 5).

reference_spacy_tokens: 1- Maintaining the unity of AL QAEDA is an important and justified objective that is achieved by fearing God both in private and in public ( Surat 65 , 5 ) .


fn_spacy_tokens_for_baseline: Although the fictional Inspector Morse freely wanders the cloisters , technically police can not enter college grounds without permission from the master .

source_bert_toks: although the fictional inspector morse freely wander ##s the cl ##ois ##ters , technically police can not enter college grounds without permission from the master .

reference_raw: Although the fictional Inspector Morse is free to roam the cloisters, technically the police cannot enter the university grounds without the master's consent.

reference_spacy_tokens: Although the fictional Inspector Morse is free to roam the cloisters , technically the police can not enter the university grounds without the master 's consent .


fn_spacy_tokens_for_baseline: ' I was merely admiring the garden .

source_bert_toks: ' i was merely admiring the garden .

reference_raw: I was just adoring the garden.

reference_spacy_tokens: I was just adoring the garden .


fn_spacy_tokens_for_baseline: The sun was shining the next morning but the brightness of the day did nothing to dispel Eline 's feelings of dejection .

source_bert_toks: the sun was shining the next morning but the brightness of the day did nothing to di ##sp ##el eli ##ne ' s feelings of de ##ject ##ion .

reference_raw: The next morning the sun shone, but the brightness of the day did not dispel Eline's feelings of despair.

reference_spacy_tokens: The next morning the sun shone , but the brightness of the day did not dispel Eline 's feelings of despair .


fn_spacy_tokens_for_baseline: The memory of lightning flaring between the cracks in the boards and me pushing home the four - inch nails with numb fingers arrived simultaneous with the patter of descending footsteps .

source_bert_toks: the memory of lightning fl ##aring between the cracks in the boards and me pushing home the four - inch nails with numb fingers arrived simultaneous with the pat ##ter of descending footsteps .

reference_raw: The memory of the lightning flashing through the cracks in the boards, and I pushed the four-inch nails home with numb fingers, came at the same time as the patter of the descending steps.

reference_spacy_tokens: The memory of the lightning flashing through the cracks in the boards , and I pushed the four - inch nails home with numb fingers , came at the same time as the patter of the descending steps .


fn_spacy_tokens_for_baseline: In the nation 's capital , the sound you hear is of paper being shuffled .

source_bert_toks: in the nation ' s capital , the sound you hear is of paper being shuffled .

reference_raw: In the capital of the nation, the noise you hear is the scrambling of paper.

reference_spacy_tokens: In the capital of the nation , the noise you hear is the scrambling of paper .


fn_spacy_tokens_for_baseline: You ca n't go round making threats against people with impunity . '

source_bert_toks: you can ' t go round making threats against people with imp ##uni ##ty . '

reference_raw: You can't go around threatening people with impunity.'

reference_spacy_tokens: You ca n't go around threatening people with impunity . '


fn_spacy_tokens_for_baseline: Proper names are paradigm referential symbols , and it seems natural to look to them for clues .

source_bert_toks: proper names are paradigm refer ##ential symbols , and it seems natural to look to them for clues .

reference_raw: The right names are paradigm reference symbols, and it seems natural to look for clues.

reference_spacy_tokens: The right names are paradigm reference symbols , and it seems natural to look for clues .


fn_spacy_tokens_for_baseline: Here even window shopping is a pleasure if you ca n't afford to treat yourself , or you can hunt out a less extravagant purchase amongst the cities ' colourful markets and larger department stores .

source_bert_toks: here even window shopping is a pleasure if you can ' t afford to treat yourself , or you can hunt out a less extravagant purchase amongst the cities ' colourful markets and larger department stores .

reference_raw: Here, even window shopping is a pleasure if you can't afford to take care of yourself, or you can hunt down a less extravagant purchase between the city's colorful markets and larger shops.

reference_spacy_tokens: Here , even window shopping is a pleasure if you ca n't afford to take care of yourself , or you can hunt down a less extravagant purchase between the city 's colorful markets and larger shops .


fn_spacy_tokens_for_baseline: Although the Nuclear Non - Proliferation Treaty ( NPT ) allows transfers of nuclear technology for peaceful purposes to non - nuclear weapon states , the United States has vehemently opposed the Russian - Iranian deal .

source_bert_toks: although the nuclear non - proliferation treaty ( np ##t ) allows transfers of nuclear technology for peaceful purposes to non - nuclear weapon states , the united states has ve ##hem ##ently opposed the russian - iranian deal .

reference_raw: While the Nuclear Non-Proliferation Treaty (NPT) permits the transfer of nuclear technology for peaceful purposes to non-nuclear states, the United States has vehemently opposed the Russian-Iran agreement.

reference_spacy_tokens: While the Nuclear Non - Proliferation Treaty ( NPT ) permits the transfer of nuclear technology for peaceful purposes to non - nuclear states , the United States has vehemently opposed the Russian - Iran agreement .


fn_spacy_tokens_for_baseline: When you are in the air use the back foot to pull the tail of the board up under your buttocks .

source_bert_toks: when you are in the air use the back foot to pull the tail of the board up under your butt ##ocks .

reference_raw: When you're in the air, use your back leg to pull the board's tail up under your ass.

reference_spacy_tokens: When you 're in the air , use your back leg to pull the board 's tail up under your ass .


fn_spacy_tokens_for_baseline: I hate to disappoint anyone but that was n't the case -- although the veiled hints caused us plenty of amusement .

source_bert_toks: i hate to di ##sa ##pp ##oint anyone but that wasn ' t the case - - although the veil ##ed hints caused us plenty of amusement .

reference_raw: I don't want to disappoint anyone, but it wasn't - though the veiled hints made us a lot of fun.

reference_spacy_tokens: I do n't want to disappoint anyone , but it was n't - though the veiled hints made us a lot of fun .


fn_spacy_tokens_for_baseline: The shooting happened after the prince went in search of a dinghy taken from his yacht .

source_bert_toks: the shooting happened after the prince went in search of a ding ##hy taken from his yacht .

reference_raw: The shooting took place after the prince went looking for the dinghy that had been taken from his yacht.

reference_spacy_tokens: The shooting took place after the prince went looking for the dinghy that had been taken from his yacht .


fn_spacy_tokens_for_baseline: Louisa was about 46 when she began to be troubled by unsightly red blotches on her face .

source_bert_toks: louisa was about 46 when she began to be troubled by un ##sight ##ly red b ##lot ##ches on her face .

reference_raw: Louisa was about forty-six when she began to worry about unsightly red spots on her face.

reference_spacy_tokens: Louisa was about forty - six when she began to worry about unsightly red spots on her face .


fn_spacy_tokens_for_baseline: She took two or three large breaths over the top of her bag of groceries , while Mrs Stych watched her stupefaction with complacency .

source_bert_toks: she took two or three large breaths over the top of her bag of groceries , while mrs st ##ych watched her stu ##pe ##fa ##ction with com ##pl ##ace ##ncy .

reference_raw: She took two or three deep breaths over the top of her shopping bag, and Mrs. Stych watched her numbness with complacency.

reference_spacy_tokens: She took two or three deep breaths over the top of her shopping bag , and Mrs. Stych watched her numbness with complacency .


fn_spacy_tokens_for_baseline: ' When my kid brother turns up with a blonde blue - eyed actress on his arm , and apparently engaged , I 'm naturally inclined to think the worst , ' he told her , scarcely moving his lips .

source_bert_toks: ' when my kid brother turns up with a blonde blue - eyed actress on his arm , and apparently engaged , i ' m naturally inclined to think the worst , ' he told her , scarcely moving his lips .

reference_raw: "When my little brother shows up with a blond-blue-eyed actress on his arm, and he's obviously involved, I'm naturally inclined to think the worst," he said, barely moving his lips.

reference_spacy_tokens: " When my little brother shows up with a blond - blue - eyed actress on his arm , and he 's obviously involved , I 'm naturally inclined to think the worst , " he said , barely moving his lips .


fn_spacy_tokens_for_baseline: For all its tension between unison and bedlam , its freedom to use any kind of gesture or step , you are rarely exhilarated by a sense of newly - discovered movement .

source_bert_toks: for all its tension between unison and bed ##lam , its freedom to use any kind of gesture or step , you are rarely ex ##hila ##rated by a sense of newly - discovered movement .

reference_raw: Despite all the tension between the unison and the bedlam, the freedom to use any gesture or step, you are rarely thrilled by the sensation of newly discovered movement.

reference_spacy_tokens: Despite all the tension between the unison and the bedlam , the freedom to use any gesture or step , you are rarely thrilled by the sensation of newly discovered movement .


fn_spacy_tokens_for_baseline: Doreen hastened towards them , her face contorted with anger as she exclaimed , ' Silas -- I 've been searching everywhere for you .

source_bert_toks: do ##reen haste ##ned towards them , her face con ##tort ##ed with anger as she exclaimed , ' silas - - i ' ve been searching everywhere for you .

reference_raw: Doreen hurried toward them, her face twisted with anger as she cried, "Silas, I've been looking for you everywhere.

reference_spacy_tokens: Doreen hurried toward them , her face twisted with anger as she cried , " Silas , I 've been looking for you everywhere .


fn_spacy_tokens_for_baseline: She pulled at the fringe of the curtain .

source_bert_toks: she pulled at the fringe of the curtain .

reference_raw: She tugged at the edge of the curtain.

reference_spacy_tokens: She tugged at the edge of the curtain .


fn_spacy_tokens_for_baseline: Estonia exchanged all the roubles in circulation for its new kroon in three days , at a rate of ten roubles per kroon .

source_bert_toks: estonia exchanged all the ro ##ub ##les in circulation for its new k ##ro ##on in three days , at a rate of ten ro ##ub ##les per k ##ro ##on .

reference_raw: Estonia traded all the rubles in circulation for its new kroon in three days at a rate of 10 roubles per kroon.

reference_spacy_tokens: Estonia traded all the rubles in circulation for its new kroon in three days at a rate of 10 roubles per kroon .


fn_spacy_tokens_for_baseline: He 's a miserly character , that one . '

source_bert_toks: he ' s a mis ##erly character , that one . '

reference_raw: He's a poor figure, this one.'

reference_spacy_tokens: He 's a poor figure , this one . '


fn_spacy_tokens_for_baseline: He stank of paint - stripper .

source_bert_toks: he stan ##k of paint - strip ##per .

reference_raw: It smells like a paint stripper.

reference_spacy_tokens: It smells like a paint stripper .


fn_spacy_tokens_for_baseline: ' I would have died for you when I married you , and now you laugh at my foolishness in marrying you !

source_bert_toks: ' i would have died for you when i married you , and now you laugh at my foolish ##ness in marrying you !

reference_raw: I'd die for you if I married you, and now you're laughing at my stupidity when I married you!

reference_spacy_tokens: I 'd die for you if I married you , and now you 're laughing at my stupidity when I married you !


fn_spacy_tokens_for_baseline: Eight minutes later Mullin 's perceptive cross - kick found Rees unmarked for an easy short - range try .

source_bert_toks: eight minutes later mu ##llin ' s per ##ceptive cross - kick found rees unmarked for an easy short - range try .

reference_raw: Eight minutes later, Mullin's conspicuous cross-kick found Rees unmarked for a simple short-range attempt.

reference_spacy_tokens: Eight minutes later , Mullin 's conspicuous cross - kick found Rees unmarked for a simple short - range attempt .


fn_spacy_tokens_for_baseline: It was fortunate that he did because otherwise the superintendent might have missed the turning on the right , discreetly hidden in a murky thicket .

source_bert_toks: it was fortunate that he did because otherwise the superintendent might have missed the turning on the right , discreet ##ly hidden in a mu ##rky thick ##et .

reference_raw: He was lucky to do so, for otherwise the superintendent might have missed a turn to the right, hidden discreetly in the muddy bushes.

reference_spacy_tokens: He was lucky to do so , for otherwise the superintendent might have missed a turn to the right , hidden discreetly in the muddy bushes .


fn_spacy_tokens_for_baseline: However , such treatment does nothing to alleviate the causes of such a bad habit , and no doubt increases the horse 's anxiety to even higher levels .

source_bert_toks: however , such treatment does nothing to alleviate the causes of such a bad habit , and no doubt increases the horse ' s anxiety to even higher levels .

reference_raw: Such treatment does not, however, mitigate the causes of such a bad habit, and it undoubtedly increases the anxiety of the horse to even higher levels.

reference_spacy_tokens: Such treatment does not , however , mitigate the causes of such a bad habit , and it undoubtedly increases the anxiety of the horse to even higher levels .


fn_spacy_tokens_for_baseline: But at least one other person was killed and several were wounded when the bomber 's vest exploded near the governor 's convoy .

source_bert_toks: but at least one other person was killed and several were wounded when the bomber ' s vest exploded near the governor ' s convoy .

reference_raw: But at least one other person had been killed, and several had been injured when the bomber's vest exploded near the governor's column.

reference_spacy_tokens: But at least one other person had been killed , and several had been injured when the bomber 's vest exploded near the governor 's column .


fn_spacy_tokens_for_baseline: On 24 - 25 February 1831 , in latitude 65 ? 57 ' S , longitude 47 ? 20 ' E , Biscoe discovered Enderby Land , sighting black mountain tops showing through the ice - cap .

source_bert_toks: on 24 - 25 february 1831 , in latitude 65 ? 57 ' s , longitude 47 ? 20 ' e , bis ##coe discovered end ##er ##by land , sighting black mountain tops showing through the ice - cap .

reference_raw: On February 24, 25, 1831, latitude 65? 57'S, longitude 47? 20'E, Biscoe discovered Enderby Land, and saw the black peaks of the mountain that appeared through the ice cap.

reference_spacy_tokens: On February 24 , 25 , 1831 , latitude 65 ? 57 'S , longitude 47 ? 20'E , Biscoe discovered Enderby Land , and saw the black peaks of the mountain that appeared through the ice cap .


fn_spacy_tokens_for_baseline: The world index gained 1.7 % .

source_bert_toks: the world index gained 1 . 7 % .

reference_raw: The World Index has won 1.7%.

reference_spacy_tokens: The World Index has won 1.7 % .


fn_spacy_tokens_for_baseline: At eighteen he 'd married a beautiful young girl of seventeen , who died when he was twenty - five , and he mourned her for ten years .

source_bert_toks: at eighteen he ' d married a beautiful young girl of seventeen , who died when he was twenty - five , and he mo ##urne ##d her for ten years .

reference_raw: When he was eighteen, he married a beautiful young woman of seventeen, who had died at twenty-five, and had mourned her for ten years.

reference_spacy_tokens: When he was eighteen , he married a beautiful young woman of seventeen , who had died at twenty - five , and had mourned her for ten years .


fn_spacy_tokens_for_baseline: In a terse statement the board of directors said it had ' considered the Great Britain management set - up and individual talks will take place over the next few days before a formal announcement is made ' .

source_bert_toks: in a ter ##se statement the board of directors said it had ' considered the great britain management set - up and individual talks will take place over the next few days before a formal announcement is made ' .

reference_raw: In a brief statement, the board of directors stated that it had "considered the setting up of the UK administration and that individual interviews would take place in the next few days before the official announcement was made."

reference_spacy_tokens: In a brief statement , the board of directors stated that it had " considered the setting up of the UK administration and that individual interviews would take place in the next few days before the official announcement was made . "


fn_spacy_tokens_for_baseline: In the distance she could hear the soporific music .

source_bert_toks: in the distance she could hear the so ##por ##ific music .

reference_raw: She could hear soft music in the distance.

reference_spacy_tokens: She could hear soft music in the distance .


fn_spacy_tokens_for_baseline: They must have kicked him very hard for it to be so tender .

source_bert_toks: they must have kicked him very hard for it to be so tender .

reference_raw: To be so gentle, he must have been hit hard.

reference_spacy_tokens: To be so gentle , he must have been hit hard .


fn_spacy_tokens_for_baseline: Then the train went into reverse , motors growling , occupants groaning , and trundled slowly back through the squalls of rain , passing Maryhill and looping down through Anniesland and over Great Western Road .

source_bert_toks: then the train went into reverse , motors growling , occupants groaning , and tr ##und ##led slowly back through the sq ##ual ##ls of rain , passing mary ##hill and loop ##ing down through annie ##sl ##and and over great western road .

reference_raw: Then the train turned, the engines snarling, the occupants groaning, and trudged slowly back through the rain, past Maryhill, past Anniesland and across the Great West Road.

reference_spacy_tokens: Then the train turned , the engines snarling , the occupants groaning , and trudged slowly back through the rain , past Maryhill , past Anniesland and across the Great West Road .


fn_spacy_tokens_for_baseline: Wily and bold , he and his companion threw their pursuer off their track by entering a lodging - house in Edmonton Street and leaving by the back - gate into Curzon Square .

source_bert_toks: wil ##y and bold , he and his companion threw their pursue ##r off their track by entering a lodging - house in edmonton street and leaving by the back - gate into cu ##rz ##on square .

reference_raw: Wistfully and boldly, he and his companion threw the chaser out of the way by entering the house on Edmonton Street and leaving at the rear gate to Curzon Square.

reference_spacy_tokens: Wistfully and boldly , he and his companion threw the chaser out of the way by entering the house on Edmonton Street and leaving at the rear gate to Curzon Square .


fn_spacy_tokens_for_baseline: An unexpected error has occurred while processing your transaction .

source_bert_toks: an unexpected error has occurred while processing your transaction .

reference_raw: There was an unexpected error processing your transaction.

reference_spacy_tokens: There was an unexpected error processing your transaction .


fn_spacy_tokens_for_baseline: The Rangers told investigators they later saw mortar rounds explode near them and thought they could see their attackers moving on the mountainside above them , the paper reported .

source_bert_toks: the rangers told investigators they later saw mortar rounds explode near them and thought they could see their attackers moving on the mountains ##ide above them , the paper reported .

reference_raw: The Rangers told the investigators that they later saw the mortar rounds blow up near them, and they thought they saw their assailants moving up the slope above them, the newspaper said.

reference_spacy_tokens: The Rangers told the investigators that they later saw the mortar rounds blow up near them , and they thought they saw their assailants moving up the slope above them , the newspaper said .


fn_spacy_tokens_for_baseline: ' Besides , if you remember , sir , the potted shrimps had a solidified butter glaze on top . '

source_bert_toks: ' besides , if you remember , sir , the pot ##ted shrimp ##s had a solid ##ified butter g ##laze on top . '

reference_raw: "Besides, if you'll recall, sir, the potted shrimp had a solid butter glass on it."

reference_spacy_tokens: " Besides , if you 'll recall , sir , the potted shrimp had a solid butter glass on it . "


fn_spacy_tokens_for_baseline: Eventually , I was strong enough to concentrate on tearing the hare into pieces , impaling the joints on sticks , and thrusting them into the glowing heat of my fire .

source_bert_toks: eventually , i was strong enough to concentrate on tearing the hare into pieces , imp ##aling the joints on sticks , and thrusting them into the glowing heat of my fire .

reference_raw: In the end, I was strong enough to concentrate on ripping the rabbit to pieces, impaling the joints on the sticks and thrusting them into the blazing heat of my fire.

reference_spacy_tokens: In the end , I was strong enough to concentrate on ripping the rabbit to pieces , impaling the joints on the sticks and thrusting them into the blazing heat of my fire .


fn_spacy_tokens_for_baseline: The karateka then pivots halfway round on the ball of the left foot , while rotating the entire body forward .

source_bert_toks: the karate ##ka then pi ##vot ##s halfway round on the ball of the left foot , while rotating the entire body forward .

reference_raw: The karateka then pivots halfway around the left foot ball and spins the whole body forward.

reference_spacy_tokens: The karateka then pivots halfway around the left foot ball and spins the whole body forward .