fn_spacy_tokens_for_baseline: The idea was strongly opposed by Britain , and quickly vetoed by the Council of Ministers .

source_bert_toks: the idea was strongly opposed by britain , and quickly veto ##ed by the council of ministers .

reference_raw: Britain strongly objected to this idea and was quickly vetoed by the Council of Ministers.

reference_spacy_tokens: Britain strongly objected to this idea and was quickly vetoed by the Council of Ministers .


fn_spacy_tokens_for_baseline: A man from a cell ahead of mine , a slight figure , was knocked aside by two more powerful men working together .

source_bert_toks: a man from a cell ahead of mine , a slight figure , was knocked aside by two more powerful men working together .

reference_raw: The man in the cell in front of me, a small figure, was knocked aside by two more powerful men working together.

reference_spacy_tokens: The man in the cell in front of me , a small figure , was knocked aside by two more powerful men working together .


fn_spacy_tokens_for_baseline: One of the few occasions big bream spend any length of time in marginal weed is the two or three weeks in spring or early summer when they spawn .

source_bert_toks: one of the few occasions big br ##ea ##m spend any length of time in marginal weed is the two or three weeks in spring or early summer when they spawn .

reference_raw: One of the few times that large cream spends any length of time in marginal weeds is two or three weeks in the spring or early summer when it is produced.

reference_spacy_tokens: One of the few times that large cream spends any length of time in marginal weeds is two or three weeks in the spring or early summer when it is produced .


fn_spacy_tokens_for_baseline: Laura unloaded her cargo on to the sofa .

source_bert_toks: laura un ##loaded her cargo on to the sofa .

reference_raw: Laura put her cargo on the couch.

reference_spacy_tokens: Laura put her cargo on the couch .


fn_spacy_tokens_for_baseline: She would lay the table her own way , not the French way , and no one would reprove her for putting the forks and spoons face up .

source_bert_toks: she would lay the table her own way , not the french way , and no one would rep ##rove her for putting the forks and spoon ##s face up .

reference_raw: She would lay the table in her own way, not in the French way, and no one would reproach her for putting the forks and spoons in front of her.

reference_spacy_tokens: She would lay the table in her own way , not in the French way , and no one would reproach her for putting the forks and spoons in front of her .


fn_spacy_tokens_for_baseline: Saturday was sunny and bright , and any claim that the match would be settled by tomorrow evening would have been dismissed with a scornful cackle .

source_bert_toks: saturday was sunny and bright , and any claim that the match would be settled by tomorrow evening would have been dismissed with a sc ##orn ##ful ca ##ckle .

reference_raw: Saturday was sunny and clear, and any claim that the match would be settled by tomorrow night would be rejected with a scornful chuckle.

reference_spacy_tokens: Saturday was sunny and clear , and any claim that the match would be settled by tomorrow night would be rejected with a scornful chuckle .


fn_spacy_tokens_for_baseline: A French lady in an adjoining room who understood some English had become greatly alarmed and taken it upon herself to summon the police .

source_bert_toks: a french lady in an adjoining room who understood some english had become greatly alarmed and taken it upon herself to summon the police .

reference_raw: The French woman in the next room, who understood some English, was very alarmed and decided to call the police.

reference_spacy_tokens: The French woman in the next room , who understood some English , was very alarmed and decided to call the police .


fn_spacy_tokens_for_baseline: The scrapping of the Wage Councils will mean that millions of working people will be open to exploitation by unscrupulous employers .

source_bert_toks: the scrap ##ping of the wage councils will mean that millions of working people will be open to exploitation by un ##sc ##rup ##ulous employers .

reference_raw: The scrapping of wage councils will mean that millions of workers will be open to exploitation by ruthless employers.

reference_spacy_tokens: The scrapping of wage councils will mean that millions of workers will be open to exploitation by ruthless employers .


fn_spacy_tokens_for_baseline: They had not mentioned Kiwi fruit , nor the avocado and they definitely had n't warned him about the pine kernels .

source_bert_toks: they had not mentioned ki ##wi fruit , nor the av ##oca ##do and they definitely hadn ' t warned him about the pine kernel ##s .

reference_raw: They didn't say anything about the Kiwi fruit or the avocado, and they certainly didn't warn him about the pine cores.

reference_spacy_tokens: They did n't say anything about the Kiwi fruit or the avocado , and they certainly did n't warn him about the pine cores .


fn_spacy_tokens_for_baseline: Most treatment programmes include behavioural modification techniques , making the patient 's access to pleasurable activities contingent on weight gain .

source_bert_toks: most treatment programmes include behaviour ##al modification techniques , making the patient ' s access to pleas ##urable activities contingent on weight gain .

reference_raw: The majority of treatment programmes include behavioural modification techniques, which make the patient's access to pleasant activities dependent on weight gain.

reference_spacy_tokens: The majority of treatment programmes include behavioural modification techniques , which make the patient 's access to pleasant activities dependent on weight gain .


fn_spacy_tokens_for_baseline: This means that Iran will place the Natanz facility , and any enriched uranium it produces , under IAEA inspection but that , as long as no nuclear materials are present , the IAEA would have no ability to examine locations in Iran where it believed nuclear weapons design research might be under way .

source_bert_toks: this means that iran will place the nat ##an ##z facility , and any enriched uranium it produces , under ia ##ea inspection but that , as long as no nuclear materials are present , the ia ##ea would have no ability to examine locations in iran where it believed nuclear weapons design research might be under way .

reference_raw: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA, but that until there is no nuclear material, the IAEA will not be able to examine the sites in Iran where it believes that research on the design of nuclear weapons may be ongoing.

reference_spacy_tokens: This means that Iran will place the Natanz facility and any enriched uranium it produces under the control of the IAEA , but that until there is no nuclear material , the IAEA will not be able to examine the sites in Iran where it believes that research on the design of nuclear weapons may be ongoing .


fn_spacy_tokens_for_baseline: The input for such a reflex could come from a single class of broadly tuned vertical orientation detectors .

source_bert_toks: the input for such a reflex could come from a single class of broadly tuned vertical orientation detectors .

reference_raw: The input of such a reflex could come from one group of broadly tuned vertical orientation detectors.

reference_spacy_tokens: The input of such a reflex could come from one group of broadly tuned vertical orientation detectors .


fn_spacy_tokens_for_baseline: It can be bought undyed , bleached or dyed in a variety of colours .

source_bert_toks: it can be bought und ##yed , b ##lea ##ched or dyed in a variety of colours .

reference_raw: It may be purchased undyed, bleached or coloured in different colours.

reference_spacy_tokens: It may be purchased undyed , bleached or coloured in different colours .


fn_spacy_tokens_for_baseline: 1 ) JOBS -- The upper parts of the Himalayas are covered with snow throughout the year making it impossible for animals and people to live there .

source_bert_toks: 1 ) jobs - - the upper parts of the himalayas are covered with snow throughout the year making it impossible for animals and people to live there .

reference_raw: 1) JOBS - The upper parts of the Himalayas are covered with snow throughout the year, which prevents animals and humans from living there.

reference_spacy_tokens: 1 ) JOBS - The upper parts of the Himalayas are covered with snow throughout the year , which prevents animals and humans from living there .


fn_spacy_tokens_for_baseline: TN contributed image analysis and software expertise in method development .

source_bert_toks: tn contributed image analysis and software expertise in method development .

reference_raw: TN has contributed to the analysis of pictures and software expertise in the development of methods.

reference_spacy_tokens: TN has contributed to the analysis of pictures and software expertise in the development of methods .


fn_spacy_tokens_for_baseline: Shows 7 : 30 and 10 : 30 pm Wednesday- Monday ; dark Tuesday ; $ 45 - 60 .

source_bert_toks: shows 7 : 30 and 10 : 30 pm wednesday - monday ; dark tuesday ; $ 45 - 60 .

reference_raw: It shows 7:30 a.m. and 10:30 a.m. Wednesday-Monday; Black Tuesday; $45 - 60.


fn_spacy_tokens_for_baseline: She looked distinctly ruffled and there was a downward tilt to her mouth that betrayed her ill - humour .

source_bert_toks: she looked distinctly ru ##ffled and there was a downward tilt to her mouth that betrayed her ill - humour .

reference_raw: She looked distinctly confused, and there was a downward tilt to her mouth that betrayed her bad humor.

reference_spacy_tokens: She looked distinctly confused , and there was a downward tilt to her mouth that betrayed her bad humor .


fn_spacy_tokens_for_baseline: ' They 've looked worse , ' retorted Isabel drily .

source_bert_toks: ' they ' ve looked worse , ' retorted isabel dr ##ily .

reference_raw: 'They looked worse,' said Isabel dryly.

reference_spacy_tokens: ' They looked worse , ' said Isabel dryly .


fn_spacy_tokens_for_baseline: Dr Ali was scurrying along beside him and from time to time glaring down the line of boys .

source_bert_toks: dr ali was sc ##ur ##ry ##ing along beside him and from time to time glaring down the line of boys .

reference_raw: Dr. Ali ran beside him, occasionally looking down the line of boys.

reference_spacy_tokens: Dr. Ali ran beside him , occasionally looking down the line of boys .


fn_spacy_tokens_for_baseline: Dahmer 's gruesome past came to light in 1991 , when a handcuffed man flagged down police and led officers to Dahmer 's reeking apartment .

source_bert_toks: da ##hm ##er ' s gr ##ues ##ome past came to light in 1991 , when a hand ##cu ##ffed man flag ##ged down police and led officers to da ##hm ##er ' s re ##eki ##ng apartment .

reference_raw: Dahmer's gruesome past came to light in 1991, when a handcuffed man flagged the police and led the officers to Dahmer's stinking apartment.

reference_spacy_tokens: Dahmer 's gruesome past came to light in 1991 , when a handcuffed man flagged the police and led the officers to Dahmer 's stinking apartment .


fn_spacy_tokens_for_baseline: The argument for solar constancy is essentially the one I have already outlined .

source_bert_toks: the argument for solar con ##stan ##cy is essentially the one i have already outlined .

reference_raw: The case of solar constancy is essentially the one I have already outlined.

reference_spacy_tokens: The case of solar constancy is essentially the one I have already outlined .


fn_spacy_tokens_for_baseline: The British officer got there first , but knew there was a secret agreement for the French to control Lebanon .

source_bert_toks: the british officer got there first , but knew there was a secret agreement for the french to control lebanon .

reference_raw: The British officer was the first to arrive, but he knew that the French had a secret agreement to control Lebanon.

reference_spacy_tokens: The British officer was the first to arrive , but he knew that the French had a secret agreement to control Lebanon .


fn_spacy_tokens_for_baseline: When their changes are completed , and after they have worked up a sweat , ringers often skip off to the local pub , leaving worship for others below .

source_bert_toks: when their changes are completed , and after they have worked up a sweat , ring ##ers often skip off to the local pub , leaving worship for others below .

reference_raw: When they've finished their changes, and when they've worked out their sweats, the bandits often jump into the local pub and leave worship for the rest of them down there.

reference_spacy_tokens: When they 've finished their changes , and when they 've worked out their sweats , the bandits often jump into the local pub and leave worship for the rest of them down there .


fn_spacy_tokens_for_baseline: In the mid-1990s , first Perl [ 32 ] and then Java [ 33 ] were becoming widespread as programming languages for developing bioinformatics tools .

source_bert_toks: in the mid - 1990s , first per ##l [ 32 ] and then java [ 33 ] were becoming widespread as programming languages for developing bio ##in ##form ##atics tools .

reference_raw: In the mid-1990s, the first Perl [32] and then Java [33] developed as programming languages for the development of bio-information tools.

reference_spacy_tokens: In the mid-1990s , the first Perl [ 32 ] and then Java [ 33 ] developed as programming languages for the development of bio - information tools .


fn_spacy_tokens_for_baseline: The response to the Government 's consultation is the third time in a week that the forum has voiced strong criticism of Scottish Office policy .

source_bert_toks: the response to the government ' s consultation is the third time in a week that the forum has voiced strong criticism of scottish office policy .

reference_raw: The response to the government consultation is the third time this week that the forum has expressed a strong criticism of the policy of the Scottish Office.

reference_spacy_tokens: The response to the government consultation is the third time this week that the forum has expressed a strong criticism of the policy of the Scottish Office .


fn_spacy_tokens_for_baseline: Those of us lucky enough to be linguists involved in teacher training have long felt that the potential contribution of linguistics to education is enormous .

source_bert_toks: those of us lucky enough to be linguist ##s involved in teacher training have long felt that the potential contribution of linguistics to education is enormous .

reference_raw: Those of us lucky enough to be linguists involved in teacher training have long felt that the potential contribution of languages to education is huge.

reference_spacy_tokens: Those of us lucky enough to be linguists involved in teacher training have long felt that the potential contribution of languages to education is huge .


fn_spacy_tokens_for_baseline: Decision to end 1948 treaty with Soviet Union

source_bert_toks: decision to end 1948 treaty with soviet union

reference_raw: The decision to terminate the 1948 agreement with the Soviet Union


fn_spacy_tokens_for_baseline: Rather than ramming the trainers with the guns , the dolphins either ' swam away or put their snouts on the trainers ' shoulders -- very affectionately ! '

source_bert_toks: rather than ram ##ming the trainers with the guns , the dolphins either ' swam away or put their snout ##s on the trainers ' shoulders - - very affectionately ! '

reference_raw: Instead of hitting the trainers with guns, the dolphins either took off or put their noses on the coach's shoulders - very fondly!'

reference_spacy_tokens: Instead of hitting the trainers with guns , the dolphins either took off or put their noses on the coach 's shoulders - very fondly ! '


fn_spacy_tokens_for_baseline: A plumbers ' convention , Renwick noted from the outsize announcement propped on a gilded easel .

source_bert_toks: a plum ##bers ' convention , ren ##wick noted from the outs ##ize announcement propped on a gilded ease ##l .

reference_raw: The plumbing convention, Renwick noted from a large announcement, resting on a golden easel.

reference_spacy_tokens: The plumbing convention , Renwick noted from a large announcement , resting on a golden easel .


fn_spacy_tokens_for_baseline: From the ferry terminals on Hong Kong Island you can escape to islands without cars or cares , where the local people smile " hello " and , if you 're lucky , point you to a secret beach for the ultimate in quality leisure time .

source_bert_toks: from the ferry terminals on hong kong island you can escape to islands without cars or cares , where the local people smile " hello " and , if you ' re lucky , point you to a secret beach for the ultimate in quality leisure time .

reference_raw: You can escape from the Hong Kong Isle ferry terminals to islands without cars or cares, where the locals smile "hello" and, if you're lucky, point you to a secret beach for the final quality of free time.

reference_spacy_tokens: You can escape from the Hong Kong Isle ferry terminals to islands without cars or cares , where the locals smile " hello " and , if you 're lucky , point you to a secret beach for the final quality of free time .


fn_spacy_tokens_for_baseline: It was almost a wail of anguish .

source_bert_toks: it was almost a wai ##l of anguish .

reference_raw: It was almost a howl of anguish.

reference_spacy_tokens: It was almost a howl of anguish .


fn_spacy_tokens_for_baseline: After a while , to Robbie 's relief , Fen threw off his knapsack , suggesting they stop and eat their sandwiches .

source_bert_toks: after a while , to robbie ' s relief , fen threw off his kn ##ap ##sack , suggesting they stop and eat their sandwiches .

reference_raw: After a while, to Robbie's relief, Fen dropped his pack and suggested they stop and eat their sandwiches.

reference_spacy_tokens: After a while , to Robbie 's relief , Fen dropped his pack and suggested they stop and eat their sandwiches .


fn_spacy_tokens_for_baseline: He remained silent when the government decided to extend the period of contribution required for a full state pension , thereby calling into question the right to retire at 60 , introduced by the Socialists .

source_bert_toks: he remained silent when the government decided to extend the period of contribution required for a full state pension , thereby calling into question the right to retire at 60 , introduced by the socialists .

reference_raw: He said nothing when the Government decided to extend the period of contribution necessary for a full state pension, thereby calling into question the right to retire at the age of 60 introduced by the Socialists.

reference_spacy_tokens: He said nothing when the Government decided to extend the period of contribution necessary for a full state pension , thereby calling into question the right to retire at the age of 60 introduced by the Socialists .


fn_spacy_tokens_for_baseline: She repeated the request about the baptism and reminded me of my promise to baptise her baby .

source_bert_toks: she repeated the request about the baptism and reminded me of my promise to ba ##pt ##ise her baby .

reference_raw: She repeated the baptism request, reminding me of my vow to christen her child.

reference_spacy_tokens: She repeated the baptism request , reminding me of my vow to christen her child .


fn_spacy_tokens_for_baseline: The bids confirmed that they were best to hang on to them and they will now be refurbished and pole - mounted at the entrance to the Museum .

source_bert_toks: the bids confirmed that they were best to hang on to them and they will now be refurbished and pole - mounted at the entrance to the museum .

reference_raw: The bids said it was best to hold on to them, and now they're going to be refurbished and posted at the museum entrance.

reference_spacy_tokens: The bids said it was best to hold on to them , and now they 're going to be refurbished and posted at the museum entrance .


fn_spacy_tokens_for_baseline: Dissection of the gallbladder was concluded uneventfully , but during removal through the umbilical incision the specimen ruptured .

source_bert_toks: di ##sse ##ction of the gall ##bla ##dder was concluded uneven ##tf ##ull ##y , but during removal through the um ##bil ##ical inc ##ision the specimen ru ##pt ##ured .

reference_raw: The dissection of the gallbladder was completed unevenly, but the sample ruptured when removed by an umbilical cut.

reference_spacy_tokens: The dissection of the gallbladder was completed unevenly , but the sample ruptured when removed by an umbilical cut .


fn_spacy_tokens_for_baseline: As midnight approached , camouflage - clad service members whooped and snapped pictures of the president , who dispensed hugs and handshakes before taking to the podium .

source_bert_toks: as midnight approached , camouflage - clad service members who ##oped and snapped pictures of the president , who di ##sp ##ense ##d hugs and hands ##hak ##es before taking to the podium .

reference_raw: As midnight approached, the camouflage-clad servicemen who were hooping and snapping pictures of the President, who gave up hugs and handshakes before taking them to the stage.

reference_spacy_tokens: As midnight approached , the camouflage - clad servicemen who were hooping and snapping pictures of the President , who gave up hugs and handshakes before taking them to the stage .


fn_spacy_tokens_for_baseline: Initially it was believed that these facilities would eventually assemble and then produce the M-9 / DF-15 and M-11 / DF-11 .

source_bert_toks: initially it was believed that these facilities would eventually assemble and then produce the m - 9 / d ##f - 15 and m - 11 / d ##f - 11 .

reference_raw: It was initially assumed that these facilities would eventually assemble and then produce M-9/DF-15 and M-11/DF-11.

reference_spacy_tokens: It was initially assumed that these facilities would eventually assemble and then produce M-9 / DF-15 and M-11 / DF-11 .


fn_spacy_tokens_for_baseline: When I realized it was over , I went and stood out in front of the house , waiting and praying for Merrill to come home , shivering as if it were 20 below zero until he got there .

source_bert_toks: when i realized it was over , i went and stood out in front of the house , waiting and praying for merrill to come home , shivering as if it were 20 below zero until he got there .

reference_raw: When I realised it was over, I went and stood outside the house, waiting and praying for Merrill to come home, shivering like it was twenty-five before he got there.

reference_spacy_tokens: When I realised it was over , I went and stood outside the house , waiting and praying for Merrill to come home , shivering like it was twenty - five before he got there .


fn_spacy_tokens_for_baseline: It is lodged on a shelf on the mountain gorge , high above the Yantra river with precipitous rocks falling steeply below it .

source_bert_toks: it is lodged on a shelf on the mountain gorge , high above the yan ##tra river with pre ##ci ##pit ##ous rocks falling steep ##ly below it .

reference_raw: It is placed on a ledge on a mountain ravine, high above the Yantra River, with rainy rocks falling steeply beneath it.

reference_spacy_tokens: It is placed on a ledge on a mountain ravine , high above the Yantra River , with rainy rocks falling steeply beneath it .


fn_spacy_tokens_for_baseline: If it is true that 7 million tonnes of straw are wasted each year , why is straw so expensive to horse riding , racing , and show jumping stables ?

source_bert_toks: if it is true that 7 million tonnes of straw are wasted each year , why is straw so expensive to horse riding , racing , and show jumping stables ?

reference_raw: If it's true that 7 million tons of straw are wasted every year, why is it so costly to ride a horse, race, and show hopping stables?

reference_spacy_tokens: If it 's true that 7 million tons of straw are wasted every year , why is it so costly to ride a horse , race , and show hopping stables ?


fn_spacy_tokens_for_baseline: yeah morning is usually a better time to exercise but i usually find that after work is when i have the time to do it

reference_raw: Yeah morning is usually a better time to practice, but I usually find out after work is when I have time to do it.

reference_spacy_tokens: Yeah morning is usually a better time to practice , but I usually find out after work is when I have time to do it .


fn_spacy_tokens_for_baseline: They sat savouring the malty brew for a while with the darkness silent outside the windows .

source_bert_toks: they sat sa ##vo ##uring the mal ##ty brew for a while with the darkness silent outside the windows .

reference_raw: For a while they sat enjoying the malty beer, and the darkness was quiet outside the windows.

reference_spacy_tokens: For a while they sat enjoying the malty beer , and the darkness was quiet outside the windows .


fn_spacy_tokens_for_baseline: Anne and Elizabeth arrived with an armful of baguettes hot from the baker , a basketful of ham , garlic sausage , pyty and several pounds of unsalted butter .

source_bert_toks: anne and elizabeth arrived with an arm ##ful of bag ##uet ##tes hot from the baker , a basket ##ful of ham , garlic sausage , p ##yt ##y and several pounds of un ##sal ##ted butter .

reference_raw: Anna and Elizabeth arrived with an armful of baguettes hot from the baker, a basket full of ham, garlic sausage, pyty, and a few pounds of unsalted buttress.

reference_spacy_tokens: Anna and Elizabeth arrived with an armful of baguettes hot from the baker , a basket full of ham , garlic sausage , pyty , and a few pounds of unsalted buttress .


fn_spacy_tokens_for_baseline: As with the BROWNIES , gruagachs will happily serve their masters for nothing more than a cup of milk .

source_bert_toks: as with the brown ##ies , gr ##ua ##ga ##chs will happily serve their masters for nothing more than a cup of milk .

reference_raw: Like the Brownies, the gruagachs would be happy to serve their masters for nothing but a glass of milk.

reference_spacy_tokens: Like the Brownies , the gruagachs would be happy to serve their masters for nothing but a glass of milk .


fn_spacy_tokens_for_baseline: Britain , the US and France warned Iraq yesterday of ' serious consequences ' if it did not remove anti - aircraft missiles threatening UN aircraft searching for nuclear and chemical weapons .

source_bert_toks: britain , the us and france warned iraq yesterday of ' serious consequences ' if it did not remove anti - aircraft missiles threatening un aircraft searching for nuclear and chemical weapons .

reference_raw: Last night, Britain, the United States, and France warned Iraq about "serious consequences" if it failed to remove anti-aircraft rockets threatening UN aircraft looking for nuclear and chemical weapons.

reference_spacy_tokens: Last night , Britain , the United States , and France warned Iraq about " serious consequences " if it failed to remove anti - aircraft rockets threatening UN aircraft looking for nuclear and chemical weapons .


fn_spacy_tokens_for_baseline: The new reached Sweden and John Tanberg , who later became the scientific director and manager of Electrolux , the world - famous manufacturer of household appliances .

source_bert_toks: the new reached sweden and john tan ##berg , who later became the scientific director and manager of electro ##lux , the world - famous manufacturer of household appliances .

reference_raw: The new ones arrived in Sweden and John Tanberg, who later became the scientific director and manager of Electrolux, the world-famous manufacturer of household equipment.

reference_spacy_tokens: The new ones arrived in Sweden and John Tanberg , who later became the scientific director and manager of Electrolux , the world - famous manufacturer of household equipment .


fn_spacy_tokens_for_baseline: In developing work in the classroom one 's own expectations and experiences often interfere with a child 's progress and it is important to be aware of this and exercise self control .

source_bert_toks: in developing work in the classroom one ' s own expectations and experiences often interfere with a child ' s progress and it is important to be aware of this and exercise self control .

reference_raw: When developing work in the classroom, the expectations and experiences of the child often affect the progress of the child, and it is important to be aware of this and to exercise self-control.

reference_spacy_tokens: When developing work in the classroom , the expectations and experiences of the child often affect the progress of the child , and it is important to be aware of this and to exercise self - control .


fn_spacy_tokens_for_baseline: One way would be to speed up the flow of health supplies and other urgent commodities to the country under a U.N. humanitarian program , he said .

source_bert_toks: one way would be to speed up the flow of health supplies and other urgent commodities to the country under a u . n . humanitarian program , he said .

reference_raw: One way would be to accelerate the flow of medical supplies and other urgent commodities into the country under the UN Humanitarian Program, he told himself.

reference_spacy_tokens: One way would be to accelerate the flow of medical supplies and other urgent commodities into the country under the UN Humanitarian Program , he told himself .


fn_spacy_tokens_for_baseline: County and district councillors came along and after searching questions , agreed with our plan wholeheartedly and gave us very good advice .

source_bert_toks: county and district councillors came along and after searching questions , agreed with our plan whole ##hearted ##ly and gave us very good advice .

reference_raw: The county and county councillors arrived and, after questioning, agreed with all their hearts to our plan, and gave us a great deal of advice.

reference_spacy_tokens: The county and county councillors arrived and , after questioning , agreed with all their hearts to our plan , and gave us a great deal of advice .


fn_spacy_tokens_for_baseline: Kraus is the man whose magazine , The Torch , provides a title for this , the second volume of Canetti 's autobiography .

source_bert_toks: k ##raus is the man whose magazine , the torch , provides a title for this , the second volume of cane ##tti ' s autobiography .

reference_raw: Kraus is the man whose magazine, The Torch, gives the title, the second volume of Canetti's autobiographical work.

reference_spacy_tokens: Kraus is the man whose magazine , The Torch , gives the title , the second volume of Canetti 's autobiographical work .


fn_spacy_tokens_for_baseline: Scientists in Rio de Janeiro blame local authorities for not fighting the mosquito over the past two years .

source_bert_toks: scientists in rio de janeiro blame local authorities for not fighting the mosquito over the past two years .

reference_raw: Scientists in Rio de Janeiro accuse the local authorities of having failed to combat a mosquito in the last two years.

reference_spacy_tokens: Scientists in Rio de Janeiro accuse the local authorities of having failed to combat a mosquito in the last two years .


fn_spacy_tokens_for_baseline: He looked down at the tablecloths splattered with grease and wine , the platters now cleared .

source_bert_toks: he looked down at the table ##cloth ##s sp ##lat ##tered with grease and wine , the platt ##ers now cleared .

reference_raw: He looked down at the tablecloths stained with grease and wine, and now the plates were clean.

reference_spacy_tokens: He looked down at the tablecloths stained with grease and wine , and now the plates were clean .


fn_spacy_tokens_for_baseline: But the son intercepted the letter and persuaded them to sign .

source_bert_toks: but the son intercepted the letter and persuaded them to sign .

reference_raw: But the son picked up the letter and convinced them to sign it.

reference_spacy_tokens: But the son picked up the letter and convinced them to sign it .


fn_spacy_tokens_for_baseline: In 1699 another English scientist , the anatomist Edward Tyson , basing his demonstration on the dissection of an orang - utang , made the influential pronouncement that pygmies represent ' an intermediate link between Ape and Man ' , 5 a proposition later adopted by both Linnaeus and Rousseau .

source_bert_toks: in 1699 another english scientist , the ana ##tom ##ist edward tyson , basin ##g his demonstration on the di ##sse ##ction of an or ##ang - uta ##ng , made the influential pro ##no ##unce ##ment that p ##y ##gm ##ies represent ' an intermediate link between ape and man ' , 5 a proposition later adopted by both linnaeus and rousseau .

reference_raw: In 1699, another English scientist, anatomist Edward Tyson, based his demonstration on the dissection of an orang-utang, made a powerful statement that pygmies represent an intermediate link between Ape and Man, five proposals later adopted by Linnaeus and Rousseau.

reference_spacy_tokens: In 1699 , another English scientist , anatomist Edward Tyson , based his demonstration on the dissection of an orang - utang , made a powerful statement that pygmies represent an intermediate link between Ape and Man , five proposals later adopted by Linnaeus and Rousseau .


fn_spacy_tokens_for_baseline: AROUND 3,000 white - collar jobs at British Coal are set to be axed and more pits could close if the industry does not become more competitive , the corporation 's chairman admitted yesterday .

source_bert_toks: around 3 , 000 white - collar jobs at british coal are set to be axe ##d and more pits could close if the industry does not become more competitive , the corporation ' s chairman admitted yesterday .

reference_raw: About 3,000 white-collar works in the British Coal are set to be axed, and more pits could be closed unless the industry becomes more competitive, the company's chairman admitted yesterday.

reference_spacy_tokens: About 3,000 white - collar works in the British Coal are set to be axed , and more pits could be closed unless the industry becomes more competitive , the company 's chairman admitted yesterday .


fn_spacy_tokens_for_baseline: She finds it disconcerting . '

source_bert_toks: she finds it disco ##nce ##rting . '

reference_raw: It's disturbing to her.'

reference_spacy_tokens: It 's disturbing to her . '


fn_spacy_tokens_for_baseline: The Peak Tram , originally steam - powered , was built to speed the wealthy taipans to their mountainside retreats .

source_bert_toks: the peak tram , originally steam - powered , was built to speed the wealthy tai ##pan ##s to their mountains ##ide retreat ##s .

reference_raw: The Peak Tram, originally steam-powered, was built to speed the rich taipans to their mountain retreats.

reference_spacy_tokens: The Peak Tram , originally steam - powered , was built to speed the rich taipans to their mountain retreats .


fn_spacy_tokens_for_baseline: At the far end of the table Nadirpur almost yelped in anguish .

source_bert_toks: at the far end of the table nad ##ir ##pur almost ye ##lp ##ed in anguish .

reference_raw: At the far end of the table Nadirpur nearly screamed in anguish.

reference_spacy_tokens: At the far end of the table Nadirpur nearly screamed in anguish .


fn_spacy_tokens_for_baseline: Mr Burrows added that Smith , who had a previous conviction for indecent assault , claimed he was high on drink and ecstasy at the time , but denied having a knife .

source_bert_toks: mr burrows added that smith , who had a previous conviction for ind ##ece ##nt assault , claimed he was high on drink and ecstasy at the time , but denied having a knife .

reference_raw: Mr. Burrows added that Smith, who had previously been convicted of indecent assault, had claimed to be drunk and ecstasy at the time, but had refused to have a knife.

reference_spacy_tokens: Mr. Burrows added that Smith , who had previously been convicted of indecent assault , had claimed to be drunk and ecstasy at the time , but had refused to have a knife .


fn_spacy_tokens_for_baseline: He said he would return to answer all charges .

source_bert_toks: he said he would return to answer all charges .

reference_raw: He said he'd come back and answer all the accusations.

reference_spacy_tokens: He said he 'd come back and answer all the accusations .


fn_spacy_tokens_for_baseline: Christina kneeled down to pick up the handle of a cup .

source_bert_toks: christina knee ##led down to pick up the handle of a cup .

reference_raw: Christine dropped to her knees and picked up the cup handle.

reference_spacy_tokens: Christine dropped to her knees and picked up the cup handle .


fn_spacy_tokens_for_baseline: There was little reason to stay on in an empty house , Belinda decided as she covered and refrigerated the kedgeree after her father had left .

source_bert_toks: there was little reason to stay on in an empty house , belinda decided as she covered and ref ##ri ##ger ##ated the ked ##ger ##ee after her father had left .

reference_raw: There was no reason to stay in an empty house, Belinda decided, covering and cooling the kedger after her father left.

reference_spacy_tokens: There was no reason to stay in an empty house , Belinda decided , covering and cooling the kedger after her father left .


fn_spacy_tokens_for_baseline: She it was who opened the door and Henry heard a high - pitched giggle followed by a lengthy squawk of pleasure .

source_bert_toks: she it was who opened the door and henry heard a high - pitched giggle followed by a lengthy sq ##ua ##wk of pleasure .

reference_raw: It was she who opened the door, and Henry heard a high-pitched giggle followed by a long whine of joy.

reference_spacy_tokens: It was she who opened the door , and Henry heard a high - pitched giggle followed by a long whine of joy .


fn_spacy_tokens_for_baseline: After being repelled by police , the crowd vented its anger by damaging property and overturning police cars .

source_bert_toks: after being rep ##elled by police , the crowd vent ##ed its anger by damaging property and over ##turn ##ing police cars .

reference_raw: After being repulsed by the police, the mob unleashed its anger by damaging property and overturning police cars.

reference_spacy_tokens: After being repulsed by the police , the mob unleashed its anger by damaging property and overturning police cars .


fn_spacy_tokens_for_baseline: Sad stories are told of people who spent years working on a language and who lost all those years in one night when their house burnt down .

source_bert_toks: sad stories are told of people who spent years working on a language and who lost all those years in one night when their house burnt down .

reference_raw: Unfortunately, there are stories about people who spent years working on the language and who lost all those years in the same night that their house burned down.

reference_spacy_tokens: Unfortunately , there are stories about people who spent years working on the language and who lost all those years in the same night that their house burned down .


fn_spacy_tokens_for_baseline: Our path dropped down to the relative calm of the sea shore , edging craggy inlets beneath overhanging cliff tops .

source_bert_toks: our path dropped down to the relative calm of the sea shore , ed ##ging cr ##ag ##gy inlet ##s beneath over ##hang ##ing cliff tops .

reference_raw: Our path fell to the relative calm of the shores of the sea, cutting through the rocky inlets beneath the overhanging peaks of the cliffs.

reference_spacy_tokens: Our path fell to the relative calm of the shores of the sea , cutting through the rocky inlets beneath the overhanging peaks of the cliffs .


fn_spacy_tokens_for_baseline: Upon arrival , Hall said that his visit , the first of its kind by an American congressman since the 1991 Gulf War , was not political but humanitarian .

source_bert_toks: upon arrival , hall said that his visit , the first of its kind by an american congressman since the 1991 gulf war , was not political but humanitarian .

reference_raw: When Hall arrived, he said that his arrival, the first of his kind by a U.S. Congressman since the Gulf War of 1991, was not political but humanitarian.

reference_spacy_tokens: When Hall arrived , he said that his arrival , the first of his kind by a U.S. Congressman since the Gulf War of 1991 , was not political but humanitarian .


fn_spacy_tokens_for_baseline: These decisions both tend to define ' severe and enduring ' mental illness in the local context and to allocate limited resources for care programming to those most in need .

source_bert_toks: these decisions both tend to define ' severe and enduring ' mental illness in the local context and to all ##oca ##te limited resources for care programming to those most in need .

reference_raw: Both decisions tend to identify "severe and permanent" mental illness in the local context and allocate limited resources for care planning to those most in need.

reference_spacy_tokens: Both decisions tend to identify " severe and permanent " mental illness in the local context and allocate limited resources for care planning to those most in need .


fn_spacy_tokens_for_baseline: Mr Mallory perceived that his ice was warm and half melted inside its chocolate coating , and that it was dripping on to his new suit .

source_bert_toks: mr mallory perceived that his ice was warm and half melted inside its chocolate coating , and that it was dripping on to his new suit .

reference_raw: Mr. Mallory saw that the ice was warm and half-melted in the chocolate coating, and that it was dripping on his new suit.

reference_spacy_tokens: Mr. Mallory saw that the ice was warm and half - melted in the chocolate coating , and that it was dripping on his new suit .


fn_spacy_tokens_for_baseline: Their complaint : the system discourages working because unemployment provides benefits that many entry - level jobs do n't include .

source_bert_toks: their complaint : the system discourage ##s working because unemployment provides benefits that many entry - level jobs don ' t include .

reference_raw: Their complaint: the system deters work, because unemployment brings benefits that many entry-level jobs do not include.

reference_spacy_tokens: Their complaint : the system deters work , because unemployment brings benefits that many entry - level jobs do not include .


fn_spacy_tokens_for_baseline: Greg retreated a short way down the path , and the Fire Officer turned back to the operation .

source_bert_toks: greg retreated a short way down the path , and the fire officer turned back to the operation .

reference_raw: Greg stepped back down the trail, and the fire officer turned back to the operation.

reference_spacy_tokens: Greg stepped back down the trail , and the fire officer turned back to the operation .


fn_spacy_tokens_for_baseline: It also gives the animal unusually short front legs and long hind legs , and an abnormally small anus , so that it hops along like a rabbit and suffers from constipation .

source_bert_toks: it also gives the animal unusually short front legs and long hind legs , and an abnormal ##ly small an ##us , so that it hop ##s along like a rabbit and suffers from con ##sti ##pati ##on .

reference_raw: It also provides the animal with unusually short front legs and long hind legs and an abnormally small ass, so that it jumps like a rabbit and suffers from constipation.

reference_spacy_tokens: It also provides the animal with unusually short front legs and long hind legs and an abnormally small ass , so that it jumps like a rabbit and suffers from constipation .


fn_spacy_tokens_for_baseline: On another thorny subject , Mr Miyazawa gently reminded Jiang that the Senkaku isles in the East China Sea , to which Peking recently reasserted its claim , belonged to Japan .

source_bert_toks: on another thorn ##y subject , mr mi ##ya ##zawa gently reminded jiang that the sen ##ka ##ku isles in the east china sea , to which peking recently re ##asse ##rted its claim , belonged to japan .

reference_raw: On another short subject, Mr. Miyazawa gently reminded Jiang that the Senkaku islands in the Eastern China Sea, to which Beijing had recently reaffirmed its claim, were Japanese.

reference_spacy_tokens: On another short subject , Mr. Miyazawa gently reminded Jiang that the Senkaku islands in the Eastern China Sea , to which Beijing had recently reaffirmed its claim , were Japanese .


fn_spacy_tokens_for_baseline: Passengers crane their necks for dizzying glimpses of the harbor .

source_bert_toks: passengers crane their necks for dizzy ##ing glimpse ##s of the harbor .

reference_raw: The passengers crane their necks for a dizzying glimpse of the port.

reference_spacy_tokens: The passengers crane their necks for a dizzying glimpse of the port .


fn_spacy_tokens_for_baseline: Of course such a stage is an essential preliminary to the formulation of a theory of the performance of action .

source_bert_toks: of course such a stage is an essential preliminary to the formulation of a theory of the performance of action .

reference_raw: Such a phase is, of course, a necessary pre-condition for the formulation of the theory of action.

reference_spacy_tokens: Such a phase is , of course , a necessary pre - condition for the formulation of the theory of action .


fn_spacy_tokens_for_baseline: And , as in Rome , you 'll find it hard to resist all the wonderful shops -- especially the beautiful leather shoes and handbags .

source_bert_toks: and , as in rome , you ' ll find it hard to resist all the wonderful shops - - especially the beautiful leather shoes and hand ##bags .

reference_raw: And like Rome, it's hard to resist all the great stores - especially the beautiful leather boots and purses.

reference_spacy_tokens: And like Rome , it 's hard to resist all the great stores - especially the beautiful leather boots and purses .


fn_spacy_tokens_for_baseline: Karl 's last act as President had been to insist that the wing mirrors on Global cars be fitted parallel to the road so that people could snort drugs off them .

source_bert_toks: karl ' s last act as president had been to insist that the wing mirrors on global cars be fitted parallel to the road so that people could snort drugs off them .

reference_raw: Karl's last act as president was to insist that the wing mirrors on global cars be installed parallel to the road so people could sniff drugs out of them.

reference_spacy_tokens: Karl 's last act as president was to insist that the wing mirrors on global cars be installed parallel to the road so people could sniff drugs out of them .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key question is how the US deployment of ballistic missile defense (formerly called theater and national missile defense) will affect the pace and extent of Chinese strategic modernisation.

reference_spacy_tokens: The key question is how the US deployment of ballistic missile defense ( formerly called theater and national missile defense ) will affect the pace and extent of Chinese strategic modernisation .


fn_spacy_tokens_for_baseline: Their heads were close together and as he appeared they all looked up in unison with startled faces and fell silent .

source_bert_toks: their heads were close together and as he appeared they all looked up in unison with startled faces and fell silent .

reference_raw: Their heads were close together, and when he appeared, they all looked up in unison with their frightened faces and fell silent.

reference_spacy_tokens: Their heads were close together , and when he appeared , they all looked up in unison with their frightened faces and fell silent .


fn_spacy_tokens_for_baseline: From here take the left hand fork which eventually merges into a surfaced minor road leading to the hamlet of Ings ( 3.5 miles ) on the main A591 .

source_bert_toks: from here take the left hand fork which eventually merge ##s into a surfaced minor road leading to the hamlet of ing ##s ( 3 . 5 miles ) on the main a ##59 ##1 .

reference_raw: From here, take the fork of the left hand, which eventually merges into the surface of a small highway that leads to the village of Ings (3.5 miles) on the main A591.

reference_spacy_tokens: From here , take the fork of the left hand , which eventually merges into the surface of a small highway that leads to the village of Ings ( 3.5 miles ) on the main A591 .


fn_spacy_tokens_for_baseline: The latter 's Port de Cannes , for example , has flourishes of bright , free brushwork for sea and hills , but a careful illusionism for the shininess of a varnished mast , where it matters .

source_bert_toks: the latter ' s port de cannes , for example , has flourish ##es of bright , free brush ##work for sea and hills , but a careful illusion ##ism for the shin ##iness of a var ##nished mast , where it matters .

reference_raw: The latter's Port de Cannes, for example, flourishes with bright, free brushwork for the sea and hills, but with careful illusionism for the brightness of the painted mast, if that matters.

reference_spacy_tokens: The latter 's Port de Cannes , for example , flourishes with bright , free brushwork for the sea and hills , but with careful illusionism for the brightness of the painted mast , if that matters .


fn_spacy_tokens_for_baseline: Disembarking from the steamer , she 'd turned her ankle .

source_bert_toks: di ##se ##mba ##rkin ##g from the steamer , she ' d turned her ankle .

reference_raw: She got off the steamer and turned her ankle.

reference_spacy_tokens: She got off the steamer and turned her ankle .


fn_spacy_tokens_for_baseline: Marje now admits that her carefully nurtured image has been torn apart by revelations from a new biography .

source_bert_toks: mar ##je now admits that her carefully nur ##ture ##d image has been torn apart by revelations from a new biography .

reference_raw: Marje now admits that her carefully nurtured image was torn apart by the discovery of a new biography.

reference_spacy_tokens: Marje now admits that her carefully nurtured image was torn apart by the discovery of a new biography .


fn_spacy_tokens_for_baseline: Many of the players refused to get into shorts , and the Empire goalie wore cricket pads over striped long johns .

source_bert_toks: many of the players refused to get into shorts , and the empire goal ##ie wore cricket pads over striped long johns .

reference_raw: Many of the players refused to get into their pants, and the Imperial goalie was wearing cricket pads over striped long Johns.

reference_spacy_tokens: Many of the players refused to get into their pants , and the Imperial goalie was wearing cricket pads over striped long Johns .


fn_spacy_tokens_for_baseline: Is colourful as a rainbow , sturdy like a cabin , its beauty invites , step into my parlour .

source_bert_toks: is colourful as a rainbow , sturdy like a cabin , its beauty invites , step into my par ##lou ##r .

reference_raw: It's the color of a rainbow, sturdy as a cabin, its beauty invites me to enter my living room.

reference_spacy_tokens: It 's the color of a rainbow , sturdy as a cabin , its beauty invites me to enter my living room .


fn_spacy_tokens_for_baseline: Until the moment they both reached into the bowl and found not only popcorn kernels but the cool touch of the other 's skin .

source_bert_toks: until the moment they both reached into the bowl and found not only popcorn kernel ##s but the cool touch of the other ' s skin .

reference_raw: Until they reached into the bowl and discovered not only the popcorn cores, but also the cold touch of the other's skin.

reference_spacy_tokens: Until they reached into the bowl and discovered not only the popcorn cores , but also the cold touch of the other 's skin .


fn_spacy_tokens_for_baseline: Only one thing made me a little suspicious when cranking up the system : in the descriptive text that appears on the screen , the word labeled is spelt " labelled " -decidedly un - American .

source_bert_toks: only one thing made me a little suspicious when crank ##ing up the system : in the descriptive text that appears on the screen , the word labeled is sp ##elt " labelled " - decidedly un - american .

reference_raw: There's only one thing that made me a little suspicious when I cranked up the system: in the descriptive text displayed on the screen, the word marked "labelled" - definitely not American.

reference_spacy_tokens: There 's only one thing that made me a little suspicious when I cranked up the system : in the descriptive text displayed on the screen , the word marked " labelled " - definitely not American .


fn_spacy_tokens_for_baseline: There were too many questions reverberating in her head .

source_bert_toks: there were too many questions rev ##er ##ber ##ating in her head .

reference_raw: Too many questions echoed in her mind.

reference_spacy_tokens: Too many questions echoed in her mind .


fn_spacy_tokens_for_baseline: Her shoulder - length hair obscured her face , though Alice moved position to try and see more than a slab of cheek .

source_bert_toks: her shoulder - length hair obscured her face , though alice moved position to try and see more than a slab of cheek .

reference_raw: Her shoulder-length hair covered her face, but Alice shifted her position to try to see more than a slab of her face.

reference_spacy_tokens: Her shoulder - length hair covered her face , but Alice shifted her position to try to see more than a slab of her face .


fn_spacy_tokens_for_baseline: had talks , round table talks at Stormant this year and John Major hardly ever appeared , he stayed in Strasbourg .

source_bert_toks: had talks , round table talks at storm ##ant this year and john major hardly ever appeared , he stayed in strasbourg .

reference_raw: had a chat, a round table chat at Stormant this year, and John Major barely showed up, stayed in Strasbourg.

reference_spacy_tokens: had a chat , a round table chat at Stormant this year , and John Major barely showed up , stayed in Strasbourg .


fn_spacy_tokens_for_baseline: No evidence obtained to date suggests that Al Qa'ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

source_bert_toks: no evidence obtained to date suggests that al q ##a ' ida has actually succeeded in producing significant quantities of chemical or biological agents or developed an effective means of delivery , but the intention to do so is clearly present .

reference_raw: There is no evidence that Al Qa'ida has actually been able to produce a significant amount of chemical or biological agents or that it has developed an effective means of delivery, but the intention to do so is clear.

reference_spacy_tokens: There is no evidence that Al Qa'ida has actually been able to produce a significant amount of chemical or biological agents or that it has developed an effective means of delivery , but the intention to do so is clear .


fn_spacy_tokens_for_baseline: Currently working on new tracks with ace mixer Cutmaster Swift , TSD-1 had better start stocking up on coffins for the sucker MCs -- he 's gon na need 'em .

source_bert_toks: currently working on new tracks with ace mixer cut ##master swift , ts ##d - 1 had better start stock ##ing up on coffin ##s for the sucker mc ##s - - he ' s go ##n na need ' em .

reference_raw: Now that he's working on new tracks with an ac-mixer Cutmaster Swift, TSD-1 should start putting on coffins for sucker MCs - he'll need them.

reference_spacy_tokens: Now that he 's working on new tracks with an ac - mixer Cutmaster Swift , TSD-1 should start putting on coffins for sucker MCs - he 'll need them .


fn_spacy_tokens_for_baseline: I followed him down from 2,000 feet -- put carb heat on -- I was descending as quickly as the helicopter ; we managed to keep him visual .

source_bert_toks: i followed him down from 2 , 000 feet - - put car ##b heat on - - i was descending as quickly as the helicopter ; we managed to keep him visual .

reference_raw: I followed him down from two thousand feet - put the carb heat on - and went down as fast as a helicopter; we were able to keep him in sight.

reference_spacy_tokens: I followed him down from two thousand feet - put the carb heat on - and went down as fast as a helicopter ; we were able to keep him in sight .


fn_spacy_tokens_for_baseline: Struck me as a bit of a scatterbrain ! ' commented Iris , arranging oatmeal cookies on a hand - painted plate .

source_bert_toks: struck me as a bit of a sc ##atter ##bra ##in ! ' commented iris , arranging o ##at ##me ##al cookies on a hand - painted plate .

reference_raw: Put me down like a sprinkler!' said Iris, putting oatmeal biscuits on a hand-painted plate.

reference_spacy_tokens: Put me down like a sprinkler ! ' said Iris , putting oatmeal biscuits on a hand - painted plate .


fn_spacy_tokens_for_baseline: When we ask these questions , we enter the domain of sociolinguistics .

source_bert_toks: when we ask these questions , we enter the domain of socio ##ling ##uis ##tics .

reference_raw: When we question these questions, we enter the social-linguistic domain.

reference_spacy_tokens: When we question these questions , we enter the social - linguistic domain .


fn_spacy_tokens_for_baseline: The sculptures make the flat railway tracks more interesting for walkers and cyclists .

source_bert_toks: the sculptures make the flat railway tracks more interesting for walkers and cyclists .

reference_raw: The statues make the flat railroad tracks more attractive to pedestrians and cyclists.

reference_spacy_tokens: The statues make the flat railroad tracks more attractive to pedestrians and cyclists .


fn_spacy_tokens_for_baseline: The younger of the trio looked at McCann and Morton and decided he would be better advised not to try and reach the .38 he had jammed into his belt .

source_bert_toks: the younger of the trio looked at mccann and morton and decided he would be better advised not to try and reach the . 38 he had jammed into his belt .

reference_raw: The younger of the three looked at McCann and Morton and decided it would be better if he didn't try to get to the .38 he'd stuck in his belt.

reference_spacy_tokens: The younger of the three looked at McCann and Morton and decided it would be better if he did n't try to get to the .38 he 'd stuck in his belt .


fn_spacy_tokens_for_baseline: She had meant to try , although she had learned where Georgie might be found and was rather more interested in seeing what one of Crystal 's lovers looked like .

source_bert_toks: she had meant to try , although she had learned where georgie might be found and was rather more interested in seeing what one of crystal ' s lovers looked like .

reference_raw: She wanted to try, though she knew where to find Georgie, and rather wanted to see what one of Crystal's lovers looked like.

reference_spacy_tokens: She wanted to try , though she knew where to find Georgie , and rather wanted to see what one of Crystal 's lovers looked like .


fn_spacy_tokens_for_baseline: ' He was the team leader but he was manning the turret on top of the Humvee , ' he said .

source_bert_toks: ' he was the team leader but he was manning the turret on top of the hum ##ve ##e , ' he said .

reference_raw: "He was the leader of the team, but he managed the tower at the top of the Humvee," he said.

reference_spacy_tokens: " He was the leader of the team , but he managed the tower at the top of the Humvee , " he said .


fn_spacy_tokens_for_baseline: Every time they got near him , he backed off , ecstatic with excitement , tail wagging furiously .

source_bert_toks: every time they got near him , he backed off , ec ##static with excitement , tail wa ##gging furiously .

reference_raw: Every time they got close to him, he backed away, excited, his tail wagging furiously.

reference_spacy_tokens: Every time they got close to him , he backed away , excited , his tail wagging furiously .


fn_spacy_tokens_for_baseline: ' Ello young'un , ' he grunted , ' I was just watchin'em lave - nettin ' on the river there . '

source_bert_toks: ' el ##lo young ' un , ' he grunted , ' i was just watch ##in ' em la ##ve - net ##tin ' on the river there . '

reference_raw: 'Ello Young'un,' he growled, 'I was just watching them lave-netting on the river.'

reference_spacy_tokens: ' Ello Young'un , ' he growled , ' I was just watching them lave - netting on the river . '


fn_spacy_tokens_for_baseline: James Woods will only say : ' She 's a little offbeat but she 's a wonderful actress and a beautiful girl .

source_bert_toks: james woods will only say : ' she ' s a little off ##beat but she ' s a wonderful actress and a beautiful girl .

reference_raw: James Woods just says, "She's a little out-of-control, but she's a great actress and a pretty girl.

reference_spacy_tokens: James Woods just says , " She 's a little out - of - control , but she 's a great actress and a pretty girl .


fn_spacy_tokens_for_baseline: On his training bags , for example , he should be trying out various double and triple kicking techniques and working out a series of combinations , linked together with speed , timing , delivery , focus and his own personal footwork manoeuvres .

source_bert_toks: on his training bags , for example , he should be trying out various double and triple kicking techniques and working out a series of combinations , linked together with speed , timing , delivery , focus and his own personal foot ##work man ##oe ##u ##vres .

reference_raw: For example, he should test various double- and triple-kicking techniques on his training bags and work out a series of combinations combined with speed, timing, delivery, focus, and personal footwork maneuvers.

reference_spacy_tokens: For example , he should test various double- and triple - kicking techniques on his training bags and work out a series of combinations combined with speed , timing , delivery , focus , and personal footwork maneuvers .


fn_spacy_tokens_for_baseline: Assistant Chief Constable Peter Gibson said : ' Despite our warnings , 192 are still prepared to carry offensive weapons .

source_bert_toks: assistant chief constable peter gibson said : ' despite our warnings , 192 are still prepared to carry offensive weapons .

reference_raw: Deputy Chief Constable Peter Gibson said, "Despite our warning, 192 are still ready to carry assault weapons.

reference_spacy_tokens: Deputy Chief Constable Peter Gibson said , " Despite our warning , 192 are still ready to carry assault weapons .


fn_spacy_tokens_for_baseline: Edwin is waiting at the bottom with a huge smile on his face .

source_bert_toks: edwin is waiting at the bottom with a huge smile on his face .

reference_raw: Edwin sits downstairs with a big smile on his face.

reference_spacy_tokens: Edwin sits downstairs with a big smile on his face .


fn_spacy_tokens_for_baseline: To do this correctly , the aligned query sequence has to be bootstrap resampled in exactly the same way as was used for precalculating the pairwise distances of the Pfam alignment .

source_bert_toks: to do this correctly , the aligned query sequence has to be boots ##tra ##p res ##amp ##led in exactly the same way as was used for pre ##cal ##cula ##ting the pair ##wise distances of the p ##fa ##m alignment .

reference_raw: To do so correctly, the aligned query sequence must be resampled in the same manner as that used to precalculate the pairwise distances of the Pfam alignment.

reference_spacy_tokens: To do so correctly , the aligned query sequence must be resampled in the same manner as that used to precalculate the pairwise distances of the Pfam alignment .


fn_spacy_tokens_for_baseline: I may add that Miss Burnet 's age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

source_bert_toks: i may add that miss burn ##et ' s age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

reference_raw: May I say that Miss Burnet's age and character make sure that my first thought of having a love interest in our story is out of the question.

reference_spacy_tokens: May I say that Miss Burnet 's age and character make sure that my first thought of having a love interest in our story is out of the question .


fn_spacy_tokens_for_baseline: Watford drew a crowd of 7,500 to Turnfurlong Lane in 1951 and , by the time Gould broke a 34-year abstinence , plans were being formulated to turn the evocatively named ground into a housing estate .

source_bert_toks: watford drew a crowd of 7 , 500 to turn ##fur ##long lane in 1951 and , by the time gould broke a 34 - year abs ##tine ##nce , plans were being formulated to turn the ev ##oca ##tively named ground into a housing estate .

reference_raw: In 1951, Watford had drawn a mob of 7,500 to Turnfurlong Lane, and by the time Gould had broken his 34-year abstinence, plans had been made to turn the evocative land into a dwelling.

reference_spacy_tokens: In 1951 , Watford had drawn a mob of 7,500 to Turnfurlong Lane , and by the time Gould had broken his 34-year abstinence , plans had been made to turn the evocative land into a dwelling .


fn_spacy_tokens_for_baseline: When they emerged forty minutes later from the second - hand shop she 'd taken him to , he wore a tweed suit , laced boots , a heavy overcoat almost ankle - length , gloves and a trilby hat .

source_bert_toks: when they emerged forty minutes later from the second - hand shop she ' d taken him to , he wore a tweed suit , laced boots , a heavy over ##coat almost ankle - length , gloves and a tri ##lby hat .

reference_raw: He was dressed in a tweed suit, laced shoes, a heavy coat nearly ankle-length, gloves, and a trilby hat when they came out forty minutes later from the second-hand store she had taken him to.

reference_spacy_tokens: He was dressed in a tweed suit , laced shoes , a heavy coat nearly ankle - length , gloves , and a trilby hat when they came out forty minutes later from the second - hand store she had taken him to .


fn_spacy_tokens_for_baseline: Televisa 's Mr Diez Barroso says rates are cheap -- around a fifth of those in America -- and that the market would accept them at twice the price .

source_bert_toks: tel ##ev ##isa ' s mr die ##z barr ##oso says rates are cheap - - around a fifth of those in america - - and that the market would accept them at twice the price .

reference_raw: Televisa's Mr. Diez Barroso says that tariffs are inexpensive - about a fifth of those in America - and that the market will accept them at twice the price.

reference_spacy_tokens: Televisa 's Mr. Diez Barroso says that tariffs are inexpensive - about a fifth of those in America - and that the market will accept them at twice the price .


fn_spacy_tokens_for_baseline: They used to see us and say , ' Here they are , the lovebirds , are we talking today or have we had a lovers ' tiff ? '

source_bert_toks: they used to see us and say , ' here they are , the love ##birds , are we talking today or have we had a lovers ' ti ##ff ? '

reference_raw: They saw us and said, "Here they are, lovebirds, are we talking today, or did we have a lover's hair?"

reference_spacy_tokens: They saw us and said , " Here they are , lovebirds , are we talking today , or did we have a lover 's hair ? "


fn_spacy_tokens_for_baseline: The ALP , however , appeared to have increased its vote by only 1 percentage point , to 39.5 per cent .

source_bert_toks: the al ##p , however , appeared to have increased its vote by only 1 percentage point , to 39 . 5 per cent .

reference_raw: However, the ALP seemed to have raised its vote by only one percentage point to 39.5 percent.

reference_spacy_tokens: However , the ALP seemed to have raised its vote by only one percentage point to 39.5 percent .


fn_spacy_tokens_for_baseline: It must be frustrating to arrive at a police station after a hectic drive , only to find that ' the processes of investigation ' necessitated a quick confession from the client .

source_bert_toks: it must be frustrating to arrive at a police station after a he ##ctic drive , only to find that ' the processes of investigation ' necessitated a quick confession from the client .

reference_raw: It must have been frustrating to come to the police station after a hectic ride, only to find that the "investigation process" required a quick admission from the client.

reference_spacy_tokens: It must have been frustrating to come to the police station after a hectic ride , only to find that the " investigation process " required a quick admission from the client .


fn_spacy_tokens_for_baseline: He scooped mud on to his forehead and cheeks and kept close in under the dripping leaf canopy cloaking the bank .

source_bert_toks: he scooped mud on to his forehead and cheeks and kept close in under the dripping leaf canopy cloak ##ing the bank .

reference_raw: He scooped mud on his forehead and cheeks and stayed close to the dripping leaf cover that covered the bank.

reference_spacy_tokens: He scooped mud on his forehead and cheeks and stayed close to the dripping leaf cover that covered the bank .


fn_spacy_tokens_for_baseline: Senior officers say more and more criminals are prepared to carry firearms in cash raids .

source_bert_toks: senior officers say more and more criminals are prepared to carry firearms in cash raids .

reference_raw: Senior officers say that more and more criminals are ready to carry weapons in cash raids.

reference_spacy_tokens: Senior officers say that more and more criminals are ready to carry weapons in cash raids .


fn_spacy_tokens_for_baseline: New evidence that Canadian trash is a security threat

source_bert_toks: new evidence that canadian trash is a security threat

reference_raw: New evidence that Canadian garbage poses a security risk


fn_spacy_tokens_for_baseline: Tug felt the call to join her , to leap to his feet and let himself be carried up on the tide , into a high and heroic world .

source_bert_toks: tug felt the call to join her , to leap to his feet and let himself be carried up on the tide , into a high and heroic world .

reference_raw: Tug felt the call to join her, to leap to his feet, to be carried by the tide, to a high and heroic world.

reference_spacy_tokens: Tug felt the call to join her , to leap to his feet , to be carried by the tide , to a high and heroic world .


fn_spacy_tokens_for_baseline: China has signed a bilateral agreement with Japan to destroy CW that Japan abandoned in Chinese territory during World War II .

source_bert_toks: china has signed a bilateral agreement with japan to destroy cw that japan abandoned in chinese territory during world war ii .

reference_raw: China has entered into a bilateral agreement with Japan to destroy the CW that Japan abandoned in China during the Second World War.

reference_spacy_tokens: China has entered into a bilateral agreement with Japan to destroy the CW that Japan abandoned in China during the Second World War .


fn_spacy_tokens_for_baseline: In the afternoon we had tea in a house full of the most beautiful women .

source_bert_toks: in the afternoon we had tea in a house full of the most beautiful women .

reference_raw: We had tea this afternoon in a house filled with the most beautiful women.

reference_spacy_tokens: We had tea this afternoon in a house filled with the most beautiful women .


fn_spacy_tokens_for_baseline: Remember that anything which excites and interests you is a possibility and the greater the contrast with your first classical choice , the better you will enable the panel to see your present range .

source_bert_toks: remember that anything which ex ##cite ##s and interests you is a possibility and the greater the contrast with your first classical choice , the better you will enable the panel to see your present range .

reference_raw: Remember, anything that arouses and interests you is possible, and the greater the contrast with your first classic selection, the better you allow the panel to see your current range.

reference_spacy_tokens: Remember , anything that arouses and interests you is possible , and the greater the contrast with your first classic selection , the better you allow the panel to see your current range .


fn_spacy_tokens_for_baseline: Prime Minister Ariel Sharon of Israel urged President Bush to step up pressure on Iran to give up all elements of its nuclear program .

source_bert_toks: prime minister ariel sharon of israel urged president bush to step up pressure on iran to give up all elements of its nuclear program .

reference_raw: Prime Minister Ariel Sharon of Israel urged President Bush to press Iran to surrender all elements of its nuclear program.

reference_spacy_tokens: Prime Minister Ariel Sharon of Israel urged President Bush to press Iran to surrender all elements of its nuclear program .


fn_spacy_tokens_for_baseline: Iraq has claimed that over 1.2 million people , mostly children and the elderly , have died during the last 10 years , and blames the deaths on shortages of food , medicine and other essential supplies .

source_bert_toks: iraq has claimed that over 1 . 2 million people , mostly children and the elderly , have died during the last 10 years , and blame ##s the deaths on shortages of food , medicine and other essential supplies .

reference_raw: Iraq argued that over 1.2 million people, mostly children and older people, had died in the last 10 years and blamed their deaths for lack of food, medicine, and other basic supplies.

reference_spacy_tokens: Iraq argued that over 1.2 million people , mostly children and older people , had died in the last 10 years and blamed their deaths for lack of food , medicine , and other basic supplies .


fn_spacy_tokens_for_baseline: Undeterred by an evasive reply , he told me he could even provide a reliable guide who would conduct me across the border .

source_bert_toks: und ##eter ##red by an eva ##sive reply , he told me he could even provide a reliable guide who would conduct me across the border .

reference_raw: Undeterred by the evasive answer, he told me that he might even be able to provide a reliable guide to guide me across the border.

reference_spacy_tokens: Undeterred by the evasive answer , he told me that he might even be able to provide a reliable guide to guide me across the border .


fn_spacy_tokens_for_baseline: Thus , pupils moving around the system can enhance a school 's provision if it is a net gainer but cause severe problems very quickly if it is a net loser .

source_bert_toks: thus , pupils moving around the system can enhance a school ' s provision if it is a net gain ##er but cause severe problems very quickly if it is a net loser .

reference_raw: Thus, pupils moving around the system can increase the provision of a school if it is a net earner, but if it is a net loser, it creates serious problems very quickly.

reference_spacy_tokens: Thus , pupils moving around the system can increase the provision of a school if it is a net earner , but if it is a net loser , it creates serious problems very quickly .


fn_spacy_tokens_for_baseline: I squelch upstairs to the flat after my half - hour walk , and Kenneth answers the door with his specs on the end of his nose and the now permanent book in his hand .

source_bert_toks: i sq ##uel ##ch upstairs to the flat after my half - hour walk , and kenneth answers the door with his spec ##s on the end of his nose and the now permanent book in his hand .

reference_raw: After a half hour's walk, I squirm up to the apartment, and Kenneth opens the door with his specs at the end of his nose and the now-permanent book in his hand.

reference_spacy_tokens: After a half hour 's walk , I squirm up to the apartment , and Kenneth opens the door with his specs at the end of his nose and the now - permanent book in his hand .


fn_spacy_tokens_for_baseline: Yet they were not downhearted .

source_bert_toks: yet they were not down ##hearted .

reference_raw: But they weren't heartless.

reference_spacy_tokens: But they were n't heartless .


fn_spacy_tokens_for_baseline: Teaching should also bring out the structural characteristics of different types of verse and poetry , eg nursery rhymes , concrete poetry , haiku , limericks , ballads , sonnets etc .

source_bert_toks: teaching should also bring out the structural characteristics of different types of verse and poetry , e ##g nursery rhymes , concrete poetry , hai ##ku , limerick ##s , ballads , son ##nets etc .

reference_raw: The teaching process should also show the structural characteristics of various types of verses and poems, e.g. nursery rhymes, concrete poetry, haik, limericks, ballads, sonnets, etc.

reference_spacy_tokens: The teaching process should also show the structural characteristics of various types of verses and poems , e.g. nursery rhymes , concrete poetry , haik , limericks , ballads , sonnets , etc .


fn_spacy_tokens_for_baseline: In general , where the company is obliged to pay ex gratia amounts in excess of the legal minimum , the full cost of the redundancy payments including the legal minimum should normally be provided .

source_bert_toks: in general , where the company is obliged to pay ex gr ##ati ##a amounts in excess of the legal minimum , the full cost of the red ##unda ##ncy payments including the legal minimum should normally be provided .

reference_raw: As a general rule, if a company is required to pay ex gratia amounts above the legal threshold, the full costs of the redundancies, including the legal threshold, should normally be provided.

reference_spacy_tokens: As a general rule , if a company is required to pay ex gratia amounts above the legal threshold , the full costs of the redundancies , including the legal threshold , should normally be provided .


fn_spacy_tokens_for_baseline: Maldom Bada had been under arrest since the alleged coup attempt of October 1991 [ see p. 38519 ] and his inclusion therefore signified his political rehabilitation .

source_bert_toks: mal ##dom bad ##a had been under arrest since the alleged coup attempt of october 1991 [ see p . 385 ##19 ] and his inclusion therefore sign ##ified his political rehabilitation .

reference_raw: Since the alleged coup attempt in October 1991 (see p. 38519), Maldom Bada has been detained and his inclusion has therefore been a sign of political rehabilitation.

reference_spacy_tokens: Since the alleged coup attempt in October 1991 ( see p. 38519 ) , Maldom Bada has been detained and his inclusion has therefore been a sign of political rehabilitation .


fn_spacy_tokens_for_baseline: Lifting and pouring cumbersome oil barrels can be an irksome task , but there are now several options to make the job easier .

source_bert_toks: lifting and pouring cum ##bers ##ome oil barrels can be an ir ##ks ##ome task , but there are now several options to make the job easier .

reference_raw: Lifting and pouring cumbersome oil barrels may be a difficult task, but there are now several possibilities to facilitate the work.

reference_spacy_tokens: Lifting and pouring cumbersome oil barrels may be a difficult task , but there are now several possibilities to facilitate the work .


fn_spacy_tokens_for_baseline: You ca n't run with your pants at half mast .

source_bert_toks: you can ' t run with your pants at half mast .

reference_raw: You can't run on a half-mast with your trousers.

reference_spacy_tokens: You ca n't run on a half - mast with your trousers .


fn_spacy_tokens_for_baseline: Six months ago , Lucian Freud surprised the art market by parting company from James Kirkman , his agent for twenty years .

source_bert_toks: six months ago , lucian freud surprised the art market by parting company from james kirk ##man , his agent for twenty years .

reference_raw: Six months ago, Lucian Freud took the art market by saying goodbye to James Kirkman, his agent for 20 years.

reference_spacy_tokens: Six months ago , Lucian Freud took the art market by saying goodbye to James Kirkman , his agent for 20 years .


fn_spacy_tokens_for_baseline: There is a large , calm pool , below the bridge ; then the river narrows , rushing quickly through a rapid stream into a broad , smooth run .

source_bert_toks: there is a large , calm pool , below the bridge ; then the river narrows , rushing quickly through a rapid stream into a broad , smooth run .

reference_raw: Below the bridge is a large, calm pool; then the river narrows and runs fast through a fast stream into a wide, smooth stream.

reference_spacy_tokens: Below the bridge is a large , calm pool ; then the river narrows and runs fast through a fast stream into a wide , smooth stream .


fn_spacy_tokens_for_baseline: So it had seemed sensible for Ross to have his old bedroom , while she 'd been far too weary to care where she slept .

source_bert_toks: so it had seemed sensible for ross to have his old bedroom , while she ' d been far too weary to care where she slept .

reference_raw: So it seemed reasonable for Ross to have his old room, while she was too tired to care where she slept.

reference_spacy_tokens: So it seemed reasonable for Ross to have his old room , while she was too tired to care where she slept .


fn_spacy_tokens_for_baseline: Anybody would think you 'd spent your life checking unmarried ladies into motels . '

source_bert_toks: anybody would think you ' d spent your life checking unmarried ladies into motel ##s . '

reference_raw: Anyone would think you've spent the rest of your life inspecting unmarried women in hotels.'

reference_spacy_tokens: Anyone would think you 've spent the rest of your life inspecting unmarried women in hotels . '


fn_spacy_tokens_for_baseline: In order to face these dangers , we resort to a plan which includes the external factors , the internal factors and spying .

source_bert_toks: in order to face these dangers , we resort to a plan which includes the external factors , the internal factors and spying .

reference_raw: To deal with these dangers, we resort to a plan involving external factors, internal factors and spying.

reference_spacy_tokens: To deal with these dangers , we resort to a plan involving external factors , internal factors and spying .


fn_spacy_tokens_for_baseline: ' Nine bean rows shall I have there , and a hive for the honey bee , ' chanted Rory .

source_bert_toks: ' nine bean rows shall i have there , and a hive for the honey bee , ' chant ##ed rory .

reference_raw: 'I'll have nine rows of beans and a bee hive,' Rory sang.

reference_spacy_tokens: ' I 'll have nine rows of beans and a bee hive , ' Rory sang .


fn_spacy_tokens_for_baseline: The extent to which various foreign governments , military establishments , and intelligence agencies secretly monitored or covertly assisted in the development of the program likewise remains an open question .

source_bert_toks: the extent to which various foreign governments , military establishments , and intelligence agencies secretly monitored or covert ##ly assisted in the development of the program likewise remains an open question .

reference_raw: The extent to which various foreign governments, war facilities, and intelligence agencies secretly monitored or secretly contributed to the development of the programme is also an open question.

reference_spacy_tokens: The extent to which various foreign governments , war facilities , and intelligence agencies secretly monitored or secretly contributed to the development of the programme is also an open question .


fn_spacy_tokens_for_baseline: Get into multimedia products , booksellers urged

source_bert_toks: get into multimedia products , books ##eller ##s urged

reference_raw: Go to multimedia products, booksellers encouraged

reference_spacy_tokens: Go to multimedia products , booksellers encouraged


fn_spacy_tokens_for_baseline: The only way to solve the problem of obtaining precise dates is to devise methods of dating sites and finds accurately .

source_bert_toks: the only way to solve the problem of obtaining precise dates is to devi ##se methods of dating sites and finds accurately .

reference_raw: The only way to solve the problem of obtaining accurate data is to develop methods of dating sites and to find accurate data.

reference_spacy_tokens: The only way to solve the problem of obtaining accurate data is to develop methods of dating sites and to find accurate data .


fn_spacy_tokens_for_baseline: Computers , Fletcher maintains , always have their on - off switch on the back .

source_bert_toks: computers , fletcher maintains , always have their on - off switch on the back .

reference_raw: The computers, Fletcher says, always have a back button.

reference_spacy_tokens: The computers , Fletcher says , always have a back button .


fn_spacy_tokens_for_baseline: Items such as these indicate just how much information objects can carry about the processes of their creation .

source_bert_toks: items such as these indicate just how much information objects can carry about the processes of their creation .

reference_raw: Items like this show how much information objects can carry about the process of creating them.

reference_spacy_tokens: Items like this show how much information objects can carry about the process of creating them .


fn_spacy_tokens_for_baseline: My master waited until a kitchen boy served us , then suddenly rose , locking the great doors of the hall as well as those to the kitchen and buttery .

source_bert_toks: my master waited until a kitchen boy served us , then suddenly rose , locking the great doors of the hall as well as those to the kitchen and butter ##y .

reference_raw: My master waited until we were served by a boy from the kitchen, then stood up suddenly and locked the big doors of the hall and the doors of the kitchen and butter.

reference_spacy_tokens: My master waited until we were served by a boy from the kitchen , then stood up suddenly and locked the big doors of the hall and the doors of the kitchen and butter .


fn_spacy_tokens_for_baseline: It was she who , when the manuscript was ready , had given him an introduction to Alistair MacFee , a professor of English at the university .

source_bert_toks: it was she who , when the manuscript was ready , had given him an introduction to alistair mac ##fe ##e , a professor of english at the university .

reference_raw: She was the one who introduced him to Alistair MacFee, the English teacher at the university, when the manuscript was ready.

reference_spacy_tokens: She was the one who introduced him to Alistair MacFee , the English teacher at the university , when the manuscript was ready .


fn_spacy_tokens_for_baseline: As the new book , Deformed Roses tells , Freda became involved in teaching mentally handicapped youngsters when she lived in Surrey Streey , Linthorpe , after seeing so - called ' ineducables ' sitting listless and dejected outside their homes as she cycled to and from her teaching job in the town 's St Hilda 's district .

source_bert_toks: as the new book , def ##or ##med roses tells , fred ##a became involved in teaching mentally handicapped young ##sters when she lived in surrey st ##ree ##y , lin ##thorpe , after seeing so - called ' in ##ed ##uca ##bles ' sitting list ##less and de ##jected outside their homes as she cycle ##d to and from her teaching job in the town ' s st hilda ' s district .

reference_raw: As the new book, Deformed Roses says, Freda took part in the teaching of mentally disabled young people when she lived in Surrey Strey, Linthorpe, after she had seen the so-called "inducables" sitting listlessly and dejected outside their homes as she circled to and from her teaching work in the district of St. Hilda.

reference_spacy_tokens: As the new book , Deformed Roses says , Freda took part in the teaching of mentally disabled young people when she lived in Surrey Strey , Linthorpe , after she had seen the so - called " inducables " sitting listlessly and dejected outside their homes as she circled to and from her teaching work in the district of St. Hilda .


fn_spacy_tokens_for_baseline: Marie sticks her jeans in too -- she 's going to wear the dress under her coat .

source_bert_toks: marie sticks her jeans in too - - she ' s going to wear the dress under her coat .

reference_raw: Marie puts her jeans in, too - she'll wear a dress under her coat.

reference_spacy_tokens: Marie puts her jeans in , too - she 'll wear a dress under her coat .


fn_spacy_tokens_for_baseline: Violence was predicted on the basis of disorder at demonstrations in Paris and Chicago earlier in the year .

source_bert_toks: violence was predicted on the basis of disorder at demonstrations in paris and chicago earlier in the year .

reference_raw: Violence was forecasted due to disorder during demonstrations in Paris and Chicago earlier this year.

reference_spacy_tokens: Violence was forecasted due to disorder during demonstrations in Paris and Chicago earlier this year .


fn_spacy_tokens_for_baseline: She wagged a playfully admonishing finger towards the audience .

source_bert_toks: she wa ##gged a playfully ad ##mon ##ishing finger towards the audience .

reference_raw: She waved a playful finger at the audience.

reference_spacy_tokens: She waved a playful finger at the audience .


fn_spacy_tokens_for_baseline: The hotel 's owners are furious that they were n't told it may be listed .

source_bert_toks: the hotel ' s owners are furious that they weren ' t told it may be listed .

reference_raw: The homeowners of the hotel are furious that they didn't know it could be on the list.

reference_spacy_tokens: The homeowners of the hotel are furious that they did n't know it could be on the list .


fn_spacy_tokens_for_baseline: The variation in day length decreases with distance from the poles and vanishes at the Equator , which receives 12 hours of light each day throughout the year .

source_bert_toks: the variation in day length decreases with distance from the poles and vanish ##es at the equator , which receives 12 hours of light each day throughout the year .

reference_raw: The variation in the length of the day is reduced by the distance from the poles and disappears in the equator, which receives 12 hours of light every day throughout the year.

reference_spacy_tokens: The variation in the length of the day is reduced by the distance from the poles and disappears in the equator , which receives 12 hours of light every day throughout the year .


fn_spacy_tokens_for_baseline: THREE years ago James Oberg won the New Scientist /Cutty Sark competition for his essay on unidentified flying objects .

source_bert_toks: three years ago james obe ##rg won the new scientist / cut ##ty sar ##k competition for his essay on unidentified flying objects .

reference_raw: Three years ago, James Oberg won a new scientist/Cutty Sark contest for his paper on unidentified flying objects.

reference_spacy_tokens: Three years ago , James Oberg won a new scientist / Cutty Sark contest for his paper on unidentified flying objects .


fn_spacy_tokens_for_baseline: Ohad Skornick , 23 , from Tel Aviv , suspected of conspiracy and failure to prevent a felony .

source_bert_toks: oh ##ad sk ##orn ##ick , 23 , from tel aviv , suspected of conspiracy and failure to prevent a felony .

reference_raw: Ohad Skornick, 23 years old, from Tel Aviv, suspected of conspiracy and failure to prevent crime.

reference_spacy_tokens: Ohad Skornick , 23 years old , from Tel Aviv , suspected of conspiracy and failure to prevent crime .


fn_spacy_tokens_for_baseline: The Springfield playing fields have been ploughed up by cars driving on them , horses cantering and people playing golf .

source_bert_toks: the springfield playing fields have been pl ##ough ##ed up by cars driving on them , horses can ##tering and people playing golf .

reference_raw: Springfield playgrounds were ploughed up by cars driving on them, horse racing, and people playing golf.

reference_spacy_tokens: Springfield playgrounds were ploughed up by cars driving on them , horse racing , and people playing golf .


fn_spacy_tokens_for_baseline: ( Harry had decided that to pay for entertaining Nadine Cunningham would be to add insult to injury . )

source_bert_toks: ( harry had decided that to pay for entertaining nad ##ine cunningham would be to add insult to injury . )

reference_raw: (Harry decided that paying for the amusement of Nadine Cunningham would be an insult to the wound.)

reference_spacy_tokens: ( Harry decided that paying for the amusement of Nadine Cunningham would be an insult to the wound . )


fn_spacy_tokens_for_baseline: Although I was shackled to a radiator , my blindfold was removed and I was given a cup of water and a sweetmeat .

source_bert_toks: although i was shack ##led to a ra ##dia ##tor , my blind ##fold was removed and i was given a cup of water and a sweet ##me ##at .

reference_raw: Even though I was handcuffed to the radiator, the blindfold was removed and I was given a cup of water and sweet meat.

reference_spacy_tokens: Even though I was handcuffed to the radiator , the blindfold was removed and I was given a cup of water and sweet meat .


fn_spacy_tokens_for_baseline: The Soviet nuclear weapon program began during World War II and culminated in a successful atomic bomb test in 1949 .

source_bert_toks: the soviet nuclear weapon program began during world war ii and culminated in a successful atomic bomb test in 1949 .

reference_raw: The Soviet nuclear-weapon program started during the Second World War and peaked in a successful nuclear-bomb test in 1949.

reference_spacy_tokens: The Soviet nuclear - weapon program started during the Second World War and peaked in a successful nuclear - bomb test in 1949 .


fn_spacy_tokens_for_baseline: The Department acknowledges the basic need to provide workplaces with easy access , good lighting and an inviting atmosphere .

source_bert_toks: the department acknowledges the basic need to provide workplace ##s with easy access , good lighting and an inviting atmosphere .

reference_raw: The Ministry recognises the essential need to ensure that workplaces are easily accessible, well illuminated and have an attractive atmosphere.

reference_spacy_tokens: The Ministry recognises the essential need to ensure that workplaces are easily accessible , well illuminated and have an attractive atmosphere .


fn_spacy_tokens_for_baseline: The security team should : A : Publish a periodic bulletin and distribute to all residents , advising them how to safely store gaz and logs B : Keep the firefighters alert at all times C : Report any thing that might be a fire hazard D : Warn against the safety of children 's toys E : Urge everyone to take precautions and guard their homes tightly

source_bert_toks: the security team should : a : publish a periodic bulletin and distribute to all residents , advising them how to safely store ga ##z and logs b : keep the firefighters alert at all times c : report any thing that might be a fire hazard d : warn against the safety of children ' s toys e : urge everyone to take precautions and guard their homes tightly

reference_raw: The security team should: A: publish a regular bulletin and distribute it to all residents, advise them on the safe storage of gaz and logs B: Keep firefighters on alert all times C: report anything likely to pose a fire hazard D: Warn against the safety of children's toys E: Urge everyone to take precautions and guard their homes carefully.

reference_spacy_tokens: The security team should : A : publish a regular bulletin and distribute it to all residents , advise them on the safe storage of gaz and logs B : Keep firefighters on alert all times C : report anything likely to pose a fire hazard D : Warn against the safety of children 's toys E : Urge everyone to take precautions and guard their homes carefully .


fn_spacy_tokens_for_baseline: The band can be knitted using tubular knitting and joined on the machine using the Passap method , as used on tubular neckbands .

source_bert_toks: the band can be knit ##ted using tubular knitting and joined on the machine using the pass ##ap method , as used on tubular neck ##band ##s .

reference_raw: The band may be knitted by tubular knitting and connected to the machine using the Passap method, which is used for tubular neck bands.

reference_spacy_tokens: The band may be knitted by tubular knitting and connected to the machine using the Passap method , which is used for tubular neck bands .


fn_spacy_tokens_for_baseline: This means " tracking , " whose main purpose is less to permit the gifted youngsters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary grounding for further study or for entering the modern world of work .

source_bert_toks: this means " tracking , " whose main purpose is less to permit the gifted young ##sters to flourish ( though that is clearly desirable ) than to ensure that the less gifted get the necessary ground ##ing for further study or for entering the modern world of work .

reference_raw: This means "tracking", the main purpose of which is less to allow talented young people to flourish (although it is clearly desirable) than to ensure that the less gifted are given the necessary grounds for further study or entry into the modern world of work.

reference_spacy_tokens: This means " tracking " , the main purpose of which is less to allow talented young people to flourish ( although it is clearly desirable ) than to ensure that the less gifted are given the necessary grounds for further study or entry into the modern world of work .


fn_spacy_tokens_for_baseline: The original surplus of £ 200 m arose on 31 March 1989 .

source_bert_toks: the original surplus of £2 ##00 ##m arose on 31 march 1989 .

reference_raw: The initial surplus of £200 million was raised on 31 March 1989.

reference_spacy_tokens: The initial surplus of £ 200 million was raised on 31 March 1989 .


fn_spacy_tokens_for_baseline: ' I fear the two of you will leave me far behind . '

source_bert_toks: ' i fear the two of you will leave me far behind . '

reference_raw: "I'm afraid you two are going to leave me behind."

reference_spacy_tokens: " I 'm afraid you two are going to leave me behind . "