fn_spacy_tokens_for_baseline: On the same programme , John Biffen , Leader of the House of Commons , challenged Heseltine 's strictures on improper breaches of Cabinet procedure .

source_bert_toks: on the same programme , john bi ##ffen , leader of the house of commons , challenged he ##sel ##tine ' s strict ##ures on improper breach ##es of cabinet procedure .

reference_raw: In the same program, John Biffen, head of the House of Commons, challenged Heseltine's restraints on inappropriate violations of government procedures.

reference_spacy_tokens: In the same program , John Biffen , head of the House of Commons , challenged Heseltine 's restraints on inappropriate violations of government procedures .


fn_spacy_tokens_for_baseline: Authorities are calling the fires " criminal acts . "

source_bert_toks: authorities are calling the fires " criminal acts . "

reference_raw: The authorities refer to fires as criminal acts.

reference_spacy_tokens: The authorities refer to fires as criminal acts .


fn_spacy_tokens_for_baseline: Where there were more Indians than positions as Chiefs , when , for example , many constables had passed the Sergeant 's exam , personal animosity could be severe .

source_bert_toks: where there were more indians than positions as chiefs , when , for example , many constable ##s had passed the sergeant ' s exam , personal an ##imo ##sity could be severe .

reference_raw: Where there were more Indians than chiefs, where, for example, a lot of constables had passed the sergeant's test, personal hostility could be serious.

reference_spacy_tokens: Where there were more Indians than chiefs , where , for example , a lot of constables had passed the sergeant 's test , personal hostility could be serious .


fn_spacy_tokens_for_baseline: Pantiles are the typical roofing material of this eastern side of England .

source_bert_toks: pan ##tile ##s are the typical roof ##ing material of this eastern side of england .

reference_raw: Pantiles are typical roofing material on the east side of England.

reference_spacy_tokens: Pantiles are typical roofing material on the east side of England .


fn_spacy_tokens_for_baseline: But while the number of fraud cases in Scotland also increased , their total value fell .

source_bert_toks: but while the number of fraud cases in scotland also increased , their total value fell .

reference_raw: However, while the number of fraud cases in Scotland has also increased, their overall value has decreased.

reference_spacy_tokens: However , while the number of fraud cases in Scotland has also increased , their overall value has decreased .


fn_spacy_tokens_for_baseline: In imagining what it would be like to be fundholders in future we should assume that overall adequacy of funding for health care will be less than we have previously known .

source_bert_toks: in imagining what it would be like to be fund ##holders in future we should assume that overall ad ##e ##qua ##cy of funding for health care will be less than we have previously known .

reference_raw: When we imagine what it would be like to become fundholders in the future, we should assume that the overall appropriateness of healthcare funding will be less than we previously knew.

reference_spacy_tokens: When we imagine what it would be like to become fundholders in the future , we should assume that the overall appropriateness of healthcare funding will be less than we previously knew .


fn_spacy_tokens_for_baseline: Car retailers sell vehicles with various kinds of warranties concerning replacement of faulty parts at the suppliers expense .

source_bert_toks: car retailers sell vehicles with various kinds of warrant ##ies concerning replacement of faulty parts at the suppliers expense .

reference_raw: Car vendors sell vehicles with different types of guarantees for the replacement of defective parts at the expense of the suppliers.

reference_spacy_tokens: Car vendors sell vehicles with different types of guarantees for the replacement of defective parts at the expense of the suppliers .


fn_spacy_tokens_for_baseline: She already knew how very bull - headed he could be when he was going after something he wanted .

source_bert_toks: she already knew how very bull - headed he could be when he was going after something he wanted .

reference_raw: She knew how stubborn he could be when he went after something he wanted.

reference_spacy_tokens: She knew how stubborn he could be when he went after something he wanted .


fn_spacy_tokens_for_baseline: The couple bought their novel residence , which was build in 1821 , for £ 80,000 in 1987 .

source_bert_toks: the couple bought their novel residence , which was build in 1821 , for £ ##80 , 000 in 1987 .

reference_raw: The couple bought a new house built in 1821 for £80,000 in 1987.

reference_spacy_tokens: The couple bought a new house built in 1821 for £ 80,000 in 1987 .


fn_spacy_tokens_for_baseline: The luggage made a sort of mountain in the barrow , and some of it would have to be lashed to the sides with ropes .

source_bert_toks: the luggage made a sort of mountain in the barrow , and some of it would have to be lashed to the sides with ropes .

reference_raw: The baggage was like a mountain in a barrow, and some of it had to be tied to the sides with ropes.

reference_spacy_tokens: The baggage was like a mountain in a barrow , and some of it had to be tied to the sides with ropes .


fn_spacy_tokens_for_baseline: She was making a tiny , repetitive sound , a little mew , as if in response to a lover 's touch .

source_bert_toks: she was making a tiny , repetitive sound , a little me ##w , as if in response to a lover ' s touch .

reference_raw: She made a small, repeated sound, a little mow, as if in response to the touch of a lover.

reference_spacy_tokens: She made a small , repeated sound , a little mow , as if in response to the touch of a lover .


fn_spacy_tokens_for_baseline: Masklin stuck a finger in his ear and wiggled it around .

source_bert_toks: mask ##lin stuck a finger in his ear and wiggled it around .

reference_raw: Masklin stuck a finger in his ear and twisted it.

reference_spacy_tokens: Masklin stuck a finger in his ear and twisted it .


fn_spacy_tokens_for_baseline: Mr Patten and his wife , Louise , 36 , an executive in a management consultancy , are one of the most affable couples on the Westminster scene .

source_bert_toks: mr pat ##ten and his wife , louise , 36 , an executive in a management consultancy , are one of the most af ##fa ##ble couples on the westminster scene .

reference_raw: Mr. Patten and his wife, Louise, 36 years old, manager of management advice, are one of the most friendly couples on the Westminster scene.

reference_spacy_tokens: Mr. Patten and his wife , Louise , 36 years old , manager of management advice , are one of the most friendly couples on the Westminster scene .


fn_spacy_tokens_for_baseline: I must get back now , if for no other reason than that the table will soon be cleared and I have n't had a bite since this morning .

source_bert_toks: i must get back now , if for no other reason than that the table will soon be cleared and i haven ' t had a bite since this morning .

reference_raw: I have to go back now, if for no other reason than that the table is about to be cleared, and I haven't eaten since this morning.

reference_spacy_tokens: I have to go back now , if for no other reason than that the table is about to be cleared , and I have n't eaten since this morning .


fn_spacy_tokens_for_baseline: ( Uitsmijter explains that it is an affectionate name meaning ' heifer ' used by betrothed people . )

source_bert_toks: ( ui ##ts ##mi ##j ##ter explains that it is an affection ##ate name meaning ' he ##ifer ' used by bet ##rot ##hed people . )

reference_raw: (Uitsmijter explains that it is a loving name with the meaning of "heifer" used by engaged people.)

reference_spacy_tokens: ( Uitsmijter explains that it is a loving name with the meaning of " heifer " used by engaged people . )


fn_spacy_tokens_for_baseline: ' But I feel annoyed that she had not thought it all through .

source_bert_toks: ' but i feel annoyed that she had not thought it all through .

reference_raw: 'But I'm angry she didn't think it through.

reference_spacy_tokens: ' But I 'm angry she did n't think it through .


fn_spacy_tokens_for_baseline: ' Sorry , ma'am , but I 'm knackered . '

source_bert_toks: ' sorry , ma ' am , but i ' m kn ##acker ##ed . '

reference_raw: "I'm sorry, ma'am, but I've been knocked."

reference_spacy_tokens: " I 'm sorry , ma'am , but I 've been knocked . "


fn_spacy_tokens_for_baseline: The report charged that Panama 's Manuel Noriega is not only in league with the drug traffickers but also is bullying the press as never before .

source_bert_toks: the report charged that panama ' s manuel nor ##ieg ##a is not only in league with the drug traffic ##kers but also is bullying the press as never before .

reference_raw: According to the report, Panama's Manuel Noriega is not only in league with drug dealers, but also intimidating the press as never before.

reference_spacy_tokens: According to the report , Panama 's Manuel Noriega is not only in league with drug dealers , but also intimidating the press as never before .


fn_spacy_tokens_for_baseline: They loosen their ties and slouch against the wall with hands in pockets in manufactured nonchalance .

source_bert_toks: they loosen their ties and sl ##ou ##ch against the wall with hands in pockets in manufactured non ##chal ##ance .

reference_raw: They loosen their ties and sluggishly against the wall, hands in pockets of manufactured nonchalance.

reference_spacy_tokens: They loosen their ties and sluggishly against the wall , hands in pockets of manufactured nonchalance .


fn_spacy_tokens_for_baseline: Concurrently , the United States along with some other IAEA board members has continued to maintain that Iran is pursuing an underground nuclear weapons program .

source_bert_toks: concurrently , the united states along with some other ia ##ea board members has continued to maintain that iran is pursuing an underground nuclear weapons program .

reference_raw: At the same time, the United States and some other members of the IAEA Council continue to argue that Iran is pursuing an underground nuclear-weapon program.

reference_spacy_tokens: At the same time , the United States and some other members of the IAEA Council continue to argue that Iran is pursuing an underground nuclear - weapon program .


fn_spacy_tokens_for_baseline: When Mrs Moreen bethought herself of this pretext for getting rid of their companion , Pemberton supposed it was precisely to approach the delicate subject of his remuneration ( 7 ) .

source_bert_toks: when mrs more ##en beth ##ough ##t herself of this pre ##text for getting rid of their companion , pe ##mber ##ton supposed it was precisely to approach the delicate subject of his re ##mun ##eration ( 7 ) .

reference_raw: When Mrs. Moreen thought of such an excuse to get rid of her companion, Pemberton assumed that it was precisely the delicate subject of his reward (7).

reference_spacy_tokens: When Mrs. Moreen thought of such an excuse to get rid of her companion , Pemberton assumed that it was precisely the delicate subject of his reward ( 7 ) .


fn_spacy_tokens_for_baseline: Nathan Road goes all the way up to Boundary Street , which marks the boundary between Kowloon and the New Territories .

source_bert_toks: nathan road goes all the way up to boundary street , which marks the boundary between ko ##wl ##oon and the new territories .

reference_raw: Nathan Road leads to Border Street, which is the border between Kowloon and the New Territories.

reference_spacy_tokens: Nathan Road leads to Border Street , which is the border between Kowloon and the New Territories .


fn_spacy_tokens_for_baseline: ' That 's because you 're bushed , ' he said .

source_bert_toks: ' that ' s because you ' re bush ##ed , ' he said .

reference_raw: 'Because you're shrubbed,' he said.

reference_spacy_tokens: ' Because you 're shrubbed , ' he said .


fn_spacy_tokens_for_baseline: At the railway station in the centre of Yeravan , workers cleaned up after violence at the weekend ; six militants died here in a shootout with troops .

source_bert_toks: at the railway station in the centre of yer ##ava ##n , workers cleaned up after violence at the weekend ; six militants died here in a shootout with troops .

reference_raw: At the station in the middle of Yeravan, workers cleaned up after the weekend of violence; six soldiers died here in a firefight with soldiers.

reference_spacy_tokens: At the station in the middle of Yeravan , workers cleaned up after the weekend of violence ; six soldiers died here in a firefight with soldiers .


fn_spacy_tokens_for_baseline: At least 400 homes have been evacuated in Sierra Madre near Los Angeles , California after a wildfire which started on Saturday , began to threaten their homes .

source_bert_toks: at least 400 homes have been evacuated in sierra mad ##re near los angeles , california after a wild ##fire which started on saturday , began to threaten their homes .

reference_raw: In Sierra Madre near Los Angeles, California, at least 400 homes were evacuated after a fire that began on Saturday and threatened their homes.

reference_spacy_tokens: In Sierra Madre near Los Angeles , California , at least 400 homes were evacuated after a fire that began on Saturday and threatened their homes .


fn_spacy_tokens_for_baseline: The Peak is still the most fashionable place to live in Hong Kong , but real estate prices here are astronomical ; rents run around HK$50,000 a month .

source_bert_toks: the peak is still the most fashionable place to live in hong kong , but real estate prices here are astronomical ; rents run around hk $ 50 , 000 a month .

reference_raw: The Peak is still the best place to live in Hong Kong, but the price of real estate is astronomical; the rent is about $50,000 a month.

reference_spacy_tokens: The Peak is still the best place to live in Hong Kong , but the price of real estate is astronomical ; the rent is about $ 50,000 a month .


fn_spacy_tokens_for_baseline: ' We can imagine that in the confusion of flight something precious , something which he could not bear to part with , had been left behind .

source_bert_toks: ' we can imagine that in the confusion of flight something precious , something which he could not bear to part with , had been left behind .

reference_raw: "We can imagine that something precious, something he couldn't bear to part with, was left behind in the confusion of flying.

reference_spacy_tokens: " We can imagine that something precious , something he could n't bear to part with , was left behind in the confusion of flying .


fn_spacy_tokens_for_baseline: Constantinople was taken by Crusader forces in 1204 , and they stripped the city of many of its finest treasures -- which now grace the public buildings of Venice -- although a large consignment of books and manuscripts was transferred to the monastery at Patmos before the city fell .

source_bert_toks: constantinople was taken by crusader forces in 120 ##4 , and they stripped the city of many of its finest treasures - - which now grace the public buildings of venice - - although a large con ##si ##gn ##ment of books and manuscripts was transferred to the monastery at pat ##mos before the city fell .

reference_raw: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a great deal of books and handwriting had been transferred to the convent in Patmos before the collapse of the city.

reference_spacy_tokens: Constantinople was captured by the Crusader forces in 1204 and stripped the city of many of its finest treasures - which now grace the public buildings of Venice - though a great deal of books and handwriting had been transferred to the convent in Patmos before the collapse of the city .


fn_spacy_tokens_for_baseline: It is not surprising that , ' the behaviour of the neonate is under the dominance of the gastrointestinal and genitourinary tracts ' .

source_bert_toks: it is not surprising that , ' the behaviour of the neon ##ate is under the dominance of the gas ##tro ##int ##estinal and gen ##ito ##uri ##nary tracts ' .

reference_raw: No wonder," the newborn's behavior is dominated by the gastrointestinal and genitourinary tracts.

reference_spacy_tokens: No wonder , " the newborn 's behavior is dominated by the gastrointestinal and genitourinary tracts .


fn_spacy_tokens_for_baseline: Entry procedures are similar to those in Hong Kong - most nationalities need only a passport to enter Macau .

source_bert_toks: entry procedures are similar to those in hong kong - most nationalities need only a passport to enter macau .

reference_raw: The process of entry is similar to that of Hong Kong - most nationals need only a passport to enter Macao.

reference_spacy_tokens: The process of entry is similar to that of Hong Kong - most nationals need only a passport to enter Macao .


fn_spacy_tokens_for_baseline: Other people 's approbation and censure is all insipid and uncritical , so does not help ; and I have no ground for confidence in myself .

source_bert_toks: other people ' s app ##ro ##bation and ce ##ns ##ure is all ins ##ip ##id and un ##cr ##itical , so does not help ; and i have no ground for confidence in myself .

reference_raw: The approval and censure of others is all insidious and uncritical, so it doesn't help; and I have no reason to believe in myself.

reference_spacy_tokens: The approval and censure of others is all insidious and uncritical , so it does n't help ; and I have no reason to believe in myself .


fn_spacy_tokens_for_baseline: I thanked him and tore up the prescription at the door .

source_bert_toks: i thanked him and tore up the prescription at the door .

reference_raw: I thanked him and ripped the recipe at the door.

reference_spacy_tokens: I thanked him and ripped the recipe at the door .


fn_spacy_tokens_for_baseline: After Jesus 's crucifixion , harsh Roman rule continued until a.d . 66 , when the Jews rebelled .

source_bert_toks: after jesus ' s cr ##uc ##if ##ix ##ion , harsh roman rule continued until a . d . 66 , when the jews rebelled .

reference_raw: After the crucifixion of Jesus, the cruel Roman government continued until the age of 66, when the Jews rebelled.

reference_spacy_tokens: After the crucifixion of Jesus , the cruel Roman government continued until the age of 66 , when the Jews rebelled .


fn_spacy_tokens_for_baseline: Two stewards attended them on deck , along with a large , silent sailor with a mole on his left cheek , who followed Stiarkoz everywhere .

source_bert_toks: two steward ##s attended them on deck , along with a large , silent sailor with a mole on his left cheek , who followed st ##ia ##rk ##oz everywhere .

reference_raw: They were accompanied by two stewards on board, along with a large, silent sailor with a mark on his left cheek, who followed Stiarkoz everywhere.

reference_spacy_tokens: They were accompanied by two stewards on board , along with a large , silent sailor with a mark on his left cheek , who followed Stiarkoz everywhere .


fn_spacy_tokens_for_baseline: Most of Kowloon 's attractions for visitors are centered near the tip of the peninsula in the district known as Tsim Sha Tsui .

source_bert_toks: most of ko ##wl ##oon ' s attractions for visitors are centered near the tip of the peninsula in the district known as ts ##im sha ts ##ui .

reference_raw: Most of Kowloon's visitors' attractions are centered near the end of the peninsula in the area known as Tsim Sha Tsui.

reference_spacy_tokens: Most of Kowloon 's visitors ' attractions are centered near the end of the peninsula in the area known as Tsim Sha Tsui .


fn_spacy_tokens_for_baseline: But , in the end , Steven did n't mind at all when discerning folk puked up all over the loathsome Lost Boys and complained of dangerous levels of heartwarming brought on by an excess of Robin Williams .

source_bert_toks: but , in the end , steven didn ' t mind at all when disc ##ern ##ing folk pu ##ked up all over the lo ##ath ##some lost boys and complained of dangerous levels of heart ##war ##ming brought on by an excess of robin williams .

reference_raw: But in the end, Steven didn't mind the fact that the recognizable people vomited all over the loathsome Lost Boys and complained about the dangerous levels of heartwarming caused by the excess of Robin Williams.

reference_spacy_tokens: But in the end , Steven did n't mind the fact that the recognizable people vomited all over the loathsome Lost Boys and complained about the dangerous levels of heartwarming caused by the excess of Robin Williams .


fn_spacy_tokens_for_baseline: Also one of the new pope 's first actions , taken on the day after his consecration , was to extract an oath of obedience from the prefect of Rome .

source_bert_toks: also one of the new pope ' s first actions , taken on the day after his consecration , was to extract an oath of obedience from the prefect of rome .

reference_raw: One of the first steps of the new Pope, taken the day after his sanctification, was to take an oath of obedience from the prefect of Rome.

reference_spacy_tokens: One of the first steps of the new Pope , taken the day after his sanctification , was to take an oath of obedience from the prefect of Rome .


fn_spacy_tokens_for_baseline: Smoke purled out of his nostrils , taken this way and that by the breeze .

source_bert_toks: smoke pu ##rled out of his nostrils , taken this way and that by the breeze .

reference_raw: Smoke flowed from his nostrils, coming this way and that in the wind.

reference_spacy_tokens: Smoke flowed from his nostrils , coming this way and that in the wind .


fn_spacy_tokens_for_baseline: Only two months later , the Korean Workers ' Party Central Committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

source_bert_toks: only two months later , the korean workers ' party central committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

reference_raw: Only two months later, the Central Committee of Korean Workers adopted policies to strengthen the military and implement import-replacement programs to reduce dependence on arms imports.

reference_spacy_tokens: Only two months later , the Central Committee of Korean Workers adopted policies to strengthen the military and implement import - replacement programs to reduce dependence on arms imports .


fn_spacy_tokens_for_baseline: The product will support PCL and Postscript emulations as well as FAX viewing under X. Special patented technology will be used to route incoming FAXes to the appropriate client workstation automatically .

source_bert_toks: the product will support pc ##l and posts ##cript em ##ulation ##s as well as fa ##x viewing under x . special patented technology will be used to route incoming fa ##xes to the appropriate client works ##tation automatically .

reference_raw: The product will support PCL and PostScript emulations, as well as FAX displays under X. Special patented technologies will be used to automatically redirect incoming FAXes to the relevant client workstation.

reference_spacy_tokens: The product will support PCL and PostScript emulations , as well as FAX displays under X. Special patented technologies will be used to automatically redirect incoming FAXes to the relevant client workstation .


fn_spacy_tokens_for_baseline: Foals rapidly stop sucking and can dehydrate very quickly .

source_bert_toks: f ##oa ##ls rapidly stop sucking and can de ##hy ##dra ##te very quickly .

reference_raw: The foals quickly stop sucking and dehydration very quickly.

reference_spacy_tokens: The foals quickly stop sucking and dehydration very quickly .


fn_spacy_tokens_for_baseline: At the same time , the massive growth in air and road transport saw shipping decline in importance .

source_bert_toks: at the same time , the massive growth in air and road transport saw shipping decline in importance .

reference_raw: At the same time, the massive growth of air and road transport has seen that shipping is becoming less important.

reference_spacy_tokens: At the same time , the massive growth of air and road transport has seen that shipping is becoming less important .


fn_spacy_tokens_for_baseline: She applies these terms to shoplifting -- ' the booster ' is a commercial shoplifter , the ' snitch ' a mere pilferer -- and links them to social class .

source_bert_toks: she applies these terms to shop ##lifting - - ' the booster ' is a commercial shop ##lift ##er , the ' s ##ni ##tch ' a mere pi ##lf ##ere ##r - - and links them to social class .

reference_raw: He uses these terms to steal-- "booster" is a shoplifter, a "snitch" is just a pilfer--and he connects them to a social class.

reference_spacy_tokens: He uses these terms to steal-- " booster " is a shoplifter , a " snitch " is just a pilfer -- and he connects them to a social class .


fn_spacy_tokens_for_baseline: This brings in sanctions against foreign companies found to be contributing to the proliferation of these weapons .

source_bert_toks: this brings in sanctions against foreign companies found to be contributing to the proliferation of these weapons .

reference_raw: This leads to sanctions against foreign companies which have been found to contribute to the spread of such weapons.

reference_spacy_tokens: This leads to sanctions against foreign companies which have been found to contribute to the spread of such weapons .


fn_spacy_tokens_for_baseline: Vices outlawed or heavily controlled elsewhere were legal here , available any hour of any day ( or night ) .

source_bert_toks: vice ##s outlawed or heavily controlled elsewhere were legal here , available any hour of any day ( or night ) .

reference_raw: Vices banned or heavily controlled elsewhere were legal here, available at any hour of the day (or night).

reference_spacy_tokens: Vices banned or heavily controlled elsewhere were legal here , available at any hour of the day ( or night ) .


fn_spacy_tokens_for_baseline: Cranston watched the sunlight shimmer on the great tocsin bell then turned round abruptly .

source_bert_toks: cr ##ans ##ton watched the sunlight shi ##mmer on the great to ##cs ##in bell then turned round abruptly .

reference_raw: Cranston watched the sun glint on the big tocsin bell, then suddenly turned.

reference_spacy_tokens: Cranston watched the sun glint on the big tocsin bell , then suddenly turned .


fn_spacy_tokens_for_baseline: Athletic prowess was admired and the Olympic games were constituted in 776 b.c . , to promote friendly competition .

source_bert_toks: athletic prowess was admired and the olympic games were constituted in 77 ##6 b . c . , to promote friendly competition .

reference_raw: Athletic prowess was admired and the Olympic Games were set up in 776 B.C. in order to encourage friendly competition.

reference_spacy_tokens: Athletic prowess was admired and the Olympic Games were set up in 776 B.C. in order to encourage friendly competition .


fn_spacy_tokens_for_baseline: The champions faxed a protest to UEFA after being ordered to meet Stuttgart on neutral territory .

source_bert_toks: the champions fa ##xed a protest to uefa after being ordered to meet stuttgart on neutral territory .

reference_raw: After being ordered to meet Stuttgart in neutral territory, the champions sent a protest to UEFA.

reference_spacy_tokens: After being ordered to meet Stuttgart in neutral territory , the champions sent a protest to UEFA .


fn_spacy_tokens_for_baseline: Officials have lifted the evacuation order for Chino Hills as well .

source_bert_toks: officials have lifted the evacuation order for chin ##o hills as well .

reference_raw: Officials have also lifted the evacuation warrant for Chino Hills.

reference_spacy_tokens: Officials have also lifted the evacuation warrant for Chino Hills .


fn_spacy_tokens_for_baseline: For safety 's sake , make sure the points on the ends of the sticks are blunted or masked with tape .

source_bert_toks: for safety ' s sake , make sure the points on the ends of the sticks are blunt ##ed or masked with tape .

reference_raw: In the interest of safety, make sure that the points on the ends of the sticks are blunted or covered with tape.

reference_spacy_tokens: In the interest of safety , make sure that the points on the ends of the sticks are blunted or covered with tape .


fn_spacy_tokens_for_baseline: Tero followed them at a distance , watching her new friend with sorrowful anxious eyes .

source_bert_toks: ter ##o followed them at a distance , watching her new friend with sorrow ##ful anxious eyes .

reference_raw: Tero watched them from afar, watching her new friend with sad, anxious eyes.

reference_spacy_tokens: Tero watched them from afar , watching her new friend with sad , anxious eyes .


fn_spacy_tokens_for_baseline: In the fourth where the track to the farm bears right , keep walking on the grass until you reach a gate .

source_bert_toks: in the fourth where the track to the farm bears right , keep walking on the grass until you reach a gate .

reference_raw: In the fourth, where the road to the farm is right, keep walking on the grass until you reach the gate.

reference_spacy_tokens: In the fourth , where the road to the farm is right , keep walking on the grass until you reach the gate .


fn_spacy_tokens_for_baseline: The seven were booked on marijuana possession charges after more than 40 policemen patrolled last Thursday 's bash on the tropical island of Phangan .

source_bert_toks: the seven were booked on marijuana possession charges after more than 40 policemen patrol ##led last thursday ' s bash on the tropical island of ph ##anga ##n .

reference_raw: Seven of them were charged with possession of marijuana after more than 40 policemen patrolled last Thursday's bash on the tropical island of Phangan.

reference_spacy_tokens: Seven of them were charged with possession of marijuana after more than 40 policemen patrolled last Thursday 's bash on the tropical island of Phangan .


fn_spacy_tokens_for_baseline: But there was something in the icecold reasoning of Holmes which made it impossible to shrink from any adventure which he might recommend .

source_bert_toks: but there was something in the ice ##col ##d reasoning of holmes which made it impossible to shrink from any adventure which he might recommend .

reference_raw: But there was something in Holmes's icy thoughts that made it impossible for him to shrink from any adventure he might recommend.

reference_spacy_tokens: But there was something in Holmes 's icy thoughts that made it impossible for him to shrink from any adventure he might recommend .


fn_spacy_tokens_for_baseline: ' You tell me how to get to the seneschal 's office , ' Quiss said evenly , ' or I shall boil you alive , understand ? '

source_bert_toks: ' you tell me how to get to the sen ##es ##chal ' s office , ' qui ##ss said evenly , ' or i shall boil you alive , understand ? '

reference_raw: 'Tell me how to get to the seneschal's office,' Quiss said evenly, 'or I'll cook you alive, understand?'

reference_spacy_tokens: ' Tell me how to get to the seneschal 's office , ' Quiss said evenly , ' or I 'll cook you alive , understand ? '


fn_spacy_tokens_for_baseline: I instruct you to pay direct debits from my account at the request of Campaign for Real Ale Limited .

source_bert_toks: i ins ##truct you to pay direct de ##bit ##s from my account at the request of campaign for real ale limited .

reference_raw: At the request of the campaign for Real Ale Limited, I order you to pay direct debits from my account.

reference_spacy_tokens: At the request of the campaign for Real Ale Limited , I order you to pay direct debits from my account .


fn_spacy_tokens_for_baseline: " I mean you , curb ! sitting there grinning while he groped at you .

source_bert_toks: " i mean you , curb ! sitting there grinning while he gr ##oped at you .

reference_raw: "I mean you, curb!" he sat there smiling as he fumbled at you.

reference_spacy_tokens: " I mean you , curb ! " he sat there smiling as he fumbled at you .


fn_spacy_tokens_for_baseline: ' I was a bit'arassed myself , ' said Father Luke , ' but the glimpse I'ad of your ordeal , Mother Verity , told me I was gettin ' off light .

source_bert_toks: ' i was a bit ' ara ##ssed myself , ' said father luke , ' but the glimpse i ' ad of your ordeal , mother verity , told me i was get ##tin ' off light .

reference_raw: 'I was a little embarrassed myself,' said Father Luke, 'but the sight of your suffering, Mother Verity, said I was getting out of the light.

reference_spacy_tokens: ' I was a little embarrassed myself , ' said Father Luke , ' but the sight of your suffering , Mother Verity , said I was getting out of the light .


fn_spacy_tokens_for_baseline: ' To tell you the truth , my secretary fucked up .

source_bert_toks: ' to tell you the truth , my secretary fucked up .

reference_raw: 'As a matter of fact, my secretary screwed up.

reference_spacy_tokens: ' As a matter of fact , my secretary screwed up .


fn_spacy_tokens_for_baseline: Simply put , Stephanopoulos did as much as any man to get the country into the mess he now so telegenically laments .

source_bert_toks: simply put , stephan ##op ##oulos did as much as any man to get the country into the mess he now so tel ##ege ##nical ##ly lame ##nts .

reference_raw: Simply put, Stephanopoulos had done everything he could to get the country into the chaos that he now so telegenically lamented.

reference_spacy_tokens: Simply put , Stephanopoulos had done everything he could to get the country into the chaos that he now so telegenically lamented .


fn_spacy_tokens_for_baseline: Inspector Fouchard hastily rethought his position and reluctantly agreed to wire the information to Paris .

source_bert_toks: inspector f ##ou ##cha ##rd hastily re ##th ##ough ##t his position and reluctantly agreed to wire the information to paris .

reference_raw: Inspector Fouchard quickly reconsidered his position and reluctantly agreed to transfer the information to Paris.

reference_spacy_tokens: Inspector Fouchard quickly reconsidered his position and reluctantly agreed to transfer the information to Paris .


fn_spacy_tokens_for_baseline: The attackers were environmental terrorists upset about a new industry coming to town .

source_bert_toks: the attackers were environmental terrorists upset about a new industry coming to town .

reference_raw: The assailants were environmental terrorists who were pissed off about a new industry coming into the city.

reference_spacy_tokens: The assailants were environmental terrorists who were pissed off about a new industry coming into the city .


fn_spacy_tokens_for_baseline: By this time , Marlin was sound asleep .

source_bert_toks: by this time , mar ##lin was sound asleep .

reference_raw: Marlin was sleeping soundly now.

reference_spacy_tokens: Marlin was sleeping soundly now .


fn_spacy_tokens_for_baseline: This was immediately whipped off by a waiting attendant who then passed it along a table for it to be boxed up and returned to me in the ante room .

source_bert_toks: this was immediately whipped off by a waiting attendant who then passed it along a table for it to be boxed up and returned to me in the ant ##e room .

reference_raw: It was immediately whipped away by the waiter, who then handed it to the desk so that it could be packed and returned to me in the anteroom.

reference_spacy_tokens: It was immediately whipped away by the waiter , who then handed it to the desk so that it could be packed and returned to me in the anteroom .


fn_spacy_tokens_for_baseline: Professor Slocombe finished muttering a Latin text over the table of laid - out darts and gave the benediction .

source_bert_toks: professor sl ##oco ##mbe finished muttering a latin text over the table of laid - out darts and gave the benedict ##ion .

reference_raw: Professor Slocombe finished muttering Latin over a table of sprawled darts and gave his blessing.

reference_spacy_tokens: Professor Slocombe finished muttering Latin over a table of sprawled darts and gave his blessing .


fn_spacy_tokens_for_baseline: They will both reappear before the court on Thursday morning .

source_bert_toks: they will both re ##app ##ear before the court on thursday morning .

reference_raw: They'll both show up at the trial Thursday morning.

reference_spacy_tokens: They 'll both show up at the trial Thursday morning .


fn_spacy_tokens_for_baseline: As the Byzantine Empire weakened at the end of the first millennium , Crusader forces were sent from Western Europe to counter the Muslim forces and retake Jerusalem for the Christian faith .

source_bert_toks: as the byzantine empire weakened at the end of the first millennium , crusader forces were sent from western europe to counter the muslim forces and re ##take jerusalem for the christian faith .

reference_raw: As the Byzantine Empire weakened at the end of the first millennia, the forces of the Crusaders were dispatched from Western Europe to fight against the Muslim forces and reclaim Jerusalem for the Christian faith.

reference_spacy_tokens: As the Byzantine Empire weakened at the end of the first millennia , the forces of the Crusaders were dispatched from Western Europe to fight against the Muslim forces and reclaim Jerusalem for the Christian faith .


fn_spacy_tokens_for_baseline: Two cart horses and one nag are kept on the farm ; Mr Long employs three labourers , at wages of 15s a week , and 3 pints of cider per day .

source_bert_toks: two cart horses and one na ##g are kept on the farm ; mr long employs three labourers , at wages of 15 ##s a week , and 3 pin ##ts of cid ##er per day .

reference_raw: There are two wagon horses and a nag on the farm; Mr. Long employs three workers at a salary of 15 a week and three beers of cider a day.

reference_spacy_tokens: There are two wagon horses and a nag on the farm ; Mr. Long employs three workers at a salary of 15 a week and three beers of cider a day .


fn_spacy_tokens_for_baseline: The stations were to be vast in size but unexciting in form .

source_bert_toks: the stations were to be vast in size but une ##x ##cit ##ing in form .

reference_raw: The stations were supposed to be huge, but not exciting in shape.

reference_spacy_tokens: The stations were supposed to be huge , but not exciting in shape .


fn_spacy_tokens_for_baseline: The longer that a person is deprived of oxygen the bluer a person becomes .

source_bert_toks: the longer that a person is deprived of oxygen the blue ##r a person becomes .

reference_raw: The longer you lose oxygen, the bluer you become.

reference_spacy_tokens: The longer you lose oxygen , the bluer you become .


fn_spacy_tokens_for_baseline: Subordination is , in the Genesis text , the punishment meted out to woman .

source_bert_toks: sub ##ord ##ination is , in the genesis text , the punishment met ##ed out to woman .

reference_raw: In the Genesis text, subordination is punishable by a woman.

reference_spacy_tokens: In the Genesis text , subordination is punishable by a woman .


fn_spacy_tokens_for_baseline: Findings based on very limited evidence can not be regarded as being firmly established and need to be verified by means of additional observations and cases .

source_bert_toks: findings based on very limited evidence can not be regarded as being firmly established and need to be verified by means of additional observations and cases .

reference_raw: Findings based on very limited evidence cannot be considered to be well established and should be examined through further observations and cases.

reference_spacy_tokens: Findings based on very limited evidence can not be considered to be well established and should be examined through further observations and cases .


fn_spacy_tokens_for_baseline: It rather shook me when I discovered I was pregnant by you . '

source_bert_toks: it rather shook me when i discovered i was pregnant by you . '

reference_raw: "When I found out I was pregnant with you, I was quite shocked."

reference_spacy_tokens: " When I found out I was pregnant with you , I was quite shocked . "


fn_spacy_tokens_for_baseline: A strong challenge from the far left , the Communist coalition Izquierda Unida , failed to topple him .

source_bert_toks: a strong challenge from the far left , the communist coalition i ##z ##qui ##er ##da un ##ida , failed to top ##ple him .

reference_raw: The great challenge of the Communist Coalition Izquierda Unida, from the far-left, failed to overthrow him.

reference_spacy_tokens: The great challenge of the Communist Coalition Izquierda Unida , from the far - left , failed to overthrow him .


fn_spacy_tokens_for_baseline: I eventually had my baby , a little girl , but she was born with spina bifida .

source_bert_toks: i eventually had my baby , a little girl , but she was born with spin ##a bi ##fi ##da .

reference_raw: In the end, I gave birth to a baby, a little girl, but she was born with a spina bifida.

reference_spacy_tokens: In the end , I gave birth to a baby , a little girl , but she was born with a spina bifida .


fn_spacy_tokens_for_baseline: It is hoped that initially the client will experience some anxiety with each target and learn to cope with this effectively , but that over five attempts of this target this anxiety will drop to a minimum .

source_bert_toks: it is hoped that initially the client will experience some anxiety with each target and learn to cope with this effectively , but that over five attempts of this target this anxiety will drop to a minimum .

reference_raw: It is hoped that the client will initially feel some anxiety about each target and learn to deal with it effectively, but that more than five attempts to do so will reduce the anxiety to a minimum.

reference_spacy_tokens: It is hoped that the client will initially feel some anxiety about each target and learn to deal with it effectively , but that more than five attempts to do so will reduce the anxiety to a minimum .


fn_spacy_tokens_for_baseline: Shakir chose to withhold his first name to spare his family unnecessary risk .

source_bert_toks: sha ##kir chose to with ##hold his first name to spare his family unnecessary risk .

reference_raw: Shakir decided to hide his first name in order to save his family unnecessary danger.

reference_spacy_tokens: Shakir decided to hide his first name in order to save his family unnecessary danger .


fn_spacy_tokens_for_baseline: Russia 's nuclear and missile capabilities presupposes its crucial role in arms control and nonproliferation , while the remnants of chemical and biological weapons programs pose major environmental and proliferation threats .

source_bert_toks: russia ' s nuclear and missile capabilities pre ##su ##pp ##oses its crucial role in arms control and non ##pro ##life ##ration , while the remnants of chemical and biological weapons programs pose major environmental and proliferation threats .

reference_raw: Russia's nuclear and missile capabilities presuppose that it plays a key role in the control and non-proliferation of weapons, whereas the remains of chemical and biological weapons programmes pose major threats to the environment and proliferation.

reference_spacy_tokens: Russia 's nuclear and missile capabilities presuppose that it plays a key role in the control and non - proliferation of weapons , whereas the remains of chemical and biological weapons programmes pose major threats to the environment and proliferation .


fn_spacy_tokens_for_baseline: One patient , suffering from cerebral palsy , was admitted with terrible bedsores which have since been treated .

source_bert_toks: one patient , suffering from cerebral pal ##sy , was admitted with terrible beds ##ores which have since been treated .

reference_raw: One patient, suffering from brain palsy, was admitted with a horrible bedsore that had been treated since then.

reference_spacy_tokens: One patient , suffering from brain palsy , was admitted with a horrible bedsore that had been treated since then .


fn_spacy_tokens_for_baseline: They were splashing through shallow water , between massive , brooding willow trunks .

source_bert_toks: they were splash ##ing through shallow water , between massive , brooding willow trunks .

reference_raw: They splattered in shallow water, among the huge, brooding trunks of willows.

reference_spacy_tokens: They splattered in shallow water , among the huge , brooding trunks of willows .


fn_spacy_tokens_for_baseline: There , hanging by their forelimbs from a vine or branch , the sloths dug a small depression in the soil with their hind legs into which they defecated .

source_bert_toks: there , hanging by their fore ##lim ##bs from a vine or branch , the slot ##hs dug a small depression in the soil with their hind legs into which they def ##eca ##ted .

reference_raw: There, hanging by the front limbs of a vine or branch, the sloths dug a small hole in the ground with their hind legs, where they defecated.

reference_spacy_tokens: There , hanging by the front limbs of a vine or branch , the sloths dug a small hole in the ground with their hind legs , where they defecated .


fn_spacy_tokens_for_baseline: British social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

source_bert_toks: british social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

reference_raw: British social habits are still evident in the sort of polite service you get in hotels and in the long rows of people who wait for buses at the time of the rush.

reference_spacy_tokens: British social habits are still evident in the sort of polite service you get in hotels and in the long rows of people who wait for buses at the time of the rush .


fn_spacy_tokens_for_baseline: Faint starlight glimmered on the steep sloping rooftops , the milky way a net of luminosity beyond the black silhouetted chimneytops of the Bell o ' the Brae .

source_bert_toks: faint star ##light g ##lim ##mere ##d on the steep sloping rooftop ##s , the milky way a net of lu ##min ##osity beyond the black silhouette ##d chimney ##tops of the bell o ' the bra ##e .

reference_raw: Faint starlight gleamed on the steeply sloping rooftops, like a milky net of luminosity behind the black, silhouetted chimneytops of Bello'Brae.

reference_spacy_tokens: Faint starlight gleamed on the steeply sloping rooftops , like a milky net of luminosity behind the black , silhouetted chimneytops of Bello'Brae .


fn_spacy_tokens_for_baseline: And anyway , the hefty Mrs Browne had marched the fellow upstairs and he had taken his instructions from Eloise .

source_bert_toks: and anyway , the he ##ft ##y mrs browne had marched the fellow upstairs and he had taken his instructions from el ##oise .

reference_raw: In any case, the heavy Mrs. Browne marched him up the stairs and took his instructions from Eloise.

reference_spacy_tokens: In any case , the heavy Mrs. Browne marched him up the stairs and took his instructions from Eloise .


fn_spacy_tokens_for_baseline: Volker 's puny body shook with anger .

source_bert_toks: vol ##ker ' s pun ##y body shook with anger .

reference_raw: Volker's tiny body trembled with anger.

reference_spacy_tokens: Volker 's tiny body trembled with anger .


fn_spacy_tokens_for_baseline: Amiss decided not to mention the dead bodies he 'd been coming across since he 'd got chummy with Jim Milton .

source_bert_toks: ami ##ss decided not to mention the dead bodies he ' d been coming across since he ' d got chu ##mmy with jim milton .

reference_raw: Amiss decided not to mention the dead bodies he'd encountered since he and Jim Milton had been chumpy.

reference_spacy_tokens: Amiss decided not to mention the dead bodies he 'd encountered since he and Jim Milton had been chumpy .


fn_spacy_tokens_for_baseline: The grandstand situated on the seaside road , the Avenida da Amizade ( Friendship Avenue ) , marks the finishing line for the Macau Grand Prix , the international car - racing event held here every November .

source_bert_toks: the grand ##stand situated on the seaside road , the ave ##ni ##da da ami ##za ##de ( friendship avenue ) , marks the finishing line for the macau grand prix , the international car - racing event held here every november .

reference_raw: The Grandstand on the seaside road, Avenida da Amizade (Friendship Avenue), marks the final line of the Macao Grand Prix, the international car - a race event that takes place here every October.

reference_spacy_tokens: The Grandstand on the seaside road , Avenida da Amizade ( Friendship Avenue ) , marks the final line of the Macao Grand Prix , the international car - a race event that takes place here every October .


fn_spacy_tokens_for_baseline: Built at Deptford in 1786 , she weighed 1,877 tons and carried a crew of 750 men .

source_bert_toks: built at dept ##ford in 1786 , she weighed 1 , 87 ##7 tons and carried a crew of 750 men .

reference_raw: Built in Deptford in 1786, she weighed 1,877 tons and carried a garrison of 750 men.

reference_spacy_tokens: Built in Deptford in 1786 , she weighed 1,877 tons and carried a garrison of 750 men .


fn_spacy_tokens_for_baseline: There is a rich seam of ' Europeanism ' running through fascist thought , as a quick perusal of Nazi newspapers or a glance at the memoirs of British fascists like Diana Mosley reveals .

source_bert_toks: there is a rich seam of ' european ##ism ' running through fascist thought , as a quick peru ##sal of nazi newspapers or a glance at the memoirs of british fascist ##s like diana mo ##sley reveals .

reference_raw: Fascist thoughts run through a rich seam of Europeanism, like the rapid persuasion of Nazi newspapers or the sight of British fascists like Diana Mosley.

reference_spacy_tokens: Fascist thoughts run through a rich seam of Europeanism , like the rapid persuasion of Nazi newspapers or the sight of British fascists like Diana Mosley .


fn_spacy_tokens_for_baseline: Margaret also went on to surmise that their arrangements could not deal with more than one child .

source_bert_toks: margaret also went on to sur ##mise that their arrangements could not deal with more than one child .

reference_raw: Margaret also assumed that they couldn't deal with more than one child.

reference_spacy_tokens: Margaret also assumed that they could n't deal with more than one child .


fn_spacy_tokens_for_baseline: In 1988 the university purportedly terminated the applicant 's contract of employment not for good cause but on the ground of redundancy , giving him three months ' written notice .

source_bert_toks: in 1988 the university purported ##ly terminated the applicant ' s contract of employment not for good cause but on the ground of red ##unda ##ncy , giving him three months ' written notice .

reference_raw: In 1988, the university allegedly withdrew the applicant's contract of employment not for good reason but for dismissal, giving him three months' written notice.

reference_spacy_tokens: In 1988 , the university allegedly withdrew the applicant 's contract of employment not for good reason but for dismissal , giving him three months ' written notice .


fn_spacy_tokens_for_baseline: Mr Prior , at the Department of Employment , was publicly reprimanded by her , and her dissatisfaction with particular policies is usually well known .

source_bert_toks: mr prior , at the department of employment , was publicly rep ##rim ##and ##ed by her , and her dissatisfaction with particular policies is usually well known .

reference_raw: Mr Prior, in the Ministry of Employment, has been publicly accused, and her dissatisfaction with certain policies is generally well known.

reference_spacy_tokens: Mr Prior , in the Ministry of Employment , has been publicly accused , and her dissatisfaction with certain policies is generally well known .


fn_spacy_tokens_for_baseline: That meant that there were seven mouths to feed , and then Daddy began to ail .

source_bert_toks: that meant that there were seven mouths to feed , and then daddy began to ai ##l .

reference_raw: That meant we had seven mouths to feed, and then Dad started to get sick.

reference_spacy_tokens: That meant we had seven mouths to feed , and then Dad started to get sick .


fn_spacy_tokens_for_baseline: ' I 'm far too thin and angular .

source_bert_toks: ' i ' m far too thin and angular .

reference_raw: I'm too thin and square.

reference_spacy_tokens: I 'm too thin and square .


fn_spacy_tokens_for_baseline: But Rachel was not discouraged .

source_bert_toks: but rachel was not discouraged .

reference_raw: But Rachel wasn't deterred.

reference_spacy_tokens: But Rachel was n't deterred .


fn_spacy_tokens_for_baseline: Tip it into a food processor or mash it with a fork in a bowl , then return to the freezer .

source_bert_toks: tip it into a food processor or mas ##h it with a fork in a bowl , then return to the freeze ##r .

reference_raw: Put it in the food processor, or weed it with a fork in the bowl, and then go back to the freezer.

reference_spacy_tokens: Put it in the food processor , or weed it with a fork in the bowl , and then go back to the freezer .


fn_spacy_tokens_for_baseline: After the acquittal of ' Inside Linda Lovelace ' in 1976 , the authorities largely abandoned the attempt to prosecute books for which any claim of literary merit could be made .

source_bert_toks: after the ac ##qui ##ttal of ' inside linda love ##lace ' in 1976 , the authorities largely abandoned the attempt to prose ##cute books for which any claim of literary merit could be made .

reference_raw: After the exoneration of "Inside Linda Lovelace" in 1976, the authorities largely abandoned the attempt to prosecute books for which any claim of literary merit could be made.

reference_spacy_tokens: After the exoneration of " Inside Linda Lovelace " in 1976 , the authorities largely abandoned the attempt to prosecute books for which any claim of literary merit could be made .


fn_spacy_tokens_for_baseline: It is an immensely readable book , yet it treats its important subject with insight and responsibility .

source_bert_toks: it is an immensely read ##able book , yet it treats its important subject with insight and responsibility .

reference_raw: It's a very readable book, but it deals with its important subject with insight and responsibility.

reference_spacy_tokens: It 's a very readable book , but it deals with its important subject with insight and responsibility .


fn_spacy_tokens_for_baseline: The kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compounded by factors like physical and mental disabilities , illiteracy and lack of job skills .

source_bert_toks: the kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compound ##ed by factors like physical and mental disabilities , ill ##iter ##acy and lack of job skills .

reference_raw: The types of services we provide help people to tackle obstacles such as health care, transport and childcare - problems that are large enough in themselves, without being compounded by factors such as physical and mental handicaps, illiteracy and lack of employability.

reference_spacy_tokens: The types of services we provide help people to tackle obstacles such as health care , transport and childcare - problems that are large enough in themselves , without being compounded by factors such as physical and mental handicaps , illiteracy and lack of employability .


fn_spacy_tokens_for_baseline: This would be , for both of them , an expiation of emotional suffering .

source_bert_toks: this would be , for both of them , an ex ##pia ##tion of emotional suffering .

reference_raw: This would be the end of emotional suffering for both of them.

reference_spacy_tokens: This would be the end of emotional suffering for both of them .


fn_spacy_tokens_for_baseline: But as he went in , something landed on his back and he felt strong , sinewy hands fasten round his throat .

source_bert_toks: but as he went in , something landed on his back and he felt strong , sin ##ew ##y hands fast ##en round his throat .

reference_raw: But as he entered, something hit him on the back, and he felt his strong, sinewy hands clasped around his neck.

reference_spacy_tokens: But as he entered , something hit him on the back , and he felt his strong , sinewy hands clasped around his neck .


fn_spacy_tokens_for_baseline: The art of change - ringing is peculiar to the English , and , like most English peculiarities , unintelligible to the rest of the world .

source_bert_toks: the art of change - ringing is peculiar to the english , and , like most english peculiar ##ities , un ##int ##elli ##gible to the rest of the world .

reference_raw: The art of changing rings is strange to the English and, like most English specialities, incomprehensible to the rest of the world.

reference_spacy_tokens: The art of changing rings is strange to the English and , like most English specialities , incomprehensible to the rest of the world .


fn_spacy_tokens_for_baseline: The news is also terrific for giving the boys a window on the world .

source_bert_toks: the news is also terrific for giving the boys a window on the world .

reference_raw: News is also great for giving boys a window in the world.

reference_spacy_tokens: News is also great for giving boys a window in the world .


fn_spacy_tokens_for_baseline: If they put a Republican into office , not only will they acquire less in terms of local benefits but their selected legislator will be relatively powerless to prevent other legislators from " bringing home the bacon " to their respective constituencies .

source_bert_toks: if they put a republican into office , not only will they acquire less in terms of local benefits but their selected legislator will be relatively powerless to prevent other legislators from " bringing home the bacon " to their respective constituencies .

reference_raw: By placing a Republican in office, they will not only receive less local benefits, but their chosen legislature will be relatively helpless to prevent other legislators from "bringing home bacon" to their respective constituencies.

reference_spacy_tokens: By placing a Republican in office , they will not only receive less local benefits , but their chosen legislature will be relatively helpless to prevent other legislators from " bringing home bacon " to their respective constituencies .


fn_spacy_tokens_for_baseline: 4:02 a.m. SHIBUMI : Power is back on , and UCSF { medical center } seems to have quieted down for the night ( they were doing triage out in the parking lot from the sound and lights of it ) .

source_bert_toks: 4 : 02 a . m . shi ##bu ##mi : power is back on , and uc ##sf { medical center } seems to have quiet ##ed down for the night ( they were doing tri ##age out in the parking lot from the sound and lights of it ) .

reference_raw: 4:02 A.M. SHIBUMI: The power is up again, and the UCSF {medical center} appears to have quieted for the night (they've been doing triage in the parking lot by the sound and lights of the car).

reference_spacy_tokens: 4:02 A.M. SHIBUMI : The power is up again , and the UCSF { medical center } appears to have quieted for the night ( they 've been doing triage in the parking lot by the sound and lights of the car ) .


fn_spacy_tokens_for_baseline: Los Angeles County Supervisor Zev Yaroslavsky stated , " Whether you live in a mobile home park or you live in an estate , when you lose your home it 's devastating . "

source_bert_toks: los angeles county supervisor zev ya ##ros ##lav ##sky stated , " whether you live in a mobile home park or you live in an estate , when you lose your home it ' s devastating . "

reference_raw: L.A. County Inspector Zev Yaroslavsky said, "If you live in a mobile home park or live in a mansion, if you lose your home, it's devastating."

reference_spacy_tokens: L.A. County Inspector Zev Yaroslavsky said , " If you live in a mobile home park or live in a mansion , if you lose your home , it 's devastating . "


fn_spacy_tokens_for_baseline: Wherever the High Gable folk go he will keep them in sight .

source_bert_toks: wherever the high gable folk go he will keep them in sight .

reference_raw: Wherever the people of High Gable go, they'll be in sight.

reference_spacy_tokens: Wherever the people of High Gable go , they 'll be in sight .


fn_spacy_tokens_for_baseline: Endless seconds wondering if those huge windows would buckle and shower us with glass .

source_bert_toks: endless seconds wondering if those huge windows would buckle and shower us with glass .

reference_raw: For endless seconds, I wonder if the big windows will buckle and spray us with glass.

reference_spacy_tokens: For endless seconds , I wonder if the big windows will buckle and spray us with glass .


fn_spacy_tokens_for_baseline: Menzies threw his wine onto the coal , it fizzed , and a reek of bonfires filled the room .

source_bert_toks: men ##zie ##s threw his wine onto the coal , it fi ##zz ##ed , and a re ##ek of bonfire ##s filled the room .

reference_raw: Menzies tossed his wine to the coal, and it fizzed, and the smell of the fires filled the room.

reference_spacy_tokens: Menzies tossed his wine to the coal , and it fizzed , and the smell of the fires filled the room .


fn_spacy_tokens_for_baseline: I changed the subject and we moved into the sitting room . '

source_bert_toks: i changed the subject and we moved into the sitting room . '

reference_raw: I changed the subject and we moved into the living room.'

reference_spacy_tokens: I changed the subject and we moved into the living room . '


fn_spacy_tokens_for_baseline: You should inspect your mail to determine the outcome of the module transfer .

source_bert_toks: you should inspect your mail to determine the outcome of the module transfer .

reference_raw: To determine the result of the module transfer, you should check your e-mail.

reference_spacy_tokens: To determine the result of the module transfer , you should check your e - mail .


fn_spacy_tokens_for_baseline: But now a donkey brayed and the faint chant of women drifted with wood smoke from the town .

source_bert_toks: but now a donkey bray ##ed and the faint chant of women drifted with wood smoke from the town .

reference_raw: But now the donkey was breathing, and the faint singing of the women was drifting out of the city with wood smoke.

reference_spacy_tokens: But now the donkey was breathing , and the faint singing of the women was drifting out of the city with wood smoke .


fn_spacy_tokens_for_baseline: It clanged urgently , like a fire - engine dashing towards a disaster , like the ambulance thundering along behind to retrieve the bodies .

source_bert_toks: it clan ##ged urgently , like a fire - engine dash ##ing towards a disaster , like the ambulance thunder ##ing along behind to retrieve the bodies .

reference_raw: It rang urgently, like a fire engine rushing toward disaster, like an ambulance thundering behind to pick up the bodies.

reference_spacy_tokens: It rang urgently , like a fire engine rushing toward disaster , like an ambulance thundering behind to pick up the bodies .


fn_spacy_tokens_for_baseline: The chefs of Brighton & Hove 's excellent restaurants can whip up a piquant sauce every bit as good as George IV 's French cooks .

source_bert_toks: the chefs of brighton & hove ' s excellent restaurants can whip up a pi ##qua ##nt sauce every bit as good as george iv ' s french cooks .

reference_raw: Chefs from the excellent restaurants of Brighton & Hove can beat up a piquant sauce every bit as good as the French chefs of George IV.

reference_spacy_tokens: Chefs from the excellent restaurants of Brighton & Hove can beat up a piquant sauce every bit as good as the French chefs of George IV .


fn_spacy_tokens_for_baseline: Fourth : Reward and Punishment ( T.C : Koranic verse )

source_bert_toks: fourth : reward and punishment ( t . c : ko ##rani ##c verse )

reference_raw: Fourth: remuneration and punishment (T.C.: Korean verse)

reference_spacy_tokens: Fourth : remuneration and punishment ( T.C. : Korean verse )


fn_spacy_tokens_for_baseline: In Colombia , the drug - financed guerrillas trying to seize the country and destroy democracy include M-19 , which Castro has clearly backed .

source_bert_toks: in colombia , the drug - financed guerrillas trying to seize the country and destroy democracy include m - 19 , which castro has clearly backed .

reference_raw: In Colombia, the drug-funded guerrillas who are trying to take over the country and destroy democracy include M-19, which Castro clearly supports.

reference_spacy_tokens: In Colombia , the drug - funded guerrillas who are trying to take over the country and destroy democracy include M-19 , which Castro clearly supports .


fn_spacy_tokens_for_baseline: The hallway smelt of boiled cabbage and old rag mats .

source_bert_toks: the hallway sm ##elt of boiled cabbage and old rag mats .

reference_raw: The corridor smelled of boiled cabbage and old rag mats.

reference_spacy_tokens: The corridor smelled of boiled cabbage and old rag mats .


fn_spacy_tokens_for_baseline: " Uranium enrichment will nevertheless proceed inside the halls uninterrupted and unmonitored by the international community , " the diplomat added ( Michael Adler , Agence France - Presse / Yahoo ! News , Feb. 1 ) .

source_bert_toks: " uranium enrichment will nevertheless proceed inside the halls un ##int ##er ##rup ##ted and un ##mon ##itor ##ed by the international community , " the diplomat added ( michael adler , age ##nce france - press ##e / yahoo ! news , feb . 1 ) .

reference_raw: "But the enrichment of uranium will continue in the halls without interruption and supervision by the international community," the diplomat added (Michael Adler, Agence France-press/Yahoo! News, February 1).

reference_spacy_tokens: " But the enrichment of uranium will continue in the halls without interruption and supervision by the international community , " the diplomat added ( Michael Adler , Agence France - press / Yahoo ! News , February 1 ) .


fn_spacy_tokens_for_baseline: It was only after the protector 's death in September 1658 that Stokes ventured to arrest his deputy and ship him back to England for trial .

source_bert_toks: it was only after the protector ' s death in september 1658 that stokes ventured to arrest his deputy and ship him back to england for trial .

reference_raw: Only after the Protector's death in September 1658 did Stokes dare arrest his deputy and send him back to England for trial.

reference_spacy_tokens: Only after the Protector 's death in September 1658 did Stokes dare arrest his deputy and send him back to England for trial .


fn_spacy_tokens_for_baseline: Eight months of commemorative jollification for the Eiffel Tower began in March .

source_bert_toks: eight months of commemorative jo ##lli ##fication for the e ##iff ##el tower began in march .

reference_raw: Eight months of commemorative cheering for the Eiffel Tower began in March.

reference_spacy_tokens: Eight months of commemorative cheering for the Eiffel Tower began in March .


fn_spacy_tokens_for_baseline: You 've bought your own twenty - two , or hired a Parabellum , and you 're using only imported rounds .

source_bert_toks: you ' ve bought your own twenty - two , or hired a para ##bell ##um , and you ' re using only imported rounds .

reference_raw: You bought your own 22, or you hired a Parabellum, and you only use imported bullets.

reference_spacy_tokens: You bought your own 22 , or you hired a Parabellum , and you only use imported bullets .


fn_spacy_tokens_for_baseline: ' You send us on our way weaponless , so that we can be slaughtered from ambush .

source_bert_toks: ' you send us on our way weapon ##less , so that we can be slaughtered from ambush .

reference_raw: You're sending us on our way unarmed so they can kill us from ambush.

reference_spacy_tokens: You 're sending us on our way unarmed so they can kill us from ambush .


fn_spacy_tokens_for_baseline: Kefalov bulged like some fossil brain adorned with innumerable ridges .

source_bert_toks: ke ##fa ##lov bulge ##d like some fossil brain adorned with inn ##ume ##rable ridges .

reference_raw: Kefalov bulged like a fossil brain decorated with countless ridges.

reference_spacy_tokens: Kefalov bulged like a fossil brain decorated with countless ridges .


fn_spacy_tokens_for_baseline: Annabel said in an agitated voice , ' I feel as if my mind is whirling madly , like a hurricane .

source_bert_toks: anna ##bel said in an agitated voice , ' i feel as if my mind is w ##hir ##ling madly , like a hurricane .

reference_raw: Annabel said excitedly, "I feel like my mind is spinning like a hurricane.

reference_spacy_tokens: Annabel said excitedly , " I feel like my mind is spinning like a hurricane .


fn_spacy_tokens_for_baseline: That demand was reportedly knocked down by the Clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that North Korea was honouring the bargain - when the Clinton team ran out of time .

source_bert_toks: that demand was reportedly knocked down by the clinton administration to a series of satellite launches and some food aid , but the potential deal still lacked a key component - how to verify that north korea was honour ##ing the bargain - when the clinton team ran out of time .

reference_raw: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid, but the potential agreement still lacked the key element to verify that North Korea was honoring the deal-when the Clinton team ran out of time.

reference_spacy_tokens: The Clinton administration supposedly reduced this demand to a series of satellite launches and some food aid , but the potential agreement still lacked the key element to verify that North Korea was honoring the deal - when the Clinton team ran out of time .


fn_spacy_tokens_for_baseline: Add to that whatever can be salvaged of the 18 state monopoly combines that were based in east Berlin , and you have a concentration of industry without equal in Europe .

source_bert_toks: add to that whatever can be salvage ##d of the 18 state monopoly combines that were based in east berlin , and you have a concentration of industry without equal in europe .

reference_raw: Add what can be saved from the 18 state monopolies that were based in East Berlin, and you have a concentration of industry that is not the same in Europe.

reference_spacy_tokens: Add what can be saved from the 18 state monopolies that were based in East Berlin , and you have a concentration of industry that is not the same in Europe .


fn_spacy_tokens_for_baseline: The trade surplus with the United States edged down about $ 33 million to $ 7.6 billion .

source_bert_toks: the trade surplus with the united states edged down about $ 33 million to $ 7 . 6 billion .

reference_raw: The US trade surplus dropped from $33 million to $7.6 billion.

reference_spacy_tokens: The US trade surplus dropped from $ 33 million to $ 7.6 billion .


fn_spacy_tokens_for_baseline: The street around the Stones ' house buzzed and crawled with police activity for the next hour .

source_bert_toks: the street around the stones ' house buzzed and crawled with police activity for the next hour .

reference_raw: For the next hour, the street around the Stones' house buzzed and groveled with police activity.

reference_spacy_tokens: For the next hour , the street around the Stones ' house buzzed and groveled with police activity .


fn_spacy_tokens_for_baseline: And the translations are so incredibly liberal , there may as well be no original text at all .

source_bert_toks: and the translations are so incredibly liberal , there may as well be no original text at all .

reference_raw: And the translations are so unbelievably free, it's possible there's no original text.

reference_spacy_tokens: And the translations are so unbelievably free , it 's possible there 's no original text .


fn_spacy_tokens_for_baseline: They encapsulate the democratically arrived - at beliefs both that it is wrong for animals to suffer in such ways , and also that legislation will lead to an amelioration in the behaviour of farmers and poachers .

source_bert_toks: they en ##cap ##sul ##ate the democratic ##ally arrived - at beliefs both that it is wrong for animals to suffer in such ways , and also that legislation will lead to an am ##eli ##oration in the behaviour of farmers and po ##ache ##rs .

reference_raw: They encapsulate democratically arrived - they believe that it is not right for animals to suffer in this way, but also that legislation will lead to an amelioration of the behaviour of farmers and poachers.

reference_spacy_tokens: They encapsulate democratically arrived - they believe that it is not right for animals to suffer in this way , but also that legislation will lead to an amelioration of the behaviour of farmers and poachers .


fn_spacy_tokens_for_baseline: Several islands and Greek city - states agreed to work together , and created a treasury to fund their plans , which was held on the island of Delos .

source_bert_toks: several islands and greek city - states agreed to work together , and created a treasury to fund their plans , which was held on the island of del ##os .

reference_raw: Several islands and Greek states agreed to cooperate and set up a treasury to finance their plans that were held on the island of Delos.

reference_spacy_tokens: Several islands and Greek states agreed to cooperate and set up a treasury to finance their plans that were held on the island of Delos .


fn_spacy_tokens_for_baseline: From the next railway station , the modern campus of the Chinese University of Hong Kong is visible .

source_bert_toks: from the next railway station , the modern campus of the chinese university of hong kong is visible .

reference_raw: From the next railway station, you can see the modern school of the Hong Kong University of China.

reference_spacy_tokens: From the next railway station , you can see the modern school of the Hong Kong University of China .


fn_spacy_tokens_for_baseline: However , with the city partitioned by fortifications and barbed wire , no Israeli or Jewish pilgrims were allowed to visit the Western Wall or other Jewish sites in East Jerusalem .

source_bert_toks: however , with the city partition ##ed by fortifications and barbed wire , no israeli or jewish pilgrims were allowed to visit the western wall or other jewish sites in east jerusalem .

reference_raw: But since the city was divided by fortresses and barbed wire, no Israeli or Jewish travellers were allowed to visit the West Wall or other Jewish sites in East Jerusalem.

reference_spacy_tokens: But since the city was divided by fortresses and barbed wire , no Israeli or Jewish travellers were allowed to visit the West Wall or other Jewish sites in East Jerusalem .


fn_spacy_tokens_for_baseline: In a sort of dream I remember being half - led , halfcarried to the carriage ; in the same state I was conveyed to the train .

source_bert_toks: in a sort of dream i remember being half - led , half ##car ##ried to the carriage ; in the same state i was conveyed to the train .

reference_raw: I recall in a dream that I was half led, half carried to a carriage; in the same condition I was taken to a train.

reference_spacy_tokens: I recall in a dream that I was half led , half carried to a carriage ; in the same condition I was taken to a train .


fn_spacy_tokens_for_baseline: My contractions started at midnight -- not very considerate bearing in mind how much I need my sleep .

source_bert_toks: my contraction ##s started at midnight - - not very consider ##ate bearing in mind how much i need my sleep .

reference_raw: I started contracting at midnight -- not very thoughtful, considering how much I needed to sleep.

reference_spacy_tokens: I started contracting at midnight -- not very thoughtful , considering how much I needed to sleep .


fn_spacy_tokens_for_baseline: Many of the inhabitants live - by choice , not necessarily through economic hardship - on the water , aboard houseboats or in houses on stilts in the main creek .

source_bert_toks: many of the inhabitants live - by choice , not necessarily through economic hardship - on the water , aboard house ##boats or in houses on stil ##ts in the main creek .

reference_raw: Many people live - of their own free will, not necessarily because of economic difficulties - on the water, on board houseboats or in houses on stilts in the main stream.

reference_spacy_tokens: Many people live - of their own free will , not necessarily because of economic difficulties - on the water , on board houseboats or in houses on stilts in the main stream .


fn_spacy_tokens_for_baseline: All ICBMs were transferred to Russia for dismantlement by September 1996 and missile silos and silo structures were destroyed under the U.S. Department of Defense Cooperative Threat Reduction ( CTR ) program by September 1999 .

source_bert_toks: all ic ##bm ##s were transferred to russia for di ##sman ##tlement by september 1996 and missile si ##los and si ##lo structures were destroyed under the u . s . department of defense cooperative threat reduction ( ct ##r ) program by september 1999 .

reference_raw: In September 1996, all ICBMs were transferred to Russia to be dismantled, and by September 1999 the missile silos and silos were destroyed in the framework of the United States Department of Defense Cooperative Threat Reduction (CTR).

reference_spacy_tokens: In September 1996 , all ICBMs were transferred to Russia to be dismantled , and by September 1999 the missile silos and silos were destroyed in the framework of the United States Department of Defense Cooperative Threat Reduction ( CTR ) .


fn_spacy_tokens_for_baseline: New York is in the process of trying to disengage itself from a 20-year - old commitment to this system of school governance , even as Chicago and other cities are moving to institute it .

source_bert_toks: new york is in the process of trying to di ##sen ##ga ##ge itself from a 20 - year - old commitment to this system of school governance , even as chicago and other cities are moving to institute it .

reference_raw: New York is trying to get away from a 20-year-old commitment to this school system, even though Chicago and other cities are moving towards it.

reference_spacy_tokens: New York is trying to get away from a 20-year - old commitment to this school system , even though Chicago and other cities are moving towards it .


fn_spacy_tokens_for_baseline: A Humboldt veteran 's tie to the new Hawaiian Islands monument : The nation 's newest national monument , a chain of islands that sweeps northwest from Hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

source_bert_toks: a humboldt veteran ' s tie to the new hawaiian islands monument : the nation ' s newest national monument , a chain of islands that sweeps northwest from hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

reference_raw: The Humboldt veteran's tie to the new Hawaiian island monument: the nation's most recent national monument, the chain of islands sweeping northwest of Hawaii, has a darker past than its azurous waters, and low-slung white sand beaches will reveal.

reference_spacy_tokens: The Humboldt veteran 's tie to the new Hawaiian island monument : the nation 's most recent national monument , the chain of islands sweeping northwest of Hawaii , has a darker past than its azurous waters , and low - slung white sand beaches will reveal .


fn_spacy_tokens_for_baseline: These unfortunate circumstances threatened to relegate Las Vegas to the status of a small desert community that could no longer support its 3000 residents .

source_bert_toks: these unfortunate circumstances threatened to re ##leg ##ate las vegas to the status of a small desert community that could no longer support its 3000 residents .

reference_raw: These unhappy circumstances threatened to give Las Vegas the status of a small desert community that could no longer support its 3,000 inhabitants.

reference_spacy_tokens: These unhappy circumstances threatened to give Las Vegas the status of a small desert community that could no longer support its 3,000 inhabitants .


fn_spacy_tokens_for_baseline: Winston turned a switch and the voice sank somewhat , though the words were still distinguishable .

source_bert_toks: winston turned a switch and the voice sank somewhat , though the words were still distinguish ##able .

reference_raw: Winston turned the switch, and his voice dropped a little, though the words were still indistinguishable.

reference_spacy_tokens: Winston turned the switch , and his voice dropped a little , though the words were still indistinguishable .


fn_spacy_tokens_for_baseline: Federal prisoners can once again purchase Playboy and Penthouse . A federal judge ruled that a ban on the publications violated the First Amendment rights of both inmates and publishers .

source_bert_toks: federal prisoners can once again purchase playboy and penthouse . a federal judge ruled that a ban on the publications violated the first amendment rights of both inmates and publishers .

reference_raw: Federal prisoners can buy Playboy and Penthouse again. The federal judge has decided that banning publications violates the First Amendment rights of both prisoners and publishers.

reference_spacy_tokens: Federal prisoners can buy Playboy and Penthouse again . The federal judge has decided that banning publications violates the First Amendment rights of both prisoners and publishers .


fn_spacy_tokens_for_baseline: If you are booked in to Black Sail Hut Youth Hostel and the weather puts you off completing the main route , you can make a circuit around Crummock Water before crossing Scarth Gap .

source_bert_toks: if you are booked in to black sail hut youth hostel and the weather puts you off completing the main route , you can make a circuit around cr ##um ##mo ##ck water before crossing scar ##th gap .

reference_raw: If you're booked at the Black Sail Hut Youth Hostel and the weather prevents you from completing the main route, you can circle the Crummock Water before you cross the Scarth Gape.

reference_spacy_tokens: If you 're booked at the Black Sail Hut Youth Hostel and the weather prevents you from completing the main route , you can circle the Crummock Water before you cross the Scarth Gape .


fn_spacy_tokens_for_baseline: The moustached man points to the word processor .

source_bert_toks: the mo ##ust ##ache ##d man points to the word processor .

reference_raw: The mustached man points to the word processor.

reference_spacy_tokens: The mustached man points to the word processor .


fn_spacy_tokens_for_baseline: The secrecy that surrounded Emor had been a large part of its charm .

source_bert_toks: the secrecy that surrounded em ##or had been a large part of its charm .

reference_raw: The secret that encircled Emor was a great part of his charm.

reference_spacy_tokens: The secret that encircled Emor was a great part of his charm .


fn_spacy_tokens_for_baseline: Returning thoughtfully to his own back bedroom , he tuned one of his receivers to the frequency he had read off the antenna and hooked it up to a tape machine .

source_bert_toks: returning thoughtfully to his own back bedroom , he tuned one of his receivers to the frequency he had read off the antenna and hooked it up to a tape machine .

reference_raw: He returned thoughtfully to his own back room, tuned one of the receivers to the frequency he had read off the antenna, and connected it to the tape machine.

reference_spacy_tokens: He returned thoughtfully to his own back room , tuned one of the receivers to the frequency he had read off the antenna , and connected it to the tape machine .


fn_spacy_tokens_for_baseline: I must admit , however , that I was somewhat surprised when , some five days after the crime , I opened my morning paper to find in large letters :

source_bert_toks: i must admit , however , that i was somewhat surprised when , some five days after the crime , i opened my morning paper to find in large letters :

reference_raw: But I must admit that I was somewhat startled when, about five days after the crime, I opened the morning paper and found in large letters:

reference_spacy_tokens: But I must admit that I was somewhat startled when , about five days after the crime , I opened the morning paper and found in large letters :


fn_spacy_tokens_for_baseline: As we know , voters tend to favor Republicans more in races for president than in those for Congress .

source_bert_toks: as we know , voters tend to favor republicans more in races for president than in those for congress .

reference_raw: As we know, voters tend to favour Republicans more in presidential races than Congress.

reference_spacy_tokens: As we know , voters tend to favour Republicans more in presidential races than Congress .


fn_spacy_tokens_for_baseline: You can not yoke the dragonfly and make it drive the corn - mill .

source_bert_toks: you can not yo ##ke the dragon ##fly and make it drive the corn - mill .

reference_raw: You can't wake a dragonfly and force it to drive a corn mill.

reference_spacy_tokens: You ca n't wake a dragonfly and force it to drive a corn mill .


fn_spacy_tokens_for_baseline: We ran into the house to get Mame , but the next tremor threw me in the air and bounced me as I tried to get to my feet .

source_bert_toks: we ran into the house to get ma ##me , but the next tremor threw me in the air and bounced me as i tried to get to my feet .

reference_raw: We ran into the house to pick up my mom, but another shock blew me up and bounced me as I tried to stand up.

reference_spacy_tokens: We ran into the house to pick up my mom , but another shock blew me up and bounced me as I tried to stand up .


fn_spacy_tokens_for_baseline: If science finds a way to safely free the subjects of Emil 's art , perhaps the I who reads this file will know that my decision is wise .

source_bert_toks: if science finds a way to safely free the subjects of emil ' s art , perhaps the i who reads this file will know that my decision is wise .

reference_raw: If science can figure out a way to safely free the subjects of Emil's art, then perhaps the one who reads this file will know that my decision is wise.

reference_spacy_tokens: If science can figure out a way to safely free the subjects of Emil 's art , then perhaps the one who reads this file will know that my decision is wise .


fn_spacy_tokens_for_baseline: Every August young women convene to light joss sticks and some even climb the nine - meter ( 30 - ft ) rock to pray for good husbands .

source_bert_toks: every august young women con ##ven ##e to light jo ##ss sticks and some even climb the nine - meter ( 30 - ft ) rock to pray for good husbands .

reference_raw: Every August, young women gather to light joss sticks, and some even climb the nine-foot-30-ft-rock to pray for a good husband.

reference_spacy_tokens: Every August , young women gather to light joss sticks , and some even climb the nine - foot-30-ft - rock to pray for a good husband .


fn_spacy_tokens_for_baseline: In theory this sounds quite unrealistic but the worker is reassured that none of these topics need be committed to memory .

source_bert_toks: in theory this sounds quite un ##real ##istic but the worker is reassured that none of these topics need be committed to memory .

reference_raw: Theoretically, this sounds rather unrealistic, but the worker is assured that none of these topics need to be memorized.

reference_spacy_tokens: Theoretically , this sounds rather unrealistic , but the worker is assured that none of these topics need to be memorized .


fn_spacy_tokens_for_baseline: The lack of epidemiological information about endometriosis is lamentable and can be improved only by studies in which an accurate visual diagnosis is made .

source_bert_toks: the lack of ep ##ide ##mi ##ological information about end ##ome ##tri ##osis is lame ##nta ##ble and can be improved only by studies in which an accurate visual diagnosis is made .

reference_raw: The lack of epidemiological information on endometriosis is regrettable and can only be improved by studies where accurate visual diagnosis is made.

reference_spacy_tokens: The lack of epidemiological information on endometriosis is regrettable and can only be improved by studies where accurate visual diagnosis is made .


fn_spacy_tokens_for_baseline: " Awards like this reflect the safe work the employees do each and every day as they protect themselves , the environment and the community .

source_bert_toks: " awards like this reflect the safe work the employees do each and every day as they protect themselves , the environment and the community .

reference_raw: "Awards like this reflect the safe work that workers do every day to protect themselves, the environment and the community."

reference_spacy_tokens: " Awards like this reflect the safe work that workers do every day to protect themselves , the environment and the community . "


fn_spacy_tokens_for_baseline: Andrew Roberts points to this as further evidence of the impressive capabilities of DML .

source_bert_toks: andrew roberts points to this as further evidence of the impressive capabilities of d ##ml .

reference_raw: Andrew Roberts refers to this as further evidence of DML's impressive abilities.

reference_spacy_tokens: Andrew Roberts refers to this as further evidence of DML 's impressive abilities .


fn_spacy_tokens_for_baseline: The Macabbees cleansed the Temple of Hellenistic idols and the blood of pagan sacrifices ; the eight - day celebration of Hanukkah ( Feast of Dedication ) commemorates their victory .

source_bert_toks: the mac ##ab ##bee ##s clean ##sed the temple of hellenistic idols and the blood of pagan sacrifices ; the eight - day celebration of han ##uk ##ka ##h ( feast of dedication ) commemorates their victory .

reference_raw: The Macabbees purged the Temple of Hellenist idols and the blood of pagan sacrifices; the eight-day celebration of Hanukkah (Feast of Dedication) commemorates their victory.

reference_spacy_tokens: The Macabbees purged the Temple of Hellenist idols and the blood of pagan sacrifices ; the eight - day celebration of Hanukkah ( Feast of Dedication ) commemorates their victory .


fn_spacy_tokens_for_baseline: It was scheduled to overnight in Croatian Serb - held territory and reach the Bihac pocket on Saturday .

source_bert_toks: it was scheduled to overnight in croatian serb - held territory and reach the bi ##ha ##c pocket on saturday .

reference_raw: The plan was to spend the night in Croatian Serbian territory and reach the Bihac pocket on Saturday.

reference_spacy_tokens: The plan was to spend the night in Croatian Serbian territory and reach the Bihac pocket on Saturday .


fn_spacy_tokens_for_baseline: This is where modern designs like the Thermatex really comes into their own , because they wick the moisture through and keep the horse warm while he 's drying .

source_bert_toks: this is where modern designs like the the ##rma ##te ##x really comes into their own , because they wi ##ck the moisture through and keep the horse warm while he ' s drying .

reference_raw: This is where modern designs, such as the Thermatex, actually come into their own, because they wick the moisture through and keep the horse warm while it's desiccating.

reference_spacy_tokens: This is where modern designs , such as the Thermatex , actually come into their own , because they wick the moisture through and keep the horse warm while it 's desiccating .


fn_spacy_tokens_for_baseline: Jets from the government 's air force counterattacked , bombing the rebel stronghold at the ancient Bala Hissar fort south of Kabul .

source_bert_toks: jets from the government ' s air force counterattack ##ed , bombing the rebel stronghold at the ancient bala hiss ##ar fort south of kabul .

reference_raw: The jets from the government's air force attacked and bombed the rebel fortress at the ancient Bala Hissar fortress south of Kabul.

reference_spacy_tokens: The jets from the government 's air force attacked and bombed the rebel fortress at the ancient Bala Hissar fortress south of Kabul .


fn_spacy_tokens_for_baseline: Wynn 's demolition of the existing properties started a trend that , more than any other , describes Las Vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

source_bert_toks: wynn ' s demolition of the existing properties started a trend that , more than any other , describes las vegas at the end of the 20th century : removal of old properties in exchange for the potential of new ones .

reference_raw: Wynn's demolition of existing property has begun a trend which, more than anything else, describes Las Vegas in the late 20th century: the removal of old property in exchange for the potential of new ones.

reference_spacy_tokens: Wynn 's demolition of existing property has begun a trend which , more than anything else , describes Las Vegas in the late 20th century : the removal of old property in exchange for the potential of new ones .


fn_spacy_tokens_for_baseline: Others said that Horsley saw in Hayling the image of what he had always wanted to be -- idealistic , full of derring - do , glamorous , and free from the tedious baggage of conventional business life .

source_bert_toks: others said that ho ##rs ##ley saw in hay ##ling the image of what he had always wanted to be - - ideal ##istic , full of der ##ring - do , g ##lam ##orous , and free from the ted ##ious baggage of conventional business life .

reference_raw: Others said that Horsley had seen in Hayling a picture of what he'd always wanted to be - idealistic, full of derring-do, charming, and free from the boring burdens of conventional business life.

reference_spacy_tokens: Others said that Horsley had seen in Hayling a picture of what he 'd always wanted to be - idealistic , full of derring - do , charming , and free from the boring burdens of conventional business life .


fn_spacy_tokens_for_baseline: Suspects are being held at various police stations in the Home Counties including Milton Keynes .

source_bert_toks: suspects are being held at various police stations in the home counties including milton keynes .

reference_raw: Suspects are being detained at different police stations in the home counties, including Milton Keynes.

reference_spacy_tokens: Suspects are being detained at different police stations in the home counties , including Milton Keynes .


fn_spacy_tokens_for_baseline: Jenny was still clinging desperately to the notion of everyday duties , but here was the mistress carrying on in a way that went straight past the mundane .

source_bert_toks: jenny was still clinging desperately to the notion of everyday duties , but here was the mistress carrying on in a way that went straight past the mundane .

reference_raw: Jenny was still desperately clinging to the idea of day-to-day duties, but there was the lady, who continued in a way that went right past the commonplace.

reference_spacy_tokens: Jenny was still desperately clinging to the idea of day - to - day duties , but there was the lady , who continued in a way that went right past the commonplace .


fn_spacy_tokens_for_baseline: The Labour Council , elected in 1982 , had as a stated policy aim that every child whose parents so wished was entitled to a pre - school place of some sort .

source_bert_toks: the labour council , elected in 1982 , had as a stated policy aim that every child whose parents so wished was entitled to a pre - school place of some sort .

reference_raw: The Labour Council, which was appointed in 1982, had the stated political objective that any child whose parents so wished would be entitled to a kindergarten place.

reference_spacy_tokens: The Labour Council , which was appointed in 1982 , had the stated political objective that any child whose parents so wished would be entitled to a kindergarten place .


fn_spacy_tokens_for_baseline: After that heartening victory it was back to league games and a very poor run of results .

source_bert_toks: after that heart ##ening victory it was back to league games and a very poor run of results .

reference_raw: After this heartbreaking victory, he went back to the league games and a very bad run of results.

reference_spacy_tokens: After this heartbreaking victory , he went back to the league games and a very bad run of results .


fn_spacy_tokens_for_baseline: A brief exchange between the barristers followed .

source_bert_toks: a brief exchange between the barrister ##s followed .

reference_raw: There was a short conversation between the lawyers.

reference_spacy_tokens: There was a short conversation between the lawyers .


fn_spacy_tokens_for_baseline: Simone tagged along in his life , sometimes rooming with him .

source_bert_toks: simone tagged along in his life , sometimes room ##ing with him .

reference_raw: Simone had tagged along in his life, and sometimes he'd hang out with him.

reference_spacy_tokens: Simone had tagged along in his life , and sometimes he 'd hang out with him .


fn_spacy_tokens_for_baseline: During the final five minutes of this sequence a period of intense activity was obvious and coincided with the emptying of water from the stomach and duodenal bulb .

source_bert_toks: during the final five minutes of this sequence a period of intense activity was obvious and coincided with the empty ##ing of water from the stomach and duo ##den ##al bulb .

reference_raw: During the last five minutes of this sequence, a period of intense activity was evident and coincided with the discharge of water from the stomach and duodenal bulb.

reference_spacy_tokens: During the last five minutes of this sequence , a period of intense activity was evident and coincided with the discharge of water from the stomach and duodenal bulb .