fn_spacy_tokens_for_baseline: Busy backyard workshops fabricate wood , metal , glass fibre and stone , while tailor and cobbler make clothes and shoes to order .

source_bert_toks: busy backyard workshops fabric ##ate wood , metal , glass fibre and stone , while tailor and cobb ##ler make clothes and shoes to order .

reference_raw: Busy garden workshops make wood, metal, glass fibres and stone, while tailors and cobblers make clothing and shoes to order.

reference_spacy_tokens: Busy garden workshops make wood , metal , glass fibres and stone , while tailors and cobblers make clothing and shoes to order .


fn_spacy_tokens_for_baseline: For the purposes of this tutorial , however , the term " terrorism " will be used to describe acts that incorporate the following elements : Intentional or threatened violence directed against civilians or noncombatants ; Actors that are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; Motivations that are chiefly political , ideological , or religious ( i.e. , not strictly criminal ) ; Often , some element of symbolism in the choice of target , together with the desire to elicit fear in a larger audience beyond the immediate victims of an attack .

source_bert_toks: for the purposes of this tutor ##ial , however , the term " terrorism " will be used to describe acts that incorporate the following elements : intentional or threatened violence directed against civilians or non ##comb ##ata ##nts ; actors that are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; motivation ##s that are chiefly political , ideological , or religious ( i . e . , not strictly criminal ) ; often , some element of symbolism in the choice of target , together with the desire to eli ##cit fear in a larger audience beyond the immediate victims of an attack .

reference_raw: However, for the purposes of this tutorial, the term "terrorism" shall be used to describe acts containing the following elements: intentional or threatened violence against civilians or non-combatants; activities which are sub-national groups or individuals (although they may receive financial or logistical support from governments); motivations which are mainly political, ideological or religious (i.e. not strictly criminal); some element of symbolism in the choice of destination, along with the desire to provoke fear in a larger audience beyond the immediate victims of the attack.

reference_spacy_tokens: However , for the purposes of this tutorial , the term " terrorism " shall be used to describe acts containing the following elements : intentional or threatened violence against civilians or non - combatants ; activities which are sub - national groups or individuals ( although they may receive financial or logistical support from governments ) ; motivations which are mainly political , ideological or religious ( i.e. not strictly criminal ) ; some element of symbolism in the choice of destination , along with the desire to provoke fear in a larger audience beyond the immediate victims of the attack .


fn_spacy_tokens_for_baseline: All pleaded guilty to this crime and took oath to perform whatever penance the Bishop should impose .

source_bert_toks: all pleaded guilty to this crime and took oath to perform whatever pena ##nce the bishop should impose .

reference_raw: They've all confessed to this crime, and they've sworn to carry out any penance the Bishop should impose.

reference_spacy_tokens: They 've all confessed to this crime , and they 've sworn to carry out any penance the Bishop should impose .


fn_spacy_tokens_for_baseline: Although the authors in this book agree that the situation is iniquitous , they differ in their views of the solution .

source_bert_toks: although the authors in this book agree that the situation is in ##iq ##uit ##ous , they differ in their views of the solution .

reference_raw: Although the authors of this book agree that the situation is unfair, their views on the solution differ.

reference_spacy_tokens: Although the authors of this book agree that the situation is unfair , their views on the solution differ .


fn_spacy_tokens_for_baseline: North Korea first became embroiled with nuclear politics during the Korean War .

source_bert_toks: north korea first became em ##bro ##iled with nuclear politics during the korean war .

reference_raw: During the Korean War, North Korea first became involved in nuclear policy.

reference_spacy_tokens: During the Korean War , North Korea first became involved in nuclear policy .


fn_spacy_tokens_for_baseline: It is hard to imagine it arising by any step - by - step process unless some earlier scaffolding has completely disappeared .

source_bert_toks: it is hard to imagine it arising by any step - by - step process unless some earlier sc ##af ##folding has completely disappeared .

reference_raw: It is difficult to imagine that it would come from a step-by-step process, unless some of the earlier scaffolding had completely vanished.

reference_spacy_tokens: It is difficult to imagine that it would come from a step - by - step process , unless some of the earlier scaffolding had completely vanished .


fn_spacy_tokens_for_baseline: To avoid climbing in the heat of noon we decided to leave at daybreak .

source_bert_toks: to avoid climbing in the heat of noon we decided to leave at day ##break .

reference_raw: In order to avoid climbing in the heat of noon, we decided to leave at dawn.

reference_spacy_tokens: In order to avoid climbing in the heat of noon , we decided to leave at dawn .


fn_spacy_tokens_for_baseline: The dragon continued through the spinney , incinerating every likely - looking bush and clump of ferns .

source_bert_toks: the dragon continued through the spin ##ney , inc ##iner ##ating every likely - looking bush and cl ##ump of ferns .

reference_raw: The dragon continued through the spine, burning every likely-looking bush and cluster of ferns.

reference_spacy_tokens: The dragon continued through the spine , burning every likely - looking bush and cluster of ferns .


fn_spacy_tokens_for_baseline: The above groups pose the following dangers : 1- Attacking for the purpose of : A : Assassination B : Kidnapping C : Aerial raids and artillery attacks 2- Sabotage A : Setting fires B : Explosions C : Technical sabotage D : Chemical sabotage 3- Spying A : Recruiting a member of society B : Planting a mole within society C : Spying surveillance operation 4- Stealing 5- Pests : A : Poisonous such as snakes and scorpions B : Harmful such as rats and cockroaches C : Sickening such as mosquitoes

source_bert_toks: the above groups pose the following dangers : 1 - attacking for the purpose of : a : assassination b : kidnapping c : aerial raids and artillery attacks 2 - sabotage a : setting fires b : explosions c : technical sabotage d : chemical sabotage 3 - spying a : recruiting a member of society b : planting a mole within society c : spying surveillance operation 4 - stealing 5 - pest ##s : a : poisonous such as snakes and scorpion ##s b : harmful such as rats and cock ##ro ##ache ##s c : sick ##ening such as mosquito ##es

reference_raw: A: Assassination B: Abduction C: Aerial raids and artillery attacks 2-Sabotage A: Firefighting B: Explosion C: Technical sabotage D: Chemical sabotage 3-Spying A: Recruitment of a member of society B: Planting of a spy in society C: Spying surveillance operation 4- Altering 5-Pests: A: Poisoning like snakes and scorpions B: Harmful like rats and cockroaches C: Sickening like mosquitoes

reference_spacy_tokens: A : Assassination B : Abduction C : Aerial raids and artillery attacks 2-Sabotage A : Firefighting B : Explosion C : Technical sabotage D : Chemical sabotage 3-Spying A : Recruitment of a member of society B : Planting of a spy in society C : Spying surveillance operation 4- Altering 5-Pests : A : Poisoning like snakes and scorpions B : Harmful like rats and cockroaches C : Sickening like mosquitoes


fn_spacy_tokens_for_baseline: In Washington , President Carter was delighted that the Shah 's arrival in the states would be further delayed .

source_bert_toks: in washington , president carter was delighted that the shah ' s arrival in the states would be further delayed .

reference_raw: In Washington, President Carter was pleased to see that the Shah's coming to the U.S. would be further delayed.

reference_spacy_tokens: In Washington , President Carter was pleased to see that the Shah 's coming to the U.S. would be further delayed .


fn_spacy_tokens_for_baseline: But she had bungled every single attempt to help .

source_bert_toks: but she had bun ##gled every single attempt to help .

reference_raw: But every time she tried to help, she messed up.

reference_spacy_tokens: But every time she tried to help , she messed up .


fn_spacy_tokens_for_baseline: Beneath the church , the Museum of Sacred Art houses a collection of sacramental objects .

source_bert_toks: beneath the church , the museum of sacred art houses a collection of sacrament ##al objects .

reference_raw: There's a collection of sacred objects under the church.

reference_spacy_tokens: There 's a collection of sacred objects under the church .


fn_spacy_tokens_for_baseline: These tensions stemmed , Castells argued , from the fact that as states intervened , these items of collective consumption become highly politicised .

source_bert_toks: these tensions stemmed , caste ##lls argued , from the fact that as states intervened , these items of collective consumption become highly pol ##itic ##ised .

reference_raw: These tensions arose, Castells argued, from the fact that, as countries intervened, these items of common consumption became highly political.

reference_spacy_tokens: These tensions arose , Castells argued , from the fact that , as countries intervened , these items of common consumption became highly political .


fn_spacy_tokens_for_baseline: When finely ground coal dust is injected into the mixture it burns more quickly and with less pollution .

source_bert_toks: when finely ground coal dust is injected into the mixture it burns more quickly and with less pollution .

reference_raw: When a finely soiled coal powder is injected into the mixture, it burns faster and less polluting.

reference_spacy_tokens: When a finely soiled coal powder is injected into the mixture , it burns faster and less polluting .


fn_spacy_tokens_for_baseline: Coming down to brass tacks , the pallet they were concerned with was immediately in front of them , and was one of the large cardboard boxes .

source_bert_toks: coming down to brass tack ##s , the pal ##let they were concerned with was immediately in front of them , and was one of the large cardboard boxes .

reference_raw: They went down to the brass boards, and the pallet they were worried about was in front of them, and it was one of the big cardboard boxes.

reference_spacy_tokens: They went down to the brass boards , and the pallet they were worried about was in front of them , and it was one of the big cardboard boxes .


fn_spacy_tokens_for_baseline: Oh , crumbs ! she thought as , quickly rinsing a smear of olive oil from her hands , she heard the bell ring again .

source_bert_toks: oh , cr ##umb ##s ! she thought as , quickly ri ##ns ##ing a sm ##ear of olive oil from her hands , she heard the bell ring again .

reference_raw: Oh, crumbs! she thought as she quickly washed the olive oil from her hands and heard the bell ring again.

reference_spacy_tokens: Oh , crumbs ! she thought as she quickly washed the olive oil from her hands and heard the bell ring again .


fn_spacy_tokens_for_baseline: It has been revealed that Abdul Qadeer Khan of Pakistan is responsible for providing Libya with its nuclear warhead plans , raw uranium and enrichment centrifuges through his black market network .

source_bert_toks: it has been revealed that abdul q ##ade ##er khan of pakistan is responsible for providing libya with its nuclear war ##head plans , raw uranium and enrichment cent ##ri ##fu ##ges through his black market network .

reference_raw: It has been established that Abdul Qadeer Khan from Pakistan is responsible for providing Libya with plans for nuclear warheads, raw uranium and enrichment centrifuges through its black market network.

reference_spacy_tokens: It has been established that Abdul Qadeer Khan from Pakistan is responsible for providing Libya with plans for nuclear warheads , raw uranium and enrichment centrifuges through its black market network .


fn_spacy_tokens_for_baseline: ' I 'm dog - tired after that trek this afternoon , ' he announced with a brief compassionate glance at Sarella .

source_bert_toks: ' i ' m dog - tired after that trek this afternoon , ' he announced with a brief compassionate glance at sar ##ella .

reference_raw: 'I'm tired of a dog this afternoon,' he said, giving Sarella a quick, sympathetic look.

reference_spacy_tokens: ' I 'm tired of a dog this afternoon , ' he said , giving Sarella a quick , sympathetic look .


fn_spacy_tokens_for_baseline: We have a real fire blazing in the hearth and the kettle 's always on . "

source_bert_toks: we have a real fire blazing in the hearth and the kettle ' s always on . "

reference_raw: There's a real fire burning in the fireplace, and the kettle is still on."

reference_spacy_tokens: There 's a real fire burning in the fireplace , and the kettle is still on . "


fn_spacy_tokens_for_baseline: A tankful of petrol would n't come amiss .

source_bert_toks: a tank ##ful of petrol wouldn ' t come ami ##ss .

reference_raw: A tank full of gasoline wouldn't go wrong.

reference_spacy_tokens: A tank full of gasoline would n't go wrong .


fn_spacy_tokens_for_baseline: Major - General ( Sir ) Thomas Picton [ q.v . ] wrote on 25 January that he was ' a most gallant , intelligent officer and estimable man . '

source_bert_toks: major - general ( sir ) thomas pic ##ton [ q . v . ] wrote on 25 january that he was ' a most gallant , intelligent officer and est ##ima ##ble man . '

reference_raw: On January 25, Major General Thomas Picton wrote that he was "a very brave, intelligent officer and an estimate man."

reference_spacy_tokens: On January 25 , Major General Thomas Picton wrote that he was " a very brave , intelligent officer and an estimate man . "


fn_spacy_tokens_for_baseline: Kirov only gripped his arm even more tightly .

source_bert_toks: ki ##rov only gripped his arm even more tightly .

reference_raw: Kirov squeezed his arm even tighter.

reference_spacy_tokens: Kirov squeezed his arm even tighter .


fn_spacy_tokens_for_baseline: Your Georgia O'Keeffe membership , please note , includes free admission to all art - related activities of the IMA 's Young Friends of Art group .

source_bert_toks: your georgia o ' ke ##ef ##fe membership , please note , includes free admission to all art - related activities of the im ##a ' s young friends of art group .

reference_raw: Your membership in Georgia O'Keeffe, please note, includes free access to all artistic activities of the IMA's Young Friends of Arms Group.

reference_spacy_tokens: Your membership in Georgia O'Keeffe , please note , includes free access to all artistic activities of the IMA 's Young Friends of Arms Group .


fn_spacy_tokens_for_baseline: Fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

source_bert_toks: fortunately , these same parents do want their children to get a decent education as traditionally understood , and they have enough common sense to know what that demands .

reference_raw: Fortunately, the same parents want their children to have a decent education, as traditionally understood, and they have enough common sense to know what it requires.

reference_spacy_tokens: Fortunately , the same parents want their children to have a decent education , as traditionally understood , and they have enough common sense to know what it requires .


fn_spacy_tokens_for_baseline: ' I do n't want to walk , ' he wailed .

source_bert_toks: ' i don ' t want to walk , ' he wai ##led .

reference_raw: 'I won't go,' he moaned.

reference_spacy_tokens: ' I wo n't go , ' he moaned .


fn_spacy_tokens_for_baseline: Such a mixture we now know as potpourri , from the French pourrir , to rot , not a very accurate name , since the ingredients are preserved rather than allowed to decay .

source_bert_toks: such a mixture we now know as pot ##pour ##ri , from the french pour ##ri ##r , to rot , not a very accurate name , since the ingredients are preserved rather than allowed to decay .

reference_raw: The mixture we now know as potpourri, from the French pourri to rot, is not a very precise name, because the ingredients are kept instead of allowed to rot.

reference_spacy_tokens: The mixture we now know as potpourri , from the French pourri to rot , is not a very precise name , because the ingredients are kept instead of allowed to rot .


fn_spacy_tokens_for_baseline: A fortnight after she had made this earth - shattering discovery she was amazed when he stuttered out an invitation to the cinema .

source_bert_toks: a fort ##night after she had made this earth - shattering discovery she was amazed when he stu ##ttered out an invitation to the cinema .

reference_raw: Two weeks after she had made this earthly discovery, she was surprised when he stuttered an invitation to the cinema.

reference_spacy_tokens: Two weeks after she had made this earthly discovery , she was surprised when he stuttered an invitation to the cinema .


fn_spacy_tokens_for_baseline: It was beginning to look ominous for the Light Blues , as the final bend favoured Oxford .

source_bert_toks: it was beginning to look ominous for the light blues , as the final bend favoured oxford .

reference_raw: The light blues were beginning to look sinister when the last bend favored Oxford.

reference_spacy_tokens: The light blues were beginning to look sinister when the last bend favored Oxford .


fn_spacy_tokens_for_baseline: The hooter recommenced its strident blasts .

source_bert_toks: the ho ##ote ##r rec ##om ##men ##ced its stride ##nt blasts .

reference_raw: The hooter fired again.

reference_spacy_tokens: The hooter fired again .


fn_spacy_tokens_for_baseline: Great rivalry between the boats sometimes led to angry words , or even sea battles , and when smoke over Downderry signalled a shoal along the coast , an exciting race would ensue .

source_bert_toks: great rivalry between the boats sometimes led to angry words , or even sea battles , and when smoke over down ##der ##ry signal ##led a sho ##al along the coast , an exciting race would en ##su ##e .

reference_raw: The great rivalry between the boats sometimes led to angry words, or even sea battles, and when the smoke above Downderry signaled the shore, an exciting race would follow.

reference_spacy_tokens: The great rivalry between the boats sometimes led to angry words , or even sea battles , and when the smoke above Downderry signaled the shore , an exciting race would follow .


fn_spacy_tokens_for_baseline: ' How can I possibly frustrate you ?

source_bert_toks: ' how can i possibly fr ##ust ##rate you ?

reference_raw: 'How can I disappoint you?

reference_spacy_tokens: ' How can I disappoint you ?


fn_spacy_tokens_for_baseline: A huddle of passengers gathered round the steps of the carriage to get a look at the reading and , lest their breathing distort the figure , Nadia held it aloft like a fish between finger and thumb .

source_bert_toks: a hu ##ddle of passengers gathered round the steps of the carriage to get a look at the reading and , lest their breathing di ##stor ##t the figure , nadia held it al ##oft like a fish between finger and thumb .

reference_raw: A crowd of passengers gathered around the steps of the carriage to see the reading, and Nadia held it up like a fish between her finger and thumb to keep her breath from distorting the figure.

reference_spacy_tokens: A crowd of passengers gathered around the steps of the carriage to see the reading , and Nadia held it up like a fish between her finger and thumb to keep her breath from distorting the figure .


fn_spacy_tokens_for_baseline: Of these he produced a remarkably large number , in almost all the counties of the region , becoming unrivalled as the leading master builder there and establishing a reputation which extended well beyond it .

source_bert_toks: of these he produced a remarkably large number , in almost all the counties of the region , becoming un ##ri ##val ##led as the leading master builder there and establishing a reputation which extended well beyond it .

reference_raw: Of these, it produced a remarkably large number, in almost all districts of the region, becoming unrivalled as the main builder there and creating a reputation far beyond it.

reference_spacy_tokens: Of these , it produced a remarkably large number , in almost all districts of the region , becoming unrivalled as the main builder there and creating a reputation far beyond it .


fn_spacy_tokens_for_baseline: Blufton respired deeply , his eyes glued first to the superintendent 's face and then Dexter 's .

source_bert_toks: blu ##ft ##on res ##pired deeply , his eyes glued first to the superintendent ' s face and then dexter ' s .

reference_raw: Blufton took a deep breath, eyes glued first to the Inspector's face, then to Dexter's.

reference_spacy_tokens: Blufton took a deep breath , eyes glued first to the Inspector 's face , then to Dexter 's .


fn_spacy_tokens_for_baseline: Taiwan has not been permitted to join the Australia Group .

source_bert_toks: taiwan has not been permitted to join the australia group .

reference_raw: Taiwan was not allowed to become a member of the Australia Group.

reference_spacy_tokens: Taiwan was not allowed to become a member of the Australia Group .


fn_spacy_tokens_for_baseline: Thereafter he lived principally at his manor of Cornwell in Oxfordshire .

source_bert_toks: thereafter he lived principally at his manor of corn ##well in oxfordshire .

reference_raw: Then he lived mainly in his estate in Cornwell, Oxfordshire.

reference_spacy_tokens: Then he lived mainly in his estate in Cornwell , Oxfordshire .


fn_spacy_tokens_for_baseline: Jean wanted to talk to him , to try to convince him to take better care of his wife .

source_bert_toks: jean wanted to talk to him , to try to convince him to take better care of his wife .

reference_raw: Jean wanted to talk to him, persuade him to take better care of his wife.

reference_spacy_tokens: Jean wanted to talk to him , persuade him to take better care of his wife .


fn_spacy_tokens_for_baseline: He intercedes on behalf of the people , and he wins some pardon from God .

source_bert_toks: he inter ##cede ##s on behalf of the people , and he wins some pardon from god .

reference_raw: He intervenes in the name of the people and wins some mercy from God.

reference_spacy_tokens: He intervenes in the name of the people and wins some mercy from God .


fn_spacy_tokens_for_baseline: Construction on Hoover Dam ( originally Boulder Dam , subsequently renamed for the president who authorized the project ) began in 1931 in a canyon 45 miles ( 72 km ) southeast of Las Vegas .

source_bert_toks: construction on hoover dam ( originally boulder dam , subsequently renamed for the president who authorized the project ) began in 1931 in a canyon 45 miles ( 72 km ) southeast of las vegas .

reference_raw: The construction of the Hoover Dam (the original Boulder Dam, which was later re-named by the President who approved the project) began in 1931 in a canyon 45 miles (72 km) southeast of Las Vegas.

reference_spacy_tokens: The construction of the Hoover Dam ( the original Boulder Dam , which was later re - named by the President who approved the project ) began in 1931 in a canyon 45 miles ( 72 km ) southeast of Las Vegas .


fn_spacy_tokens_for_baseline: An example provided by a kachcheri mudaliyar shows that out of a crop which yielded sixty bushels of paddy , a little over eight bushels was paid for cattle hire .

source_bert_toks: an example provided by a ka ##ch ##cher ##i mud ##ali ##yar shows that out of a crop which yielded sixty bush ##els of paddy , a little over eight bush ##els was paid for cattle hire .

reference_raw: The example provided by the kachcheri mudaliyar shows that from the crop that yielded sixty paddy bushes, more than eight bushes were paid for the hiring of cattle.

reference_spacy_tokens: The example provided by the kachcheri mudaliyar shows that from the crop that yielded sixty paddy bushes , more than eight bushes were paid for the hiring of cattle .


fn_spacy_tokens_for_baseline: ' For the moment , the US is not one of the worrisome elements in the group 's activity .

source_bert_toks: ' for the moment , the us is not one of the wo ##rri ##some elements in the group ' s activity .

reference_raw: The US is not yet one of the worrying elements of the group's activities.

reference_spacy_tokens: The US is not yet one of the worrying elements of the group 's activities .


fn_spacy_tokens_for_baseline: Half a universe away there had been another tunic cuff , the gold braid scorched and burned so that its imprint was fused on to the skin of his arm .

source_bert_toks: half a universe away there had been another tunic cuff , the gold braid sc ##or ##ched and burned so that its imprint was fused on to the skin of his arm .

reference_raw: Half a universe away was another tunic cuff, a gold braid burned and burned to the skin of his hand.

reference_spacy_tokens: Half a universe away was another tunic cuff , a gold braid burned and burned to the skin of his hand .


fn_spacy_tokens_for_baseline: From Washington 's perspective , " improved implementation of the Agreed Framework " meant an acceleration of safeguards inspections , even though the agreement did not require Pyongyang to submit to full safeguards inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

source_bert_toks: from washington ' s perspective , " improved implementation of the agreed framework " meant an acceleration of safeguard ##s inspections , even though the agreement did not require p ##yon ##gy ##ang to submit to full safeguard ##s inspections to verify its past activities until a significant portion of the reactor construction was completed but before the delivery of critical reactor components .

reference_raw: From Washington's point of view, "improved implementation of the agreed framework" was an acceleration of security inspections, although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the construction of the reactor was completed but before the delivery of critical reactor components.

reference_spacy_tokens: From Washington 's point of view , " improved implementation of the agreed framework " was an acceleration of security inspections , although the agreement did not require Pyongyang to undergo full security inspections to verify its previous activities until a significant part of the construction of the reactor was completed but before the delivery of critical reactor components .


fn_spacy_tokens_for_baseline: so um it was a little bit because however it was a real warm winter so even even into like November and December i was still wearing the short sleeve dresses course i 'm always hot when i 'm pregnant too so i did n't really need warm clothes

source_bert_toks: so um it was a little bit because however it was a real warm winter so even even into like november and december i was still wearing the short sleeve dresses course i ' m always hot when i ' m pregnant too so i didn ' t really need warm clothes

reference_raw: So, um, it was kind of, because no matter how hot it was, so even in November and December I was still wearing a short-sleeved dress course, I'm always hot when I'm pregnant, so I don't really need a hot dress.

reference_spacy_tokens: So , um , it was kind of , because no matter how hot it was , so even in November and December I was still wearing a short - sleeved dress course , I 'm always hot when I 'm pregnant , so I do n't really need a hot dress .


fn_spacy_tokens_for_baseline: Twenty minutes earlier he had alighted from the Gloucester train at Berkeley station .

source_bert_toks: twenty minutes earlier he had ali ##ght ##ed from the gloucester train at berkeley station .

reference_raw: He left the Gloucester train at Berkeley Station twenty minutes ago.

reference_spacy_tokens: He left the Gloucester train at Berkeley Station twenty minutes ago .


fn_spacy_tokens_for_baseline: He had turned her over then , his hands brutal , and removing his leather belt , had lashed her unmercifully across buttocks and thighs .

source_bert_toks: he had turned her over then , his hands brutal , and removing his leather belt , had lashed her un ##mer ##ciful ##ly across butt ##ocks and thighs .

reference_raw: Then he turned it over, his hands brutal, and took off his leather belt, whipping it mercilessly across the buttocks and thighs.

reference_spacy_tokens: Then he turned it over , his hands brutal , and took off his leather belt , whipping it mercilessly across the buttocks and thighs .


fn_spacy_tokens_for_baseline: The principle of non - discrimination prohibits all discrimination on grounds of nationality both between ships of the member states and between nationals of the member states , as the case may be .

source_bert_toks: the principle of non - discrimination prohibits all discrimination on grounds of nationality both between ships of the member states and between nationals of the member states , as the case may be .

reference_raw: The principle of non-discrimination precludes any discrimination based on nationality between ships of the Member States and, where appropriate, between nationals of the Member States.

reference_spacy_tokens: The principle of non - discrimination precludes any discrimination based on nationality between ships of the Member States and , where appropriate , between nationals of the Member States .


fn_spacy_tokens_for_baseline: The International Atomic Energy Association ( IAEA ) has assisted Syria on numerous projects including uranium exploration , uranium extraction from phosphoric acid , isotope production , construction of a cyclotron facility , development of nuclear research laboratories , and preparation for a nuclear power program .

source_bert_toks: the international atomic energy association ( ia ##ea ) has assisted syria on numerous projects including uranium exploration , uranium extraction from ph ##os ##ph ##oric acid , isotope production , construction of a cy ##cl ##ot ##ron facility , development of nuclear research laboratories , and preparation for a nuclear power program .

reference_raw: The International Atomic Energy Association (IAEA) has assisted Syria in a number of activities, including the exploration of uranium, the extraction of uranium from phosphoric acid, the production of isotopes, the construction of a cyclotron facility, the development of nuclear research laboratories and the preparation of a nuclear energy programme.

reference_spacy_tokens: The International Atomic Energy Association ( IAEA ) has assisted Syria in a number of activities , including the exploration of uranium , the extraction of uranium from phosphoric acid , the production of isotopes , the construction of a cyclotron facility , the development of nuclear research laboratories and the preparation of a nuclear energy programme .


fn_spacy_tokens_for_baseline: ' McCabe was probably my favourite at the time because he was so intense for three or four years .

source_bert_toks: ' mcc ##abe was probably my favourite at the time because he was so intense for three or four years .

reference_raw: 'McCabe was probably my favorite at the time, 'cause he'd been so tense for three or four years.

reference_spacy_tokens: ' McCabe was probably my favorite at the time , 'cause he 'd been so tense for three or four years .


fn_spacy_tokens_for_baseline: Its colour was of brilliant red on the left hand side , but dispersing as it went to the right ending up a pale green colour .

source_bert_toks: its colour was of brilliant red on the left hand side , but di ##sper ##sing as it went to the right ending up a pale green colour .

reference_raw: The color on the left side was bright red, but as it moved to the right it faded to a pale green color.

reference_spacy_tokens: The color on the left side was bright red , but as it moved to the right it faded to a pale green color .


fn_spacy_tokens_for_baseline: So he stayed exactly where he was , rigid with nerves and with the back of his neck all prickly , listening as the muffled footsteps died away and yet another door thumped shut .

source_bert_toks: so he stayed exactly where he was , rigid with nerves and with the back of his neck all prick ##ly , listening as the muffled footsteps died away and yet another door thumped shut .

reference_raw: So he stayed exactly where he was, stiff with nerves and prickly at the back of his neck, listening as the muffled steps faded away, and another door slammed shut.

reference_spacy_tokens: So he stayed exactly where he was , stiff with nerves and prickly at the back of his neck , listening as the muffled steps faded away , and another door slammed shut .


fn_spacy_tokens_for_baseline: He looked at her perturbed face .

source_bert_toks: he looked at her per ##tur ##bed face .

reference_raw: He looked at her expressionless face.

reference_spacy_tokens: He looked at her expressionless face .


fn_spacy_tokens_for_baseline: When NGF - untreated PC 12 cells are compared with non - transfected neuroblastoma cells , of the 55 RP transcripts detected in common for both systems , about half ( a total of 28 ) have relative abundances within a factor of 2 . Twenty transcripts are more than 3 - fold higher in relative abundance in PC 12 cells .

source_bert_toks: when ng ##f - un ##tre ##ated pc 12 cells are compared with non - trans ##fect ##ed ne ##uro ##bla ##sto ##ma cells , of the 55 r ##p transcript ##s detected in common for both systems , about half ( a total of 28 ) have relative abundance ##s within a factor of 2 . twenty transcript ##s are more than 3 - fold higher in relative abundance in pc 12 cells .

reference_raw: When PC 12 cells not treated with NGF are compared with non-transfected neuroblastoma cells, of the 55 RP transcripts that are commonly detected in both systems, approximately half (a total of 28) have a relative abundance of 2. Twenty transcripts are more than 3-fold higher in the relative abundance of PC 12 cells.

reference_spacy_tokens: When PC 12 cells not treated with NGF are compared with non - transfected neuroblastoma cells , of the 55 RP transcripts that are commonly detected in both systems , approximately half ( a total of 28 ) have a relative abundance of 2 . Twenty transcripts are more than 3-fold higher in the relative abundance of PC 12 cells .


fn_spacy_tokens_for_baseline: ' Do n't jibe at me , Argentina . '

source_bert_toks: ' don ' t ji ##be at me , argentina . '

reference_raw: "Argentine, don't jingle with me."

reference_spacy_tokens: " Argentine , do n't jingle with me . "


fn_spacy_tokens_for_baseline: There was almost a tragedy in 1905 when a major fire broke out one night in the early hours of the morning while 44 boys in the boys ' dormitories were asleep .

source_bert_toks: there was almost a tragedy in 1905 when a major fire broke out one night in the early hours of the morning while 44 boys in the boys ' dorm ##itor ##ies were asleep .

reference_raw: In 1905 it was almost tragic when a big fire broke out one night in the early hours of the morning, while 44 boys slept in the boys' bedrooms.

reference_spacy_tokens: In 1905 it was almost tragic when a big fire broke out one night in the early hours of the morning , while 44 boys slept in the boys ' bedrooms .


fn_spacy_tokens_for_baseline: That it was once much greater is attested by the many traces of former lazy - beds to be seen on the grazing land .

source_bert_toks: that it was once much greater is attested by the many traces of former lazy - beds to be seen on the grazing land .

reference_raw: The fact that it was once much larger is confirmed by the many traces of former lazy beds visible in the pastures.

reference_spacy_tokens: The fact that it was once much larger is confirmed by the many traces of former lazy beds visible in the pastures .


fn_spacy_tokens_for_baseline: ' After Stephen was captured I swore to serve the Queen until his release , to obey her commands as I would the King 's .

source_bert_toks: ' after stephen was captured i swore to serve the queen until his release , to obey her commands as i would the king ' s .

reference_raw: When Stephen was captured, I vowed to serve the Queen until he was released, to obey her commands as well as the King's.

reference_spacy_tokens: When Stephen was captured , I vowed to serve the Queen until he was released , to obey her commands as well as the King 's .


fn_spacy_tokens_for_baseline: Conditioned by years of never entering the study while her husband was working in the evening , Doreen Flyte gave a little nervous whimper then went back downstairs .

source_bert_toks: conditioned by years of never entering the study while her husband was working in the evening , do ##reen fly ##te gave a little nervous whimper then went back downstairs .

reference_raw: Conditioned by the years she had never entered the study while her husband worked at night, Doreen Flyte let out a little nervous whining and went back down the stairs.

reference_spacy_tokens: Conditioned by the years she had never entered the study while her husband worked at night , Doreen Flyte let out a little nervous whining and went back down the stairs .


fn_spacy_tokens_for_baseline: Trying Your Luck

source_bert_toks: trying your luck

reference_raw: I'm trying your happiness

reference_spacy_tokens: I 'm trying your happiness


fn_spacy_tokens_for_baseline: No , they 're business heads on business shoulders , keen - sensed and foxy , not young - looking either but tough , tanned and weathered .

source_bert_toks: no , they ' re business heads on business shoulders , keen - sensed and fox ##y , not young - looking either but tough , tanned and weathered .

reference_raw: No, they're business leaders on business shoulders, with a sharp sense and a fox, not young-looking, but tough, tanned and weathered.

reference_spacy_tokens: No , they 're business leaders on business shoulders , with a sharp sense and a fox , not young - looking , but tough , tanned and weathered .


fn_spacy_tokens_for_baseline: The expansion of air travel began the age of mass tourism , and Greece along with the Aegean Islands became exciting destinations for northern Europeans escaping their damp , cool summers .

source_bert_toks: the expansion of air travel began the age of mass tourism , and greece along with the aegean islands became exciting destinations for northern europeans escaping their damp , cool summers .

reference_raw: The expansion of air travel began in the age of mass tourism, and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet, cold years.

reference_spacy_tokens: The expansion of air travel began in the age of mass tourism , and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet , cold years .


fn_spacy_tokens_for_baseline: He cited the case of a Swiss oil trader who recently put out bids via telex for an oil tanker to pick up a cargo of crude in the Middle East .

source_bert_toks: he cited the case of a swiss oil trader who recently put out bids via tel ##ex for an oil tanker to pick up a cargo of crude in the middle east .

reference_raw: He referred to the case of a Swiss oil dealer who had just submitted a telex offer to an oil tanker to pick up a load of oil in the Middle East.

reference_spacy_tokens: He referred to the case of a Swiss oil dealer who had just submitted a telex offer to an oil tanker to pick up a load of oil in the Middle East .


fn_spacy_tokens_for_baseline: Dexter had been stationed in Brixton several years before and he inhaled the familiar atmosphere as he wound along Coldharbour Lane towards Peckham : the dilapidated shops selling second - hand furniture and televisions , the handsome couple posing against a car as though for a fashion magazine , the parked cars tumbling over the pavement .

source_bert_toks: dexter had been stationed in br ##ix ##ton several years before and he inhaled the familiar atmosphere as he wound along cold ##har ##bour lane towards peck ##ham : the dilapidated shops selling second - hand furniture and television ##s , the handsome couple posing against a car as though for a fashion magazine , the parked cars tumbling over the pavement .

reference_raw: Dexter had been stationed in Brixton a few years ago, breathing the familiar air as he circled down Coldharbour Lane toward Peckham: the ruined shops selling second-hand furniture and TVs, the handsome couple posing against the car as if it were a fashion magazine, the parked cars rolling over the sidewalk.

reference_spacy_tokens: Dexter had been stationed in Brixton a few years ago , breathing the familiar air as he circled down Coldharbour Lane toward Peckham : the ruined shops selling second - hand furniture and TVs , the handsome couple posing against the car as if it were a fashion magazine , the parked cars rolling over the sidewalk .


fn_spacy_tokens_for_baseline: well i drive a black car right now and i 've always liked black but uh i maybe uh interested in other colors uh i 'm not really interested in yellow or white

source_bert_toks: well i drive a black car right now and i ' ve always liked black but uh i maybe uh interested in other colors uh i ' m not really interested in yellow or white

reference_raw: Well, I'm driving a black car right now, and I've always liked black, but uh i may be interested in other colours, uh I don't really care about yellow or white

reference_spacy_tokens: Well , I 'm driving a black car right now , and I 've always liked black , but uh i may be interested in other colours , uh I do n't really care about yellow or white


fn_spacy_tokens_for_baseline: Among the weaver birds polygyny occurs in territories within a colony but these do not include a foraging area because the birds forage in flocks away from the breeding location .

source_bert_toks: among the weaver birds poly ##gy ##ny occurs in territories within a colony but these do not include a foraging area because the birds for ##age in flock ##s away from the breeding location .

reference_raw: Polygyny is present among the weaver birds in the territory of the colony, but it does not cover the fodder area as the birds feed in flocks away from the breeding site.

reference_spacy_tokens: Polygyny is present among the weaver birds in the territory of the colony , but it does not cover the fodder area as the birds feed in flocks away from the breeding site .


fn_spacy_tokens_for_baseline: Observe that hypnotics , minor tranquillisers , pain killers and many other mood - altering drugs are cross - addictive with alcohol and with the various illegal addictive drugs .

source_bert_toks: observe that hypnotic ##s , minor tran ##quil ##lis ##ers , pain killers and many other mood - altering drugs are cross - addict ##ive with alcohol and with the various illegal addict ##ive drugs .

reference_raw: Note that hypnotics, minor sedatives, painkillers and many other mood-altering drugs are addictive to alcohol and various illicit drugs.

reference_spacy_tokens: Note that hypnotics , minor sedatives , painkillers and many other mood - altering drugs are addictive to alcohol and various illicit drugs .


fn_spacy_tokens_for_baseline: As soon as it 's light , my old school chums Finlayson , Richards and Callaghan will come with me and patrol the area Roeux - Riencourt .

source_bert_toks: as soon as it ' s light , my old school chu ##ms fin ##lay ##son , richards and call ##aghan will come with me and patrol the area roe ##ux - ri ##en ##court .

reference_raw: When it's light, my old school buddies Finlayson, Richards and Callaghan are coming with me to patrol the Roeux-Riencourt area.

reference_spacy_tokens: When it 's light , my old school buddies Finlayson , Richards and Callaghan are coming with me to patrol the Roeux - Riencourt area .


fn_spacy_tokens_for_baseline: The interim dividend is raised to 2.35p , from 2.14p net a share , covered by earnings up 0.75p to 4.97p .

source_bert_toks: the interim divide ##nd is raised to 2 . 35 ##p , from 2 . 14 ##p net a share , covered by earnings up 0 . 75 ##p to 4 . 97 ##p .

reference_raw: The interim dividend shall be increased to 2,35 p, from 2,14p net share, covered by earnings from 0,75 p to 4,97p.

reference_spacy_tokens: The interim dividend shall be increased to 2,35 p , from 2,14p net share , covered by earnings from 0,75 p to 4,97p .


fn_spacy_tokens_for_baseline: She 'd particularly enjoyed a bout between Iris Murdoch and Professor Anscombe , she recalled , on the relation of philosophy to religion .

source_bert_toks: she ' d particularly enjoyed a bout between iris murdoch and professor an ##sco ##mbe , she recalled , on the relation of philosophy to religion .

reference_raw: She was particularly fond of the relationship between Iris Murdoch and Professor Anscombe, she reminded herself, about the relationship between philosophy and religion.

reference_spacy_tokens: She was particularly fond of the relationship between Iris Murdoch and Professor Anscombe , she reminded herself , about the relationship between philosophy and religion .


fn_spacy_tokens_for_baseline: The stomach was then returned to the abdominal cavity and the wound covered with a moistened cotton wool pad .

source_bert_toks: the stomach was then returned to the abdominal cavity and the wound covered with a moist ##ened cotton wool pad .

reference_raw: Then the stomach returned to the abdomen and the wound was covered with a wet cotton wool pad.

reference_spacy_tokens: Then the stomach returned to the abdomen and the wound was covered with a wet cotton wool pad .


fn_spacy_tokens_for_baseline: He watched in disbelief as Bremner reportedly drenched the barmaid with a glass of drink .

source_bert_toks: he watched in disbelief as br ##em ##ner reportedly drenched the bar ##maid with a glass of drink .

reference_raw: He watched incredulously as Bremner allegedly soaked the waitress with a glass of glass.

reference_spacy_tokens: He watched incredulously as Bremner allegedly soaked the waitress with a glass of glass .


fn_spacy_tokens_for_baseline: The shape of a vardo loomed in the twilight and the whinny of a horse came from the trees .

source_bert_toks: the shape of a var ##do loomed in the twilight and the w ##hin ##ny of a horse came from the trees .

reference_raw: The shape of a vardo loomed in the gloom, and the whining of a horse came out of the trees.

reference_spacy_tokens: The shape of a vardo loomed in the gloom , and the whining of a horse came out of the trees .


fn_spacy_tokens_for_baseline: The two remaining types bind to the surface of the cube .

source_bert_toks: the two remaining types bind to the surface of the cube .

reference_raw: The other two types are attached to the surface of the cube.

reference_spacy_tokens: The other two types are attached to the surface of the cube .


fn_spacy_tokens_for_baseline: She pulled herself back to the point , assuming once more an expression of sobriety .

source_bert_toks: she pulled herself back to the point , assuming once more an expression of sob ##riety .

reference_raw: She pulled herself back to the point and took another look of sobriety.

reference_spacy_tokens: She pulled herself back to the point and took another look of sobriety .


fn_spacy_tokens_for_baseline: People will note that fact with interest .

source_bert_toks: people will note that fact with interest .

reference_raw: People are going to notice this fact with interest.

reference_spacy_tokens: People are going to notice this fact with interest .


fn_spacy_tokens_for_baseline: As he approached Quigley , Quigley started to sob .

source_bert_toks: as he approached qui ##gley , qui ##gley started to sob .

reference_raw: Quigley began to weep as he approached Quigley.

reference_spacy_tokens: Quigley began to weep as he approached Quigley .


fn_spacy_tokens_for_baseline: Office Cleaning Services says it regrets the situation and has the utmost sympathy for Mrs Hampton .

source_bert_toks: office cleaning services says it regrets the situation and has the utmost sympathy for mrs hampton .

reference_raw: The cleaning department says she's sorry for the situation, and she's very sympathetic to Mrs. Hampton.

reference_spacy_tokens: The cleaning department says she 's sorry for the situation , and she 's very sympathetic to Mrs. Hampton .


fn_spacy_tokens_for_baseline: Nothing more was said as we rode down in the elevator .

source_bert_toks: nothing more was said as we rode down in the elevator .

reference_raw: There was nothing more to say as we rode down the lift.

reference_spacy_tokens: There was nothing more to say as we rode down the lift .


fn_spacy_tokens_for_baseline: I conclude , then , that you mean to refuse him . '

source_bert_toks: i conclude , then , that you mean to refuse him . '

reference_raw: I've come to the conclusion that you intend to turn him down.'

reference_spacy_tokens: I 've come to the conclusion that you intend to turn him down . '


fn_spacy_tokens_for_baseline: The majority are Cantonese , born in Hong Kong , or from South China , but there are immigrants from all over China .

source_bert_toks: the majority are cantonese , born in hong kong , or from south china , but there are immigrants from all over china .

reference_raw: Most of them are Cantonese, born in Hong Kong or South China, but there are immigrants from everywhere in China.

reference_spacy_tokens: Most of them are Cantonese , born in Hong Kong or South China , but there are immigrants from everywhere in China .


fn_spacy_tokens_for_baseline: I MOSEYED into the NME offices bearing a still - throbbing psychic wound and a mittful of rejection letters .

source_bert_toks: i mo ##sey ##ed into the nme offices bearing a still - throbbing psychic wound and a mit ##tf ##ul of rejection letters .

reference_raw: I moved into the NME offices with a still-pulsing mental wound and a mittful of rejection letters.

reference_spacy_tokens: I moved into the NME offices with a still - pulsing mental wound and a mittful of rejection letters .


fn_spacy_tokens_for_baseline: She felt somehow that her sister needed it , for it seemed only too probable that if Rupert was interested in any woman it was in Ianthe .

source_bert_toks: she felt somehow that her sister needed it , for it seemed only too probable that if rupert was interested in any woman it was in ian ##the .

reference_raw: Somehow she felt that her sister needed him, for it seemed too likely that if Rupert was interested in a woman, he would be in Ianthe.

reference_spacy_tokens: Somehow she felt that her sister needed him , for it seemed too likely that if Rupert was interested in a woman , he would be in Ianthe .


fn_spacy_tokens_for_baseline: That 's right , in other words , the insurance company ca n't back out of the contract , providing the client is paying his premiums .

source_bert_toks: that ' s right , in other words , the insurance company can ' t back out of the contract , providing the client is paying his premium ##s .

reference_raw: In other words, the insurance company cannot withdraw from the contract, provided that the client pays his premiums.

reference_spacy_tokens: In other words , the insurance company can not withdraw from the contract , provided that the client pays his premiums .


fn_spacy_tokens_for_baseline: He could n't handle the fact that his sexual dynamism was starting to lose its velocity .

source_bert_toks: he couldn ' t handle the fact that his sexual d ##yna ##mism was starting to lose its velocity .

reference_raw: He couldn't bear the fact that his sexual dynamics were beginning to lose speed.

reference_spacy_tokens: He could n't bear the fact that his sexual dynamics were beginning to lose speed .


fn_spacy_tokens_for_baseline: A cool breath of stale dank air assailed his nostrils , but to Grant it smelled sweetly of life and freedom .

source_bert_toks: a cool breath of stale dan ##k air ass ##ailed his nostrils , but to grant it smelled sweetly of life and freedom .

reference_raw: His nostrils were filled with a cold breath of stale, wet air, but he smelled sweetly of life and freedom to Grant.

reference_spacy_tokens: His nostrils were filled with a cold breath of stale , wet air , but he smelled sweetly of life and freedom to Grant .


fn_spacy_tokens_for_baseline: Chicken with hot sauce sizzled on grills .

source_bert_toks: chicken with hot sauce si ##zzled on grill ##s .

reference_raw: A chicken with a hot sauce hissed on a barbecue.

reference_spacy_tokens: A chicken with a hot sauce hissed on a barbecue .


fn_spacy_tokens_for_baseline: A large and influential Union could sway the Government which in turn could lead the League and the world .

source_bert_toks: a large and influential union could sway the government which in turn could lead the league and the world .

reference_raw: A large and powerful union could rock a government that could in turn lead the League and the world.

reference_spacy_tokens: A large and powerful union could rock a government that could in turn lead the League and the world .


fn_spacy_tokens_for_baseline: Tough loose - head called up when Heinrich Rodgers tripped on the hotel stairs last night and tore ankle ligaments .

source_bert_toks: tough loose - head called up when heinrich rodgers tripped on the hotel stairs last night and tore ankle ligament ##s .

reference_raw: When Heinrich Rodgers stumbled into the hotel stairwell last night and ripped off his ankle ligaments, he called out.

reference_spacy_tokens: When Heinrich Rodgers stumbled into the hotel stairwell last night and ripped off his ankle ligaments , he called out .


fn_spacy_tokens_for_baseline: Of the more than 42,000 people Goodwill served in 1999 , over 5,000 of them have multiple barriers to finding and keeping a job .

source_bert_toks: of the more than 42 , 000 people goodwill served in 1999 , over 5 , 000 of them have multiple barriers to finding and keeping a job .

reference_raw: Of the over 42,000 people that Goodwill served in 1999, more than 5,000 of them have a number of obstacles to finding and maintaining jobs.

reference_spacy_tokens: Of the over 42,000 people that Goodwill served in 1999 , more than 5,000 of them have a number of obstacles to finding and maintaining jobs .


fn_spacy_tokens_for_baseline: To Meryl 's vexation , the boundary wall proved to be nearly eight feet high .

source_bert_toks: to mer ##yl ' s ve ##xa ##tion , the boundary wall proved to be nearly eight feet high .

reference_raw: The boundary wall, to Meryl's delight, proved to be almost eight feet high.

reference_spacy_tokens: The boundary wall , to Meryl 's delight , proved to be almost eight feet high .


fn_spacy_tokens_for_baseline: Changing weather conditions also helped firefighting efforts , as temperature in the area fell to 90 degrees Fahrenheit , down from over a hundred degrees on Monday .

source_bert_toks: changing weather conditions also helped fire ##fighting efforts , as temperature in the area fell to 90 degrees fa ##hre ##nh ##eit , down from over a hundred degrees on monday .

reference_raw: The change in climatic conditions also helped firefighting, as the temperature in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday.

reference_spacy_tokens: The change in climatic conditions also helped firefighting , as the temperature in the area dropped to 90 degrees Fahrenheit and dropped from more than 100 degrees on Monday .


fn_spacy_tokens_for_baseline: He also brought the Ark of the Covenant , the portable tabernacle containing the Tablets of the Law received on Mount Sinai , to the Spring of Gihon , just outside the walls of Jerusalem .

source_bert_toks: he also brought the ark of the covenant , the portable tab ##ern ##acle containing the tablets of the law received on mount sinai , to the spring of gi ##hon , just outside the walls of jerusalem .

reference_raw: He had also brought the Ark of the Covenant, a portable tabernacle with the Tablets of the Law received on Mount Sinai, to the spring of Gihon, just outside the walls of Jerusalem.

reference_spacy_tokens: He had also brought the Ark of the Covenant , a portable tabernacle with the Tablets of the Law received on Mount Sinai , to the spring of Gihon , just outside the walls of Jerusalem .


fn_spacy_tokens_for_baseline: He took tutorials three times a week at twelve , and a daily lecture at two o'clock ; that left him the mornings free for research or writing .

source_bert_toks: he took tutor ##ials three times a week at twelve , and a daily lecture at two o ' clock ; that left him the mornings free for research or writing .

reference_raw: At twelve he took tutorials three times a week and lectures every day at two o'clock, leaving him free to study or write in the morning.

reference_spacy_tokens: At twelve he took tutorials three times a week and lectures every day at two o'clock , leaving him free to study or write in the morning .


fn_spacy_tokens_for_baseline: The King , visiting as a private citizen , was reticent about his political ambitions , saying only that he wanted to help Romania .

source_bert_toks: the king , visiting as a private citizen , was re ##tic ##ent about his political ambitions , saying only that he wanted to help romania .

reference_raw: The King, visiting as a private citizen, held back his political ambitions and said only that he wanted to help Romania.

reference_spacy_tokens: The King , visiting as a private citizen , held back his political ambitions and said only that he wanted to help Romania .


fn_spacy_tokens_for_baseline: He 'll never forgive her for the life she has spent and she wo n't let him see what she 's come to at the end of it !

source_bert_toks: he ' ll never forgive her for the life she has spent and she won ' t let him see what she ' s come to at the end of it !

reference_raw: She'll never forget the life she's spent, and she won't let him see what she's done at the end of it!

reference_spacy_tokens: She 'll never forget the life she 's spent , and she wo n't let him see what she 's done at the end of it !


fn_spacy_tokens_for_baseline: Two of his apologies in Africa meet the test .

source_bert_toks: two of his apologies in africa meet the test .

reference_raw: Two of his excuses in Africa have passed the test.

reference_spacy_tokens: Two of his excuses in Africa have passed the test .


fn_spacy_tokens_for_baseline: One such innovation was a technology that enabled the military to prevent buried roadside bombs from exploding .

source_bert_toks: one such innovation was a technology that enabled the military to prevent buried roadside bombs from exploding .

reference_raw: One of these innovations was the technology that allowed the military to prevent the explosion of buried road-side bombs.

reference_spacy_tokens: One of these innovations was the technology that allowed the military to prevent the explosion of buried road - side bombs .


fn_spacy_tokens_for_baseline: From a train window the views are democratically arrayed so that basilica and hedgerow , back street and castle have equal viewing time and space .

source_bert_toks: from a train window the views are democratic ##ally array ##ed so that basilica and hedge ##row , back street and castle have equal viewing time and space .

reference_raw: From the window of the train, the views are democratically arranged in such a way that basilica and hedgerows, back streets and castles have the same viewing time and space.

reference_spacy_tokens: From the window of the train , the views are democratically arranged in such a way that basilica and hedgerows , back streets and castles have the same viewing time and space .


fn_spacy_tokens_for_baseline: Gidromash , an Almaty -based Soviet - era producer of submarine - launched missiles , was converted to a civilian commercial enterprise under CTR 's Industrial Partnerships Program .

source_bert_toks: gi ##dro ##mas ##h , an alma ##ty - based soviet - era producer of submarine - launched missiles , was converted to a civilian commercial enterprise under ct ##r ' s industrial partnerships program .

reference_raw: Gidromash, an Almaty-based Soviet-era producer of submarine launch missiles, has been transformed into a civilian business under the CTR industrial partnership program.

reference_spacy_tokens: Gidromash , an Almaty - based Soviet - era producer of submarine launch missiles , has been transformed into a civilian business under the CTR industrial partnership program .


fn_spacy_tokens_for_baseline: If a trace of tropical lethargy still adds to the charm in this city of sidewalk cafes , palm trees , and pedicabs , any torpor definitely ends once inside the doors of Macau 's casinos , scene of some of the liveliest gambling west of Las Vegas .

source_bert_toks: if a trace of tropical let ##har ##gy still adds to the charm in this city of sidewalk cafes , palm trees , and pe ##dic ##ab ##s , any tor ##por definitely ends once inside the doors of macau ' s casinos , scene of some of the live ##liest gambling west of las vegas .

reference_raw: If a trace of tropical lethargy still adds to the enchantment of sidewalk cafes, palm trees, and pedicabs in this town, any torpor will surely end once inside the doors of Macau's casinos, the scene of one of the most lively games west of Las Vegas.

reference_spacy_tokens: If a trace of tropical lethargy still adds to the enchantment of sidewalk cafes , palm trees , and pedicabs in this town , any torpor will surely end once inside the doors of Macau 's casinos , the scene of one of the most lively games west of Las Vegas .


fn_spacy_tokens_for_baseline: If the light is warm , say yellow or yellow orange , the halo will tend to be warmer , orange or red - orange as in the halo around the bus headlights in London Bus .

source_bert_toks: if the light is warm , say yellow or yellow orange , the halo will tend to be warmer , orange or red - orange as in the halo around the bus headlights in london bus .

reference_raw: When the light is hot, let's say yellow or yellow orange, the halo tends to be hotter, orange or red-orange, like the halo around the London bus lights.

reference_spacy_tokens: When the light is hot , let 's say yellow or yellow orange , the halo tends to be hotter , orange or red - orange , like the halo around the London bus lights .


fn_spacy_tokens_for_baseline: In the few cases just seen where the to infinitive denotes an action , it also brings in the nuance of subsequence , of sudden movement from one instant to the next .

source_bert_toks: in the few cases just seen where the to in ##fin ##itive denotes an action , it also brings in the nu ##ance of sub ##se ##que ##nce , of sudden movement from one instant to the next .

reference_raw: In the few cases where an infinitive characterizes an action, it also creates a nuance of subsequence, a sudden movement from moment to moment.

reference_spacy_tokens: In the few cases where an infinitive characterizes an action , it also creates a nuance of subsequence , a sudden movement from moment to moment .


fn_spacy_tokens_for_baseline: The crew belonged to the 1st Battalion , 228th Aviation Regiment , based at Ft . Buchanan , Puerto Rico .

source_bert_toks: the crew belonged to the 1st battalion , 228 ##th aviation regiment , based at ft . buchanan , puerto rico .

reference_raw: The crew was part of the first battalion, the 228th Air Force, based in Ft. Buchanan, Puerto Rico.

reference_spacy_tokens: The crew was part of the first battalion , the 228th Air Force , based in Ft . Buchanan , Puerto Rico .


fn_spacy_tokens_for_baseline: Natural selection favoured those ancestral caddis genes that caused their possessors to build effective houses .

source_bert_toks: natural selection favoured those ancestral cad ##dis genes that caused their possess ##ors to build effective houses .

reference_raw: Natural selection favored the genes of the ancestral caddis, which caused their owners to build efficient homes.

reference_spacy_tokens: Natural selection favored the genes of the ancestral caddis , which caused their owners to build efficient homes .


fn_spacy_tokens_for_baseline: The Olympic Peninsula sits perched on the northwest corner of Washington like a small state , an expanse of mountains , rivers , and coastlines wrapped by an arm of the Pacific and separated from the urban swath of Greater Seattle by the inland sea of Puget Sound .

source_bert_toks: the olympic peninsula sits perched on the northwest corner of washington like a small state , an expanse of mountains , rivers , and coastline ##s wrapped by an arm of the pacific and separated from the urban swat ##h of greater seattle by the inland sea of puget sound .

reference_raw: On the northwest corner of Washington, the Olympic Peninsula sits like a small state, a stretch of mountains, rivers, and coastlines, encased in an arm of the Pacific, separated from the urban swath of Greater Seattle by the inland sea of Puget Soud.

reference_spacy_tokens: On the northwest corner of Washington , the Olympic Peninsula sits like a small state , a stretch of mountains , rivers , and coastlines , encased in an arm of the Pacific , separated from the urban swath of Greater Seattle by the inland sea of Puget Soud .


fn_spacy_tokens_for_baseline: Cheap electricity would soon be issuing forth from reactors fed by an inexhaustible resource -- seawater .

source_bert_toks: cheap electricity would soon be issuing forth from reactors fed by an in ##ex ##haus ##ti ##ble resource - - sea ##water .

reference_raw: Shortly, cheap electricity will be coming out of reactors powered by an inexhaustible source of seawater.

reference_spacy_tokens: Shortly , cheap electricity will be coming out of reactors powered by an inexhaustible source of seawater .


fn_spacy_tokens_for_baseline: Although the position has been modified by statute , traditionally a joint liability can only be enforced by bringing the claim at the same time against all the vendors undertaking the liability .

source_bert_toks: although the position has been modified by statute , traditionally a joint liability can only be enforced by bringing the claim at the same time against all the vendors undertaking the liability .

reference_raw: Although the situation has been changed by law, it is traditionally possible to enforce joint and several liability only by bringing a claim at the same time against all the sellers carrying out the liability.

reference_spacy_tokens: Although the situation has been changed by law , it is traditionally possible to enforce joint and several liability only by bringing a claim at the same time against all the sellers carrying out the liability .


fn_spacy_tokens_for_baseline: The bamboo rungs , though wide and strong , were loosely lashed with unreliable cordage , and Lorne 's and my first simultaneous step onto the lowest rung resulted in it slipping its knots and depositing us both heavily in the mud -- myself for the second time in less than twenty minutes .

source_bert_toks: the bamboo run ##gs , though wide and strong , were loosely lashed with unreliable cord ##age , and lo ##rne ' s and my first simultaneous step onto the lowest run ##g resulted in it slipping its knots and deposit ##ing us both heavily in the mud - - myself for the second time in less than twenty minutes .

reference_raw: The bamboo rungs, though broad and strong, were loosely bound with unreliable cords, and Lorne's and my first simultaneous step on the lowest rung led him to slip his knots and put us both heavily in the mud - me for the second time in less than twenty minutes.

reference_spacy_tokens: The bamboo rungs , though broad and strong , were loosely bound with unreliable cords , and Lorne 's and my first simultaneous step on the lowest rung led him to slip his knots and put us both heavily in the mud - me for the second time in less than twenty minutes .


fn_spacy_tokens_for_baseline: The movie version blows it in the first couple of minutes .

source_bert_toks: the movie version blows it in the first couple of minutes .

reference_raw: The movie version beats it in the first few minutes.

reference_spacy_tokens: The movie version beats it in the first few minutes .


fn_spacy_tokens_for_baseline: Macau 's most memorable monument is the Baroque facade of the ruins of Sao Paulo , the only remains of a beautiful 17th - century Jesuit church .

source_bert_toks: macau ' s most memorable monument is the baroque facade of the ruins of sao paulo , the only remains of a beautiful 17th - century jesuit church .

reference_raw: The most memorable monument to Macau is the Baroque facade of the ruins of Sao Paul, the only remnant of the beautiful 17th-century Jesuit Church.

reference_spacy_tokens: The most memorable monument to Macau is the Baroque facade of the ruins of Sao Paul , the only remnant of the beautiful 17th - century Jesuit Church .


fn_spacy_tokens_for_baseline: Aneurin Bevan , who led the revolt against the charges , portrayed them as the direct result of the financial strains caused by the rearmament programme .

source_bert_toks: an ##eur ##in be ##van , who led the revolt against the charges , portrayed them as the direct result of the financial strains caused by the rear ##mament programme .

reference_raw: Aneurin Bevan, who led the insurgency against the charges, depicted them as a direct result of the financial burden caused by the rearming program.

reference_spacy_tokens: Aneurin Bevan , who led the insurgency against the charges , depicted them as a direct result of the financial burden caused by the rearming program .


fn_spacy_tokens_for_baseline: We do n't waste time as we are helping the community .

source_bert_toks: we don ' t waste time as we are helping the community .

reference_raw: We're not squandering time helping the community.

reference_spacy_tokens: We 're not squandering time helping the community .


fn_spacy_tokens_for_baseline: For the first time since I had known him , his voice was barely civil .

source_bert_toks: for the first time since i had known him , his voice was barely civil .

reference_raw: His voice was hardly polite for the first time since I'd known him.

reference_spacy_tokens: His voice was hardly polite for the first time since I 'd known him .


fn_spacy_tokens_for_baseline: As the CV system improves , the blood vessels enlarge and become more elastic , and the heart becomes bigger and stronger .

source_bert_toks: as the cv system improves , the blood vessels en ##lar ##ge and become more elastic , and the heart becomes bigger and stronger .

reference_raw: As the cardiovascular system improves, the blood vessels expand and become more flexible, and the heart grows bigger and stronger.

reference_spacy_tokens: As the cardiovascular system improves , the blood vessels expand and become more flexible , and the heart grows bigger and stronger .


fn_spacy_tokens_for_baseline: For every dollar donated to Goodwill in 1998 , we helped our " graduates " earn an estimated $ 102 .

source_bert_toks: for every dollar donated to goodwill in 1998 , we helped our " graduates " earn an estimated $ 102 .

reference_raw: For each dollar donated to Goodwill in 1998, we helped our "graduates" make an estimated $102.

reference_spacy_tokens: For each dollar donated to Goodwill in 1998 , we helped our " graduates " make an estimated $ 102 .


fn_spacy_tokens_for_baseline: Prosperity has brought with it a new emphasis on historic preservation .

source_bert_toks: prosperity has brought with it a new emphasis on historic preservation .

reference_raw: Prosperity brought with it a new emphasis on historical conservation.

reference_spacy_tokens: Prosperity brought with it a new emphasis on historical conservation .


fn_spacy_tokens_for_baseline: The U.S. lawmaker got acquainted with the sufferings of the Iraqi children because of acute shortage of food and medicine as a direct result of the embargo , reported the Iraqi News Agency ( INA ) .

source_bert_toks: the u . s . law ##maker got acquainted with the suffering ##s of the iraqi children because of acute shortage of food and medicine as a direct result of the em ##bar ##go , reported the iraqi news agency ( ina ) .

reference_raw: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo, and reported it to the Iraqi News Agency.

reference_spacy_tokens: The US legislator became aware of the suffering of Iraqi children due to an acute lack of food and medicine as a direct result of the embargo , and reported it to the Iraqi News Agency .


fn_spacy_tokens_for_baseline: ' They 've done it , the young swine , ' he groaned , craning out of his high window , clutching the cold dewy sill .

source_bert_toks: ' they ' ve done it , the young sw ##ine , ' he groaned , cr ##ani ##ng out of his high window , clutching the cold dew ##y si ##ll .

reference_raw: 'They did it, young pig,' he moaned, crouching from his high window, clutching the cold, dew-sill.

reference_spacy_tokens: ' They did it , young pig , ' he moaned , crouching from his high window , clutching the cold , dew - sill .


fn_spacy_tokens_for_baseline: She says that there 's quite a lot of crime in the village , with cars driving through at night , break - in 's , etc .

source_bert_toks: she says that there ' s quite a lot of crime in the village , with cars driving through at night , break - in ' s , etc .

reference_raw: He says there's a lot of crime in the village, with cars passing by at night, break-ins, etc.

reference_spacy_tokens: He says there 's a lot of crime in the village , with cars passing by at night , break - ins , etc .


fn_spacy_tokens_for_baseline: And she turned away , Midnight 's shoes striking sparks in the darkness , and set off at a fast trot in the direction of Sam Sylvester 's semi - detached in Acacia Avenue .

source_bert_toks: and she turned away , midnight ' s shoes striking sparks in the darkness , and set off at a fast tr ##ot in the direction of sam sylvester ' s semi - detached in acacia avenue .

reference_raw: She turned away, midnight's boots sparkling in the dark, and trotted swiftly toward Sam Sylvester's half-detached Acacia Avenue.

reference_spacy_tokens: She turned away , midnight 's boots sparkling in the dark , and trotted swiftly toward Sam Sylvester 's half - detached Acacia Avenue .


fn_spacy_tokens_for_baseline: I 'm a professional chequebook girl and pickpocket .

source_bert_toks: i ' m a professional che ##que ##book girl and pick ##po ##cke ##t .

reference_raw: I'm a professional checkbook girl with a pocket.

reference_spacy_tokens: I 'm a professional checkbook girl with a pocket .


fn_spacy_tokens_for_baseline: The receptionist presided over a small office on the twenty - second floor of the United Nations Building , its unmarked door locked at all times and only accessible to authorized personnel .

source_bert_toks: the receptionist presided over a small office on the twenty - second floor of the united nations building , its unmarked door locked at all times and only accessible to authorized personnel .

reference_raw: The receptionist presided over a small office on the twenty-second floor of the United Nations building, its unmarked door locked at all times and open only to authorised personnel.

reference_spacy_tokens: The receptionist presided over a small office on the twenty - second floor of the United Nations building , its unmarked door locked at all times and open only to authorised personnel .


fn_spacy_tokens_for_baseline: Will he join me today in thanking the Sheikh of Abu Dhabi for his recent proposals which form part of the crucial negotiations that are taking place ?

source_bert_toks: will he join me today in thanking the sheikh of abu dhabi for his recent proposals which form part of the crucial negotiations that are taking place ?

reference_raw: Will he join me today to thank the sheik of Abu Dhabi for his recent proposals, which are part of the key negotiations?

reference_spacy_tokens: Will he join me today to thank the sheik of Abu Dhabi for his recent proposals , which are part of the key negotiations ?


fn_spacy_tokens_for_baseline: You can take a ferryboat through the harbor , past the ingenious Plover Cove reservoir , a water catchment area appropriated by damming and draining a broad inlet from the sea .

source_bert_toks: you can take a ferry ##boat through the harbor , past the ing ##eni ##ous pl ##over cove reservoir , a water catchment area appropriated by dam ##ming and draining a broad inlet from the sea .

reference_raw: You can drive a ferry ship through the port, past the ingenious pool of Plover Cove, a water catchment area suitable for damming and draining a wide inlet from the sea.

reference_spacy_tokens: You can drive a ferry ship through the port , past the ingenious pool of Plover Cove , a water catchment area suitable for damming and draining a wide inlet from the sea .


fn_spacy_tokens_for_baseline: If you do n't sail yourself , this is a great way to see Bermuda from the water , including the many small islands lying just off Hamilton Harbour and St. George 's Harbour .

source_bert_toks: if you don ' t sail yourself , this is a great way to see bermuda from the water , including the many small islands lying just off hamilton harbour and st . george ' s harbour .

reference_raw: If you're not sailing on your own, it's a good way to see Bermuda from the water, including a lot of small islands lying just off Hamilton Harbour and St. George's Harbour.

reference_spacy_tokens: If you 're not sailing on your own , it 's a good way to see Bermuda from the water , including a lot of small islands lying just off Hamilton Harbour and St. George 's Harbour .


fn_spacy_tokens_for_baseline: The French several times reneged on their pledges of future autonomy for the Lebanese .

source_bert_toks: the french several times rene ##ged on their pledge ##s of future autonomy for the lebanese .

reference_raw: The French have repeatedly renounced their commitment to the Lebanese's future independence.

reference_spacy_tokens: The French have repeatedly renounced their commitment to the Lebanese 's future independence .


fn_spacy_tokens_for_baseline: I felt along the ledge at the top of the door and sure enough the key was there .

source_bert_toks: i felt along the ledge at the top of the door and sure enough the key was there .

reference_raw: I found myself on the ledge at the top of the door, and I was sure that the key was there.

reference_spacy_tokens: I found myself on the ledge at the top of the door , and I was sure that the key was there .


fn_spacy_tokens_for_baseline: The messages are ordered alphabetically by error string .

source_bert_toks: the messages are ordered alphabet ##ically by error string .

reference_raw: Messages are commanded alphabetically by error strings.

reference_spacy_tokens: Messages are commanded alphabetically by error strings .


fn_spacy_tokens_for_baseline: External : All actions and methods adopted to confront dangers from outside .

source_bert_toks: external : all actions and methods adopted to confront dangers from outside .

reference_raw: External: All measures and techniques taken to deal with dangers from the outside.

reference_spacy_tokens: External : All measures and techniques taken to deal with dangers from the outside .


fn_spacy_tokens_for_baseline: He advises those less trammelled by convention than himself to adopt the use of key signatures for both horns and trumpets , except in obviously atonal music .

source_bert_toks: he advises those less tram ##mel ##led by convention than himself to adopt the use of key signatures for both horns and trumpets , except in obviously at ##onal music .

reference_raw: He advises those less trampled by convention than himself to accept the use of key signatures for both horns and trumpets, with the exception of apparently atonal music.

reference_spacy_tokens: He advises those less trampled by convention than himself to accept the use of key signatures for both horns and trumpets , with the exception of apparently atonal music .


fn_spacy_tokens_for_baseline: The black taffeta silk ballgown was strapless and backless with a plunging , gravity - defying decolletage .

source_bert_toks: the black ta ##ffe ##ta silk ball ##go ##wn was strap ##less and back ##less with a plunging , gravity - def ##ying deco ##llet ##age .

reference_raw: The black taffeta silk robe was strapless and backless with a plunging, gravitational decolletage.

reference_spacy_tokens: The black taffeta silk robe was strapless and backless with a plunging , gravitational decolletage .


fn_spacy_tokens_for_baseline: North Korea is continuing to develop the so - called " Taepodong-2 , " which is estimated to have intercontinental range .

source_bert_toks: north korea is continuing to develop the so - called " tae ##pod ##ong - 2 , " which is estimated to have intercontinental range .

reference_raw: North Korea continues to develop what is known as Taepodong-2, which is estimated to be intercontinental.

reference_spacy_tokens: North Korea continues to develop what is known as Taepodong-2 , which is estimated to be intercontinental .


fn_spacy_tokens_for_baseline: Changing abruptly to the shorter , natural day - length in March brings the goats into season between April and June to kid in September to November .

source_bert_toks: changing abruptly to the shorter , natural day - length in march brings the goats into season between april and june to kid in september to november .

reference_raw: The sudden change to a shorter natural day-length in March brings goats to the season between April and June and children between September and November.

reference_spacy_tokens: The sudden change to a shorter natural day - length in March brings goats to the season between April and June and children between September and November .


fn_spacy_tokens_for_baseline: ' You really must see this , ' Jeremy explains as he pockets the ignition key , ' it 's the heart of the nightlife area .

source_bert_toks: ' you really must see this , ' jeremy explains as he pockets the ignition key , ' it ' s the heart of the night ##life area .

reference_raw: 'You really have to see it,' Jeremy explains as he puts the ignition key in his hand, 'it's the heart of the nightlife.

reference_spacy_tokens: ' You really have to see it , ' Jeremy explains as he puts the ignition key in his hand , ' it 's the heart of the nightlife .


fn_spacy_tokens_for_baseline: His smile was contemptuous .

source_bert_toks: his smile was contempt ##uous .

reference_raw: His smile was disdainful.

reference_spacy_tokens: His smile was disdainful .


fn_spacy_tokens_for_baseline: KL Group Inc , Toronto , Ontario , has released the latest version of XRT / graph 2.2 , a graph widget and development tool enabling users to embed dynamic graphs and charts in X Window applications .

source_bert_toks: k ##l group inc , toronto , ontario , has released the latest version of x ##rt / graph 2 . 2 , a graph wi ##dget and development tool enabling users to em ##bed dynamic graphs and charts in x window applications .

reference_raw: KL Group Inc, Toronto, Ontario, published the latest version of XRT/Graph 2.2, a chart widget and development tool that allows users to insert dynamic charts and charts into X Window applications.

reference_spacy_tokens: KL Group Inc , Toronto , Ontario , published the latest version of XRT / Graph 2.2 , a chart widget and development tool that allows users to insert dynamic charts and charts into X Window applications .


fn_spacy_tokens_for_baseline: The table is ideal for circular sawing , jig sawing and shaping , and the top and frame are hot - dip galvanised for long life .

source_bert_toks: the table is ideal for circular saw ##ing , ji ##g saw ##ing and shaping , and the top and frame are hot - dip gal ##vani ##sed for long life .

reference_raw: The table is ideal for round cutting, cutting and shaping, and the top and frame are hot-dip galvanized for a long life.

reference_spacy_tokens: The table is ideal for round cutting , cutting and shaping , and the top and frame are hot - dip galvanized for a long life .


fn_spacy_tokens_for_baseline: ' Yeah well , I got busted for dope once .

source_bert_toks: ' yeah well , i got busted for do ##pe once .

reference_raw: Yeah, well, I got arrested once for drugs.

reference_spacy_tokens: Yeah , well , I got arrested once for drugs .


fn_spacy_tokens_for_baseline: Blanche wrinkled her forehead .

source_bert_toks: blanche wrinkled her forehead .

reference_raw: Blanche frowned.

reference_spacy_tokens: Blanche frowned .


fn_spacy_tokens_for_baseline: Shelling had destroyed a wing of the building and 200 children were living in the basement .

source_bert_toks: shell ##ing had destroyed a wing of the building and 200 children were living in the basement .

reference_raw: Shelling destroyed the building's flank, and 200 children lived in the cellar.

reference_spacy_tokens: Shelling destroyed the building 's flank , and 200 children lived in the cellar .


fn_spacy_tokens_for_baseline: With the Pakistan ball - tampering row at its height , Gower has embarrassed Lord 's by claiming the 1990 India tourists scuffed the ball at The Oval as they pressed for victory .

source_bert_toks: with the pakistan ball - tam ##per ##ing row at its height , go ##wer has embarrassed lord ' s by claiming the 1990 india tourists sc ##uf ##fed the ball at the oval as they pressed for victory .

reference_raw: With the Pakistani ball-tampering line at its height, Gower humiliated the Lord by claiming that the 1990 Indian tourists fought the ball at the Oval as they pressed for victory.

reference_spacy_tokens: With the Pakistani ball - tampering line at its height , Gower humiliated the Lord by claiming that the 1990 Indian tourists fought the ball at the Oval as they pressed for victory .


fn_spacy_tokens_for_baseline: It was the only European gateway to China , and through Macau flowed Western technology and religion .

source_bert_toks: it was the only european gateway to china , and through macau flowed western technology and religion .

reference_raw: It was the only gateway to China in Europe, and through Macao, Western technology and religion flowed.

reference_spacy_tokens: It was the only gateway to China in Europe , and through Macao , Western technology and religion flowed .


fn_spacy_tokens_for_baseline: The concepts involved are more vital to measurement than to those areas where girls do relatively well .

source_bert_toks: the concepts involved are more vital to measurement than to those areas where girls do relatively well .

reference_raw: The concepts in question are more important for measuring than for areas where girls are doing relatively well.

reference_spacy_tokens: The concepts in question are more important for measuring than for areas where girls are doing relatively well .


fn_spacy_tokens_for_baseline: The Kodak laboratories of my eidesis were being dismantled ; soon all that would be left was an out - of - order passport - photo - booth , mouldering on an empty station platform .

source_bert_toks: the ko ##dak laboratories of my e ##ides ##is were being dismantled ; soon all that would be left was an out - of - order passport - photo - booth , mo ##uld ##ering on an empty station platform .

reference_raw: The Kodak labs of my eidesis were being dismantled; soon all that remained was an out-of-order passport photo box, moulding on an empty station platform.

reference_spacy_tokens: The Kodak labs of my eidesis were being dismantled ; soon all that remained was an out - of - order passport photo box , moulding on an empty station platform .


fn_spacy_tokens_for_baseline: TABLE manners are a relatively recent invention , designed to clarify class boundaries .

source_bert_toks: table manners are a relatively recent invention , designed to clarify class boundaries .

reference_raw: TABLE modes are a relatively recent development designed to clarify the boundaries of the class.

reference_spacy_tokens: TABLE modes are a relatively recent development designed to clarify the boundaries of the class .


fn_spacy_tokens_for_baseline: If the events outlined by Kelly came as a shock or a surprise , he concealed it in his calm measured tones .

source_bert_toks: if the events outlined by kelly came as a shock or a surprise , he concealed it in his calm measured tones .

reference_raw: If the events Kelly had described were shock or surprise, he hid them in his calm, measured voice.

reference_spacy_tokens: If the events Kelly had described were shock or surprise , he hid them in his calm , measured voice .


fn_spacy_tokens_for_baseline: Her household utensils glittered and clanked in her lap , keys against scissors , knife against comb and spirtle and needle - case .

source_bert_toks: her household ut ##ens ##ils glitter ##ed and clan ##ked in her lap , keys against scissors , knife against comb and sp ##ir ##tle and needle - case .

reference_raw: Her household dishes glittered and clattered in her lap, keys to scissors, knives to combs, spirtles, and needle cases.

reference_spacy_tokens: Her household dishes glittered and clattered in her lap , keys to scissors , knives to combs , spirtles , and needle cases .


fn_spacy_tokens_for_baseline: I 'm awfully sorry , but in the morning we have to vacate . '

source_bert_toks: i ' m awful ##ly sorry , but in the morning we have to va ##cate . '

reference_raw: I'm sorry, but we have to leave in the morning.'

reference_spacy_tokens: I 'm sorry , but we have to leave in the morning . '


fn_spacy_tokens_for_baseline: ' We used to pelt the pigs with rotten potatoes . '

source_bert_toks: ' we used to pe ##lt the pigs with rotten potatoes . '

reference_raw: "We've been pelting pigs with rotted potatoes."

reference_spacy_tokens: " We 've been pelting pigs with rotted potatoes . "


fn_spacy_tokens_for_baseline: The central problem of the agrarian history of Tudor England has been the nature of the security enjoyed by copyholders .

source_bert_toks: the central problem of the agrarian history of tudor england has been the nature of the security enjoyed by copy ##holders .

reference_raw: The main issue in Tudor England's agrarian past is the nature of the security enjoyed by copyholders.

reference_spacy_tokens: The main issue in Tudor England 's agrarian past is the nature of the security enjoyed by copyholders .


fn_spacy_tokens_for_baseline: The contrast with her exhilaration on the frozen lake had come so swiftly .

source_bert_toks: the contrast with her ex ##hila ##ration on the frozen lake had come so swiftly .

reference_raw: The contrast to her excitement on the frozen lake came so quickly.

reference_spacy_tokens: The contrast to her excitement on the frozen lake came so quickly .


fn_spacy_tokens_for_baseline: " So crunch , crunch , crunch , bang , bang , bang -- here come the ringers from above , making a very obvious exit while the congregation is at prayer , " he says .

source_bert_toks: " so crunch , crunch , crunch , bang , bang , bang - - here come the ring ##ers from above , making a very obvious exit while the congregation is at prayer , " he says .

reference_raw: "That's crunching, crunching, crunching, banging, banging -- here comes the ringers from above, making a very clear exit while the congregation is praying," he says.

reference_spacy_tokens: " That 's crunching , crunching , crunching , banging , banging -- here comes the ringers from above , making a very clear exit while the congregation is praying , " he says .


fn_spacy_tokens_for_baseline: He said his was perhaps an ' old - fashioned ' view -- that he did not want to see the entire world addicted to drugs , like the synthetic existence described in Brave New World -- but it was an enormous leap , he thought , from ' smoking a little grass to that grim picture ' .

source_bert_toks: he said his was perhaps an ' old - fashioned ' view - - that he did not want to see the entire world addicted to drugs , like the synthetic existence described in brave new world - - but it was an enormous leap , he thought , from ' smoking a little grass to that grim picture ' .

reference_raw: He said that he might be "old-fashioned"-that he didn't want to see the whole world addicted to drugs, like the synthetic life described in Brave New World--but that was a huge leap, he thought, from "smoking a little weed to that gloomy picture."

reference_spacy_tokens: He said that he might be " old - fashioned"-that he did n't want to see the whole world addicted to drugs , like the synthetic life described in Brave New World -- but that was a huge leap , he thought , from " smoking a little weed to that gloomy picture . "


fn_spacy_tokens_for_baseline: Rice 's talent is in making these undead creatures so lifelike , so human , that the reader begins to feel for them .

source_bert_toks: rice ' s talent is in making these undead creatures so life ##like , so human , that the reader begins to feel for them .

reference_raw: Rice's talent is to make these dead creatures so lifelike, so human, that the reader is beginning to feel for them.

reference_spacy_tokens: Rice 's talent is to make these dead creatures so lifelike , so human , that the reader is beginning to feel for them .


fn_spacy_tokens_for_baseline: In the terminology of Locke ( 1964 , 1966 ) and Filshie ( 1970 ) there is a dense outer cuticulin layer about 10 nm thick which is very resistant to acids and organic solvents and probably contains a highly polymerized lipid .

source_bert_toks: in the terminology of locke ( 1964 , 1966 ) and fi ##ls ##hi ##e ( 1970 ) there is a dense outer cut ##ic ##ulin layer about 10 nm thick which is very resistant to acids and organic solvent ##s and probably contains a highly polymer ##ized lip ##id .

reference_raw: In the terminology of Locke (1964, 1966) and Filshie (1970), there is a dense outer cuticulin layer of approximately 10 nm thickness, which is highly resistant to acids and organic solvents and is likely to contain a highly polymerised lipid.

reference_spacy_tokens: In the terminology of Locke ( 1964 , 1966 ) and Filshie ( 1970 ) , there is a dense outer cuticulin layer of approximately 10 nm thickness , which is highly resistant to acids and organic solvents and is likely to contain a highly polymerised lipid .


fn_spacy_tokens_for_baseline: They talked over a meal that was prepared especially for her , and she found him a charming and entertaining companion .

source_bert_toks: they talked over a meal that was prepared especially for her , and she found him a charming and entertaining companion .

reference_raw: They talked about the food that had been specially prepared for her, and she found him a charming and amusing companion.

reference_spacy_tokens: They talked about the food that had been specially prepared for her , and she found him a charming and amusing companion .


fn_spacy_tokens_for_baseline: This complemented other missile component shipments that reportedly began in 1999 .

source_bert_toks: this complement ##ed other missile component shipments that reportedly began in 1999 .

reference_raw: This was complementary to other shipments of missile components, which allegedly started in 1999.

reference_spacy_tokens: This was complementary to other shipments of missile components , which allegedly started in 1999 .


fn_spacy_tokens_for_baseline: Frank sat in the back of Armstrong , occasionally kneeling up on the rumble seat so he could yell in my ear , but all the time talking .

source_bert_toks: frank sat in the back of armstrong , occasionally kneeling up on the rumble seat so he could yell in my ear , but all the time talking .

reference_raw: Frank was sitting in Armstrong's back, getting down from time to time on his rumbling seat so he could scream in my ear, but he was still talking.

reference_spacy_tokens: Frank was sitting in Armstrong 's back , getting down from time to time on his rumbling seat so he could scream in my ear , but he was still talking .


fn_spacy_tokens_for_baseline: Intruder jets from the aircraft carrier Ranger , and Cobra attack helicopters scoured the area for armed men .

source_bert_toks: intruder jets from the aircraft carrier ranger , and cobra attack helicopters sc ##oured the area for armed men .

reference_raw: Intruder fighters from Ranger's carrier and Cobra's attack helicopters searched the area for armed men.

reference_spacy_tokens: Intruder fighters from Ranger 's carrier and Cobra 's attack helicopters searched the area for armed men .


fn_spacy_tokens_for_baseline: ? This , however , does not qualify them or entitle them to claim authority on sociological or anthropological questions .

source_bert_toks: ? this , however , does not qualify them or en ##ti ##tle them to claim authority on sociological or anthropological questions .

reference_raw: This does not, however, give them the right to seek authority on sociological or anthropological issues.

reference_spacy_tokens: This does not , however , give them the right to seek authority on sociological or anthropological issues .


fn_spacy_tokens_for_baseline: If parents are dissatisfied with a school , they should have the option of switching to another .

source_bert_toks: if parents are dissatisfied with a school , they should have the option of switching to another .

reference_raw: If the parents are unhappy with the school, they should be able to switch to another school.

reference_spacy_tokens: If the parents are unhappy with the school , they should be able to switch to another school .


fn_spacy_tokens_for_baseline: QN : Does Duke plan on giving every new student a free iPod ?

source_bert_toks: q ##n : does duke plan on giving every new student a free ipod ?

reference_raw: QN: Is Duke going to give a free iPod to each new student?

reference_spacy_tokens: QN : Is Duke going to give a free iPod to each new student ?