fn_spacy_tokens_for_baseline: Within three days the city was completely in Israeli hands , and in two weeks it was physically and administratively reunited .

source_bert_toks: within three days the city was completely in israeli hands , and in two weeks it was physically and administratively reunited .

reference_raw: Within three days, the city was fully in Israeli hands, and within a fortnight, it was physically and administratively reunited.

reference_spacy_tokens: Within three days , the city was fully in Israeli hands , and within a fortnight , it was physically and administratively reunited .


fn_spacy_tokens_for_baseline: With a snarl that changed her smiling face into a grimace of pure hatred she threw herself at him , the weapon slashing for his face .

source_bert_toks: with a snarl that changed her smiling face into a grimace of pure hatred she threw herself at him , the weapon slash ##ing for his face .

reference_raw: With a growl that turned her smiling face into a grin of pure hatred, she threw herself at him, the weapon slashing at his face.

reference_spacy_tokens: With a growl that turned her smiling face into a grin of pure hatred , she threw herself at him , the weapon slashing at his face .


fn_spacy_tokens_for_baseline: I wo n't hurt you , but if you come near the boat , I 'll shoot you through the head ! '

source_bert_toks: i won ' t hurt you , but if you come near the boat , i ' ll shoot you through the head ! '

reference_raw: I'm not going to harm you, but if you get close to the ship, I'm going to shoot you in the head!'

reference_spacy_tokens: I 'm not going to harm you , but if you get close to the ship , I 'm going to shoot you in the head ! '


fn_spacy_tokens_for_baseline: Meanwhile , Bosnian Muslims and Croats stopped fighting today in Mostar and will exchange prisoners taken in pitched battles that devastated the ancient city , Croat radio reported .

source_bert_toks: meanwhile , bosnian muslims and croats stopped fighting today in most ##ar and will exchange prisoners taken in pitched battles that devastated the ancient city , cr ##oat radio reported .

reference_raw: In the meantime, Bosnian Muslims and Croatians stopped fighting today in Mostar and will exchange prisoners captured in pitched battles that destroyed the ancient city, Croat radio reported.

reference_spacy_tokens: In the meantime , Bosnian Muslims and Croatians stopped fighting today in Mostar and will exchange prisoners captured in pitched battles that destroyed the ancient city , Croat radio reported .


fn_spacy_tokens_for_baseline: Shaun Campbell surveys the back of the grid for grand prix racing 's biggest failures .

source_bert_toks: shaun campbell surveys the back of the grid for grand prix racing ' s biggest failures .

reference_raw: Shaun Campbell is exploring the back of the grid for the biggest failures of Grand Prix Race.

reference_spacy_tokens: Shaun Campbell is exploring the back of the grid for the biggest failures of Grand Prix Race .


fn_spacy_tokens_for_baseline: Put simply , the retailer must decide whether he is going to opt for ' quality ' or ' quantity ' .

source_bert_toks: put simply , the retailer must decide whether he is going to opt for ' quality ' or ' quantity ' .

reference_raw: In short, the retailer has to decide whether to choose 'quality' or 'quantity'.

reference_spacy_tokens: In short , the retailer has to decide whether to choose ' quality ' or ' quantity ' .


fn_spacy_tokens_for_baseline: But this year , it has finally decided to flower profusely , forming brownish clouds which drift hazily over the bush .

source_bert_toks: but this year , it has finally decided to flower prof ##use ##ly , forming brownish clouds which drift ha ##zily over the bush .

reference_raw: This year, however, he finally decided to blossom profusely, creating a brown cloud that floats hazyly over the bush.

reference_spacy_tokens: This year , however , he finally decided to blossom profusely , creating a brown cloud that floats hazyly over the bush .


fn_spacy_tokens_for_baseline: Four civilians were killed and 15 wounded in four roadside explosions in the western Shiite neighborhood of Bayaa .

source_bert_toks: four civilians were killed and 15 wounded in four roadside explosions in the western shi ##ite neighborhood of bay ##aa .

reference_raw: Four civilians have been killed and 15 injured in four roadside blasts in the western Shiite district of Bayaa.

reference_spacy_tokens: Four civilians have been killed and 15 injured in four roadside blasts in the western Shiite district of Bayaa .


fn_spacy_tokens_for_baseline: He makes sure that Dave Wynters , Stan Parsons and Eileen Tucker are totally conversant with the revenue status , if possible on a daily rather than weekly basis .

source_bert_toks: he makes sure that dave w ##yn ##ters , stan parsons and eileen tucker are totally con ##vers ##ant with the revenue status , if possible on a daily rather than weekly basis .

reference_raw: He ensures that Dave Wynters, Stan Parsons, and Eileen Tucker are in complete conversation with the state of income, if possible every day instead of every week.

reference_spacy_tokens: He ensures that Dave Wynters , Stan Parsons , and Eileen Tucker are in complete conversation with the state of income , if possible every day instead of every week .


fn_spacy_tokens_for_baseline: Who hates big mouths like Stock , Aitken and Waterbucket ?

source_bert_toks: who hates big mouths like stock , ai ##t ##ken and water ##buck ##et ?

reference_raw: Who doesn't like big kisses like Stock, Aitken and Waterbucket?

reference_spacy_tokens: Who does n't like big kisses like Stock , Aitken and Waterbucket ?


fn_spacy_tokens_for_baseline: The words were scarcely out before one of his taller companions clamped a hand round the back of his neck and with a dusty , unshod foot kicked his buttocks , exposed through his torn shorts .

source_bert_toks: the words were scarcely out before one of his taller companions clamped a hand round the back of his neck and with a dusty , un ##sho ##d foot kicked his butt ##ocks , exposed through his torn shorts .

reference_raw: The words were barely out before one of his taller companions clasped a hand around the back of his neck and kicked his buttocks with a dusty, unshocked foot, exposed to his torn shorts.

reference_spacy_tokens: The words were barely out before one of his taller companions clasped a hand around the back of his neck and kicked his buttocks with a dusty , unshocked foot , exposed to his torn shorts .


fn_spacy_tokens_for_baseline: Thai food is no exception : quick to cook and easy to prepare , these spicy dishes make an inventive alternative to the Sunday roast .

source_bert_toks: thai food is no exception : quick to cook and easy to prepare , these spicy dishes make an in ##vent ##ive alternative to the sunday roast .

reference_raw: Thai food is no exception: it is quick to cook and easy to prepare, and these spiced dishes are an inventive alternative to a Sunday roast.

reference_spacy_tokens: Thai food is no exception : it is quick to cook and easy to prepare , and these spiced dishes are an inventive alternative to a Sunday roast .


fn_spacy_tokens_for_baseline: A study of the skulls of both types showed they probably possessed mammal - like muscular cheeks , and the teeth fossils show they ground grain - like food .

source_bert_toks: a study of the skulls of both types showed they probably possessed mammal - like muscular cheeks , and the teeth fossils show they ground grain - like food .

reference_raw: A study of the skulls of both species indicated that they probably had mammalous, muscular cheeks, and the fossils of the teeth indicate that they ground grainy food.

reference_spacy_tokens: A study of the skulls of both species indicated that they probably had mammalous , muscular cheeks , and the fossils of the teeth indicate that they ground grainy food .


fn_spacy_tokens_for_baseline: She had taken off the ribbon that kept back her hair and it hung about her shoulders , much longer than Seb had realised .

source_bert_toks: she had taken off the ribbon that kept back her hair and it hung about her shoulders , much longer than se ##b had realised .

reference_raw: She removed the ribbon that held her hair back, and it hung around her shoulders for longer than Seb realized.

reference_spacy_tokens: She removed the ribbon that held her hair back , and it hung around her shoulders for longer than Seb realized .


fn_spacy_tokens_for_baseline: Wander down a meandering lane past a fisherman 's cottage , shops , workshops and yards .

source_bert_toks: wander down a mean ##der ##ing lane past a fisherman ' s cottage , shops , workshops and yards .

reference_raw: Walk down the middle lane around the fisherman's cabin, shops, workshops, and yards.

reference_spacy_tokens: Walk down the middle lane around the fisherman 's cabin , shops , workshops , and yards .


fn_spacy_tokens_for_baseline: The grass was scythed , the elm trees well - pruned and vigorous in their growth .

source_bert_toks: the grass was sc ##ythe ##d , the elm trees well - pr ##une ##d and vigorous in their growth .

reference_raw: The grass was scythed, and the elm trees were well-pruned and energetic in their growth.

reference_spacy_tokens: The grass was scythed , and the elm trees were well - pruned and energetic in their growth .


fn_spacy_tokens_for_baseline: Pi was filmed in the restaurant , in Cheltenham 's fashionable Montpelier district , as part of a programme which exposed his gang members beating up a business competitor in Manchester .

source_bert_toks: pi was filmed in the restaurant , in cheltenham ' s fashionable mont ##pel ##ier district , as part of a programme which exposed his gang members beating up a business competitor in manchester .

reference_raw: Pi was shot in a restaurant in Cheltenham's fashionable Montpelier district, as part of a program that exposes his gang members to beating up a business competitor in Manchester.

reference_spacy_tokens: Pi was shot in a restaurant in Cheltenham 's fashionable Montpelier district , as part of a program that exposes his gang members to beating up a business competitor in Manchester .


fn_spacy_tokens_for_baseline: She hunched even lower , rabbit - legged as if about to hop .

source_bert_toks: she hunched even lower , rabbit - legged as if about to hop .

reference_raw: She crouched even lower, rabbit-legged, as if she were about to jump.

reference_spacy_tokens: She crouched even lower , rabbit - legged , as if she were about to jump .


fn_spacy_tokens_for_baseline: It is commendable that they have once again quickly seized the opportunity to involve themselves fully with my Department in working towards the successful implementation of the council tax in 1993 .

source_bert_toks: it is com ##men ##dable that they have once again quickly seized the opportunity to involve themselves fully with my department in working towards the successful implementation of the council tax in 1993 .

reference_raw: It is laudable that they once again took the opportunity to fully engage with my department in their efforts to successfully implement the Council's tax in 1993.

reference_spacy_tokens: It is laudable that they once again took the opportunity to fully engage with my department in their efforts to successfully implement the Council 's tax in 1993 .


fn_spacy_tokens_for_baseline: In Market Weighton , East Yorkshire , there is a markstone right in the middle of the town , opposite the church , and in Pembridge , Herefordshire , Watkins found a markstone next to the market house .

source_bert_toks: in market weight ##on , east yorkshire , there is a marks ##tone right in the middle of the town , opposite the church , and in pe ##mb ##ridge , hereford ##shire , watkins found a marks ##tone next to the market house .

reference_raw: There's a markstone in Market Weighton, East Yorkshire, right in the center of the city, across from the church, and in Pembridge, Herefordshire, Watkins found a stone next to the marketplace.

reference_spacy_tokens: There 's a markstone in Market Weighton , East Yorkshire , right in the center of the city , across from the church , and in Pembridge , Herefordshire , Watkins found a stone next to the marketplace .


fn_spacy_tokens_for_baseline: It 's crazy to risk crashing during tests . '

source_bert_toks: it ' s crazy to risk crashing during tests . '

reference_raw: It's insane to risk crashing during the tests.'

reference_spacy_tokens: It 's insane to risk crashing during the tests . '


fn_spacy_tokens_for_baseline: Simultaneously many southern islands were devastated by the introduction of pigs , goats , sheep , cattle , rats , mice , cats and other alien species , to the lasting detriment of their vegetation and bird stocks .

source_bert_toks: simultaneously many southern islands were devastated by the introduction of pigs , goats , sheep , cattle , rats , mice , cats and other alien species , to the lasting det ##rim ##ent of their vegetation and bird stocks .

reference_raw: At the same time, many southern islands have been destroyed by the introduction of pigs, goats, sheep, cattle, rats, mice, cats and other alien species to the permanent detriment of their vegetation and bird populations.

reference_spacy_tokens: At the same time , many southern islands have been destroyed by the introduction of pigs , goats , sheep , cattle , rats , mice , cats and other alien species to the permanent detriment of their vegetation and bird populations .


fn_spacy_tokens_for_baseline: Paul Deacon , 33 , was lucky to be alive after he made a dash through the flames in his flat in Ford Way , Bishop Auckland , County Durham , in the middle of the night .

source_bert_toks: paul deacon , 33 , was lucky to be alive after he made a dash through the flames in his flat in ford way , bishop auckland , county durham , in the middle of the night .

reference_raw: Paul Deacon, 33 years old, was lucky to be alive when he ran through the flames of his apartment in Ford Way, Bishop Auckland, County Durham, in the middle of the night.

reference_spacy_tokens: Paul Deacon , 33 years old , was lucky to be alive when he ran through the flames of his apartment in Ford Way , Bishop Auckland , County Durham , in the middle of the night .


fn_spacy_tokens_for_baseline: Permanent Protection :

source_bert_toks: permanent protection :

reference_raw: Continuous security:

reference_spacy_tokens: Continuous security :


fn_spacy_tokens_for_baseline: Second , if the key assumption is valid , Democrats should have lower attendance rates on roll - call votes than Republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

source_bert_toks: second , if the key assumption is valid , democrats should have lower attendance rates on roll - call votes than republicans do to the extent that such votes reflect national policy making and that participating in such votes takes away from the time a legislator could otherwise devote to local benefit - seeking .

reference_raw: Secondly, if the key assumption is valid, Democrats should have a lower rate of participation in roll-call votes than the Republicans do, to the extent that such votes reflect national policy-making and that participation in such votes is taken away from the time when the legislature would otherwise have been able to devote itself to the search for regional benefits.

reference_spacy_tokens: Secondly , if the key assumption is valid , Democrats should have a lower rate of participation in roll - call votes than the Republicans do , to the extent that such votes reflect national policy - making and that participation in such votes is taken away from the time when the legislature would otherwise have been able to devote itself to the search for regional benefits .


fn_spacy_tokens_for_baseline: The cell line expressing GFP alone showed diffuse nuclear and cytoplasmic green fluorescence ( Figure 4A ) .

source_bert_toks: the cell line expressing g ##fp alone showed diffuse nuclear and cy ##top ##las ##mic green flu ##orescence ( figure 4a ) .

reference_raw: The cell line expressing GFP itself demonstrated diffuse nuclear and cytoplasmic green fluorescence (Figure 4A).

reference_spacy_tokens: The cell line expressing GFP itself demonstrated diffuse nuclear and cytoplasmic green fluorescence ( Figure 4A ) .


fn_spacy_tokens_for_baseline: But it must have taken some sweet talking from Newman to persuade Mansell 's wife Rosanne to agree .

source_bert_toks: but it must have taken some sweet talking from newman to persuade mans ##ell ' s wife rosa ##nne to agree .

reference_raw: But it must have taken some sweet talk from Newman to convince Mansell's woman, Rosanne, to agree with him.

reference_spacy_tokens: But it must have taken some sweet talk from Newman to convince Mansell 's woman , Rosanne , to agree with him .


fn_spacy_tokens_for_baseline: Robbery , yes , but brainless vandalism ? '

source_bert_toks: robbery , yes , but brain ##less van ##dal ##ism ? '

reference_raw: Robbery, yes, but vandalism without brains?'

reference_spacy_tokens: Robbery , yes , but vandalism without brains ? '


fn_spacy_tokens_for_baseline: These three important exceptions to copyright infringement are described and examined below .

source_bert_toks: these three important exceptions to copyright infringement are described and examined below .

reference_raw: These three important exceptions to copyright violations are described and examined below.

reference_spacy_tokens: These three important exceptions to copyright violations are described and examined below .


fn_spacy_tokens_for_baseline: These receipts are gummed into a special book kept for the purpose , as they would have to be produced if a claim for compensation is made .

source_bert_toks: these receipts are gum ##med into a special book kept for the purpose , as they would have to be produced if a claim for compensation is made .

reference_raw: Those receipts are stored in a special book kept for the purpose, since they would have to be produced in the event of a claim for damages.

reference_spacy_tokens: Those receipts are stored in a special book kept for the purpose , since they would have to be produced in the event of a claim for damages .


fn_spacy_tokens_for_baseline: She 's probably in a . stressful situation .

source_bert_toks: she ' s probably in a . stress ##ful situation .

reference_raw: He's probably in a ..stress situation.

reference_spacy_tokens: He 's probably in a .. stress situation .


fn_spacy_tokens_for_baseline: Philippa stared coolly back .

source_bert_toks: philipp ##a stared cool ##ly back .

reference_raw: Philippa looked back coldly.

reference_spacy_tokens: Philippa looked back coldly .


fn_spacy_tokens_for_baseline: Mozart 's nightly ritual , until his tenth year , of singing ' Oragna figata marina gamina fa ' with his father , is in no way a manifestation of tic disorder .

source_bert_toks: mozart ' s nightly ritual , until his tenth year , of singing ' or ##ag ##na fig ##ata marina ga ##mina fa ' with his father , is in no way a manifestation of ti ##c disorder .

reference_raw: Mozart's nocturnal ritual of singing "Oragna figata marina gamina fa" to his father until the tenth year of his life is in no way a manifestation of tic disorder.

reference_spacy_tokens: Mozart 's nocturnal ritual of singing " Oragna figata marina gamina fa " to his father until the tenth year of his life is in no way a manifestation of tic disorder .


fn_spacy_tokens_for_baseline: Scowling with concentration he began to load the six chambers of his Colt Patent Repeating Pistol with the lead which dragged down one pocket of his scarecrow 's morning coat .

source_bert_toks: scowl ##ing with concentration he began to load the six chambers of his colt patent repeating pistol with the lead which dragged down one pocket of his scare ##crow ' s morning coat .

reference_raw: He frowned intently and began to load the six chambers of his Colt Patent Recurring Pistol with a lead that pulled down one of the pockets of his scarecrow's morning jacket.

reference_spacy_tokens: He frowned intently and began to load the six chambers of his Colt Patent Recurring Pistol with a lead that pulled down one of the pockets of his scarecrow 's morning jacket .


fn_spacy_tokens_for_baseline: But there is no use pretending the Saturn - Pluto effect will be a piece of cake .

source_bert_toks: but there is no use pretending the saturn - pluto effect will be a piece of cake .

reference_raw: But there's no point in pretending that the Saturn-Pluto effect is a slice of cake.

reference_spacy_tokens: But there 's no point in pretending that the Saturn - Pluto effect is a slice of cake .


fn_spacy_tokens_for_baseline: As we tried to calm ourselves with sweet coffee , a Swiss traveller appeared .

source_bert_toks: as we tried to calm ourselves with sweet coffee , a swiss traveller appeared .

reference_raw: A Swiss traveller appeared as we tried to comfort ourselves with sweet coffee.

reference_spacy_tokens: A Swiss traveller appeared as we tried to comfort ourselves with sweet coffee .


fn_spacy_tokens_for_baseline: A large segment of British industry since the war has been publicly owned .

source_bert_toks: a large segment of british industry since the war has been publicly owned .

reference_raw: Since the war, a large part of the British industry has been publicly owned.

reference_spacy_tokens: Since the war , a large part of the British industry has been publicly owned .


fn_spacy_tokens_for_baseline: ' We listened to the song and drew our own conclusions , but it did n't matter what it meant , ' Nicholson recalled , ' because everyone was so stoned they could n't remember the words .

source_bert_toks: ' we listened to the song and drew our own conclusions , but it didn ' t matter what it meant , ' nicholson recalled , ' because everyone was so stone ##d they couldn ' t remember the words .

reference_raw: 'We've listened to the song and drawn our own conclusions, but it doesn't matter what it means,' said Nicholson, 'because everybody's so high they can't remember the words.

reference_spacy_tokens: ' We 've listened to the song and drawn our own conclusions , but it does n't matter what it means , ' said Nicholson , ' because everybody 's so high they ca n't remember the words .


fn_spacy_tokens_for_baseline: She 's always had a smile for me , Mr Feather . '

source_bert_toks: she ' s always had a smile for me , mr feather . '

reference_raw: She always laughed at me, Mr. Feather.'

reference_spacy_tokens: She always laughed at me , Mr. Feather . '


fn_spacy_tokens_for_baseline: Nuts can be eaten in moderation , but not cashew nuts as they are rich in carbohydrate .

source_bert_toks: nuts can be eaten in mode ##ration , but not cash ##ew nuts as they are rich in car ##bo ##hy ##dra ##te .

reference_raw: Nuts can be consumed moderately, but they can't cashew nuts because they're rich in carbohydrate.

reference_spacy_tokens: Nuts can be consumed moderately , but they ca n't cashew nuts because they 're rich in carbohydrate .


fn_spacy_tokens_for_baseline: She cackled , delighted with the queasy mixture on the plate , hot brown coffee lapping at the pale wedge of sugared pastry .

source_bert_toks: she ca ##ckle ##d , delighted with the que ##as ##y mixture on the plate , hot brown coffee lap ##ping at the pale wedge of sugar ##ed pastry .

reference_raw: She chuckled, pleased with the queasy mixture on her plate, and hot brown coffee lapped on a pale wedge of sugared bread.

reference_spacy_tokens: She chuckled , pleased with the queasy mixture on her plate , and hot brown coffee lapped on a pale wedge of sugared bread .


fn_spacy_tokens_for_baseline: Food and Drink : A dish for the party Thane Prince with ideas for that all - night election stint

source_bert_toks: food and drink : a dish for the party than ##e prince with ideas for that all - night election stint

reference_raw: Food and drink: food for the party Thane Prince with ideas for the all-night stand.

reference_spacy_tokens: Food and drink : food for the party Thane Prince with ideas for the all - night stand .


fn_spacy_tokens_for_baseline: Members of St Clare 's church , Newton Aycliffe , are planning a pilgrimage to Walsingham in May.

source_bert_toks: members of st clare ' s church , newton a ##y ##cliffe , are planning a pilgrimage to wal ##sing ##ham in may .

reference_raw: Members of St. Clare's Church, Newton Aycliffe, are planning to travel to Walsingham in May.

reference_spacy_tokens: Members of St. Clare 's Church , Newton Aycliffe , are planning to travel to Walsingham in May.


fn_spacy_tokens_for_baseline: And all of this can only be because you are very wicked indeed .

source_bert_toks: and all of this can only be because you are very wicked indeed .

reference_raw: And all this can only be because you're really bad.

reference_spacy_tokens: And all this can only be because you 're really bad .


fn_spacy_tokens_for_baseline: It has successfully developed and operated a port at Sheerness in Kent and drew on this experience in deciding to develop a commercial port in the easternmost portion of the old dockyard .

source_bert_toks: it has successfully developed and operated a port at sheer ##ness in kent and drew on this experience in deciding to develop a commercial port in the eastern ##most portion of the old dockyard .

reference_raw: It has successfully developed and operated a port in Sheerness in Kent and has benefited from this experience in deciding to develop a commercial port in the eastmost part of the old dockyard.

reference_spacy_tokens: It has successfully developed and operated a port in Sheerness in Kent and has benefited from this experience in deciding to develop a commercial port in the eastmost part of the old dockyard .


fn_spacy_tokens_for_baseline: This almost utopian - sounding conclusion -- that niceness and forgivingness pay -- came as a surprise to many of the experts , who had tried to be too cunning by submitting subtly nasty strategies ; while even those who had submitted nice strategies had not dared anything so forgiving as Tit for Two Tats .

source_bert_toks: this almost utopia ##n - sounding conclusion - - that nice ##ness and for ##giving ##ness pay - - came as a surprise to many of the experts , who had tried to be too cunning by submit ##ting subtly nasty strategies ; while even those who had submitted nice strategies had not dared anything so for ##giving as ti ##t for two ta ##ts .

reference_raw: This almost utopian-sounding conclusion - this goodness and forgiveness pay - had come as a surprise to many of the experts who had tried to be too crafty by presenting subtly ugly strategies; and even those who had presented nice strategies did not dare anything as forgiving as Tit for Two Tats.

reference_spacy_tokens: This almost utopian - sounding conclusion - this goodness and forgiveness pay - had come as a surprise to many of the experts who had tried to be too crafty by presenting subtly ugly strategies ; and even those who had presented nice strategies did not dare anything as forgiving as Tit for Two Tats .


fn_spacy_tokens_for_baseline: It does little for the already low standing of politicians in the public esteem for Major to say effectively that they did not have plans to raise taxes then and they only did it because it was necessary .

source_bert_toks: it does little for the already low standing of politicians in the public esteem for major to say effectively that they did not have plans to raise taxes then and they only did it because it was necessary .

reference_raw: For the already low position of politicians in public respect, it is not enough for majors to say effectively that they had no plans to raise taxes at the time, and they did so only because it was necessary.

reference_spacy_tokens: For the already low position of politicians in public respect , it is not enough for majors to say effectively that they had no plans to raise taxes at the time , and they did so only because it was necessary .


fn_spacy_tokens_for_baseline: He sentenced both to four years in a young offenders centre for hijacking and to six months for criminal damage .

source_bert_toks: he sentenced both to four years in a young offenders centre for hi ##jack ##ing and to six months for criminal damage .

reference_raw: He's convicted both of four years in the juvenile delinquency center for kidnapping and of six months for criminal damage.

reference_spacy_tokens: He 's convicted both of four years in the juvenile delinquency center for kidnapping and of six months for criminal damage .


fn_spacy_tokens_for_baseline: The second helper should squat at the person 's knees and put one arm under the upper thighs and one under the calves of the legs .

source_bert_toks: the second help ##er should squat at the person ' s knees and put one arm under the upper thighs and one under the calves of the legs .

reference_raw: The other assistant should crouch at his knees and place one arm under his upper thighs and one under his legs.

reference_spacy_tokens: The other assistant should crouch at his knees and place one arm under his upper thighs and one under his legs .


fn_spacy_tokens_for_baseline: His train to New York was scheduled to leave the station at 10:30 .

source_bert_toks: his train to new york was scheduled to leave the station at 10 : 30 .

reference_raw: His flight to New York was scheduled to leave the station at 10:30.

reference_spacy_tokens: His flight to New York was scheduled to leave the station at 10:30 .


fn_spacy_tokens_for_baseline: However , Angus did not intend to give up his pursuit of her ; she fascinated him as no other woman had .

source_bert_toks: however , angus did not intend to give up his pursuit of her ; she fascinated him as no other woman had .

reference_raw: But Angus had no intention of giving up chasing her; she fascinated him like no other woman.

reference_spacy_tokens: But Angus had no intention of giving up chasing her ; she fascinated him like no other woman .


fn_spacy_tokens_for_baseline: The answerphone flickers red from the centre of the carpet ; hesitantly I push the button .

source_bert_toks: the answer ##phone flicker ##s red from the centre of the carpet ; hesitantly i push the button .

reference_raw: The answerphone flashes red from the center of the carpet; I press the button hesitantly.

reference_spacy_tokens: The answerphone flashes red from the center of the carpet ; I press the button hesitantly .


fn_spacy_tokens_for_baseline: Nutty was not offended .

source_bert_toks: nut ##ty was not offended .

reference_raw: Nutty wasn't insulted.

reference_spacy_tokens: Nutty was n't insulted .


fn_spacy_tokens_for_baseline: To test procedures for treating wounds , the US military has shot bullets into pigs .

source_bert_toks: to test procedures for treating wounds , the us military has shot bullets into pigs .

reference_raw: In order to test wounds, the U.S. Army fired bullets into the pigs.

reference_spacy_tokens: In order to test wounds , the U.S. Army fired bullets into the pigs .


fn_spacy_tokens_for_baseline: At the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

source_bert_toks: at the same time , it does have a very sophisticated biotechnology infrastructure that includes leading research facilities and trained personnel .

reference_raw: At the same time, it has a highly sophisticated biotech infrastructure, including leading research facilities and trained personnel.

reference_spacy_tokens: At the same time , it has a highly sophisticated biotech infrastructure , including leading research facilities and trained personnel .


fn_spacy_tokens_for_baseline: But from this broken and scattered group of men and women came the startling message of the cross and resurrection with a conviction and power that neither the Jewish authorities nor the Roman rulers could stem .

source_bert_toks: but from this broken and scattered group of men and women came the startling message of the cross and resurrection with a conviction and power that neither the jewish authorities nor the roman rulers could stem .

reference_raw: But from this broken and scattered group of men and women came the startling message of the cross and of rebirth with a conviction and power that neither the Jewish authorities nor the Roman rulers could stem.

reference_spacy_tokens: But from this broken and scattered group of men and women came the startling message of the cross and of rebirth with a conviction and power that neither the Jewish authorities nor the Roman rulers could stem .


fn_spacy_tokens_for_baseline: He says she was abusive and accused him of abducting her child .

source_bert_toks: he says she was abusive and accused him of abd ##uc ##ting her child .

reference_raw: She said she was violent and accused him of kidnapping her child.

reference_spacy_tokens: She said she was violent and accused him of kidnapping her child .


fn_spacy_tokens_for_baseline: When serial washings were analysed for the presence of Ac - ASA , there was an exponential fall in concentration , compatible with removal of drug from the cell surface ( Fig 5 ) .

source_bert_toks: when serial washing ##s were anal ##yse ##d for the presence of ac - asa , there was an exponential fall in concentration , compatible with removal of drug from the cell surface ( fig 5 ) .

reference_raw: When serial washing was analysed for the presence of AC-ASA, the concentration was exponentially reduced, which is compatible with the removal of the drug from the cell surface (Figure 5).

reference_spacy_tokens: When serial washing was analysed for the presence of AC - ASA , the concentration was exponentially reduced , which is compatible with the removal of the drug from the cell surface ( Figure 5 ) .


fn_spacy_tokens_for_baseline: Tomorrow I will drive you down there .

source_bert_toks: tomorrow i will drive you down there .

reference_raw: I'll take you there tomorrow.

reference_spacy_tokens: I 'll take you there tomorrow .


fn_spacy_tokens_for_baseline: The withdrawal on Aug. 4 , 1990 , of the SMP from the government of former Prime Minister Harri Holkeri resulted in a Cabinet as listed on p. 37662 .

source_bert_toks: the withdrawal on aug . 4 , 1990 , of the sm ##p from the government of former prime minister ha ##rri ho ##lke ##ri resulted in a cabinet as listed on p . 37 ##66 ##2 .

reference_raw: The removal of the SMP from the Government of former Prime Minister Harri Holkeri on August 4, 1990 led to the cabinet listed on p. 37662.

reference_spacy_tokens: The removal of the SMP from the Government of former Prime Minister Harri Holkeri on August 4 , 1990 led to the cabinet listed on p. 37662 .


fn_spacy_tokens_for_baseline: As my hon . Friend the Member for East Lothian ( Mr. Home Robertson ) rightly pointed out , surely it is time for a little contrition .

source_bert_toks: as my hon . friend the member for east lot ##hian ( mr . home robertson ) right ##ly pointed out , surely it is time for a little con ##tri ##tion .

reference_raw: As my dear friend, the member of East Lothian (Mr. Home Robertson) rightly pointed out, I'm sure it's time for some criticism.

reference_spacy_tokens: As my dear friend , the member of East Lothian ( Mr. Home Robertson ) rightly pointed out , I 'm sure it 's time for some criticism .


fn_spacy_tokens_for_baseline: Hence , the powerful manager at work becomes the powerless driver of a vehicle caught in a traffic jam .

source_bert_toks: hence , the powerful manager at work becomes the powerless driver of a vehicle caught in a traffic jam .

reference_raw: That's why a strong manager at work becomes a helpless driver of a vehicle caught in traffic jams.

reference_spacy_tokens: That 's why a strong manager at work becomes a helpless driver of a vehicle caught in traffic jams .


fn_spacy_tokens_for_baseline: At one show a ' posse ' of 400 kids were waiting outside to ' get ' the band and one of their roadies was attacked by a youth with a knife .

source_bert_toks: at one show a ' posse ' of 400 kids were waiting outside to ' get ' the band and one of their road ##ies was attacked by a youth with a knife .

reference_raw: At one of the shows, a 'posse' of 400 children was waiting outside to 'get' the band, and one of the roadies was attacked by a young man with a knife.

reference_spacy_tokens: At one of the shows , a ' posse ' of 400 children was waiting outside to ' get ' the band , and one of the roadies was attacked by a young man with a knife .


fn_spacy_tokens_for_baseline: They then harangued their audience with long and complex arguments about the exploitative nature of capitalism and the need for working - class unity which no one , apart from themselves , wanted to hear .

source_bert_toks: they then hara ##ng ##ue ##d their audience with long and complex arguments about the exploit ##ative nature of capitalism and the need for working - class unity which no one , apart from themselves , wanted to hear .

reference_raw: Then they questioned their audience with long and complex arguments about capitalism's exploitation and the need for working class unity that no one but themselves wanted to hear.

reference_spacy_tokens: Then they questioned their audience with long and complex arguments about capitalism 's exploitation and the need for working class unity that no one but themselves wanted to hear .


fn_spacy_tokens_for_baseline: In the heart of the elegant perfumery department on the ground floor at Harrods , Guy Robert and his small team of perfume specialists will be available for consultations and Personally Created perfumes .

source_bert_toks: in the heart of the elegant perfume ##ry department on the ground floor at ha ##rro ##ds , guy robert and his small team of perfume specialists will be available for consultation ##s and personally created perfume ##s .

reference_raw: At the heart of the elegant perfumery section on the ground floor of Harrods, Guy Robert and his small group of perfume specialists will be available for consultation and personal perfumes.

reference_spacy_tokens: At the heart of the elegant perfumery section on the ground floor of Harrods , Guy Robert and his small group of perfume specialists will be available for consultation and personal perfumes .


fn_spacy_tokens_for_baseline: Did n't feel a thing , but noticed some strange bird behavior .

source_bert_toks: didn ' t feel a thing , but noticed some strange bird behavior .

reference_raw: I didn't feel anything, but I noticed some strange bird behaviour.

reference_spacy_tokens: I did n't feel anything , but I noticed some strange bird behaviour .


fn_spacy_tokens_for_baseline: Following his ejection from Kidderminster , the Bishop , the deans and many of the curates had preached long and bitter sermons against Richard Baxter to alienate the people from him .

source_bert_toks: following his e ##ject ##ion from kidd ##er ##minster , the bishop , the dean ##s and many of the curate ##s had preached long and bitter sermons against richard baxter to alien ##ate the people from him .

reference_raw: After being ejected by Kidderminster, the bishop, the dean, and many of the curates preached a long and bitter sermon against Richard Baxter to alienate his people.

reference_spacy_tokens: After being ejected by Kidderminster , the bishop , the dean , and many of the curates preached a long and bitter sermon against Richard Baxter to alienate his people .


fn_spacy_tokens_for_baseline: A Trappist monastery , situated on a hillside overlooking the east coast of Lantau , is also open to visitors .

source_bert_toks: a trap ##pis ##t monastery , situated on a hillside overlooking the east coast of lan ##ta ##u , is also open to visitors .

reference_raw: The Trappist monastery, situated on a hill overlooking the eastern shore of Lantau, is also accessible to visitors.

reference_spacy_tokens: The Trappist monastery , situated on a hill overlooking the eastern shore of Lantau , is also accessible to visitors .


fn_spacy_tokens_for_baseline: She had sprinted over the drive and was halfway across the stone - flagged terrace when a figure appeared around the corner of the house .

source_bert_toks: she had sprinted over the drive and was halfway across the stone - flag ##ged terrace when a figure appeared around the corner of the house .

reference_raw: She ran across the driveway and was halfway across the stone terrace when a figure appeared around the corner of the house.

reference_spacy_tokens: She ran across the driveway and was halfway across the stone terrace when a figure appeared around the corner of the house .


fn_spacy_tokens_for_baseline: A writer in the Town Planning Review trumpeted that train - sheds were now obsolete : ' modern terminals in great cities must be below street level hereafter ' .

source_bert_toks: a writer in the town planning review trumpet ##ed that train - sheds were now obsolete : ' modern terminals in great cities must be below street level here ##af ##ter ' .

reference_raw: The author of the Town Planning Review trumped that the train sheds were now out of date: 'The modern terminals in the big cities must be below the street level.'

reference_spacy_tokens: The author of the Town Planning Review trumped that the train sheds were now out of date : ' The modern terminals in the big cities must be below the street level . '


fn_spacy_tokens_for_baseline: Whatever the weather , tourists will flock to Oxford in their thousands every day .

source_bert_toks: whatever the weather , tourists will flock to oxford in their thousands every day .

reference_raw: No matter what the weather, the tourists come to Oxford every day in their thousands.

reference_spacy_tokens: No matter what the weather , the tourists come to Oxford every day in their thousands .


fn_spacy_tokens_for_baseline: The opening of the Pyramid redirected the circulation of visitors , but once one had left the escalators in the Hall Napoleon behind , one was confronted with the same layout of rooms as ten years ago .

source_bert_toks: the opening of the pyramid red ##ire ##cted the circulation of visitors , but once one had left the es ##cala ##tors in the hall napoleon behind , one was confronted with the same layout of rooms as ten years ago .

reference_raw: The opening of the pyramid rerouted the movement of visitors, but when one left the escalators in the Napoleon Hall, one faced the same layout of rooms as ten years ago.

reference_spacy_tokens: The opening of the pyramid rerouted the movement of visitors , but when one left the escalators in the Napoleon Hall , one faced the same layout of rooms as ten years ago .


fn_spacy_tokens_for_baseline: How could she notice such a trivial detail when her vision was impeded by tears ?

source_bert_toks: how could she notice such a trivial detail when her vision was imp ##eded by tears ?

reference_raw: How could she have noticed such a trivial detail when tears blocked her vision?

reference_spacy_tokens: How could she have noticed such a trivial detail when tears blocked her vision ?


fn_spacy_tokens_for_baseline: I was responsible for Community Programme for the last 18 months of its life , so I 'm delighted to be involved in introducing Community Action .

source_bert_toks: i was responsible for community programme for the last 18 months of its life , so i ' m delighted to be involved in introducing community action .

reference_raw: I have been responsible for the Community programme for the last 18 months of its life, so I am pleased to be involved in the implementation of Community action.

reference_spacy_tokens: I have been responsible for the Community programme for the last 18 months of its life , so I am pleased to be involved in the implementation of Community action .


fn_spacy_tokens_for_baseline: TERRY Venables was ousted as chief executive of Tottenham Hotspur yesterday but the bruising battle for the club 's future seemed far from over last night .

source_bert_toks: terry ve ##nable ##s was ousted as chief executive of tottenham hotspur yesterday but the br ##uising battle for the club ' s future seemed far from over last night .

reference_raw: TERRY Venables was quenched yesterday as head of Tottenham Hotspur, but yesterday's brutal battle for the future of the club seemed far from over.

reference_spacy_tokens: TERRY Venables was quenched yesterday as head of Tottenham Hotspur , but yesterday 's brutal battle for the future of the club seemed far from over .


fn_spacy_tokens_for_baseline: The Liberal Democratic Congress and the Confederation for an Independent Poland had pulled out of talks with Olszewski on the formation of a government because of differences over economic policy .

source_bert_toks: the liberal democratic congress and the confederation for an independent poland had pulled out of talks with ol ##sz ##ew ##ski on the formation of a government because of differences over economic policy .

reference_raw: The Liberal Democratic Congress and the Confederacy of Independent Poland withdrew their talks with Olszewski about the formation of a government due to differences in economic policy.

reference_spacy_tokens: The Liberal Democratic Congress and the Confederacy of Independent Poland withdrew their talks with Olszewski about the formation of a government due to differences in economic policy .


fn_spacy_tokens_for_baseline: The murder so shocked the nation that it eclipsed impeachment proceedings against President Fernando Collor de Mello , who resigned the next day in a corruption scandal .

source_bert_toks: the murder so shocked the nation that it eclipse ##d imp ##ea ##chment proceedings against president fernando col ##lor de mel ##lo , who resigned the next day in a corruption scandal .

reference_raw: The murder was such a shock to the nation that it blocked the prosecution of President Fernando Collor de Mello, who resigned the following day in a corruption scandal.

reference_spacy_tokens: The murder was such a shock to the nation that it blocked the prosecution of President Fernando Collor de Mello , who resigned the following day in a corruption scandal .


fn_spacy_tokens_for_baseline: He shuffles back to the sofa and drops heavily into his seat .

source_bert_toks: he shuffle ##s back to the sofa and drops heavily into his seat .

reference_raw: He steps back to the couch and falls heavily into his seat.

reference_spacy_tokens: He steps back to the couch and falls heavily into his seat .


fn_spacy_tokens_for_baseline: Prince Charles flew from Washington to Houston yesterday .

source_bert_toks: prince charles flew from washington to houston yesterday .

reference_raw: Last night, Prince Charles left Washington for Houston.

reference_spacy_tokens: Last night , Prince Charles left Washington for Houston .


fn_spacy_tokens_for_baseline: Later , when she went to the dining - room , Lucy was still simmering with resentment , and she knew that unless she pulled herself together it would begin to show .

source_bert_toks: later , when she went to the dining - room , lucy was still sim ##mering with resentment , and she knew that unless she pulled herself together it would begin to show .

reference_raw: Later, when she went into the dining room, Lucy was still smoldering with resentment, and she knew that if she didn't pull herself together, it would start to show.

reference_spacy_tokens: Later , when she went into the dining room , Lucy was still smoldering with resentment , and she knew that if she did n't pull herself together , it would start to show .


fn_spacy_tokens_for_baseline: The collaboration of artists with the stage was also brought to a high point by Serge Diaghilev , in his commissions to artists for the Russian Ballet .

source_bert_toks: the collaboration of artists with the stage was also brought to a high point by serge dia ##ghi ##lev , in his commissions to artists for the russian ballet .

reference_raw: Serge Diaghilev, in his work on artists for the Russian ballet, has also brought the artists to the top of the stage.

reference_spacy_tokens: Serge Diaghilev , in his work on artists for the Russian ballet , has also brought the artists to the top of the stage .


fn_spacy_tokens_for_baseline: Paul was less glad of the news than he should have been , in her opinion ; it was too far from his work at Mrs Gracie 's , he said .

source_bert_toks: paul was less glad of the news than he should have been , in her opinion ; it was too far from his work at mrs gracie ' s , he said .

reference_raw: Paul wasn't as happy about the news as she thought he should be; he said it was too far from his job at Mrs. Gracie's.

reference_spacy_tokens: Paul was n't as happy about the news as she thought he should be ; he said it was too far from his job at Mrs. Gracie 's .


fn_spacy_tokens_for_baseline: Now Charlie who has set a host of records in recent months is heading for another one -- the highest number of winners in the newly formed Irish jump season .

source_bert_toks: now charlie who has set a host of records in recent months is heading for another one - - the highest number of winners in the newly formed irish jump season .

reference_raw: Now Charlie, who's set up a series of records over the last few months, is heading for the next one - the highest number of winners in the newly created Irish jump season.

reference_spacy_tokens: Now Charlie , who 's set up a series of records over the last few months , is heading for the next one - the highest number of winners in the newly created Irish jump season .


fn_spacy_tokens_for_baseline: And we 're still , you know , fighting about changing the script and what have you .

source_bert_toks: and we ' re still , you know , fighting about changing the script and what have you .

reference_raw: And we're still, you know, arguing about how to change the script and what to do with you.

reference_spacy_tokens: And we 're still , you know , arguing about how to change the script and what to do with you .


fn_spacy_tokens_for_baseline: It was a statement of fact , one which again damned her , implying , as it did , that she had been the one to manipulate Peter into a liaison .

source_bert_toks: it was a statement of fact , one which again damned her , implying , as it did , that she had been the one to manipulate peter into a liaison .

reference_raw: It was a statement of fact, one that cursed her again, implying, as it was, that she was the one who rigged Peter to make contact with him.

reference_spacy_tokens: It was a statement of fact , one that cursed her again , implying , as it was , that she was the one who rigged Peter to make contact with him .


fn_spacy_tokens_for_baseline: Exploration of this area has been greatly hindered by the presence of lower Tertiary volcanics , for on seismic profiles these largely obscure the underlying geology of the basin .

source_bert_toks: exploration of this area has been greatly hind ##ered by the presence of lower tertiary volcanic ##s , for on seismic profiles these largely obscure the underlying geology of the basin .

reference_raw: The presence of lower tertiary volcanics hampers research in this area, since seismic profiles largely obscure the basic geology of the basin.

reference_spacy_tokens: The presence of lower tertiary volcanics hampers research in this area , since seismic profiles largely obscure the basic geology of the basin .


fn_spacy_tokens_for_baseline: The sharp sound of Sister Mary 's hand banging down on the square of writing paper stopped the chanting .

source_bert_toks: the sharp sound of sister mary ' s hand banging down on the square of writing paper stopped the chanting .

reference_raw: The sharp sound of Sister Mary's hand pounding on the plaza of paper stopped the chanting.

reference_spacy_tokens: The sharp sound of Sister Mary 's hand pounding on the plaza of paper stopped the chanting .


fn_spacy_tokens_for_baseline: He worked as a sports salesman , a bingo hall caller and a fruit seller before joining the Royal Navy .

source_bert_toks: he worked as a sports salesman , a bingo hall caller and a fruit seller before joining the royal navy .

reference_raw: Before joining the Royal Navy, he worked as a sports salesman, a bingo hall caller, and a fruit salesman.

reference_spacy_tokens: Before joining the Royal Navy , he worked as a sports salesman , a bingo hall caller , and a fruit salesman .


fn_spacy_tokens_for_baseline: I am your stepbrother .

source_bert_toks: i am your step ##bro ##ther .

reference_raw: I'm your half-brother.

reference_spacy_tokens: I 'm your half - brother .


fn_spacy_tokens_for_baseline: After my success , I was less sorry about deserting the stockade .

source_bert_toks: after my success , i was less sorry about desert ##ing the stock ##ade .

reference_raw: After my success, I didn't regret leaving the stockade.

reference_spacy_tokens: After my success , I did n't regret leaving the stockade .


fn_spacy_tokens_for_baseline: Carriers are prohibited from accepting cargo from NVOCC 's which do not have an up to date tariff filed with FMC , or which have not complied with the new regulations .

source_bert_toks: carriers are prohibited from accepting cargo from n ##vo ##cc ' s which do not have an up to date tariff filed with fm ##c , or which have not complied with the new regulations .

reference_raw: Carriers shall not accept cargo from NVOCCs which do not have an up-to-date tariff filed with the FMC or which do not comply with the new regulations.

reference_spacy_tokens: Carriers shall not accept cargo from NVOCCs which do not have an up - to - date tariff filed with the FMC or which do not comply with the new regulations .


fn_spacy_tokens_for_baseline: If necessary , such a person could then be sent on a suitable training course to learn any technical skills which might seem to be appropriate .

source_bert_toks: if necessary , such a person could then be sent on a suitable training course to learn any technical skills which might seem to be appropriate .

reference_raw: If necessary, such a person could then be sent to a suitable training course in order to acquire any technical skills that might be considered suitable.

reference_spacy_tokens: If necessary , such a person could then be sent to a suitable training course in order to acquire any technical skills that might be considered suitable .


fn_spacy_tokens_for_baseline: His body flexed as he hauled the heavy bike up on to the centre stand , and her heart jerked and accelerated to a steady two hundred beats a minute .

source_bert_toks: his body flexed as he hauled the heavy bike up on to the centre stand , and her heart jerked and accelerated to a steady two hundred beats a minute .

reference_raw: His body jerked as he pulled the heavy wheel into the center of the stall, and her heart jerked and accelerated to a steady two hundred beats a minute.

reference_spacy_tokens: His body jerked as he pulled the heavy wheel into the center of the stall , and her heart jerked and accelerated to a steady two hundred beats a minute .


fn_spacy_tokens_for_baseline: Her disappointment over Jonathan , which had driven her to France in the first place , had been relegated somewhere to the back of her mind .

source_bert_toks: her disappointment over jonathan , which had driven her to france in the first place , had been relegated somewhere to the back of her mind .

reference_raw: Her frustration with Jonathan, who had driven her to France in the first place, was in the back of her mind.

reference_spacy_tokens: Her frustration with Jonathan , who had driven her to France in the first place , was in the back of her mind .


fn_spacy_tokens_for_baseline: ' Better get off , ' grunted Selwyn , ' our Molly will'ave me dinner on . '

source_bert_toks: ' better get off , ' grunted se ##lwyn , ' our molly will ' ave me dinner on . '

reference_raw: "We'd better get out of here," Selwyn growled, "our Molly's going to have dinner with me."

reference_spacy_tokens: " We 'd better get out of here , " Selwyn growled , " our Molly 's going to have dinner with me . "


fn_spacy_tokens_for_baseline: This process is complicated to describe , but when expressed computationally it becomes a neat recursive procedure .

source_bert_toks: this process is complicated to describe , but when expressed computational ##ly it becomes a neat rec ##urs ##ive procedure .

reference_raw: This process is difficult to describe, but when calculated, it becomes a neat recursive process.

reference_spacy_tokens: This process is difficult to describe , but when calculated , it becomes a neat recursive process .


fn_spacy_tokens_for_baseline: The shipment of 16.48 kilograms of 93 per cent enriched uranium is destined for a 14-megawatt research reactor at Potesti , which was supplied by the California - based General Atomics company in the 1970s .

source_bert_toks: the shipment of 16 . 48 kilograms of 93 per cent enriched uranium is destined for a 14 - mega ##wat ##t research reactor at pot ##est ##i , which was supplied by the california - based general atomic ##s company in the 1970s .

reference_raw: A shipment of 16.48 kg of 93% enriched uranium is intended for a 14-megawatt research reactor in Potesti, supplied by the General Atomics Company of California in the 1970s.

reference_spacy_tokens: A shipment of 16.48 kg of 93 % enriched uranium is intended for a 14-megawatt research reactor in Potesti , supplied by the General Atomics Company of California in the 1970s .


fn_spacy_tokens_for_baseline: Mr Athulathmudali had defected from the ruling United National Party in 1991 and led a powerful opposition group , the Democratic United National Front .

source_bert_toks: mr at ##hul ##ath ##mu ##dal ##i had defected from the ruling united national party in 1991 and led a powerful opposition group , the democratic united national front .

reference_raw: In 1991, Mr. Athulathmudali fled the ruling United National Party and led a powerful opposition group, the Democratic United National Front.

reference_spacy_tokens: In 1991 , Mr. Athulathmudali fled the ruling United National Party and led a powerful opposition group , the Democratic United National Front .


fn_spacy_tokens_for_baseline: Other made - up stories included the Angels thwarting rapists and Sliwa being thrown 17 ft down a track by a shotgun - toting mugger .

source_bert_toks: other made - up stories included the angels th ##wart ##ing rap ##ists and sl ##i ##wa being thrown 17 ##ft down a track by a shotgun - to ##ting mug ##ger .

reference_raw: Other fictional stories included the Angels thwarting the rapists, and Sliwa was thrown 17ft down the track by a shotgun-totting robber.

reference_spacy_tokens: Other fictional stories included the Angels thwarting the rapists , and Sliwa was thrown 17 ft down the track by a shotgun - totting robber .


fn_spacy_tokens_for_baseline: She refused to accept this mortifying disgrace .

source_bert_toks: she refused to accept this mort ##ifying disgrace .

reference_raw: She refused to accept this humiliating shame.

reference_spacy_tokens: She refused to accept this humiliating shame .


fn_spacy_tokens_for_baseline: Alcock was cheered up by a letter from his CO at Mudros telling him the ' Your baby has just been given a new suit of clothes and is learning to walk .

source_bert_toks: al ##cock was cheered up by a letter from his co at mud ##ros telling him the ' your baby has just been given a new suit of clothes and is learning to walk .

reference_raw: Alcock was comforted by a letter from his commanding officer in Mudros that said, "Your child has just been given a new dress and is learning to walk.

reference_spacy_tokens: Alcock was comforted by a letter from his commanding officer in Mudros that said , " Your child has just been given a new dress and is learning to walk .


fn_spacy_tokens_for_baseline: So it is worth considering briefly here how to write a chase scene or a scene of action , something of course which comes in many other sorts of crime fiction .

source_bert_toks: so it is worth considering briefly here how to write a chase scene or a scene of action , something of course which comes in many other sorts of crime fiction .

reference_raw: So it's worth thinking briefly about how to write a chase scene or a scene of action, which, of course, comes from a lot of other types of crime fiction.

reference_spacy_tokens: So it 's worth thinking briefly about how to write a chase scene or a scene of action , which , of course , comes from a lot of other types of crime fiction .


fn_spacy_tokens_for_baseline: Of course , the information they glean is of little value if the Goblin is pulverised as he impacts with the ground .

source_bert_toks: of course , the information they g ##lean is of little value if the goblin is pu ##lver ##ised as he impacts with the ground .

reference_raw: The information they glean, of course, is of little value when the goblin is crushed as it hits the ground.

reference_spacy_tokens: The information they glean , of course , is of little value when the goblin is crushed as it hits the ground .


fn_spacy_tokens_for_baseline: Victor roared with good humour .

source_bert_toks: victor roared with good humour .

reference_raw: Victor bellowed with good humor.

reference_spacy_tokens: Victor bellowed with good humor .


fn_spacy_tokens_for_baseline: The SSC is designed to probe those high energies , and thus to make possible the creation of a grander theory , one that would contain the standard model but also surpass it .

source_bert_toks: the ss ##c is designed to probe those high energies , and thus to make possible the creation of a grande ##r theory , one that would contain the standard model but also sur ##pass it .

reference_raw: The SSC is designed to explore these high energy sources and thus to create a larger theory, one that contains the standard model, but also overcomes it.

reference_spacy_tokens: The SSC is designed to explore these high energy sources and thus to create a larger theory , one that contains the standard model , but also overcomes it .


fn_spacy_tokens_for_baseline: Julia , stunned but dry - eyed , had given her statement to the police .

source_bert_toks: julia , stunned but dry - eyed , had given her statement to the police .

reference_raw: Julia, bewildered but dry-eyed, gave her statement to the police.

reference_spacy_tokens: Julia , bewildered but dry - eyed , gave her statement to the police .


fn_spacy_tokens_for_baseline: But I have been unfair to the typists .

source_bert_toks: but i have been unfair to the ty ##pis ##ts .

reference_raw: But I wasn't fair to the typists.

reference_spacy_tokens: But I was n't fair to the typists .


fn_spacy_tokens_for_baseline: But it would be hard to argue , say , that Greeks are less moral because of the appalling corruption of and greed demonstrated by senior figures in the government and party of the socialist Andreas Papandreou .

source_bert_toks: but it would be hard to argue , say , that greeks are less moral because of the app ##all ##ing corruption of and greed demonstrated by senior figures in the government and party of the socialist andreas papa ##nd ##re ##ou .

reference_raw: But it would be difficult to argue, let's say, that Greeks are less ethical because of the terrible corruption and greed shown by senior figures in the government and the party of the socialist Andreas Papandreou.

reference_spacy_tokens: But it would be difficult to argue , let 's say , that Greeks are less ethical because of the terrible corruption and greed shown by senior figures in the government and the party of the socialist Andreas Papandreou .


fn_spacy_tokens_for_baseline: Washington received ' iron - clad information ' that protesters had destroyed crops and warehouses belonging to Tembo and his niece Mama Cecilia Kadzamira , the life president 's ' companion ' .

source_bert_toks: washington received ' iron - clad information ' that protesters had destroyed crops and warehouses belonging to te ##mbo and his niece mama cecilia ka ##d ##zam ##ira , the life president ' s ' companion ' .

reference_raw: Washington had received 'iron-clad information' that the protesters had destroyed the crops and storage facilities of Tembo and his niece, Mother Cecilia Kadzamira, the life president's "companion".

reference_spacy_tokens: Washington had received ' iron - clad information ' that the protesters had destroyed the crops and storage facilities of Tembo and his niece , Mother Cecilia Kadzamira , the life president 's " companion " .


fn_spacy_tokens_for_baseline: But as scores of motorists flocked to a nearby tyre centre to take advantage of the offer , the firm called a halt to the deal .

source_bert_toks: but as scores of motor ##ists flock ##ed to a nearby tyre centre to take advantage of the offer , the firm called a halt to the deal .

reference_raw: But as dozens of motorists flocked to a nearby tire center to take advantage of the offer, the company called off the deal.

reference_spacy_tokens: But as dozens of motorists flocked to a nearby tire center to take advantage of the offer , the company called off the deal .


fn_spacy_tokens_for_baseline: He claims the great record company he signed to as a teenager has become part of a giant electronics corporation .

source_bert_toks: he claims the great record company he signed to as a teenager has become part of a giant electronics corporation .

reference_raw: He claims that the great record company he signed when he was a teenager became part of a huge electronics company.

reference_spacy_tokens: He claims that the great record company he signed when he was a teenager became part of a huge electronics company .


fn_spacy_tokens_for_baseline: Last night he was being interrogated at Castlereagh , Belfast , by police including a chief superintendent heading a full - scale inquiry into the affair .

source_bert_toks: last night he was being inter ##rogated at castle ##rea ##gh , belfast , by police including a chief superintendent heading a full - scale inquiry into the affair .

reference_raw: He was questioned last night in Castlereagh, Belfast, by the police, including the Chief Inspector, who was conducting a full investigation into the matter.

reference_spacy_tokens: He was questioned last night in Castlereagh , Belfast , by the police , including the Chief Inspector , who was conducting a full investigation into the matter .


fn_spacy_tokens_for_baseline: We could hear them banging about , shifting things and wondered nervously if we were in for another move .

source_bert_toks: we could hear them banging about , shifting things and wondered nervously if we were in for another move .

reference_raw: We heard them bouncing around, changing things, and wondered nervously if we were going to make the next move.

reference_spacy_tokens: We heard them bouncing around , changing things , and wondered nervously if we were going to make the next move .


fn_spacy_tokens_for_baseline: It is possible that construction of the Natanz plant violated Iran 's IAEA safeguards obligations .

source_bert_toks: it is possible that construction of the nat ##an ##z plant violated iran ' s ia ##ea safeguard ##s obligations .

reference_raw: The construction of the Natanz plant may have been in breach of Iran's IAEA security obligations.

reference_spacy_tokens: The construction of the Natanz plant may have been in breach of Iran 's IAEA security obligations .


fn_spacy_tokens_for_baseline: The most direct example is the nervous airline passenger who is comforted by the belief that the middle - aged pilot he saw sitting on the flight deck is flying the aeroplane .

source_bert_toks: the most direct example is the nervous airline passenger who is comfort ##ed by the belief that the middle - aged pilot he saw sitting on the flight deck is flying the aero ##plane .

reference_raw: The most direct example is a nervous airline passenger, comforted by the belief that the middle-aged pilot he saw on the flight deck was flying the plane.

reference_spacy_tokens: The most direct example is a nervous airline passenger , comforted by the belief that the middle - aged pilot he saw on the flight deck was flying the plane .


fn_spacy_tokens_for_baseline: The bus trundled out into the Avenida Generalissimo Franco , a name that made my heart sink -- again the sharp , imperious police whistle -- faces looking in on us from outside , where the slow - moving crowds were talking and laughing .

source_bert_toks: the bus tr ##und ##led out into the ave ##ni ##da general ##iss ##imo franco , a name that made my heart sink - - again the sharp , imp ##eri ##ous police whistle - - faces looking in on us from outside , where the slow - moving crowds were talking and laughing .

reference_raw: The bus trudged into Avenida Generalissimo Franco, a name that made my heart sink - again with a sharp, commanding police whistle - faces staring at us from the outside, where the slow-moving crowds were talking and laughing.

reference_spacy_tokens: The bus trudged into Avenida Generalissimo Franco , a name that made my heart sink - again with a sharp , commanding police whistle - faces staring at us from the outside , where the slow - moving crowds were talking and laughing .


fn_spacy_tokens_for_baseline: He felt suddenly happy at being alive .

source_bert_toks: he felt suddenly happy at being alive .

reference_raw: He was suddenly glad to be alive.

reference_spacy_tokens: He was suddenly glad to be alive .


fn_spacy_tokens_for_baseline: The principal vehicle for implementing change was the dissemination of the company plan mapping out the route to cost competitiveness through work reorganization .

source_bert_toks: the principal vehicle for implementing change was the dissemination of the company plan mapping out the route to cost competitive ##ness through work reorganization .

reference_raw: The main vehicle for the implementation of the change was the dissemination of the company plan, which maps the path to cost-competitiveness through work reorganisations.

reference_spacy_tokens: The main vehicle for the implementation of the change was the dissemination of the company plan , which maps the path to cost - competitiveness through work reorganisations .


fn_spacy_tokens_for_baseline: ' Shallot , be so courteous as to tell Master Ruthven we await him here . '

source_bert_toks: ' shall ##ot , be so court ##eous as to tell master ruth ##ven we await him here . '

reference_raw: "Shallot, be polite enough to tell Master Ruthven we're waiting for him."

reference_spacy_tokens: " Shallot , be polite enough to tell Master Ruthven we 're waiting for him . "


fn_spacy_tokens_for_baseline: Came home in evening he says purposely to take me over next morn early .

source_bert_toks: came home in evening he says purposely to take me over next mor ##n early .

reference_raw: He came home in the middle of the night and said he was going to take me in early tomorrow.

reference_spacy_tokens: He came home in the middle of the night and said he was going to take me in early tomorrow .


fn_spacy_tokens_for_baseline: He launched into a detailed explanation , punctuated with stolen bites at the food on his plate , and Lissa followed his words with careful absorption , nodding occasionally .

source_bert_toks: he launched into a detailed explanation , pun ##ctuated with stolen bites at the food on his plate , and lissa followed his words with careful absorption , nodding occasionally .

reference_raw: He went into a detailed explanation, punctuated by stolen bites of food on his plate, and Lissa followed his words carefully, nodding from time to time.

reference_spacy_tokens: He went into a detailed explanation , punctuated by stolen bites of food on his plate , and Lissa followed his words carefully , nodding from time to time .


fn_spacy_tokens_for_baseline: Iditis is the most comprehensive and accurate resource of protein structure information available and provides a complete set of powerful data retrieval and analysis tools .

source_bert_toks: id ##itis is the most comprehensive and accurate resource of protein structure information available and provides a complete set of powerful data retrieval and analysis tools .

reference_raw: Iditis is the most comprehensive and accurate source of information on the structure of proteins available and provides a complete collection of robust data collection and analysis tools.

reference_spacy_tokens: Iditis is the most comprehensive and accurate source of information on the structure of proteins available and provides a complete collection of robust data collection and analysis tools .


fn_spacy_tokens_for_baseline: Mercury , the innermost planet , follows an elliptical orbit at a mean distance of 58 million km from the Sun .

source_bert_toks: mercury , the inner ##most planet , follows an elliptical orbit at a mean distance of 58 million km from the sun .

reference_raw: Mercury, the innermost planet, follows an elliptical trajectory at an average distance of 58 million kilometers from the sun.

reference_spacy_tokens: Mercury , the innermost planet , follows an elliptical trajectory at an average distance of 58 million kilometers from the sun .


fn_spacy_tokens_for_baseline: I had been asked by Professor John Mills and Dr James Waterhouse of Manchester School of Medicine to record my temperature every waking hour .

source_bert_toks: i had been asked by professor john mills and dr james water ##house of manchester school of medicine to record my temperature every waking hour .

reference_raw: Professor John Mills and Doctor James Waterhouse of the Manchester School of Medicine asked me to record my temperature every waking hour.

reference_spacy_tokens: Professor John Mills and Doctor James Waterhouse of the Manchester School of Medicine asked me to record my temperature every waking hour .


fn_spacy_tokens_for_baseline: The boardroom was full of women in hats and men in dark suits who looked like a convention of dentists .

source_bert_toks: the board ##room was full of women in hats and men in dark suits who looked like a convention of dentist ##s .

reference_raw: The conference room was filled with women in caps and men in dark suits who looked like a dentist convention.

reference_spacy_tokens: The conference room was filled with women in caps and men in dark suits who looked like a dentist convention .


fn_spacy_tokens_for_baseline: There were nine men around the fire , and they were cooking their terrible food .

source_bert_toks: there were nine men around the fire , and they were cooking their terrible food .

reference_raw: There were nine men around the fire, cooking their gruesome meals.

reference_spacy_tokens: There were nine men around the fire , cooking their gruesome meals .


fn_spacy_tokens_for_baseline: We strongly advise you against reheating your meal at a later time .

source_bert_toks: we strongly advise you against re ##hea ##ting your meal at a later time .

reference_raw: We strongly advise you not to heat your food later.

reference_spacy_tokens: We strongly advise you not to heat your food later .


fn_spacy_tokens_for_baseline: After being entertained to food the bride 's kin departed .

source_bert_toks: after being entertained to food the bride ' s kin departed .

reference_raw: After having fun eating, the bride's family left.

reference_spacy_tokens: After having fun eating , the bride 's family left .


fn_spacy_tokens_for_baseline: If you mumble or burble , give up all thought of advocacy .

source_bert_toks: if you mum ##ble or bu ##rb ##le , give up all thought of advocacy .

reference_raw: If you're mumbling or bubbling, stop thinking about defending yourself.

reference_spacy_tokens: If you 're mumbling or bubbling , stop thinking about defending yourself .


fn_spacy_tokens_for_baseline: It was n't ethical , but Celia seemed so terrified .

source_bert_toks: it wasn ' t ethical , but celia seemed so terrified .

reference_raw: It was not moral, but Celia seemed so frightened.

reference_spacy_tokens: It was not moral , but Celia seemed so frightened .


fn_spacy_tokens_for_baseline: But you 're all scrawny .

source_bert_toks: but you ' re all sc ##ra ##wny .

reference_raw: But you're all skinny.

reference_spacy_tokens: But you 're all skinny .


fn_spacy_tokens_for_baseline: I was dazzled by the clarity of Jean - Claude 's music .

source_bert_toks: i was da ##zzled by the clarity of jean - claude ' s music .

reference_raw: The clarity of Jean-Claude's music blinded me.

reference_spacy_tokens: The clarity of Jean - Claude 's music blinded me .


fn_spacy_tokens_for_baseline: A long way south a plump caique thudded past towing a line of six little lamp - boats , like a mallard with ducklings .

source_bert_toks: a long way south a plump cai ##que thud ##ded past towing a line of six little lamp - boats , like a mall ##ard with duck ##lings .

reference_raw: Far to the south, a plump caique thundered past a row of six small lamp-boats, like a duckling mallard.

reference_spacy_tokens: Far to the south , a plump caique thundered past a row of six small lamp - boats , like a duckling mallard .


fn_spacy_tokens_for_baseline: The landing was deserted , but the stench of blood was as strong as ever .

source_bert_toks: the landing was deserted , but the stench of blood was as strong as ever .

reference_raw: The landing was deserted, but the smell of blood was as strong as ever.

reference_spacy_tokens: The landing was deserted , but the smell of blood was as strong as ever .


fn_spacy_tokens_for_baseline: Standing barefoot in her pink - sprigged Laura Ashley nightgown , Clare looked from her bedroom window at the quietly falling snow .

source_bert_toks: standing barefoot in her pink - sp ##ri ##gged laura ashley night ##go ##wn , clare looked from her bedroom window at the quietly falling snow .

reference_raw: Clare stood barefoot in Laura Ashley's pink nightdress, staring out the bedroom window at the still-falling snow.

reference_spacy_tokens: Clare stood barefoot in Laura Ashley 's pink nightdress , staring out the bedroom window at the still - falling snow .


fn_spacy_tokens_for_baseline: Police have no leads , but everyone suspects the shooting is a payback for last year 's drive - by assassination of rival rapper Tupac Shakur .

source_bert_toks: police have no leads , but everyone suspects the shooting is a pay ##back for last year ' s drive - by assassination of rival rapper tu ##pac sha ##kur .

reference_raw: The police don't have any leads, but everyone suspects that the shooting was a retaliation for last year's drive-by murder of rival rapper Tupac Shakur.

reference_spacy_tokens: The police do n't have any leads , but everyone suspects that the shooting was a retaliation for last year 's drive - by murder of rival rapper Tupac Shakur .


fn_spacy_tokens_for_baseline: Emotional awareness , ie being open about feelings and having empathy for how other people are feeling

source_bert_toks: emotional awareness , ie being open about feelings and having empathy for how other people are feeling

reference_raw: Emotional awareness, i.e. being open to feelings and empathizing with the way other people feel.

reference_spacy_tokens: Emotional awareness , i.e. being open to feelings and empathizing with the way other people feel .


fn_spacy_tokens_for_baseline: If one tries to give a precise and explicit characterization of some paradigm in the history of science or in present - day science , it always turns out that some work within the paradigm violates the characterization .

source_bert_toks: if one tries to give a precise and explicit characterization of some paradigm in the history of science or in present - day science , it always turns out that some work within the paradigm violate ##s the characterization .

reference_raw: When you try to describe a certain paradigm precisely and explicitly in the history of science or current science, it always turns out that some work in the paradigm violates that characterization.

reference_spacy_tokens: When you try to describe a certain paradigm precisely and explicitly in the history of science or current science , it always turns out that some work in the paradigm violates that characterization .


fn_spacy_tokens_for_baseline: I studied homoeopathy in both Glasgow and London and then started a part - time appointment at the Glasgow Homoeopathic Hospital , taking over in addition a small general practice .

source_bert_toks: i studied homo ##eo ##pathy in both glasgow and london and then started a part - time appointment at the glasgow homo ##eo ##pathic hospital , taking over in addition a small general practice .

reference_raw: I looked at homoeopathy in both Glasgow and London, and then I started a part-time meeting at Glasgow Homoeopathic Hospital, taking on a little general practice.

reference_spacy_tokens: I looked at homoeopathy in both Glasgow and London , and then I started a part - time meeting at Glasgow Homoeopathic Hospital , taking on a little general practice .


fn_spacy_tokens_for_baseline: Her hair was dipping into the water and , stooping above her , Matthew was carefully pouring water from the jug , making a cascade over her hair as it washed the soapy water back into the bath .

source_bert_toks: her hair was dipping into the water and , st ##ooping above her , matthew was carefully pouring water from the jug , making a cascade over her hair as it washed the soap ##y water back into the bath .

reference_raw: Her hair was dipping into the water, and as she bent over her, Matthew carefully poured water from a jug, making a cascade over her hair as she washed the soapy water back into the bath.

reference_spacy_tokens: Her hair was dipping into the water , and as she bent over her , Matthew carefully poured water from a jug , making a cascade over her hair as she washed the soapy water back into the bath .


fn_spacy_tokens_for_baseline: Greater specialisation can also narrow horizons : ' For me , the highest pinnacle of achievement now is to be the director of a broadcast production .

source_bert_toks: greater special ##isation can also narrow horizons : ' for me , the highest pinnacle of achievement now is to be the director of a broadcast production .

reference_raw: Greater specialisation can also narrow the horizons: 'For me, the highest point of success now is to be the head of broadcast production.

reference_spacy_tokens: Greater specialisation can also narrow the horizons : ' For me , the highest point of success now is to be the head of broadcast production .


fn_spacy_tokens_for_baseline: The two Germanies confirmed ' their renunciation of the production and possession of and power to use nuclear , biological and chemical weapons ' .

source_bert_toks: the two german ##ies confirmed ' their ren ##unciation of the production and possession of and power to use nuclear , biological and chemical weapons ' .

reference_raw: Both Germans have confirmed that they have renounced the production, possession and power of nuclear, biological and chemical weapons.

reference_spacy_tokens: Both Germans have confirmed that they have renounced the production , possession and power of nuclear , biological and chemical weapons .


fn_spacy_tokens_for_baseline: Paula 's always fussing about her figure so she does n't go to Mr Roberts ' sweet shop , she buys tapes and magazines from the newsagent 's on the corner .

source_bert_toks: paula ' s always fuss ##ing about her figure so she doesn ' t go to mr roberts ' sweet shop , she buys tapes and magazines from the news ##age ##nt ' s on the corner .

reference_raw: Paula's always talking about her character, not going to Mr. Roberts' candy store, buying tapes and magazines from a newspaper in the corner.

reference_spacy_tokens: Paula 's always talking about her character , not going to Mr. Roberts ' candy store , buying tapes and magazines from a newspaper in the corner .


fn_spacy_tokens_for_baseline: When we indicated that we would like to clear him on the spot he was very reluctant to let us on board saying that the boat was ' in a hell of a mess ' !

source_bert_toks: when we indicated that we would like to clear him on the spot he was very reluctant to let us on board saying that the boat was ' in a hell of a mess ' !

reference_raw: When we indicated that we wanted to clean him up on the spot, he didn't want us on board to say that the ship was "in a hell of a mess"!

reference_spacy_tokens: When we indicated that we wanted to clean him up on the spot , he did n't want us on board to say that the ship was " in a hell of a mess " !


fn_spacy_tokens_for_baseline: The preservation of this wonderful home is ongoing ; a projected restoration of the original garden is still in progress .

source_bert_toks: the preservation of this wonderful home is ongoing ; a projected restoration of the original garden is still in progress .

reference_raw: The preservation of this beautiful house is underway; the planned restoration of the original yard is still underway.

reference_spacy_tokens: The preservation of this beautiful house is underway ; the planned restoration of the original yard is still underway .


fn_spacy_tokens_for_baseline: A reader , disgruntled in large proportion , sat down to work out how much of his salary he would have to hand over to the Inland Revenue heavy mob for the past year .

source_bert_toks: a reader , di ##sg ##run ##tled in large proportion , sat down to work out how much of his salary he would have to hand over to the inland revenue heavy mob for the past year .

reference_raw: The reader, dissatisfied in a large part, sat down to figure out how much of his salary he would have to hand over to the Inland Revenue Heavy Mafia for the last year.

reference_spacy_tokens: The reader , dissatisfied in a large part , sat down to figure out how much of his salary he would have to hand over to the Inland Revenue Heavy Mafia for the last year .


fn_spacy_tokens_for_baseline: She hopped across the lane and the ditch , and entered the woods .

source_bert_toks: she hopped across the lane and the ditch , and entered the woods .

reference_raw: She jumped across the lane and the ditch and stepped into the forest.

reference_spacy_tokens: She jumped across the lane and the ditch and stepped into the forest .


fn_spacy_tokens_for_baseline: Attention was switching to continental groups such as the Italian ' autonomists ' , who rejected the fruitless and mind - numbing discipline and line - toeing demanded by the other builders of the New Revolution .

source_bert_toks: attention was switching to continental groups such as the italian ' auto ##no ##mist ##s ' , who rejected the fruit ##less and mind - numb ##ing discipline and line - toe ##ing demanded by the other builders of the new revolution .

reference_raw: Attention went to continental groups like the Italian 'autonomists' who rejected the fruitless and mindless discipline and line-toeing required by the other builders of the new revolution.

reference_spacy_tokens: Attention went to continental groups like the Italian ' autonomists ' who rejected the fruitless and mindless discipline and line - toeing required by the other builders of the new revolution .


fn_spacy_tokens_for_baseline: Abdul Galeel Nazeer Karori , a leading Islamist and member of Sudan 's ruling National Congress party , said in Khartoum , " We will not allow any arrest or trial of a Sudanese official , unless they will arrest the 30 million Sudanese people and try them . "

source_bert_toks: abdul gale ##el na ##zee ##r ka ##ror ##i , a leading islamist and member of sudan ' s ruling national congress party , said in k ##hart ##oum , " we will not allow any arrest or trial of a sudanese official , unless they will arrest the 30 million sudanese people and try them . "

reference_raw: In Khartoum, Abdul Galeel Nazeer Karori, a leading Islamist and a member of the Sudanese ruling National Congress Party, said, "We will not allow the arrest or trial of a Sudanese official unless the 30 million Sudanese people are arrested and tested."

reference_spacy_tokens: In Khartoum , Abdul Galeel Nazeer Karori , a leading Islamist and a member of the Sudanese ruling National Congress Party , said , " We will not allow the arrest or trial of a Sudanese official unless the 30 million Sudanese people are arrested and tested . "


fn_spacy_tokens_for_baseline: Neighbours recalled how Ms Bailey was overjoyed at the birth of her daughter .

source_bert_toks: neighbours recalled how ms bailey was over ##joy ##ed at the birth of her daughter .

reference_raw: The neighbors remembered how much Mrs. Bailey was excited about her daughter's birth.

reference_spacy_tokens: The neighbors remembered how much Mrs. Bailey was excited about her daughter 's birth .


fn_spacy_tokens_for_baseline: The book , The One Percent Doctrine , by Pulitzer Prize winner Ron Suskind , says that designs for the device were found in February 2003 on a computer seized in Saudi Arabia after the arrest of a jihadist there , and that , a month later , U.S. intelligence separately uncovered an aborted plot to use several of them in an attack on the New York subway system . ( The Post Chronicle , 26Jun06 , Shaun Waterman ) ( Link )

source_bert_toks: the book , the one percent doctrine , by pulitzer prize winner ron su ##skin ##d , says that designs for the device were found in february 2003 on a computer seized in saudi arabia after the arrest of a jihad ##ist there , and that , a month later , u . s . intelligence separately uncovered an ab ##orted plot to use several of them in an attack on the new york subway system . ( the post chronicle , 26 ##jun ##0 ##6 , shaun water ##man ) ( link )

reference_raw: The book, The One Percent Doctrine, by the winner of the Pulitzer Prize, Ron Suskind, states that the designs of the equipment were found in February 2003 on a computer confiscated in Saudi Arabia after the arrest of a jihadist, and that, a month later, U.S. Intelligence discovered separately an aborted plot to use several of them in an attack on the New York Metro system (Post Chronicle, 26 June). Shaun Waterman)

reference_spacy_tokens: The book , The One Percent Doctrine , by the winner of the Pulitzer Prize , Ron Suskind , states that the designs of the equipment were found in February 2003 on a computer confiscated in Saudi Arabia after the arrest of a jihadist , and that , a month later , U.S. Intelligence discovered separately an aborted plot to use several of them in an attack on the New York Metro system ( Post Chronicle , 26 June ) . Shaun Waterman )


fn_spacy_tokens_for_baseline: The unit argues that traffic on motorways and urban roads is unlikely to increase over 50 % , so the main impact will fall on rural byways which are not equipped to cope with such a volume of vehicles .

source_bert_toks: the unit argues that traffic on motorway ##s and urban roads is unlikely to increase over 50 % , so the main impact will fall on rural by ##ways which are not equipped to cope with such a volume of vehicles .

reference_raw: According to the Unit, traffic on motorways and urban roads is unlikely to increase by more than 50%, with the result that the main impact will be on rural by-ways that are not equipped to cope with such a number of vehicles.

reference_spacy_tokens: According to the Unit , traffic on motorways and urban roads is unlikely to increase by more than 50 % , with the result that the main impact will be on rural by - ways that are not equipped to cope with such a number of vehicles .


fn_spacy_tokens_for_baseline: If someone upsets you , the most sensible thing to do is drop your stick , take off your gloves and go for him .

source_bert_toks: if someone upset ##s you , the most sensible thing to do is drop your stick , take off your gloves and go for him .

reference_raw: If you get upset, the wisest thing to do is to drop your cane, take off your mittens and go after them.

reference_spacy_tokens: If you get upset , the wisest thing to do is to drop your cane , take off your mittens and go after them .


fn_spacy_tokens_for_baseline: On 27th July 1155 Barbarossa razed Spoleto , which had paid him tribute earlier in false money .

source_bert_toks: on 27th july 115 ##5 bar ##bar ##ossa ra ##zed sp ##ole ##to , which had paid him tribute earlier in false money .

reference_raw: On July 27, 1155, Barbarossa raved Spoleto, who had paid tribute to him earlier with false money.

reference_spacy_tokens: On July 27 , 1155 , Barbarossa raved Spoleto , who had paid tribute to him earlier with false money .


fn_spacy_tokens_for_baseline: The bookcase was the top half of a big old - fashioned dresser .

source_bert_toks: the book ##case was the top half of a big old - fashioned dresser .

reference_raw: The library was the upper half of a large old-fashioned dresser.

reference_spacy_tokens: The library was the upper half of a large old - fashioned dresser .


fn_spacy_tokens_for_baseline: She loathed her mother 's loathing of Mrs Hanney ; it made her shiver with horror .

source_bert_toks: she lo ##ath ##ed her mother ' s lo ##athing of mrs han ##ney ; it made her shiver with horror .

reference_raw: She hated her mother's hatred for Mrs. Hanney; she shuddered with terror.

reference_spacy_tokens: She hated her mother 's hatred for Mrs. Hanney ; she shuddered with terror .


fn_spacy_tokens_for_baseline: That evening she typed up her interviews , she ate her usual boil - in - the - bag , individual meal , she washed up her plate , she rang up the only two rooms to let that sounded like feasible propositions ( the first one had gone and the second was intended solely for male occupation : ' I only take gentlemen ' ) and then , instead of reaching for the corkscrew , as was normally her wo nt at this time of night , she sat for a long while , gazing into the gas fire 's flame , wondering if life or fate or whatever it was could possibly -- a second time -- have engineered her future by means of making her pregnant .

source_bert_toks: that evening she typed up her interviews , she ate her usual boil - in - the - bag , individual meal , she washed up her plate , she rang up the only two rooms to let that sounded like feasible proposition ##s ( the first one had gone and the second was intended solely for male occupation : ' i only take gentlemen ' ) and then , instead of reaching for the cork ##sc ##rew , as was normally her won ##t at this time of night , she sat for a long while , gazing into the gas fire ' s flame , wondering if life or fate or whatever it was could possibly - - a second time - - have engineered her future by means of making her pregnant .

reference_raw: She wrote the interviews that night, ate her usual boil-in-the-bag meal, washed her plate, rang the only two rooms to make it sound like viable suggestions (the first one was gone, and the second was for male occupation only: "I only take gentlemen"), and then, instead of reaching for the corkscrew, as she usually would have done at this time of night, for a man's sake. For a long time, staring into the flame of the gas fire, wondering if life or fate or whatever it was could have-a second time-engineered her future by making her pregnant.

reference_spacy_tokens: She wrote the interviews that night , ate her usual boil - in - the - bag meal , washed her plate , rang the only two rooms to make it sound like viable suggestions ( the first one was gone , and the second was for male occupation only : " I only take gentlemen " ) , and then , instead of reaching for the corkscrew , as she usually would have done at this time of night , for a man 's sake . For a long time , staring into the flame of the gas fire , wondering if life or fate or whatever it was could have - a second time - engineered her future by making her pregnant .


fn_spacy_tokens_for_baseline: However , fired with enthusiasm from the successes in Sheffield , we opened for business in a church hall rented to us by a sympathetic vicar .

source_bert_toks: however , fired with enthusiasm from the successes in sheffield , we opened for business in a church hall rented to us by a sympathetic vicar .

reference_raw: But, excited by the successes of Sheffield, we opened up for business in a church hall leased to us by a sympathetic vicar.

reference_spacy_tokens: But , excited by the successes of Sheffield , we opened up for business in a church hall leased to us by a sympathetic vicar .


fn_spacy_tokens_for_baseline: The pro - Jewish New York Times describes him as ' tall , handsome and affable ' .

source_bert_toks: the pro - jewish new york times describes him as ' tall , handsome and af ##fa ##ble ' .

reference_raw: The pro-Jewish New York Times calls him "tall, handsome and friendly."

reference_spacy_tokens: The pro - Jewish New York Times calls him " tall , handsome and friendly . "


fn_spacy_tokens_for_baseline: Nutrient availability is thus enhanced but such scavenging also results in the trapping of pollutants , which can retard growth .

source_bert_toks: nutrient availability is thus enhanced but such sc ##ave ##nging also results in the trapping of poll ##uta ##nts , which can re ##tar ##d growth .

reference_raw: This increases the availability of nutrients, but also leads to the capture of pollutants, which may slow development.

reference_spacy_tokens: This increases the availability of nutrients , but also leads to the capture of pollutants , which may slow development .


fn_spacy_tokens_for_baseline: I expect it 's all right . '

source_bert_toks: i expect it ' s all right . '

reference_raw: I suppose that's all right.'

reference_spacy_tokens: I suppose that 's all right . '


fn_spacy_tokens_for_baseline: Lord Hesketh , who farms 5,000 acres at Towcester Northamptonshire , has become the first honorary vice - president of the British Simmental Cattle Society .

source_bert_toks: lord he ##ske ##th , who farms 5 , 000 acres at tow ##ces ##ter northamptonshire , has become the first honorary vice - president of the british sim ##mental cattle society .

reference_raw: Lord Hesketh, who farms 5,000 acres in Towcester Northamptonshire, is the first honorable vice president of the British Society of Simmental Cattles.

reference_spacy_tokens: Lord Hesketh , who farms 5,000 acres in Towcester Northamptonshire , is the first honorable vice president of the British Society of Simmental Cattles .