fn_spacy_tokens_for_baseline: In the great mission to cleanse America of subversives , the artist 's profession was , in itself , liable to invite suspicion .

source_bert_toks: in the great mission to clean ##se america of sub ##vers ##ives , the artist ' s profession was , in itself , liable to invite suspicion .

reference_raw: In the great mission of purging America of subversives, the artist's profession itself could inspire suspicion.

reference_spacy_tokens: In the great mission of purging America of subversives , the artist 's profession itself could inspire suspicion .


fn_spacy_tokens_for_baseline: In the harsh terrain of north - eastern Sudan , the Rashida and the Beja nomads compete for scarce resources .

source_bert_toks: in the harsh terrain of north - eastern sudan , the rashid ##a and the be ##ja no ##mad ##s compete for scarce resources .

reference_raw: Rashida and Beja nomads compete for limited resources in the harsh terrain of Northeast Sudan.

reference_spacy_tokens: Rashida and Beja nomads compete for limited resources in the harsh terrain of Northeast Sudan .


fn_spacy_tokens_for_baseline: Crushed ambitions and women 's lib feelings had rallied to the author 's right to identify herself with a polished ship .

source_bert_toks: crushed ambitions and women ' s li ##b feelings had rallied to the author ' s right to identify herself with a polished ship .

reference_raw: Crashed ambitions and women's lib feelings rallied into the author's right to identify himself with a polished ship.

reference_spacy_tokens: Crashed ambitions and women 's lib feelings rallied into the author 's right to identify himself with a polished ship .


fn_spacy_tokens_for_baseline: It was empty ; they had breakfasted upstairs in Susan 's room .

source_bert_toks: it was empty ; they had breakfast ##ed upstairs in susan ' s room .

reference_raw: It was empty; they were eating up in Susan's room.

reference_spacy_tokens: It was empty ; they were eating up in Susan 's room .


fn_spacy_tokens_for_baseline: One writer , signing his letter as " Red - blooded , balanced male , " remarked on the " frequency of women fainting in peals , " and suggested that they " settle back into their traditional role of making tea at meetings .

source_bert_toks: one writer , signing his letter as " red - blooded , balanced male , " remarked on the " frequency of women faint ##ing in pea ##ls , " and suggested that they " settle back into their traditional role of making tea at meetings .

reference_raw: One of the writers, who signed his letter as a red-blooded, balanced man, commented on the "frequency of women passing out in peals" and suggested that they "return to their traditional role of making tea in meetings.

reference_spacy_tokens: One of the writers , who signed his letter as a red - blooded , balanced man , commented on the " frequency of women passing out in peals " and suggested that they " return to their traditional role of making tea in meetings .


fn_spacy_tokens_for_baseline: The year - earlier results have been restated to reflect an accounting change .

source_bert_toks: the year - earlier results have been rest ##ated to reflect an accounting change .

reference_raw: Year - earlier outcomes were restated in order to reflect the change in accounting.

reference_spacy_tokens: Year - earlier outcomes were restated in order to reflect the change in accounting .


fn_spacy_tokens_for_baseline: A petrol - filled barge was ignited off Shoeburyness on August 8 .

source_bert_toks: a petrol - filled barge was ignited off shoe ##bury ##ness on august 8 .

reference_raw: On August 8th, a gas-filled boat was set on fire from Shoeburyness.

reference_spacy_tokens: On August 8th , a gas - filled boat was set on fire from Shoeburyness .


fn_spacy_tokens_for_baseline: We passed close by the islet , disturbing a number of grey seals basking on the dark rocks and putting a party of shags to flight .

source_bert_toks: we passed close by the isle ##t , disturbing a number of grey seals bas ##king on the dark rocks and putting a party of sha ##gs to flight .

reference_raw: We passed near the island, interrupting a series of gray seals that basked on the dark rocks and sent a group of shags flying.

reference_spacy_tokens: We passed near the island , interrupting a series of gray seals that basked on the dark rocks and sent a group of shags flying .


fn_spacy_tokens_for_baseline: ' I 'm pinching the underpinning skin in the fingers of my right hand , and I 'm jostling my balls nervously with my left hand . '

source_bert_toks: ' i ' m pinch ##ing the under ##pin ##ning skin in the fingers of my right hand , and i ' m jo ##st ##ling my balls nervously with my left hand . '

reference_raw: "I bite the backskin of my right hand and nervously push my balls with my left hand."

reference_spacy_tokens: " I bite the backskin of my right hand and nervously push my balls with my left hand . "


fn_spacy_tokens_for_baseline: " I rode a bike to Goodwill in the rain and snow .

source_bert_toks: " i rode a bike to goodwill in the rain and snow .

reference_raw: "In the rain and snow I rode my bicycle to Goodwill.

reference_spacy_tokens: " In the rain and snow I rode my bicycle to Goodwill .


fn_spacy_tokens_for_baseline: I do n't know why makers leave nuts high in this way ; if they have real confidence in their necks , they should set nuts up perfectly before the guitars leave the workshop .

source_bert_toks: i don ' t know why makers leave nuts high in this way ; if they have real confidence in their necks , they should set nuts up perfectly before the guitars leave the workshop .

reference_raw: I don't know why makers keep their nuts high like that; if they really trust their necks, they'd better put the nuts in perfect order before the guitars leave the shop.

reference_spacy_tokens: I do n't know why makers keep their nuts high like that ; if they really trust their necks , they 'd better put the nuts in perfect order before the guitars leave the shop .


fn_spacy_tokens_for_baseline: As a tort , however , it was little developed until the second half of the nineteenth century and the law remained obscure until the decision of the House of Lords in Crofter Hand - Woven Harris Tweed Co.

source_bert_toks: as a tor ##t , however , it was little developed until the second half of the nineteenth century and the law remained obscure until the decision of the house of lords in croft ##er hand - woven harris tweed co .

reference_raw: But it had not been developed until the second half of the nineteenth century, and the law remained unclear until the decision of the House of Lords at Crofter Hand-Woven Harris Tweed Co.

reference_spacy_tokens: But it had not been developed until the second half of the nineteenth century , and the law remained unclear until the decision of the House of Lords at Crofter Hand - Woven Harris Tweed Co.


fn_spacy_tokens_for_baseline: The second marriage united Judith 's brother Conrad with Adelaide , who was Lothar 's sister - in - law .

source_bert_toks: the second marriage united judith ' s brother conrad with adelaide , who was lot ##har ' s sister - in - law .

reference_raw: Judith's brother Conrad and Adelaide, Lothar's brother-in-law, were united in the second marriage.

reference_spacy_tokens: Judith 's brother Conrad and Adelaide , Lothar 's brother - in - law , were united in the second marriage .


fn_spacy_tokens_for_baseline: At himself for the doubts that ate at him , and at his ancestor for giving him nothing more than a string of empty plat itudes .

source_bert_toks: at himself for the doubts that ate at him , and at his ancestor for giving him nothing more than a string of empty pl ##at it ##udes .

reference_raw: To himself for the doubts that ate him, and to his predecessor for giving him nothing but a string of empty plat itudes.

reference_spacy_tokens: To himself for the doubts that ate him , and to his predecessor for giving him nothing but a string of empty plat itudes .


fn_spacy_tokens_for_baseline: She flew down the stairs and across the atrium floor , her heels clicking against the tiles .

source_bert_toks: she flew down the stairs and across the atrium floor , her heels clicking against the tiles .

reference_raw: She flew down the stairs and across the atrium floor, her heels clattering against the tiles.

reference_spacy_tokens: She flew down the stairs and across the atrium floor , her heels clattering against the tiles .


fn_spacy_tokens_for_baseline: The convoy was scheduled to overnight in Croatian Serb - held territory and reach the Bihac pocket on Saturday .

source_bert_toks: the convoy was scheduled to overnight in croatian serb - held territory and reach the bi ##ha ##c pocket on saturday .

reference_raw: The convoy was supposed to spend the night in Croatian Serbian territory and reach the Bihac pocket on Saturday.

reference_spacy_tokens: The convoy was supposed to spend the night in Croatian Serbian territory and reach the Bihac pocket on Saturday .


fn_spacy_tokens_for_baseline: Mastic varnish will dry in around 15 minutes , so you would have to work quickly .

source_bert_toks: mast ##ic var ##nish will dry in around 15 minutes , so you would have to work quickly .

reference_raw: In about 15 minutes, the mastic varnish will be desiccated, so you'd have to work fast.

reference_spacy_tokens: In about 15 minutes , the mastic varnish will be desiccated , so you 'd have to work fast .


fn_spacy_tokens_for_baseline: The women in the house are all toting thirty - eights in their Gucci bags .

source_bert_toks: the women in the house are all to ##ting thirty - eight ##s in their gu ##cci bags .

reference_raw: All the women in the house put thirty-eight in their Gucci bags.

reference_spacy_tokens: All the women in the house put thirty - eight in their Gucci bags .


fn_spacy_tokens_for_baseline: This replaced the jacket with a windcheater and the kepi with a Chicago - style police cap .

source_bert_toks: this replaced the jacket with a wind ##che ##ater and the ke ##pi with a chicago - style police cap .

reference_raw: This replaced the jacket with a windbreaker and a kepi with a Chicago police cap.

reference_spacy_tokens: This replaced the jacket with a windbreaker and a kepi with a Chicago police cap .


fn_spacy_tokens_for_baseline: Not the svelte , slim , sophisticated Dietrich created by Sternberg when they both went on to Hollywood together , but a rather plump and slovenly Dietrich .

source_bert_toks: not the sv ##elt ##e , slim , sophisticated dietrich created by stern ##berg when they both went on to hollywood together , but a rather plump and sl ##oven ##ly dietrich .

reference_raw: Not the svelt, slim, ingenious Dietrich that Sternberg had created when the two of them had gone to Hollywood together, but rather plump and sloven Dietrich.

reference_spacy_tokens: Not the svelt , slim , ingenious Dietrich that Sternberg had created when the two of them had gone to Hollywood together , but rather plump and sloven Dietrich .


fn_spacy_tokens_for_baseline: At a more local level , Barker and McGregor ( 1988 ) have examined the landscape changes that have occurred in the Yallahs basin , a drainage basin of 180 km situated in the Blue Mountains northeast of Kingston , Jamaica 's capital .

source_bert_toks: at a more local level , barker and mcgregor ( 1988 ) have examined the landscape changes that have occurred in the ya ##llah ##s basin , a drainage basin of 180 km situated in the blue mountains northeast of kingston , jamaica ' s capital .

reference_raw: At a more local level, Barker and McGregor (1988) examined the changes in the landscape in the Yallahs basin, a drainage basin of 180 km located in the Blue Mountains north-east of Kingston, the capital of Jamaica.

reference_spacy_tokens: At a more local level , Barker and McGregor ( 1988 ) examined the changes in the landscape in the Yallahs basin , a drainage basin of 180 km located in the Blue Mountains north - east of Kingston , the capital of Jamaica .


fn_spacy_tokens_for_baseline: I am waiting to hear back from Patti on May and June to make sure they are okay with her .

source_bert_toks: i am waiting to hear back from patti on may and june to make sure they are okay with her .

reference_raw: I'm waiting to hear from Patti in May and June to see if she's okay with them.

reference_spacy_tokens: I 'm waiting to hear from Patti in May and June to see if she 's okay with them .


fn_spacy_tokens_for_baseline: This means that the earlier categorisations of feminism ( socialist feminism , liberal feminism , radical feminism ) no longer work .

source_bert_toks: this means that the earlier cat ##ego ##ris ##ations of feminism ( socialist feminism , liberal feminism , radical feminism ) no longer work .

reference_raw: This means that the previous categories of feminism (socialist feminism, liberal feminism, radical feminism) are no longer working.

reference_spacy_tokens: This means that the previous categories of feminism ( socialist feminism , liberal feminism , radical feminism ) are no longer working .


fn_spacy_tokens_for_baseline: He downed more wine .

source_bert_toks: he downed more wine .

reference_raw: He lowered more wine.

reference_spacy_tokens: He lowered more wine .


fn_spacy_tokens_for_baseline: We dress up like bit - part players in an epic on Scott and go out into the night where the air bites clean and deep , and the snow crunches in that beautiful cold way .

source_bert_toks: we dress up like bit - part players in an epic on scott and go out into the night where the air bites clean and deep , and the snow crunch ##es in that beautiful cold way .

reference_raw: We dress up like bit-part players in Scott's epic, and we go out into the night, where the air bites clean and deep, and the snow cracks in a beautiful, cool way.

reference_spacy_tokens: We dress up like bit - part players in Scott 's epic , and we go out into the night , where the air bites clean and deep , and the snow cracks in a beautiful , cool way .


fn_spacy_tokens_for_baseline: That was all , except for a little box by the bed covered with a beautiful silky blue and green scarf with long black fringes .

source_bert_toks: that was all , except for a little box by the bed covered with a beautiful silky blue and green scarf with long black fringe ##s .

reference_raw: That was all, except for a small box by the bed, covered with a beautiful silk-blue and green scarf with long black edges.

reference_spacy_tokens: That was all , except for a small box by the bed , covered with a beautiful silk - blue and green scarf with long black edges .


fn_spacy_tokens_for_baseline: In its raw state , cocoa is very bitter , and the beans , once removed from the pods , are left to ferment to diminish the bitter flavour before they are processed .

source_bert_toks: in its raw state , cocoa is very bitter , and the beans , once removed from the pods , are left to fe ##rm ##ent to dim ##ini ##sh the bitter flavour before they are processed .

reference_raw: In its raw state, the cocoa is sour and the beans, once removed from the pods, are left to ferment in order to reduce the acidic taste prior to processing.

reference_spacy_tokens: In its raw state , the cocoa is sour and the beans , once removed from the pods , are left to ferment in order to reduce the acidic taste prior to processing .


fn_spacy_tokens_for_baseline: In its 19 December 2003 announcement that it was eliminating all materials , equipment and programs proscribed by the international community , Libya took the unusual step of first publicly revealing its nuclear weapons program , then renouncing it .

source_bert_toks: in its 19 december 2003 announcement that it was eliminating all materials , equipment and programs pro ##scribe ##d by the international community , libya took the unusual step of first publicly revealing its nuclear weapons program , then reno ##un ##cing it .

reference_raw: In its notification of 19 December 2003 of the elimination of all materials, equipment and programs prohibited by the international community, Libya took an unusual step to reveal its nuclear weapons program to the public and then to renounce it.

reference_spacy_tokens: In its notification of 19 December 2003 of the elimination of all materials , equipment and programs prohibited by the international community , Libya took an unusual step to reveal its nuclear weapons program to the public and then to renounce it .


fn_spacy_tokens_for_baseline: That night I packed , ordered the cook to prepare some chicken soup for the journey and to find some cows ' milk .

source_bert_toks: that night i packed , ordered the cook to prepare some chicken soup for the journey and to find some cows ' milk .

reference_raw: I packed that night and ordered the chef to prepare some chicken soup for the trip and find some cow's milk.

reference_spacy_tokens: I packed that night and ordered the chef to prepare some chicken soup for the trip and find some cow 's milk .


fn_spacy_tokens_for_baseline: They arrived at midday and after a delicious lunch were entertained by a three piece band .

source_bert_toks: they arrived at midday and after a delicious lunch were entertained by a three piece band .

reference_raw: They arrived at noon, and a three-piece band entertained them after a delicious lunch.

reference_spacy_tokens: They arrived at noon , and a three - piece band entertained them after a delicious lunch .


fn_spacy_tokens_for_baseline: Suddenly Harry felt the narrow cell so filled and overfilled with his own dread and hatred that he could hardly breathe .

source_bert_toks: suddenly harry felt the narrow cell so filled and over ##fi ##lled with his own dread and hatred that he could hardly breathe .

reference_raw: Harry felt suddenly that the narrow cell was so full and filled with fear and hate that he could barely breathe.

reference_spacy_tokens: Harry felt suddenly that the narrow cell was so full and filled with fear and hate that he could barely breathe .


fn_spacy_tokens_for_baseline: The association of liver disease and 1 ° SS was suggested more than 40 years ago [ 1]. While liver involvement in 1 ° SS has been considered " rare " [ 2 ] only a few clinical studies specifically address this complication and evaluate the association of liver function tests abnormalities with the severity of 1 ° SS [ 3 4 5 6].

source_bert_toks: the association of liver disease and 1 ##° ##ss was suggested more than 40 years ago [ 1 ] . while liver involvement in 1 ##° ##ss has been considered " rare " [ 2 ] only a few clinical studies specifically address this com ##plication and evaluate the association of liver function tests abnormalities with the severity of 1 ##° ##ss [ 3 4 5 6 ] .

reference_raw: The association of liver disease with 1°SS was proposed more than 40 years ago [1]. Although the involvement of liver in 1°SS was considered to be "rare" [2] only a few clinical trials specifically address this complication and evaluate the association of liver enzyme abnormalities with the severity of 1°SS [3 4 5 6].

reference_spacy_tokens: The association of liver disease with 1 ° SS was proposed more than 40 years ago [ 1]. Although the involvement of liver in 1 ° SS was considered to be " rare " [ 2 ] only a few clinical trials specifically address this complication and evaluate the association of liver enzyme abnormalities with the severity of 1 ° SS [ 3 4 5 6].


fn_spacy_tokens_for_baseline: He had been to Martin Finkelstein 's bar mitzvah and had been given a small white hat , which was still on his mantelpiece at home .

source_bert_toks: he had been to martin fin ##kel ##stein ' s bar mit ##z ##vah and had been given a small white hat , which was still on his man ##tel ##piece at home .

reference_raw: He was at Martin Finkelstein's bar mitzvah and got a little white hat that was still on the mantelpiece at home.

reference_spacy_tokens: He was at Martin Finkelstein 's bar mitzvah and got a little white hat that was still on the mantelpiece at home .


fn_spacy_tokens_for_baseline: The case relates to the 58-acre Brio Superfund dump , 20 miles southeast of Houston .

source_bert_toks: the case relates to the 58 - acre br ##io super ##fu ##nd dump , 20 miles southeast of houston .

reference_raw: This case concerns a 58-acre Brio Superfund dump, 20 miles south-east of Houston.

reference_spacy_tokens: This case concerns a 58-acre Brio Superfund dump , 20 miles south - east of Houston .


fn_spacy_tokens_for_baseline: We want junior doctors to train , not to sleepwalk .

source_bert_toks: we want junior doctors to train , not to sleep ##walk .

reference_raw: We want junior doctors training, not sleeping.

reference_spacy_tokens: We want junior doctors training , not sleeping .


fn_spacy_tokens_for_baseline: These cards I filed in alphabetical order , and I noted on each one details of new purchases and quantities .

source_bert_toks: these cards i filed in alphabet ##ical order , and i noted on each one details of new purchases and quantities .

reference_raw: I filled out these cards in alphabetical order, and on each of them I noted the details of the new purchases and quantities.

reference_spacy_tokens: I filled out these cards in alphabetical order , and on each of them I noted the details of the new purchases and quantities .


fn_spacy_tokens_for_baseline: This bizarre get - up helped slot Latin American women into a caricature of fruit - bearing flamboyance in the US mind .

source_bert_toks: this bizarre get - up helped slot latin american women into a car ##ica ##ture of fruit - bearing fl ##am ##boy ##ance in the us mind .

reference_raw: This bizarre rise helped slot Latin American women into a caricature of fruit-bearing flamboyance in the American mind.

reference_spacy_tokens: This bizarre rise helped slot Latin American women into a caricature of fruit - bearing flamboyance in the American mind .


fn_spacy_tokens_for_baseline: The series of nuclear tests in 1995 - 96 prior to China 's signature of the Comprehensive Test Ban Treaty ( CTBT ) may have resulted in a smaller and lighter warhead design for the new generation of intercontinental ballistic missiles ( ICBMs ) now under development .

source_bert_toks: the series of nuclear tests in 1995 - 96 prior to china ' s signature of the comprehensive test ban treaty ( ct ##bt ) may have resulted in a smaller and lighter war ##head design for the new generation of intercontinental ballistic missiles ( ic ##bm ##s ) now under development .

reference_raw: The series of nuclear tests in 1995 - 96 before China signed the Comprehensive Test Ban Treaty (CTBT) could lead to a smaller and lighter design for the new generation of intercontinental ballistic missiles (ICBMs) currently under development.

reference_spacy_tokens: The series of nuclear tests in 1995 - 96 before China signed the Comprehensive Test Ban Treaty ( CTBT ) could lead to a smaller and lighter design for the new generation of intercontinental ballistic missiles ( ICBMs ) currently under development .


fn_spacy_tokens_for_baseline: The magnetopause marks the inner boundary of the agitated region which itself is called the magnetosheath .

source_bert_toks: the magnet ##opa ##use marks the inner boundary of the agitated region which itself is called the magnet ##osh ##ea ##th .

reference_raw: A magnetopause marks the internal boundary of an agitated area, which is itself called a magnetosheath.

reference_spacy_tokens: A magnetopause marks the internal boundary of an agitated area , which is itself called a magnetosheath .


fn_spacy_tokens_for_baseline: Did the pudgy publicity - seeker really swim much of the breadth of the Atlantic or merely glide --- and also ride a raft --- across strong westward ocean currents ?

source_bert_toks: did the pu ##d ##gy publicity - seeker really swim much of the breadth of the atlantic or merely glide - - - and also ride a raft - - - across strong westward ocean currents ?

reference_raw: Did the plump publicity seeker really swim most of the width of the Atlantic, or simply glide - and ride a raft - through the strong currents of the western oceans?

reference_spacy_tokens: Did the plump publicity seeker really swim most of the width of the Atlantic , or simply glide - and ride a raft - through the strong currents of the western oceans ?


fn_spacy_tokens_for_baseline: The SRI has allegedly taken in Iraqi scientists prior to the recent Gulf War .

source_bert_toks: the sri has allegedly taken in iraqi scientists prior to the recent gulf war .

reference_raw: The SRI was supposedly recruited by Iraqi scientists before the last Gulf War.

reference_spacy_tokens: The SRI was supposedly recruited by Iraqi scientists before the last Gulf War .


fn_spacy_tokens_for_baseline: A group of Marcos loyalists yesterday filed a petition to the Supreme Court seeking to reverse an earlier ruling that upheld Mrs Aquino 's decision to bar Marcos 's return .

source_bert_toks: a group of marcos loyalists yesterday filed a petition to the supreme court seeking to reverse an earlier ruling that upheld mrs aquino ' s decision to bar marcos ' s return .

reference_raw: Yesterday, a group of Marcos loyalists made a petition to the Supreme Court to reverse a previous decision confirming the decision of Mrs. Aquin to bar the return of Marcos.

reference_spacy_tokens: Yesterday , a group of Marcos loyalists made a petition to the Supreme Court to reverse a previous decision confirming the decision of Mrs. Aquin to bar the return of Marcos .


fn_spacy_tokens_for_baseline: I felt like shouting .

source_bert_toks: i felt like shouting .

reference_raw: I wanted to scream.

reference_spacy_tokens: I wanted to scream .


fn_spacy_tokens_for_baseline: SCHOOLBOY Brian Linkin cheated death when he was struck by lightning -- because he refused to take off his smelly trainers .

source_bert_toks: school ##boy brian link ##in cheated death when he was struck by lightning - - because he refused to take off his smell ##y trainers .

reference_raw: SCHOOLBOY Brian Linkin cheated death when he was struck by lightning - because he refused to remove his stinking coaches.

reference_spacy_tokens: SCHOOLBOY Brian Linkin cheated death when he was struck by lightning - because he refused to remove his stinking coaches .


fn_spacy_tokens_for_baseline: They wrangled interminably , he goading her into outbursts of anger just to watch her beauty at its best , she calling him all the names she could lay her tongue to .

source_bert_toks: they wr ##ang ##led inter ##mina ##bly , he goa ##ding her into outburst ##s of anger just to watch her beauty at its best , she calling him all the names she could lay her tongue to .

reference_raw: They twisted inexorably, and he drove her into an outburst of rage, just to see how beautiful she was, and she called him all the names she could put her tongue to.

reference_spacy_tokens: They twisted inexorably , and he drove her into an outburst of rage , just to see how beautiful she was , and she called him all the names she could put her tongue to .


fn_spacy_tokens_for_baseline: He moves toward the right corner of the wide hallway , waving on his audience , then turns to take his briefcase from me , pulling out a thick blue stack of Muslim tracts .

source_bert_toks: he moves toward the right corner of the wide hallway , waving on his audience , then turns to take his briefcase from me , pulling out a thick blue stack of muslim tracts .

reference_raw: He walks to the left corner of the wide corridor, waves at his audience, then turns to take his briefcase from me and pulls out a thick blue pile of Muslim tracts.

reference_spacy_tokens: He walks to the left corner of the wide corridor , waves at his audience , then turns to take his briefcase from me and pulls out a thick blue pile of Muslim tracts .


fn_spacy_tokens_for_baseline: People ca n't bear - they 've got enough to listen to already - and anybody who waffles is written off pretty quickly and , therefore , you lose your point ..

source_bert_toks: people can ' t bear - they ' ve got enough to listen to already - and anybody who wa ##ffle ##s is written off pretty quickly and , therefore , you lose your point . .

reference_raw: People can't stand it - they've got enough to listen to - and anyone who's got a waffle written off pretty fast, and that's why you're losing your point...

reference_spacy_tokens: People ca n't stand it - they 've got enough to listen to - and anyone who 's got a waffle written off pretty fast , and that 's why you 're losing your point ...


fn_spacy_tokens_for_baseline: They were lashed together , upright and side by side , between the rear four seats .

source_bert_toks: they were lashed together , upright and side by side , between the rear four seats .

reference_raw: They were bound together, upright and side by side, between the four seats in the back.

reference_spacy_tokens: They were bound together , upright and side by side , between the four seats in the back .


fn_spacy_tokens_for_baseline: He shot his son a reproachful look .

source_bert_toks: he shot his son a rep ##ro ##ach ##ful look .

reference_raw: He shot his son an accusing look.

reference_spacy_tokens: He shot his son an accusing look .


fn_spacy_tokens_for_baseline: The Daily Telegraph joined in , fulminating against the welfare state 's profligate fanatics , spendthrifts of the taxpayer 's money .

source_bert_toks: the daily telegraph joined in , fu ##lm ##inating against the welfare state ' s prof ##liga ##te fan ##atics , spend ##th ##rift ##s of the taxpayer ' s money .

reference_raw: The Daily Telegraph joined in, fulminating against the profligate fanatics of the welfare state and spending taxpayers' money.

reference_spacy_tokens: The Daily Telegraph joined in , fulminating against the profligate fanatics of the welfare state and spending taxpayers ' money .


fn_spacy_tokens_for_baseline: Then that discomfiting gaze shifted once again to Charity 's face .

source_bert_toks: then that disco ##m ##fi ##ting gaze shifted once again to charity ' s face .

reference_raw: Then the unsatisfactory look went back to Charity's face.

reference_spacy_tokens: Then the unsatisfactory look went back to Charity 's face .


fn_spacy_tokens_for_baseline: To some extent the very brilliance of the court life led by the sovereigns and its impact on public opinion was their undoing for the fete imperiale is indelibly associated with them .

source_bert_toks: to some extent the very brilliance of the court life led by the sovereign ##s and its impact on public opinion was their undo ##ing for the fe ##te imperial ##e is ind ##eli ##bly associated with them .

reference_raw: To a certain extent, the very genius of the court life led by the sovereigns, and its impact on public opinion, is that their damage to the fete imperiale is indelibly linked to them.

reference_spacy_tokens: To a certain extent , the very genius of the court life led by the sovereigns , and its impact on public opinion , is that their damage to the fete imperiale is indelibly linked to them .


fn_spacy_tokens_for_baseline: It comes in 50 g balls and retails at £ 1.95 a ball .

source_bert_toks: it comes in 50 ##g balls and retail ##s at £1 . 95 a ball .

reference_raw: He comes in 50 g balls and he sells at 1.95 pounds a ball.

reference_spacy_tokens: He comes in 50 g balls and he sells at 1.95 pounds a ball .


fn_spacy_tokens_for_baseline: Already many foreign firms , especially banks , have their own cryptographers , conference speakers reported .

source_bert_toks: already many foreign firms , especially banks , have their own crypt ##ographer ##s , conference speakers reported .

reference_raw: Many foreign companies, particularly banks, now have their own cryptographers and conference speakers.

reference_spacy_tokens: Many foreign companies , particularly banks , now have their own cryptographers and conference speakers .


fn_spacy_tokens_for_baseline: He ruminated a while longer .

source_bert_toks: he rum ##inated a while longer .

reference_raw: He rumbled for a moment.

reference_spacy_tokens: He rumbled for a moment .


fn_spacy_tokens_for_baseline: According to William , the man and the woman took all their clothes off and climbed into the bath so the woman was sitting with her back to the man , and the man peed into the water .

source_bert_toks: according to william , the man and the woman took all their clothes off and climbed into the bath so the woman was sitting with her back to the man , and the man pee ##d into the water .

reference_raw: According to William, the man and the woman took off all their clothes and climbed into the bathroom, so the woman sat with her back to the man, and the man pissed in the water.

reference_spacy_tokens: According to William , the man and the woman took off all their clothes and climbed into the bathroom , so the woman sat with her back to the man , and the man pissed in the water .


fn_spacy_tokens_for_baseline: The Byzantine Empire had powerful and well - fortified cities , but the countryside and the outlying islands were ravaged by waves of invaders .

source_bert_toks: the byzantine empire had powerful and well - fortified cities , but the countryside and the outlying islands were ravaged by waves of invaders .

reference_raw: The Byzantine Empire had powerful and well-fortified cities, but the landscape and distant islands were ravaged by waves of aliens.

reference_spacy_tokens: The Byzantine Empire had powerful and well - fortified cities , but the landscape and distant islands were ravaged by waves of aliens .


fn_spacy_tokens_for_baseline: Even Mr Murray , who appeared on television to condemn Peking for its butchery , has since acknowledged that ' at the end of the day , we have to live with these guys .

source_bert_toks: even mr murray , who appeared on television to condemn peking for its butcher ##y , has since acknowledged that ' at the end of the day , we have to live with these guys .

reference_raw: Even Mr. Murray, who appeared on TV to condemn Beijing for his massacre, has since admitted that we must live with them at the end of the day.

reference_spacy_tokens: Even Mr. Murray , who appeared on TV to condemn Beijing for his massacre , has since admitted that we must live with them at the end of the day .


fn_spacy_tokens_for_baseline: There is limited open - source information available concerning Iran 's chemical weapons program .

source_bert_toks: there is limited open - source information available concerning iran ' s chemical weapons program .

reference_raw: The available source information on Iran's chemical weapons programme is limited.

reference_spacy_tokens: The available source information on Iran 's chemical weapons programme is limited .


fn_spacy_tokens_for_baseline: ' Dame Sybil mentioned that you have no ribbon to fasten your braid , my lady .

source_bert_toks: ' dame sy ##bil mentioned that you have no ribbon to fast ##en your braid , my lady .

reference_raw: Lady Sybil mentioned you don't have a ribbon to fasten a ponytail, my lady.

reference_spacy_tokens: Lady Sybil mentioned you do n't have a ribbon to fasten a ponytail , my lady .


fn_spacy_tokens_for_baseline: The post - apartheid government of South Africa implemented its nonproliferation and disarmament policy through the Non - Proliferation of Weapons of Mass Destruction Act ( No . 87 of 1993 ) to control the transfer of sensitive items and technologies .

source_bert_toks: the post - apartheid government of south africa implemented its non ##pro ##life ##ration and di ##sar ##mament policy through the non - proliferation of weapons of mass destruction act ( no . 87 of 1993 ) to control the transfer of sensitive items and technologies .

reference_raw: The post - the apartheid government of South Africa has implemented its non-proliferation and disarmament policy through the Law on the Proliferation of Weapons of Mass Destruction (No 87 of 1993) in order to control the transfer of sensitive objects and technologies.

reference_spacy_tokens: The post - the apartheid government of South Africa has implemented its non - proliferation and disarmament policy through the Law on the Proliferation of Weapons of Mass Destruction ( No 87 of 1993 ) in order to control the transfer of sensitive objects and technologies .


fn_spacy_tokens_for_baseline: These events have underscored the importance of using PCR and other techniques that will readily identify herpes B virus infections .

source_bert_toks: these events have under ##sco ##red the importance of using pc ##r and other techniques that will readily identify her ##pes b virus infections .

reference_raw: These events underline the importance of the use of PCR and other techniques that can easily identify infections with herpes B virus.

reference_spacy_tokens: These events underline the importance of the use of PCR and other techniques that can easily identify infections with herpes B virus .


fn_spacy_tokens_for_baseline: Dese are my tree cheeldrin . ' ( then came the embarrassment which always petrified us ) .

source_bert_toks: des ##e are my tree che ##eld ##rin . ' ( then came the embarrassment which always pet ##rified us ) .

reference_raw: Deserts are my tree cheeldrin.' (then came the shame that always froze us).

reference_spacy_tokens: Deserts are my tree cheeldrin . ' ( then came the shame that always froze us ) .


fn_spacy_tokens_for_baseline: So Father Luke , in penitence , took up the labour of making the soup , buying the bread rolls and wheeling the barrow .

source_bert_toks: so father luke , in pen ##ite ##nce , took up the labour of making the soup , buying the bread rolls and wheeling the barrow .

reference_raw: So, in penance, Father Luke took the job of making soup, buying bread rolls, and turning the barrow.

reference_spacy_tokens: So , in penance , Father Luke took the job of making soup , buying bread rolls , and turning the barrow .


fn_spacy_tokens_for_baseline: The cat looked at Lyn and opened its mouth in a soundless mew .

source_bert_toks: the cat looked at l ##yn and opened its mouth in a sound ##less me ##w .

reference_raw: The cat looked at Lyn and opened his mouth in a soundless mow.

reference_spacy_tokens: The cat looked at Lyn and opened his mouth in a soundless mow .


fn_spacy_tokens_for_baseline: Then lay him over your knee with a basin to catch the vomit , and wiggle your finger near the back of his throat .

source_bert_toks: then lay him over your knee with a basin to catch the vomit , and wig ##gle your finger near the back of his throat .

reference_raw: Then put it on your knee with a bowl to catch the vomit and wriggle your finger at the back of his neck.

reference_spacy_tokens: Then put it on your knee with a bowl to catch the vomit and wriggle your finger at the back of his neck .


fn_spacy_tokens_for_baseline: ' I 've become confident , outgoing and I 've got much more energy .

source_bert_toks: ' i ' ve become confident , outgoing and i ' ve got much more energy .

reference_raw: 'I'm confident, I'm out, and I'm a lot more energy.

reference_spacy_tokens: ' I 'm confident , I 'm out , and I 'm a lot more energy .


fn_spacy_tokens_for_baseline: He was , and is , a distinctly affable chap , whereas I came across as cold , prickly and generally difficult .

source_bert_toks: he was , and is , a distinctly af ##fa ##ble cha ##p , whereas i came across as cold , prick ##ly and generally difficult .

reference_raw: He's, and he's, a very friendly guy, while I've come across as cold, prickly, and generally difficult.

reference_spacy_tokens: He 's , and he 's , a very friendly guy , while I 've come across as cold , prickly , and generally difficult .


fn_spacy_tokens_for_baseline: Children misbehave when they are discouraged and believe they can not succeed by useful means .

source_bert_toks: children mis ##be ##ha ##ve when they are discouraged and believe they can not succeed by useful means .

reference_raw: Children act badly when dissuaded and believe that they cannot succeed by useful means.

reference_spacy_tokens: Children act badly when dissuaded and believe that they can not succeed by useful means .


fn_spacy_tokens_for_baseline: Nor would they welcome a takeover by the Tigrayans .

source_bert_toks: nor would they welcome a takeover by the ti ##gra ##yan ##s .

reference_raw: They wouldn't even welcome the Tigrayans taking over.

reference_spacy_tokens: They would n't even welcome the Tigrayans taking over .


fn_spacy_tokens_for_baseline: What puzzled him was her reasons for meeting all expenses , and some absurd generosities , out of her capital , never opening her legendarily replete jewel box to assuage them .

source_bert_toks: what puzzled him was her reasons for meeting all expenses , and some absurd gene ##ros ##ities , out of her capital , never opening her legend ##ari ##ly rep ##lete jewel box to ass ##ua ##ge them .

reference_raw: What puzzled him was the fact that she had met all the expenses and some absurd generosity from the capital, and had never opened her legendaryly replenished jewel box to persuade them.

reference_spacy_tokens: What puzzled him was the fact that she had met all the expenses and some absurd generosity from the capital , and had never opened her legendaryly replenished jewel box to persuade them .


fn_spacy_tokens_for_baseline: They belong to a group of 15 ringers -- including two octogenarians and four youngsters in training -- who drive every Sunday from church to church in a sometimes - exhausting effort to keep the bells sounding in the many belfries of East Anglia .

source_bert_toks: they belong to a group of 15 ring ##ers - - including two oct ##ogen ##arians and four young ##sters in training - - who drive every sunday from church to church in a sometimes - exhaust ##ing effort to keep the bells sounding in the many bel ##fr ##ies of east anglia .

reference_raw: They belong to a group of 15 ringers - including two octogenarians and four young men in training - who drive from church to church every Sunday in an effort to keep the bells ringing in many East Anglia bells.

reference_spacy_tokens: They belong to a group of 15 ringers - including two octogenarians and four young men in training - who drive from church to church every Sunday in an effort to keep the bells ringing in many East Anglia bells .


fn_spacy_tokens_for_baseline: The purpose of education is to encourage young men and women to realize their full academic potential .

source_bert_toks: the purpose of education is to encourage young men and women to realize their full academic potential .

reference_raw: The aim of education is to encourage young males and females to realise their full academic potential.

reference_spacy_tokens: The aim of education is to encourage young males and females to realise their full academic potential .


fn_spacy_tokens_for_baseline: The dispatcher counted the seconds on his large watch , then chopped his arm .

source_bert_toks: the dispatch ##er counted the seconds on his large watch , then chopped his arm .

reference_raw: The dispatcher counted the seconds on his big watch, then cut off his hand.

reference_spacy_tokens: The dispatcher counted the seconds on his big watch , then cut off his hand .


fn_spacy_tokens_for_baseline: For one thing , they do not eject the eggs or young of their hosts -- waxbills -- from the nest .

source_bert_toks: for one thing , they do not e ##ject the eggs or young of their hosts - - wax ##bill ##s - - from the nest .

reference_raw: First of all, they don't expel eggs or young hosts - waxbills - from their nests.

reference_spacy_tokens: First of all , they do n't expel eggs or young hosts - waxbills - from their nests .


fn_spacy_tokens_for_baseline: Mix butter and sardines very thoroughly , mashing them with a fork until you have a smooth paste .

source_bert_toks: mix butter and sar ##dine ##s very thoroughly , mas ##hing them with a fork until you have a smooth paste .

reference_raw: Mix the butter and the sardines very carefully, so that they can be molded with a fork until you have a smooth paste.

reference_spacy_tokens: Mix the butter and the sardines very carefully , so that they can be molded with a fork until you have a smooth paste .


fn_spacy_tokens_for_baseline: The acquittal of four white officers in April last year led to rioting in LA

source_bert_toks: the ac ##qui ##ttal of four white officers in april last year led to riot ##ing in la

reference_raw: The exoneration of four white officers in April last year led to a riot in Los Angeles.

reference_spacy_tokens: The exoneration of four white officers in April last year led to a riot in Los Angeles .


fn_spacy_tokens_for_baseline: Apart from basic agreements on the necessity for law and order for survival purposes , an issue which will be treated later in the chapter , there are a number of similarities which should be mentioned .

source_bert_toks: apart from basic agreements on the necessity for law and order for survival purposes , an issue which will be treated later in the chapter , there are a number of similarities which should be mentioned .

reference_raw: In addition to the basic agreements on the necessity of law and order for survival, which will be dealt with at a later stage in this chapter, there are a number of similarities that should be mentioned.

reference_spacy_tokens: In addition to the basic agreements on the necessity of law and order for survival , which will be dealt with at a later stage in this chapter , there are a number of similarities that should be mentioned .


fn_spacy_tokens_for_baseline: He trained in desktop publishing and combined his enthusiastic work ethic with new - found skills in a burgeoning industry .

source_bert_toks: he trained in desktop publishing and combined his enthusiastic work et ##hic with new - found skills in a bu ##rgeon ##ing industry .

reference_raw: He trained in the publishing of the desktops and combined his enthusiastic work ethic with his new-found abilities in the burgeoning industry.

reference_spacy_tokens: He trained in the publishing of the desktops and combined his enthusiastic work ethic with his new - found abilities in the burgeoning industry .


fn_spacy_tokens_for_baseline: The modern world is juxtaposed against and involved with a world very definitely presented in terms of primitive rite -- nowhere more clearly than in the ritual expiation of the curse .

source_bert_toks: the modern world is ju ##xt ##ap ##osed against and involved with a world very definitely presented in terms of primitive rite - - nowhere more clearly than in the ritual ex ##pia ##tion of the curse .

reference_raw: The modern world is juxtaposed against and involved in a world that is very certainly represented by primitive rituals - no clearer than the ritual expiration of the curse.

reference_spacy_tokens: The modern world is juxtaposed against and involved in a world that is very certainly represented by primitive rituals - no clearer than the ritual expiration of the curse .


fn_spacy_tokens_for_baseline: The body of philosophical opinion which avers that life is absurd has never appealed to him .

source_bert_toks: the body of philosophical opinion which ave ##rs that life is absurd has never appealed to him .

reference_raw: He never liked the body of philosophical opinion that averted the absurdity of life.

reference_spacy_tokens: He never liked the body of philosophical opinion that averted the absurdity of life .


fn_spacy_tokens_for_baseline: Of course the converse can be said , as several knobbly and bow - legged clerics would humbly be the first to acknowledge .

source_bert_toks: of course the converse can be said , as several knob ##bly and bow - legged cleric ##s would hum ##bly be the first to acknowledge .

reference_raw: The conversation could be said, of course, because a few of the knobbly and arch-legged priests would humbly be the first to admit it.

reference_spacy_tokens: The conversation could be said , of course , because a few of the knobbly and arch - legged priests would humbly be the first to admit it .


fn_spacy_tokens_for_baseline: On 8 March 1996 , the Washington Post reported , " US intelligence officials have concluded that companies in China are providing Iran with several virtually complete factories suited for making deadly poison gases , " and that Iranian " military - related organizations " are buying from China glass - lined vessels for mixing precursors , special air - filtration equipment , and the technology to manufacture these items and others indigenously .

source_bert_toks: on 8 march 1996 , the washington post reported , " us intelligence officials have concluded that companies in china are providing iran with several virtually complete factories suited for making deadly poison gases , " and that iranian " military - related organizations " are buying from china glass - lined vessels for mixing precursor ##s , special air - fi ##lt ##ration equipment , and the technology to manufacture these items and others indigenous ##ly .

reference_raw: On 8 March 1996, the Washington Post announced, "U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases," and that Iran's "military-related organizations" purchase from Chinese glass-lined vessels for the mixing of precursors, special air-filtration equipment, and technology for the production of such items and other indigenous products.

reference_spacy_tokens: On 8 March 1996 , the Washington Post announced , " U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases , " and that Iran 's " military - related organizations " purchase from Chinese glass - lined vessels for the mixing of precursors , special air - filtration equipment , and technology for the production of such items and other indigenous products .


fn_spacy_tokens_for_baseline: Gradually beat in the eggs , one at a time -- if you add them too quickly the mixture may curdle .

source_bert_toks: gradually beat in the eggs , one at a time - - if you add them too quickly the mixture may cu ##rd ##le .

reference_raw: Gradually beat the eggs one by one - if you add them too fast, the mixture can curl up.

reference_spacy_tokens: Gradually beat the eggs one by one - if you add them too fast , the mixture can curl up .


fn_spacy_tokens_for_baseline: This court is in no way prejudging any defence of justification which may hereafter be raised in those libel proceedings .

source_bert_toks: this court is in no way pre ##ju ##d ##ging any defence of justification which may here ##af ##ter be raised in those libel proceedings .

reference_raw: The Court of First Instance does not in any way prejudice the defence of the statement of reasons which may then be raised in the context of the libel proceedings.

reference_spacy_tokens: The Court of First Instance does not in any way prejudice the defence of the statement of reasons which may then be raised in the context of the libel proceedings .


fn_spacy_tokens_for_baseline: Then , as she skewered him with a look of pure detestation , he reached out suddenly and caught her by the wrists .

source_bert_toks: then , as she sk ##ew ##ered him with a look of pure det ##est ##ation , he reached out suddenly and caught her by the wrists .

reference_raw: Then, as she gave him a look of pure disgust, he reached out and grabbed her wrists.

reference_spacy_tokens: Then , as she gave him a look of pure disgust , he reached out and grabbed her wrists .


fn_spacy_tokens_for_baseline: He should do more to reduce tax rates on wealth and income , in recognition of the fact that those cuts yield higher , not lower , revenues .

source_bert_toks: he should do more to reduce tax rates on wealth and income , in recognition of the fact that those cuts yield higher , not lower , revenues .

reference_raw: It should do more to reduce tax rates on wealth and income, recognising that these cuts yield higher, not lower, incomes.

reference_spacy_tokens: It should do more to reduce tax rates on wealth and income , recognising that these cuts yield higher , not lower , incomes .


fn_spacy_tokens_for_baseline: Only interviews with the prime suspects could enlighten us now but , instead , they served to confuse still further .

source_bert_toks: only interviews with the prime suspects could en ##light ##en us now but , instead , they served to confuse still further .

reference_raw: Only interviews with the prime suspects could enlighten us now, but instead they served as a further distraction.

reference_spacy_tokens: Only interviews with the prime suspects could enlighten us now , but instead they served as a further distraction .


fn_spacy_tokens_for_baseline: The internal wrangles , sometimes over single issues , which are coming to characterise British party politics in the 1980s , may well foreshadow a similar process .

source_bert_toks: the internal wr ##ang ##les , sometimes over single issues , which are coming to character ##ise british party politics in the 1980s , may well fore ##sha ##do ##w a similar process .

reference_raw: The internal turmoil, sometimes over the individual issues that come to characterize British party politics in the 1980s, can well foresaw a similar process.

reference_spacy_tokens: The internal turmoil , sometimes over the individual issues that come to characterize British party politics in the 1980s , can well foresaw a similar process .


fn_spacy_tokens_for_baseline: Marsh , the professor of Old Testament , had been a superlative teacher but his health was gone and he was now a passenger .

source_bert_toks: marsh , the professor of old testament , had been a super ##lative teacher but his health was gone and he was now a passenger .

reference_raw: Marsh, the Professor of the Old Testament, was a super-lative teacher, but his health was gone, and now he was a passenger.

reference_spacy_tokens: Marsh , the Professor of the Old Testament , was a super - lative teacher , but his health was gone , and now he was a passenger .


fn_spacy_tokens_for_baseline: She was puny .

source_bert_toks: she was pun ##y .

reference_raw: She was small.

reference_spacy_tokens: She was small .


fn_spacy_tokens_for_baseline: 4 scoops vanilla ice cream

source_bert_toks: 4 scoop ##s vanilla ice cream

reference_raw: 4 cups of vanilla ice cream

reference_spacy_tokens: 4 cups of vanilla ice cream


fn_spacy_tokens_for_baseline: More often than not , ringers think of the church as something stuck on the bottom of the belfry .

source_bert_toks: more often than not , ring ##ers think of the church as something stuck on the bottom of the bel ##fr ##y .

reference_raw: More often than not, the ringers think of the church as something stuck at the bottom of the bell.

reference_spacy_tokens: More often than not , the ringers think of the church as something stuck at the bottom of the bell .


fn_spacy_tokens_for_baseline: Young readers taught by an approach that stresses decoding ( accurate word - for - word reproduction of what is on the page ) may fail to become proficient readers .

source_bert_toks: young readers taught by an approach that stresses deco ##ding ( accurate word - for - word reproduction of what is on the page ) may fail to become proficient readers .

reference_raw: Young readers who learn from an approach that highlights decoding (accurate word-for-word reproduction of what's on the page) may not become skilled readers.

reference_spacy_tokens: Young readers who learn from an approach that highlights decoding ( accurate word - for - word reproduction of what 's on the page ) may not become skilled readers .


fn_spacy_tokens_for_baseline: NEW YORK ( AP ) --- Steffi Graf led the way into the fourth round of the U.S. Open on Friday while Byron Black of Zimbabwe pulled off the latest upset .

source_bert_toks: new york ( ap ) - - - ste ##ffi graf led the way into the fourth round of the u . s . open on friday while byron black of zimbabwe pulled off the latest upset .

reference_raw: New York (AP) --Steffi Graf led the way to the fourth round of the U.S. Open on Friday, while Byron Black of Zimbabwe withdrew his latest agitation.

reference_spacy_tokens: New York ( AP ) --Steffi Graf led the way to the fourth round of the U.S. Open on Friday , while Byron Black of Zimbabwe withdrew his latest agitation .


fn_spacy_tokens_for_baseline: Annie laughed once more as Billy put a hand up to his lips in mock horror and then her face suddenly flushed as she realised he was appraising her .

source_bert_toks: annie laughed once more as billy put a hand up to his lips in mock horror and then her face suddenly flushed as she realised he was app ##rai ##sing her .

reference_raw: Annie laughed again as Billy put his hand to his lips in mock horror, and then suddenly her face flushed as she realized he was appreciating her.

reference_spacy_tokens: Annie laughed again as Billy put his hand to his lips in mock horror , and then suddenly her face flushed as she realized he was appreciating her .


fn_spacy_tokens_for_baseline: Yet his comments were curiously approving .

source_bert_toks: yet his comments were curiously app ##roving .

reference_raw: But his remarks were strangely agreeable.

reference_spacy_tokens: But his remarks were strangely agreeable .


fn_spacy_tokens_for_baseline: She was not expecting the vaguely defined figure that coalesced as her vision cleared .

source_bert_toks: she was not expecting the vaguely defined figure that coal ##es ##ced as her vision cleared .

reference_raw: She didn't expect the vaguely defined figure to come together as her vision cleared.

reference_spacy_tokens: She did n't expect the vaguely defined figure to come together as her vision cleared .


fn_spacy_tokens_for_baseline: In response she kicked at his shins , pummelled him furiously with her fists , and opened her mouth to shout .

source_bert_toks: in response she kicked at his shin ##s , pu ##mmel ##led him furiously with her fists , and opened her mouth to shout .

reference_raw: In response, she kicked him in the shins, pounded him furiously with her fists, and opened her mouth to scream.

reference_spacy_tokens: In response , she kicked him in the shins , pounded him furiously with her fists , and opened her mouth to scream .


fn_spacy_tokens_for_baseline: Stanley 's jaw clicked as he chomped .

source_bert_toks: stanley ' s jaw clicked as he cho ##mp ##ed .

reference_raw: Stanley's jaw snapped as he chopped.

reference_spacy_tokens: Stanley 's jaw snapped as he chopped .


fn_spacy_tokens_for_baseline: An intellectual ripper , which veers between poetry and pretentiousness .

source_bert_toks: an intellectual rip ##per , which ve ##ers between poetry and pre ##ten ##tious ##ness .

reference_raw: An intellectual ripper that turns between poetry and pretence.

reference_spacy_tokens: An intellectual ripper that turns between poetry and pretence .


fn_spacy_tokens_for_baseline: It was the first game Aitken had started since the Skol Cup final four months ago , though his display belied such sparing use of his talents .

source_bert_toks: it was the first game ai ##t ##ken had started since the sk ##ol cup final four months ago , though his display bel ##ied such spa ##ring use of his talents .

reference_raw: It was the first game that Aitken had begun since the Skol Cup last four months ago, although his display believed that his talents had been so sparsely exploited.

reference_spacy_tokens: It was the first game that Aitken had begun since the Skol Cup last four months ago , although his display believed that his talents had been so sparsely exploited .


fn_spacy_tokens_for_baseline: In this case , though , hostility had festered .

source_bert_toks: in this case , though , hostility had fest ##ered .

reference_raw: But in this case, the hostility was overflowing.

reference_spacy_tokens: But in this case , the hostility was overflowing .


fn_spacy_tokens_for_baseline: The Indonesian government has proposed the levying of a toll on ships passing through the Malacca strait to raise funds to combat pollution in the heavily used seaway .

source_bert_toks: the indonesian government has proposed the levy ##ing of a toll on ships passing through the malacca strait to raise funds to combat pollution in the heavily used sea ##way .

reference_raw: The Government of Indonesia has proposed the levying of tolls on ships crossing the Malacca Channel in order to raise money for the fight against pollution in the heavily used seaways.

reference_spacy_tokens: The Government of Indonesia has proposed the levying of tolls on ships crossing the Malacca Channel in order to raise money for the fight against pollution in the heavily used seaways .


fn_spacy_tokens_for_baseline: Sometimes it seemed that those who loved them were almost willing the band to spend their lives touring pubs , returning to Farnborough merely to return the empties and pick up the bills .

source_bert_toks: sometimes it seemed that those who loved them were almost willing the band to spend their lives touring pubs , returning to far ##nb ##orough merely to return the em ##pt ##ies and pick up the bills .

reference_raw: Sometimes it seemed that those who loved them were almost willing to spend the rest of their lives touring the pubs, returning to Farnborough only to return the blanks and collect the bills.

reference_spacy_tokens: Sometimes it seemed that those who loved them were almost willing to spend the rest of their lives touring the pubs , returning to Farnborough only to return the blanks and collect the bills .


fn_spacy_tokens_for_baseline: John Brady , whose company claims it owns licensing rights to the creatures , said : ' Henson walked past our exhibit with some heavy - set gentlemen .

source_bert_toks: john brady , whose company claims it owns licensing rights to the creatures , said : ' henson walked past our exhibit with some heavy - set gentlemen .

reference_raw: John Brady, whose company claims to have the right to license these creatures, said, "Henson walked past our exhibit with a couple of heavily dressed gentlemen.

reference_spacy_tokens: John Brady , whose company claims to have the right to license these creatures , said , " Henson walked past our exhibit with a couple of heavily dressed gentlemen .


fn_spacy_tokens_for_baseline: Although information on WMD programs for many countries is often limited , when it comes to assessing Iran 's alleged CW program , one must sift through a mountain of information , much of which is long on allegation and short on specific , corroborated evidence .

source_bert_toks: although information on w ##md programs for many countries is often limited , when it comes to assessing iran ' s alleged cw program , one must si ##ft through a mountain of information , much of which is long on all ##ega ##tion and short on specific , co ##rro ##bor ##ated evidence .

reference_raw: Although information on weapons of mass destruction programmes is often limited in many countries, when it comes to the assessment of Iran's alleged CW program, it is necessary to go through a mountain of information, most of which are long on allegations and lack of concrete, confirmed evidence.

reference_spacy_tokens: Although information on weapons of mass destruction programmes is often limited in many countries , when it comes to the assessment of Iran 's alleged CW program , it is necessary to go through a mountain of information , most of which are long on allegations and lack of concrete , confirmed evidence .


fn_spacy_tokens_for_baseline: This explains the presence in Guangzhou of the Huaisheng Mosque , reputed to be China 's oldest , and traditionally dated a.d . 627 .

source_bert_toks: this explains the presence in guangzhou of the hua ##ish ##eng mosque , reputed to be china ' s oldest , and traditionally dated a . d . 62 ##7 .

reference_raw: That explains why the Huaisheng Mosque is present in Guangzhou, known to be the oldest Chinese and traditionally dated A.D. 627.

reference_spacy_tokens: That explains why the Huaisheng Mosque is present in Guangzhou , known to be the oldest Chinese and traditionally dated A.D. 627 .


fn_spacy_tokens_for_baseline: But if this really was the sum of Hoover 's sexuality -- sad , mean and sporadic , a slight release from the need to control himself utterly -- he seems almost pitiable .

source_bert_toks: but if this really was the sum of hoover ' s sexuality - - sad , mean and sporadic , a slight release from the need to control himself utterly - - he seems almost pit ##iable .

reference_raw: But if it really was the sum of Hoover's sexuality--sad, mean, and sporadic, a slight release from the need for complete self-control--it seemed almost regrettable.

reference_spacy_tokens: But if it really was the sum of Hoover 's sexuality -- sad , mean , and sporadic , a slight release from the need for complete self - control -- it seemed almost regrettable .


fn_spacy_tokens_for_baseline: She took a deep sniff of it .

source_bert_toks: she took a deep sniff of it .

reference_raw: She took a deep breath.

reference_spacy_tokens: She took a deep breath .


fn_spacy_tokens_for_baseline: He screamed and clawed at his eyes .

source_bert_toks: he screamed and clawed at his eyes .

reference_raw: He screamed, clutching at his eyes.

reference_spacy_tokens: He screamed , clutching at his eyes .


fn_spacy_tokens_for_baseline: Running their corporation according to the ancient precepts of the Talmud , they shunned all publicity and trusted only a handful of associates .

source_bert_toks: running their corporation according to the ancient pre ##ce ##pts of the talmud , they shu ##nne ##d all publicity and trusted only a handful of associates .

reference_raw: They ran their company according to the ancient Talmud precepts, avoiding all publicity and trusting only a handful of associates.

reference_spacy_tokens: They ran their company according to the ancient Talmud precepts , avoiding all publicity and trusting only a handful of associates .


fn_spacy_tokens_for_baseline: She turned her head away , scalding tears coursing down her cheeks and on to the pillow which had absorbed her earlier grief .

source_bert_toks: she turned her head away , sc ##aldi ##ng tears co ##urs ##ing down her cheeks and on to the pillow which had absorbed her earlier grief .

reference_raw: She turned her head away, burning tears streaming down her cheeks and onto the pillow that had absorbed her earlier sorrow.

reference_spacy_tokens: She turned her head away , burning tears streaming down her cheeks and onto the pillow that had absorbed her earlier sorrow .


fn_spacy_tokens_for_baseline: ' Once he knew where we were Lewis telegraphed every few hours .

source_bert_toks: ' once he knew where we were lewis telegraph ##ed every few hours .

reference_raw: 'As soon as he found out where Lewis was sending us a telegram every couple of hours.

reference_spacy_tokens: ' As soon as he found out where Lewis was sending us a telegram every couple of hours .


fn_spacy_tokens_for_baseline: Pears are treated in much the same way , but are never wrapped .

source_bert_toks: pear ##s are treated in much the same way , but are never wrapped .

reference_raw: Pears are treated in much the same way, but they are never packaged.

reference_spacy_tokens: Pears are treated in much the same way , but they are never packaged .


fn_spacy_tokens_for_baseline: His hand groped around the wall just inside the door , feeling for the light switch .

source_bert_toks: his hand gr ##oped around the wall just inside the door , feeling for the light switch .

reference_raw: He fumbled around the wall just inside the door, groping for the light switch.

reference_spacy_tokens: He fumbled around the wall just inside the door , groping for the light switch .


fn_spacy_tokens_for_baseline: Lesser folk were aggrieved by the foresters ' interference with their rights of common in the Forest ; the Forest officers for their part reported that privileges they claimed had no warrant .

source_bert_toks: lesser folk were ag ##gr ##ie ##ved by the forest ##ers ' interference with their rights of common in the forest ; the forest officers for their part reported that privileges they claimed had no warrant .

reference_raw: Lesser people were aggravated by the foresters' interference with their rights of common in the forest; forest officers reported that the privileges they claimed did not have a warrant.

reference_spacy_tokens: Lesser people were aggravated by the foresters ' interference with their rights of common in the forest ; forest officers reported that the privileges they claimed did not have a warrant .


fn_spacy_tokens_for_baseline: In South - west England tin , copper and other metals have been mined for at least 2000 years from deposits related to Variscan granites ; in the Pennine range of central and northern England over a similar period , lead , and lately fluorite and baryte , have been extracted from vein and replacement deposits in Carboniferous sediments ; in Central Wales , the Isle of Man and the Southern Uplands of Scotland lead and zinc have been mined from vein deposits in Lower Palaeozoic greywackes and in the Lake District copper , lead and zinc have been recovered from a variety of deposits in Lower Palaeozoic sedimentary and volcanic rocks underlain by Caledonian granites .

source_bert_toks: in south - west england tin , copper and other metals have been mined for at least 2000 years from deposits related to var ##is ##can granite ##s ; in the penn ##ine range of central and northern england over a similar period , lead , and lately flu ##ori ##te and bar ##yte , have been extracted from vein and replacement deposits in carbon ##iferous sediments ; in central wales , the isle of man and the southern upland ##s of scotland lead and zinc have been mined from vein deposits in lower pal ##ae ##oz ##oic grey ##wa ##cke ##s and in the lake district copper , lead and zinc have been recovered from a variety of deposits in lower pal ##ae ##oz ##oic sedimentary and volcanic rocks under ##lain by caledonian granite ##s .

reference_raw: In South-Western England, tin, copper and other metals have been extracted from Variscan granite deposits for at least 2000 years; in the Pennine region of Central and Northern England, lead and recently fluorite and baryte have been extracted from veins and spare deposits in carboniferous sediments; in Central Wales, the Isle of Man and the southern uplands of Scotland and lead zinc have been extracted. From vein deposits in the Lower Palaeozoic greywacks and in the Lake District copper, lead and zinc were recovered from various deposits in the Lower Palaeozoic sedimentary and volcanic rocks under the skin of Caledonian granites.

reference_spacy_tokens: In South - Western England , tin , copper and other metals have been extracted from Variscan granite deposits for at least 2000 years ; in the Pennine region of Central and Northern England , lead and recently fluorite and baryte have been extracted from veins and spare deposits in carboniferous sediments ; in Central Wales , the Isle of Man and the southern uplands of Scotland and lead zinc have been extracted . From vein deposits in the Lower Palaeozoic greywacks and in the Lake District copper , lead and zinc were recovered from various deposits in the Lower Palaeozoic sedimentary and volcanic rocks under the skin of Caledonian granites .


fn_spacy_tokens_for_baseline: A narrow path zigzagged steeply down from in front of the colonnade to the shore .

source_bert_toks: a narrow path z ##ig ##za ##gged steep ##ly down from in front of the colon ##nad ##e to the shore .

reference_raw: The narrow path swung steeply from the front of the colonnade to the shore.

reference_spacy_tokens: The narrow path swung steeply from the front of the colonnade to the shore .


fn_spacy_tokens_for_baseline: Within minutes , he was getting pulped by the shorebreak .

source_bert_toks: within minutes , he was getting pulp ##ed by the shore ##break .

reference_raw: In a few minutes he was being crushed by a shorebreak.

reference_spacy_tokens: In a few minutes he was being crushed by a shorebreak .


fn_spacy_tokens_for_baseline: ALQAEDA may deny his request for vacation in certain cases .

source_bert_toks: al ##qa ##eda may deny his request for vacation in certain cases .

reference_raw: In some cases, ALQAEDA may refuse to apply for a holiday.

reference_spacy_tokens: In some cases , ALQAEDA may refuse to apply for a holiday .


fn_spacy_tokens_for_baseline: A guy in a bell - bottomed jumpsuit flew by me at some speed and struck the sidewalk .

source_bert_toks: a guy in a bell - bottom ##ed jumps ##uit flew by me at some speed and struck the sidewalk .

reference_raw: A man in a bell-bottomed suit flew past me at a certain speed and hit the sidewalk.

reference_spacy_tokens: A man in a bell - bottomed suit flew past me at a certain speed and hit the sidewalk .


fn_spacy_tokens_for_baseline: He pulled open a door and took out a decanter and a balloon snifter .

source_bert_toks: he pulled open a door and took out a dec ##ante ##r and a balloon s ##ni ##ft ##er .

reference_raw: He opened the door and pulled out a decanter and a balloon whistle.

reference_spacy_tokens: He opened the door and pulled out a decanter and a balloon whistle .


fn_spacy_tokens_for_baseline: The first run - through was a complete failure .

source_bert_toks: the first run - through was a complete failure .

reference_raw: The first search was a complete failure.

reference_spacy_tokens: The first search was a complete failure .


fn_spacy_tokens_for_baseline: Crossing the Bering Sea we spotted white hulks of icebergs in the straits between North America and Asia .

source_bert_toks: crossing the be ##ring sea we spotted white hulk ##s of ice ##berg ##s in the straits between north america and asia .

reference_raw: We crossed the Bering Sea and saw the white hulks of glaciers in the straits between North America and Asia.

reference_spacy_tokens: We crossed the Bering Sea and saw the white hulks of glaciers in the straits between North America and Asia .


fn_spacy_tokens_for_baseline: Her body itched constantly and salt crystals from the drying of perspiration clung to the hair of her armpits and rimed her skin .

source_bert_toks: her body it ##ched constantly and salt crystals from the drying of per ##sp ##ira ##tion clung to the hair of her arm ##pit ##s and rim ##ed her skin .

reference_raw: Her body was itching steadily, and the salt crystals from the drying of sweat clung to the hair of her armpits, rimming her skin.

reference_spacy_tokens: Her body was itching steadily , and the salt crystals from the drying of sweat clung to the hair of her armpits , rimming her skin .


fn_spacy_tokens_for_baseline: Meanwhile , Iran has also developed short - range artillery rockets and is producing the Scud - B and the Scud - C -- called the Shehab-1 and Shehab-2 , respectively .

source_bert_toks: meanwhile , iran has also developed short - range artillery rockets and is producing the sc ##ud - b and the sc ##ud - c - - called the she ##hab - 1 and she ##hab - 2 , respectively .

reference_raw: Meanwhile, Iran has also developed small-range artillery missiles and is producing Scud-B and Scud-C-called Shehab-1 and Shehab-2.

reference_spacy_tokens: Meanwhile , Iran has also developed small - range artillery missiles and is producing Scud - B and Scud - C - called Shehab-1 and Shehab-2 .


fn_spacy_tokens_for_baseline: Tim , the gobaholic pretty boy frontman , is already a seasoned media pro -- although it rankles the band that it 's Tim 's face that is being plastered everywhere .

source_bert_toks: tim , the go ##bah ##olic pretty boy frontman , is already a seasoned media pro - - although it rank ##les the band that it ' s tim ' s face that is being plastered everywhere .

reference_raw: Tim, the gobaholic handsome boy frontman, is already a seasoned media pro - though he ranks the band as Tim's face is plastered all over the place.

reference_spacy_tokens: Tim , the gobaholic handsome boy frontman , is already a seasoned media pro - though he ranks the band as Tim 's face is plastered all over the place .


fn_spacy_tokens_for_baseline: ' He 's pretty straightforward most of the time , but he will nip darned hard when you 're tacking up and mean it !

source_bert_toks: ' he ' s pretty straightforward most of the time , but he will ni ##p dar ##ned hard when you ' re tack ##ing up and mean it !

reference_raw: 'He's pretty simple most of the time, but he'll nibble hard when you step up and mean it!

reference_spacy_tokens: ' He 's pretty simple most of the time , but he 'll nibble hard when you step up and mean it !


fn_spacy_tokens_for_baseline: We lived in a barracks in the End , barely saw the inside of the tube for ten weeks .

source_bert_toks: we lived in a barracks in the end , barely saw the inside of the tube for ten weeks .

reference_raw: We lived in a house in the End, and for ten weeks we could barely see the inside of the tunnel.

reference_spacy_tokens: We lived in a house in the End , and for ten weeks we could barely see the inside of the tunnel .


fn_spacy_tokens_for_baseline: Charles heard the scrape of a match , then a muttered curse .

source_bert_toks: charles heard the scrape of a match , then a muttered curse .

reference_raw: Charles heard the clatter of a match, then the murmur of a curse.

reference_spacy_tokens: Charles heard the clatter of a match , then the murmur of a curse .


fn_spacy_tokens_for_baseline: The other good news with Sun E45 , is that sand does n't stick to the skin .

source_bert_toks: the other good news with sun e ##45 , is that sand doesn ' t stick to the skin .

reference_raw: Another good thing about Sun E45 is that the sand doesn't stay on the skin.

reference_spacy_tokens: Another good thing about Sun E45 is that the sand does n't stay on the skin .


fn_spacy_tokens_for_baseline: About 80 species of birds worldwide have dispensed with the bothersome business of raising their own young and only about 50 of these are cuckoos of one sort or another .

source_bert_toks: about 80 species of birds worldwide have di ##sp ##ense ##d with the bother ##some business of raising their own young and only about 50 of these are cuckoo ##s of one sort or another .

reference_raw: Around 80 species of birds around the world have lost the burden of raising their own young, and only about 50 of them are cuckoos of one kind or another.

reference_spacy_tokens: Around 80 species of birds around the world have lost the burden of raising their own young , and only about 50 of them are cuckoos of one kind or another .


fn_spacy_tokens_for_baseline: Her hair lost its lustre .

source_bert_toks: her hair lost its lust ##re .

reference_raw: Her hair had lost its luster.

reference_spacy_tokens: Her hair had lost its luster .


fn_spacy_tokens_for_baseline: Population studies have shown that the susceptibility of institutionalised catatonic schizophrenics to cancer is very low .

source_bert_toks: population studies have shown that the su ##sc ##ept ##ibility of institutional ##ised cat ##aton ##ic sc ##hi ##zo ##ph ##ren ##ics to cancer is very low .

reference_raw: Population studies have shown that institutionalised catatonic schizophrenics are highly susceptible to cancer.

reference_spacy_tokens: Population studies have shown that institutionalised catatonic schizophrenics are highly susceptible to cancer .


fn_spacy_tokens_for_baseline: Two major disasters , costing ninety - four lives , provoked an unprecedented public outcry and led to a series of punitive measures against British clubs and their supporters .

source_bert_toks: two major disasters , costing ninety - four lives , provoked an unprecedented public out ##cr ##y and led to a series of pun ##itive measures against british clubs and their supporters .

reference_raw: Two major disasters, costing ninety-four lives, provoked an unprecedented public outburst and led to a series of repressions against British clubs and their supporters.

reference_spacy_tokens: Two major disasters , costing ninety - four lives , provoked an unprecedented public outburst and led to a series of repressions against British clubs and their supporters .


fn_spacy_tokens_for_baseline: The crag contains a great selection of classic climbs ; it would be a pity to lose access to it because of the thoughtless actions of a few loud - mouthed oafs .

source_bert_toks: the cr ##ag contains a great selection of classic climbs ; it would be a pity to lose access to it because of the thought ##less actions of a few loud - mouthed o ##af ##s .

reference_raw: The rock contains a great selection of classic climbs; it would be a shame to lose access to it because of the mindless deeds of a few loud-mouthed oafs.

reference_spacy_tokens: The rock contains a great selection of classic climbs ; it would be a shame to lose access to it because of the mindless deeds of a few loud - mouthed oafs .


fn_spacy_tokens_for_baseline: Lachlan 's axe clashed with it in mid - sweep .

source_bert_toks: lac ##hl ##an ' s axe clashed with it in mid - sweep .

reference_raw: Lachlan's axe struck him in mid-sweep.

reference_spacy_tokens: Lachlan 's axe struck him in mid - sweep .


fn_spacy_tokens_for_baseline: The colonial experience gave him material for his propositions about colonial nationalism , the subject which he quickly made his own .

source_bert_toks: the colonial experience gave him material for his proposition ##s about colonial nationalism , the subject which he quickly made his own .

reference_raw: His colonial experience had given him a basis for his suggestions about colonial nationalism, a subject he had quickly developed.

reference_spacy_tokens: His colonial experience had given him a basis for his suggestions about colonial nationalism , a subject he had quickly developed .


fn_spacy_tokens_for_baseline: The former Metrologie unit was Santa Cruz Operation Inc 's first partner in Europe and says that the relationship will continue .

source_bert_toks: the former metro ##logie unit was santa cruz operation inc ' s first partner in europe and says that the relationship will continue .

reference_raw: The former Metrology Unit was the first mate of Santa Cruz Operation Inc. in Europe and said the relationship would continue.

reference_spacy_tokens: The former Metrology Unit was the first mate of Santa Cruz Operation Inc. in Europe and said the relationship would continue .


fn_spacy_tokens_for_baseline: Mr Justice Elliot Belgrave had on Feb. 7 and Feb. 8 ordered the flogging of four convicted armed robbers , a measure immediately condemned by Amnesty International and other human rights organizations .

source_bert_toks: mr justice elliot bel ##grave had on feb . 7 and feb . 8 ordered the fl ##og ##ging of four convicted armed robbers , a measure immediately condemned by amnesty international and other human rights organizations .

reference_raw: On February 7th and February 8, Judge Elliot Belgrave ordered the whipping of four convicted armed robbers, an act immediately condemned by Amnesty International and other human rights organizations.

reference_spacy_tokens: On February 7th and February 8 , Judge Elliot Belgrave ordered the whipping of four convicted armed robbers , an act immediately condemned by Amnesty International and other human rights organizations .


fn_spacy_tokens_for_baseline: It is a dark and brooding sprawl of clutter and squawk which , magically , unravels into a jaw - dropping listening experience .

source_bert_toks: it is a dark and brooding sp ##ra ##wl of cl ##utter and sq ##ua ##wk which , magical ##ly , un ##rave ##ls into a jaw - dropping listening experience .

reference_raw: It's a dark, brooding sprawl of clutter and squawk that magically unravels into a hearing experience that drops its jaws.

reference_spacy_tokens: It 's a dark , brooding sprawl of clutter and squawk that magically unravels into a hearing experience that drops its jaws .


fn_spacy_tokens_for_baseline: I could n't wait for him to get here and yet when he tooted his car horn I suddenly clutched Mum and did n't want to go after all .

source_bert_toks: i couldn ' t wait for him to get here and yet when he too ##ted his car horn i suddenly clutched mum and didn ' t want to go after all .

reference_raw: I couldn't wait for him to come, but when he took his car horn, I suddenly grabbed my mom and didn't want to go.

reference_spacy_tokens: I could n't wait for him to come , but when he took his car horn , I suddenly grabbed my mom and did n't want to go .


fn_spacy_tokens_for_baseline: After Vezeronce Godomar took power in Burgundy , which he held until his overthrow in 534 .

source_bert_toks: after ve ##zer ##on ##ce god ##oma ##r took power in burgundy , which he held until his overthrow in 53 ##4 .

reference_raw: After Vezeronce Godomar took power in Burgundy, which he held until he was toppled in 534.

reference_spacy_tokens: After Vezeronce Godomar took power in Burgundy , which he held until he was toppled in 534 .


fn_spacy_tokens_for_baseline: These do not exist in the hops and must be converted from precursor a acids which are present by an extended period of boiling .

source_bert_toks: these do not exist in the hop ##s and must be converted from precursor a acids which are present by an extended period of boiling .

reference_raw: They do not exist in hops and must be converted from precursor acids present during a longer period of boiling.

reference_spacy_tokens: They do not exist in hops and must be converted from precursor acids present during a longer period of boiling .


fn_spacy_tokens_for_baseline: This power is common among other mammals .

source_bert_toks: this power is common among other mammals .

reference_raw: That power is common to other mammals.

reference_spacy_tokens: That power is common to other mammals .


fn_spacy_tokens_for_baseline: Chapters 2 - 6 discuss the technical issues of biological terrorism in greater detail .

source_bert_toks: chapters 2 - 6 discuss the technical issues of biological terrorism in greater detail .

reference_raw: The technical issues of bioterrorism are discussed in more detail in sections 2 to 6.

reference_spacy_tokens: The technical issues of bioterrorism are discussed in more detail in sections 2 to 6 .


fn_spacy_tokens_for_baseline: Frank 's reputation rests primarily on The Americans ( 1959 ) , a stunning collection of photographs which captured the underbelly of the United States -- its poverty , its injustice and the yearnings of its alienated underclass .

source_bert_toks: frank ' s reputation rests primarily on the americans ( 1959 ) , a stunning collection of photographs which captured the under ##bell ##y of the united states - - its poverty , its injustice and the yearning ##s of its alien ##ated under ##class .

reference_raw: Frank's reputation rests primarily on the Americans (1959), a stunning collection of photographs that captured the underbellies of the United States -- his poverty, his injustice, and the desires of his alienated underclass.

reference_spacy_tokens: Frank 's reputation rests primarily on the Americans ( 1959 ) , a stunning collection of photographs that captured the underbellies of the United States -- his poverty , his injustice , and the desires of his alienated underclass .


fn_spacy_tokens_for_baseline: He punted the few yards to the shore .

source_bert_toks: he punt ##ed the few yards to the shore .

reference_raw: He pushed a few yards to the bank.

reference_spacy_tokens: He pushed a few yards to the bank .


fn_spacy_tokens_for_baseline: Sure enough I found what I was looking for : a concealed pocket inside the quilted jerkin .

source_bert_toks: sure enough i found what i was looking for : a concealed pocket inside the quilt ##ed jerk ##in .

reference_raw: Of course I found what I was looking for: a hidden pocket in a blanket.

reference_spacy_tokens: Of course I found what I was looking for : a hidden pocket in a blanket .


fn_spacy_tokens_for_baseline: If plant and animal production is made much more efficient in its use of resources , food surpluses could remain a recurring problem , certainly in the short term .

source_bert_toks: if plant and animal production is made much more efficient in its use of resources , food surplus ##es could remain a recurring problem , certainly in the short term .

reference_raw: If plant and animal production is more efficient in using resources, food surpluses could remain a recurrent problem, certainly in the short term.

reference_spacy_tokens: If plant and animal production is more efficient in using resources , food surpluses could remain a recurrent problem , certainly in the short term .


fn_spacy_tokens_for_baseline: To achieve his dream , he has to stand logic on its head .

source_bert_toks: to achieve his dream , he has to stand logic on its head .

reference_raw: In order to achieve his dream, he must have logic on his head.

reference_spacy_tokens: In order to achieve his dream , he must have logic on his head .


fn_spacy_tokens_for_baseline: When she came to think of it , the only thing she and Jerome had ever agreed about was what a difficult , trying and utterly maddening creature Nora was .

source_bert_toks: when she came to think of it , the only thing she and jerome had ever agreed about was what a difficult , trying and utterly madden ##ing creature nora was .

reference_raw: When she thought about it, the only thing she and Jerome had ever agreed on was what a hard, trying, and utterly insane creature Nora was.

reference_spacy_tokens: When she thought about it , the only thing she and Jerome had ever agreed on was what a hard , trying , and utterly insane creature Nora was .


fn_spacy_tokens_for_baseline: I was hanging on to the ledge at the deep end , arms out in the crucifix position when I saw her come out of the ladies ' changing rooms wearing a yellow and white striped one - piece .

source_bert_toks: i was hanging on to the ledge at the deep end , arms out in the cr ##uc ##if ##ix position when i saw her come out of the ladies ' changing rooms wearing a yellow and white striped one - piece .

reference_raw: I was clinging to the ledge at the far end, arms outstretched in a crucifix position when I saw her come out of the ladies' changing room in a yellow-and-white striped one-piece.

reference_spacy_tokens: I was clinging to the ledge at the far end , arms outstretched in a crucifix position when I saw her come out of the ladies ' changing room in a yellow - and - white striped one - piece .


fn_spacy_tokens_for_baseline: The baptising is the act of initiation into the community of the redeemed .

source_bert_toks: the ba ##pt ##ising is the act of initiation into the community of the red ##eem ##ed .

reference_raw: Baptising is an act of instigation to the community of the redeemed.

reference_spacy_tokens: Baptising is an act of instigation to the community of the redeemed .


fn_spacy_tokens_for_baseline: Since electrical pulses zinging down a wire are more regular and predictable than a steel cable moving inside a plastic cover , the result should be more precise control of engine revs and better fuel consumption .

source_bert_toks: since electrical pulses z ##inging down a wire are more regular and predictable than a steel cable moving inside a plastic cover , the result should be more precise control of engine rev ##s and better fuel consumption .

reference_raw: As the electric pulses zigzagging on the wire are more regular and predictable than the steel cable moving inside the plastic envelope, the result should be a more accurate control of the engine revs and a better fuel consumption.

reference_spacy_tokens: As the electric pulses zigzagging on the wire are more regular and predictable than the steel cable moving inside the plastic envelope , the result should be a more accurate control of the engine revs and a better fuel consumption .


fn_spacy_tokens_for_baseline: It takes longer to saturate large rods with deuterium than to saturate the smaller ones ; the latter took up to a fortnight and they estimated that the largest rods could take up to a year .

source_bert_toks: it takes longer to sat ##ura ##te large rods with de ##uter ##ium than to sat ##ura ##te the smaller ones ; the latter took up to a fort ##night and they estimated that the largest rods could take up to a year .

reference_raw: It takes longer to feed the large rods with deuterium than to feed the smaller ones; they lasted up to two weeks and estimated that the largest rods could last up to a year.

reference_spacy_tokens: It takes longer to feed the large rods with deuterium than to feed the smaller ones ; they lasted up to two weeks and estimated that the largest rods could last up to a year .


fn_spacy_tokens_for_baseline: Colonnaded public buildings , iron balconies , winding streets , flagstoned squares and the many churches all speak of the Portuguese inheritance as well as the Chinese , a fusion of East and West that has produced the unique Macanese culture .

source_bert_toks: colon ##nad ##ed public buildings , iron bal ##con ##ies , winding streets , flags ##tone ##d squares and the many churches all speak of the portuguese inheritance as well as the chinese , a fusion of east and west that has produced the unique mac ##ane ##se culture .

reference_raw: The colonned public buildings, the steel balconies, the winding streets, the flagstone squares, and many churches, all speak of the Portuguese heritage, and of China, the fusion of East and West, which created a unique Macanese culture.

reference_spacy_tokens: The colonned public buildings , the steel balconies , the winding streets , the flagstone squares , and many churches , all speak of the Portuguese heritage , and of China , the fusion of East and West , which created a unique Macanese culture .


fn_spacy_tokens_for_baseline: Viewing sunset and dawnrise skyscapes was secondary to viewing each other across the road .

source_bert_toks: viewing sunset and dawn ##rise sky ##sca ##pes was secondary to viewing each other across the road .

reference_raw: The sight of the sunset and the dawn sky was secondary to seeing each other on the other side of the road.

reference_spacy_tokens: The sight of the sunset and the dawn sky was secondary to seeing each other on the other side of the road .


fn_spacy_tokens_for_baseline: So it was n't as if she was being maltreated . '

source_bert_toks: so it wasn ' t as if she was being mal ##tre ##ated . '

reference_raw: So it wasn't like she was being treated badly.'

reference_spacy_tokens: So it was n't like she was being treated badly . '


fn_spacy_tokens_for_baseline: Mr Weston was kicked , punched and hit with an umbrella before his poster -- ' Rich Tories are the real poll tax parasites ' -- was stamped on and ripped up .

source_bert_toks: mr weston was kicked , punched and hit with an umbrella before his poster - - ' rich tori ##es are the real poll tax parasites ' - - was stamped on and ripped up .

reference_raw: Mr. Weston was kicked, hit and hit by an umbrella in front of his poster - 'Rich Tories are real polling parasites' - he was stamped and torn apart.

reference_spacy_tokens: Mr. Weston was kicked , hit and hit by an umbrella in front of his poster - ' Rich Tories are real polling parasites ' - he was stamped and torn apart .


fn_spacy_tokens_for_baseline: A tallyman or woman visited their dressing - rooms with exquisitely embroidered lingerie which they found impossible to resist .

source_bert_toks: a tally ##man or woman visited their dressing - rooms with exquisite ##ly embroidered linger ##ie which they found impossible to resist .

reference_raw: A tallyman or woman visited their dressing rooms with an exquisitely embroidered underwear they found impossible to resist.

reference_spacy_tokens: A tallyman or woman visited their dressing rooms with an exquisitely embroidered underwear they found impossible to resist .


fn_spacy_tokens_for_baseline: A former Manchester policeman jailed for 17 years for armed robbery and firearms offences has been freed by the Appeal Court .

source_bert_toks: a former manchester policeman jailed for 17 years for armed robbery and firearms offences has been freed by the appeal court .

reference_raw: The appeal court released an ex-Manchester cop in prison for 17 years for armed theft and firearms crimes.

reference_spacy_tokens: The appeal court released an ex - Manchester cop in prison for 17 years for armed theft and firearms crimes .


fn_spacy_tokens_for_baseline: Yet , encouraged by Tory Central Office , sections of the Press are keener to criticise Labour for the quality of its opposition than to slam the Government for policy failures .

source_bert_toks: yet , encouraged by tory central office , sections of the press are keen ##er to critic ##ise labour for the quality of its opposition than to slam the government for policy failures .

reference_raw: But, supported by the Central Office of Tory, press sections are keener to criticize Labour for the quality of his opposition than to beat the government for political failures.

reference_spacy_tokens: But , supported by the Central Office of Tory , press sections are keener to criticize Labour for the quality of his opposition than to beat the government for political failures .


fn_spacy_tokens_for_baseline: I thought and think that war is an evil abominable thing which gets man no further and only lowers him in his search after truth .

source_bert_toks: i thought and think that war is an evil ab ##omi ##nable thing which gets man no further and only lowers him in his search after truth .

reference_raw: I've been thinking and thinking that war is a bad thing that doesn't get a man any more, and it just reduces him to the point where he's looking for the truth.

reference_spacy_tokens: I 've been thinking and thinking that war is a bad thing that does n't get a man any more , and it just reduces him to the point where he 's looking for the truth .


fn_spacy_tokens_for_baseline: Informed on by the Spanish police , he committed suicide rather than be captured by the Gestapo , by taking an overdose of morphine .

source_bert_toks: informed on by the spanish police , he committed suicide rather than be captured by the gestapo , by taking an overdose of mor ##phine .

reference_raw: Informed by the Spanish police, he committed suicide rather than being captured by the Gestapo by an overdose of morphia.

reference_spacy_tokens: Informed by the Spanish police , he committed suicide rather than being captured by the Gestapo by an overdose of morphia .