fn_spacy_tokens_for_baseline: To begin with , a very large number of the objects recovered from archaeological sites had a ritual function , and many of the images carved on sealstones and painted on wall plaster and pottery show religious symbols , rituals , or mythic events .

source_bert_toks: to begin with , a very large number of the objects recovered from archaeological sites had a ritual function , and many of the images carved on seals ##tones and painted on wall plaster and pottery show religious symbols , rituals , or myth ##ic events .

reference_raw: For starters, many of the objects recovered from archaeological sites had a ritual function, and many of the paintings engraved on sealstones and painted on wall plaster and ceramic show religious symbols, rituals, and mythical events.

reference_spacy_tokens: For starters , many of the objects recovered from archaeological sites had a ritual function , and many of the paintings engraved on sealstones and painted on wall plaster and ceramic show religious symbols , rituals , and mythical events .


fn_spacy_tokens_for_baseline: ' Thomas met his enemy face to face that afternoon too , ' shrilled Gwendolen , determined that her beloved 's name should at least be represented .

source_bert_toks: ' thomas met his enemy face to face that afternoon too , ' shrill ##ed gwen ##do ##len , determined that her beloved ' s name should at least be represented .

reference_raw: 'Thomas met the enemy face-to-face that afternoon,' said Gwendolen, determined that the name of her beloved should at least be represented.

reference_spacy_tokens: ' Thomas met the enemy face - to - face that afternoon , ' said Gwendolen , determined that the name of her beloved should at least be represented .


fn_spacy_tokens_for_baseline: The blurb on this book / disk package reads , " Supplies you with 470,000 true synonyms for 40,000 entries . "

source_bert_toks: the blur ##b on this book / disk package reads , " supplies you with 470 , 000 true synonym ##s for 40 , 000 entries . "

reference_raw: The blur on this package of books and disks reads, "Supply you with 470,000 real synonyms for 40,000 items."

reference_spacy_tokens: The blur on this package of books and disks reads , " Supply you with 470,000 real synonyms for 40,000 items . "


fn_spacy_tokens_for_baseline: There are no indications that this view has altered since the end of the Cold War .

source_bert_toks: there are no indications that this view has altered since the end of the cold war .

reference_raw: There is nothing to suggest that that position has changed since the end of the Cold War.

reference_spacy_tokens: There is nothing to suggest that that position has changed since the end of the Cold War .


fn_spacy_tokens_for_baseline: My feet tickle with the marching rhythm .

source_bert_toks: my feet tick ##le with the marching rhythm .

reference_raw: My feet tingle with the rhythm of the march.

reference_spacy_tokens: My feet tingle with the rhythm of the march .


fn_spacy_tokens_for_baseline: The climate here can best be described as " changeable " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city 's magic .

source_bert_toks: the climate here can best be described as " change ##able " and yet the sudden shifts from light to dark , sunshine to shower , are part of the city ' s magic .

reference_raw: The climate here is best described as "changeable", but the sudden shift from daylight to darkness, sun to shower, is part of the city's magic.

reference_spacy_tokens: The climate here is best described as " changeable " , but the sudden shift from daylight to darkness , sun to shower , is part of the city 's magic .


fn_spacy_tokens_for_baseline: Even without a shirt , and he was often bare - chested beneath his jacket .

source_bert_toks: even without a shirt , and he was often bare - chest ##ed beneath his jacket .

reference_raw: Even without his shirt, and his chest was often bare under his jacket.

reference_spacy_tokens: Even without his shirt , and his chest was often bare under his jacket .


fn_spacy_tokens_for_baseline: He needed smartening up a bit ; his mother ought to look after him better , even if the dad had scarpered with this Sheila woman .

source_bert_toks: he needed smart ##ening up a bit ; his mother ought to look after him better , even if the dad had scar ##per ##ed with this sheila woman .

reference_raw: He needed to be smart; his mother should take better care of him, even if his father was scarred by this Sheila.

reference_spacy_tokens: He needed to be smart ; his mother should take better care of him , even if his father was scarred by this Sheila .


fn_spacy_tokens_for_baseline: As the double - decker boats get ready to leave the pier , bells ring , the gangplank is raised , deckhands in blue sailor suits man the hawsers , and a couple of hundred commuters begin a seven - minute sightseeing tour .

source_bert_toks: as the double - decker boats get ready to leave the pier , bells ring , the gang ##pl ##an ##k is raised , deck ##hand ##s in blue sailor suits man the ha ##ws ##ers , and a couple of hundred commuter ##s begin a seven - minute sights ##ee ##ing tour .

reference_raw: As the two deckboats prepare to leave the pier, the bells ring, the gangplank rises, the deckhands in the blue sailor suits the hawsers, and a few hundred commuters begin a seven-minute sightseeing tour.

reference_spacy_tokens: As the two deckboats prepare to leave the pier , the bells ring , the gangplank rises , the deckhands in the blue sailor suits the hawsers , and a few hundred commuters begin a seven - minute sightseeing tour .


fn_spacy_tokens_for_baseline: His electrifying speed earned him seven international caps for Scotland as a wing three - quarter .

source_bert_toks: his elect ##ri ##fying speed earned him seven international caps for scotland as a wing three - quarter .

reference_raw: His electric speed earned him seven international caps for Scotland as a three-quarter wing.

reference_spacy_tokens: His electric speed earned him seven international caps for Scotland as a three - quarter wing .


fn_spacy_tokens_for_baseline: These are particularly exciting times at the Indianapolis Museum of Art : Progress continues on the J.K. Lilly estate - Oldfields , our Ravine Garden has been restored to its original splendor , and there is national attention showered on our current exhibition of Japanese Painting . ( please see The New York Times article I have included . ) With thousands of trees and flowers in bloom , we are having a beautiful Spring !

source_bert_toks: these are particularly exciting times at the indianapolis museum of art : progress continues on the j . k . lilly estate - old ##fields , our ravine garden has been restored to its original sp ##len ##dor , and there is national attention showered on our current exhibition of japanese painting . ( please see the new york times article i have included . ) with thousands of trees and flowers in bloom , we are having a beautiful spring !

reference_raw: This is a particularly exciting time at the Indianapolis Museum of Art: progress continues in the J.K. Lilly estate-oldfields, our Ravine Garden has been restored to its original beauty, and the nation's attention has been showered in our present exhibition of Japanese paintings (see the New York Times article I've included), with thousands of trees and flowers in bloom, we have a beautiful spring!

reference_spacy_tokens: This is a particularly exciting time at the Indianapolis Museum of Art : progress continues in the J.K. Lilly estate - oldfields , our Ravine Garden has been restored to its original beauty , and the nation 's attention has been showered in our present exhibition of Japanese paintings ( see the New York Times article I 've included ) , with thousands of trees and flowers in bloom , we have a beautiful spring !


fn_spacy_tokens_for_baseline: The waterfront here offers unparalled views of the harbor and Hong Kong Island .

source_bert_toks: the waterfront here offers un ##para ##lled views of the harbor and hong kong island .

reference_raw: There is a unique view of the port and the island of Hong Kong.

reference_spacy_tokens: There is a unique view of the port and the island of Hong Kong .


fn_spacy_tokens_for_baseline: David took Hayley 's hand in his , and Juliet felt a strange warmth steal through her , and a pang of some emotion she did n't recognise .

source_bert_toks: david took hay ##ley ' s hand in his , and juliet felt a strange warmth steal through her , and a pang of some emotion she didn ' t recognise .

reference_raw: David took Hayley's hand in his, and Juliet felt a strange warmth creep through her, a pang of emotion she did not recognize.

reference_spacy_tokens: David took Hayley 's hand in his , and Juliet felt a strange warmth creep through her , a pang of emotion she did not recognize .


fn_spacy_tokens_for_baseline: ' I had been rowing with my dad since I was little , so I did n't want to go to his new family with my brother .

source_bert_toks: ' i had been rowing with my dad since i was little , so i didn ' t want to go to his new family with my brother .

reference_raw: I fought with my father when I was a kid, so I didn't want to go to his new family with my brother.

reference_spacy_tokens: I fought with my father when I was a kid , so I did n't want to go to his new family with my brother .


fn_spacy_tokens_for_baseline: I took the dinghy as far as we could go , right up near to the lock gates .

source_bert_toks: i took the ding ##hy as far as we could go , right up near to the lock gates .

reference_raw: I took the dinghy as far as I could go, close to the lockgate.

reference_spacy_tokens: I took the dinghy as far as I could go , close to the lockgate .


fn_spacy_tokens_for_baseline: Students living in crowded dormitories under the watchful eyes of their ' banzhuren ' and monitors could be kept in line relatively easily .

source_bert_toks: students living in crowded dorm ##itor ##ies under the watch ##ful eyes of their ' ban ##zh ##ure ##n ' and monitors could be kept in line relatively easily .

reference_raw: Students living in crowded bedrooms under the watchful eyes of their "banzhuren" and monitors were relatively easy to keep in line.

reference_spacy_tokens: Students living in crowded bedrooms under the watchful eyes of their " banzhuren " and monitors were relatively easy to keep in line .


fn_spacy_tokens_for_baseline: Sometimes , no matter how hard you brandished your fist , no matter how loudly you barked a protest , the world continued on its way without even noticing that you were there .

source_bert_toks: sometimes , no matter how hard you brand ##ished your fist , no matter how loudly you barked a protest , the world continued on its way without even noticing that you were there .

reference_raw: Sometimes, no matter how hard you flicked your fist, no matter how loud you snapped a protest, the world went on without noticing you were there.

reference_spacy_tokens: Sometimes , no matter how hard you flicked your fist , no matter how loud you snapped a protest , the world went on without noticing you were there .


fn_spacy_tokens_for_baseline: The parable may refer to the fact that in Jesus ' time the Zealots ( this was a name given to nationalists ) were stirring up the peasants to revolt against such landlords .

source_bert_toks: the para ##ble may refer to the fact that in jesus ' time the ze ##alo ##ts ( this was a name given to nationalists ) were stirring up the peasants to revolt against such landlord ##s .

reference_raw: The parable might refer to the fact that, in Jesus' time, the Zealots (that was the name given to the nationalists) had incited the peasants to rebel against such landlords.

reference_spacy_tokens: The parable might refer to the fact that , in Jesus ' time , the Zealots ( that was the name given to the nationalists ) had incited the peasants to rebel against such landlords .


fn_spacy_tokens_for_baseline: The air was constantly heavy with moisture , few days being clear of the mists , which veiled the moor - tops and drifted among the valley trees in swathes , cloaking the bare branches .

source_bert_toks: the air was constantly heavy with moisture , few days being clear of the mist ##s , which veil ##ed the moor - tops and drifted among the valley trees in swat ##hes , cloak ##ing the bare branches .

reference_raw: The air was still thick with moisture, and for several days it was clear of the fog that obscured the moor-tops and floated in swaths among the valley trees, covering the bare branches.

reference_spacy_tokens: The air was still thick with moisture , and for several days it was clear of the fog that obscured the moor - tops and floated in swaths among the valley trees , covering the bare branches .


fn_spacy_tokens_for_baseline: A spokesman for the college , Scott Craig , described the scene : " I saw flames about 100 feet high in the air shooting up with the wind just howling .

source_bert_toks: a spokesman for the college , scott craig , described the scene : " i saw flames about 100 feet high in the air shooting up with the wind just howling .

reference_raw: The school spokesman, Scott Craig, described the scene: "I saw fires in the air, about a hundred feet high, shot up by the wind, howling.

reference_spacy_tokens: The school spokesman , Scott Craig , described the scene : " I saw fires in the air , about a hundred feet high , shot up by the wind , howling .


fn_spacy_tokens_for_baseline: The next thing she had known , Louise and Miriam were wrapping her unclothed person in a clean towel while , not far away , the Padre was discussing religious matters with Harry and Fleury .

source_bert_toks: the next thing she had known , louise and miriam were wrapping her un ##cloth ##ed person in a clean towel while , not far away , the padre was discussing religious matters with harry and fl ##eur ##y .

reference_raw: The next thing she knew, Louise and Miriam wrapped her undressed person in a clean towel while the Padre discussed religious matters with Harry and Fleury not far away.

reference_spacy_tokens: The next thing she knew , Louise and Miriam wrapped her undressed person in a clean towel while the Padre discussed religious matters with Harry and Fleury not far away .


fn_spacy_tokens_for_baseline: Jalal Shamlou was seething .

source_bert_toks: ja ##lal sham ##lou was see ##thing .

reference_raw: Jalal Shamlou was pouring.

reference_spacy_tokens: Jalal Shamlou was pouring .


fn_spacy_tokens_for_baseline: " You really think a woman should be forced to have a baby if she does n't want it ? "

source_bert_toks: " you really think a woman should be forced to have a baby if she doesn ' t want it ? "

reference_raw: "Do you really think a woman should be forced to bear a child if she doesn't want to?"

reference_spacy_tokens: " Do you really think a woman should be forced to bear a child if she does n't want to ? "


fn_spacy_tokens_for_baseline: We experience guilt when we blame ourselves or our actions for events .

source_bert_toks: we experience guilt when we blame ourselves or our actions for events .

reference_raw: When we blame ourselves or our actions for events, we feel guilty.

reference_spacy_tokens: When we blame ourselves or our actions for events , we feel guilty .


fn_spacy_tokens_for_baseline: A strategy centered on eliminating extremist enclaves in Pakistan carries additional risks .

source_bert_toks: a strategy centered on eliminating ex ##tre ##mist enclave ##s in pakistan carries additional risks .

reference_raw: A strategy focused on the elimination of extremist enclaves in Pakistan entails additional hazards.

reference_spacy_tokens: A strategy focused on the elimination of extremist enclaves in Pakistan entails additional hazards .


fn_spacy_tokens_for_baseline: They were strong stuff these Tales of the Wild East , which included gang rapes , homosexual orgies , incest , fratricide .

source_bert_toks: they were strong stuff these tales of the wild east , which included gang rape ##s , homosexual org ##ies , inc ##est , fra ##tric ##ide .

reference_raw: These stories of the Wild East were powerful things, including gang rapes, gay orgies, incest, and fratricides.

reference_spacy_tokens: These stories of the Wild East were powerful things , including gang rapes , gay orgies , incest , and fratricides .


fn_spacy_tokens_for_baseline: Only two months later , the Korean Workers ' Party Central Committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

source_bert_toks: only two months later , the korean workers ' party central committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

reference_raw: Only two months later, the Central Committee of Korean Workers adopted policies to strengthen the military and implement import-replacement programs to reduce dependence on weapons imports.

reference_spacy_tokens: Only two months later , the Central Committee of Korean Workers adopted policies to strengthen the military and implement import - replacement programs to reduce dependence on weapons imports .


fn_spacy_tokens_for_baseline: I 'd hoped to gain sympathy from those idiotic journalists .

source_bert_toks: i ' d hoped to gain sympathy from those idiot ##ic journalists .

reference_raw: I was hoping to get sympathy from those idiot journalists.

reference_spacy_tokens: I was hoping to get sympathy from those idiot journalists .


fn_spacy_tokens_for_baseline: Her shift , too , was white , but it was sticking to her body here and there with sweat .

source_bert_toks: her shift , too , was white , but it was sticking to her body here and there with sweat .

reference_raw: Her shift was white, too, but she clung to her body from time to time with sweat.

reference_spacy_tokens: Her shift was white , too , but she clung to her body from time to time with sweat .


fn_spacy_tokens_for_baseline: In French the two sentences are further linked by the contrasted masculine and feminine genders reinforcing the metaphor of deceased husband and bereaved wife .

source_bert_toks: in french the two sentences are further linked by the contrasted masculine and feminine gender ##s rein ##for ##cing the metaphor of deceased husband and be ##rea ##ved wife .

reference_raw: In France, the two sentences are further linked by the contrast between male and female sexes that reinforce the metaphor of a dead husband and a bereaved wife.

reference_spacy_tokens: In France , the two sentences are further linked by the contrast between male and female sexes that reinforce the metaphor of a dead husband and a bereaved wife .


fn_spacy_tokens_for_baseline: Significantly , however , it also recommended safeguards against the dismissal of chief officers including a proposal to prevent dismissal of a chief executive except on the vote of two - thirds of council membership .

source_bert_toks: significantly , however , it also recommended safeguard ##s against the dismissal of chief officers including a proposal to prevent dismissal of a chief executive except on the vote of two - thirds of council membership .

reference_raw: However, importantly, it also recommended safeguards against senior officials being dismissed, including a proposal to prevent the chief executive from being dismissed, with the exception of a vote of two-thirds of the members of the board.

reference_spacy_tokens: However , importantly , it also recommended safeguards against senior officials being dismissed , including a proposal to prevent the chief executive from being dismissed , with the exception of a vote of two - thirds of the members of the board .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali gunmen who hijacked a United Nations chartered ship carrying food aid to victims of tsunamis released the ship after holding it for more than two months.

reference_spacy_tokens: According to the United Nations , Somali gunmen who hijacked a United Nations chartered ship carrying food aid to victims of tsunamis released the ship after holding it for more than two months .


fn_spacy_tokens_for_baseline: A survey of lands belonging to the manor of Sheffield in 1611 describes the farmsteads and gives the names and measurements of all the fields .

source_bert_toks: a survey of lands belonging to the manor of sheffield in 1611 describes the farms ##tead ##s and gives the names and measurements of all the fields .

reference_raw: The inspection of the land belonging to the Sheffield estate in 1611 describes the farms and describes the names and measurements of all the fields.

reference_spacy_tokens: The inspection of the land belonging to the Sheffield estate in 1611 describes the farms and describes the names and measurements of all the fields .


fn_spacy_tokens_for_baseline: The friar sighed and rose , dusting the wet ice from his robe .

source_bert_toks: the friar sighed and rose , dustin ##g the wet ice from his robe .

reference_raw: The monk sighed and stood up, brushing wet ice from his robes.

reference_spacy_tokens: The monk sighed and stood up , brushing wet ice from his robes .


fn_spacy_tokens_for_baseline: Sending it by sea , on the other hand , would run the risk of hijackings by terrorists or even governments .

source_bert_toks: sending it by sea , on the other hand , would run the risk of hi ##jack ##ings by terrorists or even governments .

reference_raw: On the other hand, sending it by sea would risk kidnapping by terrorists or even governments.

reference_spacy_tokens: On the other hand , sending it by sea would risk kidnapping by terrorists or even governments .


fn_spacy_tokens_for_baseline: Maggie 's gaze was locked onto her younger sister 's agonized eyes , then the eyes too had gone .

source_bert_toks: maggie ' s gaze was locked onto her younger sister ' s ago ##ni ##zed eyes , then the eyes too had gone .

reference_raw: Maggie's eyes were fixed on the anguished eyes of her younger sister, and then her eyes were gone.

reference_spacy_tokens: Maggie 's eyes were fixed on the anguished eyes of her younger sister , and then her eyes were gone .


fn_spacy_tokens_for_baseline: The point dogs catch him and one of them nips him on the leg -- take that for being more popular with the boss .

source_bert_toks: the point dogs catch him and one of them ni ##ps him on the leg - - take that for being more popular with the boss .

reference_raw: The point dogs catch him, and one of them nipples him on the leg -- take it for being more popular with the boss.

reference_spacy_tokens: The point dogs catch him , and one of them nipples him on the leg -- take it for being more popular with the boss .


fn_spacy_tokens_for_baseline: The dragon folded its wings and poked its head in among the greenery , while its master leaned against a tree and whistled tunelessly .

source_bert_toks: the dragon folded its wings and poked its head in among the greene ##ry , while its master leaned against a tree and whistled tune ##lessly .

reference_raw: The dragon folded its wings and stuck its head through the green, while its master leaned against the tree and whistled tunelessly.

reference_spacy_tokens: The dragon folded its wings and stuck its head through the green , while its master leaned against the tree and whistled tunelessly .


fn_spacy_tokens_for_baseline: Taking a walk on the Malvern Hills the children were surprised to learn that the next highest point on the horizon is the Russian mountain range , the Urals .

source_bert_toks: taking a walk on the malvern hills the children were surprised to learn that the next highest point on the horizon is the russian mountain range , the ur ##als .

reference_raw: As they walked along the Malvern Hills, the children were surprised to learn that the next highest point on the horizon was the Russian mountainside, the Urals.

reference_spacy_tokens: As they walked along the Malvern Hills , the children were surprised to learn that the next highest point on the horizon was the Russian mountainside , the Urals .


fn_spacy_tokens_for_baseline: " The books in the prison library are ghastly and we only get the most dreadful newspapers , The Sun and something called . the Daily Star .

source_bert_toks: " the books in the prison library are g ##has ##tly and we only get the most dreadful newspapers , the sun and something called . the daily star .

reference_raw: "The books in the prison library are terrible, and all we get are the worst newspapers, the Sun, and something called the Daily Star.

reference_spacy_tokens: " The books in the prison library are terrible , and all we get are the worst newspapers , the Sun , and something called the Daily Star .


fn_spacy_tokens_for_baseline: It is essential that the inside surface is smooth and flowing , any ripples are exaggerated by the reflections from the spherical surface .

source_bert_toks: it is essential that the inside surface is smooth and flowing , any ripple ##s are exaggerated by the reflections from the spherical surface .

reference_raw: It is essential that the inner surface is smooth and flowing, and that any ripples are exaggerated by the reflections of the round surface.

reference_spacy_tokens: It is essential that the inner surface is smooth and flowing , and that any ripples are exaggerated by the reflections of the round surface .


fn_spacy_tokens_for_baseline: Jalalabad has up to now disproved this theory .

source_bert_toks: ja ##lal ##abad has up to now di ##sp ##roved this theory .

reference_raw: So far, Jalalabad has refuted that theory.

reference_spacy_tokens: So far , Jalalabad has refuted that theory .


fn_spacy_tokens_for_baseline: Her hands had gone , involuntarily , to the buttons on her bodice , her fingers defensively closing the gap .

source_bert_toks: her hands had gone , in ##vo ##lun ##tar ##ily , to the buttons on her bo ##dice , her fingers defensive ##ly closing the gap .

reference_raw: Involuntarily, her hands went to the buttons on her body and her fingers closed the gap.

reference_spacy_tokens: Involuntarily , her hands went to the buttons on her body and her fingers closed the gap .


fn_spacy_tokens_for_baseline: He also brought the Ark of the Covenant , the portable tabernacle containing the Tablets of the Law received on Mount Sinai , to the Spring of Gihon , just outside the walls of Jerusalem .

source_bert_toks: he also brought the ark of the covenant , the portable tab ##ern ##acle containing the tablets of the law received on mount sinai , to the spring of gi ##hon , just outside the walls of jerusalem .

reference_raw: He had also brought the Ark of the Covenant, a portable tablet containing the tablets of the Law received on Mount Sinai, to the spring of Gihon, just outside the walls of Jerusalem.

reference_spacy_tokens: He had also brought the Ark of the Covenant , a portable tablet containing the tablets of the Law received on Mount Sinai , to the spring of Gihon , just outside the walls of Jerusalem .


fn_spacy_tokens_for_baseline: Here , a fast , sparkling fresh stream springs into existence , fords a lane and runs parallel to a wooden pathway .

source_bert_toks: here , a fast , sparkling fresh stream springs into existence , ford ##s a lane and runs parallel to a wooden pathway .

reference_raw: Here, a quick, sparkling fresh stream emerges, forks a lane and runs parallel to a wooden path.

reference_spacy_tokens: Here , a quick , sparkling fresh stream emerges , forks a lane and runs parallel to a wooden path .


fn_spacy_tokens_for_baseline: He had seemed too good to be true -- the perfectly attired golfer , with check cap , patterned pullover , tartan trousers and , most improbable of all , a Royal and Ancient tie .

source_bert_toks: he had seemed too good to be true - - the perfectly attire ##d golfer , with check cap , patterned pull ##over , tar ##tan trousers and , most imp ##ro ##ba ##ble of all , a royal and ancient tie .

reference_raw: He seemed too good to be true -- a perfectly dressed golfer with a control cap, a patterned pullover, tartan pants, and, most unlikely of all, a royal and ancient tie.

reference_spacy_tokens: He seemed too good to be true -- a perfectly dressed golfer with a control cap , a patterned pullover , tartan pants , and , most unlikely of all , a royal and ancient tie .


fn_spacy_tokens_for_baseline: If they did we should have them , for every port is watched .

source_bert_toks: if they did we should have them , for every port is watched .

reference_raw: If they did, we'd have them, because we're watching every harbor.

reference_spacy_tokens: If they did , we 'd have them , because we 're watching every harbor .


fn_spacy_tokens_for_baseline: The tough world of motor racing finds Cagney competing against his brother for glory and the girl .

source_bert_toks: the tough world of motor racing finds ca ##gne ##y competing against his brother for glory and the girl .

reference_raw: In the hard world of motor races, Cagney is in competition with his brother for fame and the girl.

reference_spacy_tokens: In the hard world of motor races , Cagney is in competition with his brother for fame and the girl .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key question is how the US deployment of ballistic missile defense (formerly known as theater and national missile defense) will affect the pace and extent of Chinese strategic modernisation.

reference_spacy_tokens: The key question is how the US deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and extent of Chinese strategic modernisation .


fn_spacy_tokens_for_baseline: True to the myth , the reclusive Hughes immediately cloistered himself in the Desert Inn 's penthouse .

source_bert_toks: true to the myth , the rec ##lus ##ive hughes immediately cl ##ois ##tered himself in the desert inn ' s penthouse .

reference_raw: True to the myth, the solitary Hughes immediately cloistered himself in the dungeons of the desert inn.

reference_spacy_tokens: True to the myth , the solitary Hughes immediately cloistered himself in the dungeons of the desert inn .


fn_spacy_tokens_for_baseline: Deeply concerned by this news , we dispatched letters to the agony aunts of Fleet Street to seek advice .

source_bert_toks: deeply concerned by this news , we dispatched letters to the agony aunt ##s of fleet street to seek advice .

reference_raw: Deeply concerned with this news, we sent letters to Fleet Street's tormented aunts for advice.

reference_spacy_tokens: Deeply concerned with this news , we sent letters to Fleet Street 's tormented aunts for advice .


fn_spacy_tokens_for_baseline: It was tactful of you not to say so .

source_bert_toks: it was ta ##ct ##ful of you not to say so .

reference_raw: It was nice of you not to say that.

reference_spacy_tokens: It was nice of you not to say that .


fn_spacy_tokens_for_baseline: I do not know of any direct evidence that sexually transmitted diseases increase the libido of sufferers , but I conjecture that it would be worth looking into .

source_bert_toks: i do not know of any direct evidence that sexually transmitted diseases increase the li ##bid ##o of suffer ##ers , but i conjecture that it would be worth looking into .

reference_raw: I don't know any direct evidence that sexually transmitted diseases increase the sufferer's libido, but I think it's worth looking into.

reference_spacy_tokens: I do n't know any direct evidence that sexually transmitted diseases increase the sufferer 's libido , but I think it 's worth looking into .


fn_spacy_tokens_for_baseline: So the insufficiency of gold reserves resulted from higher volume of trade , not higher prices .

source_bert_toks: so the ins ##uf ##fi ##ciency of gold reserves resulted from higher volume of trade , not higher prices .

reference_raw: The lack of gold reserves was therefore the result of a higher volume of trade, not higher prices.

reference_spacy_tokens: The lack of gold reserves was therefore the result of a higher volume of trade , not higher prices .


fn_spacy_tokens_for_baseline: One of these walls , the Western Wall , is today a major reminder of Jerusalem 's greatness under Herod .

source_bert_toks: one of these walls , the western wall , is today a major reminder of jerusalem ' s great ##ness under hero ##d .

reference_raw: One of these walls, the western wall, is now the main remembrance of the greatness of Jerusalem under Herod.

reference_spacy_tokens: One of these walls , the western wall , is now the main remembrance of the greatness of Jerusalem under Herod .


fn_spacy_tokens_for_baseline: I venture to guess he would still be director .

source_bert_toks: i venture to guess he would still be director .

reference_raw: I dare say he'd still be a director.

reference_spacy_tokens: I dare say he 'd still be a director .


fn_spacy_tokens_for_baseline: But there 'll be some jollification around the old homestead tonight and nobody likes tripping the light fantastic better than wor Martin . '

source_bert_toks: but there ' ll be some jo ##lli ##fication around the old homestead tonight and nobody likes trip ##ping the light fantastic better than wo ##r martin . '

reference_raw: But there's going to be a little cheering around the old house tonight, and no one likes to trip through the light more fantastically than Wor Martin.'

reference_spacy_tokens: But there 's going to be a little cheering around the old house tonight , and no one likes to trip through the light more fantastically than Wor Martin . '


fn_spacy_tokens_for_baseline: She swung back , weaponless and frightened .

source_bert_toks: she swung back , weapon ##less and frightened .

reference_raw: She turned away, unarmed and frightened.

reference_spacy_tokens: She turned away , unarmed and frightened .


fn_spacy_tokens_for_baseline: One thinks of the stories of child muggers bearing sharp knives , driven below by a greater police presence upstairs , of the Underground ' acid fiend ' who squirts hydrochloric acid on people 's legs before making his escape , of steamers , hip - hop - styled persons perpetrating economy - sized thefts .

source_bert_toks: one thinks of the stories of child mug ##gers bearing sharp knives , driven below by a greater police presence upstairs , of the underground ' acid fi ##end ' who sq ##ui ##rts hydro ##ch ##lor ##ic acid on people ' s legs before making his escape , of steamer ##s , hip - hop - styled persons per ##pet ##rating economy - sized theft ##s .

reference_raw: One remembers the tales of child robbers with sharp knives, driven by a larger police presence up there, of an underground "acid fiend" who sprays hydrochloric acid on people's feet before he escapes, of steamers and hip-hop people who commit economic thefts.

reference_spacy_tokens: One remembers the tales of child robbers with sharp knives , driven by a larger police presence up there , of an underground " acid fiend " who sprays hydrochloric acid on people 's feet before he escapes , of steamers and hip - hop people who commit economic thefts .


fn_spacy_tokens_for_baseline: Were CDs cheap items , one might excuse this , but the practice , of which PolyGram is the worst offender , is inconsiderate to the consumer .

source_bert_toks: were cds cheap items , one might excuse this , but the practice , of which poly ##gram is the worst offender , is inc ##ons ##ider ##ate to the consumer .

reference_raw: If CDs were cheap, it might be excused, but the practice of which PolyGram is the worst perpetrator is inconsiderable to the consumer.

reference_spacy_tokens: If CDs were cheap , it might be excused , but the practice of which PolyGram is the worst perpetrator is inconsiderable to the consumer .


fn_spacy_tokens_for_baseline: It noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would degrade the fighting ability of enemy forces .

source_bert_toks: it noted the utility of forcing the enemy to " suit up " in preparation for real or imagined use of chemical agents , for doing so would de ##grade the fighting ability of enemy forces .

reference_raw: He noted how useful it was to force the enemy to "suit up" in preparation for the actual or imagined use of chemical agents, since it would undermine the fighting capabilities of the enemy forces.

reference_spacy_tokens: He noted how useful it was to force the enemy to " suit up " in preparation for the actual or imagined use of chemical agents , since it would undermine the fighting capabilities of the enemy forces .


fn_spacy_tokens_for_baseline: Ingleborough 's steep sides always manage to give the impression that the top of the hill has been sliced off ; when it 's cloaked in a mist cap , you can almost imagine a cone - shaped summit .

source_bert_toks: ing ##le ##borough ' s steep sides always manage to give the impression that the top of the hill has been sliced off ; when it ' s cloak ##ed in a mist cap , you can almost imagine a cone - shaped summit .

reference_raw: The steep slopes of Ingleborough always give the impression that the top of the hill has been cut off; if it is covered in a fog cap, you can almost imagine a cone-shaped peak.

reference_spacy_tokens: The steep slopes of Ingleborough always give the impression that the top of the hill has been cut off ; if it is covered in a fog cap , you can almost imagine a cone - shaped peak .


fn_spacy_tokens_for_baseline: Hong Kong currency is widely accepted in Guangzhou , or you can change your currency into RMB ( yuan ) at any bank or hotel .

source_bert_toks: hong kong currency is widely accepted in guangzhou , or you can change your currency into rm ##b ( yuan ) at any bank or hotel .

reference_raw: The Hong Kong currency is widely received in Guangzhou, or you can change your currency to RMB (yuan) at any bank or hotel.

reference_spacy_tokens: The Hong Kong currency is widely received in Guangzhou , or you can change your currency to RMB ( yuan ) at any bank or hotel .


fn_spacy_tokens_for_baseline: As far as I understand from the gossip there 's nothing'll come out of it by goin' to the polis ; it 's got to come from Parliament .

source_bert_toks: as far as i understand from the gossip there ' s nothing ' ll come out of it by goin ' to the pol ##is ; it ' s got to come from parliament .

reference_raw: As far as I can tell by the rumors, there's nothing going to come out of this by going to the polis; it's got to come out of Parliament.

reference_spacy_tokens: As far as I can tell by the rumors , there 's nothing going to come out of this by going to the polis ; it 's got to come out of Parliament .


fn_spacy_tokens_for_baseline: Pare the mangoes and cut the flesh away from the pit lengthwise into long slices .

source_bert_toks: par ##e the mango ##es and cut the flesh away from the pit length ##wise into long slices .

reference_raw: Separate the mangoes and cut the meat out of the hole lengthwise into long slices.

reference_spacy_tokens: Separate the mangoes and cut the meat out of the hole lengthwise into long slices .


fn_spacy_tokens_for_baseline: Our preference is to have the lines so matched that , when the two handles are held together , the stunt kite soars overhead and is as stable as a single line kite .

source_bert_toks: our preference is to have the lines so matched that , when the two handles are held together , the stunt kite so ##ars overhead and is as stable as a single line kite .

reference_raw: We prefer to have the lines in such a way that if the two handles are held together, the stunt dragon rises above us and is as stable as a single line dragon.

reference_spacy_tokens: We prefer to have the lines in such a way that if the two handles are held together , the stunt dragon rises above us and is as stable as a single line dragon .


fn_spacy_tokens_for_baseline: If you need to tack quickly , then once again , start at the starboard end , or at least to starboard of the main bunch of yachts .

source_bert_toks: if you need to tack quickly , then once again , start at the starboard end , or at least to starboard of the main bunch of yacht ##s .

reference_raw: If you have to go fast, then start again at the right end, or at least to the right of the main group of yachts.

reference_spacy_tokens: If you have to go fast , then start again at the right end , or at least to the right of the main group of yachts .


fn_spacy_tokens_for_baseline: She washed hurriedly , then pulled on her old jeans and jersey and tied her hair back with the shoelace .

source_bert_toks: she washed hurriedly , then pulled on her old jeans and jersey and tied her hair back with the shoe ##lace .

reference_raw: She washed quickly, then put on her old jeans and sweater and tied her hair back with a lace.

reference_spacy_tokens: She washed quickly , then put on her old jeans and sweater and tied her hair back with a lace .


fn_spacy_tokens_for_baseline: Fighting ceased only with the advent of darkness -- but the respite was to be brief .

source_bert_toks: fighting ceased only with the advent of darkness - - but the res ##pit ##e was to be brief .

reference_raw: The struggle ended only with the coming of darkness - but the rest should have been short.

reference_spacy_tokens: The struggle ended only with the coming of darkness - but the rest should have been short .


fn_spacy_tokens_for_baseline: Donna seemed quite excited about it .

source_bert_toks: donna seemed quite excited about it .

reference_raw: Donna seemed quite enthusiastic about it.

reference_spacy_tokens: Donna seemed quite enthusiastic about it .


fn_spacy_tokens_for_baseline: They value their architects more for their business demeanours than for their designs , and choose them from a limited number of established companies , more valued for reliability than originality .

source_bert_toks: they value their architects more for their business dem ##ean ##ours than for their designs , and choose them from a limited number of established companies , more valued for reliability than original ##ity .

reference_raw: They appreciate their architects more for their business behaviour than for their designs, and select them from a limited number of established companies, which are more reliable than originality.

reference_spacy_tokens: They appreciate their architects more for their business behaviour than for their designs , and select them from a limited number of established companies , which are more reliable than originality .


fn_spacy_tokens_for_baseline: He secured it with the safety - pin .

source_bert_toks: he secured it with the safety - pin .

reference_raw: He put a safety pin on it.

reference_spacy_tokens: He put a safety pin on it .


fn_spacy_tokens_for_baseline: For cartons of Kent cigarettes and a few videos , it was always possible to circumvent the regulations limiting abortion to the victims of rape or incest , or life - threatening complications .

source_bert_toks: for cart ##ons of kent cigarettes and a few videos , it was always possible to ci ##rc ##um ##vent the regulations limiting abortion to the victims of rape or inc ##est , or life - threatening complications .

reference_raw: In the case of boxes of Kent cigarettes and several videos, regulations restricting abortion to victims of rape, incest or life-threatening complications could always be circumvented.

reference_spacy_tokens: In the case of boxes of Kent cigarettes and several videos , regulations restricting abortion to victims of rape , incest or life - threatening complications could always be circumvented .


fn_spacy_tokens_for_baseline: If found guilty , he will be Russia 's most prolific serial killer and qualify as one of the most depraved mass murderers of all time .

source_bert_toks: if found guilty , he will be russia ' s most prolific serial killer and qualify as one of the most de ##pr ##ave ##d mass murderers of all time .

reference_raw: If he's found guilty, he'll be the most prosperous serial killer in Russia and he'll be considered one of the most vicious mass murderers of all time.

reference_spacy_tokens: If he 's found guilty , he 'll be the most prosperous serial killer in Russia and he 'll be considered one of the most vicious mass murderers of all time .


fn_spacy_tokens_for_baseline: Although the banyan trees that once flourished here are now no more , the often - restored complex has remained a focus of local Buddhist activities .

source_bert_toks: although the ban ##yan trees that once flourished here are now no more , the often - restored complex has remained a focus of local buddhist activities .

reference_raw: Although the Banyan trees that once flourished here are no longer, the often-reconstructed complex remains the focus of local Buddhism activities.

reference_spacy_tokens: Although the Banyan trees that once flourished here are no longer , the often - reconstructed complex remains the focus of local Buddhism activities .


fn_spacy_tokens_for_baseline: Rare species of butterflies and delicate hummingbirds take to the air , and crocodiles and manatees still live in and around vast tracts of mangrove swamp in the south .

source_bert_toks: rare species of butterflies and delicate humming ##birds take to the air , and crocodile ##s and mana ##tees still live in and around vast tracts of mangrove swamp in the south .

reference_raw: Frequent species of butterflies and delicate hummingbirds fly into the air, and crocodiles and manatees still live in and around the vast tracts of mangrove swamps in the south.

reference_spacy_tokens: Frequent species of butterflies and delicate hummingbirds fly into the air , and crocodiles and manatees still live in and around the vast tracts of mangrove swamps in the south .


fn_spacy_tokens_for_baseline: A child was screaming in one of the flats , while two dogs were snarling as they fought in the wasteland beyond the apartment house .

source_bert_toks: a child was screaming in one of the flats , while two dogs were snarl ##ing as they fought in the waste ##land beyond the apartment house .

reference_raw: A child screamed in one of the apartments, and two dogs growled as they fought in the wastelands behind the house.

reference_spacy_tokens: A child screamed in one of the apartments , and two dogs growled as they fought in the wastelands behind the house .


fn_spacy_tokens_for_baseline: Colonnaded public buildings , iron balconies , winding streets , flagstoned squares and the many churches all speak of the Portuguese inheritance as well as the Chinese , a fusion of East and West that has produced the unique Macanese culture .

source_bert_toks: colon ##nad ##ed public buildings , iron bal ##con ##ies , winding streets , flags ##tone ##d squares and the many churches all speak of the portuguese inheritance as well as the chinese , a fusion of east and west that has produced the unique mac ##ane ##se culture .

reference_raw: The colonned public buildings, the iron balconies, the winding streets, the flagstone squares, and many churches, all speak of the Portuguese heritage, and of China, the fusion of East and West, which created a unique Macanese culture.

reference_spacy_tokens: The colonned public buildings , the iron balconies , the winding streets , the flagstone squares , and many churches , all speak of the Portuguese heritage , and of China , the fusion of East and West , which created a unique Macanese culture .


fn_spacy_tokens_for_baseline: Three tiny fluffy moor hen chicks , ' a sooty brood ' , cheeped loudly and paddled for shelter beneath a pile of brush wood .

source_bert_toks: three tiny fluffy moor hen chicks , ' a soo ##ty brood ' , che ##ep ##ed loudly and paddle ##d for shelter beneath a pile of brush wood .

reference_raw: Three small, fluffy moor chickens, 'sooty brood', beeped loudly and paddled for cover under a heap of brushwood.

reference_spacy_tokens: Three small , fluffy moor chickens , ' sooty brood ' , beeped loudly and paddled for cover under a heap of brushwood .


fn_spacy_tokens_for_baseline: They sat in silence , their pulses thumping , breathing on the windows to encourage the steaming - up process , desperately anxious to get out .

source_bert_toks: they sat in silence , their pulses thumping , breathing on the windows to encourage the steaming - up process , desperately anxious to get out .

reference_raw: They sat in silence, their pulses pounding, breathing against the windows to encourage the steaming process, desperately anxious to get out.

reference_spacy_tokens: They sat in silence , their pulses pounding , breathing against the windows to encourage the steaming process , desperately anxious to get out .


fn_spacy_tokens_for_baseline: Judy Holt offers an aggressive Rita her face contorted into a bitter snarl .

source_bert_toks: judy holt offers an aggressive rita her face con ##tort ##ed into a bitter snarl .

reference_raw: Judy Holt is offering an aggressive Rita, her face twisted into a bitter growl.

reference_spacy_tokens: Judy Holt is offering an aggressive Rita , her face twisted into a bitter growl .


fn_spacy_tokens_for_baseline: In September 1907 he was stripped of the captaincy and fined £ 10 for drunkenness and violent behaviour and in 1910 transferred for a measly £ 100 to Woolwich Arsenal .

source_bert_toks: in september 1907 he was stripped of the captain ##cy and fined £10 for drunken ##ness and violent behaviour and in 1910 transferred for a me ##as ##ly £100 to wool ##wich arsenal .

reference_raw: He lost his captainship in September 1907, fined £10 for drunkenness and violence, and in 1910 he was transferred to Woolwich Arsenal for a measly £100.

reference_spacy_tokens: He lost his captainship in September 1907 , fined £ 10 for drunkenness and violence , and in 1910 he was transferred to Woolwich Arsenal for a measly £ 100 .


fn_spacy_tokens_for_baseline: He helped put the wrap over her shoulders and she was silent on the short drive home .

source_bert_toks: he helped put the wrap over her shoulders and she was silent on the short drive home .

reference_raw: He helped her put the cover over her shoulders, and she was quiet on the way home.

reference_spacy_tokens: He helped her put the cover over her shoulders , and she was quiet on the way home .


fn_spacy_tokens_for_baseline: North from Chonku Chuli the pink granite mass of Makalu emerged above the seemingly vertical snow walls of the West Col ( 6135 m ) .

source_bert_toks: north from cho ##nk ##u chu ##li the pink granite mass of ma ##kal ##u emerged above the seemingly vertical snow walls of the west col ( 61 ##35 m ) .

reference_raw: North of Chonku Chuli, the pink granite mass of Makalu appeared over the seemingly vertical snow walls of the West Col (6135 m).

reference_spacy_tokens: North of Chonku Chuli , the pink granite mass of Makalu appeared over the seemingly vertical snow walls of the West Col ( 6135 m ) .


fn_spacy_tokens_for_baseline: Instead of a wild , hatless girl , we saw a beautiful , carefully dressed young lady .

source_bert_toks: instead of a wild , hat ##less girl , we saw a beautiful , carefully dressed young lady .

reference_raw: Instead of a wild, hairless girl, we saw a beautiful, well-dressed young woman.

reference_spacy_tokens: Instead of a wild , hairless girl , we saw a beautiful , well - dressed young woman .


fn_spacy_tokens_for_baseline: These powers , which the reformers Ephialtes and Pericles tendentiously represented as ' usurped privileges ' , were given to the council of 500 and to the People i.e. the Assembly and the law - courts .

source_bert_toks: these powers , which the reformer ##s ep ##hia ##lt ##es and per ##icles tend ##ent ##iously represented as ' us ##ur ##ped privileges ' , were given to the council of 500 and to the people i . e . the assembly and the law - courts .

reference_raw: These powers, which the reformers Ephialtes and Pericles tended to present as 'usurped privileges', were given to the Council of 500 and to the People, i.e. the Assembly and the Courts of Justice.

reference_spacy_tokens: These powers , which the reformers Ephialtes and Pericles tended to present as ' usurped privileges ' , were given to the Council of 500 and to the People , i.e. the Assembly and the Courts of Justice .


fn_spacy_tokens_for_baseline: Fruit was picked from a plantation growing mangoes , guava , grapes , oranges , lemons and bananas .

source_bert_toks: fruit was picked from a plantation growing mango ##es , gu ##ava , grapes , orange ##s , lemon ##s and bananas .

reference_raw: The fruit has been harvested from a plantation that grows mangoes, guava, grapes, oranges, lemons and bananas.

reference_spacy_tokens: The fruit has been harvested from a plantation that grows mangoes , guava , grapes , oranges , lemons and bananas .


fn_spacy_tokens_for_baseline: Legislation was introduced in the session 1984 -- 85 and became effective in April 1986 .

source_bert_toks: legislation was introduced in the session 1984 - - 85 and became effective in april 1986 .

reference_raw: The legislation was introduced at the 1984 meeting - 85 and entered into force in April 1986.

reference_spacy_tokens: The legislation was introduced at the 1984 meeting - 85 and entered into force in April 1986 .


fn_spacy_tokens_for_baseline: ' He should n't be allowed to get away with such vile behaviour .

source_bert_toks: ' he shouldn ' t be allowed to get away with such vile behaviour .

reference_raw: 'He should not be allowed to escape with such foul behavior.

reference_spacy_tokens: ' He should not be allowed to escape with such foul behavior .


fn_spacy_tokens_for_baseline: It is a worthwhile conjecture that many , particularly the young , set their faces against these forms of dissection as a morally enhanced form of squeamishness .

source_bert_toks: it is a worth ##while conjecture that many , particularly the young , set their faces against these forms of di ##sse ##ction as a morally enhanced form of sq ##ue ##ami ##sh ##ness .

reference_raw: It is a reasonable assumption that many, especially young ones, face these forms of dissection as a morally enhanced form of squeamish.

reference_spacy_tokens: It is a reasonable assumption that many , especially young ones , face these forms of dissection as a morally enhanced form of squeamish .


fn_spacy_tokens_for_baseline: The last step but one creaked protestingly and she grimaced apprehensively , her body almost turning to stone as she waited for Dane to suddenly appear and demand to know what she was doing .

source_bert_toks: the last step but one creaked protesting ##ly and she grimaced app ##re ##hen ##sive ##ly , her body almost turning to stone as she waited for dane to suddenly appear and demand to know what she was doing .

reference_raw: The last step, but one, groaned in protest, and she grinned apprehensively, her body nearly turning to stone as she waited for Dane to suddenly appear and demand to know what she was doing.

reference_spacy_tokens: The last step , but one , groaned in protest , and she grinned apprehensively , her body nearly turning to stone as she waited for Dane to suddenly appear and demand to know what she was doing .


fn_spacy_tokens_for_baseline: It is not clear where Sir Trevor learned to tickle the ivories .

source_bert_toks: it is not clear where sir trevor learned to tick ##le the ivo ##ries .

reference_raw: It's unclear where Sir Trevor learned to twitch ivories.

reference_spacy_tokens: It 's unclear where Sir Trevor learned to twitch ivories .


fn_spacy_tokens_for_baseline: ' This then , ' he said , staring with mild reproof at the impassive faces of Regan and Harrison , ' is all the information we have on the Irish Republican Brotherhood ? '

source_bert_toks: ' this then , ' he said , staring with mild rep ##ro ##of at the imp ##ass ##ive faces of regan and harrison , ' is all the information we have on the irish republican brotherhood ? '

reference_raw: "That's all we have on the Irish Republican Brotherhood," he said, looking at Regan and Harrison's impassive faces with mild reproach?"

reference_spacy_tokens: " That 's all we have on the Irish Republican Brotherhood , " he said , looking at Regan and Harrison 's impassive faces with mild reproach ? "


fn_spacy_tokens_for_baseline: " Hostile and even friendly nations routinely steal information from U.S. companies and share it with their own companies , " said Noel D. Matchett , a former staffer at the federal National Security Agency and now president of Information Security Inc. , Silver Spring , MD .

source_bert_toks: " hostile and even friendly nations routinely steal information from u . s . companies and share it with their own companies , " said noel d . match ##ett , a former staff ##er at the federal national security agency and now president of information security inc . , silver spring , md .

reference_raw: "Hostility and even friendship nations routinely steal information from American companies and share it with their own companies," said Noel D. Matchett, former employee of the Federal Security Agency and now president of Information Security Inc., Silver Spring, MD.

reference_spacy_tokens: " Hostility and even friendship nations routinely steal information from American companies and share it with their own companies , " said Noel D. Matchett , former employee of the Federal Security Agency and now president of Information Security Inc. , Silver Spring , MD .


fn_spacy_tokens_for_baseline: One of CD 's favourite books , which , like David Copperfield , he devoured eagerly as a child .

source_bert_toks: one of cd ' s favourite books , which , like david copper ##field , he dev ##oured eagerly as a child .

reference_raw: One of the CD's favorite books, which he, like David Copperfield, ate eagerly as a child.

reference_spacy_tokens: One of the CD 's favorite books , which he , like David Copperfield , ate eagerly as a child .


fn_spacy_tokens_for_baseline: All of our Six summer camping sessions are booked to capacity ( and , truth be told , with maybe one our two extra returning campers squeezed in ) and we have a waiting list of 60 children who are hoping to come if a spot should open .

source_bert_toks: all of our six summer camping sessions are booked to capacity ( and , truth be told , with maybe one our two extra returning camp ##ers squeezed in ) and we have a waiting list of 60 children who are hoping to come if a spot should open .

reference_raw: All of our six summer camping sessions are reserved for capacity (and, in fact, one of our two more returning campers has been squeezed in) and we have a waiting list of 60 kids who hope to come if the place opens.

reference_spacy_tokens: All of our six summer camping sessions are reserved for capacity ( and , in fact , one of our two more returning campers has been squeezed in ) and we have a waiting list of 60 kids who hope to come if the place opens .


fn_spacy_tokens_for_baseline: If you walk east on the Star Ferry terminal concourse , you will find yourself on the wonderful Promenade , which begins at the clock tower , all that remains of the once grand Kowloon- Canton Railway Terminus .

source_bert_toks: if you walk east on the star ferry terminal concourse , you will find yourself on the wonderful promenade , which begins at the clock tower , all that remains of the once grand ko ##wl ##oon - canton railway terminus .

reference_raw: If you go east on the Star Ferry Terminal Concourse, you'll be on the fabulous Promenade that starts at the clock tower, all that's left of the once-great Kowloon-Canton Railway Terminus.

reference_spacy_tokens: If you go east on the Star Ferry Terminal Concourse , you 'll be on the fabulous Promenade that starts at the clock tower , all that 's left of the once - great Kowloon - Canton Railway Terminus .


fn_spacy_tokens_for_baseline: A few days before Michael came home , our daughter - in - law Pippa came to stay for a few days , bringing Emily , who was to go to a boarding - school in Yorkshire .

source_bert_toks: a few days before michael came home , our daughter - in - law pip ##pa came to stay for a few days , bringing emily , who was to go to a boarding - school in yorkshire .

reference_raw: A few days before Michael returned home, our daughter-in-Law Pippa came to stay for a couple of days with Emily, who was supposed to go to a boarding school in Yorkshire.

reference_spacy_tokens: A few days before Michael returned home , our daughter - in - Law Pippa came to stay for a couple of days with Emily , who was supposed to go to a boarding school in Yorkshire .


fn_spacy_tokens_for_baseline: What , for that matter , would he have done , when confronted with the pile of chips and mass of Brussels sprouts heaped onto a plate containing an alleged sole meuniere , in a restaurant where they ought to know better ?

source_bert_toks: what , for that matter , would he have done , when confronted with the pile of chips and mass of brussels sp ##rou ##ts heap ##ed onto a plate containing an alleged sole me ##uni ##ere , in a restaurant where they ought to know better ?

reference_raw: What would he do, when faced with a pile of chips and a pile of Brussels sprouts piled on a plate containing the supposed sole meunière, in a restaurant where they should know better?

reference_spacy_tokens: What would he do , when faced with a pile of chips and a pile of Brussels sprouts piled on a plate containing the supposed sole meuniere , in a restaurant where they should know better ?


fn_spacy_tokens_for_baseline: You probably could n't say the same for Howard Kendall -- the Everton manager tried in vain to sign the big fellow from Luton earlier in the season .

source_bert_toks: you probably couldn ' t say the same for howard kendall - - the everton manager tried in vain to sign the big fellow from luton earlier in the season .

reference_raw: I don't think you could say the same thing about Howard Kendall - the Everton manager was trying to sign a big guy from Luton earlier this season.

reference_spacy_tokens: I do n't think you could say the same thing about Howard Kendall - the Everton manager was trying to sign a big guy from Luton earlier this season .


fn_spacy_tokens_for_baseline: The TV no longer needs to be cranked to full volume exclusively for the benefit of one family member with poor hearing .

source_bert_toks: the tv no longer needs to be crank ##ed to full volume exclusively for the benefit of one family member with poor hearing .

reference_raw: It is no longer necessary to turn the television into full volume solely for the benefit of a family member with poor hearing.

reference_spacy_tokens: It is no longer necessary to turn the television into full volume solely for the benefit of a family member with poor hearing .


fn_spacy_tokens_for_baseline: In our station , the only facility was an iron cauldron of boiling water .

source_bert_toks: in our station , the only facility was an iron ca ##uld ##ron of boiling water .

reference_raw: The only device in our station was an iron boiler of boiling water.

reference_spacy_tokens: The only device in our station was an iron boiler of boiling water .


fn_spacy_tokens_for_baseline: Even the view was all but invisible through a windscreen coated with Roman grime .

source_bert_toks: even the view was all but invisible through a winds ##creen coated with roman grim ##e .

reference_raw: Even the view was almost invisible through the windshield covered with Roman grime.

reference_spacy_tokens: Even the view was almost invisible through the windshield covered with Roman grime .


fn_spacy_tokens_for_baseline: It had been badly damaged in the rapids .

source_bert_toks: it had been badly damaged in the rapids .

reference_raw: It was badly damaged in the fasts.

reference_spacy_tokens: It was badly damaged in the fasts .


fn_spacy_tokens_for_baseline: Cruella Baines grunted and waddled off along the line of windows , her steel bangles rattling against her gigantic thighs .

source_bert_toks: cruel ##la bain ##es grunted and wa ##ddled off along the line of windows , her steel bang ##les rattling against her gigantic thighs .

reference_raw: Cruella Baines grunted and waddled along the row of windows, steel hammers clattering against her huge thighs.

reference_spacy_tokens: Cruella Baines grunted and waddled along the row of windows , steel hammers clattering against her huge thighs .


fn_spacy_tokens_for_baseline: The leaves are grown opposite , and are bright to pale green on the upper side and greyish to whitish green on the underside .

source_bert_toks: the leaves are grown opposite , and are bright to pale green on the upper side and greyish to whitish green on the underside .

reference_raw: The leaves are grown in the opposite direction, with a light to pale green on the upper side and a gray to white green on the lower side.

reference_spacy_tokens: The leaves are grown in the opposite direction , with a light to pale green on the upper side and a gray to white green on the lower side .


fn_spacy_tokens_for_baseline: The results from the mechanical time log are presented in graph , chart and tabular form .

source_bert_toks: the results from the mechanical time log are presented in graph , chart and tab ##ular form .

reference_raw: Results of the mechanical time record are presented in graphs, charts and tabular formats.

reference_spacy_tokens: Results of the mechanical time record are presented in graphs , charts and tabular formats .


fn_spacy_tokens_for_baseline: Like the sea it is a music primeval and here is no storm , only the silken waves soughing .

source_bert_toks: like the sea it is a music prime ##val and here is no storm , only the silk ##en waves so ##ugh ##ing .

reference_raw: Like the sea, it's a music primeval, and it's not a storm, it's just silk waves sobbing.

reference_spacy_tokens: Like the sea , it 's a music primeval , and it 's not a storm , it 's just silk waves sobbing .


fn_spacy_tokens_for_baseline: It could well be that some of the summit surfaces of the Hercynian blocks are Eogene pediplains , while the weathering responsible for the formation of tors may have been tropical weathering of the same date .

source_bert_toks: it could well be that some of the summit surfaces of the her ##cy ##nian blocks are e ##ogen ##e pe ##di ##pl ##ains , while the weather ##ing responsible for the formation of tor ##s may have been tropical weather ##ing of the same date .

reference_raw: It may well be that some of the top surfaces of the Hercynian blocks are Eogene pediplains, whereas the weather that is responsible for the formation of the turtles may have been tropical weather on the same day.

reference_spacy_tokens: It may well be that some of the top surfaces of the Hercynian blocks are Eogene pediplains , whereas the weather that is responsible for the formation of the turtles may have been tropical weather on the same day .


fn_spacy_tokens_for_baseline: We rolled into Casma just after three in the morning , the stink of fish oil hanging over the port and an old adobe fort peering at us out of mist .

source_bert_toks: we rolled into cas ##ma just after three in the morning , the stink of fish oil hanging over the port and an old adobe fort peering at us out of mist .

reference_raw: We rolled into Casma just after three o'clock in the morning, the smell of fish oil hanging over the harbor, and the old Adobe Fort staring out of the fog at us.

reference_spacy_tokens: We rolled into Casma just after three o'clock in the morning , the smell of fish oil hanging over the harbor , and the old Adobe Fort staring out of the fog at us .


fn_spacy_tokens_for_baseline: Produces SCUDs with North Korean help .

source_bert_toks: produces sc ##ud ##s with north korean help .

reference_raw: It produces SCUDs with North Korean assistance.

reference_spacy_tokens: It produces SCUDs with North Korean assistance .


fn_spacy_tokens_for_baseline: However , according to eye - witnesses , at about 6 am soldiers ordered the workers from the outbuilding where they lived , forced some of them to kneel on the ground and then shot them .

source_bert_toks: however , according to eye - witnesses , at about 6 ##am soldiers ordered the workers from the out ##building where they lived , forced some of them to knee ##l on the ground and then shot them .

reference_raw: But according to eyewitnesses, about six in the morning soldiers ordered workers from the building where they lived, forced some of them to kneel down and then shot them.

reference_spacy_tokens: But according to eyewitnesses , about six in the morning soldiers ordered workers from the building where they lived , forced some of them to kneel down and then shot them .


fn_spacy_tokens_for_baseline: Have you come to revenge yourself on me for failing you ? '

source_bert_toks: have you come to revenge yourself on me for failing you ? '

reference_raw: Have you come to avenge me for your failure?'

reference_spacy_tokens: Have you come to avenge me for your failure ? '


fn_spacy_tokens_for_baseline: Lasers are also being used to vaporise the dirt from limestone and marble sculpture .

source_bert_toks: lasers are also being used to vapor ##ise the dirt from limestone and marble sculpture .

reference_raw: Lasers are also used to evaporate dirt from limestone and marble statues.

reference_spacy_tokens: Lasers are also used to evaporate dirt from limestone and marble statues .


fn_spacy_tokens_for_baseline: ' If I ever go to a funeral in an out - of - the - way place , I always get pushed a discoloured glass of potheen .

source_bert_toks: ' if i ever go to a funeral in an out - of - the - way place , i always get pushed a disco ##lou ##red glass of pot ##hee ##n .

reference_raw: 'If I ever go to a funeral in a remote place, they always push me a colored glass of potheen.

reference_spacy_tokens: ' If I ever go to a funeral in a remote place , they always push me a colored glass of potheen .


fn_spacy_tokens_for_baseline: Suit 's pumped me full of painkillers , but nothing else .

source_bert_toks: suit ' s pumped me full of pain ##kill ##ers , but nothing else .

reference_raw: The suit filled me with painkillers, but that's all.

reference_spacy_tokens: The suit filled me with painkillers , but that 's all .


fn_spacy_tokens_for_baseline: When Hari returned home , she found William in the workshop hammering leather soles on to a pair of small boots .

source_bert_toks: when hari returned home , she found william in the workshop hammering leather sole ##s on to a pair of small boots .

reference_raw: When Hari came home, she found William in the workshop, slamming leather feet into his small shoes.

reference_spacy_tokens: When Hari came home , she found William in the workshop , slamming leather feet into his small shoes .


fn_spacy_tokens_for_baseline: In February 1990 legislation to allow women to be ordained as priests was approved and sent to all the dioceses to be discussed and voted on .

source_bert_toks: in february 1990 legislation to allow women to be ordained as priests was approved and sent to all the dioceses to be discussed and voted on .

reference_raw: In February 1990, legislation allowing women to be decreed as priests was approved and sent to all dioceses for debate and vote.

reference_spacy_tokens: In February 1990 , legislation allowing women to be decreed as priests was approved and sent to all dioceses for debate and vote .


fn_spacy_tokens_for_baseline: Uniform centralization was the administrative pre - condition of all other reform , as the Caroline bureaucrats found when their agrarian programme was blocked by oligarchic municipalities .

source_bert_toks: uniform central ##ization was the administrative pre - condition of all other reform , as the caroline bureau ##crats found when their agrarian programme was blocked by ol ##iga ##rch ##ic municipalities .

reference_raw: Uniform centralisation was an administrative pre-condition for all other reforms, as Caroline bureaucrats found when their agrarian program was blocked by oligarchic communities.

reference_spacy_tokens: Uniform centralisation was an administrative pre - condition for all other reforms , as Caroline bureaucrats found when their agrarian program was blocked by oligarchic communities .


fn_spacy_tokens_for_baseline: Human relationships can not usually be kept within neat bounds by both partners , but tend to spill over in deep emotions of pain and anger .

source_bert_toks: human relationships can not usually be kept within neat bounds by both partners , but tend to spill over in deep emotions of pain and anger .

reference_raw: Human relations cannot normally be kept within the neat limits of the two partners, but tend to flow into deep feelings of pain and anger.

reference_spacy_tokens: Human relations can not normally be kept within the neat limits of the two partners , but tend to flow into deep feelings of pain and anger .


fn_spacy_tokens_for_baseline: When I went to visit him we sat in his book - lined study surrounded by all the trappings of an academic career but in his garage there were untreated specimens and a range of specialist tools .

source_bert_toks: when i went to visit him we sat in his book - lined study surrounded by all the trapping ##s of an academic career but in his garage there were un ##tre ##ated specimens and a range of specialist tools .

reference_raw: When I went to see him, we were sitting in his book-lined office, surrounded by all the traps of an academic career, but there were untreated specimens and a number of special tools in his garage.

reference_spacy_tokens: When I went to see him , we were sitting in his book - lined office , surrounded by all the traps of an academic career , but there were untreated specimens and a number of special tools in his garage .


fn_spacy_tokens_for_baseline: Cut away the waste wood around the ears with the coping saw , and use the 1 in shallow gouge to further shape them and the nostrils so that they angle back at each side .

source_bert_toks: cut away the waste wood around the ears with the coping saw , and use the 1 ##in shallow go ##uge to further shape them and the nostrils so that they angle back at each side .

reference_raw: Cut the wastewood around the ears with a coping saw and use the 1in shallow gouge to further shape them and the nostrils so that they can turn back on either side.

reference_spacy_tokens: Cut the wastewood around the ears with a coping saw and use the 1 in shallow gouge to further shape them and the nostrils so that they can turn back on either side .


fn_spacy_tokens_for_baseline: Prior to Libya 's 19 December 2003 announcement to abandon its WMD programs , US intelligence agencies alleged that Qadhafi had attempted to recruit South African scientists to assist in the acquisition of BW , and that Libya had started to develop pathogens and toxins for weapons use .

source_bert_toks: prior to libya ' s 19 december 2003 announcement to abandon its w ##md programs , us intelligence agencies alleged that q ##ad ##ha ##fi had attempted to recruit south african scientists to assist in the acquisition of b ##w , and that libya had started to develop pathogen ##s and toxin ##s for weapons use .

reference_raw: Prior to the notification by Libya of 19 December 2003 to abandon its weapons of mass destruction programmes, U.S. intelligence agencies claimed that Qadhafi had tried to recruit South African scientists to help acquire BV and that Libya had begun to develop pathogens and toxins for weapons use.

reference_spacy_tokens: Prior to the notification by Libya of 19 December 2003 to abandon its weapons of mass destruction programmes , U.S. intelligence agencies claimed that Qadhafi had tried to recruit South African scientists to help acquire BV and that Libya had begun to develop pathogens and toxins for weapons use .


fn_spacy_tokens_for_baseline: The smell of the peat , gurgle of water racing over boulders and chuckle of flocks of fieldfares searching for mountain ash berries are as characteristic as the scenery itself .

source_bert_toks: the smell of the peat , gu ##rg ##le of water racing over boulders and chuckle of flock ##s of field ##fare ##s searching for mountain ash berries are as characteristic as the scenery itself .

reference_raw: The smell of peat, the gust of water running over boulders and the laughter of flocks of fieldfares looking for mountain ash berries is as characteristic as the landscape itself.

reference_spacy_tokens: The smell of peat , the gust of water running over boulders and the laughter of flocks of fieldfares looking for mountain ash berries is as characteristic as the landscape itself .


fn_spacy_tokens_for_baseline: First he fumbled beneath the lacings of his breastplate to produce a scrap of silk .

source_bert_toks: first he fumbled beneath the lac ##ings of his breast ##plate to produce a scrap of silk .

reference_raw: First, he fumbled under the laces of his chest to make a piece of silk.

reference_spacy_tokens: First , he fumbled under the laces of his chest to make a piece of silk .


fn_spacy_tokens_for_baseline: To get the best shots of the Falcon 's descent into an American football stadium Steve set up cameras inside the Hercules plane and attached to the freefallers themselves before positioning himself on the ground .

source_bert_toks: to get the best shots of the falcon ' s descent into an american football stadium steve set up cameras inside the hercules plane and attached to the free ##fall ##ers themselves before positioning himself on the ground .

reference_raw: In order to get the best footage of the Falcon's fall into the American football stadium, Steve set up cameras inside the Hercules plane and attached himself to the free-fallers before putting himself on the ground.

reference_spacy_tokens: In order to get the best footage of the Falcon 's fall into the American football stadium , Steve set up cameras inside the Hercules plane and attached himself to the free - fallers before putting himself on the ground .


fn_spacy_tokens_for_baseline: Rate ( s ) and justification : Three levels of presort discounts based on processing costs bypassed because of worksharing by mailers .

source_bert_toks: rate ( s ) and justification : three levels of pre ##sor ##t discount ##s based on processing costs bypassed because of works ##hari ##ng by mail ##ers .

reference_raw: Rate (s) and justification: Three degrees of presort discounts based on the cost of processing bypassed due to the sharing of work by mailers.

reference_spacy_tokens: Rate ( s ) and justification : Three degrees of presort discounts based on the cost of processing bypassed due to the sharing of work by mailers .


fn_spacy_tokens_for_baseline: ' How do I know this is n't a forgery ? '

source_bert_toks: ' how do i know this isn ' t a forge ##ry ? '

reference_raw: "How do I know it's not a fake?"

reference_spacy_tokens: " How do I know it 's not a fake ? "


fn_spacy_tokens_for_baseline: Even the most powerful cannon is not much use if its crew has been squashed by a boulder .

source_bert_toks: even the most powerful cannon is not much use if its crew has been squash ##ed by a boulder .

reference_raw: Even the most powerful cannon won't do much good if his crew is crushed by a boulder.

reference_spacy_tokens: Even the most powerful cannon wo n't do much good if his crew is crushed by a boulder .


fn_spacy_tokens_for_baseline: Cave has influenced other kindred spirits to leave behind self - immolation in favour of The Song .

source_bert_toks: cave has influenced other kind ##red spirits to leave behind self - im ##mo ##lation in favour of the song .

reference_raw: The cave has compelled other soul mates to leave behind self-immolation for the Song.

reference_spacy_tokens: The cave has compelled other soul mates to leave behind self - immolation for the Song .


fn_spacy_tokens_for_baseline: The cost in the first stage of this unique project is estimated at 200 million dollars .

source_bert_toks: the cost in the first stage of this unique project is estimated at 200 million dollars .

reference_raw: The cost of this single project is estimated at $200 million in the first phase.

reference_spacy_tokens: The cost of this single project is estimated at $ 200 million in the first phase .


fn_spacy_tokens_for_baseline: You 'll find that prices are about the same in Hong Kong Central and Kowloon , and somewhat cheaper in Causeway Bay , which caters to local shopping .

source_bert_toks: you ' ll find that prices are about the same in hong kong central and ko ##wl ##oon , and somewhat cheaper in causeway bay , which cater ##s to local shopping .

reference_raw: You'll find that prices are about the same in Hong Kong Center and Kowloon, and a little cheaper in Causeway Bay, which caters for local shopping.

reference_spacy_tokens: You 'll find that prices are about the same in Hong Kong Center and Kowloon , and a little cheaper in Causeway Bay , which caters for local shopping .


fn_spacy_tokens_for_baseline: The Tang clan 's earliest walled village was Lo Wai , which also has its defensive wall intact and is entered by a narrow gate .

source_bert_toks: the tang clan ' s earliest walled village was lo wai , which also has its defensive wall intact and is entered by a narrow gate .

reference_raw: The first walled village of the Tang clan was Lo Wai, which also had an intact defense wall, and was entered by a narrow gate.

reference_spacy_tokens: The first walled village of the Tang clan was Lo Wai , which also had an intact defense wall , and was entered by a narrow gate .


fn_spacy_tokens_for_baseline: We see his professional disdain : before he arrived he spoke disparagingly of his impending host , doubting that Mr MacAulay had himself authored the history of the island of St Kilda , which bore his name .

source_bert_toks: we see his professional disdain : before he arrived he spoke di ##spar ##aging ##ly of his impending host , doubt ##ing that mr macau ##lay had himself authored the history of the island of st kilda , which bore his name .

reference_raw: We see his professional contempt: by the time he arrived, he had spoken disparagingly of his impending host, doubting that Mr. MacAulay himself had written the history of St. Kilda, which bore his name.

reference_spacy_tokens: We see his professional contempt : by the time he arrived , he had spoken disparagingly of his impending host , doubting that Mr. MacAulay himself had written the history of St. Kilda , which bore his name .


fn_spacy_tokens_for_baseline: The economical shuffle of the marathon runner is useless for the 10 K runner , because the latter is developing more power in each stride .

source_bert_toks: the economical shuffle of the marathon runner is useless for the 10 ##k runner , because the latter is developing more power in each stride .

reference_raw: The economic shift of a marathon runner is useless to a 10K runner, because he develops more power every step.

reference_spacy_tokens: The economic shift of a marathon runner is useless to a 10 K runner , because he develops more power every step .


fn_spacy_tokens_for_baseline: He rather thought he 'd let him stew for a while ; with the murder investigation on , he could n't get far -- or he 'd be a fool to try , and Peckham was no fool .

source_bert_toks: he rather thought he ' d let him stew for a while ; with the murder investigation on , he couldn ' t get far - - or he ' d be a fool to try , and peck ##ham was no fool .

reference_raw: Rather, he thought he'd let him choke for a while; he couldn't get far with the murder investigation - or else he'd be a fool to try, and Peckham wasn't a fool.

reference_spacy_tokens: Rather , he thought he 'd let him choke for a while ; he could n't get far with the murder investigation - or else he 'd be a fool to try , and Peckham was n't a fool .


fn_spacy_tokens_for_baseline: Waiting for him in the studio seven people are busy setting up the camera and lights and unwrapping white plaster pillars and an assortment of very beautiful chairs and tables .

source_bert_toks: waiting for him in the studio seven people are busy setting up the camera and lights and un ##wr ##app ##ing white plaster pillars and an assortment of very beautiful chairs and tables .

reference_raw: In the studio, seven people are busy setting up cameras and lights and unpacking white plaster pillars and a series of very beautiful chairs and tables.

reference_spacy_tokens: In the studio , seven people are busy setting up cameras and lights and unpacking white plaster pillars and a series of very beautiful chairs and tables .


fn_spacy_tokens_for_baseline: Another report indicates that " Iran has ... conducted extensive research on more lethal active agents like anthrax , hoof and mouth disease , and biotoxins . "

source_bert_toks: another report indicates that " iran has . . . conducted extensive research on more lethal active agents like ant ##hra ##x , ho ##of and mouth disease , and bio ##to ##xin ##s . "

reference_raw: According to another report, "Iran has done extensive research on more deadly active substances such as anthrax, hooves and mouth disease, and biotoxins."

reference_spacy_tokens: According to another report , " Iran has done extensive research on more deadly active substances such as anthrax , hooves and mouth disease , and biotoxins . "


fn_spacy_tokens_for_baseline: A FRAIL pensioner died of shock after he was mugged as he fed the pigeons near his home .

source_bert_toks: a frail pension ##er died of shock after he was mug ##ged as he fed the pigeons near his home .

reference_raw: The FRAIL pensioner died of shock after being ambushed while feeding pigeons near his house.

reference_spacy_tokens: The FRAIL pensioner died of shock after being ambushed while feeding pigeons near his house .


fn_spacy_tokens_for_baseline: Battling Dave Cannon sprayed a whole trailer - load of the cow muck over a council building after plans for his retirement bungalow were turned down for the fourth time .

source_bert_toks: battling dave cannon sprayed a whole trailer - load of the cow mu ##ck over a council building after plans for his retirement bungalow were turned down for the fourth time .

reference_raw: When the plans for his retirement bungalow had been rejected for the fourth time, the fighting Dave Cannon had sprinkled an entire trailer full of cow muck over the council building.

reference_spacy_tokens: When the plans for his retirement bungalow had been rejected for the fourth time , the fighting Dave Cannon had sprinkled an entire trailer full of cow muck over the council building .


fn_spacy_tokens_for_baseline: One of them dropped into a formal curtsey , revealing both her cleavage and her undergarment , and he smiled grimly .

source_bert_toks: one of them dropped into a formal curt ##sey , revealing both her cleavage and her under ##gar ##ment , and he smiled grimly .

reference_raw: One fell into a formal curtsey, revealing both her cleavage and her underwear, and he smiled grimly.

reference_spacy_tokens: One fell into a formal curtsey , revealing both her cleavage and her underwear , and he smiled grimly .


fn_spacy_tokens_for_baseline: He felt flushed and there was a prickling sensation in his legs and hands .

source_bert_toks: he felt flushed and there was a prick ##ling sensation in his legs and hands .

reference_raw: He felt flushed, and his legs and hands felt prickly.

reference_spacy_tokens: He felt flushed , and his legs and hands felt prickly .


fn_spacy_tokens_for_baseline: The most spectacular art treasures of the church are its gorgeous Byzantine mosaics , glittering Old Testament scenes high on the walls ( do n't forget the binoculars ) , and a triumphant Mary and Jesus enthroned in the apse over the high altar .

source_bert_toks: the most spectacular art treasures of the church are its gorgeous byzantine mosaic ##s , glittering old testament scenes high on the walls ( don ' t forget the binoculars ) , and a triumphant mary and jesus en ##th ##rone ##d in the ap ##se over the high altar .

reference_raw: The most magnificent art treasures of the Church are its beautiful Byzantine mosaics, the glittering scenes of the Old Testament high on the walls (remember the telescopes), and the triumphant Mary and Jesus were enthroned in the apse above the high altar.

reference_spacy_tokens: The most magnificent art treasures of the Church are its beautiful Byzantine mosaics , the glittering scenes of the Old Testament high on the walls ( remember the telescopes ) , and the triumphant Mary and Jesus were enthroned in the apse above the high altar .


fn_spacy_tokens_for_baseline: Or parameters which provoke the discharger 's concern can be framed leniently , control being assured by the insertion of a much stricter parameter of more general application .

source_bert_toks: or parameters which provoke the discharge ##r ' s concern can be framed len ##ient ##ly , control being assured by the insertion of a much strict ##er parameter of more general application .

reference_raw: Or the parameters that give rise to the discharger's concern can be easily framed, and control can be ensured by inserting a much stricter parameter of more general application.

reference_spacy_tokens: Or the parameters that give rise to the discharger 's concern can be easily framed , and control can be ensured by inserting a much stricter parameter of more general application .


fn_spacy_tokens_for_baseline: Bella was in hospital and she still believed that Gazzer , in spite of all his denials and glib talk , had put her there .

source_bert_toks: bella was in hospital and she still believed that ga ##zz ##er , in spite of all his denial ##s and g ##lib talk , had put her there .

reference_raw: Bella was in the hospital, and she still believed that Gazzer had put her there, despite all his denials and slippery talk.

reference_spacy_tokens: Bella was in the hospital , and she still believed that Gazzer had put her there , despite all his denials and slippery talk .


fn_spacy_tokens_for_baseline: Even if the security is ample , the bank will not want the time , trouble and loss of goodwill involved in attempting to repossess its loan .

source_bert_toks: even if the security is ample , the bank will not want the time , trouble and loss of goodwill involved in attempting to rep ##oss ##ess its loan .

reference_raw: Even if the security is large, the bank will not want the time, trouble and loss of goodwill involved in the attempt to repossess its loan.

reference_spacy_tokens: Even if the security is large , the bank will not want the time , trouble and loss of goodwill involved in the attempt to repossess its loan .


fn_spacy_tokens_for_baseline: Ever since 1957 the Canton Trade Fair ( officially the Chinese Export Commodities Fair ) has attracted throngs of international business people every spring and autumn .

source_bert_toks: ever since 1957 the canton trade fair ( officially the chinese export commodities fair ) has attracted th ##rong ##s of international business people every spring and autumn .

reference_raw: Since 1957, the Canton Trade Fair (officially the Chinese Export Commodity Fair) has attracted crowds of international entrepreneurs in the summer and autumn.

reference_spacy_tokens: Since 1957 , the Canton Trade Fair ( officially the Chinese Export Commodity Fair ) has attracted crowds of international entrepreneurs in the summer and autumn .


fn_spacy_tokens_for_baseline: Chased them , got one , took him in , and told him he would be summonsed for playing football in the street .

source_bert_toks: chased them , got one , took him in , and told him he would be summons ##ed for playing football in the street .

reference_raw: I chased them, got one, took him in, and told him he'd be called to play soccer on the street.

reference_spacy_tokens: I chased them , got one , took him in , and told him he 'd be called to play soccer on the street .


fn_spacy_tokens_for_baseline: Russia inherited the declared Soviet stockpile of 40,000 metric tons of CW munitions and agents stored in bulk .

source_bert_toks: russia inherited the declared soviet stock ##pile of 40 , 000 metric tons of cw munitions and agents stored in bulk .

reference_raw: Russia inherited the declared Soviet stockpile of 40,000 metric tons of CW ammunition and agents stored in bulk.

reference_spacy_tokens: Russia inherited the declared Soviet stockpile of 40,000 metric tons of CW ammunition and agents stored in bulk .


fn_spacy_tokens_for_baseline: China is not , however , a member of the Australia Group ( AG ) , a voluntary supply - side export control regime focused on chemical and biological weapons , though the issuance of new export control regulations in 2002 has put Beijing 's export control policy fully in line with that of the AG .

source_bert_toks: china is not , however , a member of the australia group ( ag ) , a voluntary supply - side export control regime focused on chemical and biological weapons , though the iss ##uance of new export control regulations in 2002 has put beijing ' s export control policy fully in line with that of the ag .

reference_raw: However, China is not a member of the Australia Group (AG), a voluntary supply-side export control regime aimed at chemical and biological weapons, although the issue of new export control regulations in 2002 has fully aligned Beijing's export control policy with that of the AG.

reference_spacy_tokens: However , China is not a member of the Australia Group ( AG ) , a voluntary supply - side export control regime aimed at chemical and biological weapons , although the issue of new export control regulations in 2002 has fully aligned Beijing 's export control policy with that of the AG .


fn_spacy_tokens_for_baseline: ' When Postine next revives , her brain activity should have returned to normal . '

source_bert_toks: ' when post ##ine next revive ##s , her brain activity should have returned to normal . '

reference_raw: "The next time Postine comes back to life, her brain activity should be back to normal."

reference_spacy_tokens: " The next time Postine comes back to life , her brain activity should be back to normal . "


fn_spacy_tokens_for_baseline: ' How interesting , I 'm sure , ' he wheezed at last .

source_bert_toks: ' how interesting , i ' m sure , ' he w ##hee ##zed at last .

reference_raw: "I'm sure that's interesting," he said finally.

reference_spacy_tokens: " I 'm sure that 's interesting , " he said finally .


fn_spacy_tokens_for_baseline: She pointed to his forehead where the blood had congealed and dried around the cut .

source_bert_toks: she pointed to his forehead where the blood had cong ##eal ##ed and dried around the cut .

reference_raw: She pointed to his forehead, where the blood had clotted and dried around the wound.

reference_spacy_tokens: She pointed to his forehead , where the blood had clotted and dried around the wound .


fn_spacy_tokens_for_baseline: During and after the exile Ezechiel ( 33.23 ) , the Third Isaiah ( 57.1 - 10 ; 65.11 - 12 ) and the Second Zechariah ( 10.2 ; 13.2 ) denounced the worship of idols , the slaying of children , and the practice of ritual prostitution .

source_bert_toks: during and after the exile e ##ze ##chi ##el ( 33 . 23 ) , the third isaiah ( 57 . 1 - 10 ; 65 . 11 - 12 ) and the second ze ##cha ##ria ##h ( 10 . 2 ; 13 . 2 ) denounced the worship of idols , the sl ##ay ##ing of children , and the practice of ritual prostitution .

reference_raw: During and after the exile of Ezechiel (33.23), the third Isaiah (57.1-10; 65.11-12) and the second Zechariah (10.2; 13.2) condemned the worship of idols, the slaughter of children and the practice of ritual prostitution.

reference_spacy_tokens: During and after the exile of Ezechiel ( 33.23 ) , the third Isaiah ( 57.1 - 10 ; 65.11 - 12 ) and the second Zechariah ( 10.2 ; 13.2 ) condemned the worship of idols , the slaughter of children and the practice of ritual prostitution .


fn_spacy_tokens_for_baseline: She was down to her undergarment now , a black lace one - piece chemise adorned with crimson frills and a multitude of tiny feathers .

source_bert_toks: she was down to her under ##gar ##ment now , a black lace one - piece che ##mise adorned with crimson fr ##ill ##s and a multitude of tiny feathers .

reference_raw: Now she was in her underwear, a black lace one-piece chemistry decorated with crimson frills and a lot of tiny feathers.

reference_spacy_tokens: Now she was in her underwear , a black lace one - piece chemistry decorated with crimson frills and a lot of tiny feathers .


fn_spacy_tokens_for_baseline: Something important was eluding her , and until she 'd worked out what it was she did n't want to demand an explanation from him .

source_bert_toks: something important was el ##uding her , and until she ' d worked out what it was she didn ' t want to demand an explanation from him .

reference_raw: Something important was missing, and she didn't want to ask him to explain it until she found out what it was.

reference_spacy_tokens: Something important was missing , and she did n't want to ask him to explain it until she found out what it was .


fn_spacy_tokens_for_baseline: The minimum 24-hour cost per guest is £ 140 .

source_bert_toks: the minimum 24 - hour cost per guest is £1 ##40 .

reference_raw: At least 24 hours per guest is £140.

reference_spacy_tokens: At least 24 hours per guest is £ 140 .


fn_spacy_tokens_for_baseline: North Atlantic Treaty Organization and Afghan troops launched an offensive last month to flush out Taliban militants from the province 's northern tip .

source_bert_toks: north atlantic treaty organization and afghan troops launched an offensive last month to flush out taliban militants from the province ' s northern tip .

reference_raw: The North Atlantic Treaty Organization and Afghan troops launched an attack last month to remove Taliban troops from the northern tip of the province.

reference_spacy_tokens: The North Atlantic Treaty Organization and Afghan troops launched an attack last month to remove Taliban troops from the northern tip of the province .