fn_spacy_tokens_for_baseline: If Leeds are so shite why does he still go to Elland Rd to watch on his days off I wonder ? ?

source_bert_toks: if leeds are so shit ##e why does he still go to ella ##nd rd to watch on his days off i wonder ? ?

reference_raw: If Leeds is so shitty, why is he still going to Elland Rd to take a look at his days off, I wonder?

reference_spacy_tokens: If Leeds is so shitty , why is he still going to Elland Rd to take a look at his days off , I wonder ?


fn_spacy_tokens_for_baseline: Some of these also fetched a large sum , the emerald necklace making £ 396,000 and the tiara £ 275,000 .

source_bert_toks: some of these also fetch ##ed a large sum , the emerald necklace making £3 ##9 ##6 , 000 and the tia ##ra £2 ##75 , 000 .

reference_raw: Some of them also brought a large sum of money, a chain of emeralds making £396,000, and a tiara of £275,000.

reference_spacy_tokens: Some of them also brought a large sum of money , a chain of emeralds making £ 396,000 , and a tiara of £ 275,000 .


fn_spacy_tokens_for_baseline: Moisten the chicken using the reduced stock and garnish with the cooked vegetables from the stock , but discard the bouquet garni .

source_bert_toks: moist ##en the chicken using the reduced stock and ga ##rn ##ish with the cooked vegetables from the stock , but disc ##ard the bouquet ga ##rn ##i .

reference_raw: Wet the chicken with reduced stock and garnish it with cooked vegetables from the stock, but discard the bouquet garni.

reference_spacy_tokens: Wet the chicken with reduced stock and garnish it with cooked vegetables from the stock , but discard the bouquet garni .


fn_spacy_tokens_for_baseline: Potatoes are farmed in Britain in three basic seasonal groups : EARLIES , SECOND EARLIES , and MAINCROP .

source_bert_toks: potatoes are farm ##ed in britain in three basic seasonal groups : earl ##ies , second earl ##ies , and main ##cr ##op .

reference_raw: In the United Kingdom, potatoes are held in three basic seasonal groups: EARLIES, SECOND EARLIES and MAINCROP.

reference_spacy_tokens: In the United Kingdom , potatoes are held in three basic seasonal groups : EARLIES , SECOND EARLIES and MAINCROP .


fn_spacy_tokens_for_baseline: The costs of the preferred British Rail route have risen from £ 1.7bn to between £ 3.5bn and £ 4bn partly because of extra tunnelling insisted upon by ministers after protests in south London and Kent .

source_bert_toks: the costs of the preferred british rail route have risen from £1 . 7 ##bn to between £3 . 5 ##bn and £ ##4 ##bn partly because of extra tunnel ##ling insisted upon by ministers after protests in south london and kent .

reference_raw: The cost of the preferred British railway route increased from £1.7 billion to £3.5 billion to £4 billion, partly due to the additional tunnelling that ministers demanded after the protests in South London and Kent.

reference_spacy_tokens: The cost of the preferred British railway route increased from £ 1.7 billion to £ 3.5 billion to £ 4 billion , partly due to the additional tunnelling that ministers demanded after the protests in South London and Kent .


fn_spacy_tokens_for_baseline: She was not going to have to invent an excuse to ring Veronica after all .

source_bert_toks: she was not going to have to in ##vent an excuse to ring veronica after all .

reference_raw: After all, she wouldn't have to come up with an excuse to call Veronica.

reference_spacy_tokens: After all , she would n't have to come up with an excuse to call Veronica .


fn_spacy_tokens_for_baseline: If matches were used , say the prosecution , to find spots for sexual comfort , then all the men were to blame if those matches led to the deaths of the girls .

source_bert_toks: if matches were used , say the prosecution , to find spots for sexual comfort , then all the men were to blame if those matches led to the deaths of the girls .

reference_raw: If the matches were used, let's say the prosecution, to find a place for sexual comfort, then all the men were to blame if the matches resulted in the girls' deaths.

reference_spacy_tokens: If the matches were used , let 's say the prosecution , to find a place for sexual comfort , then all the men were to blame if the matches resulted in the girls ' deaths .


fn_spacy_tokens_for_baseline: Receivers Arthur Anderson have been appointed by Natwest Bank to recoup losses from Levitt and his company .

source_bert_toks: receivers arthur anderson have been appointed by nat ##west bank to rec ##ou ##p losses from levi ##tt and his company .

reference_raw: The beneficiaries of Arthur Anderson were named by the Natwest Bank to recover the losses of Levitt and his company.

reference_spacy_tokens: The beneficiaries of Arthur Anderson were named by the Natwest Bank to recover the losses of Levitt and his company .


fn_spacy_tokens_for_baseline: This is the very last thing that should ever suffer in a time of recession or emergency when people 's belts have to tighten .

source_bert_toks: this is the very last thing that should ever suffer in a time of recession or emergency when people ' s belts have to tighten .

reference_raw: It's the last thing you're going to have to endure in a recession or an emergency when people have to tighten their belts.

reference_spacy_tokens: It 's the last thing you 're going to have to endure in a recession or an emergency when people have to tighten their belts .


fn_spacy_tokens_for_baseline: WHITEHALL 'S most expensive confidential memoranda are written by Mr Nicholas Ridley , the Trade Secretary , and cost £ 4.86 a time , an official investigation revealed yesterday .

source_bert_toks: whitehall ' s most expensive confidential memo ##rand ##a are written by mr nicholas ridley , the trade secretary , and cost £ ##4 . 86 a time , an official investigation revealed yesterday .

reference_raw: WHITEHALL's most expensive secret memoranda is written by Mr. Nicholas Ridley, Secretary of Commerce, and costs £4.86 a day, an official investigation revealed yesterday.

reference_spacy_tokens: WHITEHALL 's most expensive secret memoranda is written by Mr. Nicholas Ridley , Secretary of Commerce , and costs £ 4.86 a day , an official investigation revealed yesterday .


fn_spacy_tokens_for_baseline: Thus adult people may be dominantly oral types , taking everything to them ( engulfers ) or gift - givers or miserly people of the anal type .

source_bert_toks: thus adult people may be dominant ##ly oral types , taking everything to them ( eng ##ulf ##ers ) or gift - give ##rs or mis ##erly people of the anal type .

reference_raw: Adults can therefore dominate the oral type and take everything (engulfers) or donors or sufferers of the anal type.

reference_spacy_tokens: Adults can therefore dominate the oral type and take everything ( engulfers ) or donors or sufferers of the anal type .


fn_spacy_tokens_for_baseline: The cheese stunk like that .

source_bert_toks: the cheese stu ##nk like that .

reference_raw: Cheese stings like this.

reference_spacy_tokens: Cheese stings like this .


fn_spacy_tokens_for_baseline: I have taken my children to the battlefields of north - east France as a result of which their grandfather died because of the foolishness of politicians .

source_bert_toks: i have taken my children to the battlefield ##s of north - east france as a result of which their grandfather died because of the foolish ##ness of politicians .

reference_raw: I took my children to the battlefields of northeast France, where their grandfather died because of the stupidity of politicians.

reference_spacy_tokens: I took my children to the battlefields of northeast France , where their grandfather died because of the stupidity of politicians .


fn_spacy_tokens_for_baseline: ' How perceptive of you , cara .

source_bert_toks: ' how per ##ceptive of you , cara .

reference_raw: 'That's very thoughtful of you, Cara.

reference_spacy_tokens: ' That 's very thoughtful of you , Cara .


fn_spacy_tokens_for_baseline: If it had been carved to life all the detail would have disappeared in a dense and unreadable thicket of vegetation .

source_bert_toks: if it had been carved to life all the detail would have disappeared in a dense and un ##rea ##dable thick ##et of vegetation .

reference_raw: If it had been carved into life, all the details would have been lost in a thick, unreadable bush of vegetation.

reference_spacy_tokens: If it had been carved into life , all the details would have been lost in a thick , unreadable bush of vegetation .


fn_spacy_tokens_for_baseline: Morley 's ' sin ' was to acknowledge the short - term attraction of crack and to seek to explain , from his own experience , how the drug might alleviate social alienation .

source_bert_toks: morley ' s ' sin ' was to acknowledge the short - term attraction of crack and to seek to explain , from his own experience , how the drug might alleviate social alien ##ation .

reference_raw: Morley's 'sin' was to acknowledge the short-term attraction of crack and try to explain, from his own experience, how the drug could ease social estrangement.

reference_spacy_tokens: Morley 's ' sin ' was to acknowledge the short - term attraction of crack and try to explain , from his own experience , how the drug could ease social estrangement .


fn_spacy_tokens_for_baseline: Robbie listened uncomfortably , deploring the fiction about Hugh that she 'd allowed to continue .

source_bert_toks: robbie listened uncomfortably , de ##pl ##orin ##g the fiction about hugh that she ' d allowed to continue .

reference_raw: Robbie listened uncomfortably, regretting Hugh's fiction, which she had allowed to continue.

reference_spacy_tokens: Robbie listened uncomfortably , regretting Hugh 's fiction , which she had allowed to continue .


fn_spacy_tokens_for_baseline: Or they might shelter piratical degenerates who had become creatures of Chaos .

source_bert_toks: or they might shelter pi ##ratic ##al de ##gen ##erate ##s who had become creatures of chaos .

reference_raw: Or they could hide the piratical perverts that had become creatures of Chaos.

reference_spacy_tokens: Or they could hide the piratical perverts that had become creatures of Chaos .


fn_spacy_tokens_for_baseline: Mark 's meeting with the Irish Minister of Industry and his loquacious officials was pure theatre .

source_bert_toks: mark ' s meeting with the irish minister of industry and his lo ##qua ##cious officials was pure theatre .

reference_raw: Mark's meeting with the Irish Minister of Industry and his wealthy officials was pure theater.

reference_spacy_tokens: Mark 's meeting with the Irish Minister of Industry and his wealthy officials was pure theater .


fn_spacy_tokens_for_baseline: Nobody knew more about lambing and calving than a veterinary surgeon so he was invited to instruct .

source_bert_toks: nobody knew more about lamb ##ing and calvin ##g than a veterinary surgeon so he was invited to ins ##truct .

reference_raw: No one knew more about sheep and calves than a veterinarian, so he was asked to give instructions.

reference_spacy_tokens: No one knew more about sheep and calves than a veterinarian , so he was asked to give instructions .


fn_spacy_tokens_for_baseline: Some of the 14 alleged bin Laden associates arrested in Jordan in December have begun talking to investigators .

source_bert_toks: some of the 14 alleged bin laden associates arrested in jordan in december have begun talking to investigators .

reference_raw: Some of the 14 alleged bin Laden co-workers arrested in Jordan in December started talking to investigators.

reference_spacy_tokens: Some of the 14 alleged bin Laden co - workers arrested in Jordan in December started talking to investigators .


fn_spacy_tokens_for_baseline: The Middle Kingdom is a recreated " living " history of China 's past , presented through a number of full - size replicas of shrines , temples , pagodas , palaces , and street scenes .

source_bert_toks: the middle kingdom is a recreated " living " history of china ' s past , presented through a number of full - size replica ##s of shrines , temples , pagoda ##s , palaces , and street scenes .

reference_raw: The Middle Kingdom is the recreated "living" history of China's past, presented in a series of full-size replicas of temples, temples, pagodas, castles, and street scenes.

reference_spacy_tokens: The Middle Kingdom is the recreated " living " history of China 's past , presented in a series of full - size replicas of temples , temples , pagodas , castles , and street scenes .


fn_spacy_tokens_for_baseline: By the autumn Poitou , Angoumois and Saintonge had fallen to the French .

source_bert_toks: by the autumn po ##ito ##u , ang ##oum ##ois and saint ##ong ##e had fallen to the french .

reference_raw: In autumn, Poitou, Angoumois and Saintonge went to France.

reference_spacy_tokens: In autumn , Poitou , Angoumois and Saintonge went to France .


fn_spacy_tokens_for_baseline: The bar was busy when we entered , buzzing with agricultural talk , but the moment we appeared , there was total silence .

source_bert_toks: the bar was busy when we entered , buzzing with agricultural talk , but the moment we appeared , there was total silence .

reference_raw: When we entered the bar, the bar was busy, humming with agricultural conversations, but when we showed up there was a complete silence.

reference_spacy_tokens: When we entered the bar , the bar was busy , humming with agricultural conversations , but when we showed up there was a complete silence .


fn_spacy_tokens_for_baseline: An interesting , friendly howff in a Victorian building replacing the original Inn built in 1676 .

source_bert_toks: an interesting , friendly how ##ff in a victorian building replacing the original inn built in 167 ##6 .

reference_raw: Interesting, friendly howff in the Victorian building that replaces the original hotel built in 1676.

reference_spacy_tokens: Interesting , friendly howff in the Victorian building that replaces the original hotel built in 1676 .


fn_spacy_tokens_for_baseline: You 're the most wanted man in Britain .

source_bert_toks: you ' re the most wanted man in britain .

reference_raw: You are the most sought-after man in Britain.

reference_spacy_tokens: You are the most sought - after man in Britain .


fn_spacy_tokens_for_baseline: The map stopped at the southern side of the Jebel , just where the Sahara began .

source_bert_toks: the map stopped at the southern side of the je ##bel , just where the sahara began .

reference_raw: The map stopped on the south side of the Jebel, just as the Sahara had begun.

reference_spacy_tokens: The map stopped on the south side of the Jebel , just as the Sahara had begun .


fn_spacy_tokens_for_baseline: There was a creak of splintering wood as the tall man prized off the lid of the crate .

source_bert_toks: there was a cr ##eak of splinter ##ing wood as the tall man prized off the lid of the crate .

reference_raw: There was a screech of splintering wood as the tall man appreciated the lid of the box.

reference_spacy_tokens: There was a screech of splintering wood as the tall man appreciated the lid of the box .


fn_spacy_tokens_for_baseline: I did n't explain why and took instead a tartan scarf -- to be Rob Roy , I said , but actually to conceal my lack of proper neckwear .

source_bert_toks: i didn ' t explain why and took instead a tar ##tan scarf - - to be rob roy , i said , but actually to conceal my lack of proper neck ##wear .

reference_raw: I did not explain why, and instead I took a tartan shawl - to be Rob Roy, I said, but to conceal my lack of proper clothing.

reference_spacy_tokens: I did not explain why , and instead I took a tartan shawl - to be Rob Roy , I said , but to conceal my lack of proper clothing .


fn_spacy_tokens_for_baseline: Passports found in one of the houses identify the men as from a privilege convenience province noted for lawless tribes .

source_bert_toks: passports found in one of the houses identify the men as from a privilege convenience province noted for law ##less tribes .

reference_raw: The passports found in one of the houses identify the men from the privileged comfort province noted for the illegal tribes.

reference_spacy_tokens: The passports found in one of the houses identify the men from the privileged comfort province noted for the illegal tribes .


fn_spacy_tokens_for_baseline: Two officers radioed his warning to control .

source_bert_toks: two officers radio ##ed his warning to control .

reference_raw: Two officers gave him a warning to check.

reference_spacy_tokens: Two officers gave him a warning to check .


fn_spacy_tokens_for_baseline: One is not referring here to the mentally disabled , who are already well represented .

source_bert_toks: one is not referring here to the mentally disabled , who are already well represented .

reference_raw: One does not mention mentally handicapped people who are already well represented.

reference_spacy_tokens: One does not mention mentally handicapped people who are already well represented .


fn_spacy_tokens_for_baseline: Eventually she bought a maroon dress with a crocheted collar and a matching bolero which hid a small repaired split under the arm .

source_bert_toks: eventually she bought a maroon dress with a cr ##oche ##ted collar and a matching bo ##ler ##o which hid a small repaired split under the arm .

reference_raw: Finally, she bought a maroon gown with a crocheted collar and a matching bolero that concealed a small repaired section under her arm.

reference_spacy_tokens: Finally , she bought a maroon gown with a crocheted collar and a matching bolero that concealed a small repaired section under her arm .


fn_spacy_tokens_for_baseline: The two parties may agree a price for the land or ask an agent to act on their behalf .

source_bert_toks: the two parties may agree a price for the land or ask an agent to act on their behalf .

reference_raw: The two parties may agree on the cost of the land or ask the agent to act on their behalf.

reference_spacy_tokens: The two parties may agree on the cost of the land or ask the agent to act on their behalf .


fn_spacy_tokens_for_baseline: Vanity is a sin . '

source_bert_toks: vanity is a sin . '

reference_raw: Vanity is an abomination.'

reference_spacy_tokens: Vanity is an abomination . '


fn_spacy_tokens_for_baseline: Eventually , if the body lay undisturbed for long enough , the skin might even detach itself from the body .

source_bert_toks: eventually , if the body lay und ##ist ##urbed for long enough , the skin might even det ##ach itself from the body .

reference_raw: In the end, if the body lay undisturbed for long enough, the skin could be separated from the body.

reference_spacy_tokens: In the end , if the body lay undisturbed for long enough , the skin could be separated from the body .


fn_spacy_tokens_for_baseline: Agnes waited for George , but when he stayed quiet , she said : ' Harry , Neptune Court and its purlieus will be absolutely crawling with cops .

source_bert_toks: agnes waited for george , but when he stayed quiet , she said : ' harry , neptune court and its pu ##rl ##ieu ##s will be absolutely crawling with cops .

reference_raw: Agnes waited for George, but when he was silent, she said, "Harry, Neptune Court, and her purlieus, are going to be full of cops.

reference_spacy_tokens: Agnes waited for George , but when he was silent , she said , " Harry , Neptune Court , and her purlieus , are going to be full of cops .


fn_spacy_tokens_for_baseline: If you missed the chance to win this fantastic three night stay in the Big Apple in our September issue , have a go NOW !

source_bert_toks: if you missed the chance to win this fantastic three night stay in the big apple in our september issue , have a go now !

reference_raw: If you've missed a chance to win this fabulous three-night stand at the Big Apple in our September edition, go now!

reference_spacy_tokens: If you 've missed a chance to win this fabulous three - night stand at the Big Apple in our September edition , go now !


fn_spacy_tokens_for_baseline: You can not harvest a durian , but the first person to reach a fallen fruit , even on another 's land , may claim it .

source_bert_toks: you can not harvest a du ##rian , but the first person to reach a fallen fruit , even on another ' s land , may claim it .

reference_raw: You can't pick a durian, but the first person to reach a fallen fruit, even on the land of another, can claim it.

reference_spacy_tokens: You ca n't pick a durian , but the first person to reach a fallen fruit , even on the land of another , can claim it .


fn_spacy_tokens_for_baseline: Britten is a master at creating vivid accompaniment figurations which give us a strong impression of the music 's emotive message even before the melody begins .

source_bert_toks: britten is a master at creating vivid accompaniment fig ##uration ##s which give us a strong impression of the music ' s em ##ot ##ive message even before the melody begins .

reference_raw: Britten is a genius at creating live accompanying images that give us a strong impression of the emotional message of the music before the melody begins.

reference_spacy_tokens: Britten is a genius at creating live accompanying images that give us a strong impression of the emotional message of the music before the melody begins .


fn_spacy_tokens_for_baseline: He just lay there and he quietly slipped away -- most unlike himself because he was normally such a noisy , impudent chap .

source_bert_toks: he just lay there and he quietly slipped away - - most unlike himself because he was normally such a noisy , imp ##ude ##nt cha ##p .

reference_raw: He simply lay there and quietly slipped away - most unlike himself, for he was usually such a noisy, insolent man.

reference_spacy_tokens: He simply lay there and quietly slipped away - most unlike himself , for he was usually such a noisy , insolent man .


fn_spacy_tokens_for_baseline: Apart from the battery of robots and electric motors under computer control , firms are selling gadgets for teaching the principles of microprocessors .

source_bert_toks: apart from the battery of robots and electric motors under computer control , firms are selling ga ##dgets for teaching the principles of micro ##pro ##ces ##sor ##s .

reference_raw: In addition to a battery of robots and electric motors under computer control, companies sell equipment to teach microprocessor principles.

reference_spacy_tokens: In addition to a battery of robots and electric motors under computer control , companies sell equipment to teach microprocessor principles .


fn_spacy_tokens_for_baseline: It is feared forecasted wind gusts of up to 80 km / h ( 49 Mph ) overnight could fan the first fire into the township of Winmalee as it heads East .

source_bert_toks: it is feared forecast ##ed wind gust ##s of up to 80 km / h ( 49 mph ) overnight could fan the first fire into the township of win ##mal ##ee as it heads east .

reference_raw: It is feared that the forecasted wind gusts of up to 80 km/h (49 Mph) overnight may ignite the first fire in the township of Winmalee as it heads east.

reference_spacy_tokens: It is feared that the forecasted wind gusts of up to 80 km / h ( 49 Mph ) overnight may ignite the first fire in the township of Winmalee as it heads east .


fn_spacy_tokens_for_baseline: Food packaging manufacturer Linpac has marked its announcement of a corporate environmental policy with the introduction of a 50 % recycled polystyrene food container .

source_bert_toks: food packaging manufacturer lin ##pac has marked its announcement of a corporate environmental policy with the introduction of a 50 % recycled poly ##sty ##ren ##e food container .

reference_raw: Food packaging manufacturer Linpac has announced a corporate environmental policy by introducing a 50 % recycled polystyrene food container.

reference_spacy_tokens: Food packaging manufacturer Linpac has announced a corporate environmental policy by introducing a 50 % recycled polystyrene food container .


fn_spacy_tokens_for_baseline: Of late , they have been involving themselves in congressional races , to the chagrin of the national party .

source_bert_toks: of late , they have been involving themselves in congressional races , to the cha ##grin of the national party .

reference_raw: They've been involved in congressional races lately, to the national party chagrin.

reference_spacy_tokens: They 've been involved in congressional races lately , to the national party chagrin .


fn_spacy_tokens_for_baseline: But he found flying and sailing both more invigorating and he kept procrastinating .

source_bert_toks: but he found flying and sailing both more in ##vi ##gor ##ating and he kept pro ##cr ##ast ##inating .

reference_raw: But he found flying and sailing both more refreshing, and he continued to procrastinate.

reference_spacy_tokens: But he found flying and sailing both more refreshing , and he continued to procrastinate .


fn_spacy_tokens_for_baseline: Over 1,300 litres of highly alcoholic brew had been seized from one wing alone , in nine months .

source_bert_toks: over 1 , 300 litres of highly alcoholic brew had been seized from one wing alone , in nine months .

reference_raw: In nine months, more than 1,300 liters of high-alcohol beer were confiscated from one wing alone.

reference_spacy_tokens: In nine months , more than 1,300 liters of high - alcohol beer were confiscated from one wing alone .


fn_spacy_tokens_for_baseline: They were genial enough and we exchanged pleasantries until the leading galleon said , ' Do you believe in destiny ? '

source_bert_toks: they were gen ##ial enough and we exchanged pleasant ##ries until the leading gall ##eon said , ' do you believe in destiny ? '

reference_raw: They were genial enough, and we traded pleasantries until the leading galleon said, "Do you believe in fate?"

reference_spacy_tokens: They were genial enough , and we traded pleasantries until the leading galleon said , " Do you believe in fate ? "


fn_spacy_tokens_for_baseline: In order to develop job skills , a man with some serious disabilities begins working in Goodwill 's industrial division .

source_bert_toks: in order to develop job skills , a man with some serious disabilities begins working in goodwill ' s industrial division .

reference_raw: In order to develop the skills of a job, a man with some serious disabilities will start a job in the Goodwill industrial division.

reference_spacy_tokens: In order to develop the skills of a job , a man with some serious disabilities will start a job in the Goodwill industrial division .


fn_spacy_tokens_for_baseline: First choose the size of mirror that you want and then have a sheet of mirrored glass cut to your specifications .

source_bert_toks: first choose the size of mirror that you want and then have a sheet of mirrored glass cut to your specifications .

reference_raw: First select the size of the mirror you want, and then have the mirrored glass screen cut to the specification.

reference_spacy_tokens: First select the size of the mirror you want , and then have the mirrored glass screen cut to the specification .


fn_spacy_tokens_for_baseline: It was in fact the back axle of a lady 's tricycle which he had seen laying discarded on the top of someone 's dustbin .

source_bert_toks: it was in fact the back axle of a lady ' s tri ##cycle which he had seen laying discarded on the top of someone ' s dust ##bin .

reference_raw: In fact, it was the rear axle of the lady's tricycle he'd seen lying on the top of someone's dustbin.

reference_spacy_tokens: In fact , it was the rear axle of the lady 's tricycle he 'd seen lying on the top of someone 's dustbin .


fn_spacy_tokens_for_baseline: He did n't say so , but it was evident that he had been successful in the sheepdog trials , because he was unusually cheerful and forthcoming and he seemed quite jubilant to meet them there .

source_bert_toks: he didn ' t say so , but it was evident that he had been successful in the sheep ##dog trials , because he was unusually cheerful and forthcoming and he seemed quite ju ##bil ##ant to meet them there .

reference_raw: He did not say so, but it was clear that he had succeeded in the experiments of the sheepdogs, for he was unusually cheerful and accommodating, and he seemed quite happy to meet them there.

reference_spacy_tokens: He did not say so , but it was clear that he had succeeded in the experiments of the sheepdogs , for he was unusually cheerful and accommodating , and he seemed quite happy to meet them there .


fn_spacy_tokens_for_baseline: He rose , crossed to the clerk from Records to ask him for another file .

source_bert_toks: he rose , crossed to the clerk from records to ask him for another file .

reference_raw: He got up and went to the Records official and asked him for another file.

reference_spacy_tokens: He got up and went to the Records official and asked him for another file .


fn_spacy_tokens_for_baseline: Most of the patients developed ascites , jaundice , and encephalopathy that progressed even after interferon alfa was stopped .

source_bert_toks: most of the patients developed as ##cite ##s , ja ##und ##ice , and en ##ce ##pha ##lo ##pathy that progressed even after inter ##fer ##on alfa was stopped .

reference_raw: Most patients developed ascites, hepatitis and encephalopathy that progressed even after discontinuation of interferon alfa.

reference_spacy_tokens: Most patients developed ascites , hepatitis and encephalopathy that progressed even after discontinuation of interferon alfa .


fn_spacy_tokens_for_baseline: Once done , he set about building this lodge to serve as a grandstand , from whose balcony he could be with family and friends and watch his hounds coursing deer across the bare miles .

source_bert_toks: once done , he set about building this lodge to serve as a grand ##stand , from whose balcony he could be with family and friends and watch his hounds co ##urs ##ing deer across the bare miles .

reference_raw: When he had finished, he set out to build this cabin to serve as a grandstand, from which he could be with his family and friends on the balcony and watch his dogs roll over the barren miles of deer.

reference_spacy_tokens: When he had finished , he set out to build this cabin to serve as a grandstand , from which he could be with his family and friends on the balcony and watch his dogs roll over the barren miles of deer .


fn_spacy_tokens_for_baseline: He pulled off part of the officer 's jumper and pulled it tightly across the back of his neck .

source_bert_toks: he pulled off part of the officer ' s jumper and pulled it tightly across the back of his neck .

reference_raw: He removed a piece of the officer's sweater and pulled it tightly over the back of his neck.

reference_spacy_tokens: He removed a piece of the officer 's sweater and pulled it tightly over the back of his neck .


fn_spacy_tokens_for_baseline: Black and white or colour photographs should be sent together one of the special Pears Soap cartons .

source_bert_toks: black and white or colour photographs should be sent together one of the special pear ##s soap cart ##ons .

reference_raw: One of the special Pears Soap boxes should be sent together in black, white or colour photographs.

reference_spacy_tokens: One of the special Pears Soap boxes should be sent together in black , white or colour photographs .


fn_spacy_tokens_for_baseline: Depraved visitors came to witness the horrors Drachenfels devised , and pitiful slave - servitors catered for the debased appetites of visiting connoisseurs of carnage and debauchery .

source_bert_toks: de ##pr ##ave ##d visitors came to witness the horrors dr ##ache ##n ##fe ##ls devised , and pit ##iful slave - ser ##vi ##tors cater ##ed for the de ##base ##d appetite ##s of visiting con ##no ##isse ##urs of carnage and de ##bau ##cher ##y .

reference_raw: The sick visitors had come to witness the horrors that Drachenfels had devised, and the poor slave-servitors had eaten the debauchery of visiting connoisseurs of bloodshed and debauchery.

reference_spacy_tokens: The sick visitors had come to witness the horrors that Drachenfels had devised , and the poor slave - servitors had eaten the debauchery of visiting connoisseurs of bloodshed and debauchery .


fn_spacy_tokens_for_baseline: I 'll say hypocrisy is vile

source_bert_toks: i ' ll say h ##yp ##oc ##ris ##y is vile

reference_raw: I'm going to say that hypocrisy is disgusting.

reference_spacy_tokens: I 'm going to say that hypocrisy is disgusting .


fn_spacy_tokens_for_baseline: Despite conflicting statements from Tehran and press conjecture centring on Libya , it was never clear who was responsible for laying them .

source_bert_toks: despite conflicting statements from tehran and press conjecture cent ##ring on libya , it was never clear who was responsible for laying them .

reference_raw: Despite the conflicting statements of Tehran and the press conference on Libya, it was never clear who was responsible for setting them up.

reference_spacy_tokens: Despite the conflicting statements of Tehran and the press conference on Libya , it was never clear who was responsible for setting them up .


fn_spacy_tokens_for_baseline: It smelled of age rather than leather when he lowered himself on to it , rising dust spoiling the air , the material itself creaking dryly .

source_bert_toks: it smelled of age rather than leather when he lowered himself on to it , rising dust spoil ##ing the air , the material itself cr ##eak ##ing dryly .

reference_raw: He smelled more of age than of skin as he lowered himself to it, and the rising dust spoiled the air, and the material itself squeaked dryly.

reference_spacy_tokens: He smelled more of age than of skin as he lowered himself to it , and the rising dust spoiled the air , and the material itself squeaked dryly .


fn_spacy_tokens_for_baseline: They 'll be able to bask in the sun , visit some of the hundreds of palm - fringed coves around the island , or participate in excellent watersports .

source_bert_toks: they ' ll be able to bas ##k in the sun , visit some of the hundreds of palm - fringe ##d cove ##s around the island , or participate in excellent waters ##ports .

reference_raw: They can bask in the sun, visit hundreds of palm-fringed bays around the island, or take part in excellent water ports.

reference_spacy_tokens: They can bask in the sun , visit hundreds of palm - fringed bays around the island , or take part in excellent water ports .


fn_spacy_tokens_for_baseline: Sometimes -- on ' Love ' -- they 're like the Pixies on a dump - truck full of downers .

source_bert_toks: sometimes - - on ' love ' - - they ' re like the pi ##xie ##s on a dump - truck full of down ##ers .

reference_raw: Sometimes -- on love -- they're like Pixies in a dump truck full of bottoms.

reference_spacy_tokens: Sometimes -- on love -- they 're like Pixies in a dump truck full of bottoms .


fn_spacy_tokens_for_baseline: Soldiers stopped and crouched down every 50 meters ( yards ) to watch and listen .

source_bert_toks: soldiers stopped and crouched down every 50 meters ( yards ) to watch and listen .

reference_raw: The soldiers stopped and squatted every fifty yards (yards) to watch and listen.

reference_spacy_tokens: The soldiers stopped and squatted every fifty yards ( yards ) to watch and listen .


fn_spacy_tokens_for_baseline: The choice represents the 1.4 million men and women who make up the U. S. military , which led the invasion of Iraq nine months ago and this month captured deposed leader Saddam Hussein .

source_bert_toks: the choice represents the 1 . 4 million men and women who make up the u . s . military , which led the invasion of iraq nine months ago and this month captured deposed leader saddam hussein .

reference_raw: The choice is the 1.4 million men and women who make up the U.S. Army, which led the invasion of Iraq nine months ago, and this month caught the deposed leader of Saddam Hussein.

reference_spacy_tokens: The choice is the 1.4 million men and women who make up the U.S. Army , which led the invasion of Iraq nine months ago , and this month caught the deposed leader of Saddam Hussein .


fn_spacy_tokens_for_baseline: Britain urgently requires a mechanism for influencing the policies and behaviour of its police .

source_bert_toks: britain urgently requires a mechanism for influencing the policies and behaviour of its police .

reference_raw: The United Kingdom urgently needs a mechanism to influence the policies and behaviour of its police.

reference_spacy_tokens: The United Kingdom urgently needs a mechanism to influence the policies and behaviour of its police .


fn_spacy_tokens_for_baseline: The series of nuclear tests in 1995 - 96 prior to China 's signature of the Comprehensive Test Ban Treaty ( CTBT ) may have resulted in a smaller and lighter warhead design for the new generation of intercontinental ballistic missiles ( ICBMs ) now under development .

source_bert_toks: the series of nuclear tests in 1995 - 96 prior to china ' s signature of the comprehensive test ban treaty ( ct ##bt ) may have resulted in a smaller and lighter war ##head design for the new generation of intercontinental ballistic missiles ( ic ##bm ##s ) now under development .

reference_raw: The series of nuclear tests in 1995 - 96 before China signed the Comprehensive Test Ban Agreement (CTBT) could lead to a smaller and lighter design for the new generation of intercontinental ballistic missiles (ICBMs) currently under development.

reference_spacy_tokens: The series of nuclear tests in 1995 - 96 before China signed the Comprehensive Test Ban Agreement ( CTBT ) could lead to a smaller and lighter design for the new generation of intercontinental ballistic missiles ( ICBMs ) currently under development .


fn_spacy_tokens_for_baseline: A typewriter clacked away as an aide took a lawyer 's statement about a land dispute , one of dozens the police station has handled .

source_bert_toks: a type ##writer cl ##ack ##ed away as an aide took a lawyer ' s statement about a land dispute , one of dozens the police station has handled .

reference_raw: The typewriter clicked as the aide took a statement from a lawyer about a land dispute, one of the dozens the police station had handled.

reference_spacy_tokens: The typewriter clicked as the aide took a statement from a lawyer about a land dispute , one of the dozens the police station had handled .


fn_spacy_tokens_for_baseline: The modern model helicopter has progressed to the point where learning to fly them is comparatively easy and loops and rolls are commonplace .

source_bert_toks: the modern model helicopter has progressed to the point where learning to fly them is comparatively easy and loops and rolls are commonplace .

reference_raw: A modern model helicopter has progressed to a point where it is relatively easy to learn how to fly, and loops and rolls are common.

reference_spacy_tokens: A modern model helicopter has progressed to a point where it is relatively easy to learn how to fly , and loops and rolls are common .


fn_spacy_tokens_for_baseline: HELSINKI , Finland ( AP ) --- Former Finnish Prime Minister Harri Holkeri will be part of an international body overseeing the disarmament of rival factions in Northern Ireland , President Martti Ahtisaari said Thursday .

source_bert_toks: helsinki , finland ( ap ) - - - former finnish prime minister ha ##rri ho ##lke ##ri will be part of an international body overseeing the di ##sar ##mament of rival factions in northern ireland , president mart ##ti ah ##tis ##aar ##i said thursday .

reference_raw: HELSINKI, Finland (AP) - Former Finnish Prime Minister Harri Holkeri will be part of an international body overseeing the disarming of rival factions in Northern Ireland, President Martti Ahtisaari said on Thursday.

reference_spacy_tokens: HELSINKI , Finland ( AP ) - Former Finnish Prime Minister Harri Holkeri will be part of an international body overseeing the disarming of rival factions in Northern Ireland , President Martti Ahtisaari said on Thursday .


fn_spacy_tokens_for_baseline: Plans to lease timber rights from indigenous peoples for extremely low prices were also criticised .

source_bert_toks: plans to lease timber rights from indigenous peoples for extremely low prices were also criticised .

reference_raw: The plans to rent timber rights from indigenous peoples at very low prices were also criticised.

reference_spacy_tokens: The plans to rent timber rights from indigenous peoples at very low prices were also criticised .


fn_spacy_tokens_for_baseline: " Progressive education " ( as it was once called ) is far more interesting and agreeable to teachers than is disciplined instruction .

source_bert_toks: " progressive education " ( as it was once called ) is far more interesting and agree ##able to teachers than is disciplined instruction .

reference_raw: "Progressive education" (as they used to call it) is much more interesting and pleasant for teachers than disciplined education.

reference_spacy_tokens: " Progressive education " ( as they used to call it ) is much more interesting and pleasant for teachers than disciplined education .


fn_spacy_tokens_for_baseline: When we blame our ills upon someone we call a ' witch ' we proclaim our own innocence at their expense .

source_bert_toks: when we blame our ill ##s upon someone we call a ' witch ' we pro ##claim our own innocence at their expense .

reference_raw: When we accuse our ills of someone we call a witch, we declare ourselves innocent at their expense.

reference_spacy_tokens: When we accuse our ills of someone we call a witch , we declare ourselves innocent at their expense .


fn_spacy_tokens_for_baseline: BLACKEYES ended , trailing an ever thinner line of puzzled viewers , exasperated critics , and the nagging question , what went wrong ?

source_bert_toks: black ##eye ##s ended , trailing an ever thinner line of puzzled viewers , exasperated critics , and the na ##gging question , what went wrong ?

reference_raw: BLACKEYES ended with a thinning line of confused viewers, angry critics, and a nagging question, what went wrong?

reference_spacy_tokens: BLACKEYES ended with a thinning line of confused viewers , angry critics , and a nagging question , what went wrong ?


fn_spacy_tokens_for_baseline: We have n't ratted on our friends .

source_bert_toks: we haven ' t rat ##ted on our friends .

reference_raw: We didn't give up on our friends.

reference_spacy_tokens: We did n't give up on our friends .


fn_spacy_tokens_for_baseline: Intense , novel and variable stimuli are attended to rather than others , whilst regularly repeated stimuli seem to become ignored .

source_bert_toks: intense , novel and variable stimuli are attended to rather than others , whilst regularly repeated stimuli seem to become ignored .

reference_raw: Intensive, new and variable stimuli are more concerned than others, while regular repeated stimuli appear to be ignored.

reference_spacy_tokens: Intensive , new and variable stimuli are more concerned than others , while regular repeated stimuli appear to be ignored .


fn_spacy_tokens_for_baseline: The front door and the vestibule door had been blown off and the heavy mahogany coat stand lay across the foot of the stairs .

source_bert_toks: the front door and the vest ##ib ##ule door had been blown off and the heavy mahogany coat stand lay across the foot of the stairs .

reference_raw: The front door and the lobby door were blown off, and a heavy mahogany-coat stand was at the bottom of the stairs.

reference_spacy_tokens: The front door and the lobby door were blown off , and a heavy mahogany - coat stand was at the bottom of the stairs .


fn_spacy_tokens_for_baseline: He never bitched about other members of the team , but of people we knew . '

source_bert_toks: he never bitch ##ed about other members of the team , but of people we knew . '

reference_raw: He didn't complain about the other members of the team, but about the people we knew.'

reference_spacy_tokens: He did n't complain about the other members of the team , but about the people we knew . '


fn_spacy_tokens_for_baseline: This was the moment when Melody chose to knock at the door and Anna 's head jerked back , away from him .

source_bert_toks: this was the moment when melody chose to knock at the door and anna ' s head jerked back , away from him .

reference_raw: This was the moment Melody decided to knock on the door, and Anna turned her head away from him.

reference_spacy_tokens: This was the moment Melody decided to knock on the door , and Anna turned her head away from him .


fn_spacy_tokens_for_baseline: The anger and astonishment in her face gave way to something very like pity .

source_bert_toks: the anger and astonishment in her face gave way to something very like pity .

reference_raw: The anger and surprise on her face gave way to something very similar to regret.

reference_spacy_tokens: The anger and surprise on her face gave way to something very similar to regret .


fn_spacy_tokens_for_baseline: He liked to think of Beamish in the dock at the Central Court , his counsel blustering on about his client 's perfectly normal , acceptable need for heavy metal poisons ( ' But how do you explain , Mr Beamish , your ordering a quantity of thallium from a perfectly reputable chemist 's . ? ' )

source_bert_toks: he liked to think of beam ##ish in the dock at the central court , his counsel blu ##ster ##ing on about his client ' s perfectly normal , acceptable need for heavy metal poison ##s ( ' but how do you explain , mr beam ##ish , your ordering a quantity of tha ##lli ##um from a perfectly rep ##utable chemist ' s . ? ' )

reference_raw: He liked to think of Beamish on the docks of the Central Court, his counsel blubbering about his client's perfectly normal and acceptable need for heavy metal poisons ('But how do you explain, Mr. Beamish, that you ordered a quantity of thallium from a perfectly reputable chemist?')

reference_spacy_tokens: He liked to think of Beamish on the docks of the Central Court , his counsel blubbering about his client 's perfectly normal and acceptable need for heavy metal poisons ( ' But how do you explain , Mr. Beamish , that you ordered a quantity of thallium from a perfectly reputable chemist ? ' )


fn_spacy_tokens_for_baseline: ' Willingly , ' Rose agreed , and led the way to a small antechamber that led off the main saloon .

source_bert_toks: ' willingly , ' rose agreed , and led the way to a small ant ##ech ##am ##ber that led off the main saloon .

reference_raw: 'Of course,' said Rose, leading them to a small anteroom leading from the main saloon.

reference_spacy_tokens: ' Of course , ' said Rose , leading them to a small anteroom leading from the main saloon .


fn_spacy_tokens_for_baseline: For all its historic grandeur , the loyal Senate now is the equivalent of a city council , its statesmanship dedicated to water supplies , sewage lines , and the establishment of playgrounds .

source_bert_toks: for all its historic grande ##ur , the loyal senate now is the equivalent of a city council , its statesman ##ship dedicated to water supplies , sewage lines , and the establishment of playground ##s .

reference_raw: For all its historical grandeur, the Loyal Senate is now the equivalent of a city council, its statesmanship devoted to water supply, sewage lines, and the setting-up of playgrounds.

reference_spacy_tokens: For all its historical grandeur , the Loyal Senate is now the equivalent of a city council , its statesmanship devoted to water supply , sewage lines , and the setting - up of playgrounds .


fn_spacy_tokens_for_baseline: If you are a consultant to a developing Mini - Enterprise you might find yourself spending a whole day in the school .

source_bert_toks: if you are a consultant to a developing mini - enterprise you might find yourself spending a whole day in the school .

reference_raw: If you're a consultant for a developing mini-enterprise, you'll be able to spend all day at school.

reference_spacy_tokens: If you 're a consultant for a developing mini - enterprise , you 'll be able to spend all day at school .


fn_spacy_tokens_for_baseline: In the nine months , net rose 4.3 % to $ 525.8 million or $ 4.67 a share , from $ 504.2 million , or $ 4.41 a share , last year .

source_bert_toks: in the nine months , net rose 4 . 3 % to $ 525 . 8 million or $ 4 . 67 a share , from $ 50 ##4 . 2 million , or $ 4 . 41 a share , last year .

reference_raw: Over the course of the nine months, the network rose 4.3% to $525.8 million, or $4.67 a share, from $504.2 million last year, or $4.41 a share.

reference_spacy_tokens: Over the course of the nine months , the network rose 4.3 % to $ 525.8 million , or $ 4.67 a share , from $ 504.2 million last year , or $ 4.41 a share .


fn_spacy_tokens_for_baseline: In the Sunday Telegraph , interviewer Helena de Bertodano said that her first meeting with Brown had been ' tense ' because a ' PR magnate , an elderly man with a cut - glass English accent ' had insisted on sitting in on their conversation but that Brown subsequently arranged a one - on - one meeting for the next day .

source_bert_toks: in the sunday telegraph , interview ##er helena de bert ##oda ##no said that her first meeting with brown had been ' tense ' because a ' pr magnate , an elderly man with a cut - glass english accent ' had insisted on sitting in on their conversation but that brown subsequently arranged a one - on - one meeting for the next day .

reference_raw: In the Sunday telegraph, the interviewer Helena de Bertodano said that her first meeting with Brown was tense because an a'Pr. magnate, an old man with a cut-glass English accent, insisted on sitting in the conversation, but Brown later made a one-on-one appointment for the next day.

reference_spacy_tokens: In the Sunday telegraph , the interviewer Helena de Bertodano said that her first meeting with Brown was tense because an a'Pr . magnate , an old man with a cut - glass English accent , insisted on sitting in the conversation , but Brown later made a one - on - one appointment for the next day .


fn_spacy_tokens_for_baseline: A Trappist monastery , situated on a hillside overlooking the east coast of Lantau , is also open to visitors .

source_bert_toks: a trap ##pis ##t monastery , situated on a hillside overlooking the east coast of lan ##ta ##u , is also open to visitors .

reference_raw: The Trappist monastery, situated on a hill overlooking the eastern shore of Lantau, is also open to visitors.

reference_spacy_tokens: The Trappist monastery , situated on a hill overlooking the eastern shore of Lantau , is also open to visitors .


fn_spacy_tokens_for_baseline: You will not beguile me .

source_bert_toks: you will not beg ##uil ##e me .

reference_raw: You won't confuse me.

reference_spacy_tokens: You wo n't confuse me .


fn_spacy_tokens_for_baseline: I would lie for hours in my sea grey with the remains of bubble bath .

source_bert_toks: i would lie for hours in my sea grey with the remains of bubble bath .

reference_raw: I'd lay in my sea gray for hours with the remains of a bubble bath.

reference_spacy_tokens: I 'd lay in my sea gray for hours with the remains of a bubble bath .


fn_spacy_tokens_for_baseline: Scanning the lists of officers , Sly was struck by the number of times each name occurred , but in a different post .

source_bert_toks: scanning the lists of officers , sly was struck by the number of times each name occurred , but in a different post .

reference_raw: Sly looked at the lists of officers and was struck by the number of times each name had occurred, but in a different position.

reference_spacy_tokens: Sly looked at the lists of officers and was struck by the number of times each name had occurred , but in a different position .


fn_spacy_tokens_for_baseline: The Lake District is situated in the northernmost peninsula of England .

source_bert_toks: the lake district is situated in the northernmost peninsula of england .

reference_raw: The lake district is situated in the northmost peninsula of England.

reference_spacy_tokens: The lake district is situated in the northmost peninsula of England .


fn_spacy_tokens_for_baseline: Someone suggested they should all bathe in champagne beforehand and the bath was filled with some cheap bubbly .

source_bert_toks: someone suggested they should all bath ##e in champagne beforehand and the bath was filled with some cheap bu ##bbly .

reference_raw: Someone suggested that everyone should take a bath in champagne in advance, and that the bath was full of cheap bubbles.

reference_spacy_tokens: Someone suggested that everyone should take a bath in champagne in advance , and that the bath was full of cheap bubbles .


fn_spacy_tokens_for_baseline: John Lloyd , producer of Not The Nine O'Clock News , Spitting Image and Blackadder , says that for his generation of university students 20 years ago Python was the seminal programme .

source_bert_toks: john lloyd , producer of not the nine o ' clock news , spitting image and black ##ad ##der , says that for his generation of university students 20 years ago python was the seminal programme .

reference_raw: John Lloyd, the manufacturer of Not The Nine O'Clock News, Spitting Picture and Blackadder, says that Python was a seminal program for his generation of college students 20 years ago.

reference_spacy_tokens: John Lloyd , the manufacturer of Not The Nine O'Clock News , Spitting Picture and Blackadder , says that Python was a seminal program for his generation of college students 20 years ago .


fn_spacy_tokens_for_baseline: He also highlights the well - known dangers of people becoming addicted to computers ( New Scientist , 24 February , p 532 ) .

source_bert_toks: he also highlights the well - known dangers of people becoming addicted to computers ( new scientist , 24 february , p 53 ##2 ) .

reference_raw: It also highlights the well-known dangers of people becoming computer-dependent (New Scientist, 24 February, p 532).

reference_spacy_tokens: It also highlights the well - known dangers of people becoming computer - dependent ( New Scientist , 24 February , p 532 ) .


fn_spacy_tokens_for_baseline: It had never been intended and was not his desire that Japan should become an ally of the United States ; rather Japan should be recognised as a neutral .

source_bert_toks: it had never been intended and was not his desire that japan should become an ally of the united states ; rather japan should be recognised as a neutral .

reference_raw: It was never intended, and he didn't want Japan to become an ally of the United States; instead, Japan should be recognised as a neutral.

reference_spacy_tokens: It was never intended , and he did n't want Japan to become an ally of the United States ; instead , Japan should be recognised as a neutral .


fn_spacy_tokens_for_baseline: He shuddered involuntarily and walked on towards the printing works .

source_bert_toks: he shuddered in ##vo ##lun ##tar ##ily and walked on towards the printing works .

reference_raw: Involuntarily he shivered and went to the press.

reference_spacy_tokens: Involuntarily he shivered and went to the press .


fn_spacy_tokens_for_baseline: The smallest thing you could do would be to help a poor injured man towards the comfort of an inn ! '

source_bert_toks: the smallest thing you could do would be to help a poor injured man towards the comfort of an inn ! '

reference_raw: The least you can do is assist the poor wounded man in the comfort of the inn!'

reference_spacy_tokens: The least you can do is assist the poor wounded man in the comfort of the inn ! '


fn_spacy_tokens_for_baseline: West Jerusalem , separated from the rest of the new Jewish nation , held out under siege for several months until Israeli forces secured a land corridor connecting the city to the coastal areas .

source_bert_toks: west jerusalem , separated from the rest of the new jewish nation , held out under siege for several months until israeli forces secured a land corridor connecting the city to the coastal areas .

reference_raw: West Jerusalem, separated from the rest of the new Jewish nation, had been besieged for several months, until Israeli forces had established a land corridor linking the city to coastal areas.

reference_spacy_tokens: West Jerusalem , separated from the rest of the new Jewish nation , had been besieged for several months , until Israeli forces had established a land corridor linking the city to coastal areas .


fn_spacy_tokens_for_baseline: Do you think the Ancient World was all rose petals , lute music , and plump vats of honey sealed with bear fat ?

source_bert_toks: do you think the ancient world was all rose petals , lu ##te music , and plump va ##ts of honey sealed with bear fat ?

reference_raw: You think the ancient world was all rose petals, lute music, and plump tubs of honey sealed with bear fat?

reference_spacy_tokens: You think the ancient world was all rose petals , lute music , and plump tubs of honey sealed with bear fat ?


fn_spacy_tokens_for_baseline: He moaned more loudly and the people at the next table held their drinks in mid - air .

source_bert_toks: he moaned more loudly and the people at the next table held their drinks in mid - air .

reference_raw: He groaned louder, and the people at the next table were holding their drinks in the air.

reference_spacy_tokens: He groaned louder , and the people at the next table were holding their drinks in the air .


fn_spacy_tokens_for_baseline: A CONVICTED sex attacker who kidnapped a six - year - old girl from a playground was jailed for two years yesterday after a top judge said the law forced him to disregard the man 's long criminal record .

source_bert_toks: a convicted sex attacker who kidnapped a six - year - old girl from a playground was jailed for two years yesterday after a top judge said the law forced him to disregard the man ' s long criminal record .

reference_raw: A convicted sexual assailant who abducted a six-year-old girl from a playground was sentenced to two years yesterday after the highest judge said that the law forced him to ignore his long criminal record.

reference_spacy_tokens: A convicted sexual assailant who abducted a six - year - old girl from a playground was sentenced to two years yesterday after the highest judge said that the law forced him to ignore his long criminal record .


fn_spacy_tokens_for_baseline: Maps : The Schneider map of the Kathmandu Valley is invaluable ; outside the valley , the Nelles map of Nepal should be taken with a pinch of salt .

source_bert_toks: maps : the schneider map of the kathmandu valley is in ##val ##ua ##ble ; outside the valley , the nell ##es map of nepal should be taken with a pinch of salt .

reference_raw: Maps: The Schneider map of the Kathmandu valley is invaluable; outside the valley, the Nepal map should be taken with a bit of salt.

reference_spacy_tokens: Maps : The Schneider map of the Kathmandu valley is invaluable ; outside the valley , the Nepal map should be taken with a bit of salt .


fn_spacy_tokens_for_baseline: A macroeconomic model by its very nature must be highly simplified since its purpose is to simulate what is happening in the economy as a whole .

source_bert_toks: a macro ##economic model by its very nature must be highly simplified since its purpose is to simulate what is happening in the economy as a whole .

reference_raw: The macro-economic model must, by its very nature, be very simplified as it aims to simulate what is happening in the economy as a whole.

reference_spacy_tokens: The macro - economic model must , by its very nature , be very simplified as it aims to simulate what is happening in the economy as a whole .


fn_spacy_tokens_for_baseline: Here males stay with their male kin as adults and females move into new groups at adolescence .

source_bert_toks: here males stay with their male kin as adults and females move into new groups at adolescence .

reference_raw: This is where men stay with their male relatives while adults and women move into new groups when they grow up.

reference_spacy_tokens: This is where men stay with their male relatives while adults and women move into new groups when they grow up .


fn_spacy_tokens_for_baseline: ' My , my , yes ' , she burbled , settling back into her chair .

source_bert_toks: ' my , my , yes ' , she bu ##rb ##led , settling back into her chair .

reference_raw: "My, my, yes," she said, and sat back in her chair.

reference_spacy_tokens: " My , my , yes , " she said , and sat back in her chair .


fn_spacy_tokens_for_baseline: Although ( according to attitudinism ) ethical statements express attitudes rather than beliefs they are in many ways quite comparable to factual statements which express beliefs .

source_bert_toks: although ( according to at ##ti ##tu ##dini ##sm ) ethical statements express attitudes rather than beliefs they are in many ways quite comparable to factual statements which express beliefs .

reference_raw: Although moral statements (according to attitudinism) express attitudes rather than beliefs, they are in many ways quite similar to factual statements expressing beliefs.

reference_spacy_tokens: Although moral statements ( according to attitudinism ) express attitudes rather than beliefs , they are in many ways quite similar to factual statements expressing beliefs .


fn_spacy_tokens_for_baseline: Mildred felt a wave of tenderness towards the scrawny creature .

source_bert_toks: mildred felt a wave of tenderness towards the sc ##ra ##wny creature .

reference_raw: Mildred felt a wave of tenderness toward the thin creature.

reference_spacy_tokens: Mildred felt a wave of tenderness toward the thin creature .


fn_spacy_tokens_for_baseline: A third suggestion is that the black and white stripes dazzle the lion when it gets very close to its prey and make it difficult for the killer to concentrate on its fast - moving victim .

source_bert_toks: a third suggestion is that the black and white stripes da ##zzle the lion when it gets very close to its prey and make it difficult for the killer to concentrate on its fast - moving victim .

reference_raw: The third suggestion is that black-and-white stripes blind the lion when he gets very close to his prey, making it difficult for the killer to focus on his fast-moving victim.

reference_spacy_tokens: The third suggestion is that black - and - white stripes blind the lion when he gets very close to his prey , making it difficult for the killer to focus on his fast - moving victim .


fn_spacy_tokens_for_baseline: Earlier , in the last week of March , 28 officers and civilians had been arrested for reportedly planning a coup against the government .

source_bert_toks: earlier , in the last week of march , 28 officers and civilians had been arrested for reportedly planning a coup against the government .

reference_raw: Earlier, in the last week of March, 28 officers and civilians were arrested for allegedly planning a co-up against the government.

reference_spacy_tokens: Earlier , in the last week of March , 28 officers and civilians were arrested for allegedly planning a co - up against the government .


fn_spacy_tokens_for_baseline: Traffic disruption and a shortage of change at the turnstiles saw the kick - off delayed by 15 minutes .

source_bert_toks: traffic disruption and a shortage of change at the turns ##tile ##s saw the kick - off delayed by 15 minutes .

reference_raw: The traffic disruption and the lack of change in the turntiles saw that the launch had been postponed by 15 minutes.

reference_spacy_tokens: The traffic disruption and the lack of change in the turntiles saw that the launch had been postponed by 15 minutes .


fn_spacy_tokens_for_baseline: She was drugged with opium .

source_bert_toks: she was drugged with opium .

reference_raw: She was intoxicated with opium.

reference_spacy_tokens: She was intoxicated with opium .


fn_spacy_tokens_for_baseline: Snorting at the friar 's apparent stupidity , Cranston turned his horse and led them out of the main alleyways of Southwark .

source_bert_toks: snort ##ing at the friar ' s apparent stupidity , cr ##ans ##ton turned his horse and led them out of the main alley ##ways of south ##wark .

reference_raw: Cranston sniffed at the friar's apparent stupidity, turned his horse and led them out of the main streets of Southwark.

reference_spacy_tokens: Cranston sniffed at the friar 's apparent stupidity , turned his horse and led them out of the main streets of Southwark .


fn_spacy_tokens_for_baseline: In order to avoid a major rebellion , Father eventually gave in and lugged my piece of wood all the way to Berwickshire .

source_bert_toks: in order to avoid a major rebellion , father eventually gave in and lu ##gged my piece of wood all the way to berwick ##shire .

reference_raw: To avoid a major uprising, my father finally gave up and dragged my piece of wood all the way to Berwickshire.

reference_spacy_tokens: To avoid a major uprising , my father finally gave up and dragged my piece of wood all the way to Berwickshire .


fn_spacy_tokens_for_baseline: In every case they pictured a pastoral place where streams trickled through lush meadows , waterfalls fell into cool , sparkling pools or the sea gently bathed a sandy beach .

source_bert_toks: in every case they pictured a pastoral place where streams trickle ##d through lush meadows , waterfalls fell into cool , sparkling pools or the sea gently bathed a sandy beach .

reference_raw: In any case, they thought of a pastoral place where streams flowed through lush meadows, where waterfalls fell into cold, sparkling puddles, or where the sea gently bathed a sandy beach.

reference_spacy_tokens: In any case , they thought of a pastoral place where streams flowed through lush meadows , where waterfalls fell into cold , sparkling puddles , or where the sea gently bathed a sandy beach .


fn_spacy_tokens_for_baseline: So , once again , Anabelle was awakened in the middle of her sleep by the buzz of loud voices outside the nest .

source_bert_toks: so , once again , ana ##belle was awakened in the middle of her sleep by the buzz of loud voices outside the nest .

reference_raw: And so Anabelle woke again in her sleep with the buzz of loud voices outside the nest.

reference_spacy_tokens: And so Anabelle woke again in her sleep with the buzz of loud voices outside the nest .


fn_spacy_tokens_for_baseline: Bird goaded and inspired his own teammates , and they heeded him : If he told a teammate to do something , he did it .

source_bert_toks: bird goa ##ded and inspired his own teammates , and they hee ##ded him : if he told a teammate to do something , he did it .

reference_raw: Bird went on and inspired his own teammates, and they paid attention to him: when he asked his teammate to do something, he did it.

reference_spacy_tokens: Bird went on and inspired his own teammates , and they paid attention to him : when he asked his teammate to do something , he did it .


fn_spacy_tokens_for_baseline: ' I compose a few things during slack times on journeys , ' Googol admitted .

source_bert_toks: ' i compose a few things during slack times on journeys , ' goo ##gol admitted .

reference_raw: 'I put together a few things during the restless days of my travels,' Googol admitted.

reference_spacy_tokens: ' I put together a few things during the restless days of my travels , ' Googol admitted .


fn_spacy_tokens_for_baseline: The Frenchman , in bare feet and clutching his overalls , hurried southwards .

source_bert_toks: the frenchman , in bare feet and clutching his overall ##s , hurried southward ##s .

reference_raw: The Frenchman, bare-footed and clasped in his overalls, hurried south.

reference_spacy_tokens: The Frenchman , bare - footed and clasped in his overalls , hurried south .


fn_spacy_tokens_for_baseline: As if the verglas was n't enough , there 's a concrete snowfield below the wall .

source_bert_toks: as if the ve ##rg ##las wasn ' t enough , there ' s a concrete snow ##field below the wall .

reference_raw: As if the verglas weren't enough, there was a concrete field of snow under the wall.

reference_spacy_tokens: As if the verglas were n't enough , there was a concrete field of snow under the wall .


fn_spacy_tokens_for_baseline: Mrs B , just down the lane from the farm , described them as rather wild .

source_bert_toks: mrs b , just down the lane from the farm , described them as rather wild .

reference_raw: Mrs. B, just down the road from the farmhouse, described them as quite wild.

reference_spacy_tokens: Mrs. B , just down the road from the farmhouse , described them as quite wild .


fn_spacy_tokens_for_baseline: I had n't seen her since that night at the Club and I was beginning to despair of ever seeing her again .

source_bert_toks: i hadn ' t seen her since that night at the club and i was beginning to despair of ever seeing her again .

reference_raw: I hadn't seen her since that night at the club, and I was desperate to see her again.

reference_spacy_tokens: I had n't seen her since that night at the club , and I was desperate to see her again .


fn_spacy_tokens_for_baseline: It would be a bit tricky for the count to keep her shut away if they were staying with him .

source_bert_toks: it would be a bit tricky for the count to keep her shut away if they were staying with him .

reference_raw: If they stayed with him, it would be a little difficult for the count to keep her quiet.

reference_spacy_tokens: If they stayed with him , it would be a little difficult for the count to keep her quiet .


fn_spacy_tokens_for_baseline: Maxim had a sore forearm and stomach , a slight headache and a torn seam in his light jacket .

source_bert_toks: maxim had a sore forearm and stomach , a slight headache and a torn seam in his light jacket .

reference_raw: Maxim had a sore forearm and stomach, a slight headache, and a ragged seam in his light coat.

reference_spacy_tokens: Maxim had a sore forearm and stomach , a slight headache , and a ragged seam in his light coat .


fn_spacy_tokens_for_baseline: Reviews have been mixed , but smart critics who should have known better have dismissed Broomfield 's journalistic malevolence as fun , wacky , postmodern , an expose of the seamy underbelly of fame by a renegade who eschews the boring objectivity of the documentary tradition .

source_bert_toks: reviews have been mixed , but smart critics who should have known better have dismissed broom ##field ' s journalist ##ic male ##vo ##lence as fun , wa ##cky , post ##mo ##dern , an expose of the seam ##y under ##bell ##y of fame by a renegade who es ##che ##ws the boring object ##ivity of the documentary tradition .

reference_raw: The reviews were mixed, but the clever critics, who should have known better, dismissed Broomfield's journalistic malice as a fun, wacky, postmodern revelation of the seamy underbelly of glory by a renegade who casts out the boring objectivity of the documentary tradition.

reference_spacy_tokens: The reviews were mixed , but the clever critics , who should have known better , dismissed Broomfield 's journalistic malice as a fun , wacky , postmodern revelation of the seamy underbelly of glory by a renegade who casts out the boring objectivity of the documentary tradition .


fn_spacy_tokens_for_baseline: Both SCQZI and SRAI house extensive collections of virulent strains .

source_bert_toks: both sc ##q ##zi and sr ##ai house extensive collections of vi ##ru ##lent strains .

reference_raw: Both SCQZI and SRAI house large collections of virulent species.

reference_spacy_tokens: Both SCQZI and SRAI house large collections of virulent species .


fn_spacy_tokens_for_baseline: Secondly , the waterlogged soils remain cold in spring , and organic matter resulting from vigorous plant growth breaks down only slowly and peat has accumulated widely in the islands .

source_bert_toks: secondly , the water ##log ##ged soils remain cold in spring , and organic matter resulting from vigorous plant growth breaks down only slowly and peat has accumulated widely in the islands .

reference_raw: Second, the water-logged soils remain cold in the spring, and the organic matter resulting from the strong growth of the plants is only slowly broken down and the peat has accumulated extensively on the islands.

reference_spacy_tokens: Second , the water - logged soils remain cold in the spring , and the organic matter resulting from the strong growth of the plants is only slowly broken down and the peat has accumulated extensively on the islands .


fn_spacy_tokens_for_baseline: Both men were dubious about how long someone would be able to endure in the winter , equally they could think of no alternative .

source_bert_toks: both men were dubious about how long someone would be able to endure in the winter , equally they could think of no alternative .

reference_raw: The two men doubted how long someone could last in the winter, and they couldn't think of any other way.

reference_spacy_tokens: The two men doubted how long someone could last in the winter , and they could n't think of any other way .


fn_spacy_tokens_for_baseline: However , it is possible for war engines and large monsters to damage them .

source_bert_toks: however , it is possible for war engines and large monsters to damage them .

reference_raw: But war engines and big monsters can harm them.

reference_spacy_tokens: But war engines and big monsters can harm them .


fn_spacy_tokens_for_baseline: The flute , therefore , is not heard by the snake .

source_bert_toks: the flute , therefore , is not heard by the snake .

reference_raw: That's why the snake doesn't listen to the flute.

reference_spacy_tokens: That 's why the snake does n't listen to the flute .


fn_spacy_tokens_for_baseline: ' Most of it was sopped up by the double thickness of the collar at the back but it soaked down through .

source_bert_toks: ' most of it was so ##pped up by the double thickness of the collar at the back but it soaked down through .

reference_raw: Most of it was soaked with the double thickness of the collar at the back, but it soaked through.

reference_spacy_tokens: Most of it was soaked with the double thickness of the collar at the back , but it soaked through .


fn_spacy_tokens_for_baseline: Haunted by visions of death , each finds purpose , desire and a horrible end within sight of the treasure .

source_bert_toks: haunted by visions of death , each finds purpose , desire and a horrible end within sight of the treasure .

reference_raw: Haunted by visions of death, each finds a purpose, a desire, and a terrible end in view of the treasure.

reference_spacy_tokens: Haunted by visions of death , each finds a purpose , a desire , and a terrible end in view of the treasure .


fn_spacy_tokens_for_baseline: Already the information manager and the archivist are beginning to merge in a variety of business and government locations .

source_bert_toks: already the information manager and the arch ##ivist are beginning to merge in a variety of business and government locations .

reference_raw: The information manager and the archivist are already coming together in various business and government locations.

reference_spacy_tokens: The information manager and the archivist are already coming together in various business and government locations .


fn_spacy_tokens_for_baseline: The road behind the tall wall was still quiet , but the birds were making up for it , their incessant repeated sounds rising to sudden random crescendos as they all chirped fiercely together .

source_bert_toks: the road behind the tall wall was still quiet , but the birds were making up for it , their inc ##ess ##ant repeated sounds rising to sudden random cr ##es ##cend ##os as they all chi ##rp ##ed fiercely together .

reference_raw: The road beyond the high wall was still silent, but the birds made up for it, their continuous echoes rising to sudden random crescendos as they chirked wildly together.

reference_spacy_tokens: The road beyond the high wall was still silent , but the birds made up for it , their continuous echoes rising to sudden random crescendos as they chirked wildly together .


fn_spacy_tokens_for_baseline: It is the policies of successive governments to discipline the unemployed .

source_bert_toks: it is the policies of successive governments to discipline the unemployed .

reference_raw: Discriminating the unemployed is a policy of successive governments.

reference_spacy_tokens: Discriminating the unemployed is a policy of successive governments .


fn_spacy_tokens_for_baseline: A better understanding of the mechanisms that underlie natural immunity to pneumococcus could pave the way for the development of more effective , species - specific pneumococcal vaccines .

source_bert_toks: a better understanding of the mechanisms that under ##lie natural immunity to p ##ne ##um ##oco ##ccus could pa ##ve the way for the development of more effective , species - specific p ##ne ##um ##oco ##cca ##l vaccines .

reference_raw: A better understanding of the mechanisms underlying natural immunity to pneumococcus could pave the way for more efficient, species-specific pneumococcal vaccines to be developed.

reference_spacy_tokens: A better understanding of the mechanisms underlying natural immunity to pneumococcus could pave the way for more efficient , species - specific pneumococcal vaccines to be developed .


fn_spacy_tokens_for_baseline: When she married a Kent farm labourer her own relatives disowned her : ' it was n't a very happy thing , you see , that she married into this family .

source_bert_toks: when she married a kent farm labour ##er her own relatives di ##so ##wn ##ed her : ' it wasn ' t a very happy thing , you see , that she married into this family .

reference_raw: She was disowned by her own relatives when she took the Kent farm worker: 'You know, it wasn't a very happy thing about her marriage to this family.

reference_spacy_tokens: She was disowned by her own relatives when she took the Kent farm worker : ' You know , it was n't a very happy thing about her marriage to this family .


fn_spacy_tokens_for_baseline: Fourth , the theory indicates why the Republican Party may have a difficult time attracting viable candidates for congressional office .

source_bert_toks: fourth , the theory indicates why the republican party may have a difficult time attracting viable candidates for congressional office .

reference_raw: Fourth, the theory suggests why it might be difficult for the Republican Party to attract viable candidates to the Congressional Office.

reference_spacy_tokens: Fourth , the theory suggests why it might be difficult for the Republican Party to attract viable candidates to the Congressional Office .


fn_spacy_tokens_for_baseline: ' I do n't mind lobbyists , I 'd just rather they called themselves by their proper name as they do in Washington , rather than wittering on for hours about relationships with opinion - formers .

source_bert_toks: ' i don ' t mind lobby ##ists , i ' d just rather they called themselves by their proper name as they do in washington , rather than wit ##tering on for hours about relationships with opinion - former ##s .

reference_raw: "I don't mind the lobbyists, but I'd rather they named themselves by their proper name, as they do in Washington, than talk about their relationship with opinion-formers for hours.

reference_spacy_tokens: " I do n't mind the lobbyists , but I 'd rather they named themselves by their proper name , as they do in Washington , than talk about their relationship with opinion - formers for hours .


fn_spacy_tokens_for_baseline: Conner is still furious about losing Tuesday 's protest .

source_bert_toks: conner is still furious about losing tuesday ' s protest .

reference_raw: Conner's still angry about the loss of Tuesday's protest.

reference_spacy_tokens: Conner 's still angry about the loss of Tuesday 's protest .


fn_spacy_tokens_for_baseline: When they moved into the open countryside he saw fields and hedges , the broad gleam of a river .

source_bert_toks: when they moved into the open countryside he saw fields and hedges , the broad gleam of a river .

reference_raw: As they moved into the open countryside, he could see the fields and hedges, the wide glow of the river.

reference_spacy_tokens: As they moved into the open countryside , he could see the fields and hedges , the wide glow of the river .


fn_spacy_tokens_for_baseline: Equally worrying is the fact that deaf people are effectively disenfranchised because they can neither get access to nor take part in the political debate .

source_bert_toks: equally worrying is the fact that deaf people are effectively di ##sen ##fra ##nch ##ised because they can neither get access to nor take part in the political debate .

reference_raw: Equally alarming is the fact that deaf people are effectively disenfranchised because they cannot access or participate in a political debate.

reference_spacy_tokens: Equally alarming is the fact that deaf people are effectively disenfranchised because they can not access or participate in a political debate .


fn_spacy_tokens_for_baseline: Vertical pitches descend 250 feet to an immense cavern , second in dimensions only to the chamber in Gaping Gill .

source_bert_toks: vertical pitches descend 250 feet to an immense cavern , second in dimensions only to the chamber in gaping gill .

reference_raw: The vertical pitches fall 250 feet into a huge cave, the second in dimensions only to the chamber of the Gaping Gill.

reference_spacy_tokens: The vertical pitches fall 250 feet into a huge cave , the second in dimensions only to the chamber of the Gaping Gill .


fn_spacy_tokens_for_baseline: In other words , we want to close down any possibility , however permitted under the international guidelines , that Iran will gain knowledge in its pursuit of nuclear weapons .

source_bert_toks: in other words , we want to close down any possibility , however permitted under the international guidelines , that iran will gain knowledge in its pursuit of nuclear weapons .

reference_raw: In other words, we want to put an end to any possibility, however permitted by international guidelines, that Iran will gain experience in the pursuit of nuclear weapons.

reference_spacy_tokens: In other words , we want to put an end to any possibility , however permitted by international guidelines , that Iran will gain experience in the pursuit of nuclear weapons .


fn_spacy_tokens_for_baseline: For special occasions , Judith showed her how to define her eyes by applying a taupe eyeshadow to her eyelids and a dark brown shade to the outside edges and along top and lower lashes .

source_bert_toks: for special occasions , judith showed her how to define her eyes by applying a tau ##pe eyes ##had ##ow to her eyelids and a dark brown shade to the outside edges and along top and lower lashes .

reference_raw: On special occasions, Judith showed her how to define her eyes by applying a taupe eye shadow to her eyelids and a dark brown shadow to the outer edges and to the upper and lower lashes.

reference_spacy_tokens: On special occasions , Judith showed her how to define her eyes by applying a taupe eye shadow to her eyelids and a dark brown shadow to the outer edges and to the upper and lower lashes .


fn_spacy_tokens_for_baseline: The vehicles were then sold for cash with which Scott disappeared .

source_bert_toks: the vehicles were then sold for cash with which scott disappeared .

reference_raw: The cars were then traded for the cash that Scott disappeared with.

reference_spacy_tokens: The cars were then traded for the cash that Scott disappeared with .


fn_spacy_tokens_for_baseline: There was a queer pity in his voice .

source_bert_toks: there was a queer pity in his voice .

reference_raw: There was a strange regret in his voice.

reference_spacy_tokens: There was a strange regret in his voice .


fn_spacy_tokens_for_baseline: Turn back the flaps , allow the moisture time to dry , then brush a mastic compound on to the roof boards and press down the flaps firmly .

source_bert_toks: turn back the flaps , allow the moisture time to dry , then brush a mast ##ic compound on to the roof boards and press down the flaps firmly .

reference_raw: Turn the flaps back, allow the moisture time to dry, then brush the mastic compound onto the roofboards and push the flaps tight.

reference_spacy_tokens: Turn the flaps back , allow the moisture time to dry , then brush the mastic compound onto the roofboards and push the flaps tight .


fn_spacy_tokens_for_baseline: With the honourable exception of L'Equipe , who condemned the incident in no uncertain terms on its front page , the French press had an ambiguous , if not sympathetic , reaction .

source_bert_toks: with the honourable exception of l ' e ##qui ##pe , who condemned the incident in no uncertain terms on its front page , the french press had an ambiguous , if not sympathetic , reaction .

reference_raw: The French press, with the honorable exception of L'Equipe, who denounced the incident without doubt on the front page, had an ambiguous, if not sympathetic, response.

reference_spacy_tokens: The French press , with the honorable exception of L'Equipe , who denounced the incident without doubt on the front page , had an ambiguous , if not sympathetic , response .


fn_spacy_tokens_for_baseline: I was very rude and tactless with your grandmother .

source_bert_toks: i was very rude and ta ##ct ##less with your grandmother .

reference_raw: I've been very unkind and insensitive to your grandmother.

reference_spacy_tokens: I 've been very unkind and insensitive to your grandmother .


fn_spacy_tokens_for_baseline: Outside his window the moon had risen over the fells and it was reflected exactly in the round lake .

source_bert_toks: outside his window the moon had risen over the fell ##s and it was reflected exactly in the round lake .

reference_raw: Outside his window, the moon lifted above the falls, reflected exactly in the round lake.

reference_spacy_tokens: Outside his window , the moon lifted above the falls , reflected exactly in the round lake .


fn_spacy_tokens_for_baseline: I applied for parole , and usually you get your answer a couple of weeks before the date you could be going out .

source_bert_toks: i applied for parole , and usually you get your answer a couple of weeks before the date you could be going out .

reference_raw: I applied for parole, and you usually get a response a few weeks before you can date.

reference_spacy_tokens: I applied for parole , and you usually get a response a few weeks before you can date .


fn_spacy_tokens_for_baseline: The rest of the year , life goes on at its accustomed pace : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and the old fishermen stirring shrimp paste .

source_bert_toks: the rest of the year , life goes on at its accustomed pace : rick ##ety machines chu ##gging in two - man factories , children in school uniforms being fe ##rrie ##d home to house ##boats , and the old fishermen stirring shrimp paste .

reference_raw: For the rest of the year, life goes on at the usual pace: rickety machines chugging in two-man factories, children in school uniforms being ferried home to houseboats, and old fishermen mixing prawn paste.

reference_spacy_tokens: For the rest of the year , life goes on at the usual pace : rickety machines chugging in two - man factories , children in school uniforms being ferried home to houseboats , and old fishermen mixing prawn paste .


fn_spacy_tokens_for_baseline: Other conundra m - y appear rather less cosmically ' relevant ; they may seem to be of little importance yet , like Mercury 's orbit , may prove in the long term to be extremely important .

source_bert_toks: other con ##und ##ra m - y appear rather less cosmic ##ally ' relevant ; they may seem to be of little importance yet , like mercury ' s orbit , may prove in the long term to be extremely important .

reference_raw: Other conundra m-y appear to be rather less cosmically important; they may seem to be of little importance, but in the long run, like Mercury's orb, they may prove to be extremely important.

reference_spacy_tokens: Other conundra m - y appear to be rather less cosmically important ; they may seem to be of little importance , but in the long run , like Mercury 's orb , they may prove to be extremely important .


fn_spacy_tokens_for_baseline: The transplant process takes six weeks overall during which Rhys will be under the care of the specialist bone marrow team , led by Dr Tony Oakhill .

source_bert_toks: the transplant process takes six weeks overall during which rhys will be under the care of the specialist bone marrow team , led by dr tony oak ##hill .

reference_raw: The transplant process lasts for a total of six weeks, during which Rhys will be under the care of a specialist bone marrow team, led by Doctor Tony Oakhill.

reference_spacy_tokens: The transplant process lasts for a total of six weeks , during which Rhys will be under the care of a specialist bone marrow team , led by Doctor Tony Oakhill .


fn_spacy_tokens_for_baseline: Prisons are terrible places .

source_bert_toks: prisons are terrible places .

reference_raw: Prisons are horrible places.

reference_spacy_tokens: Prisons are horrible places .


fn_spacy_tokens_for_baseline: When ready to serve , reheat the soup to boiling point and pour into a heated tureen .

source_bert_toks: when ready to serve , re ##hea ##t the soup to boiling point and pour into a heated tu ##reen .

reference_raw: When ready to serve, heat the soup to boiling point and pour it into a heated tower.

reference_spacy_tokens: When ready to serve , heat the soup to boiling point and pour it into a heated tower .


fn_spacy_tokens_for_baseline: ifkA null cells aggregated earlier than normal due to a more rapid establishment of the cAMP pulsing system .

source_bert_toks: if ##ka null cells aggregate ##d earlier than normal due to a more rapid establishment of the camp pulsing system .

reference_raw: ifkA null cells aggregated earlier than normal due to the faster establishment of the CAMP pulsing system.

reference_spacy_tokens: ifkA null cells aggregated earlier than normal due to the faster establishment of the CAMP pulsing system .


fn_spacy_tokens_for_baseline: They even expressed affection obscenely , as if to purge their relationships of any possible betraying taint .

source_bert_toks: they even expressed affection obscene ##ly , as if to purge their relationships of any possible betray ##ing tai ##nt .

reference_raw: They even expressed their love obscenely, as if to cleanse their relationship of any possible betrayal.

reference_spacy_tokens: They even expressed their love obscenely , as if to cleanse their relationship of any possible betrayal .


fn_spacy_tokens_for_baseline: Most are plucked and pickled for sale as the ' ambelpoulia ' delicacy .

source_bert_toks: most are plucked and pick ##led for sale as the ' am ##bel ##po ##ulia ' del ##ica ##cy .

reference_raw: Most of them are plucked and cucumbered for sale as 'ambelpoulia's delicacy.

reference_spacy_tokens: Most of them are plucked and cucumbered for sale as ' ambelpoulia 's delicacy .


fn_spacy_tokens_for_baseline: I 'd never seen her without a single string of pearls , which she fingered constantly .

source_bert_toks: i ' d never seen her without a single string of pearls , which she fingered constantly .

reference_raw: I've never seen her without a string of pearls that she's been touching all the time.

reference_spacy_tokens: I 've never seen her without a string of pearls that she 's been touching all the time .


fn_spacy_tokens_for_baseline: A more educated , literate , and rational society weakens their effect ; contraceptive knowledge and practice spreads first in the more educated classes , then to poorer people .

source_bert_toks: a more educated , liter ##ate , and rational society weaken ##s their effect ; contra ##ceptive knowledge and practice spreads first in the more educated classes , then to poorer people .

reference_raw: A more educated, literate, and rational society undermines their effect; contraceptive knowledge and practice spread first to the more educated and then to the poor.

reference_spacy_tokens: A more educated , literate , and rational society undermines their effect ; contraceptive knowledge and practice spread first to the more educated and then to the poor .


fn_spacy_tokens_for_baseline: While others dashed about and fussed and worried , he achieved enviable results with the minimum of effort .

source_bert_toks: while others dashed about and fuss ##ed and worried , he achieved en ##via ##ble results with the minimum of effort .

reference_raw: While others were rushing around, fussing and worrying, he had achieved enviable results with minimal effort.

reference_spacy_tokens: While others were rushing around , fussing and worrying , he had achieved enviable results with minimal effort .


fn_spacy_tokens_for_baseline: Israel 's plan was actually that of an American businessman now under arrest in the United States charged with trading with Iran .

source_bert_toks: israel ' s plan was actually that of an american businessman now under arrest in the united states charged with trading with iran .

reference_raw: In fact, Israel's plan was that of an American businessman who is now in custody in the United States accused of trading with Iran.

reference_spacy_tokens: In fact , Israel 's plan was that of an American businessman who is now in custody in the United States accused of trading with Iran .


fn_spacy_tokens_for_baseline: I got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

source_bert_toks: i got up and dressed in a sweater and pants , made my bed , then sat on the end and shook physically with anxiety .

reference_raw: I got up, put on a sweater and trousers, made a bed, and sat on the end of it, shaking physically with anxiety.

reference_spacy_tokens: I got up , put on a sweater and trousers , made a bed , and sat on the end of it , shaking physically with anxiety .


fn_spacy_tokens_for_baseline: Which is why it always surprises me when people turn out to be such bad listeners .

source_bert_toks: which is why it always surprises me when people turn out to be such bad listeners .

reference_raw: That's why I always wonder when people turn out to be such a bad listener.

reference_spacy_tokens: That 's why I always wonder when people turn out to be such a bad listener .


fn_spacy_tokens_for_baseline: We had to climb what seemed a never - ending staircase to a high platform where we took our seats in a punt at the top of a slide having water rushing down it .

source_bert_toks: we had to climb what seemed a never - ending staircase to a high platform where we took our seats in a punt at the top of a slide having water rushing down it .

reference_raw: We had to climb what seemed to be an endless staircase to a high platform, where we sat down in a hole at the top of a slide with water running down it.

reference_spacy_tokens: We had to climb what seemed to be an endless staircase to a high platform , where we sat down in a hole at the top of a slide with water running down it .


fn_spacy_tokens_for_baseline: She hopped off the chair .

source_bert_toks: she hopped off the chair .

reference_raw: She jumped out of her chair.

reference_spacy_tokens: She jumped out of her chair .


fn_spacy_tokens_for_baseline: People came and went , said they were coming for a couple of days and stayed a week .

source_bert_toks: people came and went , said they were coming for a couple of days and stayed a week .

reference_raw: People came and went, said they'd be here for a few days, and they'd be here for a week.

reference_spacy_tokens: People came and went , said they 'd be here for a few days , and they 'd be here for a week .


fn_spacy_tokens_for_baseline: " Four Aberdeen Proving Ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the Army base in Harford County .

source_bert_toks: " four aberdeen proving ground employees were taken to a local hospital yesterday after a report of a chemical leak , the third incident in about a week during which workers were at risk of exposure to lethal substances at the army base in ha ##rford county .

reference_raw: "Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported, the third incident in about a week, during which employees were exposed to lethal substances at Harford County Army base.

reference_spacy_tokens: " Four Aberdeen Proving Ground personnel were taken to a local hospital yesterday after a chemical leak was reported , the third incident in about a week , during which employees were exposed to lethal substances at Harford County Army base .


fn_spacy_tokens_for_baseline: This is not to decry the useful , and often innovative , work done by such institutions .

source_bert_toks: this is not to dec ##ry the useful , and often innovative , work done by such institutions .

reference_raw: This does not mean that the work done by these institutions is useful and often innovative.

reference_spacy_tokens: This does not mean that the work done by these institutions is useful and often innovative .


fn_spacy_tokens_for_baseline: Accordingly , when Kepler first heard of Galileo 's telescopic observations , he was alarmed lest the satellites reported should be planets orbiting another sun .

source_bert_toks: accordingly , when kepler first heard of galileo ' s tel ##es ##copic observations , he was alarmed lest the satellites reported should be planets orbiting another sun .

reference_raw: As a result, when Kepler first heard about Galileo's telescopic sightings, he was alarmed that the satellites reported should not be planets orbiting another sun.

reference_spacy_tokens: As a result , when Kepler first heard about Galileo 's telescopic sightings , he was alarmed that the satellites reported should not be planets orbiting another sun .