fn_spacy_tokens_for_baseline: ' Well , ' she smiled , after the preliminary introduction , ' do I pass whatever test you have ? '

source_bert_toks: ' well , ' she smiled , after the preliminary introduction , ' do i pass whatever test you have ? '

reference_raw: "Well," she said, smiling at the initial introduction, "am I going to pass any test you've got?"

reference_spacy_tokens: " Well , " she said , smiling at the initial introduction , " am I going to pass any test you 've got ? "


fn_spacy_tokens_for_baseline: The door opened and a young priest came into the room , a wiry man of middle height .

source_bert_toks: the door opened and a young priest came into the room , a wi ##ry man of middle height .

reference_raw: The door opened and a young priest, a wry man of middle height, entered the room.

reference_spacy_tokens: The door opened and a young priest , a wry man of middle height , entered the room .


fn_spacy_tokens_for_baseline: They liked people like Henry .

source_bert_toks: they liked people like henry .

reference_raw: They were fond of people such as Henry.

reference_spacy_tokens: They were fond of people such as Henry .


fn_spacy_tokens_for_baseline: ' I shall need to think about it , of course , ' replied the honourable lady , ' Things are too far advanced -- the jubilee celebration .

source_bert_toks: ' i shall need to think about it , of course , ' replied the honourable lady , ' things are too far advanced - - the jubilee celebration .

reference_raw: 'Of course, I'll have to think about it,' said the honorable lady, 'Things are too advanced - a jubilee celebration.

reference_spacy_tokens: ' Of course , I 'll have to think about it , ' said the honorable lady , ' Things are too advanced - a jubilee celebration .


fn_spacy_tokens_for_baseline: When Herbert of Maine renounced his homage to Geoffrey of Anjou and recognized William the Conqueror as his lord , he received back everything from William ' just as a knight received it from his lord ' .

source_bert_toks: when herbert of maine reno ##unced his homage to geoffrey of an ##jou and recognized william the conqueror as his lord , he received back everything from william ' just as a knight received it from his lord ' .

reference_raw: When Herbert of Maine gave up his tribute to Geoffrey of Anjou and recognized William the Conqueror as his master, he received everything from William 'just as the knight had received it from his master'.

reference_spacy_tokens: When Herbert of Maine gave up his tribute to Geoffrey of Anjou and recognized William the Conqueror as his master , he received everything from William ' just as the knight had received it from his master ' .


fn_spacy_tokens_for_baseline: And while she sounded sympathetic , she was in reality infuriated with Doreen .

source_bert_toks: and while she sounded sympathetic , she was in reality in ##fur ##iated with do ##reen .

reference_raw: And as sympathetic as she was, she was, in fact, mad at Doreen.

reference_spacy_tokens: And as sympathetic as she was , she was , in fact , mad at Doreen .


fn_spacy_tokens_for_baseline: Little snippets of their talk registered in her brain as she strolled past , looking vague and preoccupied .

source_bert_toks: little s ##ni ##ppet ##s of their talk registered in her brain as she strolled past , looking vague and preoccupied .

reference_raw: The little bits of their conversation registered in her mind as she passed, looking vague and busy.

reference_spacy_tokens: The little bits of their conversation registered in her mind as she passed , looking vague and busy .


fn_spacy_tokens_for_baseline: No doubt they excelled at things in which indolent societies specialize ; no doubt their basketwork became rococo , their erotic skills more gymnastical , their use of crushed leaves to induce stupefying trances increasingly efficient .

source_bert_toks: no doubt they excelled at things in which indo ##lent societies special ##ize ; no doubt their basket ##work became roc ##oco , their erotic skills more gymnast ##ical , their use of crushed leaves to induce stu ##pe ##fying trance ##s increasingly efficient .

reference_raw: There was no doubt that they excelled at the things in which indolent societies specialized; no doubt their baskets became rococo, their erotic skills became more gymnastic, and their use of crushed leaves to induce stupendous trances became more effective.

reference_spacy_tokens: There was no doubt that they excelled at the things in which indolent societies specialized ; no doubt their baskets became rococo , their erotic skills became more gymnastic , and their use of crushed leaves to induce stupendous trances became more effective .


fn_spacy_tokens_for_baseline: She wondered as she climbed into the car whether to mention that it would have been considerate to have the door already open , but she knew what Bri would say -- ' You 're always whingeing on . '

source_bert_toks: she wondered as she climbed into the car whether to mention that it would have been consider ##ate to have the door already open , but she knew what br ##i would say - - ' you ' re always w ##hing ##ein ##g on . '

reference_raw: As she got into the car, she wondered if it would be wise to have the door open, but she knew what Bri was going to say - 'You're still whining.'

reference_spacy_tokens: As she got into the car , she wondered if it would be wise to have the door open , but she knew what Bri was going to say - ' You 're still whining . '


fn_spacy_tokens_for_baseline: Other hot and bone - weary seamen were about to enter , groups from various ships docked at the port .

source_bert_toks: other hot and bone - weary seamen were about to enter , groups from various ships docked at the port .

reference_raw: More hot and bone-weared sailors were about to enter, groups of different ships docked in the harbor.

reference_spacy_tokens: More hot and bone - weared sailors were about to enter , groups of different ships docked in the harbor .


fn_spacy_tokens_for_baseline: Iran 's plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

source_bert_toks: iran ' s plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

reference_raw: The intentions of Iran to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons.

reference_spacy_tokens: The intentions of Iran to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons .


fn_spacy_tokens_for_baseline: Personnel associated with Coast have characterized it as the most sophisticated program of its type outside of the former Soviet Union , but international CBW experts generally consider it to have been considerably less advanced from a scientific standpoint .

source_bert_toks: personnel associated with coast have characterized it as the most sophisticated program of its type outside of the former soviet union , but international cb ##w experts generally consider it to have been considerably less advanced from a scientific stand ##point .

reference_raw: Coast-related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union, but international CBW experts generally consider it to be significantly less advanced from a scientific point of view.

reference_spacy_tokens: Coast - related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union , but international CBW experts generally consider it to be significantly less advanced from a scientific point of view .


fn_spacy_tokens_for_baseline: Czarina Alexandra , convinced that Rasputin was an emissary from God , brought him into the royal family 's inner circle and prompted widespread , published speculation that the two were lovers .

source_bert_toks: c ##zar ##ina alexandra , convinced that ras ##put ##in was an emi ##ssar ##y from god , brought him into the royal family ' s inner circle and prompted widespread , published speculation that the two were lovers .

reference_raw: Convinced that Rasputin was an envoy of God, Czarina Alexandra brought him into the inner circle of the royal family and prompted widespread speculation that they were lovers.

reference_spacy_tokens: Convinced that Rasputin was an envoy of God , Czarina Alexandra brought him into the inner circle of the royal family and prompted widespread speculation that they were lovers .


fn_spacy_tokens_for_baseline: For an exotic change , and one comparatively low in calories , try a spicy shellfish soup or one of the seafood noodle dishes .

source_bert_toks: for an exotic change , and one comparatively low in cal ##ories , try a spicy shell ##fish soup or one of the seafood no ##odle dishes .

reference_raw: For an exotic change and a relatively small calorie, try some spicy mollusk soup or some seafood noodle dish.

reference_spacy_tokens: For an exotic change and a relatively small calorie , try some spicy mollusk soup or some seafood noodle dish .


fn_spacy_tokens_for_baseline: And nine unnamed UDR soldiers have been given honours ranging from a CBE to Mentions - in - Despatches in awards for gallant or meritorious service .

source_bert_toks: and nine unnamed ud ##r soldiers have been given honours ranging from a cbe to mentions - in - des ##pa ##tch ##es in awards for gallant or meritorious service .

reference_raw: And nine unnamed UDR soldiers received honors from the CBE to the Mentions-in-Despatch awards for gallant and meritful service.

reference_spacy_tokens: And nine unnamed UDR soldiers received honors from the CBE to the Mentions - in - Despatch awards for gallant and meritful service .


fn_spacy_tokens_for_baseline: The light of the risen sun was glittering now on the tall glazed windows of the central part and glowing like honey on the yellow walls .

source_bert_toks: the light of the risen sun was glittering now on the tall glazed windows of the central part and glowing like honey on the yellow walls .

reference_raw: The light of the rising sun gleamed now on the high glass windows of the central section, gleaming like honey on the yellow walls.

reference_spacy_tokens: The light of the rising sun gleamed now on the high glass windows of the central section , gleaming like honey on the yellow walls .


fn_spacy_tokens_for_baseline: The two stallions who could not even do the test had previously shown themselves to be intelligent by their rapid ability to learn when they were broken in .

source_bert_toks: the two stallion ##s who could not even do the test had previously shown themselves to be intelligent by their rapid ability to learn when they were broken in .

reference_raw: The two stallions, who couldn't even do the test, had already shown that they were smart because they were quick enough to learn when they broke in.

reference_spacy_tokens: The two stallions , who could n't even do the test , had already shown that they were smart because they were quick enough to learn when they broke in .


fn_spacy_tokens_for_baseline: Romania 's entry into the war against Austria at the end of August served only to lengthen Russia 's frontier , laying her open to further attack when Romania collapsed in December 1916 .

source_bert_toks: romania ' s entry into the war against austria at the end of august served only to length ##en russia ' s frontier , laying her open to further attack when romania collapsed in december 1916 .

reference_raw: The accession of Romania to the war against Austria at the end of August served only to prolong the Russian border and to open it up for further attacks when Romania collapsed in December 1916.

reference_spacy_tokens: The accession of Romania to the war against Austria at the end of August served only to prolong the Russian border and to open it up for further attacks when Romania collapsed in December 1916 .


fn_spacy_tokens_for_baseline: By common consent they sat down on the wet seat of ' Traveller 's Rest ' , huddled under the umbrella , and stared out across the city .

source_bert_toks: by common consent they sat down on the wet seat of ' traveller ' s rest ' , huddled under the umbrella , and stared out across the city .

reference_raw: They sat together in the wet seat of "Traveller's Rest" by mutual agreement, crouched under the umbrella, and looked out over the city.

reference_spacy_tokens: They sat together in the wet seat of " Traveller 's Rest " by mutual agreement , crouched under the umbrella , and looked out over the city .


fn_spacy_tokens_for_baseline: Now she was in what seemed like a natural theatre , a deep , round hollow in the ground .

source_bert_toks: now she was in what seemed like a natural theatre , a deep , round hollow in the ground .

reference_raw: Now she was in what looked like a natural theater, a deep, round hole in the ground.

reference_spacy_tokens: Now she was in what looked like a natural theater , a deep , round hole in the ground .


fn_spacy_tokens_for_baseline: I have felt many aftershocks .

source_bert_toks: i have felt many after ##sho ##cks .

reference_raw: I've had a lot of aftershocks.

reference_spacy_tokens: I 've had a lot of aftershocks .


fn_spacy_tokens_for_baseline: In 1770 , Russia came to aid the Greeks ( defined by their Orthodox religion rather than by historical geographical boundaries ) , declaring war on the Ottoman Empire and occupying several Aegean islands until 1774 .

source_bert_toks: in 1770 , russia came to aid the greeks ( defined by their orthodox religion rather than by historical geographical boundaries ) , declaring war on the ottoman empire and occupying several aegean islands until 1774 .

reference_raw: In 1770, Russia came to help Greece (defined by its Orthodox religion rather than by its historical geographical boundaries), declared war on the Ottoman Empire and occupied several Aegean islands until 1774.

reference_spacy_tokens: In 1770 , Russia came to help Greece ( defined by its Orthodox religion rather than by its historical geographical boundaries ) , declared war on the Ottoman Empire and occupied several Aegean islands until 1774 .


fn_spacy_tokens_for_baseline: The reporter did not disclose specific details of their chat , but the disclosure prompted concern that it might have been more confidential matters which could have been overheard .

source_bert_toks: the reporter did not disclose specific details of their chat , but the disclosure prompted concern that it might have been more confidential matters which could have been overheard .

reference_raw: The reporter did not disclose the specific details of their conversation, but the disclosure gave rise to concern that it might be a more confidential matter to be heard.

reference_spacy_tokens: The reporter did not disclose the specific details of their conversation , but the disclosure gave rise to concern that it might be a more confidential matter to be heard .


fn_spacy_tokens_for_baseline: Sooty turned to Yanto , who was already grinning with anticipation .

source_bert_toks: soo ##ty turned to yan ##to , who was already grinning with anticipation .

reference_raw: Sooty turned to Yant, who was already smiling expectantly.

reference_spacy_tokens: Sooty turned to Yant , who was already smiling expectantly .


fn_spacy_tokens_for_baseline: Bodie 's car screeched through the London streets .

source_bert_toks: bo ##die ' s car sc ##ree ##ched through the london streets .

reference_raw: Bodie's car screamed through the streets of London.

reference_spacy_tokens: Bodie 's car screamed through the streets of London .


fn_spacy_tokens_for_baseline: Rising from the table , he took up his book , and departed into the crowd .

source_bert_toks: rising from the table , he took up his book , and departed into the crowd .

reference_raw: He got up from the table, picked up his book, and walked out into the crowd.

reference_spacy_tokens: He got up from the table , picked up his book , and walked out into the crowd .


fn_spacy_tokens_for_baseline: He found Carrie seated by the bedside , but was distressed to find that Anna would not talk to him .

source_bert_toks: he found carrie seated by the bedside , but was distressed to find that anna would not talk to him .

reference_raw: He found Carrie sitting next to the bed, but he was anxious to see that Anna wasn't going to talk to him.

reference_spacy_tokens: He found Carrie sitting next to the bed , but he was anxious to see that Anna was n't going to talk to him .


fn_spacy_tokens_for_baseline: Her parents say no - one warned them that the drug , Pre , could affect the immune system , making Lexie more susceptible to infection .

source_bert_toks: her parents say no - one warned them that the drug , pre , could affect the immune system , making lexie more susceptible to infection .

reference_raw: Her parents said they weren't warned that the drug, Pre, could affect the immune system, making Lexie more prone to infection.

reference_spacy_tokens: Her parents said they were n't warned that the drug , Pre , could affect the immune system , making Lexie more prone to infection .


fn_spacy_tokens_for_baseline: The government - owned daily Al - Gomhuriya said the two men were probably killed in a gunfight between police and the militants .

source_bert_toks: the government - owned daily al - go ##m ##hur ##iya said the two men were probably killed in a gun ##fight between police and the militants .

reference_raw: A government-owned day-to-day Al-Gomhuriya said that both men were probably killed in a police-militant shooting.

reference_spacy_tokens: A government - owned day - to - day Al - Gomhuriya said that both men were probably killed in a police - militant shooting .


fn_spacy_tokens_for_baseline: These sales do not necessarily indicate the presence of an offensive CW capability but are worth noting due to their potential diversion to an illicit Iranian CW program .

source_bert_toks: these sales do not necessarily indicate the presence of an offensive cw capability but are worth noting due to their potential diversion to an illicit iranian cw program .

reference_raw: These sales are not necessarily indicative of the existence of an attackable CW capability, but it is important to note that they may be diverted to an illegal Iranian CW programme.

reference_spacy_tokens: These sales are not necessarily indicative of the existence of an attackable CW capability , but it is important to note that they may be diverted to an illegal Iranian CW programme .


fn_spacy_tokens_for_baseline: To begin with she heard nothing to justify her fright , and got as far as the staircase between floors before the lift began to hum .

source_bert_toks: to begin with she heard nothing to justify her fright , and got as far as the staircase between floors before the lift began to hum .

reference_raw: For starters, she heard nothing to justify her fear, and reached the stairwell between the floors before the elevator began to buzz.

reference_spacy_tokens: For starters , she heard nothing to justify her fear , and reached the stairwell between the floors before the elevator began to buzz .


fn_spacy_tokens_for_baseline: These patrols are formed as follows : 1- Single patrols which consist of two people checking the outside area of the location 2- Common patrols which consist of one man and a dog , also checking the outside area of the location .

source_bert_toks: these patrols are formed as follows : 1 - single patrols which consist of two people checking the outside area of the location 2 - common patrols which consist of one man and a dog , also checking the outside area of the location .

reference_raw: These patrols are formed as follows: 1-Single patrols consisting of two people who control the outer area of the place 2-Common patrols consisting of one man and one dog, which also control the outer area of the place.

reference_spacy_tokens: These patrols are formed as follows : 1-Single patrols consisting of two people who control the outer area of the place 2-Common patrols consisting of one man and one dog , which also control the outer area of the place .


fn_spacy_tokens_for_baseline: Which is why the majority of golf pros insist on GORE - TEX fabric .

source_bert_toks: which is why the majority of golf pro ##s insist on gore - tex fabric .

reference_raw: That's why most golf professionals insist on the fabric of GORE-TEX.

reference_spacy_tokens: That 's why most golf professionals insist on the fabric of GORE - TEX .


fn_spacy_tokens_for_baseline: On the floor there were three whodunit paperbacks and a copy of The Village Voice with face - powder spilled on it .

source_bert_toks: on the floor there were three who ##dun ##it paperback ##s and a copy of the village voice with face - powder spilled on it .

reference_raw: There were three backs of Whodunit paper on the floor, and a copy of the Village Voice, with a face-powder on it.

reference_spacy_tokens: There were three backs of Whodunit paper on the floor , and a copy of the Village Voice , with a face - powder on it .


fn_spacy_tokens_for_baseline: And to think she had always poured scorn on her older sisters when they had put on such fluttering airs in front of a man .

source_bert_toks: and to think she had always poured sc ##orn on her older sisters when they had put on such fluttering airs in front of a man .

reference_raw: And to think that she always poured contempt on her older sisters when they put on such fluttering air in front of a man.

reference_spacy_tokens: And to think that she always poured contempt on her older sisters when they put on such fluttering air in front of a man .


fn_spacy_tokens_for_baseline: This realization led to several white calico garments ; fulsome petticoats , frilled blouses and fancy nightdresses being the most obvious , all of them generous with material .

source_bert_toks: this realization led to several white cal ##ico garments ; fu ##ls ##ome pet ##tic ##oat ##s , fr ##ille ##d blouse ##s and fancy night ##dre ##sse ##s being the most obvious , all of them generous with material .

reference_raw: This knowledge led to a number of white calico suits; the most obvious were many petticoats, frilled blouses, and fancy nightgowns, all of which were generous with material.

reference_spacy_tokens: This knowledge led to a number of white calico suits ; the most obvious were many petticoats , frilled blouses , and fancy nightgowns , all of which were generous with material .


fn_spacy_tokens_for_baseline: Fabrics produced from this fibre are fine , strong and hard - wearing can be washed frequently without the shape and size altering , and can be drip dried .

source_bert_toks: fabrics produced from this fibre are fine , strong and hard - wearing can be washed frequently without the shape and size altering , and can be drip dried .

reference_raw: Fabrics obtained from this fibre are fine, thick and hard-weared can be washed often without changing shape and size, and may be dried.

reference_spacy_tokens: Fabrics obtained from this fibre are fine , thick and hard - weared can be washed often without changing shape and size , and may be dried .


fn_spacy_tokens_for_baseline: Thorough cooking of these foods is very difficult or impossible unless they are thawed before cooking begins .

source_bert_toks: thorough cooking of these foods is very difficult or impossible unless they are tha ##wed before cooking begins .

reference_raw: The cooking of such foods is very difficult or impossible if they are not melted before the cooking begins.

reference_spacy_tokens: The cooking of such foods is very difficult or impossible if they are not melted before the cooking begins .


fn_spacy_tokens_for_baseline: She had , as yet , no child to console her , and she had cabled her sister Dorothy to come from Wales to spend the winter with her .

source_bert_toks: she had , as yet , no child to console her , and she had cable ##d her sister dorothy to come from wales to spend the winter with her .

reference_raw: She didn't have a baby to comfort her yet, so she called her sister Dorothy to come out of Wales and spend the winter with her.

reference_spacy_tokens: She did n't have a baby to comfort her yet , so she called her sister Dorothy to come out of Wales and spend the winter with her .


fn_spacy_tokens_for_baseline: [ 10 ] showed that in the two - group microarray study setting the t -statistic assumption of equal variances between the two groups could result in poor performance .

source_bert_toks: [ 10 ] showed that in the two - group micro ##ar ##ray study setting the t - stat ##istic assumption of equal variance ##s between the two groups could result in poor performance .

reference_raw: [10] has shown that in a two-group micro-ray study setting a t-statistic assumption of the same variability between the two groups could lead to a lack of performance.

reference_spacy_tokens: [ 10 ] has shown that in a two - group micro - ray study setting a t - statistic assumption of the same variability between the two groups could lead to a lack of performance .


fn_spacy_tokens_for_baseline: Helicopter trips around the city are fascinating and great fun ; they are an integral part of daily patrolling of the British Sector .

source_bert_toks: helicopter trips around the city are fascinating and great fun ; they are an integral part of daily patrolling of the british sector .

reference_raw: Helicopter trips around the city are interesting and very entertaining; they are an integral part of the day-to-day patrol of the British sector.

reference_spacy_tokens: Helicopter trips around the city are interesting and very entertaining ; they are an integral part of the day - to - day patrol of the British sector .


fn_spacy_tokens_for_baseline: As they bicker , Panama is flat broke .

source_bert_toks: as they bi ##cker , panama is flat broke .

reference_raw: While they're bickering, Panama's flat-rounded.

reference_spacy_tokens: While they 're bickering , Panama 's flat - rounded .


fn_spacy_tokens_for_baseline: A gymnasium boasts the most modern of techno - gym equipment for an exhilarating workout .

source_bert_toks: a gymnasium boasts the most modern of techno - gym equipment for an ex ##hila ##rating workout .

reference_raw: The gym boasts the state-of-the-art techno-gym equipment for exciting exercises.

reference_spacy_tokens: The gym boasts the state - of - the - art techno - gym equipment for exciting exercises .


fn_spacy_tokens_for_baseline: He had not anticipated that she would still retain sufficient will - power to deny him when he had asked his empty , ritual question .

source_bert_toks: he had not anticipated that she would still retain sufficient will - power to deny him when he had asked his empty , ritual question .

reference_raw: He didn't expect her to retain enough willpower to deny him when he asked his empty, ritual question.

reference_spacy_tokens: He did n't expect her to retain enough willpower to deny him when he asked his empty , ritual question .


fn_spacy_tokens_for_baseline: The event was staged to fulfil Zechariah 's prophecy of the Messianic King riding into Jerusalem ( Matt .

source_bert_toks: the event was staged to fu ##lf ##il ze ##cha ##ria ##h ' s prophecy of the mess ##iani ##c king riding into jerusalem ( matt .

reference_raw: The event was staged in order to fulfill Zechariah's prediction that the Messian king was riding to Jerusalem (Matt).

reference_spacy_tokens: The event was staged in order to fulfill Zechariah 's prediction that the Messian king was riding to Jerusalem ( Matt ) .


fn_spacy_tokens_for_baseline: Try my Sorbie Cleane Shampoo for chemically treated hair and moisturise every few days with Sorbie Deep Conditioner .

source_bert_toks: try my so ##rb ##ie clean ##e sham ##poo for chemical ##ly treated hair and moist ##uri ##se every few days with so ##rb ##ie deep condition ##er .

reference_raw: Try my Sorbie Clean Shampoo for chemically treated hair and wet with Sorbie Deep Conditioner every few days.

reference_spacy_tokens: Try my Sorbie Clean Shampoo for chemically treated hair and wet with Sorbie Deep Conditioner every few days .


fn_spacy_tokens_for_baseline: The irony is that Blake is fit to play , his convalescence helped by a stream of get - well wishes - many from Peterborough fans .

source_bert_toks: the irony is that blake is fit to play , his con ##vale ##sc ##ence helped by a stream of get - well wishes - many from peterborough fans .

reference_raw: The irony was that Blake was fit to play, and his recovery was helped by a flow of good wishes, many from Peterborough fans.

reference_spacy_tokens: The irony was that Blake was fit to play , and his recovery was helped by a flow of good wishes , many from Peterborough fans .


fn_spacy_tokens_for_baseline: 2- A bachelor can have a vacation by rotation for five days every month .

source_bert_toks: 2 - a bachelor can have a vacation by rotation for five days every month .

reference_raw: 2-Bachelor may take a five-day vacation every month by rotation.

reference_spacy_tokens: 2-Bachelor may take a five - day vacation every month by rotation .


fn_spacy_tokens_for_baseline: You can help them to know that feeling .

source_bert_toks: you can help them to know that feeling .

reference_raw: You can help them understand the feeling.

reference_spacy_tokens: You can help them understand the feeling .


fn_spacy_tokens_for_baseline: Accompanied by a biographical essay by art historian Stellweg and a memoir by Mexican writer Elena Poniatowska , the images are strong enough to require no explanation .

source_bert_toks: accompanied by a biographical essay by art historian ste ##ll ##we ##g and a memoir by mexican writer elena po ##nia ##tow ##ska , the images are strong enough to require no explanation .

reference_raw: Accompanied by the biographical essay of art historian Stellweg and the memory of the Mexican writer Elena Poniatowski, the paintings are so powerful that they need no explanation.

reference_spacy_tokens: Accompanied by the biographical essay of art historian Stellweg and the memory of the Mexican writer Elena Poniatowski , the paintings are so powerful that they need no explanation .


fn_spacy_tokens_for_baseline: The problems and costs of organizing transactions depend on both their nature and the assumed characteristics of decision - makers in the model .

source_bert_toks: the problems and costs of organizing transactions depend on both their nature and the assumed characteristics of decision - makers in the model .

reference_raw: The problems and costs of organising transactions are dependent both on their nature and on the expected characteristics of the decision-makers in the model.

reference_spacy_tokens: The problems and costs of organising transactions are dependent both on their nature and on the expected characteristics of the decision - makers in the model .


fn_spacy_tokens_for_baseline: And he warned that no more talks between local parties and the British and Irish governments could take place until Dublin dropped its territorial claim on Ulster .

source_bert_toks: and he warned that no more talks between local parties and the british and irish governments could take place until dublin dropped its territorial claim on ulster .

reference_raw: And he warned that there would be no more talks between the local parties and the British and Irish Governments until Dublin dropped his land application to Ulster.

reference_spacy_tokens: And he warned that there would be no more talks between the local parties and the British and Irish Governments until Dublin dropped his land application to Ulster .


fn_spacy_tokens_for_baseline: ' Yes , we heard about the tea - parties and the Christmas get - togethers .

source_bert_toks: ' yes , we heard about the tea - parties and the christmas get - together ##s .

reference_raw: 'Yes, we've heard of tea parties and Christmas reunions.

reference_spacy_tokens: ' Yes , we 've heard of tea parties and Christmas reunions .


fn_spacy_tokens_for_baseline: Above all , it 's a relaxing therapy and she sees it as a major way of helping a runner ' warm down ' .

source_bert_toks: above all , it ' s a relaxing therapy and she sees it as a major way of helping a runner ' warm down ' .

reference_raw: First of all, it's a loosening therapy, and he sees it as the main way to help a runner "warm down."

reference_spacy_tokens: First of all , it 's a loosening therapy , and he sees it as the main way to help a runner " warm down . "


fn_spacy_tokens_for_baseline: Johnny Cooper still has vivid memories of that frightening moment .

source_bert_toks: johnny cooper still has vivid memories of that frightening moment .

reference_raw: Johnny Cooper still remembers that terrible moment vividly.

reference_spacy_tokens: Johnny Cooper still remembers that terrible moment vividly .


fn_spacy_tokens_for_baseline: The late 1980s saw a rise of several new potential exporters of nuclear assistance .

source_bert_toks: the late 1980s saw a rise of several new potential export ##ers of nuclear assistance .

reference_raw: In the late 1980s, a number of new potential nuclear aid exporters have increased.

reference_spacy_tokens: In the late 1980s , a number of new potential nuclear aid exporters have increased .


fn_spacy_tokens_for_baseline: Digital Equipment Corp told the Microprocessor Forum last month that its Alpha chip is in production at 150 MHz , with usable yields up to 182 MHz .

source_bert_toks: digital equipment corp told the micro ##pro ##ces ##sor forum last month that its alpha chip is in production at 150 mhz , with usable yields up to 182 mhz .

reference_raw: Last month, Digital Equipment Corp informed the Microprocessor Forum that its alpha chip is produced at 150 MHz, with usable yields up to 182 MHz.

reference_spacy_tokens: Last month , Digital Equipment Corp informed the Microprocessor Forum that its alpha chip is produced at 150 MHz , with usable yields up to 182 MHz .


fn_spacy_tokens_for_baseline: But I can not denounce them in other people 's words .

source_bert_toks: but i can not den ##oun ##ce them in other people ' s words .

reference_raw: But I can't condemn them in the words of others.

reference_spacy_tokens: But I ca n't condemn them in the words of others .


fn_spacy_tokens_for_baseline: We had an altercation that soon resolved itself with me lying face - down in a damp bed of cardboard boxes at the loot of a hidden staircase .

source_bert_toks: we had an alter ##cation that soon resolved itself with me lying face - down in a damp bed of cardboard boxes at the lo ##ot of a hidden staircase .

reference_raw: We had an argument that soon resolved when I lay facedown in a wet bed of cardboard boxes at the loot of the hidden stairs.

reference_spacy_tokens: We had an argument that soon resolved when I lay facedown in a wet bed of cardboard boxes at the loot of the hidden stairs .


fn_spacy_tokens_for_baseline: He has not won it since he demolished John Parrott in 1989 -- and he has shown a total commitment and desire to lift the trophy at the Crucible Theatre in Sheffield on May 4 .

source_bert_toks: he has not won it since he demolished john parrot ##t in 1989 - - and he has shown a total commitment and desire to lift the trophy at the cr ##ucible theatre in sheffield on may 4 .

reference_raw: He hasn't won it since he destroyed John Parrott in 1989-and on May 4th, he's shown complete commitment and desire to lift the trophy at the Crucible Theatre in Sheffield.

reference_spacy_tokens: He has n't won it since he destroyed John Parrott in 1989-and on May 4th , he 's shown complete commitment and desire to lift the trophy at the Crucible Theatre in Sheffield .


fn_spacy_tokens_for_baseline: Students ( particularly advanced students ) are frequently vexed by doubts as to the amount of detail that they should put into their answer .

source_bert_toks: students ( particularly advanced students ) are frequently ve ##xed by doubts as to the amount of detail that they should put into their answer .

reference_raw: Students (particularly advanced students) are often questioned about the amount of detail they should provide in their response.

reference_spacy_tokens: Students ( particularly advanced students ) are often questioned about the amount of detail they should provide in their response .


fn_spacy_tokens_for_baseline: The freeze caused interest rates to rise steeply , the overnight rate reaching 38 per cent on Sept. 17 before settling back to 30 per cent .

source_bert_toks: the freeze caused interest rates to rise steep ##ly , the overnight rate reaching 38 per cent on sept . 17 before settling back to 30 per cent .

reference_raw: As a result of the freezing, interest rates increased sharply, and the overnight rate reached 38% on September 17 before settling back to 30%.

reference_spacy_tokens: As a result of the freezing , interest rates increased sharply , and the overnight rate reached 38 % on September 17 before settling back to 30 % .


fn_spacy_tokens_for_baseline: The drops of liquid solidified during the fall and were instantly cooled by the water , which also preserved the shot from damage by impact on a hard surface .

source_bert_toks: the drops of liquid solid ##ified during the fall and were instantly cooled by the water , which also preserved the shot from damage by impact on a hard surface .

reference_raw: The drops of liquid solidified in the fall and were immediately refrigerated by the water, which also kept the shot from damage by impact on the hard surface.

reference_spacy_tokens: The drops of liquid solidified in the fall and were immediately refrigerated by the water , which also kept the shot from damage by impact on the hard surface .


fn_spacy_tokens_for_baseline: I 'm wearing a denim waistcoat , cheesecloth shirt and baggy denim jeans , and I 'm smiling fit to burst , as I always seem to be in photographs .

source_bert_toks: i ' m wearing a denim waist ##coat , cheese ##cloth shirt and bag ##gy denim jeans , and i ' m smiling fit to burst , as i always seem to be in photographs .

reference_raw: I'm wearing a jeans vest, a cheesecloth shirt and a baggy jeans, and I'm smiling like I always look in a picture.

reference_spacy_tokens: I 'm wearing a jeans vest , a cheesecloth shirt and a baggy jeans , and I 'm smiling like I always look in a picture .


fn_spacy_tokens_for_baseline: I 've felt sick every morning since Sunday . '

source_bert_toks: i ' ve felt sick every morning since sunday . '

reference_raw: Every morning since Sunday, I've felt ill.'

reference_spacy_tokens: Every morning since Sunday , I 've felt ill . '


fn_spacy_tokens_for_baseline: A water tank was also erected to store this water atop a house at the Station end of Ledsam Street and a bath - house opened on the ground floor .

source_bert_toks: a water tank was also erected to store this water atop a house at the station end of led ##sam street and a bath - house opened on the ground floor .

reference_raw: A water tank had also been built to store the water at the top of the house at the end of Ledsam Street, and a bathroom had been opened on the ground floor.

reference_spacy_tokens: A water tank had also been built to store the water at the top of the house at the end of Ledsam Street , and a bathroom had been opened on the ground floor .


fn_spacy_tokens_for_baseline: Four roadside bombs blew up in the western Shiite neighborhood of Bayaa , killing four civilians and wounding 15 others .

source_bert_toks: four roadside bombs blew up in the western shi ##ite neighborhood of bay ##aa , killing four civilians and wounding 15 others .

reference_raw: In the western Shiite district of Bayaa, four roadside bombs exploded, killing four civilians and wounding 15 more.

reference_spacy_tokens: In the western Shiite district of Bayaa , four roadside bombs exploded , killing four civilians and wounding 15 more .


fn_spacy_tokens_for_baseline: The exhibition brings together work from artists based in the subcontinent and Asian artists based in Britain ( until 28 Mar ) .

source_bert_toks: the exhibition brings together work from artists based in the subcontinent and asian artists based in britain ( until 28 mar ) .

reference_raw: The exhibition combines the work of artists based in the UK-based subcontinent and Asian artists (until 28 Mar).

reference_spacy_tokens: The exhibition combines the work of artists based in the UK - based subcontinent and Asian artists ( until 28 Mar ) .


fn_spacy_tokens_for_baseline: Just as dentists are taught to plug cavities on sight , so they are trained to remove badly worn , leaky or broken fillings .

source_bert_toks: just as dentist ##s are taught to plug ca ##vi ##ties on sight , so they are trained to remove badly worn , leak ##y or broken filling ##s .

reference_raw: Just as dentists learn to plug cavities on sight, they're trained to take out poorly worn, leaky or broken fillings.

reference_spacy_tokens: Just as dentists learn to plug cavities on sight , they 're trained to take out poorly worn , leaky or broken fillings .


fn_spacy_tokens_for_baseline: The case languished after Morsi was elected last year in the country 's first free presidential race , although local news outlets and Morsi 's opponents accused militants from Hamas , the Brotherhood 's Palestinian offshoot , of freeing their colleagues .

source_bert_toks: the case lang ##uis ##hed after mor ##si was elected last year in the country ' s first free presidential race , although local news outlets and mor ##si ' s opponents accused militants from hamas , the brotherhood ' s palestinian offs ##hoot , of freeing their colleagues .

reference_raw: After the election of Morsi last year in the country's first free presidential race, the case lingered, even though local news outlets and Morsi's opponents blamed the militia of Hamas, the Palestinian Brotherhood, for the release of their colleagues.

reference_spacy_tokens: After the election of Morsi last year in the country 's first free presidential race , the case lingered , even though local news outlets and Morsi 's opponents blamed the militia of Hamas , the Palestinian Brotherhood , for the release of their colleagues .


fn_spacy_tokens_for_baseline: He was preaching that evening at a chapel a couple of miles beyond Burford .

source_bert_toks: he was preaching that evening at a chapel a couple of miles beyond bu ##rford .

reference_raw: That night he preached in a chapel a few miles from Burford.

reference_spacy_tokens: That night he preached in a chapel a few miles from Burford .


fn_spacy_tokens_for_baseline: She took her mother 's hands , they were cold and clammy .

source_bert_toks: she took her mother ' s hands , they were cold and cl ##am ##my .

reference_raw: She took her mother's hands, which were cold and sticky.

reference_spacy_tokens: She took her mother 's hands , which were cold and sticky .


fn_spacy_tokens_for_baseline: There were no victorias conveniently passing , and Rose was forced to commandeer a passing donkey cart , much to the amazement of its young driver , especially when a bowler - hatted Stitch leapt in after him .

source_bert_toks: there were no victoria ##s convenient ##ly passing , and rose was forced to command ##eer a passing donkey cart , much to the amazement of its young driver , especially when a bowler - hat ##ted stitch leapt in after him .

reference_raw: There was no victory, and Rose was forced to command the passing donkey cart, much to the surprise of the young driver, especially when the bowler-hatted Stitch jumped in behind him.

reference_spacy_tokens: There was no victory , and Rose was forced to command the passing donkey cart , much to the surprise of the young driver , especially when the bowler - hatted Stitch jumped in behind him .


fn_spacy_tokens_for_baseline: For centuries , the two religions co - existed uneasily though there were intermittent purges on witches and people who insisted on celebrating their pagan heritage .

source_bert_toks: for centuries , the two religions co - existed une ##asi ##ly though there were intermittent purge ##s on witches and people who insisted on celebrating their pagan heritage .

reference_raw: For centuries, the two religions had coexisted uneasily, though there were occasional cleansings of witches and people who insisted on celebrating their pagan heritage.

reference_spacy_tokens: For centuries , the two religions had coexisted uneasily , though there were occasional cleansings of witches and people who insisted on celebrating their pagan heritage .


fn_spacy_tokens_for_baseline: Sheldukher fumbled for his laser pistol .

source_bert_toks: she ##ld ##uk ##her fumbled for his laser pistol .

reference_raw: Sheldukher groped for the laser pistol.

reference_spacy_tokens: Sheldukher groped for the laser pistol .


fn_spacy_tokens_for_baseline: It contains the Xubaizhi collection of painting and calligraphy ; galleries devoted to antiquities and ceramics ; and a gallery of modern Chinese art .

source_bert_toks: it contains the xu ##bai ##zhi collection of painting and call ##igraphy ; galleries devoted to antiquities and ceramics ; and a gallery of modern chinese art .

reference_raw: Contains Xubaizhi painting and calligraphy, galleries dedicated to antiques and ceramics, and a gallery of modern Chinese art.

reference_spacy_tokens: Contains Xubaizhi painting and calligraphy , galleries dedicated to antiques and ceramics , and a gallery of modern Chinese art .


fn_spacy_tokens_for_baseline: The Cockney porter who had smuggled in a bottle of booze for him said that one of them liked to satisfy herself with the aid of bottle necks .

source_bert_toks: the cock ##ney porter who had smug ##gled in a bottle of boo ##ze for him said that one of them liked to satisfy herself with the aid of bottle necks .

reference_raw: The Cockney porter, who had been sneaking in a bottle of booze for him, said that one of them liked to be satisfied with the neck of the bottle.

reference_spacy_tokens: The Cockney porter , who had been sneaking in a bottle of booze for him , said that one of them liked to be satisfied with the neck of the bottle .


fn_spacy_tokens_for_baseline: The care attendants are carefully chosen and trained , and are able to help a large cross section of people tied to their homes looking after someone else .

source_bert_toks: the care attendants are carefully chosen and trained , and are able to help a large cross section of people tied to their homes looking after someone else .

reference_raw: Caretakers are carefully selected and trained, and are able to help a large cross section of people bound to their homes to take care of someone else.

reference_spacy_tokens: Caretakers are carefully selected and trained , and are able to help a large cross section of people bound to their homes to take care of someone else .


fn_spacy_tokens_for_baseline: Ought Ulster not be ruled by the monarch of Scotland ?

source_bert_toks: ought ulster not be ruled by the monarch of scotland ?

reference_raw: Should Ulster not be ruled by a Scottish ruler?

reference_spacy_tokens: Should Ulster not be ruled by a Scottish ruler ?


fn_spacy_tokens_for_baseline: The 24 China Folk Culture Villages represent China 's ethnic variety ; they feature craftspeople in traditional costumes along with folksong and dance performances .

source_bert_toks: the 24 china folk culture villages represent china ' s ethnic variety ; they feature crafts ##pe ##ople in traditional costumes along with folks ##ong and dance performances .

reference_raw: Twenty-four Chinese folk culture villages represent a Chinese ethnic diversity; they are characterised by artisans in conventional costumes, along with folksong and dance performances.

reference_spacy_tokens: Twenty - four Chinese folk culture villages represent a Chinese ethnic diversity ; they are characterised by artisans in conventional costumes , along with folksong and dance performances .


fn_spacy_tokens_for_baseline: He 'd assembled a lot of evidence about unethical behaviour .

source_bert_toks: he ' d assembled a lot of evidence about une ##thic ##al behaviour .

reference_raw: He's gathered a lot of evidence of unethic behavior.

reference_spacy_tokens: He 's gathered a lot of evidence of unethic behavior .


fn_spacy_tokens_for_baseline: Nevertheless , he was clinically frank in his analysis of his side 's shortcomings on Saturday night .

source_bert_toks: nevertheless , he was clinical ##ly frank in his analysis of his side ' s short ##coming ##s on saturday night .

reference_raw: But when he analyzed his side's shortcomings on Saturday night, he was clinically honest.

reference_spacy_tokens: But when he analyzed his side 's shortcomings on Saturday night , he was clinically honest .


fn_spacy_tokens_for_baseline: There was always too much to do and although she hated it when she came as a young bride , she had grown to love it and would defend it with her life .

source_bert_toks: there was always too much to do and although she hated it when she came as a young bride , she had grown to love it and would defend it with her life .

reference_raw: There was always too much to do, and though she hated it when she came to be a young bride, she had grown to love him, and she would protect him with her life.

reference_spacy_tokens: There was always too much to do , and though she hated it when she came to be a young bride , she had grown to love him , and she would protect him with her life .


fn_spacy_tokens_for_baseline: Bryony took the toast out and began to smear it with tomato chutney .

source_bert_toks: br ##yon ##y took the toast out and began to sm ##ear it with tomato chu ##t ##ney .

reference_raw: Bryony took out the toast and started sprinkling it with tomato chutney.

reference_spacy_tokens: Bryony took out the toast and started sprinkling it with tomato chutney .


fn_spacy_tokens_for_baseline: And if the principle works with man as well , then by spending your whole life in a cruising aircraft you might live to be a hundred .

source_bert_toks: and if the principle works with man as well , then by spending your whole life in a cruising aircraft you might live to be a hundred .

reference_raw: And if that principle works with a man, you could live to be 100 if you spend the rest of your days on a cruise plane.

reference_spacy_tokens: And if that principle works with a man , you could live to be 100 if you spend the rest of your days on a cruise plane .


fn_spacy_tokens_for_baseline: Two massive truck bombs detonated on either end of the main street in Khazna about 4:30 a. m. , killing at least 35 people , wounding 180 and leveling more than 30 houses .

source_bert_toks: two massive truck bombs detonated on either end of the main street in k ##ha ##z ##na about 4 : 30 a . m . , killing at least 35 people , wounding 180 and level ##ing more than 30 houses .

reference_raw: About 4:30 a.m., two massive truck bombs exploded on both sides of the main street in Khazna, killing at least 35 people, wounding 180 and leveling over 30 houses.

reference_spacy_tokens: About 4:30 a.m. , two massive truck bombs exploded on both sides of the main street in Khazna , killing at least 35 people , wounding 180 and leveling over 30 houses .


fn_spacy_tokens_for_baseline: He left a box of matches and rags outside his Cardiff shop to make the fire look like a Halloween prank .

source_bert_toks: he left a box of matches and rags outside his cardiff shop to make the fire look like a halloween prank .

reference_raw: He left a pack of matches and rags in front of his cardiff store to make the fire look like a Halloween joke.

reference_spacy_tokens: He left a pack of matches and rags in front of his cardiff store to make the fire look like a Halloween joke .


fn_spacy_tokens_for_baseline: Auction houses and buyers argue over compensation

source_bert_toks: auction houses and buyers argue over compensation

reference_raw: Auction Houses and Buyers are fighting over compensation


fn_spacy_tokens_for_baseline: He wrote of the calm sea at St Malo , the pink sky , the sweet air .

source_bert_toks: he wrote of the calm sea at st mal ##o , the pink sky , the sweet air .

reference_raw: He wrote about the calm ocean in St. Malo, the pink sky, the sweet air.

reference_spacy_tokens: He wrote about the calm ocean in St. Malo , the pink sky , the sweet air .


fn_spacy_tokens_for_baseline: They did not halt the process of change , and the riots only assumed major proportions in times of wider crisis , such as in 1549 and during the Civil Wars .

source_bert_toks: they did not halt the process of change , and the riots only assumed major proportions in times of wider crisis , such as in 154 ##9 and during the civil wars .

reference_raw: They did not stop the process of change, and in times of wider crisis, for example in 1549 and during the civil wars, the riots only assumed a significant proportion.

reference_spacy_tokens: They did not stop the process of change , and in times of wider crisis , for example in 1549 and during the civil wars , the riots only assumed a significant proportion .


fn_spacy_tokens_for_baseline: And immediately told her , ' You 're nude ! '

source_bert_toks: and immediately told her , ' you ' re nude ! '

reference_raw: And he said, "You're naked!"

reference_spacy_tokens: And he said , " You 're naked ! "


fn_spacy_tokens_for_baseline: Quarrels between brothers and sisters provide the ideal training - ground to carry out this kind of teaching .

source_bert_toks: quarrel ##s between brothers and sisters provide the ideal training - ground to carry out this kind of teaching .

reference_raw: The quarters between brothers and sisters provide an ideal training ground for such learning.

reference_spacy_tokens: The quarters between brothers and sisters provide an ideal training ground for such learning .


fn_spacy_tokens_for_baseline: The 14th - safest Tory seat in the country fell to the Liberal Democrats .

source_bert_toks: the 14th - safe ##st tory seat in the country fell to the liberal democrats .

reference_raw: The 14th safest Tory's seat in the country went to the Liberal Democrats.

reference_spacy_tokens: The 14th safest Tory 's seat in the country went to the Liberal Democrats .


fn_spacy_tokens_for_baseline: She noticed Diana 's uncertainty and , ignoring the other guests who were still buzzing over Diana 's choice of dress , whisked her off to the powder room .

source_bert_toks: she noticed diana ' s uncertainty and , ignoring the other guests who were still buzzing over diana ' s choice of dress , w ##his ##ked her off to the powder room .

reference_raw: She noticed Diana's insecurity and, ignoring the other guests who were still humming about Diana's choice of clothes, whisked her into the powder room.

reference_spacy_tokens: She noticed Diana 's insecurity and , ignoring the other guests who were still humming about Diana 's choice of clothes , whisked her into the powder room .


fn_spacy_tokens_for_baseline: Septimus , who lived in the Green Tree Inn , Skinnergate , did not live to see his design leave the drawing board for in 1862 he drowned while swimming off Redcar .

source_bert_toks: sept ##imus , who lived in the green tree inn , skinner ##gate , did not live to see his design leave the drawing board for in 1862 he drowned while swimming off red ##car .

reference_raw: Septimus, who lived at the Green Tree Ins in Skinnergate, did not live to see his design leave the drawing board because in 1862 he drowned while swimming in Redcar.

reference_spacy_tokens: Septimus , who lived at the Green Tree Ins in Skinnergate , did not live to see his design leave the drawing board because in 1862 he drowned while swimming in Redcar .


fn_spacy_tokens_for_baseline: Many people , in Northern Ireland and in Britain , have doubted the will of the authorities in the Republic to hand over wanted republican terrorists who have fled to the south .

source_bert_toks: many people , in northern ireland and in britain , have doubted the will of the authorities in the republic to hand over wanted republican terrorists who have fled to the south .

reference_raw: Many people, in Northern Ireland and the UK, doubted the will of the authorities in the Republic to hand over the sought-after Republican terrorists who had fled south.

reference_spacy_tokens: Many people , in Northern Ireland and the UK , doubted the will of the authorities in the Republic to hand over the sought - after Republican terrorists who had fled south .


fn_spacy_tokens_for_baseline: Is there anywhere around here where we can have a cup of coffee ? '

source_bert_toks: is there anywhere around here where we can have a cup of coffee ? '

reference_raw: Is there somewhere we can get a cup of coffee?'

reference_spacy_tokens: Is there somewhere we can get a cup of coffee ? '


fn_spacy_tokens_for_baseline: Huy listened to him descending them , then the soft creak and click of the door .

source_bert_toks: hu ##y listened to him descending them , then the soft cr ##eak and click of the door .

reference_raw: Huy listened as he descended, then a soft crack and a click of the door.

reference_spacy_tokens: Huy listened as he descended , then a soft crack and a click of the door .


fn_spacy_tokens_for_baseline: Libya almost certainly will keep its chemical warfare program as long as Qadhafi remains in power .

source_bert_toks: libya almost certainly will keep its chemical warfare program as long as q ##ad ##ha ##fi remains in power .

reference_raw: Libya will almost certainly maintain its chemical warfare program until Qadhafi is in power.

reference_spacy_tokens: Libya will almost certainly maintain its chemical warfare program until Qadhafi is in power .


fn_spacy_tokens_for_baseline: He then showed her with great pride some utterly appalling objects which were used to persuade customers to buy their products .

source_bert_toks: he then showed her with great pride some utterly app ##all ##ing objects which were used to persuade customers to buy their products .

reference_raw: Then, with great pride, he showed her some absolutely horrible objects that were used to convince customers to buy their products.

reference_spacy_tokens: Then , with great pride , he showed her some absolutely horrible objects that were used to convince customers to buy their products .


fn_spacy_tokens_for_baseline: Universities dislike students who change courses in the middle of a year .

source_bert_toks: universities dislike students who change courses in the middle of a year .

reference_raw: Universities don't like students changing courses in the middle of the year.

reference_spacy_tokens: Universities do n't like students changing courses in the middle of the year .


fn_spacy_tokens_for_baseline: It was not itself a centre of manufacturing , but it outstripped all other ports as a point of transit for English exports and became thereby a major entrepot of international trade .

source_bert_toks: it was not itself a centre of manufacturing , but it outs ##trip ##ped all other ports as a point of transit for english exports and became thereby a major en ##tre ##pot of international trade .

reference_raw: It was not itself the centre of production, but it exceeded all other ports as a transit point for English exports and thus became the main entrepty of international trade.

reference_spacy_tokens: It was not itself the centre of production , but it exceeded all other ports as a transit point for English exports and thus became the main entrepty of international trade .


fn_spacy_tokens_for_baseline: His secret ambition was for the Argentine ban to be lifted so he could get to England and avenge Pedro 's death by taking out the English and especially one poker - faced Guards Officer .

source_bert_toks: his secret ambition was for the argentine ban to be lifted so he could get to england and avenge pedro ' s death by taking out the english and especially one poker - faced guards officer .

reference_raw: His secret ambition was to lift the Argentine ban so that he could get to England and revenge the death of Pedro by taking out an English officer, especially a poker-faced guard.

reference_spacy_tokens: His secret ambition was to lift the Argentine ban so that he could get to England and revenge the death of Pedro by taking out an English officer , especially a poker - faced guard .


fn_spacy_tokens_for_baseline: At 14 , Gedge was outstanding in several subjects , especially French , and for a while harboured dreams of travelling the world as an interpreter .

source_bert_toks: at 14 , ge ##dge was outstanding in several subjects , especially french , and for a while harbour ##ed dreams of travelling the world as an interpreter .

reference_raw: At fourteen, Gedge had been excellent in a number of subjects, especially in France, and for a time he had had dreams of traveling the world as an interpreter.

reference_spacy_tokens: At fourteen , Gedge had been excellent in a number of subjects , especially in France , and for a time he had had dreams of traveling the world as an interpreter .


fn_spacy_tokens_for_baseline: The dolphins have often formed up in groups of up to 3000 when they reach Izu , and they are driven into the narrow inlets of Suruga Bay .

source_bert_toks: the dolphins have often formed up in groups of up to 3000 when they reach i ##zu , and they are driven into the narrow inlet ##s of sur ##uga bay .

reference_raw: When they reach Izu, dolphins often form a group of up to 3,000, and are driven into the narrow entrances of Suruga Bay.

reference_spacy_tokens: When they reach Izu , dolphins often form a group of up to 3,000 , and are driven into the narrow entrances of Suruga Bay .


fn_spacy_tokens_for_baseline: Roman Legions guarding Hadrian 's Wall in the north of England carried banners made of Chinese silk , so some enterprising businessman had seized trading opportunities centuries before Marco Polo .

source_bert_toks: roman legions guarding had ##rian ' s wall in the north of england carried banners made of chinese silk , so some enter ##pr ##ising businessman had seized trading opportunities centuries before marco polo .

reference_raw: The Roman legions patrolling Hadrian's Wall in the north of England carried banners of Chinese silk, so a businessman took advantage of business opportunities centuries before Marco Polo.

reference_spacy_tokens: The Roman legions patrolling Hadrian 's Wall in the north of England carried banners of Chinese silk , so a businessman took advantage of business opportunities centuries before Marco Polo .


fn_spacy_tokens_for_baseline: An admiring smile curved his lips as he rested back against the boulder and closed his eyes .

source_bert_toks: an admiring smile curved his lips as he rested back against the boulder and closed his eyes .

reference_raw: A smile of admiration curved his lips as he leaned back against the boulder and closed his eyes.

reference_spacy_tokens: A smile of admiration curved his lips as he leaned back against the boulder and closed his eyes .


fn_spacy_tokens_for_baseline: As I was typing this on the computer ( my VDU is a television set ) , the screen went odd with flashing lines and all the words missing .

source_bert_toks: as i was typing this on the computer ( my v ##du is a television set ) , the screen went odd with flashing lines and all the words missing .

reference_raw: When I wrote it on my computer (my VDU is a television set), the screen went off with flashing lines and missing words.

reference_spacy_tokens: When I wrote it on my computer ( my VDU is a television set ) , the screen went off with flashing lines and missing words .


fn_spacy_tokens_for_baseline: It was the wrong occasion : the amateur just ' likes flags and razzamatazz ' but the professional creates the atmosphere to suit the occasion .

source_bert_toks: it was the wrong occasion : the amateur just ' likes flags and ra ##zza ##mata ##zz ' but the professional creates the atmosphere to suit the occasion .

reference_raw: It was a bad opportunity: an amateur only "likes flags and razzamatazz", but a professional makes an atmosphere that suits the occasion.

reference_spacy_tokens: It was a bad opportunity : an amateur only " likes flags and razzamatazz " , but a professional makes an atmosphere that suits the occasion .


fn_spacy_tokens_for_baseline: The dish is tenderised and given its unique flavour by rubbing portions of duck with garlic , salt and black pepper .

source_bert_toks: the dish is tender ##ised and given its unique flavour by rubbing portions of duck with garlic , salt and black pepper .

reference_raw: The food is tender and gives its unique taste by rubbing the portions of the duck with garlic, salt and black pepper.

reference_spacy_tokens: The food is tender and gives its unique taste by rubbing the portions of the duck with garlic , salt and black pepper .


fn_spacy_tokens_for_baseline: Harvey poured two glasses of milk and put two doughnuts on to paper plates .

source_bert_toks: harvey poured two glasses of milk and put two dough ##nut ##s on to paper plates .

reference_raw: Harvey poured two goblets of milk and put two donuts on paper plates.

reference_spacy_tokens: Harvey poured two goblets of milk and put two donuts on paper plates .


fn_spacy_tokens_for_baseline: She went over to the shelf where she had left her drink , and stared down in dismay at the overturned glass , the shards of crystal glinting wickedly up at her in the dim light .

source_bert_toks: she went over to the shelf where she had left her drink , and stared down in dismay at the overturned glass , the shards of crystal glint ##ing wicked ##ly up at her in the dim light .

reference_raw: She went to the shelf where she had left her drink and stared in horror at the overturned glass, the crystal shards gleaming at her in the dim light.

reference_spacy_tokens: She went to the shelf where she had left her drink and stared in horror at the overturned glass , the crystal shards gleaming at her in the dim light .


fn_spacy_tokens_for_baseline: The education establishment will fight against common sense every inch of the way .

source_bert_toks: the education establishment will fight against common sense every inch of the way .

reference_raw: The educational establishment will fight against common sense every inch of the way.

reference_spacy_tokens: The educational establishment will fight against common sense every inch of the way .


fn_spacy_tokens_for_baseline: We were woken up at 5.30 am , and Alex and I were told to go over to the kitchens to fetch the breakfast .

source_bert_toks: we were woken up at 5 . 30 am , and alex and i were told to go over to the kitchens to fetch the breakfast .

reference_raw: We got up at 5:30 in the morning, and Alex and I were told to get breakfast in the kitchen.

reference_spacy_tokens: We got up at 5:30 in the morning , and Alex and I were told to get breakfast in the kitchen .


fn_spacy_tokens_for_baseline: He believes in his heart that Daisy has loved him during the many years they have not seen each other but he has pined over her .

source_bert_toks: he believes in his heart that daisy has loved him during the many years they have not seen each other but he has pine ##d over her .

reference_raw: He believes in his heart that Daisy loved him in years when they didn't see each other, but he blamed her.

reference_spacy_tokens: He believes in his heart that Daisy loved him in years when they did n't see each other , but he blamed her .


fn_spacy_tokens_for_baseline: He uncorked his canteen and took a long drink of water .

source_bert_toks: he un ##cor ##ked his canteen and took a long drink of water .

reference_raw: He uncorked the bottle and drank deeply.

reference_spacy_tokens: He uncorked the bottle and drank deeply .


fn_spacy_tokens_for_baseline: She dabbed some perfume on her throat and ran downstairs .

source_bert_toks: she da ##bbed some perfume on her throat and ran downstairs .

reference_raw: She rubbed a little perfume around her neck and ran down the stairs.

reference_spacy_tokens: She rubbed a little perfume around her neck and ran down the stairs .


fn_spacy_tokens_for_baseline: The market runs all the way up to Tin Hau Temple , where you will find fortune tellers ' tables ( some speak English ) and possibly street performers singing Chinese opera or pop songs .

source_bert_toks: the market runs all the way up to tin ha ##u temple , where you will find fortune teller ##s ' tables ( some speak english ) and possibly street performers singing chinese opera or pop songs .

reference_raw: The market goes all the way to the Tin Hau Temple, where you can find the tables of fortune tellers (some speak English) and possibly street artists who sing Chinese opera or pop songs.

reference_spacy_tokens: The market goes all the way to the Tin Hau Temple , where you can find the tables of fortune tellers ( some speak English ) and possibly street artists who sing Chinese opera or pop songs .


fn_spacy_tokens_for_baseline: It was stuffed with manila files and loose papers .

source_bert_toks: it was stuffed with manila files and loose papers .

reference_raw: It was filled with manila files and loose papers.

reference_spacy_tokens: It was filled with manila files and loose papers .


fn_spacy_tokens_for_baseline: The earliest account of the English ( Tacitus 's Germania , AD 97 - 8 ) remarks on their habit of drowning sacrificial victims in bogs .

source_bert_toks: the earliest account of the english ( ta ##cit ##us ' s german ##ia , ad 97 - 8 ) remarks on their habit of drowning sac ##ri ##fi ##cial victims in bog ##s .

reference_raw: The first account of the English (Germania, Tacitus, AD 97-8) comments on their habit of drowning victims in swamps.

reference_spacy_tokens: The first account of the English ( Germania , Tacitus , AD 97 - 8 ) comments on their habit of drowning victims in swamps .


fn_spacy_tokens_for_baseline: They 've been looking for him all the time for their revenge , but it is only now that they have begun to find him out . '

source_bert_toks: they ' ve been looking for him all the time for their revenge , but it is only now that they have begun to find him out . '

reference_raw: They were still looking for him to avenge him, but only now did they begin to discover him.'

reference_spacy_tokens: They were still looking for him to avenge him , but only now did they begin to discover him . '


fn_spacy_tokens_for_baseline: It raids the pupae and larvae from the nests of other ant species , brings them back to its nest , and when the pupae and larvae later hatch they work as slaves for their captors .

source_bert_toks: it raids the pup ##ae and larvae from the nests of other ant species , brings them back to its nest , and when the pup ##ae and larvae later hatch they work as slaves for their capt ##ors .

reference_raw: They attack pupae and larvae from the nests of other ant species, bring them back to their nest, and when the pupae and larvae later hatch, they work as slaves to their captors.

reference_spacy_tokens: They attack pupae and larvae from the nests of other ant species , bring them back to their nest , and when the pupae and larvae later hatch , they work as slaves to their captors .


fn_spacy_tokens_for_baseline: According to current estimates , around 2 million tons of largely untreated industrial waste is discharged into Hong Kong 's coastal waters every day .

source_bert_toks: according to current estimates , around 2 million tons of largely un ##tre ##ated industrial waste is discharged into hong kong ' s coastal waters every day .

reference_raw: According to current estimates, approximately 2 million tonnes of largely untreated industrial waste are released daily into the coastal waters of Hong Kong.

reference_spacy_tokens: According to current estimates , approximately 2 million tonnes of largely untreated industrial waste are released daily into the coastal waters of Hong Kong .


fn_spacy_tokens_for_baseline: Supported by a sublime melancholy soundtrack by Robert Caux , Lepage creates a nocturnal , yearning world of dreams and addiction .

source_bert_toks: supported by a sublime melancholy soundtrack by robert ca ##ux , le ##page creates a nocturnal , yearning world of dreams and addiction .

reference_raw: Supported by Robert Caux's noble melancholy sound track, Lepage creates a nightly, yearning world of dreams and addiction.

reference_spacy_tokens: Supported by Robert Caux 's noble melancholy sound track , Lepage creates a nightly , yearning world of dreams and addiction .


fn_spacy_tokens_for_baseline: Mr Gorbachev 's words -- and the wave of shrewd and generally conciliatory diplomatic actions that followed -- sent a tremor through the American diplomatic establishment .

source_bert_toks: mr go ##rba ##chev ' s words - - and the wave of sh ##rew ##d and generally con ##ci ##lia ##tory diplomatic actions that followed - - sent a tremor through the american diplomatic establishment .

reference_raw: Mr. Gorbachev's words - and the wave of clever and generally conciliatory diplomatic actions that followed - sent a shiver through the U.S. diplomatic establishment.

reference_spacy_tokens: Mr. Gorbachev 's words - and the wave of clever and generally conciliatory diplomatic actions that followed - sent a shiver through the U.S. diplomatic establishment .


fn_spacy_tokens_for_baseline: They took down the bucket labelled ' Buoyancy " and experimented with stones , shells , pieces of wood , metal bottle tops , forks , sponges , plastic boats and animals , plastic bobbins and two plastic cups , one of which sinks when filled with water and the other which floats just under the surface .

source_bert_toks: they took down the bucket labelled ' bu ##oya ##ncy " and experimented with stones , shells , pieces of wood , metal bottle tops , forks , sponge ##s , plastic boats and animals , plastic bob ##bin ##s and two plastic cups , one of which sinks when filled with water and the other which floats just under the surface .

reference_raw: They took down a bucket marked "Buoyancy" and tested it with stones, shells, pieces of wood, metal bottle tops, forks, mushrooms, plastic boats and animals, plastic bobbins and two plastic cups, one of which sinks when filled with water and the other that floats just below the surface.

reference_spacy_tokens: They took down a bucket marked " Buoyancy " and tested it with stones , shells , pieces of wood , metal bottle tops , forks , mushrooms , plastic boats and animals , plastic bobbins and two plastic cups , one of which sinks when filled with water and the other that floats just below the surface .


fn_spacy_tokens_for_baseline: They were on the top floor of an old house and he was very cold and very miserable .

source_bert_toks: they were on the top floor of an old house and he was very cold and very miserable .

reference_raw: They were on the top floor of the old house, and he was very cold and very unhappy.

reference_spacy_tokens: They were on the top floor of the old house , and he was very cold and very unhappy .


fn_spacy_tokens_for_baseline: At Kemmendine , there were two experienced missionaries , men of outstanding ability , character and devotion .

source_bert_toks: at ke ##mme ##ndi ##ne , there were two experienced missionaries , men of outstanding ability , character and devotion .

reference_raw: There were two skilled missionaries in Kemmendine, men of excellent skill, character, and devotion.

reference_spacy_tokens: There were two skilled missionaries in Kemmendine , men of excellent skill , character , and devotion .


fn_spacy_tokens_for_baseline: One of its characters from real life is Squeaky Fromme , she who tried to assassinate President Gerald Ford , who sings a duet with John Warnock Hinckley , the would - be assassin of President Ronald Reagan .

source_bert_toks: one of its characters from real life is squeak ##y from ##me , she who tried to assassinate president gerald ford , who sings a duet with john warn ##ock hi ##nc ##kley , the would - be assassin of president ronald reagan .

reference_raw: One of her real-life characters is Squeaky Fromme, the one who tried to kill President Gerald Ford, who was singing a duet with John Warnock Hinckley, President Ronald Reagan's would-be killer.

reference_spacy_tokens: One of her real - life characters is Squeaky Fromme , the one who tried to kill President Gerald Ford , who was singing a duet with John Warnock Hinckley , President Ronald Reagan 's would - be killer .


fn_spacy_tokens_for_baseline: He 'll be cross , but I 'll go .

source_bert_toks: he ' ll be cross , but i ' ll go .

reference_raw: He's upset, but I'm going.

reference_spacy_tokens: He 's upset , but I 'm going .


fn_spacy_tokens_for_baseline: Delight that she could be stirred by another person .

source_bert_toks: delight that she could be stirred by another person .

reference_raw: It's a pleasure to be moved by someone else.

reference_spacy_tokens: It 's a pleasure to be moved by someone else .


fn_spacy_tokens_for_baseline: The average stay is two years and this is considered insufficient time to master the workings of a complex government department .

source_bert_toks: the average stay is two years and this is considered insufficient time to master the workings of a complex government department .

reference_raw: The average stay is two years, which is considered to be a lack of time to master the work of a complex government department.

reference_spacy_tokens: The average stay is two years , which is considered to be a lack of time to master the work of a complex government department .


fn_spacy_tokens_for_baseline: Subject specialization and formal teaching would be undermined .

source_bert_toks: subject specialization and formal teaching would be undermine ##d .

reference_raw: Subject specialisation and formal learning would be compromised.

reference_spacy_tokens: Subject specialisation and formal learning would be compromised .


fn_spacy_tokens_for_baseline: Dividend yields are close to a 20-year low .

source_bert_toks: divide ##nd yields are close to a 20 - year low .

reference_raw: The yields of the dividend are almost 20 years short.

reference_spacy_tokens: The yields of the dividend are almost 20 years short .


fn_spacy_tokens_for_baseline: He was n't staring at her breast , but at her badge .

source_bert_toks: he wasn ' t staring at her breast , but at her badge .

reference_raw: He wasn't looking at her breasts, he was looking at her insignia.

reference_spacy_tokens: He was n't looking at her breasts , he was looking at her insignia .


fn_spacy_tokens_for_baseline: For example , you could reward a child for staying with you in the supermarket by buying a small treat as you leave .

source_bert_toks: for example , you could reward a child for staying with you in the supermarket by buying a small treat as you leave .

reference_raw: For example, you can pay a kid for staying in a supermarket with you by buying a little treat on your way out.

reference_spacy_tokens: For example , you can pay a kid for staying in a supermarket with you by buying a little treat on your way out .


fn_spacy_tokens_for_baseline: This attack was conducted in retaliation for the U.S. bombing raid on Tripoli , which was carried out in the aftermath of Libyan terrorist activities in Germany .

source_bert_toks: this attack was conducted in retaliation for the u . s . bombing raid on tripoli , which was carried out in the aftermath of libyan terrorist activities in germany .

reference_raw: The attack was carried out in retaliation for the U.S. bombing of Tripoli in the wake of Libyan terrorist activities in Germany.

reference_spacy_tokens: The attack was carried out in retaliation for the U.S. bombing of Tripoli in the wake of Libyan terrorist activities in Germany .


fn_spacy_tokens_for_baseline: Warlords operated in the west , and the east was dominated by an independent anarchist force , the green armies of Makhno .

source_bert_toks: warlord ##s operated in the west , and the east was dominated by an independent anarchist force , the green armies of ma ##kh ##no .

reference_raw: The warlords were operating in the west, and the east was ruled by an independent anarchist force, the green armies of Makhno.

reference_spacy_tokens: The warlords were operating in the west , and the east was ruled by an independent anarchist force , the green armies of Makhno .


fn_spacy_tokens_for_baseline: Shortly after setting up home he ran into a series of mishaps .

source_bert_toks: shortly after setting up home he ran into a series of mis ##ha ##ps .

reference_raw: Shortly after he got home, he ran into a series of accidents.

reference_spacy_tokens: Shortly after he got home , he ran into a series of accidents .


fn_spacy_tokens_for_baseline: She did , however , ask that Christine send her a photograph .

source_bert_toks: she did , however , ask that christine send her a photograph .

reference_raw: But she wanted Christine to send her a picture.

reference_spacy_tokens: But she wanted Christine to send her a picture .


fn_spacy_tokens_for_baseline: He hates the thought of missing out on a big occasion .

source_bert_toks: he hates the thought of missing out on a big occasion .

reference_raw: He doesn't like the idea of missing out on a big occasion.

reference_spacy_tokens: He does n't like the idea of missing out on a big occasion .


fn_spacy_tokens_for_baseline: An intention to kill must be proved in order to convict someone of attempted murder .

source_bert_toks: an intention to kill must be proved in order to convict someone of attempted murder .

reference_raw: In order to convict someone of an attempted homicide, the intention to kill must be proven.

reference_spacy_tokens: In order to convict someone of an attempted homicide , the intention to kill must be proven .


fn_spacy_tokens_for_baseline: The craftsmanship and engineering prowess are obvious ; the wishbones so beautiful you just want to touch them .

source_bert_toks: the craftsman ##ship and engineering prowess are obvious ; the wish ##bone ##s so beautiful you just want to touch them .

reference_raw: The skill of art and engineering is obvious; the wishbones are so beautiful that you just want to touch them.

reference_spacy_tokens: The skill of art and engineering is obvious ; the wishbones are so beautiful that you just want to touch them .


fn_spacy_tokens_for_baseline: A police spokeswoman said they could not confirm reports of a second bag snatch from a another woman 's car just a few minutes later .

source_bert_toks: a police spoke ##sw ##oman said they could not confirm reports of a second bag snatch from a another woman ' s car just a few minutes later .

reference_raw: A police spokesman said they couldn't confirm reports of a second bag stolen from another woman's car a few minutes later.

reference_spacy_tokens: A police spokesman said they could n't confirm reports of a second bag stolen from another woman 's car a few minutes later .


fn_spacy_tokens_for_baseline: American education 's future will be determined by the degree to which we -- all of us -- allow this common sense to prevail over the illusions that we also share .

source_bert_toks: american education ' s future will be determined by the degree to which we - - all of us - - allow this common sense to pre ##va ##il over the illusions that we also share .

reference_raw: The future of America's education will be determined by the extent to which we - all of us - allow this common sense to prevail over the illusions we share.

reference_spacy_tokens: The future of America 's education will be determined by the extent to which we - all of us - allow this common sense to prevail over the illusions we share .


fn_spacy_tokens_for_baseline: ' Cheers , Pat , ' I said raising my mug of brandy .

source_bert_toks: ' cheers , pat , ' i said raising my mug of brandy .

reference_raw: "Cheers, Pat," I said, picking up a cup of brandy.

reference_spacy_tokens: " Cheers , Pat , " I said , picking up a cup of brandy .


fn_spacy_tokens_for_baseline: The objective of this flow cytometric study was to evaluate the impact of preoperative radiotherapy on the prevalence of DNA aneuploidy and to analyse the prognostic significance of DNA ploidy in oesophageal squamous cell cancer .

source_bert_toks: the objective of this flow cy ##tom ##et ##ric study was to evaluate the impact of pre ##oper ##ative radio ##therapy on the prevalence of dna an ##eu ##pl ##oid ##y and to anal ##yse the pro ##gno ##stic significance of dna pl ##oid ##y in o ##es ##op ##ha ##ge ##al sq ##ua ##mous cell cancer .

reference_raw: The purpose of this flow cytometric study was to assess the impact of pre-operative radiotherapy on the prevalence of DNA aneuploidy and to analyse the prognostic significance of DNA ploidy in oesophageal squamous cell carcinoma.

reference_spacy_tokens: The purpose of this flow cytometric study was to assess the impact of pre - operative radiotherapy on the prevalence of DNA aneuploidy and to analyse the prognostic significance of DNA ploidy in oesophageal squamous cell carcinoma .


fn_spacy_tokens_for_baseline: For every ticket bought , £ 1 will be donated to a children 's charity , chosen by you .

source_bert_toks: for every ticket bought , £1 will be donated to a children ' s charity , chosen by you .

reference_raw: For each ticket purchased, £1 will be given to the children's charity chosen by you.

reference_spacy_tokens: For each ticket purchased , £ 1 will be given to the children 's charity chosen by you .


fn_spacy_tokens_for_baseline: Technology transfer for new Iranian missiles and artillery rockets .

source_bert_toks: technology transfer for new iranian missiles and artillery rockets .

reference_raw: Transfer of technology to new Iran missiles and artillery missiles.

reference_spacy_tokens: Transfer of technology to new Iran missiles and artillery missiles .


fn_spacy_tokens_for_baseline: Bare - headed , his dark curly hair sparkling with raindrops , Connor stopped in front of Joshua and said urgently ,

source_bert_toks: bare - headed , his dark curly hair sparkling with rain ##drop ##s , connor stopped in front of joshua and said urgently ,

reference_raw: Bare-headed, his dark curled hair glistening with raindrops, Connor stopped in front of Joshua and said urgently:

reference_spacy_tokens: Bare - headed , his dark curled hair glistening with raindrops , Connor stopped in front of Joshua and said urgently :


fn_spacy_tokens_for_baseline: Talks aimed at averting a trade war between the European Community and the United States of America are to resume next week .

source_bert_toks: talks aimed at ave ##rting a trade war between the european community and the united states of america are to resume next week .

reference_raw: Negotiations to avoid a trade war between the European Community and the United States of America will continue next week.

reference_spacy_tokens: Negotiations to avoid a trade war between the European Community and the United States of America will continue next week .


fn_spacy_tokens_for_baseline: Blanche was disquieted but not sure why .

source_bert_toks: blanche was di ##s ##qui ##ete ##d but not sure why .

reference_raw: Blanche was nervous, but he didn't know why.

reference_spacy_tokens: Blanche was nervous , but he did n't know why .


fn_spacy_tokens_for_baseline: This spell may be cast against any one opponent in hand - to - hand combat with the caster .

source_bert_toks: this spell may be cast against any one opponent in hand - to - hand combat with the caste ##r .

reference_raw: This spell can be cast against any opponent in a hand-to-hand battle with a caster.

reference_spacy_tokens: This spell can be cast against any opponent in a hand - to - hand battle with a caster .


fn_spacy_tokens_for_baseline: At the bottom end , the masses were being fed on a diet of bingo , moronic competitions and ' news ' reduced to a jumble of tits and bums , Tory propaganda and invented Royal Family rubbish .

source_bert_toks: at the bottom end , the masses were being fed on a diet of bingo , mor ##onic competitions and ' news ' reduced to a ju ##mble of tits and bum ##s , tory propaganda and invented royal family rubbish .

reference_raw: At the bottom, the masses were fed on bingo diets, stupid competitions, and "news" reduced to a jumble of tits and bums, Tory propaganda, and the invention of royal family rubbish.

reference_spacy_tokens: At the bottom , the masses were fed on bingo diets , stupid competitions , and " news " reduced to a jumble of tits and bums , Tory propaganda , and the invention of royal family rubbish .


fn_spacy_tokens_for_baseline: However , comments by the American Banker 's President that U S industry must shed more jobs , saw Wall Street lose thirty four points .

source_bert_toks: however , comments by the american banker ' s president that u s industry must shed more jobs , saw wall street lose thirty four points .

reference_raw: But the U.S. Banker President's remarks that the U.S. industry needs to shed more jobs, saw Wall Street lose thirty-four points.

reference_spacy_tokens: But the U.S. Banker President 's remarks that the U.S. industry needs to shed more jobs , saw Wall Street lose thirty - four points .


fn_spacy_tokens_for_baseline: Even that 's good news . even if she is the milk snatcher . '

source_bert_toks: even that ' s good news . even if she is the milk snatch ##er . '

reference_raw: That's good news . . . even if it's a milk thief.'

reference_spacy_tokens: That 's good news . . . even if it 's a milk thief . '


fn_spacy_tokens_for_baseline: The road swung back and forth between sandhills and glimpses of flat water , toward the sea , then inland to villages .

source_bert_toks: the road swung back and forth between sand ##hill ##s and glimpse ##s of flat water , toward the sea , then inland to villages .

reference_raw: The road turned back and forth between the sandhills and glimpses of flat water, to the sea, and then inland to the villages.

reference_spacy_tokens: The road turned back and forth between the sandhills and glimpses of flat water , to the sea , and then inland to the villages .


fn_spacy_tokens_for_baseline: Under Ugandan law , those charged with treason are not permitted to be granted bail for at least 480 days .

source_bert_toks: under uganda ##n law , those charged with treason are not permitted to be granted bail for at least 480 days .

reference_raw: Under Ugandan law, those accused of treachery are not allowed to be bailed for at least 480 days.

reference_spacy_tokens: Under Ugandan law , those accused of treachery are not allowed to be bailed for at least 480 days .


fn_spacy_tokens_for_baseline: But hosiery companies are fighting back this Christmas with some flamboyant stockings and tights designed to liven up the festive party season .

source_bert_toks: but ho ##sier ##y companies are fighting back this christmas with some fl ##am ##boy ##ant stockings and tight ##s designed to live ##n up the fest ##ive party season .

reference_raw: But the hosiery companies are fighting this Christmas with some flamboyant stockings and stockings designed to survive the holiday season.

reference_spacy_tokens: But the hosiery companies are fighting this Christmas with some flamboyant stockings and stockings designed to survive the holiday season .


fn_spacy_tokens_for_baseline: A homespun woollen mantle was fastened across her shoulders , hiding her torn dress .

source_bert_toks: a homes ##pu ##n wool ##len mantle was fastened across her shoulders , hiding her torn dress .

reference_raw: She wore a homespun woollen cloak over her shoulders, concealing her torn dress.

reference_spacy_tokens: She wore a homespun woollen cloak over her shoulders , concealing her torn dress .


fn_spacy_tokens_for_baseline: But before this both centres produced very similar ranges of designs and there are considerable difficulties in distinguishing on stylistic grounds alone between late Malaga and early Valencia lustre pottery .

source_bert_toks: but before this both centres produced very similar ranges of designs and there are considerable difficulties in distinguishing on stylistic grounds alone between late malaga and early valencia lust ##re pottery .

reference_raw: Before that, however, the two centres produced a very similar number of designs and, for stylistic reasons alone, it is difficult to differentiate between the late Malaga and the early Valencia lustre pottery.

reference_spacy_tokens: Before that , however , the two centres produced a very similar number of designs and , for stylistic reasons alone , it is difficult to differentiate between the late Malaga and the early Valencia lustre pottery .


fn_spacy_tokens_for_baseline: The last dull memory of winter faded and the hedges were a mass of silvery catkins of the pussy willow , while amongst them flourished cuckoo - flowers and Jack - by - the - hedge , attracting the early orange - tip butterflies .

source_bert_toks: the last dull memory of winter faded and the hedges were a mass of silvery cat ##kins of the pussy willow , while amongst them flourished cuckoo - flowers and jack - by - the - hedge , attracting the early orange - tip butterflies .

reference_raw: The last dim memory of winter faded, and the hedges were a mass of silvery catkins from a cunt willow, and among them were cuckoo-flowers and Jack-by-hedges, attracting the first orange-tipped butterflies.

reference_spacy_tokens: The last dim memory of winter faded , and the hedges were a mass of silvery catkins from a cunt willow , and among them were cuckoo - flowers and Jack - by - hedges , attracting the first orange - tipped butterflies .


fn_spacy_tokens_for_baseline: A rope had been thrown over a low beam in the room and tied to the top of the Bookman 's cage .

source_bert_toks: a rope had been thrown over a low beam in the room and tied to the top of the book ##man ' s cage .

reference_raw: A rope was thrown over a low beam in the room and strapped to the top of the Bookman's cage.

reference_spacy_tokens: A rope was thrown over a low beam in the room and strapped to the top of the Bookman 's cage .


fn_spacy_tokens_for_baseline: He did n't even know her surname .

source_bert_toks: he didn ' t even know her surname .

reference_raw: He did not even know her last name.

reference_spacy_tokens: He did not even know her last name .


fn_spacy_tokens_for_baseline: The call for education to buttress democracy by inculcating into young people the principles of citizenship became increasingly exaggerated and , in some senses , melodramatic .

source_bert_toks: the call for education to butt ##ress democracy by inc ##ul ##cating into young people the principles of citizenship became increasingly exaggerated and , in some senses , mel ##od ##rama ##tic .

reference_raw: The call for education to promote democracy by involving young people in the principles of citizenship has become increasingly exaggerated and, in a sense, melodramatic.

reference_spacy_tokens: The call for education to promote democracy by involving young people in the principles of citizenship has become increasingly exaggerated and , in a sense , melodramatic .


fn_spacy_tokens_for_baseline: The bottom dwellers mentioned so far tend to prefer the shallower waters of the continental shelf .

source_bert_toks: the bottom dwellers mentioned so far tend to prefer the shallow ##er waters of the continental shelf .

reference_raw: The bottom residents mentioned so far tend to prefer the shallower waters of the continental shelf.

reference_spacy_tokens: The bottom residents mentioned so far tend to prefer the shallower waters of the continental shelf .


fn_spacy_tokens_for_baseline: The district covered by his law practice ranged ' from the middle veld north of the Magaliesberg Mountains to the bank of the Crocodile River bordering Bechuanaland ' .

source_bert_toks: the district covered by his law practice ranged ' from the middle ve ##ld north of the mag ##ali ##es ##berg mountains to the bank of the crocodile river bordering be ##chua ##nal ##and ' .

reference_raw: The area covered by his legal practice ranged from the middle peak north of the Magaliesberg Mountains to the shore of the Crocodile River bordering Bechuanaland.

reference_spacy_tokens: The area covered by his legal practice ranged from the middle peak north of the Magaliesberg Mountains to the shore of the Crocodile River bordering Bechuanaland .


fn_spacy_tokens_for_baseline: Certainly she presented me with my medal for the 100 metres and as I stood on the plinth she did not bat an eyelid .

source_bert_toks: certainly she presented me with my medal for the 100 metres and as i stood on the pl ##int ##h she did not bat an eye ##lid .

reference_raw: I'm sure she gave me a medal for a hundred meters, and when I was standing on the plinth, she didn't hit my eyelid.

reference_spacy_tokens: I 'm sure she gave me a medal for a hundred meters , and when I was standing on the plinth , she did n't hit my eyelid .


fn_spacy_tokens_for_baseline: Everyone enjoyed the stimulating sessions of Elementary Dance , Music and Rhythmics and varied Medau work given by Alexa Hahn , Gisela Spiess - Jaenicke , Katarina Hutz - Medau and Annet Kramer respectively .

source_bert_toks: everyone enjoyed the stimulating sessions of elementary dance , music and rhythmic ##s and varied med ##au work given by alexa hahn , gi ##sel ##a spies ##s - jae ##nick ##e , kata ##rina hut ##z - med ##au and anne ##t kramer respectively .

reference_raw: They all enjoyed the stimulant sessions of elementary dances, music and rhythms, and the varied Medau work provided by Alexa Hahn, Gisela Spiess-Jaenicke, Katarina Hutz-Medau and Annet Kramer.

reference_spacy_tokens: They all enjoyed the stimulant sessions of elementary dances , music and rhythms , and the varied Medau work provided by Alexa Hahn , Gisela Spiess - Jaenicke , Katarina Hutz - Medau and Annet Kramer .


fn_spacy_tokens_for_baseline: Whatever their basis in nefarious dealings , misunderstood intelligence , or dreams , noble things were being attempted , and if they came off the world would have cause to be grateful .

source_bert_toks: whatever their basis in ne ##far ##ious dealings , misunderstood intelligence , or dreams , noble things were being attempted , and if they came off the world would have cause to be grateful .

reference_raw: Irrespective of their bases in reckless dealings, misunderstandings of intelligence, or dreams, noble things were being tried, and if they came out of the world, they would have reason to be grateful.

reference_spacy_tokens: Irrespective of their bases in reckless dealings , misunderstandings of intelligence , or dreams , noble things were being tried , and if they came out of the world , they would have reason to be grateful .