fn_spacy_tokens_for_baseline: Everyone was always too busy discussing how awful the food was .

source_bert_toks: everyone was always too busy discussing how awful the food was .

reference_raw: They were always too busy talking about how bad the food was.

reference_spacy_tokens: They were always too busy talking about how bad the food was .


fn_spacy_tokens_for_baseline: The lush , unique colours that make Rosemary clay so pleasing to the eye , now also please with fittings featuring precision unmatched by traditional manufacturing methods .

source_bert_toks: the lush , unique colours that make rosemary clay so pleasing to the eye , now also please with fitting ##s featuring precision un ##mat ##ched by traditional manufacturing methods .

reference_raw: The lush, unique colors that make Rosemary clay so pleasing to the eye now also please with fittings that perform precision that is not matched by traditional production methods.

reference_spacy_tokens: The lush , unique colors that make Rosemary clay so pleasing to the eye now also please with fittings that perform precision that is not matched by traditional production methods .


fn_spacy_tokens_for_baseline: If it had been impossible for one reason or another to use a boat on the water I would have done the best I could with a plummet and noted what I could see from the banks .

source_bert_toks: if it had been impossible for one reason or another to use a boat on the water i would have done the best i could with a plum ##met and noted what i could see from the banks .

reference_raw: If, for one reason or another, it was impossible to take a boat in the water, I would do my best with a plummet and note what I could see from the shores.

reference_spacy_tokens: If , for one reason or another , it was impossible to take a boat in the water , I would do my best with a plummet and note what I could see from the shores .


fn_spacy_tokens_for_baseline: Immediately after the interview , he was apprehended again by the Jordanian authority . ]

source_bert_toks: immediately after the interview , he was app ##re ##hend ##ed again by the jordanian authority . ]

reference_raw: Immediately after the interview, the Jordanian government arrested him again.]

reference_spacy_tokens: Immediately after the interview , the Jordanian government arrested him again . ]


fn_spacy_tokens_for_baseline: ' My face , ' he shrieked in a choked whisper , and sank his teeth into the wrist of the hand that was choking him .

source_bert_toks: ' my face , ' he shrieked in a choked whisper , and sank his teeth into the wrist of the hand that was choking him .

reference_raw: "My face," he screamed in a strangled whisper, and sank his teeth into the wrist of the hand that had strangled him.

reference_spacy_tokens: " My face , " he screamed in a strangled whisper , and sank his teeth into the wrist of the hand that had strangled him .


fn_spacy_tokens_for_baseline: Firefighters were working to keep the base of the crane cool , and the stability of the structure was being monitored with lasers .

source_bert_toks: firefighters were working to keep the base of the crane cool , and the stability of the structure was being monitored with lasers .

reference_raw: The firemen worked to keep the base of the crane cool, and lasers traced the stability of the structure.

reference_spacy_tokens: The firemen worked to keep the base of the crane cool , and lasers traced the stability of the structure .


fn_spacy_tokens_for_baseline: If used effectively , CBW are potentially capable of inflicting a large number of casualties -- more than is possible with conventional explosives .

source_bert_toks: if used effectively , cb ##w are potentially capable of in ##flict ##ing a large number of casualties - - more than is possible with conventional explosives .

reference_raw: If used effectively, CBW could potentially cause a large number of deaths - more than conventional explosions are possible.

reference_spacy_tokens: If used effectively , CBW could potentially cause a large number of deaths - more than conventional explosions are possible .


fn_spacy_tokens_for_baseline: One expert , whose job is so politically sensitive that he spoke on condition that he would n't be named or quoted , said the expected influx of East European refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

source_bert_toks: one expert , whose job is so politically sensitive that he spoke on condition that he wouldn ' t be named or quoted , said the expected influx of east european refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

reference_raw: One expert, whose work is so politically sensitive that he speaks on the condition that he is not named or quoted, said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer-maintenance workers, for example, doubling as alien spies.

reference_spacy_tokens: One expert , whose work is so politically sensitive that he speaks on the condition that he is not named or quoted , said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer - maintenance workers , for example , doubling as alien spies .


fn_spacy_tokens_for_baseline: The reaction of the urban proletariat was natural ; one can not safely deduce from it any decisive change in attitude towards death and survival .

source_bert_toks: the reaction of the urban pro ##let ##aria ##t was natural ; one can not safely de ##du ##ce from it any decisive change in attitude towards death and survival .

reference_raw: The reaction of the urban proletariat was natural; no decisive change in attitude to death and survival could be safely inferred from it.

reference_spacy_tokens: The reaction of the urban proletariat was natural ; no decisive change in attitude to death and survival could be safely inferred from it .


fn_spacy_tokens_for_baseline: Some onboard klaxon wailed as though in pain at the effort .

source_bert_toks: some onboard k ##la ##xon wai ##led as though in pain at the effort .

reference_raw: Some aboard Klaxon groaned as if in pain at the effort.

reference_spacy_tokens: Some aboard Klaxon groaned as if in pain at the effort .


fn_spacy_tokens_for_baseline: At first Anne felt indignant with Joe , but when she thought it over , realised the good sense of his warning .

source_bert_toks: at first anne felt ind ##ignant with joe , but when she thought it over , realised the good sense of his warning .

reference_raw: At first, Anna was angry with Joe, but when she thought about it, she realized that he had a good sense of warning.

reference_spacy_tokens: At first , Anna was angry with Joe , but when she thought about it , she realized that he had a good sense of warning .


fn_spacy_tokens_for_baseline: Woolley flattened out , turned right and prowled over the surface for about a quarter of a mile .

source_bert_toks: wool ##ley flattened out , turned right and pro ##wled over the surface for about a quarter of a mile .

reference_raw: Woolley flattened, turned to the right, and swerved over the surface for about a quarter of a mile.

reference_spacy_tokens: Woolley flattened , turned to the right , and swerved over the surface for about a quarter of a mile .


fn_spacy_tokens_for_baseline: When she turned back , the crushed grape was stuck to her belly and sending a thread of juice into the crease of her thigh .

source_bert_toks: when she turned back , the crushed grape was stuck to her belly and sending a thread of juice into the cr ##ease of her thigh .

reference_raw: When she turned back, the crumpled grape was glued to her stomach, sending a thread of juice into the crease of her thigh.

reference_spacy_tokens: When she turned back , the crumpled grape was glued to her stomach , sending a thread of juice into the crease of her thigh .


fn_spacy_tokens_for_baseline: The East India Company expanded the docks at Blackwall , whaling ships operated from the Greenland Dock at Bermondsey , and tea clippers were familiar vessels on the river .

source_bert_toks: the east india company expanded the docks at black ##wall , whaling ships operated from the greenland dock at be ##rm ##ond ##sey , and tea clip ##pers were familiar vessels on the river .

reference_raw: The East India Company extended the docks at Blackwall, whaling ships operating from the Greenland dock in Bermondsey, and tea scissors were familiar vessels on the river.

reference_spacy_tokens: The East India Company extended the docks at Blackwall , whaling ships operating from the Greenland dock in Bermondsey , and tea scissors were familiar vessels on the river .


fn_spacy_tokens_for_baseline: They began to build a roadway using very large hollow blocks .

source_bert_toks: they began to build a roadway using very large hollow blocks .

reference_raw: They started building a road with very large hollow blocks.

reference_spacy_tokens: They started building a road with very large hollow blocks .


fn_spacy_tokens_for_baseline: Bright Eyes : you can keep shampoo out of babies ' eyes by smearing a line of Vaseline just above their eyebrows .

source_bert_toks: bright eyes : you can keep sham ##poo out of babies ' eyes by sm ##earing a line of vase ##line just above their eyebrows .

reference_raw: Bright eyes: you can keep the shampoo out of the children's eyes by staining the line of Vaseline just above their brows.

reference_spacy_tokens: Bright eyes : you can keep the shampoo out of the children 's eyes by staining the line of Vaseline just above their brows .


fn_spacy_tokens_for_baseline: Iran does not yet have the necessary infrastructure to support a nuclear weapons program , although is actively negotiating for purchase of technologies and whole facilities to support all of the above strategies .

source_bert_toks: iran does not yet have the necessary infrastructure to support a nuclear weapons program , although is actively negotiating for purchase of technologies and whole facilities to support all of the above strategies .

reference_raw: Iran does not yet have the necessary infrastructure to support the nuclear arms programme, but it is actively negotiating the purchase of technology and entire equipment to support all of the above strategies.

reference_spacy_tokens: Iran does not yet have the necessary infrastructure to support the nuclear arms programme , but it is actively negotiating the purchase of technology and entire equipment to support all of the above strategies .


fn_spacy_tokens_for_baseline: " Well " - he turned and looked towards the window - " I noticed as I passed that you had a box of Havana cigars , the . the Excepcionales .

source_bert_toks: " well " - he turned and looked towards the window - " i noticed as i passed that you had a box of havana cigar ##s , the . the ex ##ce ##pc ##ional ##es .

reference_raw: "Well," he said, turning to look out the window, "as I passed by, I noticed that you had a pack of Havana cigars, an Excise.

reference_spacy_tokens: " Well , " he said , turning to look out the window , " as I passed by , I noticed that you had a pack of Havana cigars , an Excise .


fn_spacy_tokens_for_baseline: International : Deputies argue over Russia 's new name

source_bert_toks: international : deputies argue over russia ' s new name

reference_raw: International: Representatives are fighting over Russia's new name

reference_spacy_tokens: International : Representatives are fighting over Russia 's new name


fn_spacy_tokens_for_baseline: ' I dislike being the centre of attention . '

source_bert_toks: ' i dislike being the centre of attention . '

reference_raw: "I don't like being the center of attention."

reference_spacy_tokens: " I do n't like being the center of attention . "


fn_spacy_tokens_for_baseline: By the 1880s the mines and foundries , manned by immigrant labour , had begun to outstrip their German rivals in the production of coal and steel .

source_bert_toks: by the 1880s the mines and found ##ries , manned by immigrant labour , had begun to outs ##trip their german rivals in the production of coal and steel .

reference_raw: In the 1880s, mines and foundries, manned by immigrant labor, began to overcome their German rivals in coal and steel production.

reference_spacy_tokens: In the 1880s , mines and foundries , manned by immigrant labor , began to overcome their German rivals in coal and steel production .


fn_spacy_tokens_for_baseline: It 's not bad to succeed , to excel , and it 's always satisfying to solve a difficulty .

source_bert_toks: it ' s not bad to succeed , to excel , and it ' s always satisfying to solve a difficulty .

reference_raw: It's not wrong to succeed, to excel, and it's always satisfying to solve a problem.

reference_spacy_tokens: It 's not wrong to succeed , to excel , and it 's always satisfying to solve a problem .


fn_spacy_tokens_for_baseline: It is suggested that stability testing should be a continuing process involving samples from each stage of the development of a product .

source_bert_toks: it is suggested that stability testing should be a continuing process involving samples from each stage of the development of a product .

reference_raw: It is proposed that stability trials should be a continuous process involving samples from each stage of product development.

reference_spacy_tokens: It is proposed that stability trials should be a continuous process involving samples from each stage of product development .


fn_spacy_tokens_for_baseline: The helicopter clatters overhead .

source_bert_toks: the helicopter cl ##atter ##s overhead .

reference_raw: The helicopter is crashing overhead.

reference_spacy_tokens: The helicopter is crashing overhead .


fn_spacy_tokens_for_baseline: After the autumn and winter rains the stream becomes a raging torrent , flowing in places along a deep ravine .

source_bert_toks: after the autumn and winter rains the stream becomes a raging torre ##nt , flowing in places along a deep ravine .

reference_raw: After autumn and winter rains, the stream becomes a raging torrent, flowing in places along a dark ravine.

reference_spacy_tokens: After autumn and winter rains , the stream becomes a raging torrent , flowing in places along a dark ravine .


fn_spacy_tokens_for_baseline: Memories died : and the dead dogs ' bones , picked bare by the vultures , had been scattered on the shingle or swept into the river now flooded with melted mountain snow .

source_bert_toks: memories died : and the dead dogs ' bones , picked bare by the vulture ##s , had been scattered on the shin ##gle or swept into the river now flooded with melted mountain snow .

reference_raw: The memories died: and the bones of the dead dogs, harvested naked by the vultures, were scattered on a shingle or swept into a river that was now flooded with molted mountain snow.

reference_spacy_tokens: The memories died : and the bones of the dead dogs , harvested naked by the vultures , were scattered on a shingle or swept into a river that was now flooded with molted mountain snow .


fn_spacy_tokens_for_baseline: There would be freedom of movement between the zones and limited settlement rights .

source_bert_toks: there would be freedom of movement between the zones and limited settlement rights .

reference_raw: Free movement between areas and limited settlement rights would exist.

reference_spacy_tokens: Free movement between areas and limited settlement rights would exist .


fn_spacy_tokens_for_baseline: Although he liked to be admired for his prowess , he did n't like male - talk of that kind .

source_bert_toks: although he liked to be admired for his prowess , he didn ' t like male - talk of that kind .

reference_raw: Though he liked to be appreciated for his prowess, he didn't like that kind of man talk.

reference_spacy_tokens: Though he liked to be appreciated for his prowess , he did n't like that kind of man talk .


fn_spacy_tokens_for_baseline: He died in 1942 and it is my lasting regret that after I left Oxford I did not see him again ; I still have the letters he wrote me when I was in the Sudan .

source_bert_toks: he died in 1942 and it is my lasting regret that after i left oxford i did not see him again ; i still have the letters he wrote me when i was in the sudan .

reference_raw: He died in 1942, and I'm sorry I never saw him again after I left Oxford; I still have the letters he wrote to me when I was in Sudan.

reference_spacy_tokens: He died in 1942 , and I 'm sorry I never saw him again after I left Oxford ; I still have the letters he wrote to me when I was in Sudan .


fn_spacy_tokens_for_baseline: Sighs of relief stuck in my throat as the cacophony of rumbles and clangs which portends a tractor with a roller in tow , carried round the corner .

source_bert_toks: sighs of relief stuck in my throat as the ca ##co ##phon ##y of rumble ##s and clan ##gs which porte ##nds a tractor with a roller in tow , carried round the corner .

reference_raw: There were sighs of relief in my throat as the cacophony of thunder and clangs that portrayed a tractor with a roller towed around the corner.

reference_spacy_tokens: There were sighs of relief in my throat as the cacophony of thunder and clangs that portrayed a tractor with a roller towed around the corner .


fn_spacy_tokens_for_baseline: Heavy machinery : Machines can range widely from bandsaws to bottling plants .

source_bert_toks: heavy machinery : machines can range widely from bands ##aw ##s to bot ##tling plants .

reference_raw: Heavy machinery: Machines can vary widely from bandsaws to bottling plants.

reference_spacy_tokens: Heavy machinery : Machines can vary widely from bandsaws to bottling plants .


fn_spacy_tokens_for_baseline: Yelling and whistling , the audience begged for more .

source_bert_toks: yelling and whistling , the audience begged for more .

reference_raw: The audience shouted and whistled, asking for more.

reference_spacy_tokens: The audience shouted and whistled , asking for more .


fn_spacy_tokens_for_baseline: It is less sure that anyone in 1975 could have foreseen the dramatic increase in the demand for places in the ten years to follow .

source_bert_toks: it is less sure that anyone in 1975 could have fore ##see ##n the dramatic increase in the demand for places in the ten years to follow .

reference_raw: It is less certain that anyone in 1975 could predict a dramatic increase in demand for jobs in the next ten years.

reference_spacy_tokens: It is less certain that anyone in 1975 could predict a dramatic increase in demand for jobs in the next ten years .


fn_spacy_tokens_for_baseline: Keep textiles out of light , which both fades dyes and supplies the energy to begin the process of breaking the fibres down , as with the shredded silk curtains of many a National Trust mansion .

source_bert_toks: keep textiles out of light , which both fades dye ##s and supplies the energy to begin the process of breaking the fibre ##s down , as with the shredded silk curtains of many a national trust mansion .

reference_raw: Keep the fabrics out of the light, which will both fade the dyes and give the energy to begin the process of tearing down the fibres, like the torn silk curtains of many of the National Trustees.

reference_spacy_tokens: Keep the fabrics out of the light , which will both fade the dyes and give the energy to begin the process of tearing down the fibres , like the torn silk curtains of many of the National Trustees .


fn_spacy_tokens_for_baseline: It once took 12 men to ring the great bell in the west tower , a task now accomplished with electricity .

source_bert_toks: it once took 12 men to ring the great bell in the west tower , a task now accomplished with electricity .

reference_raw: It had once taken twelve men to ring the big bell in the western tower, a task now accomplished with electricity.

reference_spacy_tokens: It had once taken twelve men to ring the big bell in the western tower , a task now accomplished with electricity .


fn_spacy_tokens_for_baseline: The fact that some supposedly knowledgeable people think the two incompatible just shows how ignorant they are .

source_bert_toks: the fact that some supposedly knowledge ##able people think the two incompatible just shows how ignorant they are .

reference_raw: The fact that some supposedly knowledgeable people think that these two are not compatible only shows how ignorant they are.

reference_spacy_tokens: The fact that some supposedly knowledgeable people think that these two are not compatible only shows how ignorant they are .


fn_spacy_tokens_for_baseline: You can also cross the Brenner Pass and visit Austria or from the western Alps , venture into Switzerland at the foot of the famous Matterhorn .

source_bert_toks: you can also cross the br ##enne ##r pass and visit austria or from the western alps , venture into switzerland at the foot of the famous matter ##horn .

reference_raw: You can also cross the Brenner Pass and go to Austria or the Western Alps and venture to Switzerland at the foot of the famous Matterhorn.

reference_spacy_tokens: You can also cross the Brenner Pass and go to Austria or the Western Alps and venture to Switzerland at the foot of the famous Matterhorn .


fn_spacy_tokens_for_baseline: That means lengthy and usually uncomfortable treatment .

source_bert_toks: that means lengthy and usually uncomfortable treatment .

reference_raw: This means long and usually uncomfortable treatment.

reference_spacy_tokens: This means long and usually uncomfortable treatment .


fn_spacy_tokens_for_baseline: No wonder his precious had ripped his throat out .

source_bert_toks: no wonder his precious had ripped his throat out .

reference_raw: No wonder his precious man tore his throat out.

reference_spacy_tokens: No wonder his precious man tore his throat out .


fn_spacy_tokens_for_baseline: Her father had been maimed while on duty in Ireland , and she herself had been sold into virtual slavery there , where she had been seduced and made pregnant .

source_bert_toks: her father had been mai ##med while on duty in ireland , and she herself had been sold into virtual slavery there , where she had been seduce ##d and made pregnant .

reference_raw: When she was on duty in Ireland, her father was crippled, and she herself was sold to virtual slavery, where she was seduced and pregnant.

reference_spacy_tokens: When she was on duty in Ireland , her father was crippled , and she herself was sold to virtual slavery , where she was seduced and pregnant .


fn_spacy_tokens_for_baseline: It was boring for them and now they go out they spend some time er amongst each other and they have time to chat around .

source_bert_toks: it was boring for them and now they go out they spend some time er amongst each other and they have time to chat around .

reference_raw: It was boring for them, and now they're going out for a while, er, and they've got time to talk.

reference_spacy_tokens: It was boring for them , and now they 're going out for a while , er , and they 've got time to talk .


fn_spacy_tokens_for_baseline: The screech died away to a strangulated hissing as though the victim had clamped his lower lip with his teeth , biting with all the force of a steel beast - trap .

source_bert_toks: the sc ##ree ##ch died away to a st ##rang ##ulated hissing as though the victim had clamped his lower lip with his teeth , biting with all the force of a steel beast - trap .

reference_raw: The scream died away in a strangled hiss, as if the victim had clamped his teeth against his lower mouth, biting with the strength of a steel animal trap.

reference_spacy_tokens: The scream died away in a strangled hiss , as if the victim had clamped his teeth against his lower mouth , biting with the strength of a steel animal trap .


fn_spacy_tokens_for_baseline: George was not abashed .

source_bert_toks: george was not aba ##shed .

reference_raw: George wasn't embarrassed.

reference_spacy_tokens: George was n't embarrassed .


fn_spacy_tokens_for_baseline: I remembered his amusement about such underwear on his first evening at Sleet , how he subsided into laughter , infectious to everyone but me .

source_bert_toks: i remembered his amusement about such underwear on his first evening at sl ##eet , how he subsided into laughter , infectious to everyone but me .

reference_raw: I remembered how he had been amused by such underwear on his first night in Sleet, how he had subsided in laughter, infectious to everyone but me.

reference_spacy_tokens: I remembered how he had been amused by such underwear on his first night in Sleet , how he had subsided in laughter , infectious to everyone but me .


fn_spacy_tokens_for_baseline: What had happened in Amsterdam at the Strickers ' had stunned him -- as if he had been standing too long ' against a church wall ' .

source_bert_toks: what had happened in amsterdam at the st ##rick ##ers ' had stunned him - - as if he had been standing too long ' against a church wall ' .

reference_raw: He was stunned by the events of the Strickers in Amsterdam - as if he had stood too long against the wall of the church.

reference_spacy_tokens: He was stunned by the events of the Strickers in Amsterdam - as if he had stood too long against the wall of the church .


fn_spacy_tokens_for_baseline: On Thursday night Chris came out in dark red blotches .

source_bert_toks: on thursday night chris came out in dark red b ##lot ##ches .

reference_raw: On Thursday night Chris appeared in dark red spots.

reference_spacy_tokens: On Thursday night Chris appeared in dark red spots .


fn_spacy_tokens_for_baseline: Downes shook his head in stupefaction .

source_bert_toks: down ##es shook his head in stu ##pe ##fa ##ction .

reference_raw: Downes shook his head numbly.

reference_spacy_tokens: Downes shook his head numbly .


fn_spacy_tokens_for_baseline: ' Well , just as well , ' Simone said ; ' after all , you 're engaged .

source_bert_toks: ' well , just as well , ' simone said ; ' after all , you ' re engaged .

reference_raw: 'Well, that's a good thing,' said Simone, 'you're betrothed after all.

reference_spacy_tokens: ' Well , that 's a good thing , ' said Simone , ' you 're betrothed after all .


fn_spacy_tokens_for_baseline: East Germany 's entry to the Common Market looks a little less certain .

source_bert_toks: east germany ' s entry to the common market looks a little less certain .

reference_raw: The accession of East Germany to the common market seems a little less certain.

reference_spacy_tokens: The accession of East Germany to the common market seems a little less certain .


fn_spacy_tokens_for_baseline: A passing farmer said he was strong enough to prise open the bars with his bare hands .

source_bert_toks: a passing farmer said he was strong enough to pri ##se open the bars with his bare hands .

reference_raw: A passing farmer said he was strong enough to open the bars with his naked hands.

reference_spacy_tokens: A passing farmer said he was strong enough to open the bars with his naked hands .


fn_spacy_tokens_for_baseline: Beside this a man in blue overalls , wearing a cheap aluminium facemask , is cutting off the strip he has just laid between the joists .

source_bert_toks: beside this a man in blue overall ##s , wearing a cheap aluminium face ##mas ##k , is cutting off the strip he has just laid between the jo ##ists .

reference_raw: Beside him, a guy in a blue overalls, wearing a cheap aluminum mask, cuts off the strip he'd just laid between the joists.

reference_spacy_tokens: Beside him , a guy in a blue overalls , wearing a cheap aluminum mask , cuts off the strip he 'd just laid between the joists .


fn_spacy_tokens_for_baseline: There 's only one way you can cripple a bad scientist , and that 's to demonstrate how bad his science is .

source_bert_toks: there ' s only one way you can cr ##ip ##ple a bad scientist , and that ' s to demonstrate how bad his science is .

reference_raw: There's only one way to cripple a bad researcher, and that's to show how bad his science is.

reference_spacy_tokens: There 's only one way to cripple a bad researcher , and that 's to show how bad his science is .


fn_spacy_tokens_for_baseline: Facing the strong wind in the first half , Aldershot defended superbly .

source_bert_toks: facing the strong wind in the first half , al ##ders ##hot defended superb ##ly .

reference_raw: As Aldershot faced the heavy wind in the first half, he defended himself perfectly.

reference_spacy_tokens: As Aldershot faced the heavy wind in the first half , he defended himself perfectly .


fn_spacy_tokens_for_baseline: " They had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

source_bert_toks: " they had several metres still to go when it became too hot and we had to evacuate them because it would have endangered them . "

reference_raw: "They had a few more meters to go when it got hot, and we had to evacuate them because they'd be in danger."

reference_spacy_tokens: " They had a few more meters to go when it got hot , and we had to evacuate them because they 'd be in danger . "


fn_spacy_tokens_for_baseline: Taking advantage of the discretionary powers granted him by the tsar , he asked for a treaty guaranteeing Russia 's right to a protectorate over the Orthodox Christians of the Ottoman Empire .

source_bert_toks: taking advantage of the discretion ##ary powers granted him by the tsar , he asked for a treaty guarantee ##ing russia ' s right to a protectorate over the orthodox christians of the ottoman empire .

reference_raw: Using the discretionary powers vested in him by the Tsar, he requested a treaty guaranteeing Russia's right to protectorate over the Orthodox Christens of the Ottoman Empire.

reference_spacy_tokens: Using the discretionary powers vested in him by the Tsar , he requested a treaty guaranteeing Russia 's right to protectorate over the Orthodox Christens of the Ottoman Empire .


fn_spacy_tokens_for_baseline: More of these ' coldwater tropicals ' are housed in outside containers which are planted with Water Lettuce .

source_bert_toks: more of these ' cold ##water tropical ##s ' are housed in outside containers which are planted with water let ##tu ##ce .

reference_raw: More of these "cold water tropics" are stored in outer containers planted with water salad.

reference_spacy_tokens: More of these " cold water tropics " are stored in outer containers planted with water salad .


fn_spacy_tokens_for_baseline: When he took his BA at Oxford Wren 's forename was Percy ; during his years in the IES he changed this to Percival , and it was only when he became an author that he added Christopher .

source_bert_toks: when he took his ba at oxford wren ' s fore ##name was percy ; during his years in the ie ##s he changed this to percival , and it was only when he became an author that he added christopher .

reference_raw: When he took his first name from Oxford Wren, Percy was Percy; during his years in the IES, he changed it to Percival, and only when he was a writer did he add Christopher.

reference_spacy_tokens: When he took his first name from Oxford Wren , Percy was Percy ; during his years in the IES , he changed it to Percival , and only when he was a writer did he add Christopher .


fn_spacy_tokens_for_baseline: Perhaps illness had dulled his recollection .

source_bert_toks: perhaps illness had dull ##ed his rec ##oll ##ection .

reference_raw: Maybe the disease dulled his memory.

reference_spacy_tokens: Maybe the disease dulled his memory .


fn_spacy_tokens_for_baseline: It 's showin ' 52 all day .

source_bert_toks: it ' s show ##in ' 52 all day .

reference_raw: It's been in '52 all the time.

reference_spacy_tokens: It 's been in ' 52 all the time .


fn_spacy_tokens_for_baseline: I turned and saw my saviour , the wench with black curly hair from the tavern .

source_bert_toks: i turned and saw my sa ##vio ##ur , the wen ##ch with black curly hair from the tavern .

reference_raw: I turned and saw my savior, a wench with black curls of hair from the inn.

reference_spacy_tokens: I turned and saw my savior , a wench with black curls of hair from the inn .


fn_spacy_tokens_for_baseline: They had three sent off , the assistant manager Terry McDermott was apparently cautioned , there was a bomb scare and a pitch invasion was averted by police .

source_bert_toks: they had three sent off , the assistant manager terry mc ##dermott was apparently caution ##ed , there was a bomb scare and a pitch invasion was ave ##rted by police .

reference_raw: Three were sent away, Terry McDermott's assistant manager was obviously warned, there was a bomb scare, and the police stopped a pitch invasion.

reference_spacy_tokens: Three were sent away , Terry McDermott 's assistant manager was obviously warned , there was a bomb scare , and the police stopped a pitch invasion .


fn_spacy_tokens_for_baseline: She felt disquieted at the lack of interest the girl had shown -- anything might happen in this sort of house , she told herself indignantly .

source_bert_toks: she felt di ##s ##qui ##ete ##d at the lack of interest the girl had shown - - anything might happen in this sort of house , she told herself ind ##ignant ##ly .

reference_raw: She was unsettled by the lack of interest the girl had shown - anything could happen in a house like this, she thought indignantly.

reference_spacy_tokens: She was unsettled by the lack of interest the girl had shown - anything could happen in a house like this , she thought indignantly .


fn_spacy_tokens_for_baseline: This was a formal combat to settle a territorial dispute .

source_bert_toks: this was a formal combat to settle a territorial dispute .

reference_raw: It was a formal battle to settle a territorial dispute.

reference_spacy_tokens: It was a formal battle to settle a territorial dispute .


fn_spacy_tokens_for_baseline: I shall make it clear to those moronic malcontents on the terraces that I have no intention of quitting .

source_bert_toks: i shall make it clear to those mor ##onic mal ##con ##ten ##ts on the terraces that i have no intention of quit ##ting .

reference_raw: I'll explain to those idiotic malcontents on the terraces that I don't intend to leave.

reference_spacy_tokens: I 'll explain to those idiotic malcontents on the terraces that I do n't intend to leave .


fn_spacy_tokens_for_baseline: Indeed , although their tactics were laudable , how many times did the England backline movement really look like succeeding in the Final ?

source_bert_toks: indeed , although their tactics were lau ##dable , how many times did the england back ##line movement really look like succeeding in the final ?

reference_raw: In fact, while their tactics were commendable, how many times did the English back-up movement really look like a success in the Finals?

reference_spacy_tokens: In fact , while their tactics were commendable , how many times did the English back - up movement really look like a success in the Finals ?


fn_spacy_tokens_for_baseline: He started to hum through his nose .

source_bert_toks: he started to hum through his nose .

reference_raw: He began buzzing through his nose.

reference_spacy_tokens: He began buzzing through his nose .


fn_spacy_tokens_for_baseline: He found the Prioress alone in her chamber , the table before her strewn with manuscripts .

source_bert_toks: he found the prior ##ess alone in her chamber , the table before her strewn with manuscripts .

reference_raw: He found the Prioress alone in her room, a desk littered with manuscripts in front of her.

reference_spacy_tokens: He found the Prioress alone in her room , a desk littered with manuscripts in front of her .


fn_spacy_tokens_for_baseline: For political reasons , no single definition has been accepted worldwide and several different ones are in current use .

source_bert_toks: for political reasons , no single definition has been accepted worldwide and several different ones are in current use .

reference_raw: For political reasons, there is no uniform definition in the world and a number of different definitions are currently being used.

reference_spacy_tokens: For political reasons , there is no uniform definition in the world and a number of different definitions are currently being used .


fn_spacy_tokens_for_baseline: While all the other pros were complaining about the course length , Daly was revelling in it .

source_bert_toks: while all the other pro ##s were complaining about the course length , daly was rev ##elling in it .

reference_raw: While all the other professionals complained about the length of the course, Daly was enjoying it.

reference_spacy_tokens: While all the other professionals complained about the length of the course , Daly was enjoying it .


fn_spacy_tokens_for_baseline: It should be noted also that Cognitive - Behaviour Therapy has been applied beyond psychiatric disorders to the problems of offenders and to people with learning difficulties .

source_bert_toks: it should be noted also that cognitive - behaviour therapy has been applied beyond psychiatric disorders to the problems of offenders and to people with learning difficulties .

reference_raw: It should also be noted that cognitive-behavior therapy is applied beyond psychiatric conditions to the problems of perpetrators and people with learning difficulties.

reference_spacy_tokens: It should also be noted that cognitive - behavior therapy is applied beyond psychiatric conditions to the problems of perpetrators and people with learning difficulties .


fn_spacy_tokens_for_baseline: He found Zacco lightly intoxicated , and playing dice for high stakes among a circle of friends .

source_bert_toks: he found zac ##co lightly into ##xi ##cated , and playing dice for high stakes among a circle of friends .

reference_raw: He found Zacco lightly drunk, playing dice for high stakes among the circles of friends.

reference_spacy_tokens: He found Zacco lightly drunk , playing dice for high stakes among the circles of friends .


fn_spacy_tokens_for_baseline: The celibate woman was seen as having been freed from the ' curse of Eve ' , to bear children in sorrow and to be under the domination of the male .

source_bert_toks: the ce ##lib ##ate woman was seen as having been freed from the ' curse of eve ' , to bear children in sorrow and to be under the domination of the male .

reference_raw: The celibate woman was considered free from the curse of Eve, to carry children in mourning and to be under the control of a man.

reference_spacy_tokens: The celibate woman was considered free from the curse of Eve , to carry children in mourning and to be under the control of a man .


fn_spacy_tokens_for_baseline: Thin drizzle dampened the pavement , which gleamed in reflection of the oil - lamps within .

source_bert_toks: thin dr ##iz ##zle damp ##ened the pavement , which gleamed in reflection of the oil - lamps within .

reference_raw: A thin drizzle dampened the sidewalk, gleaming in the reflection of the oil lamps inside.

reference_spacy_tokens: A thin drizzle dampened the sidewalk , gleaming in the reflection of the oil lamps inside .


fn_spacy_tokens_for_baseline: One counsellor described the feelings of some single women at midlife who come to her , unable to understand their renewed anguish .

source_bert_toks: one counsel ##lor described the feelings of some single women at mid ##life who come to her , unable to understand their renewed anguish .

reference_raw: One of the counselors described the feelings of some unmarried middle-aged women who came to her, unable to understand their renewed anguish.

reference_spacy_tokens: One of the counselors described the feelings of some unmarried middle - aged women who came to her , unable to understand their renewed anguish .


fn_spacy_tokens_for_baseline: He grinned his wide toothless grin at her and made his way unsteadily across the room to her side .

source_bert_toks: he grinned his wide tooth ##less grin at her and made his way un ##stead ##ily across the room to her side .

reference_raw: He smiled at her with a wide, toothless smile and made his way unsteadily across the room to her side.

reference_spacy_tokens: He smiled at her with a wide , toothless smile and made his way unsteadily across the room to her side .


fn_spacy_tokens_for_baseline: During her visit she had two frightening experiences .

source_bert_toks: during her visit she had two frightening experiences .

reference_raw: She had two terrible experiences during her visit.

reference_spacy_tokens: She had two terrible experiences during her visit .


fn_spacy_tokens_for_baseline: China has also been involved in several other sales to Iran , involving CW technology ; as a result , several Chinese companies and individuals have faced American sanctions .

source_bert_toks: china has also been involved in several other sales to iran , involving cw technology ; as a result , several chinese companies and individuals have faced american sanctions .

reference_raw: China was also involved in a number of other sales to Iran, including CW technology; as a result, a number of Chinese companies and individuals were facing US sanctions.

reference_spacy_tokens: China was also involved in a number of other sales to Iran , including CW technology ; as a result , a number of Chinese companies and individuals were facing US sanctions .


fn_spacy_tokens_for_baseline: In mid-2002 , U.S. intelligence discovered that North Korea had been receiving materials from Pakistan for a highly enriched uranium production facility .

source_bert_toks: in mid - 2002 , u . s . intelligence discovered that north korea had been receiving materials from pakistan for a highly enriched uranium production facility .

reference_raw: In mid-2002, U.S. Intelligence discovered that North Korea was receiving material from Pakistan for a highly enriched uranium facility.

reference_spacy_tokens: In mid-2002 , U.S. Intelligence discovered that North Korea was receiving material from Pakistan for a highly enriched uranium facility .


fn_spacy_tokens_for_baseline: He denounced the old religion as the Lie and called on men to worship the deity whom he called Ahura Mazdah , the wise Lord , who stood for the Truth .

source_bert_toks: he denounced the old religion as the lie and called on men to worship the deity whom he called ah ##ura mazda ##h , the wise lord , who stood for the truth .

reference_raw: He condemned the old religion as a lie and called upon men to worship the God he called Ahura Mazdah, the wise Lord who stood for the truth.

reference_spacy_tokens: He condemned the old religion as a lie and called upon men to worship the God he called Ahura Mazdah , the wise Lord who stood for the truth .


fn_spacy_tokens_for_baseline: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear weapon state in 1991 , and International Atomic Energy Agency ( IAEA ) inspectors subsequently verified the completeness of its nuclear dismantlement .

source_bert_toks: south africa acc ##eded to the treaty on the non - proliferation of nuclear weapons ( np ##t ) as a non - nuclear weapon state in 1991 , and international atomic energy agency ( ia ##ea ) inspectors subsequently verified the complete ##ness of its nuclear di ##sman ##tlement .

reference_raw: South Africa acceded to the Treaty on the Non-Proliferation of Nuclear Weapons (NPT) as a non-nuclear state in 1991 and the International Atomic Energy Agency (IAEA) inspectors subsequently verified the completeness of their nuclear dismantling.

reference_spacy_tokens: South Africa acceded to the Treaty on the Non - Proliferation of Nuclear Weapons ( NPT ) as a non - nuclear state in 1991 and the International Atomic Energy Agency ( IAEA ) inspectors subsequently verified the completeness of their nuclear dismantling .


fn_spacy_tokens_for_baseline: The Soviet Union was then supplying Iraq with the Scud - B and those countries to which the Soviets had previously sold Scud - Bs were under contract not to transfer them to third parties .

source_bert_toks: the soviet union was then supplying iraq with the sc ##ud - b and those countries to which the soviets had previously sold sc ##ud - bs were under contract not to transfer them to third parties .

reference_raw: The Soviet Union then supplied the Scud-B to Iraq, and the countries to which the Soviets had previously sold the Scud-Bs had a contract not to give them to third parties.

reference_spacy_tokens: The Soviet Union then supplied the Scud - B to Iraq , and the countries to which the Soviets had previously sold the Scud - Bs had a contract not to give them to third parties .


fn_spacy_tokens_for_baseline: ' We figured , ' their leader said in an almost respectful tone , ' that if anyone might have heard thing or two on this world it 'd be you , Mister Curb , Miz Yorder . '

source_bert_toks: ' we figured , ' their leader said in an almost respectful tone , ' that if anyone might have heard thing or two on this world it ' d be you , mister curb , mi ##z yo ##rder . '

reference_raw: 'We thought,' said their leader, almost respectfully, 'that if anyone could hear anything in this world, it would be you, Mr Curb, Miz Yorder.'

reference_spacy_tokens: ' We thought , ' said their leader , almost respectfully , ' that if anyone could hear anything in this world , it would be you , Mr Curb , Miz Yorder . '


fn_spacy_tokens_for_baseline: Instead of replying , Anna countered with a question of her own .

source_bert_toks: instead of reply ##ing , anna countered with a question of her own .

reference_raw: Instead of answering, Anna answered her own question.

reference_spacy_tokens: Instead of answering , Anna answered her own question .


fn_spacy_tokens_for_baseline: For three hours she had tried to analyse it away , her nerves sharpened , her skin alive with the sharp torment of physical arousal .

source_bert_toks: for three hours she had tried to anal ##yse it away , her nerves sharpened , her skin alive with the sharp torment of physical arousal .

reference_raw: For three hours she tried to analyze it, her nerves sharpened, her skin alive with the sharp agony of physical excitement.

reference_spacy_tokens: For three hours she tried to analyze it , her nerves sharpened , her skin alive with the sharp agony of physical excitement .


fn_spacy_tokens_for_baseline: But Jerry 's troubles did n't end there .

source_bert_toks: but jerry ' s troubles didn ' t end there .

reference_raw: But that's not where Jerry's troubles stopped.

reference_spacy_tokens: But that 's not where Jerry 's troubles stopped .


fn_spacy_tokens_for_baseline: He worked without an easel and with the minimum of fuss , placing his canvas on a chair and painting quietly , ' interrupting only now and then to take a gulp of alcohol from a bottle .

source_bert_toks: he worked without an ease ##l and with the minimum of fuss , placing his canvas on a chair and painting quietly , ' interrupting only now and then to take a gulp of alcohol from a bottle .

reference_raw: He worked without a easel and with a minimum of commotion, laid the canvas on a chair and quietly painted, "I interrupt only occasionally to drink from the bottle.

reference_spacy_tokens: He worked without a easel and with a minimum of commotion , laid the canvas on a chair and quietly painted , " I interrupt only occasionally to drink from the bottle .


fn_spacy_tokens_for_baseline: She watched as they scrambled from the truck , running after Lais , wishing their footsteps did n't crunch so loudly on the gravel .

source_bert_toks: she watched as they scrambled from the truck , running after lai ##s , wishing their footsteps didn ' t crunch so loudly on the gravel .

reference_raw: She watched them get out of the car and run after Lais, wishing their feet hadn't cracked so loudly on the gravel.

reference_spacy_tokens: She watched them get out of the car and run after Lais , wishing their feet had n't cracked so loudly on the gravel .


fn_spacy_tokens_for_baseline: The jury deliberated the case for more than three days before reaching its decision Tuesday .

source_bert_toks: the jury deliberate ##d the case for more than three days before reaching its decision tuesday .

reference_raw: The jury considered the case for more than three days before deciding on Tuesday.

reference_spacy_tokens: The jury considered the case for more than three days before deciding on Tuesday .


fn_spacy_tokens_for_baseline: Lucy had been approached by an international humanist organisation , there was funding , and Lucy was raring to go .

source_bert_toks: lucy had been approached by an international humanist organisation , there was funding , and lucy was ra ##ring to go .

reference_raw: Lucy was approached by an international humanist organization, and there was funding, and Lucy ventured to leave.

reference_spacy_tokens: Lucy was approached by an international humanist organization , and there was funding , and Lucy ventured to leave .


fn_spacy_tokens_for_baseline: Character is probed by handwriting analysts .

source_bert_toks: character is probe ##d by handwriting analysts .

reference_raw: The character is examined by handwriting analysts.

reference_spacy_tokens: The character is examined by handwriting analysts .


fn_spacy_tokens_for_baseline: She studied the sergeant with a twinkle of amusement in her eyes .

source_bert_toks: she studied the sergeant with a twinkle of amusement in her eyes .

reference_raw: She looked at the sergeant with a flash of amusement in her eyes.

reference_spacy_tokens: She looked at the sergeant with a flash of amusement in her eyes .


fn_spacy_tokens_for_baseline: There were suspicions about the role that Conservative Central Office played in orchestrating some of these manoeuvres .

source_bert_toks: there were suspicions about the role that conservative central office played in orchestra ##ting some of these man ##oe ##u ##vres .

reference_raw: They suspected the role played by the Conservative Central Office in orchestrating some of these maneuvers.

reference_spacy_tokens: They suspected the role played by the Conservative Central Office in orchestrating some of these maneuvers .


fn_spacy_tokens_for_baseline: I noticed bunches and bunches of grain and seaweed , marguerites and long - stemmed buttercups drying in the pantry , for winter . '

source_bert_toks: i noticed bunch ##es and bunch ##es of grain and sea ##weed , marguerite ##s and long - stemmed butter ##cup ##s drying in the pantry , for winter . '

reference_raw: I noticed a lot of grains and seaweeds, marguerites and long-stemmed buttercups drying in the pantry for the winter.'

reference_spacy_tokens: I noticed a lot of grains and seaweeds , marguerites and long - stemmed buttercups drying in the pantry for the winter . '


fn_spacy_tokens_for_baseline: Herge 's widow and Tintin aficionados do not deny the Tintin cartoons may have overtones about drinking , but they do not want Tintin pigeonholed as a boy with a drinking problem .

source_bert_toks: her ##ge ' s widow and tin ##tin afi ##cion ##ados do not deny the tin ##tin cartoons may have over ##tones about drinking , but they do not want tin ##tin pigeon ##hole ##d as a boy with a drinking problem .

reference_raw: Herge's widow and Tintin's aficionados don't deny that the Tintin cartoons may have too much to drink, but they don't want Tin's pigeon holed up like a kid with a drinking problem.

reference_spacy_tokens: Herge 's widow and Tintin 's aficionados do n't deny that the Tintin cartoons may have too much to drink , but they do n't want Tin 's pigeon holed up like a kid with a drinking problem .


fn_spacy_tokens_for_baseline: Nyerere 's reputation as an individual remains high and was reinforced by his decision to resign as president in late 1985 .

source_bert_toks: ny ##ere ##re ' s reputation as an individual remains high and was reinforced by his decision to resign as president in late 1985 .

reference_raw: The reputation of Nyerere as an individual remains high and has been strengthened by his decision to resign from the presidency at the end of 1985.

reference_spacy_tokens: The reputation of Nyerere as an individual remains high and has been strengthened by his decision to resign from the presidency at the end of 1985 .


fn_spacy_tokens_for_baseline: The notion that tracking is somehow " undemocratic " is absurd .

source_bert_toks: the notion that tracking is somehow " und ##em ##oc ##ratic " is absurd .

reference_raw: The idea that tracking is somehow undemocratic is ludicrous.

reference_spacy_tokens: The idea that tracking is somehow undemocratic is ludicrous .


fn_spacy_tokens_for_baseline: Emmie got up , trying not to creak the chair .

source_bert_toks: em ##mie got up , trying not to cr ##eak the chair .

reference_raw: Emmie stood up and tried not to squeak in the chair.

reference_spacy_tokens: Emmie stood up and tried not to squeak in the chair .


fn_spacy_tokens_for_baseline: Paul unconsciously strokes his widow 's peak with thumb and forefinger .

source_bert_toks: paul unconscious ##ly strokes his widow ' s peak with thumb and fore ##finger .

reference_raw: Involuntarily, Paul strokes the top of his widow with his thumb and index finger.

reference_spacy_tokens: Involuntarily , Paul strokes the top of his widow with his thumb and index finger .


fn_spacy_tokens_for_baseline: Also , hormonal changes during the month can alter the chemistry of a perfume on our skin , so what smells great today may be decidedly ' iffy ' by next Thursday .

source_bert_toks: also , ho ##rm ##onal changes during the month can alter the chemistry of a perfume on our skin , so what smells great today may be decidedly ' if ##fy ' by next thursday .

reference_raw: Also, the hormonal changes in the month may change the chemical composition of the perfume on our skin, so what stinks good today can definitely be 'iffy' by next Thursday.

reference_spacy_tokens: Also , the hormonal changes in the month may change the chemical composition of the perfume on our skin , so what stinks good today can definitely be ' iffy ' by next Thursday .


fn_spacy_tokens_for_baseline: Vessels can be accepted of 140 m length and 7.4 m draught .

source_bert_toks: vessels can be accepted of 140 ##m length and 7 . 4 ##m draught .

reference_raw: Vessels of 140 m long and 7.4 m draughts may be accepted.

reference_spacy_tokens: Vessels of 140 m long and 7.4 m draughts may be accepted .


fn_spacy_tokens_for_baseline: They can be of great service in transmitting the Faith , even though they can never replace the personal witness which is essential to the proclamation of the full truth and value of the Christian message .

source_bert_toks: they can be of great service in transmitting the faith , even though they can never replace the personal witness which is essential to the proclamation of the full truth and value of the christian message .

reference_raw: They can be very helpful in conveying the Faith, although they can never replace a personal witness that is necessary to declare the full truth and value of the Christian message.

reference_spacy_tokens: They can be very helpful in conveying the Faith , although they can never replace a personal witness that is necessary to declare the full truth and value of the Christian message .


fn_spacy_tokens_for_baseline: The last British government in Uganda , initially seeking an integrated state in recognition of local realities , was forced to contrive a more or less federal one .

source_bert_toks: the last british government in uganda , initially seeking an integrated state in recognition of local realities , was forced to con ##tri ##ve a more or less federal one .

reference_raw: The last British government in Uganda, which initially sought an integrated state to recognize local realities, was forced to conspire to a more or less federal state.

reference_spacy_tokens: The last British government in Uganda , which initially sought an integrated state to recognize local realities , was forced to conspire to a more or less federal state .


fn_spacy_tokens_for_baseline: It 's also a city of the imagination , reinvented and reappraised in the literature of its exiles .

source_bert_toks: it ' s also a city of the imagination , rein ##vent ##ed and re ##app ##rai ##sed in the literature of its exiles .

reference_raw: It is also a city of imagination, reconstructed and re-appraised in the literature of its exiles.

reference_spacy_tokens: It is also a city of imagination , reconstructed and re - appraised in the literature of its exiles .


fn_spacy_tokens_for_baseline: There are memories you never forget -- and they are revolting memories -- and here they come again .

source_bert_toks: there are memories you never forget - - and they are revolt ##ing memories - - and here they come again .

reference_raw: There are memories that you never forget-and they are repulsive memories-and here they come again.

reference_spacy_tokens: There are memories that you never forget - and they are repulsive memories - and here they come again .


fn_spacy_tokens_for_baseline: This new power to presume guilt of unspecified offences was advertised as a unique response to the unique evil of drug trafficking .

source_bert_toks: this new power to pre ##sume guilt of unspecified offences was advertised as a unique response to the unique evil of drug trafficking .

reference_raw: This new power to assume the guilt of unspecified crimes has been advertised as a unique response to the unique evil of drug trafficking.

reference_spacy_tokens: This new power to assume the guilt of unspecified crimes has been advertised as a unique response to the unique evil of drug trafficking .


fn_spacy_tokens_for_baseline: Hear the coo of the dove , the flap of its wings .

source_bert_toks: hear the co ##o of the dove , the flap of its wings .

reference_raw: Listen to the bay of the dove, the flap of its wings.

reference_spacy_tokens: Listen to the bay of the dove , the flap of its wings .


fn_spacy_tokens_for_baseline: Philippine Ambassador Roy Seneres had said he would seek clemency from Sheik Zayed if legal strategies failed .

source_bert_toks: philippine ambassador roy sen ##eres had said he would seek cl ##eme ##ncy from she ##ik za ##yed if legal strategies failed .

reference_raw: Philippine Ambassador Roy Seneres said that if the legal strategy failed, he would seek mercy from Sheik Zayed.

reference_spacy_tokens: Philippine Ambassador Roy Seneres said that if the legal strategy failed , he would seek mercy from Sheik Zayed .


fn_spacy_tokens_for_baseline: It is widely accepted that infection is the primary cause of Whipple 's disease , but the importance of an associated immune deficiency in starting or promoting persistence of the infection is less clear .

source_bert_toks: it is widely accepted that infection is the primary cause of whip ##ple ' s disease , but the importance of an associated immune deficiency in starting or promoting persistence of the infection is less clear .

reference_raw: While it is widely accepted that infection is the main cause of Whipple's disease, the importance of the associated immunodeficiency in starting or promoting the persistency of the infection is less evident.

reference_spacy_tokens: While it is widely accepted that infection is the main cause of Whipple 's disease , the importance of the associated immunodeficiency in starting or promoting the persistency of the infection is less evident .


fn_spacy_tokens_for_baseline: Dexter had woken up early only to find himself with forty minutes to kill .

source_bert_toks: dexter had woken up early only to find himself with forty minutes to kill .

reference_raw: Dexter awoke early only to find that he had 40 minutes to kill.

reference_spacy_tokens: Dexter awoke early only to find that he had 40 minutes to kill .


fn_spacy_tokens_for_baseline: [ Mississippi ] National Guard Prepares For Hurricane Season [ and Chemical Terrorism ]

source_bert_toks: [ mississippi ] national guard prepares for hurricane season [ and chemical terrorism ]

reference_raw: [Missippi] National Guard Prepares for the hurricane season [and chemistry terrorism]

reference_spacy_tokens: [ Missippi ] National Guard Prepares for the hurricane season [ and chemistry terrorism ]


fn_spacy_tokens_for_baseline: In me battled a flood of relief at being reprieved and anger at such vile deception .

source_bert_toks: in me battled a flood of relief at being rep ##rie ##ved and anger at such vile deception .

reference_raw: In me, I fought a flood of relief at being reprieved and angry at such foul deception.

reference_spacy_tokens: In me , I fought a flood of relief at being reprieved and angry at such foul deception .


fn_spacy_tokens_for_baseline: BILLY ROY DANIELS was convicted in January 1990 of ' being knowingly concerned in the importation of cannabis ' from Spain .

source_bert_toks: billy roy daniels was convicted in january 1990 of ' being knowing ##ly concerned in the import ##ation of cannabis ' from spain .

reference_raw: BILLY ROY DANIELS was convicted in January 1990 of 'being consciously involved in the import of cannabis from Spain.

reference_spacy_tokens: BILLY ROY DANIELS was convicted in January 1990 of ' being consciously involved in the import of cannabis from Spain .


fn_spacy_tokens_for_baseline: It was a dress she 'd bought at Kelly 's urging , even though she 'd been positive she 'd never find occasion to wear it .

source_bert_toks: it was a dress she ' d bought at kelly ' s urging , even though she ' d been positive she ' d never find occasion to wear it .

reference_raw: It was a dress she had bought at Kelly's insistence, though she was sure she would never find the opportunity to wear it.

reference_spacy_tokens: It was a dress she had bought at Kelly 's insistence , though she was sure she would never find the opportunity to wear it .


fn_spacy_tokens_for_baseline: A quick bath and a change into one of Elinor 's cotton caftans , a blue ribbon to tie up my hair and a dab of powder on my freckles rendered me presentable enough to be fed .

source_bert_toks: a quick bath and a change into one of eli ##nor ' s cotton caf ##tan ##s , a blue ribbon to tie up my hair and a da ##b of powder on my fr ##eck ##les rendered me present ##able enough to be fed .

reference_raw: A quick bath and a change in one of Elinor's cotton caftans, a blue band that tied my hair, and a dab of dust on my freckles made me presentable enough to feed.

reference_spacy_tokens: A quick bath and a change in one of Elinor 's cotton caftans , a blue band that tied my hair , and a dab of dust on my freckles made me presentable enough to feed .


fn_spacy_tokens_for_baseline: My mum says he can kip on her sofa because she likes anyone with a Manc accent .

source_bert_toks: my mum says he can ki ##p on her sofa because she likes anyone with a man ##c accent .

reference_raw: My mom says he can knock on her couch because she likes someone with a Manc accent.

reference_spacy_tokens: My mom says he can knock on her couch because she likes someone with a Manc accent .


fn_spacy_tokens_for_baseline: It was n't that funny , but I agreed .

source_bert_toks: it wasn ' t that funny , but i agreed .

reference_raw: It wasn't much of a joke, but I agreed to it.

reference_spacy_tokens: It was n't much of a joke , but I agreed to it .


fn_spacy_tokens_for_baseline: The navy , in particular , prizes its warm - water ports .

source_bert_toks: the navy , in particular , prizes its warm - water ports .

reference_raw: In particular, the Navy values its hot water ports.

reference_spacy_tokens: In particular , the Navy values its hot water ports .


fn_spacy_tokens_for_baseline: In Spain , breads flavoured with cinnamon and dried fruit are baked at Easter , and some contain hard - boiled eggs , according to Elizabeth Luard 's European Festival Food .

source_bert_toks: in spain , bread ##s flavour ##ed with cinnamon and dried fruit are baked at easter , and some contain hard - boiled eggs , according to elizabeth lu ##ard ' s european festival food .

reference_raw: In Spain, according to Elizabeth Luard's European Festival Food, breads flavoured with cinnamon and dried fruit are roasted in Easter and some contain hard-boiled eggs.

reference_spacy_tokens: In Spain , according to Elizabeth Luard 's European Festival Food , breads flavoured with cinnamon and dried fruit are roasted in Easter and some contain hard - boiled eggs .


fn_spacy_tokens_for_baseline: Secondly , the results were consistent , with no dramatic difference from place to place at any particular time .

source_bert_toks: secondly , the results were consistent , with no dramatic difference from place to place at any particular time .

reference_raw: Second, the results were consistent and did not differ dramatically from place to place at any given time.

reference_spacy_tokens: Second , the results were consistent and did not differ dramatically from place to place at any given time .


fn_spacy_tokens_for_baseline: This high incidence of failing to establish a tissue diagnosis is due to reliance on imaging by some clinicians who are reticent , perhaps rightly , about invasive diagnostic techniques in a predominantly elderly and frail population .

source_bert_toks: this high incidence of failing to establish a tissue diagnosis is due to reliance on imaging by some clinic ##ians who are re ##tic ##ent , perhaps right ##ly , about invasive diagnostic techniques in a predominantly elderly and frail population .

reference_raw: This high incidence of failure to diagnose tissues is due to the dependency of some clinicians who are reticent, perhaps rightly correct, on invasive diagnostic techniques in a predominantly elderly and fragile population.

reference_spacy_tokens: This high incidence of failure to diagnose tissues is due to the dependency of some clinicians who are reticent , perhaps rightly correct , on invasive diagnostic techniques in a predominantly elderly and fragile population .


fn_spacy_tokens_for_baseline: We 're very saddened by the news .

source_bert_toks: we ' re very sad ##dened by the news .

reference_raw: The news is very sad for us.

reference_spacy_tokens: The news is very sad for us .


fn_spacy_tokens_for_baseline: Could Filmer have been so stupid as to get the horses ' names wrong in addition to the cities ?

source_bert_toks: could film ##er have been so stupid as to get the horses ' names wrong in addition to the cities ?

reference_raw: Could Filmer have been foolish enough to misrepresent the names of the horses besides the towns?

reference_spacy_tokens: Could Filmer have been foolish enough to misrepresent the names of the horses besides the towns ?


fn_spacy_tokens_for_baseline: Last week SNM guerrillas took me into Somalia from Djibouti , a crossing made on foot by night , dodging police and army patrols .

source_bert_toks: last week s ##n ##m guerrillas took me into somalia from dj ##ib ##out ##i , a crossing made on foot by night , dod ##ging police and army patrols .

reference_raw: Last week, the SNM guerrillas took me from Djibouti to Somalia, where I walked in the middle of the night, avoiding police and military patrols.

reference_spacy_tokens: Last week , the SNM guerrillas took me from Djibouti to Somalia , where I walked in the middle of the night , avoiding police and military patrols .


fn_spacy_tokens_for_baseline: Computer misuse or security breaches can take many forms , but these all fall into two broad categories : physical and logical .

source_bert_toks: computer mis ##use or security breach ##es can take many forms , but these all fall into two broad categories : physical and logical .

reference_raw: Computer abuse or security violations can take many forms, but all fall into two broad categories: physical and logical.

reference_spacy_tokens: Computer abuse or security violations can take many forms , but all fall into two broad categories : physical and logical .


fn_spacy_tokens_for_baseline: Above , in the dark , there was a rumbling from the Towers of Paine , the crackling sound of old rock being broken by new ice and the skitter of smaller stones plunging down a crevasse .

source_bert_toks: above , in the dark , there was a rumbling from the towers of pain ##e , the crack ##ling sound of old rock being broken by new ice and the ski ##tter of smaller stones plunging down a cr ##eva ##sse .

reference_raw: Above them, in the darkness, came the roar of the Towers of Paine, the crackling sound of old stone broken by new ice, and the skitter of smaller stones plunging down a crack.

reference_spacy_tokens: Above them , in the darkness , came the roar of the Towers of Paine , the crackling sound of old stone broken by new ice , and the skitter of smaller stones plunging down a crack .


fn_spacy_tokens_for_baseline: Several other humans banged into him , almost jarring Masklin loose .

source_bert_toks: several other humans banged into him , almost jar ##ring mask ##lin loose .

reference_raw: Several other people slammed into him, almost knocking Masklin loose.

reference_spacy_tokens: Several other people slammed into him , almost knocking Masklin loose .


fn_spacy_tokens_for_baseline: A checklist should be made of all cash , cheques and postal orders received through the post and handed to the cashier for entry into the appropriate records .

source_bert_toks: a check ##list should be made of all cash , che ##ques and postal orders received through the post and handed to the cash ##ier for entry into the appropriate records .

reference_raw: A checklist should be drawn up of all cash, cheques and postal orders received by post and sent to the cashier for entry in the relevant records.

reference_spacy_tokens: A checklist should be drawn up of all cash , cheques and postal orders received by post and sent to the cashier for entry in the relevant records .


fn_spacy_tokens_for_baseline: Fifteen minutes passed and no car turned into the shaded driveway .

source_bert_toks: fifteen minutes passed and no car turned into the shaded driveway .

reference_raw: Fifteen minutes passed, and no car turned into a shadowed drive.

reference_spacy_tokens: Fifteen minutes passed , and no car turned into a shadowed drive .


fn_spacy_tokens_for_baseline: " But - it 's - but- " Carolyn stammered and stopped .

source_bert_toks: " but - it ' s - but - " carolyn stammered and stopped .

reference_raw: "But-but-" Carolyn stuttered and paused.

reference_spacy_tokens: " But - but- " Carolyn stuttered and paused .


fn_spacy_tokens_for_baseline: The dark side of ambition .

source_bert_toks: the dark side of ambition .

reference_raw: Black side of ambition.

reference_spacy_tokens: Black side of ambition .


fn_spacy_tokens_for_baseline: With it , she had chosen a pair of black sneakers and a huge black bracelet .

source_bert_toks: with it , she had chosen a pair of black sneakers and a huge black bracelet .

reference_raw: She picked out a pair of black tennis shoes and a big black bracelet.

reference_spacy_tokens: She picked out a pair of black tennis shoes and a big black bracelet .


fn_spacy_tokens_for_baseline: The same blue as her taffeta gown , the deep brim lined with tiny , ruched frills on the underside , a huge bow at the back with waist - length streamers stitched with tiny blue and white beads .

source_bert_toks: the same blue as her ta ##ffe ##ta gown , the deep br ##im lined with tiny , ru ##ched fr ##ill ##s on the underside , a huge bow at the back with waist - length stream ##ers stitch ##ed with tiny blue and white beads .

reference_raw: The same blue as her taffeta dress, the deep edge lined with small, ruched frills at the bottom, a huge bow at the back, waist-length streamers stitched with tiny blue and white beads.

reference_spacy_tokens: The same blue as her taffeta dress , the deep edge lined with small , ruched frills at the bottom , a huge bow at the back , waist - length streamers stitched with tiny blue and white beads .


fn_spacy_tokens_for_baseline: The Governors of the eight US states abutting the Great Lakes have agreed on a series of voluntary pollution controls .

source_bert_toks: the governors of the eight us states abu ##tting the great lakes have agreed on a series of voluntary pollution controls .

reference_raw: The governors of the eight U.S. states that abduct the Great Lakes have agreed on a number of voluntary pollution controls.

reference_spacy_tokens: The governors of the eight U.S. states that abduct the Great Lakes have agreed on a number of voluntary pollution controls .


fn_spacy_tokens_for_baseline: These reports are termed speculative by a nuclear industry journal ( 7198 ) .

source_bert_toks: these reports are termed speculative by a nuclear industry journal ( 71 ##9 ##8 ) .

reference_raw: These reports are referred to as speculatives in the Nuclear Industry Magazine (7198).

reference_spacy_tokens: These reports are referred to as speculatives in the Nuclear Industry Magazine ( 7198 ) .


fn_spacy_tokens_for_baseline: Each patient underwent studies of anal sphincteric function before operation and a median of 12 months ( range 3 - 24 months ) after operation .

source_bert_toks: each patient underwent studies of anal sp ##hin ##cter ##ic function before operation and a median of 12 months ( range 3 - 24 months ) after operation .

reference_raw: Each patient had an anal sphincteric function study prior to surgery and a median of 12 months (range 3 to 24 months) after surgery.

reference_spacy_tokens: Each patient had an anal sphincteric function study prior to surgery and a median of 12 months ( range 3 to 24 months ) after surgery .


fn_spacy_tokens_for_baseline: The outcome of State Department deliberations in the first four months of 1949 was that the character of the occupation must be changed so as to afford the Japanese more legitimate freedom of action .

source_bert_toks: the outcome of state department del ##ibe ##rations in the first four months of 1949 was that the character of the occupation must be changed so as to afford the japanese more legitimate freedom of action .

reference_raw: The result of the State Department's discussions in the first four months of 1949 was that the nature of the profession had to be changed in order to give the Japanese more legitimate freedom of action.

reference_spacy_tokens: The result of the State Department 's discussions in the first four months of 1949 was that the nature of the profession had to be changed in order to give the Japanese more legitimate freedom of action .


fn_spacy_tokens_for_baseline: Winnie felt guilty , sometimes , when she read of people crowded into tenements , and thought of her own empty bedrooms .

source_bert_toks: winnie felt guilty , sometimes , when she read of people crowded into ten ##ement ##s , and thought of her own empty bedrooms .

reference_raw: Winnie sometimes felt guilty reading about people crowded in apartments and thinking about her own empty bedrooms.

reference_spacy_tokens: Winnie sometimes felt guilty reading about people crowded in apartments and thinking about her own empty bedrooms .


fn_spacy_tokens_for_baseline: Despite also being a Director of LET Leisure and the Riverside Racket Club in west London , Hutchins is still looking to expand .

source_bert_toks: despite also being a director of let leisure and the riverside rack ##et club in west london , hut ##chin ##s is still looking to expand .

reference_raw: Even though Hutchins is also the CEO of LET Leisure and the Riverside Racket Club in West London, he still wants to expand.

reference_spacy_tokens: Even though Hutchins is also the CEO of LET Leisure and the Riverside Racket Club in West London , he still wants to expand .


fn_spacy_tokens_for_baseline: Apple confirms that the machine will be built by Sharp Corp and will cost under $ 1,000 .

source_bert_toks: apple confirms that the machine will be built by sharp corp and will cost under $ 1 , 000 .

reference_raw: Apple confirms that Sharp Corp is going to build this machine and it's going to be worth less than $1,000.

reference_spacy_tokens: Apple confirms that Sharp Corp is going to build this machine and it 's going to be worth less than $ 1,000 .


fn_spacy_tokens_for_baseline: The collapse of this organisation created a multitude of problems and led to the rapid disintegration of the Soviet Union as a unitary superpower .

source_bert_toks: the collapse of this organisation created a multitude of problems and led to the rapid di ##sin ##te ##gration of the soviet union as a unitary super ##power .

reference_raw: The collapse of this organization caused a number of problems and led to the rapid disintegration of the Soviet Union as a unitary superpower.

reference_spacy_tokens: The collapse of this organization caused a number of problems and led to the rapid disintegration of the Soviet Union as a unitary superpower .


fn_spacy_tokens_for_baseline: The traditional Russian Easter cake Kulitsch is even eaten with hard - boiled eggs after being blessed by a priest .

source_bert_toks: the traditional russian easter cake ku ##lit ##sch is even eaten with hard - boiled eggs after being blessed by a priest .

reference_raw: After being blessed by a priest, the traditional Russian Easter cake Kulitsch is even eaten with a hard-boiled ova.

reference_spacy_tokens: After being blessed by a priest , the traditional Russian Easter cake Kulitsch is even eaten with a hard - boiled ova .


fn_spacy_tokens_for_baseline: Missions led by Edward Monckton and Charles Des Voeux were despatched by the Company in 1772 to north Sumatra and Kedah , but without results , because the East India Company refused to promise aid against Selangor .

source_bert_toks: missions led by edward mon ##ck ##ton and charles des vo ##eux were des ##pa ##tched by the company in 1772 to north sumatra and ked ##ah , but without results , because the east india company refused to promise aid against selangor .

reference_raw: In 1772, the company sent missions led by Edward Monckton and Charles Des Voeux to northern Sumatra and Kedah, but without results, because the East India Company refused to promise assistance to Selangor.

reference_spacy_tokens: In 1772 , the company sent missions led by Edward Monckton and Charles Des Voeux to northern Sumatra and Kedah , but without results , because the East India Company refused to promise assistance to Selangor .


fn_spacy_tokens_for_baseline: Seventy nine per cent were completely cured of their symptoms .

source_bert_toks: seventy nine per cent were completely cured of their symptoms .

reference_raw: Seventy-nine percent were completely healed from their symptoms.

reference_spacy_tokens: Seventy - nine percent were completely healed from their symptoms .


fn_spacy_tokens_for_baseline: Hammond kept his back half - turned ; Fulke slouched , staring up at the ceiling ; Rastani seemed more confident and Athelstan caught the sardonic mocking look in his dark , brilliant eyes .

source_bert_toks: hammond kept his back half - turned ; fu ##lke sl ##ou ##ched , staring up at the ceiling ; ras ##tani seemed more confident and at ##hel ##stan caught the sar ##don ##ic mocking look in his dark , brilliant eyes .

reference_raw: Hammond's back was half-turned; Fulke leaned back and looked up at the ceiling; Rastani seemed more confident, and Athelstan caught the sardonic mocking expression in his dark, brilliant eyes.

reference_spacy_tokens: Hammond 's back was half - turned ; Fulke leaned back and looked up at the ceiling ; Rastani seemed more confident , and Athelstan caught the sardonic mocking expression in his dark , brilliant eyes .


fn_spacy_tokens_for_baseline: The security team should : A : Publish a periodic bulletin and distribute to all residents , advising them how to safely store gaz and logs B : Keep the firefighters alert at all times C : Report any thing that might be a fire hazard D : Warn against the safety of children 's toys E : Urge everyone to take precautions and guard their homes tightly

source_bert_toks: the security team should : a : publish a periodic bulletin and distribute to all residents , advising them how to safely store ga ##z and logs b : keep the firefighters alert at all times c : report any thing that might be a fire hazard d : warn against the safety of children ' s toys e : urge everyone to take precautions and guard their homes tightly

reference_raw: The security team should: A: publish a regular bulletin and distribute it to all residents, advise them on the safe storage of gaz and logs B: Keep firefighters at all times C: report anything that could be a fire hazard D: Warn against the safety of children's toys E: Urge everyone to take precautions and guard their homes carefully.

reference_spacy_tokens: The security team should : A : publish a regular bulletin and distribute it to all residents , advise them on the safe storage of gaz and logs B : Keep firefighters at all times C : report anything that could be a fire hazard D : Warn against the safety of children 's toys E : Urge everyone to take precautions and guard their homes carefully .


fn_spacy_tokens_for_baseline: The impact of his writings and theories fully justifies his appellation ' the father of modern seismology ' .

source_bert_toks: the impact of his writings and theories fully just ##ifies his app ##ella ##tion ' the father of modern se ##ism ##ology ' .

reference_raw: The effect of his writings and theories fully warrants his "father of modern seismology."

reference_spacy_tokens: The effect of his writings and theories fully warrants his " father of modern seismology . "


fn_spacy_tokens_for_baseline: Reflective thinking can perhaps be summarized by a quotation from the philosopher Basil Mitchell .

source_bert_toks: reflective thinking can perhaps be summarized by a quota ##tion from the philosopher basil mitchell .

reference_raw: Reflective thinking may be summed up by quotes from the philosopher Basil Mitchell.

reference_spacy_tokens: Reflective thinking may be summed up by quotes from the philosopher Basil Mitchell .


fn_spacy_tokens_for_baseline: Despite many technical delays ( misfit of original Siemens equipment with Russian technology ) and efforts by the United States to stall the project , frequently by lobbying the Russia government for the cancellation of the deal , most notably during the Gore - Chernomyrdin Commission meetings , the facility is nearing completion .

source_bert_toks: despite many technical delays ( mis ##fi ##t of original siemens equipment with russian technology ) and efforts by the united states to stall the project , frequently by lobbying the russia government for the cancellation of the deal , most notably during the gore - cher ##no ##my ##rdi ##n commission meetings , the facility is nearing completion .

reference_raw: Despite a number of technical delays (the failure of the original Siemens equipment with Russia's technology) and the efforts of the United States to delay the project, often by lobbying the Government of Russia to cancel the agreement, in particular during the meetings of the Gore-Chernomyrdin Commission, the facility is close to completion.

reference_spacy_tokens: Despite a number of technical delays ( the failure of the original Siemens equipment with Russia 's technology ) and the efforts of the United States to delay the project , often by lobbying the Government of Russia to cancel the agreement , in particular during the meetings of the Gore - Chernomyrdin Commission , the facility is close to completion .


fn_spacy_tokens_for_baseline: It 's 45 cm wide , has five programmes , including cold pre - wash and quick - wash , and uses residual heat to dry the dishes .

source_bert_toks: it ' s 45 cm wide , has five programmes , including cold pre - wash and quick - wash , and uses residual heat to dry the dishes .

reference_raw: It's 45 cm in width, it's got five programs, including cold pre-washing and quick-washing, and it uses residual heat to dry the dishes.

reference_spacy_tokens: It 's 45 cm in width , it 's got five programs , including cold pre - washing and quick - washing , and it uses residual heat to dry the dishes .


fn_spacy_tokens_for_baseline: The world 's most expensive resort at $ 1.6 billion , the Bellagio 's amenities include 5-star dining , Chanel - caliber boutiques , and a world - class collection of artistic masterworks .

source_bert_toks: the world ' s most expensive resort at $ 1 . 6 billion , the bella ##gio ' s amenities include 5 - star dining , chan ##el - caliber boutique ##s , and a world - class collection of artistic master ##works .

reference_raw: The most expensive resort in the world for $1.6 trillion is a five-star restaurant, a chanel-caliber boutique, and a world-class collection of art masterpieces.

reference_spacy_tokens: The most expensive resort in the world for $ 1.6 trillion is a five - star restaurant , a chanel - caliber boutique , and a world - class collection of art masterpieces .


fn_spacy_tokens_for_baseline: She was skirting the moving foam , a foot away , and jumped sideways when a wave overreached .

source_bert_toks: she was skirt ##ing the moving foam , a foot away , and jumped sideways when a wave over ##rea ##ched .

reference_raw: She skirted the moving foam a foot away, leaping to one side as the wave overtook her.

reference_spacy_tokens: She skirted the moving foam a foot away , leaping to one side as the wave overtook her .


fn_spacy_tokens_for_baseline: Environmental assessments are important and they should be truthful and comprehensive .

source_bert_toks: environmental assessments are important and they should be truth ##ful and comprehensive .

reference_raw: Environmental assessments are important and should be true and comprehensive.

reference_spacy_tokens: Environmental assessments are important and should be true and comprehensive .


fn_spacy_tokens_for_baseline: At one she ran through her presentation .

source_bert_toks: at one she ran through her presentation .

reference_raw: She went over one of the presentations.

reference_spacy_tokens: She went over one of the presentations .


fn_spacy_tokens_for_baseline: She gulped the hot tea , put the cup down , took hold of a sandwich and sank hungry white teeth into it .

source_bert_toks: she gulped the hot tea , put the cup down , took hold of a sandwich and sank hungry white teeth into it .

reference_raw: She swallowed hot tea, put it down, grabbed a sandwich, and sank her hungry white teeth into it.

reference_spacy_tokens: She swallowed hot tea , put it down , grabbed a sandwich , and sank her hungry white teeth into it .


fn_spacy_tokens_for_baseline: From time to time , horses and riders would canter past .

source_bert_toks: from time to time , horses and riders would can ##ter past .

reference_raw: From time to time, horses and riders trotted past.

reference_spacy_tokens: From time to time , horses and riders trotted past .


fn_spacy_tokens_for_baseline: While waiting to order we were entertained by the sight of a bookish American muttering : ' You got ta try this !

source_bert_toks: while waiting to order we were entertained by the sight of a book ##ish american muttering : ' you got ta try this !

reference_raw: While we were waiting for an order, we were amused by the sight of a bookish American mumbling, "You've got to try this!

reference_spacy_tokens: While we were waiting for an order , we were amused by the sight of a bookish American mumbling , " You 've got to try this !


fn_spacy_tokens_for_baseline: Settled in what had become his usual position , Hargreave watched and waited in the observation chamber as Wingate was led in and shackled to the heavy steel chair in the centre of the room .

source_bert_toks: settled in what had become his usual position , ha ##rg ##rea ##ve watched and waited in the observation chamber as wing ##ate was led in and shack ##led to the heavy steel chair in the centre of the room .

reference_raw: Hargreave, seated in his usual position, watched and waited in the observation room as Wingate was led in and chained to a heavy steel chair in the center of the room.

reference_spacy_tokens: Hargreave , seated in his usual position , watched and waited in the observation room as Wingate was led in and chained to a heavy steel chair in the center of the room .


fn_spacy_tokens_for_baseline: ' It began with striking his spurs off for disobedience , but ended more on the lines of he could stay and rot for two weeks for all Zacco cared .

source_bert_toks: ' it began with striking his spurs off for di ##so ##bed ##ience , but ended more on the lines of he could stay and rot for two weeks for all zac ##co cared .

reference_raw: It started with the insubordination of his spurs, but ended more with the fact that he could stay and rot for two weeks for all that Zacco cared about.

reference_spacy_tokens: It started with the insubordination of his spurs , but ended more with the fact that he could stay and rot for two weeks for all that Zacco cared about .


fn_spacy_tokens_for_baseline: Seoul lies within easy striking distance of North Korea 's artillery and rocket systems and , today , the South Korean civilian population has no protection against CW attack .

source_bert_toks: seoul lies within easy striking distance of north korea ' s artillery and rocket systems and , today , the south korean civilian population has no protection against cw attack .

reference_raw: Seoul is well within striking distance of North Korea's artillery and missile systems, and the civilian population of South Korea is currently unprotected from the attack of the CW.

reference_spacy_tokens: Seoul is well within striking distance of North Korea 's artillery and missile systems , and the civilian population of South Korea is currently unprotected from the attack of the CW .


fn_spacy_tokens_for_baseline: Locally elected school boards , especially in our larger cities , become the prey of ambitious , generally corrupt , and invariably demagogic local politicians or would - be politicians .

source_bert_toks: locally elected school boards , especially in our larger cities , become the prey of ambitious , generally corrupt , and invariably dem ##ago ##gic local politicians or would - be politicians .

reference_raw: Locally elected school boards, especially in our larger cities, become the victim of ambitious, generally corrupt, and invariably demagogic politicians or would-be politicians.

reference_spacy_tokens: Locally elected school boards , especially in our larger cities , become the victim of ambitious , generally corrupt , and invariably demagogic politicians or would - be politicians .


fn_spacy_tokens_for_baseline: The debate about what the WEA was and should be doing had particular point in 1953 , the year the government initiated its own enquiry into adult education .

source_bert_toks: the debate about what the we ##a was and should be doing had particular point in 1953 , the year the government initiated its own en ##qui ##ry into adult education .

reference_raw: The debate on what the WEA is and should do was particularly relevant in 1953, when the government launched its own adult education investigation.

reference_spacy_tokens: The debate on what the WEA is and should do was particularly relevant in 1953 , when the government launched its own adult education investigation .


fn_spacy_tokens_for_baseline: Dark - haired girls could dye their hair blond , but no trace of the original color was permitted to show .

source_bert_toks: dark - haired girls could dye their hair blond , but no trace of the original color was permitted to show .

reference_raw: The dark-haired girls could dye their hair blond, but no trace of the original color was allowed.

reference_spacy_tokens: The dark - haired girls could dye their hair blond , but no trace of the original color was allowed .


fn_spacy_tokens_for_baseline: As I questioned her during the session , Maxine described to me a life as Martha , a fisherman 's wife in a small seaport in the late eighteenth century .

source_bert_toks: as i questioned her during the session , maxi ##ne described to me a life as martha , a fisherman ' s wife in a small sea ##port in the late eighteenth century .

reference_raw: While I was interviewing her during the session, Maxine described life to me as Martha, a fisherwoman in a small port at the end of the 18th century.

reference_spacy_tokens: While I was interviewing her during the session , Maxine described life to me as Martha , a fisherwoman in a small port at the end of the 18th century .


fn_spacy_tokens_for_baseline: The two chambers of the modern House of Assembly meet in the so - called western building ( on the right side if you 're facing from the square ) ; the public - records office and government publications department are housed in the other historic buildings .

source_bert_toks: the two chambers of the modern house of assembly meet in the so - called western building ( on the right side if you ' re facing from the square ) ; the public - records office and government publications department are housed in the other historic buildings .

reference_raw: The two chambers of the modern House of Assembly convene in the so-called Western building (on the right side if you face the square); the public - Records Office and Public Publications are located in other historical buildings.

reference_spacy_tokens: The two chambers of the modern House of Assembly convene in the so - called Western building ( on the right side if you face the square ) ; the public - Records Office and Public Publications are located in other historical buildings .


fn_spacy_tokens_for_baseline: Because of the new legitimacy Las Vegas acquired from Hughes ' investments , established companies such as Hilton Hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal skimming of profits was rampant .

source_bert_toks: because of the new legitimacy las vegas acquired from hughes ' investments , established companies such as hilton hotels bought into the gaming business , and their influence helped draw a line in the desert sand between legitimate operations and mob casinos , where illegal ski ##mming of profits was rampant .

reference_raw: Due to the new legitimacy that Las Vegas has acquired from Hughes' investments, established companies like Hilton Hotels have bought into gambling, and their influence has helped to draw a line in the desert sand between legitimate operations and mafia casinos, where illegal income skimmming is rampant.

reference_spacy_tokens: Due to the new legitimacy that Las Vegas has acquired from Hughes ' investments , established companies like Hilton Hotels have bought into gambling , and their influence has helped to draw a line in the desert sand between legitimate operations and mafia casinos , where illegal income skimmming is rampant .


fn_spacy_tokens_for_baseline: On nice days we made the most of the sunshine and moved the bench into the garden where we assembled the clocks , sitting in our bikinis .

source_bert_toks: on nice days we made the most of the sunshine and moved the bench into the garden where we assembled the clocks , sitting in our bikini ##s .

reference_raw: On good days, we took the best of the sun and moved the bench to the garden, where we gathered the clocks and sat in our bikinis.

reference_spacy_tokens: On good days , we took the best of the sun and moved the bench to the garden , where we gathered the clocks and sat in our bikinis .


fn_spacy_tokens_for_baseline: She began associating with both Marxist and Fabian intellectual socialists .

source_bert_toks: she began ass ##oc ##iating with both marxist and fabian intellectual socialists .

reference_raw: She started to associate with Marxist and Fabian intellectual socialists.

reference_spacy_tokens: She started to associate with Marxist and Fabian intellectual socialists .


fn_spacy_tokens_for_baseline: Eventually the government paid to dig a well on the tribal land and gained the use of the Kaibab Paiute water at the monument .

source_bert_toks: eventually the government paid to dig a well on the tribal land and gained the use of the kai ##ba ##b pa ##iu ##te water at the monument .

reference_raw: Finally, the government paid to dig a well on the tribal soil and to use Kaibab Paiute water at the memorial.

reference_spacy_tokens: Finally , the government paid to dig a well on the tribal soil and to use Kaibab Paiute water at the memorial .


fn_spacy_tokens_for_baseline: She was nervous of all Men , and preferred to be with the women of the Court .

source_bert_toks: she was nervous of all men , and preferred to be with the women of the court .

reference_raw: She was unnerving of all the men, and she preferred to be with the women of the court.

reference_spacy_tokens: She was unnerving of all the men , and she preferred to be with the women of the court .


fn_spacy_tokens_for_baseline: To him , the developing process is drudgery .

source_bert_toks: to him , the developing process is dr ##udge ##ry .

reference_raw: For him, the process of development is exhausting.

reference_spacy_tokens: For him , the process of development is exhausting .


fn_spacy_tokens_for_baseline: Insurance salesmen shall be banned .

source_bert_toks: insurance sales ##men shall be banned .

reference_raw: Insurance sellers are banned.

reference_spacy_tokens: Insurance sellers are banned .


fn_spacy_tokens_for_baseline: The dressmaker called , and the merciless corsetiere , and two obsequious men from Bodmin with bolts of wools and flannels and silks which they laid out across the drawing - room sofa for Aunt Emily to see .

source_bert_toks: the dress ##maker called , and the mer ##ci ##less co ##rse ##tier ##e , and two ob ##se ##qui ##ous men from bo ##dm ##in with bolts of wool ##s and fl ##anne ##ls and silk ##s which they laid out across the drawing - room sofa for aunt emily to see .

reference_raw: The dresser called, a merciless corsetier, and two obsessive Bodmin men with wool and flannels and silk bolts lying on the far side of the living room sofa for Aunt Emily to see.

reference_spacy_tokens: The dresser called , a merciless corsetier , and two obsessive Bodmin men with wool and flannels and silk bolts lying on the far side of the living room sofa for Aunt Emily to see .


fn_spacy_tokens_for_baseline: A survey has revealed that pressure of work at Oxford university is making students lives a misery .

source_bert_toks: a survey has revealed that pressure of work at oxford university is making students lives a misery .

reference_raw: Research has shown that the pressure of working at Oxford University makes students' lives miserable.

reference_spacy_tokens: Research has shown that the pressure of working at Oxford University makes students ' lives miserable .