fn_spacy_tokens_for_baseline: On arrival the guest will be offered ocha ( hot green tea ) with a Gomenkudasai ( ' Excuse me for the intrusion ' ) and several pieces of omanju ( rice cakes ) .

source_bert_toks: on arrival the guest will be offered och ##a ( hot green tea ) with a go ##men ##ku ##das ##ai ( ' excuse me for the intrusion ' ) and several pieces of oman ##ju ( rice cakes ) .

reference_raw: On arrival, the guest will be offered an ocha (hot green tea) with a Gomenkudasai ("Sorry to interrupt") and a few pieces of omanju (rice cakes).

reference_spacy_tokens: On arrival , the guest will be offered an ocha ( hot green tea ) with a Gomenkudasai ( " Sorry to interrupt " ) and a few pieces of omanju ( rice cakes ) .


fn_spacy_tokens_for_baseline: Isay was beside him , wreaking carnage with his staff .

source_bert_toks: isa ##y was beside him , wr ##eak ##ing carnage with his staff .

reference_raw: Isay was at his side, wreaking bloodshed with his staff.

reference_spacy_tokens: Isay was at his side , wreaking bloodshed with his staff .


fn_spacy_tokens_for_baseline: They found Dad in the middle of the road with a pig straddling him and manure all over his face .

source_bert_toks: they found dad in the middle of the road with a pig st ##rad ##dling him and man ##ure all over his face .

reference_raw: They found my father in the middle of the road with a pig in his arms and manure all over his face.

reference_spacy_tokens: They found my father in the middle of the road with a pig in his arms and manure all over his face .


fn_spacy_tokens_for_baseline: At the upper terminus there is a four - level shopping center , the Peak Galleria , and the Peak Tower , which resembles an airport control tower and has shops , entertainment , and restaurants .

source_bert_toks: at the upper terminus there is a four - level shopping center , the peak gall ##eria , and the peak tower , which resembles an airport control tower and has shops , entertainment , and restaurants .

reference_raw: At the top of the terminus is a four-level shopping centre, the Peak Galleria, and the Peak Tower, which is similar to the airfield control tower and has shops, amusements, and restaurants.

reference_spacy_tokens: At the top of the terminus is a four - level shopping centre , the Peak Galleria , and the Peak Tower , which is similar to the airfield control tower and has shops , amusements , and restaurants .


fn_spacy_tokens_for_baseline: The United Nations says Somali gunmen who hijacked a U.N. - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

source_bert_toks: the united nations says somali gunmen who hi ##jack ##ed a u . n . - chartered vessel carrying food aid for tsunami victims have released the ship after holding it for more than two months .

reference_raw: According to the United Nations, Somali gunmen who hijacked the United Nations - a chartered ship carrying food aid to the victims of tsunamis released the ship after it was detained for more than two months.

reference_spacy_tokens: According to the United Nations , Somali gunmen who hijacked the United Nations - a chartered ship carrying food aid to the victims of tsunamis released the ship after it was detained for more than two months .


fn_spacy_tokens_for_baseline: Later their feet turn orange .

source_bert_toks: later their feet turn orange .

reference_raw: Later, their legs are orange.

reference_spacy_tokens: Later , their legs are orange .


fn_spacy_tokens_for_baseline: ) Notwithstanding everyone 's reluctance , Lehrman got several minutes of film that brought dozens of bit players and their world to life -- the seductive Sandor Ferenczi at a caf , ( he once conducted affairs with a patient and her mother at the same time ) , the warm and animated Princess Marie Bonaparte graciously introducing everybody to everybody else at tea parties ( she later rescued Freud from the Nazis ) , a dashing and alarmingly radiant Wilhelm Reich ( he lated invented orgone therapy ) .

source_bert_toks: ) notwithstanding everyone ' s reluctance , le ##hr ##man got several minutes of film that brought dozens of bit players and their world to life - - the seductive sand ##or fe ##ren ##cz ##i at a caf , ( he once conducted affairs with a patient and her mother at the same time ) , the warm and animated princess marie bonaparte gr ##acious ##ly introducing everybody to everybody else at tea parties ( she later rescued freud from the nazis ) , a dash ##ing and alarm ##ingly radiant wilhelm reich ( he late ##d invented org ##one therapy ) .

reference_raw: ) Irrespective of everyone's reluctance, Lehrman received a few minutes of film that brought back dozens of bitters and their world to life - the seductive Sandor Ferenczi in a coffee shop (he once had an affair with a patient and her mother at the same time), the hot and animated Princess Marie Bonaparte graciously introduced everyone at tea parties (she later saved Freud from the Nazis). Wilhelm Reich (late inventing orgone therapy) was alarmingly and alarmingly radiant.

reference_spacy_tokens: ) Irrespective of everyone 's reluctance , Lehrman received a few minutes of film that brought back dozens of bitters and their world to life - the seductive Sandor Ferenczi in a coffee shop ( he once had an affair with a patient and her mother at the same time ) , the hot and animated Princess Marie Bonaparte graciously introduced everyone at tea parties ( she later saved Freud from the Nazis ) . Wilhelm Reich ( late inventing orgone therapy ) was alarmingly and alarmingly radiant .


fn_spacy_tokens_for_baseline: As the Byzantine Empire weakened at the end of the first millennium , Crusader forces were sent from Western Europe to counter the Muslim forces and retake Jerusalem for the Christian faith .

source_bert_toks: as the byzantine empire weakened at the end of the first millennium , crusader forces were sent from western europe to counter the muslim forces and re ##take jerusalem for the christian faith .

reference_raw: As the Byzantine Empire weakened at the end of the first millennia, crusaders were sent from Western Europe to fight against Muslim forces and take Jerusalem back to the Christian faith.

reference_spacy_tokens: As the Byzantine Empire weakened at the end of the first millennia , crusaders were sent from Western Europe to fight against Muslim forces and take Jerusalem back to the Christian faith .


fn_spacy_tokens_for_baseline: He 'll tell M Ps that the Government is trying to restart negotiations involving all the constitutional parties in the Province .

source_bert_toks: he ' ll tell m ps that the government is trying to restart negotiations involving all the constitutional parties in the province .

reference_raw: He's going to tell M.P. that the government is trying to reopen negotiations with all the constitutional parties in the province.

reference_spacy_tokens: He 's going to tell M.P. that the government is trying to reopen negotiations with all the constitutional parties in the province .


fn_spacy_tokens_for_baseline: The screech of a jet will do nicely .

source_bert_toks: the sc ##ree ##ch of a jet will do nicely .

reference_raw: The squeal of the jet will do nicely.

reference_spacy_tokens: The squeal of the jet will do nicely .


fn_spacy_tokens_for_baseline: An hour later , the paper 's circulation manager , Miguel Soler , was shot and killed near his home .

source_bert_toks: an hour later , the paper ' s circulation manager , miguel sole ##r , was shot and killed near his home .

reference_raw: An hour later, the editor of the newspaper, Miguel Soler, was gunned down and killed near his house.

reference_spacy_tokens: An hour later , the editor of the newspaper , Miguel Soler , was gunned down and killed near his house .


fn_spacy_tokens_for_baseline: Somewhere in a room above them , a woman gently crooned the tune of a lullaby .

source_bert_toks: somewhere in a room above them , a woman gently cr ##oon ##ed the tune of a lullaby .

reference_raw: Somewhere in the room above them, a woman gently twisted the lullaby's melody.

reference_spacy_tokens: Somewhere in the room above them , a woman gently twisted the lullaby 's melody .


fn_spacy_tokens_for_baseline: She was vacuum cleaning the passage right up to the door at the end when she noticed what she thought was a brown silk slip lying on the floor at the base of the locked door .

source_bert_toks: she was vacuum cleaning the passage right up to the door at the end when she noticed what she thought was a brown silk slip lying on the floor at the base of the locked door .

reference_raw: At the end she was vacuum-cleaning the passage to the door when she saw what she thought was a brown silk slick lying on the floor at the foot of the locked door.

reference_spacy_tokens: At the end she was vacuum - cleaning the passage to the door when she saw what she thought was a brown silk slick lying on the floor at the foot of the locked door .


fn_spacy_tokens_for_baseline: So there , while you think of Case , you also think of Pittman and Leonsis and increasingly a range of other executives .

source_bert_toks: so there , while you think of case , you also think of pitt ##man and leon ##sis and increasingly a range of other executives .

reference_raw: So here, when you're thinking about Case, you're thinking about Pittman and Leonsis and more and more of the other executives.

reference_spacy_tokens: So here , when you 're thinking about Case , you 're thinking about Pittman and Leonsis and more and more of the other executives .


fn_spacy_tokens_for_baseline: The mother had moved her family to another den , and I could n't find it .

source_bert_toks: the mother had moved her family to another den , and i couldn ' t find it .

reference_raw: My mother moved her family to another lair, and I couldn't find her.

reference_spacy_tokens: My mother moved her family to another lair , and I could n't find her .


fn_spacy_tokens_for_baseline: My first boyfriend seemed to like me , specs and all .

source_bert_toks: my first boyfriend seemed to like me , spec ##s and all .

reference_raw: My first friend seemed to like me, the specs, that sort of thing.

reference_spacy_tokens: My first friend seemed to like me , the specs , that sort of thing .


fn_spacy_tokens_for_baseline: She had done acid once , at college , and it had not been anything like this evening 's entertainment .

source_bert_toks: she had done acid once , at college , and it had not been anything like this evening ' s entertainment .

reference_raw: She had done sour once in college, and it was nothing like tonight's entertainment.

reference_spacy_tokens: She had done sour once in college , and it was nothing like tonight 's entertainment .


fn_spacy_tokens_for_baseline: Hear the songs of Bob Marley booming from a hundred cranked - up car stereos or the chorus of frogs that begin to call as evening descends .

source_bert_toks: hear the songs of bob marley booming from a hundred crank ##ed - up car stereo ##s or the chorus of frogs that begin to call as evening descends .

reference_raw: You can hear Bob Marley's songs booming from a hundred cranks - up car stereos, or the chorus of frogs, which start calling as the evening goes down.

reference_spacy_tokens: You can hear Bob Marley 's songs booming from a hundred cranks - up car stereos , or the chorus of frogs , which start calling as the evening goes down .


fn_spacy_tokens_for_baseline: Moltenskoi was also commander during document sweeps , or zachistka operations , in the Chechen villages of Sernovodsk and Assinovskaya in July that were denounced as cruel and wanton even by pro - Kremlin officials in the region .

source_bert_toks: molten ##sko ##i was also commander during document sweeps , or zach ##ist ##ka operations , in the che ##chen villages of ser ##nov ##ods ##k and ass ##ino ##vs ##kaya in july that were denounced as cruel and want ##on even by pro - k ##rem ##lin officials in the region .

reference_raw: In July, Moltenskoi was also a leader in document searches or zachistka operations in the Chechen villages of Sernovodsk and Assinovskay, which were condemned as cruel and wanton even by pro-Kremlin officials in the region.

reference_spacy_tokens: In July , Moltenskoi was also a leader in document searches or zachistka operations in the Chechen villages of Sernovodsk and Assinovskay , which were condemned as cruel and wanton even by pro - Kremlin officials in the region .


fn_spacy_tokens_for_baseline: This is not simply one make of computer -- there are literally hundreds of different makes , available with a wide range of choices of memory , storage and screen .

source_bert_toks: this is not simply one make of computer - - there are literally hundreds of different makes , available with a wide range of choices of memory , storage and screen .

reference_raw: It's not just one computer, it's literally hundreds of different devices, available with a wide range of options for memory, storage, and screen.

reference_spacy_tokens: It 's not just one computer , it 's literally hundreds of different devices , available with a wide range of options for memory , storage , and screen .


fn_spacy_tokens_for_baseline: From Hartsop village follow a distinct path east to Hayeswater reservoir ( 1.25 miles ) before tacking diagonally uphill to your right onto the Gray Crag ridge ( 0.5 miles ) .

source_bert_toks: from hart ##sop village follow a distinct path east to hayes ##water reservoir ( 1 . 25 miles ) before tack ##ing diagonal ##ly up ##hill to your right onto the gray cr ##ag ridge ( 0 . 5 miles ) .

reference_raw: From the village of Hartsop follows a clear route east to the Hayeswater reservoir (1.25 miles) before moving diagonally up the hill to the right to the crest of the Gray Crag (0.5 miles).

reference_spacy_tokens: From the village of Hartsop follows a clear route east to the Hayeswater reservoir ( 1.25 miles ) before moving diagonally up the hill to the right to the crest of the Gray Crag ( 0.5 miles ) .


fn_spacy_tokens_for_baseline: Detectives believe that Elizabeth managed to grab the canister , but it was wrenched from her grasp .

source_bert_toks: detectives believe that elizabeth managed to grab the can ##ister , but it was wrenched from her grasp .

reference_raw: The detectives believe Elizabeth was able to grab the container, but it was wrenched out of her grasp.

reference_spacy_tokens: The detectives believe Elizabeth was able to grab the container , but it was wrenched out of her grasp .


fn_spacy_tokens_for_baseline: Their career prospects , their contacts with foreign scholars , their publication outlets -- all were controlled by a complex web of party bodies ultimately responsible to the Central Committee .

source_bert_toks: their career prospects , their contacts with foreign scholars , their publication outlets - - all were controlled by a complex web of party bodies ultimately responsible to the central committee .

reference_raw: Their career prospects, their contacts with foreign scholars, their publications - all were controlled by a complex network of parties ultimately responsible for the Central Committee.

reference_spacy_tokens: Their career prospects , their contacts with foreign scholars , their publications - all were controlled by a complex network of parties ultimately responsible for the Central Committee .


fn_spacy_tokens_for_baseline: Keeping them functioning , not to mention well - maintained , was a formidable task , as not all routes could traverse the world on purely British turf .

source_bert_toks: keeping them functioning , not to mention well - maintained , was a formidable task , as not all routes could traverse the world on purely british turf .

reference_raw: Keeping them functioning, not to mention well maintained, was a formidable task, for not all routes could cross the world on purely British territory.

reference_spacy_tokens: Keeping them functioning , not to mention well maintained , was a formidable task , for not all routes could cross the world on purely British territory .


fn_spacy_tokens_for_baseline: An extreme example was the sharp decline in competitiveness of Japanese industry between 1970 and 1973 when a rising yen pushed up Japanese relative labour costs by one - third .

source_bert_toks: an extreme example was the sharp decline in competitive ##ness of japanese industry between 1970 and 1973 when a rising yen pushed up japanese relative labour costs by one - third .

reference_raw: An extreme example was the sharp decline in the competitiveness of the Japanese industry between 1970 and 1973, when the rising yen increased the relative labour costs of Japan by one third.

reference_spacy_tokens: An extreme example was the sharp decline in the competitiveness of the Japanese industry between 1970 and 1973 , when the rising yen increased the relative labour costs of Japan by one third .


fn_spacy_tokens_for_baseline: The kiss and branding also appear in a fifteenth - century Italian novella .

source_bert_toks: the kiss and branding also appear in a fifteenth - century italian novella .

reference_raw: Kissing and branding also appear in a 15th-century Italian novel.

reference_spacy_tokens: Kissing and branding also appear in a 15th - century Italian novel .


fn_spacy_tokens_for_baseline: ' So now you 're saying I 'm ill - mannered ? '

source_bert_toks: ' so now you ' re saying i ' m ill - manner ##ed ? '

reference_raw: "So what you're saying is that I'm rude?"

reference_spacy_tokens: " So what you 're saying is that I 'm rude ? "


fn_spacy_tokens_for_baseline: The dorsal fin is ornamented with these two colours .

source_bert_toks: the dorsal fin is or ##name ##nted with these two colours .

reference_raw: The dorsal fin is decorated with these two colors.

reference_spacy_tokens: The dorsal fin is decorated with these two colors .


fn_spacy_tokens_for_baseline: The building is decrepit , the doors do not shut , the windows have no glass , some taps leak continuously , the staff are too embarrassed to show me the lavatories .

source_bert_toks: the building is dec ##re ##pit , the doors do not shut , the windows have no glass , some taps leak continuously , the staff are too embarrassed to show me the lava ##tori ##es .

reference_raw: The building's down, the doors don't close, the windows don't have glass, some taps keep leaking, and the staff is too embarrassed to show me the toilets.

reference_spacy_tokens: The building 's down , the doors do n't close , the windows do n't have glass , some taps keep leaking , and the staff is too embarrassed to show me the toilets .


fn_spacy_tokens_for_baseline: He was an ailing man of 61 who had never commanded in the field , knew nothing of Gallipoli and was appointed solely because of seniority on the army list .

source_bert_toks: he was an ai ##ling man of 61 who had never commanded in the field , knew nothing of gall ##ip ##oli and was appointed solely because of senior ##ity on the army list .

reference_raw: He was a sick, 61-year-old man who had never been in charge of the field, knew nothing of Gallipoli, and was appointed only for his rank on the military list.

reference_spacy_tokens: He was a sick , 61-year - old man who had never been in charge of the field , knew nothing of Gallipoli , and was appointed only for his rank on the military list .


fn_spacy_tokens_for_baseline: ' Are the teachers strict here ? ' asked Sybil , wiping her eyes with a corner of her voluminous cloak .

source_bert_toks: ' are the teachers strict here ? ' asked sy ##bil , wiping her eyes with a corner of her vol ##umi ##nous cloak .

reference_raw: 'Are the teachers strict here?' said Sybil, wiping her eyes with the corner of her bulky cloak.

reference_spacy_tokens: ' Are the teachers strict here ? ' said Sybil , wiping her eyes with the corner of her bulky cloak .


fn_spacy_tokens_for_baseline: Memorisation of material is also greatly helped by such a system .

source_bert_toks: memo ##ris ##ation of material is also greatly helped by such a system .

reference_raw: This system also greatly helps to memorize the material.

reference_spacy_tokens: This system also greatly helps to memorize the material .


fn_spacy_tokens_for_baseline: He crossed the road , thumped across a pasture , then dropped into a small valley where a tangle of thorns grew either side of a trickling brook .

source_bert_toks: he crossed the road , thumped across a pasture , then dropped into a small valley where a tangle of thorns grew either side of a trick ##ling brook .

reference_raw: He crossed the road, pounded across the pasture, and fell into a small valley where a tangle of thorns grew on either side of the stream.

reference_spacy_tokens: He crossed the road , pounded across the pasture , and fell into a small valley where a tangle of thorns grew on either side of the stream .


fn_spacy_tokens_for_baseline: The grey - haired bandit tore off his stocking mask , sank to his knees and gasped : ' Mind my heart .

source_bert_toks: the grey - haired bandit tore off his stock ##ing mask , sank to his knees and gasped : ' mind my heart .

reference_raw: The gray-haired bandit tore off his stocking mask, dropped to his knees, and gasped, "Mind my heart.

reference_spacy_tokens: The gray - haired bandit tore off his stocking mask , dropped to his knees , and gasped , " Mind my heart .


fn_spacy_tokens_for_baseline: Corbett was immediately struck by the fellow 's swarthy good looks and elegant dress : dark purple hose , soft buskins on his feet , and an open - necked , spotless , white cambric shirt .

source_bert_toks: corbett was immediately struck by the fellow ' s sw ##arth ##y good looks and elegant dress : dark purple hose , soft bus ##kins on his feet , and an open - neck ##ed , spot ##less , white cam ##bri ##c shirt .

reference_raw: Corbett was instantly struck by the man's dark, good looks and elegant clothes: dark-violet stockings, soft buskins on his feet, and an open-necked, spotless white cambric shirt.

reference_spacy_tokens: Corbett was instantly struck by the man 's dark , good looks and elegant clothes : dark - violet stockings , soft buskins on his feet , and an open - necked , spotless white cambric shirt .


fn_spacy_tokens_for_baseline: Coffin stayed on , spoke briefly to the two men , who were polite but not cordial , and departed in his turn .

source_bert_toks: coffin stayed on , spoke briefly to the two men , who were polite but not cord ##ial , and departed in his turn .

reference_raw: Coffin paused, spoke briefly to the two men, who were polite but not warm, and left in his turn.

reference_spacy_tokens: Coffin paused , spoke briefly to the two men , who were polite but not warm , and left in his turn .


fn_spacy_tokens_for_baseline: It was fractured with a solvent - cleaned chisel , and the outer orange layer discarded .

source_bert_toks: it was fractured with a solvent - cleaned chi ##sel , and the outer orange layer discarded .

reference_raw: It was broken with a solvent-cleaned chisel, and the outer layer of orange was discarded.

reference_spacy_tokens: It was broken with a solvent - cleaned chisel , and the outer layer of orange was discarded .


fn_spacy_tokens_for_baseline: In the early 1960s , the Soviet Union provided extensive technical assistance while North Korea constructed its Yo ( ngbyo ( n Nuclear Research Center , which included the installation of a Soviet IRT- 2000 Nuclear Research Reactor , and other facilities ( see Yo ( ngbyo ( n Nuclear Research Center ) .

source_bert_toks: in the early 1960s , the soviet union provided extensive technical assistance while north korea constructed its yo ( ng ##by ##o ( n nuclear research center , which included the installation of a soviet ir ##t - 2000 nuclear research reactor , and other facilities ( see yo ( ng ##by ##o ( n nuclear research center ) .

reference_raw: In the early 1960s, the Soviet Union provided extensive technical assistance, while North Korea built its YO (Natural Research Centre, including installing the Soviet IRT-2000 nuclear research reactor and other facilities (see Yo (National Research Centre).

reference_spacy_tokens: In the early 1960s , the Soviet Union provided extensive technical assistance , while North Korea built its YO ( Natural Research Centre , including installing the Soviet IRT-2000 nuclear research reactor and other facilities ( see Yo ( National Research Centre ) .


fn_spacy_tokens_for_baseline: The expansion of air travel began the age of mass tourism , and Greece along with the Aegean Islands became exciting destinations for northern Europeans escaping their damp , cool summers .

source_bert_toks: the expansion of air travel began the age of mass tourism , and greece along with the aegean islands became exciting destinations for northern europeans escaping their damp , cool summers .

reference_raw: The expansion of air travel began in the age of mass tourists, and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet, cold summers.

reference_spacy_tokens: The expansion of air travel began in the age of mass tourists , and Greece and the Aegean Islands became exciting destinations for northern Europeans to escape their wet , cold summers .


fn_spacy_tokens_for_baseline: ' What was your husband 's code - name ? '

source_bert_toks: ' what was your husband ' s code - name ? '

reference_raw: "What was the code name of your husband?"

reference_spacy_tokens: " What was the code name of your husband ? "


fn_spacy_tokens_for_baseline: -- Students should move up the educational ladder as their academic potential allows .

source_bert_toks: - - students should move up the educational ladder as their academic potential allows .

reference_raw: - Students should move up the educational ladder as far as their academic capabilities allow.

reference_spacy_tokens: - Students should move up the educational ladder as far as their academic capabilities allow .


fn_spacy_tokens_for_baseline: I am not such a fathead as to attempt to describe the pleasure of eating , but I would draw your attention to the vegetable soup cooked with a hambone ( le garbure ) , to the river trout braised in Henri IV 's favourite Juranon wine , the grilled breast of duck .

source_bert_toks: i am not such a fat ##head as to attempt to describe the pleasure of eating , but i would draw your attention to the vegetable soup cooked with a ham ##bone ( le ga ##rb ##ure ) , to the river trout bra ##ised in henri iv ' s favourite ju ##rano ##n wine , the grille ##d breast of duck .

reference_raw: I'm not so fat as to try to describe the pleasure of eating, but I'd like to draw your attention to the vegetable soup cooked with a hambone (le garbure), the river trout braided in Henri IV's favorite juranon wine, the grilled chest of ducks.

reference_spacy_tokens: I 'm not so fat as to try to describe the pleasure of eating , but I 'd like to draw your attention to the vegetable soup cooked with a hambone ( le garbure ) , the river trout braided in Henri IV 's favorite juranon wine , the grilled chest of ducks .


fn_spacy_tokens_for_baseline: And if he ever decided to stay over when he had n't told me in advance , he 'd always ring and tell me where I could reach him .

source_bert_toks: and if he ever decided to stay over when he hadn ' t told me in advance , he ' d always ring and tell me where i could reach him .

reference_raw: And if he ever decided to stay with me when he didn't tell me in advance, he would always ring and tell me where to find him.

reference_spacy_tokens: And if he ever decided to stay with me when he did n't tell me in advance , he would always ring and tell me where to find him .


fn_spacy_tokens_for_baseline: His rejoinder explained it all .

source_bert_toks: his rejoin ##der explained it all .

reference_raw: His reply explained everything.

reference_spacy_tokens: His reply explained everything .


fn_spacy_tokens_for_baseline: Stand upright , holding the bar at shoulder height in front of your chest with your palms facing outwards .

source_bert_toks: stand upright , holding the bar at shoulder height in front of your chest with your palms facing outward ##s .

reference_raw: Get up and hold the bar at shoulder height in front of your chest, palms facing outwards.

reference_spacy_tokens: Get up and hold the bar at shoulder height in front of your chest , palms facing outwards .


fn_spacy_tokens_for_baseline: Nobody took this fable seriously until in 1961 a Russian film - maker managed to record it actually happening .

source_bert_toks: nobody took this fable seriously until in 1961 a russian film - maker managed to record it actually happening .

reference_raw: No one took this story seriously until in 1961 a Russian filmmaker was able to record that it was actually happening.

reference_spacy_tokens: No one took this story seriously until in 1961 a Russian filmmaker was able to record that it was actually happening .


fn_spacy_tokens_for_baseline: Parents act as role models of self - sufficiency instead of dependency .

source_bert_toks: parents act as role models of self - su ##ffi ##ciency instead of dependency .

reference_raw: Parents play the role of self-sufficiency rather than dependency.

reference_spacy_tokens: Parents play the role of self - sufficiency rather than dependency .


fn_spacy_tokens_for_baseline: The optimism of 1959 which runs through them is quite breathtaking at this distance in time : ' Some experts insist on talking as if the only choices were immediate surrender , immediate preventive war or eventual world annihilation , ' Kahn declared .

source_bert_toks: the optimism of 1959 which runs through them is quite breath ##taking at this distance in time : ' some experts insist on talking as if the only choices were immediate surrender , immediate prevent ##ive war or eventual world ann ##ih ##ilation , ' kahn declared .

reference_raw: The 1959 optimism that passes through them is quite breathtaking at this distance in time: 'Some experts insist on speaking as if the only option is immediate surrender, immediate preemptive war or possible destruction of the world,' Kahn said.

reference_spacy_tokens: The 1959 optimism that passes through them is quite breathtaking at this distance in time : ' Some experts insist on speaking as if the only option is immediate surrender , immediate preemptive war or possible destruction of the world , ' Kahn said .


fn_spacy_tokens_for_baseline: He woke stupefied , flicking his tongue over his parched lips like a reptile .

source_bert_toks: he woke stu ##pe ##fied , flicking his tongue over his parc ##hed lips like a rep ##tile .

reference_raw: He awoke numbly, his tongue flicking over his parched lips like a reptile.

reference_spacy_tokens: He awoke numbly , his tongue flicking over his parched lips like a reptile .


fn_spacy_tokens_for_baseline: McKee ( 1987 ) reports that siblings of unemployed men were the second most important category ( after parents ) to give assistance .

source_bert_toks: mc ##kee ( 1987 ) reports that siblings of unemployed men were the second most important category ( after parents ) to give assistance .

reference_raw: McKee (1987) reports that the second most important category (after parents) of assistance was the brother and sister of the unemployed.

reference_spacy_tokens: McKee ( 1987 ) reports that the second most important category ( after parents ) of assistance was the brother and sister of the unemployed .


fn_spacy_tokens_for_baseline: ' I know where your cuff - links are ; I 've got them in my jewellery box .

source_bert_toks: ' i know where your cuff - links are ; i ' ve got them in my jewellery box .

reference_raw: I know where your cufflinks are; they're in my jewelry box.

reference_spacy_tokens: I know where your cufflinks are ; they 're in my jewelry box .


fn_spacy_tokens_for_baseline: The forepaws grew thicker , the hind legs longer , the torso broader .

source_bert_toks: the fore ##pa ##ws grew thicker , the hind legs longer , the torso broader .

reference_raw: The front legs were thicker, the hind legs longer, the torso wider.

reference_spacy_tokens: The front legs were thicker , the hind legs longer , the torso wider .


fn_spacy_tokens_for_baseline: Only the dwindling band of loyal Conservative voters was likely to believe that the increase in charges compared with the rates was the responsibility of profligate local authorities .

source_bert_toks: only the d ##wind ##ling band of loyal conservative voters was likely to believe that the increase in charges compared with the rates was the responsibility of prof ##liga ##te local authorities .

reference_raw: Only a shrinking group of loyal conservative voters was likely to believe that the increase in fees compared to tariffs was the responsibility of the profligation of the local authorities.

reference_spacy_tokens: Only a shrinking group of loyal conservative voters was likely to believe that the increase in fees compared to tariffs was the responsibility of the profligation of the local authorities .


fn_spacy_tokens_for_baseline: The FDA 's US Orphan Drug Act is intended to assist and encourage companies to develop safe and effective therapies for the treatment of rare diseases and disorders .

source_bert_toks: the fda ' s us orphan drug act is intended to assist and encourage companies to develop safe and effective the ##ra ##pies for the treatment of rare diseases and disorders .

reference_raw: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient treatments for rare diseases and disorders.

reference_spacy_tokens: The U.S. Orphan Drug Act of the FDA aims to help and encourage companies to develop safe and efficient treatments for rare diseases and disorders .


fn_spacy_tokens_for_baseline: Mortified by the twist in his sobriety , George decided to go the whole hog and join the Total Abstinence Society .

source_bert_toks: mort ##ified by the twist in his sob ##riety , george decided to go the whole hog and join the total abs ##tine ##nce society .

reference_raw: Grieved by the twist of his sobriety, George decided to go all the way to the pig and join the Total Abstinence Society.

reference_spacy_tokens: Grieved by the twist of his sobriety , George decided to go all the way to the pig and join the Total Abstinence Society .


fn_spacy_tokens_for_baseline: About 100 supporters ululated and shouted " Viva " as government bodyguards whisked Mrs. Mandela and her daughter Zenani through a crowd of journalists at Jan Smuts International Airport and into a waiting Mercedes Benz .

source_bert_toks: about 100 supporters ul ##ulated and shouted " viva " as government bodyguards w ##his ##ked mrs . mandela and her daughter zen ##ani through a crowd of journalists at jan sm ##uts international airport and into a waiting mercedes benz .

reference_raw: A hundred or so supporters called out and shouted "Viva" as the government bodyguards whisked Mrs. Mandela and her daughter Zenani through a crowd of journalists at Jan Smuts International Airport to the waiting Mercedes Benz.

reference_spacy_tokens: A hundred or so supporters called out and shouted " Viva " as the government bodyguards whisked Mrs. Mandela and her daughter Zenani through a crowd of journalists at Jan Smuts International Airport to the waiting Mercedes Benz .


fn_spacy_tokens_for_baseline: The artist must play an integral part in the process from the beginning .

source_bert_toks: the artist must play an integral part in the process from the beginning .

reference_raw: From the start, an artist has to play an integral part in the procedure.

reference_spacy_tokens: From the start , an artist has to play an integral part in the procedure .


fn_spacy_tokens_for_baseline: Clouds of little - crested parrots and rose - breasted cockatoos swarmed upon the woods that were dotted here and there over the grasslands .

source_bert_toks: clouds of little - crested parrot ##s and rose - breast ##ed cock ##ato ##os swarm ##ed upon the woods that were dotted here and there over the grasslands .

reference_raw: Clouds of small-cropped parrots and rosy-breasted cockatoos swarmed through the forests, which were dotted here and there across the grasslands.

reference_spacy_tokens: Clouds of small - cropped parrots and rosy - breasted cockatoos swarmed through the forests , which were dotted here and there across the grasslands .


fn_spacy_tokens_for_baseline: And are you happy with your pointlessly expensive urban house with its coffee - and - cream decor and its bristling gadgets , your sixty - five - minute slog into work every day , your overheated office with the'phone shrilling in your ear , your tiresomely predictable holidays , your interests in food , jogging and American films of the 1940s , your car which is always getting scratched , and your kids and the mortgage and the bills and all that ?

source_bert_toks: and are you happy with your pointless ##ly expensive urban house with its coffee - and - cream decor and its br ##ist ##ling ga ##dgets , your sixty - five - minute sl ##og into work every day , your over ##hea ##ted office with the ' phone shrill ##ing in your ear , your tires ##ome ##ly predictable holidays , your interests in food , jogging and american films of the 1940s , your car which is always getting scratched , and your kids and the mortgage and the bills and all that ?

reference_raw: And you're happy with your unnecessarily expensive city house with its coffee and cream decorations and its bristling machines, your sixty-five-minute shift to work every day, your overheated office with the phone ringing in your ear, your tiresomely predictable holidays, your interest in food, running and American movies in the 1940s, your car that's still scratching, and your kids. mortgages and bills and everything?

reference_spacy_tokens: And you 're happy with your unnecessarily expensive city house with its coffee and cream decorations and its bristling machines , your sixty - five - minute shift to work every day , your overheated office with the phone ringing in your ear , your tiresomely predictable holidays , your interest in food , running and American movies in the 1940s , your car that 's still scratching , and your kids . mortgages and bills and everything ?


fn_spacy_tokens_for_baseline: Dear Lord , he can be stupid , thought Scarlet , as she saw Camille about to respond with the surprised gratification of a matador to whom the bull has blindly turned his flank .

source_bert_toks: dear lord , he can be stupid , thought scarlet , as she saw camille about to respond with the surprised gr ##ati ##fication of a mata ##dor to whom the bull has blindly turned his flank .

reference_raw: Dear God, he can be a fool, Scarlet thought, seeing Camille about to respond with the surprised satisfaction of a matador to whom the bull had blindly turned his hip.

reference_spacy_tokens: Dear God , he can be a fool , Scarlet thought , seeing Camille about to respond with the surprised satisfaction of a matador to whom the bull had blindly turned his hip .


fn_spacy_tokens_for_baseline: We heard at the end of the statement a characteristically honest and courageous statement by the Secretary of State .

source_bert_toks: we heard at the end of the statement a characteristic ##ally honest and courageous statement by the secretary of state .

reference_raw: At the end of the statement, we heard a typically sincere and courageous statement from the Foreign Minister.

reference_spacy_tokens: At the end of the statement , we heard a typically sincere and courageous statement from the Foreign Minister .


fn_spacy_tokens_for_baseline: Immediately Holmes jumped up and hit the bell - rope hard .

source_bert_toks: immediately holmes jumped up and hit the bell - rope hard .

reference_raw: Instantly Holmes leapt to his feet and struck the bell-rope hard.

reference_spacy_tokens: Instantly Holmes leapt to his feet and struck the bell - rope hard .


fn_spacy_tokens_for_baseline: Cos you 'll get half way and you 'll have to hike

source_bert_toks: co ##s you ' ll get half way and you ' ll have to hike

reference_raw: Because you're halfway there and you're going to have to go on a trip.

reference_spacy_tokens: Because you 're halfway there and you 're going to have to go on a trip .


fn_spacy_tokens_for_baseline: And as she stood there , listening to the sounds coming from the kitchen , of glasses clinking and water splashing , she found herself glancing down at his coat .

source_bert_toks: and as she stood there , listening to the sounds coming from the kitchen , of glasses cl ##inking and water splash ##ing , she found herself glancing down at his coat .

reference_raw: And as she stood there, listening to the sounds of the kitchen, the clicking of glasses and the splashing of water, she found herself looking down at his coat.

reference_spacy_tokens: And as she stood there , listening to the sounds of the kitchen , the clicking of glasses and the splashing of water , she found herself looking down at his coat .


fn_spacy_tokens_for_baseline: ' Shakespeare ! ' hooted Carrie .

source_bert_toks: ' shakespeare ! ' ho ##oted carrie .

reference_raw: "Shakespear!" Carrie shouted.

reference_spacy_tokens: " Shakespear ! " Carrie shouted .


fn_spacy_tokens_for_baseline: His dark eyes directed to beyond the window where the Expo lights sparkled colourfully into the distance .

source_bert_toks: his dark eyes directed to beyond the window where the expo lights sparkled colourful ##ly into the distance .

reference_raw: His dark eyes went to the window, where the Expo lights glittered colorfully in the distance.

reference_spacy_tokens: His dark eyes went to the window , where the Expo lights glittered colorfully in the distance .


fn_spacy_tokens_for_baseline: When he had finished , he dressed in the clean clothes Riley had put in his bag and returned to his room , where he sat on the bed , resting himself against the pillows .

source_bert_toks: when he had finished , he dressed in the clean clothes riley had put in his bag and returned to his room , where he sat on the bed , resting himself against the pillows .

reference_raw: When he was done, he put on the clean clothes Riley had put in his bag and went back to his room, where he sat on the bed and leaned back on the cushions.

reference_spacy_tokens: When he was done , he put on the clean clothes Riley had put in his bag and went back to his room , where he sat on the bed and leaned back on the cushions .


fn_spacy_tokens_for_baseline: In the industrialised nations , where numbers have levelled out , their population bomb is perceived as exploding somewhere else , among dark - skinned peoples .

source_bert_toks: in the industrial ##ised nations , where numbers have level ##led out , their population bomb is perceived as exploding somewhere else , among dark - skinned peoples .

reference_raw: In industrialized countries, where numbers have leveled, their population bombs are perceived as explosions elsewhere, among dark-skinned nations.

reference_spacy_tokens: In industrialized countries , where numbers have leveled , their population bombs are perceived as explosions elsewhere , among dark - skinned nations .


fn_spacy_tokens_for_baseline: Perhaps we can now hazard an attempt at defining ' a good reader ' .

source_bert_toks: perhaps we can now hazard an attempt at defining ' a good reader ' .

reference_raw: Maybe now we can risk trying to define 'good reader'.

reference_spacy_tokens: Maybe now we can risk trying to define ' good reader ' .


fn_spacy_tokens_for_baseline: On the following day two more Iraqi formations made incursions into Saudi Arabian territory .

source_bert_toks: on the following day two more iraqi formations made inc ##urs ##ions into saudi arabian territory .

reference_raw: The next day, two more Iraqi formations invaded Saudi Arabia.

reference_spacy_tokens: The next day , two more Iraqi formations invaded Saudi Arabia .


fn_spacy_tokens_for_baseline: After Forest had taken over , all their fine apparel had been removed and replaced with ill - fitting second - hand garments .

source_bert_toks: after forest had taken over , all their fine apparel had been removed and replaced with ill - fitting second - hand garments .

reference_raw: When Forest took over, all their fine clothing was removed and replaced by ill-fitting second-hand clothing.

reference_spacy_tokens: When Forest took over , all their fine clothing was removed and replaced by ill - fitting second - hand clothing .


fn_spacy_tokens_for_baseline: TIME WARNER , Ice - T and Body Count 's label , is producing a public television special to discuss issues raised by the uproar over ' Cop Killer ' .

source_bert_toks: time warner , ice - t and body count ' s label , is producing a public television special to discuss issues raised by the up ##ro ##ar over ' cop killer ' .

reference_raw: TIME WARNER, Ice-T and Body Count's label, creates a public television special to discuss the issues raised by the uproar of 'Cop Killer'.

reference_spacy_tokens: TIME WARNER , Ice - T and Body Count 's label , creates a public television special to discuss the issues raised by the uproar of ' Cop Killer ' .


fn_spacy_tokens_for_baseline: All over the island tall old trees crashed down , and less tall trees whipped about and were filleted of their leaves and branches .

source_bert_toks: all over the island tall old trees crashed down , and less tall trees whipped about and were fill ##ete ##d of their leaves and branches .

reference_raw: Tall old trees fell all over the island, and less tall trees whipped around and filled with leaves and branches.

reference_spacy_tokens: Tall old trees fell all over the island , and less tall trees whipped around and filled with leaves and branches .


fn_spacy_tokens_for_baseline: Trains were either diverted from Worcester to New Street via Bromsgrove , or terminated at Stourbridge Junction .

source_bert_toks: trains were either diverted from worcester to new street via bro ##ms ##grove , or terminated at st ##our ##bridge junction .

reference_raw: The trains were either transferred from Worcester to New Street through Bromsgrove or stopped at Stourbridge Junction.

reference_spacy_tokens: The trains were either transferred from Worcester to New Street through Bromsgrove or stopped at Stourbridge Junction .


fn_spacy_tokens_for_baseline: Following its victory , Athens introduced the concept of a mutual protection alliance ( a kind of NATO of the ancient world ) .

source_bert_toks: following its victory , athens introduced the concept of a mutual protection alliance ( a kind of nato of the ancient world ) .

reference_raw: After its victory, Athens introduced the concept of an alliance to protect each other (a kind of NATO from the old world).

reference_spacy_tokens: After its victory , Athens introduced the concept of an alliance to protect each other ( a kind of NATO from the old world ) .


fn_spacy_tokens_for_baseline: She insisted on having wine with the meal , and as I had n't had a drink in a long time , it made me feel rather tipsy .

source_bert_toks: she insisted on having wine with the meal , and as i hadn ' t had a drink in a long time , it made me feel rather tips ##y .

reference_raw: She insisted on having wine with food, and since I hadn't had a drink in a long time, I felt rather drunk.

reference_spacy_tokens: She insisted on having wine with food , and since I had n't had a drink in a long time , I felt rather drunk .


fn_spacy_tokens_for_baseline: She cut through the tight bonds of twine , the shiny brown wrappings , with Leonie 's penknife .

source_bert_toks: she cut through the tight bonds of twin ##e , the shiny brown wrapping ##s , with leon ##ie ' s pen ##k ##ni ##fe .

reference_raw: With Leonie's penknife, she cut through the tight bindings of the twine and the gleaming brown wrappings.

reference_spacy_tokens: With Leonie 's penknife , she cut through the tight bindings of the twine and the gleaming brown wrappings .


fn_spacy_tokens_for_baseline: And I suppose we 'd better go and asphyxiate ourselves up at the sulphur springs .

source_bert_toks: and i suppose we ' d better go and as ##phy ##xia ##te ourselves up at the sul ##ph ##ur springs .

reference_raw: And I think we should go and suffocate ourselves in the sulphur springs.

reference_spacy_tokens: And I think we should go and suffocate ourselves in the sulphur springs .


fn_spacy_tokens_for_baseline: The boats go on to the friendly fishermen 's island of Tap Mun , in Mirs Bay , with stops in remote hamlets of the Sai Kung Peninsula .

source_bert_toks: the boats go on to the friendly fishermen ' s island of tap mu ##n , in mir ##s bay , with stops in remote hamlets of the sai kung peninsula .

reference_raw: The ships will proceed to the friendly fishing island of Tap Mun, Mirs Bay, where they will stop in the remote villages of the Sai Kung Peninsula.

reference_spacy_tokens: The ships will proceed to the friendly fishing island of Tap Mun , Mirs Bay , where they will stop in the remote villages of the Sai Kung Peninsula .


fn_spacy_tokens_for_baseline: Some of his poses aroused derision from contemporaries , but his art suited the Romantic sensibilities of his day , and the principle of depicting living creatures became gradually accepted .

source_bert_toks: some of his poses aroused der ##ision from contemporaries , but his art suited the romantic sen ##si ##bilities of his day , and the principle of depicting living creatures became gradually accepted .

reference_raw: Some of his poses aroused the mockery of contemporaries, but his art suited the romantic sensibilities of his day, and the principle of depiction of living beings was gradually adopted.

reference_spacy_tokens: Some of his poses aroused the mockery of contemporaries , but his art suited the romantic sensibilities of his day , and the principle of depiction of living beings was gradually adopted .


fn_spacy_tokens_for_baseline: Such transfers have resulted in numerous U.S. nonproliferation sanctions being imposed on Chinese entities .

source_bert_toks: such transfers have resulted in numerous u . s . non ##pro ##life ##ration sanctions being imposed on chinese entities .

reference_raw: These transfers led to the imposition of a number of US non-proliferation sanctions on Chinese entities.

reference_spacy_tokens: These transfers led to the imposition of a number of US non - proliferation sanctions on Chinese entities .


fn_spacy_tokens_for_baseline: Only the sound of the rain , pattering more gently against the window , disturbed the quiet now .

source_bert_toks: only the sound of the rain , pat ##tering more gently against the window , disturbed the quiet now .

reference_raw: The silence was disturbed only by the sound of the rain patting gently against the window.

reference_spacy_tokens: The silence was disturbed only by the sound of the rain patting gently against the window .


fn_spacy_tokens_for_baseline: ' Structure ' sprays are a sort of setting lotion in natural spray form , allowing permed or curly hair to be scrunched into shape .

source_bert_toks: ' structure ' spray ##s are a sort of setting lot ##ion in natural spray form , allowing per ##med or curly hair to be sc ##run ##ched into shape .

reference_raw: "Structure" sprays are a kind of set-up lotion in the form of a natural spray, which allows the smooth or curly hair to be cut into shape.

reference_spacy_tokens: " Structure " sprays are a kind of set - up lotion in the form of a natural spray , which allows the smooth or curly hair to be cut into shape .


fn_spacy_tokens_for_baseline: Ace woke at once , drawing her gun and spinning about on the carpeting of plaster chips and glass fragments , searching for the source and target .

source_bert_toks: ace woke at once , drawing her gun and spinning about on the carpet ##ing of plaster chips and glass fragments , searching for the source and target .

reference_raw: Ace awoke instantly, drew her pistol, and turned on a carpet of plaster chips and pieces of glass, looking for the source and destination.

reference_spacy_tokens: Ace awoke instantly , drew her pistol , and turned on a carpet of plaster chips and pieces of glass , looking for the source and destination .


fn_spacy_tokens_for_baseline: And as the horse thudded over the frozen grass of the common land and came to the high road in a clatter of hooves , she sensed , beneath the fear , some ripple of excitement .

source_bert_toks: and as the horse thud ##ded over the frozen grass of the common land and came to the high road in a cl ##atter of hooves , she sensed , beneath the fear , some ripple of excitement .

reference_raw: And as the horse thundered across the frozen grass of the common ground and came to the high road in a clatter of hooves, she felt a ripple of excitement beneath her fear.

reference_spacy_tokens: And as the horse thundered across the frozen grass of the common ground and came to the high road in a clatter of hooves , she felt a ripple of excitement beneath her fear .


fn_spacy_tokens_for_baseline: Making his craftsmen redundant is heartbreaking .

source_bert_toks: making his craftsmen redundant is heartbreak ##ing .

reference_raw: It breaks my heart to make his craftsmen redundant.

reference_spacy_tokens: It breaks my heart to make his craftsmen redundant .


fn_spacy_tokens_for_baseline: Now suddenly , for no apparent reason , they become careless and leave their faeces on the carpet .

source_bert_toks: now suddenly , for no apparent reason , they become careless and leave their fae ##ces on the carpet .

reference_raw: All of a sudden, for no apparent reason, they become indifferent and leave their faces on the carpet.

reference_spacy_tokens: All of a sudden , for no apparent reason , they become indifferent and leave their faces on the carpet .


fn_spacy_tokens_for_baseline: It rattled along the road , waking a baroque concerto of echoes from rotting red - brick gables , and somewhere , in a front - room shrouded with dirty net curtains , a baby began to cry .

source_bert_toks: it rattled along the road , waking a baroque concerto of echoes from rotting red - brick gables , and somewhere , in a front - room sh ##roud ##ed with dirty net curtains , a baby began to cry .

reference_raw: He rattled along the road, awakening a baroque concert of echoes from rotting red brick gables, and somewhere in the front room, covered with dirty net curtains, a child began to cry.

reference_spacy_tokens: He rattled along the road , awakening a baroque concert of echoes from rotting red brick gables , and somewhere in the front room , covered with dirty net curtains , a child began to cry .


fn_spacy_tokens_for_baseline: One such quiet stroll had become a 12-mile hike by the time we got back to our hotel .

source_bert_toks: one such quiet stroll had become a 12 - mile hike by the time we got back to our hotel .

reference_raw: When we got back to the hotel, one of those quiet walks became a 12-mile trip.

reference_spacy_tokens: When we got back to the hotel , one of those quiet walks became a 12-mile trip .


fn_spacy_tokens_for_baseline: There is nothing to do but press ahead , the senses even more vigilant .

source_bert_toks: there is nothing to do but press ahead , the senses even more vi ##gil ##ant .

reference_raw: There's nothing to do but push forward, senses even more alert.

reference_spacy_tokens: There 's nothing to do but push forward , senses even more alert .


fn_spacy_tokens_for_baseline: No wonder , then , that at the cessation of Lend - Lease , which had until VJ Day bridged the gap in the British accounts , Keynes could talk of a ' financial Dunkirk ' .

source_bert_toks: no wonder , then , that at the ce ##ssa ##tion of lend - lease , which had until v ##j day bridge ##d the gap in the british accounts , keynes could talk of a ' financial dunkirk ' .

reference_raw: So it's no wonder Keynes was able to talk about "financial Dunkirk" at the end of Lend-Lease, which was until VJ Day bridged the gap in British accounts.

reference_spacy_tokens: So it 's no wonder Keynes was able to talk about " financial Dunkirk " at the end of Lend - Lease , which was until VJ Day bridged the gap in British accounts .


fn_spacy_tokens_for_baseline: Where he had touched her her scalp was prickling like a porcupine .

source_bert_toks: where he had touched her her scalp was prick ##ling like a por ##cup ##ine .

reference_raw: The place where he touched her scalp stinged like a porcupine.

reference_spacy_tokens: The place where he touched her scalp stinged like a porcupine .


fn_spacy_tokens_for_baseline: Contravening his own argument , however , Schiefer also speculated that the Iranians were most likely trying to acquire the fungi for defensive purposes , such as developing gas masks that would be protective in the event of its offensive use .

source_bert_toks: contra ##ven ##ing his own argument , however , sc ##hi ##efe ##r also speculated that the iranian ##s were most likely trying to acquire the fungi for defensive purposes , such as developing gas masks that would be protective in the event of its offensive use .

reference_raw: But, contrary to his own argument, Schiefer also speculated that the Iranians were probably trying to acquire a fungi for defense purposes, such as the development of a gas-mask that would protect it if it were used in an attack.

reference_spacy_tokens: But , contrary to his own argument , Schiefer also speculated that the Iranians were probably trying to acquire a fungi for defense purposes , such as the development of a gas - mask that would protect it if it were used in an attack .


fn_spacy_tokens_for_baseline: It is surely preferable to retain some defined elements of musical form , so that the music can be retained in the memory .

source_bert_toks: it is surely prefer ##able to retain some defined elements of musical form , so that the music can be retained in the memory .

reference_raw: It is certainly preferable to maintain certain defined elements of musical form in order to preserve the music in memory.

reference_spacy_tokens: It is certainly preferable to maintain certain defined elements of musical form in order to preserve the music in memory .


fn_spacy_tokens_for_baseline: ( ' Give yourself time to reconnoitre the Subject 's area and known haunts . ' )

source_bert_toks: ( ' give yourself time to rec ##on ##no ##it ##re the subject ' s area and known haunt ##s . ' )

reference_raw: ('Give yourself time to explore the subject's territory and known haunts.')

reference_spacy_tokens: ( ' Give yourself time to explore the subject 's territory and known haunts . ' )


fn_spacy_tokens_for_baseline: The filial bond remains , though , and when the women call , the pigs come .

source_bert_toks: the fi ##lia ##l bond remains , though , and when the women call , the pigs come .

reference_raw: But the file bond stays, and when the women call, the pigs come.

reference_spacy_tokens: But the file bond stays , and when the women call , the pigs come .


fn_spacy_tokens_for_baseline: Luckily for him , there was a troop of Boy Scouts camped nearby and they were able to get his car back on the road and Mr. Shaw on his way to York .

source_bert_toks: luckily for him , there was a troop of boy scouts camped nearby and they were able to get his car back on the road and mr . shaw on his way to york .

reference_raw: Fortunately for him, there was a squad of Boy Scouts encamped nearby, and they were able to get his car back on the road and Mr. Shaw on his way to York.

reference_spacy_tokens: Fortunately for him , there was a squad of Boy Scouts encamped nearby , and they were able to get his car back on the road and Mr. Shaw on his way to York .


fn_spacy_tokens_for_baseline: He dozed on the short drive , but unfortunately he was wide awake and very horny when they reached their hotel room .

source_bert_toks: he do ##zed on the short drive , but unfortunately he was wide awake and very horn ##y when they reached their hotel room .

reference_raw: He dozed on the short drive, but, unfortunately, when they reached the hotel room, he was wide awake and very hot.

reference_spacy_tokens: He dozed on the short drive , but , unfortunately , when they reached the hotel room , he was wide awake and very hot .


fn_spacy_tokens_for_baseline: Alex was a prickly person , an unbalanced person , sometimes an infuriating person , but Charles did n't want to think of him as a murderer .

source_bert_toks: alex was a prick ##ly person , an un ##balance ##d person , sometimes an in ##fur ##iating person , but charles didn ' t want to think of him as a murderer .

reference_raw: Alex was a prickly man, unbalanced, sometimes angry, but Charles didn't want to think of him as a killer.

reference_spacy_tokens: Alex was a prickly man , unbalanced , sometimes angry , but Charles did n't want to think of him as a killer .


fn_spacy_tokens_for_baseline: Contoured metallic parts glided and folded out over me , emerging from the wall and pushing me back in with them .

source_bert_toks: con ##tour ##ed metallic parts glided and folded out over me , emerging from the wall and pushing me back in with them .

reference_raw: The shaped metal parts slid and rolled over me, came out of the wall and pushed me back with them.

reference_spacy_tokens: The shaped metal parts slid and rolled over me , came out of the wall and pushed me back with them .


fn_spacy_tokens_for_baseline: Twenty minutes later she stood in front of the mirror wearing the fragile lace undies which were also the result of her impulse - buying .

source_bert_toks: twenty minutes later she stood in front of the mirror wearing the fragile lace und ##ies which were also the result of her impulse - buying .

reference_raw: Twenty minutes later she was standing in front of the mirror, wearing frail lace underwear that was also the result of her impulse purchase.

reference_spacy_tokens: Twenty minutes later she was standing in front of the mirror , wearing frail lace underwear that was also the result of her impulse purchase .


fn_spacy_tokens_for_baseline: He pulled a jute sack onto his lap and pointed down at my face with a dagger .

source_bert_toks: he pulled a ju ##te sack onto his lap and pointed down at my face with a dagger .

reference_raw: He pulled the jute bag to his lap and pointed a dagger at my face.

reference_spacy_tokens: He pulled the jute bag to his lap and pointed a dagger at my face .


fn_spacy_tokens_for_baseline: Jack finally crested the hill and stood in the shadow of the Monument .

source_bert_toks: jack finally crested the hill and stood in the shadow of the monument .

reference_raw: At last Jack climbed the hill and stood in the shadow of the monument.

reference_spacy_tokens: At last Jack climbed the hill and stood in the shadow of the monument .


fn_spacy_tokens_for_baseline: ' I am vexed , John .

source_bert_toks: ' i am ve ##xed , john .

reference_raw: I'm drunk, John.

reference_spacy_tokens: I 'm drunk , John .


fn_spacy_tokens_for_baseline: Julie Tullis , who was Britain 's most eminent woman mountaineer , died five years ago on K2 following her ascent of the peak .

source_bert_toks: julie tu ##llis , who was britain ' s most eminent woman mountain ##eer , died five years ago on k ##2 following her ascent of the peak .

reference_raw: Julia Tullis, the most prominent female mountaineer in Britain, died on K2 five years ago after her rise from the peak.

reference_spacy_tokens: Julia Tullis , the most prominent female mountaineer in Britain , died on K2 five years ago after her rise from the peak .


fn_spacy_tokens_for_baseline: ST came to me and rubbed against my side , purring his rattling , wheezing purr .

source_bert_toks: st came to me and rubbed against my side , pu ##rring his rattling , w ##hee ##zing pu ##rr .

reference_raw: S.T. came to me and rubbed me on the side, pursing his rattling, wheezing purre.

reference_spacy_tokens: S.T. came to me and rubbed me on the side , pursing his rattling , wheezing purre .


fn_spacy_tokens_for_baseline: Many village priests insisted on living in luxury , dressing in the best garb , jerkin and multi - coloured hose , and making every effort to palliate the hardships of their lives .

source_bert_toks: many village priests insisted on living in luxury , dressing in the best ga ##rb , jerk ##in and multi - coloured hose , and making every effort to pal ##lia ##te the hardship ##s of their lives .

reference_raw: Many village priests insisted on living in luxury, wearing their best suits, jackets, and multicolored hoses, and making every effort to alleviate the hardships of their lives.

reference_spacy_tokens: Many village priests insisted on living in luxury , wearing their best suits , jackets , and multicolored hoses , and making every effort to alleviate the hardships of their lives .


fn_spacy_tokens_for_baseline: And there are a lot of people who face these challenges every day of their lives .

source_bert_toks: and there are a lot of people who face these challenges every day of their lives .

reference_raw: And there's a lot of people who face these challenges on a daily basis.

reference_spacy_tokens: And there 's a lot of people who face these challenges on a daily basis .


fn_spacy_tokens_for_baseline: For myself , on those occasions that Gillian embellished my dance - card , I reined myself in , generously not seeking to provoke dismaying comparison .

source_bert_toks: for myself , on those occasions that gillian em ##bell ##ished my dance - card , i rein ##ed myself in , generous ##ly not seeking to provoke dismay ##ing comparison .

reference_raw: For myself, on those occasions when Gillian had embellished my dance card, I reined in, generously trying not to make a terrible comparison.

reference_spacy_tokens: For myself , on those occasions when Gillian had embellished my dance card , I reined in , generously trying not to make a terrible comparison .


fn_spacy_tokens_for_baseline: And can we expect states to allow non - coercive jural agencies to gather information in an effective manner when this involves the divulgence of state secrets , even if this is seen as the only way to secure confidence in , for instance , disarmament treaties ?

source_bert_toks: and can we expect states to allow non - coe ##rc ##ive ju ##ral agencies to gather information in an effective manner when this involves the di ##vu ##lge ##nce of state secrets , even if this is seen as the only way to secure confidence in , for instance , di ##sar ##mament treaties ?

reference_raw: And can we expect states to allow non-coercive legal agencies to collect information effectively if it involves revealing state secrets, even if it is considered the only way to secure confidence in, for example, disarmament contracts?

reference_spacy_tokens: And can we expect states to allow non - coercive legal agencies to collect information effectively if it involves revealing state secrets , even if it is considered the only way to secure confidence in , for example , disarmament contracts ?


fn_spacy_tokens_for_baseline: Display your children 's art lesson masterpieces round the room -- it will encourage and gratify them and will certainly provide talking points .

source_bert_toks: display your children ' s art lesson masterpiece ##s round the room - - it will encourage and gr ##ati ##fy them and will certainly provide talking points .

reference_raw: Show your children's art masterpieces around the room - it will encourage and satisfy them, and it will certainly provide speech points.

reference_spacy_tokens: Show your children 's art masterpieces around the room - it will encourage and satisfy them , and it will certainly provide speech points .


fn_spacy_tokens_for_baseline: He sat back and massaged his temples , his eyes closed .

source_bert_toks: he sat back and massage ##d his temples , his eyes closed .

reference_raw: He leaned back and rubbed his temples, eyes closed.

reference_spacy_tokens: He leaned back and rubbed his temples , eyes closed .


fn_spacy_tokens_for_baseline: China has produced and deployed a wide range of ballistic missiles , ranging from short - range missiles to intercontinental ballistic missiles ( ICBMs ) .

source_bert_toks: china has produced and deployed a wide range of ballistic missiles , ranging from short - range missiles to intercontinental ballistic missiles ( ic ##bm ##s ) .

reference_raw: China has produced and deployed a wide range of ballistic missiles, ranging from short-range to inter-continental ballistic missiles.

reference_spacy_tokens: China has produced and deployed a wide range of ballistic missiles , ranging from short - range to inter - continental ballistic missiles .


fn_spacy_tokens_for_baseline: Stitch braid or fringing to the right side on the lower edge .

source_bert_toks: stitch braid or fr ##inging to the right side on the lower edge .

reference_raw: Stick a knot or a string on the right side of the lower edge.

reference_spacy_tokens: Stick a knot or a string on the right side of the lower edge .


fn_spacy_tokens_for_baseline: " Hostile and even friendly nations routinely steal information from U.S. companies and share it with their own companies , " said Noel D. Matchett , a former staffer at the federal National Security Agency and now president of Information Security Inc. , Silver Spring , MD .

source_bert_toks: " hostile and even friendly nations routinely steal information from u . s . companies and share it with their own companies , " said noel d . match ##ett , a former staff ##er at the federal national security agency and now president of information security inc . , silver spring , md .

reference_raw: "Hostile and even friendly nations routinely steal information from American companies and share it with their own companies," said Noel D. Matchett, an ex-Federal Security Agency employee and now president of Information Security Inc., Silver Spring, MD.

reference_spacy_tokens: " Hostile and even friendly nations routinely steal information from American companies and share it with their own companies , " said Noel D. Matchett , an ex - Federal Security Agency employee and now president of Information Security Inc. , Silver Spring , MD .


fn_spacy_tokens_for_baseline: Thirteen of the health effects would be due to thyroid cancer fatalities , assuming a 5 per cent fatality rate among a total number of expected thyroid cancers of 250 .

source_bert_toks: thirteen of the health effects would be due to thyroid cancer fatalities , assuming a 5 per cent fatal ##ity rate among a total number of expected thyroid cancers of 250 .

reference_raw: Thirteen of the health effects would be caused by the death of thyroid cancer, assuming that among the total number of expected thyroid cancers, the death rate would be 5%.

reference_spacy_tokens: Thirteen of the health effects would be caused by the death of thyroid cancer , assuming that among the total number of expected thyroid cancers , the death rate would be 5 % .


fn_spacy_tokens_for_baseline: Two fine , upstanding members of staff attend a Christmas party in the staff canteen , c.1971 -- which just goes to show that Christmas in the National Library is not what it used to be !

source_bert_toks: two fine , ups ##tan ##ding members of staff attend a christmas party in the staff canteen , c . 1971 - - which just goes to show that christmas in the national library is not what it used to be !

reference_raw: Two fine, honest staff members attend a Christmas party in the staff canteen, C.1971 - to show that Christmas in the National Library isn't what it used to be!

reference_spacy_tokens: Two fine , honest staff members attend a Christmas party in the staff canteen , C.1971 - to show that Christmas in the National Library is n't what it used to be !


fn_spacy_tokens_for_baseline: Polly poured the coffee , adding milk and three spoonfuls of sugar .

source_bert_toks: polly poured the coffee , adding milk and three spoon ##ful ##s of sugar .

reference_raw: Polly poured coffee and added milk and three spoons of sugar.

reference_spacy_tokens: Polly poured coffee and added milk and three spoons of sugar .


fn_spacy_tokens_for_baseline: In my estimation , the best pencils are totally soluble , not relatively so as Mr Robb states .

source_bert_toks: in my estimation , the best pencil ##s are totally soluble , not relatively so as mr robb states .

reference_raw: In my opinion, the best pencils are completely soluble, not as much as Mr. Robb says.

reference_spacy_tokens: In my opinion , the best pencils are completely soluble , not as much as Mr. Robb says .


fn_spacy_tokens_for_baseline: Now both of them were choking with their laughter as Mick ended , ' It got so bad that they used to wait for it every Sunday night and try to smother me with a pillow .

source_bert_toks: now both of them were choking with their laughter as mick ended , ' it got so bad that they used to wait for it every sunday night and try to sm ##oth ##er me with a pillow .

reference_raw: Now they were both suffocating with laughter when Mick finished, 'It was so bad they waited for him every Sunday night and tried to suffocate me with a pillow.

reference_spacy_tokens: Now they were both suffocating with laughter when Mick finished , ' It was so bad they waited for him every Sunday night and tried to suffocate me with a pillow .


fn_spacy_tokens_for_baseline: Sometimes we crunched across crystalline ice , or slid tiny steps at a time over glass ice , so we created shiny black footprints in the dusting of snow .

source_bert_toks: sometimes we crunch ##ed across crystalline ice , or slid tiny steps at a time over glass ice , so we created shiny black footprints in the dustin ##g of snow .

reference_raw: Sometimes we scraped through crystal ice or slid small steps at a time over glass ice, creating shiny black footprints in the dust of snow.

reference_spacy_tokens: Sometimes we scraped through crystal ice or slid small steps at a time over glass ice , creating shiny black footprints in the dust of snow .


fn_spacy_tokens_for_baseline: In the period since his appointment , he has merged the two companies , their products and the sales force into the single organisation that is in operation today .

source_bert_toks: in the period since his appointment , he has merged the two companies , their products and the sales force into the single organisation that is in operation today .

reference_raw: In the period since his appointment, he has combined the two companies, their products and their sales forces into a single organisation that is currently in operation.

reference_spacy_tokens: In the period since his appointment , he has combined the two companies , their products and their sales forces into a single organisation that is currently in operation .


fn_spacy_tokens_for_baseline: Preoccupied with the thoughts of his suffering , the trivial concerns of her lover become increasingly aggravating as they hang around with the crowds at Brighton .

source_bert_toks: preoccupied with the thoughts of his suffering , the trivial concerns of her lover become increasingly ag ##gra ##vating as they hang around with the crowds at brighton .

reference_raw: Preoccupied with the thoughts of his suffering, her lover's petty fears grew more and more acute as they roamed the crowds of Brighton.

reference_spacy_tokens: Preoccupied with the thoughts of his suffering , her lover 's petty fears grew more and more acute as they roamed the crowds of Brighton .


fn_spacy_tokens_for_baseline: The Dutch government rids itself of the art mountain

source_bert_toks: the dutch government rid ##s itself of the art mountain

reference_raw: The Dutch government disposes of a mountain of art.

reference_spacy_tokens: The Dutch government disposes of a mountain of art .


fn_spacy_tokens_for_baseline: Brush the steaks with the oil .

source_bert_toks: brush the steak ##s with the oil .

reference_raw: Blow those steaks with oil.

reference_spacy_tokens: Blow those steaks with oil .


fn_spacy_tokens_for_baseline: I did n't stay long after that , only enough to learn Estelle 's schedule so that I might help her into her new place .

source_bert_toks: i didn ' t stay long after that , only enough to learn este ##lle ' s schedule so that i might help her into her new place .

reference_raw: After that, I didn't stay long, just enough to learn Estelle's plan so I could help her get to her new place.

reference_spacy_tokens: After that , I did n't stay long , just enough to learn Estelle 's plan so I could help her get to her new place .


fn_spacy_tokens_for_baseline: Some of these rise above sea level , but the vast majority are submarine features known as seamounts , or if they are flat - topped , guyots .

source_bert_toks: some of these rise above sea level , but the vast majority are submarine features known as seam ##ount ##s , or if they are flat - topped , guy ##ots .

reference_raw: Some of these rise above sea level, but the vast majority of them are submersible features known as sea-mounts or, if they are flat-topped, manots.

reference_spacy_tokens: Some of these rise above sea level , but the vast majority of them are submersible features known as sea - mounts or , if they are flat - topped , manots .


fn_spacy_tokens_for_baseline: At our yearly rally in March classes took place by Rita Horton , Frances Almond , Ruth Rolph , Sophie Roe , Molly Scrutton and Ruby Philpott .

source_bert_toks: at our yearly rally in march classes took place by rita horton , frances almond , ruth ro ##lp ##h , sophie roe , molly sc ##rut ##ton and ruby phil ##pot ##t .

reference_raw: Rita Horton, Frances Almond, Ruth Rolph, Sophie Roe, Molly Scrutton and Ruby Philpott attended our annual meeting in March.

reference_spacy_tokens: Rita Horton , Frances Almond , Ruth Rolph , Sophie Roe , Molly Scrutton and Ruby Philpott attended our annual meeting in March .


fn_spacy_tokens_for_baseline: Now he sniffs cocaine , too .

source_bert_toks: now he sniff ##s cocaine , too .

reference_raw: And now he's smelling cocaine.

reference_spacy_tokens: And now he 's smelling cocaine .


fn_spacy_tokens_for_baseline: Once he had actually cracked her rib .

source_bert_toks: once he had actually cracked her rib .

reference_raw: He even broke her rib once.

reference_spacy_tokens: He even broke her rib once .


fn_spacy_tokens_for_baseline: My son 's teacher had recently died in a bombing and my wife had cried for days . I worried that the two of them would be in shock .

source_bert_toks: my son ' s teacher had recently died in a bombing and my wife had cried for days . i worried that the two of them would be in shock .

reference_raw: My son's teacher died in a bombing the other day, and my wife cried for days, and I was afraid they'd be shaken.

reference_spacy_tokens: My son 's teacher died in a bombing the other day , and my wife cried for days , and I was afraid they 'd be shaken .


fn_spacy_tokens_for_baseline: Next to Chez Panisse a homeless couple , bundled into a blue sleeping bag , sat up , said , " Good morning " and then the woman smiled , said , " Is n't it great just to be alive ? " I agreed .

source_bert_toks: next to che ##z pan ##isse a homeless couple , bundled into a blue sleeping bag , sat up , said , " good morning " and then the woman smiled , said , " isn ' t it great just to be alive ? " i agreed .

reference_raw: Beside Chez Panisse, a couple of homeless men, wrapped in a bluish sleeping bag, sat down, said, "Good morning," and then she smiled and said, "Isn't it good to be alive?" I said.

reference_spacy_tokens: Beside Chez Panisse , a couple of homeless men , wrapped in a bluish sleeping bag , sat down , said , " Good morning , " and then she smiled and said , " Is n't it good to be alive ? " I said .


fn_spacy_tokens_for_baseline: Gelatine surfaced - size papers offer maximum durability for oil pastels because the surface withstands vigorous work .

source_bert_toks: gel ##atin ##e surfaced - size papers offer maximum du ##ra ##bility for oil paste ##ls because the surface withstand ##s vigorous work .

reference_raw: The surface-size gelatin papers offer maximum shelf life for oil pastels, as the surface resists intense work.

reference_spacy_tokens: The surface - size gelatin papers offer maximum shelf life for oil pastels , as the surface resists intense work .


fn_spacy_tokens_for_baseline: ' I 'm not spending the time ploughing the Cochlea fever - steppes or herding Tyyrkyn mountain pigs .

source_bert_toks: ' i ' m not spending the time pl ##ough ##ing the co ##ch ##lea fever - steppe ##s or herd ##ing ty ##yr ##ky ##n mountain pigs .

reference_raw: 'I don't spend my time ploughing up Cochlea fever steppes or breeding Tyrkyn mountain pigs.

reference_spacy_tokens: ' I do n't spend my time ploughing up Cochlea fever steppes or breeding Tyrkyn mountain pigs .


fn_spacy_tokens_for_baseline: He probably took one look at Zen and scarpered . )

source_bert_toks: he probably took one look at zen and scar ##per ##ed . )

reference_raw: He looked at Zen, probably scarred.)

reference_spacy_tokens: He looked at Zen , probably scarred . )


fn_spacy_tokens_for_baseline: 13 RICH : Um , I got a couple more hours .

source_bert_toks: 13 rich : um , i got a couple more hours .

reference_raw: 13 RICH: Um, I have a few hours left.

reference_spacy_tokens: 13 RICH : Um , I have a few hours left .


fn_spacy_tokens_for_baseline: Until his knees failed him and the cartilages were removed , he was also one of the finest of all cover fielders , with electrifying speed and a pin - point throw that seemed barely credible .

source_bert_toks: until his knees failed him and the cart ##ila ##ges were removed , he was also one of the finest of all cover fielder ##s , with elect ##ri ##fying speed and a pin - point throw that seemed barely credible .

reference_raw: Until his knees had failed him and the cartilages had been removed, he was also one of the best of the cover fielders, with an electrical speed and a pinpoint toss that seemed almost unreliable.

reference_spacy_tokens: Until his knees had failed him and the cartilages had been removed , he was also one of the best of the cover fielders , with an electrical speed and a pinpoint toss that seemed almost unreliable .


fn_spacy_tokens_for_baseline: Dozens of firemen fought to control the blaze at Old Hall Farm , Heath Road , Tendring , shortly before 8 pm on Tuesday .

source_bert_toks: dozens of fire ##men fought to control the blaze at old hall farm , heath road , tend ##ring , shortly before 8 pm on tuesday .

reference_raw: Dozens of firefighters fought over the fire at Old Hall Farm, Heath Road, Tendring, just before eight o'clock on Tuesday.

reference_spacy_tokens: Dozens of firefighters fought over the fire at Old Hall Farm , Heath Road , Tendring , just before eight o'clock on Tuesday .


fn_spacy_tokens_for_baseline: Imported dried cod ( bacalhao ) is the Portuguese national dish ; several varieties are available , usually baked .

source_bert_toks: imported dried cod ( ba ##cal ##ha ##o ) is the portuguese national dish ; several varieties are available , usually baked .

reference_raw: The imported dried cod (bacalhao) is a Portuguese domestic food; several varieties are available, usually baked.

reference_spacy_tokens: The imported dried cod ( bacalhao ) is a Portuguese domestic food ; several varieties are available , usually baked .


fn_spacy_tokens_for_baseline: How idiotic it was for a man of forty to allow his head to be turned once more by prettiness .

source_bert_toks: how idiot ##ic it was for a man of forty to allow his head to be turned once more by pre ##tti ##ness .

reference_raw: How stupid it was for a 40-year-old man to let his head turn with beauty again.

reference_spacy_tokens: How stupid it was for a 40-year - old man to let his head turn with beauty again .


fn_spacy_tokens_for_baseline: His eyelids stuck together .

source_bert_toks: his eyelids stuck together .

reference_raw: His eyelids were glued together.

reference_spacy_tokens: His eyelids were glued together .


fn_spacy_tokens_for_baseline: Facts such as the deceased woman 's maiden name , the birthplace of the deceased and so on will all be needed , as will the person 's national insurance number , state benefit books and NHS card .

source_bert_toks: facts such as the deceased woman ' s maiden name , the birthplace of the deceased and so on will all be needed , as will the person ' s national insurance number , state benefit books and nhs card .

reference_raw: Facts such as the maiden name of the dead woman, the place of birth of the dead woman, etc., as well as the person's national insurance number, the state benefit books and the NHS card, will be needed.

reference_spacy_tokens: Facts such as the maiden name of the dead woman , the place of birth of the dead woman , etc . , as well as the person 's national insurance number , the state benefit books and the NHS card , will be needed .


fn_spacy_tokens_for_baseline: Regulations have also been discussed regarding the suspension and dismissal of public employees who do not express loyalty to General Noriega .

source_bert_toks: regulations have also been discussed regarding the suspension and dismissal of public employees who do not express loyalty to general nor ##ieg ##a .

reference_raw: The regulations on the suspension and termination of civil servants who are not loyal to General Noriega were also discussed.

reference_spacy_tokens: The regulations on the suspension and termination of civil servants who are not loyal to General Noriega were also discussed .


fn_spacy_tokens_for_baseline: Their curiosity pushed them to build vessels that were strong enough to ford the open seas and reach these islands , marking the start of the long legacy of Mediterranean seafaring .

source_bert_toks: their curiosity pushed them to build vessels that were strong enough to ford the open seas and reach these islands , marking the start of the long legacy of mediterranean sea ##far ##ing .

reference_raw: Curiosity urged them to build ships that were strong enough to forge open seas and reach these islands, marking the beginning of a long legacy of Mediterranean seafaring.

reference_spacy_tokens: Curiosity urged them to build ships that were strong enough to forge open seas and reach these islands , marking the beginning of a long legacy of Mediterranean seafaring .


fn_spacy_tokens_for_baseline: The Irish National Teachers Organisation , which organised the survey of about 500 members during the first two weeks of this month , said Education Minister Jeremy Hanley must now delay statutory assessment .

source_bert_toks: the irish national teachers organisation , which organised the survey of about 500 members during the first two weeks of this month , said education minister jeremy han ##ley must now delay statutory assessment .

reference_raw: In the first two weeks of this month, the Irish National Teachers Organization, which organised an inspection of about 500 members, said that the Minister of Education Jeremy Hanley must now postpone the statutory assessment.

reference_spacy_tokens: In the first two weeks of this month , the Irish National Teachers Organization , which organised an inspection of about 500 members , said that the Minister of Education Jeremy Hanley must now postpone the statutory assessment .


fn_spacy_tokens_for_baseline: I saw a range of hills behind us .

source_bert_toks: i saw a range of hills behind us .

reference_raw: I could see the mountains beyond.

reference_spacy_tokens: I could see the mountains beyond .


fn_spacy_tokens_for_baseline: ' I will not have this dreadful art in the gallery , ' he would say with genuine exasperation .

source_bert_toks: ' i will not have this dreadful art in the gallery , ' he would say with genuine ex ##as ##peration .

reference_raw: "I won't have that terrible art in the gallery," he said with genuine exasperation.

reference_spacy_tokens: " I wo n't have that terrible art in the gallery , " he said with genuine exasperation .


fn_spacy_tokens_for_baseline: Also , the visitors with high security clearance should be designated parking spots inside the location .

source_bert_toks: also , the visitors with high security clearance should be designated parking spots inside the location .

reference_raw: Visitors with a high security clearance should also be designated parking spaces within the site.

reference_spacy_tokens: Visitors with a high security clearance should also be designated parking spaces within the site .


fn_spacy_tokens_for_baseline: However , Slovo was able to disprove the allegations .

source_bert_toks: however , sl ##ovo was able to di ##sp ##rove the allegations .

reference_raw: However, Slovo was able to rebut those allegations.

reference_spacy_tokens: However , Slovo was able to rebut those allegations .


fn_spacy_tokens_for_baseline: Dear Mailhouse donor reminder :

source_bert_toks: dear mail ##house donor reminder :

reference_raw: Dear Mailhouse Donor Reminds me:

reference_spacy_tokens: Dear Mailhouse Donor Reminds me :


fn_spacy_tokens_for_baseline: You might also venture to talk to your wife , in one of her calmer moments .

source_bert_toks: you might also venture to talk to your wife , in one of her calm ##er moments .

reference_raw: You may also dare to speak to your wife in one of her calmer moments.

reference_spacy_tokens: You may also dare to speak to your wife in one of her calmer moments .


fn_spacy_tokens_for_baseline: Mercer came back after a while to collect the Unwins and the Youngs , and the general jollifications everywhere wore on without any alarms .

source_bert_toks: mercer came back after a while to collect the un ##win ##s and the young ##s , and the general jo ##lli ##fication ##s everywhere wore on without any alarms .

reference_raw: After a while Mercer returned to pick up the Unwins and the Youngs, and the general cheers went on without alarm.

reference_spacy_tokens: After a while Mercer returned to pick up the Unwins and the Youngs , and the general cheers went on without alarm .


fn_spacy_tokens_for_baseline: ' Am I to be weaponless again ? ' said Hrun .

source_bert_toks: ' am i to be weapon ##less again ? ' said hr ##un .

reference_raw: 'Shall I be unarmed again?' said Hrun.

reference_spacy_tokens: ' Shall I be unarmed again ? ' said Hrun .


fn_spacy_tokens_for_baseline: A man who had superglue squirted in his face by muggers may have lost the sight of one eye .

source_bert_toks: a man who had super ##gl ##ue sq ##ui ##rted in his face by mug ##gers may have lost the sight of one eye .

reference_raw: A man with superglue spraying muggers in his face might lose sight of one eye.

reference_spacy_tokens: A man with superglue spraying muggers in his face might lose sight of one eye .


fn_spacy_tokens_for_baseline: A flag worded ' The dog that left this mess has an inconsiderate owner ' was launched yesterday by Fido , Fight Inconsiderate Dog Owners ..

source_bert_toks: a flag word ##ed ' the dog that left this mess has an inc ##ons ##ider ##ate owner ' was launched yesterday by fi ##do , fight inc ##ons ##ider ##ate dog owners . .

reference_raw: The flag said, "The dog who left this mess has a careless owner" was launched yesterday by Fido, Fight Unconsiderate Dog Owners.

reference_spacy_tokens: The flag said , " The dog who left this mess has a careless owner " was launched yesterday by Fido , Fight Unconsiderate Dog Owners .


fn_spacy_tokens_for_baseline: Literature has always flourished in Dublin , the only city to have produced three Nobel Prize winners for literature -- Yeats , Shaw , and Beckett .

source_bert_toks: literature has always flourished in dublin , the only city to have produced three nobel prize winners for literature - - ye ##ats , shaw , and beckett .

reference_raw: Literature has always flourished in Dublin, the only city that has created three Nobel Prize winners for literature - Yeats, Shaw, and Beckett.

reference_spacy_tokens: Literature has always flourished in Dublin , the only city that has created three Nobel Prize winners for literature - Yeats , Shaw , and Beckett .


fn_spacy_tokens_for_baseline: She was the great - granddaughter of the early nineteenth - century feminist Anna Wheeler .

source_bert_toks: she was the great - granddaughter of the early nineteenth - century feminist anna wheeler .

reference_raw: She was the granddaughter of the feminist Anna Wheeler of the early nineteenth century.

reference_spacy_tokens: She was the granddaughter of the feminist Anna Wheeler of the early nineteenth century .


fn_spacy_tokens_for_baseline: ' May birds are always cheeping '

source_bert_toks: ' may birds are always che ##ep ##ing '

reference_raw: 'May the birds beep all the time.'

reference_spacy_tokens: ' May the birds beep all the time . '


fn_spacy_tokens_for_baseline: Almost an hour passed with my heart thumping every time the door of number four opened .

source_bert_toks: almost an hour passed with my heart thumping every time the door of number four opened .

reference_raw: Almost an hour passed, my heart pounding every time the door of number four opened.

reference_spacy_tokens: Almost an hour passed , my heart pounding every time the door of number four opened .


fn_spacy_tokens_for_baseline: Kevin Phillips ' snarl says it all as he leads the Neath tribe 's celebrations after winning the 1990 Schweppes Cup Final .

source_bert_toks: kevin phillips ' snarl says it all as he leads the neat ##h tribe ' s celebrations after winning the 1990 sc ##h ##we ##ppe ##s cup final .

reference_raw: Kevin Phillips' growl tells the story as he conducts the celebrations of the Neath tribe after the victory of the 1990 Schweppes Cup Final.

reference_spacy_tokens: Kevin Phillips ' growl tells the story as he conducts the celebrations of the Neath tribe after the victory of the 1990 Schweppes Cup Final .


fn_spacy_tokens_for_baseline: The refugees have stripped the surrounding hills almost bare , and spend much of their time collecting branches .

source_bert_toks: the refugees have stripped the surrounding hills almost bare , and spend much of their time collecting branches .

reference_raw: Refugees had almost bared the surrounding hills and spent most of their time picking up branches.

reference_spacy_tokens: Refugees had almost bared the surrounding hills and spent most of their time picking up branches .


fn_spacy_tokens_for_baseline: She heaped a teaspoonful of instant coffee into a couple of beakers and poured a steaming jet of water on to it .

source_bert_toks: she heap ##ed a tea ##sp ##oon ##ful of instant coffee into a couple of beak ##ers and poured a steaming jet of water on to it .

reference_raw: She piled a spoonful of instant coffee into two beakers and poured a steaming stream of water.

reference_spacy_tokens: She piled a spoonful of instant coffee into two beakers and poured a steaming stream of water .


fn_spacy_tokens_for_baseline: The Snake Goddess figurines found in a sanctuary at Kannia had snakes wreathing their crowns ; one had snakes on her arms as well and a dove on her cheek .

source_bert_toks: the snake goddess fig ##uri ##nes found in a sanctuary at kan ##nia had snakes wreath ##ing their crowns ; one had snakes on her arms as well and a dove on her cheek .

reference_raw: The serpent-goddess figures found in the shrine in Kannia had snakes wreathing their crowns; one had snakes on his arms and a dove on his face.

reference_spacy_tokens: The serpent - goddess figures found in the shrine in Kannia had snakes wreathing their crowns ; one had snakes on his arms and a dove on his face .


fn_spacy_tokens_for_baseline: Rubin himself appeared on stage for a pep talk , a short and stocky 40ish fellow in business blues .

source_bert_toks: rubin himself appeared on stage for a pep talk , a short and stock ##y 40 ##ish fellow in business blues .

reference_raw: Rubin himself appeared on the stage for a pep talk, a short, stocky 40-year-old man in business blues.

reference_spacy_tokens: Rubin himself appeared on the stage for a pep talk , a short , stocky 40-year - old man in business blues .


fn_spacy_tokens_for_baseline: The cruise ships crank up their flood lights , and the parties begin .

source_bert_toks: the cruise ships crank up their flood lights , and the parties begin .

reference_raw: Cruise ships turn off their floodlights and the parties begin.

reference_spacy_tokens: Cruise ships turn off their floodlights and the parties begin .


fn_spacy_tokens_for_baseline: At Stade Roland Garros , the Centre Court temperature is rarely like to be less than 100 degrees F. The sunbaked concrete and clay cauldron is no place for the weak kneed or willed .

source_bert_toks: at stade roland ga ##rro ##s , the centre court temperature is rarely like to be less than 100 degrees f . the sun ##ba ##ked concrete and clay ca ##uld ##ron is no place for the weak knee ##d or willed .

reference_raw: At the stage of Roland Garros, the temperature of the Centre Court is rarely less than 100 degrees F. Sunbaked concrete and clay pots are no place for weak knees or wills.

reference_spacy_tokens: At the stage of Roland Garros , the temperature of the Centre Court is rarely less than 100 degrees F. Sunbaked concrete and clay pots are no place for weak knees or wills .


fn_spacy_tokens_for_baseline: To revenge him , his widow joined the independent French section of the Special Operations Executive in October 1943 .

source_bert_toks: to revenge him , his widow joined the independent french section of the special operations executive in october 1943 .

reference_raw: In order to avenge him, his widow joined the French Special Operations Executive's independent section in October 1943.

reference_spacy_tokens: In order to avenge him , his widow joined the French Special Operations Executive 's independent section in October 1943 .


fn_spacy_tokens_for_baseline: " We are sure that anybody that was on the sidewalk was vaporized , " Norick said .

source_bert_toks: " we are sure that anybody that was on the sidewalk was vapor ##ized , " nor ##ick said .

reference_raw: "We're pretty sure whoever was on the sidewalk disappeared," Norick said.

reference_spacy_tokens: " We 're pretty sure whoever was on the sidewalk disappeared , " Norick said .