fn_spacy_tokens_for_baseline: Oh , Lord , it seems only yesterday when I and my master , Benjamin Daunbey , nephew to the great Cardinal Wolsey , were sent to the Chateau de Maubisson outside Paris to resolve certain mysteries .

source_bert_toks: oh , lord , it seems only yesterday when i and my master , benjamin da ##un ##bey , nephew to the great cardinal wo ##ls ##ey , were sent to the chateau de ma ##ub ##isson outside paris to resolve certain mysteries .

reference_raw: God, it seems only yesterday that my master, Benjamin Daunbey, cousin of the great Cardinal Wolsey, was sent to the Chateau de Maubisson outside Paris to solve certain mysteries.

reference_spacy_tokens: God , it seems only yesterday that my master , Benjamin Daunbey , cousin of the great Cardinal Wolsey , was sent to the Chateau de Maubisson outside Paris to solve certain mysteries .


fn_spacy_tokens_for_baseline: She shepherded him towards the Captain talking all the time .

source_bert_toks: she shepherd ##ed him towards the captain talking all the time .

reference_raw: She kept herding him to the captain, who was still talking.

reference_spacy_tokens: She kept herding him to the captain , who was still talking .


fn_spacy_tokens_for_baseline: Kelly tied her laces around the back of her heel to combat loose shoes but ended up with a rubbed Achilles tendon .

source_bert_toks: kelly tied her lace ##s around the back of her heel to combat loose shoes but ended up with a rubbed achilles tend ##on .

reference_raw: Kelly bound the laces around her heel to fight off the loose boots, but ended up with a scratched Achilles tendon.

reference_spacy_tokens: Kelly bound the laces around her heel to fight off the loose boots , but ended up with a scratched Achilles tendon .


fn_spacy_tokens_for_baseline: But one thing I did learn : Bournemouth was covered in a thick blanket of fog yesterday . '

source_bert_toks: but one thing i did learn : bournemouth was covered in a thick blanket of fog yesterday . '

reference_raw: But I've learned one thing: last night Bournemouth was wrapped in a thick blanket of mist.'

reference_spacy_tokens: But I 've learned one thing : last night Bournemouth was wrapped in a thick blanket of mist . '


fn_spacy_tokens_for_baseline: ' This is a pivot point in our policy , ' a senior Obama administration official told reporters aboard Air Force 2 en route to Afghanistan .

source_bert_toks: ' this is a pi ##vot point in our policy , ' a senior obama administration official told reporters aboard air force 2 en route to afghanistan .

reference_raw: "That's the key to our politics," a senior Obama administration official told the reporters aboard Air Force 2 on their way to Afghanistan.

reference_spacy_tokens: " That 's the key to our politics , " a senior Obama administration official told the reporters aboard Air Force 2 on their way to Afghanistan .


fn_spacy_tokens_for_baseline: Avoid these and go for the grilled items -- possibles are poussins or chicken breast , game such as pheasant , partridge or guinea fowl , or , if you do n't have ethical qualms , lean veal .

source_bert_toks: avoid these and go for the grille ##d items - - possible ##s are po ##uss ##ins or chicken breast , game such as ph ##ea ##sant , partridge or guinea f ##ow ##l , or , if you don ' t have ethical qu ##al ##ms , lean ve ##al .

reference_raw: Avoid them and go for barbecued items - possibles are poussins or chicken breasts, games like pheasants, partridges or guinea fowls, or, if you have no moral qualms, lean calves.

reference_spacy_tokens: Avoid them and go for barbecued items - possibles are poussins or chicken breasts , games like pheasants , partridges or guinea fowls , or , if you have no moral qualms , lean calves .


fn_spacy_tokens_for_baseline: One of the most obvious differences between Japanese and Western business practices is the use of business calling cards or meishi .

source_bert_toks: one of the most obvious differences between japanese and western business practices is the use of business calling cards or mei ##shi .

reference_raw: The use of business call cards or meishi is one of the most evident differences between Japanese and Western business practices.

reference_spacy_tokens: The use of business call cards or meishi is one of the most evident differences between Japanese and Western business practices .


fn_spacy_tokens_for_baseline: The Inspector and the Colonel left the room , looking very unhappy .

source_bert_toks: the inspector and the colonel left the room , looking very unhappy .

reference_raw: The inspector and the colonel walked out of the room, looking very unhappy.

reference_spacy_tokens: The inspector and the colonel walked out of the room , looking very unhappy .


fn_spacy_tokens_for_baseline: Later , crippled by paralysis , he could only hobble about the streets , before being confined to his room in Brighton .

source_bert_toks: later , crippled by paralysis , he could only ho ##bble about the streets , before being confined to his room in brighton .

reference_raw: Later, crippled by paralysis, he could only walk the streets until he was confined to his room in Brighton.

reference_spacy_tokens: Later , crippled by paralysis , he could only walk the streets until he was confined to his room in Brighton .


fn_spacy_tokens_for_baseline: He bent low to study the packet .

source_bert_toks: he bent low to study the packet .

reference_raw: He stooped to study the package.

reference_spacy_tokens: He stooped to study the package .


fn_spacy_tokens_for_baseline: With temperatures in the high 30 degree Celsius range and winds around 50 km / h ( 31 Mph ) , fire fighters are bracing for the worst in the Blue Mountains over the next few days .

source_bert_toks: with temperatures in the high 30 degree ce ##ls ##ius range and winds around 50 km / h ( 31 mph ) , fire fighters are bracing for the worst in the blue mountains over the next few days .

reference_raw: With temperatures at a distance of 30 degrees Celsius and winds of about 50 km/h (31 Mph), firefighters in the Blue Mountains will prepare for the lowest in the next few days.

reference_spacy_tokens: With temperatures at a distance of 30 degrees Celsius and winds of about 50 km / h ( 31 Mph ) , firefighters in the Blue Mountains will prepare for the lowest in the next few days .


fn_spacy_tokens_for_baseline: Dig holes immediately in front of two or more entrance holes .

source_bert_toks: dig holes immediately in front of two or more entrance holes .

reference_raw: Dig holes immediately before two or more openings.

reference_spacy_tokens: Dig holes immediately before two or more openings .


fn_spacy_tokens_for_baseline: They meet in packs called Hives and their Promise Badge is a silver bee .

source_bert_toks: they meet in packs called hive ##s and their promise badge is a silver bee .

reference_raw: They meet in packs called the Hives, and their vow of evil is a silver bee.

reference_spacy_tokens: They meet in packs called the Hives , and their vow of evil is a silver bee .


fn_spacy_tokens_for_baseline: It is also very important for you to reward yourself when you have had some success .

source_bert_toks: it is also very important for you to reward yourself when you have had some success .

reference_raw: It's also very important that you pay back when you've had some success.

reference_spacy_tokens: It 's also very important that you pay back when you 've had some success .


fn_spacy_tokens_for_baseline: Although in 88 b.c . , Mithradates made a swift and successful raid from the East across Asia Minor and the Aegean Islands , the next major power change brought influence from the West .

source_bert_toks: although in 88 b . c . , mit ##hra ##dates made a swift and successful raid from the east across asia minor and the aegean islands , the next major power change brought influence from the west .

reference_raw: Although in 88 B.C., Mithradates quickly and successfully invaded Asia Minor and the Aegean Islands from the east, another major change in power brought influence from the west.

reference_spacy_tokens: Although in 88 B.C. , Mithradates quickly and successfully invaded Asia Minor and the Aegean Islands from the east , another major change in power brought influence from the west .


fn_spacy_tokens_for_baseline: I admired my daughter - in - law so much the day I saw her stand a full five minutes waiting for her little boy who was watching a worm disappearing through a hole in the earth .

source_bert_toks: i admired my daughter - in - law so much the day i saw her stand a full five minutes waiting for her little boy who was watching a worm disappearing through a hole in the earth .

reference_raw: I admired my daughter-in-law so much the day I saw her standing there for five minutes, waiting for her little boy to watch a worm vanish through a hole in the ground.

reference_spacy_tokens: I admired my daughter - in - law so much the day I saw her standing there for five minutes , waiting for her little boy to watch a worm vanish through a hole in the ground .


fn_spacy_tokens_for_baseline: I am delighted with the house I am renting from him .

source_bert_toks: i am delighted with the house i am rent ##ing from him .

reference_raw: I'm happy with the house I borrow from him.

reference_spacy_tokens: I 'm happy with the house I borrow from him .


fn_spacy_tokens_for_baseline: Todor Zhivkov , 81 , Bulgaria 's communist leader from 1954 until November 1989 , was convicted of misappropriation of state property and embezzlement on Sept. 4 and sentenced to seven years ' imprisonment .

source_bert_toks: tod ##or z ##hi ##v ##kov , 81 , bulgaria ' s communist leader from 1954 until november 1989 , was convicted of mis ##app ##ropriation of state property and em ##be ##zzle ##ment on sept . 4 and sentenced to seven years ' imprisonment .

reference_raw: Todor Zhivkov, 81, Bulgaria's Communist leader from 1954 to November 1989, was convicted of misappropriation of state property and fraud on September 4 and sentenced to seven years in prison.

reference_spacy_tokens: Todor Zhivkov , 81 , Bulgaria 's Communist leader from 1954 to November 1989 , was convicted of misappropriation of state property and fraud on September 4 and sentenced to seven years in prison .


fn_spacy_tokens_for_baseline: Because such potentially distressing events are predictable , but unavoidable , they are an ideal focus for an investigation of coping behaviours .

source_bert_toks: because such potentially distress ##ing events are predictable , but una ##vo ##ida ##ble , they are an ideal focus for an investigation of coping behaviour ##s .

reference_raw: Since these potentially stressful events are predictable but inevitable, they are the ideal focus for investigating behaviour.

reference_spacy_tokens: Since these potentially stressful events are predictable but inevitable , they are the ideal focus for investigating behaviour .


fn_spacy_tokens_for_baseline: I wanted to curl into a tiny ball and be forgotten about by everyone .

source_bert_toks: i wanted to curl into a tiny ball and be forgotten about by everyone .

reference_raw: I wanted to turn into a little ball and let everyone forget about me.

reference_spacy_tokens: I wanted to turn into a little ball and let everyone forget about me .


fn_spacy_tokens_for_baseline: But the broomstick could n't do anything to avert the crash .

source_bert_toks: but the broom ##stick couldn ' t do anything to ave ##rt the crash .

reference_raw: But there was nothing the broom could do to stop the accident.

reference_spacy_tokens: But there was nothing the broom could do to stop the accident .


fn_spacy_tokens_for_baseline: They peeled no vegetables , roasted no joints , bought no floor polish or detergent , no furniture cleaner or disinfectant .

source_bert_toks: they peeled no vegetables , roasted no joints , bought no floor polish or deter ##gent , no furniture cleaner or di ##sin ##fect ##ant .

reference_raw: They peeled no greens, roasted no joints, bought no floor polish or detergent, no furniture cleaner or disinfectant.

reference_spacy_tokens: They peeled no greens , roasted no joints , bought no floor polish or detergent , no furniture cleaner or disinfectant .


fn_spacy_tokens_for_baseline: His last name was covered in snot .

source_bert_toks: his last name was covered in s ##not .

reference_raw: There was a snot on his surname.

reference_spacy_tokens: There was a snot on his surname .


fn_spacy_tokens_for_baseline: An internal garage presents no problems for built - in lighting down the pit , but garages 20 m down the garden could prove expensive in armoured cable .

source_bert_toks: an internal garage presents no problems for built - in lighting down the pit , but garage ##s 20 ##m down the garden could prove expensive in armoured cable .

reference_raw: The interior garage poses no problem with the built-in illumination of the hole, but the garages 20 meters down the garden could be costly in armored cables.

reference_spacy_tokens: The interior garage poses no problem with the built - in illumination of the hole , but the garages 20 meters down the garden could be costly in armored cables .


fn_spacy_tokens_for_baseline: you do n't well speaking for myself i do n't sleep as well when i am not exercising and uh

source_bert_toks: you don ' t well speaking for myself i don ' t sleep as well when i am not exercising and uh

reference_raw: you don't speak well for yourself I don't sleep well when I'm not practicing

reference_spacy_tokens: you do n't speak well for yourself I do n't sleep well when I 'm not practicing


fn_spacy_tokens_for_baseline: Try to eat slowly and really savour your food at meals so that you feel satisfied and therefore less likely to snack later on .

source_bert_toks: try to eat slowly and really sa ##vo ##ur your food at meals so that you feel satisfied and therefore less likely to snack later on .

reference_raw: Try to eat your food slowly and truly enjoy it with food so that you feel happy and therefore less likely to eat it later.

reference_spacy_tokens: Try to eat your food slowly and truly enjoy it with food so that you feel happy and therefore less likely to eat it later .


fn_spacy_tokens_for_baseline: Mash it or puree it in the blender with an equal quantity of fresh unsalted butter .

source_bert_toks: mas ##h it or pure ##e it in the blend ##er with an equal quantity of fresh un ##sal ##ted butter .

reference_raw: Mash it or purify it in a blender with the same quantity of fresh, unsalted buttress.

reference_spacy_tokens: Mash it or purify it in a blender with the same quantity of fresh , unsalted buttress .


fn_spacy_tokens_for_baseline: The Tien Chi , first test - fired in 1997 , is a solid - fueled , two - stage missile with a 300 km range that can reach China 's southeastern coast .

source_bert_toks: the tie ##n chi , first test - fired in 1997 , is a solid - fueled , two - stage missile with a 300 km range that can reach china ' s southeastern coast .

reference_raw: Tien Chi's first test, fired in 1997, is a solid-fueled, two-stage rocket with a 300-kilometre radius that can reach the southeast coast of China.

reference_spacy_tokens: Tien Chi 's first test , fired in 1997 , is a solid - fueled , two - stage rocket with a 300-kilometre radius that can reach the southeast coast of China .


fn_spacy_tokens_for_baseline: Nicolo was standing in the centre of the room , scowling darkly at her .

source_bert_toks: nico ##lo was standing in the centre of the room , scowl ##ing darkly at her .

reference_raw: Nicolo stood in the middle of the room, frowning darkly at her.

reference_spacy_tokens: Nicolo stood in the middle of the room , frowning darkly at her .


fn_spacy_tokens_for_baseline: Then I repeated the oft cried lie , ' Climb when you 're ready Ben . it 's a piece of cake ! '

source_bert_toks: then i repeated the of ##t cried lie , ' climb when you ' re ready ben . it ' s a piece of cake ! '

reference_raw: Then I repeated the cry of lies, "When you're ready, Ben, it's a cake!"

reference_spacy_tokens: Then I repeated the cry of lies , " When you 're ready , Ben , it 's a cake ! "


fn_spacy_tokens_for_baseline: Corbett stopped , calming his horse which grew skittish at the sight .

source_bert_toks: corbett stopped , calming his horse which grew ski ##tti ##sh at the sight .

reference_raw: Corbett stopped and reassured his horse, which was growing skittish at the sight of him.

reference_spacy_tokens: Corbett stopped and reassured his horse , which was growing skittish at the sight of him .


fn_spacy_tokens_for_baseline: When Lydia answered the door , he removed his hat and said , ' Would you tell Mr and Mrs Oaks that Mr Brayton of Skiplam Grange would like a word ? '

source_bert_toks: when lydia answered the door , he removed his hat and said , ' would you tell mr and mrs oaks that mr bray ##ton of skip ##lam grange would like a word ? '

reference_raw: When Lydia opened the door, he took off his hat and said, "Will you tell the Lord and Lady Oaks that Captain Brayton of Skiplam Grange would like to speak with him?"

reference_spacy_tokens: When Lydia opened the door , he took off his hat and said , " Will you tell the Lord and Lady Oaks that Captain Brayton of Skiplam Grange would like to speak with him ? "


fn_spacy_tokens_for_baseline: the food basket ( i.e. rationed food ) is no longer taken advantage of in full by the poorer segments of the urban population simply because they can not afford it any more .

source_bert_toks: the food basket ( i . e . ratio ##ned food ) is no longer taken advantage of in full by the poorer segments of the urban population simply because they can not afford it any more .

reference_raw: the food basket (i.e. rationed food) is no longer fully exploited by the poorer parts of the urban population simply because they can no longer afford it.

reference_spacy_tokens: the food basket ( i.e. rationed food ) is no longer fully exploited by the poorer parts of the urban population simply because they can no longer afford it .


fn_spacy_tokens_for_baseline: It could also have a bearing on its unusual style -- no verbal testimonies from friends and colleagues , no old archive footage , just Van getting royally stoned on the music with some mates .

source_bert_toks: it could also have a bearing on its unusual style - - no verbal test ##imo ##nies from friends and colleagues , no old archive footage , just van getting royal ##ly stone ##d on the music with some mates .

reference_raw: He might also have something to do with his unusual style -- no verbal testimony from friends and colleagues, no old archive footage, only Van getting royally high on music with some of his friends.

reference_spacy_tokens: He might also have something to do with his unusual style -- no verbal testimony from friends and colleagues , no old archive footage , only Van getting royally high on music with some of his friends .


fn_spacy_tokens_for_baseline: Psychiatrists diagnosed Hinckley as suffering from a ' schizotypal personality disorder ' , also known as ambulatory or borderline schizophrenia ( Hinckley was subsequently committed to a mental hospital . )

source_bert_toks: psychiatrist ##s diagnosed hi ##nc ##kley as suffering from a ' sc ##hi ##zo ##ty ##pal personality disorder ' , also known as am ##bula ##tory or border ##line schizophrenia ( hi ##nc ##kley was subsequently committed to a mental hospital . )

reference_raw: Psychiatrists diagnosed Hinckley as having "schizotypal personality disorder", also known as ambulatory or borderline schizophrenia (Hinckley was subsequently transferred to a psychiatric hospital).

reference_spacy_tokens: Psychiatrists diagnosed Hinckley as having " schizotypal personality disorder " , also known as ambulatory or borderline schizophrenia ( Hinckley was subsequently transferred to a psychiatric hospital ) .


fn_spacy_tokens_for_baseline: I am correct , am I not ? '

source_bert_toks: i am correct , am i not ? '

reference_raw: I'm right, aren't I?'

reference_spacy_tokens: I 'm right , are n't I ? '


fn_spacy_tokens_for_baseline: That explanation depends on the presence of molecular oxygen in the gas cloud that was condensing to form the Sun , something the San Diego chemists think was likely , although they can not be certain .

source_bert_toks: that explanation depends on the presence of molecular oxygen in the gas cloud that was conde ##ns ##ing to form the sun , something the san diego chemist ##s think was likely , although they can not be certain .

reference_raw: The explanation depends on the presence of molecular oxygen in the gas cloud, which condensates to form the sun, which the San Diego chemists believe is probable, even if they can't be sure.

reference_spacy_tokens: The explanation depends on the presence of molecular oxygen in the gas cloud , which condensates to form the sun , which the San Diego chemists believe is probable , even if they ca n't be sure .


fn_spacy_tokens_for_baseline: These instances arose because the recipients just did not read the letters sent to them .

source_bert_toks: these instances arose because the recipients just did not read the letters sent to them .

reference_raw: These cases were caused by the fact that the addressees simply did not read the letters sent to them.

reference_spacy_tokens: These cases were caused by the fact that the addressees simply did not read the letters sent to them .


fn_spacy_tokens_for_baseline: They are two of some 40,000 BCCI account holders in Britain with collective losses amounting to about £ 2 billion .

source_bert_toks: they are two of some 40 , 000 bc ##ci account holders in britain with collective losses amount ##ing to about £2 billion .

reference_raw: They are two of the approximately 40,000 holders of BCCI accounts in the United Kingdom, with collective losses of around £2 billion.

reference_spacy_tokens: They are two of the approximately 40,000 holders of BCCI accounts in the United Kingdom , with collective losses of around £ 2 billion .


fn_spacy_tokens_for_baseline: For many years Norfolk and the whole of East Anglia has been neglected and ridiculed by the music industry .

source_bert_toks: for many years norfolk and the whole of east anglia has been neglected and rid ##ic ##uled by the music industry .

reference_raw: Norfolk and the whole of East England have been neglected and mocked by the music industry for many years.

reference_spacy_tokens: Norfolk and the whole of East England have been neglected and mocked by the music industry for many years .


fn_spacy_tokens_for_baseline: The Germans were temporarily secure behind the bridges , however , and remained poised while they awaited the arrival of a new army of volunteers .

source_bert_toks: the germans were temporarily secure behind the bridges , however , and remained poised while they awaited the arrival of a new army of volunteers .

reference_raw: But the Germans were temporarily safe beyond the bridges, waiting for a new army of volunteers to arrive.

reference_spacy_tokens: But the Germans were temporarily safe beyond the bridges , waiting for a new army of volunteers to arrive .


fn_spacy_tokens_for_baseline: The doorbell rang as Juliet fastened her black sandals .

source_bert_toks: the doorbell rang as juliet fastened her black sandals .

reference_raw: When Juliet buckled her black sandals, the bell rang.

reference_spacy_tokens: When Juliet buckled her black sandals , the bell rang .


fn_spacy_tokens_for_baseline: Ten metres from the line I saw Ray , twisted to dip and strained my hamstring .

source_bert_toks: ten metres from the line i saw ray , twisted to dip and strained my ham ##st ##ring .

reference_raw: Ten meters from the line, I could see Ray, turning to sink and stretching my hamstring.

reference_spacy_tokens: Ten meters from the line , I could see Ray , turning to sink and stretching my hamstring .


fn_spacy_tokens_for_baseline: The mule uttered its insane bray and broke free of its prison at last .

source_bert_toks: the mule uttered its insane bray and broke free of its prison at last .

reference_raw: The mule uttered his mad braye and finally broke free of his prison.

reference_spacy_tokens: The mule uttered his mad braye and finally broke free of his prison .


fn_spacy_tokens_for_baseline: Roxanne killed six people during its first pass before moving into the Gulf of Mexico and meandering for days .

source_bert_toks: ro ##xa ##nne killed six people during its first pass before moving into the gulf of mexico and mean ##der ##ing for days .

reference_raw: Roxanne killed six people in his first pass before he moved to the Gulf of Mexico and meant for a few days.

reference_spacy_tokens: Roxanne killed six people in his first pass before he moved to the Gulf of Mexico and meant for a few days .


fn_spacy_tokens_for_baseline: The enraged animal charged into Christopher Rogers , pinning him to the ground .

source_bert_toks: the enraged animal charged into christopher rogers , pinning him to the ground .

reference_raw: An angry animal attacked Christopher Rogers and pinned him to the ground.

reference_spacy_tokens: An angry animal attacked Christopher Rogers and pinned him to the ground .


fn_spacy_tokens_for_baseline: In Oz David Widgery took time off from musing on the revolution to provide an obituary for Jack Kerouac , one of the people with whom the entire movement had started .

source_bert_toks: in oz david wi ##dge ##ry took time off from mu ##sing on the revolution to provide an obituary for jack ke ##rou ##ac , one of the people with whom the entire movement had started .

reference_raw: In Oz, David Widgery took a break from the thought of a revolution to provide an obituary for Jack Kerouac, one of the people with whom the whole movement had begun.

reference_spacy_tokens: In Oz , David Widgery took a break from the thought of a revolution to provide an obituary for Jack Kerouac , one of the people with whom the whole movement had begun .


fn_spacy_tokens_for_baseline: He rests both thumbs in the waistband of his trousers .

source_bert_toks: he rests both thumbs in the waistband of his trousers .

reference_raw: He puts both thumbs in the belt of his pants.

reference_spacy_tokens: He puts both thumbs in the belt of his pants .


fn_spacy_tokens_for_baseline: BARCELONA have offered coach Johan Cruyff a two - year extension on his contract after the European Cup holders ' 2 - 1 Intercontinental Cup defeat by South American champions Sao Paulo in Tokyo on Sunday .

source_bert_toks: barcelona have offered coach johan cr ##uy ##ff a two - year extension on his contract after the european cup holders ' 2 - 1 intercontinental cup defeat by south american champions sao paulo in tokyo on sunday .

reference_raw: BARCELONA offered coach Johan Cruyff a two-year extension of his contract after the two-to-one intercontinental championships of South American champions, Sao Paulo, in Tokyo on Sunday.

reference_spacy_tokens: BARCELONA offered coach Johan Cruyff a two - year extension of his contract after the two - to - one intercontinental championships of South American champions , Sao Paulo , in Tokyo on Sunday .


fn_spacy_tokens_for_baseline: The first - ever world symposium on bad breath is to be held this April in Mexico .

source_bert_toks: the first - ever world symposium on bad breath is to be held this april in mexico .

reference_raw: The world's first symposium on bad breath will take place in Mexico this morning.

reference_spacy_tokens: The world 's first symposium on bad breath will take place in Mexico this morning .


fn_spacy_tokens_for_baseline: It is instructive to preface an exposition of the theory with Kane 's somewhat ingenuous comment on the ancestors of modern blacks :

source_bert_toks: it is ins ##truct ##ive to preface an exposition of the theory with kane ' s somewhat ing ##en ##uous comment on the ancestors of modern blacks :

reference_raw: It is instructive to preface the theory with Kane's somewhat ingenious comment on the ancestors of modern blacks:

reference_spacy_tokens: It is instructive to preface the theory with Kane 's somewhat ingenious comment on the ancestors of modern blacks :


fn_spacy_tokens_for_baseline: It 's helping them to understand the immense pressures on them to stay forever in the closet .

source_bert_toks: it ' s helping them to understand the immense pressures on them to stay forever in the closet .

reference_raw: It helps them understand the enormous pressure on them to stay in the wardrobe forever.

reference_spacy_tokens: It helps them understand the enormous pressure on them to stay in the wardrobe forever .


fn_spacy_tokens_for_baseline: His eyes were an astounding blue and his complexion was ruddy from a life spent mostly at sea .

source_bert_toks: his eyes were an as ##tou ##nding blue and his complexion was rudd ##y from a life spent mostly at sea .

reference_raw: His eyes were shocking blue, and his skin was ruddy from life spent most of the time at sea.

reference_spacy_tokens: His eyes were shocking blue , and his skin was ruddy from life spent most of the time at sea .


fn_spacy_tokens_for_baseline: He wanted to contribute actively to governing the country once more and have influence in policy making .

source_bert_toks: he wanted to contribute actively to governing the country once more and have influence in policy making .

reference_raw: He wanted to make an active contribution to the country's governance again and influence policy-making.

reference_spacy_tokens: He wanted to make an active contribution to the country 's governance again and influence policy - making .


fn_spacy_tokens_for_baseline: He emptied the rest of the wine into their glasses and wondered if he should order another .

source_bert_toks: he emptied the rest of the wine into their glasses and wondered if he should order another .

reference_raw: He drained the rest of the wine into their glasses and wondered if he ought to order some more.

reference_spacy_tokens: He drained the rest of the wine into their glasses and wondered if he ought to order some more .


fn_spacy_tokens_for_baseline: When Marines who fall in these theaters of war are honored at Camp Pendleton , the memorial ceremonies are eerily familiar but also unique .

source_bert_toks: when marines who fall in these theaters of war are honored at camp pendleton , the memorial ceremonies are ee ##rily familiar but also unique .

reference_raw: When the Marines who fall into these war theatres are honoured at Camp Pendleton, the memorial ceremony is eerily familiar but unique.

reference_spacy_tokens: When the Marines who fall into these war theatres are honoured at Camp Pendleton , the memorial ceremony is eerily familiar but unique .


fn_spacy_tokens_for_baseline: ' I spend half my life changing beds , stuffing the washing machine and emptying wastepaper baskets . '

source_bert_toks: ' i spend half my life changing beds , stuffing the washing machine and empty ##ing waste ##paper baskets . '

reference_raw: "I've spent half my life changing beds, stuffing the washing machine and emptying the trash cans."

reference_spacy_tokens: " I 've spent half my life changing beds , stuffing the washing machine and emptying the trash cans . "


fn_spacy_tokens_for_baseline: Only recently has Louis been reappraised as an effective ruler in his own right .

source_bert_toks: only recently has louis been re ##app ##rai ##sed as an effective ruler in his own right .

reference_raw: It wasn't until recently that Louis had been reappraised as an effective emperor in his own right.

reference_spacy_tokens: It was n't until recently that Louis had been reappraised as an effective emperor in his own right .


fn_spacy_tokens_for_baseline: He wanted to howl like a dog and hear the echoes all around him .

source_bert_toks: he wanted to howl like a dog and hear the echoes all around him .

reference_raw: He wanted to scream like a dog and hear echoes all around him.

reference_spacy_tokens: He wanted to scream like a dog and hear echoes all around him .


fn_spacy_tokens_for_baseline: There was a soft rap at the door .

source_bert_toks: there was a soft rap at the door .

reference_raw: There was a soft knock on the door.

reference_spacy_tokens: There was a soft knock on the door .


fn_spacy_tokens_for_baseline: The film , starring Sam Neill and Laura Dern , mixes palaeontology and genetic engineering .

source_bert_toks: the film , starring sam neill and laura der ##n , mixes pal ##ae ##ont ##ology and genetic engineering .

reference_raw: The movie, starting with Sam Neill and Laura Dern, combines paleontology and genetic engineering.

reference_spacy_tokens: The movie , starting with Sam Neill and Laura Dern , combines paleontology and genetic engineering .


fn_spacy_tokens_for_baseline: In mitigation Lawrence Hazell , for Muise , said he committed the offence because he owed some people £ 110 .

source_bert_toks: in mit ##iga ##tion lawrence hazel ##l , for mu ##ise , said he committed the offence because he owed some people £1 ##10 .

reference_raw: Because of Muise, Lawrence Hazell said that he was guilty of the crime because he owed a few people 110 pounds.

reference_spacy_tokens: Because of Muise , Lawrence Hazell said that he was guilty of the crime because he owed a few people 110 pounds .


fn_spacy_tokens_for_baseline: Only an hour 's drive from the beautiful Kashubian Lake district , rich in forests and rolling countryside .

source_bert_toks: only an hour ' s drive from the beautiful ka ##shu ##bian lake district , rich in forests and rolling countryside .

reference_raw: It's only an hour's drive from the lovely district of Kashubian Lake, rich in forests and rolling landscapes.

reference_spacy_tokens: It 's only an hour 's drive from the lovely district of Kashubian Lake , rich in forests and rolling landscapes .


fn_spacy_tokens_for_baseline: Many countries are already proceeding towards democracy .

source_bert_toks: many countries are already proceeding towards democracy .

reference_raw: Many countries are already moving towards democracy.

reference_spacy_tokens: Many countries are already moving towards democracy .


fn_spacy_tokens_for_baseline: Last year , a scuffle between pro- and anti - Tripoli protesters broke out at the university when the younger Kadafi came to give a speech .

source_bert_toks: last year , a sc ##uf ##fle between pro - and anti - tripoli protesters broke out at the university when the younger ka ##da ##fi came to give a speech .

reference_raw: Last year, when the younger Kadafi came to speak, there was a fight between pro- and anti-Tripoli protestors at the university.

reference_spacy_tokens: Last year , when the younger Kadafi came to speak , there was a fight between pro- and anti - Tripoli protestors at the university .


fn_spacy_tokens_for_baseline: He also declares that Iran is neither currently planning to build nuclear weapons nor will attempt to do so in the future , any nuclear technology will be applied to developing nuclear energy for peaceful purposes .

source_bert_toks: he also declares that iran is neither currently planning to build nuclear weapons nor will attempt to do so in the future , any nuclear technology will be applied to developing nuclear energy for peaceful purposes .

reference_raw: It also states that Iran is not currently planning to build nuclear weapons, nor will it attempt to do so in the future, and that any nuclear technology will be used for the development of nuclear power for peaceful purposes.

reference_spacy_tokens: It also states that Iran is not currently planning to build nuclear weapons , nor will it attempt to do so in the future , and that any nuclear technology will be used for the development of nuclear power for peaceful purposes .


fn_spacy_tokens_for_baseline: This notion has been adopted by a number of animal learning theorists ( e.g. Spear 1973 , 1981 ; Hirsh 1980 ) .

source_bert_toks: this notion has been adopted by a number of animal learning theorists ( e . g . spear 1973 , 1981 ; hi ##rs ##h 1980 ) .

reference_raw: This concept was accepted by a number of theorists in the field of animal education (for example, Spear 1973, 1981; Hirsh 1980).

reference_spacy_tokens: This concept was accepted by a number of theorists in the field of animal education ( for example , Spear 1973 , 1981 ; Hirsh 1980 ) .


fn_spacy_tokens_for_baseline: Significant decreases in mortality from heart disease and respiratory diseases are also observable from these data .

source_bert_toks: significant decreases in mortality from heart disease and respiratory diseases are also ob ##ser ##vable from these data .

reference_raw: These data also show a significant reduction in mortality due to heart disease and respiratory disease.

reference_spacy_tokens: These data also show a significant reduction in mortality due to heart disease and respiratory disease .


fn_spacy_tokens_for_baseline: It covers about 3630 acres , traversed by the River Holbeck and drained by several small tributaries , mainly Fitlock Brook .

source_bert_toks: it covers about 36 ##30 acres , traversed by the river ho ##lb ##eck and drained by several small tributaries , mainly fit ##lock brook .

reference_raw: It covers about 3,630 acres, traversed by the Holbeck River, and depleted by several small tributaries, mainly Fitlock Brook.

reference_spacy_tokens: It covers about 3,630 acres , traversed by the Holbeck River , and depleted by several small tributaries , mainly Fitlock Brook .


fn_spacy_tokens_for_baseline: CROWN prosecutors are to appeal against a lenient sentence imposed on a rapist whose victim died after the attack .

source_bert_toks: crown prosecutors are to appeal against a len ##ient sentence imposed on a rap ##ist whose victim died after the attack .

reference_raw: The Crown Prosecutor will appeal against a lenient sentence imposed on a violent offender whose victim died after the attack.

reference_spacy_tokens: The Crown Prosecutor will appeal against a lenient sentence imposed on a violent offender whose victim died after the attack .


fn_spacy_tokens_for_baseline: Then Dad stormed right into the house and up the stairs to see me .

source_bert_toks: then dad stormed right into the house and up the stairs to see me .

reference_raw: Then my dad ran straight into the house and up the stairs to meet me.

reference_spacy_tokens: Then my dad ran straight into the house and up the stairs to meet me .


fn_spacy_tokens_for_baseline: COLOMBIA 'S army has destroyed at least three million opium poppies in province of Narino , the largest crop ever destroyed in the South American country , the Colprensa news agency reported yesterday .

source_bert_toks: colombia ' s army has destroyed at least three million opium pop ##pies in province of na ##rino , the largest crop ever destroyed in the south american country , the col ##pre ##ns ##a news agency reported yesterday .

reference_raw: COLOMBIA's army killed at least three million opium poppies in the province of Narino, the largest crop in South America, reported yesterday by the Colprensa News Agency.

reference_spacy_tokens: COLOMBIA 's army killed at least three million opium poppies in the province of Narino , the largest crop in South America , reported yesterday by the Colprensa News Agency .


fn_spacy_tokens_for_baseline: The theory states that individuals possess certain characteristics so that they are predisposed to act in a certain way within a given situation .

source_bert_toks: the theory states that individuals possess certain characteristics so that they are pre ##dis ##posed to act in a certain way within a given situation .

reference_raw: According to the theory, individuals have certain characteristics in order to be able to act in a certain way in a given situation.

reference_spacy_tokens: According to the theory , individuals have certain characteristics in order to be able to act in a certain way in a given situation .


fn_spacy_tokens_for_baseline: The EC is broadly agreed to end the European single market in waste , wherein toxic materials traverse Europe in the search for the cheapest and least - regulated outlet , but can not agree on how to do it .

source_bert_toks: the ec is broadly agreed to end the european single market in waste , wherein toxic materials traverse europe in the search for the cheap ##est and least - regulated outlet , but can not agree on how to do it .

reference_raw: The European Commission has generally agreed to put an end to the European single market in waste, where toxic materials travel across Europe in search of the cheapest and least regulated outlets, but cannot agree on how to do so.

reference_spacy_tokens: The European Commission has generally agreed to put an end to the European single market in waste , where toxic materials travel across Europe in search of the cheapest and least regulated outlets , but can not agree on how to do so .


fn_spacy_tokens_for_baseline: And Basinger , a cool customer , has never looked more comfortable with another actor , not even Alec Baldwin .

source_bert_toks: and basin ##ger , a cool customer , has never looked more comfortable with another actor , not even alec baldwin .

reference_raw: And Basinger, a good customer, had never been more comfortable with any other actor, not even Alec Baldwin.

reference_spacy_tokens: And Basinger , a good customer , had never been more comfortable with any other actor , not even Alec Baldwin .


fn_spacy_tokens_for_baseline: If you continue to the end of the promenade , you will be in Tsim Sha Tsui East , a busy commercial district built on more than 60 hectares ( 150 acres ) of reclaimed land .

source_bert_toks: if you continue to the end of the promenade , you will be in ts ##im sha ts ##ui east , a busy commercial district built on more than 60 hectares ( 150 acres ) of reclaimed land .

reference_raw: If you continue until the end of the promenade, you will be in Tsim Sha Tsui East, a busy commercial area built on more than 60 hectares (150 hectares) of reclaimed land.

reference_spacy_tokens: If you continue until the end of the promenade , you will be in Tsim Sha Tsui East , a busy commercial area built on more than 60 hectares ( 150 hectares ) of reclaimed land .


fn_spacy_tokens_for_baseline: John is hungry , so he undoes his seat belt slowly and carefully .

source_bert_toks: john is hungry , so he undo ##es his seat belt slowly and carefully .

reference_raw: John is starving, so he slowly and carefully unfastens his seatbelt.

reference_spacy_tokens: John is starving , so he slowly and carefully unfastens his seatbelt .


fn_spacy_tokens_for_baseline: After removing the last traces of the final wash from the agarose pellet , 30 l of the sample buffer ( 0 .

source_bert_toks: after removing the last traces of the final wash from the ag ##aro ##se pe ##llet , 30 l of the sample buffer ( 0 .

reference_raw: After removing the final residue from the agarose pellet, 30 litres of sample buffer (0.

reference_spacy_tokens: After removing the final residue from the agarose pellet , 30 litres of sample buffer ( 0 .


fn_spacy_tokens_for_baseline: Pakistani military and government leaders had regarded Mahsud as Public Enemy No . 1 , a clever , ruthless opponent responsible for engineering suicide bomb attacks and ambushes that killed more than 1,200 people in recent years .

source_bert_toks: pakistani military and government leaders had regarded ma ##hs ##ud as public enemy no . 1 , a clever , ruthless opponent responsible for engineering suicide bomb attacks and ambush ##es that killed more than 1 , 200 people in recent years .

reference_raw: Pakistani military and government leaders considered Mahsud to be public enemy number one, a smart and ruthless opponent in charge of technical suicide bombings and ambushes that have killed over 1,200 people in recent years.

reference_spacy_tokens: Pakistani military and government leaders considered Mahsud to be public enemy number one , a smart and ruthless opponent in charge of technical suicide bombings and ambushes that have killed over 1,200 people in recent years .


fn_spacy_tokens_for_baseline: Food is at its most plentiful during the short summer months , when the snow melts to uncover the higher mountain pastures .

source_bert_toks: food is at its most pl ##ent ##iful during the short summer months , when the snow melt ##s to uncover the higher mountain pastures .

reference_raw: During the short summer months, when the snow melts to uncover the higher mountain pastures, the food is at its most abundant.

reference_spacy_tokens: During the short summer months , when the snow melts to uncover the higher mountain pastures , the food is at its most abundant .


fn_spacy_tokens_for_baseline: The answer must be ' not a great deal ' ; for none of the portents of success are immediately apparent .

source_bert_toks: the answer must be ' not a great deal ' ; for none of the porte ##nts of success are immediately apparent .

reference_raw: The answer must be 'not much' ; for no sign of success is immediately apparent.

reference_spacy_tokens: The answer must be ' not much ' ; for no sign of success is immediately apparent .


fn_spacy_tokens_for_baseline: For details of the series look in the Radio Times or get a list of the programmes , either from Radio Brighton or by writing to me , Doctor Brian Smith at the Physics Building in the university .

source_bert_toks: for details of the series look in the radio times or get a list of the programmes , either from radio brighton or by writing to me , doctor brian smith at the physics building in the university .

reference_raw: For details of the series, check the Radio Times or get a list of programs, either from Radio Brighton or by writing to me, Dr. Brian Smith from the University Physics Building.

reference_spacy_tokens: For details of the series , check the Radio Times or get a list of programs , either from Radio Brighton or by writing to me , Dr. Brian Smith from the University Physics Building .


fn_spacy_tokens_for_baseline: 3- Secret gates should be built 50 meters apart to be used for emergency only .

source_bert_toks: 3 - secret gates should be built 50 meters apart to be used for emergency only .

reference_raw: 3-Secret Gates should be built 50 metres apart for emergency purposes only.

reference_spacy_tokens: 3-Secret Gates should be built 50 metres apart for emergency purposes only .


fn_spacy_tokens_for_baseline: This is surely a babyhood memory , slightly corrupted , of seeing the word ' toilets ' reflected fleetingly in my nurse 's spectacles when we travelled from London to Dover to sail for the continent .

source_bert_toks: this is surely a baby ##hood memory , slightly corrupted , of seeing the word ' toilets ' reflected fleeting ##ly in my nurse ' s spectacle ##s when we travelled from london to dover to sail for the continent .

reference_raw: I'm sure it's a childhood memory, a little damaged, of seeing the word "toilets" reflected briefly in my sister's glasses as we traveled from London to Dover to sail for the continent.

reference_spacy_tokens: I 'm sure it 's a childhood memory , a little damaged , of seeing the word " toilets " reflected briefly in my sister 's glasses as we traveled from London to Dover to sail for the continent .


fn_spacy_tokens_for_baseline: Iraq was accused by the United States administration of failing to meet a UN July 25 deadline to give a full disclosure of its nuclear capabilities .

source_bert_toks: iraq was accused by the united states administration of failing to meet a un july 25 deadline to give a full disclosure of its nuclear capabilities .

reference_raw: The U.S. government accused Iraq of failing to comply with the deadline of July 25th to fully disclose its nuclear capabilities.

reference_spacy_tokens: The U.S. government accused Iraq of failing to comply with the deadline of July 25th to fully disclose its nuclear capabilities .


fn_spacy_tokens_for_baseline: He is supposed to remain impartial and not get involved in national politics .

source_bert_toks: he is supposed to remain imp ##art ##ial and not get involved in national politics .

reference_raw: He should remain unbiased and stay out of national politics.

reference_spacy_tokens: He should remain unbiased and stay out of national politics .


fn_spacy_tokens_for_baseline: What is needed is money to upgrade the ways of showing that art , and if London needs a new museum at all , it is a museum of modern art .

source_bert_toks: what is needed is money to upgrade the ways of showing that art , and if london needs a new museum at all , it is a museum of modern art .

reference_raw: It takes money to improve the way in which this art is displayed, and if London wants a new museum at all, it's a museum of modern art.

reference_spacy_tokens: It takes money to improve the way in which this art is displayed , and if London wants a new museum at all , it 's a museum of modern art .


fn_spacy_tokens_for_baseline: Oh yes , what do you fancy for your lunch ?

source_bert_toks: oh yes , what do you fancy for your lunch ?

reference_raw: Yeah, what do you like for lunch?

reference_spacy_tokens: Yeah , what do you like for lunch ?


fn_spacy_tokens_for_baseline: Women 's rights activists say five women have been flogged publicly this year .

source_bert_toks: women ' s rights activists say five women have been fl ##og ##ged publicly this year .

reference_raw: Women's rights activists say that five women were publicly whipped this year.

reference_spacy_tokens: Women 's rights activists say that five women were publicly whipped this year .


fn_spacy_tokens_for_baseline: Duncan peeped down into the water of the loch and , just then , the wind blew strong and fast making the water splash and ripple and the green weeds slithered about under the surface .

source_bert_toks: duncan pee ##ped down into the water of the loch and , just then , the wind blew strong and fast making the water splash and ripple and the green weeds slit ##hered about under the surface .

reference_raw: Duncan peered down into the water of the lake, and just then the wind blew hard and fast, causing the water to splash and wave and the green weeds to slide beneath the surface.

reference_spacy_tokens: Duncan peered down into the water of the lake , and just then the wind blew hard and fast , causing the water to splash and wave and the green weeds to slide beneath the surface .


fn_spacy_tokens_for_baseline: The thunder crashed , the lightning flared , and the rain came down in torrents .

source_bert_toks: the thunder crashed , the lightning flared , and the rain came down in torre ##nts .

reference_raw: The storm crashed, the lightning flared, and the rain fell in torrents.

reference_spacy_tokens: The storm crashed , the lightning flared , and the rain fell in torrents .


fn_spacy_tokens_for_baseline: A good example is where someone may question you about a situation ostensibly to become clearer about the facts .

source_bert_toks: a good example is where someone may question you about a situation ostensibly to become clearer about the facts .

reference_raw: A good example is where you can be questioned about a situation that is obvious enough to make the facts clearer.

reference_spacy_tokens: A good example is where you can be questioned about a situation that is obvious enough to make the facts clearer .


fn_spacy_tokens_for_baseline: The man paused , then magnanimously decided to give the benefit of his expertise , ' What you want to do is chop ten minutes out of it .

source_bert_toks: the man paused , then magna ##ni ##mous ##ly decided to give the benefit of his expertise , ' what you want to do is chop ten minutes out of it .

reference_raw: The man paused, then made a generous decision to use his expertise, "What you want to do is cut off ten minutes.

reference_spacy_tokens: The man paused , then made a generous decision to use his expertise , " What you want to do is cut off ten minutes .


fn_spacy_tokens_for_baseline: It is significant that in his affidavit evidence the debtor criticises the quality of the advice he received , but he does not otherwise query the reasonableness of the charges .

source_bert_toks: it is significant that in his af ##fi ##dav ##it evidence the debt ##or critic ##ises the quality of the advice he received , but he does not otherwise query the reasonable ##ness of the charges .

reference_raw: It is important that the debtor criticizes the quality of the advice given to him in his sworn evidence, but does not otherwise question the reasonableness of the fees.

reference_spacy_tokens: It is important that the debtor criticizes the quality of the advice given to him in his sworn evidence , but does not otherwise question the reasonableness of the fees .


fn_spacy_tokens_for_baseline: Operating profit fell to £ 10.5 m from £ 11.1 m in 1991 .

source_bert_toks: operating profit fell to £10 . 5 ##m from £1 ##1 . 1 ##m in 1991 .

reference_raw: The operating profit dropped from £11.1 million in 1991 to £10.5 million.

reference_spacy_tokens: The operating profit dropped from £ 11.1 million in 1991 to £ 10.5 million .


fn_spacy_tokens_for_baseline: Hundreds of gallons of toxic waste from US bases are being shipped into Britain for disposal , despite denials by the government .

source_bert_toks: hundreds of gallons of toxic waste from us bases are being shipped into britain for disposal , despite denial ##s by the government .

reference_raw: Hundreds of gallons of toxic waste from U.S. bases are being shipped to Britain for disposal, despite the government's refusal.

reference_spacy_tokens: Hundreds of gallons of toxic waste from U.S. bases are being shipped to Britain for disposal , despite the government 's refusal .


fn_spacy_tokens_for_baseline: Most of us have experienced a strong , nearly uncontrollable urge for a certain type of food .

source_bert_toks: most of us have experienced a strong , nearly un ##con ##tro ##lla ##ble urge for a certain type of food .

reference_raw: Most of us experienced a strong, almost uncontrollable desire to eat a certain kind of food.

reference_spacy_tokens: Most of us experienced a strong , almost uncontrollable desire to eat a certain kind of food .


fn_spacy_tokens_for_baseline: It seems cruel that what is encouraged and praised in girls as children ( and is also , after all , an expression of identity and creativity which little boys too could benefit from ) is suddenly , at age eleven seen as vanity , and a sign of low intellect .

source_bert_toks: it seems cruel that what is encouraged and praised in girls as children ( and is also , after all , an expression of identity and creativity which little boys too could benefit from ) is suddenly , at age eleven seen as vanity , and a sign of low intellect .

reference_raw: It seems harsh that what is encouraged and praised by girls as children (and, after all, it is also an expression of identity and creativity that little boys can benefit from) is suddenly, at the age of eleven, perceived as vanity, a sign of low intellect.

reference_spacy_tokens: It seems harsh that what is encouraged and praised by girls as children ( and , after all , it is also an expression of identity and creativity that little boys can benefit from ) is suddenly , at the age of eleven , perceived as vanity , a sign of low intellect .


fn_spacy_tokens_for_baseline: In a moment or two , when she 'd recovered , she produced her chillim and the little pouch of tobacco that she kept in her waistband .

source_bert_toks: in a moment or two , when she ' d recovered , she produced her chill ##im and the little pouch of tobacco that she kept in her waistband .

reference_raw: After a moment or two, when she had recovered, she produced a chillim and a small bag of tobacco in her belt.

reference_spacy_tokens: After a moment or two , when she had recovered , she produced a chillim and a small bag of tobacco in her belt .


fn_spacy_tokens_for_baseline: The make - up did a terrific job , but could n't get rid of the two deep creases that ran from the corners of her mouth to her jawline , or the network of lines on her brow .

source_bert_toks: the make - up did a terrific job , but couldn ' t get rid of the two deep cr ##ease ##s that ran from the corners of her mouth to her jaw ##line , or the network of lines on her brow .

reference_raw: The makeup did a great job, but she couldn't get rid of the two deep creases that ran from the corners of her mouth to her jawline, or the net of lines on her forehead.

reference_spacy_tokens: The makeup did a great job , but she could n't get rid of the two deep creases that ran from the corners of her mouth to her jawline , or the net of lines on her forehead .


fn_spacy_tokens_for_baseline: The Army of God , for example , is an extremist anti - abortion group that has assassinated doctors who perform abortions and has sent hundreds of anthrax hoax letters to family - planning clinics around the United States .

source_bert_toks: the army of god , for example , is an ex ##tre ##mist anti - abortion group that has assassinated doctors who perform abortion ##s and has sent hundreds of ant ##hra ##x hoax letters to family - planning clinics around the united states .

reference_raw: The Army of God, for example, is an extremist anti-abortion group that murdered doctors who carried out abortions and wrote hundreds of anthrax hoax letters to their families-planning clinics in the United States.

reference_spacy_tokens: The Army of God , for example , is an extremist anti - abortion group that murdered doctors who carried out abortions and wrote hundreds of anthrax hoax letters to their families - planning clinics in the United States .


fn_spacy_tokens_for_baseline: Soon they were on the sky bus , hundreds of metres above the dark Wambizi Woods .

source_bert_toks: soon they were on the sky bus , hundreds of metres above the dark wa ##mb ##iz ##i woods .

reference_raw: Soon they were on a sky bus, hundreds of meters over the dark woods of the Wambizi.

reference_spacy_tokens: Soon they were on a sky bus , hundreds of meters over the dark woods of the Wambizi .


fn_spacy_tokens_for_baseline: That was n't too sensible , way out here on this moonless night , etc . , with a couple of lethal fire - arms lying around .

source_bert_toks: that wasn ' t too sensible , way out here on this moon ##less night , etc . , with a couple of lethal fire - arms lying around .

reference_raw: It wasn't very reasonable, out here on this moon-free night, and so on, with a few deadly firearms lying around.

reference_spacy_tokens: It was n't very reasonable , out here on this moon - free night , and so on , with a few deadly firearms lying around .


fn_spacy_tokens_for_baseline: People would say he was harmless , but I did n't like the idea of my remarks and behaviour being stored up for him later to gossip about or pass judgment on .

source_bert_toks: people would say he was harmless , but i didn ' t like the idea of my remarks and behaviour being stored up for him later to gossip about or pass judgment on .

reference_raw: People would say he was innocuous, but I didn't like the idea that my remarks and behavior would be stored for him later in order to discuss or pass judgment.

reference_spacy_tokens: People would say he was innocuous , but I did n't like the idea that my remarks and behavior would be stored for him later in order to discuss or pass judgment .


fn_spacy_tokens_for_baseline: Louisa arrived in time to hear this and to see , a moment later , the tears start to Frere 's eyes , then she was down beside the unconscious woman , holding her head .

source_bert_toks: louisa arrived in time to hear this and to see , a moment later , the tears start to fr ##ere ' s eyes , then she was down beside the unconscious woman , holding her head .

reference_raw: Louisa had arrived just in time to hear it, to see that the tears had begun in Frere's eyes, and then she was down next to the unconscious woman, holding her head.

reference_spacy_tokens: Louisa had arrived just in time to hear it , to see that the tears had begun in Frere 's eyes , and then she was down next to the unconscious woman , holding her head .


fn_spacy_tokens_for_baseline: Initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

source_bert_toks: initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

reference_raw: The first phones said there were a lot of animals in the house, and the firemen were working fast to save all the cats and dogs.

reference_spacy_tokens: The first phones said there were a lot of animals in the house , and the firemen were working fast to save all the cats and dogs .


fn_spacy_tokens_for_baseline: She turned and Cameron saw , under her arm , old Donald 's face , eyes staring fixedly , his mouth drooping at one side , a shine of saliva on his chin .

source_bert_toks: she turned and cameron saw , under her arm , old donald ' s face , eyes staring fixed ##ly , his mouth dr ##ooping at one side , a shine of saliva on his chin .

reference_raw: She turned and Cameron could see the face of old Donald under her arm, his eyes fixed, his mouth drooping to one side, the gleam of saliva on his chin.

reference_spacy_tokens: She turned and Cameron could see the face of old Donald under her arm , his eyes fixed , his mouth drooping to one side , the gleam of saliva on his chin .


fn_spacy_tokens_for_baseline: Yet these feelings seem to diminish in intensity as one gets older .

source_bert_toks: yet these feelings seem to dim ##ini ##sh in intensity as one gets older .

reference_raw: But these feelings seem to decrease in intensity as you grow older.

reference_spacy_tokens: But these feelings seem to decrease in intensity as you grow older .


fn_spacy_tokens_for_baseline: The nation has recently considered leaning toward the mainstream right to expand its influence .

source_bert_toks: the nation has recently considered leaning toward the mainstream right to expand its influence .

reference_raw: Recently, the nation has considered leaning toward the mainstream right to expand its power.

reference_spacy_tokens: Recently , the nation has considered leaning toward the mainstream right to expand its power .


fn_spacy_tokens_for_baseline: Between Piccadilly and Putney , where he lived in the basement of a decaying Victorian house , he progressed through his usual states of somnolence , sick juddering wakefulness , and increasing worry about Val .

source_bert_toks: between pic ##ca ##dilly and put ##ney , where he lived in the basement of a decay ##ing victorian house , he progressed through his usual states of so ##m ##no ##lence , sick judd ##ering wake ##fulness , and increasing worry about val .

reference_raw: Between Piccadilly and Putney, where he lived in the cellar of the decaying Victorian house, he made his way through his usual state of sleepiness, sick judgment, and growing concern for Val.

reference_spacy_tokens: Between Piccadilly and Putney , where he lived in the cellar of the decaying Victorian house , he made his way through his usual state of sleepiness , sick judgment , and growing concern for Val .


fn_spacy_tokens_for_baseline: Arafat named an ally , Brig . Gen. Jibril Rajoub , to the post of national security advisor Monday , which was widely interpreted as a move to limit the powers of Abbas ' security chief , Mohammed Dahlan .

source_bert_toks: ara ##fat named an ally , brig . gen . ji ##bri ##l raj ##ou ##b , to the post of national security advisor monday , which was widely interpreted as a move to limit the powers of abbas ' security chief , mohammed dahl ##an .

reference_raw: Arafat appointed an ally, Brig. General Jibril Rajoub, to the post of National Security Adviser on Monday, which was widely interpreted as a move to restrict the powers of Abbas' chief of security, Mohammed Dahlan.

reference_spacy_tokens: Arafat appointed an ally , Brig . General Jibril Rajoub , to the post of National Security Adviser on Monday , which was widely interpreted as a move to restrict the powers of Abbas ' chief of security , Mohammed Dahlan .


fn_spacy_tokens_for_baseline: Some members of this Government are becoming more ludicrous than their Spitting Image puppets .

source_bert_toks: some members of this government are becoming more lu ##dic ##rous than their spitting image puppets .

reference_raw: Some members of the government are becoming more ridiculous than their Spitting Image Dolls.

reference_spacy_tokens: Some members of the government are becoming more ridiculous than their Spitting Image Dolls .


fn_spacy_tokens_for_baseline: ' People have been listening to each other , making progress , making compromises , ' said U. S. Ambassador Zalmay Khalilzad , who is involved in the discussions and trying to push them along .

source_bert_toks: ' people have been listening to each other , making progress , making compromise ##s , ' said u . s . ambassador za ##lma ##y k ##hal ##il ##za ##d , who is involved in the discussions and trying to push them along .

reference_raw: 'People listen to each other, make progress, make trade-offs,' said U.S. Ambassador Zalmay Khalilzad, who was involved in the debates and was trying to push them forward.

reference_spacy_tokens: ' People listen to each other , make progress , make trade - offs , ' said U.S. Ambassador Zalmay Khalilzad , who was involved in the debates and was trying to push them forward .


fn_spacy_tokens_for_baseline: The Patriot movement subscribes to a conspiratorial world - view in which the federal government is in league with Jewish bankers to deprive ordinary Americans of their land and liberty .

source_bert_toks: the patriot movement sub ##scribe ##s to a con ##sp ##ira ##tori ##al world - view in which the federal government is in league with jewish bankers to de ##pr ##ive ordinary americans of their land and liberty .

reference_raw: The Patriot movement subscribes to a conspiratorial view of the world, in which the federal government is in league with Jewish bankers in order to deprive ordinary America of their country and freedom.

reference_spacy_tokens: The Patriot movement subscribes to a conspiratorial view of the world , in which the federal government is in league with Jewish bankers in order to deprive ordinary America of their country and freedom .


fn_spacy_tokens_for_baseline: The Taconian movements of eastern North America clearly represent the meeting of plates with the involvement of considerable quantities of Oceanic material .

source_bert_toks: the ta ##con ##ian movements of eastern north america clearly represent the meeting of plates with the involvement of considerable quantities of oceanic material .

reference_raw: The Taconian movements in East North America clearly represent a meeting of plates involving a significant amount of oceanic material.

reference_spacy_tokens: The Taconian movements in East North America clearly represent a meeting of plates involving a significant amount of oceanic material .


fn_spacy_tokens_for_baseline: Tears springing to her eyes , she pushed her chair back , rose , and ran out of the dining room .

source_bert_toks: tears spring ##ing to her eyes , she pushed her chair back , rose , and ran out of the dining room .

reference_raw: Tears welled up in her eyes, she pushed back her chair, got up, and ran out of the cafeteria.

reference_spacy_tokens: Tears welled up in her eyes , she pushed back her chair , got up , and ran out of the cafeteria .


fn_spacy_tokens_for_baseline: I must however caution that financial and other constraints compel us to plan more conservatively than I imagine you would wish .

source_bert_toks: i must however caution that financial and other constraints com ##pel us to plan more conservative ##ly than i imagine you would wish .

reference_raw: However, I must warn you that financial and other constraints force us to plan more conservatively than you'd like.

reference_spacy_tokens: However , I must warn you that financial and other constraints force us to plan more conservatively than you 'd like .


fn_spacy_tokens_for_baseline: Heat rose from the depths , and every smooth cold surface was damp with condensation .

source_bert_toks: heat rose from the depths , and every smooth cold surface was damp with conde ##ns ##ation .

reference_raw: The heat was rising from the depths, and all the smooth cool surfaces were wet with condensation.

reference_spacy_tokens: The heat was rising from the depths , and all the smooth cool surfaces were wet with condensation .


fn_spacy_tokens_for_baseline: If it 's difficult to make the tool shed secure , think about buying army surplus steel lockers or ammunition boxes to lock your tools in , and if necessary bolt the containers to the floor .

source_bert_toks: if it ' s difficult to make the tool shed secure , think about buying army surplus steel locker ##s or ammunition boxes to lock your tools in , and if necessary bolt the containers to the floor .

reference_raw: If it's difficult to secure the tool shed, think about buying military surplus steel cabinets or ammunition boxes to lock your instruments in and, if necessary, lock the containers to the floor.

reference_spacy_tokens: If it 's difficult to secure the tool shed , think about buying military surplus steel cabinets or ammunition boxes to lock your instruments in and , if necessary , lock the containers to the floor .


fn_spacy_tokens_for_baseline: Men wearing white gloves moved it , but you could n't see them do it as the bodies were out of shot . '

source_bert_toks: men wearing white gloves moved it , but you couldn ' t see them do it as the bodies were out of shot . '

reference_raw: The men in the white gauntlets moved it, but you couldn't see them do it when the bodies weren't shot.'

reference_spacy_tokens: The men in the white gauntlets moved it , but you could n't see them do it when the bodies were n't shot . '


fn_spacy_tokens_for_baseline: If Dublin were razed to the ground , what would it matter if some of the ashes belonged to Marks and Spencer ?

source_bert_toks: if dublin were ra ##zed to the ground , what would it matter if some of the ashes belonged to marks and spencer ?

reference_raw: If Dublin was grounded, what difference would it make if some of the ashes were Marks and Spencer's?

reference_spacy_tokens: If Dublin was grounded , what difference would it make if some of the ashes were Marks and Spencer 's ?


fn_spacy_tokens_for_baseline: Not only did it create jobs , but it also created Lake Mead , the massive reservoir that today provides water to all of southern Nevada .

source_bert_toks: not only did it create jobs , but it also created lake mead , the massive reservoir that today provides water to all of southern nevada .

reference_raw: Not only did it create jobs, it also created Lake Mead, a massive reservoir that now provides water to the entire south of Nevada.

reference_spacy_tokens: Not only did it create jobs , it also created Lake Mead , a massive reservoir that now provides water to the entire south of Nevada .


fn_spacy_tokens_for_baseline: Marvel at Henri La Mothe as he dives 28 feet into 12- inches of water .

source_bert_toks: marvel at henri la moth ##e as he dive ##s 28 feet into 12 - inches of water .

reference_raw: He marvels at Henri La Mothe as he dives 28 feet into 12-inch water.

reference_spacy_tokens: He marvels at Henri La Mothe as he dives 28 feet into 12-inch water .


fn_spacy_tokens_for_baseline: The junks are a picturesque sight : children frolicking on the poop deck , women preparing food or playing mahjong , elderly folk watching the sunset , dogs and cats underfoot , songbirds in bamboo cages overhead - and all afloat .

source_bert_toks: the junk ##s are a picturesque sight : children fr ##olic ##king on the po ##op deck , women preparing food or playing ma ##h ##jong , elderly folk watching the sunset , dogs and cats under ##foot , song ##birds in bamboo cages overhead - and all afl ##oat .

reference_raw: The junks are picturesque sights: children flickering on the poop deck, women preparing food or acting mahjong, older people watching the sunset, dogs and cats underfoot, songbirds in bamboo cages above them - and all on the surface.

reference_spacy_tokens: The junks are picturesque sights : children flickering on the poop deck , women preparing food or acting mahjong , older people watching the sunset , dogs and cats underfoot , songbirds in bamboo cages above them - and all on the surface .


fn_spacy_tokens_for_baseline: The game is up and you must skulk back to your own area , full of socks and thick hats , and leave the mysterious , metallic things to people who can answer such a query with a number and a knowing smile .

source_bert_toks: the game is up and you must sk ##ul ##k back to your own area , full of socks and thick hats , and leave the mysterious , metallic things to people who can answer such a query with a number and a knowing smile .

reference_raw: The game's over, and you have to go back to your place, full of socks and thick hats, and leave the mysterious metallic things to people who can answer that question with a certain number and a knowing smile.

reference_spacy_tokens: The game 's over , and you have to go back to your place , full of socks and thick hats , and leave the mysterious metallic things to people who can answer that question with a certain number and a knowing smile .


fn_spacy_tokens_for_baseline: With its sequence of four thousand years of remains , Jarlshof is the longest - lived and most complex archaeological site in Historic Scotland 's care .

source_bert_toks: with its sequence of four thousand years of remains , jar ##ls ##hof is the longest - lived and most complex archaeological site in historic scotland ' s care .

reference_raw: With a series of four thousand years of remains, Jarlshof is the longest-lived and most complex archaeological site in the care of Historical Scotland.

reference_spacy_tokens: With a series of four thousand years of remains , Jarlshof is the longest - lived and most complex archaeological site in the care of Historical Scotland .


fn_spacy_tokens_for_baseline: He should do more to reduce tax rates on wealth and income , in recognition of the fact that those cuts yield higher , not lower , revenues .

source_bert_toks: he should do more to reduce tax rates on wealth and income , in recognition of the fact that those cuts yield higher , not lower , revenues .

reference_raw: It should do more to reduce tax rates on wealth and revenue, recognising that these cuts yield higher, not lower, revenues.

reference_spacy_tokens: It should do more to reduce tax rates on wealth and revenue , recognising that these cuts yield higher , not lower , revenues .


fn_spacy_tokens_for_baseline: I failed to play a tape throughout the weekend of a drill relentlessly droning away in some shelfless room out of sight .

source_bert_toks: i failed to play a tape throughout the weekend of a drill relentless ##ly dr ##oning away in some shelf ##less room out of sight .

reference_raw: During the weekend of the drill, I failed to play a videotape... ...droning tirelessly in a shelfless room out of view.

reference_spacy_tokens: During the weekend of the drill , I failed to play a videotape ... ... droning tirelessly in a shelfless room out of view .


fn_spacy_tokens_for_baseline: It veered out of control , swerved across the road and crashed into a shop front .

source_bert_toks: it ve ##ered out of control , sw ##erved across the road and crashed into a shop front .

reference_raw: He turned out of control, turned across the road, and hit the front of the store.

reference_spacy_tokens: He turned out of control , turned across the road , and hit the front of the store .


fn_spacy_tokens_for_baseline: ' It is bad enough doing that to the uninitiated , but to do it to the Secretary of State is really beyond the pale -- it 's quite pathetic . '

source_bert_toks: ' it is bad enough doing that to the un ##ini ##tia ##ted , but to do it to the secretary of state is really beyond the pale - - it ' s quite pathetic . '

reference_raw: "It's bad enough to do it to the uninitiated, but to do it to the Foreign Minister is more than pale-it's kind of lame."

reference_spacy_tokens: " It 's bad enough to do it to the uninitiated , but to do it to the Foreign Minister is more than pale - it 's kind of lame . "


fn_spacy_tokens_for_baseline: Diesel park West sent us incredible demo tapes , but I would not do a deal without seeing them perform live . ,

source_bert_toks: diesel park west sent us incredible demo tapes , but i would not do a deal without seeing them perform live . ,

reference_raw: Diesel Park West sent us unbelievable demo tapes, but I wouldn't make a deal if I didn't see them perform live.

reference_spacy_tokens: Diesel Park West sent us unbelievable demo tapes , but I would n't make a deal if I did n't see them perform live .


fn_spacy_tokens_for_baseline: Also the brothers did n't announce the claim for any of the killings .

source_bert_toks: also the brothers didn ' t announce the claim for any of the killings .

reference_raw: And the brothers didn't say anything about the killings.

reference_spacy_tokens: And the brothers did n't say anything about the killings .


fn_spacy_tokens_for_baseline: Her lovely fingers merely hovered momentarily over the sugar - coated biscuits arranged on a china plate with tiny pink flowers and a fluted edge .

source_bert_toks: her lovely fingers merely hovered momentarily over the sugar - coated biscuits arranged on a china plate with tiny pink flowers and a flute ##d edge .

reference_raw: Her beautiful fingers simply floated for a moment over the sugar-covered cookies stacked on a porcelain plate with tiny pink flowers and fluted edges.

reference_spacy_tokens: Her beautiful fingers simply floated for a moment over the sugar - covered cookies stacked on a porcelain plate with tiny pink flowers and fluted edges .


fn_spacy_tokens_for_baseline: In one of my first jobs I plastered on the make - up and wore very executive - type suits .

source_bert_toks: in one of my first jobs i plastered on the make - up and wore very executive - type suits .

reference_raw: I put on makeup in one of my first jobs and wore a very executive suit.

reference_spacy_tokens: I put on makeup in one of my first jobs and wore a very executive suit .


fn_spacy_tokens_for_baseline: He smoked it deliberately in slow puffs , giving Peter time to consider their situation .

source_bert_toks: he smoked it deliberately in slow puff ##s , giving peter time to consider their situation .

reference_raw: He blew it deliberately in slow puffs, giving Peter time to think about their situation.

reference_spacy_tokens: He blew it deliberately in slow puffs , giving Peter time to think about their situation .


fn_spacy_tokens_for_baseline: But I must have met thousands of mothers in my career .

source_bert_toks: but i must have met thousands of mothers in my career .

reference_raw: But in my career, I had to get to know thousands of mothers.

reference_spacy_tokens: But in my career , I had to get to know thousands of mothers .


fn_spacy_tokens_for_baseline: These young people are rarely lazy -- they 're virtually always depressed and afraid of rejection they ca n't handle .

source_bert_toks: these young people are rarely lazy - - they ' re virtually always depressed and afraid of rejection they can ' t handle .

reference_raw: These young people are seldom sluggish - they're almost always depressed and afraid of rejection they can't handle.

reference_spacy_tokens: These young people are seldom sluggish - they 're almost always depressed and afraid of rejection they ca n't handle .


fn_spacy_tokens_for_baseline: The whole place had an odour of long - gone take - away curries and engine oil .

source_bert_toks: the whole place had an o ##dou ##r of long - gone take - away currie ##s and engine oil .

reference_raw: The smell of long-gone take-off curries and engine oil was all over the place.

reference_spacy_tokens: The smell of long - gone take - off curries and engine oil was all over the place .


fn_spacy_tokens_for_baseline: QN : Is there a clear path for future negotiations between Israel and the Palestinian authority ?

source_bert_toks: q ##n : is there a clear path for future negotiations between israel and the palestinian authority ?

reference_raw: QN: Is there a clear way for future negotiations between Israel and the Palestinian Authority?

reference_spacy_tokens: QN : Is there a clear way for future negotiations between Israel and the Palestinian Authority ?


fn_spacy_tokens_for_baseline: The yew had been grown by John Combes in the early 1700s when this house was built , and there had been an altercation about it ; there had also been an altercation about the building .

source_bert_toks: the ye ##w had been grown by john comb ##es in the early 1700 ##s when this house was built , and there had been an alter ##cation about it ; there had also been an alter ##cation about the building .

reference_raw: John Combes grew the yew in the early seventeenth century, when the house was built, and there was a fight about it; there was a fight about the building.

reference_spacy_tokens: John Combes grew the yew in the early seventeenth century , when the house was built , and there was a fight about it ; there was a fight about the building .


fn_spacy_tokens_for_baseline: He demolished , in print , rivals and competitors .

source_bert_toks: he demolished , in print , rivals and competitors .

reference_raw: He destroyed rivals and competitors in the press.

reference_spacy_tokens: He destroyed rivals and competitors in the press .


fn_spacy_tokens_for_baseline: A TV WEEKLY poll attracted calls from 9,342 viewers who are vexed by the new theme music for Emmerdale .

source_bert_toks: a tv weekly poll attracted calls from 9 , 34 ##2 viewers who are ve ##xed by the new theme music for em ##mer ##dale .

reference_raw: The TV poll of WEEKLY has attracted calls from 9,342 viewers, who are buzzing with Emmerdale's new theme music.

reference_spacy_tokens: The TV poll of WEEKLY has attracted calls from 9,342 viewers , who are buzzing with Emmerdale 's new theme music .


fn_spacy_tokens_for_baseline: Unemployment rose from 1.2 million ( 9.5 per cent ) in the second quarter of 1929 to 3 million ( 22.7 per cent ) in the third quarter of 1932 .

source_bert_toks: unemployment rose from 1 . 2 million ( 9 . 5 per cent ) in the second quarter of 1929 to 3 million ( 22 . 7 per cent ) in the third quarter of 1932 .

reference_raw: In the second quarter of 1929, unemployment increased from 1.2 million (9.5%) to 3 million (22.7%) in the third quarter of 1932.

reference_spacy_tokens: In the second quarter of 1929 , unemployment increased from 1.2 million ( 9.5 % ) to 3 million ( 22.7 % ) in the third quarter of 1932 .


fn_spacy_tokens_for_baseline: I remove the fry just before this stage ; gently syphoning them from their leaf , and then treating them as for fry hatched artificially .

source_bert_toks: i remove the fry just before this stage ; gently sy ##phon ##ing them from their leaf , and then treating them as for fry hatch ##ed artificial ##ly .

reference_raw: I take the fry out just before this stage, gently syphoning it from the leaves, then treating it as if it had been hatched artificially.

reference_spacy_tokens: I take the fry out just before this stage , gently syphoning it from the leaves , then treating it as if it had been hatched artificially .


fn_spacy_tokens_for_baseline: You ca n't just accuse me without backing that accusation up .

source_bert_toks: you can ' t just accuse me without backing that accusation up .

reference_raw: You can't just blame me if you don't back up the charge.

reference_spacy_tokens: You ca n't just blame me if you do n't back up the charge .


fn_spacy_tokens_for_baseline: The little stream wound among floating eyots of water flowers that looked like day stars reflecting a mystical heaven .

source_bert_toks: the little stream wound among floating e ##yo ##ts of water flowers that looked like day stars reflecting a mystical heaven .

reference_raw: There was a small stream between floating eyots of water-flowers that looked like day stars reflecting a mystical sky.

reference_spacy_tokens: There was a small stream between floating eyots of water - flowers that looked like day stars reflecting a mystical sky .


fn_spacy_tokens_for_baseline: The resulting collective consciousness is captured in Nike ads that depict the players doing everything together .

source_bert_toks: the resulting collective consciousness is captured in nike ads that depict the players doing everything together .

reference_raw: The resulting collective consciousness is captured in Nike commercials, depicting the actors who do everything together.

reference_spacy_tokens: The resulting collective consciousness is captured in Nike commercials , depicting the actors who do everything together .


fn_spacy_tokens_for_baseline: Nell guessed from the centrifuges and freezers what type of work they had been designed for .

source_bert_toks: nell guessed from the cent ##ri ##fu ##ges and freeze ##rs what type of work they had been designed for .

reference_raw: Nell could tell from the centrifuges and freezers what kind of work they were designed for.

reference_spacy_tokens: Nell could tell from the centrifuges and freezers what kind of work they were designed for .


fn_spacy_tokens_for_baseline: In the style of his father he squandered the Vernon fortune and he alienated his wife .

source_bert_toks: in the style of his father he sq ##uan ##der ##ed the vernon fortune and he alien ##ated his wife .

reference_raw: He wasted Vernon's fortune in the style of his father and alienated his wife.

reference_spacy_tokens: He wasted Vernon 's fortune in the style of his father and alienated his wife .


source_bert_toks: the u . s . delegation was led by ambassador henry cr ##ump ##ton , coordinator for counter ##ter ##ror ##ism , at the state department " ( outlook india , 21 ##ap ##r ##0 ##6 , pt ##i ) http : / / www . outlook ##ind ##ia . com / pt ##i _ print . as ##p ? id = 37 ##9 ##46 ##8

reference_raw: The US delegation was headed by Ambassador Henry Crumpton, Coordinator of Counterterrorism, at the Ministry of Foreign Affairs (Outlook India, 21 April 2006, PTI) http://www.outlookindia.com/pti_print.asp? id=379468


fn_spacy_tokens_for_baseline: Instead she rushed angrily about the house , screeching threats and peering uselessly into dark corners in the pretence of looking for a switch .

source_bert_toks: instead she rushed angrily about the house , sc ##ree ##ching threats and peering useless ##ly into dark corners in the pre ##ten ##ce of looking for a switch .

reference_raw: Instead, she ran furiously around the house, shrieking threats and looking in vain at the dark corners, pretending to look for a switch.

reference_spacy_tokens: Instead , she ran furiously around the house , shrieking threats and looking in vain at the dark corners , pretending to look for a switch .


fn_spacy_tokens_for_baseline: The waiter had brought a jug of wine and two glasses , and Miguel poured out the sparkling liquid .

source_bert_toks: the waiter had brought a jug of wine and two glasses , and miguel poured out the sparkling liquid .

reference_raw: The waiter brought a pitcher of wine and two glasses, and Miguel poured out a sparkling liquid.

reference_spacy_tokens: The waiter brought a pitcher of wine and two glasses , and Miguel poured out a sparkling liquid .


fn_spacy_tokens_for_baseline: Gould was enthralled by the spirit and customs of the Aborigines , and above all their almost religious respect for nature and its creatures .

source_bert_toks: gould was en ##th ##ral ##led by the spirit and customs of the ab ##ori ##gin ##es , and above all their almost religious respect for nature and its creatures .

reference_raw: Gould was fascinated by the spirit and habits of the natives and, above all, by their almost religious respect for nature and its beings.

reference_spacy_tokens: Gould was fascinated by the spirit and habits of the natives and , above all , by their almost religious respect for nature and its beings .


fn_spacy_tokens_for_baseline: The intensity of it stupefied her .

source_bert_toks: the intensity of it stu ##pe ##fied her .

reference_raw: She was stunned by the intensity of it.

reference_spacy_tokens: She was stunned by the intensity of it .


fn_spacy_tokens_for_baseline: Central News is a product aimed at students at the intermediate level and above .

source_bert_toks: central news is a product aimed at students at the intermediate level and above .

reference_raw: Central News is an intermediate-level and higher-student-oriented product.

reference_spacy_tokens: Central News is an intermediate - level and higher - student - oriented product .


fn_spacy_tokens_for_baseline: The racial card has been used to effect in previous New York elections , but in Mr Giuliani 's case he is being criticised as an opportunist for his attacks on the city 's first black Democratic nominee .

source_bert_toks: the racial card has been used to effect in previous new york elections , but in mr gi ##ulia ##ni ' s case he is being criticised as an op ##port ##uni ##st for his attacks on the city ' s first black democratic nominee .

reference_raw: The race card was used in recent elections in New York, but in the case of Mr. Giuliani, he is criticized as an opportunist for attacking the first black Democratic candidate in the city.

reference_spacy_tokens: The race card was used in recent elections in New York , but in the case of Mr. Giuliani , he is criticized as an opportunist for attacking the first black Democratic candidate in the city .


fn_spacy_tokens_for_baseline: More importantly , the door was now open to end the ' provisional ' Bonn Republic , unite with East Germany and re - create a single German state .

source_bert_toks: more importantly , the door was now open to end the ' provisional ' bonn republic , unite with east germany and re - create a single german state .

reference_raw: More importantly, the door was now open to end the "provisional" of the Bonn Republic, which merged with East Germany and re-established a single German state.

reference_spacy_tokens: More importantly , the door was now open to end the " provisional " of the Bonn Republic , which merged with East Germany and re - established a single German state .


fn_spacy_tokens_for_baseline: It is a pervasive ideology that bolsters the global political economy , capitalist and non - capitalist alike .

source_bert_toks: it is a per ##vas ##ive ideology that bo ##lster ##s the global political economy , capitalist and non - capitalist alike .

reference_raw: The world's political economy, capitalist and non-capitalist, is driven by a pervasive ideology.

reference_spacy_tokens: The world 's political economy , capitalist and non - capitalist , is driven by a pervasive ideology .


fn_spacy_tokens_for_baseline: There were many incorrect statements , false rumours and wrong inferences .

source_bert_toks: there were many incorrect statements , false rumours and wrong inference ##s .

reference_raw: There were a lot of false statements, false rumors, and wrong inferences.

reference_spacy_tokens: There were a lot of false statements , false rumors , and wrong inferences .


fn_spacy_tokens_for_baseline: Whoever needed to know his identity must have some pretty strong reason and quite astonishing contacts if officials from the East were doing the dirty work .

source_bert_toks: whoever needed to know his identity must have some pretty strong reason and quite astonishing contacts if officials from the east were doing the dirty work .

reference_raw: Anyone who needed to know his identity had to have a pretty good reason and a pretty amazing connection if the East officials were doing their dirty work.

reference_spacy_tokens: Anyone who needed to know his identity had to have a pretty good reason and a pretty amazing connection if the East officials were doing their dirty work .


fn_spacy_tokens_for_baseline: ' I studied architecture here , but then went to the States for the degree , ' Vitor replied , and rapped out brief details .

source_bert_toks: ' i studied architecture here , but then went to the states for the degree , ' vito ##r replied , and rap ##ped out brief details .

reference_raw: 'I've been studying architecture here, but then I've gone to the States to get a degree,' Vitor replied, snapping out brief details.

reference_spacy_tokens: ' I 've been studying architecture here , but then I 've gone to the States to get a degree , ' Vitor replied , snapping out brief details .


fn_spacy_tokens_for_baseline: And I 'd say , ' Well , I would n't come to the studio today , because I have to be in bed with so and so . '

source_bert_toks: and i ' d say , ' well , i wouldn ' t come to the studio today , because i have to be in bed with so and so . '

reference_raw: And I said, "Well, I don't want to go to the studio tonight, 'cause I have to be in bed with that."

reference_spacy_tokens: And I said , " Well , I do n't want to go to the studio tonight , 'cause I have to be in bed with that . "


fn_spacy_tokens_for_baseline: He bowed slightly , then shouldered his camera and was soon out of sight .

source_bert_toks: he bowed slightly , then shouldered his camera and was soon out of sight .

reference_raw: He bowed slightly, then backed the camera and was soon out of sight.

reference_spacy_tokens: He bowed slightly , then backed the camera and was soon out of sight .


fn_spacy_tokens_for_baseline: Where the road bears left continue straight on to pick up the coast path above Caerbwdy Bay -- look out for the purple sandstone around the bay .

source_bert_toks: where the road bears left continue straight on to pick up the coast path above ca ##er ##b ##wd ##y bay - - look out for the purple sandstone around the bay .

reference_raw: Where the left-hand bears continue to follow the coast road over Caerbwdy Bay - watch the purple sandstone around the bay.

reference_spacy_tokens: Where the left - hand bears continue to follow the coast road over Caerbwdy Bay - watch the purple sandstone around the bay .


fn_spacy_tokens_for_baseline: It was , to his delight , leaking but still seaworthy ; but an interested crowd of MacIans had gathered on the shore , and even Lachlan could see that to row up Kentra Bay to attack Arivegaig , with an audience eagerly running ahead to arrange a warm welcome for him , was scarcely sensible .

source_bert_toks: it was , to his delight , leaking but still sea ##worthy ; but an interested crowd of mac ##ians had gathered on the shore , and even lac ##hl ##an could see that to row up kent ##ra bay to attack ari ##ve ##gai ##g , with an audience eagerly running ahead to arrange a warm welcome for him , was scarcely sensible .

reference_raw: It was leaking, to his delight, but it was still seaworthy; but a crowd of MacIans had gathered on the shore, and even Lachlan could see that it was hardly reasonable to line up Kentra Bay to attack Arivegaig, and the audience was eagerly in front of him to give him a warm welcome.

reference_spacy_tokens: It was leaking , to his delight , but it was still seaworthy ; but a crowd of MacIans had gathered on the shore , and even Lachlan could see that it was hardly reasonable to line up Kentra Bay to attack Arivegaig , and the audience was eagerly in front of him to give him a warm welcome .


fn_spacy_tokens_for_baseline: The house abashed me .

source_bert_toks: the house aba ##shed me .

reference_raw: I was embarrassed by the house.

reference_spacy_tokens: I was embarrassed by the house .


fn_spacy_tokens_for_baseline: ' It was a pitiful performance which clearly demonstrated that the people of Northern Ireland have very little time for Mrs Thatcher and her party .

source_bert_toks: ' it was a pit ##iful performance which clearly demonstrated that the people of northern ireland have very little time for mrs thatcher and her party .

reference_raw: It was a pathetic performance that made it clear that the people of Northern Ireland had very little time for Mrs. Thatcher and her party.

reference_spacy_tokens: It was a pathetic performance that made it clear that the people of Northern Ireland had very little time for Mrs. Thatcher and her party .


fn_spacy_tokens_for_baseline: Some owners have claimed that their Cornish Rex cats wag their tails when pleased , like dogs , although this is hard to believe .

source_bert_toks: some owners have claimed that their cornish rex cats wa ##g their tails when pleased , like dogs , although this is hard to believe .

reference_raw: Some of the owners said that their Cornish Rex cats wriggle their tails when they like it, like dogs, though it's hard to believe.

reference_spacy_tokens: Some of the owners said that their Cornish Rex cats wriggle their tails when they like it , like dogs , though it 's hard to believe .


fn_spacy_tokens_for_baseline: Jim is now the lucky owner of his third gold spray valve and now has three years ' supply of vegetarian burger bites .

source_bert_toks: jim is now the lucky owner of his third gold spray valve and now has three years ' supply of vegetarian burger bites .

reference_raw: Jim now owns his third gold spray valve, and now he's got a three-year supply of vegetarian burger bites.

reference_spacy_tokens: Jim now owns his third gold spray valve , and now he 's got a three - year supply of vegetarian burger bites .


fn_spacy_tokens_for_baseline: The EC pig meat reference price decreased by 0.3 per cent in the week ended May 30 to 57.41 per cent of the basic price .

source_bert_toks: the ec pig meat reference price decreased by 0 . 3 per cent in the week ended may 30 to 57 . 41 per cent of the basic price .

reference_raw: In the week ending May 30th to 57.41% of the basic price, the EC reference price for pigmeat fell by 0.3%.

reference_spacy_tokens: In the week ending May 30th to 57.41 % of the basic price , the EC reference price for pigmeat fell by 0.3 % .


fn_spacy_tokens_for_baseline: I happily pay my yearly subscription just to read Roger Angell 's occasional essays on baseball . '

source_bert_toks: i happily pay my yearly subscription just to read roger angel ##l ' s occasional essays on baseball . '

reference_raw: I'm happy to pay my annual subscription just to read Roger Angel's occasional baseball paper.'

reference_spacy_tokens: I 'm happy to pay my annual subscription just to read Roger Angel 's occasional baseball paper . '