fn_spacy_tokens_for_baseline: Tests of spatial visualisation have indeed seemed to confirm that this is the case .

source_bert_toks: tests of spatial visual ##isation have indeed seemed to confirm that this is the case .

reference_raw: Indeed, the spatial visualization tests seem to prove that this is the case.

reference_spacy_tokens: Indeed , the spatial visualization tests seem to prove that this is the case .


fn_spacy_tokens_for_baseline: At the door to the marquee they exchanged greetings with scores of other guests , gradually making their way inside .

source_bert_toks: at the door to the mar ##que ##e they exchanged greeting ##s with scores of other guests , gradually making their way inside .

reference_raw: They exchanged greetings with dozens of other guests at the entrance to the marquee and made their way in.

reference_spacy_tokens: They exchanged greetings with dozens of other guests at the entrance to the marquee and made their way in .


fn_spacy_tokens_for_baseline: Foshan 's most outstanding artistic monument is Zu Miao , the Taoist Ancestral Temple , a Sung dynasty establishment rebuilt in the 14th century and well worth visiting .

source_bert_toks: f ##osh ##an ' s most outstanding artistic monument is zu mia ##o , the tao ##ist ancestral temple , a sung dynasty establishment rebuilt in the 14th century and well worth visiting .

reference_raw: Foshan's greatest art monument is Zu Miao, the Taoist Ancestral Temple, a Sung dynasty facility rebuilt in the 14th century, and it's worth a visit.

reference_spacy_tokens: Foshan 's greatest art monument is Zu Miao , the Taoist Ancestral Temple , a Sung dynasty facility rebuilt in the 14th century , and it 's worth a visit .


fn_spacy_tokens_for_baseline: Hear the songs of Bob Marley booming from a hundred cranked - up car stereos or the chorus of frogs that begin to call as evening descends .

source_bert_toks: hear the songs of bob marley booming from a hundred crank ##ed - up car stereo ##s or the chorus of frogs that begin to call as evening descends .

reference_raw: You can hear Bob Marley's songs booming out of 100 cranks - up car stereos, or the chorus of frogs, which start calling as the evening goes down.

reference_spacy_tokens: You can hear Bob Marley 's songs booming out of 100 cranks - up car stereos , or the chorus of frogs , which start calling as the evening goes down .


fn_spacy_tokens_for_baseline: Both need a shady , sheltered , moist spot in the garden .

source_bert_toks: both need a shady , sheltered , moist spot in the garden .

reference_raw: They both need a shady, sheltered, moist place in the garden.

reference_spacy_tokens: They both need a shady , sheltered , moist place in the garden .


fn_spacy_tokens_for_baseline: Borland International Inc president and chief executive Philippe Kahn says the company will report profit for the fourth quarter to March 31 , and adds that he is comfortable with analysts ' estimates of profits of about $ 0.10 a share : Borland 's target is to be profitable every quarter in the coming fiscal 1994 -- Paradox for Windows is ' doing great " and is on a winning track and Quattro Pro is now picking up .

source_bert_toks: bo ##rland international inc president and chief executive philippe kahn says the company will report profit for the fourth quarter to march 31 , and adds that he is comfortable with analysts ' estimates of profits of about $ 0 . 10 a share : bo ##rland ' s target is to be profitable every quarter in the coming fiscal 1994 - - paradox for windows is ' doing great " and is on a winning track and qu ##att ##ro pro is now picking up .

reference_raw: Borland International Inc. President and chief executive, Philippe Kahn, says that the company will report profits for the fourth quarter of March 31st, and adds that it is satisfied with analysts' forecasts of profits of about $0.10 a share: Borland's target is to be profitable every quarter in the coming tax year 1994; Paradox for Windows is "doing well" and is on the winning track, and Quattro Pro is now.

reference_spacy_tokens: Borland International Inc. President and chief executive , Philippe Kahn , says that the company will report profits for the fourth quarter of March 31st , and adds that it is satisfied with analysts ' forecasts of profits of about $ 0.10 a share : Borland 's target is to be profitable every quarter in the coming tax year 1994 ; Paradox for Windows is " doing well " and is on the winning track , and Quattro Pro is now .


fn_spacy_tokens_for_baseline: ' He 's a bit of a recluse , I believe . '

source_bert_toks: ' he ' s a bit of a rec ##lus ##e , i believe . '

reference_raw: "I think he's a little lonely."

reference_spacy_tokens: " I think he 's a little lonely . "


fn_spacy_tokens_for_baseline: On sighting the desolate Andes after a voyage of four months , they were far from delighted , and apparently turned round and sailed back towards their atolls .

source_bert_toks: on sighting the des ##olate andes after a voyage of four months , they were far from delighted , and apparently turned round and sailed back towards their atoll ##s .

reference_raw: When they saw the deserted Andes after a four-month voyage, they were far from happy, and seemed to turn and sail back to their tolls.

reference_spacy_tokens: When they saw the deserted Andes after a four - month voyage , they were far from happy , and seemed to turn and sail back to their tolls .


fn_spacy_tokens_for_baseline: Dawn handed her a syringe filled with heart stimulant and soon Sandy was settled down in a warm recovery cage .

source_bert_toks: dawn handed her a sy ##ring ##e filled with heart st ##im ##ula ##nt and soon sandy was settled down in a warm recovery cage .

reference_raw: Dawn handed her a heart-stimulant needle, and soon Sandy was in a warm recovery cage.

reference_spacy_tokens: Dawn handed her a heart - stimulant needle , and soon Sandy was in a warm recovery cage .


fn_spacy_tokens_for_baseline: But they speared him , and she fainted , just that once .

source_bert_toks: but they spear ##ed him , and she faint ##ed , just that once .

reference_raw: But he was stabbed, and she passed out, just once.

reference_spacy_tokens: But he was stabbed , and she passed out , just once .


fn_spacy_tokens_for_baseline: The Soviet Union had been by far the largest aid donor to Vietnam since the inception of the republic in 1976 .

source_bert_toks: the soviet union had been by far the largest aid donor to vietnam since the inception of the republic in 1976 .

reference_raw: Since the inception of the Republic of 1976, the Soviet Union has been by far the largest aid donation to Vietnam.

reference_spacy_tokens: Since the inception of the Republic of 1976 , the Soviet Union has been by far the largest aid donation to Vietnam .


fn_spacy_tokens_for_baseline: ' I do n't feel resentful that God has decided to take me before my allotted span .

source_bert_toks: ' i don ' t feel res ##ent ##ful that god has decided to take me before my allotted span .

reference_raw: I'm not angry that God chose to take me before my allotted span.

reference_spacy_tokens: I 'm not angry that God chose to take me before my allotted span .


fn_spacy_tokens_for_baseline: ' Are you suggesting that the travellers have murdered Barbs for her money ? ' asked Clarissa , ignoring this interruption from the men .

source_bert_toks: ' are you suggesting that the travellers have murdered bar ##bs for her money ? ' asked clarissa , ignoring this interruption from the men .

reference_raw: 'You mean the pilgrims killed Barbs for her money?' Clarissa asked, ignoring the interruption from the men.

reference_spacy_tokens: ' You mean the pilgrims killed Barbs for her money ? ' Clarissa asked , ignoring the interruption from the men .


fn_spacy_tokens_for_baseline: ' No , do n't be so quick to offence , ' entreated Harry hastily .

source_bert_toks: ' no , don ' t be so quick to offence , ' en ##tre ##ated harry hastily .

reference_raw: 'No, don't insult me so fast,' said Harry hurriedly.

reference_spacy_tokens: ' No , do n't insult me so fast , ' said Harry hurriedly .


fn_spacy_tokens_for_baseline: One expert , whose job is so politically sensitive that he spoke on condition that he would n't be named or quoted , said the expected influx of East European refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

source_bert_toks: one expert , whose job is so politically sensitive that he spoke on condition that he wouldn ' t be named or quoted , said the expected influx of east european refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

reference_raw: One expert, whose work is politically sensitive enough to speak on the condition that he is not named or quoted, said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer-protection workers, for example, doubling as foreign spies.

reference_spacy_tokens: One expert , whose work is politically sensitive enough to speak on the condition that he is not named or quoted , said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer - protection workers , for example , doubling as foreign spies .


fn_spacy_tokens_for_baseline: PERSISTENT shoplifter Anthony Thompson tried to walk out of a clothes store with £ 370 worth of clothing .

source_bert_toks: persistent shop ##lift ##er anthony thompson tried to walk out of a clothes store with £3 ##70 worth of clothing .

reference_raw: Persistent thief Anthony Thompson tried to leave the clothing store with 370 pounds of clothing.

reference_spacy_tokens: Persistent thief Anthony Thompson tried to leave the clothing store with 370 pounds of clothing .


fn_spacy_tokens_for_baseline: Morgan , Andrew Carnegie , and John D. Rockefeller , Sr followed suit in their massive restructurings of US railroads and industries .

source_bert_toks: morgan , andrew carnegie , and john d . rockefeller , sr followed suit in their massive restructuring ##s of us railroads and industries .

reference_raw: Morgan, Andrew Carnegie, and John D. Rockefeller, the Sr followed suit in the massive restructuring of the U.S. railways and industry.

reference_spacy_tokens: Morgan , Andrew Carnegie , and John D. Rockefeller , the Sr followed suit in the massive restructuring of the U.S. railways and industry .


fn_spacy_tokens_for_baseline: All living things on Earth are composed of cells sometimes just a single cell , but sometimes ( as in dogs , humans , or oak trees ) containing billions of cells .

source_bert_toks: all living things on earth are composed of cells sometimes just a single cell , but sometimes ( as in dogs , humans , or oak trees ) containing billions of cells .

reference_raw: All living things on Earth consist of cells sometimes only one cell, but sometimes (like dogs, people, or oak trees) they contain millions of cells.

reference_spacy_tokens: All living things on Earth consist of cells sometimes only one cell , but sometimes ( like dogs , people , or oak trees ) they contain millions of cells .


fn_spacy_tokens_for_baseline: The two are said to be doubtful about Sun 's ability to deliver the code on time and they suspect the company may not give their systems priority over its own .

source_bert_toks: the two are said to be doubtful about sun ' s ability to deliver the code on time and they suspect the company may not give their systems priority over its own .

reference_raw: They say they doubt Sun's ability to deliver the code in time, and suspect that the company may not give its systems priority over its own.

reference_spacy_tokens: They say they doubt Sun 's ability to deliver the code in time , and suspect that the company may not give its systems priority over its own .


fn_spacy_tokens_for_baseline: Jinky was James Dean with a ginger hairdo , an Uddingston rebel without a cause .

source_bert_toks: jin ##ky was james dean with a ginger hair ##do , an ud ##ding ##ston rebel without a cause .

reference_raw: Jinky was James Dean with ginger hair, Uddingston's rebel for no reason.

reference_spacy_tokens: Jinky was James Dean with ginger hair , Uddingston 's rebel for no reason .


fn_spacy_tokens_for_baseline: Many of the chemical weapons storage facilities lack a basic automatic alarm system to warn of dangerous levels of agent in the air .

source_bert_toks: many of the chemical weapons storage facilities lack a basic automatic alarm system to warn of dangerous levels of agent in the air .

reference_raw: Many chemical weapons stores lack a basic automatic alarm system to warn against dangerous levels of agents in the air.

reference_spacy_tokens: Many chemical weapons stores lack a basic automatic alarm system to warn against dangerous levels of agents in the air .


fn_spacy_tokens_for_baseline: The Cardiff and Cambridge University player twisted an ankle during training and will undergo a fitness test before tomorrow 's game against France B in Arcachon .

source_bert_toks: the cardiff and cambridge university player twisted an ankle during training and will undergo a fitness test before tomorrow ' s game against france b in arc ##ach ##on .

reference_raw: A Cardiff and Cambridge University player turned an ankle during training and will pass a fitness test before tomorrow's match against France B in Arcachon.

reference_spacy_tokens: A Cardiff and Cambridge University player turned an ankle during training and will pass a fitness test before tomorrow 's match against France B in Arcachon .


fn_spacy_tokens_for_baseline: They are scholars , mystics and sorcerers without peer , but are affected by a languor that means they rarely bestir themselves except for the most pressing and dire of circumstances .

source_bert_toks: they are scholars , mystic ##s and sorcerer ##s without peer , but are affected by a lang ##uo ##r that means they rarely best ##ir themselves except for the most pressing and dire of circumstances .

reference_raw: They're scholars, mystics, and wizards with no peers, but they're affected by a languor, which means they're rarely better off, except for the most urgent and dire circumstances.

reference_spacy_tokens: They 're scholars , mystics , and wizards with no peers , but they 're affected by a languor , which means they 're rarely better off , except for the most urgent and dire circumstances .


fn_spacy_tokens_for_baseline: A Brief History

source_bert_toks: a brief history

reference_raw: Brief Histories

reference_spacy_tokens: Brief Histories


fn_spacy_tokens_for_baseline: Theodosius , the Eastern emperor , summoned a Council to meet at Ephesus .

source_bert_toks: theo ##dos ##ius , the eastern emperor , summoned a council to meet at ep ##hes ##us .

reference_raw: Theodosius, the Emperor of the East, called the Council to meet in Ephesus.

reference_spacy_tokens: Theodosius , the Emperor of the East , called the Council to meet in Ephesus .


fn_spacy_tokens_for_baseline: His muscular build , boyish charm and natural sense of fun and adventure made him a popular screen idol with men and women alike .

source_bert_toks: his muscular build , boy ##ish charm and natural sense of fun and adventure made him a popular screen idol with men and women alike .

reference_raw: His muscle build, his boyish charm, his natural sense of fun and adventure made him a popular screen idol for men and women.

reference_spacy_tokens: His muscle build , his boyish charm , his natural sense of fun and adventure made him a popular screen idol for men and women .


fn_spacy_tokens_for_baseline: He spent the interval just sitting in his dressing room , gathering his strength for the next act .

source_bert_toks: he spent the interval just sitting in his dressing room , gathering his strength for the next act .

reference_raw: He spent the rest of the time sitting in his closet, gathering his strength for the next act.

reference_spacy_tokens: He spent the rest of the time sitting in his closet , gathering his strength for the next act .


fn_spacy_tokens_for_baseline: There were so many ways in which she could help , and by doing so she might mitigate the fears which crowded upon her when dusk fell .

source_bert_toks: there were so many ways in which she could help , and by doing so she might mit ##igate the fears which crowded upon her when dusk fell .

reference_raw: There were so many ways she could help, and by doing so she could ease the fears that filled her when it got dark.

reference_spacy_tokens: There were so many ways she could help , and by doing so she could ease the fears that filled her when it got dark .


fn_spacy_tokens_for_baseline: It is actively selling its expertise through research contracts at home and abroad .

source_bert_toks: it is actively selling its expertise through research contracts at home and abroad .

reference_raw: It actively sells its expertise through domestic and foreign research contracts.

reference_spacy_tokens: It actively sells its expertise through domestic and foreign research contracts .


fn_spacy_tokens_for_baseline: Tai Po , just south of Fanling , is known for its market , Tai Po Market , which buzzes with activity daily from 7 am to 6 pm .

source_bert_toks: tai po , just south of fan ##ling , is known for its market , tai po market , which buzz ##es with activity daily from 7 am to 6 pm .

reference_raw: Tai Po, north of Fanling, is known for its market, Tai Po Market, which buzzes from 7 a.m. to 6 p.m. every day.

reference_spacy_tokens: Tai Po , north of Fanling , is known for its market , Tai Po Market , which buzzes from 7 a.m. to 6 p.m. every day .


fn_spacy_tokens_for_baseline: Alexandra looked uncomprehending and moved to put her spoon in her soup .

source_bert_toks: alexandra looked un ##com ##pre ##hend ##ing and moved to put her spoon in her soup .

reference_raw: Alexandra looked incomprehensive and moved to put the teaspoon in the soup.

reference_spacy_tokens: Alexandra looked incomprehensive and moved to put the teaspoon in the soup .


fn_spacy_tokens_for_baseline: They believe it even though the evidence is suspect , such is the charmed life of the child .

source_bert_toks: they believe it even though the evidence is suspect , such is the charm ##ed life of the child .

reference_raw: They believe that even if the evidence is suspicious, it's the child's charmed life.

reference_spacy_tokens: They believe that even if the evidence is suspicious , it 's the child 's charmed life .


fn_spacy_tokens_for_baseline: You do n't want to antagonize rich and powerful Emissaries , especially not on their own ship in deep space .

source_bert_toks: you don ' t want to ant ##ago ##ni ##ze rich and powerful emi ##ssar ##ies , especially not on their own ship in deep space .

reference_raw: You don't want to alienate rich and powerful envoys, especially not on your own ship in deep space.

reference_spacy_tokens: You do n't want to alienate rich and powerful envoys , especially not on your own ship in deep space .


fn_spacy_tokens_for_baseline: And the question this poses is : do they become better adults as a result of their Utopian lifestyle ?

source_bert_toks: and the question this poses is : do they become better adults as a result of their utopia ##n lifestyle ?

reference_raw: And the question is, do they become better grown-ups because of their Utopian way of life?

reference_spacy_tokens: And the question is , do they become better grown - ups because of their Utopian way of life ?


fn_spacy_tokens_for_baseline: She patrolled the aisles like a gaoler and woe betide you if that heavy tread stopped at your desk .

source_bert_toks: she patrol ##led the aisles like a gao ##ler and wo ##e bet ##ide you if that heavy tread stopped at your desk .

reference_raw: She patrolled the alleys like a gaoler, and woe bet on you when the heavy tread stops at your table.

reference_spacy_tokens: She patrolled the alleys like a gaoler , and woe bet on you when the heavy tread stops at your table .


fn_spacy_tokens_for_baseline: Hope categorised the social substance on view as exactly as a geologist would have named the crystals in a wound of rock .

source_bert_toks: hope cat ##ego ##rise ##d the social substance on view as exactly as a geologist would have named the crystals in a wound of rock .

reference_raw: Hope categorized the social substance from view, just like a geologist would name the crystals in a rock wound.

reference_spacy_tokens: Hope categorized the social substance from view , just like a geologist would name the crystals in a rock wound .


fn_spacy_tokens_for_baseline: The young Albanian stares up from Pristina 's rubbish - strewn streets towards the wooded hills on the west of the town .

source_bert_toks: the young albanian stares up from pri ##sti ##na ' s rubbish - strewn streets towards the wooded hills on the west of the town .

reference_raw: The young Albanian looks up from the garbage-strewn streets of Pristina to the forested hills to the western side of the city.

reference_spacy_tokens: The young Albanian looks up from the garbage - strewn streets of Pristina to the forested hills to the western side of the city .


fn_spacy_tokens_for_baseline: Since then he briefly coached the Lakers at the end of the 1994 season and toured the world with his own team .

source_bert_toks: since then he briefly coached the lakers at the end of the 1994 season and toured the world with his own team .

reference_raw: Since then, at the end of the 1994 season, he had briefly trained the Lakers and toured the world with his own team.

reference_spacy_tokens: Since then , at the end of the 1994 season , he had briefly trained the Lakers and toured the world with his own team .


fn_spacy_tokens_for_baseline: For suddenly Gus Hambro performed a minor miracle , by producing a fiery blush that made itself visible in waves of dubious gratitude and indubitable mortification even through the layers of river mud that still decorated his face .

source_bert_toks: for suddenly gus ham ##bro performed a minor miracle , by producing a fiery blush that made itself visible in waves of dubious gratitude and ind ##ub ##ita ##ble mort ##ification even through the layers of river mud that still decorated his face .

reference_raw: For all of a sudden Gus Hambro had performed a minor miracle by creating a fiery blush that was visible in waves of dubious gratitude and indisputable mortification, even through the layers of river mud that still adorned his face.

reference_spacy_tokens: For all of a sudden Gus Hambro had performed a minor miracle by creating a fiery blush that was visible in waves of dubious gratitude and indisputable mortification , even through the layers of river mud that still adorned his face .


fn_spacy_tokens_for_baseline: Penry 's displeasure gave her a sudden , desperate longing to get back to wherever -- and more importantly whoever -- she belonged .

source_bert_toks: pen ##ry ' s displeasure gave her a sudden , desperate longing to get back to wherever - - and more importantly whoever - - she belonged .

reference_raw: Penry's displeasure gave her a sudden, desperate desire to go back to where she belonged - and, more importantly, who she belonged to.

reference_spacy_tokens: Penry 's displeasure gave her a sudden , desperate desire to go back to where she belonged - and , more importantly , who she belonged to .


fn_spacy_tokens_for_baseline: Addressing thousands of Libyans in Tripoli 's Green Square in July , he threatened to dispatch Libyan suicide bombers to Europe in retaliation for the NATO bombings .

source_bert_toks: addressing thousands of libyan ##s in tripoli ' s green square in july , he threatened to dispatch libyan suicide bombers to europe in retaliation for the nato bombings .

reference_raw: In July, he tackled thousands of Libyans in the Green Square of Tripoli and threatened to send Libyan suicide-bombers to Europe in retaliation for NATO bombings.

reference_spacy_tokens: In July , he tackled thousands of Libyans in the Green Square of Tripoli and threatened to send Libyan suicide - bombers to Europe in retaliation for NATO bombings .


fn_spacy_tokens_for_baseline: But amazingly her dreams were untainted by the intensity of her loathing .

source_bert_toks: but amazingly her dreams were un ##tain ##ted by the intensity of her lo ##athing .

reference_raw: But it was amazing that her dreams were untainted by the intensity of her hatred.

reference_spacy_tokens: But it was amazing that her dreams were untainted by the intensity of her hatred .


fn_spacy_tokens_for_baseline: A very loud hooter started bleating frantically , and made Robyn jump .

source_bert_toks: a very loud ho ##ote ##r started b ##lea ##ting frantically , and made robyn jump .

reference_raw: The loud hooter began to scream frantically, forcing Robyn to jump.

reference_spacy_tokens: The loud hooter began to scream frantically , forcing Robyn to jump .


fn_spacy_tokens_for_baseline: 27 deaths have been confirmed in Peloponnese , one of the hardest hit areas .

source_bert_toks: 27 deaths have been confirmed in pe ##lo ##pon ##nese , one of the hardest hit areas .

reference_raw: Twenty-seven deaths were confirmed in Peloponnese, one of the most severe hit zones.

reference_spacy_tokens: Twenty - seven deaths were confirmed in Peloponnese , one of the most severe hit zones .


fn_spacy_tokens_for_baseline: He stuttered out what he had to say .

source_bert_toks: he stu ##ttered out what he had to say .

reference_raw: He stammered what he had to say.

reference_spacy_tokens: He stammered what he had to say .


fn_spacy_tokens_for_baseline: The bill was drafted by civil servants , lawyers and ' enarques ' -- among them Henri Pigeat , later the number two ( 1976 ) and head ( 1979 - 86 ) of AFP .

source_bert_toks: the bill was drafted by civil servants , lawyers and ' en ##ar ##ques ' - - among them henri pig ##ea ##t , later the number two ( 1976 ) and head ( 1979 - 86 ) of af ##p .

reference_raw: The bill was drawn up by officials, lawyers, and 'enarques', including Henri Pigeat, and later by the number two (1976) and the head of the AFP (1979-86).

reference_spacy_tokens: The bill was drawn up by officials , lawyers , and ' enarques ' , including Henri Pigeat , and later by the number two ( 1976 ) and the head of the AFP ( 1979 - 86 ) .


fn_spacy_tokens_for_baseline: Call a prolonged , strangled , almost blood - curdling screech ; also hisses , snores and barks .

source_bert_toks: call a prolonged , strangled , almost blood - cu ##rd ##ling sc ##ree ##ch ; also hiss ##es , s ##nor ##es and bark ##s .

reference_raw: Call it a long, strangled, almost bloody creak; also hissing, snoring and barking.

reference_spacy_tokens: Call it a long , strangled , almost bloody creak ; also hissing , snoring and barking .


fn_spacy_tokens_for_baseline: On May 19th seven civil servants were fired ( though , in one of many farcical moves , five have now been unfired ) among muttering that there may have been criminality in the office .

source_bert_toks: on may 19th seven civil servants were fired ( though , in one of many far ##cic ##al moves , five have now been un ##fire ##d ) among muttering that there may have been criminal ##ity in the office .

reference_raw: On May 19th, seven civil servants were dismissed (though in one of many farcical movements, five of them were now unfired) among the rumors that there might be a crime in the office.

reference_spacy_tokens: On May 19th , seven civil servants were dismissed ( though in one of many farcical movements , five of them were now unfired ) among the rumors that there might be a crime in the office .


fn_spacy_tokens_for_baseline: His face lit up , he put his plastic tumbler down on the mantelpiece .

source_bert_toks: his face lit up , he put his plastic tumble ##r down on the man ##tel ##piece .

reference_raw: He lit up his face and laid his plastic tray on the mantelpiece.

reference_spacy_tokens: He lit up his face and laid his plastic tray on the mantelpiece .


fn_spacy_tokens_for_baseline: In the post - war period , Hollywood began to atone for its blatantly racist depictions of blacks with sporadic anti - racist films , almost always directed by whites .

source_bert_toks: in the post - war period , hollywood began to at ##one for its b ##lat ##antly racist depictions of blacks with sporadic anti - racist films , almost always directed by whites .

reference_raw: In the aftermath of the war, Hollywood began to undo its blatantly racist representation of black people with sporadic anti-racist films, almost always directed by white people.

reference_spacy_tokens: In the aftermath of the war , Hollywood began to undo its blatantly racist representation of black people with sporadic anti - racist films , almost always directed by white people .


fn_spacy_tokens_for_baseline: To counter this , the populations moved from their homes on the coast and built settlements inland , out of sight of the raiding parties .

source_bert_toks: to counter this , the populations moved from their homes on the coast and built settlements inland , out of sight of the raiding parties .

reference_raw: To counter this, the population moved out of their homes along the coast, building settlements in the interior, out of sight of the raiding parties.

reference_spacy_tokens: To counter this , the population moved out of their homes along the coast , building settlements in the interior , out of sight of the raiding parties .


fn_spacy_tokens_for_baseline: To have closed such a gap the niggled gentleman must have swiped the juice from his companions ' lips the moment we passed and kick - started them into a sprint .

source_bert_toks: to have closed such a gap the ni ##ggle ##d gentleman must have swiped the juice from his companions ' lips the moment we passed and kick - started them into a sprint .

reference_raw: To close such a gap, the nigger gentleman had to wipe the juice from his companions' lips as we passed and kick them into a sprint.

reference_spacy_tokens: To close such a gap , the nigger gentleman had to wipe the juice from his companions ' lips as we passed and kick them into a sprint .


fn_spacy_tokens_for_baseline: Although it contained elements of Baal and Astarte worship , it was essentially monotheistic .

source_bert_toks: although it contained elements of ba ##al and as ##tar ##te worship , it was essentially mono ##the ##istic .

reference_raw: Though it had elements of Baal and Astarte worship, it was essentially monotheistic.

reference_spacy_tokens: Though it had elements of Baal and Astarte worship , it was essentially monotheistic .


fn_spacy_tokens_for_baseline: He could visualize the sniggers of his subordinates .

source_bert_toks: he could visual ##ize the s ##nig ##gers of his subordinate ##s .

reference_raw: He could imagine the laughter of his subordinates.

reference_spacy_tokens: He could imagine the laughter of his subordinates .


fn_spacy_tokens_for_baseline: Crashing merrily on their heels came the newcomers , horseman after horseman , knights and squires and grooms , flashing the red and green mascles of the Earl of Kent 's livery .

source_bert_toks: crashing mer ##rily on their heels came the newcomers , horse ##man after horse ##man , knights and squire ##s and groom ##s , flashing the red and green mas ##cles of the earl of kent ' s livery .

reference_raw: The newcomers, rider after rider, knights, squires, and grooms, came crashing down on their heels, flashing the red and green mascles of the Earl of Kent's liver.

reference_spacy_tokens: The newcomers , rider after rider , knights , squires , and grooms , came crashing down on their heels , flashing the red and green mascles of the Earl of Kent 's liver .


fn_spacy_tokens_for_baseline: Lethal will probably be a top - notch producer in another album 's time -- Muggs already is .

source_bert_toks: lethal will probably be a top - notch producer in another album ' s time - - mug ##gs already is .

reference_raw: Lethal's probably going to be the first producer in the next album -- Muggs already is.

reference_spacy_tokens: Lethal 's probably going to be the first producer in the next album -- Muggs already is .


fn_spacy_tokens_for_baseline: Loads of people have complimented me , including one very important person . '

source_bert_toks: loads of people have complimented me , including one very important person . '

reference_raw: I've been flattered by a lot of people, including one very important person.'

reference_spacy_tokens: I 've been flattered by a lot of people , including one very important person . '


fn_spacy_tokens_for_baseline: The suit was settled in late 1991 , but Iran still retains ownership of Eurodif shares .

source_bert_toks: the suit was settled in late 1991 , but iran still retains ownership of euro ##di ##f shares .

reference_raw: The lawsuit was settled at the end of 1991, but Iran still holds shares in Eurodif.

reference_spacy_tokens: The lawsuit was settled at the end of 1991 , but Iran still holds shares in Eurodif .


fn_spacy_tokens_for_baseline: ' Get on ! ' said Teng , drawing the long club from his belt and jabbing the man viciously in the small of the back .

source_bert_toks: ' get on ! ' said ten ##g , drawing the long club from his belt and ja ##bbing the man vicious ##ly in the small of the back .

reference_raw: 'Come on!' said Teng, pulling a long club from his belt and stabbing the man viciously in the small back.

reference_spacy_tokens: ' Come on ! ' said Teng , pulling a long club from his belt and stabbing the man viciously in the small back .


fn_spacy_tokens_for_baseline: If it can be , and if by so doing , the patient would be able to enjoy a further period of life without increased discomfort , then the cure or palliative measure should be adopted .

source_bert_toks: if it can be , and if by so doing , the patient would be able to enjoy a further period of life without increased discomfort , then the cure or pal ##lia ##tive measure should be adopted .

reference_raw: If this is possible, and if this is the case, the patient will be able to enjoy another life without increasing discomfort, then treatment or palliatory measures should be taken.

reference_spacy_tokens: If this is possible , and if this is the case , the patient will be able to enjoy another life without increasing discomfort , then treatment or palliatory measures should be taken .


fn_spacy_tokens_for_baseline: It has to be pointed out , however , that we selected asymptomatic patients and thus total colonic transit times have still to be considered in the high normal range .

source_bert_toks: it has to be pointed out , however , that we selected as ##ym ##pt ##oma ##tic patients and thus total colon ##ic transit times have still to be considered in the high normal range .

reference_raw: However, it should be noted that we have selected asymptomatic patients, and therefore the overall colonic transit time has not yet been taken into account in the high normal range.

reference_spacy_tokens: However , it should be noted that we have selected asymptomatic patients , and therefore the overall colonic transit time has not yet been taken into account in the high normal range .


fn_spacy_tokens_for_baseline: We are all bombarded through the media about the nutritional adequacy of the food we eat .

source_bert_toks: we are all bomb ##arded through the media about the nutritional ad ##e ##qua ##cy of the food we eat .

reference_raw: We're all bombarded by the media about the nutritional suitability of the food we're eating.

reference_spacy_tokens: We 're all bombarded by the media about the nutritional suitability of the food we 're eating .


fn_spacy_tokens_for_baseline: These subsidiaries have since been sold leaving Sekers exclusively as manufacturers of quality furnishing fabrics , although today many high street retailers sell their cloth under the brand name of Stoddard Templeton .

source_bert_toks: these subsidiaries have since been sold leaving se ##kers exclusively as manufacturers of quality fur ##nish ##ing fabrics , although today many high street retailers sell their cloth under the brand name of st ##od ##dar ##d temple ##ton .

reference_raw: Since then, these subsidiaries have been sold from Sekers exclusively as manufacturers of high-quality furniture, although many high-street vendors now sell their fabric under the brand name Stoddard Templeton.

reference_spacy_tokens: Since then , these subsidiaries have been sold from Sekers exclusively as manufacturers of high - quality furniture , although many high - street vendors now sell their fabric under the brand name Stoddard Templeton .


fn_spacy_tokens_for_baseline: ' In other words , you do n't want me to behave in my usual bull - headed manner . '

source_bert_toks: ' in other words , you don ' t want me to behave in my usual bull - headed manner . '

reference_raw: "In other words, you don't want me to act like a bull."

reference_spacy_tokens: " In other words , you do n't want me to act like a bull . "


fn_spacy_tokens_for_baseline: While I did not attend the trial -- I was lucky to be able to read your highly amusing and informative dispatches , several of which made me spit up my lunch laughing -- it certainly seemed as if the image of Bill Gates took a beating and the insular culture of Microsoft did not look so good .

source_bert_toks: while i did not attend the trial - - i was lucky to be able to read your highly amusing and inform ##ative dispatch ##es , several of which made me spit up my lunch laughing - - it certainly seemed as if the image of bill gates took a beating and the ins ##ular culture of microsoft did not look so good .

reference_raw: Although I didn't attend the trial-I was fortunate enough to read your highly amusing and informative dispatches, some of which made me spit out my lunch laughter-it certainly seemed to me that Bill Gates had been beaten and Microsoft's insular culture didn't look so good.

reference_spacy_tokens: Although I did n't attend the trial - I was fortunate enough to read your highly amusing and informative dispatches , some of which made me spit out my lunch laughter - it certainly seemed to me that Bill Gates had been beaten and Microsoft 's insular culture did n't look so good .


fn_spacy_tokens_for_baseline: Then , as now , the norm was that young married couples should live in a residence separate from those of their families of origin , and the three - generational household was as rare then as it is now .

source_bert_toks: then , as now , the norm was that young married couples should live in a residence separate from those of their families of origin , and the three - generation ##al household was as rare then as it is now .

reference_raw: Then, as now, the rule was that young married couples should live in a place separate from their family of origin, and the three-generation household was as rare as it is now.

reference_spacy_tokens: Then , as now , the rule was that young married couples should live in a place separate from their family of origin , and the three - generation household was as rare as it is now .


fn_spacy_tokens_for_baseline: Gaggia machines burbled on marble bars , new secretaries clicked across polished floors , uniformed valets twirled glass doors .

source_bert_toks: gag ##gia machines bu ##rb ##led on marble bars , new secretaries clicked across polished floors , uniformed valet ##s t ##wi ##rled glass doors .

reference_raw: The gaggia machines bubbling on the marble bars, the new secretaries clattered across the polished floors, the uniformed butlers twitched the glass doors.

reference_spacy_tokens: The gaggia machines bubbling on the marble bars , the new secretaries clattered across the polished floors , the uniformed butlers twitched the glass doors .


fn_spacy_tokens_for_baseline: It 's an ideal way for the visitor to reach outlying sights and villages .

source_bert_toks: it ' s an ideal way for the visitor to reach outlying sights and villages .

reference_raw: It's the perfect way for visitors to reach distant sights and villages.

reference_spacy_tokens: It 's the perfect way for visitors to reach distant sights and villages .


fn_spacy_tokens_for_baseline: I did n't imagine Surkov 's misfortune would entirely spoil her amorous pleasure .

source_bert_toks: i didn ' t imagine sur ##kov ' s mis ##fort ##une would entirely spoil her amor ##ous pleasure .

reference_raw: I didn't think Surkov's unhappiness would completely spoil her lovely pleasure.

reference_spacy_tokens: I did n't think Surkov 's unhappiness would completely spoil her lovely pleasure .


fn_spacy_tokens_for_baseline: system and he gave to all his students so my daughter 's even talked to and i 've talked to several people from North Carolina i was just curious

source_bert_toks: system and he gave to all his students so my daughter ' s even talked to and i ' ve talked to several people from north carolina i was just curious

reference_raw: system, and he gave all his students, so my daughter even talked to me, and I talked to a few people in North Carolina, I was just wondering.

reference_spacy_tokens: system , and he gave all his students , so my daughter even talked to me , and I talked to a few people in North Carolina , I was just wondering .


fn_spacy_tokens_for_baseline: TWO alert cops made a drug bust -- and seized cannabis plants growing at the POLICE STATION .

source_bert_toks: two alert cops made a drug bust - - and seized cannabis plants growing at the police station .

reference_raw: TWO warning cops broke down - and confiscated cannabis plants growing in POLICE STATION.

reference_spacy_tokens: TWO warning cops broke down - and confiscated cannabis plants growing in POLICE STATION .


fn_spacy_tokens_for_baseline: AKU 's Biomedical Engineering Department offers graduate programs in three major specialties -- Bioelectrics , Biomaterials , and Biomechanics -- which incorporate traditional engineering programs to address problems associated with human physiology , treatment , and rehabilitation .

source_bert_toks: ak ##u ' s biomedical engineering department offers graduate programs in three major special ##ties - - bio ##ele ##ctric ##s , bio ##mate ##rial ##s , and bio ##me ##chan ##ics - - which incorporate traditional engineering programs to address problems associated with human physiology , treatment , and rehabilitation .

reference_raw: The Department of Biomedical Engineering of AKU offers graduate programs in three main specialties - bioelectrics, biomaterials, and biomechanicals - which include traditional engineering programs to address human physiology, treatment, and recovery problems.

reference_spacy_tokens: The Department of Biomedical Engineering of AKU offers graduate programs in three main specialties - bioelectrics , biomaterials , and biomechanicals - which include traditional engineering programs to address human physiology , treatment , and recovery problems .


fn_spacy_tokens_for_baseline: Then Buddie had slapped his thighs and bellowed with laughter as the biggest bin overturned and its slimy contents rushed towards Frankie in an oozing wave .

source_bert_toks: then bud ##die had slapped his thighs and bellowed with laughter as the biggest bin overturned and its slim ##y contents rushed towards frankie in an o ##oz ##ing wave .

reference_raw: Then Buddie patted his thighs and roared with laughter as the largest basket rolled over, its slimy contents rushing toward Frankie in an oozing wave.

reference_spacy_tokens: Then Buddie patted his thighs and roared with laughter as the largest basket rolled over , its slimy contents rushing toward Frankie in an oozing wave .


fn_spacy_tokens_for_baseline: She owned the packet of tea bags in the kitchen .

source_bert_toks: she owned the packet of tea bags in the kitchen .

reference_raw: She had a pack of tea bags in the kitchen.

reference_spacy_tokens: She had a pack of tea bags in the kitchen .


fn_spacy_tokens_for_baseline: Mrs Stych noted carefully all the ' day core ' , as she called it , while she removed her coat and gave it to Mrs Murphy to hang up .

source_bert_toks: mrs st ##ych noted carefully all the ' day core ' , as she called it , while she removed her coat and gave it to mrs murphy to hang up .

reference_raw: Mrs. Stych took a careful note of the day's core, as she called it, and took off her coat and handed it to Mrs. Murphy to hang up.

reference_spacy_tokens: Mrs. Stych took a careful note of the day 's core , as she called it , and took off her coat and handed it to Mrs. Murphy to hang up .


fn_spacy_tokens_for_baseline: No one at that time in Glasgow had ever seen anything like it outside a porn mag .

source_bert_toks: no one at that time in glasgow had ever seen anything like it outside a porn mag .

reference_raw: No one in Glasgow had ever seen anything like it outside a porn magazine.

reference_spacy_tokens: No one in Glasgow had ever seen anything like it outside a porn magazine .


fn_spacy_tokens_for_baseline: awake , listening : laughter of guest love - makers trying to be more quiet

reference_raw: awake, listening: the laughter of guest lovers trying to be calmer

reference_spacy_tokens: awake , listening : the laughter of guest lovers trying to be calmer


fn_spacy_tokens_for_baseline: It would be wise to desist from this activity forthwith .

source_bert_toks: it would be wise to des ##ist from this activity forth ##with .

reference_raw: It would be wise to withdraw from this activity immediately.

reference_spacy_tokens: It would be wise to withdraw from this activity immediately .


fn_spacy_tokens_for_baseline: Residents counterattacked and drove them back , Lameen said .

source_bert_toks: residents counterattack ##ed and drove them back , lame ##en said .

reference_raw: The residents attacked and drove them back, Lameen said.

reference_spacy_tokens: The residents attacked and drove them back , Lameen said .


fn_spacy_tokens_for_baseline: However , the end of the golden age was drawing near .

source_bert_toks: however , the end of the golden age was drawing near .

reference_raw: But the golden age was coming to a close.

reference_spacy_tokens: But the golden age was coming to a close .


fn_spacy_tokens_for_baseline: These discussions are often tedious and pedantic .

source_bert_toks: these discussions are often ted ##ious and pe ##dant ##ic .

reference_raw: These discussions are often boring and pedantic.

reference_spacy_tokens: These discussions are often boring and pedantic .


fn_spacy_tokens_for_baseline: Remind me to tell you some time about my Uncle Morton 's wife and his mistress both turning up to his funeral in the self - same dress .

source_bert_toks: remind me to tell you some time about my uncle morton ' s wife and his mistress both turning up to his funeral in the self - same dress .

reference_raw: Remind me to tell you a little bit about Uncle Morton's wife and his wife showing up at his funeral in the same clothes.

reference_spacy_tokens: Remind me to tell you a little bit about Uncle Morton 's wife and his wife showing up at his funeral in the same clothes .


fn_spacy_tokens_for_baseline: Now that can create problems between one person who 's elected and a person who is not elected .

source_bert_toks: now that can create problems between one person who ' s elected and a person who is not elected .

reference_raw: This could create a problem between the one person who's been chosen and the one who's not chosen.

reference_spacy_tokens: This could create a problem between the one person who 's been chosen and the one who 's not chosen .


fn_spacy_tokens_for_baseline: The first meal of the day should be substantial , otherwise you 're likely to feel hungry later .

source_bert_toks: the first meal of the day should be substantial , otherwise you ' re likely to feel hungry later .

reference_raw: The first meal of the day should be significant, or you'll probably be hungry later.

reference_spacy_tokens: The first meal of the day should be significant , or you 'll probably be hungry later .


fn_spacy_tokens_for_baseline: A letter to the Japanese ambassador in Washington , signed by all 100 members of the US Senate , had preceded what the US saw as Japan 's belated Aug. 5 commitment on sanctions .

source_bert_toks: a letter to the japanese ambassador in washington , signed by all 100 members of the us senate , had preceded what the us saw as japan ' s bela ##ted aug . 5 commitment on sanctions .

reference_raw: A letter to the Japanese ambassador in Washington, signed by all 100 members of the U.S. Senate, predated what the U.S. viewed as a delayed August 5 commitment to sanctions.

reference_spacy_tokens: A letter to the Japanese ambassador in Washington , signed by all 100 members of the U.S. Senate , predated what the U.S. viewed as a delayed August 5 commitment to sanctions .


fn_spacy_tokens_for_baseline: This approach , however , is open to charges of functionalism and presumes a conspiracy between judiciary and government .

source_bert_toks: this approach , however , is open to charges of functional ##ism and pre ##sume ##s a conspiracy between judiciary and government .

reference_raw: However, this approach is open to accusations of functionalism and presupposes a plot between the judiciary and the government.

reference_spacy_tokens: However , this approach is open to accusations of functionalism and presupposes a plot between the judiciary and the government .


fn_spacy_tokens_for_baseline: Her finger snagged on roughened bark , and she stared down at it , watching the bright droplets of blood trickle to the floor and settle among shards of broken glass .

source_bert_toks: her finger s ##na ##gged on rough ##ened bark , and she stared down at it , watching the bright droplets of blood trickle to the floor and settle among shards of broken glass .

reference_raw: She caught the rough bark with her finger and stared down at it, watching the bright droplets of blood trickle down to the floor and settle down among the splinters of broken glass.

reference_spacy_tokens: She caught the rough bark with her finger and stared down at it , watching the bright droplets of blood trickle down to the floor and settle down among the splinters of broken glass .


fn_spacy_tokens_for_baseline: But I have heard since that two other witnesses described a chap with dark hair . '

source_bert_toks: but i have heard since that two other witnesses described a cha ##p with dark hair . '

reference_raw: But I've heard since the other two witnesses described a man with dark hair.'

reference_spacy_tokens: But I 've heard since the other two witnesses described a man with dark hair . '


fn_spacy_tokens_for_baseline: ' For many farmers it spells financial disaster and few of the smaller ones have recovered .

source_bert_toks: ' for many farmers it spells financial disaster and few of the smaller ones have recovered .

reference_raw: For many farmers, it spells a financial catastrophe, and few of the smaller ones have recovered.

reference_spacy_tokens: For many farmers , it spells a financial catastrophe , and few of the smaller ones have recovered .


fn_spacy_tokens_for_baseline: The Conservatives had dominated Hampshire county politics for over a century .

source_bert_toks: the conservatives had dominated hampshire county politics for over a century .

reference_raw: For more than a century, the Conservatives have ruled the politics of Hampshire County.

reference_spacy_tokens: For more than a century , the Conservatives have ruled the politics of Hampshire County .


fn_spacy_tokens_for_baseline: I am waiting to hear back from Patti on May and June to make sure they are okay with her .

source_bert_toks: i am waiting to hear back from patti on may and june to make sure they are okay with her .

reference_raw: I'm waiting for Patti to call me back in May and June to make sure she doesn't mind.

reference_spacy_tokens: I 'm waiting for Patti to call me back in May and June to make sure she does n't mind .


fn_spacy_tokens_for_baseline: ' It was a complete fiasco , ' said his lawyer .

source_bert_toks: ' it was a complete fia ##sco , ' said his lawyer .

reference_raw: "It was a complete failure," the lawyer said.

reference_spacy_tokens: " It was a complete failure , " the lawyer said .


fn_spacy_tokens_for_baseline: Flatten the bread with a rolling - pin , then spread each slice thinly with mayonnaise .

source_bert_toks: flat ##ten the bread with a rolling - pin , then spread each slice thin ##ly with mayo ##nna ##ise .

reference_raw: Flat the bread with a rolling pin and spread each slice thinly with mayonnaise.

reference_spacy_tokens: Flat the bread with a rolling pin and spread each slice thinly with mayonnaise .


fn_spacy_tokens_for_baseline: Pyongyang said it was lifting the freeze to generate electricity to compensate for the loss of HFO supplies , and North Korean technicians were able to remove seals and disable monitoring cameras at nuclear facilities in Yo ( ngbyo ( n - kun within a matter of days .

source_bert_toks: p ##yon ##gy ##ang said it was lifting the freeze to generate electricity to compensate for the loss of h ##fo supplies , and north korean technicians were able to remove seals and di ##sable monitoring cameras at nuclear facilities in yo ( ng ##by ##o ( n - kun within a matter of days .

reference_raw: According to Pyongyang, the freeze was lifted to generate electricity to compensate for the loss of HFO supplies, and North Korean technicians were able to remove the seals and deactivate the surveillance cameras in the nuclear facilities in Yo (n-kun in a matter of days).

reference_spacy_tokens: According to Pyongyang , the freeze was lifted to generate electricity to compensate for the loss of HFO supplies , and North Korean technicians were able to remove the seals and deactivate the surveillance cameras in the nuclear facilities in Yo ( n - kun in a matter of days ) .


fn_spacy_tokens_for_baseline: Colin 's getting pretty flustered and red in the face .

source_bert_toks: colin ' s getting pretty flu ##stered and red in the face .

reference_raw: Colin's blushing and red on his face.

reference_spacy_tokens: Colin 's blushing and red on his face .


fn_spacy_tokens_for_baseline: As the army swung westwards by the forest below the Dwarf Hold of Everpeak it was joined by Forest Goblin tribes riding giant spiders and whooping their savage war cries .

source_bert_toks: as the army swung westward ##s by the forest below the dwarf hold of ever ##pe ##ak it was joined by forest goblin tribes riding giant spiders and who ##oping their savage war cries .

reference_raw: As the army swerved westward through the forest beneath the Dwarf Hold of Everpeak, the forest goblin tribes joined them, riding giant spiders and shouting wild war cries.

reference_spacy_tokens: As the army swerved westward through the forest beneath the Dwarf Hold of Everpeak , the forest goblin tribes joined them , riding giant spiders and shouting wild war cries .


fn_spacy_tokens_for_baseline: Wheeler clicked his tongue , as much in irritation that the conversation should continue so long without his leading it as in deprecation of the mention of police , and past history discreditable to the Church .

source_bert_toks: wheeler clicked his tongue , as much in irritation that the conversation should continue so long without his leading it as in de ##pre ##cation of the mention of police , and past history disc ##red ##ita ##ble to the church .

reference_raw: Wheeler clicked his tongue, so irritated that the conversation had to go on so long without leading it, as if he'd missed the mention of the police, and that past history had been discredited to the Church.

reference_spacy_tokens: Wheeler clicked his tongue , so irritated that the conversation had to go on so long without leading it , as if he 'd missed the mention of the police , and that past history had been discredited to the Church .


fn_spacy_tokens_for_baseline: Janet . came running in , flung her arms round Cookie and gave her a smacking kiss .

source_bert_toks: janet . came running in , flung her arms round cookie and gave her a smack ##ing kiss .

reference_raw: Janet ran in, threw her arms around Cookie, and kissed her.

reference_spacy_tokens: Janet ran in , threw her arms around Cookie , and kissed her .


fn_spacy_tokens_for_baseline: Mr Dubcek , 70 , whose reforms were crushed by the Soviets in 1968 , was being driven in a car which plunged into a ravine near Prague .

source_bert_toks: mr dub ##cek , 70 , whose reforms were crushed by the soviets in 1968 , was being driven in a car which plunged into a ravine near prague .

reference_raw: Mr. Dubcek, 70, whose reforms were crushed by the Soviets in 1968, was driven by a car that plunged into a chasm near Prague.

reference_spacy_tokens: Mr. Dubcek , 70 , whose reforms were crushed by the Soviets in 1968 , was driven by a car that plunged into a chasm near Prague .


fn_spacy_tokens_for_baseline: Her dialogue has a wonderfully polished lustre that recalls Wilde and Firbank .

source_bert_toks: her dialogue has a wonderful ##ly polished lust ##re that recalls wilde and fir ##bank .

reference_raw: There's a beautifully polished glow in her dialogue that remembers Wilde and Firbank.

reference_spacy_tokens: There 's a beautifully polished glow in her dialogue that remembers Wilde and Firbank .


fn_spacy_tokens_for_baseline: The government - controlled Working People 's Daily reported on Jan. 29 , 1990 , that police and Army units had seized illegal drugs worth US$ 14,000,000 in 1989 .

source_bert_toks: the government - controlled working people ' s daily reported on jan . 29 , 1990 , that police and army units had seized illegal drugs worth us $ 14 , 000 , 000 in 1989 .

reference_raw: On January 29, 1990, government-controlled working people reported that police and military units confiscated illegal drugs worth $14,000,000 in 1989.

reference_spacy_tokens: On January 29 , 1990 , government - controlled working people reported that police and military units confiscated illegal drugs worth $ 14,000,000 in 1989 .


fn_spacy_tokens_for_baseline: Those scavengers living their entire lives in those caverns underneath Kefalov were merely an extreme example of segmented vision -- their whole cosmos reduced to a few cubic kilometres of debris .

source_bert_toks: those sc ##ave ##nger ##s living their entire lives in those cavern ##s underneath ke ##fa ##lov were merely an extreme example of segment ##ed vision - - their whole cosmos reduced to a few cubic kilometres of debris .

reference_raw: The scavengers who lived their whole lives in the caves below Kefalov were only an extreme example of segmented vision-the entire universe reduced to a few cubic kilometers of debris.

reference_spacy_tokens: The scavengers who lived their whole lives in the caves below Kefalov were only an extreme example of segmented vision - the entire universe reduced to a few cubic kilometers of debris .


fn_spacy_tokens_for_baseline: It is Coward who is singled out for specific blame by Durgnat , his screenplay compared explicitly / dismissively to women 's romance fiction as if that , by itself , was a confirmation of worthlessness .

source_bert_toks: it is coward who is singled out for specific blame by du ##rg ##nat , his screenplay compared explicitly / dismiss ##ively to women ' s romance fiction as if that , by itself , was a confirmation of worthless ##ness .

reference_raw: It was Coward who had been chosen by Durgnat for specific fault, and his script compared expressly/dismissively with women's romantic fiction, as if it were in itself a confirmation of worthlessness.

reference_spacy_tokens: It was Coward who had been chosen by Durgnat for specific fault , and his script compared expressly / dismissively with women 's romantic fiction , as if it were in itself a confirmation of worthlessness .


fn_spacy_tokens_for_baseline: I kept expecting the teacher to praise her , but instead she suddenly cried out ,

source_bert_toks: i kept expecting the teacher to praise her , but instead she suddenly cried out ,

reference_raw: I was still waiting for the teacher to praise her, but instead she screamed,

reference_spacy_tokens: I was still waiting for the teacher to praise her , but instead she screamed ,


fn_spacy_tokens_for_baseline: In the USA some interesting research ( Zuravin and Watson , 1987 ) has been conducted into anonymous reports of child physical abuse , which indicated that reports made by anonymous sources were more likely to be unfounded than reports made by professionals and nonprofessionals .

source_bert_toks: in the usa some interesting research ( zur ##avi ##n and watson , 1987 ) has been conducted into anonymous reports of child physical abuse , which indicated that reports made by anonymous sources were more likely to be un ##founded than reports made by professionals and non ##pro ##fe ##ssion ##als .

reference_raw: Some interesting research has been carried out in the US (Zuravin and Watson, 1987) on anonymous reports of child physical violence, suggesting that reports from anonymous sources are more likely to be unsubstantiated than reports from professionals and non-professionals.

reference_spacy_tokens: Some interesting research has been carried out in the US ( Zuravin and Watson , 1987 ) on anonymous reports of child physical violence , suggesting that reports from anonymous sources are more likely to be unsubstantiated than reports from professionals and non - professionals .


fn_spacy_tokens_for_baseline: Most of the program has revolved around research and the production of isotopes for use in medical and agricultural applications .

source_bert_toks: most of the program has rev ##olved around research and the production of isotope ##s for use in medical and agricultural applications .

reference_raw: The main focus of the programme was research and production of isotopes for medical and agricultural uses.

reference_spacy_tokens: The main focus of the programme was research and production of isotopes for medical and agricultural uses .


fn_spacy_tokens_for_baseline: I always start with the eyes , because it gives the moisturiser a chance to sink in , and it also means I can wipe away any spills without reapplying foundation . '

source_bert_toks: i always start with the eyes , because it gives the moist ##uri ##ser a chance to sink in , and it also means i can wipe away any spill ##s without re ##app ##ly ##ing foundation . '

reference_raw: I always start with the eyes, because it gives the damper a chance to sink in, and it also means that I can wipe out all the spills without using the base again.'

reference_spacy_tokens: I always start with the eyes , because it gives the damper a chance to sink in , and it also means that I can wipe out all the spills without using the base again . '


fn_spacy_tokens_for_baseline: ' He does n't deserve to , ' Clift ranted .

source_bert_toks: ' he doesn ' t deserve to , ' cl ##if ##t ran ##ted .

reference_raw: 'They don't deserve it,' said Clift.

reference_spacy_tokens: ' They do n't deserve it , ' said Clift .


fn_spacy_tokens_for_baseline: " Nixon , though always suspicious of his political enemies , consistently underestimated their ruthlessness and willingness to sacrifice the national interest in the pursuit of their institutional vendetta . "

source_bert_toks: " nixon , though always suspicious of his political enemies , consistently under ##est ##imated their ruthless ##ness and willingness to sacrifice the national interest in the pursuit of their institutional ve ##nde ##tta . "

reference_raw: "Nixon, though he has always suspected his political enemies, has consistently underestimated his ruthlessness and willingness to sacrifice his national interest in pursuing his institutional revenge."

reference_spacy_tokens: " Nixon , though he has always suspected his political enemies , has consistently underestimated his ruthlessness and willingness to sacrifice his national interest in pursuing his institutional revenge . "


fn_spacy_tokens_for_baseline: Step out of the hotel and your senses will be bombarded by a range of sights , sounds , smells , tastes , and textures that let you know that you could only be in Jamaica .

source_bert_toks: step out of the hotel and your senses will be bomb ##arded by a range of sights , sounds , smells , tastes , and textures that let you know that you could only be in jamaica .

reference_raw: Get out of the hotel and your senses will be bombarded by a series of sights, sounds, smells, flavors, and textures that tell you that you can only be in Jamaica.

reference_spacy_tokens: Get out of the hotel and your senses will be bombarded by a series of sights , sounds , smells , flavors , and textures that tell you that you can only be in Jamaica .


fn_spacy_tokens_for_baseline: The producers approached the Psarias family to film family celebrations at the Olive Tree , scenes from Sunday celebrations in the Greek Orthodox Church , and cooking with some of the Greek women .

source_bert_toks: the producers approached the ps ##aria ##s family to film family celebrations at the olive tree , scenes from sunday celebrations in the greek orthodox church , and cooking with some of the greek women .

reference_raw: Producers approached the Psarias family to film family festivities on the olive tree, scenes from Sunday festivals in the Greek Orthodox Church, and to cook with some Greek women.

reference_spacy_tokens: Producers approached the Psarias family to film family festivities on the olive tree , scenes from Sunday festivals in the Greek Orthodox Church , and to cook with some Greek women .


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are all over the place, streets are buzzing, traffic is getting more and more congested, and at the frenetic speed of rush hour, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are all over the place , streets are buzzing , traffic is getting more and more congested , and at the frenetic speed of rush hour , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: Sebastian laughed and reached out to the ribbon on Meg 's ponytail .

source_bert_toks: sebastian laughed and reached out to the ribbon on meg ' s ponytail .

reference_raw: Sebastian laughed and reached for the ribbon on Meg's tail.

reference_spacy_tokens: Sebastian laughed and reached for the ribbon on Meg 's tail .


fn_spacy_tokens_for_baseline: " Like a Shadow " is pleasantly bouncy , and a fantastic guitar solo brings life to " Your Love Is Killing Me . "

source_bert_toks: " like a shadow " is pleasantly bo ##un ##cy , and a fantastic guitar solo brings life to " your love is killing me . "

reference_raw: "Shadow" is a pleasant leap, and a great guitar solo brings life to "Your love kills me."

reference_spacy_tokens: " Shadow " is a pleasant leap , and a great guitar solo brings life to " Your love kills me . "


fn_spacy_tokens_for_baseline: This makes , therefore , for the very tempting prediction that sign language perception should show a RHA , since it appears to be spatially organised .

source_bert_toks: this makes , therefore , for the very tempting prediction that sign language perception should show a r ##ha , since it appears to be spatial ##ly organised .

reference_raw: As a result, there is a very tempting prediction that the concept of sign language should show the RHA, as it appears to be spatially organised.

reference_spacy_tokens: As a result , there is a very tempting prediction that the concept of sign language should show the RHA , as it appears to be spatially organised .


fn_spacy_tokens_for_baseline: Colonel Munro ( Maurice Roevens ) claps Day - Lewis in irons for allegedly preaching sedition , the Brits surrender to the French and there is a horribly violent battle in which our stalwart bunch escape yet again .

source_bert_toks: colonel munro ( maurice roe ##ven ##s ) clap ##s day - lewis in iron ##s for allegedly preaching se ##dition , the brit ##s surrender to the french and there is a horribly violent battle in which our st ##al ##wart bunch escape yet again .

reference_raw: Colonel Munro (Maurice Roevens) claps Day-Lewis in irons for supposedly preaching sedition, the British give in to the French, and there's a terrible battle in which our stalwart group escapes again.

reference_spacy_tokens: Colonel Munro ( Maurice Roevens ) claps Day - Lewis in irons for supposedly preaching sedition , the British give in to the French , and there 's a terrible battle in which our stalwart group escapes again .


fn_spacy_tokens_for_baseline: ' All the sorts ' were included with hardy trees and shrubs able to thrive unsheltered in open air .

source_bert_toks: ' all the sorts ' were included with hardy trees and shrubs able to thrive un ##sh ##elt ##ered in open air .

reference_raw: "All sorts" were covered with hard trees and bushes capable of prospering unsheltered in the open air.

reference_spacy_tokens: " All sorts " were covered with hard trees and bushes capable of prospering unsheltered in the open air .


fn_spacy_tokens_for_baseline: But , though Jerome 's intemperate denigration of the married state met with little sympathy , Augustine did not manage to dispel the sombre cloud that continued to hover over sexual relations .

source_bert_toks: but , though jerome ' s int ##em ##per ##ate den ##ig ##ration of the married state met with little sympathy , augustine did not manage to di ##sp ##el the so ##mbre cloud that continued to hove ##r over sexual relations .

reference_raw: But although Jerome's impulsive denunciation of the marriage met with little sympathy, Augustine was unable to dispel the gloomy cloud that continued to float over sexual relationships.

reference_spacy_tokens: But although Jerome 's impulsive denunciation of the marriage met with little sympathy , Augustine was unable to dispel the gloomy cloud that continued to float over sexual relationships .


fn_spacy_tokens_for_baseline: THE first women Royal Marines recruits have waltzed through the elite corps ' gruelling military training .

source_bert_toks: the first women royal marines recruits have waltz ##ed through the elite corps ' gr ##uel ##ling military training .

reference_raw: The first women The recruits of the Royal Marines danced through the grueling military training of the elite corps.

reference_spacy_tokens: The first women The recruits of the Royal Marines danced through the grueling military training of the elite corps .


fn_spacy_tokens_for_baseline: Arafat allowed his men to join a leftist Lebanese assault on Damour , a pretty Christian coastal village of silk factories and olive groves that lay across the Sidon - Beirut highway .

source_bert_toks: ara ##fat allowed his men to join a leftist lebanese assault on dam ##our , a pretty christian coastal village of silk factories and olive groves that lay across the sid ##on - beirut highway .

reference_raw: Arafat allowed his men to join the left-hand Lebanese attack on Damour, a beautiful Christian coastal village of silk factories and olive groves across the Sidon-Beirut road.

reference_spacy_tokens: Arafat allowed his men to join the left - hand Lebanese attack on Damour , a beautiful Christian coastal village of silk factories and olive groves across the Sidon - Beirut road .


fn_spacy_tokens_for_baseline: This behaviour , observed by many owners when their pets have been chastised or corrected in some way , is usually referred to as a dignified sulk .

source_bert_toks: this behaviour , observed by many owners when their pets have been cha ##stis ##ed or corrected in some way , is usually referred to as a dig ##nified sul ##k .

reference_raw: This behavior, observed by many owners when their pets are punished or corrected in some way, is usually referred to as a dignified sulk.

reference_spacy_tokens: This behavior , observed by many owners when their pets are punished or corrected in some way , is usually referred to as a dignified sulk .


fn_spacy_tokens_for_baseline: Social Worker : Why is experiencing some pleasure in that situation blameworthy ?

source_bert_toks: social worker : why is experiencing some pleasure in that situation blame ##worthy ?

reference_raw: Social worker: Why is there any joy in this situation to be blamed for?

reference_spacy_tokens: Social worker : Why is there any joy in this situation to be blamed for ?


fn_spacy_tokens_for_baseline: The hens clambered in , cackling with delight and greed .

source_bert_toks: the hen ##s cl ##am ##bered in , ca ##ck ##ling with delight and greed .

reference_raw: The chickens clambered in, whimpering with pleasure and greed.

reference_spacy_tokens: The chickens clambered in , whimpering with pleasure and greed .


fn_spacy_tokens_for_baseline: Research has however shown that in terms of the arrangement of the protein molecules this model is no longer accurate .

source_bert_toks: research has however shown that in terms of the arrangement of the protein molecules this model is no longer accurate .

reference_raw: However, research has shown that this model is no longer precise with regard to the arrangement of protein molecules.

reference_spacy_tokens: However , research has shown that this model is no longer precise with regard to the arrangement of protein molecules .


fn_spacy_tokens_for_baseline: Australian World Cup tactics help set up May 2 showdown at Twickenham

source_bert_toks: australian world cup tactics help set up may 2 showdown at t ##wick ##enham

reference_raw: Australian World Cup tactics helps set up a show in Twickenham on May 2nd.

reference_spacy_tokens: Australian World Cup tactics helps set up a show in Twickenham on May 2nd .


fn_spacy_tokens_for_baseline: This is not significant for less than three tracks , as it is effectively the same as a sequential search for one or two tracks .

source_bert_toks: this is not significant for less than three tracks , as it is effectively the same as a sequential search for one or two tracks .

reference_raw: This is not important for less than three tracks, since it is in fact the same as a gradual search for one or two tracks.

reference_spacy_tokens: This is not important for less than three tracks , since it is in fact the same as a gradual search for one or two tracks .


fn_spacy_tokens_for_baseline: He arrived in Edinburgh that evening and was ferried by the organizer to his first reading at the university .

source_bert_toks: he arrived in edinburgh that evening and was fe ##rrie ##d by the organizer to his first reading at the university .

reference_raw: He arrived in Edinburgh that night, and the organizer took him to his first reading at the university.

reference_spacy_tokens: He arrived in Edinburgh that night , and the organizer took him to his first reading at the university .


fn_spacy_tokens_for_baseline: It has sown confusion and anxiety among researchers by giving birth to the ambiguous concept of sensitive but unclassified research .

source_bert_toks: it has so ##wn confusion and anxiety among researchers by giving birth to the ambiguous concept of sensitive but un ##class ##ified research .

reference_raw: By giving birth to an ambiguous concept of sensitive but non-classified research, it has created confusion and anxiety among researchers.

reference_spacy_tokens: By giving birth to an ambiguous concept of sensitive but non - classified research , it has created confusion and anxiety among researchers .


fn_spacy_tokens_for_baseline: To get here , follow the path from the southwest end of Discovery Bay ; the walk takes about 30 minutes .

source_bert_toks: to get here , follow the path from the southwest end of discovery bay ; the walk takes about 30 minutes .

reference_raw: If you want to get here, follow the trail from the southwest end of Discovery Bay; it takes about half an hour to walk.

reference_spacy_tokens: If you want to get here , follow the trail from the southwest end of Discovery Bay ; it takes about half an hour to walk .


fn_spacy_tokens_for_baseline: Margaret is delighted to be making this return trip on what she describes as a warm and friendly course .

source_bert_toks: margaret is delighted to be making this return trip on what she describes as a warm and friendly course .

reference_raw: Margaret is pleased to make this trip back on what she describes as a warm and friendly journey.

reference_spacy_tokens: Margaret is pleased to make this trip back on what she describes as a warm and friendly journey .


fn_spacy_tokens_for_baseline: It seemed to me at the time that this fact did not square with claims that the Bible was inerrant .

source_bert_toks: it seemed to me at the time that this fact did not square with claims that the bible was in ##er ##rant .

reference_raw: At the time, it seemed to me that this fact didn't compare with the assertion that the Bible was inert.

reference_spacy_tokens: At the time , it seemed to me that this fact did n't compare with the assertion that the Bible was inert .


fn_spacy_tokens_for_baseline: Rinse off and moisturise .

source_bert_toks: ri ##nse off and moist ##uri ##se .

reference_raw: Rinse and wet.

reference_spacy_tokens: Rinse and wet .


fn_spacy_tokens_for_baseline: If he was all on the same scale as his foot he must certainly have been a giant . '

source_bert_toks: if he was all on the same scale as his foot he must certainly have been a giant . '

reference_raw: If he was on the same scale as his leg, he must have been a giant.'

reference_spacy_tokens: If he was on the same scale as his leg , he must have been a giant . '


fn_spacy_tokens_for_baseline: On the Neapolitan Riviera , you may spend a week in Sorrento visiting the famous sights of Pompeii , Herculaneum and Vesuvius , then spend a week relaxing on the captivating island of Capri .

source_bert_toks: on the ne ##ap ##oli ##tan ri ##vier ##a , you may spend a week in so ##rre ##nto visiting the famous sights of po ##mp ##ei ##i , her ##cula ##ne ##um and ve ##su ##vius , then spend a week relaxing on the capt ##ivating island of cap ##ri .

reference_raw: On the Neapolitan Riviera, you can spend a week in Sorrento to visit the famous sights of Pompei, Herculaneum and Vesuvius, and then spend a week resting on Capri's captive island.

reference_spacy_tokens: On the Neapolitan Riviera , you can spend a week in Sorrento to visit the famous sights of Pompei , Herculaneum and Vesuvius , and then spend a week resting on Capri 's captive island .


fn_spacy_tokens_for_baseline: He cocked an eye speculatively over the rim .

source_bert_toks: he cocked an eye speculative ##ly over the rim .

reference_raw: He looked thoughtfully at the edge.

reference_spacy_tokens: He looked thoughtfully at the edge .


fn_spacy_tokens_for_baseline: Flights are not permitted into Iraq .

source_bert_toks: flights are not permitted into iraq .

reference_raw: Flights to Iraq are not allowed.

reference_spacy_tokens: Flights to Iraq are not allowed .


fn_spacy_tokens_for_baseline: The six - part drama , adapted from Georges Simenon 's novels , is set in 1950s ' Paris , but was shot in Budapest .

source_bert_toks: the six - part drama , adapted from georges sim ##eno ##n ' s novels , is set in 1950s ' paris , but was shot in budapest .

reference_raw: The six-part theater, adapted to Georges Simenon's novels, was set in Paris in the 1950s, but was shot in Budapest.

reference_spacy_tokens: The six - part theater , adapted to Georges Simenon 's novels , was set in Paris in the 1950s , but was shot in Budapest .


fn_spacy_tokens_for_baseline: ' We use it a lot , ' the girl said , showing her into the room .

source_bert_toks: ' we use it a lot , ' the girl said , showing her into the room .

reference_raw: "We use it a lot," she said, and led her into the room.

reference_spacy_tokens: " We use it a lot , " she said , and led her into the room .


fn_spacy_tokens_for_baseline: In the room which focuses on sight , visitors see , hear and feel themselves being poured out of a can of draught Guinness , into a glass , down a mouth and through the human body .

source_bert_toks: in the room which focuses on sight , visitors see , hear and feel themselves being poured out of a can of draught guinness , into a glass , down a mouth and through the human body .

reference_raw: In a room that concentrates on sight, visitors see, hear and feel themselves being poured from a tin of guinness, into a glass, through a mouth, through a human body.

reference_spacy_tokens: In a room that concentrates on sight , visitors see , hear and feel themselves being poured from a tin of guinness , into a glass , through a mouth , through a human body .


fn_spacy_tokens_for_baseline: I have to preserve the secrecy of work in AL - QAEDA , so God is my witness .

source_bert_toks: i have to preserve the secrecy of work in al - qaeda , so god is my witness .

reference_raw: I must keep a secret from work at Al-Qaeda, so God is my witness.

reference_spacy_tokens: I must keep a secret from work at Al - Qaeda , so God is my witness .


fn_spacy_tokens_for_baseline: A spokesman for Hampshire police said : ' It seems Mrs Soper died and then her husband passed away a short time later .

source_bert_toks: a spokesman for hampshire police said : ' it seems mrs so ##per died and then her husband passed away a short time later .

reference_raw: The Hampshire Police spokesman said, "It seems that Mrs. Soper died and that her husband died soon after.

reference_spacy_tokens: The Hampshire Police spokesman said , " It seems that Mrs. Soper died and that her husband died soon after .


fn_spacy_tokens_for_baseline: Full of hope , I took the watch in to a smart business in the Rue du Rhone , where it was examined by a stately manager .

source_bert_toks: full of hope , i took the watch in to a smart business in the rue du rhone , where it was examined by a state ##ly manager .

reference_raw: With all my hopes, I took the watch to a smart shop in the Rue du Rhone, where it was examined by a majestic executive.

reference_spacy_tokens: With all my hopes , I took the watch to a smart shop in the Rue du Rhone , where it was examined by a majestic executive .


fn_spacy_tokens_for_baseline: They lay there together for several minutes gasping and perspiring .

source_bert_toks: they lay there together for several minutes gasping and per ##sp ##iring .

reference_raw: They lay together for several minutes, gasping and sweating.

reference_spacy_tokens: They lay together for several minutes , gasping and sweating .


fn_spacy_tokens_for_baseline: Apply cream blusher in a soft terracotta shade , or powder first , then apply a powder blusher in glowing earthy tone .

source_bert_toks: apply cream blush ##er in a soft terra ##cott ##a shade , or powder first , then apply a powder blush ##er in glowing earth ##y tone .

reference_raw: Use the cream redder in a soft terracotta shade, or the powder first, and then use the powder redder in a shining earthy tone.

reference_spacy_tokens: Use the cream redder in a soft terracotta shade , or the powder first , and then use the powder redder in a shining earthy tone .


fn_spacy_tokens_for_baseline: ' He could n't cure a side of bacon , ' muttered Jackie .

source_bert_toks: ' he couldn ' t cure a side of bacon , ' muttered jackie .

reference_raw: 'He couldn't heal any bacon,' Jackie murmured.

reference_spacy_tokens: ' He could n't heal any bacon , ' Jackie murmured .


fn_spacy_tokens_for_baseline: Her thirst sharpened even more .

source_bert_toks: her thirst sharpened even more .

reference_raw: She grew even more thirsty.

reference_spacy_tokens: She grew even more thirsty .


fn_spacy_tokens_for_baseline: The knife flashed in the spotlight , glinting viciously before the razor - sharp blade was drawn across his throat .

source_bert_toks: the knife flashed in the spotlight , glint ##ing vicious ##ly before the razor - sharp blade was drawn across his throat .

reference_raw: The knife flickered in the spotlight, gleaming viciously before the razor-sharp blade was pulled across his neck.

reference_spacy_tokens: The knife flickered in the spotlight , gleaming viciously before the razor - sharp blade was pulled across his neck .


fn_spacy_tokens_for_baseline: Neither has his brood cycle been deactivated , like yours or mine , or any other serving soldier 's . '

source_bert_toks: neither has his brood cycle been dea ##ct ##ivated , like yours or mine , or any other serving soldier ' s . '

reference_raw: Not even his brood cycle has been disabled, like yours, mine, or any other serving soldier's.'

reference_spacy_tokens: Not even his brood cycle has been disabled , like yours , mine , or any other serving soldier 's . '


fn_spacy_tokens_for_baseline: To speak as I have of meteorite ' concentrations ' may conjure the wrong image .

source_bert_toks: to speak as i have of meteor ##ite ' concentrations ' may con ##jure the wrong image .

reference_raw: Talking like I do about "concentrations" meteorite can create a bad image.

reference_spacy_tokens: Talking like I do about " concentrations " meteorite can create a bad image .


fn_spacy_tokens_for_baseline: All use their elongated snout as a taste organ .

source_bert_toks: all use their elongated snout as a taste organ .

reference_raw: They all use their long noses as taste organs.

reference_spacy_tokens: They all use their long noses as taste organs .


fn_spacy_tokens_for_baseline: Annabelle Irwin , a retired Iowa State English professor who drew on her experience as a high school teacher in collaborating on an acclaimed series of books for young teen - agers , died Sept. 13 at a daughter 's home in Des Moines , Iowa .

source_bert_toks: annabelle irwin , a retired iowa state english professor who drew on her experience as a high school teacher in collaborating on an acclaimed series of books for young teen - age ##rs , died sept . 13 at a daughter ' s home in des moines , iowa .

reference_raw: Annabelle Irwin, a retired professor of Iowa State England, who drew on her experience as a high-school teacher in working with an acclaimed series of young children's books, died September 13 at her daughter's house in Des Moines, Iowa.

reference_spacy_tokens: Annabelle Irwin , a retired professor of Iowa State England , who drew on her experience as a high - school teacher in working with an acclaimed series of young children 's books , died September 13 at her daughter 's house in Des Moines , Iowa .


fn_spacy_tokens_for_baseline: ASLACTON , England -- Of all scenes that evoke rural England , this is one of the loveliest : An ancient stone church stands amid the fields , the sound of bells cascading from its tower , calling the faithful to evensong .

source_bert_toks: as ##la ##cton , england - - of all scenes that ev ##oke rural england , this is one of the love ##liest : an ancient stone church stands amid the fields , the sound of bells cas ##ca ##ding from its tower , calling the faithful to even ##son ##g .

reference_raw: ASLACTON, England - Of all the scenes that evoke rural England, this is one of the most beautiful: the ancient stone church stands in the middle of the fields, the sound of bells cascading from its turret and calling the faithful to Evensong.

reference_spacy_tokens: ASLACTON , England - Of all the scenes that evoke rural England , this is one of the most beautiful : the ancient stone church stands in the middle of the fields , the sound of bells cascading from its turret and calling the faithful to Evensong .


fn_spacy_tokens_for_baseline: In stark contrast , industry seems almost eager to put all its cards on the table .

source_bert_toks: in stark contrast , industry seems almost eager to put all its cards on the table .

reference_raw: On the other hand, the industry seems almost anxious to put all its cards on the table.

reference_spacy_tokens: On the other hand , the industry seems almost anxious to put all its cards on the table .


fn_spacy_tokens_for_baseline: In the prototype , the battery was housed by folding the tie lining around it , and fastening with a staple .

source_bert_toks: in the prototype , the battery was housed by folding the tie lining around it , and fast ##ening with a staple .

reference_raw: In the prototype, the battery was housed by folding a tie lining around it and fastening it with a fastener.

reference_spacy_tokens: In the prototype , the battery was housed by folding a tie lining around it and fastening it with a fastener .


fn_spacy_tokens_for_baseline: We wondered if the musicians and bare - breasted dancers amongst the tomb paintings brought them comfort or torment .

source_bert_toks: we wondered if the musicians and bare - breast ##ed dancers amongst the tomb paintings brought them comfort or torment .

reference_raw: We wondered if the musicians and the bare-breasted dancers among the grave paintings had brought them comfort or torture.

reference_spacy_tokens: We wondered if the musicians and the bare - breasted dancers among the grave paintings had brought them comfort or torture .


fn_spacy_tokens_for_baseline: The crowd was disappointed but knew that cancellation was inevitable .

source_bert_toks: the crowd was disappointed but knew that cancellation was inevitable .

reference_raw: The crowd was dissatisfied, but it knew that cancellation was inevitable.

reference_spacy_tokens: The crowd was dissatisfied , but it knew that cancellation was inevitable .


fn_spacy_tokens_for_baseline: Which is why you can pass through two town gates within a minute .

source_bert_toks: which is why you can pass through two town gates within a minute .

reference_raw: That's why you can get through two city gates in a minute.

reference_spacy_tokens: That 's why you can get through two city gates in a minute .


fn_spacy_tokens_for_baseline: So there , while you think of Case , you also think of Pittman and Leonsis and increasingly a range of other executives .

source_bert_toks: so there , while you think of case , you also think of pitt ##man and leon ##sis and increasingly a range of other executives .

reference_raw: So here, when you're thinking about Case, you're thinking about Pittman and Leonsis and more and more of the other executives.

reference_spacy_tokens: So here , when you 're thinking about Case , you 're thinking about Pittman and Leonsis and more and more of the other executives .


fn_spacy_tokens_for_baseline: CRYSTAL Palace unveil their new strike force today when Paul Williams and Chris Armstrong team up against Oldham at Selhurst Park .

source_bert_toks: crystal palace un ##ve ##il their new strike force today when paul williams and chris armstrong team up against oldham at se ##l ##hurst park .

reference_raw: Today, when Paul Williams and Chris Armstrong fight against Oldham in Selhurst Park, Crystal Palace unveils a new strike force.

reference_spacy_tokens: Today , when Paul Williams and Chris Armstrong fight against Oldham in Selhurst Park , Crystal Palace unveils a new strike force .


fn_spacy_tokens_for_baseline: She arched her eyebrows .

source_bert_toks: she arched her eyebrows .

reference_raw: She raised an eyebrow.

reference_spacy_tokens: She raised an eyebrow .


fn_spacy_tokens_for_baseline: Fitzsimmons broke Jeffries nose , cut both cheeks to the bone , but Jeffries landed a right to the stomach and a left hook to the jaw and ' Fitz ' was counted out .

source_bert_toks: fitz ##si ##mmon ##s broke jeff ##ries nose , cut both cheeks to the bone , but jeff ##ries landed a right to the stomach and a left hook to the jaw and ' fitz ' was counted out .

reference_raw: Fitzsimmons smashed Jeffries' nose and cut both cheeks to the bone, but Jeffries landed right on his stomach and left hook on his jaw and counted "Fitz."

reference_spacy_tokens: Fitzsimmons smashed Jeffries ' nose and cut both cheeks to the bone , but Jeffries landed right on his stomach and left hook on his jaw and counted " Fitz . "


fn_spacy_tokens_for_baseline: He stressed that none of the secret information about health issues or spending plans were kept in the safe .

source_bert_toks: he stressed that none of the secret information about health issues or spending plans were kept in the safe .

reference_raw: He pointed out that no secret information about health problems or spending plans was kept in the vault.

reference_spacy_tokens: He pointed out that no secret information about health problems or spending plans was kept in the vault .


fn_spacy_tokens_for_baseline: Milton Keynes Borough Council say they will save £ 400,000 a year by switching to a fortnightly collection of rubbish .

source_bert_toks: milton keynes borough council say they will save £ ##400 , 000 a year by switching to a fort ##night ##ly collection of rubbish .

reference_raw: Milton Keynes Borough Council says that it saves 400,000 pounds a year by switching to a two-week collection of garbage.

reference_spacy_tokens: Milton Keynes Borough Council says that it saves 400,000 pounds a year by switching to a two - week collection of garbage .


fn_spacy_tokens_for_baseline: Stir together the flour , ground cinnamon , grated suet , flaked almonds and orange zest .

source_bert_toks: stir together the flour , ground cinnamon , gr ##ated sue ##t , fl ##ake ##d almond ##s and orange ze ##st .

reference_raw: Mix flour, ground cinnamon, grated suet, flaked tonsils and orange zest.

reference_spacy_tokens: Mix flour , ground cinnamon , grated suet , flaked tonsils and orange zest .


fn_spacy_tokens_for_baseline: One rectangular building straddled the compound fence with an annexe attached on the inside from which there did not appear to be access to the compound .

source_bert_toks: one rectangular building st ##rad ##dled the compound fence with an annex ##e attached on the inside from which there did not appear to be access to the compound .

reference_raw: One rectangular building had a compound fence with an appendix attached to its interior, from which it seemed that it could not be accessed.

reference_spacy_tokens: One rectangular building had a compound fence with an appendix attached to its interior , from which it seemed that it could not be accessed .


fn_spacy_tokens_for_baseline: 1 Think about the subject and jot down ideas and facts as they occur to you .

source_bert_toks: 1 think about the subject and jo ##t down ideas and facts as they occur to you .

reference_raw: 1 Think of the subject and write out ideas and facts when you think of them.

reference_spacy_tokens: 1 Think of the subject and write out ideas and facts when you think of them .


fn_spacy_tokens_for_baseline: Mr Koll reckons it will climb from $ 14 billion in 1992 to $ 18 billion this year , an all - time high .

source_bert_toks: mr ko ##ll reckon ##s it will climb from $ 14 billion in 1992 to $ 18 billion this year , an all - time high .

reference_raw: Mr. Koll reckons it's going to rise from $14 billion in 1992 to $18 billion this year, which is an all-time high.

reference_spacy_tokens: Mr. Koll reckons it 's going to rise from $ 14 billion in 1992 to $ 18 billion this year , which is an all - time high .


fn_spacy_tokens_for_baseline: Many will use a common editorial .

source_bert_toks: many will use a common editorial .

reference_raw: A lot of them use a common editorial.

reference_spacy_tokens: A lot of them use a common editorial .


fn_spacy_tokens_for_baseline: Otherwise she felt certain he 'd dismiss the whole embarrassing situation with a careless sneer .

source_bert_toks: otherwise she felt certain he ' d dismiss the whole embarrassing situation with a careless s ##neer .

reference_raw: Otherwise, she was sure she would dismiss the awkward situation with a careless grin.

reference_spacy_tokens: Otherwise , she was sure she would dismiss the awkward situation with a careless grin .


fn_spacy_tokens_for_baseline: He has dwelt with them , but the one whom he promises as another Paraclete will dwell in them ( John 14:17 ) .

source_bert_toks: he has d ##we ##lt with them , but the one whom he promises as another para ##cle ##te will dwell in them ( john 14 : 17 ) .

reference_raw: He lives with them, but the one he promises as the next paraclet will live with them (John 14:17).

reference_spacy_tokens: He lives with them , but the one he promises as the next paraclet will live with them ( John 14:17 ) .


fn_spacy_tokens_for_baseline: A first planeload of ANC exiles returned home from Zambia on March 7 , and a further 550 were expected during the ensuing weeks .

source_bert_toks: a first plane ##load of an ##c exiles returned home from zambia on march 7 , and a further 550 were expected during the ensuing weeks .

reference_raw: On March 7th, the first shipment of ANC exiles returned home from Zambia and another 550 was expected in the following weeks.

reference_spacy_tokens: On March 7th , the first shipment of ANC exiles returned home from Zambia and another 550 was expected in the following weeks .


fn_spacy_tokens_for_baseline: If somebody can be persuaded to say something which is critical of Darwin he can get his name in the papers or on the box .

source_bert_toks: if somebody can be persuaded to say something which is critical of darwin he can get his name in the papers or on the box .

reference_raw: If you can convince someone to say something that's critical of Darwin, you can get your name on the paper or on the box.

reference_spacy_tokens: If you can convince someone to say something that 's critical of Darwin , you can get your name on the paper or on the box .


fn_spacy_tokens_for_baseline: He drew on socks , a tight pair of Italian jeans , and plimsolls , combed his receding hair before a mirror .

source_bert_toks: he drew on socks , a tight pair of italian jeans , and pl ##im ##sol ##ls , comb ##ed his rec ##eding hair before a mirror .

reference_raw: He pulled on his socks and tight Italian jeans and plimsolls and brushed his receding hair in front of the mirror.

reference_spacy_tokens: He pulled on his socks and tight Italian jeans and plimsolls and brushed his receding hair in front of the mirror .