fn_spacy_tokens_for_baseline: Having decided that he wanted to make a career in physics he enrolled at Vanderbilt University in Nashville Tennessee to study for his doctorate in experimental high energy particle physics .

source_bert_toks: having decided that he wanted to make a career in physics he enrolled at vanderbilt university in nashville tennessee to study for his doctorate in experimental high energy particle physics .

reference_raw: When he decided to pursue his career in physics, he signed up at the University of Vanderbilt in Nashville Tennessee to study for a PhD in experimental high-energy particle physics.

reference_spacy_tokens: When he decided to pursue his career in physics , he signed up at the University of Vanderbilt in Nashville Tennessee to study for a PhD in experimental high - energy particle physics .


fn_spacy_tokens_for_baseline: QN : Did John pass through the Rome airport customs ?

source_bert_toks: q ##n : did john pass through the rome airport customs ?

reference_raw: QN: Did John go through the customs of Rome Airport?

reference_spacy_tokens: QN : Did John go through the customs of Rome Airport ?


fn_spacy_tokens_for_baseline: New construction is everywhere , the streets buzz , traffic is increasingly congested , and in the frenetic pace of rush hour everyone in Dublin seems intent on changing places with everyone else .

source_bert_toks: new construction is everywhere , the streets buzz , traffic is increasingly cong ##ested , and in the fr ##ene ##tic pace of rush hour everyone in dublin seems intent on changing places with everyone else .

reference_raw: New buildings are everywhere, streets are buzzing, traffic is getting more and more crowded, and at the frantic speed of rush hour, everyone in Dublin seems to want to change places with everyone else.

reference_spacy_tokens: New buildings are everywhere , streets are buzzing , traffic is getting more and more crowded , and at the frantic speed of rush hour , everyone in Dublin seems to want to change places with everyone else .


fn_spacy_tokens_for_baseline: There was no happy return to the Hippy days when they teamed up for the Sixties hit I Got You Babe .

source_bert_toks: there was no happy return to the hip ##py days when they teamed up for the sixties hit i got you babe .

reference_raw: There wasn't a happy return to the hippie days when they joined up for the '60s I Got You Babe.

reference_spacy_tokens: There was n't a happy return to the hippie days when they joined up for the ' 60s I Got You Babe .


fn_spacy_tokens_for_baseline: She arched her back , tried to stretch her neck above assorted flesh and hair and smell .

source_bert_toks: she arched her back , tried to stretch her neck above ass ##orted flesh and hair and smell .

reference_raw: She bent her back, trying to stretch her neck over the tangled flesh and hair and the scent.

reference_spacy_tokens: She bent her back , trying to stretch her neck over the tangled flesh and hair and the scent .


fn_spacy_tokens_for_baseline: ' Now , boy , ' he said , ' take me to the captain or I 'll break your arm ! '

source_bert_toks: ' now , boy , ' he said , ' take me to the captain or i ' ll break your arm ! '

reference_raw: 'Now, lad,' he said, 'take me to the captain, or I'll smash your arm!'

reference_spacy_tokens: ' Now , lad , ' he said , ' take me to the captain , or I 'll smash your arm ! '


fn_spacy_tokens_for_baseline: It has made physically handicapped people keen to stress that they are not mentally handicapped , not stupid .

source_bert_toks: it has made physically handicapped people keen to stress that they are not mentally handicapped , not stupid .

reference_raw: Physically disabled people are eager to point out that they're not mentally handicapped or stupid.

reference_spacy_tokens: Physically disabled people are eager to point out that they 're not mentally handicapped or stupid .


fn_spacy_tokens_for_baseline: Pigeons found sheltered ledges , dogs that were normally unconcerned snarled as their owners tugged them on leashes .

source_bert_toks: pigeons found sheltered ledge ##s , dogs that were normally un ##con ##cer ##ned snarled as their owners tugged them on leash ##es .

reference_raw: The pigeons found sheltered ledges, and the dogs, which were usually unconcerned, growled as their owners pulled them on leashes.

reference_spacy_tokens: The pigeons found sheltered ledges , and the dogs , which were usually unconcerned , growled as their owners pulled them on leashes .


fn_spacy_tokens_for_baseline: And there were other things ; saliva drooled from her lips and every few seconds she gave a retching cough .

source_bert_toks: and there were other things ; saliva dr ##ool ##ed from her lips and every few seconds she gave a re ##tch ##ing cough .

reference_raw: And there were other things: saliva drooled out of her mouth, and every few seconds she cleared her throat.

reference_spacy_tokens: And there were other things : saliva drooled out of her mouth , and every few seconds she cleared her throat .


fn_spacy_tokens_for_baseline: She was later to become the council 's vice - chairman .

source_bert_toks: she was later to become the council ' s vice - chairman .

reference_raw: Later she became Vice-President of the Council.

reference_spacy_tokens: Later she became Vice - President of the Council .


fn_spacy_tokens_for_baseline: ' But the pharmacist mocked the claim .

source_bert_toks: ' but the ph ##arm ##ac ##ist mocked the claim .

reference_raw: 'But the pharmacist laughed at the claim.

reference_spacy_tokens: ' But the pharmacist laughed at the claim .


fn_spacy_tokens_for_baseline: Paul Davies , 19 , admitted manslaughter at the Old Bailey in February .

source_bert_toks: paul davies , 19 , admitted mans ##lau ##ght ##er at the old bailey in february .

reference_raw: Paul Davies, 19, admitted murder at the Old Bailey in February.

reference_spacy_tokens: Paul Davies , 19 , admitted murder at the Old Bailey in February .


fn_spacy_tokens_for_baseline: But then at Vladimir , Holly had been segregated from the mass of the zeks , the convicts who formed the greatest part of the prison population .

source_bert_toks: but then at vladimir , holly had been segregated from the mass of the ze ##ks , the convicts who formed the greatest part of the prison population .

reference_raw: But then, in Vladimir, Holly was separated from the mass of Zeks, the convicts who made up most of the prison population.

reference_spacy_tokens: But then , in Vladimir , Holly was separated from the mass of Zeks , the convicts who made up most of the prison population .


fn_spacy_tokens_for_baseline: There were rumors in 2003 of Burmese plans to purchase ballistic missiles from North Korea , but it is unclear whether any transactions have been completed .

source_bert_toks: there were rumors in 2003 of burmese plans to purchase ballistic missiles from north korea , but it is unclear whether any transactions have been completed .

reference_raw: There were rumors in 2003 that Burmese was planning to buy ballistic missiles from North Korea, but it is not clear if the operations had been completed.

reference_spacy_tokens: There were rumors in 2003 that Burmese was planning to buy ballistic missiles from North Korea , but it is not clear if the operations had been completed .


fn_spacy_tokens_for_baseline: The welcome he received on the factory tour obviously boded well for the by - election as ten days later both candidates were elected .

source_bert_toks: the welcome he received on the factory tour obviously bo ##ded well for the by - election as ten days later both candidates were elected .

reference_raw: The welcome he had received on the factory trip seemed to be a good one for the by-election, since the two candidates had been elected ten days later.

reference_spacy_tokens: The welcome he had received on the factory trip seemed to be a good one for the by - election , since the two candidates had been elected ten days later .


fn_spacy_tokens_for_baseline: The tiff between John and Edward still made itself felt .

source_bert_toks: the ti ##ff between john and edward still made itself felt .

reference_raw: The tension between John and Edward was still making itself feel.

reference_spacy_tokens: The tension between John and Edward was still making itself feel .


fn_spacy_tokens_for_baseline: By 1989 the church was meeting in fortnightly celebrations in Raynes Park High School and at the time of writing the church has grown to a membership of 300 .

source_bert_toks: by 1989 the church was meeting in fort ##night ##ly celebrations in ray ##nes park high school and at the time of writing the church has grown to a membership of 300 .

reference_raw: In 1989, the church met at Raynes Park High School for two weeks, and at the time of writing, the church became a member of 300.

reference_spacy_tokens: In 1989 , the church met at Raynes Park High School for two weeks , and at the time of writing , the church became a member of 300 .


fn_spacy_tokens_for_baseline: Now I straddled this heavy machine and revved with jerked gauntlet .

source_bert_toks: now i st ##rad ##dled this heavy machine and rev ##ved with jerked gaunt ##let .

reference_raw: Now I was striding this heavy machine and revolving with a jerked glove.

reference_spacy_tokens: Now I was striding this heavy machine and revolving with a jerked glove .


fn_spacy_tokens_for_baseline: To be a philosopher all you got to do is jot down any old garbage that comes into your head and next thing you know they 're handing you out a Nobel Prize or a Companion of Honour .

source_bert_toks: to be a philosopher all you got to do is jo ##t down any old garbage that comes into your head and next thing you know they ' re handing you out a nobel prize or a companion of honour .

reference_raw: To be a philosopher, all you have to do is put the old trash in your head, and the next thing you know, they're giving you the Nobel Prize or the Honor Companion.

reference_spacy_tokens: To be a philosopher , all you have to do is put the old trash in your head , and the next thing you know , they 're giving you the Nobel Prize or the Honor Companion .


fn_spacy_tokens_for_baseline: Analysts predict the agency 's share price will now climb above £ 2 m .

source_bert_toks: analysts predict the agency ' s share price will now climb above £2 ##m .

reference_raw: Analysts predict that the agency's share price will now rise above £2 million.

reference_spacy_tokens: Analysts predict that the agency 's share price will now rise above £ 2 million .


fn_spacy_tokens_for_baseline: Disk compressors tend to tell a few fibs when assessing how much hard disk space you 've got , hence the spurious figures

source_bert_toks: disk compressor ##s tend to tell a few fi ##bs when assessing how much hard disk space you ' ve got , hence the spur ##ious figures

reference_raw: When assessing how much hard disk space you have, disk compressors tend to say a few threads,

reference_spacy_tokens: When assessing how much hard disk space you have , disk compressors tend to say a few threads ,


fn_spacy_tokens_for_baseline: A legitimate businessman , Hughes was nonetheless eccentric and dramatic , a style suited to the Las Vegas ethos .

source_bert_toks: a legitimate businessman , hughes was nonetheless eccentric and dramatic , a style suited to the las vegas et ##hos .

reference_raw: Hughes was a legitimate businessman, however, eccentric and dramatic, a style suitable for Las Vegas ethos.

reference_spacy_tokens: Hughes was a legitimate businessman , however , eccentric and dramatic , a style suitable for Las Vegas ethos .


fn_spacy_tokens_for_baseline: I watched them leave , paying particular attention to Mathilda and how she held the arm of a grizzle - haired , thickset man who appeared to be her father .

source_bert_toks: i watched them leave , paying particular attention to math ##il ##da and how she held the arm of a gr ##iz ##zle - haired , thick ##set man who appeared to be her father .

reference_raw: I watched them go, paying special attention to Mathilda and the way she held the hand of the gray-haired, fat man who looked like her father.

reference_spacy_tokens: I watched them go , paying special attention to Mathilda and the way she held the hand of the gray - haired , fat man who looked like her father .


fn_spacy_tokens_for_baseline: Most of the nobility were dreaming of classical temples in their parks , or other architectural fantasies from foreign climes , which through the eighteenth century grew ever more complicated .

source_bert_toks: most of the nobility were dreaming of classical temples in their parks , or other architectural fantasies from foreign cl ##ime ##s , which through the eighteenth century grew ever more complicated .

reference_raw: Most nobles dreamt of classic temples in their parks, or of other architectural images of foreign climates that had become more complex in the eighteenth century.

reference_spacy_tokens: Most nobles dreamt of classic temples in their parks , or of other architectural images of foreign climates that had become more complex in the eighteenth century .


fn_spacy_tokens_for_baseline: Her torch flickered across the wall and she switched it off , holding her breath in case someone had noticed the distant gleam of light .

source_bert_toks: her torch flickered across the wall and she switched it off , holding her breath in case someone had noticed the distant gleam of light .

reference_raw: Her torch flashed over the wall, and she turned it off, holding her breath in case anyone noticed a distant flash of light.

reference_spacy_tokens: Her torch flashed over the wall , and she turned it off , holding her breath in case anyone noticed a distant flash of light .


fn_spacy_tokens_for_baseline: 4 Meanwhile , pat salt into the ends of the marrow bones , then wrap them in muslin and tie with string .

source_bert_toks: 4 meanwhile , pat salt into the ends of the marrow bones , then wrap them in mu ##slin and tie with string .

reference_raw: 4 In the meantime, pat the salt at the end of the bone marrow, then wrap it in muslin and tie it with a chain.

reference_spacy_tokens: 4 In the meantime , pat the salt at the end of the bone marrow , then wrap it in muslin and tie it with a chain .


fn_spacy_tokens_for_baseline: Oscar sat inside his parked truck at the top of the slip road leading down on to the E 35 for traffic heading along the autobahn to Freiburg and Basle .

source_bert_toks: oscar sat inside his parked truck at the top of the slip road leading down on to the e 35 for traffic heading along the auto ##bahn to freiburg and bas ##le .

reference_raw: Oscar was sitting in a parked car on the top of a slippery road that led to E-35 for traffic on his way to Freiburg and Basle.

reference_spacy_tokens: Oscar was sitting in a parked car on the top of a slippery road that led to E-35 for traffic on his way to Freiburg and Basle .


fn_spacy_tokens_for_baseline: Many Greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the United States and Australia .

source_bert_toks: many greek islanders chose to leave rather than live in poverty and terror , and many made new homes in the united states and australia .

reference_raw: A number of Greek islanders chose to leave rather than live in poverty and terror, and a number of them created new homes in the United States and Australia.

reference_spacy_tokens: A number of Greek islanders chose to leave rather than live in poverty and terror , and a number of them created new homes in the United States and Australia .


fn_spacy_tokens_for_baseline: Although I could n't actually see Mate 's sneer , I felt it in the darkness .

source_bert_toks: although i couldn ' t actually see mate ' s s ##neer , i felt it in the darkness .

reference_raw: Though I could not really see Mate's grin, I could feel it in the dark.

reference_spacy_tokens: Though I could not really see Mate 's grin , I could feel it in the dark .


fn_spacy_tokens_for_baseline: A villainous raid upon the Stockade where the men do lie and even upon ourselves where we dwell at Belmont would have robbed us of all we have assured thus far by the Grace of God .

source_bert_toks: a villain ##ous raid upon the stock ##ade where the men do lie and even upon ourselves where we dwell at belmont would have robbed us of all we have assured thus far by the grace of god .

reference_raw: A vicious raid on the stockade, where men lie, and even on ourselves, where we live in Belmont, would deprive us of all we have so far been assured by God's grace.

reference_spacy_tokens: A vicious raid on the stockade , where men lie , and even on ourselves , where we live in Belmont , would deprive us of all we have so far been assured by God 's grace .


fn_spacy_tokens_for_baseline: At fifty feet he levelled out , slipped the safety off the spear gun , and swam slowly round the coral outcrop .

source_bert_toks: at fifty feet he level ##led out , slipped the safety off the spear gun , and swam slowly round the coral out ##cr ##op .

reference_raw: He straightened at fifty feet, slipped the safety off the spear-gun, and swam slowly around the coral extrusion.

reference_spacy_tokens: He straightened at fifty feet , slipped the safety off the spear - gun , and swam slowly around the coral extrusion .


fn_spacy_tokens_for_baseline: A protest outside fleet headquarters had been whipped up , he said , by deliberately spread rumours that two planeloads of Ukrainian National Guard were arriving to arrest Adml Kasatanov .

source_bert_toks: a protest outside fleet headquarters had been whipped up , he said , by deliberately spread rumours that two plane ##load ##s of ukrainian national guard were arriving to arrest ad ##ml ka ##sat ##anov .

reference_raw: He said that the protest outside Fleet Headquarters had been whipped up by the deliberate spread of rumors that two Ukrainian National Guard aircraft had arrived to arrest Adml Kasatanov.

reference_spacy_tokens: He said that the protest outside Fleet Headquarters had been whipped up by the deliberate spread of rumors that two Ukrainian National Guard aircraft had arrived to arrest Adml Kasatanov .


fn_spacy_tokens_for_baseline: He can hardly bring himself to turn away , and sneaks back for another fix whenever he gets the chance .

source_bert_toks: he can hardly bring himself to turn away , and sneak ##s back for another fix whenever he gets the chance .

reference_raw: He could hardly bring himself to turn away and sneak back to get another fix whenever he could.

reference_spacy_tokens: He could hardly bring himself to turn away and sneak back to get another fix whenever he could .


fn_spacy_tokens_for_baseline: General Wojciech Jaruzelski adopted a hard line and declared martial law in December 1981 in response to continued strikes across Poland .

source_bert_toks: general wo ##j ##cie ##ch jar ##uze ##ls ##ki adopted a hard line and declared martial law in december 1981 in response to continued strikes across poland .

reference_raw: General Wojciech Jaruzelski took the hard line and declared martial law in December 1981 in response to further attacks in Poland.

reference_spacy_tokens: General Wojciech Jaruzelski took the hard line and declared martial law in December 1981 in response to further attacks in Poland .


fn_spacy_tokens_for_baseline: There was a small expressive sound made by a number of crossbows being cocked .

source_bert_toks: there was a small expressive sound made by a number of crossbow ##s being cocked .

reference_raw: There was a small, expressive sound from several bows cocked.

reference_spacy_tokens: There was a small , expressive sound from several bows cocked .


fn_spacy_tokens_for_baseline: The team laughed and nodded their approval , continuing with their meal as the rain dripped steadily into the mess - tins and the mugs of tea .

source_bert_toks: the team laughed and nodded their approval , continuing with their meal as the rain dripped steadily into the mess - tin ##s and the mug ##s of tea .

reference_raw: The team laughed and nodded agreement, continuing to eat as the rain continued to dribble into the mess cans and cups of tea.

reference_spacy_tokens: The team laughed and nodded agreement , continuing to eat as the rain continued to dribble into the mess cans and cups of tea .


fn_spacy_tokens_for_baseline: There is a similar organisation that runs projects in Scotland ; and the National Trust also uses volunteers in many aspects of its work .

source_bert_toks: there is a similar organisation that runs projects in scotland ; and the national trust also uses volunteers in many aspects of its work .

reference_raw: A similar organisation operates projects in Scotland; the National Trust also uses volunteers in many aspects of its work.

reference_spacy_tokens: A similar organisation operates projects in Scotland ; the National Trust also uses volunteers in many aspects of its work .


fn_spacy_tokens_for_baseline: All those absent - minded old people .

source_bert_toks: all those absent - minded old people .

reference_raw: All those distracted old people.

reference_spacy_tokens: All those distracted old people .


fn_spacy_tokens_for_baseline: Given their continuing powerlessness , however , even the younger workers are unlikely to seek an improvement in their position by resort to militant action .

source_bert_toks: given their continuing powerless ##ness , however , even the younger workers are unlikely to seek an improvement in their position by resort to militant action .

reference_raw: However, due to their continued helplessness, it is unlikely that even younger workers will seek to improve their position by resorting to military action.

reference_spacy_tokens: However , due to their continued helplessness , it is unlikely that even younger workers will seek to improve their position by resorting to military action .


fn_spacy_tokens_for_baseline: Howard , who has been dogged by policy fumbles and racial jibes against Asian immigrants and aborigines by some of his candidates in recent days , maintains he 's still on course for victory .

source_bert_toks: howard , who has been dogg ##ed by policy fumble ##s and racial ji ##bes against asian immigrants and ab ##ori ##gin ##es by some of his candidates in recent days , maintains he ' s still on course for victory .

reference_raw: Howard, who, in recent days, has been dogged by political feuds and racial disputes against Asian immigrants and natives, claims that he is still on his way to victory.

reference_spacy_tokens: Howard , who , in recent days , has been dogged by political feuds and racial disputes against Asian immigrants and natives , claims that he is still on his way to victory .


fn_spacy_tokens_for_baseline: ' Suicide attackers are n't hard - core Taliban terrorists -- these are boys who are picked up by the Taliban and brainwashed , ' Ahmed said .

source_bert_toks: ' suicide attackers aren ' t hard - core taliban terrorists - - these are boys who are picked up by the taliban and brain ##washed , ' ahmed said .

reference_raw: 'Suicide-assailants are not hard-core Taliban terrorists - these are the guys that the Taliban picked up and brainwashed,' Ahmed said.

reference_spacy_tokens: ' Suicide - assailants are not hard - core Taliban terrorists - these are the guys that the Taliban picked up and brainwashed , ' Ahmed said .


fn_spacy_tokens_for_baseline: These and other nuclear technology transfers were reportedly made under a cooperation agreement signed in the mid - 1980s .

source_bert_toks: these and other nuclear technology transfers were reportedly made under a cooperation agreement signed in the mid - 1980s .

reference_raw: These and other transfers of nuclear technology were reportedly carried out on the basis of a cooperation contract signed in the mid-1980s.

reference_spacy_tokens: These and other transfers of nuclear technology were reportedly carried out on the basis of a cooperation contract signed in the mid-1980s .


fn_spacy_tokens_for_baseline: With extreme tact and gentleness , Aunt Tossie persuaded Mrs Geary into an Old People 's Home .

source_bert_toks: with extreme ta ##ct and gentle ##ness , aunt toss ##ie persuaded mrs gear ##y into an old people ' s home .

reference_raw: Aunt Tossie, with extreme tact and gentleness, convinced Mrs. Geary to go to the Old People's Home.

reference_spacy_tokens: Aunt Tossie , with extreme tact and gentleness , convinced Mrs. Geary to go to the Old People 's Home .


fn_spacy_tokens_for_baseline: He was not wearing his faded jeans , but a pair of creamy - coloured trousers and a short - sleeved shirt , and he had combed his hair away from his face .

source_bert_toks: he was not wearing his faded jeans , but a pair of creamy - coloured trousers and a short - sleeve ##d shirt , and he had comb ##ed his hair away from his face .

reference_raw: He wasn't wearing faded jeans, he was wearing cream-colored pants and a short-sleeved shirt, and he brushed his hair from his face.

reference_spacy_tokens: He was n't wearing faded jeans , he was wearing cream - colored pants and a short - sleeved shirt , and he brushed his hair from his face .


fn_spacy_tokens_for_baseline: Senators who refused to conform to these inherently conservative norms were condemned to ineffectiveness .

source_bert_toks: senators who refused to conform to these inherently conservative norms were condemned to ineffective ##ness .

reference_raw: Senators who refused to comply with these inherently conservative standards were doomed to ineffectiveness.

reference_spacy_tokens: Senators who refused to comply with these inherently conservative standards were doomed to ineffectiveness .


fn_spacy_tokens_for_baseline: The aim was " to make sure that all their employees are well - versed with the terms of the Race Relations Act , 1976 , and also that they are committed to multi - culturism , anti - racism and the provision of equal opportunities for all . "

source_bert_toks: the aim was " to make sure that all their employees are well - verse ##d with the terms of the race relations act , 1976 , and also that they are committed to multi - cult ##uri ##sm , anti - racism and the provision of equal opportunities for all . "

reference_raw: The goal was to "make sure that all their employees are in a good position to comply with the conditions of the Race Relations Act of 1976, as well as to be committed to multi-culturism, anti-racism and equal opportunities for all."

reference_spacy_tokens: The goal was to " make sure that all their employees are in a good position to comply with the conditions of the Race Relations Act of 1976 , as well as to be committed to multi - culturism , anti - racism and equal opportunities for all . "


fn_spacy_tokens_for_baseline: The coach wrenched forwards , the spurred boot of the trooper next them stabbed at his horse 's side , blood spurted and red drops hit the window .

source_bert_toks: the coach wrenched forwards , the spurred boot of the trooper next them stabbed at his horse ' s side , blood spur ##ted and red drops hit the window .

reference_raw: The coach lurched forward, the spurred boot of the soldier beside them jabbed at his horse's side, blood spilling and red droplets hitting the window.

reference_spacy_tokens: The coach lurched forward , the spurred boot of the soldier beside them jabbed at his horse 's side , blood spilling and red droplets hitting the window .


fn_spacy_tokens_for_baseline: The selection of early Adoration studies , those associated with the Anghiari commission , and a chronologically varied series of grotesque heads are particularly noteworthy .

source_bert_toks: the selection of early ad ##oration studies , those associated with the ang ##hia ##ri commission , and a chronological ##ly varied series of grotesque heads are particularly noteworthy .

reference_raw: The selection of early Adoration studies, the ones associated with the Anghiari Commission and the chronologically diverse set of grotesque heads is particularly important.

reference_spacy_tokens: The selection of early Adoration studies , the ones associated with the Anghiari Commission and the chronologically diverse set of grotesque heads is particularly important .


fn_spacy_tokens_for_baseline: All was dark except for a tiny glimmer of red light .

source_bert_toks: all was dark except for a tiny g ##lim ##mer of red light .

reference_raw: Everything was dark except for a tiny flash of red light.

reference_spacy_tokens: Everything was dark except for a tiny flash of red light .


fn_spacy_tokens_for_baseline: MPs are also to summon Sir Clive Whitmore , Permanent Secretary at the Home Office , to explain repeated failures by his ministry to curb TV licence evasion .

source_bert_toks: mps are also to summon sir clive w ##hit ##more , permanent secretary at the home office , to explain repeated failures by his ministry to curb tv licence eva ##sion .

reference_raw: Members will also call on Sir Clive Whitmore, Permanent Secretary of the Ministry of the Interior, to explain the repeated failures of the Ministry to reduce the avoidance of television licences.

reference_spacy_tokens: Members will also call on Sir Clive Whitmore , Permanent Secretary of the Ministry of the Interior , to explain the repeated failures of the Ministry to reduce the avoidance of television licences .


fn_spacy_tokens_for_baseline: That dignity continued to be displayed when some of the women who were widowed testified before Congress about not having received enough money to live on .

source_bert_toks: that dignity continued to be displayed when some of the women who were widowed testified before congress about not having received enough money to live on .

reference_raw: This dignity continued to show when some of the widowed women testified before Congress that they had not received enough money to survive.

reference_spacy_tokens: This dignity continued to show when some of the widowed women testified before Congress that they had not received enough money to survive .


fn_spacy_tokens_for_baseline: Among other things , smoking makes the blood clot more easily and puts him at risk of another heart attack , which may be less mild than the first .

source_bert_toks: among other things , smoking makes the blood cl ##ot more easily and puts him at risk of another heart attack , which may be less mild than the first .

reference_raw: Among other things, smoking makes it easier for the blood to coagulate and puts it at risk of another heart attack, which may be less mild than the first.

reference_spacy_tokens: Among other things , smoking makes it easier for the blood to coagulate and puts it at risk of another heart attack , which may be less mild than the first .


fn_spacy_tokens_for_baseline: In this , continental European researchers have generally been more broad - minded than those in Britain , and it seems to me a view that should be adopted more widely .

source_bert_toks: in this , continental european researchers have generally been more broad - minded than those in britain , and it seems to me a view that should be adopted more widely .

reference_raw: In this context, continental European researchers are generally more general than British researchers, and I consider it appropriate to adopt a broader approach.

reference_spacy_tokens: In this context , continental European researchers are generally more general than British researchers , and I consider it appropriate to adopt a broader approach .


fn_spacy_tokens_for_baseline: No one knows , but I will raise a possibility that has a chance to be true for a biosphere .

source_bert_toks: no one knows , but i will raise a possibility that has a chance to be true for a bio ##sphere .

reference_raw: No one knows, but I'm going to raise the possibility of being true to the biosphere.

reference_spacy_tokens: No one knows , but I 'm going to raise the possibility of being true to the biosphere .


fn_spacy_tokens_for_baseline: Puddles were forming on the parched earth .

source_bert_toks: puddle ##s were forming on the parc ##hed earth .

reference_raw: Puddles were forming on the dry ground.

reference_spacy_tokens: Puddles were forming on the dry ground .


fn_spacy_tokens_for_baseline: As a result , an alumina implant can shield the surrounding bone from the stresses generated by normal activity , and the bone loses the stimulation which is necessary for it to remain healthy .

source_bert_toks: as a result , an al ##umi ##na implant can shield the surrounding bone from the stresses generated by normal activity , and the bone loses the stimulation which is necessary for it to remain healthy .

reference_raw: As a result, an aluminium implant can protect the surrounding bone from the stress caused by normal activity, and the bone loses the stimulation necessary to keep it healthy.

reference_spacy_tokens: As a result , an aluminium implant can protect the surrounding bone from the stress caused by normal activity , and the bone loses the stimulation necessary to keep it healthy .


fn_spacy_tokens_for_baseline: If the matter is to be discussed with the miscreant partner at all he should be given a genuine opportunity to put his case to all the other partners .

source_bert_toks: if the matter is to be discussed with the mis ##cre ##ant partner at all he should be given a genuine opportunity to put his case to all the other partners .

reference_raw: If the issue is to be discussed with a rogue partner at all, he should be given a real opportunity to present his case to all other partners.

reference_spacy_tokens: If the issue is to be discussed with a rogue partner at all , he should be given a real opportunity to present his case to all other partners .


fn_spacy_tokens_for_baseline: It can be hoped that Spanish Prime Minister Felipe Gonzalez will draw the right conclusion from his narrow election victory Sunday .

source_bert_toks: it can be hoped that spanish prime minister felipe gonzalez will draw the right conclusion from his narrow election victory sunday .

reference_raw: It can be hoped that Spanish Prime Minister Felipe Gonzalez will draw the right conclusion from his tight election victory on Sunday.

reference_spacy_tokens: It can be hoped that Spanish Prime Minister Felipe Gonzalez will draw the right conclusion from his tight election victory on Sunday .


fn_spacy_tokens_for_baseline: The state - run media echoed official denouncements blaming Israel for the hijacking , and saying the Israelis had planned it all along .

source_bert_toks: the state - run media echoed official den ##oun ##ce ##ments blaming israel for the hi ##jack ##ing , and saying the israelis had planned it all along .

reference_raw: State-run media echoed official accusations accusing Israel of kidnapping, saying that the Israelis had been planning it all along.

reference_spacy_tokens: State - run media echoed official accusations accusing Israel of kidnapping , saying that the Israelis had been planning it all along .


fn_spacy_tokens_for_baseline: Here was a most lovely situation , a sandspit which had been built up into a peninsula .

source_bert_toks: here was a most lovely situation , a sands ##pit which had been built up into a peninsula .

reference_raw: Here was the most beautiful situation, the sandpit that had been built into the peninsula.

reference_spacy_tokens: Here was the most beautiful situation , the sandpit that had been built into the peninsula .


fn_spacy_tokens_for_baseline: The first is to build the new shopping mall or supermarket immediately adjacent to the town centre .

source_bert_toks: the first is to build the new shopping mall or supermarket immediately adjacent to the town centre .

reference_raw: The first is to build a new shopping centre or supermarket immediately adjacent to the city centre.

reference_spacy_tokens: The first is to build a new shopping centre or supermarket immediately adjacent to the city centre .


fn_spacy_tokens_for_baseline: The basic elements of life in the Aegean began to come together as early as 5000 b.c . , and were already in place by the late Bronze Age ( c. 2700 b.c . ) .

source_bert_toks: the basic elements of life in the aegean began to come together as early as 5000 b . c . , and were already in place by the late bronze age ( c . 270 ##0 b . c . ) .

reference_raw: At the end of the Bronze Age (c. 2700 b.c.), the basic features of life in the Aegean began to come together as early as 5,000 b.c..

reference_spacy_tokens: At the end of the Bronze Age ( c. 2700 b.c . ) , the basic features of life in the Aegean began to come together as early as 5,000 b.c ..


fn_spacy_tokens_for_baseline: Despite the considerable losses of useful energy in the conversion process , electricity is indispensable for its flexibility of use .

source_bert_toks: despite the considerable losses of useful energy in the conversion process , electricity is ind ##is ##pen ##sable for its flexibility of use .

reference_raw: Despite the significant loss of useful energy in the conversion process, electricity is essential for its flexible use.

reference_spacy_tokens: Despite the significant loss of useful energy in the conversion process , electricity is essential for its flexible use .


fn_spacy_tokens_for_baseline: There have been allegations that the Soviet Union developed a new class of nerve agent ( Novichok ) , estimated to be 5 - 10 times more toxic than VX .

source_bert_toks: there have been allegations that the soviet union developed a new class of nerve agent ( novi ##cho ##k ) , estimated to be 5 - 10 times more toxic than v ##x .

reference_raw: There are allegations that the Soviet Union has developed a new group of nerve agents (Novichok) which is estimated to be five to ten times more toxic than VX.

reference_spacy_tokens: There are allegations that the Soviet Union has developed a new group of nerve agents ( Novichok ) which is estimated to be five to ten times more toxic than VX .


fn_spacy_tokens_for_baseline: Firefighters Responsibilities : 1- Firefighting training 2- Evacuation training 3- Supervise the fire equipment in order to ensure : A : It remains in place B : Does not get damaged 4- Run some tests to identify the negatives .

source_bert_toks: firefighters responsibilities : 1 - fire ##fighting training 2 - evacuation training 3 - supervise the fire equipment in order to ensure : a : it remains in place b : does not get damaged 4 - run some tests to identify the negative ##s .

reference_raw: Firemen Responsibilities: 1-Firefighting training 2-Evacuation training 3-Supervise the fire-fighting device to ensure that: A: Stays in place B: Do not get damaged 4-Do some tests to detect negatives.

reference_spacy_tokens: Firemen Responsibilities : 1-Firefighting training 2-Evacuation training 3-Supervise the fire - fighting device to ensure that : A : Stays in place B : Do not get damaged 4-Do some tests to detect negatives .


fn_spacy_tokens_for_baseline: And he strode to her , grabbing her wrist and tugging her upstairs .

source_bert_toks: and he strode to her , grabbing her wrist and tugging her upstairs .

reference_raw: He went to her, grabbed her by the wrist, and pulled her up.

reference_spacy_tokens: He went to her , grabbed her by the wrist , and pulled her up .


fn_spacy_tokens_for_baseline: Russia inherited most of the Soviet missile complex , although significant portions are located in Ukraine .

source_bert_toks: russia inherited most of the soviet missile complex , although significant portions are located in ukraine .

reference_raw: Russia inherited most of the Soviet missile complex, though a significant part of it is located in Ukraine.

reference_spacy_tokens: Russia inherited most of the Soviet missile complex , though a significant part of it is located in Ukraine .


fn_spacy_tokens_for_baseline: The elder of the body slaves gathered the braided ends of his master 's hair and bound them together with gold wire .

source_bert_toks: the elder of the body slaves gathered the braid ##ed ends of his master ' s hair and bound them together with gold wire .

reference_raw: The elder of the flesh-slaves gathered up the tangled ends of his master's hair and bound them with golden wire.

reference_spacy_tokens: The elder of the flesh - slaves gathered up the tangled ends of his master 's hair and bound them with golden wire .


fn_spacy_tokens_for_baseline: At least she only robbed bins and doorsteps , she did n't shoplift .

source_bert_toks: at least she only robbed bin ##s and doorstep ##s , she didn ' t shop ##lift .

reference_raw: At least she was just stealing trash cans and doors, not stealing.

reference_spacy_tokens: At least she was just stealing trash cans and doors , not stealing .


fn_spacy_tokens_for_baseline: From them a new vision and emotion will emanate to solace the soul and give it joy .

source_bert_toks: from them a new vision and emotion will em ##ana ##te to sol ##ace the soul and give it joy .

reference_raw: A new vision and emotion will emanate from them to comfort the soul and make it happy.

reference_spacy_tokens: A new vision and emotion will emanate from them to comfort the soul and make it happy .


fn_spacy_tokens_for_baseline: He uncorked the bottle and carefully poured the brandy .

source_bert_toks: he un ##cor ##ked the bottle and carefully poured the brandy .

reference_raw: He unbuckled the bottle and carefully poured the brandy.

reference_spacy_tokens: He unbuckled the bottle and carefully poured the brandy .


fn_spacy_tokens_for_baseline: UNITA , the National Union for the Total Independence of Angola , fought for 20 years to dethrone the rival anti - colonial movement that seized power on the eve of Angola 's independence from Portugal in 1975 .

source_bert_toks: unit ##a , the national union for the total independence of angola , fought for 20 years to det ##hr ##one the rival anti - colonial movement that seized power on the eve of angola ' s independence from portugal in 1975 .

reference_raw: UNITA, the National Union for the Total Independence of Angola, fought for 20 years to overthrow the rival anti-colonial movement that seized power on the eve of Angola's independence from Portugal in 1975.

reference_spacy_tokens: UNITA , the National Union for the Total Independence of Angola , fought for 20 years to overthrow the rival anti - colonial movement that seized power on the eve of Angola 's independence from Portugal in 1975 .


fn_spacy_tokens_for_baseline: The corruption , cynicism and disillusionment which now proliferate should not mystify us .

source_bert_toks: the corruption , cy ##nic ##ism and di ##sil ##lusion ##ment which now pro ##life ##rate should not my ##sti ##fy us .

reference_raw: The corruption, cynicism, and disillusion that now spread should not be mystic.

reference_spacy_tokens: The corruption , cynicism , and disillusion that now spread should not be mystic .


fn_spacy_tokens_for_baseline: Also : a coworker and fellow Joss - fan lent me a tape of Angel several weeks ago .

source_bert_toks: also : a cow ##or ##ker and fellow jo ##ss - fan lent me a tape of angel several weeks ago .

reference_raw: Also: a colleague and colleague Joss-fan loaned me a tape of Angel a few weeks ago.

reference_spacy_tokens: Also : a colleague and colleague Joss - fan loaned me a tape of Angel a few weeks ago .


fn_spacy_tokens_for_baseline: Both authors contributed equally to the paper .

source_bert_toks: both authors contributed equally to the paper .

reference_raw: The two authors made the same contribution to the document.

reference_spacy_tokens: The two authors made the same contribution to the document .


fn_spacy_tokens_for_baseline: However , the same sources profess to being amazed at his move to a position ' that is clearly a demotion ' and to a company owned by P&G 's rival Unilever , which is equally formulaic .

source_bert_toks: however , the same sources prof ##ess to being amazed at his move to a position ' that is clearly a demo ##tion ' and to a company owned by p & g ' s rival un ##ile ##ver , which is equally formula ##ic .

reference_raw: But the same sources claim to be surprised at the fact that he's moved into a position "which is obviously a demotion" and to a company owned by P&G's rival Unilever, which is equally formal.

reference_spacy_tokens: But the same sources claim to be surprised at the fact that he 's moved into a position " which is obviously a demotion " and to a company owned by P&G 's rival Unilever , which is equally formal .


fn_spacy_tokens_for_baseline: Campbell looks at the shoplifting of young females .

source_bert_toks: campbell looks at the shop ##lifting of young females .

reference_raw: Campbell's looking at young women stealing.

reference_spacy_tokens: Campbell 's looking at young women stealing .


fn_spacy_tokens_for_baseline: Billy Tolboys pulled up the collar of his ancient leather overcoat and hunched down even deeper into the motorcycle sidecar .

source_bert_toks: billy to ##lb ##oys pulled up the collar of his ancient leather over ##coat and hunched down even deeper into the motorcycle side ##car .

reference_raw: Billy Tolboys pulled up the collar of his old leather jacket and ducked deeper into the sidecar of the motorcycle.

reference_spacy_tokens: Billy Tolboys pulled up the collar of his old leather jacket and ducked deeper into the sidecar of the motorcycle .


fn_spacy_tokens_for_baseline: The spindly Navigator yawned .

source_bert_toks: the spin ##dly navigator yawned .

reference_raw: The spiny Navigator yawned.

reference_spacy_tokens: The spiny Navigator yawned .


fn_spacy_tokens_for_baseline: Although no reference to them exists among surviving documents , it is certainly reasonable to assume that James sired children .

source_bert_toks: although no reference to them exists among surviving documents , it is certainly reasonable to assume that james sired children .

reference_raw: Although there is no mention of them among the surviving documents, it is certainly reasonable to assume that James created children.

reference_spacy_tokens: Although there is no mention of them among the surviving documents , it is certainly reasonable to assume that James created children .


fn_spacy_tokens_for_baseline: The landowner , a former state and federal congressman , fenced off property which included part of the Truka land .

source_bert_toks: the landowner , a former state and federal congressman , fence ##d off property which included part of the tr ##uka land .

reference_raw: The owner of the land, a former state and a federal congresswoman, fenced off property that included part of Truka's land.

reference_spacy_tokens: The owner of the land , a former state and a federal congresswoman , fenced off property that included part of Truka 's land .


fn_spacy_tokens_for_baseline: Jenny might have called it sarcasm , but all he felt was an emotion that bordered on disappointment .

source_bert_toks: jenny might have called it sarcasm , but all he felt was an emotion that bordered on disappointment .

reference_raw: Jenny might call it sarcasm, but all he felt was an emotion that was bound by frustration.

reference_spacy_tokens: Jenny might call it sarcasm , but all he felt was an emotion that was bound by frustration .


fn_spacy_tokens_for_baseline: They can be fixed directly to masonry .

source_bert_toks: they can be fixed directly to masonry .

reference_raw: They can be attached directly to the masonry.

reference_spacy_tokens: They can be attached directly to the masonry .


fn_spacy_tokens_for_baseline: So Owen 's high road to the regeneration of society through the co - operative community petered out to its disillusioning end .

source_bert_toks: so owen ' s high road to the regeneration of society through the co - operative community peter ##ed out to its di ##sil ##lusion ##ing end .

reference_raw: So Owen's high road to the regeneration of society through the cooperative community turned to an unsatisfactory end.

reference_spacy_tokens: So Owen 's high road to the regeneration of society through the cooperative community turned to an unsatisfactory end .


fn_spacy_tokens_for_baseline: A bell tolled above his head .

source_bert_toks: a bell toll ##ed above his head .

reference_raw: The bell rang over his head.

reference_spacy_tokens: The bell rang over his head .


fn_spacy_tokens_for_baseline: Initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

source_bert_toks: initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

reference_raw: The first call said there were a lot of animals in the house, and the firemen were working fast to save all the chicks and dogs.

reference_spacy_tokens: The first call said there were a lot of animals in the house , and the firemen were working fast to save all the chicks and dogs .


fn_spacy_tokens_for_baseline: Lack of imagination may also prevent one partner from recognizing what the other is coping with .

source_bert_toks: lack of imagination may also prevent one partner from recognizing what the other is coping with .

reference_raw: A lack of imagination can also prevent one of his companions from knowing what the other is dealing with.

reference_spacy_tokens: A lack of imagination can also prevent one of his companions from knowing what the other is dealing with .


fn_spacy_tokens_for_baseline: PLAYER : ( Lost ) There we were -- demented children mincing about in clothes that no one ever wore , speaking as no man ever spoke , swearing love in wigs and rhymed couplets , killing each other with wooden swords , hollow protestations of faith hurled after empty promises of vengeance -- and every gesture , every pose , vanishing into the thin unpopulated air .

source_bert_toks: player : ( lost ) there we were - - dem ##ented children min ##cing about in clothes that no one ever wore , speaking as no man ever spoke , swearing love in wig ##s and rhyme ##d couple ##ts , killing each other with wooden swords , hollow protest ##ations of faith hurled after empty promises of vengeance - - and every gesture , every pose , vanishing into the thin un ##pop ##ulated air .

reference_raw: PLAYER: (Lost) There we were - demented children scrambling about in clothes no one had ever worn, talking like no one had ever spoken, swearing love in wigs and rhyming pairs, killing each other with wooden swords, empty protests of faith thrown by empty promises of revenge - and every gesture, every pose, disappearing into the thin, uninhabited air.

reference_spacy_tokens: PLAYER : ( Lost ) There we were - demented children scrambling about in clothes no one had ever worn , talking like no one had ever spoken , swearing love in wigs and rhyming pairs , killing each other with wooden swords , empty protests of faith thrown by empty promises of revenge - and every gesture , every pose , disappearing into the thin , uninhabited air .


fn_spacy_tokens_for_baseline: At 934 m ( 3,064 ft ) , Lantau Peak is high enough to attract the occasional rain cloud - refreshingly cool breezes blow on most hot summer days .

source_bert_toks: at 93 ##4 m ( 3 , 06 ##4 ft ) , lan ##ta ##u peak is high enough to attract the occasional rain cloud - refreshing ##ly cool breeze ##s blow on most hot summer days .

reference_raw: At 934 m (3,064 ft), Lantau Peak is so high that it attracts occasional rain clouds - a refreshingly cold wind blows on most hot summer days.

reference_spacy_tokens: At 934 m ( 3,064 ft ) , Lantau Peak is so high that it attracts occasional rain clouds - a refreshingly cold wind blows on most hot summer days .


fn_spacy_tokens_for_baseline: Rebels said they were n't aware that a drone had taken out a regime rocket launcher until some time after Saturday 's strike .

source_bert_toks: rebels said they weren ' t aware that a drone had taken out a regime rocket launcher until some time after saturday ' s strike .

reference_raw: The rebels said they didn't know the drone had killed the regimen's rocket launcher until some time after the attack on Saturday.

reference_spacy_tokens: The rebels said they did n't know the drone had killed the regimen 's rocket launcher until some time after the attack on Saturday .


fn_spacy_tokens_for_baseline: Gingerly she took a sip of the soup , surprised to find it was not only delicious but nothing to do with any can or packet .

source_bert_toks: gingerly she took a sip of the soup , surprised to find it was not only delicious but nothing to do with any can or packet .

reference_raw: She drank her soup gingerly and was surprised to find that it was not only delicious, but had nothing to do with a can or a package.

reference_spacy_tokens: She drank her soup gingerly and was surprised to find that it was not only delicious , but had nothing to do with a can or a package .


fn_spacy_tokens_for_baseline: However , the report lacks details , and its contents have not been confirmed .

source_bert_toks: however , the report lacks details , and its contents have not been confirmed .

reference_raw: However, the report does not contain detailed information and its content has not been validated.

reference_spacy_tokens: However , the report does not contain detailed information and its content has not been validated .


fn_spacy_tokens_for_baseline: Although they were later acquitted of illegally importing arms and ammunition for use in the North , they were dismissed from the cabinet for their part in the affair .

source_bert_toks: although they were later acquitted of illegally import ##ing arms and ammunition for use in the north , they were dismissed from the cabinet for their part in the affair .

reference_raw: Although they were later acquitted of illegal imports of weapons and munitions for use in the north, they were dismissed from the government for their part in the matter.

reference_spacy_tokens: Although they were later acquitted of illegal imports of weapons and munitions for use in the north , they were dismissed from the government for their part in the matter .


fn_spacy_tokens_for_baseline: He was sprawled in his chair , his long legs outstretched , his hand holding the plate of sandwiches away from his body .

source_bert_toks: he was sprawled in his chair , his long legs outstretched , his hand holding the plate of sandwiches away from his body .

reference_raw: He lay back in his chair, his long legs outstretched, his hand holding a plate of sandwiches from his body.

reference_spacy_tokens: He lay back in his chair , his long legs outstretched , his hand holding a plate of sandwiches from his body .


fn_spacy_tokens_for_baseline: There were also tunnels with an electric light - railway to whisk the leadership away in the event of danger even here deep below the ground .

source_bert_toks: there were also tunnels with an electric light - railway to w ##his ##k the leadership away in the event of danger even here deep below the ground .

reference_raw: There were also corridors with an electric light-railway that would take the lead away in case of danger, even here, deep underground.

reference_spacy_tokens: There were also corridors with an electric light - railway that would take the lead away in case of danger , even here , deep underground .


fn_spacy_tokens_for_baseline: Last year Britain consumed six million tonnes of potatos .

source_bert_toks: last year britain consumed six million tonnes of potato ##s .

reference_raw: Last year, Britain swallowed six million tons of potatoes.

reference_spacy_tokens: Last year , Britain swallowed six million tons of potatoes .


fn_spacy_tokens_for_baseline: The Chinese will install 4 m new phone lines in 1993 -- 2 m home - produced and 2 m from abroad .

source_bert_toks: the chinese will install 4 m new phone lines in 1993 - - 2 m home - produced and 2 m from abroad .

reference_raw: In 1993, China will set up 4 million new telephone lines - 2 million home-produced and 2 million from abroad.

reference_spacy_tokens: In 1993 , China will set up 4 million new telephone lines - 2 million home - produced and 2 million from abroad .


fn_spacy_tokens_for_baseline: I started with crunchy buschetta soused in green olive oil and spread with tapenda -- delicious , but at £ 4.25 expensive for peasant - cuisine - come - to - Kensington .

source_bert_toks: i started with crunch ##y busch ##etta sous ##ed in green olive oil and spread with tape ##nda - - delicious , but at £ ##4 . 25 expensive for peasant - cuisine - come - to - kensington .

reference_raw: I started with a crispy buschetta soaked in green olive oil and spread with a tapenda - delicious, but expensive for a farmer's kitchen coming to Kensington for £4.25.

reference_spacy_tokens: I started with a crispy buschetta soaked in green olive oil and spread with a tapenda - delicious , but expensive for a farmer 's kitchen coming to Kensington for £ 4.25 .


fn_spacy_tokens_for_baseline: In the rehearsal room after lunch I find a tough - looking guy brawling with two younger men .

source_bert_toks: in the rehearsal room after lunch i find a tough - looking guy brawl ##ing with two younger men .

reference_raw: After lunch, I find a hard-looking man fighting with two younger men.

reference_spacy_tokens: After lunch , I find a hard - looking man fighting with two younger men .


fn_spacy_tokens_for_baseline: There was the sound of the boy clomping miserably up the stairs .

source_bert_toks: there was the sound of the boy cl ##omp ##ing mis ##era ##bly up the stairs .

reference_raw: There was the sound of a boy struggling up the stairs.

reference_spacy_tokens: There was the sound of a boy struggling up the stairs .


fn_spacy_tokens_for_baseline: They then set their sights on the islands of the Knights of St. John and , after an unsuccessful siege in 1480 , they finally ejected the knights from the Dodecanese in 1522 .

source_bert_toks: they then set their sights on the islands of the knights of st . john and , after an unsuccessful siege in 148 ##0 , they finally ejected the knights from the dod ##eca ##nese in 152 ##2 .

reference_raw: Then they set their sights on the islands of St. John's Knights, and, after a failed siege in 1480, eventually ejected the Knights from the Dodecanese in 1522.

reference_spacy_tokens: Then they set their sights on the islands of St. John 's Knights , and , after a failed siege in 1480 , eventually ejected the Knights from the Dodecanese in 1522 .


fn_spacy_tokens_for_baseline: A yellow - red light jetted out from the eye - holes of the distorted faces , like a bright beam shining through a keyhole in a door .

source_bert_toks: a yellow - red light jett ##ed out from the eye - holes of the distorted faces , like a bright beam shining through a key ##hole in a door .

reference_raw: Yellow-red light erupted from the eyeholes of the distorted faces, like a bright beam shining through a keyhole in a door.

reference_spacy_tokens: Yellow - red light erupted from the eyeholes of the distorted faces , like a bright beam shining through a keyhole in a door .


fn_spacy_tokens_for_baseline: Cobalt shook his head , which might have meant he did n't know or might have been admonishment for Oliver who was still holding the bottle of wine .

source_bert_toks: cobalt shook his head , which might have meant he didn ' t know or might have been ad ##mon ##ishment for oliver who was still holding the bottle of wine .

reference_raw: Cobalt shook his head, which could mean that he didn't know, or that he might have warned Oliver, who was still holding a bottle of wine.

reference_spacy_tokens: Cobalt shook his head , which could mean that he did n't know , or that he might have warned Oliver , who was still holding a bottle of wine .


fn_spacy_tokens_for_baseline: Mertseger 's father , the general in command of cavalry , was a stocky man like Huy .

source_bert_toks: mer ##ts ##eger ' s father , the general in command of cavalry , was a stock ##y man like hu ##y .

reference_raw: Mertseger's father, the commander of the cavalry, was a stocky man like Huy.

reference_spacy_tokens: Mertseger 's father , the commander of the cavalry , was a stocky man like Huy .


fn_spacy_tokens_for_baseline: This song appealed especially , as we had filched it from the Germans .

source_bert_toks: this song appealed especially , as we had fi ##lch ##ed it from the germans .

reference_raw: This song was particularly appealing, as we had done with the Germans.

reference_spacy_tokens: This song was particularly appealing , as we had done with the Germans .


fn_spacy_tokens_for_baseline: The location of the perimeter of a square can be described by continuous lines .

source_bert_toks: the location of the perimeter of a square can be described by continuous lines .

reference_raw: The placement of the square circumference may be described by continuous lines.

reference_spacy_tokens: The placement of the square circumference may be described by continuous lines .


fn_spacy_tokens_for_baseline: The conventional wisdom about ' ring and spoke ' road patterns survived , as indicated by the commencement of Birmingham 's inner ring road ( Smallbrook Ringway ) in 1957 .

source_bert_toks: the conventional wisdom about ' ring and spoke ' road patterns survived , as indicated by the commencement of birmingham ' s inner ring road ( small ##brook ring ##way ) in 1957 .

reference_raw: According to the beginning of Birmingham's inner ring road (Smallbrook Ringway) in 1957, the traditional wisdom of the "ring and speaking" patterns survived.

reference_spacy_tokens: According to the beginning of Birmingham 's inner ring road ( Smallbrook Ringway ) in 1957 , the traditional wisdom of the " ring and speaking " patterns survived .


fn_spacy_tokens_for_baseline: She then literally jumped in her seat as a huge peal of thunder crashed directly overhead .

source_bert_toks: she then literally jumped in her seat as a huge pea ##l of thunder crashed directly overhead .

reference_raw: Then she literally leapt into her seat as a huge thunderclap crashed directly above her head.

reference_spacy_tokens: Then she literally leapt into her seat as a huge thunderclap crashed directly above her head .


fn_spacy_tokens_for_baseline: We had two gatherings of businessmen in Brighton and London , attended by the Minister for the Arts , and a new director was appointed for the Lewes All Saints Community Arts Centre .

source_bert_toks: we had two gatherings of businessmen in brighton and london , attended by the minister for the arts , and a new director was appointed for the lew ##es all saints community arts centre .

reference_raw: There were two meetings of entrepreneurs in Brighton and London, attended by the Arts Secretary, and a new director was appointed for the Arts Center in Lewes All Saints.

reference_spacy_tokens: There were two meetings of entrepreneurs in Brighton and London , attended by the Arts Secretary , and a new director was appointed for the Arts Center in Lewes All Saints .


fn_spacy_tokens_for_baseline: It is only the second time this century that a school of sperm whales has been seen in the waters around Orkney .

source_bert_toks: it is only the second time this century that a school of sperm whales has been seen in the waters around or ##kney .

reference_raw: In the waters around Orkney, it was only the second time in this century that a sperm-whaling college was seen.

reference_spacy_tokens: In the waters around Orkney , it was only the second time in this century that a sperm - whaling college was seen .


fn_spacy_tokens_for_baseline: There is a full sized double bed plus a comfortable bed settee which will sleep two children .

source_bert_toks: there is a full sized double bed plus a comfortable bed set ##tee which will sleep two children .

reference_raw: There's a full-size double bed and a comfortable bed settee that'll keep two kids asleep.

reference_spacy_tokens: There 's a full - size double bed and a comfortable bed settee that 'll keep two kids asleep .


fn_spacy_tokens_for_baseline: According to US press accounts citing a top secret CIA report dated 2 October 1996 , China sold Iran nearly 400 metric tons of carbon disulfide , a nerve and riot control gas precursor .

source_bert_toks: according to us press accounts citing a top secret cia report dated 2 october 1996 , china sold iran nearly 400 metric tons of carbon di ##sul ##fide , a nerve and riot control gas precursor .

reference_raw: According to U.S. press releases, citing a top-secret CIA report of 2 October 1996, China sold Iran nearly 400 tonnes of carbon disulfide, a precursor to nerve and riot control gas.

reference_spacy_tokens: According to U.S. press releases , citing a top - secret CIA report of 2 October 1996 , China sold Iran nearly 400 tonnes of carbon disulfide , a precursor to nerve and riot control gas .


fn_spacy_tokens_for_baseline: On January 23rd American and Iraqi patrols collided on the Saudi - Iraq border just west of the westernmost tip of Kuwait .

source_bert_toks: on january 23rd american and iraqi patrols collided on the saudi - iraq border just west of the western ##most tip of kuwait .

reference_raw: On January 23, American and Iraqi patrols hit the Saudi-Iraq border just west of Kuwait.

reference_spacy_tokens: On January 23 , American and Iraqi patrols hit the Saudi - Iraq border just west of Kuwait .


fn_spacy_tokens_for_baseline: Unidentified groups of rioters attacked and set on fire the city police headquarters , where it was believed that some of those arrested earlier in University Square were being held .

source_bert_toks: unidentified groups of riot ##ers attacked and set on fire the city police headquarters , where it was believed that some of those arrested earlier in university square were being held .

reference_raw: Unidentified groups of rioters attacked and burned down the city police headquarters, where it was believed that some of the people who had been arrested earlier in University Square were being held.

reference_spacy_tokens: Unidentified groups of rioters attacked and burned down the city police headquarters , where it was believed that some of the people who had been arrested earlier in University Square were being held .


fn_spacy_tokens_for_baseline: A typical miser , he hid his money in the house in various places .

source_bert_toks: a typical mis ##er , he hid his money in the house in various places .

reference_raw: Typical loser, hiding his money in a house in different places.

reference_spacy_tokens: Typical loser , hiding his money in a house in different places .


fn_spacy_tokens_for_baseline: If you looked past the rock pools and the exotic plants , past the miniature waterfall , you could see blue sky , a stand of coconut palms , and even , in the distance , a lagoon .

source_bert_toks: if you looked past the rock pools and the exotic plants , past the miniature waterfall , you could see blue sky , a stand of coconut palms , and even , in the distance , a lagoon .

reference_raw: If you looked past the rock puddles and the exotic plants, past the miniature waterfall, you could see the blue sky, a row of coconut palms, and even a lagoon in the distance.

reference_spacy_tokens: If you looked past the rock puddles and the exotic plants , past the miniature waterfall , you could see the blue sky , a row of coconut palms , and even a lagoon in the distance .


fn_spacy_tokens_for_baseline: It 's fun but utterly phoney .

source_bert_toks: it ' s fun but utterly phone ##y .

reference_raw: It's funny, but it's totally fake.

reference_spacy_tokens: It 's funny , but it 's totally fake .


fn_spacy_tokens_for_baseline: European heads of government from Moscow to Madrid showered telegrams of congratulation on Clinton , saying they expected to maintain good ties with Washington .

source_bert_toks: european heads of government from moscow to madrid showered telegram ##s of cong ##rat ##ulation on clinton , saying they expected to maintain good ties with washington .

reference_raw: European heads of government from Moscow to Madrid gave Clinton telegrams of congratulation, saying that they expected to maintain a good relationship with Washington.

reference_spacy_tokens: European heads of government from Moscow to Madrid gave Clinton telegrams of congratulation , saying that they expected to maintain a good relationship with Washington .


fn_spacy_tokens_for_baseline: The Contemporary Arts Centre of Cincinnati was acquitted of obscenity on Oct. 5 for having displayed an exhibition of photographs by the late Robert Mapplethorpe .

source_bert_toks: the contemporary arts centre of cincinnati was acquitted of ob ##sc ##enity on oct . 5 for having displayed an exhibition of photographs by the late robert map ##ple ##thorpe .

reference_raw: On October 5th, the Cincinnati Contemporary Arts Center was absolved of obscenity for displaying photographs by the late Robert Mapplethorpe.

reference_spacy_tokens: On October 5th , the Cincinnati Contemporary Arts Center was absolved of obscenity for displaying photographs by the late Robert Mapplethorpe .


fn_spacy_tokens_for_baseline: As a young man , David Gower prophesied that he would be England captain by the age of 25 .

source_bert_toks: as a young man , david go ##wer prop ##hes ##ied that he would be england captain by the age of 25 .

reference_raw: As a young man, David Gower had predicted that he would be a captain of England by the age of 25.

reference_spacy_tokens: As a young man , David Gower had predicted that he would be a captain of England by the age of 25 .


fn_spacy_tokens_for_baseline: The Colonel at one point was firing his revolver over Donald Roy 's shoulder , and reaching the place they could see the bridge ( ' D ' ) 70 yards off .

source_bert_toks: the colonel at one point was firing his revolver over donald roy ' s shoulder , and reaching the place they could see the bridge ( ' d ' ) 70 yards off .

reference_raw: At one point the colonel fired a pistol over Donald Roy's shoulder and came to where he could see the bridge ('D') 70 yards away.

reference_spacy_tokens: At one point the colonel fired a pistol over Donald Roy 's shoulder and came to where he could see the bridge ( ' D ' ) 70 yards away .


fn_spacy_tokens_for_baseline: Combine all salad ingredients with the flaked tuna .

source_bert_toks: combine all salad ingredients with the fl ##ake ##d tuna .

reference_raw: Combine all the salad ingredients with flaky tuna.

reference_spacy_tokens: Combine all the salad ingredients with flaky tuna .


fn_spacy_tokens_for_baseline: An urn of Waimea sand , representing the ashes of the dead man , was voided on the sea .

source_bert_toks: an ur ##n of wai ##me ##a sand , representing the ashes of the dead man , was void ##ed on the sea .

reference_raw: The urn of Waimea sand, representing the dead man's ashes, was empty in the sea.

reference_spacy_tokens: The urn of Waimea sand , representing the dead man 's ashes , was empty in the sea .


fn_spacy_tokens_for_baseline: Affixed horizontally to the inside of the treadmill were stout iron bars for the prisoned workers to grasp .

source_bert_toks: af ##fixed horizontally to the inside of the tread ##mill were stout iron bars for the prison ##ed workers to grasp .

reference_raw: Sturdy iron bars were attached horizontally to the inside of the treadmill so that the prisoners could grasp it.

reference_spacy_tokens: Sturdy iron bars were attached horizontally to the inside of the treadmill so that the prisoners could grasp it .


fn_spacy_tokens_for_baseline: I see now why you were so evasive when I said I had n't power of attorney . '

source_bert_toks: i see now why you were so eva ##sive when i said i hadn ' t power of attorney . '

reference_raw: I can see why you were so shy when I told you I didn't have the power of attorney.'

reference_spacy_tokens: I can see why you were so shy when I told you I did n't have the power of attorney . '


fn_spacy_tokens_for_baseline: And the presidential election is not won on a first - past - the - post basis by simply tallying the votes for Bush , Clinton and Ross Perot across the country .

source_bert_toks: and the presidential election is not won on a first - past - the - post basis by simply tally ##ing the votes for bush , clinton and ross per ##ot across the country .

reference_raw: And the presidential election is not won in the first place by simply raising the votes of Bush, Clinton, and Ross Perot across the country.

reference_spacy_tokens: And the presidential election is not won in the first place by simply raising the votes of Bush , Clinton , and Ross Perot across the country .


fn_spacy_tokens_for_baseline: John Bridge was described as ' mild and affable in his deportment , possessing great equality of temper , and a very engaging suavity of manners ' .

source_bert_toks: john bridge was described as ' mild and af ##fa ##ble in his de ##port ##ment , possessing great equality of temper , and a very engaging su ##avi ##ty of manners ' .

reference_raw: John Bridge was described as "mild and affable in his deportation, with a great equality of temper, and a very interesting suavity of manners."

reference_spacy_tokens: John Bridge was described as " mild and affable in his deportation , with a great equality of temper , and a very interesting suavity of manners . "


fn_spacy_tokens_for_baseline: -- It is generally desirable to use older textbooks -- many of them , alas , out of print -- rather than newer ones .

source_bert_toks: - - it is generally desirable to use older textbooks - - many of them , ala ##s , out of print - - rather than newer ones .

reference_raw: -- In general, it is preferable to use older textbooks -- many of which, unfortunately, are not printed -- rather than more recent textbooks.

reference_spacy_tokens: -- In general , it is preferable to use older textbooks -- many of which , unfortunately , are not printed -- rather than more recent textbooks .


fn_spacy_tokens_for_baseline: From where we sat we could hear their occasional bursts of laughter and the dim drone of their voices , but the words themselves were lost to us .

source_bert_toks: from where we sat we could hear their occasional bursts of laughter and the dim drone of their voices , but the words themselves were lost to us .

reference_raw: From where we sat we could hear their occasional bursts of laughter and the faint sound of their voices, but the words themselves were lost to us.

reference_spacy_tokens: From where we sat we could hear their occasional bursts of laughter and the faint sound of their voices , but the words themselves were lost to us .


fn_spacy_tokens_for_baseline: In any case , big birds tend not to bother cracking nuts , but swallow them to be pulverised with grit in their muscular gizzards .

source_bert_toks: in any case , big birds tend not to bother cracking nuts , but swallow them to be pu ##lver ##ised with grit in their muscular gi ##zza ##rds .

reference_raw: In any case, large birds tend not to bother cracking nuts, but swallow them to be crushed by a grit in their muscle gizzards.

reference_spacy_tokens: In any case , large birds tend not to bother cracking nuts , but swallow them to be crushed by a grit in their muscle gizzards .


fn_spacy_tokens_for_baseline: On Monday morning Greg had no classes before eleven , so he took the early bus to Burnley and went straight to the Public Library .

source_bert_toks: on monday morning greg had no classes before eleven , so he took the early bus to burnley and went straight to the public library .

reference_raw: On Monday morning, Greg didn't have any classes until eleven o'clock, so he took the first train to Burnley and headed straight for the public library.

reference_spacy_tokens: On Monday morning , Greg did n't have any classes until eleven o'clock , so he took the first train to Burnley and headed straight for the public library .


fn_spacy_tokens_for_baseline: Project Officer Dr. Wouter Basson also set up an elaborate network of procurement and financial front companies overseas .

source_bert_toks: project officer dr . wo ##uter bass ##on also set up an elaborate network of procurement and financial front companies overseas .

reference_raw: The project officer, Dr. Wouter Basson, has also set up an intricate network of contracts and financial front companies abroad.

reference_spacy_tokens: The project officer , Dr. Wouter Basson , has also set up an intricate network of contracts and financial front companies abroad .


fn_spacy_tokens_for_baseline: The policy review concluded that the United States should seek " improved implementation of the Agreed Framework , verifiable constraints on North Korea 's missile program , a ban on missile exports , and a less threatening North Korean conventional military posture . "

source_bert_toks: the policy review concluded that the united states should seek " improved implementation of the agreed framework , ve ##ri ##fia ##ble constraints on north korea ' s missile program , a ban on missile exports , and a less threatening north korean conventional military posture . "

reference_raw: The political review concluded that the US should aim to "improve implementation of the agreed framework, verifiable restrictions on North Korea's missile program, prohibition of missile exports, and less threatening North Korea's conventional military position."

reference_spacy_tokens: The political review concluded that the US should aim to " improve implementation of the agreed framework , verifiable restrictions on North Korea 's missile program , prohibition of missile exports , and less threatening North Korea 's conventional military position . "


fn_spacy_tokens_for_baseline: The popular phrase " Soon come " indicates an apparent lack of concern about time and an unhurried attitude to daily tasks .

source_bert_toks: the popular phrase " soon come " indicates an apparent lack of concern about time and an un ##hur ##ried attitude to daily tasks .

reference_raw: The popular phrase "Soon Coming" suggests a clear lack of concern about time and an unhurried approach to day-to-day work.

reference_spacy_tokens: The popular phrase " Soon Coming " suggests a clear lack of concern about time and an unhurried approach to day - to - day work .


fn_spacy_tokens_for_baseline: So the fire is burning round the clock seven days a week as the women and their children do the family baking .

source_bert_toks: so the fire is burning round the clock seven days a week as the women and their children do the family baking .

reference_raw: So the fire burns around the clock seven days a week, while the women and their children cook their families.

reference_spacy_tokens: So the fire burns around the clock seven days a week , while the women and their children cook their families .


fn_spacy_tokens_for_baseline: This is indeed what the data indicate , particularly in the case of the House .

source_bert_toks: this is indeed what the data indicate , particularly in the case of the house .

reference_raw: That is indeed what the figures show, especially in the case of the House.

reference_spacy_tokens: That is indeed what the figures show , especially in the case of the House .


fn_spacy_tokens_for_baseline: Until yesterday , Taylor would concede only that Gascoigne MIGHT be England 's best player , which is a bit like saying that Linford Christie might be our best sprinter .

source_bert_toks: until yesterday , taylor would con ##cede only that gas ##co ##ign ##e might be england ' s best player , which is a bit like saying that lin ##ford christie might be our best sprinter .

reference_raw: Until yesterday, Taylor only admitted that Gascoigne Might was the best player in England, which is kind of like saying that Linford Christie could be our best sprinter.

reference_spacy_tokens: Until yesterday , Taylor only admitted that Gascoigne Might was the best player in England , which is kind of like saying that Linford Christie could be our best sprinter .


fn_spacy_tokens_for_baseline: Many of those who voted against Mr Yeltsin in Congress last week have probably deceived themselves into thinking that the hands of the clock can be put back .

source_bert_toks: many of those who voted against mr ye ##lts ##in in congress last week have probably dec ##ei ##ved themselves into thinking that the hands of the clock can be put back .

reference_raw: A lot of those who voted against Mr. Yeltsin in Congress last week probably fooled themselves into thinking we could get the clock back.

reference_spacy_tokens: A lot of those who voted against Mr. Yeltsin in Congress last week probably fooled themselves into thinking we could get the clock back .


fn_spacy_tokens_for_baseline: THE airpass holder who whinged to the Dallas check - in clerk that she had spent all day standing by for a flight out of one of America 's less attractive airports was gently chastised .

source_bert_toks: the air ##pass holder who w ##hing ##ed to the dallas check - in clerk that she had spent all day standing by for a flight out of one of america ' s less attractive airports was gently cha ##stis ##ed .

reference_raw: The ticket holder, whining to the Dallas check-in clerk, who had been waiting all day for a flight from one of America's less attractive airports, was mildly chastised.

reference_spacy_tokens: The ticket holder , whining to the Dallas check - in clerk , who had been waiting all day for a flight from one of America 's less attractive airports , was mildly chastised .


fn_spacy_tokens_for_baseline: In the adjoining Garden on the Ramparts stand two obelisks marking the place where the victims of the Defenestration fell in 1618 .

source_bert_toks: in the adjoining garden on the ramp ##arts stand two obe ##lis ##ks marking the place where the victims of the def ##enes ##tra ##tion fell in 1618 .

reference_raw: There are two obelisks in the adjacent garden on the Ramparts, marking the place where the Defenestration victims fell in 1618.

reference_spacy_tokens: There are two obelisks in the adjacent garden on the Ramparts , marking the place where the Defenestration victims fell in 1618 .


fn_spacy_tokens_for_baseline: Afterwards he was haunted by the sound his footsteps had made in the brooding post - dawn silence , the crunch and crackle of his shoes breaking ice .

source_bert_toks: afterwards he was haunted by the sound his footsteps had made in the brooding post - dawn silence , the crunch and crack ##le of his shoes breaking ice .

reference_raw: Then he was haunted by the sound of his steps in the brooding silence after dawn, by the crackling and crackling of his boots breaking ice.

reference_spacy_tokens: Then he was haunted by the sound of his steps in the brooding silence after dawn , by the crackling and crackling of his boots breaking ice .


fn_spacy_tokens_for_baseline: It was difficult to cross the moor in the dark , but at last we reached the light .

source_bert_toks: it was difficult to cross the moor in the dark , but at last we reached the light .

reference_raw: It was hard to get across the moor in the dark, but we finally got to the light.

reference_spacy_tokens: It was hard to get across the moor in the dark , but we finally got to the light .


fn_spacy_tokens_for_baseline: Only the Austrians seem able to outdo Germans in the quantities of food one is expected to eat in restaurants .

source_bert_toks: only the austrians seem able to out ##do germans in the quantities of food one is expected to eat in restaurants .

reference_raw: Only the Austrians seem to be able to outrun the Germans in the amount of food they expect to eat in restaurants.

reference_spacy_tokens: Only the Austrians seem to be able to outrun the Germans in the amount of food they expect to eat in restaurants .


fn_spacy_tokens_for_baseline: ' She made this a wonderful day for us and eased the pain tremendously . '

source_bert_toks: ' she made this a wonderful day for us and eased the pain tremendous ##ly . '

reference_raw: "She's made it a wonderful day for us, and she's greatly relieved the pain."

reference_spacy_tokens: " She 's made it a wonderful day for us , and she 's greatly relieved the pain . "


fn_spacy_tokens_for_baseline: ' Sixth place , ' he said , with a triumphant hoot .

source_bert_toks: ' sixth place , ' he said , with a triumphant ho ##ot .

reference_raw: "Sixth place," he said triumphantly.

reference_spacy_tokens: " Sixth place , " he said triumphantly .


fn_spacy_tokens_for_baseline: Lucy Keane , defending , said the tragedy arose from the mother 's unhappy childhood and adolescence and the unhappy relationship she had which resulted in the birth of her son .

source_bert_toks: lucy keane , defending , said the tragedy arose from the mother ' s unhappy childhood and adolescence and the unhappy relationship she had which resulted in the birth of her son .

reference_raw: Lucy Keane, who defended herself, said that the tragedy was the result of her mother's unfortunate childhood and adolescence and the unfortunate relationship that had led her son to be born.

reference_spacy_tokens: Lucy Keane , who defended herself , said that the tragedy was the result of her mother 's unfortunate childhood and adolescence and the unfortunate relationship that had led her son to be born .


fn_spacy_tokens_for_baseline: These disturbances typically evinced a High Church and Country Tory brand of Jacobitism .

source_bert_toks: these disturbances typically ev ##in ##ced a high church and country tory brand of jacob ##itis ##m .

reference_raw: These disturbances typically evoked the brand of Jacobitism in the High Church and Country Tory.

reference_spacy_tokens: These disturbances typically evoked the brand of Jacobitism in the High Church and Country Tory .


fn_spacy_tokens_for_baseline: She was like one walking in her sleep , but when they tried to get her into the train she came to life and struggled .

source_bert_toks: she was like one walking in her sleep , but when they tried to get her into the train she came to life and struggled .

reference_raw: She was like a man walking in his sleep, but when he tried to get her on a train, he came to life and fought.

reference_spacy_tokens: She was like a man walking in his sleep , but when he tried to get her on a train , he came to life and fought .


fn_spacy_tokens_for_baseline: One 1989 - 90 report , which will be referred to again in chapter 10 , concerned the sale of the Rover Group .

source_bert_toks: one 1989 - 90 report , which will be referred to again in chapter 10 , concerned the sale of the rover group .

reference_raw: One of the 1989-90 reports, which will be referred to again in Chapter 10, related to the sale of the Rover Group.

reference_spacy_tokens: One of the 1989 - 90 reports , which will be referred to again in Chapter 10 , related to the sale of the Rover Group .


fn_spacy_tokens_for_baseline: Solicitors are bound by strict rules that regulate their professional conduct and in the particular context of financial services there are important guidelines designed to protect the management or proper investment of your money : --

source_bert_toks: solicitor ##s are bound by strict rules that regulate their professional conduct and in the particular context of financial services there are important guidelines designed to protect the management or proper investment of your money : - -

reference_raw: Legal practitioners are bound by strict rules governing their professional behaviour and, in the specific context of financial services, there are important guidelines designed to protect the management or sound investment of your money: -

reference_spacy_tokens: Legal practitioners are bound by strict rules governing their professional behaviour and , in the specific context of financial services , there are important guidelines designed to protect the management or sound investment of your money : -


fn_spacy_tokens_for_baseline: It 's daft for you to get a stiff neck on the sofa when there 's room in my bed . '

source_bert_toks: it ' s da ##ft for you to get a stiff neck on the sofa when there ' s room in my bed . '

reference_raw: It's easy for you to have a stiff neck on the couch when there's room in my bed.'

reference_spacy_tokens: It 's easy for you to have a stiff neck on the couch when there 's room in my bed . '


fn_spacy_tokens_for_baseline: And this vacuum is the perfect breeding ground for the inflation of self - doubt and self - criticism , and increasingly unfounded imaginings about other people 's competence , or about their disdain towards oneself .

source_bert_toks: and this vacuum is the perfect breeding ground for the inflation of self - doubt and self - criticism , and increasingly un ##founded imagining ##s about other people ' s competence , or about their disdain towards oneself .

reference_raw: And this vacuum is the perfect breeding ground for inflation of self-doubt and self-criticism, and increasingly unwarranted fantasies about other people's abilities or their contempt for themselves.

reference_spacy_tokens: And this vacuum is the perfect breeding ground for inflation of self - doubt and self - criticism , and increasingly unwarranted fantasies about other people 's abilities or their contempt for themselves .


fn_spacy_tokens_for_baseline: ' Yes , let 's , ' she consented cuttingly .

source_bert_toks: ' yes , let ' s , ' she consent ##ed cutting ##ly .

reference_raw: 'Yes, we will,' she agreed curtly.

reference_spacy_tokens: ' Yes , we will , ' she agreed curtly .


fn_spacy_tokens_for_baseline: A lot of people said last year that I should n't have had a factory bike , so I was happy that my early results demonstrated I was worthy of an NSR .

source_bert_toks: a lot of people said last year that i shouldn ' t have had a factory bike , so i was happy that my early results demonstrated i was worthy of an ns ##r .

reference_raw: Last year, a lot of people said I wasn't supposed to have a factory bike, so I was glad my first results showed me worthy of the NSR.

reference_spacy_tokens: Last year , a lot of people said I was n't supposed to have a factory bike , so I was glad my first results showed me worthy of the NSR .


fn_spacy_tokens_for_baseline: First , the claim must arise or be outstanding on the termination of the employee 's employment .

source_bert_toks: first , the claim must arise or be outstanding on the termination of the employee ' s employment .

reference_raw: First, the claim must arise or become unpaid when the employee ceases to be employed.

reference_spacy_tokens: First , the claim must arise or become unpaid when the employee ceases to be employed .


fn_spacy_tokens_for_baseline: After a few minutes Jack groped for the bedside table .

source_bert_toks: after a few minutes jack gr ##oped for the bedside table .

reference_raw: After a few minutes, Jack fumbled for the nightstand.

reference_spacy_tokens: After a few minutes , Jack fumbled for the nightstand .


fn_spacy_tokens_for_baseline: The main items were a £ 1,000 grandfather clock , a square occasional table worth £ 900 , a Pembroke table , a tip - top table and £ 400 worth of wine .

source_bert_toks: the main items were a £1 , 000 grandfather clock , a square occasional table worth £ ##90 ##0 , a pembroke table , a tip - top table and £ ##400 worth of wine .

reference_raw: The main items consisted of a clock of £1,000 grandpa, a square occasional table of £900, a table of Pembroke, a table of tips, and a table of £400 worth of wine.

reference_spacy_tokens: The main items consisted of a clock of £ 1,000 grandpa , a square occasional table of £ 900 , a table of Pembroke , a table of tips , and a table of £ 400 worth of wine .


fn_spacy_tokens_for_baseline: But this sunny morning , she was expansive .

source_bert_toks: but this sunny morning , she was expansive .

reference_raw: But she was huge this sunny morning.

reference_spacy_tokens: But she was huge this sunny morning .


fn_spacy_tokens_for_baseline: When the time comes to recover the gold , the ripples are removed and the carpet is shaken .

source_bert_toks: when the time comes to recover the gold , the ripple ##s are removed and the carpet is shaken .

reference_raw: When the time comes for the gold to be recovered, the ripples will be removed and the carpet will tremble.

reference_spacy_tokens: When the time comes for the gold to be recovered , the ripples will be removed and the carpet will tremble .


fn_spacy_tokens_for_baseline: Imagining the worst , I phoned my doctor .

source_bert_toks: imagining the worst , i phone ##d my doctor .

reference_raw: I imagined the worst, so I called the doctor.

reference_spacy_tokens: I imagined the worst , so I called the doctor .


fn_spacy_tokens_for_baseline: The results corroborate the role of these proteins in pheromone transport and elaborate the structural basis of ligand binding .

source_bert_toks: the results co ##rro ##bor ##ate the role of these proteins in ph ##ero ##mon ##e transport and elaborate the structural basis of ligand binding .

reference_raw: The results confirm the role of these proteins in the transport of pheromone and develop a structural basis for ligand binding.

reference_spacy_tokens: The results confirm the role of these proteins in the transport of pheromone and develop a structural basis for ligand binding .


fn_spacy_tokens_for_baseline: His short doze in the living room had been long enough to keep him awake now .

source_bert_toks: his short do ##ze in the living room had been long enough to keep him awake now .

reference_raw: His brief sleep in the living room was long enough to keep him awake.

reference_spacy_tokens: His brief sleep in the living room was long enough to keep him awake .


fn_spacy_tokens_for_baseline: The larks went up , twittering in the scented air above the down .

source_bert_toks: the lark ##s went up , twitter ##ing in the scented air above the down .

reference_raw: The larks rose and twitched in the fragrant air above the ground.

reference_spacy_tokens: The larks rose and twitched in the fragrant air above the ground .


fn_spacy_tokens_for_baseline: ' They had already lost one boat , their clothes were in rags , and all they had to eat was mouldy flour and a few dried apples .

source_bert_toks: ' they had already lost one boat , their clothes were in rags , and all they had to eat was mo ##uld ##y flour and a few dried apples .

reference_raw: They'd lost a boat, their clothes were in rags, and all they had to eat was moldy flour and some dried apples.

reference_spacy_tokens: They 'd lost a boat , their clothes were in rags , and all they had to eat was moldy flour and some dried apples .


fn_spacy_tokens_for_baseline: Farriery was wanting in that fundamental science .

source_bert_toks: far ##rier ##y was wanting in that fundamental science .

reference_raw: Farriery had longed for this basic science.

reference_spacy_tokens: Farriery had longed for this basic science .


fn_spacy_tokens_for_baseline: So far , the debate about economic policy has been confined largely to technocrats and foreign advisers lodged in expensive hotels where one night costs around the average worker 's monthly wage .

source_bert_toks: so far , the debate about economic policy has been confined largely to techno ##crats and foreign advisers lodged in expensive hotels where one night costs around the average worker ' s monthly wage .

reference_raw: So far, the debate on economic policy has been largely limited to technocrats and foreign advisors kept in expensive hotels where one night costs about the average employee's monthly salary.

reference_spacy_tokens: So far , the debate on economic policy has been largely limited to technocrats and foreign advisors kept in expensive hotels where one night costs about the average employee 's monthly salary .


fn_spacy_tokens_for_baseline: ' Have you got any food ? ' said Adam hoarsely , hunching up sideways in the driver 's seat .

source_bert_toks: ' have you got any food ? ' said adam hoarse ##ly , hu ##nch ##ing up sideways in the driver ' s seat .

reference_raw: 'Do you have anything to eat?' said Adam hoarsely, crouching sideways in the driver's seat.

reference_spacy_tokens: ' Do you have anything to eat ? ' said Adam hoarsely , crouching sideways in the driver 's seat .


fn_spacy_tokens_for_baseline: At six weeks old , he was baptized with the names John Cyril at Holy Trinity Church , Rustenburg .

source_bert_toks: at six weeks old , he was baptized with the names john cyril at holy trinity church , rust ##enburg .

reference_raw: When he was six weeks old, he was christened by the name of John Cyril at the Church of the Holy Trinity in Rustenburg.

reference_spacy_tokens: When he was six weeks old , he was christened by the name of John Cyril at the Church of the Holy Trinity in Rustenburg .


fn_spacy_tokens_for_baseline: Vita laced her shoe .

source_bert_toks: vita laced her shoe .

reference_raw: Vita latched her boot.

reference_spacy_tokens: Vita latched her boot .


fn_spacy_tokens_for_baseline: Labour 's record on capital spending was lamentable .

source_bert_toks: labour ' s record on capital spending was lame ##nta ##ble .

reference_raw: Labour's record of capital expenditure was mournful.

reference_spacy_tokens: Labour 's record of capital expenditure was mournful .


fn_spacy_tokens_for_baseline: AOL would never have existed if it had been founded here , I am sure , since its employees would have been mocked into obscurity by the digerati .

source_bert_toks: ao ##l would never have existed if it had been founded here , i am sure , since its employees would have been mocked into ob ##scu ##rity by the dig ##era ##ti .

reference_raw: I'm sure AOL would never have existed if it had been established here, for its staff would have been mocked by the digerati into obscurity.

reference_spacy_tokens: I 'm sure AOL would never have existed if it had been established here , for its staff would have been mocked by the digerati into obscurity .


fn_spacy_tokens_for_baseline: The magistrates point to the problematical definition of crimes against humanity , which was last modified by the Court of Cassation in 1985 to clarify the Klaus Barbie case .

source_bert_toks: the magistrates point to the problematic ##al definition of crimes against humanity , which was last modified by the court of cass ##ation in 1985 to clarify the klaus barbie case .

reference_raw: Judges refer to the problematic definition of crimes against humanity, which was last amended by the Court of Cassation in 1985 to clarify the case of Klaus Barbie.

reference_spacy_tokens: Judges refer to the problematic definition of crimes against humanity , which was last amended by the Court of Cassation in 1985 to clarify the case of Klaus Barbie .