fn_spacy_tokens_for_baseline: The oak door clunked shut , and Jennifer realized that she had forgotten to curtsy , so she managed an awkward one without toppling over .

source_bert_toks: the oak door cl ##unk ##ed shut , and jennifer realized that she had forgotten to curt ##sy , so she managed an awkward one without top ##pling over .

reference_raw: The oak door slammed shut, and Jennifer realized she'd forgotten to bow, so she managed the awkward one without falling over.

reference_spacy_tokens: The oak door slammed shut , and Jennifer realized she 'd forgotten to bow , so she managed the awkward one without falling over .


fn_spacy_tokens_for_baseline: I think it almost does not matter what the judge does since it 's clear that the balance of power is shifting again , although it not clear where it will land .

source_bert_toks: i think it almost does not matter what the judge does since it ' s clear that the balance of power is shifting again , although it not clear where it will land .

reference_raw: I think it almost doesn't matter what the judge does, because it's clear that the balance of power is shifting again, though it's not clear where it's going to land.

reference_spacy_tokens: I think it almost does n't matter what the judge does , because it 's clear that the balance of power is shifting again , though it 's not clear where it 's going to land .


fn_spacy_tokens_for_baseline: He squatted down and propped it against a clump of little bushes , pulling up the aerial as far as it would go .

source_bert_toks: he squat ##ted down and propped it against a cl ##ump of little bushes , pulling up the aerial as far as it would go .

reference_raw: He crouched, leaned it against a cluster of small bushes, and pulled the antenna as far as he could.

reference_spacy_tokens: He crouched , leaned it against a cluster of small bushes , and pulled the antenna as far as he could .


fn_spacy_tokens_for_baseline: " There are a lot of issues I want to take a look at , but the issue of humanitarian concerns is number one , " he said .

source_bert_toks: " there are a lot of issues i want to take a look at , but the issue of humanitarian concerns is number one , " he said .

reference_raw: "There are many questions I'd like to examine, but the question of humanitarian concern is number one," he said.

reference_spacy_tokens: " There are many questions I 'd like to examine , but the question of humanitarian concern is number one , " he said .


fn_spacy_tokens_for_baseline: But the attacks helped foster a sense that large swaths of the country are unsafe .

source_bert_toks: but the attacks helped foster a sense that large swat ##hs of the country are unsafe .

reference_raw: But the attacks have helped to increase the sense that the great swaths of the country are dangerous.

reference_spacy_tokens: But the attacks have helped to increase the sense that the great swaths of the country are dangerous .


fn_spacy_tokens_for_baseline: He grinned and pointed to a hand - written notice pinned to a nearby post .

source_bert_toks: he grinned and pointed to a hand - written notice pinned to a nearby post .

reference_raw: He smiled and pointed to a handwritten note nailed to a nearby post.

reference_spacy_tokens: He smiled and pointed to a handwritten note nailed to a nearby post .


fn_spacy_tokens_for_baseline: From the church came a dual impulse strengthening this morality : the prevailing teaching on sexual abstention outside of marriage under pain of mortal sin , and the rigorous life of a clergy pledged to chastity and preaching the need for an unmarried laity to practise the same degree and kind of circumspection in sexual matters which the clergy had been taught to impose upon themselves .

source_bert_toks: from the church came a dual impulse strengthening this morality : the prevailing teaching on sexual abs ##ten ##tion outside of marriage under pain of mortal sin , and the rigorous life of a clergy pledged to cha ##sti ##ty and preaching the need for an unmarried lai ##ty to pr ##act ##ise the same degree and kind of ci ##rc ##ums ##pe ##ction in sexual matters which the clergy had been taught to impose upon themselves .

reference_raw: There was a dual impulse from the church to strengthen this morality: the predominant teaching of sexual abstinence outside marriage under the pain of a mortal sin, and the strict life of a priest committed to chastity and preaching the need for unmarried laity to exercise the same degree of caution in sexual matters that the priests were taught to impose on themselves.

reference_spacy_tokens: There was a dual impulse from the church to strengthen this morality : the predominant teaching of sexual abstinence outside marriage under the pain of a mortal sin , and the strict life of a priest committed to chastity and preaching the need for unmarried laity to exercise the same degree of caution in sexual matters that the priests were taught to impose on themselves .


fn_spacy_tokens_for_baseline: Let me say finally , that it 's my intention that we should all starve together , or all survive together . '

source_bert_toks: let me say finally , that it ' s my intention that we should all star ##ve together , or all survive together . '

reference_raw: I'm going to say at last that I want all of us to go hungry together, or all of us to survive together.'

reference_spacy_tokens: I 'm going to say at last that I want all of us to go hungry together , or all of us to survive together . '


fn_spacy_tokens_for_baseline: Despite his arrogance and cruelty towards opponents , he had been a remarkably enlightened and often liberal and generous ruler .

source_bert_toks: despite his arrogance and cruelty towards opponents , he had been a remarkably en ##light ##ened and often liberal and generous ruler .

reference_raw: Despite his arrogance and cruelty to the adversaries, he was a remarkably illuminated, often liberal, and generous ruler.

reference_spacy_tokens: Despite his arrogance and cruelty to the adversaries , he was a remarkably illuminated , often liberal , and generous ruler .


fn_spacy_tokens_for_baseline: Drumheller told the Post he was surprised when a few days later , on February 5 , 2003 , Powell told the U.N. Security Council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

source_bert_toks: drum ##hell ##er told the post he was surprised when a few days later , on february 5 , 2003 , powell told the u . n . security council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

reference_raw: Drumheller said to the Post that he was surprised when a few days later, on February 5, 2003, Powell said to the UN Security Council, "We have a first-hand description of the bio-weapons factories on bicycles and rails."

reference_spacy_tokens: Drumheller said to the Post that he was surprised when a few days later , on February 5 , 2003 , Powell said to the UN Security Council , " We have a first - hand description of the bio - weapons factories on bicycles and rails . "


fn_spacy_tokens_for_baseline: The muzzle flash illuminated Farrell and the yard around him for several feet as he raked the sub - gun back and forth , spent cartridge cases spewing from the weapon ; smoke and steam rising into the damp air .

source_bert_toks: the muzzle flash illuminated farrell and the yard around him for several feet as he raked the sub - gun back and forth , spent cartridge cases sp ##ew ##ing from the weapon ; smoke and steam rising into the damp air .

reference_raw: Farrell and the courtyard around him were illuminated by the muzzle flicker of a few feet as he raked the sub-gun back and forth, the spent cartridges spewing from the weapon; smoke and steam rose in the damp air.

reference_spacy_tokens: Farrell and the courtyard around him were illuminated by the muzzle flicker of a few feet as he raked the sub - gun back and forth , the spent cartridges spewing from the weapon ; smoke and steam rose in the damp air .


fn_spacy_tokens_for_baseline: Black , stinking water is covered by a thick green scum , which crawls with bugs , centipedes , bloated flies and worse .

source_bert_toks: black , stink ##ing water is covered by a thick green sc ##um , which crawl ##s with bugs , cent ##ipe ##des , b ##lo ##ated flies and worse .

reference_raw: The black, stinking water is covered with a thick green filth that clutters with bugs, centipedes, bloated flies, and worse.

reference_spacy_tokens: The black , stinking water is covered with a thick green filth that clutters with bugs , centipedes , bloated flies , and worse .


fn_spacy_tokens_for_baseline: Yet the liberal interpretation of divorce laws appears to have led to the alarming trends already observed .

source_bert_toks: yet the liberal interpretation of divorce laws appears to have led to the alarm ##ing trends already observed .

reference_raw: However, the free interpretation of divorce laws seems to have led to the alarming trends that have already been observed.

reference_spacy_tokens: However , the free interpretation of divorce laws seems to have led to the alarming trends that have already been observed .


fn_spacy_tokens_for_baseline: It was wrong what he did but he should be shown compassion . '

source_bert_toks: it was wrong what he did but he should be shown compassion . '

reference_raw: What he did wasn't right, but you should show him mercy.'

reference_spacy_tokens: What he did was n't right , but you should show him mercy . '


fn_spacy_tokens_for_baseline: Iran is suspected of having developed such a capability with aid from individuals and companies in the West , as well as India and China .

source_bert_toks: iran is suspected of having developed such a capability with aid from individuals and companies in the west , as well as india and china .

reference_raw: Iran is suspected to have developed such capacity with support from individuals and companies in the West, as well as from India and China.

reference_spacy_tokens: Iran is suspected to have developed such capacity with support from individuals and companies in the West , as well as from India and China .


fn_spacy_tokens_for_baseline: They were a barbaric race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

source_bert_toks: they were a bar ##bari ##c race , and their custody of the area brought about a dark period during which the written word was forgotten and art disappeared .

reference_raw: It was a barbaric race, and their care for the area had led to a dark period during which the written word had been forgotten and the craft had vanished.

reference_spacy_tokens: It was a barbaric race , and their care for the area had led to a dark period during which the written word had been forgotten and the craft had vanished .


fn_spacy_tokens_for_baseline: The magnificent frescoes and mosaics found at Akrotiri are in Athens at present , but the remains of the buildings at the site provide ample evidence of the sophistication of the culture here .

source_bert_toks: the magnificent frescoes and mosaic ##s found at ak ##rot ##iri are in athens at present , but the remains of the buildings at the site provide ample evidence of the so ##phi ##stic ##ation of the culture here .

reference_raw: The magnificent frescoes and mosaics found in Akrotiri are currently in Athens, but the remains of the buildings on the scene provide sufficient evidence of the sophistication of the culture here.

reference_spacy_tokens: The magnificent frescoes and mosaics found in Akrotiri are currently in Athens , but the remains of the buildings on the scene provide sufficient evidence of the sophistication of the culture here .


fn_spacy_tokens_for_baseline: Once the turkey is defrosted , remove the giblets , keep it in a fridge and cook within 24 hours .

source_bert_toks: once the turkey is def ##ros ##ted , remove the gi ##ble ##ts , keep it in a fridge and cook within 24 hours .

reference_raw: Once the turkey has been frozen, remove the giblets, store them in the refrigerator and cook within 24 hours.

reference_spacy_tokens: Once the turkey has been frozen , remove the giblets , store them in the refrigerator and cook within 24 hours .


fn_spacy_tokens_for_baseline: With unemployment at its lowest point in years in central Indiana , many people still have a hard time finding meaningful employment .

source_bert_toks: with unemployment at its lowest point in years in central indiana , many people still have a hard time finding meaningful employment .

reference_raw: With unemployment at the lowest point in the years in Central Indiana, many people still find it difficult to find meaningful jobs.

reference_spacy_tokens: With unemployment at the lowest point in the years in Central Indiana , many people still find it difficult to find meaningful jobs .


fn_spacy_tokens_for_baseline: I fought for breath between heaves , snatching down flecks of vomit and coughing and spewing at the same time .

source_bert_toks: i fought for breath between he ##aves , snatch ##ing down fl ##eck ##s of vomit and coughing and sp ##ew ##ing at the same time .

reference_raw: I struggled to catch my breath between the heaves, plucking away the drops of vomit and coughing and spouting at the same time.

reference_spacy_tokens: I struggled to catch my breath between the heaves , plucking away the drops of vomit and coughing and spouting at the same time .


fn_spacy_tokens_for_baseline: But there is no evidence of such a direct link between the Bootle killing and screen violence , and many people may find such speculation insensitive and distasteful at this stage .

source_bert_toks: but there is no evidence of such a direct link between the boot ##le killing and screen violence , and many people may find such speculation ins ##ens ##itive and di ##sta ##ste ##ful at this stage .

reference_raw: But there is no evidence of such a direct link between the killing of the Bootle and the screening of violence, and at this stage many people may find such speculation unfeeling and disgusting.

reference_spacy_tokens: But there is no evidence of such a direct link between the killing of the Bootle and the screening of violence , and at this stage many people may find such speculation unfeeling and disgusting .


fn_spacy_tokens_for_baseline: He is charged with the murder of all three women , his wife , daughter and mother - in - law sometime between the 14th and 20th of August .

source_bert_toks: he is charged with the murder of all three women , his wife , daughter and mother - in - law sometime between the 14th and 20th of august .

reference_raw: He's been charged with the murder of all three women, his wife, daughter and father-in-law, sometime between August 14 and 20.

reference_spacy_tokens: He 's been charged with the murder of all three women , his wife , daughter and father - in - law , sometime between August 14 and 20 .


fn_spacy_tokens_for_baseline: You have to stash it somewhere out of sight .

source_bert_toks: you have to st ##ash it somewhere out of sight .

reference_raw: You've got to hide it somewhere out of sight.

reference_spacy_tokens: You 've got to hide it somewhere out of sight .


fn_spacy_tokens_for_baseline: This created a pattern seen today throughout the Aegean of a small port ( skala ) which serves an inland settlement or chora , making it easier to protect the island from attack .

source_bert_toks: this created a pattern seen today throughout the aegean of a small port ( ska ##la ) which serves an inland settlement or cho ##ra , making it easier to protect the island from attack .

reference_raw: This created a model seen today across the Aegean of a small port (skala) serving an inland settlement or chora, which facilitates the protection of the island from attack.

reference_spacy_tokens: This created a model seen today across the Aegean of a small port ( skala ) serving an inland settlement or chora , which facilitates the protection of the island from attack .


fn_spacy_tokens_for_baseline: It 's , he is such an awful actor !

source_bert_toks: it ' s , he is such an awful actor !

reference_raw: He's a terrible actor!

reference_spacy_tokens: He 's a terrible actor !


fn_spacy_tokens_for_baseline: ' Initiation ' was a particularly strong piece , well drawn and lusciously coloured with the woman gazing directly out carrying a severed head in one hand whilst a chubby cupid somersaults in glee .

source_bert_toks: ' initiation ' was a particularly strong piece , well drawn and lu ##sc ##iously coloured with the woman gazing directly out carrying a severed head in one hand whilst a chu ##bby cup ##id some ##rsa ##ult ##s in glee .

reference_raw: "Initiation" was a particularly strong piece, well-drawn and lusciously colored, with a woman staring straight out, with a severed head in one hand, while a plump cupid sorceries in glee.

reference_spacy_tokens: " Initiation " was a particularly strong piece , well - drawn and lusciously colored , with a woman staring straight out , with a severed head in one hand , while a plump cupid sorceries in glee .


fn_spacy_tokens_for_baseline: One possibility is that studies report different estimates of the single true relationship between a given pollutant and a health effect due to differences in study design , random chance , or other factors .

source_bert_toks: one possibility is that studies report different estimates of the single true relationship between a given poll ##uta ##nt and a health effect due to differences in study design , random chance , or other factors .

reference_raw: One possibility is that studies report different estimates of a single true relationship between a pollutant and a health effect due to differences in the design of the study, random coincidence or other factors.

reference_spacy_tokens: One possibility is that studies report different estimates of a single true relationship between a pollutant and a health effect due to differences in the design of the study , random coincidence or other factors .


fn_spacy_tokens_for_baseline: On May 31 , in the southern mountains of Colombia , 130 members of the Quintin Lame group surrendered their weapons to the authorities .

source_bert_toks: on may 31 , in the southern mountains of colombia , 130 members of the qui ##nti ##n lame group surrendered their weapons to the authorities .

reference_raw: On May 31, 130 members of the Quintin Lame group in the southern mountains of Colombia gave their weapons to the authorities.

reference_spacy_tokens: On May 31 , 130 members of the Quintin Lame group in the southern mountains of Colombia gave their weapons to the authorities .


fn_spacy_tokens_for_baseline: The lookout point at Lok Ma Chau was once known as Hong Kong 's " window on China " - in the years of China 's isolation from the West , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

source_bert_toks: the lookout point at lok ma cha ##u was once known as hong kong ' s " window on china " - in the years of china ' s isolation from the west , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

reference_raw: The watchpoint at Lok Ma Chau was once known as Hong Kong's "China Window" - in the years of China's isolation from the West, tourists would come here and rent telescopes to see the great mystery behind them.

reference_spacy_tokens: The watchpoint at Lok Ma Chau was once known as Hong Kong 's " China Window " - in the years of China 's isolation from the West , tourists would come here and rent telescopes to see the great mystery behind them .


fn_spacy_tokens_for_baseline: The door bumped against whoever it was who 'd begun to open it .

source_bert_toks: the door bumped against whoever it was who ' d begun to open it .

reference_raw: The door hit whoever it was that started to open it.

reference_spacy_tokens: The door hit whoever it was that started to open it .


fn_spacy_tokens_for_baseline: I suppose the , the example of that is where a house wall was pushed in by the , the mass that was thronging outside the Brunwick gates .

source_bert_toks: i suppose the , the example of that is where a house wall was pushed in by the , the mass that was th ##rong ##ing outside the br ##un ##wick gates .

reference_raw: I think the example of this is where the wall of the house was pushed in, the mass that was crowding in front of the Brunwick Gate.

reference_spacy_tokens: I think the example of this is where the wall of the house was pushed in , the mass that was crowding in front of the Brunwick Gate .


fn_spacy_tokens_for_baseline: Thus , the possibility of social democracy is also neatly nipped in the bud .

source_bert_toks: thus , the possibility of social democracy is also neatly ni ##pped in the bud .

reference_raw: So the possibility of social democracy is also neatly nibbled in the bud.

reference_spacy_tokens: So the possibility of social democracy is also neatly nibbled in the bud .


fn_spacy_tokens_for_baseline: Cupboard doors were flying , the trash can in the kitchen walked a few feet , the dogs came running , and I scooted them into the dog run and stood in the doorway myself , watching the outside trash cans dance across the concrete .

source_bert_toks: cupboard doors were flying , the trash can in the kitchen walked a few feet , the dogs came running , and i scooted them into the dog run and stood in the doorway myself , watching the outside trash cans dance across the concrete .

reference_raw: The door to the closet flew, the garbage can in the kitchen walked a few yards, the dogs ran, and I scooted them into the dog run, and I stood in the doorway myself, watching the outdoor garbage cans dance on the concrete.

reference_spacy_tokens: The door to the closet flew , the garbage can in the kitchen walked a few yards , the dogs ran , and I scooted them into the dog run , and I stood in the doorway myself , watching the outdoor garbage cans dance on the concrete .


fn_spacy_tokens_for_baseline: Outside the nurses were clattering the tea - cups .

source_bert_toks: outside the nurses were cl ##atter ##ing the tea - cups .

reference_raw: Outside, the nurses rattled cups of tea.

reference_spacy_tokens: Outside , the nurses rattled cups of tea .


fn_spacy_tokens_for_baseline: That amount is convertible into shares of Meridian common stock at $ 2 a share during its one - year term .

source_bert_toks: that amount is convertible into shares of meridian common stock at $ 2 a share during its one - year term .

reference_raw: This amount shall be convertible into shares in Meridian ordinary shares at a rate of $2 per share over a period of one year.

reference_spacy_tokens: This amount shall be convertible into shares in Meridian ordinary shares at a rate of $ 2 per share over a period of one year .


fn_spacy_tokens_for_baseline: Brian 's childhood memories are of days filled with happiness and laughter .

source_bert_toks: brian ' s childhood memories are of days filled with happiness and laughter .

reference_raw: Brian's childhood recollections are days of happiness and laughter.

reference_spacy_tokens: Brian 's childhood recollections are days of happiness and laughter .


fn_spacy_tokens_for_baseline: She could imagine it clanging across the hall , up the stairway , along the draughty corridors , around the drawing - room and out through the open windows .

source_bert_toks: she could imagine it clan ##ging across the hall , up the stairway , along the draught ##y corridors , around the drawing - room and out through the open windows .

reference_raw: She could imagine him crashing down the hall, up the stairs, down the draughty corridors, around the drawing-room, through the open windows.

reference_spacy_tokens: She could imagine him crashing down the hall , up the stairs , down the draughty corridors , around the drawing - room , through the open windows .


fn_spacy_tokens_for_baseline: Rather they appeared to be just incomplete or abandoned .

source_bert_toks: rather they appeared to be just incomplete or abandoned .

reference_raw: On the contrary, it seemed that they were unfinished or abandoned.

reference_spacy_tokens: On the contrary , it seemed that they were unfinished or abandoned .


fn_spacy_tokens_for_baseline: The people farmed and fished ; on the dawning of the Bronze Age in 2700 b.c . , they began to work with metals .

source_bert_toks: the people farm ##ed and fished ; on the dawn ##ing of the bronze age in 270 ##0 b . c . , they began to work with metals .

reference_raw: Humans farmed and hunted; by the dawn of the Bronze Age in 2700 B.C., they began working with metals.

reference_spacy_tokens: Humans farmed and hunted ; by the dawn of the Bronze Age in 2700 B.C. , they began working with metals .


fn_spacy_tokens_for_baseline: The bloodshed in Lebanon appears to be part of a broader upsurge in unrest .

source_bert_toks: the blood ##shed in lebanon appears to be part of a broader ups ##urg ##e in unrest .

reference_raw: The massacre in Lebanon seems to be part of a wider uprising in riots.

reference_spacy_tokens: The massacre in Lebanon seems to be part of a wider uprising in riots .


fn_spacy_tokens_for_baseline: ' I 'm not a salesman , ' Grimwood bleated .

source_bert_toks: ' i ' m not a salesman , ' grim ##wood b ##lea ##ted .

reference_raw: 'I don't sell,' said Grimwood.

reference_spacy_tokens: ' I do n't sell , ' said Grimwood .


fn_spacy_tokens_for_baseline: This states that individuals will value currencies for the bundle of goods that can be purchased with them .

source_bert_toks: this states that individuals will value cu ##rre ##ncies for the bundle of goods that can be purchased with them .

reference_raw: It states that individuals will appreciate the currency of a package of goods they can buy with them.

reference_spacy_tokens: It states that individuals will appreciate the currency of a package of goods they can buy with them .


fn_spacy_tokens_for_baseline: Browsing is a real pleasure in Macau 's main streets and byways , where shops aimed at the tourist market are interspersed with the more workaday ironmongers , herbalists , and noodle stalls .

source_bert_toks: brows ##ing is a real pleasure in macau ' s main streets and by ##ways , where shops aimed at the tourist market are interspersed with the more work ##aday iron ##mon ##gers , herbal ##ists , and no ##odle stalls .

reference_raw: Browsing is a real pleasure in the main streets and byways of Macao, where shops aimed at the tourism market are intertwined with more day-to-day ironmongers, herbalists, and noodle stalls.

reference_spacy_tokens: Browsing is a real pleasure in the main streets and byways of Macao , where shops aimed at the tourism market are intertwined with more day - to - day ironmongers , herbalists , and noodle stalls .


fn_spacy_tokens_for_baseline: It 's anyone 's guess what may happen in the future , but for now Hong Kong bristles with energy and ambition , and for the visitor , this beautiful city with its contrasts and variety is an exhilarating experience .

source_bert_toks: it ' s anyone ' s guess what may happen in the future , but for now hong kong br ##istles with energy and ambition , and for the visitor , this beautiful city with its contrasts and variety is an ex ##hila ##rating experience .

reference_raw: It is anyone's guess as to what might happen in the future, but for now Hong Kong is bristling with energy and ambition, and for visitors, this beautiful city with its contrasts and diversity is a thrilling experience.

reference_spacy_tokens: It is anyone 's guess as to what might happen in the future , but for now Hong Kong is bristling with energy and ambition , and for visitors , this beautiful city with its contrasts and diversity is a thrilling experience .


fn_spacy_tokens_for_baseline: The place is devoid of alcoholic recourse , even the bands ' riders are untroubled by hard liquor , shit , we 're all going to have to take crack instead !

source_bert_toks: the place is devoid of alcoholic rec ##ours ##e , even the bands ' riders are un ##tro ##ub ##led by hard liquor , shit , we ' re all going to have to take crack instead !

reference_raw: There's no alcohol use in this place, even the band's riders aren't worried about hard liquor, shit, we'll all have to go for a break instead!

reference_spacy_tokens: There 's no alcohol use in this place , even the band 's riders are n't worried about hard liquor , shit , we 'll all have to go for a break instead !


fn_spacy_tokens_for_baseline: As winter approaches it makes sense to include details of the school 's procedures for short notice closures with a reassurance that young children will never be sent off to an empty home .

source_bert_toks: as winter approaches it makes sense to include details of the school ' s procedures for short notice closure ##s with a re ##ass ##urance that young children will never be sent off to an empty home .

reference_raw: As winter approaches, it makes sense to include details of school's short-term closure procedures with assurance that young children will never be sent to an empty home.

reference_spacy_tokens: As winter approaches , it makes sense to include details of school 's short - term closure procedures with assurance that young children will never be sent to an empty home .


fn_spacy_tokens_for_baseline: I beckoned her to come in and have coffee , but she shook her head and tapped on the glass again and mouthed the words , ' I want you , ' like a trapped goldfish .

source_bert_toks: i beck ##oned her to come in and have coffee , but she shook her head and tapped on the glass again and mouthed the words , ' i want you , ' like a trapped gold ##fish .

reference_raw: I motioned for her to come in for a cup of coffee, but she shook her head, tapped the glass again, and said, "I want you," like a trapped goldfish.

reference_spacy_tokens: I motioned for her to come in for a cup of coffee , but she shook her head , tapped the glass again , and said , " I want you , " like a trapped goldfish .


fn_spacy_tokens_for_baseline: Each year on San Juan , a hundred thousand bonfires dot the slopes of the huge crater which holds La Paz .

source_bert_toks: each year on san juan , a hundred thousand bonfire ##s dot the slopes of the huge crater which holds la paz .

reference_raw: Every year on San Juan, hundreds of thousands of fires permeate the slopes of the great crater that holds La Paz.

reference_spacy_tokens: Every year on San Juan , hundreds of thousands of fires permeate the slopes of the great crater that holds La Paz .


fn_spacy_tokens_for_baseline: The paramedics resuscitated Dawn , who had stopped breathing , and they later received the Queen 's Award for their prompt action .

source_bert_toks: the para ##med ##ics res ##us ##cit ##ated dawn , who had stopped breathing , and they later received the queen ' s award for their prompt action .

reference_raw: The medics revived Dawn, who stopped breathing, and later received the Queen's Award for their immediate action.

reference_spacy_tokens: The medics revived Dawn , who stopped breathing , and later received the Queen 's Award for their immediate action .


fn_spacy_tokens_for_baseline: Rolled up , admittedly , but those things can be opened and inflated from their gas cylinders in seconds .

source_bert_toks: rolled up , admitted ##ly , but those things can be opened and inflated from their gas cylinders in seconds .

reference_raw: It's rolled up, I'm sure, but these things can be opened and blown out of the gas cylinders in a matter of seconds.

reference_spacy_tokens: It 's rolled up , I 'm sure , but these things can be opened and blown out of the gas cylinders in a matter of seconds .


fn_spacy_tokens_for_baseline: Providing they entertain us with stupendous performances , who cares if sponsors want to make them millionaires .

source_bert_toks: providing they entertain us with stu ##pen ##dou ##s performances , who cares if sponsors want to make them millionaire ##s .

reference_raw: Provided we're entertained by staggering performances, who cares if the sponsors want to turn them into millionaires.

reference_spacy_tokens: Provided we 're entertained by staggering performances , who cares if the sponsors want to turn them into millionaires .


fn_spacy_tokens_for_baseline: ' Well , ' Melissa murmured aloud as she listened to his footsteps pattering through the hall , followed by the slam of the outer door , ' there goes a man with a guilty secret .

source_bert_toks: ' well , ' melissa murmured aloud as she listened to his footsteps pat ##tering through the hall , followed by the slam of the outer door , ' there goes a man with a guilty secret .

reference_raw: "Well," Melissa whispered loudly, listening to his footsteps patting down the corridor, followed by the slam of the outer door, "there's a man with a guilty secret.

reference_spacy_tokens: " Well , " Melissa whispered loudly , listening to his footsteps patting down the corridor , followed by the slam of the outer door , " there 's a man with a guilty secret .


fn_spacy_tokens_for_baseline: POOL wizard Daz Ward potted a £ 100,000 windfall yesterday after being plucked off the dole queue .

source_bert_toks: pool wizard da ##z ward pot ##ted a £100 , 000 wind ##fall yesterday after being plucked off the do ##le queue .

reference_raw: The POOL magician, Daz Ward, potted a £100,000 windfall last night after he was pulled out of the dole line.

reference_spacy_tokens: The POOL magician , Daz Ward , potted a £ 100,000 windfall last night after he was pulled out of the dole line .


fn_spacy_tokens_for_baseline: Providing an influx of $ 165 million to the southwestern economy , Hoover Dam played a major role in preventing Las Vegas from drying up , both financially and literally .

source_bert_toks: providing an influx of $ 165 million to the southwestern economy , hoover dam played a major role in preventing las vegas from drying up , both financially and literally .

reference_raw: With an inflow of $165 million to the southwest economy, Hoover Dam played an important role in preventing Las Vegas from drying, both financially and literally.

reference_spacy_tokens: With an inflow of $ 165 million to the southwest economy , Hoover Dam played an important role in preventing Las Vegas from drying , both financially and literally .


fn_spacy_tokens_for_baseline: Her fingers were fusing into claws .

source_bert_toks: her fingers were fu ##sing into claws .

reference_raw: Her fingers flicked into claws.

reference_spacy_tokens: Her fingers flicked into claws .


fn_spacy_tokens_for_baseline: She yanked Anna toward the car and did n't stop even when the child stumbled and almost fell .

source_bert_toks: she yanked anna toward the car and didn ' t stop even when the child stumbled and almost fell .

reference_raw: She jerked Anna to the car and did not stop when the child stumbled and nearly fell.

reference_spacy_tokens: She jerked Anna to the car and did not stop when the child stumbled and nearly fell .


fn_spacy_tokens_for_baseline: We are concerned that S. 556 's short timeframes for installation of controls could lead power plants to be taken off - line at important times , which could lead to electricity shortages .

source_bert_toks: we are concerned that s . 55 ##6 ' s short time ##frame ##s for installation of controls could lead power plants to be taken off - line at important times , which could lead to electricity shortages .

reference_raw: We fear that the short timeframes of S. 556 for the installation of checks may lead to the shutdown of power plants at important times, which may lead to a shortage of electricity.

reference_spacy_tokens: We fear that the short timeframes of S. 556 for the installation of checks may lead to the shutdown of power plants at important times , which may lead to a shortage of electricity .


fn_spacy_tokens_for_baseline: The problem is that the Labour party dodges all the important European issues because its conversion to the EC is not so much skin deep as ruled purely by expediency .

source_bert_toks: the problem is that the labour party dodge ##s all the important european issues because its conversion to the ec is not so much skin deep as ruled purely by ex ##ped ##ien ##cy .

reference_raw: The problem is that the Labour Party avoids all important European issues, because its conversion to the EC is not as deep as it is governed exclusively by expediency.

reference_spacy_tokens: The problem is that the Labour Party avoids all important European issues , because its conversion to the EC is not as deep as it is governed exclusively by expediency .


fn_spacy_tokens_for_baseline: Type of fixation may influence the accessibility of the PCNA protein to antibody detection although results from other studies do not support this conclusion .

source_bert_toks: type of fix ##ation may influence the accessibility of the pc ##na protein to antibody detection although results from other studies do not support this conclusion .

reference_raw: The type of fixation may affect the availability of the PCNA protein to detect antibodies, even if the results of other studies do not substantiate this conclusion.

reference_spacy_tokens: The type of fixation may affect the availability of the PCNA protein to detect antibodies , even if the results of other studies do not substantiate this conclusion .


fn_spacy_tokens_for_baseline: ' Good lord , ' he said , hitting his head against the top of the door frame .

source_bert_toks: ' good lord , ' he said , hitting his head against the top of the door frame .

reference_raw: "Good Lord," he said, striking the top of the door frame with his head.

reference_spacy_tokens: " Good Lord , " he said , striking the top of the door frame with his head .


fn_spacy_tokens_for_baseline: Their lambent glow danced over her sable - dark hair , touched her face briefly , then slid reluctantly away as she moved into the shadows between each one .

source_bert_toks: their lamb ##ent glow danced over her sable - dark hair , touched her face briefly , then slid reluctantly away as she moved into the shadows between each one .

reference_raw: Their bright glow danced across her sable-dark hair, touched her cheek for a moment, then slid back reluctantly as she moved into the shadows between them.

reference_spacy_tokens: Their bright glow danced across her sable - dark hair , touched her cheek for a moment , then slid back reluctantly as she moved into the shadows between them .


fn_spacy_tokens_for_baseline: I drive back to the hotel with Lucker swigging at a litre bottle of vodka beside me .

source_bert_toks: i drive back to the hotel with luck ##er sw ##ig ##ging at a litre bottle of vodka beside me .

reference_raw: I'm going back to the hotel with Lucker sipping at a liter bottle of vodka next to me.

reference_spacy_tokens: I 'm going back to the hotel with Lucker sipping at a liter bottle of vodka next to me .


fn_spacy_tokens_for_baseline: The truck smashed into the barrier , broke through it , lurched down an embankment .

source_bert_toks: the truck smashed into the barrier , broke through it , lurched down an embankment .

reference_raw: The truck hit the barrier, broke through it, and lurched down the embankment.

reference_spacy_tokens: The truck hit the barrier , broke through it , and lurched down the embankment .


fn_spacy_tokens_for_baseline: He took her to a rather smart Italian restaurant full of intimate little tables far too close together for private conversation .

source_bert_toks: he took her to a rather smart italian restaurant full of intimate little tables far too close together for private conversation .

reference_raw: He took her to a rather clever Italian restaurant full of intimacy tables too close to each other for private conversations.

reference_spacy_tokens: He took her to a rather clever Italian restaurant full of intimacy tables too close to each other for private conversations .


fn_spacy_tokens_for_baseline: Lorton opened the door , and the dachshund rushed in , yapping furiously .

source_bert_toks: lo ##rton opened the door , and the da ##chs ##hun ##d rushed in , ya ##pping furiously .

reference_raw: Lorton opened the door, and the dachshund rushed in, barking furiously.

reference_spacy_tokens: Lorton opened the door , and the dachshund rushed in , barking furiously .


fn_spacy_tokens_for_baseline: The old house with its atmosphere of murder , the singular and formidable inhabitants , the unknown dangers of the approach , and the fact that we were putting ourselves legally in a false position all combined to damp my ardour .

source_bert_toks: the old house with its atmosphere of murder , the singular and formidable inhabitants , the unknown dangers of the approach , and the fact that we were putting ourselves legally in a false position all combined to damp my ar ##dou ##r .

reference_raw: The old house with its atmosphere of murder, the unique and formidable inhabitants, the unidentified dangers of our approach, and the fact that we were legally in a false position, all combined to dampen my passion.

reference_spacy_tokens: The old house with its atmosphere of murder , the unique and formidable inhabitants , the unidentified dangers of our approach , and the fact that we were legally in a false position , all combined to dampen my passion .


fn_spacy_tokens_for_baseline: Compared to Martin Amis , though , Barnes is positively garrulous .

source_bert_toks: compared to martin ami ##s , though , barnes is positively ga ##rr ##ulous .

reference_raw: But compared to Martin Amis, Barnes has a positive look.

reference_spacy_tokens: But compared to Martin Amis , Barnes has a positive look .


fn_spacy_tokens_for_baseline: She was nursing her fifth cup of awful coffee .

source_bert_toks: she was nursing her fifth cup of awful coffee .

reference_raw: She was taking care of her fifth cup of terrible coffee.

reference_spacy_tokens: She was taking care of her fifth cup of terrible coffee .


fn_spacy_tokens_for_baseline: It could point to plenty of ailments that the Spanish economic rejuvenation so far has failed to cure .

source_bert_toks: it could point to plenty of ai ##lm ##ents that the spanish economic re ##ju ##ven ##ation so far has failed to cure .

reference_raw: It could point to a number of diseases that the Spanish economic rejuvenation has not yet healed.

reference_spacy_tokens: It could point to a number of diseases that the Spanish economic rejuvenation has not yet healed .


fn_spacy_tokens_for_baseline: I kept my head down and pretended to be consuming the scraps left on my dish .

source_bert_toks: i kept my head down and pretended to be consuming the scrap ##s left on my dish .

reference_raw: I kept my head down and pretended to eat the scraps I had left on my plate.

reference_spacy_tokens: I kept my head down and pretended to eat the scraps I had left on my plate .


fn_spacy_tokens_for_baseline: We recommend cleansing in the morning with a facial was or bar -- both refreshing but non - drying alternatives to tissue - off milks .

source_bert_toks: we recommend cleansing in the morning with a facial was or bar - - both refreshing but non - drying alternatives to tissue - off milk ##s .

reference_raw: We recommend cleaning in the morning with a face or a bar - both refreshing and non-drying alternatives to tissue milk.

reference_spacy_tokens: We recommend cleaning in the morning with a face or a bar - both refreshing and non - drying alternatives to tissue milk .


fn_spacy_tokens_for_baseline: As of early September 2004 , Iran was cited as testing its Shehab-3 missile for a second time , further proving its persistence to test and develop its extended range missile capabilities .

source_bert_toks: as of early september 2004 , iran was cited as testing its she ##hab - 3 missile for a second time , further proving its persistence to test and develop its extended range missile capabilities .

reference_raw: Since the beginning of September 2004, Iran has been referred to as a second test of its Shehab-3 missile, which further demonstrates its persistence in testing and developing its extended range missile capabilities.

reference_spacy_tokens: Since the beginning of September 2004 , Iran has been referred to as a second test of its Shehab-3 missile , which further demonstrates its persistence in testing and developing its extended range missile capabilities .


fn_spacy_tokens_for_baseline: There 's nothing they like better than having a good chat about the latest bit of gossip : who is doing what , where , and why .

source_bert_toks: there ' s nothing they like better than having a good chat about the latest bit of gossip : who is doing what , where , and why .

reference_raw: There's nothing they like more than a good talk of the last piece of gossip: who does what, where, and why.

reference_spacy_tokens: There 's nothing they like more than a good talk of the last piece of gossip : who does what , where , and why .


fn_spacy_tokens_for_baseline: They were A L L confederates in the same unknown crime .

source_bert_toks: they were a l l confederates in the same unknown crime .

reference_raw: They were LL confederates in one unknown crime.

reference_spacy_tokens: They were LL confederates in one unknown crime .


fn_spacy_tokens_for_baseline: These social readings of Lacanian psychoanalysis have allowed feminist literary , film , and cultural studies to refine their simplistic descriptions of subjectivity on the basis of biological sex or social gender relations .

source_bert_toks: these social readings of lac ##anian psycho ##analysis have allowed feminist literary , film , and cultural studies to ref ##ine their sim ##pl ##istic descriptions of subject ##ivity on the basis of biological sex or social gender relations .

reference_raw: These social readings of Lacanian psychoanalysis have enabled feminist literary, film and cultural studies to improve their simplistic definition of subjectivity based on biological sex or social sex relationships.

reference_spacy_tokens: These social readings of Lacanian psychoanalysis have enabled feminist literary , film and cultural studies to improve their simplistic definition of subjectivity based on biological sex or social sex relationships .


fn_spacy_tokens_for_baseline: Interference crackled across the screen .

source_bert_toks: interference crack ##led across the screen .

reference_raw: Interference broke through the screen.

reference_spacy_tokens: Interference broke through the screen .


fn_spacy_tokens_for_baseline: Breakfast cereals are mostly sugar - coated ; when she occasionally has a wholegrain cereal ( like Weetabix ) she adds two teaspoons of sugar .

source_bert_toks: breakfast cereal ##s are mostly sugar - coated ; when she occasionally has a whole ##gra ##in cereal ( like wee ##ta ##bi ##x ) she adds two tea ##sp ##oons of sugar .

reference_raw: The breakfast cereals are mainly sugar-coated; sometimes the whole grain (like Weetabix) adds two spoons of sugar.

reference_spacy_tokens: The breakfast cereals are mainly sugar - coated ; sometimes the whole grain ( like Weetabix ) adds two spoons of sugar .


fn_spacy_tokens_for_baseline: So he could control his baser instincts !

source_bert_toks: so he could control his base ##r instincts !

reference_raw: To control his basic instincts!

reference_spacy_tokens: To control his basic instincts !


fn_spacy_tokens_for_baseline: That , combined with the formation of the Nevada Gaming Control Board , would signal the beginning of the end for heavy mob influence in the city .

source_bert_toks: that , combined with the formation of the nevada gaming control board , would signal the beginning of the end for heavy mob influence in the city .

reference_raw: This, combined with the creation of the Nevada Gaming Control Board, would signal the beginning of the end of the city's massive crowd influence.

reference_spacy_tokens: This , combined with the creation of the Nevada Gaming Control Board , would signal the beginning of the end of the city 's massive crowd influence .


fn_spacy_tokens_for_baseline: The distance between the first and fourth bump should be 100 meters , and the distance between the fourth and the sixth should be 50 meters , so cars can not travel fast in the direction of the building 5- Barbed Wires : They should be placed around the building , around the walls , or on top of the walls 6- Nails Obstacle : These are placed at the main gate in order to puncture the tires of any car crashing in

source_bert_toks: the distance between the first and fourth bump should be 100 meters , and the distance between the fourth and the sixth should be 50 meters , so cars can not travel fast in the direction of the building 5 - barbed wires : they should be placed around the building , around the walls , or on top of the walls 6 - nails obstacle : these are placed at the main gate in order to pun ##cture the tires of any car crashing in

reference_raw: The distance between the first and fourth bump should be 100 metres, and the distance between the fourth and sixth should be 50 metres, so that vehicles cannot travel rapidly towards the building 5-barbed cables: they should be placed around the building, around the walls or at the top of the wall 6-Nails Obstacle: they are placed at the main gate to puncture the tires of any collision.

reference_spacy_tokens: The distance between the first and fourth bump should be 100 metres , and the distance between the fourth and sixth should be 50 metres , so that vehicles can not travel rapidly towards the building 5-barbed cables : they should be placed around the building , around the walls or at the top of the wall 6-Nails Obstacle : they are placed at the main gate to puncture the tires of any collision .


fn_spacy_tokens_for_baseline: It was my part after we had discovered in the transformed Henderson the fallen despot , to attach myself to his household and keep the others in touch with his movements .

source_bert_toks: it was my part after we had discovered in the transformed henderson the fallen des ##pot , to attach myself to his household and keep the others in touch with his movements .

reference_raw: When we discovered the fallen despot in the transformed Henderson, it was my role to join his household and keep the rest in touch with his movements.

reference_spacy_tokens: When we discovered the fallen despot in the transformed Henderson , it was my role to join his household and keep the rest in touch with his movements .


fn_spacy_tokens_for_baseline: He was one against four -- and already wounded -- and yet he stood there deliberately inciting the men to fight .

source_bert_toks: he was one against four - - and already wounded - - and yet he stood there deliberately inc ##iting the men to fight .

reference_raw: He was one against four-and he was already wounded-and yet he stood there deliberately instigating the men to fight.

reference_spacy_tokens: He was one against four - and he was already wounded - and yet he stood there deliberately instigating the men to fight .


fn_spacy_tokens_for_baseline: Ship interiors were specially insulated to combat the problem and an operation similar to degaussing was carried out prior to docking with other vessels .

source_bert_toks: ship interiors were specially ins ##ulated to combat the problem and an operation similar to de ##gau ##ssing was carried out prior to docking with other vessels .

reference_raw: The ship's inners were specially isolated to combat the problem and a degaussing operation was carried out before docking with other vessels.

reference_spacy_tokens: The ship 's inners were specially isolated to combat the problem and a degaussing operation was carried out before docking with other vessels .


fn_spacy_tokens_for_baseline: One of the cows mooed as she passed their field .

source_bert_toks: one of the cows mo ##oed as she passed their field .

reference_raw: As she passed their field, one of the cows mooted.

reference_spacy_tokens: As she passed their field , one of the cows mooted .


fn_spacy_tokens_for_baseline: Follow this path to a footpath junction then bear right to cross a stile .

source_bert_toks: follow this path to a foot ##path junction then bear right to cross a stil ##e .

reference_raw: Follow this path to the crossroads, then take the right hand to cross the stile.

reference_spacy_tokens: Follow this path to the crossroads , then take the right hand to cross the stile .


fn_spacy_tokens_for_baseline: She stares straight ahead , but she has opened the window just enough to eavesdrop on the interview taking place on the pavement outside , between Rainbow and the little dove .

source_bert_toks: she stares straight ahead , but she has opened the window just enough to ea ##ves ##drop on the interview taking place on the pavement outside , between rainbow and the little dove .

reference_raw: She looks straight ahead, but she opened the window just enough to listen to the conversation on the sidewalk outside, between Rainbow and the little dove.

reference_spacy_tokens: She looks straight ahead , but she opened the window just enough to listen to the conversation on the sidewalk outside , between Rainbow and the little dove .


fn_spacy_tokens_for_baseline: Sometime during 1984 , Iran successfully concluded a secret agreement with Libya for the purchase of a small number of MAZ-543P transporter - erector launchers ( TELs ) and Scud - B missiles .

source_bert_toks: sometime during 1984 , iran successfully concluded a secret agreement with libya for the purchase of a small number of ma ##z - 54 ##3 ##p transport ##er - erect ##or launcher ##s ( tel ##s ) and sc ##ud - b missiles .

reference_raw: At some point in 1984, Iran successfully entered into a secret agreement with Libya to purchase a small number of MAZ-543P transporters - erector launchers (TELs) and Scud-B rockets.

reference_spacy_tokens: At some point in 1984 , Iran successfully entered into a secret agreement with Libya to purchase a small number of MAZ-543P transporters - erector launchers ( TELs ) and Scud - B rockets .


fn_spacy_tokens_for_baseline: The words seemed weighed carefully .

source_bert_toks: the words seemed weighed carefully .

reference_raw: The words seemed to be carefully considered.

reference_spacy_tokens: The words seemed to be carefully considered .


fn_spacy_tokens_for_baseline: Microwave on high for approximately 5 minutes or until just tender but retaining their shape .

source_bert_toks: microwave on high for approximately 5 minutes or until just tender but retaining their shape .

reference_raw: Micro-waves at high altitude for about five minutes, or until they're just tender, but they're still in shape.

reference_spacy_tokens: Micro - waves at high altitude for about five minutes , or until they 're just tender , but they 're still in shape .


fn_spacy_tokens_for_baseline: Griffin Moss is a contented artist until he receives an enigmatic note from Sabine Strohem , a stranger from a South Pacific island .

source_bert_toks: griffin moss is a content ##ed artist until he receives an enigma ##tic note from sabine st ##ro ##hem , a stranger from a south pacific island .

reference_raw: Griffin Moss is a happy artist until he receives a mysterious message from Sabine Strohem, a foreigner from the island of the South Pacific.

reference_spacy_tokens: Griffin Moss is a happy artist until he receives a mysterious message from Sabine Strohem , a foreigner from the island of the South Pacific .


fn_spacy_tokens_for_baseline: At other times my master , tired by the reticence of Agrippa and the others , continued his absorption with alchemy .

source_bert_toks: at other times my master , tired by the re ##tic ##ence of ag ##rip ##pa and the others , continued his absorption with al ##che ##my .

reference_raw: At other times, my master, exhausted by Agrippa and the others' restraints, continued to absorb him with alchemy.

reference_spacy_tokens: At other times , my master , exhausted by Agrippa and the others ' restraints , continued to absorb him with alchemy .


fn_spacy_tokens_for_baseline: Skim off all fat from grill pan after cooking meat or poultry , leaving any sediment .

source_bert_toks: ski ##m off all fat from grill pan after cooking meat or poultry , leaving any sediment .

reference_raw: After cooking meat or chickens, remove all fat from the barbecue pan and leave no sediment.

reference_spacy_tokens: After cooking meat or chickens , remove all fat from the barbecue pan and leave no sediment .


fn_spacy_tokens_for_baseline: After the cleaning in AlbuFahd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he 's ready to cooperate .

source_bert_toks: after the cleaning in al ##bu ##fa ##hd , the brothers killed three of the spies in his tribe , and for the first time there was no reaction against the brothers , but instead he came to them , asking for forgiveness , and he ' s ready to cooperate .

reference_raw: After cleaning up in AlbuFahd, the brothers killed three of his tribe's spies, and for the first time they didn't react to the brothers, but instead he came to them and asked for forgiveness, and he was prepared to cooperate.

reference_spacy_tokens: After cleaning up in AlbuFahd , the brothers killed three of his tribe 's spies , and for the first time they did n't react to the brothers , but instead he came to them and asked for forgiveness , and he was prepared to cooperate .


fn_spacy_tokens_for_baseline: Nikola Koljevic , their deputy leader , says Serbs will go back to their old demand for a Bosnian confederation of independent Serb , Muslim and Croat states .

source_bert_toks: nikola ko ##l ##jevic , their deputy leader , says serbs will go back to their old demand for a bosnian confederation of independent serb , muslim and cr ##oat states .

reference_raw: Nikola Koljevic, their second-in-command, says that the Serbs will return to their old request for a Bosnian confederation of independent Serbian, Muslim and Croatian states.

reference_spacy_tokens: Nikola Koljevic , their second - in - command , says that the Serbs will return to their old request for a Bosnian confederation of independent Serbian , Muslim and Croatian states .


fn_spacy_tokens_for_baseline: North of the town , a commanding view over all the New Territories to the north can be seen from Tai Mo Shan , Hong Kong 's highest peak at 957 m ( 3,140 ft ) .

source_bert_toks: north of the town , a commanding view over all the new territories to the north can be seen from tai mo shan , hong kong ' s highest peak at 95 ##7 m ( 3 , 140 ft ) .

reference_raw: To the north of the city, a commanding view of all the new territories to the north can be seen from Tai Mo Shan, the highest point in Hong Kong at 957 m (3,140 ft).

reference_spacy_tokens: To the north of the city , a commanding view of all the new territories to the north can be seen from Tai Mo Shan , the highest point in Hong Kong at 957 m ( 3,140 ft ) .


fn_spacy_tokens_for_baseline: He was charged with and was probably guilty of forgery , subornation of a jury , and concealment of a felony .

source_bert_toks: he was charged with and was probably guilty of forge ##ry , sub ##orn ##ation of a jury , and conceal ##ment of a felony .

reference_raw: He's been charged, and he's probably guilty of counterfeiting, subpoenaing a jury, and hiding a crime.

reference_spacy_tokens: He 's been charged , and he 's probably guilty of counterfeiting , subpoenaing a jury , and hiding a crime .


fn_spacy_tokens_for_baseline: Chardonnay wines are notably lighter in body than those made from Pinot Noir , with a naturally higher acidity and a finer bouquet .

source_bert_toks: char ##don ##nay wines are notably lighter in body than those made from pin ##ot noir , with a naturally higher acid ##ity and a finer bouquet .

reference_raw: The chardonnay wines are particularly lighter in the body than the wines of Pinot Noir, with a naturally higher acidity and a better flower.

reference_spacy_tokens: The chardonnay wines are particularly lighter in the body than the wines of Pinot Noir , with a naturally higher acidity and a better flower .


fn_spacy_tokens_for_baseline: It was pitch black on the other side , but an awful smell wafted out through the slit , a smell of whisky and greasy hair and sweat .

source_bert_toks: it was pitch black on the other side , but an awful smell wa ##fted out through the slit , a smell of whisky and greasy hair and sweat .

reference_raw: It was dark on the other side, but there was a terrible smell in the crack, the smell of whiskey and greased hair and sweat.

reference_spacy_tokens: It was dark on the other side , but there was a terrible smell in the crack , the smell of whiskey and greased hair and sweat .


fn_spacy_tokens_for_baseline: ' I think they would have lost our trail in last night 's snowstorm .

source_bert_toks: ' i think they would have lost our trail in last night ' s snow ##storm .

reference_raw: 'I think they'd lose track of us in the storm last night.

reference_spacy_tokens: ' I think they 'd lose track of us in the storm last night .


fn_spacy_tokens_for_baseline: The mockery of such spirits would seem to us today to be capable of attracting their spiteful revenge .

source_bert_toks: the mock ##ery of such spirits would seem to us today to be capable of attracting their spite ##ful revenge .

reference_raw: Today, it seems to us that the ridicule of such spirits is capable of attracting their vengeful vengeance.

reference_spacy_tokens: Today , it seems to us that the ridicule of such spirits is capable of attracting their vengeful vengeance .


fn_spacy_tokens_for_baseline: Fulk 's great - grandson married into the Trusbut family who had a seat at Warter village .

source_bert_toks: fu ##lk ' s great - grandson married into the tr ##us ##bu ##t family who had a seat at war ##ter village .

reference_raw: Fulk's great-great-great-great-grandson married to the Trusbut family, who sat in Warter Village.

reference_spacy_tokens: Fulk 's great - great - great - great - grandson married to the Trusbut family , who sat in Warter Village .


fn_spacy_tokens_for_baseline: A large shipment of sardines canned in Tangier was sold to representatives of the British Consulate by Hollander .

source_bert_toks: a large shipment of sar ##dine ##s canned in tang ##ier was sold to representatives of the british consulate by holland ##er .

reference_raw: Hollander sold a large consignment of sardines preserved in Tangier to the British consulate.

reference_spacy_tokens: Hollander sold a large consignment of sardines preserved in Tangier to the British consulate .


fn_spacy_tokens_for_baseline: Jack Troake stares out at the frozen sea and grouses about the wind crushing the ice against the shore , locking his boat in port and delaying the start of the seal hunt .

source_bert_toks: jack tr ##oa ##ke stares out at the frozen sea and gr ##ouse ##s about the wind crushing the ice against the shore , locking his boat in port and delaying the start of the seal hunt .

reference_raw: Jack Troake stares at the frozen sea and mouses about the wind crushing the ice against the shore, locking his ship in the harbor and delaying the start of the seal hunt.

reference_spacy_tokens: Jack Troake stares at the frozen sea and mouses about the wind crushing the ice against the shore , locking his ship in the harbor and delaying the start of the seal hunt .


fn_spacy_tokens_for_baseline: He took down volumes from the shelves , undid their clasps and , chattering like a child , pointed out the beauty of the calligraphy .

source_bert_toks: he took down volumes from the shelves , und ##id their clasp ##s and , chatter ##ing like a child , pointed out the beauty of the call ##igraphy .

reference_raw: He took the bookshelves, unfastened them, and, chattering like a child, pointed out the beauty of the calligraphy.

reference_spacy_tokens: He took the bookshelves , unfastened them , and , chattering like a child , pointed out the beauty of the calligraphy .


fn_spacy_tokens_for_baseline: The second - hottest day in the U.S. was June 29 , 1994 , when it hit 128 degrees in Lake Havasu City , Ariz. , and 125 degrees Fahrenheit ( the third - highest temperature ever recorded in the U.S. ) in Laughlin , Nev.

source_bert_toks: the second - hottest day in the u . s . was june 29 , 1994 , when it hit 128 degrees in lake ha ##vas ##u city , ari ##z . , and 125 degrees fa ##hre ##nh ##eit ( the third - highest temperature ever recorded in the u . s . ) in laugh ##lin , ne ##v .

reference_raw: The second hottest day in the United States was June 29, 1994, when it reached 128 degrees in Lake Havas City, Ariz, and 125 degrees Fahrenheit (third highest temperature ever recorded in the United States) in Laughlin, Nev.

reference_spacy_tokens: The second hottest day in the United States was June 29 , 1994 , when it reached 128 degrees in Lake Havas City , Ariz , and 125 degrees Fahrenheit ( third highest temperature ever recorded in the United States ) in Laughlin , Nev.


fn_spacy_tokens_for_baseline: When the fire jumped containment lines , around 95 percent of the fire had been contained .

source_bert_toks: when the fire jumped containment lines , around 95 percent of the fire had been contained .

reference_raw: When the fire leapt to containment lines, about 95 percent of the fire was contained.

reference_spacy_tokens: When the fire leapt to containment lines , about 95 percent of the fire was contained .


fn_spacy_tokens_for_baseline: In the morning , she asked where Tom had gone and my auntie told her .

source_bert_toks: in the morning , she asked where tom had gone and my aunt ##ie told her .

reference_raw: She asked where Tom had gone this morning, and my aunt told her.

reference_spacy_tokens: She asked where Tom had gone this morning , and my aunt told her .


fn_spacy_tokens_for_baseline: Across Gloucester Road , opposite the World Trade Centre , is the Noonday Gun , which under British rule was sounded on the stroke of midday .

source_bert_toks: across gloucester road , opposite the world trade centre , is the noon ##day gun , which under british rule was sounded on the stroke of midday .

reference_raw: On the other side of Gloucester Road, across from the World Trade Center, is the noonday weapon that, under British rule, sounded at noon.

reference_spacy_tokens: On the other side of Gloucester Road , across from the World Trade Center , is the noonday weapon that , under British rule , sounded at noon .


fn_spacy_tokens_for_baseline: The only witnesses on this whole soggy wasteland are the father and his son walking their dog .

source_bert_toks: the only witnesses on this whole so ##ggy waste ##land are the father and his son walking their dog .

reference_raw: The only witnesses in this wet wasteland are the father and his son walking their dog.

reference_spacy_tokens: The only witnesses in this wet wasteland are the father and his son walking their dog .


fn_spacy_tokens_for_baseline: He is a man of fifty , strong , active , with iron - gray hair , great bunched black eyebrows , the step of a deer and the air of an emperor - a fierce , masterful man , with a red - hot spirit behind his parchment face .

source_bert_toks: he is a man of fifty , strong , active , with iron - gray hair , great bunch ##ed black eyebrows , the step of a deer and the air of an emperor - a fierce , master ##ful man , with a red - hot spirit behind his parchment face .

reference_raw: He is a man of fifty, strong and active, with iron-gray hair, large black eyebrows, the step of a deer, and the air of a ruler-a fierce, masterful man with a red-hot soul behind his parchment face.

reference_spacy_tokens: He is a man of fifty , strong and active , with iron - gray hair , large black eyebrows , the step of a deer , and the air of a ruler - a fierce , masterful man with a red - hot soul behind his parchment face .


fn_spacy_tokens_for_baseline: Unemployment still is officially recorded at 16.5 % , the highest rate in Europe , although actual joblessness may be lower .

source_bert_toks: unemployment still is officially recorded at 16 . 5 % , the highest rate in europe , although actual job ##lessness may be lower .

reference_raw: Unemployment is still officially recorded at 16.5%, the highest rate in Europe, although the actual unemployment rate may be lower.

reference_spacy_tokens: Unemployment is still officially recorded at 16.5 % , the highest rate in Europe , although the actual unemployment rate may be lower .


fn_spacy_tokens_for_baseline: He jabbered away to his friends , and Ellie assumed he was explaining that item number one was a drink .

source_bert_toks: he ja ##bber ##ed away to his friends , and ellie assumed he was explaining that item number one was a drink .

reference_raw: He chatted with his friends, and Ellie assumed he was explaining that item number one was a drink.

reference_spacy_tokens: He chatted with his friends , and Ellie assumed he was explaining that item number one was a drink .


fn_spacy_tokens_for_baseline: She was responsible for making sure the house got clean and the chores got done and to make sure we played a part in that , and of course she was going to make sure we did our part .

source_bert_toks: she was responsible for making sure the house got clean and the chores got done and to make sure we played a part in that , and of course she was going to make sure we did our part .

reference_raw: It was her job to make sure that the house was clean and the work was done, and to make sure that we played a role in it, and of course she wanted to make sure that we did what we did.

reference_spacy_tokens: It was her job to make sure that the house was clean and the work was done , and to make sure that we played a role in it , and of course she wanted to make sure that we did what we did .


fn_spacy_tokens_for_baseline: Moonlight flashed on the blade of his sword , pointing ( as far as Guy was concerned ) in no particular direction at all .

source_bert_toks: moonlight flashed on the blade of his sword , pointing ( as far as guy was concerned ) in no particular direction at all .

reference_raw: The moonlight shone on the blade of his sword, pointing (as far as Guy was concerned) in no particular direction.

reference_spacy_tokens: The moonlight shone on the blade of his sword , pointing ( as far as Guy was concerned ) in no particular direction .


fn_spacy_tokens_for_baseline: On the other hand , the smallest dinosaur known -- of the type that were probably the immediate ancestors of modern birds -- was no bigger than a mistlethrush weighing only a few grammes .

source_bert_toks: on the other hand , the smallest dinosaur known - - of the type that were probably the immediate ancestors of modern birds - - was no bigger than a mist ##let ##hr ##ush weighing only a few gram ##mes .

reference_raw: On the other hand, the smallest dinosaur known-the kind that was probably the immediate ancestors of modern birds-was no larger than a mistlethrush that weighed only a few grams.

reference_spacy_tokens: On the other hand , the smallest dinosaur known - the kind that was probably the immediate ancestors of modern birds - was no larger than a mistlethrush that weighed only a few grams .


fn_spacy_tokens_for_baseline: He had had a varied and an outstanding career .

source_bert_toks: he had had a varied and an outstanding career .

reference_raw: He had a diverse and excellent career.

reference_spacy_tokens: He had a diverse and excellent career .


fn_spacy_tokens_for_baseline: She whimpered and wriggled further into the chesterfield 's cushiony depths .

source_bert_toks: she whimpered and wr ##ig ##gled further into the chesterfield ' s cushion ##y depths .

reference_raw: She whined and wriggled deeper into the pillowy depths of the chesterfield.

reference_spacy_tokens: She whined and wriggled deeper into the pillowy depths of the chesterfield .


fn_spacy_tokens_for_baseline: The process need was obvious , and within two years , AT & T ; had developed and installed the automatic switchboard .

source_bert_toks: the process need was obvious , and within two years , at & t ; had developed and installed the automatic switch ##board .

reference_raw: The necessity of the process was clear, and in two years AT & T had developed and installed an automatic switch-board.

reference_spacy_tokens: The necessity of the process was clear , and in two years AT & T had developed and installed an automatic switch - board .


fn_spacy_tokens_for_baseline: They were no better in trousers , because then they both got the waistline wrong .

source_bert_toks: they were no better in trousers , because then they both got the waist ##line wrong .

reference_raw: They weren't much better in pants, because then they were both wrong about their belts.

reference_spacy_tokens: They were n't much better in pants , because then they were both wrong about their belts .


fn_spacy_tokens_for_baseline: Prosperity has brought with it a new emphasis on historic preservation .

source_bert_toks: prosperity has brought with it a new emphasis on historic preservation .

reference_raw: Prosperity brought a new emphasis on historical preservation.

reference_spacy_tokens: Prosperity brought a new emphasis on historical preservation .


fn_spacy_tokens_for_baseline: THE parents of a baby boy who died from injuries suffered before birth won a historic legal victory yesterday when three judges allowed their damages action against a health board to go ahead .

source_bert_toks: the parents of a baby boy who died from injuries suffered before birth won a historic legal victory yesterday when three judges allowed their damages action against a health board to go ahead .

reference_raw: The parents of a little boy who died from injuries sustained prior to birth won a historical legal victory yesterday when three judges allowed their actions against the health board to continue.

reference_spacy_tokens: The parents of a little boy who died from injuries sustained prior to birth won a historical legal victory yesterday when three judges allowed their actions against the health board to continue .


fn_spacy_tokens_for_baseline: like um in the warm weather it 's always shorts and a T - shirt or a button up or something like that and then in the winter time it 's jeans or or pants i usually um you know college is so casual you really do n't want to dress up unless you

source_bert_toks: like um in the warm weather it ' s always shorts and a t - shirt or a button up or something like that and then in the winter time it ' s jeans or or pants i usually um you know college is so casual you really don ' t want to dress up unless you

reference_raw: like, um, in hot weather, it's always shorts and shirts or buttons or something, and then in winter, it's jeans or pants, usually um, you know that college is so casual that you don't really want to dress unless you're wearing it.

reference_spacy_tokens: like , um , in hot weather , it 's always shorts and shirts or buttons or something , and then in winter , it 's jeans or pants , usually um , you know that college is so casual that you do n't really want to dress unless you 're wearing it .


fn_spacy_tokens_for_baseline: The amulets , including flat plates designed for attachment to a background material as well as three - dimensional figurines , featured a wide range of animals identified in mythology with attributes favourable to human well - being .

source_bert_toks: the amulet ##s , including flat plates designed for attachment to a background material as well as three - dimensional fig ##uri ##nes , featured a wide range of animals identified in mythology with attributes favourable to human well - being .

reference_raw: Amulets, including flat plates intended to be attached to the background material and three-dimensional figures, featured a wide range of animals identified in mythology with attributes favourable to human health.

reference_spacy_tokens: Amulets , including flat plates intended to be attached to the background material and three - dimensional figures , featured a wide range of animals identified in mythology with attributes favourable to human health .


fn_spacy_tokens_for_baseline: The lookout point at Lok Ma Chau was once known as Hong Kong 's " window on China " - in the years of China 's isolation from the West , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

source_bert_toks: the lookout point at lok ma cha ##u was once known as hong kong ' s " window on china " - in the years of china ' s isolation from the west , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

reference_raw: The watchpoint at Lok Ma Chau used to be known as Hong Kong's "China Window" - during the years of Chinese isolation from the West, tourists would come here and rent telescopes to see the great mystery behind them.

reference_spacy_tokens: The watchpoint at Lok Ma Chau used to be known as Hong Kong 's " China Window " - during the years of Chinese isolation from the West , tourists would come here and rent telescopes to see the great mystery behind them .


fn_spacy_tokens_for_baseline: You 'll find Hong Kong easy to get around , the people helpful , English spoken everywhere , and food that lives up to its reputation .

source_bert_toks: you ' ll find hong kong easy to get around , the people helpful , english spoken everywhere , and food that lives up to its reputation .

reference_raw: Hong Kong will be easy to get around, people useful, English spoken everywhere, and food that will live up to its reputation.

reference_spacy_tokens: Hong Kong will be easy to get around , people useful , English spoken everywhere , and food that will live up to its reputation .


fn_spacy_tokens_for_baseline: While it 's no longer the bargain shopping destination it once was , there are still some good buys to be had .

source_bert_toks: while it ' s no longer the bargain shopping destination it once was , there are still some good buys to be had .

reference_raw: Although this is not the bargain-shop destination it used to be, there are still some good purchases to be made.

reference_spacy_tokens: Although this is not the bargain - shop destination it used to be , there are still some good purchases to be made .


fn_spacy_tokens_for_baseline: Despite Alcuin 's reservations about Eardwulf , the king must have stepped into the shoes of the slain Aethelred as a recipient of Carolingian favours and may even have married a kinswoman of Charlemagne .

source_bert_toks: despite al ##cu ##in ' s reservations about ear ##d ##wu ##lf , the king must have stepped into the shoes of the slain ae ##the ##lr ##ed as a recipient of carol ##ing ##ian favour ##s and may even have married a kin ##sw ##oman of charlemagne .

reference_raw: Despite Alcuin's reservations about Eardwulf, the King had to step into the shoes of the murdered Aethelre as a recipient of Carolingian favors, and he might even have married a relative of Charlesmagne.

reference_spacy_tokens: Despite Alcuin 's reservations about Eardwulf , the King had to step into the shoes of the murdered Aethelre as a recipient of Carolingian favors , and he might even have married a relative of Charlesmagne .


fn_spacy_tokens_for_baseline: A spreadsheet makes operations like totalling a column of numbers or producing a bar chart a straightforward operation -- SuperCalc 5.5 makes them incredibly quick and easy due to the icons in its new Tool Bar .

source_bert_toks: a spreads ##hee ##t makes operations like total ##ling a column of numbers or producing a bar chart a straightforward operation - - super ##cal ##c 5 . 5 makes them incredibly quick and easy due to the icons in its new tool bar .

reference_raw: The table makes operations such as summing a column of numbers or creating a bar chart a simple operation -- SuperCalc 5.5 makes them incredibly fast and easy because of the icons in the new toolbar.

reference_spacy_tokens: The table makes operations such as summing a column of numbers or creating a bar chart a simple operation -- SuperCalc 5.5 makes them incredibly fast and easy because of the icons in the new toolbar .


fn_spacy_tokens_for_baseline: I 'd had a couple of drinks , lapped up some fast food , and jumped into a cab .

source_bert_toks: i ' d had a couple of drinks , lap ##ped up some fast food , and jumped into a cab .

reference_raw: I had a few drinks, knocked on a quick meal, and jumped into the cab.

reference_spacy_tokens: I had a few drinks , knocked on a quick meal , and jumped into the cab .


fn_spacy_tokens_for_baseline: We sit in lines and worship a corpse .

source_bert_toks: we sit in lines and worship a corpse .

reference_raw: We sit in the rows and worship the dead.

reference_spacy_tokens: We sit in the rows and worship the dead .


fn_spacy_tokens_for_baseline: Technical Capability : The terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

source_bert_toks: technical capability : the terrorist groups of greatest concern possess the technical capability and know - how to acquire , produce , and deliver chemical or biological agents , or to recruit scientific experts in these areas .

reference_raw: Technical capacity: Terrorist groups of major concern have the technical capacity and knowledge to acquire, produce or supply chemical or biological agents or to recruit scientific experts in these fields.

reference_spacy_tokens: Technical capacity : Terrorist groups of major concern have the technical capacity and knowledge to acquire , produce or supply chemical or biological agents or to recruit scientific experts in these fields .


fn_spacy_tokens_for_baseline: Reporting from Tripoli , Libya Waves of NATO fighter planes hit the Libyan capital Tuesday with one of the largest bombardments of the city since the Western - led alliance began airstrikes almost three months ago .

source_bert_toks: reporting from tripoli , libya waves of nato fighter planes hit the libyan capital tuesday with one of the largest bombardment ##s of the city since the western - led alliance began airs ##tri ##kes almost three months ago .

reference_raw: News from Tripoli, Libya Waves of NATO fighters hit the Libyan capital on Tuesday with one of the biggest bombings in the city since the Western-led alliance started air strikes nearly three months ago.

reference_spacy_tokens: News from Tripoli , Libya Waves of NATO fighters hit the Libyan capital on Tuesday with one of the biggest bombings in the city since the Western - led alliance started air strikes nearly three months ago .


fn_spacy_tokens_for_baseline: After they had proved their trustworthiness , permission would be given for them to live in couples in a pension .

source_bert_toks: after they had proved their trust ##worth ##iness , permission would be given for them to live in couples in a pension .

reference_raw: Once they've proven their credibility, they'll be allowed to live in couples in retirement.

reference_spacy_tokens: Once they 've proven their credibility , they 'll be allowed to live in couples in retirement .


fn_spacy_tokens_for_baseline: Bush was affable and even supportive of Gorbachev 's reforms , keen to make the meeting a success .

source_bert_toks: bush was af ##fa ##ble and even supportive of go ##rba ##chev ' s reforms , keen to make the meeting a success .

reference_raw: Bush was friendly and even supporting Gorbachev's reforms, eager to make the meeting a success.

reference_spacy_tokens: Bush was friendly and even supporting Gorbachev 's reforms , eager to make the meeting a success .


fn_spacy_tokens_for_baseline: One of Cornford 's most important implications for Eliot was his redefinition of what ' comedy ' meant in terms of Greek and more primitive drama .

source_bert_toks: one of corn ##ford ' s most important implications for eliot was his red ##ef ##ini ##tion of what ' comedy ' meant in terms of greek and more primitive drama .

reference_raw: One of the most important consequences for Eliot in Cornford was his re-definition of the meaning of "comedy" in Greek and more primitive drama.

reference_spacy_tokens: One of the most important consequences for Eliot in Cornford was his re - definition of the meaning of " comedy " in Greek and more primitive drama .


fn_spacy_tokens_for_baseline: The path then skirts woodland at Nether How and returns via Mill Beck to Buttermere car park .

source_bert_toks: the path then skirts woodland at net ##her how and returns via mill beck to butter ##mere car park .

reference_raw: The road then circles the forests of Nether How and returns through Mill Beck to the Butterre parking lot.

reference_spacy_tokens: The road then circles the forests of Nether How and returns through Mill Beck to the Butterre parking lot .


fn_spacy_tokens_for_baseline: Some pimpled boy whose name she did n't know put one finger coyly beneath his chin and snickered , ' Oh , look , she 's blushing . '

source_bert_toks: some pi ##mple ##d boy whose name she didn ' t know put one finger co ##yl ##y beneath his chin and s ##nick ##ered , ' oh , look , she ' s blushing . '

reference_raw: Some spoiled boy whose name she didn't know put a coy finger under his chin and said, "Look, he's blushing."

reference_spacy_tokens: Some spoiled boy whose name she did n't know put a coy finger under his chin and said , " Look , he 's blushing . "


fn_spacy_tokens_for_baseline: BY THE DEATH in his 87th year of David Thomson of Cessford , Kelso , the Borders area has lost a fine gentleman and a great pioneer farmer , in many instances ahead of his time .

source_bert_toks: by the death in his 87 ##th year of david thomson of ce ##ss ##ford , ke ##ls ##o , the borders area has lost a fine gentleman and a great pioneer farmer , in many instances ahead of his time .

reference_raw: In his 87th year of David Thomson of Cessford, Kelso, the Borders region has been deprived of a fine gentleman and a great pioneer farmer, in many cases before his time.

reference_spacy_tokens: In his 87th year of David Thomson of Cessford , Kelso , the Borders region has been deprived of a fine gentleman and a great pioneer farmer , in many cases before his time .


fn_spacy_tokens_for_baseline: Leonora stared at the closed door forlornly , certain she 'd lie awake for what was left of the night .

source_bert_toks: leon ##ora stared at the closed door for ##lor ##nl ##y , certain she ' d lie awake for what was left of the night .

reference_raw: Leonora stared forlornly at the shut door, sure that she would lie awake for the rest of the night.

reference_spacy_tokens: Leonora stared forlornly at the shut door , sure that she would lie awake for the rest of the night .


fn_spacy_tokens_for_baseline: Over the last 100 years , the ice cap has shrunk in area from 20 kmsq to only 13 kmsq ; this year its thickness has dropped by 2.5 metres .

source_bert_toks: over the last 100 years , the ice cap has sh ##run ##k in area from 20 km ##s ##q to only 13 km ##s ##q ; this year its thickness has dropped by 2 . 5 metres .

reference_raw: In the last 100 years, the ice cap has decreased from 20 kmsq to only 13 kmsq; this year its thickness has decreased by 2.5 m.

reference_spacy_tokens: In the last 100 years , the ice cap has decreased from 20 kmsq to only 13 kmsq ; this year its thickness has decreased by 2.5 m.


fn_spacy_tokens_for_baseline: If using dark chocolate , beat the mixture for 1 - 2min with an electric or hand whisk , until it thickens slightly and lightens in texture ( this is not necessary when using white chocolate ) .

source_bert_toks: if using dark chocolate , beat the mixture for 1 - 2 ##min with an electric or hand w ##his ##k , until it thick ##ens slightly and light ##ens in texture ( this is not necessary when using white chocolate ) .

reference_raw: If you use dark chocolate, beat the mixture to 1-2min with an electric or hand whisk, until it becomes slightly thicker and lightens the texture (this is not necessary if you use white chocolate).

reference_spacy_tokens: If you use dark chocolate , beat the mixture to 1 - 2min with an electric or hand whisk , until it becomes slightly thicker and lightens the texture ( this is not necessary if you use white chocolate ) .


fn_spacy_tokens_for_baseline: He was draped in the doorway , sporting a chunky oatmeal sweater and a pair of thigh - hugging beige trousers and looking tanned and fit after their afternoon in the snow .

source_bert_toks: he was draped in the doorway , sporting a chunk ##y o ##at ##me ##al sweater and a pair of thigh - hugging beige trousers and looking tanned and fit after their afternoon in the snow .

reference_raw: He was draped in the doorway, wearing a stubby oatmeal sweater and a pair of thigh-hugging beige pants, and looking tanned and fit in the snow after their afternoon.

reference_spacy_tokens: He was draped in the doorway , wearing a stubby oatmeal sweater and a pair of thigh - hugging beige pants , and looking tanned and fit in the snow after their afternoon .


fn_spacy_tokens_for_baseline: Black tea has been shown to have a preventative effect against skin carcinogenesis in animal models [ 4 5 6 7 8 9]. Of particular interest are the accumulating data that reflect similar potential health benefits associated with both the epicatechins of green tea and the theaflavins of black tea [ 10 11]. Several mechanisms may be responsible for the anti - initiation and anti - promotion properties of black tea [ 5 10 11 12 13 14 15 ]

source_bert_toks: black tea has been shown to have a prevent ##ative effect against skin car ##cino ##genesis in animal models [ 4 5 6 7 8 9 ] . of particular interest are the acc ##um ##ulating data that reflect similar potential health benefits associated with both the epic ##ate ##chin ##s of green tea and the the ##af ##lav ##ins of black tea [ 10 11 ] . several mechanisms may be responsible for the anti - initiation and anti - promotion properties of black tea [ 5 10 11 12 13 14 15 ]

reference_raw: Black tea has been shown to have a preventive effect against skin cancer in animal models [4 5 6 7 8 9]. The main concern is the accumulation of data reflecting similar potential health benefits related to both green tea and black tea epicatechins [10 11]. Several mechanisms may be responsible for anti-initiation and anti-promotional properties of black tea [5 10 11 12]. 14 15]

reference_spacy_tokens: Black tea has been shown to have a preventive effect against skin cancer in animal models [ 4 5 6 7 8 9]. The main concern is the accumulation of data reflecting similar potential health benefits related to both green tea and black tea epicatechins [ 10 11]. Several mechanisms may be responsible for anti - initiation and anti - promotional properties of black tea [ 5 10 11 12]. 14 15 ]


fn_spacy_tokens_for_baseline: He was whelped on 17 March 1970 , so the history of the Rottweiler in New Zealand is in its infancy , barely twenty years old .

source_bert_toks: he was w ##hel ##ped on 17 march 1970 , so the history of the rot ##t ##weiler in new zealand is in its infancy , barely twenty years old .

reference_raw: It was wheeled on 17 March 1970, so the history of the Rottweiler in New Zealand is barely twenty years old.

reference_spacy_tokens: It was wheeled on 17 March 1970 , so the history of the Rottweiler in New Zealand is barely twenty years old .


fn_spacy_tokens_for_baseline: Harold Badcock , Tyndale Lecturer in Medieval European History , shot his wife a look of hate as she entered the living room .

source_bert_toks: harold bad ##cock , ty ##nda ##le lecturer in medieval european history , shot his wife a look of hate as she entered the living room .

reference_raw: Harold Badcock, Tyndale Lecturer of Medieval European History, shot his wife a look of hatred as she entered the sitting-room.

reference_spacy_tokens: Harold Badcock , Tyndale Lecturer of Medieval European History , shot his wife a look of hatred as she entered the sitting - room .


fn_spacy_tokens_for_baseline: The detainee is not allowed to shower and her daily ration comprises two cups of tea and a quarter loaf of bread stuffed with scraps of unpalatable food .

source_bert_toks: the det ##aine ##e is not allowed to shower and her daily ratio ##n comprises two cups of tea and a quarter loaf of bread stuffed with scrap ##s of un ##pala ##table food .

reference_raw: The detainee is not allowed to take a shower, and her daily ration consists of two cups of tea and a quarter of a loaf of bread stuffed with scraps of non-palatable food.

reference_spacy_tokens: The detainee is not allowed to take a shower , and her daily ration consists of two cups of tea and a quarter of a loaf of bread stuffed with scraps of non - palatable food .


fn_spacy_tokens_for_baseline: The council hopes to shred more than a thousand trees this year . turning them into wood chips .

source_bert_toks: the council hopes to sh ##red more than a thousand trees this year . turning them into wood chips .

reference_raw: This year, the Council hopes to tear down over a thousand trees and turn them into wooden chips.

reference_spacy_tokens: This year , the Council hopes to tear down over a thousand trees and turn them into wooden chips .


fn_spacy_tokens_for_baseline: In " Dance of Death , " he paints a skeleton - like figure , dancing amid beachfront trees and mountains , draped in what looks like a pilgrim 's black top - hat .

source_bert_toks: in " dance of death , " he paints a skeleton - like figure , dancing amid beach ##front trees and mountains , draped in what looks like a pilgrim ' s black top - hat .

reference_raw: In the "Dance of Death," he paints a figure like a skeleton, dancing in the trees and mountains of the beach, draped in what appears to be a traveler's black hat.

reference_spacy_tokens: In the " Dance of Death , " he paints a figure like a skeleton , dancing in the trees and mountains of the beach , draped in what appears to be a traveler 's black hat .


fn_spacy_tokens_for_baseline: ' In light of yesterday 's incident , we have reinforced security at our roadblocks and strongly advise people to stay away from the area around Parliament , ' military spokesman Capt . Howard Politini said .

source_bert_toks: ' in light of yesterday ' s incident , we have reinforced security at our road ##block ##s and strongly advise people to stay away from the area around parliament , ' military spokesman capt . howard pol ##iti ##ni said .

reference_raw: 'As a result of last night's incident, we've strengthened security at our barricades and strongly advised people to stay out of the area around Parliament,' military spokesman Captain Howard Politini said.

reference_spacy_tokens: ' As a result of last night 's incident , we 've strengthened security at our barricades and strongly advised people to stay out of the area around Parliament , ' military spokesman Captain Howard Politini said .


fn_spacy_tokens_for_baseline: ' I 'm so glad to have met you , ' Anneliese was saying over the chatter and hubbub of the party , one - year - old Christian in her arms .

source_bert_toks: ' i ' m so glad to have met you , ' anne ##lies ##e was saying over the chatter and hub ##bu ##b of the party , one - year - old christian in her arms .

reference_raw: 'I'm so glad to meet you,' Annaliese said over the conversation and hubbub of the group, a year-old Christian in her arms.

reference_spacy_tokens: ' I 'm so glad to meet you , ' Annaliese said over the conversation and hubbub of the group , a year - old Christian in her arms .


fn_spacy_tokens_for_baseline: She must have put the idea into his head herself : pinned it onto the back of his mind , like one of her flaming hairpieces .

source_bert_toks: she must have put the idea into his head herself : pinned it onto the back of his mind , like one of her flaming hair ##piece ##s .

reference_raw: She had to put the idea in his head herself: pin it to the back of his mind, like one of her flaming hair-pieces.

reference_spacy_tokens: She had to put the idea in his head herself : pin it to the back of his mind , like one of her flaming hair - pieces .


fn_spacy_tokens_for_baseline: A man has been jailed for life for strangling his estranged wife , after finding a love letter she had written to another man .

source_bert_toks: a man has been jailed for life for st ##rang ##ling his estranged wife , after finding a love letter she had written to another man .

reference_raw: A man was sentenced to death for strangling his estranged wife when she found the love letter she had written to another man.

reference_spacy_tokens: A man was sentenced to death for strangling his estranged wife when she found the love letter she had written to another man .


fn_spacy_tokens_for_baseline: The heat evaporates the water and this also lowers the temperature .

source_bert_toks: the heat eva ##por ##ates the water and this also lowers the temperature .

reference_raw: Heat vaporizes the water, which also reduces the temperature.

reference_spacy_tokens: Heat vaporizes the water , which also reduces the temperature .


fn_spacy_tokens_for_baseline: As for the supposedly curative hair of the dog , this stems from the ancient belief that the only cure for an infected dog bite was a poultice of milk , bread and fur from the offending animal .

source_bert_toks: as for the supposedly cu ##rative hair of the dog , this stems from the ancient belief that the only cure for an infected dog bite was a po ##ult ##ice of milk , bread and fur from the off ##ending animal .

reference_raw: As far as the dog's supposedly cured hair is concerned, it is based on the ancient belief that the only cure for an infected dog bite is a bunch of milk, bread and fur from an insulting animal.

reference_spacy_tokens: As far as the dog 's supposedly cured hair is concerned , it is based on the ancient belief that the only cure for an infected dog bite is a bunch of milk , bread and fur from an insulting animal .