fn_spacy_tokens_for_baseline: On the night of the dinner - party , it seems , the kitchen maid has allowed the meat to scorch .

source_bert_toks: on the night of the dinner - party , it seems , the kitchen maid has allowed the meat to sc ##or ##ch .

reference_raw: The kitchen maid seems to have let the meat burn on the night of the dinner party.

reference_spacy_tokens: The kitchen maid seems to have let the meat burn on the night of the dinner party .


fn_spacy_tokens_for_baseline: Mr Levy - Lang is characteristically disingenuous about the talismanic date of 1992 .

source_bert_toks: mr levy - lang is characteristic ##ally di ##sing ##en ##uous about the tal ##isman ##ic date of 1992 .

reference_raw: Mr Levy-Lang is unusually dissimilar about the talismanic date of 1992.

reference_spacy_tokens: Mr Levy - Lang is unusually dissimilar about the talismanic date of 1992 .


fn_spacy_tokens_for_baseline: The country must build a working repository by about 1998 .

source_bert_toks: the country must build a working repository by about 1998 .

reference_raw: By about 1998, the country has to build a working storage facility.

reference_spacy_tokens: By about 1998 , the country has to build a working storage facility .


fn_spacy_tokens_for_baseline: After that he announced his repentance at the mosque twice in front of Albu'Ubaid tribe , denouncing who joins the police and army , and sorry for all he 's done , without any pressure or threats from the brothers .

source_bert_toks: after that he announced his rep ##ent ##ance at the mosque twice in front of al ##bu ' u ##bai ##d tribe , den ##oun ##cing who joins the police and army , and sorry for all he ' s done , without any pressure or threats from the brothers .

reference_raw: Then, twice before the Albu'Ubaid tribe, he announced his penance at the mosque, denounced who had joined the police and the army, and regretted what he had done, without the pressure or threat of the brothers.

reference_spacy_tokens: Then , twice before the Albu'Ubaid tribe , he announced his penance at the mosque , denounced who had joined the police and the army , and regretted what he had done , without the pressure or threat of the brothers .


fn_spacy_tokens_for_baseline: ' Blood probably coagulated before he entered the water . '

source_bert_toks: ' blood probably coa ##gul ##ated before he entered the water . '

reference_raw: 'The blood was probably clotted before he went into the water.'

reference_spacy_tokens: ' The blood was probably clotted before he went into the water . '


fn_spacy_tokens_for_baseline: We shall not deceive the people by saying the task of National Reconstruction is easy , or that it can be accomplished in a twelve month [ period].

source_bert_toks: we shall not dec ##ei ##ve the people by saying the task of national reconstruction is easy , or that it can be accomplished in a twelve month [ period ] .

reference_raw: We will not fool people by saying that the task of national reconstruction is simple, or that it can be achieved within 12 months of [period].

reference_spacy_tokens: We will not fool people by saying that the task of national reconstruction is simple , or that it can be achieved within 12 months of [ period].


fn_spacy_tokens_for_baseline: J CALE 's laconic blend of rock , Country and blues has been influencing the way other axemen think for years .

source_bert_toks: j cale ' s lac ##onic blend of rock , country and blues has been influencing the way other axe ##men think for years .

reference_raw: J. CALE's laconical mixture of rock, country, and blue has influenced the way other axemen have thought for years.

reference_spacy_tokens: J. CALE 's laconical mixture of rock , country , and blue has influenced the way other axemen have thought for years .


fn_spacy_tokens_for_baseline: Sheikh Mohammed , who is also the UAE Defence Minister , said during the launching ceremony " we wish to make Dubai a center of modern economy " .

source_bert_toks: sheikh mohammed , who is also the uae defence minister , said during the launching ceremony " we wish to make dubai a center of modern economy " .

reference_raw: Sheik Mohammed, who is also Secretary of Defense of the UAE, said during the opening ceremony, "We want to make Dubai the center of the modern economy."

reference_spacy_tokens: Sheik Mohammed , who is also Secretary of Defense of the UAE , said during the opening ceremony , " We want to make Dubai the center of the modern economy . "


fn_spacy_tokens_for_baseline: Reflecting on the experience , Donia said : " I think you 're exhilarated by the determination and strength of the human spirit . "

source_bert_toks: reflecting on the experience , don ##ia said : " i think you ' re ex ##hila ##rated by the determination and strength of the human spirit . "

reference_raw: Reflecting this experience, Donia said, "I think you're thrilled with the determination and strength of the human spirit."

reference_spacy_tokens: Reflecting this experience , Donia said , " I think you 're thrilled with the determination and strength of the human spirit . "


fn_spacy_tokens_for_baseline: Canadian and Dutch scientists were approached by Iranian personnel looking to acquire mycotoxin - producing fungi ( Fusarium spp . ) in 1989 .

source_bert_toks: canadian and dutch scientists were approached by iranian personnel looking to acquire my ##cot ##ox ##in - producing fungi ( fu ##sari ##um spp . ) in 1989 .

reference_raw: In 1989, scientists from Canada and the Netherlands were approached by Iranians who sought to acquire mycotoxin-producing fungi (Fusarium spp.).

reference_spacy_tokens: In 1989 , scientists from Canada and the Netherlands were approached by Iranians who sought to acquire mycotoxin - producing fungi ( Fusarium spp . ) .


fn_spacy_tokens_for_baseline: Their findings disturbed the High Loremaster sufficiently for him to take them to the Phoenix King .

source_bert_toks: their findings disturbed the high lore ##master sufficiently for him to take them to the phoenix king .

reference_raw: Their findings upset the High Loremaster enough to lead them to the King of Phoenix.

reference_spacy_tokens: Their findings upset the High Loremaster enough to lead them to the King of Phoenix .


fn_spacy_tokens_for_baseline: She said another group of men were in the restaurant , engaged in ' jovial banter with the staff of the Chinese takeaway ' .

source_bert_toks: she said another group of men were in the restaurant , engaged in ' jo ##vial ban ##ter with the staff of the chinese take ##away ' .

reference_raw: She said there was another group of men at the restaurant, engaged in a "jovial bant with a Chinese take-off staff."

reference_spacy_tokens: She said there was another group of men at the restaurant , engaged in a " jovial bant with a Chinese take - off staff . "


fn_spacy_tokens_for_baseline: Addressing a meeting at a neighborhood center , a Goodwill staff member tells the audience how Goodwill can help them find and keep jobs .

source_bert_toks: addressing a meeting at a neighborhood center , a goodwill staff member tells the audience how goodwill can help them find and keep jobs .

reference_raw: At a meeting in the neighborhood center, a member of Goodwill's staff tells the audience how Goodwill can help them find and maintain a job.

reference_spacy_tokens: At a meeting in the neighborhood center , a member of Goodwill 's staff tells the audience how Goodwill can help them find and maintain a job .


fn_spacy_tokens_for_baseline: A chocolate ball made from delectable Belgian chocolate -- filled with Stilton steeped in port .

source_bert_toks: a chocolate ball made from del ##ect ##able belgian chocolate - - filled with stil ##ton steep ##ed in port .

reference_raw: In the harbor, a chocolate ball made of delicious Belgian chocolate, full of Stilton.

reference_spacy_tokens: In the harbor , a chocolate ball made of delicious Belgian chocolate , full of Stilton .


fn_spacy_tokens_for_baseline: This nanny worked in the big brewery down Manchester Road , capping the bottles and loading them into wooden crates .

source_bert_toks: this nanny worked in the big brewery down manchester road , cap ##ping the bottles and loading them into wooden crates .

reference_raw: The babysitter was working in a big brewery on Manchester Road, wrapping bottles and putting them in wooden boxes.

reference_spacy_tokens: The babysitter was working in a big brewery on Manchester Road , wrapping bottles and putting them in wooden boxes .


fn_spacy_tokens_for_baseline: Before the first series went out we got ourselves an established and admired distributor and waited for the programme sales cash to roll in .

source_bert_toks: before the first series went out we got ourselves an established and admired distributor and waited for the programme sales cash to roll in .

reference_raw: Before the first series went out, we bought a well-established and admired distributor and waited for the program's money to come in.

reference_spacy_tokens: Before the first series went out , we bought a well - established and admired distributor and waited for the program 's money to come in .


fn_spacy_tokens_for_baseline: Blanch the spinach leaves in boiling water for about 30 seconds , then dry with a paper towel .

source_bert_toks: blanc ##h the spin ##ach leaves in boiling water for about 30 seconds , then dry with a paper towel .

reference_raw: Dry the spinach for about 30 seconds in boiling water, then dry with a paper towel.

reference_spacy_tokens: Dry the spinach for about 30 seconds in boiling water , then dry with a paper towel .


fn_spacy_tokens_for_baseline: When it comes to genetic flexibility , however , the star performer is quite definitely E. coli .

source_bert_toks: when it comes to genetic flexibility , however , the star performer is quite definitely e . coli .

reference_raw: But when it comes to genetic elasticity, the star artist is definitely E. coli.

reference_spacy_tokens: But when it comes to genetic elasticity , the star artist is definitely E. coli .


fn_spacy_tokens_for_baseline: When I put my front paws on my lady 's shoulders , I was about a foot taller than her .

source_bert_toks: when i put my front paws on my lady ' s shoulders , i was about a foot taller than her .

reference_raw: I was about a foot taller than her when I put my forepaws on my lady's shoulders.

reference_spacy_tokens: I was about a foot taller than her when I put my forepaws on my lady 's shoulders .


fn_spacy_tokens_for_baseline: She shut her eyes in shame .

source_bert_toks: she shut her eyes in shame .

reference_raw: She closed her eyes in shame.

reference_spacy_tokens: She closed her eyes in shame .


fn_spacy_tokens_for_baseline: This is a bit of a shocker .

source_bert_toks: this is a bit of a shock ##er .

reference_raw: That's a little shocking.

reference_spacy_tokens: That 's a little shocking .


fn_spacy_tokens_for_baseline: Jamaican music ska -- and , especially , reggae -- has since the 1970s been exported and enjoyed around the world .

source_bert_toks: jamaican music ska - - and , especially , reggae - - has since the 1970s been exported and enjoyed around the world .

reference_raw: Jamaican musical ska - especially reggae - has been exported and enjoyed throughout the world since the 1970s.

reference_spacy_tokens: Jamaican musical ska - especially reggae - has been exported and enjoyed throughout the world since the 1970s .


fn_spacy_tokens_for_baseline: She shed her clothes , and slipped quickly into its impersonal embrace .

source_bert_toks: she shed her clothes , and slipped quickly into its imp ##erson ##al embrace .

reference_raw: She put on her clothes and slipped quickly into her impersonal embrace.

reference_spacy_tokens: She put on her clothes and slipped quickly into her impersonal embrace .


fn_spacy_tokens_for_baseline: He abused his inheritance , behaved extravagantly , and nearly got his comeuppance from the weasels -- a violent proletariat who squatted in his house while he was doing time for car theft .

source_bert_toks: he abused his inheritance , behaved extravagant ##ly , and nearly got his come ##up ##pan ##ce from the weasel ##s - - a violent pro ##let ##aria ##t who squat ##ted in his house while he was doing time for car theft .

reference_raw: He took advantage of his legacy, acted extravagantly, and almost got his comeupance from the weasels, a violent proletariat who had crouched in his house while he was trying to steal a car.

reference_spacy_tokens: He took advantage of his legacy , acted extravagantly , and almost got his comeupance from the weasels , a violent proletariat who had crouched in his house while he was trying to steal a car .


fn_spacy_tokens_for_baseline: She hears a beating of wings and sees the approach of the swan .

source_bert_toks: she hears a beating of wings and sees the approach of the swan .

reference_raw: He hears the beating of wings and sees the swan coming.

reference_spacy_tokens: He hears the beating of wings and sees the swan coming .


fn_spacy_tokens_for_baseline: Fellowship member Bob Taylor ( not related to the Coordinator ) entered into a project of some restoration at his local church .

source_bert_toks: fellowship member bob taylor ( not related to the coordinator ) entered into a project of some restoration at his local church .

reference_raw: Fellowship member Bob Taylor (not related to the coordinator) has embarked on a project of some sort of restoration in his local church.

reference_spacy_tokens: Fellowship member Bob Taylor ( not related to the coordinator ) has embarked on a project of some sort of restoration in his local church .


fn_spacy_tokens_for_baseline: Following this period of Soviet - led assistance , North Korea made substantive gains in the area of chemical warfare .

source_bert_toks: following this period of soviet - led assistance , north korea made substantive gains in the area of chemical warfare .

reference_raw: After that time in Soviet-led aid, North Korea made substantial profits in the field of chemical warfare.

reference_spacy_tokens: After that time in Soviet - led aid , North Korea made substantial profits in the field of chemical warfare .


fn_spacy_tokens_for_baseline: On a calm day , it can register a pressure difference across the thickness of the Handbook of Chemistry and Physics .

source_bert_toks: on a calm day , it can register a pressure difference across the thickness of the handbook of chemistry and physics .

reference_raw: On a quiet day, he can detect the pressure difference between the thickness of the manual of chemistry and physics.

reference_spacy_tokens: On a quiet day , he can detect the pressure difference between the thickness of the manual of chemistry and physics .


fn_spacy_tokens_for_baseline: They demanded that a second shaft be sunk to afford protection against the aftermath of explosions -- the main cause of death in a methane explosion being not the explosion itself , but poisoning by carbon monoxide or suffocation by choke damp ( carbon dioxide ) or other products of combustion .

source_bert_toks: they demanded that a second shaft be sunk to afford protection against the aftermath of explosions - - the main cause of death in a methane explosion being not the explosion itself , but poisoning by carbon mono ##xide or su ##ff ##ocation by choke damp ( carbon dioxide ) or other products of combustion .

reference_raw: They wanted to sink a second shaft to provide protection against the consequences of explosions-the main cause of death in a methane explosion was not the explosion itself, but the poisoning of carbon monoxide or asphyxiation by suffocating damp (carbon dioxide) or other products of combustion.

reference_spacy_tokens: They wanted to sink a second shaft to provide protection against the consequences of explosions - the main cause of death in a methane explosion was not the explosion itself , but the poisoning of carbon monoxide or asphyxiation by suffocating damp ( carbon dioxide ) or other products of combustion .


fn_spacy_tokens_for_baseline: Latin America as a whole contributed only 5.45 % to the total number of scientific publications in these ten years ( RICYT 2002 ) .

source_bert_toks: latin america as a whole contributed only 5 . 45 % to the total number of scientific publications in these ten years ( ric ##yt 2002 ) .

reference_raw: In these 10 years, Latin America as a whole contributed only 5.45% to the overall number of scientific publications (RICYT 2002).

reference_spacy_tokens: In these 10 years , Latin America as a whole contributed only 5.45 % to the overall number of scientific publications ( RICYT 2002 ) .


fn_spacy_tokens_for_baseline: Or use concealer underneath .

source_bert_toks: or use conceal ##er underneath .

reference_raw: Or use a hider underneath.

reference_spacy_tokens: Or use a hider underneath .


fn_spacy_tokens_for_baseline: Applying eyeliner can be a tricky business ( see page 82 ) , but if you really love that 50s look , Lentheric 's Eye - Definer is the best liquid liner we could find .

source_bert_toks: applying eye ##liner can be a tricky business ( see page 82 ) , but if you really love that 50 ##s look , lent ##her ##ic ' s eye - define ##r is the best liquid liner we could find .

reference_raw: The use of the eye liner can be tricky (see page 82), but if you really like the look of the 50s, Lentheric's eye liner is the best liquid liner we can find.

reference_spacy_tokens: The use of the eye liner can be tricky ( see page 82 ) , but if you really like the look of the 50s , Lentheric 's eye liner is the best liquid liner we can find .


fn_spacy_tokens_for_baseline: A cloud of steam arose , the perfume of coffee .

source_bert_toks: a cloud of steam arose , the perfume of coffee .

reference_raw: There was a cloud of steam, the smell of coffee.

reference_spacy_tokens: There was a cloud of steam , the smell of coffee .


fn_spacy_tokens_for_baseline: New fires were reportedly still breaking out this morning .

source_bert_toks: new fires were reportedly still breaking out this morning .

reference_raw: Reportedly, there were still new fires this morning.

reference_spacy_tokens: Reportedly , there were still new fires this morning .


fn_spacy_tokens_for_baseline: 2 ) Congressional representatives have two basic responsibilities while voting in office -- dealing with national issues ( programmatic actions such as casting roll call votes on legislation that imposes costs and/or confers benefits on the population at large ) and attending to local issues ( constituency service and pork barrel ) .

source_bert_toks: 2 ) congressional representatives have two basic responsibilities while voting in office - - dealing with national issues ( program ##matic actions such as casting roll call votes on legislation that impose ##s costs and / or con ##fers benefits on the population at large ) and attending to local issues ( constituency service and pork barrel ) .

reference_raw: 2) Congressional representatives, when they vote in office, have two basic duties: to address national issues (programmatic measures such as the casting of roll-call votes on legislation that imposes costs or benefits for the general population) and to address local issues (constituency services and pork barrels).

reference_spacy_tokens: 2 ) Congressional representatives , when they vote in office , have two basic duties : to address national issues ( programmatic measures such as the casting of roll - call votes on legislation that imposes costs or benefits for the general population ) and to address local issues ( constituency services and pork barrels ) .


fn_spacy_tokens_for_baseline: ' And he 's mad at them , ' Jamie grinned , drinking his pint as I annihilated various dodging , multi - coloured spacecraft on the screen .

source_bert_toks: ' and he ' s mad at them , ' jamie grinned , drinking his pin ##t as i ann ##ih ##ila ##ted various dod ##ging , multi - coloured spacecraft on the screen .

reference_raw: 'And he's mad at them,' Jamie said, sipping a pint as I wiped out the various dodging, multicolored spaceships on the screen.

reference_spacy_tokens: ' And he 's mad at them , ' Jamie said , sipping a pint as I wiped out the various dodging , multicolored spaceships on the screen .


fn_spacy_tokens_for_baseline: The rasp of his beard stubble was a sweet pain .

source_bert_toks: the ras ##p of his beard stubble was a sweet pain .

reference_raw: The rustle of his beard stubble was a sweet pain.

reference_spacy_tokens: The rustle of his beard stubble was a sweet pain .


fn_spacy_tokens_for_baseline: Over 350,000 copies of the trilogy have been sold and the hardback is now in its fifth reprint .

source_bert_toks: over 350 , 000 copies of the trilogy have been sold and the hard ##back is now in its fifth reprint .

reference_raw: More than 350,000 copies of the trilogy have been sold, and the backdrop is now in its fifth reprint.

reference_spacy_tokens: More than 350,000 copies of the trilogy have been sold , and the backdrop is now in its fifth reprint .


fn_spacy_tokens_for_baseline: In 1967 , the military took the reins of power in Athens , and until 1974 , the " Colonels " held sway with a repressive and brutal regime .

source_bert_toks: in 1967 , the military took the reins of power in athens , and until 1974 , the " colonel ##s " held sway with a rep ##ress ##ive and brutal regime .

reference_raw: In 1967, the army took the reins of power in Athens, and by 1974 the colonels held sway under a repressive and brutal regime.

reference_spacy_tokens: In 1967 , the army took the reins of power in Athens , and by 1974 the colonels held sway under a repressive and brutal regime .


fn_spacy_tokens_for_baseline: His silence about the authorship of the more famous epigram thus amounts almost to a denial that Simonides wrote it .

source_bert_toks: his silence about the authorship of the more famous ep ##ig ##ram thus amounts almost to a denial that simon ##ides wrote it .

reference_raw: His silence as to the authorship of the more famous epigraph is, therefore, almost a denial that Simonides wrote it.

reference_spacy_tokens: His silence as to the authorship of the more famous epigraph is , therefore , almost a denial that Simonides wrote it .


fn_spacy_tokens_for_baseline: To portray a sex fiend , the press needs sex attacks .

source_bert_toks: to portray a sex fi ##end , the press needs sex attacks .

reference_raw: In order to depict a sex offender, the press needs a sexual assault.

reference_spacy_tokens: In order to depict a sex offender , the press needs a sexual assault .


fn_spacy_tokens_for_baseline: She shook her head to rearrange her disarrayed hair ; the golden tresses tumbling about her face and shoulders in glorious abandon made her look doubly desirable .

source_bert_toks: she shook her head to rear ##rang ##e her di ##sar ##ray ##ed hair ; the golden tres ##ses tumbling about her face and shoulders in glorious abandon made her look do ##ub ##ly desirable .

reference_raw: She shook her head to rearrange her disarrayed hair; the gold tresses tumbling about her face and shoulders in glorious abandon made her look doubly desirable.

reference_spacy_tokens: She shook her head to rearrange her disarrayed hair ; the gold tresses tumbling about her face and shoulders in glorious abandon made her look doubly desirable .


fn_spacy_tokens_for_baseline: SPECIAL RULES : Kislev Horse Archers can skirmish as described in the rules for skirmishing troops in the Warhammer rulebook .

source_bert_toks: special rules : ki ##sle ##v horse archers can skirmish as described in the rules for skirmish ##ing troops in the war ##hammer rule ##book .

reference_raw: Kislev Horse Archers can fight as described in the Warhammer rulebook rules for fighting soldiers.

reference_spacy_tokens: Kislev Horse Archers can fight as described in the Warhammer rulebook rules for fighting soldiers .


fn_spacy_tokens_for_baseline: Goodenache watched them , not knowing in his befuddled state what to do .

source_bert_toks: good ##ena ##che watched them , not knowing in his be ##fu ##ddled state what to do .

reference_raw: Goodenache watched them, not knowing what to do in his confused state.

reference_spacy_tokens: Goodenache watched them , not knowing what to do in his confused state .


fn_spacy_tokens_for_baseline: Another horrific cry rose into the night , raising the small hairs on two ill - washed necks , and causing Pooley 's teeth to chatter noisily .

source_bert_toks: another horrific cry rose into the night , raising the small hairs on two ill - washed necks , and causing poole ##y ' s teeth to chatter no ##isi ##ly .

reference_raw: Another terrible cry rose into the night, raising the little hairs of two badly washed necks, causing Pooley's teeth to chat loudly.

reference_spacy_tokens: Another terrible cry rose into the night , raising the little hairs of two badly washed necks , causing Pooley 's teeth to chat loudly .


fn_spacy_tokens_for_baseline: The plans showed over forty rooms and vestibules on four elevations , with two staircases , two lifts that stopped at every floor , hot and cold running water in all five bathrooms , water closets that flushed , electric light , a cellar , a garage and a garden .

source_bert_toks: the plans showed over forty rooms and vest ##ib ##ules on four elevations , with two staircase ##s , two lifts that stopped at every floor , hot and cold running water in all five bathrooms , water closet ##s that flushed , electric light , a cellar , a garage and a garden .

reference_raw: The blueprints showed more than forty rooms and lobbys at four altitudes, two stairways, two elevators that stopped on each floor, hot and cold running water in all five bathrooms, water closets that flushed, electric light, basement, garage and garden.

reference_spacy_tokens: The blueprints showed more than forty rooms and lobbys at four altitudes , two stairways , two elevators that stopped on each floor , hot and cold running water in all five bathrooms , water closets that flushed , electric light , basement , garage and garden .


fn_spacy_tokens_for_baseline: Through the cool and shady pine trees , there is a private beach with bar .

source_bert_toks: through the cool and shady pine trees , there is a private beach with bar .

reference_raw: There's a private beach with a bar through the cold and shadowy pine trees.

reference_spacy_tokens: There 's a private beach with a bar through the cold and shadowy pine trees .


fn_spacy_tokens_for_baseline: Um , yeah when I started to be able to decide what I wanted to read , as opposed to having somebody read it to me , I tended to lean more towards , yeah , fantasy - type books .

source_bert_toks: um , yeah when i started to be able to decide what i wanted to read , as opposed to having somebody read it to me , i tended to lean more towards , yeah , fantasy - type books .

reference_raw: Um, yeah, when I started making up my mind what I wanted to hear, instead of having someone reread it to me, I tended to lean closer to, yeah, fantasy-type books.

reference_spacy_tokens: Um , yeah , when I started making up my mind what I wanted to hear , instead of having someone reread it to me , I tended to lean closer to , yeah , fantasy - type books .


fn_spacy_tokens_for_baseline: Under Dauntless 's watchful eye , Cleo prowled around the attic , exploring .

source_bert_toks: under da ##unt ##less ' s watch ##ful eye , cl ##eo pro ##wled around the attic , exploring .

reference_raw: Under Dauntless's watchful eye, Cleo prowled around the loft and studied it.

reference_spacy_tokens: Under Dauntless 's watchful eye , Cleo prowled around the loft and studied it .


fn_spacy_tokens_for_baseline: And suddenly Morse knew where the body had been launched into the river and into eternity ; knew , too , that if Lucy Downes could so quickly arouse the rather sluggish libido of a Lewis , then it was hardly difficult to guess her effect upon the lively carnality of a Kemp .

source_bert_toks: and suddenly morse knew where the body had been launched into the river and into eternity ; knew , too , that if lucy down ##es could so quickly ar ##ouse the rather slug ##gis ##h li ##bid ##o of a lewis , then it was hardly difficult to guess her effect upon the lively car ##nal ##ity of a kemp .

reference_raw: And suddenly Morse knew where the body had been dumped into the river and into eternity; he also knew that if Lucy Downes had been able to arouse Lewis's rather slow libido so quickly, it would be hard to guess what effect it had on the living flesh of the Kemp.

reference_spacy_tokens: And suddenly Morse knew where the body had been dumped into the river and into eternity ; he also knew that if Lucy Downes had been able to arouse Lewis 's rather slow libido so quickly , it would be hard to guess what effect it had on the living flesh of the Kemp .


fn_spacy_tokens_for_baseline: Here they found Sir Archibald Douglas awaiting them , his Galloway levies , to the number of almost two thousand , hidden in a great declivity of the hills to the north - east .

source_bert_toks: here they found sir archibald douglas awaiting them , his galloway levi ##es , to the number of almost two thousand , hidden in a great dec ##li ##vity of the hills to the north - east .

reference_raw: Here they found Sir Archibald Douglas waiting for them, with his Galloway levies of nearly two thousand, hidden in the high hills to the northeast.

reference_spacy_tokens: Here they found Sir Archibald Douglas waiting for them , with his Galloway levies of nearly two thousand , hidden in the high hills to the northeast .


fn_spacy_tokens_for_baseline: In August 1818 Ibrahim , son of Muhammad Ali Pasha , viceroy of Egypt , captured the Saudi capital of Dara'iyyah .

source_bert_toks: in august 1818 ibrahim , son of muhammad ali pasha , viceroy of egypt , captured the saudi capital of dar ##a ' i ##yya ##h .

reference_raw: In August 1818, Ibrahim, son of Muhammad Ali Pasha, the Vice-Roy of Egypt, captured the Saudi capital of Dara'iyah.

reference_spacy_tokens: In August 1818 , Ibrahim , son of Muhammad Ali Pasha , the Vice - Roy of Egypt , captured the Saudi capital of Dara'iyah .


fn_spacy_tokens_for_baseline: He then was responsible for salting the venison and packing it in barrels , and keeping it safe until required , or sending it wherever the king wanted it .

source_bert_toks: he then was responsible for salt ##ing the ve ##nis ##on and packing it in barrels , and keeping it safe until required , or sending it wherever the king wanted it .

reference_raw: Then it was his responsibility to saline the poison, to pack it in barrels, to keep it safe until it was necessary, or to send it wherever the King wanted it to be.

reference_spacy_tokens: Then it was his responsibility to saline the poison , to pack it in barrels , to keep it safe until it was necessary , or to send it wherever the King wanted it to be .


fn_spacy_tokens_for_baseline: In April he apologised again in Okinawa , Japan 's southernmost island and scene of much wartime brutality .

source_bert_toks: in april he ap ##olo ##gis ##ed again in okinawa , japan ' s southernmost island and scene of much wartime brutality .

reference_raw: In April, he apologized again in Okinawa, the southmost island of Japan, and a scene of extreme war brutality.

reference_spacy_tokens: In April , he apologized again in Okinawa , the southmost island of Japan , and a scene of extreme war brutality .


fn_spacy_tokens_for_baseline: She burped surreptitiously , still churning .

source_bert_toks: she bu ##rp ##ed sur ##re ##pt ##iti ##ously , still churning .

reference_raw: She bellowed surreptitiously, still churning.

reference_spacy_tokens: She bellowed surreptitiously , still churning .


fn_spacy_tokens_for_baseline: I kneed him in the balls as hard as I could .

source_bert_toks: i knee ##d him in the balls as hard as i could .

reference_raw: I knelt down on his balls as hard as I could.

reference_spacy_tokens: I knelt down on his balls as hard as I could .


fn_spacy_tokens_for_baseline: JERUSALEM Israel has stopped targeting Palestinian militants for death , Israeli security officials said early today , fulfilling one Palestinian condition for a truce .

source_bert_toks: jerusalem israel has stopped targeting palestinian militants for death , israeli security officials said early today , fulfilling one palestinian condition for a truce .

reference_raw: JERUSALM Israel stopped targeting Palestinian militants for death, Israeli security officials said earlier today, meeting one of the Palestinian conditions for a truce.

reference_spacy_tokens: JERUSALM Israel stopped targeting Palestinian militants for death , Israeli security officials said earlier today , meeting one of the Palestinian conditions for a truce .


fn_spacy_tokens_for_baseline: It pounded the soft earth and gurgled along the gutters to splash with relentless monotony into the tub outside the back door .

source_bert_toks: it pounded the soft earth and gu ##rg ##led along the gut ##ters to splash with relentless mono ##ton ##y into the tub outside the back door .

reference_raw: He pounded on the soft ground and began to gurgle along the sewers, splashing in relentless monotony into the bath outside the rear door.

reference_spacy_tokens: He pounded on the soft ground and began to gurgle along the sewers , splashing in relentless monotony into the bath outside the rear door .


fn_spacy_tokens_for_baseline: ' I find it useful to recite calming verse in moments of great stress . '

source_bert_toks: ' i find it useful to rec ##ite calming verse in moments of great stress . '

reference_raw: "I think it's useful to recite the soothing verse in times of great stress."

reference_spacy_tokens: " I think it 's useful to recite the soothing verse in times of great stress . "


fn_spacy_tokens_for_baseline: It grabbed a chair , crunched the metal -- like paper , and flung it aside with a snarl .

source_bert_toks: it grabbed a chair , crunch ##ed the metal - - like paper , and flung it aside with a snarl .

reference_raw: He grabbed a chair, scraped the metal like paper, and hurled it away with a growl.

reference_spacy_tokens: He grabbed a chair , scraped the metal like paper , and hurled it away with a growl .


fn_spacy_tokens_for_baseline: You can view artifacts from the Bronze Age , trace the history of the Easter Rising , or revisit Leopold Bloom 's odyssey in Ulysses .

source_bert_toks: you can view artifacts from the bronze age , trace the history of the easter rising , or rev ##isi ##t leopold bloom ' s odyssey in ulysses .

reference_raw: You can view the artefacts of the Bronze Age, trace the history of the Easter Rising, or review the Odyssey of Leopold Bloom in Ulysses.

reference_spacy_tokens: You can view the artefacts of the Bronze Age , trace the history of the Easter Rising , or review the Odyssey of Leopold Bloom in Ulysses .


fn_spacy_tokens_for_baseline: About -80 ° C , antifreeze turns to pink ice and gasoline ( petrol ) fails to vaporize or ignite .

source_bert_toks: about - 80 ##° ##c , anti ##free ##ze turns to pink ice and gasoline ( petrol ) fails to vapor ##ize or ign ##ite .

reference_raw: Around -80°C, the anti-freeze turns to pink ice and petrol (petrol) does not evaporate or ignite.

reference_spacy_tokens: Around -80 ° C , the anti - freeze turns to pink ice and petrol ( petrol ) does not evaporate or ignite .


fn_spacy_tokens_for_baseline: ' You 're a smart kid , ' he lisped in his movie - star voice .

source_bert_toks: ' you ' re a smart kid , ' he li ##sp ##ed in his movie - star voice .

reference_raw: "You're a clever boy," he said in the voice of the movie star.

reference_spacy_tokens: " You 're a clever boy , " he said in the voice of the movie star .


fn_spacy_tokens_for_baseline: Did you spot that tiny patch of freckles on her left cheek ?

source_bert_toks: did you spot that tiny patch of fr ##eck ##les on her left cheek ?

reference_raw: Did you see that little patch of crackle on her left cheek?

reference_spacy_tokens: Did you see that little patch of crackle on her left cheek ?


fn_spacy_tokens_for_baseline: In 2002 , Iran tested a new version of its Muajar-4 ( Mohajer ) unmanned aerial vehicle ( UAV ) , which some experts claim could be used for potential CBW delivery .

source_bert_toks: in 2002 , iran tested a new version of its mu ##aja ##r - 4 ( mo ##ha ##jer ) unmanned aerial vehicle ( ua ##v ) , which some experts claim could be used for potential cb ##w delivery .

reference_raw: In 2002, Iran tested a new version of its Muajar-4 (Mohajer) unmanned aircraft vehicle (UAV), which some experts claim could be used for the possible supply of CBW.

reference_spacy_tokens: In 2002 , Iran tested a new version of its Muajar-4 ( Mohajer ) unmanned aircraft vehicle ( UAV ) , which some experts claim could be used for the possible supply of CBW .


fn_spacy_tokens_for_baseline: The valley narrows as the enclosing heights crowd in and the road ascends to a large car park and signs inviting a visit to the Falls of Measach nearby .

source_bert_toks: the valley narrows as the en ##cl ##osing heights crowd in and the road as ##cend ##s to a large car park and signs inviting a visit to the falls of me ##asa ##ch nearby .

reference_raw: The valley narrows as the surrounding heights crowd in, and the road rises to a large parking lot and signs calling for a visit to the Measach Falls nearby.

reference_spacy_tokens: The valley narrows as the surrounding heights crowd in , and the road rises to a large parking lot and signs calling for a visit to the Measach Falls nearby .


fn_spacy_tokens_for_baseline: In many cases the Romans merely paved the existing roadways , but their needs were not always those of their predecessors , and they were obliged to pioneer new routes .

source_bert_toks: in many cases the romans merely paved the existing roadway ##s , but their needs were not always those of their predecessors , and they were obliged to pioneer new routes .

reference_raw: In many cases, the Romans had merely padded existing roads, but their needs were not always those of their predecessors, and they had to pioneer new roads.

reference_spacy_tokens: In many cases , the Romans had merely padded existing roads , but their needs were not always those of their predecessors , and they had to pioneer new roads .


fn_spacy_tokens_for_baseline: Revitalise your image with the help of our experts

source_bert_toks: rev ##ital ##ise your image with the help of our experts

reference_raw: Revitalize your image with the help of our experts


fn_spacy_tokens_for_baseline: The odour of seaweed wafted from the cliffs beyond the harbour and mingled with the fragrance of Jo 's cigar .

source_bert_toks: the o ##dou ##r of sea ##weed wa ##fted from the cliffs beyond the harbour and mingled with the fragrance of jo ' s cigar .

reference_raw: The smell of seaweed wafted from the cliffs behind the harbor, mingling with the smell of Jo's cigar.

reference_spacy_tokens: The smell of seaweed wafted from the cliffs behind the harbor , mingling with the smell of Jo 's cigar .


fn_spacy_tokens_for_baseline: Haslemere Border road runners took on a windy and hilly course at Cranleigh last Sunday .

source_bert_toks: has ##lem ##ere border road runners took on a windy and hilly course at cr ##an ##leigh last sunday .

reference_raw: Last Sunday, Haslemere Border Road Runners took a wind-drenched, hilly course in Cranleigh.

reference_spacy_tokens: Last Sunday , Haslemere Border Road Runners took a wind - drenched , hilly course in Cranleigh .


fn_spacy_tokens_for_baseline: Pot up one or two strawberry plants for a special treat : bring them into a cool greenhouse or conservatory , watering sparingly .

source_bert_toks: pot up one or two strawberry plants for a special treat : bring them into a cool greenhouse or conservatory , watering spa ##ring ##ly .

reference_raw: Pour one or two strawberry plants for special treatment: bring them to a cold greenhouse or conservatory and water sparingly.

reference_spacy_tokens: Pour one or two strawberry plants for special treatment : bring them to a cold greenhouse or conservatory and water sparingly .


fn_spacy_tokens_for_baseline: The expensive ( and dangerous ) charm of the FBR derives from its ability to breed fissile plutonium 239 for use as its fuel from uranium 's most common isotope , non - fissionable U238 .

source_bert_toks: the expensive ( and dangerous ) charm of the f ##br derives from its ability to breed fis ##sil ##e pluto ##nium 239 for use as its fuel from uranium ' s most common isotope , non - fission ##able u2 ##38 .

reference_raw: The FBR's expensive (and dangerous) charm derives from its ability to produce fission plutonium 239 for use as fuel from the most common isotope of uranium, non-fissionable U238.

reference_spacy_tokens: The FBR 's expensive ( and dangerous ) charm derives from its ability to produce fission plutonium 239 for use as fuel from the most common isotope of uranium , non - fissionable U238 .


fn_spacy_tokens_for_baseline: In any event , you will at least not now disgrace your coffin . '

source_bert_toks: in any event , you will at least not now disgrace your coffin . '

reference_raw: In any case, at least you won't dishonor your coffin now.'

reference_spacy_tokens: In any case , at least you wo n't dishonor your coffin now . '


fn_spacy_tokens_for_baseline: The crossing , which is normally thronged with Palestinians , closed for the day when the explosion occurred .

source_bert_toks: the crossing , which is normally th ##rong ##ed with palestinians , closed for the day when the explosion occurred .

reference_raw: The crossing, which is usually crowded with Palestinians, has been shut down for the day of the explosion.

reference_spacy_tokens: The crossing , which is usually crowded with Palestinians , has been shut down for the day of the explosion .


fn_spacy_tokens_for_baseline: But perhaps history is on the Weinsteins ' side : It took jerks like the old - time moguls to bring film to maturity .

source_bert_toks: but perhaps history is on the wei ##nstein ##s ' side : it took jerk ##s like the old - time mo ##gul ##s to bring film to maturity .

reference_raw: But maybe history is on the Weinstein side: it took idiots like old moguls to make a movie mature.

reference_spacy_tokens: But maybe history is on the Weinstein side : it took idiots like old moguls to make a movie mature .


fn_spacy_tokens_for_baseline: Mrs Baggley examined the disbelief in Theodora 's eye before she went on , ' I 'm not sure how much Mrs Thrigg is influenced here by the theme of the novelettes she devours .

source_bert_toks: mrs bag ##gley examined the disbelief in theodor ##a ' s eye before she went on , ' i ' m not sure how much mrs th ##ri ##gg is influenced here by the theme of the novel ##ettes she dev ##ours .

reference_raw: Mrs. Baggley examined the incredulity in Theodora's eyes before continuing, "I don't know how much Mrs. Thrigg is affected by the subject of the novels she eats.

reference_spacy_tokens: Mrs. Baggley examined the incredulity in Theodora 's eyes before continuing , " I do n't know how much Mrs. Thrigg is affected by the subject of the novels she eats .


fn_spacy_tokens_for_baseline: Holding his breath , Patrick lifted the gate slightly to prevent it scraping along the ground and then pushed it open .

source_bert_toks: holding his breath , patrick lifted the gate slightly to prevent it scraping along the ground and then pushed it open .

reference_raw: Patrick held his breath, lifted the gate slightly to keep it from scratching the floor, then opened it.

reference_spacy_tokens: Patrick held his breath , lifted the gate slightly to keep it from scratching the floor , then opened it .


fn_spacy_tokens_for_baseline: They did the journey without the luxury of a hood or a heater in temperatures which at one point dipped to minus 4C.

source_bert_toks: they did the journey without the luxury of a hood or a heat ##er in temperatures which at one point dipped to minus 4 ##c .

reference_raw: They made the journey without the luxury of a hood or a heater at a temperature that went down to minus 4C at one point.

reference_spacy_tokens: They made the journey without the luxury of a hood or a heater at a temperature that went down to minus 4C at one point .


fn_spacy_tokens_for_baseline: ' If I did n't know it was impossible , I 'd swear you 'd cooked up this little plot deliberately . '

source_bert_toks: ' if i didn ' t know it was impossible , i ' d swear you ' d cooked up this little plot deliberately . '

reference_raw: "If I didn't know it wasn't possible, I'd have sworn that you made this little conspiracy on purpose."

reference_spacy_tokens: " If I did n't know it was n't possible , I 'd have sworn that you made this little conspiracy on purpose . "


fn_spacy_tokens_for_baseline: From 1980 to 1990 Iran refused to pay for ar accept delivery of uranium enriched to 3 % U-235 processed by Eurodif .

source_bert_toks: from 1980 to 1990 iran refused to pay for ar accept delivery of uranium enriched to 3 % u - 235 processed by euro ##di ##f .

reference_raw: Between 1980 and 1990, Iran refused to pay for or accept the supply of 3% U-235 enriched uranium prepared by Eurodif.

reference_spacy_tokens: Between 1980 and 1990 , Iran refused to pay for or accept the supply of 3 % U-235 enriched uranium prepared by Eurodif .


fn_spacy_tokens_for_baseline: It was hard to tell because his face was masked with ribbons of caked blood , and his eyes were just slits in a puffy mess of red and black bruises .

source_bert_toks: it was hard to tell because his face was masked with ribbons of cake ##d blood , and his eyes were just slits in a puff ##y mess of red and black bruises .

reference_raw: It was hard to tell, for his face was covered with ribbons of caked blood, and his eyes were slits in a cloud of red and black bruises.

reference_spacy_tokens: It was hard to tell , for his face was covered with ribbons of caked blood , and his eyes were slits in a cloud of red and black bruises .


fn_spacy_tokens_for_baseline: Finally , she cajoled half a dozen men to help her break into the jail .

source_bert_toks: finally , she ca ##jo ##led half a dozen men to help her break into the jail .

reference_raw: She finally cheered up half a dozen men to help her break into the prison.

reference_spacy_tokens: She finally cheered up half a dozen men to help her break into the prison .


fn_spacy_tokens_for_baseline: ' When he told me he was panning for gold , I simply did n't believe it .

source_bert_toks: ' when he told me he was pan ##ning for gold , i simply didn ' t believe it .

reference_raw: When he told me he was going for gold, I just didn't believe it.

reference_spacy_tokens: When he told me he was going for gold , I just did n't believe it .


fn_spacy_tokens_for_baseline: They wink , they pout , they gobble down the complimentary potato salad .

source_bert_toks: they wink , they po ##ut , they go ##bble down the compliment ##ary potato salad .

reference_raw: They wink, pout, eat free potato salad.

reference_spacy_tokens: They wink , pout , eat free potato salad .


fn_spacy_tokens_for_baseline: The tree has fruited quite well again , though it is too early for the fruits to have taken on their heady aroma .

source_bert_toks: the tree has fruit ##ed quite well again , though it is too early for the fruits to have taken on their head ##y aroma .

reference_raw: The tree was fruitful again, though it was too soon for the fruit to have a heady smell.

reference_spacy_tokens: The tree was fruitful again , though it was too soon for the fruit to have a heady smell .


fn_spacy_tokens_for_baseline: They 'll starve us all to death ! '

source_bert_toks: they ' ll star ##ve us all to death ! '

reference_raw: We're all going to die of starvation!'

reference_spacy_tokens: We 're all going to die of starvation ! '


fn_spacy_tokens_for_baseline: China and Japan were not on speaking terms , so trade between them had to be channeled through a neutral middleman .

source_bert_toks: china and japan were not on speaking terms , so trade between them had to be channel ##ed through a neutral middle ##man .

reference_raw: China and Japan were not speaking, and trade between them had to be channelled through a neutral intermediary.

reference_spacy_tokens: China and Japan were not speaking , and trade between them had to be channelled through a neutral intermediary .


fn_spacy_tokens_for_baseline: Another camera was bolted to one of the aircraft , yet another was in a third observer aircraft , as the formation took off from Rendcombe 's grass runway .

source_bert_toks: another camera was bolted to one of the aircraft , yet another was in a third observer aircraft , as the formation took off from ren ##dc ##om ##be ' s grass runway .

reference_raw: Another camera was fixed on one of the planes, but the other was on the third watcher plane when the formation left Rendcombe's grassy runway.

reference_spacy_tokens: Another camera was fixed on one of the planes , but the other was on the third watcher plane when the formation left Rendcombe 's grassy runway .


fn_spacy_tokens_for_baseline: Nicandra regretted that her friend was not sleeping in the largest guest room , with the biggest possible fire taking the edge off its disused chill ; for not many visitors slept at Deer Forest .

source_bert_toks: nic ##andra regretted that her friend was not sleeping in the largest guest room , with the biggest possible fire taking the edge off its disused chill ; for not many visitors slept at deer forest .

reference_raw: Nicandra regretted that her friend had not slept in the largest visitor's room, and that the greatest possible fire had taken the edge of its disused cold; for few visitors had slept in the Deer Forest.

reference_spacy_tokens: Nicandra regretted that her friend had not slept in the largest visitor 's room , and that the greatest possible fire had taken the edge of its disused cold ; for few visitors had slept in the Deer Forest .


fn_spacy_tokens_for_baseline: They refer variously to ' depictions ' or ' expressions ' of the crime .

source_bert_toks: they refer variously to ' depictions ' or ' expressions ' of the crime .

reference_raw: They refer differently to "images" or "expressions" of a crime.

reference_spacy_tokens: They refer differently to " images " or " expressions " of a crime .


fn_spacy_tokens_for_baseline: For once in her life she left the loft with the lights on and the hatch open .

source_bert_toks: for once in her life she left the loft with the lights on and the hatch open .

reference_raw: For the first time in her life, she left the attic with the lights on and the hatch open.

reference_spacy_tokens: For the first time in her life , she left the attic with the lights on and the hatch open .


fn_spacy_tokens_for_baseline: Unix System Labs is set to kick off a Solution Providers Program May 17 in which it will partner with systems integrators such as EDS and make sales calls with them .

source_bert_toks: unix system labs is set to kick off a solution providers program may 17 in which it will partner with systems int ##eg ##rator ##s such as eds and make sales calls with them .

reference_raw: Unix System Labs is set to launch the Solution Providers program on May 17, in which it will associate with system integrators such as EDS and make sales calls with them.

reference_spacy_tokens: Unix System Labs is set to launch the Solution Providers program on May 17 , in which it will associate with system integrators such as EDS and make sales calls with them .


fn_spacy_tokens_for_baseline: They messed up a baton change and failed to finish , creeping from the track with the ribald comments of the crowd in their ears !

source_bert_toks: they messed up a baton change and failed to finish , creeping from the track with the rib ##ald comments of the crowd in their ears !

reference_raw: They spoiled the change of the baton and failed to complete it, creeping out of the track with the ribald comments of the crowd in their ears!

reference_spacy_tokens: They spoiled the change of the baton and failed to complete it , creeping out of the track with the ribald comments of the crowd in their ears !


fn_spacy_tokens_for_baseline: He 's been waiting to get even with you , that 's all .

source_bert_toks: he ' s been waiting to get even with you , that ' s all .

reference_raw: He was just waiting for you to get back together, that's all.

reference_spacy_tokens: He was just waiting for you to get back together , that 's all .


fn_spacy_tokens_for_baseline: Suddenly the Trunchbull lunged forward and grabbed the large empty china platter on which the cake had rested .

source_bert_toks: suddenly the tr ##un ##ch ##bu ##ll lunged forward and grabbed the large empty china platt ##er on which the cake had rested .

reference_raw: Suddenly the Trunchbull lunged forward and took hold of the large, empty porcelain plate on which the cake had been resting.

reference_spacy_tokens: Suddenly the Trunchbull lunged forward and took hold of the large , empty porcelain plate on which the cake had been resting .


fn_spacy_tokens_for_baseline: Erika thawed , melted , forgave Fritz , for which he was pathetically grateful , and sent him for fruit juice while she looked for Paul who was happily playing table tennis .

source_bert_toks: erika tha ##wed , melted , for ##ga ##ve fritz , for which he was pathetic ##ally grateful , and sent him for fruit juice while she looked for paul who was happily playing table tennis .

reference_raw: Erica melted, melted, forgave Fritz, for which he was pitifully grateful, and sent him out for fruit juice, looking for Paul, who was happy to play table tennis.

reference_spacy_tokens: Erica melted , melted , forgave Fritz , for which he was pitifully grateful , and sent him out for fruit juice , looking for Paul , who was happy to play table tennis .


fn_spacy_tokens_for_baseline: Mr Hale won three awards , including the Queen 's Commendation for Brave Conduct , after he made six journeys into the blazing inferno to help save lives .

source_bert_toks: mr hale won three awards , including the queen ' s commendation for brave conduct , after he made six journeys into the blazing inferno to help save lives .

reference_raw: Mr. Hale won three awards, including the Queen's Commendation for Brave Behavior, after six trips to the burning hell to help save lives.

reference_spacy_tokens: Mr. Hale won three awards , including the Queen 's Commendation for Brave Behavior , after six trips to the burning hell to help save lives .


fn_spacy_tokens_for_baseline: An important son was Nebo , who was later deified as the god of learning , for taking the gift of written language to other kingdoms .

source_bert_toks: an important son was ne ##bo , who was later dei ##fied as the god of learning , for taking the gift of written language to other kingdoms .

reference_raw: The important son was Nebo, who later became the god of learning, because he had taken the gift of written language to other kingdoms.

reference_spacy_tokens: The important son was Nebo , who later became the god of learning , because he had taken the gift of written language to other kingdoms .


fn_spacy_tokens_for_baseline: Coming to Goodwill was the first step toward my becoming totally independent .

source_bert_toks: coming to goodwill was the first step toward my becoming totally independent .

reference_raw: Coming to Goodwill was the first step to becoming completely independent.

reference_spacy_tokens: Coming to Goodwill was the first step to becoming completely independent .


fn_spacy_tokens_for_baseline: I could picture that : a Technicolor sunrise , and three singing sailors swarming through the docks .

source_bert_toks: i could picture that : a tech ##nic ##olo ##r sunrise , and three singing sailors swarm ##ing through the docks .

reference_raw: I could imagine it: the dawn of the Technicolor, and three singing sailors scurrying through the docks.

reference_spacy_tokens: I could imagine it : the dawn of the Technicolor , and three singing sailors scurrying through the docks .


fn_spacy_tokens_for_baseline: US Federal District Judge Robert F. Collins of New Orleans was indicted on Feb. 8 for allegedly promising a ' favourable consideration ' to a marijuana smuggler -- who was awaiting sentence -- in return for a bribe .

source_bert_toks: us federal district judge robert f . collins of new orleans was indicted on feb . 8 for allegedly promising a ' favourable consideration ' to a marijuana smug ##gler - - who was awaiting sentence - - in return for a bribe .

reference_raw: The U.S. Federal District Judge Robert F. Collins of New Orleans has been charged with Feb. 8 for supposedly promising a'favorable consideration' to a marijuana runner-who is awaiting a sentence-in exchange for a bribe.

reference_spacy_tokens: The U.S. Federal District Judge Robert F. Collins of New Orleans has been charged with Feb. 8 for supposedly promising a'favorable consideration ' to a marijuana runner - who is awaiting a sentence - in exchange for a bribe .


fn_spacy_tokens_for_baseline: The less complicated version of playing tunes on bells , as do the carillons of continental Europe , is considered by the English to be childish , fit only for foreigners .

source_bert_toks: the less complicated version of playing tunes on bells , as do the car ##illon ##s of continental europe , is considered by the english to be childish , fit only for foreigners .

reference_raw: The less complex text of playing songs on bells, like the carillons of continental Europe, is regarded by the English as childish and fit only for foreigners.

reference_spacy_tokens: The less complex text of playing songs on bells , like the carillons of continental Europe , is regarded by the English as childish and fit only for foreigners .


fn_spacy_tokens_for_baseline: The deal is in the best interests of the United States as it will make them partners with the world 's largest democracy , marking an important step in their strategic relationship , he said .

source_bert_toks: the deal is in the best interests of the united states as it will make them partners with the world ' s largest democracy , marking an important step in their strategic relationship , he said .

reference_raw: The agreement is in the best interest of the United States, because it will make them partners with the largest democracy in the world and mark an important step in their strategy, he said.

reference_spacy_tokens: The agreement is in the best interest of the United States , because it will make them partners with the largest democracy in the world and mark an important step in their strategy , he said .


fn_spacy_tokens_for_baseline: I toddled through the gate and made for the tree because it was studded all over with soft dark fruit .

source_bert_toks: i todd ##led through the gate and made for the tree because it was stud ##ded all over with soft dark fruit .

reference_raw: I toddled through the gate and made my way to the tree, for it was full of soft, dark fruit.

reference_spacy_tokens: I toddled through the gate and made my way to the tree , for it was full of soft , dark fruit .


fn_spacy_tokens_for_baseline: The engine purred throatily , doors clunked with glamorous solidity , the car felt luxurious and astronomically expensive .

source_bert_toks: the engine pu ##rred throat ##ily , doors cl ##unk ##ed with g ##lam ##orous solid ##ity , the car felt luxurious and astronomical ##ly expensive .

reference_raw: The engine purred throatily, the door closed with glamorous solidity, and the car felt luxurious and astronomically expensive.

reference_spacy_tokens: The engine purred throatily , the door closed with glamorous solidity , and the car felt luxurious and astronomically expensive .


fn_spacy_tokens_for_baseline: He said : ' Barbara Coleman is what you English call a chatterbox .

source_bert_toks: he said : ' barbara coleman is what you english call a chatter ##box .

reference_raw: "Barbara Coleman is what you English call a chat box," he said.

reference_spacy_tokens: " Barbara Coleman is what you English call a chat box , " he said .


fn_spacy_tokens_for_baseline: Exposure to lead was calculated from antenatal and delivery maternal blood samples , and samples from the children at birth , six and 15 months , two years , then annually .

source_bert_toks: exposure to lead was calculated from ant ##ena ##tal and delivery maternal blood samples , and samples from the children at birth , six and 15 months , two years , then annually .

reference_raw: The exposure to lead was calculated on the basis of antenatal and delivery mother blood samples and on the basis of samples from infants at birth, six and 15 months, two years and then once a year.

reference_spacy_tokens: The exposure to lead was calculated on the basis of antenatal and delivery mother blood samples and on the basis of samples from infants at birth , six and 15 months , two years and then once a year .


fn_spacy_tokens_for_baseline: RED ink is splattered all over Britain 's companies .

source_bert_toks: red ink is sp ##lat ##tered all over britain ' s companies .

reference_raw: The RED ink is scattered throughout Britain's companies.

reference_spacy_tokens: The RED ink is scattered throughout Britain 's companies .


fn_spacy_tokens_for_baseline: Everything hung on this final event of the year .

source_bert_toks: everything hung on this final event of the year .

reference_raw: It all depended on the last event of the year.

reference_spacy_tokens: It all depended on the last event of the year .


fn_spacy_tokens_for_baseline: ' Poor thing , ' she 'd sob , thinking about the heroine , and she 'd get undressed so that she could carry on crying in bed .

source_bert_toks: ' poor thing , ' she ' d sob , thinking about the heroine , and she ' d get und ##ressed so that she could carry on crying in bed .

reference_raw: "Poor thing," she sobbed, thinking of the heroine, and took off her clothes so that she could continue to cry in bed.

reference_spacy_tokens: " Poor thing , " she sobbed , thinking of the heroine , and took off her clothes so that she could continue to cry in bed .


fn_spacy_tokens_for_baseline: Pressure mounts as Bond shares slide to 10-year low

source_bert_toks: pressure mounts as bond shares slide to 10 - year low

reference_raw: Pressure rises as Bond shares slip to a 10-year low


fn_spacy_tokens_for_baseline: If a mish - mash of tartans with ostentatious golden embroideries of coronation coaches and ' E ' monograms are your bag , take heart .

source_bert_toks: if a mis ##h - mas ##h of tar ##tan ##s with os ##ten ##tat ##ious golden em ##bro ##ider ##ies of coronation coaches and ' e ' mono ##gram ##s are your bag , take heart .

reference_raw: If your bag is a mash of tartans with ostentatious golden embroideries of coronation carriages and "E" monographs, take it from me.

reference_spacy_tokens: If your bag is a mash of tartans with ostentatious golden embroideries of coronation carriages and " E " monographs , take it from me .


fn_spacy_tokens_for_baseline: I 'll type out my notes for you in some kind of order , giving correct dates and names , but I can give you a brief run - down now . '

source_bert_toks: i ' ll type out my notes for you in some kind of order , giving correct dates and names , but i can give you a brief run - down now . '

reference_raw: I'll write you my notes in some order, give you the right dates and names, but I can give you a short run.'

reference_spacy_tokens: I 'll write you my notes in some order , give you the right dates and names , but I can give you a short run . '


fn_spacy_tokens_for_baseline: Saccharine , for instance , or the ersatz in general , he abominated .

source_bert_toks: sac ##cha ##rine , for instance , or the er ##sat ##z in general , he ab ##omi ##nated .

reference_raw: Saccharine, for example, or the ersatz in general, was abomination.

reference_spacy_tokens: Saccharine , for example , or the ersatz in general , was abomination .


fn_spacy_tokens_for_baseline: Another one of his tricks was to lurk behind the counter at the Turk 's Head so customers would think there was no one there , and then , when they were thinking of leaving or helping themselves to the jam doughnuts , he 'd leap on to a wooden box to bring his large dome head just above the level of the counter and say , ' Can I help you ? ' in a very loud voice .

source_bert_toks: another one of his tricks was to lu ##rk behind the counter at the turk ' s head so customers would think there was no one there , and then , when they were thinking of leaving or helping themselves to the jam dough ##nut ##s , he ' d leap on to a wooden box to bring his large dome head just above the level of the counter and say , ' can i help you ? ' in a very loud voice .

reference_raw: One of his other tricks was to hide behind the counter at the Turk's Head so that the customers would think there was no one there, and when they thought of leaving or helping themselves to the jamming donuts, he would jump to a wooden box and bring his big dome head just above the level of the counter and say, "Can I help you?" in a very noisy voice.

reference_spacy_tokens: One of his other tricks was to hide behind the counter at the Turk 's Head so that the customers would think there was no one there , and when they thought of leaving or helping themselves to the jamming donuts , he would jump to a wooden box and bring his big dome head just above the level of the counter and say , " Can I help you ? " in a very noisy voice .


fn_spacy_tokens_for_baseline: The fire has spread extensively and it is estimated that approximately 2,500 acres of forest have been damaged .

source_bert_toks: the fire has spread extensively and it is estimated that approximately 2 , 500 acres of forest have been damaged .

reference_raw: The fire has spread widely and is estimated to have damaged some 2,500 acres of forest.

reference_spacy_tokens: The fire has spread widely and is estimated to have damaged some 2,500 acres of forest .


fn_spacy_tokens_for_baseline: Square Face : Wear a headpiece that sits on the back of your head and opt for an understated veil style , although your face shape will carry a long veil beautifully .

source_bert_toks: square face : wear a head ##piece that sits on the back of your head and opt for an under ##sta ##ted veil style , although your face shape will carry a long veil beautifully .

reference_raw: Square Face: Wear the headphone that sits on the back of your head and chooses the underestimated style of the veil, though the shape of your face will be beautifully veiled.

reference_spacy_tokens: Square Face : Wear the headphone that sits on the back of your head and chooses the underestimated style of the veil , though the shape of your face will be beautifully veiled .


fn_spacy_tokens_for_baseline: But nobody coaches or motivates quite like Barrington and his personality , almost as much as Parke 's burgeoning promise , was written all over this enthralling match .

source_bert_toks: but nobody coaches or mo ##tiv ##ates quite like barrington and his personality , almost as much as park ##e ' s bu ##rgeon ##ing promise , was written all over this en ##th ##ral ##ling match .

reference_raw: But no one coaches or encourages the likes of Barrington and his personality, almost as much as Parke's burgeoning promise, was written in this enthusiastic game.

reference_spacy_tokens: But no one coaches or encourages the likes of Barrington and his personality , almost as much as Parke 's burgeoning promise , was written in this enthusiastic game .


fn_spacy_tokens_for_baseline: On the Thursday Luis Mendoza pulled a groin muscle , so Luke had to take his place .

source_bert_toks: on the thursday luis mendoza pulled a groin muscle , so luke had to take his place .

reference_raw: Luis Mendoza drew a groin muscle on Thursday, so Luke had to take his place.

reference_spacy_tokens: Luis Mendoza drew a groin muscle on Thursday , so Luke had to take his place .


fn_spacy_tokens_for_baseline: The many - to - many relationship between the entity PARENT and the entity CHILD is 2 : n ( that is , each child has two parents ) ; but a PARENT can beget more than one CHILD .

source_bert_toks: the many - to - many relationship between the entity parent and the entity child is 2 : n ( that is , each child has two parents ) ; but a parent can beg ##et more than one child .

reference_raw: The many-to-many relationship between PARENT and CHILD is 2:n (i.e. each child has two parents); however, PARENT may produce more than one CHILD.

reference_spacy_tokens: The many - to - many relationship between PARENT and CHILD is 2 : n ( i.e. each child has two parents ) ; however , PARENT may produce more than one CHILD .


fn_spacy_tokens_for_baseline: Braille and large print materials are bulky ; braillers , typewriters , tape recorders and closed circuit television sets are both heavy and demanding of space .

source_bert_toks: bra ##ille and large print materials are bulky ; bra ##ille ##rs , type ##writer ##s , tape recorder ##s and closed circuit television sets are both heavy and demanding of space .

reference_raw: Brailles and large print materials are large; braillers, typewriters, tape recorders and closed-circuit televisions are both heavy and space-intensive.

reference_spacy_tokens: Brailles and large print materials are large ; braillers , typewriters , tape recorders and closed - circuit televisions are both heavy and space - intensive .


fn_spacy_tokens_for_baseline: She plastered his head with a yellow liquid that stung like salt when it ran into his eyes .

source_bert_toks: she plastered his head with a yellow liquid that stung like salt when it ran into his eyes .

reference_raw: She covered his head with a yellow liquid that stung like salt as it ran into his eyes.

reference_spacy_tokens: She covered his head with a yellow liquid that stung like salt as it ran into his eyes .


fn_spacy_tokens_for_baseline: Sandhu is being held without bond by the INS pending deportation hearings .

source_bert_toks: sand ##hu is being held without bond by the ins pending deportation hearings .

reference_raw: Sandhu is being held unbound by the INS until deportation hearings.

reference_spacy_tokens: Sandhu is being held unbound by the INS until deportation hearings .


fn_spacy_tokens_for_baseline: The exterior of both buildings will have a face lift along with the reception area at No . 5 .

source_bert_toks: the exterior of both buildings will have a face lift along with the reception area at no . 5 .

reference_raw: The outside of both buildings will be face-lifted along with the reception area at 5.

reference_spacy_tokens: The outside of both buildings will be face - lifted along with the reception area at 5 .


fn_spacy_tokens_for_baseline: The night of the next day we entrained .

source_bert_toks: the night of the next day we en ##train ##ed .

reference_raw: On the night of the following day, we've been trained.

reference_spacy_tokens: On the night of the following day , we 've been trained .


fn_spacy_tokens_for_baseline: Faber is introducing a new vertical blind called Uprite which has aluminium slats and will give unequalled service as it can be washed and re - hung immediately .

source_bert_toks: faber is introducing a new vertical blind called up ##rite which has aluminium sl ##ats and will give une ##qual ##led service as it can be washed and re - hung immediately .

reference_raw: Faber introduces a new vertical blind called Uprite, which has aluminum slats and provides an uneven service, as it can be washed and hung immediately.

reference_spacy_tokens: Faber introduces a new vertical blind called Uprite , which has aluminum slats and provides an uneven service , as it can be washed and hung immediately .


fn_spacy_tokens_for_baseline: I give them a hot mash too , as well as letting them scratch about here , we cook up all the scraps in the kitchen .

source_bert_toks: i give them a hot mas ##h too , as well as letting them scratch about here , we cook up all the scrap ##s in the kitchen .

reference_raw: I'm also giving them hot mash, and I'm gonna let them scratch around here, and we're gonna make all the leftovers in the kitchen.

reference_spacy_tokens: I 'm also giving them hot mash , and I 'm gon na let them scratch around here , and we 're gon na make all the leftovers in the kitchen .


fn_spacy_tokens_for_baseline: At his institute in Copenhagen ardent youths would arrive to lay their latest intellectual offering before him and to seek his criticism and approbation .

source_bert_toks: at his institute in copenhagen ardent youths would arrive to lay their latest intellectual offering before him and to seek his criticism and app ##ro ##bation .

reference_raw: At his institute in Copenhagen, young people would come to present their latest intellectual offer to him, and to seek his criticism and approval.

reference_spacy_tokens: At his institute in Copenhagen , young people would come to present their latest intellectual offer to him , and to seek his criticism and approval .


fn_spacy_tokens_for_baseline: Then I fucked up .

source_bert_toks: then i fucked up .

reference_raw: And then I screwed it up.

reference_spacy_tokens: And then I screwed it up .


fn_spacy_tokens_for_baseline: The Cyclon-30 cyclotron , provided by Belgium 's Ion Beam Applications , is the same model as the cyclotron in Iran , where it is suspected of being used to enrich uranium .

source_bert_toks: the cy ##cl ##on - 30 cy ##cl ##ot ##ron , provided by belgium ' s ion beam applications , is the same model as the cy ##cl ##ot ##ron in iran , where it is suspected of being used to en ##rich uranium .

reference_raw: Cyclotron-30, supplied by Belgian ion-beam applications, is the same model as the cyclotron in Iran, where it is believed to be used for uranium enrichment.

reference_spacy_tokens: Cyclotron-30 , supplied by Belgian ion - beam applications , is the same model as the cyclotron in Iran , where it is believed to be used for uranium enrichment .


fn_spacy_tokens_for_baseline: Those misalignments include the dollar 's tumble to postwar lows in 1995 .

source_bert_toks: those mis ##ali ##gn ##ments include the dollar ' s tumble to postwar low ##s in 1995 .

reference_raw: These imbalances include the fall of the dollar into postwar lows in 1995.

reference_spacy_tokens: These imbalances include the fall of the dollar into postwar lows in 1995 .


fn_spacy_tokens_for_baseline: Then we could go to his place and learn to sledge .

source_bert_toks: then we could go to his place and learn to sl ##edge .

reference_raw: Then we can go to him and learn how to sled.

reference_spacy_tokens: Then we can go to him and learn how to sled .


fn_spacy_tokens_for_baseline: Agonizing over what to say , he was suddenly struck by inspiration .

source_bert_toks: ago ##ni ##zing over what to say , he was suddenly struck by inspiration .

reference_raw: Inspiring at what to say, he was suddenly struck by inspiration.

reference_spacy_tokens: Inspiring at what to say , he was suddenly struck by inspiration .


fn_spacy_tokens_for_baseline: That , combined with the formation of the Nevada Gaming Control Board , would signal the beginning of the end for heavy mob influence in the city .

source_bert_toks: that , combined with the formation of the nevada gaming control board , would signal the beginning of the end for heavy mob influence in the city .

reference_raw: This, together with the creation of the Nevada Gaming Control Board, would signal the beginning of the end of the city's massive crowd influence.

reference_spacy_tokens: This , together with the creation of the Nevada Gaming Control Board , would signal the beginning of the end of the city 's massive crowd influence .


fn_spacy_tokens_for_baseline: Such an arrangement would encourage defendants to plead guilty to the lesser offence and thus spare the complainant the trauma of giving evidence in court .

source_bert_toks: such an arrangement would encourage defendants to plead guilty to the lesser offence and thus spare the complain ##ant the trauma of giving evidence in court .

reference_raw: Such an agreement would encourage the defendants to confess to a minor offence and thus save the complainant from the trauma of testifying in court.

reference_spacy_tokens: Such an agreement would encourage the defendants to confess to a minor offence and thus save the complainant from the trauma of testifying in court .


fn_spacy_tokens_for_baseline: Eventually , he turns your support into a payoff for all of us .

source_bert_toks: eventually , he turns your support into a pay ##off for all of us .

reference_raw: In the end, it turns your support into a payoff for all of us.

reference_spacy_tokens: In the end , it turns your support into a payoff for all of us .


fn_spacy_tokens_for_baseline: Second , the political response to a rapid deterioration in the economy implies a greater probability of a coup d'etat or a battening down of the hatches by the government .

source_bert_toks: second , the political response to a rapid deterioration in the economy implies a greater probability of a coup d ' etat or a bat ##ten ##ing down of the hatch ##es by the government .

reference_raw: Secondly, a political response to a fast economic downturn means that the government is more likely to take a coup d'etat or hit the hatches.

reference_spacy_tokens: Secondly , a political response to a fast economic downturn means that the government is more likely to take a coup d'etat or hit the hatches .


fn_spacy_tokens_for_baseline: The major changes were not to daily tasks and routines , but to the political power base , which changed regularly and not necessarily peacefully throughout the ages .

source_bert_toks: the major changes were not to daily tasks and routines , but to the political power base , which changed regularly and not necessarily peacefully throughout the ages .

reference_raw: The major changes were not in everyday tasks and routines, but in a political base that changed regularly and not necessarily in peace over the years.

reference_spacy_tokens: The major changes were not in everyday tasks and routines , but in a political base that changed regularly and not necessarily in peace over the years .


fn_spacy_tokens_for_baseline: Parents could be forgiven for thinking it 's another foreign language , the current wave of political bickering about education .

source_bert_toks: parents could be forgiven for thinking it ' s another foreign language , the current wave of political bi ##cker ##ing about education .

reference_raw: Parents can be forgiven for thinking it's another foreign language, a current wave of political squabbling about education.

reference_spacy_tokens: Parents can be forgiven for thinking it 's another foreign language , a current wave of political squabbling about education .


fn_spacy_tokens_for_baseline: Ajla was to have been taken with her father to live with a German family after her recuperation .

source_bert_toks: aj ##la was to have been taken with her father to live with a german family after her rec ##up ##eration .

reference_raw: After her recovery, Ajla was to be taken with her father to live with the German family.

reference_spacy_tokens: After her recovery , Ajla was to be taken with her father to live with the German family .


fn_spacy_tokens_for_baseline: A CHARITY which provides holidays for underprivileged children has issued a plea for help .

source_bert_toks: a charity which provides holidays for under ##pr ##iv ##ile ##ged children has issued a plea for help .

reference_raw: A request for assistance was made by the CHARITY, which provides holidays for disadvantaged children.

reference_spacy_tokens: A request for assistance was made by the CHARITY , which provides holidays for disadvantaged children .


fn_spacy_tokens_for_baseline: He lost his hold on the bag and a slew of rice and chicken and ochre sauce splashed on to the carpet .

source_bert_toks: he lost his hold on the bag and a sl ##ew of rice and chicken and och ##re sauce splashed on to the carpet .

reference_raw: He lost his grip on the bag and splashed on the carpet with rice and chicken and ochre sauce.

reference_spacy_tokens: He lost his grip on the bag and splashed on the carpet with rice and chicken and ochre sauce .


fn_spacy_tokens_for_baseline: He regilded picture frames , glued back together broken cups and plates .

source_bert_toks: he reg ##ilde ##d picture frames , glued back together broken cups and plates .

reference_raw: He regilded the frames of the paintings and put the broken cups and plates back together.

reference_spacy_tokens: He regilded the frames of the paintings and put the broken cups and plates back together .


fn_spacy_tokens_for_baseline: If American think - tankers would find Germany odd , they would be floored by Japan -- but would cock an interested eyebrow when they went to the Soviet Union .

source_bert_toks: if american think - tanker ##s would find germany odd , they would be floor ##ed by japan - - but would cock an interested eyebrow when they went to the soviet union .

reference_raw: If American think tankers find Germany odd, they'll be flattened by Japan - but they'll raise an interested eyebrow when they go to the Soviet Union.

reference_spacy_tokens: If American think tankers find Germany odd , they 'll be flattened by Japan - but they 'll raise an interested eyebrow when they go to the Soviet Union .


fn_spacy_tokens_for_baseline: The following weekend I cemented capping stones round the top of the new pond and also round the header pools .

source_bert_toks: the following weekend i cement ##ed cap ##ping stones round the top of the new pond and also round the header pools .

reference_raw: The following week I put the capping stones around the top of the new pond and around the header pools.

reference_spacy_tokens: The following week I put the capping stones around the top of the new pond and around the header pools .


fn_spacy_tokens_for_baseline: Fifth : Securing supply of food and water .

source_bert_toks: fifth : securing supply of food and water .

reference_raw: Five: Provision of food and water supplies.

reference_spacy_tokens: Five : Provision of food and water supplies .


fn_spacy_tokens_for_baseline: I took the fedora from the hat peg and perched it over my brow .

source_bert_toks: i took the fed ##ora from the hat peg and perched it over my brow .

reference_raw: I took the fedora out of the hatpeg and put it on my forehead.

reference_spacy_tokens: I took the fedora out of the hatpeg and put it on my forehead .


fn_spacy_tokens_for_baseline: There was a loud clack behind him as one of the players hurled the white down the table , scattering the colours .

source_bert_toks: there was a loud cl ##ack behind him as one of the players hurled the white down the table , scattering the colours .

reference_raw: There was a loud click behind him as one of the players threw the white on the table, scattering the colors.

reference_spacy_tokens: There was a loud click behind him as one of the players threw the white on the table , scattering the colors .


fn_spacy_tokens_for_baseline: They have Kalashnikov rifles slung ready across their chests and wear distinctive red and white armbands and helmets .

source_bert_toks: they have kala ##sh ##nikov rifles slung ready across their chests and wear distinctive red and white arm ##band ##s and helmets .

reference_raw: They've got Kalashnikov rifles hanging over their chests and wearing distinctive red-and-white bracelets and helmets.

reference_spacy_tokens: They 've got Kalashnikov rifles hanging over their chests and wearing distinctive red - and - white bracelets and helmets .


fn_spacy_tokens_for_baseline: She was economical in her conversation .

source_bert_toks: she was economical in her conversation .

reference_raw: In her conversation, she was economic.

reference_spacy_tokens: In her conversation , she was economic .


fn_spacy_tokens_for_baseline: A yelp of shock escaped her as the door opened forcefully beneath her second assault to reveal a figure straight out of a Viking saga .

source_bert_toks: a ye ##lp of shock escaped her as the door opened forcefully beneath her second assault to reveal a figure straight out of a viking saga .

reference_raw: A scream of shock escaped her as the door swung open under her second attack, revealing a figure directly from the Viking sag.

reference_spacy_tokens: A scream of shock escaped her as the door swung open under her second attack , revealing a figure directly from the Viking sag .


fn_spacy_tokens_for_baseline: Sepp Blatter , the secretary general of Fifa , has described Rojas as ' a mediocre actor ' .

source_bert_toks: sep ##p b ##lat ##ter , the secretary general of fifa , has described ro ##jas as ' a med ##io ##cre actor ' .

reference_raw: Sepp Blatter, secretary-general of Fifa, described Rojas as an average actor.

reference_spacy_tokens: Sepp Blatter , secretary - general of Fifa , described Rojas as an average actor .


fn_spacy_tokens_for_baseline: As they parked and headed for the open front door , a smiling woman in a dusky pink two - piece and with her silver hair caught back in a chignon appeared to welcome them .

source_bert_toks: as they parked and headed for the open front door , a smiling woman in a dusk ##y pink two - piece and with her silver hair caught back in a chi ##gnon appeared to welcome them .

reference_raw: As they parked and headed for the open front door, they were greeted by a smiling woman in a dark pink double-piece, her silver hair caught in a chignon.

reference_spacy_tokens: As they parked and headed for the open front door , they were greeted by a smiling woman in a dark pink double - piece , her silver hair caught in a chignon .


fn_spacy_tokens_for_baseline: The police radioed for help and very soon ten more squad cards and twenty - five officers swarmed around Willis 's home while a police helicopter spotlighted on the scene with its powerful searchlight .

source_bert_toks: the police radio ##ed for help and very soon ten more squad cards and twenty - five officers swarm ##ed around willis ' s home while a police helicopter spotlight ##ed on the scene with its powerful search ##light .

reference_raw: The police called for help, and very soon there were ten other squad cards and twenty-five officers swarming around Willis' house, while a police helicopter with its powerful headlights was on the scene.

reference_spacy_tokens: The police called for help , and very soon there were ten other squad cards and twenty - five officers swarming around Willis ' house , while a police helicopter with its powerful headlights was on the scene .


fn_spacy_tokens_for_baseline: All the predictable grunts , groans and tear - jerking final showdown are in place , which is both very cynical and very reassuring .

source_bert_toks: all the predictable grunt ##s , groans and tear - jerking final showdown are in place , which is both very cynical and very reassuring .

reference_raw: All the predictable grunts, groans, and the final showdown of tears are in place, which is both very cynical and very comforting.

reference_spacy_tokens: All the predictable grunts , groans , and the final showdown of tears are in place , which is both very cynical and very comforting .


fn_spacy_tokens_for_baseline: Iraq says the United States and Britain hold up delivery of needed supplies , using their clout in the United Nations .

source_bert_toks: iraq says the united states and britain hold up delivery of needed supplies , using their cl ##out in the united nations .

reference_raw: Iraq claims that the United States and the United Kingdom are delaying the delivery of the necessary resources by using their influence in the United Nations.

reference_spacy_tokens: Iraq claims that the United States and the United Kingdom are delaying the delivery of the necessary resources by using their influence in the United Nations .


fn_spacy_tokens_for_baseline: Hefty young chap like that could have swatted her out of the way with one hand ! '

source_bert_toks: he ##ft ##y young cha ##p like that could have swat ##ted her out of the way with one hand ! '

reference_raw: Such a heavy young man could have knocked her out of the way with one hand!'

reference_spacy_tokens: Such a heavy young man could have knocked her out of the way with one hand ! '


fn_spacy_tokens_for_baseline: Maggie 's baby was a puny infant , but he thrived against all the odds and was baptized Patrick after his father .

source_bert_toks: maggie ' s baby was a pun ##y infant , but he thrive ##d against all the odds and was baptized patrick after his father .

reference_raw: Maggie's child was a small child, but he prospered against all odds and was baptized by Patrick after his father.

reference_spacy_tokens: Maggie 's child was a small child , but he prospered against all odds and was baptized by Patrick after his father .


fn_spacy_tokens_for_baseline: Diana was so chummy with him she even used to iron his shirts .

source_bert_toks: diana was so chu ##mmy with him she even used to iron his shirts .

reference_raw: Diana was so stupid with him that she even ironed his shirts.

reference_spacy_tokens: Diana was so stupid with him that she even ironed his shirts .


fn_spacy_tokens_for_baseline: In November 2000 , China promised not to assist any country in the development of nuclear - capable ballistic missiles .

source_bert_toks: in november 2000 , china promised not to assist any country in the development of nuclear - capable ballistic missiles .

reference_raw: In December 2000, China promised not to help any country develop nuclear-skilled ballistic missiles.

reference_spacy_tokens: In December 2000 , China promised not to help any country develop nuclear - skilled ballistic missiles .


fn_spacy_tokens_for_baseline: Now , with money in the bank , a small crew of employees and plenty of business , what does Mr Chambers put his relative success down to ?

source_bert_toks: now , with money in the bank , a small crew of employees and plenty of business , what does mr chambers put his relative success down to ?

reference_raw: With money in the bank, a small staff, and a lot of business, where does Mr. Chambers put his relative success?

reference_spacy_tokens: With money in the bank , a small staff , and a lot of business , where does Mr. Chambers put his relative success ?


fn_spacy_tokens_for_baseline: This time , Adlesperger 's battalion was assigned to sweep a neighborhood that had been the responsibility of another unit during the initial attack .

source_bert_toks: this time , ad ##les ##per ##ger ' s battalion was assigned to sweep a neighborhood that had been the responsibility of another unit during the initial attack .

reference_raw: This time, Adlesperger's battalion had been assigned to search the area under the responsibility of another unit during the first attack.

reference_spacy_tokens: This time , Adlesperger 's battalion had been assigned to search the area under the responsibility of another unit during the first attack .


fn_spacy_tokens_for_baseline: For a moment she looked furiously at Donald , her teeth bared like a cat 's , then she shook her hair out , spattering Donald with bree and barley , and hauled him back into the dance .

source_bert_toks: for a moment she looked furiously at donald , her teeth bared like a cat ' s , then she shook her hair out , spat ##tering donald with bree and barley , and hauled him back into the dance .

reference_raw: She glared at Donald for a moment, her teeth bared like a cat's, then shook her hair, splashed Donald with bree and barley, and dragged him back into the dance.

reference_spacy_tokens: She glared at Donald for a moment , her teeth bared like a cat 's , then shook her hair , splashed Donald with bree and barley , and dragged him back into the dance .


fn_spacy_tokens_for_baseline: And the throne of the country was occupied by a puppet - king regarded as an iniquitous usurper .

source_bert_toks: and the throne of the country was occupied by a puppet - king regarded as an in ##iq ##uit ##ous us ##ur ##per .

reference_raw: And the throne of the land was occupied by a puppet king who was considered an evil usurper.

reference_spacy_tokens: And the throne of the land was occupied by a puppet king who was considered an evil usurper .


fn_spacy_tokens_for_baseline: Some cleansers help loosen simple blackheads , but are unsuitable for whiteheads , inflamed pimples or cysts .

source_bert_toks: some clean ##ser ##s help loosen simple black ##heads , but are unsuitable for whitehead ##s , in ##fl ##ame ##d pi ##mple ##s or cy ##sts .

reference_raw: Some cleansers help to loosen simple black heads, but they are not suitable for whiteheads, inflammatory pimples or cysts.

reference_spacy_tokens: Some cleansers help to loosen simple black heads , but they are not suitable for whiteheads , inflammatory pimples or cysts .


fn_spacy_tokens_for_baseline: We are a third - rate rugby nation at present , but that does n't mean we have to stay third - rate ' .

source_bert_toks: we are a third - rate rugby nation at present , but that doesn ' t mean we have to stay third - rate ' .

reference_raw: We're currently a third-class rugby nation, but that doesn't mean we have to stay in the third grade.

reference_spacy_tokens: We 're currently a third - class rugby nation , but that does n't mean we have to stay in the third grade .


fn_spacy_tokens_for_baseline: Mr Charlwood was a widower with two teenage daughters and did not want to leave them for longer than necessary .

source_bert_toks: mr char ##l ##wood was a widow ##er with two teenage daughters and did not want to leave them for longer than necessary .

reference_raw: Mr. Charlwood was a widowed man with two teenage daughters, and he didn't want to leave them any longer than he had to.

reference_spacy_tokens: Mr. Charlwood was a widowed man with two teenage daughters , and he did n't want to leave them any longer than he had to .


fn_spacy_tokens_for_baseline: Again , a person charged with attempted larceny can not be convicted of attempting to obtain by false pretences ( Rex v. Gallagher ( 1929 ) 21 Cr . App . R. 172 ) .

source_bert_toks: again , a person charged with attempted la ##rce ##ny can not be convicted of attempting to obtain by false pre ##ten ##ces ( rex v . gallagher ( 1929 ) 21 cr . app . r . 172 ) .

reference_raw: Once again, a person accused of attempted robbery cannot be convicted of attempted fraud (Rex v. Gallagher (1929) 21 C.A.P.R. 172).

reference_spacy_tokens: Once again , a person accused of attempted robbery can not be convicted of attempted fraud ( Rex v. Gallagher ( 1929 ) 21 C.A.P.R. 172 ) .


fn_spacy_tokens_for_baseline: ' Shall I be able to reach you at 1027 , Westminster Drive ? ' she asked .

source_bert_toks: ' shall i be able to reach you at 102 ##7 , westminster drive ? ' she asked .

reference_raw: "Can I get to you at 1027, Westminster Drive?" she asked.

reference_spacy_tokens: " Can I get to you at 1027 , Westminster Drive ? " she asked .


fn_spacy_tokens_for_baseline: Four robed men were idling beneath the ' cafe ' sign , which was daubed in white on the mud wall .

source_bert_toks: four robe ##d men were id ##ling beneath the ' cafe ' sign , which was da ##ub ##ed in white on the mud wall .

reference_raw: Under the "cafe" sign, daubed in white on the mud wall, four cloaked men were idling.

reference_spacy_tokens: Under the " cafe " sign , daubed in white on the mud wall , four cloaked men were idling .


fn_spacy_tokens_for_baseline: It seemed especially designed to give weight to his ineptitudes , lending a ridiculous dignity in space to what he had screwed up , like making a free - hanging sculpture of a broken egg - whisk .

source_bert_toks: it seemed especially designed to give weight to his in ##ept ##itude ##s , lending a ridiculous dignity in space to what he had screwed up , like making a free - hanging sculpture of a broken egg - w ##his ##k .

reference_raw: It seemed especially designed to give weight to his incompetence, to give the ridiculous dignity of the universe to what he'd messed up, like making a free-hanging statue of a broken egg whisker.

reference_spacy_tokens: It seemed especially designed to give weight to his incompetence , to give the ridiculous dignity of the universe to what he 'd messed up , like making a free - hanging statue of a broken egg whisker .


fn_spacy_tokens_for_baseline: It was a heavy snowfall and by morning even the most prominent landmark was disguised beneath a thick covering of snow .

source_bert_toks: it was a heavy snowfall and by morning even the most prominent landmark was disguised beneath a thick covering of snow .

reference_raw: The snow was heavy, and in the morning even the most prominent landmark was hidden under a thick snow cover.

reference_spacy_tokens: The snow was heavy , and in the morning even the most prominent landmark was hidden under a thick snow cover .


fn_spacy_tokens_for_baseline: ' That is to go down to my wine cellar and get a bottle of nice cold vintage champagne .

source_bert_toks: ' that is to go down to my wine cellar and get a bottle of nice cold vintage champagne .

reference_raw: 'That's to go down to the basement of my wine and get a bottle of nice, cold wine champagne.

reference_spacy_tokens: ' That 's to go down to the basement of my wine and get a bottle of nice , cold wine champagne .


fn_spacy_tokens_for_baseline: The Counts were well pleased at this ; but all the people of the land were sorrowful .

source_bert_toks: the counts were well pleased at this ; but all the people of the land were sorrow ##ful .

reference_raw: The Counts were pleased; but all the people in the country were sad.

reference_spacy_tokens: The Counts were pleased ; but all the people in the country were sad .


fn_spacy_tokens_for_baseline: On 11 January 2007 , China successfully carried out a test of a direct ascent anti - satellite ( ASAT ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the Earth 's surface .

source_bert_toks: on 11 january 2007 , china successfully carried out a test of a direct ascent anti - satellite ( asa ##t ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the earth ' s surface .

reference_raw: As of 11 January 2007, China successfully tested a direct-accession anti-sat (ASAT) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth.

reference_spacy_tokens: As of 11 January 2007 , China successfully tested a direct - accession anti - sat ( ASAT ) weapon by using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth .