fn_spacy_tokens_for_baseline: Some minerals seem to survive more or less unaltered even after being subject to prolonged weathering , whereas others decompose very rapidly .

source_bert_toks: some minerals seem to survive more or less una ##lter ##ed even after being subject to prolonged weather ##ing , whereas others deco ##mp ##ose very rapidly .

reference_raw: Some minerals appear to survive more or less unchanged even after a long period of weather, while others decay very quickly.

reference_spacy_tokens: Some minerals appear to survive more or less unchanged even after a long period of weather , while others decay very quickly .


fn_spacy_tokens_for_baseline: In general , these groups are more prepared to inflict indiscriminate casualties because they are not driven by specific political goals but rather by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .

source_bert_toks: in general , these groups are more prepared to in ##flict ind ##is ##cr ##imi ##nate casualties because they are not driven by specific political goals but rather by irrational belief systems , ex ##tre ##mist id ##eo ##logies ( such as neo - nazis ##m ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamental ##ism .

reference_raw: In general, these groups are more prepared to inflict indiscriminate losses because they are not driven by specific political goals, but by irrational belief systems, extremist ideologies (such as neo-Nazism), apocalyptic prophecy (predicting the end of the world), or religious fundamentalism.

reference_spacy_tokens: In general , these groups are more prepared to inflict indiscriminate losses because they are not driven by specific political goals , but by irrational belief systems , extremist ideologies ( such as neo - Nazism ) , apocalyptic prophecy ( predicting the end of the world ) , or religious fundamentalism .


fn_spacy_tokens_for_baseline: Vitor went down on his hunkers and , much to the child 's glee , spent a minute or two admiring the toy .

source_bert_toks: vito ##r went down on his hu ##nk ##ers and , much to the child ' s glee , spent a minute or two admiring the toy .

reference_raw: Vitor sank to his knees and, to the child's delight, spent a minute or two admiring the toy.

reference_spacy_tokens: Vitor sank to his knees and , to the child 's delight , spent a minute or two admiring the toy .


fn_spacy_tokens_for_baseline: He notified the Royal Greenwich Observatory , which confirmed the discovery and cabled the central clearing house for astronomical telegrams at the Harvard - Smithsonian Center for Astrophysics in Cambridge , Massachusetts .

source_bert_toks: he notified the royal greenwich observatory , which confirmed the discovery and cable ##d the central clearing house for astronomical telegram ##s at the harvard - smithsonian center for astro ##physics in cambridge , massachusetts .

reference_raw: He reported to the Royal Greenwich Observatory, which confirmed that he had discovered and wired the central clearing house for astronomical telegrams at the Harvard-Smithson Center for Astrophysics in Cambridge, Massachusetts.

reference_spacy_tokens: He reported to the Royal Greenwich Observatory , which confirmed that he had discovered and wired the central clearing house for astronomical telegrams at the Harvard - Smithson Center for Astrophysics in Cambridge , Massachusetts .


fn_spacy_tokens_for_baseline: Archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

source_bert_toks: archaeology shows that , during this time , societies lived mainly in coastal trading towns with little settlement inland .

reference_raw: Archaeological evidence shows that, during that period, companies lived mainly in offshore trading cities with small settlements inland.

reference_spacy_tokens: Archaeological evidence shows that , during that period , companies lived mainly in offshore trading cities with small settlements inland .


fn_spacy_tokens_for_baseline: In April 2004 , six truck drivers working for Halliburton Co. were killed , and a seventh is missing and presumed dead .

source_bert_toks: in april 2004 , six truck drivers working for hall ##ib ##urt ##on co . were killed , and a seventh is missing and presumed dead .

reference_raw: In April 2004, six truck drivers working for Halliburton Co. were killed, and the 7th is missing and deemed dead.

reference_spacy_tokens: In April 2004 , six truck drivers working for Halliburton Co. were killed , and the 7th is missing and deemed dead .


fn_spacy_tokens_for_baseline: The aroma that exuded from the chemist shop in those days like er Depends what they 'd been using you see ?

source_bert_toks: the aroma that ex ##uded from the chemist shop in those days like er depends what they ' d been using you see ?

reference_raw: The smell that came out of the pharmacy at the time like er Depends on what they used you to see?

reference_spacy_tokens: The smell that came out of the pharmacy at the time like er Depends on what they used you to see ?


fn_spacy_tokens_for_baseline: Places to avoid : We would n't recommend the glass - bottom boat tour around the reefs of Nassau .

source_bert_toks: places to avoid : we wouldn ' t recommend the glass - bottom boat tour around the reefs of nassau .

reference_raw: We wouldn't recommend a glass-bottom cruise around the Nassau cliffs.

reference_spacy_tokens: We would n't recommend a glass - bottom cruise around the Nassau cliffs .


fn_spacy_tokens_for_baseline: The kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compounded by factors like physical and mental disabilities , illiteracy and lack of job skills .

source_bert_toks: the kinds of services we provide help people deal with obstacles like health care , transportation and child care - problems that are big enough on their own without being compound ##ed by factors like physical and mental disabilities , ill ##iter ##acy and lack of job skills .

reference_raw: The types of services we provide help people to tackle obstacles such as health care, transport and childcare - problems that are large enough in themselves, without being compounded by factors such as physical and mental disabilities, illiteracy and job shortages.

reference_spacy_tokens: The types of services we provide help people to tackle obstacles such as health care , transport and childcare - problems that are large enough in themselves , without being compounded by factors such as physical and mental disabilities , illiteracy and job shortages .


fn_spacy_tokens_for_baseline: His gaze slanted over her .

source_bert_toks: his gaze slant ##ed over her .

reference_raw: He looked at her.

reference_spacy_tokens: He looked at her .


fn_spacy_tokens_for_baseline: The countryside around Dilley teems with wildlife .

source_bert_toks: the countryside around dil ##ley tee ##ms with wildlife .

reference_raw: The landscape around Dilley is full of wildlife.

reference_spacy_tokens: The landscape around Dilley is full of wildlife .


fn_spacy_tokens_for_baseline: The proof of this lies in the fact that it was H E who had arranged for the presence of Scott Eccles , which could only have been done for the purpose of an alibi .

source_bert_toks: the proof of this lies in the fact that it was h e who had arranged for the presence of scott ec ##cles , which could only have been done for the purpose of an ali ##bi .

reference_raw: The evidence is that HE arranged for Scott Eccles to be present, which could only be done for an alibi.

reference_spacy_tokens: The evidence is that HE arranged for Scott Eccles to be present , which could only be done for an alibi .


fn_spacy_tokens_for_baseline: In any case , Ari , do n't lose sleep over any big hotel being built here .

source_bert_toks: in any case , ari , don ' t lose sleep over any big hotel being built here .

reference_raw: Anyway, Ari, don't lose it because you're building a big hotel here.

reference_spacy_tokens: Anyway , Ari , do n't lose it because you 're building a big hotel here .


fn_spacy_tokens_for_baseline: Simple heavy cotton parkas and overjackets go well with chunky sweaters and jeans .

source_bert_toks: simple heavy cotton park ##as and over ##jack ##ets go well with chunk ##y sweater ##s and jeans .

reference_raw: Simple, heavy cotton jackets and overcoats go well with big sweaters and jeans.

reference_spacy_tokens: Simple , heavy cotton jackets and overcoats go well with big sweaters and jeans .


fn_spacy_tokens_for_baseline: Bonanno , who turns 90 on Wednesday , served nearly two years in prison for obstruction of justice and refusing to snitch on reputed leaders of New York 's mob .

source_bert_toks: bon ##ann ##o , who turns 90 on wednesday , served nearly two years in prison for obstruction of justice and refusing to s ##ni ##tch on reputed leaders of new york ' s mob .

reference_raw: Bonanno, who was 90 on Wednesday, served almost two years in prison for obstruction of justice and refused to rat out the reputable leaders of the New York mob.

reference_spacy_tokens: Bonanno , who was 90 on Wednesday , served almost two years in prison for obstruction of justice and refused to rat out the reputable leaders of the New York mob .


fn_spacy_tokens_for_baseline: Our culture may have rendered natural selection relatively irrelevant .

source_bert_toks: our culture may have rendered natural selection relatively irrelevant .

reference_raw: Our culture may have made natural selection relatively unimportant.

reference_spacy_tokens: Our culture may have made natural selection relatively unimportant .


fn_spacy_tokens_for_baseline: There was a tone of ineffable self - satisfaction in Jamieson 's voice when he told Doug that he was on his way out to arrest Mac .

source_bert_toks: there was a tone of in ##ef ##fa ##ble self - satisfaction in jamie ##son ' s voice when he told doug that he was on his way out to arrest mac .

reference_raw: Jamieson's voice was unsatisfactory when he told Doug he was on his way to arrest Mac.

reference_spacy_tokens: Jamieson 's voice was unsatisfactory when he told Doug he was on his way to arrest Mac .


fn_spacy_tokens_for_baseline: Over 10,000 residents have evacuated areas threatened by the flames .

source_bert_toks: over 10 , 000 residents have evacuated areas threatened by the flames .

reference_raw: Over 10,000 people have evacuated fire-threatening areas.

reference_spacy_tokens: Over 10,000 people have evacuated fire - threatening areas .


fn_spacy_tokens_for_baseline: The pasted patches of grass must shine in the distance like lighthouses and the pack 's trails , perfumed by their paws , must stretch ahead like lines of reflector studs down the middle of a motorway .

source_bert_toks: the paste ##d patches of grass must shine in the distance like lighthouse ##s and the pack ' s trails , perfume ##d by their paws , must stretch ahead like lines of reflect ##or stud ##s down the middle of a motorway .

reference_raw: Pastures of grass must shine in the distance like beacons, and the trails of the pack, perfumed by their paws, must stretch forward like rows of reflectors in the middle of the motorway.

reference_spacy_tokens: Pastures of grass must shine in the distance like beacons , and the trails of the pack , perfumed by their paws , must stretch forward like rows of reflectors in the middle of the motorway .


fn_spacy_tokens_for_baseline: Women were remarking on the window hangings -- ' You could hang my whole downstairs with one of those red curtains , ' said Mary McCulloch , ' and have a length left over for the beds . '

source_bert_toks: women were remark ##ing on the window hanging ##s - - ' you could hang my whole downstairs with one of those red curtains , ' said mary mcc ##ull ##och , ' and have a length left over for the beds . '

reference_raw: The women remarked on the curtains of the window - 'You could put me all the way down with one of those red curtains,' said Mary McCulloch, 'and you've got a long way to go to bed.'

reference_spacy_tokens: The women remarked on the curtains of the window - ' You could put me all the way down with one of those red curtains , ' said Mary McCulloch , ' and you 've got a long way to go to bed . '


fn_spacy_tokens_for_baseline: Time and again the Romans were stirred by the love of liberty and faction , which is a central feature of the whole urban renaissance , to rise against the pope and send him packing .

source_bert_toks: time and again the romans were stirred by the love of liberty and faction , which is a central feature of the whole urban renaissance , to rise against the pope and send him packing .

reference_raw: Over and over, the Romans were moved by the love of freedom and faction, a central feature of the entire city's renaissance, to rise up against the Pope and send him packing.

reference_spacy_tokens: Over and over , the Romans were moved by the love of freedom and faction , a central feature of the entire city 's renaissance , to rise up against the Pope and send him packing .


fn_spacy_tokens_for_baseline: Do you want me to pay Pasadena on Friday for these months or do you want me to hold off until I finish July and August ?

source_bert_toks: do you want me to pay pasadena on friday for these months or do you want me to hold off until i finish july and august ?

reference_raw: Should I pay Pasadena for these months on Friday, or should I wait till the end of June and August?

reference_spacy_tokens: Should I pay Pasadena for these months on Friday , or should I wait till the end of June and August ?


fn_spacy_tokens_for_baseline: You 'll only hear from us if we want your program , or if you 've enclosed return postage and a suitable mailer for returning disks we 're unable to use .

source_bert_toks: you ' ll only hear from us if we want your program , or if you ' ve enclosed return postage and a suitable mail ##er for returning disks we ' re unable to use .

reference_raw: We'll only let you know if we want your program, or if you've enclosed a return mail and a suitable e-mail to return disks that we can't use.

reference_spacy_tokens: We 'll only let you know if we want your program , or if you 've enclosed a return mail and a suitable e - mail to return disks that we ca n't use .


fn_spacy_tokens_for_baseline: Between 1857 and his arrest in 1862 Chernyshevsky , in collaboration with N. A. Dobroliubov ( 1836 - 61 ) , made of Sovremennik ( The Contemporary ) the most outstanding legal vehicle for subversive propaganda .

source_bert_toks: between 1857 and his arrest in 1862 cher ##ny ##sh ##evsky , in collaboration with n . a . do ##bro ##li ##ub ##ov ( 1836 - 61 ) , made of so ##vre ##men ##nik ( the contemporary ) the most outstanding legal vehicle for sub ##vers ##ive propaganda .

reference_raw: Between 1857 and his arrest in 1862, Chernyshevsky, in cooperation with N.A. Dobroliubov (1836-61), made from Sovremennik (contemporary), the most excellent legal instrument for subversive propaganda.

reference_spacy_tokens: Between 1857 and his arrest in 1862 , Chernyshevsky , in cooperation with N.A. Dobroliubov ( 1836 - 61 ) , made from Sovremennik ( contemporary ) , the most excellent legal instrument for subversive propaganda .


fn_spacy_tokens_for_baseline: The difficulties have arisen mainly in cases where B has misrepresented to A his ( B 's ) identity .

source_bert_toks: the difficulties have arise ##n mainly in cases where b has mis ##re ##pres ##ented to a his ( b ' s ) identity .

reference_raw: Difficulties arise mainly in cases where B incorrectly represented his (B) identity to A.

reference_spacy_tokens: Difficulties arise mainly in cases where B incorrectly represented his ( B ) identity to A.


fn_spacy_tokens_for_baseline: Far better to relax in your favourite armchair , enjoy a drink with your husband ( or wife ) and talk through today 's problems than escape with a mate for endless rounds of gin and tonic .

source_bert_toks: far better to relax in your favourite armchair , enjoy a drink with your husband ( or wife ) and talk through today ' s problems than escape with a mate for endless rounds of gin and tonic .

reference_raw: It's much better to relax in your favorite chair, have a drink with your husband (or wife) and talk about today's problems than to run off with a friend for endless rounds of gin and tonic.

reference_spacy_tokens: It 's much better to relax in your favorite chair , have a drink with your husband ( or wife ) and talk about today 's problems than to run off with a friend for endless rounds of gin and tonic .


fn_spacy_tokens_for_baseline: If you walk east on the Star Ferry terminal concourse , you will find yourself on the wonderful Promenade , which begins at the clock tower , all that remains of the once grand Kowloon- Canton Railway Terminus .

source_bert_toks: if you walk east on the star ferry terminal concourse , you will find yourself on the wonderful promenade , which begins at the clock tower , all that remains of the once grand ko ##wl ##oon - canton railway terminus .

reference_raw: If you go south on the Star Ferry terminal concourse, you'll find yourself on a beautiful promenade that starts at the clock tower, all that's left of the once-great Kowloon-Canton railway terminus.

reference_spacy_tokens: If you go south on the Star Ferry terminal concourse , you 'll find yourself on a beautiful promenade that starts at the clock tower , all that 's left of the once - great Kowloon - Canton railway terminus .


fn_spacy_tokens_for_baseline: Coughing and spluttering as she gasped for air , Laura was jerked into consciousness by the sound of a high - pitched giggle and the feel of a wet kiss on her cheek .

source_bert_toks: coughing and sp ##lu ##ttering as she gasped for air , laura was jerked into consciousness by the sound of a high - pitched giggle and the feel of a wet kiss on her cheek .

reference_raw: Coughing and splashing as she gasped for air, Laura was jerked to consciousness by the sound of a high-pitched chuckle and the feeling of a wet kiss on her cheek.

reference_spacy_tokens: Coughing and splashing as she gasped for air , Laura was jerked to consciousness by the sound of a high - pitched chuckle and the feeling of a wet kiss on her cheek .


fn_spacy_tokens_for_baseline: In January 1985 , before he was supplanted at the top by Lendl , the New Yorker defeated the stern Czechoslovak in straight sets in the Masters final .

source_bert_toks: in january 1985 , before he was su ##pp ##lan ##ted at the top by lend ##l , the new yorker defeated the stern czechoslovak in straight sets in the masters final .

reference_raw: In January 1985, before Lendl had supplanted him, the New York man had defeated the stern Czechoslovak in a straight series in the Masters Final.

reference_spacy_tokens: In January 1985 , before Lendl had supplanted him , the New York man had defeated the stern Czechoslovak in a straight series in the Masters Final .


fn_spacy_tokens_for_baseline: He defeated fellow Scot Colin Montgomerie at the first hole of a sudden - death decider after the pair had tied on three - over - par 287 .

source_bert_toks: he defeated fellow sc ##ot colin mont ##go ##merie at the first hole of a sudden - death decide ##r after the pair had tied on three - over - par 287 .

reference_raw: He beat his fellow Scot Colin Montgomerie in the first hole of a sudden-death decision-maker when the two of them were tethered to three-over-par 287.

reference_spacy_tokens: He beat his fellow Scot Colin Montgomerie in the first hole of a sudden - death decision - maker when the two of them were tethered to three - over - par 287 .


fn_spacy_tokens_for_baseline: After Yeltsin 's order last week , the local soviet approved a resolution calling for simultaneous new elections for the president and Parliament , a plan being increasingly mentioned as a way out of the conflict .

source_bert_toks: after ye ##lts ##in ' s order last week , the local soviet approved a resolution calling for simultaneous new elections for the president and parliament , a plan being increasingly mentioned as a way out of the conflict .

reference_raw: Following Yeltsin's order last week, the local Soviets approved a resolution calling for a parallel re-election of the President and Parliament, and the plan is increasingly mentioned as a way out of the conflict.

reference_spacy_tokens: Following Yeltsin 's order last week , the local Soviets approved a resolution calling for a parallel re - election of the President and Parliament , and the plan is increasingly mentioned as a way out of the conflict .


fn_spacy_tokens_for_baseline: American education 's future will be determined by the degree to which we -- all of us -- allow this common sense to prevail over the illusions that we also share .

source_bert_toks: american education ' s future will be determined by the degree to which we - - all of us - - allow this common sense to pre ##va ##il over the illusions that we also share .

reference_raw: The future of American education will depend on the extent to which we - all of us - allow this common sense to prevail over the illusions we share.

reference_spacy_tokens: The future of American education will depend on the extent to which we - all of us - allow this common sense to prevail over the illusions we share .


fn_spacy_tokens_for_baseline: A final statement yesterday said : " While some advances are being made in nations throughout the hemisphere , the state of press freedom in the Americas still must be regarded as grim as long as journalists and their families are subject to the crudest form of censorship : death by assassination . "

source_bert_toks: a final statement yesterday said : " while some advances are being made in nations throughout the hemisphere , the state of press freedom in the americas still must be regarded as grim as long as journalists and their families are subject to the crude ##st form of censorship : death by assassination . "

reference_raw: Yesterday's final statement said, "While some progress has been made in countries across the hemisphere, the state of freedom of the press in America must be regarded as gloomy as long as journalists and their families are subject to the most brutal form of censorship: death by murder."

reference_spacy_tokens: Yesterday 's final statement said , " While some progress has been made in countries across the hemisphere , the state of freedom of the press in America must be regarded as gloomy as long as journalists and their families are subject to the most brutal form of censorship : death by murder . "


fn_spacy_tokens_for_baseline: The gaunt figures strode ever onwards .

source_bert_toks: the gaunt figures strode ever onwards .

reference_raw: The scrawny figures continued on.

reference_spacy_tokens: The scrawny figures continued on .


fn_spacy_tokens_for_baseline: A TOP salesman sacked for shirking after his boss had him tailed by a private eye won £ 11,000 compensation yesterday .

source_bert_toks: a top salesman sacked for shi ##rkin ##g after his boss had him tailed by a private eye won £1 ##1 , 000 compensation yesterday .

reference_raw: A TOP salesman fired for shirking after being followed by a private eye won £11,000 indemnity last night.

reference_spacy_tokens: A TOP salesman fired for shirking after being followed by a private eye won £ 11,000 indemnity last night .


fn_spacy_tokens_for_baseline: Nicky looked crestfallen but did not dare argue with Constance when she was in this mood .

source_bert_toks: nicky looked crest ##fall ##en but did not dare argue with constance when she was in this mood .

reference_raw: Nicky looked upright, but he didn't dare argue with Constance when she was in that mood.

reference_spacy_tokens: Nicky looked upright , but he did n't dare argue with Constance when she was in that mood .


fn_spacy_tokens_for_baseline: He gave Captain Lake a severe reprimand for his brutality and ordered him to return to Sombrero to see if Jeffrey were alive and , if so , to rescue him .

source_bert_toks: he gave captain lake a severe rep ##rim ##and for his brutality and ordered him to return to so ##mbre ##ro to see if jeffrey were alive and , if so , to rescue him .

reference_raw: He rebuked Captain Lake for his brutality and ordered him to go back to Sombrero to see if Jeffrey was alive and, if so, to save him.

reference_spacy_tokens: He rebuked Captain Lake for his brutality and ordered him to go back to Sombrero to see if Jeffrey was alive and , if so , to save him .


fn_spacy_tokens_for_baseline: Despite the name , the Tattershall Park Country Club is n't a pricey place - admission is only £ 1 for adults and 50p for children .

source_bert_toks: despite the name , the ta ##tters ##hall park country club isn ' t a price ##y place - admission is only £1 for adults and 50 ##p for children .

reference_raw: Despite that name, the Tattershall Park Country Club is not a very expensive place - admission is only £1 for adults and £50 for children.

reference_spacy_tokens: Despite that name , the Tattershall Park Country Club is not a very expensive place - admission is only £ 1 for adults and £ 50 for children .


fn_spacy_tokens_for_baseline: Although he had had a smoker 's cough for many years , it was less than a year ago that he was diagnosed as having incurable lung cancer .

source_bert_toks: although he had had a smoke ##r ' s cough for many years , it was less than a year ago that he was diagnosed as having inc ##urable lung cancer .

reference_raw: Although he had been coughing for many years, he had been diagnosed with uncurable lung cancer less than a year ago.

reference_spacy_tokens: Although he had been coughing for many years , he had been diagnosed with uncurable lung cancer less than a year ago .


fn_spacy_tokens_for_baseline: Imported dried cod ( bacalhao ) is the Portuguese national dish ; several varieties are available , usually baked .

source_bert_toks: imported dried cod ( ba ##cal ##ha ##o ) is the portuguese national dish ; several varieties are available , usually baked .

reference_raw: The imported desiccated cod (bacalhao) is a Portuguese national food; several varieties are available, usually baked.

reference_spacy_tokens: The imported desiccated cod ( bacalhao ) is a Portuguese national food ; several varieties are available , usually baked .


fn_spacy_tokens_for_baseline: Utah 's Dugway Proving Ground has been chosen as a site to test military vaccines against germ warfare agents .

source_bert_toks: utah ' s dug ##way proving ground has been chosen as a site to test military vaccines against ge ##rm warfare agents .

reference_raw: Utah's Dugway Proving Ground was selected as the site for testing military vaccines against germ warfare agents.

reference_spacy_tokens: Utah 's Dugway Proving Ground was selected as the site for testing military vaccines against germ warfare agents .


fn_spacy_tokens_for_baseline: President Bush has agreed to meet within 90 days with Mr. Barco , President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia to discuss the drug problem .

source_bert_toks: president bush has agreed to meet within 90 days with mr . bar ##co , president alan garcia of peru and president jaime paz za ##mora of bolivia to discuss the drug problem .

reference_raw: President Bush has agreed to meet Mr. Barco, President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia in 90 days to discuss the drug problem.

reference_spacy_tokens: President Bush has agreed to meet Mr. Barco , President Alan Garcia of Peru and President Jaime Paz Zamora of Bolivia in 90 days to discuss the drug problem .


fn_spacy_tokens_for_baseline: I suddenly realized why he smoked so much and felt queasy all over again .

source_bert_toks: i suddenly realized why he smoked so much and felt que ##as ##y all over again .

reference_raw: I suddenly realized why he was smoking so much and feeling sick again.

reference_spacy_tokens: I suddenly realized why he was smoking so much and feeling sick again .


fn_spacy_tokens_for_baseline: He is hunched over , his elbows fused to his knees and his hands pressed flat against the sides of his head , blinkering his downwards stare from the irreconcilable contrast of ever changing outside and never - changing inside .

source_bert_toks: he is hunched over , his elbows fused to his knees and his hands pressed flat against the sides of his head , blink ##ering his downwards stare from the ir ##re ##con ##ci ##lab ##le contrast of ever changing outside and never - changing inside .

reference_raw: He's crouched, elbows folded to his knees, hands pressed to the sides of his head, blinking down from the irreconcilable contrast of ever changing outside and never changing inside.

reference_spacy_tokens: He 's crouched , elbows folded to his knees , hands pressed to the sides of his head , blinking down from the irreconcilable contrast of ever changing outside and never changing inside .


fn_spacy_tokens_for_baseline: She felt nauseous , and , terrified she might be sick , she pushed away his hand so that she could hold her head up .

source_bert_toks: she felt na ##use ##ous , and , terrified she might be sick , she pushed away his hand so that she could hold her head up .

reference_raw: She felt sick, and, frightened that she might be ill, she pushed his hand away to raise her head.

reference_spacy_tokens: She felt sick , and , frightened that she might be ill , she pushed his hand away to raise her head .


fn_spacy_tokens_for_baseline: The areas surrounding the springs were desert oases : sprawling collections of grasses , trees , and wildlife .

source_bert_toks: the areas surrounding the springs were desert o ##ase ##s : sprawling collections of grasses , trees , and wildlife .

reference_raw: The areas around the springs were desert oases: vast collections of grasses, trees, and wildlife.

reference_spacy_tokens: The areas around the springs were desert oases : vast collections of grasses , trees , and wildlife .


fn_spacy_tokens_for_baseline: It was n't until a.d . 330 , however , when the newly converted Emperor Constantine made Byzantium , renamed Constantinople , capital of his Eastern Empire that Christianity was assured of its dominant role in future Greek life .

source_bert_toks: it wasn ' t until a . d . 330 , however , when the newly converted emperor constantine made by ##zan ##tium , renamed constantinople , capital of his eastern empire that christianity was assured of its dominant role in future greek life .

reference_raw: But it was not until April 330, when the newly converted Emperor Constantine created Byzantium and renamed Constantinople, the capital of the Eastern Empire, that Christianity was assured of its dominant role in the future Greek life.

reference_spacy_tokens: But it was not until April 330 , when the newly converted Emperor Constantine created Byzantium and renamed Constantinople , the capital of the Eastern Empire , that Christianity was assured of its dominant role in the future Greek life .


fn_spacy_tokens_for_baseline: Oh , they may rail against you at first ; they may decry you as a heathen or a literary savage ; but while those in power say such things , others will read your tales and see their true worth .

source_bert_toks: oh , they may rail against you at first ; they may dec ##ry you as a heath ##en or a literary savage ; but while those in power say such things , others will read your tales and see their true worth .

reference_raw: Oh, they can rail against you at first; they can desecrate you as a pagan or a literary savage; but while those in power say such things, others will read your stories and see what they really mean.

reference_spacy_tokens: Oh , they can rail against you at first ; they can desecrate you as a pagan or a literary savage ; but while those in power say such things , others will read your stories and see what they really mean .


fn_spacy_tokens_for_baseline: So I wet the line with spit and slide the float and locking shot another foot deeper .

source_bert_toks: so i wet the line with spit and slide the float and locking shot another foot deeper .

reference_raw: So I soaked the line with spit and slid the float and the lock shot another foot deeper.

reference_spacy_tokens: So I soaked the line with spit and slid the float and the lock shot another foot deeper .


fn_spacy_tokens_for_baseline: They found the brassiere under the bed and Jo let him hook it up at the back for her .

source_bert_toks: they found the brass ##iere under the bed and jo let him hook it up at the back for her .

reference_raw: They found a bra under the bed, and Jo had him put it in the back for her.

reference_spacy_tokens: They found a bra under the bed , and Jo had him put it in the back for her .


fn_spacy_tokens_for_baseline: The three of us stopped breathing for a moment , and then when it kept on coming we lunged for the doorway .

source_bert_toks: the three of us stopped breathing for a moment , and then when it kept on coming we lunged for the doorway .

reference_raw: The three of us paused for a moment, and then, as he continued to approach, we lunged for the door.

reference_spacy_tokens: The three of us paused for a moment , and then , as he continued to approach , we lunged for the door .


fn_spacy_tokens_for_baseline: Her heart was acting so erratically that she could hardly analyse what he had just said .

source_bert_toks: her heart was acting so erratic ##ally that she could hardly anal ##yse what he had just said .

reference_raw: Her heart was so erratic that it was hard to analyze what he had just said.

reference_spacy_tokens: Her heart was so erratic that it was hard to analyze what he had just said .


fn_spacy_tokens_for_baseline: The room was not very warm and she felt goosebumps on her arms .

source_bert_toks: the room was not very warm and she felt goose ##bu ##mps on her arms .

reference_raw: The room wasn't very warm, and she felt goose bumps on her arms.

reference_spacy_tokens: The room was n't very warm , and she felt goose bumps on her arms .


fn_spacy_tokens_for_baseline: Again when Pharaoh makes Joseph vizier of Egypt he gives him special clothes , as does Joseph his brothers to mark his reconciliation with them .

source_bert_toks: again when pharaoh makes joseph viz ##ier of egypt he gives him special clothes , as does joseph his brothers to mark his reconciliation with them .

reference_raw: Once again, when the Pharaoh makes Joseph a visionary of Egypt, he gives him a special dress, as does Joseph's brothers, to mark his peace with them.

reference_spacy_tokens: Once again , when the Pharaoh makes Joseph a visionary of Egypt , he gives him a special dress , as does Joseph 's brothers , to mark his peace with them .


fn_spacy_tokens_for_baseline: She tried to call him but he could not have heard her because the air was filled with the terrible blare of a foghorn .

source_bert_toks: she tried to call him but he could not have heard her because the air was filled with the terrible b ##lar ##e of a fog ##horn .

reference_raw: She tried to call him, but he couldn't hear her, for the air was filled with the terrible glow of a misthorn.

reference_spacy_tokens: She tried to call him , but he could n't hear her , for the air was filled with the terrible glow of a misthorn .


fn_spacy_tokens_for_baseline: This makes working at the chemical weapons destruction facility in Anniston one of the safest places in the nation to work , according to statistics from the National Safety Council . ( U.S. Army Chemical Materials Agency , 23Jun06 , Washington Group International ) ( Link )

source_bert_toks: this makes working at the chemical weapons destruction facility in ann ##isto ##n one of the safe ##st places in the nation to work , according to statistics from the national safety council . ( u . s . army chemical materials agency , 23 ##jun ##0 ##6 , washington group international ) ( link )

reference_raw: According to statistics from the National Security Council (U.S. Army Chemical Materials Agency, 23 June 2006, Washington Group International) (Link), working at the Chemical Weapons Destruction Facility in Anniston is one of the most secure places in the country to work.

reference_spacy_tokens: According to statistics from the National Security Council ( U.S. Army Chemical Materials Agency , 23 June 2006 , Washington Group International ) ( Link ) , working at the Chemical Weapons Destruction Facility in Anniston is one of the most secure places in the country to work .


fn_spacy_tokens_for_baseline: The struggle against the drug lords in Colombia will be a near thing .

source_bert_toks: the struggle against the drug lords in colombia will be a near thing .

reference_raw: Fighting drug lords in Colombia will be close.

reference_spacy_tokens: Fighting drug lords in Colombia will be close .


fn_spacy_tokens_for_baseline: Our group 's been in hibernation since the war began ; for some while your lot was doing a much better job of getting at the British than we could ever hope to do .

source_bert_toks: our group ' s been in hi ##ber ##nation since the war began ; for some while your lot was doing a much better job of getting at the british than we could ever hope to do .

reference_raw: Our group has been hibernating since the war started; for some time, your lot has been doing a much better job of getting to the British than we could ever hope for.

reference_spacy_tokens: Our group has been hibernating since the war started ; for some time , your lot has been doing a much better job of getting to the British than we could ever hope for .


fn_spacy_tokens_for_baseline: Here , the experience of New York City is decisive .

source_bert_toks: here , the experience of new york city is decisive .

reference_raw: Here, New York City's expertise is crucial.

reference_spacy_tokens: Here , New York City 's expertise is crucial .


fn_spacy_tokens_for_baseline: If , you study the evidences and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

source_bert_toks: if , you study the evidence ##s and statements released by these people , we tend to appreciate their ignorance which was based on prominent views .

reference_raw: When you study the evidence and statements made by these people, we tend to appreciate their ignorance, which is based on prominent opinions.

reference_spacy_tokens: When you study the evidence and statements made by these people , we tend to appreciate their ignorance , which is based on prominent opinions .


fn_spacy_tokens_for_baseline: The Prince looked at Owen , laughed archly and placed a placating hand on Owen 's .

source_bert_toks: the prince looked at owen , laughed arch ##ly and placed a pl ##aca ##ting hand on owen ' s .

reference_raw: The prince looked at Owen, gave an arched laugh, and put his hand on Owen's.

reference_spacy_tokens: The prince looked at Owen , gave an arched laugh , and put his hand on Owen 's .


fn_spacy_tokens_for_baseline: Why do some women see marriage as an absolute priority from the start of a relationship , yet others would n't sashay down the aisle if their lives depended on it ?

source_bert_toks: why do some women see marriage as an absolute priority from the start of a relationship , yet others wouldn ' t sasha ##y down the aisle if their lives depended on it ?

reference_raw: Why do some women consider marriage to be an absolute priority from the beginning of a relationship, but others wouldn't sash down the aisle if their lives depended on it?

reference_spacy_tokens: Why do some women consider marriage to be an absolute priority from the beginning of a relationship , but others would n't sash down the aisle if their lives depended on it ?


fn_spacy_tokens_for_baseline: Madrid - based Microsoft Iberica SRL generates 28 % of its turnover in Catalonia , and managing director Joao Teixeira believes the move will increase this figure still more .

source_bert_toks: madrid - based microsoft ib ##eric ##a sr ##l generates 28 % of its turnover in catalonia , and managing director joao te ##ix ##eira believes the move will increase this figure still more .

reference_raw: The Madrid-based Microsoft Iberica SRL generates 28% of its turnover in Catalonia, and the CEO, Joao Teixeira, believes that the transfer will increase this figure further.

reference_spacy_tokens: The Madrid - based Microsoft Iberica SRL generates 28 % of its turnover in Catalonia , and the CEO , Joao Teixeira , believes that the transfer will increase this figure further .


fn_spacy_tokens_for_baseline: My next target was the deck chair area , which was liberally sprinkled with coins .

source_bert_toks: my next target was the deck chair area , which was liberal ##ly sp ##rin ##kled with coins .

reference_raw: My next target was the deck chair area, which was liberally sprayed with coins.

reference_spacy_tokens: My next target was the deck chair area , which was liberally sprayed with coins .


fn_spacy_tokens_for_baseline: Two firefighters were injured while fighting the fire and were transported to Erie County Medical Center , " said Division Fire Chief Thomas Ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

source_bert_toks: two firefighters were injured while fighting the fire and were transported to erie county medical center , " said division fire chief thomas ashe who also said that sections of the kitchen wall at the back of the house had to be torn out to stop the fire from spreading through the walls .

reference_raw: Two firemen were injured in a firefight and transported to the Erie County Medical Center," said Division Fire Chief Thomas Ashe, who also said that sections of the kitchen wall in the back of the house had to be ripped out to prevent the fire from spreading through the walls.

reference_spacy_tokens: Two firemen were injured in a firefight and transported to the Erie County Medical Center , " said Division Fire Chief Thomas Ashe , who also said that sections of the kitchen wall in the back of the house had to be ripped out to prevent the fire from spreading through the walls .


fn_spacy_tokens_for_baseline: Donald took a deep swig of his beer .

source_bert_toks: donald took a deep sw ##ig of his beer .

reference_raw: Donald sipped his beer deeply.

reference_spacy_tokens: Donald sipped his beer deeply .


fn_spacy_tokens_for_baseline: I chirruped to the horse , and he quickened his pace .

source_bert_toks: i chi ##rr ##up ##ed to the horse , and he quick ##ened his pace .

reference_raw: I chirped at the horse, and it accelerated.

reference_spacy_tokens: I chirped at the horse , and it accelerated .


fn_spacy_tokens_for_baseline: This creates the dilemma illustrated in the project discussed above , of appearing to meet local needs when in fact such actions do little about the real causes of social problems and may indeed aggravate them by uprooting local leaders .

source_bert_toks: this creates the dilemma illustrated in the project discussed above , of appearing to meet local needs when in fact such actions do little about the real causes of social problems and may indeed ag ##gra ##vate them by up ##ro ##oting local leaders .

reference_raw: This creates a dilemma, as illustrated in the project discussed above, that it appears to meet local needs when such actions do not really address the real causes of social problems and can even exacerbate them by uprooting local leaders.

reference_spacy_tokens: This creates a dilemma , as illustrated in the project discussed above , that it appears to meet local needs when such actions do not really address the real causes of social problems and can even exacerbate them by uprooting local leaders .


fn_spacy_tokens_for_baseline: Therefore , obtaining reliable open source information on such programs is very challenging .

source_bert_toks: therefore , obtaining reliable open source information on such programs is very challenging .

reference_raw: It is therefore very difficult to obtain credible open source information about these programmes.

reference_spacy_tokens: It is therefore very difficult to obtain credible open source information about these programmes .


fn_spacy_tokens_for_baseline: The document was found among the many original musical manuscripts left by Lucien Garban , an intimate friend who kept up a fascinating correspondence with the composer .

source_bert_toks: the document was found among the many original musical manuscripts left by lucien ga ##rba ##n , an intimate friend who kept up a fascinating correspondence with the composer .

reference_raw: The document was found among the many original musical handwritings left behind by Lucien Garban, an intimate friend who kept an interesting correspondence with the composer.

reference_spacy_tokens: The document was found among the many original musical handwritings left behind by Lucien Garban , an intimate friend who kept an interesting correspondence with the composer .


fn_spacy_tokens_for_baseline: She was wandering the crags .

source_bert_toks: she was wandering the cr ##ags .

reference_raw: She roamed the rocks.

reference_spacy_tokens: She roamed the rocks .


fn_spacy_tokens_for_baseline: ' I ca n't take much more of this , ' he confided to Lily , and she told him to shush .

source_bert_toks: ' i can ' t take much more of this , ' he con ##fide ##d to lily , and she told him to shu ##sh .

reference_raw: "I can't take it anymore," he told Lily, and she told him to shut up.

reference_spacy_tokens: " I ca n't take it anymore , " he told Lily , and she told him to shut up .


fn_spacy_tokens_for_baseline: Kerri - Lisa McCammont , 17 , of Crawley , West Sussex , was convicted of manslaughter after Hove Crown Court heard she stabbed Joanne Thorns , 18 , three times when they argued over Scottish romeo Paul McKeown , 24 .

source_bert_toks: kerr ##i - lisa mcc ##am ##mont , 17 , of crawley , west sussex , was convicted of mans ##lau ##ght ##er after hove crown court heard she stabbed joanne thorns , 18 , three times when they argued over scottish romeo paul mc ##ke ##own , 24 .

reference_raw: Kerri-Lisa McCammont, 17 years old, from Crawley, West Sussex, was convicted of murder after the Hove Crown Court heard that she stabbed Joanne Thorns, 18 or 3 times, when they argued about Scottish Romeo Paul McKeown, 24 years old.

reference_spacy_tokens: Kerri - Lisa McCammont , 17 years old , from Crawley , West Sussex , was convicted of murder after the Hove Crown Court heard that she stabbed Joanne Thorns , 18 or 3 times , when they argued about Scottish Romeo Paul McKeown , 24 years old .


fn_spacy_tokens_for_baseline: They would be segregated from members of the caste system and lived on the outskirts of villages or in their own communities .

source_bert_toks: they would be segregated from members of the caste system and lived on the outskirts of villages or in their own communities .

reference_raw: They will be separated from members of the caste system and live on the edge of villages or in their own communities.

reference_spacy_tokens: They will be separated from members of the caste system and live on the edge of villages or in their own communities .


fn_spacy_tokens_for_baseline: But why might potential buyers of financial assets delay their transactions and instead hold their wealth in a perfectly liquid form with a zero or low yield , e.g. cash or current account deposits ?

source_bert_toks: but why might potential buyers of financial assets delay their transactions and instead hold their wealth in a perfectly liquid form with a zero or low yield , e . g . cash or current account deposits ?

reference_raw: But why would potential buyers of financial assets delay their operations and instead keep their wealth in a perfectly liquid form with zero or low yields, such as cash or current-account deposits?

reference_spacy_tokens: But why would potential buyers of financial assets delay their operations and instead keep their wealth in a perfectly liquid form with zero or low yields , such as cash or current - account deposits ?


fn_spacy_tokens_for_baseline: At a guess , she had had a tiff with Mr Carson .

source_bert_toks: at a guess , she had had a ti ##ff with mr carson .

reference_raw: She had a relationship with Mr. Carson at some point.

reference_spacy_tokens: She had a relationship with Mr. Carson at some point .


fn_spacy_tokens_for_baseline: On 8 March 1996 , the Washington Post reported , " US intelligence officials have concluded that companies in China are providing Iran with several virtually complete factories suited for making deadly poison gases , " and that Iranian " military - related organizations " are buying from China glass - lined vessels for mixing precursors , special air - filtration equipment , and the technology to manufacture these items and others indigenously .

source_bert_toks: on 8 march 1996 , the washington post reported , " us intelligence officials have concluded that companies in china are providing iran with several virtually complete factories suited for making deadly poison gases , " and that iranian " military - related organizations " are buying from china glass - lined vessels for mixing precursor ##s , special air - fi ##lt ##ration equipment , and the technology to manufacture these items and others indigenous ##ly .

reference_raw: On 8 March 1996, the Washington Post announced, "U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases," and that Iran's "military-related organizations" purchase from Chinese glass-lined vessels for the mixing of precursors, special air-filtration equipment, and technology for the production of such items and other indigenous products.

reference_spacy_tokens: On 8 March 1996 , the Washington Post announced , " U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases , " and that Iran 's " military - related organizations " purchase from Chinese glass - lined vessels for the mixing of precursors , special air - filtration equipment , and technology for the production of such items and other indigenous products .


fn_spacy_tokens_for_baseline: In the motorcade were Bandeira 's wife and eldest daughter , his male secretary , two Japanese business associates and four thickset men with short haircuts whose eyes darted everywhere .

source_bert_toks: in the motor ##cade were band ##eira ' s wife and eldest daughter , his male secretary , two japanese business associates and four thick ##set men with short hair ##cut ##s whose eyes darted everywhere .

reference_raw: Bandeira's wife and eldest daughter were in the column, his male secretary, two Japanese business associates, and four fat men with short hairs, their eyes darting everywhere.

reference_spacy_tokens: Bandeira 's wife and eldest daughter were in the column , his male secretary , two Japanese business associates , and four fat men with short hairs , their eyes darting everywhere .


fn_spacy_tokens_for_baseline: The family grew still larger with the birth of my sister Anita .

source_bert_toks: the family grew still larger with the birth of my sister anita .

reference_raw: When my sister Anita was born, the family got bigger.

reference_spacy_tokens: When my sister Anita was born , the family got bigger .


fn_spacy_tokens_for_baseline: One rose , two roses , three roses . and , at the heart of the third rose , a gleam of light .

source_bert_toks: one rose , two roses , three roses . and , at the heart of the third rose , a gleam of light .

reference_raw: One rose, two roses, three roses . . . and a glimmer of light in the heart of the third rose.

reference_spacy_tokens: One rose , two roses , three roses . . . and a glimmer of light in the heart of the third rose .


fn_spacy_tokens_for_baseline: Jones , now 19 , and living in Holyhead , said Roberts and son , Ian , would hold him upside down , tie his feet with rope or string , and tie it to an overhead pole .

source_bert_toks: jones , now 19 , and living in holy ##head , said roberts and son , ian , would hold him upside down , tie his feet with rope or string , and tie it to an overhead pole .

reference_raw: Jones, now nineteen, and living in Holyhead, said that Roberts and his son, Ian, would hold him upside down, tie his legs with a rope or rope, and tie him to a pole above his head.

reference_spacy_tokens: Jones , now nineteen , and living in Holyhead , said that Roberts and his son , Ian , would hold him upside down , tie his legs with a rope or rope , and tie him to a pole above his head .


fn_spacy_tokens_for_baseline: The old pre - war autobahn to Stuttgart only had a double carriageway and after fifty years of use was often under repair .

source_bert_toks: the old pre - war auto ##bahn to stuttgart only had a double carriage ##way and after fifty years of use was often under repair .

reference_raw: The old pre-war machine on Stuttgart had only two carriageways, and after fifty years of use it was often repaired.

reference_spacy_tokens: The old pre - war machine on Stuttgart had only two carriageways , and after fifty years of use it was often repaired .


fn_spacy_tokens_for_baseline: And a glimmer of light was beginning to shine through the darkness .

source_bert_toks: and a g ##lim ##mer of light was beginning to shine through the darkness .

reference_raw: And there was a flash of light in the darkness.

reference_spacy_tokens: And there was a flash of light in the darkness .


fn_spacy_tokens_for_baseline: The black economy refers to those unrecorded economic transactions conducted on a cash basis with a view to illegal evasion of tax .

source_bert_toks: the black economy refers to those un ##re ##cor ##ded economic transactions conducted on a cash basis with a view to illegal eva ##sion of tax .

reference_raw: The black economy refers to unrecorded economic transactions carried out in cash for the purpose of tax avoidance.

reference_spacy_tokens: The black economy refers to unrecorded economic transactions carried out in cash for the purpose of tax avoidance .


fn_spacy_tokens_for_baseline: No solo del pan vive el hombre Not only of bread does man live Man does not live by bread alone

source_bert_toks: no solo del pan vi ##ve el ho ##mbre not only of bread does man live man does not live by bread alone

reference_raw: No solo del pan vive el hombre Not only does a man survive by bread


fn_spacy_tokens_for_baseline: They worked on through the files for the rest of the morning , a routine they had been through so often that they commented mostly in half - sentences or barely audible grunts .

source_bert_toks: they worked on through the files for the rest of the morning , a routine they had been through so often that they commented mostly in half - sentences or barely audible grunt ##s .

reference_raw: They worked through the files for the rest of the morning, a routine they'd been through so often that they'd mostly commented in half-sentence or barely heard grunts.

reference_spacy_tokens: They worked through the files for the rest of the morning , a routine they 'd been through so often that they 'd mostly commented in half - sentence or barely heard grunts .


fn_spacy_tokens_for_baseline: These are also ' baddies ' as they make the blood more liable to clot , so the fewer of them you have in your blood the better for your heart .

source_bert_toks: these are also ' bad ##dies ' as they make the blood more liable to cl ##ot , so the fewer of them you have in your blood the better for your heart .

reference_raw: They're also "baddies" because they make blood more likely to coagulate, so the fewer you have in your blood, the better for your heart.

reference_spacy_tokens: They 're also " baddies " because they make blood more likely to coagulate , so the fewer you have in your blood , the better for your heart .


fn_spacy_tokens_for_baseline: Their narrow perspective alienates them from broad - minded people who value the business in broader terms , who value certain immeasurable bit critical factors such as morale , expertise and goodwill .

source_bert_toks: their narrow perspective alien ##ates them from broad - minded people who value the business in broader terms , who value certain im ##me ##asurable bit critical factors such as morale , expertise and goodwill .

reference_raw: Their narrow perspective is alienating them from wide-minded people who value business in a wider sense, who value certain immeasurable bit-critical factors such as morale, expertise, and goodwill.

reference_spacy_tokens: Their narrow perspective is alienating them from wide - minded people who value business in a wider sense , who value certain immeasurable bit - critical factors such as morale , expertise , and goodwill .


fn_spacy_tokens_for_baseline: To her amazement ( and do doubt his ) he turned out to be her miscreant husband .

source_bert_toks: to her amazement ( and do doubt his ) he turned out to be her mis ##cre ##ant husband .

reference_raw: To her surprise (and doubt his) he turned out to be her rude husband.

reference_spacy_tokens: To her surprise ( and doubt his ) he turned out to be her rude husband .


fn_spacy_tokens_for_baseline: Dungannon three quarters were caught offside in front of the posts and Laing kicked the easiest of penalties to give Instonians a narrow but deserved victory .

source_bert_toks: dung ##ann ##on three quarters were caught offs ##ide in front of the posts and lai ##ng kicked the easiest of penalties to give ins ##ton ##ians a narrow but deserved victory .

reference_raw: Dungannon three-quarters had been caught in front of the posts, and Laing had kicked the simplest punishments to give the Instonians a small but deserving victory.

reference_spacy_tokens: Dungannon three - quarters had been caught in front of the posts , and Laing had kicked the simplest punishments to give the Instonians a small but deserving victory .


fn_spacy_tokens_for_baseline: A 78-year - old fruit seller , Kareem Ameen , crouched on the ground crying and pummeling his chest .

source_bert_toks: a 78 - year - old fruit seller , ka ##ree ##m am ##een , crouched on the ground crying and pu ##mmel ##ing his chest .

reference_raw: The 78-year-old fruit seller, Kareem Ameen, squatted on the floor, crying and pounding his chest.

reference_spacy_tokens: The 78-year - old fruit seller , Kareem Ameen , squatted on the floor , crying and pounding his chest .


fn_spacy_tokens_for_baseline: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras , but Iranian officials were " not allowing the IAEA to install the cameras inside the cascade halls in Natanz and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

source_bert_toks: the nuclear agency had hoped to monitor the larger cent ##ri ##fu ##ge cascade with cameras , but iranian officials were " not allowing the ia ##ea to install the cameras inside the cascade halls in nat ##an ##z and are causing further delays in the inspectors ' activity , " a diplomat who closely monitors the agency said yesterday .

reference_raw: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras, but Iranian officials had "not allowed the IAEA to install cameras in the Natanz cascade halls, and were causing further slowdowns in the inspectors' activities," a diplomat who had been closely monitoring the agency had said yesterday.

reference_spacy_tokens: The nuclear agency had hoped to monitor the larger centrifuge cascade with cameras , but Iranian officials had " not allowed the IAEA to install cameras in the Natanz cascade halls , and were causing further slowdowns in the inspectors ' activities , " a diplomat who had been closely monitoring the agency had said yesterday .


fn_spacy_tokens_for_baseline: Do you know the Denouncement of Atavenom sequence ? '

source_bert_toks: do you know the den ##oun ##ce ##ment of ata ##ven ##om sequence ? '

reference_raw: You know the Declaration of Atavenom Sequence?'

reference_spacy_tokens: You know the Declaration of Atavenom Sequence ? '


fn_spacy_tokens_for_baseline: He checked his bearings again and pointed to the sand - spit .

source_bert_toks: he checked his bearings again and pointed to the sand - spit .

reference_raw: He checked his bearings again and pointed to the sand.

reference_spacy_tokens: He checked his bearings again and pointed to the sand .


fn_spacy_tokens_for_baseline: Or there 's Thornton 's Arcade ( above ) , one of several glass - roofed malls built by Edwardian theatre designer Frank Matcham at the turn of the century

source_bert_toks: or there ' s thornton ' s arcade ( above ) , one of several glass - roofed malls built by edward ##ian theatre designer frank match ##am at the turn of the century

reference_raw: Or it's Thornton's Arcade (above), one of several glass-roofed shopping centers built at the turn of the century by Edwardian theatrical designer Frank Matcham.

reference_spacy_tokens: Or it 's Thornton 's Arcade ( above ) , one of several glass - roofed shopping centers built at the turn of the century by Edwardian theatrical designer Frank Matcham .


fn_spacy_tokens_for_baseline: The fire started in the basement and spread to a small portion of the first floor .

source_bert_toks: the fire started in the basement and spread to a small portion of the first floor .

reference_raw: The fire began in the cellar and spread to a small part of the first floor.

reference_spacy_tokens: The fire began in the cellar and spread to a small part of the first floor .


fn_spacy_tokens_for_baseline: ' This boy who lived next door to me taught me how to shoplift for him .

source_bert_toks: ' this boy who lived next door to me taught me how to shop ##lift for him .

reference_raw: The boy who lived next door taught me how to steal for him.

reference_spacy_tokens: The boy who lived next door taught me how to steal for him .


fn_spacy_tokens_for_baseline: I 'm gon na hae ma forty winks

source_bert_toks: i ' m gonna ha ##e ma forty wink ##s

reference_raw: I'll have the ma 40 blinks

reference_spacy_tokens: I 'll have the ma 40 blinks


fn_spacy_tokens_for_baseline: Now , as though solaced by the memory she said , ' I have known times when the water went to ice .

source_bert_toks: now , as though sol ##ace ##d by the memory she said , ' i have known times when the water went to ice .

reference_raw: Now, as if comforted by the memory, she said, "I know a time when the water went to ice.

reference_spacy_tokens: Now , as if comforted by the memory , she said , " I know a time when the water went to ice .


fn_spacy_tokens_for_baseline: ' Ken most of the folk hereabouts ? ' demanded the customer , uncorking the bottle with his teeth and filling the grubby glass that had been set in front of him .

source_bert_toks: ' ken most of the folk here ##ab ##outs ? ' demanded the customer , un ##cor ##king the bottle with his teeth and filling the gr ##ub ##by glass that had been set in front of him .

reference_raw: 'Ken most of the people around here?' asked the customer, opening the bottle with his teeth and filling the grubby glass in front of him.

reference_spacy_tokens: ' Ken most of the people around here ? ' asked the customer , opening the bottle with his teeth and filling the grubby glass in front of him .


fn_spacy_tokens_for_baseline: By dethroning Ferdinand Napoleon turned the revolution of Aranjuez against himself : the rising against Napoleon was thus , in part , a revolution of disappointed hopes .

source_bert_toks: by det ##hr ##oning ferdinand napoleon turned the revolution of ara ##n ##ju ##ez against himself : the rising against napoleon was thus , in part , a revolution of disappointed hopes .

reference_raw: By overthrowing Ferdinand Napoleon, he turned the Aranjuez revolution against himself: the rise against Napoleon was, in part, a revolution of disappointed hopes.

reference_spacy_tokens: By overthrowing Ferdinand Napoleon , he turned the Aranjuez revolution against himself : the rise against Napoleon was , in part , a revolution of disappointed hopes .


fn_spacy_tokens_for_baseline: Unemployment is at an all - time low .

source_bert_toks: unemployment is at an all - time low .

reference_raw: Unemployed people are at an all-time low.

reference_spacy_tokens: Unemployed people are at an all - time low .


fn_spacy_tokens_for_baseline: He has himself , let us say , spent a couple of disillusioning years in Bali , so that he fully understands the considerations which tempt the young man , but has the advantage of fuller information .

source_bert_toks: he has himself , let us say , spent a couple of di ##sil ##lusion ##ing years in bali , so that he fully understands the considerations which te ##mpt the young man , but has the advantage of fuller information .

reference_raw: He has himself, let's say, spent a few disappointing years in Bali to fully understand the considerations that attract the young man, but he has the advantage of fuller information.

reference_spacy_tokens: He has himself , let 's say , spent a few disappointing years in Bali to fully understand the considerations that attract the young man , but he has the advantage of fuller information .


fn_spacy_tokens_for_baseline: The other firefighter was treated for injuries he received to his hand , which was believed to have been caused by glass or a cat scratching him .

source_bert_toks: the other fire ##fighter was treated for injuries he received to his hand , which was believed to have been caused by glass or a cat scratching him .

reference_raw: The second fireman was treated for injuries to his arm, which were believed to have been caused by a glass or a kitten scratching him.

reference_spacy_tokens: The second fireman was treated for injuries to his arm , which were believed to have been caused by a glass or a kitten scratching him .


fn_spacy_tokens_for_baseline: Central Council is also grateful to their spouses who often support the welfare work of their partners , and to the many other volunteers who also help .

source_bert_toks: central council is also grateful to their spouse ##s who often support the welfare work of their partners , and to the many other volunteers who also help .

reference_raw: The Central Council is also grateful to their spouses, who often support the social work of their spouses, and to many other volunteers who also help them.

reference_spacy_tokens: The Central Council is also grateful to their spouses , who often support the social work of their spouses , and to many other volunteers who also help them .


fn_spacy_tokens_for_baseline: They said the sailors were detained after about 500 seamen brawled along Lisbon 's dockside , besieging a police station , smashing windows in shops and bars and overturning cars .

source_bert_toks: they said the sailors were detained after about 500 seamen brawl ##ed along lisbon ' s docks ##ide , be ##sie ##ging a police station , smashing windows in shops and bars and over ##turn ##ing cars .

reference_raw: It was said that the sailors had been arrested after about 500 sailors had fought along the Lisbon docks, besieged a police station, smashed windows in shops and bars, and overturned cars.

reference_spacy_tokens: It was said that the sailors had been arrested after about 500 sailors had fought along the Lisbon docks , besieged a police station , smashed windows in shops and bars , and overturned cars .


fn_spacy_tokens_for_baseline: And in this city , where literature and theater have historically dominated the scene , visual arts are finally coming into their own with the new Museum of Modern Art and the many galleries that display the work of modern Irish artists .

source_bert_toks: and in this city , where literature and theater have historically dominated the scene , visual arts are finally coming into their own with the new museum of modern art and the many galleries that display the work of modern irish artists .

reference_raw: And in this city, where literature and theatre have historically dominated the scene, visual art has finally come to its own with a new museum of modern art and many galleries showing the work of modern Irish artists.

reference_spacy_tokens: And in this city , where literature and theatre have historically dominated the scene , visual art has finally come to its own with a new museum of modern art and many galleries showing the work of modern Irish artists .


reference_raw: And in this city, where literature and theatre have historically dominated the scene, the visual arts, with a new museum of modern art, and many galleries showing the works of modern Irish artists, eventually come into play.

reference_spacy_tokens: And in this city , where literature and theatre have historically dominated the scene , the visual arts , with a new museum of modern art , and many galleries showing the works of modern Irish artists , eventually come into play .


fn_spacy_tokens_for_baseline: " The water was jetting out of that particular area .

source_bert_toks: " the water was jett ##ing out of that particular area .

reference_raw: "Water flowed from this particular area."

reference_spacy_tokens: " Water flowed from this particular area . "


fn_spacy_tokens_for_baseline: With frequent admonishments to Hector -- who not unnaturally found enormous pleasure in exploring the overgrown gardens -- to keep close , she strolled to the back of the house where a huge stable block stood almost empty .

source_bert_toks: with frequent ad ##mon ##ishment ##s to hector - - who not unnatural ##ly found enormous pleasure in exploring the overgrown gardens - - to keep close , she strolled to the back of the house where a huge stable block stood almost empty .

reference_raw: With frequent admonitions to Hector, who was not unnaturally happy to explore the overgrown gardens, she went to the back of the house, where the huge stable block was almost empty.

reference_spacy_tokens: With frequent admonitions to Hector , who was not unnaturally happy to explore the overgrown gardens , she went to the back of the house , where the huge stable block was almost empty .


fn_spacy_tokens_for_baseline: This busy , modern European city sits on a thousand years of history -- history is present everywhere , from elegant Merrion Square to the bullet holes on the General Post Office .

source_bert_toks: this busy , modern european city sits on a thousand years of history - - history is present everywhere , from elegant mer ##rion square to the bullet holes on the general post office .

reference_raw: This busy, modern European city sits on thousands of years of history - history is everywhere, from elegant Merrion Square to bullet holes in the General Post Office.

reference_spacy_tokens: This busy , modern European city sits on thousands of years of history - history is everywhere , from elegant Merrion Square to bullet holes in the General Post Office .


fn_spacy_tokens_for_baseline: Forests were set on fire .

source_bert_toks: forests were set on fire .

reference_raw: The forests were burned.

reference_spacy_tokens: The forests were burned .


fn_spacy_tokens_for_baseline: ' You know , Katie , she 's an old miser and everyone borrows money off her or else they buy the things you knit off her .

source_bert_toks: ' you know , katie , she ' s an old mis ##er and everyone borrow ##s money off her or else they buy the things you knit off her .

reference_raw: "You know, Katie, she's a poor old lady, and everybody borrows money from her, or they'll buy what you knit out of her.

reference_spacy_tokens: " You know , Katie , she 's a poor old lady , and everybody borrows money from her , or they 'll buy what you knit out of her .


fn_spacy_tokens_for_baseline: Beyond the tiny hamlet the smaller unpaved road climbed a shallow hill before disappearing eastwards in a stand of dark trees .

source_bert_toks: beyond the tiny hamlet the smaller un ##pa ##ved road climbed a shallow hill before disappearing eastward ##s in a stand of dark trees .

reference_raw: Beyond the small village, a small, unpaved road climbed a shallow hill, then disappeared east in a row of dark trees.

reference_spacy_tokens: Beyond the small village , a small , unpaved road climbed a shallow hill , then disappeared east in a row of dark trees .


fn_spacy_tokens_for_baseline: He took off the phoney glasses and tweed hat and threw them to one side .

source_bert_toks: he took off the phone ##y glasses and tweed hat and threw them to one side .

reference_raw: He removed his fake spectacles and tweed hat and tossed them aside.

reference_spacy_tokens: He removed his fake spectacles and tweed hat and tossed them aside .


fn_spacy_tokens_for_baseline: If the concept of autonomous agents were something like a usefulor more , a properdefinition of life itself , then autonomous agents span the gap from the merely physical to that new realm of the merely physical where " purpose " is ascribed by all of us to one another .

source_bert_toks: if the concept of autonomous agents were something like a useful ##or more , a proper ##de ##fin ##ition of life itself , then autonomous agents span the gap from the merely physical to that new realm of the merely physical where " purpose " is ascribed by all of us to one another .

reference_raw: If the concept of independent agents is something like a useful or more, a proper definition of living itself, then independent agents span the gap between mere physicality and this new realm of mere physicality, in which we all attribute "purpose" to each other.

reference_spacy_tokens: If the concept of independent agents is something like a useful or more , a proper definition of living itself , then independent agents span the gap between mere physicality and this new realm of mere physicality , in which we all attribute " purpose " to each other .


fn_spacy_tokens_for_baseline: Still reeling from the effects of the Persian devastation , Jerusalem was conquered in 638 by the forces of Islam .

source_bert_toks: still reeling from the effects of the persian devastation , jerusalem was conquered in 63 ##8 by the forces of islam .

reference_raw: Jerusalem, still reeling from the effects of the Persian destruction, was conquered by Islam's forces in 638.

reference_spacy_tokens: Jerusalem , still reeling from the effects of the Persian destruction , was conquered by Islam 's forces in 638 .


fn_spacy_tokens_for_baseline: People showered unsought librettos on him all his life and he ignored them .

source_bert_toks: people showered un ##so ##ught libretto ##s on him all his life and he ignored them .

reference_raw: All his life, people sprayed him with unsought librettos, and he ignored them.

reference_spacy_tokens: All his life , people sprayed him with unsought librettos , and he ignored them .


fn_spacy_tokens_for_baseline: The hard core of the concretion was pulverized with a mortar and pestle , and sieved through a 1-mm screen .

source_bert_toks: the hard core of the con ##cre ##tion was pu ##lver ##ized with a mortar and pest ##le , and si ##eve ##d through a 1 - mm screen .

reference_raw: The hard core of the concretion had been crushed with mortar and pestle, and was sieved through a 1-mm screen.

reference_spacy_tokens: The hard core of the concretion had been crushed with mortar and pestle , and was sieved through a 1-mm screen .


fn_spacy_tokens_for_baseline: Project Officer Dr. Wouter Basson also set up an elaborate network of procurement and financial front companies overseas .

source_bert_toks: project officer dr . wo ##uter bass ##on also set up an elaborate network of procurement and financial front companies overseas .

reference_raw: The project officer, Dr. Wouter Basson, has also set up an intricate network of contracts and financial front companies abroad.

reference_spacy_tokens: The project officer , Dr. Wouter Basson , has also set up an intricate network of contracts and financial front companies abroad .


fn_spacy_tokens_for_baseline: Crop yield is poor , partly because of the chronic lack of water , and fields once tended are now deserted .

source_bert_toks: crop yield is poor , partly because of the chronic lack of water , and fields once tended are now deserted .

reference_raw: The crop yield is low, partly due to a chronic lack of water, and the fields that used to be tended are now abandoned.

reference_spacy_tokens: The crop yield is low , partly due to a chronic lack of water , and the fields that used to be tended are now abandoned .


fn_spacy_tokens_for_baseline: They are entrusted with the task of tracking down the movement of strangers who are approaching the location .

source_bert_toks: they are entrusted with the task of tracking down the movement of strangers who are approaching the location .

reference_raw: Their mission is to track the movement of aliens approaching the site.

reference_spacy_tokens: Their mission is to track the movement of aliens approaching the site .


fn_spacy_tokens_for_baseline: There was a round of dainty sandwiches and three small dry cakes left over from Cook 's Friday baking session .

source_bert_toks: there was a round of dai ##nty sandwiches and three small dry cakes left over from cook ' s friday baking session .

reference_raw: There was a round of dainty sandwiches and three little dry cakes left over from Cook's Friday roasting session.

reference_spacy_tokens: There was a round of dainty sandwiches and three little dry cakes left over from Cook 's Friday roasting session .


fn_spacy_tokens_for_baseline: He said ' The RS/6000 is not big now in Hungary , and it has only recently come off the Comecon list .

source_bert_toks: he said ' the rs / 6000 is not big now in hungary , and it has only recently come off the come ##con list .

reference_raw: He said, "RS/6000 isn't much in Hungary now, and it's only recently been removed from the Comecon list.

reference_spacy_tokens: He said , " RS/6000 is n't much in Hungary now , and it 's only recently been removed from the Comecon list .


fn_spacy_tokens_for_baseline: VE and VG nerve agents are also mentioned in South Korean assessments of DPRK chemical weapons , although these reports do not appear to be based on hard data but rather on inference .

source_bert_toks: ve and v ##g nerve agents are also mentioned in south korean assessments of d ##pr ##k chemical weapons , although these reports do not appear to be based on hard data but rather on inference .

reference_raw: VE and VG nerve agents are also mentioned in South Korea's assessment of chemical weapons of the DPRK, although these reports do not appear to be based on reliable information but rather on conclusions.

reference_spacy_tokens: VE and VG nerve agents are also mentioned in South Korea 's assessment of chemical weapons of the DPRK , although these reports do not appear to be based on reliable information but rather on conclusions .


fn_spacy_tokens_for_baseline: On the other hand , she conceded , someone had to do the kind of menial tasks she was at present condemned to -- but why was it always women who did them ?

source_bert_toks: on the other hand , she conceded , someone had to do the kind of men ##ial tasks she was at present condemned to - - but why was it always women who did them ?

reference_raw: On the other hand, she admitted, someone had to do the menial tasks she was currently condemned to do-but why did women always do them?

reference_spacy_tokens: On the other hand , she admitted , someone had to do the menial tasks she was currently condemned to do - but why did women always do them ?


fn_spacy_tokens_for_baseline: I was deeply moved by the story of Alejandra Munoz , a Mexican woman illegally brought into the United States by her cousins who deceived her into becoming a ' surrogate mother ' .

source_bert_toks: i was deeply moved by the story of ale ##jan ##dra munoz , a mexican woman illegally brought into the united states by her cousins who dec ##ei ##ved her into becoming a ' sur ##rogate mother ' .

reference_raw: I was deeply moved by the story of Alejandra Munoz, a Mexican woman illegally brought to the U.S. by her cousins who tricked her into becoming a surrogate mother.

reference_spacy_tokens: I was deeply moved by the story of Alejandra Munoz , a Mexican woman illegally brought to the U.S. by her cousins who tricked her into becoming a surrogate mother .


fn_spacy_tokens_for_baseline: The Northern Regional Strategy Team had commented on the relatively small rate of owner - occupation and planners had long whinged about the impact of the shortage of ' executive housing ' on industrial development .

source_bert_toks: the northern regional strategy team had commented on the relatively small rate of owner - occupation and planners had long w ##hing ##ed about the impact of the shortage of ' executive housing ' on industrial development .

reference_raw: The Northern Regional Strategy Team has commented on the relatively low number of owner-occupied and planners who have long been whining about the impact of the lack of "executive housing" on industrial development.

reference_spacy_tokens: The Northern Regional Strategy Team has commented on the relatively low number of owner - occupied and planners who have long been whining about the impact of the lack of " executive housing " on industrial development .


fn_spacy_tokens_for_baseline: As the door of the empty box creaked open in the wind , Liz heard the phone ringing , ringing .

source_bert_toks: as the door of the empty box creaked open in the wind , liz heard the phone ringing , ringing .

reference_raw: As the door to the empty box blew open in the wind, Liz heard the phone ring and ring.

reference_spacy_tokens: As the door to the empty box blew open in the wind , Liz heard the phone ring and ring .


fn_spacy_tokens_for_baseline: Do n't forget to phone me that flight data . '

source_bert_toks: don ' t forget to phone me that flight data . '

reference_raw: Don't forget to call me the flight data.'

reference_spacy_tokens: Do n't forget to call me the flight data . '


fn_spacy_tokens_for_baseline: This is corroborated by the data obtained from the snowball sample which show that , while 38 per cent of males were known , only 20 per cent of females were known .

source_bert_toks: this is co ##rro ##bor ##ated by the data obtained from the snow ##ball sample which show that , while 38 per cent of males were known , only 20 per cent of females were known .

reference_raw: This is confirmed by data obtained from a snowball sample showing that, although 38 % of males were known, only 20 % of females were known.

reference_spacy_tokens: This is confirmed by data obtained from a snowball sample showing that , although 38 % of males were known , only 20 % of females were known .


fn_spacy_tokens_for_baseline: Many admitted to having a doze through a meaningless movie presentation that talked more of light and energy , love and space than the car .

source_bert_toks: many admitted to having a do ##ze through a meaningless movie presentation that talked more of light and energy , love and space than the car .

reference_raw: Many admitted to sleeping through a meaningless film presentation that spoke more about light and energy, love and space than a car.

reference_spacy_tokens: Many admitted to sleeping through a meaningless film presentation that spoke more about light and energy , love and space than a car .


fn_spacy_tokens_for_baseline: The sparrows twittered and fluttered under the eaves , and the sound of children 's laughter floated up from the pool down the hill .

source_bert_toks: the sparrow ##s twitter ##ed and fluttered under the ea ##ves , and the sound of children ' s laughter floated up from the pool down the hill .

reference_raw: Sparrows twitched and fluttered under the eaves, and the sound of children's laughter rose from the pool below.

reference_spacy_tokens: Sparrows twitched and fluttered under the eaves , and the sound of children 's laughter rose from the pool below .


fn_spacy_tokens_for_baseline: And just because the fish lives in the water with it , does not mean that it is going to eat it -- it would be like you eating mouldy food .

source_bert_toks: and just because the fish lives in the water with it , does not mean that it is going to eat it - - it would be like you eating mo ##uld ##y food .

reference_raw: And just because a fish lives with it doesn't mean it eats it - it'd be like eating fungus food.

reference_spacy_tokens: And just because a fish lives with it does n't mean it eats it - it 'd be like eating fungus food .


fn_spacy_tokens_for_baseline: JUST a little ditty penned by beer poet laureate Rex Tyler , a prolific rhymster with an entire anthology of odes for all the 70 bottled beers sold in his extraordinary store .

source_bert_toks: just a little di ##tty penned by beer poet laureate rex tyler , a prolific r ##hy ##ms ##ter with an entire anthology of ode ##s for all the 70 bottled beers sold in his extraordinary store .

reference_raw: Just a little ditty penned by a beer poet laureate Rex Tyler, a prosperous rhymster with an anthology of ods for all 70 bottled beers sold in his special store.

reference_spacy_tokens: Just a little ditty penned by a beer poet laureate Rex Tyler , a prosperous rhymster with an anthology of ods for all 70 bottled beers sold in his special store .


fn_spacy_tokens_for_baseline: When the boot is laced up , your heel should be held firmly and you should not be able to move it about .

source_bert_toks: when the boot is laced up , your heel should be held firmly and you should not be able to move it about .

reference_raw: When the shoe is fastened, your heel should be held tight and you should not be able to move it around.

reference_spacy_tokens: When the shoe is fastened , your heel should be held tight and you should not be able to move it around .


fn_spacy_tokens_for_baseline: All current affairs in the whole world of lamentable war and strife needed to be weighed in this balance .

source_bert_toks: all current affairs in the whole world of lame ##nta ##ble war and strife needed to be weighed in this balance .

reference_raw: In this balance, all current matters in a world of woeful war and strife must be weighed.

reference_spacy_tokens: In this balance , all current matters in a world of woeful war and strife must be weighed .


fn_spacy_tokens_for_baseline: Electronic theft by foreign and industrial spies and disgruntled employees is costing U.S. companies billions and eroding their international competitive advantage .

source_bert_toks: electronic theft by foreign and industrial spies and di ##sg ##run ##tled employees is costing u . s . companies billions and er ##od ##ing their international competitive advantage .

reference_raw: The electronic theft of foreign and industrial spies and disgruntled workers is costing American companies billions of dollars and eroding their international competitive advantage.

reference_spacy_tokens: The electronic theft of foreign and industrial spies and disgruntled workers is costing American companies billions of dollars and eroding their international competitive advantage .


fn_spacy_tokens_for_baseline: But , so far , government officials involved in negotiating the 1992 directives can not point to instances of the Germans becoming more obstructive .

source_bert_toks: but , so far , government officials involved in negotiating the 1992 directive ##s can not point to instances of the germans becoming more ob ##st ##ru ##ctive .

reference_raw: However, so far, government officials involved in the negotiation of the 1992 directives cannot show that the Germans have become more obstructive.

reference_spacy_tokens: However , so far , government officials involved in the negotiation of the 1992 directives can not show that the Germans have become more obstructive .


fn_spacy_tokens_for_baseline: Seeking redemption or salvation through the church or through faith provides a way of cleansing ourselves of sin and , as it were , perfecting our individual creation .

source_bert_toks: seeking redemption or salvation through the church or through faith provides a way of cleansing ourselves of sin and , as it were , perfect ##ing our individual creation .

reference_raw: Searching for redemption or redemption through the Church or through faith is a way to purge ourselves of sin and, as it has been, to perfect our individual creation.

reference_spacy_tokens: Searching for redemption or redemption through the Church or through faith is a way to purge ourselves of sin and , as it has been , to perfect our individual creation .


fn_spacy_tokens_for_baseline: Taszar , Hungary --- U.S. Defense Secretary William Perry visits U.S. troops , then overnights in Budapest and leaves for Sarajevo Wednesday morning .

source_bert_toks: ta ##sz ##ar , hungary - - - u . s . defense secretary william perry visits u . s . troops , then overnight ##s in budapest and leaves for sarajevo wednesday morning .

reference_raw: Taszar, Hungary -- U.S. Secretary of Defense William Perry visits U.S. troops, then stays in Budapest at night, leaving for Sarajevo on Wednesday morning.

reference_spacy_tokens: Taszar , Hungary -- U.S. Secretary of Defense William Perry visits U.S. troops , then stays in Budapest at night , leaving for Sarajevo on Wednesday morning .


fn_spacy_tokens_for_baseline: ' Too many things to do , ' said Doyle , zipping up his black leather windcheater .

source_bert_toks: ' too many things to do , ' said doyle , zip ##ping up his black leather wind ##che ##ater .

reference_raw: 'There's too much to do,' said Doyle, turning on his black leather windbreaker.

reference_spacy_tokens: ' There 's too much to do , ' said Doyle , turning on his black leather windbreaker .


fn_spacy_tokens_for_baseline: Then , some way further on , in a feature of self - congratulation and vicarious identification , the svelte couple whose lifestyle and dinner party habits were being extolled in full double page ( low cholesterol ) spread colour for emulation by fellow believers , were clearly seen in full frontal and blatant use of the Kiwi - plus ca change , as Clarence Birdseye might have said .

source_bert_toks: then , some way further on , in a feature of self - cong ##rat ##ulation and vicar ##ious identification , the sv ##elt ##e couple whose lifestyle and dinner party habits were being ex ##to ##lled in full double page ( low cho ##les ##terol ) spread colour for em ##ulation by fellow believers , were clearly seen in full frontal and b ##lat ##ant use of the ki ##wi - plus ca change , as clarence birds ##eye might have said .

reference_raw: Then, a little further, in the character of self-congratulation and vicarious identification, the svelt couple whose lifestyle and party habits were extolled in a full double-page (low cholesterol) spread color for the emulation of their fellow believers were clearly seen in full frontal and blatant use of the Kiwi-and-ca-change, as Clarence Birdseye might have said.

reference_spacy_tokens: Then , a little further , in the character of self - congratulation and vicarious identification , the svelt couple whose lifestyle and party habits were extolled in a full double - page ( low cholesterol ) spread color for the emulation of their fellow believers were clearly seen in full frontal and blatant use of the Kiwi - and - ca - change , as Clarence Birdseye might have said .


fn_spacy_tokens_for_baseline: Lowthorpe is a small elongated village , situated five miles northeast of Driffield , which stretches southwards for nearly three and a half miles across the plain of Holderness .

source_bert_toks: low ##thorpe is a small elongated village , situated five miles northeast of dr ##iff ##ield , which stretches southward ##s for nearly three and a half miles across the plain of holder ##ness .

reference_raw: Lowthorpe is a small elongated village five miles north-east of Driffield, stretching south for almost three and a half miles across the plain of Holderness.

reference_spacy_tokens: Lowthorpe is a small elongated village five miles north - east of Driffield , stretching south for almost three and a half miles across the plain of Holderness .


fn_spacy_tokens_for_baseline: The wind stirred the silk fringes of Dr Bailey 's too - rich headgear .

source_bert_toks: the wind stirred the silk fringe ##s of dr bailey ' s too - rich head ##ge ##ar .

reference_raw: The wind stirred the silken edges of Dr. Bailey's too-rich headgear.

reference_spacy_tokens: The wind stirred the silken edges of Dr. Bailey 's too - rich headgear .


fn_spacy_tokens_for_baseline: The bitter taste of slavery is always in the background .

source_bert_toks: the bitter taste of slavery is always in the background .

reference_raw: There's always a sour taste of slavery in the background.

reference_spacy_tokens: There 's always a sour taste of slavery in the background .


fn_spacy_tokens_for_baseline: They parted laughing , and Paul went back to his room , bestowed the chamber - pot in its place , and went out to his morning lecture on moral philosophy .

source_bert_toks: they parted laughing , and paul went back to his room , bestowed the chamber - pot in its place , and went out to his morning lecture on moral philosophy .

reference_raw: They parted with laughter, and Paul returned to his room, gave the chamber pot instead, and went to his morning lecture on moral philosophy.

reference_spacy_tokens: They parted with laughter , and Paul returned to his room , gave the chamber pot instead , and went to his morning lecture on moral philosophy .


fn_spacy_tokens_for_baseline: If anyone finds the above paragraph startling , you 're welcome to write to me for clarification .

source_bert_toks: if anyone finds the above paragraph startling , you ' re welcome to write to me for cl ##ari ##fication .

reference_raw: If anyone is surprised by this paragraph, you can write to me for explanations.

reference_spacy_tokens: If anyone is surprised by this paragraph , you can write to me for explanations .


fn_spacy_tokens_for_baseline: Requirements of joining AL QAEDA : 1 - Abiding by AL QAEDA rules , its beliefs and objectives as previously mentioned 2 - Obedience to the leaders in charge as much as possible , without disobeying Islamic rules 3 - No connection between AL QAEDA membership and any other Islamic group 4 - Maintain secrecy in work - related issues 5- Physically healthy ( except in administrative work ) 6- The candidate should not be in question when it comes to religion , integrity or his morality 7- Reciting the pledge of AL - QAEDA .

source_bert_toks: requirements of joining al qaeda : 1 - ab ##idi ##ng by al qaeda rules , its beliefs and objectives as previously mentioned 2 - obedience to the leaders in charge as much as possible , without di ##so ##bey ##ing islamic rules 3 - no connection between al qaeda membership and any other islamic group 4 - maintain secrecy in work - related issues 5 - physically healthy ( except in administrative work ) 6 - the candidate should not be in question when it comes to religion , integrity or his morality 7 - rec ##iting the pledge of al - qaeda .

reference_raw: Requests for membership of AL QAEDA: 1 - Abiding by the rules of the AL QAEDA, its beliefs and objectives as set out above 2 - Obedience to the leaders responsible, as far as possible, without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work-related matters 5- Physically sound (excluding administrative work) 6- in terms of religion, integrity or morality 7-Reciting AL-QAEDA's promise.

reference_spacy_tokens: Requests for membership of AL QAEDA : 1 - Abiding by the rules of the AL QAEDA , its beliefs and objectives as set out above 2 - Obedience to the leaders responsible , as far as possible , without violating Islamic rules 3 - No link between AL QAEDA and any other Islamic group 4 - Keeping secrets on work - related matters 5- Physically sound ( excluding administrative work ) 6- in terms of religion , integrity or morality 7-Reciting AL - QAEDA 's promise .


fn_spacy_tokens_for_baseline: Some 35,000 spent fuel assemblies are stored on land and at sea , in dumps that are overfilled and do not meet international standards .

source_bert_toks: some 35 , 000 spent fuel assemblies are stored on land and at sea , in dump ##s that are over ##fi ##lled and do not meet international standards .

reference_raw: Some 35,000 spent fuel collections are stored on land and at sea in landfills that are overloaded and do not comply with international standards.

reference_spacy_tokens: Some 35,000 spent fuel collections are stored on land and at sea in landfills that are overloaded and do not comply with international standards .


fn_spacy_tokens_for_baseline: He gave her a reproachful glance .

source_bert_toks: he gave her a rep ##ro ##ach ##ful glance .

reference_raw: He looked at her accusingly.

reference_spacy_tokens: He looked at her accusingly .


fn_spacy_tokens_for_baseline: Hamas and other Palestinian militant group rejected Abbas ' call to end their attacks with a deadly raid on an Israeli army outpost in Gaza .

source_bert_toks: hamas and other palestinian militant group rejected abbas ' call to end their attacks with a deadly raid on an israeli army outpost in gaza .

reference_raw: Hamas and other Palestinian militant groups rejected Abbas' request to end the attack by a deadly raid on the Israeli military base in Gaza.

reference_spacy_tokens: Hamas and other Palestinian militant groups rejected Abbas ' request to end the attack by a deadly raid on the Israeli military base in Gaza .


fn_spacy_tokens_for_baseline: It is a dismal and discomfiting picture , but it is at least a ' natural ' one .

source_bert_toks: it is a di ##sma ##l and disco ##m ##fi ##ting picture , but it is at least a ' natural ' one .

reference_raw: It's a gloomy and unpleasant picture, but at least it's 'natural'.

reference_spacy_tokens: It 's a gloomy and unpleasant picture , but at least it 's ' natural ' .