fn_spacy_tokens_for_baseline: The PRC confirms that it has sold an electromagnetic separator and a mini - reactor to Iran .

source_bert_toks: the prc confirms that it has sold an electromagnetic sep ##arat ##or and a mini - reactor to iran .

reference_raw: The People's Republic of China acknowledges that it sold Iran an electromagnetic separator and a mini-reactor.

reference_spacy_tokens: The People 's Republic of China acknowledges that it sold Iran an electromagnetic separator and a mini - reactor .


fn_spacy_tokens_for_baseline: Removal of the typesetting information from a dictionary to leave just the bare ASCII text loses useful information that the typography makes visually apparent .

source_bert_toks: removal of the types ##etti ##ng information from a dictionary to leave just the bare as ##ci ##i text loses useful information that the ty ##po ##graphy makes visually apparent .

reference_raw: Removing the typesetting information from the vocabulary so that only the bare ASCII text will lose the useful information that the typography displays visually.

reference_spacy_tokens: Removing the typesetting information from the vocabulary so that only the bare ASCII text will lose the useful information that the typography displays visually .


fn_spacy_tokens_for_baseline: Conservative Luis Percovich , then Interior Minister , went so far as to hail the barefoot business people as the harbingers of a ' new Peru ' .

source_bert_toks: conservative luis per ##co ##vich , then interior minister , went so far as to hail the barefoot business people as the ha ##rbin ##gers of a ' new peru ' .

reference_raw: Conservative Luis Percovich, then Minister of the Interior, went so far as to hail the bare-foot merchants as "New Peru's Harbingers."

reference_spacy_tokens: Conservative Luis Percovich , then Minister of the Interior , went so far as to hail the bare - foot merchants as " New Peru 's Harbingers . "


fn_spacy_tokens_for_baseline: Since March 2009 , at least 57 foreign troops , including 32 Americans , have been killed in 19 attacks by Afghan service members .

source_bert_toks: since march 2009 , at least 57 foreign troops , including 32 americans , have been killed in 19 attacks by afghan service members .

reference_raw: Since March 2009, at least 57 foreign soldiers, including 32 Americans, have been killed in 19 attacks by Afghan soldiers.

reference_spacy_tokens: Since March 2009 , at least 57 foreign soldiers , including 32 Americans , have been killed in 19 attacks by Afghan soldiers .


fn_spacy_tokens_for_baseline: Babur thinks he looks like a film star , the sort who gets typecast as a rugged mountain trapper .

source_bert_toks: babu ##r thinks he looks like a film star , the sort who gets type ##cast as a rugged mountain trap ##per .

reference_raw: Babur thinks he looks like a movie star, the kind he writes like a rugged mountain trapper.

reference_spacy_tokens: Babur thinks he looks like a movie star , the kind he writes like a rugged mountain trapper .


fn_spacy_tokens_for_baseline: Derry 's quote was taken out of context -- the interview from which that quote was lifted was a very light - hearted affair . '

source_bert_toks: derry ' s quote was taken out of context - - the interview from which that quote was lifted was a very light - hearted affair . '

reference_raw: Derry's quote had been taken out of context - the conversation from which the quote had been removed was a very light-hearted matter.'

reference_spacy_tokens: Derry 's quote had been taken out of context - the conversation from which the quote had been removed was a very light - hearted matter . '


fn_spacy_tokens_for_baseline: A faint frown of doubt brought Lucenzo 's brows together .

source_bert_toks: a faint frown of doubt brought luce ##nzo ' s brows together .

reference_raw: Lucenzo's eyebrows came together with a slight scowl of doubt.

reference_spacy_tokens: Lucenzo 's eyebrows came together with a slight scowl of doubt .


fn_spacy_tokens_for_baseline: Very soon a cold stone wall of silence had tormented them to wounded exasperation .

source_bert_toks: very soon a cold stone wall of silence had tormented them to wounded ex ##as ##peration .

reference_raw: Very soon they were tortured by a cold stone wall of silence.

reference_spacy_tokens: Very soon they were tortured by a cold stone wall of silence .


fn_spacy_tokens_for_baseline: He listened to the hisses and pops of static as the number connected and the phone rang again .

source_bert_toks: he listened to the hiss ##es and pops of static as the number connected and the phone rang again .

reference_raw: He listened to the sizzles and pops of static as the number reconnected and the phone rang again.

reference_spacy_tokens: He listened to the sizzles and pops of static as the number reconnected and the phone rang again .


fn_spacy_tokens_for_baseline: Chessani , 43 , is charged with dereliction of duty and violating a lawful order for not ordering a complete investigation of the incident as a possible war crime .

source_bert_toks: chess ##ani , 43 , is charged with derelict ##ion of duty and violating a lawful order for not ordering a complete investigation of the incident as a possible war crime .

reference_raw: Chessani, 43 years old, is charged with abandonment and violation of a legal order not to order a full investigation of the incident as a potential war crime.

reference_spacy_tokens: Chessani , 43 years old , is charged with abandonment and violation of a legal order not to order a full investigation of the incident as a potential war crime .


fn_spacy_tokens_for_baseline: He debated with himself whether to stay and so risk capture or leave while the exit was clear .

source_bert_toks: he debated with himself whether to stay and so risk capture or leave while the exit was clear .

reference_raw: He wondered if he should stay and risk capturing or leaving while the exit was clear.

reference_spacy_tokens: He wondered if he should stay and risk capturing or leaving while the exit was clear .


fn_spacy_tokens_for_baseline: There will also be concern with teachers ' conceptions of how pupils influence both those goals and the actions taken to achieve them .

source_bert_toks: there will also be concern with teachers ' conception ##s of how pupils influence both those goals and the actions taken to achieve them .

reference_raw: Teachers will also be concerned about how pupils influence these objectives and the measures taken to achieve them.

reference_spacy_tokens: Teachers will also be concerned about how pupils influence these objectives and the measures taken to achieve them .


fn_spacy_tokens_for_baseline: A follow - up meeting between the movement and the king never materialised , and after the two clashes on the border King Hassan has called off a second meeting .

source_bert_toks: a follow - up meeting between the movement and the king never material ##ised , and after the two clashes on the border king hassan has called off a second meeting .

reference_raw: The subsequent meeting between the movement and the King never materialized, and after two encounters at the border, King Hassan called off the second meeting.

reference_spacy_tokens: The subsequent meeting between the movement and the King never materialized , and after two encounters at the border , King Hassan called off the second meeting .


fn_spacy_tokens_for_baseline: South Africa is the first and , to date , only country to build a nuclear arsenal , and then voluntarily dismantle its entire nuclear weapons program .

source_bert_toks: south africa is the first and , to date , only country to build a nuclear arsenal , and then voluntarily di ##sman ##tle its entire nuclear weapons program .

reference_raw: South Africa is the first and only country to build a nuclear arsenal and then voluntarily dismantle its entire nuclear weapons program.

reference_spacy_tokens: South Africa is the first and only country to build a nuclear arsenal and then voluntarily dismantle its entire nuclear weapons program .


fn_spacy_tokens_for_baseline: And the and the whine of the crusher you know , the two plates rubbing against each other .

source_bert_toks: and the and the w ##hine of the crush ##er you know , the two plates rubbing against each other .

reference_raw: And the squeal of the crusher, you know, the two plates rubbing each other.

reference_spacy_tokens: And the squeal of the crusher , you know , the two plates rubbing each other .


fn_spacy_tokens_for_baseline: Mrs Prophet , also known as Guru Ma , has predicted a nuclear cataclysm for April 23rd .

source_bert_toks: mrs prophet , also known as guru ma , has predicted a nuclear cat ##ac ##ly ##sm for april 23rd .

reference_raw: Mrs. Prophet, also known as Guru Ma, predicted a nuclear disaster on April 23.

reference_spacy_tokens: Mrs. Prophet , also known as Guru Ma , predicted a nuclear disaster on April 23 .


fn_spacy_tokens_for_baseline: Hargreave pulled pensively at his cigar and tipped back his chair .

source_bert_toks: ha ##rg ##rea ##ve pulled pens ##ively at his cigar and tipped back his chair .

reference_raw: Hargreave tugged thoughtfully at his cigar and tilted his chair back.

reference_spacy_tokens: Hargreave tugged thoughtfully at his cigar and tilted his chair back .


fn_spacy_tokens_for_baseline: ' I would n't insult you by thinking I could learn enough in a couple of days .

source_bert_toks: ' i wouldn ' t insult you by thinking i could learn enough in a couple of days .

reference_raw: I wouldn't offend you if I thought I could learn enough in a few days.

reference_spacy_tokens: I would n't offend you if I thought I could learn enough in a few days .


fn_spacy_tokens_for_baseline: Mr. Gonzalez also has split with the left in reaffirming Spain 's NATO commitment and in renewing a defense treaty with the U.S.

source_bert_toks: mr . gonzalez also has split with the left in re ##af ##firm ##ing spain ' s nato commitment and in renew ##ing a defense treaty with the u . s .

reference_raw: Mr. Gonzalez also broke up with the left to confirm Spain's commitment to NATO and to renew the defence agreement with the United States.

reference_spacy_tokens: Mr. Gonzalez also broke up with the left to confirm Spain 's commitment to NATO and to renew the defence agreement with the United States .


fn_spacy_tokens_for_baseline: By afternoon their Geiger counter clacked off the scale as a 100-by-30-mile ( 160-by-48 kilometer ) blanket of radioactivity arrived .

source_bert_toks: by afternoon their ge ##iger counter cl ##ack ##ed off the scale as a 100 - by - 30 - mile ( 160 - by - 48 kilometer ) blanket of radio ##act ##ivity arrived .

reference_raw: In the afternoon, their Geiger counter clicked off the scale as a 100-by-30-mile-160-by-48-kilometre blanket of radioactivity arrived.

reference_spacy_tokens: In the afternoon , their Geiger counter clicked off the scale as a 100-by-30-mile-160-by-48-kilometre blanket of radioactivity arrived .


fn_spacy_tokens_for_baseline: These stories are commonplace , although those involved are wary of going on record .

source_bert_toks: these stories are commonplace , although those involved are wary of going on record .

reference_raw: These stories are common, though the ones involved are careful to go on the record.

reference_spacy_tokens: These stories are common , though the ones involved are careful to go on the record .


fn_spacy_tokens_for_baseline: It consists of approximately four - six Shehab-2 TELs and four - eight Shehab-3 MELs and is believed to be organized with one - two Shehab-2 and one - two Shehab-3 battalions .

source_bert_toks: it consists of approximately four - six she ##hab - 2 tel ##s and four - eight she ##hab - 3 mel ##s and is believed to be organized with one - two she ##hab - 2 and one - two she ##hab - 3 battalions .

reference_raw: It consists of approximately four-six Shehab-2 TELs and four-eight Shehab-3 MELs and is considered to be organized by one-two Shehab-2 and one-two Shehab-3 battalions.

reference_spacy_tokens: It consists of approximately four - six Shehab-2 TELs and four - eight Shehab-3 MELs and is considered to be organized by one - two Shehab-2 and one - two Shehab-3 battalions .


fn_spacy_tokens_for_baseline: A BT spokesman said : ' People will soon realise that there is no such thing as a free anything in the world , least of all telephone calls . '

source_bert_toks: a bt spokesman said : ' people will soon realise that there is no such thing as a free anything in the world , least of all telephone calls . '

reference_raw: The BT spokesman said, "People will soon realize that nothing in the world is free, least of all phone calls."

reference_spacy_tokens: The BT spokesman said , " People will soon realize that nothing in the world is free , least of all phone calls . "


fn_spacy_tokens_for_baseline: As we talk , Dolph Lundgren waddles by .

source_bert_toks: as we talk , do ##lp ##h lund ##gren wa ##ddle ##s by .

reference_raw: Dolph Lundgren walks by as we speak.

reference_spacy_tokens: Dolph Lundgren walks by as we speak .


fn_spacy_tokens_for_baseline: Dr Michael Stroud slipped into the chasm as the pair were crossing an ice shelf in driving snow and 100 mph winds .

source_bert_toks: dr michael st ##roud slipped into the cha ##sm as the pair were crossing an ice shelf in driving snow and 100 ##mp ##h winds .

reference_raw: Dr. Michael Stroud slipped into the abyss as the two of them crossed the ice rack in the driving snow and a hundred-mph winds.

reference_spacy_tokens: Dr. Michael Stroud slipped into the abyss as the two of them crossed the ice rack in the driving snow and a hundred - mph winds .


fn_spacy_tokens_for_baseline: Indeed effective use of tribunals may be more expensive to a claimant .

source_bert_toks: indeed effective use of tribunal ##s may be more expensive to a claim ##ant .

reference_raw: Indeed, the effective use of the courts may be more costly for the claimant.

reference_spacy_tokens: Indeed , the effective use of the courts may be more costly for the claimant .


fn_spacy_tokens_for_baseline: and i often find that even when i do n't feel that much like exercising like i 'll be really tired and i 'll start swimming and i 'll actually and i 'll actually get energy

source_bert_toks: and i often find that even when i don ' t feel that much like exercising like i ' ll be really tired and i ' ll start swimming and i ' ll actually and i ' ll actually get energy

reference_raw: and I often find that even though I don't feel like practicing like I'm really tired and I'm going to start swimming and I'm actually and I'm going to get energy

reference_spacy_tokens: and I often find that even though I do n't feel like practicing like I 'm really tired and I 'm going to start swimming and I 'm actually and I 'm going to get energy


fn_spacy_tokens_for_baseline: The IAEA raised questions regarding possible enrichment activities at the workshops of the Kalaye Electric Company relating to production of centrifuge components .

source_bert_toks: the ia ##ea raised questions regarding possible enrichment activities at the workshops of the kala ##ye electric company relating to production of cent ##ri ##fu ##ge components .

reference_raw: In the Kalaye Electric Company workshops on the production of centrifuge components, the IAEA raised concerns about possible enrichment activities.

reference_spacy_tokens: In the Kalaye Electric Company workshops on the production of centrifuge components , the IAEA raised concerns about possible enrichment activities .


fn_spacy_tokens_for_baseline: We can not feel that such an arrangement is in any way unjust to you .

source_bert_toks: we can not feel that such an arrangement is in any way un ##just to you .

reference_raw: We don't think such a deal is unfair to you in any way.

reference_spacy_tokens: We do n't think such a deal is unfair to you in any way .


fn_spacy_tokens_for_baseline: A Muslim officer who recently quit the Yugoslav army claimed yesterday it had massively armed Serbian militiamen in Bosnia and co - ordinated plans to partition the republic along ethnic lines .

source_bert_toks: a muslim officer who recently quit the yugoslav army claimed yesterday it had massive ##ly armed serbian militia ##men in bosnia and co - or ##dina ##ted plans to partition the republic along ethnic lines .

reference_raw: A Muslim officer who recently left the Yugoslav Army claimed yesterday that he had massively armed Serbian militia in Bosnia and coordinated plans to divide the Republic along ethnic lines.

reference_spacy_tokens: A Muslim officer who recently left the Yugoslav Army claimed yesterday that he had massively armed Serbian militia in Bosnia and coordinated plans to divide the Republic along ethnic lines .


fn_spacy_tokens_for_baseline: Dot thought at first she meant it was unkind for the man to be so constricted by the many instruments strapped to all parts of his body .

source_bert_toks: dot thought at first she meant it was un ##kind for the man to be so con ##st ##ricted by the many instruments strapped to all parts of his body .

reference_raw: At first, Dot thought, it was not nice for a man to be so constricted by the many instruments attached to every part of his body.

reference_spacy_tokens: At first , Dot thought , it was not nice for a man to be so constricted by the many instruments attached to every part of his body .


fn_spacy_tokens_for_baseline: A woman abandoned by her husband found her wage of new and crucial importance and looked to the union for support .

source_bert_toks: a woman abandoned by her husband found her wage of new and crucial importance and looked to the union for support .

reference_raw: A woman left behind by her husband found her salary new and vital and looked to the union for support.

reference_spacy_tokens: A woman left behind by her husband found her salary new and vital and looked to the union for support .


fn_spacy_tokens_for_baseline: They sat quietly in Jerusalem until the Spirit came upon them at Pentecost ; then they could not keep quiet about the mighty deeds of God .

source_bert_toks: they sat quietly in jerusalem until the spirit came upon them at pen ##tec ##ost ; then they could not keep quiet about the mighty deeds of god .

reference_raw: They sat silently in Jerusalem until the Spirit came upon them in Pentecost; then they could not be silent about God's great deeds.

reference_spacy_tokens: They sat silently in Jerusalem until the Spirit came upon them in Pentecost ; then they could not be silent about God 's great deeds .


fn_spacy_tokens_for_baseline: ' The pain will be exquisite , Doctor , and I shall savour every nuance of your screams .

source_bert_toks: ' the pain will be exquisite , doctor , and i shall sa ##vo ##ur every nu ##ance of your screams .

reference_raw: 'The pain will be exquisite, Doctor, and I will enjoy every nuance of your screams.

reference_spacy_tokens: ' The pain will be exquisite , Doctor , and I will enjoy every nuance of your screams .


fn_spacy_tokens_for_baseline: On washing day I fill a bucket half full of very hot water and add my cup of soap powder before going back to the house for breakfast .

source_bert_toks: on washing day i fill a bucket half full of very hot water and add my cup of soap powder before going back to the house for breakfast .

reference_raw: On the day of washing, I filled a bucket half full of very hot water and added a mug of soap powder before I went home for breakfast.

reference_spacy_tokens: On the day of washing , I filled a bucket half full of very hot water and added a mug of soap powder before I went home for breakfast .


fn_spacy_tokens_for_baseline: This 320 km range is the range of the Shehab-1 ( i.e. , Hwasong-5 ) and is slightly greater than the 280 km of the standard Scud - B. It is unlikely that the Iranians manufactured these missiles , but rather they were assembled from components provided by the DPRK .

source_bert_toks: this 320 ##km range is the range of the she ##hab - 1 ( i . e . , h ##was ##ong - 5 ) and is slightly greater than the 280 ##km of the standard sc ##ud - b . it is unlikely that the iranian ##s manufactured these missiles , but rather they were assembled from components provided by the d ##pr ##k .

reference_raw: This 320 km range is the Shehab-1 (Hwasong-5) range and slightly higher than the 280 km standard Scud-B range. It is unlikely that the Iranians would have produced these rockets, but instead assembled from components supplied by the DPRK.

reference_spacy_tokens: This 320 km range is the Shehab-1 ( Hwasong-5 ) range and slightly higher than the 280 km standard Scud - B range . It is unlikely that the Iranians would have produced these rockets , but instead assembled from components supplied by the DPRK .


fn_spacy_tokens_for_baseline: Electrolux , the world 's biggest household appliance maker , has seen its year end profits for 1991 fall , due in part to its transfer of cooker production to Spennymoor .

source_bert_toks: electro ##lux , the world ' s biggest household app ##lian ##ce maker , has seen its year end profits for 1991 fall , due in part to its transfer of cooke ##r production to sp ##en ##ny ##moor .

reference_raw: Electrolux, the world's largest household equipment manufacturer, saw its 1991 end-of-year profits fall, partly due to its transfer of cooking to Spennymoor.

reference_spacy_tokens: Electrolux , the world 's largest household equipment manufacturer , saw its 1991 end - of - year profits fall , partly due to its transfer of cooking to Spennymoor .


fn_spacy_tokens_for_baseline: It uses the left side of our brain to project past failures , thus actively interfering with our ability to overcome the negative impact that we face .

source_bert_toks: it uses the left side of our brain to project past failures , thus actively interfering with our ability to overcome the negative impact that we face .

reference_raw: It uses the left-hand side of our brain to project past failures and thus actively intervenes in our ability to overcome the negative effects we face.

reference_spacy_tokens: It uses the left - hand side of our brain to project past failures and thus actively intervenes in our ability to overcome the negative effects we face .


fn_spacy_tokens_for_baseline: Fortunately the ground comes cheap , leased from the patron Lord Camrose on a peppercorn rent .

source_bert_toks: fortunately the ground comes cheap , leased from the patron lord cam ##rose on a pepper ##cor ##n rent .

reference_raw: Luckily, the land comes cheap, rented by Lord Camrose's patron for the peppercorn rent.

reference_spacy_tokens: Luckily , the land comes cheap , rented by Lord Camrose 's patron for the peppercorn rent .


fn_spacy_tokens_for_baseline: The house was decked in virginal white .

source_bert_toks: the house was deck ##ed in virgin ##al white .

reference_raw: The house was full of virgin white.

reference_spacy_tokens: The house was full of virgin white .


fn_spacy_tokens_for_baseline: The operator then turns a handle to allow three or more spears to puncture the cans and allow their contents to run into the bottom of the hopper .

source_bert_toks: the operator then turns a handle to allow three or more spears to pun ##cture the cans and allow their contents to run into the bottom of the hopper .

reference_raw: The operator then turns the handle so that three or more spears can pierce the cans and allow the contents to reach the bottom of the jumper.

reference_spacy_tokens: The operator then turns the handle so that three or more spears can pierce the cans and allow the contents to reach the bottom of the jumper .


fn_spacy_tokens_for_baseline: The slides were dehydrated through graded ethanol baths with 0.3 M NH 4 -Acetate , air dried and processed for autoradiography .

source_bert_toks: the slides were de ##hy ##dra ##ted through graded ethanol baths with 0 . 3 m nh 4 - ace ##tate , air dried and processed for auto ##rad ##iography .

reference_raw: The slides were dried in graded ethanol baths with 0.3 M NH 4 -Accetate, dried air and processed for autoradiography.

reference_spacy_tokens: The slides were dried in graded ethanol baths with 0.3 M NH 4 -Accetate , dried air and processed for autoradiography .


fn_spacy_tokens_for_baseline: In 1951 , during the period of the Vietnamese uprising against the French colonial rule , he walked through his country 's rich tropical forests to China , where he and his colleagues set up a temporary university .

source_bert_toks: in 1951 , during the period of the vietnamese uprising against the french colonial rule , he walked through his country ' s rich tropical forests to china , where he and his colleagues set up a temporary university .

reference_raw: In 1951, during the Vietnamese rebellion against the French colonial rule, he crossed the rich tropical forests of his country to China, where he and his colleagues set up a temporary university.

reference_spacy_tokens: In 1951 , during the Vietnamese rebellion against the French colonial rule , he crossed the rich tropical forests of his country to China , where he and his colleagues set up a temporary university .


fn_spacy_tokens_for_baseline: The Alex Harvey Band came into the shop quite a few times that summer , Chris Glenn , the bass player , bought his gold lurex socks from us .

source_bert_toks: the alex harvey band came into the shop quite a few times that summer , chris glenn , the bass player , bought his gold lure ##x socks from us .

reference_raw: Alex Harvey's band had come to the store quite a few times that summer, Chris Glenn, the bass player, had bought us his golden lurex stockings.

reference_spacy_tokens: Alex Harvey 's band had come to the store quite a few times that summer , Chris Glenn , the bass player , had bought us his golden lurex stockings .


fn_spacy_tokens_for_baseline: ASUTRAMES gave out leaflets , explaining what the government was trying to do with those ' elections ' .

source_bert_toks: as ##ut ##ram ##es gave out leaflets , explaining what the government was trying to do with those ' elections ' .

reference_raw: ASUTRAMES published leaflets explaining what the government was trying to do about the elections.

reference_spacy_tokens: ASUTRAMES published leaflets explaining what the government was trying to do about the elections .


fn_spacy_tokens_for_baseline: But Downing Street mandarins grew so alarmed at reports of a snub yesterday that the text of private diplomatic traffic , a telex sent by Mr Clinton on Saturday , was made public .

source_bert_toks: but downing street mandarin ##s grew so alarmed at reports of a s ##nu ##b yesterday that the text of private diplomatic traffic , a tel ##ex sent by mr clinton on saturday , was made public .

reference_raw: But Downing Street Mandarins was so startled by the news of the snub yesterday that the message of private diplomatic transport, a telex sent by Mr. Clinton on Saturday, was published.

reference_spacy_tokens: But Downing Street Mandarins was so startled by the news of the snub yesterday that the message of private diplomatic transport , a telex sent by Mr. Clinton on Saturday , was published .


fn_spacy_tokens_for_baseline: Hickman died Jan. 7 at Forward Operating Base Salerno , Afghanistan , of wounds suffered earlier that day when his unit was attacked with an improvised explosive device and small - arms fire at Combat Outpost Bowri Tana .

source_bert_toks: hi ##ckman died jan . 7 at forward operating base sale ##rno , afghanistan , of wounds suffered earlier that day when his unit was attacked with an improvised explosive device and small - arms fire at combat outpost bow ##ri tan ##a .

reference_raw: Hickman died on January 7 at Forward Operations Base Salerno, Afghanistan, from injuries sustained earlier that day when his unit was attacked by an impromptu explosive device and a small-armed fire at Bowri Tana Combat Base.

reference_spacy_tokens: Hickman died on January 7 at Forward Operations Base Salerno , Afghanistan , from injuries sustained earlier that day when his unit was attacked by an impromptu explosive device and a small - armed fire at Bowri Tana Combat Base .


fn_spacy_tokens_for_baseline: Using a knife dusted with cornflour , make ' bag ' creases on the short sides of the cake .

source_bert_toks: using a knife dust ##ed with corn ##fl ##our , make ' bag ' cr ##ease ##s on the short sides of the cake .

reference_raw: Use a knife stained with corn flour to make a 'bag' crease on the short sides of the cake.

reference_spacy_tokens: Use a knife stained with corn flour to make a ' bag ' crease on the short sides of the cake .


fn_spacy_tokens_for_baseline: A Red Alert swung into action and an Army Lynx helicopter and a police search helicopter hovered over nearby woodland as mounted police and dog handlers combed the area .

source_bert_toks: a red alert swung into action and an army lynx helicopter and a police search helicopter hovered over nearby woodland as mounted police and dog handler ##s comb ##ed the area .

reference_raw: The Red Alert went into action, and the Army Lynx helicopter and the police search helicopter hovered over the nearby forest, while mounted police and dog-handlers swept the area.

reference_spacy_tokens: The Red Alert went into action , and the Army Lynx helicopter and the police search helicopter hovered over the nearby forest , while mounted police and dog - handlers swept the area .


fn_spacy_tokens_for_baseline: Qualities of timelessness , and oneness with the people and surroundings are reflected in Prunella 's book , and the beautiful black and white photographs are also enchanting .

source_bert_toks: qualities of timeless ##ness , and one ##ness with the people and surroundings are reflected in pr ##une ##lla ' s book , and the beautiful black and white photographs are also en ##chan ##ting .

reference_raw: The qualities of timelessness and oneness with the people and the surroundings are reflected in Prunella's book, and the beautiful black-and-white photographs are also charming.

reference_spacy_tokens: The qualities of timelessness and oneness with the people and the surroundings are reflected in Prunella 's book , and the beautiful black - and - white photographs are also charming .


fn_spacy_tokens_for_baseline: Reports say Iran is working on laser enrichment technologies .

source_bert_toks: reports say iran is working on laser enrichment technologies .

reference_raw: According to reports, Iran is working on laser enrichment technology.

reference_spacy_tokens: According to reports , Iran is working on laser enrichment technology .


fn_spacy_tokens_for_baseline: They can take one of the following forms : 1- Steel pipes : Insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2- Barrels : They are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3- Ditches : They are better than road bumps because they are harder to see .

source_bert_toks: they can take one of the following forms : 1 - steel pipes : insert 4 inch pipes in the ground at 50 centimeters apart and a height of one meter then fill them with cement 2 - barrels : they are filled with cement and place around the building , especially at the entrance to prevent cars from crashing into it 3 - ditch ##es : they are better than road bumps because they are harder to see .

reference_raw: They may take one of the following forms: 1-Steel pipes: insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre, then fill them with cement 2-Barrels: they are filled with cement and they are located around the building, especially at the entrance to prevent vehicles from crashing into it 3-Ditches: they are superior to road bumps because they are more difficult to see.

reference_spacy_tokens: They may take one of the following forms : 1-Steel pipes : insert 4 inch pipes into the ground at a distance of 50 cm and a height of 1 metre , then fill them with cement 2-Barrels : they are filled with cement and they are located around the building , especially at the entrance to prevent vehicles from crashing into it 3-Ditches : they are superior to road bumps because they are more difficult to see .


fn_spacy_tokens_for_baseline: IT 'S not just because we 're serialising it that I recommend Jack Ashley 's autobiography .

source_bert_toks: it ' s not just because we ' re serial ##ising it that i recommend jack ashley ' s autobiography .

reference_raw: It's not just because we're serializing it that I'm recommending an autobiographer for Jack Ashley.

reference_spacy_tokens: It 's not just because we 're serializing it that I 'm recommending an autobiographer for Jack Ashley .


fn_spacy_tokens_for_baseline: Lais 's long blonde hair tumbled across her face and Peach , splattered with her sister 's blood , brushed it back softly .

source_bert_toks: lai ##s ' s long blonde hair tumbled across her face and peach , sp ##lat ##tered with her sister ' s blood , brushed it back softly .

reference_raw: Lais's long blond hair fell over her face, and Peach, stained with her sister's blood, gently brushed her back.

reference_spacy_tokens: Lais 's long blond hair fell over her face , and Peach , stained with her sister 's blood , gently brushed her back .


fn_spacy_tokens_for_baseline: Royal Marines intercepted the vessel which was found to be carrying cargo which is banned under the United Nations measures .

source_bert_toks: royal marines intercepted the vessel which was found to be carrying cargo which is banned under the united nations measures .

reference_raw: The Royal Marines have captured a vessel that has been found to be carrying cargo that is prohibited by UN measures.

reference_spacy_tokens: The Royal Marines have captured a vessel that has been found to be carrying cargo that is prohibited by UN measures .


fn_spacy_tokens_for_baseline: I may add that Miss Burnet 's age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

source_bert_toks: i may add that miss burn ##et ' s age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

reference_raw: I might add that Miss Burnet's age and character make sure that my first thought of having a love interest in our story is out of the question.

reference_spacy_tokens: I might add that Miss Burnet 's age and character make sure that my first thought of having a love interest in our story is out of the question .


fn_spacy_tokens_for_baseline: If you want to be kind , the character can find himself manacled to the wall in one of the empty cells .

source_bert_toks: if you want to be kind , the character can find himself mana ##cle ##d to the wall in one of the empty cells .

reference_raw: If you'd like to be nice, the figure could be strapped to a wall in one of the empty cells.

reference_spacy_tokens: If you 'd like to be nice , the figure could be strapped to a wall in one of the empty cells .


fn_spacy_tokens_for_baseline: As a result I was ridiculed by the other children .

source_bert_toks: as a result i was rid ##ic ##uled by the other children .

reference_raw: As a result, the other children mocked me.

reference_spacy_tokens: As a result , the other children mocked me .


fn_spacy_tokens_for_baseline: The pilot dipped the nose of the aircraft and dropped down behind the van , close enough to be able to read its registration number : only a delivery van from the nearby town .

source_bert_toks: the pilot dipped the nose of the aircraft and dropped down behind the van , close enough to be able to read its registration number : only a delivery van from the nearby town .

reference_raw: The pilot dipped the nose of the plane and dropped into the back of the van, close enough to read the registration number: just a van from a nearby town.

reference_spacy_tokens: The pilot dipped the nose of the plane and dropped into the back of the van , close enough to read the registration number : just a van from a nearby town .


fn_spacy_tokens_for_baseline: It is grotesque , Watson , ' Holmes added , as he slowly fastened his notebook , ' but , as I have had occasion to remark , there is but one step from the grotesque to the horrible . '

source_bert_toks: it is grotesque , watson , ' holmes added , as he slowly fastened his notebook , ' but , as i have had occasion to remark , there is but one step from the grotesque to the horrible . '

reference_raw: "It's grotesque, Watson," said Holmes, as he slowly attached his notebook, "but, as I've had occasion to say, there's only one step from grotesque to terrible."

reference_spacy_tokens: " It 's grotesque , Watson , " said Holmes , as he slowly attached his notebook , " but , as I 've had occasion to say , there 's only one step from grotesque to terrible . "


fn_spacy_tokens_for_baseline: Ben stood staring at her across the garden , a puzzled , worried expression on his face .

source_bert_toks: ben stood staring at her across the garden , a puzzled , worried expression on his face .

reference_raw: Ben stood staring at her across the garden, his face confused and troubled.

reference_spacy_tokens: Ben stood staring at her across the garden , his face confused and troubled .


fn_spacy_tokens_for_baseline: Even before we had left the environs of Mount Pleasant airport , we had seen upland geese grazing unconcernedly alongside the runway , and we crossed creeks where small parties of speckled teal were swimming .

source_bert_toks: even before we had left the en ##vir ##ons of mount pleasant airport , we had seen upland geese grazing un ##con ##cer ##ned ##ly alongside the runway , and we crossed creeks where small parties of spec ##kled tea ##l were swimming .

reference_raw: Even before we left the environs of Mount Pleasant, we saw the mountain geese grazing unconcernedly along the runway, and crossed the streams where small groups of stained teal swam.

reference_spacy_tokens: Even before we left the environs of Mount Pleasant , we saw the mountain geese grazing unconcernedly along the runway , and crossed the streams where small groups of stained teal swam .


fn_spacy_tokens_for_baseline: Consequently she 's got the beginnings of a nasty boil on her arm . '

source_bert_toks: consequently she ' s got the beginnings of a nasty boil on her arm . '

reference_raw: That's why he's got the beginnings of a nasty cooking on his arm.'

reference_spacy_tokens: That 's why he 's got the beginnings of a nasty cooking on his arm . '


fn_spacy_tokens_for_baseline: Ever since 1969 , when he had his first show , his cartoonish black - and - white paintings have managed to comment without mercy or a smidgen of socially redeeming tact on , among other things , men 's -- and women 's -- looks ( Warhol 's nosejob painting must be an important icon in his private gallery ) ; issues of health ( a hilarious series of men in the throes of having heart attacks ) ; bestiality ( pert Fifties housewife on her knees doing something unspeakable to a poodle with her arm ) and religion ( famous Biblical figure on the cross getting a pie in the face ) .

source_bert_toks: ever since 1969 , when he had his first show , his cartoon ##ish black - and - white paintings have managed to comment without mercy or a sm ##idge ##n of socially red ##eem ##ing ta ##ct on , among other things , men ' s - - and women ' s - - looks ( war ##hol ' s nose ##jo ##b painting must be an important icon in his private gallery ) ; issues of health ( a hilarious series of men in the th ##ro ##es of having heart attacks ) ; best ##ial ##ity ( per ##t fifties house ##wife on her knees doing something un ##sp ##eak ##able to a po ##odle with her arm ) and religion ( famous biblical figure on the cross getting a pie in the face ) .

reference_raw: Since his first performance in 1969, his cartoon black-and-white paintings have been able to comment without mercy or a smidge of socially redeemable tacts on, among other things, men's - and women's - looks (the painting of Warhol's nose must be an important icon in his private gallery); health issues (the hilarious series of men in the throes of heart attacks); (pert fifty housewife on her knees doing something unspeakable to a poodle with her hand) and religion (renowned biblical figure on a cross getting a pie in the face).

reference_spacy_tokens: Since his first performance in 1969 , his cartoon black - and - white paintings have been able to comment without mercy or a smidge of socially redeemable tacts on , among other things , men 's - and women 's - looks ( the painting of Warhol 's nose must be an important icon in his private gallery ) ; health issues ( the hilarious series of men in the throes of heart attacks ) ; ( pert fifty housewife on her knees doing something unspeakable to a poodle with her hand ) and religion ( renowned biblical figure on a cross getting a pie in the face ) .


fn_spacy_tokens_for_baseline: The nearest we got to an official pronouncement on the recent escalation of terrorism was the inane comment of Security Minister Sir John Wheeler that the IRA was defeated .

source_bert_toks: the nearest we got to an official pro ##no ##unce ##ment on the recent es ##cala ##tion of terrorism was the ina ##ne comment of security minister sir john wheeler that the ira was defeated .

reference_raw: The closest we had to an official statement about the recent escalation of terrorism was the inadvertent comment of Security Secretary Sir John Wheeler that the IRA had been defeated.

reference_spacy_tokens: The closest we had to an official statement about the recent escalation of terrorism was the inadvertent comment of Security Secretary Sir John Wheeler that the IRA had been defeated .


fn_spacy_tokens_for_baseline: But they need not be to do their jobs well .

source_bert_toks: but they need not be to do their jobs well .

reference_raw: But they don't have to be good at their work.

reference_spacy_tokens: But they do n't have to be good at their work .


fn_spacy_tokens_for_baseline: To reintroduce us to the joys of story telling round the log fire , Signals rounded up a slightly disconcerting group of five contemporary writers , all strange to me .

source_bert_toks: to rein ##tro ##du ##ce us to the joy ##s of story telling round the log fire , signals rounded up a slightly disco ##nce ##rting group of five contemporary writers , all strange to me .

reference_raw: To bring us back to the joys of telling stories around the log fire, the Signals gathered a slightly disturbing group of five contemporary writers, all odd to me.

reference_spacy_tokens: To bring us back to the joys of telling stories around the log fire , the Signals gathered a slightly disturbing group of five contemporary writers , all odd to me .


fn_spacy_tokens_for_baseline: Many farmers even in DRAs are wealthy on paper simply because land prices have increased dramatically during the last thirty years .

source_bert_toks: many farmers even in dr ##as are wealthy on paper simply because land prices have increased dramatically during the last thirty years .

reference_raw: Many farmers, even in the DRAs, are rich on paper simply because land prices have risen dramatically over the past 30 years.

reference_spacy_tokens: Many farmers , even in the DRAs , are rich on paper simply because land prices have risen dramatically over the past 30 years .


fn_spacy_tokens_for_baseline: She flung herself on Wexford , yelping frenetically , and when he pushed her away , ran round him in circles , wildly gyrating her tail and flapping her knitted ears .

source_bert_toks: she flung herself on wexford , ye ##lp ##ing fr ##ene ##tically , and when he pushed her away , ran round him in circles , wildly g ##yra ##ting her tail and flap ##ping her knit ##ted ears .

reference_raw: She threw herself at Wexford, howling wildly, and as he pushed her away, she ran around him in circles, gyrating her tail wildly, flapping her knitted ears.

reference_spacy_tokens: She threw herself at Wexford , howling wildly , and as he pushed her away , she ran around him in circles , gyrating her tail wildly , flapping her knitted ears .


fn_spacy_tokens_for_baseline: However , we are understandably reluctant to raise this with the creditor organisations .

source_bert_toks: however , we are understand ##ably reluctant to raise this with the credit ##or organisations .

reference_raw: However, it is clear that we do not want to raise this with creditor organisations.

reference_spacy_tokens: However , it is clear that we do not want to raise this with creditor organisations .


fn_spacy_tokens_for_baseline: He says : ' The initial expectation was that Eastern Europe would replay the last 30 years of telecommunications history in Western Europe , buying miles of copper cable and so on .

source_bert_toks: he says : ' the initial expectation was that eastern europe would replay the last 30 years of telecommunications history in western europe , buying miles of copper cable and so on .

reference_raw: He said, "The initial expectation was that Eastern Europe would replay the last 30 years of telecommunications history in Western Europe, buy millions of copper cables and so on.

reference_spacy_tokens: He said , " The initial expectation was that Eastern Europe would replay the last 30 years of telecommunications history in Western Europe , buy millions of copper cables and so on .


fn_spacy_tokens_for_baseline: Stevenson , a quick - moving , stocky northerner with a distinguished record in every possible branch of the Met , was rumoured to be going up to Assistant Commissioner just as soon as the present incumbent retired .

source_bert_toks: stevenson , a quick - moving , stock ##y northern ##er with a distinguished record in every possible branch of the met , was rum ##oured to be going up to assistant commissioner just as soon as the present incumbent retired .

reference_raw: Stevenson, a fast-moving, sturdy Northerner with a distinguished record in every branch of the Met, was said to go to the Deputy Commissioner as soon as the current incumbent retired.

reference_spacy_tokens: Stevenson , a fast - moving , sturdy Northerner with a distinguished record in every branch of the Met , was said to go to the Deputy Commissioner as soon as the current incumbent retired .


fn_spacy_tokens_for_baseline: Merit , in business since 1979 , has always sold aluminum awnings and started selling Sunbrela brand fabric awnings about eight years ago .

source_bert_toks: merit , in business since 1979 , has always sold aluminum aw ##ning ##s and started selling sun ##bre ##la brand fabric aw ##ning ##s about eight years ago .

reference_raw: Merit has been selling aluminium awnings in business since 1979 and started selling Sunbrela's cloth awnings about eight years ago.

reference_spacy_tokens: Merit has been selling aluminium awnings in business since 1979 and started selling Sunbrela 's cloth awnings about eight years ago .


fn_spacy_tokens_for_baseline: Immediately the pigeons began to strut and flutter out , billing and cooing with pleasure .

source_bert_toks: immediately the pigeons began to st ##rut and flutter out , billing and co ##oin ##g with pleasure .

reference_raw: Instantly, the pigeons began to strut and flutter, billowing and bouncing with joy.

reference_spacy_tokens: Instantly , the pigeons began to strut and flutter , billowing and bouncing with joy .


fn_spacy_tokens_for_baseline: 12:38 a.m. DAYAC : I was driving my truck , stopped at a red light at the corner of Shattuck and Alcatraz at the Oakland - Berkeley border when it hit .

source_bert_toks: 12 : 38 a . m . day ##ac : i was driving my truck , stopped at a red light at the corner of sha ##tt ##uck and al ##cat ##raz at the oakland - berkeley border when it hit .

reference_raw: 12:38 A.M. DAYAC: I was driving my car, and when it hit, I stopped in the light at the corner of Shattuck and Alcatraz on the Oakland-Berkeley border.

reference_spacy_tokens: 12:38 A.M. DAYAC : I was driving my car , and when it hit , I stopped in the light at the corner of Shattuck and Alcatraz on the Oakland - Berkeley border .


fn_spacy_tokens_for_baseline: Fourth seed Lendl retired after straining his left side while trailing 5 - 4 in the first set .

source_bert_toks: fourth seed lend ##l retired after straining his left side while trailing 5 - 4 in the first set .

reference_raw: The fourth seed, Lendl, had retired after exerting his left side and was trailing 5-4 in the first set.

reference_spacy_tokens: The fourth seed , Lendl , had retired after exerting his left side and was trailing 5 - 4 in the first set .


fn_spacy_tokens_for_baseline: A bray of trumpets stilled the clamour , their shrill so angry the birds in the trees around Smithfield rose in noisy protesting flocks .

source_bert_toks: a bray of trumpets stilled the cl ##amo ##ur , their shrill so angry the birds in the trees around smith ##field rose in noisy protesting flock ##s .

reference_raw: The hoarse of trumpets stilled the clamor, and their screams were so angry that the birds in the trees around Smithfield rose in loud, protesting flocks.

reference_spacy_tokens: The hoarse of trumpets stilled the clamor , and their screams were so angry that the birds in the trees around Smithfield rose in loud , protesting flocks .


fn_spacy_tokens_for_baseline: The Old Bailey heard he then cut her up before taking parts of her body on the Underground system to be dumped outside a women 's refuge .

source_bert_toks: the old bailey heard he then cut her up before taking parts of her body on the underground system to be dumped outside a women ' s refuge .

reference_raw: The old Bailey heard that he'd then sliced her up before he'd taken parts of her body into the underground system to get dumped in front of the women's shelter.

reference_spacy_tokens: The old Bailey heard that he 'd then sliced her up before he 'd taken parts of her body into the underground system to get dumped in front of the women 's shelter .


fn_spacy_tokens_for_baseline: ' He did n't score many goals but he was brilliant at laying on the ball for others .

source_bert_toks: ' he didn ' t score many goals but he was brilliant at laying on the ball for others .

reference_raw: He didn't score a lot of goals, but he was great at laying on the ball for other people.

reference_spacy_tokens: He did n't score a lot of goals , but he was great at laying on the ball for other people .


fn_spacy_tokens_for_baseline: As he picked it up , the boy opened his eyes .

source_bert_toks: as he picked it up , the boy opened his eyes .

reference_raw: The boy's eyes widened as he picked it up.

reference_spacy_tokens: The boy 's eyes widened as he picked it up .


fn_spacy_tokens_for_baseline: Its purpose was to hear prisoners ' petitions for release .

source_bert_toks: its purpose was to hear prisoners ' petitions for release .

reference_raw: The purpose was to hear the prisoner's request for release.

reference_spacy_tokens: The purpose was to hear the prisoner 's request for release .


fn_spacy_tokens_for_baseline: Known as ' the little onion ' , this herb is best used raw in salad dressings , or added to dips and sauces , or to flavour savoury butter and egg dishes .

source_bert_toks: known as ' the little onion ' , this herb is best used raw in salad dressing ##s , or added to dip ##s and sauce ##s , or to flavour sa ##vo ##ury butter and egg dishes .

reference_raw: This herb, known as "small onion", is best used raw in salad dressings, or added to sauces and sauces, or to taste delicious butter and egg dishes.

reference_spacy_tokens: This herb , known as " small onion " , is best used raw in salad dressings , or added to sauces and sauces , or to taste delicious butter and egg dishes .


fn_spacy_tokens_for_baseline: He is still remembered with great affection within the Association and his widow , Lady Peck , continues a most welcome interest in the House .

source_bert_toks: he is still remembered with great affection within the association and his widow , lady peck , continues a most welcome interest in the house .

reference_raw: He is still remembered with great affection in the Association, and his wife, Lady Peck, continues to have a very welcome interest in the House.

reference_spacy_tokens: He is still remembered with great affection in the Association , and his wife , Lady Peck , continues to have a very welcome interest in the House .


fn_spacy_tokens_for_baseline: Poxed , disfigured scavengers scuttled across hillocks of debris which rained into this underworld from a low steel sky by way of chutes and grilles .

source_bert_toks: po ##xed , di ##sf ##ig ##ured sc ##ave ##nger ##s sc ##ut ##tled across hill ##ocks of debris which rained into this underworld from a low steel sky by way of chu ##tes and grille ##s .

reference_raw: Poxed, disfigured scavengers scuttled over the piles of rubble that rained down from the low steel sky through chutes and barbecues into the underworld.

reference_spacy_tokens: Poxed , disfigured scavengers scuttled over the piles of rubble that rained down from the low steel sky through chutes and barbecues into the underworld .


fn_spacy_tokens_for_baseline: Constitutionally , the President of the Assembly would assume the functions of the Croatian President should the latter be incapacitated .

source_bert_toks: constitutional ##ly , the president of the assembly would assume the functions of the croatian president should the latter be inca ##pac ##itated .

reference_raw: In constitutional terms, the President of the Assembly would take over the duties of the Croatian President if he were unable to act.

reference_spacy_tokens: In constitutional terms , the President of the Assembly would take over the duties of the Croatian President if he were unable to act .


fn_spacy_tokens_for_baseline: He knelt down in front of her stereo system .

source_bert_toks: he knelt down in front of her stereo system .

reference_raw: He dropped to his knees before her stereo system.

reference_spacy_tokens: He dropped to his knees before her stereo system .


fn_spacy_tokens_for_baseline: One advantage of such a site , however , is that samples of blood and urine that are required for analysis of rhythms are readily refrigerated so that deterioration is less of a problem than in other environments .

source_bert_toks: one advantage of such a site , however , is that samples of blood and urine that are required for analysis of rhythms are readily ref ##ri ##ger ##ated so that deterioration is less of a problem than in other environments .

reference_raw: However, one of the advantages of such a site is that the blood and urine samples required for rhythm analysis are easily cooled, so that deterioration is less problematic than in other environments.

reference_spacy_tokens: However , one of the advantages of such a site is that the blood and urine samples required for rhythm analysis are easily cooled , so that deterioration is less problematic than in other environments .


fn_spacy_tokens_for_baseline: The overt and crudest manifestations of Irish misogyny were our first target and we vented our rage and flexed our lesbian muscles in a myriad of dangerous and daring ways .

source_bert_toks: the over ##t and crude ##st manifestation ##s of irish mis ##ogy ##ny were our first target and we vent ##ed our rage and flexed our lesbian muscles in a myriad of dangerous and daring ways .

reference_raw: The obvious and most brutal manifestations of Irish misogyny were our first target, and we unleashed our anger and flexed our lesbian muscles in a myriad of dangerous and daring ways.

reference_spacy_tokens: The obvious and most brutal manifestations of Irish misogyny were our first target , and we unleashed our anger and flexed our lesbian muscles in a myriad of dangerous and daring ways .


fn_spacy_tokens_for_baseline: After reversing one move his feet slipped , followed rapidly by his hands , and a moment later he landed on top of me with a crash of flailing limbs and a clatter of runners .

source_bert_toks: after rev ##ers ##ing one move his feet slipped , followed rapidly by his hands , and a moment later he landed on top of me with a crash of fl ##ailing limbs and a cl ##atter of runners .

reference_raw: When he reversed one movement, his legs slipped, followed quickly by his hands, and a moment later he landed on me with a crash of flailing extremities and a crash of runners.

reference_spacy_tokens: When he reversed one movement , his legs slipped , followed quickly by his hands , and a moment later he landed on me with a crash of flailing extremities and a crash of runners .


fn_spacy_tokens_for_baseline: Nick looked across the room to where a fat man in jeans stood by the bar and ticked the side of his forehead like a taxi driver acknowledging a tip .

source_bert_toks: nick looked across the room to where a fat man in jeans stood by the bar and ticked the side of his forehead like a taxi driver acknowledging a tip .

reference_raw: Nick glanced across the room to where the fat man in the jeans was at the bar, ticking the side of his forehead like a taxi driver with a tip.

reference_spacy_tokens: Nick glanced across the room to where the fat man in the jeans was at the bar , ticking the side of his forehead like a taxi driver with a tip .


fn_spacy_tokens_for_baseline: The maximum amount for a protected deposit was increased to £ 20,000 .

source_bert_toks: the maximum amount for a protected deposit was increased to £2 ##0 , 000 .

reference_raw: The highest amount of the protected deposit has been increased to £20,000.

reference_spacy_tokens: The highest amount of the protected deposit has been increased to £ 20,000 .


fn_spacy_tokens_for_baseline: On Sunday , at least 24 people died and dozens were hurt when a suicide bomber targeted a police patrol in a crowded marketplace in Oruzgan province , local officials said .

source_bert_toks: on sunday , at least 24 people died and dozens were hurt when a suicide bomber targeted a police patrol in a crowded marketplace in or ##uz ##gan province , local officials said .

reference_raw: At least 24 people had died on Sunday, and dozens had been injured when a suicide bomber had targeted a police guard in a crowded market in Oruzgan Province, the local officials said.

reference_spacy_tokens: At least 24 people had died on Sunday , and dozens had been injured when a suicide bomber had targeted a police guard in a crowded market in Oruzgan Province , the local officials said .


fn_spacy_tokens_for_baseline: ENGLAND manager Graham Taylor baffled fans with his team selections and tactical changes in last summer 's European Championship in Sweden .

source_bert_toks: england manager graham taylor baffled fans with his team selections and tactical changes in last summer ' s european championship in sweden .

reference_raw: ENGLAND Manager Graham Taylor confused fans with team selection and tactical changes at the Swedish European Championships last summer.

reference_spacy_tokens: ENGLAND Manager Graham Taylor confused fans with team selection and tactical changes at the Swedish European Championships last summer .


fn_spacy_tokens_for_baseline: The budget set by the council would mean an increase from £ 309.34 to £ 353 a rise of 14pc .

source_bert_toks: the budget set by the council would mean an increase from £3 ##0 ##9 . 34 to £3 ##53 a rise of 14 ##pc .

reference_raw: The budget set by the Council would mean a raise of 14 percentage points from £309.34 to £353.

reference_spacy_tokens: The budget set by the Council would mean a raise of 14 percentage points from £ 309.34 to £ 353 .


fn_spacy_tokens_for_baseline: The sounds enraged Sonny ; his face turned red with temper .

source_bert_toks: the sounds enraged sonny ; his face turned red with temper .

reference_raw: Sonny was angry at the sounds; his face was flushed with temper.

reference_spacy_tokens: Sonny was angry at the sounds ; his face was flushed with temper .


fn_spacy_tokens_for_baseline: Coventry nodded and opened a tin of biscuits .

source_bert_toks: coventry nodded and opened a tin of biscuits .

reference_raw: Coventry nodded and opened the can of cookies.

reference_spacy_tokens: Coventry nodded and opened the can of cookies .


fn_spacy_tokens_for_baseline: Following his instruction , his party hastened to the windows .

source_bert_toks: following his instruction , his party haste ##ned to the windows .

reference_raw: His party hurried to the windows after his instructions.

reference_spacy_tokens: His party hurried to the windows after his instructions .


fn_spacy_tokens_for_baseline: She sat on the chair by the window and gazed out at the wide lawns edged by chestnut trees .

source_bert_toks: she sat on the chair by the window and gazed out at the wide lawn ##s edged by chestnut trees .

reference_raw: She sat in a chair by the window and looked out at the broad lawns bordered by the chestnut trees.

reference_spacy_tokens: She sat in a chair by the window and looked out at the broad lawns bordered by the chestnut trees .


fn_spacy_tokens_for_baseline: Not to be missed is a visit to Guangzhou 's famous open - air market , Qing Ping .

source_bert_toks: not to be missed is a visit to guangzhou ' s famous open - air market , qing ping .

reference_raw: It's not to be missed. It's to see the famous open air market in Guangzhou, Qing Ping.

reference_spacy_tokens: It 's not to be missed . It 's to see the famous open air market in Guangzhou , Qing Ping .


fn_spacy_tokens_for_baseline: Once again a distinction must be made between an ' odorant ' defined earlier as ' any chemical compound which stimulates the olfactory sense ' and an ' odour ' being a sensation of smell .

source_bert_toks: once again a distinction must be made between an ' odor ##ant ' defined earlier as ' any chemical compound which stimulate ##s the ol ##factory sense ' and an ' o ##dou ##r ' being a sensation of smell .

reference_raw: Once again, it is necessary to distinguish between the 'odorant' described previously as 'any chemical compound that stimulates the sense of smell' and the 'odour' is a sense of smell.

reference_spacy_tokens: Once again , it is necessary to distinguish between the ' odorant ' described previously as ' any chemical compound that stimulates the sense of smell ' and the ' odour ' is a sense of smell .


fn_spacy_tokens_for_baseline: The public perceived enormous Conservative stress on defence in the Pre - Campaign Wave and again in the latter half of the campaign , but much less in the first half of the campaign .

source_bert_toks: the public perceived enormous conservative stress on defence in the pre - campaign wave and again in the latter half of the campaign , but much less in the first half of the campaign .

reference_raw: In the pre-campaign wave, and again in the second half of the campaign, the public felt enormous conservative pressure on defense, but much less in the first half of the campaign.

reference_spacy_tokens: In the pre - campaign wave , and again in the second half of the campaign , the public felt enormous conservative pressure on defense , but much less in the first half of the campaign .


fn_spacy_tokens_for_baseline: No point in riling Mrs Hollins any further .

source_bert_toks: no point in ri ##ling mrs ho ##llins any further .

reference_raw: There's no point in rising Mrs. Hollins anymore.

reference_spacy_tokens: There 's no point in rising Mrs. Hollins anymore .


fn_spacy_tokens_for_baseline: When the rain had stopped completely Kali joined the flow of women making their way towards the stream to refill their water containers .

source_bert_toks: when the rain had stopped completely kali joined the flow of women making their way towards the stream to ref ##ill their water containers .

reference_raw: When the rain had stopped altogether, Kali joined the stream of women who had made their way to the stream to refill their water tanks.

reference_spacy_tokens: When the rain had stopped altogether , Kali joined the stream of women who had made their way to the stream to refill their water tanks .


fn_spacy_tokens_for_baseline: Greece wildfires force thousands to evacuate

source_bert_toks: greece wild ##fires force thousands to evacuate

reference_raw: Greece's wildfires compel thousands of people to evacuate

reference_spacy_tokens: Greece 's wildfires compel thousands of people to evacuate


fn_spacy_tokens_for_baseline: Iran is often accused in Western circles of secretly developing an offensive biological warfare ( BW ) program .

source_bert_toks: iran is often accused in western circles of secretly developing an offensive biological warfare ( b ##w ) program .

reference_raw: Iran is often blamed in Western circles for the secret development of an offensive biological war program.

reference_spacy_tokens: Iran is often blamed in Western circles for the secret development of an offensive biological war program .


fn_spacy_tokens_for_baseline: In any case , wings which could have lifted that huge body would have been far too cumbersome when diving .

source_bert_toks: in any case , wings which could have lifted that huge body would have been far too cum ##bers ##ome when diving .

reference_raw: In any event, the wings that could lift the huge body would be too cumbersome to sink.

reference_spacy_tokens: In any event , the wings that could lift the huge body would be too cumbersome to sink .


fn_spacy_tokens_for_baseline: Our neighbours , with whom we drank Metaxa and broke plates most evenings , thought they were trying to discourage tourists from venturing into the mountains because of the risk .

source_bert_toks: our neighbours , with whom we drank meta ##xa and broke plates most evenings , thought they were trying to discourage tourists from vent ##uring into the mountains because of the risk .

reference_raw: Our neighbors, who used to drink Metaxa and break plates most nights, thought they were trying to keep tourists from venturing into the mountains because of the risk.

reference_spacy_tokens: Our neighbors , who used to drink Metaxa and break plates most nights , thought they were trying to keep tourists from venturing into the mountains because of the risk .


fn_spacy_tokens_for_baseline: The sun left a red stain behind as it retreated below the horizon .

source_bert_toks: the sun left a red stain behind as it retreated below the horizon .

reference_raw: The sun had left a red spot behind as it receded beneath the horizon.

reference_spacy_tokens: The sun had left a red spot behind as it receded beneath the horizon .


fn_spacy_tokens_for_baseline: One of the circumstances constituting this offence is where the penis penetrate the anus of a male or a female , and the maximum penalty is life imprisonment .

source_bert_toks: one of the circumstances con ##stituting this offence is where the penis penetrate the an ##us of a male or a female , and the maximum penalty is life imprisonment .

reference_raw: One of the circumstances constituting the offence is when the penis enters a man's or a woman's arse and the maximum sentence is life imprisonment.

reference_spacy_tokens: One of the circumstances constituting the offence is when the penis enters a man 's or a woman 's arse and the maximum sentence is life imprisonment .


fn_spacy_tokens_for_baseline: A six - day chartered trip , sailing around the rugged western Scottish Isles of Skye , Mull , Isla and Jura , costs £ 385 per person ( waterproof hire is extra ) .

source_bert_toks: a six - day chartered trip , sailing around the rugged western scottish isles of skye , mu ##ll , isla and ju ##ra , costs £3 ##85 per person ( water ##proof hire is extra ) .

reference_raw: A six-day charter cruise, sailing around the rugged western islands of Skye, Mull, Isla and Jura, costs £385 per person (the watertight rent is extra).

reference_spacy_tokens: A six - day charter cruise , sailing around the rugged western islands of Skye , Mull , Isla and Jura , costs £ 385 per person ( the watertight rent is extra ) .


fn_spacy_tokens_for_baseline: The railway line then curves gracefully around Tolo Harbor , an idyllic body of water well - protected from the open sea .

source_bert_toks: the railway line then curves gracefully around to ##lo harbor , an id ##yl ##lic body of water well - protected from the open sea .

reference_raw: The railway line then curves gracefully around the port of Tolo, an idyllic body of water well protected from the open sea.

reference_spacy_tokens: The railway line then curves gracefully around the port of Tolo , an idyllic body of water well protected from the open sea .


fn_spacy_tokens_for_baseline: In their tomb portrayals the deceased are always seen as young and fit , the image of eternal youth .

source_bert_toks: in their tomb portrayal ##s the deceased are always seen as young and fit , the image of eternal youth .

reference_raw: In their grave portraits, the dead are always seen as young and fit, as an image of eternity's youth.

reference_spacy_tokens: In their grave portraits , the dead are always seen as young and fit , as an image of eternity 's youth .


fn_spacy_tokens_for_baseline: Several hours passed while he sat there , knowing that Maud would be inconsolable at having missed a charity dinner .

source_bert_toks: several hours passed while he sat there , knowing that maud would be inc ##ons ##ola ##ble at having missed a charity dinner .

reference_raw: As he sat there, several hours passed, knowing that Maud would be inconvenient to miss a charity dinner.

reference_spacy_tokens: As he sat there , several hours passed , knowing that Maud would be inconvenient to miss a charity dinner .


fn_spacy_tokens_for_baseline: His mastiff jaw jutted .

source_bert_toks: his mast ##iff jaw ju ##tted .

reference_raw: His mastiff-jaw protruded.

reference_spacy_tokens: His mastiff - jaw protruded .


fn_spacy_tokens_for_baseline: Which was why he dipped the second piece of fried bread carefully in the egg and turned it about , concentrating on making it yellow all over .

source_bert_toks: which was why he dipped the second piece of fried bread carefully in the egg and turned it about , concentrating on making it yellow all over .

reference_raw: So he carefully soaked the second piece of fried bread into the egg and turned it around, concentrating on making it yellow again.

reference_spacy_tokens: So he carefully soaked the second piece of fried bread into the egg and turned it around , concentrating on making it yellow again .


fn_spacy_tokens_for_baseline: If you ca n't get your own way or what you want by openly and honestly asking for it , do n't use sly or surreptitious methods because they could backfire and land you in the soup .

source_bert_toks: if you can ' t get your own way or what you want by openly and honestly asking for it , don ' t use sly or sur ##re ##pt ##iti ##ous methods because they could back ##fire and land you in the soup .

reference_raw: If you can't get your way or what you want by asking for it openly and honestly, don't use tricky or stealthy methods, because they can backfire and put you in the soup.

reference_spacy_tokens: If you ca n't get your way or what you want by asking for it openly and honestly , do n't use tricky or stealthy methods , because they can backfire and put you in the soup .


fn_spacy_tokens_for_baseline: A large forest fire that started on Monday , June 9 is still out of control in the municipality of Froland in southern Norway .

source_bert_toks: a large forest fire that started on monday , june 9 is still out of control in the municipality of fr ##ola ##nd in southern norway .

reference_raw: The big forest fire that started on Monday, June 9th is still out of control in the town of Froland in southern Norway.

reference_spacy_tokens: The big forest fire that started on Monday , June 9th is still out of control in the town of Froland in southern Norway .


fn_spacy_tokens_for_baseline: ' It upsets me when I think of how they think . '

source_bert_toks: ' it upset ##s me when i think of how they think . '

reference_raw: "I'm mad when I think about what they're thinking."

reference_spacy_tokens: " I 'm mad when I think about what they 're thinking . "


fn_spacy_tokens_for_baseline: It will also design instrumentation for investigating the problems of man in hazardous environments and develop apparatus for use in biological research in space .

source_bert_toks: it will also design instrumentation for investigating the problems of man in hazardous environments and develop apparatus for use in biological research in space .

reference_raw: It will also develop tools to investigate human problems in dangerous environments and develop equipment for use in biological research in space.

reference_spacy_tokens: It will also develop tools to investigate human problems in dangerous environments and develop equipment for use in biological research in space .


fn_spacy_tokens_for_baseline: It certainly brought a chuckle from my lips .

source_bert_toks: it certainly brought a chuckle from my lips .

reference_raw: I'm sure it brought a laugh out of my mouth.

reference_spacy_tokens: I 'm sure it brought a laugh out of my mouth .


fn_spacy_tokens_for_baseline: In 1990 Alvarez was abducted from his home in Guadalajara by bounty hunters and smuggled into the USA where he was delivered to the DEA .

source_bert_toks: in 1990 alvarez was abducted from his home in guadalajara by bounty hunters and smug ##gled into the usa where he was delivered to the dea .

reference_raw: In 1990, Alvarez was kidnapped from his home in Guadalajara by bounty hunters and smuggled into the United States to deliver him to the DEA.

reference_spacy_tokens: In 1990 , Alvarez was kidnapped from his home in Guadalajara by bounty hunters and smuggled into the United States to deliver him to the DEA .


fn_spacy_tokens_for_baseline: They had brought a modest decline in the face of extreme boom conditions , but no collapse .

source_bert_toks: they had brought a modest decline in the face of extreme boom conditions , but no collapse .

reference_raw: In the face of extreme boom conditions, they led to a slight decline, but no collapse.

reference_spacy_tokens: In the face of extreme boom conditions , they led to a slight decline , but no collapse .


fn_spacy_tokens_for_baseline: Viewpoint : Lawson suffers for Thatcher 's hatred of EMS

source_bert_toks: viewpoint : lawson suffers for thatcher ' s hatred of ems

reference_raw: Viewpoint: Lawson suffers because Thatcher hates the EMS.

reference_spacy_tokens: Viewpoint : Lawson suffers because Thatcher hates the EMS .


fn_spacy_tokens_for_baseline: We would thus , no doubt , be much puzzled by the occasional glimpse of the great metropolises , particularly since only the towering edifices of their tourist attractions were usually portrayed .

source_bert_toks: we would thus , no doubt , be much puzzled by the occasional glimpse of the great metropolis ##es , particularly since only the towering ed ##ifice ##s of their tourist attractions were usually portrayed .

reference_raw: The occasional glimpse of the great metropolises would no doubt confuse us, especially since only the towering edifices of their tourist attractions were usually depicted.

reference_spacy_tokens: The occasional glimpse of the great metropolises would no doubt confuse us , especially since only the towering edifices of their tourist attractions were usually depicted .


fn_spacy_tokens_for_baseline: Alexei constructed a suitable reply , then discarded it in favour of plain truth .

source_bert_toks: alexei constructed a suitable reply , then discarded it in favour of plain truth .

reference_raw: Alexei made an appropriate answer, then rejected it for the simple truth.

reference_spacy_tokens: Alexei made an appropriate answer , then rejected it for the simple truth .


fn_spacy_tokens_for_baseline: Yet , looking into those liquid dark eyes , Fran could n't help the sudden feeling that she was standing on the verge of something so mind - blowing that it made her afraid .

source_bert_toks: yet , looking into those liquid dark eyes , fran couldn ' t help the sudden feeling that she was standing on the verge of something so mind - blowing that it made her afraid .

reference_raw: But when Fran looked into those liquid, dark eyes, she could not escape the sudden feeling that she was on the verge of something so mind-blowing that she was afraid.

reference_spacy_tokens: But when Fran looked into those liquid , dark eyes , she could not escape the sudden feeling that she was on the verge of something so mind - blowing that she was afraid .


fn_spacy_tokens_for_baseline: Only modification to the aircraft was the fitting to two extra fuel tanks totalling 40 gallons .

source_bert_toks: only modification to the aircraft was the fitting to two extra fuel tanks total ##ling 40 gallons .

reference_raw: The only modification of the aircraft was the installation of two additional fuel tanks of 40 gallons.

reference_spacy_tokens: The only modification of the aircraft was the installation of two additional fuel tanks of 40 gallons .


fn_spacy_tokens_for_baseline: It was past midnight and we shivered through to dawn in guilty contemplation of our good fortune .

source_bert_toks: it was past midnight and we shivered through to dawn in guilty con ##tem ##pl ##ation of our good fortune .

reference_raw: It was after midnight, and we shuddered into the dawn, thinking guiltyly of our happiness.

reference_spacy_tokens: It was after midnight , and we shuddered into the dawn , thinking guiltyly of our happiness .


fn_spacy_tokens_for_baseline: I wonder how many climbers today empathise with my reasons for climbing ?

source_bert_toks: i wonder how many climb ##ers today em ##path ##ise with my reasons for climbing ?

reference_raw: How many climbers are empathizing with my reasons for climbing today?

reference_spacy_tokens: How many climbers are empathizing with my reasons for climbing today ?


fn_spacy_tokens_for_baseline: The human crabs scuttled clear of its feelers .

source_bert_toks: the human crabs sc ##ut ##tled clear of its feel ##ers .

reference_raw: Human crabs scuttled away from their feelings.

reference_spacy_tokens: Human crabs scuttled away from their feelings .


fn_spacy_tokens_for_baseline: ' My wife has informed me that the two boys who attacked you stole your handbag . '

source_bert_toks: ' my wife has informed me that the two boys who attacked you stole your hand ##bag . '

reference_raw: "My wife told me that the two boys who attacked you stole your purse."

reference_spacy_tokens: " My wife told me that the two boys who attacked you stole your purse . "


fn_spacy_tokens_for_baseline: Debbie had spent the evening snorting cocaine and drinking , say police .

source_bert_toks: debbie had spent the evening snort ##ing cocaine and drinking , say police .

reference_raw: Debbie spent the night sniffing cocaine and drinking, let's say, the police.

reference_spacy_tokens: Debbie spent the night sniffing cocaine and drinking , let 's say , the police .


fn_spacy_tokens_for_baseline: The goal was to produce both reverse - engineered and extended - range variants of the R-17E known as the Hwasong-5 and the Hwasong-6 , respectively .

source_bert_toks: the goal was to produce both reverse - engineered and extended - range variants of the r - 17 ##e known as the h ##was ##ong - 5 and the h ##was ##ong - 6 , respectively .

reference_raw: The goal was to produce both reverse-engineered and extended-range R-17E variants called Hwasong-5 and Hwasong-6.

reference_spacy_tokens: The goal was to produce both reverse - engineered and extended - range R-17E variants called Hwasong-5 and Hwasong-6 .


fn_spacy_tokens_for_baseline: His eyes were so far out of his head that he looked like a startled grasshopper .

source_bert_toks: his eyes were so far out of his head that he looked like a startled grass ##hopper .

reference_raw: His eyes were so far from his head that he looked like a frightened locust.

reference_spacy_tokens: His eyes were so far from his head that he looked like a frightened locust .


fn_spacy_tokens_for_baseline: Malcolm Watters , senior careers tutor , careers , said : ' There is considerable local and national concern about the drop in number of students applying to study physics at advanced level in sixth form colleges .

source_bert_toks: malcolm watt ##ers , senior careers tutor , careers , said : ' there is considerable local and national concern about the drop in number of students applying to study physics at advanced level in sixth form colleges .

reference_raw: Malcolm Watters, a senior career teacher, and a career, said, "There is a strong local and national concern about the decline in the number of students applying for advanced-level physics in sixth-form universities.

reference_spacy_tokens: Malcolm Watters , a senior career teacher , and a career , said , " There is a strong local and national concern about the decline in the number of students applying for advanced - level physics in sixth - form universities .


fn_spacy_tokens_for_baseline: All the entries can then be perused at leisure in a popular year - long exhibition in the foyer of the Ark Restaurant .

source_bert_toks: all the entries can then be peru ##sed at leisure in a popular year - long exhibition in the foyer of the ark restaurant .

reference_raw: In a popular year-long exhibition in the lobby of the Ark Restaurant, all the items can be used for leisure.

reference_spacy_tokens: In a popular year - long exhibition in the lobby of the Ark Restaurant , all the items can be used for leisure .


fn_spacy_tokens_for_baseline: He quickly , efficiently , made coffee .

source_bert_toks: he quickly , efficiently , made coffee .

reference_raw: Quickly, efficiently, he made a cup of tea.

reference_spacy_tokens: Quickly , efficiently , he made a cup of tea .


fn_spacy_tokens_for_baseline: The meeting had been called in an effort to heal the renewed rift between the two Presidents resulting from the October retreat by the central administration from radical economic reform .

source_bert_toks: the meeting had been called in an effort to heal the renewed rift between the two presidents resulting from the october retreat by the central administration from radical economic reform .

reference_raw: The meeting was convened in an effort to remedy the renewed rift between the two presidents as a result of the October withdrawal of the central government from radical economic reform.

reference_spacy_tokens: The meeting was convened in an effort to remedy the renewed rift between the two presidents as a result of the October withdrawal of the central government from radical economic reform .


fn_spacy_tokens_for_baseline: " I live in hopes that the ringers themselves will be drawn into that fuller life .

source_bert_toks: " i live in hopes that the ring ##ers themselves will be drawn into that fuller life .

reference_raw: "I live in the hope of attracting the ringers themselves to this fuller life."

reference_spacy_tokens: " I live in the hope of attracting the ringers themselves to this fuller life . "


fn_spacy_tokens_for_baseline: Helen Mirren as DCI Tennison in the gripping TV thriller , Prime Suspect .

source_bert_toks: helen mir ##ren as dc ##i tennis ##on in the gripping tv thriller , prime suspect .

reference_raw: Helen Mirren as Detective Tennison in the clutching TV thriller, prime suspect.

reference_spacy_tokens: Helen Mirren as Detective Tennison in the clutching TV thriller , prime suspect .


fn_spacy_tokens_for_baseline: The old lane was in use down to comparatively recent times as a through road from Northampton to Banbury .

source_bert_toks: the old lane was in use down to comparatively recent times as a through road from northampton to ban ##bury .

reference_raw: The old lane had been used down a relatively recent route from Northampton to Banbury.

reference_spacy_tokens: The old lane had been used down a relatively recent route from Northampton to Banbury .


fn_spacy_tokens_for_baseline: Lining the walls from floor to ceiling and rising up from the centre of the room were pigeon - holes , grids of boxes made from varnished plywood .

source_bert_toks: lining the walls from floor to ceiling and rising up from the centre of the room were pigeon - holes , grid ##s of boxes made from var ##nished pl ##ywood .

reference_raw: Lining the walls from floor to ceiling and rising from the center of the room were pigeonholes, grids of boxes made of painted plywood.

reference_spacy_tokens: Lining the walls from floor to ceiling and rising from the center of the room were pigeonholes , grids of boxes made of painted plywood .


fn_spacy_tokens_for_baseline: SARHWU claimed that 500 - 800 of its members were attacked by 1,000 strike - breaking vigilantes as they disembarked from trains at Germiston .

source_bert_toks: sar ##h ##wu claimed that 500 - 800 of its members were attacked by 1 , 000 strike - breaking vi ##gil ##antes as they di ##se ##mba ##rked from trains at ge ##rmi ##ston .

reference_raw: SARHWU claimed that 500-800 of its members had been attacked by a thousand strike guards as they dismounted from the trains in Germiston.

reference_spacy_tokens: SARHWU claimed that 500 - 800 of its members had been attacked by a thousand strike guards as they dismounted from the trains in Germiston .


fn_spacy_tokens_for_baseline: After the fatherhood revelations he threw out his wife and child and became violent and aggressive .

source_bert_toks: after the father ##hood revelations he threw out his wife and child and became violent and aggressive .

reference_raw: After the discovery of paternity, he fired his wife and child and became violent and aggressive.

reference_spacy_tokens: After the discovery of paternity , he fired his wife and child and became violent and aggressive .


fn_spacy_tokens_for_baseline: Paul - Marie had un - English shorts , long white socks , olive - brown legs .

source_bert_toks: paul - marie had un - english shorts , long white socks , olive - brown legs .

reference_raw: Paul-Marie was wearing non-English stockings, long white socks, and olive-brown feet.

reference_spacy_tokens: Paul - Marie was wearing non - English stockings , long white socks , and olive - brown feet .


fn_spacy_tokens_for_baseline: She took a step towards him .

source_bert_toks: she took a step towards him .

reference_raw: She moved toward him.

reference_spacy_tokens: She moved toward him .


fn_spacy_tokens_for_baseline: The ragged edges of the hole glinted sharply , and Jesus knew that any failed attempt to enter the Lift would be likely to result in his being sliced to ribbons within a matter of seconds .

source_bert_toks: the ragged edges of the hole glint ##ed sharply , and jesus knew that any failed attempt to enter the lift would be likely to result in his being sliced to ribbons within a matter of seconds .

reference_raw: The ragged edges of the hole glittered sharply, and Jesus knew that any failed attempt to enter the Rift would probably lead to him being sliced into ribbons in a matter of seconds.

reference_spacy_tokens: The ragged edges of the hole glittered sharply , and Jesus knew that any failed attempt to enter the Rift would probably lead to him being sliced into ribbons in a matter of seconds .


fn_spacy_tokens_for_baseline: These are long , flexible curlers that are heated in a plug - in carrying wallet and can be used on dry hair for all - over curly styles .

source_bert_toks: these are long , flexible curl ##ers that are heated in a plug - in carrying wallet and can be used on dry hair for all - over curly styles .

reference_raw: These are long, flexible curlers, which are heated in a plug-in carrying a wallet and can be used on dry fur for all-curly styles.

reference_spacy_tokens: These are long , flexible curlers , which are heated in a plug - in carrying a wallet and can be used on dry fur for all - curly styles .


fn_spacy_tokens_for_baseline: He laughed out loud and threw up both his arms in triumph .

source_bert_toks: he laughed out loud and threw up both his arms in triumph .

reference_raw: He laughed aloud and spread both hands triumphantly.

reference_spacy_tokens: He laughed aloud and spread both hands triumphantly .


fn_spacy_tokens_for_baseline: And once they were christened , as we might expect , the ' Hooligans ' were understood as an entirely unprecedented and ' un - British ' phenomenon : indeed , we must allow that it was most ingenious of late Victorian England to disown the British Hooligan by giving him an ' Irish ' name .

source_bert_toks: and once they were christ ##ened , as we might expect , the ' ho ##oli ##gan ##s ' were understood as an entirely unprecedented and ' un - british ' phenomenon : indeed , we must allow that it was most ing ##eni ##ous of late victorian england to di ##so ##wn the british ho ##oli ##gan by giving him an ' irish ' name .

reference_raw: And when they were baptized, as we might have expected, the Hooligans were understood to be an unprecedented and un-British phenomenon: indeed, we must allow the most brilliant of late Victorian England to disown the British Hooligan by giving him an Irish name.

reference_spacy_tokens: And when they were baptized , as we might have expected , the Hooligans were understood to be an unprecedented and un - British phenomenon : indeed , we must allow the most brilliant of late Victorian England to disown the British Hooligan by giving him an Irish name .


fn_spacy_tokens_for_baseline: Mrs Bird managed to lobby the chairman about their case .

source_bert_toks: mrs bird managed to lobby the chairman about their case .

reference_raw: Mrs. Bird was able to talk to the Chairman about their case.

reference_spacy_tokens: Mrs. Bird was able to talk to the Chairman about their case .


fn_spacy_tokens_for_baseline: You will notice that there is , in the wording of that letter , something curious .

source_bert_toks: you will notice that there is , in the word ##ing of that letter , something curious .

reference_raw: Note that there is something curious about the wording of this letter.

reference_spacy_tokens: Note that there is something curious about the wording of this letter .


fn_spacy_tokens_for_baseline: These personal responses to discussions of parental figures should be recognised by social workers in preparation for working in this area .

source_bert_toks: these personal responses to discussions of parental figures should be recognised by social workers in preparation for working in this area .

reference_raw: These personal reactions to the discussion of parental data should be recognised by social workers when preparing for work in this field.

reference_spacy_tokens: These personal reactions to the discussion of parental data should be recognised by social workers when preparing for work in this field .


fn_spacy_tokens_for_baseline: Karr 's hunch had been right .

source_bert_toks: ka ##rr ' s hu ##nch had been right .

reference_raw: Karr's premonition was correct.

reference_spacy_tokens: Karr 's premonition was correct .


fn_spacy_tokens_for_baseline: Safely buried , Osiris now arose from the grave to train his son Horus for the punishment of Seth .

source_bert_toks: safely buried , os ##iri ##s now arose from the grave to train his son ho ##rus for the punishment of seth .

reference_raw: Safely buried, Osiris rose from his grave to train his son Horus to punish Seth.

reference_spacy_tokens: Safely buried , Osiris rose from his grave to train his son Horus to punish Seth .


fn_spacy_tokens_for_baseline: It took some time and hard work , but with the help of Goodwill , Jerry was able to work out a payment plan with the prosecutor 's office , find housing and conduct a more thorough job search .

source_bert_toks: it took some time and hard work , but with the help of goodwill , jerry was able to work out a payment plan with the prosecutor ' s office , find housing and conduct a more thorough job search .

reference_raw: It took some time and a lot of work, but with the help of Goodwill, Jerry was able to work out a payment plan with the D.A.'s office, get a place to live, and do a more thorough job search.

reference_spacy_tokens: It took some time and a lot of work , but with the help of Goodwill , Jerry was able to work out a payment plan with the D.A. 's office , get a place to live , and do a more thorough job search .


fn_spacy_tokens_for_baseline: It sheared through bone and muscle alike , the strident snapping of the femur reverberating inside the room .

source_bert_toks: it shear ##ed through bone and muscle alike , the stride ##nt snapping of the fe ##mur rev ##er ##ber ##ating inside the room .

reference_raw: It scissored through bone and muscle, and the strong snap of the femur echoed in the room.

reference_spacy_tokens: It scissored through bone and muscle , and the strong snap of the femur echoed in the room .


fn_spacy_tokens_for_baseline: The opposition was led by a retired Admiral who complained that the tower would obscure the view from his house .

source_bert_toks: the opposition was led by a retired admiral who complained that the tower would obscure the view from his house .

reference_raw: The opposition was led by a retired admiral who complained that the tower would conceal the view from his home.

reference_spacy_tokens: The opposition was led by a retired admiral who complained that the tower would conceal the view from his home .


fn_spacy_tokens_for_baseline: Li made the statement during trilateral talks between delegations from the United States , China , and North Korea .

source_bert_toks: li made the statement during tri ##lateral talks between delegation ##s from the united states , china , and north korea .

reference_raw: Li made a statement during trilateral negotiations between U.S., China, and North Korea delegations.

reference_spacy_tokens: Li made a statement during trilateral negotiations between U.S. , China , and North Korea delegations .


fn_spacy_tokens_for_baseline: A quantity of food and a baby sterilizer unit were taken from a house in Hammond Drive , Darlington , on Saturday .

source_bert_toks: a quantity of food and a baby ste ##ril ##izer unit were taken from a house in hammond drive , darlington , on saturday .

reference_raw: On Saturday, a lot of food and a baby sterilizer unit were taken from a house in Hammond Drive, Darlington.

reference_spacy_tokens: On Saturday , a lot of food and a baby sterilizer unit were taken from a house in Hammond Drive , Darlington .


fn_spacy_tokens_for_baseline: Many of the differences identified predate the emergence of any specific schizophrenic symptoms .

source_bert_toks: many of the differences identified pre ##date the emergence of any specific sc ##hi ##zo ##ph ##ren ##ic symptoms .

reference_raw: Many of the differences identified preceded the emergence of any specific schizophrenic symptoms.

reference_spacy_tokens: Many of the differences identified preceded the emergence of any specific schizophrenic symptoms .


fn_spacy_tokens_for_baseline: No , what struck Jacob as oppressively squalid was the subject matter he was forced to contemplate week after week : fleeting , age - inappropriate sexual liaisons in the Oval Office ; the seep of money into every cranny of the political system ; Trent Lott ; Newt Gingrich .

source_bert_toks: no , what struck jacob as oppressive ##ly sq ##ual ##id was the subject matter he was forced to con ##tem ##plate week after week : fleeting , age - inappropriate sexual liaison ##s in the oval office ; the see ##p of money into every cr ##ann ##y of the political system ; trent lot ##t ; newt gin ##gr ##ich .

reference_raw: No, what Jacob found oppressive was a subject he had to think about week after week: elusive, age-inappropriate sexual contacts in the Oval Office; money spilling into all the crannies of the political system; Trent Lott; Newt Gingrich.

reference_spacy_tokens: No , what Jacob found oppressive was a subject he had to think about week after week : elusive , age - inappropriate sexual contacts in the Oval Office ; money spilling into all the crannies of the political system ; Trent Lott ; Newt Gingrich .


fn_spacy_tokens_for_baseline: They had retained a firm conviction , despite the talk about the ' social gospel ' , of the need for personal salvation through individual conversion , a belief which accorded with the century 's emphasis on individualism .

source_bert_toks: they had retained a firm conviction , despite the talk about the ' social gospel ' , of the need for personal salvation through individual conversion , a belief which accord ##ed with the century ' s emphasis on individual ##ism .

reference_raw: Despite the "social gospel" talk, they maintained a firm belief that personal salvation was needed by individual transformation, a belief that was consistent with the century's emphasis on individualism.

reference_spacy_tokens: Despite the " social gospel " talk , they maintained a firm belief that personal salvation was needed by individual transformation , a belief that was consistent with the century 's emphasis on individualism .


fn_spacy_tokens_for_baseline: Equally , at the other extreme , we reject the belief that any notion of correct or incorrect use of language is an affront to personal liberty .

source_bert_toks: equally , at the other extreme , we reject the belief that any notion of correct or incorrect use of language is an af ##front to personal liberty .

reference_raw: Similarly, on the other hand, we reject the belief that any concept of correct or incorrect use of language is an insult to personal freedom.

reference_spacy_tokens: Similarly , on the other hand , we reject the belief that any concept of correct or incorrect use of language is an insult to personal freedom .


fn_spacy_tokens_for_baseline: We smoke a joint in my car .

source_bert_toks: we smoke a joint in my car .

reference_raw: We're having a joint in my car.

reference_spacy_tokens: We 're having a joint in my car .


fn_spacy_tokens_for_baseline: The voice startled her out of her reverie and she turned to see Candy in the doorway , her pert features anxious .

source_bert_toks: the voice startled her out of her rev ##erie and she turned to see candy in the doorway , her per ##t features anxious .

reference_raw: The voice frightened her from her reverie, and she turned to see Candy in the doorway, her pert features anxious.

reference_spacy_tokens: The voice frightened her from her reverie , and she turned to see Candy in the doorway , her pert features anxious .