fn_spacy_tokens_for_baseline: Her head - dress was old - fashioned , two veils of pleated lawn falling down either side of her heart - shaped face and fastened under the chin by a bejewelled gorget .

source_bert_toks: her head - dress was old - fashioned , two veil ##s of plea ##ted lawn falling down either side of her heart - shaped face and fastened under the chin by a be ##je ##well ##ed gorge ##t .

reference_raw: Her headdress was old-fashioned, and two veils of pleated grass fell on either side of her heart-shaped face, and she was fastened under her chin by a jeweled gorge.

reference_spacy_tokens: Her headdress was old - fashioned , and two veils of pleated grass fell on either side of her heart - shaped face , and she was fastened under her chin by a jeweled gorge .


fn_spacy_tokens_for_baseline: The lamps , at a total cost of £ 4,000 , were installed by Grampian Regional Council after talks with local police .

source_bert_toks: the lamps , at a total cost of £ ##4 , 000 , were installed by gram ##pia ##n regional council after talks with local police .

reference_raw: The lamps, for a total cost of £4,000, were set up by the Grampian Regional Council after interviews with the local police.

reference_spacy_tokens: The lamps , for a total cost of £ 4,000 , were set up by the Grampian Regional Council after interviews with the local police .


fn_spacy_tokens_for_baseline: Two main factories located in the cities of Kanggye and Sakchu are reportedly tasked with the final preparation , filling , and distribution of CW agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

source_bert_toks: two main factories located in the cities of kang ##gy ##e and sa ##k ##chu are reportedly tasked with the final preparation , filling , and distribution of cw agents in artillery shells from 80 mm and larger , as well as 240 mm caliber artillery rockets .

reference_raw: Two major plants located in Kanggye and Sakchu are said to be responsible for the final preparation, filling and distribution of CW agents in artillery shells of 80 mm or more, as well as 240 mm in artillery rockets.

reference_spacy_tokens: Two major plants located in Kanggye and Sakchu are said to be responsible for the final preparation , filling and distribution of CW agents in artillery shells of 80 mm or more , as well as 240 mm in artillery rockets .


fn_spacy_tokens_for_baseline: President Elias Hrawi , Prime Minister Umar Karami and the president of the National Assembly , Hussain al - Hussaini , visited Damascus on Oct. 17 to attend the first session of the Lebanese - Syrian Supreme Council .

source_bert_toks: president elias hr ##aw ##i , prime minister umar kara ##mi and the president of the national assembly , hussain al - hussain ##i , visited damascus on oct . 17 to attend the first session of the lebanese - syrian supreme council .

reference_raw: President Elias Hrawi, President Umar Karami and President of the National Assembly, Hussain al-Hussaini, visited Damascus on October 17 to attend the first meeting of the Lebanese-Syrian Supreme Council.

reference_spacy_tokens: President Elias Hrawi , President Umar Karami and President of the National Assembly , Hussain al - Hussaini , visited Damascus on October 17 to attend the first meeting of the Lebanese - Syrian Supreme Council .


fn_spacy_tokens_for_baseline: It is estimated that Russia has between 735 and 1,365 metric tons ( t ) of weapons grade - equivalent highly enriched uranium ( HEU ) and between 106 and 156 t of military - use plutonium .

source_bert_toks: it is estimated that russia has between 73 ##5 and 1 , 365 metric tons ( t ) of weapons grade - equivalent highly enriched uranium ( he ##u ) and between 106 and 156 t of military - use pluto ##nium .

reference_raw: Russia is estimated to have between 735 and 1,365 tonnes (t) of weapons grade - equivalent high enriched uranium (HEU) and between 106 and 156 tonnes of military - using plutonium.

reference_spacy_tokens: Russia is estimated to have between 735 and 1,365 tonnes ( t ) of weapons grade - equivalent high enriched uranium ( HEU ) and between 106 and 156 tonnes of military - using plutonium .


fn_spacy_tokens_for_baseline: This westernmost part of the Soviet Union used to draw little attention , except from spies .

source_bert_toks: this western ##most part of the soviet union used to draw little attention , except from spies .

reference_raw: The Westmost part of the Soviet Union used to attract little attention except spies.

reference_spacy_tokens: The Westmost part of the Soviet Union used to attract little attention except spies .


fn_spacy_tokens_for_baseline: Whitlock noticed the holster affixed to the guard 's belt , then glanced down at the leashed Doberman sitting obediently beside him .

source_bert_toks: w ##hit ##lock noticed the holster af ##fixed to the guard ' s belt , then glanced down at the leash ##ed do ##berman sitting obe ##die ##ntly beside him .

reference_raw: Whitlock noticed the case on the guard's belt and looked down at the leashed Doberman, who sat obediently beside him.

reference_spacy_tokens: Whitlock noticed the case on the guard 's belt and looked down at the leashed Doberman , who sat obediently beside him .


fn_spacy_tokens_for_baseline: Lydia was evasive , not having a good answer ready .

source_bert_toks: lydia was eva ##sive , not having a good answer ready .

reference_raw: Lydia was avoiding, and she didn't have a good answer.

reference_spacy_tokens: Lydia was avoiding , and she did n't have a good answer .


fn_spacy_tokens_for_baseline: When the final numbers are tallied , sales of new cars and light trucks in the United States in 1990 will almost certainly have fallen by about 500,000 , to 14 m vehicles .

source_bert_toks: when the final numbers are tall ##ied , sales of new cars and light trucks in the united states in 1990 will almost certainly have fallen by about 500 , 000 , to 14 m vehicles .

reference_raw: With the final figures high, sales of new cars and light trucks in the United States in 1990 will almost certainly fall by about 500,000 to 14 million vehicles.

reference_spacy_tokens: With the final figures high , sales of new cars and light trucks in the United States in 1990 will almost certainly fall by about 500,000 to 14 million vehicles .


fn_spacy_tokens_for_baseline: While Anna picked flowers , Ruth observed every detail of the dress and deportment of the people in the square , for she hoped one day to emulate them .

source_bert_toks: while anna picked flowers , ruth observed every detail of the dress and de ##port ##ment of the people in the square , for she hoped one day to em ##ulate them .

reference_raw: While Anna was picking flowers, Ruth watched every detail of the dress and deportation of the people in the plaza, hoping that one day she would imitate them.

reference_spacy_tokens: While Anna was picking flowers , Ruth watched every detail of the dress and deportation of the people in the plaza , hoping that one day she would imitate them .


fn_spacy_tokens_for_baseline: Whether desirable or not , this is a child - care program , not an educational program .

source_bert_toks: whether desirable or not , this is a child - care program , not an educational program .

reference_raw: Desired or not, it's a child-care program, not an education program.

reference_spacy_tokens: Desired or not , it 's a child - care program , not an education program .


fn_spacy_tokens_for_baseline: And she finally ends by saying , ' All I can look forward to now is the toneless drone of the master 's voice and the pendulum swing of his leg over the desk . '

source_bert_toks: and she finally ends by saying , ' all i can look forward to now is the tone ##less drone of the master ' s voice and the pendulum swing of his leg over the desk . '

reference_raw: And at last she said, "All I can look forward to is the toneless hum of the master's voice and the pendulum swing of his foot across the table."

reference_spacy_tokens: And at last she said , " All I can look forward to is the toneless hum of the master 's voice and the pendulum swing of his foot across the table . "


fn_spacy_tokens_for_baseline: The pair became used to the waves and hoots from passing motorists , trucks and even train drivers as they journeyed to the Mediterranean coast .

source_bert_toks: the pair became used to the waves and ho ##ots from passing motor ##ists , trucks and even train drivers as they journey ##ed to the mediterranean coast .

reference_raw: On their way to the Mediterranean coast, the couple became accustomed to the waves and hooters of passing motorists, trucks, and even train drivers.

reference_spacy_tokens: On their way to the Mediterranean coast , the couple became accustomed to the waves and hooters of passing motorists , trucks , and even train drivers .


fn_spacy_tokens_for_baseline: He wore a plaid plus - fours suit and a silk cravat .

source_bert_toks: he wore a plaid plus - fours suit and a silk cr ##ava ##t .

reference_raw: He was wearing a plaid plus four suit and a silk collar.

reference_spacy_tokens: He was wearing a plaid plus four suit and a silk collar .


fn_spacy_tokens_for_baseline: I gave easy birth to an 8 lb son .

source_bert_toks: i gave easy birth to an 8 ##lb son .

reference_raw: I delivered an 8lb son easily.

reference_spacy_tokens: I delivered an 8 lb son easily .


fn_spacy_tokens_for_baseline: And it evinces a rather daring readiness to weave its fiction around the world of work , where private lives are inextricably bound up with talk of profit margins and raw materials .

source_bert_toks: and it ev ##in ##ces a rather daring readiness to weave its fiction around the world of work , where private lives are in ##ex ##tric ##ably bound up with talk of profit margins and raw materials .

reference_raw: And it leads to a rather daring readiness to weave its fiction around the world of work, where private life is inextricably linked to the talk of profit margins and raw materials.

reference_spacy_tokens: And it leads to a rather daring readiness to weave its fiction around the world of work , where private life is inextricably linked to the talk of profit margins and raw materials .


fn_spacy_tokens_for_baseline: The latest posters advertise the police ball .

source_bert_toks: the latest posters ad ##vert ##ise the police ball .

reference_raw: The last posters advertise a police prom.

reference_spacy_tokens: The last posters advertise a police prom .


fn_spacy_tokens_for_baseline: This often made formal terminations at the end of the season unnecessary .

source_bert_toks: this often made formal termination ##s at the end of the season unnecessary .

reference_raw: This often made formal closures unnecessary at the end of the season.

reference_spacy_tokens: This often made formal closures unnecessary at the end of the season .


fn_spacy_tokens_for_baseline: She snapped her bag shut and groped under the bed for her shoes .

source_bert_toks: she snapped her bag shut and gr ##oped under the bed for her shoes .

reference_raw: She closed the bag and fumbled under the bed for her boots.

reference_spacy_tokens: She closed the bag and fumbled under the bed for her boots .


fn_spacy_tokens_for_baseline: ' They 're tip - top kids , sir .

source_bert_toks: ' they ' re tip - top kids , sir .

reference_raw: 'They're kids with tips, sir.

reference_spacy_tokens: ' They 're kids with tips , sir .


fn_spacy_tokens_for_baseline: The dog gets up and shakes his ears noisily .

source_bert_toks: the dog gets up and shakes his ears no ##isi ##ly .

reference_raw: The dog rises and clasps his ears loudly.

reference_spacy_tokens: The dog rises and clasps his ears loudly .


fn_spacy_tokens_for_baseline: Gough , writing from a Marxist perspective , finds the de - industrialisation thesis wanting on two counts .

source_bert_toks: gough , writing from a marxist perspective , finds the de - industrial ##isation thesis wanting on two counts .

reference_raw: Gough, who writes from a Marxist point of view, finds the de-industrialization thesis to be desired in two respects.

reference_spacy_tokens: Gough , who writes from a Marxist point of view , finds the de - industrialization thesis to be desired in two respects .


fn_spacy_tokens_for_baseline: He was n't confined indoors .

source_bert_toks: he wasn ' t confined indoors .

reference_raw: He wasn't trapped inside.

reference_spacy_tokens: He was n't trapped inside .


fn_spacy_tokens_for_baseline: Danielle 's shoulders hunched up protectively at the recollection .

source_bert_toks: danielle ' s shoulders hunched up protective ##ly at the rec ##oll ##ection .

reference_raw: Danielle crouched her shoulders protectively at the memory.

reference_spacy_tokens: Danielle crouched her shoulders protectively at the memory .


fn_spacy_tokens_for_baseline: The best are those where the head is made from a single piece of metal rather than where individual teeth are riveted into place .

source_bert_toks: the best are those where the head is made from a single piece of metal rather than where individual teeth are ri ##vet ##ed into place .

reference_raw: The best are the ones where the head is made of a single piece of metal rather than where the individual teeth are rived into place.

reference_spacy_tokens: The best are the ones where the head is made of a single piece of metal rather than where the individual teeth are rived into place .


fn_spacy_tokens_for_baseline: The voice at the other end warmed .

source_bert_toks: the voice at the other end warmed .

reference_raw: The voice on the other side was hot.

reference_spacy_tokens: The voice on the other side was hot .


fn_spacy_tokens_for_baseline: The child born to Sarah Byrne had been baptized Anna Beckett .

source_bert_toks: the child born to sarah byrne had been baptized anna beckett .

reference_raw: The child of Sarah Byrne was christened Anna Beckett.

reference_spacy_tokens: The child of Sarah Byrne was christened Anna Beckett .


fn_spacy_tokens_for_baseline: Thornton was corpulent , about 5 ft . 7 ins . tall , of ' forbidding ' and ' very lusty ' appearance with powerful limbs , a short , thick neck , and a swollen , shining face .

source_bert_toks: thornton was corp ##ulent , about 5 ft . 7 ins . tall , of ' forbid ##ding ' and ' very lust ##y ' appearance with powerful limbs , a short , thick neck , and a swollen , shining face .

reference_raw: Thornton was fit, about five ft. seven inches tall, "forbidding" and "very lusty", with strong limbs, a short, thick neck, and a swollen, gleaming face.

reference_spacy_tokens: Thornton was fit , about five ft . seven inches tall , " forbidding " and " very lusty " , with strong limbs , a short , thick neck , and a swollen , gleaming face .


fn_spacy_tokens_for_baseline: The positivist method operates by the categorization of directly observable social phenomena into variables which are tested in their causal relationship to certain independent variables in an attempt to produce testable laws and theories .

source_bert_toks: the po ##sit ##ivist method operates by the cat ##ego ##rization of directly ob ##ser ##vable social phenomena into variables which are tested in their causal relationship to certain independent variables in an attempt to produce test ##able laws and theories .

reference_raw: The positive method is based on the classification of directly observable social phenomena into variables that are tested in a causal relationship with certain independent variables in order to produce testable laws and theories.

reference_spacy_tokens: The positive method is based on the classification of directly observable social phenomena into variables that are tested in a causal relationship with certain independent variables in order to produce testable laws and theories .


fn_spacy_tokens_for_baseline: Bernie downed his whisky and said , ' Seen that telephone number ?

source_bert_toks: bernie downed his whisky and said , ' seen that telephone number ?

reference_raw: Bernie lowered his whiskey and said, "Did you see the phone number?

reference_spacy_tokens: Bernie lowered his whiskey and said , " Did you see the phone number ?


fn_spacy_tokens_for_baseline: More glass covered the road ; she heard it crunching beneath the tyres .

source_bert_toks: more glass covered the road ; she heard it crunch ##ing beneath the tyres .

reference_raw: The road was covered with more glass; she could hear it crackling under the tires.

reference_spacy_tokens: The road was covered with more glass ; she could hear it crackling under the tires .


fn_spacy_tokens_for_baseline: What on earth would she think if she saw her in this ridiculous get - up ?

source_bert_toks: what on earth would she think if she saw her in this ridiculous get - up ?

reference_raw: What in God's name would she think if she saw her in that ridiculous awakening?

reference_spacy_tokens: What in God 's name would she think if she saw her in that ridiculous awakening ?


fn_spacy_tokens_for_baseline: This enables you to guide the rear section home without catching the inner surface of the Dacron sleeve and helps to make sure that the sections are fully joined .

source_bert_toks: this enables you to guide the rear section home without catching the inner surface of the da ##cr ##on sleeve and helps to make sure that the sections are fully joined .

reference_raw: This allows you to lead the rear section home without capturing the interior surface of the Dacron sleeve and helps ensure that the sections are fully integrated.

reference_spacy_tokens: This allows you to lead the rear section home without capturing the interior surface of the Dacron sleeve and helps ensure that the sections are fully integrated .


fn_spacy_tokens_for_baseline: In summer the water is home to huge plastic bathtubs in which unhappy families sit self - consciously picking at their dog 's dinners , or pudgy louts grow raucous on tinned beer .

source_bert_toks: in summer the water is home to huge plastic bath ##tub ##s in which unhappy families sit self - consciously picking at their dog ' s dinners , or pu ##d ##gy lou ##ts grow ra ##uc ##ous on tin ##ned beer .

reference_raw: In the summer, the water is home to huge plastic tubs, where unhappy families sit self-consciously and pick up their dog dinners, or puzzling louts grow raucous on tinned beer.

reference_spacy_tokens: In the summer , the water is home to huge plastic tubs , where unhappy families sit self - consciously and pick up their dog dinners , or puzzling louts grow raucous on tinned beer .


fn_spacy_tokens_for_baseline: In a recent interview with Al - Jazeera he spoke against the Arab regimes .

source_bert_toks: in a recent interview with al - ja ##zee ##ra he spoke against the arab regimes .

reference_raw: He spoke recently with Al-Jazeera against Arab regimes.

reference_spacy_tokens: He spoke recently with Al - Jazeera against Arab regimes .


fn_spacy_tokens_for_baseline: Mrs Hentz filed a complaint on her daughter 's behalf with the state Human Rights Department and , still not appeased , took the matter to the US Office Of Civil Rights .

source_bert_toks: mrs hen ##tz filed a complaint on her daughter ' s behalf with the state human rights department and , still not app ##eased , took the matter to the us office of civil rights .

reference_raw: Mrs. Hentz complained to the State Department of Human Rights on behalf of her daughter and, still unsatisfactory, took the matter to the U.S. Civil Rights Office.

reference_spacy_tokens: Mrs. Hentz complained to the State Department of Human Rights on behalf of her daughter and , still unsatisfactory , took the matter to the U.S. Civil Rights Office .


fn_spacy_tokens_for_baseline: Maggie felt like curling up and crawling away .

source_bert_toks: maggie felt like curling up and crawling away .

reference_raw: Maggie wanted to curl up and crawl away.

reference_spacy_tokens: Maggie wanted to curl up and crawl away .


fn_spacy_tokens_for_baseline: The beard and wild hair , the dirty smelly clothes -- had n't he seen that same person only that morning ?

source_bert_toks: the beard and wild hair , the dirty smell ##y clothes - - hadn ' t he seen that same person only that morning ?

reference_raw: His beard, his wild hair, his filthy, stinking clothes -- hadn't he seen the same person before this morning?

reference_spacy_tokens: His beard , his wild hair , his filthy , stinking clothes -- had n't he seen the same person before this morning ?


fn_spacy_tokens_for_baseline: This fellow 's been wrangling with Zacco .

source_bert_toks: this fellow ' s been wr ##ang ##ling with zac ##co .

reference_raw: This guy was hooking up with Zacco.

reference_spacy_tokens: This guy was hooking up with Zacco .


fn_spacy_tokens_for_baseline: I switched all of the questions I was waffling on , and still got neutral .

source_bert_toks: i switched all of the questions i was wa ##ff ##ling on , and still got neutral .

reference_raw: I've changed all the questions I've been working on, and I'm still neutral.

reference_spacy_tokens: I 've changed all the questions I 've been working on , and I 'm still neutral .


fn_spacy_tokens_for_baseline: It 's a man 's bottom that 's wiggling

source_bert_toks: it ' s a man ' s bottom that ' s wig ##gling

reference_raw: It's the bottom of a man who wriggles

reference_spacy_tokens: It 's the bottom of a man who wriggles


fn_spacy_tokens_for_baseline: She is an outgoing , cheerful person with an ability to communicate her feelings , to get along , and find enjoyment in most situations .

source_bert_toks: she is an outgoing , cheerful person with an ability to communicate her feelings , to get along , and find enjoyment in most situations .

reference_raw: He's a distant, happy person with the ability to communicate his feelings, get along, and enjoy most situations.

reference_spacy_tokens: He 's a distant , happy person with the ability to communicate his feelings , get along , and enjoy most situations .


fn_spacy_tokens_for_baseline: Arkan showed his less affable side when he tackled the photographer who accompanied me around the throat , throwing him out of his office and smashing his video camera underfoot .

source_bert_toks: ark ##an showed his less af ##fa ##ble side when he tackled the photographer who accompanied me around the throat , throwing him out of his office and smashing his video camera under ##foot .

reference_raw: Arkan showed his less friendly side as he tackled the photographer who had followed me around the neck, threw him out of his office and smashed the camera under his feet.

reference_spacy_tokens: Arkan showed his less friendly side as he tackled the photographer who had followed me around the neck , threw him out of his office and smashed the camera under his feet .


fn_spacy_tokens_for_baseline: Obviously we feel discouraged , but we do what we can . '

source_bert_toks: obviously we feel discouraged , but we do what we can . '

reference_raw: We're obviously embarrassed, but we're doing the best we can.'

reference_spacy_tokens: We 're obviously embarrassed , but we 're doing the best we can . '


fn_spacy_tokens_for_baseline: Liquidise a large , raw carrot to a smooth paste , or boil or steam the carrot then mash it thoroughly .

source_bert_toks: liquid ##ise a large , raw carrot to a smooth paste , or boil or steam the carrot then mas ##h it thoroughly .

reference_raw: Liquidise a large raw carrot into a smooth paste, or boil or steam the carrot and then wash it thoroughly.

reference_spacy_tokens: Liquidise a large raw carrot into a smooth paste , or boil or steam the carrot and then wash it thoroughly .


fn_spacy_tokens_for_baseline: All four of the white Los Angeles police officers , whose acquittal in the Rodney King beating case sparked several days of rioting in the city in late April and early May [ see p. 38894 ] , were indicted by a grand jury on Aug. 4 on federal charges of violating King 's civil rights .

source_bert_toks: all four of the white los angeles police officers , whose ac ##qui ##ttal in the rodney king beating case sparked several days of riot ##ing in the city in late april and early may [ see p . 38 ##8 ##9 ##4 ] , were indicted by a grand jury on aug . 4 on federal charges of violating king ' s civil rights .

reference_raw: All four white Los Angeles police officers, whose exoneration in the Rodney King beating case sparked several days of riots in the city at the end of April and early May [see p. 38894], were charged by the Grand Jury of August 4 on federal charges of violation of King's civil rights.

reference_spacy_tokens: All four white Los Angeles police officers , whose exoneration in the Rodney King beating case sparked several days of riots in the city at the end of April and early May [ see p. 38894 ] , were charged by the Grand Jury of August 4 on federal charges of violation of King 's civil rights .


fn_spacy_tokens_for_baseline: The issue of natural genius is more fully treated in chapter five below ; here , it is necessary to observe that Duck 's success was largely a consequence of the attention inevitably accorded to a prodigy of any description .

source_bert_toks: the issue of natural genius is more fully treated in chapter five below ; here , it is necessary to observe that duck ' s success was largely a consequence of the attention inevitably accord ##ed to a prodigy of any description .

reference_raw: The question of natural genius is dealt with in more detail in Chapter 5 below; in this case, it should be noted that Duck's success was largely the result of the attention necessarily given to the prodigy of any description.

reference_spacy_tokens: The question of natural genius is dealt with in more detail in Chapter 5 below ; in this case , it should be noted that Duck 's success was largely the result of the attention necessarily given to the prodigy of any description .


fn_spacy_tokens_for_baseline: She felt herself to be reasonably proficient in Italian and she had begun , rather to the disapproval of her employers , to learn a few words of the Neapolitan dialect .

source_bert_toks: she felt herself to be reasonably proficient in italian and she had begun , rather to the disapproval of her employers , to learn a few words of the ne ##ap ##oli ##tan dialect .

reference_raw: She felt that she was reasonably good at Italian, and instead of agreeing with her employers, she began to learn a few words from the Neapolitan dialect.

reference_spacy_tokens: She felt that she was reasonably good at Italian , and instead of agreeing with her employers , she began to learn a few words from the Neapolitan dialect .


fn_spacy_tokens_for_baseline: ' Guess who 's just pulled off the interview of the year ? '

source_bert_toks: ' guess who ' s just pulled off the interview of the year ? '

reference_raw: "Guess who just finished this year's interview?"

reference_spacy_tokens: " Guess who just finished this year 's interview ? "


fn_spacy_tokens_for_baseline: Walter Boag assesses their present - day successors who are currently expanding the text of the soda ash story in a way which , for enterprise and determination , would surely win an approving nod .

source_bert_toks: walter bo ##ag assess ##es their present - day successors who are currently expanding the text of the soda ash story in a way which , for enterprise and determination , would surely win an app ##roving nod .

reference_raw: Walter Boag assesses his current successors, who are currently expanding the text of the soda-ash story in a way that, for business and determination, would certainly win a nod of approval.

reference_spacy_tokens: Walter Boag assesses his current successors , who are currently expanding the text of the soda - ash story in a way that , for business and determination , would certainly win a nod of approval .


fn_spacy_tokens_for_baseline: The Christianity that coalesced and took shape in Constantine 's time was in fact a hybrid , containing significant skeins of thought derived from Mithraism and from the sun cult .

source_bert_toks: the christianity that coal ##es ##ced and took shape in constantine ' s time was in fact a hybrid , containing significant sk ##ein ##s of thought derived from mit ##hra ##ism and from the sun cult .

reference_raw: Christianity, which came together and took shape in Constantine's time, was in fact a hybrid that contained significant skeins of thought derived from mithraism and sun cult.

reference_spacy_tokens: Christianity , which came together and took shape in Constantine 's time , was in fact a hybrid that contained significant skeins of thought derived from mithraism and sun cult .


fn_spacy_tokens_for_baseline: Cross the Strait by Menai Suspension Bridge .

source_bert_toks: cross the strait by men ##ai suspension bridge .

reference_raw: Cross the Channel by the Menai Suspension Bridge.

reference_spacy_tokens: Cross the Channel by the Menai Suspension Bridge .


fn_spacy_tokens_for_baseline: I put their empties on the bar and , of course , I glanced in here to see whether there were any more to clear away .

source_bert_toks: i put their em ##pt ##ies on the bar and , of course , i glanced in here to see whether there were any more to clear away .

reference_raw: I put their blanks on the bar, and, of course, I looked here to see if there was anything left to clean up.

reference_spacy_tokens: I put their blanks on the bar , and , of course , I looked here to see if there was anything left to clean up .


fn_spacy_tokens_for_baseline: Room is obviously important when the ballerina is wearing a tutu , whose shape should not be distorted by a collision between the partners .

source_bert_toks: room is obviously important when the ball ##erina is wearing a tu ##tu , whose shape should not be distorted by a collision between the partners .

reference_raw: The room is obviously important when the ballerina wears a tut, the shape of which should not be distorted by a collision between the partners.

reference_spacy_tokens: The room is obviously important when the ballerina wears a tut , the shape of which should not be distorted by a collision between the partners .


fn_spacy_tokens_for_baseline: Souness played and he was a heavy - set , mean bastard .

source_bert_toks: so ##unes ##s played and he was a heavy - set , mean bastard .

reference_raw: Souness was playing, and he was a heavy, mean son of a bitch.

reference_spacy_tokens: Souness was playing , and he was a heavy , mean son of a bitch .


fn_spacy_tokens_for_baseline: They are currently sifting through information gathered from more than 350 people questioned in a major weekend operation to retrace the dead man 's last known movements .

source_bert_toks: they are currently si ##fting through information gathered from more than 350 people questioned in a major weekend operation to re ##tra ##ce the dead man ' s last known movements .

reference_raw: They are currently siphoning through information gathered from more than 350 people questioned during a major weekend operation to trace the last known movements of the dead man.

reference_spacy_tokens: They are currently siphoning through information gathered from more than 350 people questioned during a major weekend operation to trace the last known movements of the dead man .


fn_spacy_tokens_for_baseline: She gave a tiny strangled gasp and shuddered , feeling the waves of shock coursing along her veins .

source_bert_toks: she gave a tiny strangled gasp and shuddered , feeling the waves of shock co ##urs ##ing along her veins .

reference_raw: She let out a small, strangled gasp and shivered, feeling the shock surge through her veins.

reference_spacy_tokens: She let out a small , strangled gasp and shivered , feeling the shock surge through her veins .


fn_spacy_tokens_for_baseline: That feverish July , the air tasted of electricity .

source_bert_toks: that fever ##ish july , the air tasted of electricity .

reference_raw: That feverish July, the air smelled of electricity.

reference_spacy_tokens: That feverish July , the air smelled of electricity .


fn_spacy_tokens_for_baseline: On the day the portrait was to be exported to a private gallery in the United States , an Englishwoman telegraphed from a resort in Germany offering to make up the balance of £ 40,000 .

source_bert_toks: on the day the portrait was to be exported to a private gallery in the united states , an english ##woman telegraph ##ed from a resort in germany offering to make up the balance of £ ##40 , 000 .

reference_raw: On the day that the portrait was to be exported to a private gallery in the United States, an Englishwoman telephoned from a German resort offering a balance of £40,000.

reference_spacy_tokens: On the day that the portrait was to be exported to a private gallery in the United States , an Englishwoman telephoned from a German resort offering a balance of £ 40,000 .


fn_spacy_tokens_for_baseline: Sun glinted off the water and the golden light was so pellucid , so dazzling , that she felt in her bag for her sunglasses .

source_bert_toks: sun glint ##ed off the water and the golden light was so pe ##ll ##uc ##id , so dazzling , that she felt in her bag for her sunglasses .

reference_raw: The sun glinted off the water, and the golden light was so bright, so dazzling, that she found her sunglasses in her bag.

reference_spacy_tokens: The sun glinted off the water , and the golden light was so bright , so dazzling , that she found her sunglasses in her bag .


fn_spacy_tokens_for_baseline: The only party aggrieved by these arrangements is the Ministry of Defence ( MoD ) .

source_bert_toks: the only party ag ##gr ##ie ##ved by these arrangements is the ministry of defence ( mod ) .

reference_raw: The only party affected by these measures is the Ministry of Defence.

reference_spacy_tokens: The only party affected by these measures is the Ministry of Defence .


fn_spacy_tokens_for_baseline: 1- The married have a vacation by rotation for a week every three weeks , and in certain cases AL - QAEDA may deny this vacation for four months .

source_bert_toks: 1 - the married have a vacation by rotation for a week every three weeks , and in certain cases al - qaeda may deny this vacation for four months .

reference_raw: 1- The spouses have a rotational holiday of one week every three weeks, and in some cases AL-QAEDA can refuse that leave for four months.

reference_spacy_tokens: 1- The spouses have a rotational holiday of one week every three weeks , and in some cases AL - QAEDA can refuse that leave for four months .


fn_spacy_tokens_for_baseline: The sleek , expressionless woman wore a silvery skintight jumpsuit which almost appeared to have been sprayed on to her limbs , not donned .

source_bert_toks: the sleek , expression ##less woman wore a silvery skin ##tight jumps ##uit which almost appeared to have been sprayed on to her limbs , not don ##ned .

reference_raw: The smooth, expressionless woman was dressed in a silver-skinned suit that looked almost as if it had been sprayed on her limbs, not dressed.

reference_spacy_tokens: The smooth , expressionless woman was dressed in a silver - skinned suit that looked almost as if it had been sprayed on her limbs , not dressed .


fn_spacy_tokens_for_baseline: He gave her a cool smile over the rim of the snifter .

source_bert_toks: he gave her a cool smile over the rim of the s ##ni ##ft ##er .

reference_raw: He smiled coldly at her over the edge of the whistle.

reference_spacy_tokens: He smiled coldly at her over the edge of the whistle .


fn_spacy_tokens_for_baseline: Though this was only a preliminary , hypothetical run - through , she felt as nervous as a bride at a wedding rehearsal .

source_bert_toks: though this was only a preliminary , hypothetical run - through , she felt as nervous as a bride at a wedding rehearsal .

reference_raw: Although it was only a preliminary, hypothetical examination, she felt as nervous as a bride at a wedding rehearsal.

reference_spacy_tokens: Although it was only a preliminary , hypothetical examination , she felt as nervous as a bride at a wedding rehearsal .


fn_spacy_tokens_for_baseline: The glacier ends in a cliff that calves small icebergs that head seaward , grind to a halt when they hit the sand base of the river and dissolve in tears at the indignity of it all .

source_bert_toks: the glacier ends in a cliff that calves small ice ##berg ##s that head sea ##ward , grind to a halt when they hit the sand base of the river and dissolve in tears at the ind ##ign ##ity of it all .

reference_raw: The glacier ends in a rock that calves little glaciers that head towards the sea, grinds to a halt as they hit the sandy bottom of the river and melts into tears at the indignity of it all.

reference_spacy_tokens: The glacier ends in a rock that calves little glaciers that head towards the sea , grinds to a halt as they hit the sandy bottom of the river and melts into tears at the indignity of it all .


fn_spacy_tokens_for_baseline: His head was itching too much from the dreadful old grey wig .

source_bert_toks: his head was it ##ching too much from the dreadful old grey wig .

reference_raw: His head throbbed too much from that ghastly old gray wig.

reference_spacy_tokens: His head throbbed too much from that ghastly old gray wig .


fn_spacy_tokens_for_baseline: Fearful of punitive damages , companies will avoid doing anything that might later be seen as an admission of guilt .

source_bert_toks: fearful of pun ##itive damages , companies will avoid doing anything that might later be seen as an admission of guilt .

reference_raw: Fearful of retribution, companies will avoid doing anything that could later be considered a plea of guilt.

reference_spacy_tokens: Fearful of retribution , companies will avoid doing anything that could later be considered a plea of guilt .


fn_spacy_tokens_for_baseline: Horrified that she could have been so thoughtless , Rory laid a beseeching hand on her arm .

source_bert_toks: horrified that she could have been so thought ##less , rory laid a be ##see ##ching hand on her arm .

reference_raw: Horrified that she might be so reckless, Rory put a beseeching hand on her arm.

reference_spacy_tokens: Horrified that she might be so reckless , Rory put a beseeching hand on her arm .


fn_spacy_tokens_for_baseline: Grass - blades clashed around her , a bird of some kind clattered up .

source_bert_toks: grass - blades clashed around her , a bird of some kind cl ##atter ##ed up .

reference_raw: Grass blades clattered around her, and some bird rattled.

reference_spacy_tokens: Grass blades clattered around her , and some bird rattled .


fn_spacy_tokens_for_baseline: Iran , in fact , was the Soviet Union 's largest trading partner in the Middle East during this period .

source_bert_toks: iran , in fact , was the soviet union ' s largest trading partner in the middle east during this period .

reference_raw: In fact, during that period, Iran was the largest trading associate of the Soviet Union in the Middle East.

reference_spacy_tokens: In fact , during that period , Iran was the largest trading associate of the Soviet Union in the Middle East .


fn_spacy_tokens_for_baseline: Not having my legs waxed !

source_bert_toks: not having my legs wax ##ed !

reference_raw: I don't want my legs dried up!

reference_spacy_tokens: I do n't want my legs dried up !


fn_spacy_tokens_for_baseline: Behind us an impatient motorist tooted a horn .

source_bert_toks: behind us an impatient motor ##ist too ##ted a horn .

reference_raw: Behind us, an impatient motorist took a corner.

reference_spacy_tokens: Behind us , an impatient motorist took a corner .


fn_spacy_tokens_for_baseline: In the eastern town of Douala a crowd of about 50,000 demanding the overthrow of Biya was confronted by troops on May 16 , but refused to disperse .

source_bert_toks: in the eastern town of do ##ual ##a a crowd of about 50 , 000 demanding the overthrow of bi ##ya was confronted by troops on may 16 , but refused to disperse .

reference_raw: On the 16th of May, in the eastern city of Douala, a mob of about 50,000, demanding the destruction of Biya, was confronted by soldiers, but refused to disperse.

reference_spacy_tokens: On the 16th of May , in the eastern city of Douala , a mob of about 50,000 , demanding the destruction of Biya , was confronted by soldiers , but refused to disperse .


fn_spacy_tokens_for_baseline: In this extended discussion the author defines the caring professions as those whose members have both a commitment to caring and a task to care .

source_bert_toks: in this extended discussion the author defines the caring professions as those whose members have both a commitment to caring and a task to care .

reference_raw: In this far-reaching debate, the author defines the care professions as those whose members have both a duty to care and a duty to care.

reference_spacy_tokens: In this far - reaching debate , the author defines the care professions as those whose members have both a duty to care and a duty to care .


fn_spacy_tokens_for_baseline: The decision has incensed many civilians , and prompted demonstrations .

source_bert_toks: the decision has incense ##d many civilians , and prompted demonstrations .

reference_raw: The decision ignited a lot of civilians and prompted demonstrations.

reference_spacy_tokens: The decision ignited a lot of civilians and prompted demonstrations .


fn_spacy_tokens_for_baseline: Given Iran 's strong biotechnology and pharmaceutical infrastructure , it is not difficult to envision the development of a concealed BW program .

source_bert_toks: given iran ' s strong biotechnology and pharmaceutical infrastructure , it is not difficult to en ##vision the development of a concealed b ##w program .

reference_raw: Given Iran's strong biotechnology and pharmaceutical infrastructure, it is not difficult to imagine the development of a hidden BW program.

reference_spacy_tokens: Given Iran 's strong biotechnology and pharmaceutical infrastructure , it is not difficult to imagine the development of a hidden BW program .


fn_spacy_tokens_for_baseline: She stood a colander under a saucepan and poured sprouts into it .

source_bert_toks: she stood a cola ##nder under a sauce ##pan and poured sp ##rou ##ts into it .

reference_raw: She put the colander under the saucepan and poured the germs into it.

reference_spacy_tokens: She put the colander under the saucepan and poured the germs into it .


fn_spacy_tokens_for_baseline: ' You would , ' he murmured , in a voice of maddening certainty , of maddening calm .

source_bert_toks: ' you would , ' he murmured , in a voice of madden ##ing certainty , of madden ##ing calm .

reference_raw: "You'd do that," he whispered in a voice of mad certainty and mad calm.

reference_spacy_tokens: " You 'd do that , " he whispered in a voice of mad certainty and mad calm .


fn_spacy_tokens_for_baseline: LANDED GENTLY : Fergie , now in a one - piece bathing costume , and friend crawl out of their hideaway swimming pool after a refreshing dip

source_bert_toks: landed gently : fe ##rg ##ie , now in a one - piece bathing costume , and friend crawl out of their hide ##away swimming pool after a refreshing dip

reference_raw: Fergie, now in a one-piece bathing suit, and her friend crawls out of her hiding pool after a refreshing dip.

reference_spacy_tokens: Fergie , now in a one - piece bathing suit , and her friend crawls out of her hiding pool after a refreshing dip .


fn_spacy_tokens_for_baseline: Ruysch , a member of the Royal Society , devised an arterial technique for human embalming ; although a master of the art he was extremely secretive and never divulged his recipe .

source_bert_toks: ru ##ys ##ch , a member of the royal society , devised an arterial technique for human em ##bal ##ming ; although a master of the art he was extremely secretive and never di ##vu ##lge ##d his recipe .

reference_raw: Ruysch, a member of the Royal Society, had devised an arterial technique for human embalming; though he was a master of art, he was extremely mysterious and did not reveal his recipe.

reference_spacy_tokens: Ruysch , a member of the Royal Society , had devised an arterial technique for human embalming ; though he was a master of art , he was extremely mysterious and did not reveal his recipe .


fn_spacy_tokens_for_baseline: He wiped a peephole from the condensation on the window and viewed the world beyond .

source_bert_toks: he wiped a pee ##ph ##ole from the conde ##ns ##ation on the window and viewed the world beyond .

reference_raw: He wiped a peephole from the condensation in the window and looked out over the world beyond.

reference_spacy_tokens: He wiped a peephole from the condensation in the window and looked out over the world beyond .


fn_spacy_tokens_for_baseline: But when she heard her children were being maltreated she came back a year later and fought to have them returned to her .

source_bert_toks: but when she heard her children were being mal ##tre ##ated she came back a year later and fought to have them returned to her .

reference_raw: But when she heard that her children were being abused, she returned a year later, fighting for their return.

reference_spacy_tokens: But when she heard that her children were being abused , she returned a year later , fighting for their return .


fn_spacy_tokens_for_baseline: In Hull a student , Tom Fawthrop , later a fixture on It and other underground papers , ripped up his finals papers .

source_bert_toks: in hull a student , tom fa ##wt ##hr ##op , later a fixture on it and other underground papers , ripped up his finals papers .

reference_raw: In Hull, a student, Tom Fawthrop, later a fixture on it and other subterranean newspapers, tore up the finals.

reference_spacy_tokens: In Hull , a student , Tom Fawthrop , later a fixture on it and other subterranean newspapers , tore up the finals .


fn_spacy_tokens_for_baseline: It is also popular for rugged outerwear use and is establishing a presence in polo shirts and track suits , not to mention the key innerwear section of hosiery and lingerie .

source_bert_toks: it is also popular for rugged outer ##wear use and is establishing a presence in polo shirts and track suits , not to mention the key inner ##wear section of ho ##sier ##y and linger ##ie .

reference_raw: It is also popular for rugged outdoor use and introduces the presence of polo shirts and track suits, not to mention the key part of hosiery and underwear.

reference_spacy_tokens: It is also popular for rugged outdoor use and introduces the presence of polo shirts and track suits , not to mention the key part of hosiery and underwear .


fn_spacy_tokens_for_baseline: There was a crackle of static , like a public address system at a church social , then another record started .

source_bert_toks: there was a crack ##le of static , like a public address system at a church social , then another record started .

reference_raw: There was a crackle of static, like a public address system in a church society, and then another record began.

reference_spacy_tokens: There was a crackle of static , like a public address system in a church society , and then another record began .


fn_spacy_tokens_for_baseline: ' I got the money , ' he squealed .

source_bert_toks: ' i got the money , ' he squealed .

reference_raw: "I have the money," he squeaked.

reference_spacy_tokens: " I have the money , " he squeaked .


fn_spacy_tokens_for_baseline: They denied the allegations and last month three were bound over by a Liverpool stipendiary magistrate , despite the CPS successfully appealing against a decision that proceedings against the four be stayed .

source_bert_toks: they denied the allegations and last month three were bound over by a liverpool st ##ipe ##ndi ##ary magistrate , despite the cp ##s successfully appealing against a decision that proceedings against the four be stayed .

reference_raw: They denied the charges and, last month, three of them were bound by the Liverpool Stipendiary Judge, even though the CPS had successfully challenged the decision to stay the proceedings against the four of them.

reference_spacy_tokens: They denied the charges and , last month , three of them were bound by the Liverpool Stipendiary Judge , even though the CPS had successfully challenged the decision to stay the proceedings against the four of them .


fn_spacy_tokens_for_baseline: We went carefully up the rickety stairs , wall bulges out here , and roof dips down there , torn matting and straying hooky rugs .

source_bert_toks: we went carefully up the rick ##ety stairs , wall bulge ##s out here , and roof dip ##s down there , torn matt ##ing and stray ##ing hook ##y rug ##s .

reference_raw: We walked carefully up the rickety steps, the walls here, and the roof went down there, tearing up mats and straying hooky carpets.

reference_spacy_tokens: We walked carefully up the rickety steps , the walls here , and the roof went down there , tearing up mats and straying hooky carpets .


fn_spacy_tokens_for_baseline: Its best - known feature is its soft and pliable duck - like beak .

source_bert_toks: its best - known feature is its soft and pl ##iable duck - like beak .

reference_raw: Its most famous feature is its soft, soft ducky beak.

reference_spacy_tokens: Its most famous feature is its soft , soft ducky beak .


fn_spacy_tokens_for_baseline: Enter the cross - eyed daughter , bearing wine , plates and cutlery .

source_bert_toks: enter the cross - eyed daughter , bearing wine , plates and cutler ##y .

reference_raw: Enter the girl with the cross eyes, carrying wine, plates, and silverware.

reference_spacy_tokens: Enter the girl with the cross eyes , carrying wine , plates , and silverware .


fn_spacy_tokens_for_baseline: So in the case of a ruler who reigned for a long time , coins enable us to date the changes during the reign .

source_bert_toks: so in the case of a ruler who reigned for a long time , coins enable us to date the changes during the reign .

reference_raw: So in the case of a ruler who has ruled for a long time, the coins allow us to date the changes during the government.

reference_spacy_tokens: So in the case of a ruler who has ruled for a long time , the coins allow us to date the changes during the government .


fn_spacy_tokens_for_baseline: Three hundred years later he is remembered as an honourable man , an epithet to be prized above the highest awards attainable .

source_bert_toks: three hundred years later he is remembered as an honourable man , an epithet to be prized above the highest awards attain ##able .

reference_raw: Three hundred years later, he is remembered as a man of honor, an epithet to be valued above the highest prizes achievable.

reference_spacy_tokens: Three hundred years later , he is remembered as a man of honor , an epithet to be valued above the highest prizes achievable .


fn_spacy_tokens_for_baseline: If you want to know what a man is really like , take notice of how he acts when he loses money .

source_bert_toks: if you want to know what a man is really like , take notice of how he acts when he loses money .

reference_raw: If you want to know what a man really is, remember what he's like when he's out of money.

reference_spacy_tokens: If you want to know what a man really is , remember what he 's like when he 's out of money .


fn_spacy_tokens_for_baseline: The male patient is asked to pass a little urine ( perhaps the equivalent of two tablespoons ) into one glass beaker and then to pass more into a second beaker .

source_bert_toks: the male patient is asked to pass a little urine ( perhaps the equivalent of two tables ##poo ##ns ) into one glass beak ##er and then to pass more into a second beak ##er .

reference_raw: The male patient is asked to pass a small amount of urine (perhaps the equivalent of two table spoons) into one of the glass beakers and then pass more into the other.

reference_spacy_tokens: The male patient is asked to pass a small amount of urine ( perhaps the equivalent of two table spoons ) into one of the glass beakers and then pass more into the other .


fn_spacy_tokens_for_baseline: He took a deep breath , coughed yet again , and picked up one of the sheets of paper before him .

source_bert_toks: he took a deep breath , coughed yet again , and picked up one of the sheets of paper before him .

reference_raw: He took a deep breath, cleared his throat again, and picked up a sheet of paper in front of him.

reference_spacy_tokens: He took a deep breath , cleared his throat again , and picked up a sheet of paper in front of him .


fn_spacy_tokens_for_baseline: A 1999 report by the U.S. Congress stated the following with regard to how the North Korean military views chemical weaponry :

source_bert_toks: a 1999 report by the u . s . congress stated the following with regard to how the north korean military views chemical weaponry :

reference_raw: In a report from the United States Congress in 1999, the North Korean military expressed the following views on chemical weapons:

reference_spacy_tokens: In a report from the United States Congress in 1999 , the North Korean military expressed the following views on chemical weapons :


fn_spacy_tokens_for_baseline: Throgmorton slurped from his goblet .

source_bert_toks: th ##ro ##gm ##ort ##on sl ##ur ##ped from his go ##ble ##t .

reference_raw: Throgmorton sipped out of his cup.

reference_spacy_tokens: Throgmorton sipped out of his cup .


fn_spacy_tokens_for_baseline: There are many guided bus tours to sights outside the city , and some are accessible by city bus .

source_bert_toks: there are many guided bus tours to sights outside the city , and some are accessible by city bus .

reference_raw: There are many tours of the bus to the outskirts of the city, and some of them are accessible by the city bus.

reference_spacy_tokens: There are many tours of the bus to the outskirts of the city , and some of them are accessible by the city bus .


fn_spacy_tokens_for_baseline: Middlesbrough goalkeeper Stephen Pears , who lives nearby , donated a magnum of champagne which he won as a man of the match prize .

source_bert_toks: middlesbrough goalkeeper stephen pear ##s , who lives nearby , donated a magnum of champagne which he won as a man of the match prize .

reference_raw: Middlesbrough goalkeeper Stephen Pears, who lives nearby, gave him a bottle of champagne that he won as a match prize man.

reference_spacy_tokens: Middlesbrough goalkeeper Stephen Pears , who lives nearby , gave him a bottle of champagne that he won as a match prize man .


fn_spacy_tokens_for_baseline: The point is not new : Samuel Johnson believed that Shakespeare 's comedies reveal a profounder instinct than his tragedies : ' his tragedy seems to be skill , his comedy to be instinct ' .

source_bert_toks: the point is not new : samuel johnson believed that shakespeare ' s comedies reveal a profound ##er instinct than his tr ##aged ##ies : ' his tragedy seems to be skill , his comedy to be instinct ' .

reference_raw: The point is not new: Samuel Johnson believed that Shakespeare's comics revealed a deeper instinct than his tragedy: 'his tragedy seems to be a skill, his comics to be an instinct.'

reference_spacy_tokens: The point is not new : Samuel Johnson believed that Shakespeare 's comics revealed a deeper instinct than his tragedy : ' his tragedy seems to be a skill , his comics to be an instinct . '


fn_spacy_tokens_for_baseline: In this paper , we addressed the question of how many replicates are needed to achieve adequate power while considering an efficient technical procedure that is applicable in microarray experiments .

source_bert_toks: in this paper , we addressed the question of how many replicate ##s are needed to achieve adequate power while considering an efficient technical procedure that is applicable in micro ##ar ##ray experiments .

reference_raw: This document addressed the question of how many replicates are needed to achieve adequate performance, taking into account the effective technical procedure applicable to micro-array experiments.

reference_spacy_tokens: This document addressed the question of how many replicates are needed to achieve adequate performance , taking into account the effective technical procedure applicable to micro - array experiments .


fn_spacy_tokens_for_baseline: She guessed Nina had been too overwrought to shoot up .

source_bert_toks: she guessed nina had been too over ##wr ##ough ##t to shoot up .

reference_raw: She guessed that Nina was too busy to fire.

reference_spacy_tokens: She guessed that Nina was too busy to fire .


fn_spacy_tokens_for_baseline: They say they were outraged by the Sept. 11 terrorist attacks , and claim to despise Al Qaeda .

source_bert_toks: they say they were outraged by the sept . 11 terrorist attacks , and claim to des ##pis ##e al qaeda .

reference_raw: They say they were indignant in September 11 terrorist attacks, and they claim to despise Al Qaeda.

reference_spacy_tokens: They say they were indignant in September 11 terrorist attacks , and they claim to despise Al Qaeda .


fn_spacy_tokens_for_baseline: In Omi 's room , the door opened a crack : herself frightened , Erika peeked into the sitting - room and hushed an even more frightened Paul into silence as he whispered , ' What is it ?

source_bert_toks: in om ##i ' s room , the door opened a crack : herself frightened , erika peeked into the sitting - room and hushed an even more frightened paul into silence as he whispered , ' what is it ?

reference_raw: The door opened in Omi's room: she was frightened, Erica peered into the living room and silenced even more frightened Paul as he whispered, "What's the matter?

reference_spacy_tokens: The door opened in Omi 's room : she was frightened , Erica peered into the living room and silenced even more frightened Paul as he whispered , " What 's the matter ?


fn_spacy_tokens_for_baseline: Harry quaffed down his ale and called to Marion Treffry for more .

source_bert_toks: harry qu ##af ##fed down his ale and called to marion tre ##ff ##ry for more .

reference_raw: Harry knocked off his beer and called out to Marion Treffry for more.

reference_spacy_tokens: Harry knocked off his beer and called out to Marion Treffry for more .


fn_spacy_tokens_for_baseline: They were tired and despondent , stooped in their waterproof coveralls .

source_bert_toks: they were tired and des ##pon ##dent , st ##ooped in their water ##proof cover ##all ##s .

reference_raw: They were tired and despondent, crouched in their watertight jumpsuits.

reference_spacy_tokens: They were tired and despondent , crouched in their watertight jumpsuits .


fn_spacy_tokens_for_baseline: She had planted some runner beans in the patch of the old vegetable garden he had dug earlier ; they were flowering energetically and seemed to have been worth the trouble .

source_bert_toks: she had planted some runner beans in the patch of the old vegetable garden he had dug earlier ; they were flowering energetic ##ally and seemed to have been worth the trouble .

reference_raw: She'd put some runner beans in a patch of old vegetable garden he'd dug before; they bloomed energetically, and seemed worth the trouble.

reference_spacy_tokens: She 'd put some runner beans in a patch of old vegetable garden he 'd dug before ; they bloomed energetically , and seemed worth the trouble .


fn_spacy_tokens_for_baseline: One Victorian explorer reported that he could catch these cats and tether them near his food stores to keep the rats down .

source_bert_toks: one victorian explorer reported that he could catch these cats and te ##ther them near his food stores to keep the rats down .

reference_raw: One of the Victorian scouts said he could catch the cats and tie them up near the food stores to keep the rats down.

reference_spacy_tokens: One of the Victorian scouts said he could catch the cats and tie them up near the food stores to keep the rats down .


fn_spacy_tokens_for_baseline: If the first were correct , surely a house full of children and servants would have heard poor William 's pleas and , even if they had been too frightened of his mother 's retribution to release him , surely they would have passed him food .

source_bert_toks: if the first were correct , surely a house full of children and servants would have heard poor william ' s pleas and , even if they had been too frightened of his mother ' s retribution to release him , surely they would have passed him food .

reference_raw: If the first had been right, a house full of children and servants would have heard poor William's pleas, and if they had been too afraid of his mother's vengeance to let him go, they would have given him food.

reference_spacy_tokens: If the first had been right , a house full of children and servants would have heard poor William 's pleas , and if they had been too afraid of his mother 's vengeance to let him go , they would have given him food .


fn_spacy_tokens_for_baseline: His head sank so low that his collar dented his bottom lip , and Sarah had touched his arm in sympathy , earning an even stronger rebuke herself .

source_bert_toks: his head sank so low that his collar dent ##ed his bottom lip , and sarah had touched his arm in sympathy , earning an even stronger re ##bu ##ke herself .

reference_raw: He dropped his head so low that his collar buried his lower lip, and Sarah touched his arm sympathetically, earning an even stronger rebuke herself.

reference_spacy_tokens: He dropped his head so low that his collar buried his lower lip , and Sarah touched his arm sympathetically , earning an even stronger rebuke herself .


fn_spacy_tokens_for_baseline: Nick had got the now , so there were no jokes , no idle chit - chat .

source_bert_toks: nick had got the now , so there were no jokes , no idle chi ##t - chat .

reference_raw: Nick's got it now, so there's no jokes, no idle chat.

reference_spacy_tokens: Nick 's got it now , so there 's no jokes , no idle chat .


fn_spacy_tokens_for_baseline: They 've fumbled their grip on ' youth ' culture and let it slide into their bottomless pockets .

source_bert_toks: they ' ve fumbled their grip on ' youth ' culture and let it slide into their bottom ##less pockets .

reference_raw: They reached for the 'youth' culture and let it slip into their bottomless pockets.

reference_spacy_tokens: They reached for the ' youth ' culture and let it slip into their bottomless pockets .


fn_spacy_tokens_for_baseline: His skin was bursting , stretched almost to transparency by the blood pumped down into it .

source_bert_toks: his skin was bursting , stretched almost to transparency by the blood pumped down into it .

reference_raw: His skin burst, stretched almost to transparency by the blood that poured into him.

reference_spacy_tokens: His skin burst , stretched almost to transparency by the blood that poured into him .


fn_spacy_tokens_for_baseline: Virgin 's boss , a millionaire before he was 21 , stressed that the multi - nationals should stop laying people off and inject some risk capital into the country .

source_bert_toks: virgin ' s boss , a millionaire before he was 21 , stressed that the multi - nationals should stop laying people off and in ##ject some risk capital into the country .

reference_raw: Virgin's boss, a millionaire before he was 21, stressed that multinationals should stop firing people and put some risk capital into the country.

reference_spacy_tokens: Virgin 's boss , a millionaire before he was 21 , stressed that multinationals should stop firing people and put some risk capital into the country .


fn_spacy_tokens_for_baseline: The Persians were defeated , and Athens duly punished the islands that had turned against it .

source_bert_toks: the persians were defeated , and athens duly punished the islands that had turned against it .

reference_raw: The Persians had been defeated, and Athens had properly punished the islands that had turned on them.

reference_spacy_tokens: The Persians had been defeated , and Athens had properly punished the islands that had turned on them .


fn_spacy_tokens_for_baseline: Already his mouth was watering at the prospect of sinking his teeth into a thick slice of bread liberally spread with best butter and sprinkled with sugar from one of the big sacks standing in the corner .

source_bert_toks: already his mouth was watering at the prospect of sinking his teeth into a thick slice of bread liberal ##ly spread with best butter and sp ##rin ##kled with sugar from one of the big sacks standing in the corner .

reference_raw: He was already watering his mouth with the prospect of sinking his teeth into a thick slice of bread, liberally spread with the best butter, and spilling sugar from one of the large sacks in the corner.

reference_spacy_tokens: He was already watering his mouth with the prospect of sinking his teeth into a thick slice of bread , liberally spread with the best butter , and spilling sugar from one of the large sacks in the corner .


fn_spacy_tokens_for_baseline: Walk up the steps to reach Caine Lane , where you 'll find the Museum of Medical Sciences ( open Tuesday - Saturday 10 am - 5 pm ; admission by donation ) .

source_bert_toks: walk up the steps to reach caine lane , where you ' ll find the museum of medical sciences ( open tuesday - saturday 10 am - 5 pm ; admission by donation ) .

reference_raw: Go up the stairs to Caine Lane, where you will find the Museum of Medical Sciences (Open Tuesday - Saturday 10 - 5:00 a.m.

reference_spacy_tokens: Go up the stairs to Caine Lane , where you will find the Museum of Medical Sciences ( Open Tuesday - Saturday 10 - 5:00 a.m.


fn_spacy_tokens_for_baseline: On 23 June 1996 , the Sunday Telegraph reported about a " secret multi - million - pound deal with the Indian government which will supply banned materials used to manufacture poison gas . "

source_bert_toks: on 23 june 1996 , the sunday telegraph reported about a " secret multi - million - pound deal with the indian government which will supply banned materials used to manufacture poison gas . "

reference_raw: On 23 June 1996, the Sunday Telegraph announced a "secret multi-million-pound deal with the Indian government that would supply prohibited materials used for the production of poison gas."

reference_spacy_tokens: On 23 June 1996 , the Sunday Telegraph announced a " secret multi - million - pound deal with the Indian government that would supply prohibited materials used for the production of poison gas . "


fn_spacy_tokens_for_baseline: In an outhouse the Rottweiler roared his rage at the intrusion .

source_bert_toks: in an out ##house the rot ##t ##weiler roared his rage at the intrusion .

reference_raw: In the outhouse, the Rottweiler bellowed his anger at the intrusion.

reference_spacy_tokens: In the outhouse , the Rottweiler bellowed his anger at the intrusion .


fn_spacy_tokens_for_baseline: The voice of Chaos thundered in the valleys .

source_bert_toks: the voice of chaos thunder ##ed in the valleys .

reference_raw: Chaos's voice rumbled in the valleys.

reference_spacy_tokens: Chaos 's voice rumbled in the valleys .


fn_spacy_tokens_for_baseline: For nobody wanted to know about her bathtime invention .

source_bert_toks: for nobody wanted to know about her bath ##time invention .

reference_raw: Because no one wanted to know about her idea of bathing time.

reference_spacy_tokens: Because no one wanted to know about her idea of bathing time .


fn_spacy_tokens_for_baseline: As the plane circled in wide sweeps , each one lower than the other , the Pack did pray -- silently , sincerely -- Brown Owl with them .

source_bert_toks: as the plane circled in wide sweeps , each one lower than the other , the pack did pray - - silently , sincerely - - brown owl with them .

reference_raw: As the plane wheeled in broad sweeps, each lower than the other, the pack prayed - quietly, sincerely - with them the Brown Owl.

reference_spacy_tokens: As the plane wheeled in broad sweeps , each lower than the other , the pack prayed - quietly , sincerely - with them the Brown Owl .


fn_spacy_tokens_for_baseline: The bridesmaids wore very pretty dresses also made of ivory wild silk with pale pink sashes and circlets of white flowers on their heads .

source_bert_toks: the bride ##sma ##ids wore very pretty dresses also made of ivory wild silk with pale pink sash ##es and circle ##ts of white flowers on their heads .

reference_raw: The bridesmaids wore very beautiful dresses, also made of ivory wild silk, with pale pink sashes and a circle of white flowers on their heads.

reference_spacy_tokens: The bridesmaids wore very beautiful dresses , also made of ivory wild silk , with pale pink sashes and a circle of white flowers on their heads .


fn_spacy_tokens_for_baseline: These are held in place by wooden boards , supported by pegs .

source_bert_toks: these are held in place by wooden boards , supported by peg ##s .

reference_raw: They are held in place by wooden boards with pegs.

reference_spacy_tokens: They are held in place by wooden boards with pegs .


fn_spacy_tokens_for_baseline: Wainfleet did not want it back , the only reason he was carrying it around was that he had jotted a telephone number on the back .

source_bert_toks: wai ##n ##fleet did not want it back , the only reason he was carrying it around was that he had jo ##tted a telephone number on the back .

reference_raw: Wainfleet didn't want it back, and the only reason he carried it was because he'd written a phone number on the back.

reference_spacy_tokens: Wainfleet did n't want it back , and the only reason he carried it was because he 'd written a phone number on the back .


fn_spacy_tokens_for_baseline: The bigger nations , for their part , have already developed systems of takeover supervision , and do not want to be encumbered with another layer of M & A bureaucracy .

source_bert_toks: the bigger nations , for their part , have already developed systems of takeover supervision , and do not want to be en ##cum ##bered with another layer of m & a bureaucracy .

reference_raw: Larger countries, on the other hand, have already developed takeover surveillance systems and do not want to be burdened with another layer of M&A bureaucracy.

reference_spacy_tokens: Larger countries , on the other hand , have already developed takeover surveillance systems and do not want to be burdened with another layer of M&A bureaucracy .


fn_spacy_tokens_for_baseline: China is a party to most of the major international agreements regulating biological weapons , including the Geneva Protocol and the Biological and Toxin Weapons Convention ( BWC or BTWC ) .

source_bert_toks: china is a party to most of the major international agreements regulating biological weapons , including the geneva protocol and the biological and toxin weapons convention ( b ##wc or bt ##wc ) .

reference_raw: China is a party to most of the main international agreements governing biological weapons, including the Geneva Convention and the Convention on Biological and Toxin Weapons (BWC or BTWC).

reference_spacy_tokens: China is a party to most of the main international agreements governing biological weapons , including the Geneva Convention and the Convention on Biological and Toxin Weapons ( BWC or BTWC ) .


fn_spacy_tokens_for_baseline: The pupils discussed , then as later , whether a horse 's hair across the palm of the hand would split the bamboo cane picked by the master for its elastic swishing quality .

source_bert_toks: the pupils discussed , then as later , whether a horse ' s hair across the palm of the hand would split the bamboo cane picked by the master for its elastic sw ##ishing quality .

reference_raw: Then, later, the students discussed whether the horse's hair on the palm of his hand would split the bamboo stick the master had chosen for its elastic swishing quality.

reference_spacy_tokens: Then , later , the students discussed whether the horse 's hair on the palm of his hand would split the bamboo stick the master had chosen for its elastic swishing quality .


fn_spacy_tokens_for_baseline: They made sure children got safely on to the chairlift and picked them up and dusted them down if they fell .

source_bert_toks: they made sure children got safely on to the chair ##lift and picked them up and dust ##ed them down if they fell .

reference_raw: They arranged for the children to get safely into the elevator, picked them up, and dusted them if they fell.

reference_spacy_tokens: They arranged for the children to get safely into the elevator , picked them up , and dusted them if they fell .


fn_spacy_tokens_for_baseline: Monsieur Truffer came in our car and directed us through Cherbourg and up to Bourbourg , which is on a hillside rising behind the east side of the Harbour .

source_bert_toks: monsieur tr ##uf ##fer came in our car and directed us through cher ##bourg and up to bo ##ur ##bourg , which is on a hillside rising behind the east side of the harbour .

reference_raw: Mr. Truffer came into our car and led us through Cherbourg to Bourbourg, which is on a hill that slopes to the east of the Harbour.

reference_spacy_tokens: Mr. Truffer came into our car and led us through Cherbourg to Bourbourg , which is on a hill that slopes to the east of the Harbour .


fn_spacy_tokens_for_baseline: Skischools nearly always have classes for expert skiers which explore the mountains with their instructors .

source_bert_toks: ski ##sch ##ool ##s nearly always have classes for expert skier ##s which explore the mountains with their instructors .

reference_raw: Skischools almost always have a class for professional skiers who explore the mountains with their instructors.

reference_spacy_tokens: Skischools almost always have a class for professional skiers who explore the mountains with their instructors .


fn_spacy_tokens_for_baseline: This limit is to be obligatory in vulnerable areas which are to be designated over the next two years .

source_bert_toks: this limit is to be obligatory in vulnerable areas which are to be designated over the next two years .

reference_raw: This limit should be mandatory in vulnerable areas to be identified for the next two years.

reference_spacy_tokens: This limit should be mandatory in vulnerable areas to be identified for the next two years .


fn_spacy_tokens_for_baseline: I might even have griped about my existence with the Gorengs and thought wistfully of alternatives .

source_bert_toks: i might even have grip ##ed about my existence with the gore ##ng ##s and thought wi ##st ##fully of alternatives .

reference_raw: I could even accept my existence with the Gorengs, thinking thoughtfully of alternatives.

reference_spacy_tokens: I could even accept my existence with the Gorengs , thinking thoughtfully of alternatives .


fn_spacy_tokens_for_baseline: Then , a couple of minutes later , it went totally silent , and that unsettled her even further .

source_bert_toks: then , a couple of minutes later , it went totally silent , and that un ##sett ##led her even further .

reference_raw: Then, a few minutes later, she was completely silent, and that bothered her even more.

reference_spacy_tokens: Then , a few minutes later , she was completely silent , and that bothered her even more .


fn_spacy_tokens_for_baseline: Fred fidgeted in his chair .

source_bert_toks: fred fi ##dget ##ed in his chair .

reference_raw: Fred shifted in his chair.

reference_spacy_tokens: Fred shifted in his chair .


fn_spacy_tokens_for_baseline: Conscious awareness and reflection on one 's own experience is thought to have an inhibiting effect .

source_bert_toks: conscious awareness and reflection on one ' s own experience is thought to have an inhibit ##ing effect .

reference_raw: Conscious awareness and consideration of one's own experience is considered to be an inhibitory effect.

reference_spacy_tokens: Conscious awareness and consideration of one 's own experience is considered to be an inhibitory effect .


fn_spacy_tokens_for_baseline: Robyn watched from the shelter of the long cream curtains which shrouded the vast downstairs window , her finger curled thankfully around the mug of hot , hot coffee .

source_bert_toks: robyn watched from the shelter of the long cream curtains which sh ##roud ##ed the vast downstairs window , her finger curled thankfully around the mug of hot , hot coffee .

reference_raw: Robyn watched from the cover of the long cream curtains that covered the huge downstairs window, her finger curled gratefully around a cup of hot coffee.

reference_spacy_tokens: Robyn watched from the cover of the long cream curtains that covered the huge downstairs window , her finger curled gratefully around a cup of hot coffee .


fn_spacy_tokens_for_baseline: At night the beaches flamed with bonfires lit to extract lime from the coral , which was then mixed with coconut oil to form the white cement with which the hulls were caulked .

source_bert_toks: at night the beaches flame ##d with bonfire ##s lit to extract lime from the coral , which was then mixed with coconut oil to form the white cement with which the hull ##s were ca ##ul ##ked .

reference_raw: At night, the beaches lit with fires to extract lime from the coral, which was then mixed with coconut oil to form the white cement with which the hulls were made.

reference_spacy_tokens: At night , the beaches lit with fires to extract lime from the coral , which was then mixed with coconut oil to form the white cement with which the hulls were made .


fn_spacy_tokens_for_baseline: It has been suggested that perhaps cytoplasmic proteins are not exported in prl suppressor strains because they fold rapidly and escape recognition by SecB , while secretory proteins , even those lacking a signal sequence , fold more slowly , allowing time for SecB recognition and binding [ 5 13]. SecB binds to a variety of unfolded proteins in vitro [ 24 25 ] , although binding appears to be more selective in vivo [ 26]. This selectivity may be based on the slower folding characteristics of secretory proteins .

source_bert_toks: it has been suggested that perhaps cy ##top ##las ##mic proteins are not exported in pr ##l suppress ##or strains because they fold rapidly and escape recognition by sec ##b , while secret ##ory proteins , even those lacking a signal sequence , fold more slowly , allowing time for sec ##b recognition and binding [ 5 13 ] . sec ##b binds to a variety of unfolded proteins in vitro [ 24 25 ] , although binding appears to be more selective in vivo [ 26 ] . this select ##ivity may be based on the slower folding characteristics of secret ##ory proteins .

reference_raw: It has been suggested that cytoplasmic proteins may not be exported in prl suppressor strains, because they are rapidly assembled and cannot be recognised by the SECB, whereas secretory proteins, even those with no signal sequence, are refolding more slowly, allowing time for SECB recognition and binding [5 13], are bound to different unfolded proteins in vitro [24 25], although binding appears to be more selective in vivo [26]. This selectivity may be based on the slower-folding properties of secretory proteins.

reference_spacy_tokens: It has been suggested that cytoplasmic proteins may not be exported in prl suppressor strains , because they are rapidly assembled and can not be recognised by the SECB , whereas secretory proteins , even those with no signal sequence , are refolding more slowly , allowing time for SECB recognition and binding [ 5 13 ] , are bound to different unfolded proteins in vitro [ 24 25 ] , although binding appears to be more selective in vivo [ 26]. This selectivity may be based on the slower - folding properties of secretory proteins .


fn_spacy_tokens_for_baseline: It really deserves a more romantic name , Plockton meaning the town on the headland .

source_bert_toks: it really deserves a more romantic name , pl ##ock ##ton meaning the town on the head ##land .

reference_raw: He really deserves a more romantic name, and Plockton means the city of the country.

reference_spacy_tokens: He really deserves a more romantic name , and Plockton means the city of the country .


fn_spacy_tokens_for_baseline: One minute he was embracing her , kissing her passionately , and now he was leaping around the bedroom like a young gallant , getting ready to get out .

source_bert_toks: one minute he was embracing her , kissing her passionate ##ly , and now he was leaping around the bedroom like a young gallant , getting ready to get out .

reference_raw: One minute he was hugging her, kissing her passionately, and now he was bouncing around the room like a young gallant, preparing to leave.

reference_spacy_tokens: One minute he was hugging her , kissing her passionately , and now he was bouncing around the room like a young gallant , preparing to leave .


fn_spacy_tokens_for_baseline: When they arrived at the house , they saw a man whom they had good reason to suppose to be the assailant washing blood from himself .

source_bert_toks: when they arrived at the house , they saw a man whom they had good reason to suppose to be the ass ##ail ##ant washing blood from himself .

reference_raw: When they reached the house, they saw a man they had good reason to believe was the attacker who was cleaning his own blood.

reference_spacy_tokens: When they reached the house , they saw a man they had good reason to believe was the attacker who was cleaning his own blood .


fn_spacy_tokens_for_baseline: The severity of these symptoms was graded into four categories : absent , mild , moderate , or severe , according to De Meester et al 's criteria .

source_bert_toks: the severity of these symptoms was graded into four categories : absent , mild , moderate , or severe , according to de me ##ester et al ' s criteria .

reference_raw: The severity of these symptoms was divided into four categories: absent, mild, moderate or severe according to the criteria of De Meester et al.

reference_spacy_tokens: The severity of these symptoms was divided into four categories : absent , mild , moderate or severe according to the criteria of De Meester et al .


fn_spacy_tokens_for_baseline: But the Jezebel poems went far beyond vilification of Elizabeth .

source_bert_toks: but the je ##ze ##bel poems went far beyond vi ##li ##fication of elizabeth .

reference_raw: But Jezebel's poems have gone far beyond Elizabeth's vulnerabilities.

reference_spacy_tokens: But Jezebel 's poems have gone far beyond Elizabeth 's vulnerabilities .


fn_spacy_tokens_for_baseline: I 'm short and Jewish .

source_bert_toks: i ' m short and jewish .

reference_raw: I'm small and I'm Jewish.

reference_spacy_tokens: I 'm small and I 'm Jewish .


fn_spacy_tokens_for_baseline: Local historian Count Nikolai Tolstoy , who has himself given evidence in the war crimes trial of John Demianuk , says he 's in favour of prosecutions .

source_bert_toks: local historian count nikolai to ##ls ##toy , who has himself given evidence in the war crimes trial of john demi ##anu ##k , says he ' s in favour of prosecution ##s .

reference_raw: The local historian Count Nikolai Tolstoy, who himself testifyed in John Demianuk's war crimes case, says he's in favor of the prosecution.

reference_spacy_tokens: The local historian Count Nikolai Tolstoy , who himself testifyed in John Demianuk 's war crimes case , says he 's in favor of the prosecution .


fn_spacy_tokens_for_baseline: On the Silver and Knitmaster Chunky and double knit ribbers , these controls are on the right and left edge of the carriage towards the bottom .

source_bert_toks: on the silver and knit ##master chunk ##y and double knit rib ##bers , these controls are on the right and left edge of the carriage towards the bottom .

reference_raw: On silver and Knitmaster Chunky and double knit ribbers, these controls are on the right and right side of the wagon to the bottom.

reference_spacy_tokens: On silver and Knitmaster Chunky and double knit ribbers , these controls are on the right and right side of the wagon to the bottom .


fn_spacy_tokens_for_baseline: The traditional way to cook them was fry them alive in hot bacon fat , then add an egg , which had the effect of binding them together .

source_bert_toks: the traditional way to cook them was fry them alive in hot bacon fat , then add an egg , which had the effect of binding them together .

reference_raw: The traditional way to cook them was to fry them alive with hot bacon grease and then add an egg that would bind them together.

reference_spacy_tokens: The traditional way to cook them was to fry them alive with hot bacon grease and then add an egg that would bind them together .


fn_spacy_tokens_for_baseline: Late in the evening , she finally slipped up to her bedroom , walking barefooted so that she would n't be heard .

source_bert_toks: late in the evening , she finally slipped up to her bedroom , walking barefoot ##ed so that she wouldn ' t be heard .

reference_raw: Late in the evening, she finally slipped into her bedroom and walked naked so no one could hear her.

reference_spacy_tokens: Late in the evening , she finally slipped into her bedroom and walked naked so no one could hear her .


fn_spacy_tokens_for_baseline: Sure enough , Bumboy came lolloping out of its stall , each leg going somewhere different , neighing and dumping in its blinkers and Dobbin hat .

source_bert_toks: sure enough , bum ##boy came lo ##llo ##ping out of its stall , each leg going somewhere different , ne ##igh ##ing and dumping in its blink ##ers and do ##bb ##in hat .

reference_raw: Of course, Bumboy lolled out of the stall, each leg moving in a different direction, weighing and dumping in his blinkers and Dobbin's hat.

reference_spacy_tokens: Of course , Bumboy lolled out of the stall , each leg moving in a different direction , weighing and dumping in his blinkers and Dobbin 's hat .


fn_spacy_tokens_for_baseline: He 's waiting for a thank you or some kind of acknowledgment of his help .

source_bert_toks: he ' s waiting for a thank you or some kind of ac ##k ##now ##led ##gm ##ent of his help .

reference_raw: He's expecting a thank-you or some confirmation of his help.

reference_spacy_tokens: He 's expecting a thank - you or some confirmation of his help .


fn_spacy_tokens_for_baseline: On 14 May 1994 , Korean technicians began removing the spent fuel rods without the supervision of IAEA inspectors .

source_bert_toks: on 14 may 1994 , korean technicians began removing the spent fuel rods without the supervision of ia ##ea inspectors .

reference_raw: On 14 May 1994, Korean engineers began to remove spent fuel rods without the supervision of IAEA inspectors.

reference_spacy_tokens: On 14 May 1994 , Korean engineers began to remove spent fuel rods without the supervision of IAEA inspectors .


fn_spacy_tokens_for_baseline: All of a sudden I realized how barbaric it was and that I did n't have to do it .

source_bert_toks: all of a sudden i realized how bar ##bari ##c it was and that i didn ' t have to do it .

reference_raw: I suddenly realized how barbarous that was, and I didn't have to do it.

reference_spacy_tokens: I suddenly realized how barbarous that was , and I did n't have to do it .


fn_spacy_tokens_for_baseline: Still drowsy and warm from sleep , she lay thinking of Johnny Latimer and whether Time or the house ( for she could not decide which it was that played the tricks and pulled the strings ) would let him come back to her again .

source_bert_toks: still dr ##ows ##y and warm from sleep , she lay thinking of johnny la ##time ##r and whether time or the house ( for she could not decide which it was that played the tricks and pulled the strings ) would let him come back to her again .

reference_raw: Still sleepy and hot from sleep, she lay thinking about Johnny Latimer, and whether Time or the house (because she couldn't decide who was playing tricks and pulling strings) would let him come back to her.

reference_spacy_tokens: Still sleepy and hot from sleep , she lay thinking about Johnny Latimer , and whether Time or the house ( because she could n't decide who was playing tricks and pulling strings ) would let him come back to her .


fn_spacy_tokens_for_baseline: There was no fire , and the pilot and passenger were able to evacuate the aircraft unaided and unhurt .

source_bert_toks: there was no fire , and the pilot and passenger were able to evacuate the aircraft una ##ided and un ##hur ##t .

reference_raw: There was no fire, and the pilot and the passenger were able to leave the aircraft unaided and unhurt.

reference_spacy_tokens: There was no fire , and the pilot and the passenger were able to leave the aircraft unaided and unhurt .


fn_spacy_tokens_for_baseline: About one hundred sculptures and constructions , the majority loaned by the Fundacio Joan Miro and shown with related drawings and sketches .

source_bert_toks: about one hundred sculptures and constructions , the majority loaned by the fund ##acio joan mir ##o and shown with related drawings and sketches .

reference_raw: About a hundred statues and buildings, most of which were lent by Fundacio Joan Miro and displayed with related drawings and drawings.

reference_spacy_tokens: About a hundred statues and buildings , most of which were lent by Fundacio Joan Miro and displayed with related drawings and drawings .


fn_spacy_tokens_for_baseline: On the main floor a lorry serves as a DJ booth ( cab ) and stage ( trailer ) , and the walls and ceiling are festooned with white camouflage netting .

source_bert_toks: on the main floor a lo ##rry serves as a dj booth ( cab ) and stage ( trailer ) , and the walls and ceiling are fest ##oon ##ed with white camouflage netting .

reference_raw: On the main floor, the truck serves as a DJ booth (cab) and stage (trailer) and the walls and ceiling are covered with white camouflage netting.

reference_spacy_tokens: On the main floor , the truck serves as a DJ booth ( cab ) and stage ( trailer ) and the walls and ceiling are covered with white camouflage netting .


fn_spacy_tokens_for_baseline: Early mining of the concealed coal measures in Nottinghamshire occurred to the northeast of the county town , with later expansion at the end of the nineteenth century in the Mansfield area ( Waller , 1983 ) .

source_bert_toks: early mining of the concealed coal measures in nottinghamshire occurred to the northeast of the county town , with later expansion at the end of the nineteenth century in the mansfield area ( waller , 1983 ) .

reference_raw: Early mining of hidden coal measures in Nottinghamshire took place in the north-east of the county city, and later expansion in Mansfield at the end of the nineteenth century (Waller, 1983).

reference_spacy_tokens: Early mining of hidden coal measures in Nottinghamshire took place in the north - east of the county city , and later expansion in Mansfield at the end of the nineteenth century ( Waller , 1983 ) .


fn_spacy_tokens_for_baseline: Their aircraft pushed back from the gate just before 8:00 .

source_bert_toks: their aircraft pushed back from the gate just before 8 : 00 .

reference_raw: Their plane pulled out of the gate just before eight o'clock.

reference_spacy_tokens: Their plane pulled out of the gate just before eight o'clock .


fn_spacy_tokens_for_baseline: ' What guilty neglect and vicious treatment ' , wrote one clergyman , ' could have led to all the depravity of the maritime population ?

source_bert_toks: ' what guilty neglect and vicious treatment ' , wrote one clergyman , ' could have led to all the de ##pr ##avi ##ty of the maritime population ?

reference_raw: "What guilty negligence and malicious treatment", written by a priest, could lead to all the perversions of the marine population?

reference_spacy_tokens: " What guilty negligence and malicious treatment " , written by a priest , could lead to all the perversions of the marine population ?


fn_spacy_tokens_for_baseline: But this animal -- which I nicknamed ' Ginger ' -- is fawn or biscuit - coloured all over .

source_bert_toks: but this animal - - which i nicknamed ' ginger ' - - is fa ##wn or bis ##cuit - coloured all over .

reference_raw: But this animal, which I called "Ginger", is full of fawn and cookies.

reference_spacy_tokens: But this animal , which I called " Ginger " , is full of fawn and cookies .


fn_spacy_tokens_for_baseline: The crime was ascribed to Nihilism , and the murderers were never arrested .

source_bert_toks: the crime was ascribed to ni ##hil ##ism , and the murderers were never arrested .

reference_raw: The murder was attributed to Nihilism, and the killers were never arrested.

reference_spacy_tokens: The murder was attributed to Nihilism , and the killers were never arrested .


fn_spacy_tokens_for_baseline: One of the most vexing problems is when and how to mingle the male and female laundry .

source_bert_toks: one of the most ve ##xing problems is when and how to ming ##le the male and female laundry .

reference_raw: One of the most sexual problems is when and how to mix a man's and a woman's laundry.

reference_spacy_tokens: One of the most sexual problems is when and how to mix a man 's and a woman 's laundry .


fn_spacy_tokens_for_baseline: The government urged betel chewers throughout the country to spit the red juice in spittoons .

source_bert_toks: the government urged bet ##el chew ##ers throughout the country to spit the red juice in spit ##to ##ons .

reference_raw: The government urged betel chewers all over the country to spit red juice in spits.

reference_spacy_tokens: The government urged betel chewers all over the country to spit red juice in spits .


fn_spacy_tokens_for_baseline: Using computer overlays and databases , for example , the military figured out the patterns insurgents were using for conducting car bombing operations .

source_bert_toks: using computer over ##lay ##s and databases , for example , the military figured out the patterns insurgents were using for conducting car bombing operations .

reference_raw: For example, using computer overlays and databases, the military discovered the models used by the rebels to carry out car bombing operations.

reference_spacy_tokens: For example , using computer overlays and databases , the military discovered the models used by the rebels to carry out car bombing operations .


fn_spacy_tokens_for_baseline: The US Semiconductor Industry Association has denied those claims by Japan that US companies cancelled semiconductor shipments to Japanese firms after orders had been placed .

source_bert_toks: the us semiconductor industry association has denied those claims by japan that us companies cancelled semiconductor shipments to japanese firms after orders had been placed .

reference_raw: The US Semiconductor Industry Association rejected Japan's claim that the US companies cancelled the semiconductor shipments to Japanese companies after the orders were issued.

reference_spacy_tokens: The US Semiconductor Industry Association rejected Japan 's claim that the US companies cancelled the semiconductor shipments to Japanese companies after the orders were issued .


fn_spacy_tokens_for_baseline: The other , Ronald Radosh , had described it as " heavy and plodding , without any real juice to it . "

source_bert_toks: the other , ronald ra ##dos ##h , had described it as " heavy and pl ##od ##ding , without any real juice to it . "

reference_raw: The other one, Ronald Radosh, described it as "heavy and plodding, with no real juicy."

reference_spacy_tokens: The other one , Ronald Radosh , described it as " heavy and plodding , with no real juicy . "


fn_spacy_tokens_for_baseline: Last night Tom McGovern , a member the yard 's industrial committee , vowed to fight any enforced redundancies .

source_bert_toks: last night tom mc ##go ##vern , a member the yard ' s industrial committee , vowed to fight any enforced red ##unda ##ncies .

reference_raw: Last night, Tom McGovern, a member of the yard's industrial committee, promised to fight any forced dismissal.

reference_spacy_tokens: Last night , Tom McGovern , a member of the yard 's industrial committee , promised to fight any forced dismissal .


fn_spacy_tokens_for_baseline: Charlotte knew she should glean as much as she possibly could , but her brain seemed sluggish and uninventive .

source_bert_toks: charlotte knew she should g ##lean as much as she possibly could , but her brain seemed slug ##gis ##h and un ##in ##vent ##ive .

reference_raw: Charlotte knew she was supposed to glee as much as she could, but her brain seemed slow and uninventive.

reference_spacy_tokens: Charlotte knew she was supposed to glee as much as she could , but her brain seemed slow and uninventive .


fn_spacy_tokens_for_baseline: As he was putting their luggage into the book , the girl came out of the hotel carrying her backpack .

source_bert_toks: as he was putting their luggage into the book , the girl came out of the hotel carrying her backpack .

reference_raw: As he put their bags in the book, the girl left the hotel with her pack.

reference_spacy_tokens: As he put their bags in the book , the girl left the hotel with her pack .


fn_spacy_tokens_for_baseline: Dover is now proposing a third force that can genetically transform a species ; transforming not because of the external forces of selection or drift , but from within .

source_bert_toks: dover is now proposing a third force that can genetically transform a species ; transforming not because of the external forces of selection or drift , but from within .

reference_raw: Dover is now proposing a third force that can genetically alter a species; it is changing not from the external forces of choice or drift, but from the inside.

reference_spacy_tokens: Dover is now proposing a third force that can genetically alter a species ; it is changing not from the external forces of choice or drift , but from the inside .


fn_spacy_tokens_for_baseline: The same effect occurs in cattle , though cattle belch out surplus methane .

source_bert_toks: the same effect occurs in cattle , though cattle bel ##ch out surplus methane .

reference_raw: The same effect occurs in bovine animals, although the cattle bellow over the excess methane.

reference_spacy_tokens: The same effect occurs in bovine animals , although the cattle bellow over the excess methane .


fn_spacy_tokens_for_baseline: In other news , I accidently found myself setting up a meeting that is NOT MY JOB .

source_bert_toks: in other news , i accident ##ly found myself setting up a meeting that is not my job .

reference_raw: In other news, I happen to have arranged a meeting that's not my JOB.

reference_spacy_tokens: In other news , I happen to have arranged a meeting that 's not my JOB .


fn_spacy_tokens_for_baseline: Me , I was forthcoming with the details .

source_bert_toks: me , i was forthcoming with the details .

reference_raw: I, I've been accommodating with the details.

reference_spacy_tokens: I , I 've been accommodating with the details .