fn_spacy_tokens_for_baseline: Before entering into detailed debate on these contentious issues it is important to emphasise two general points .

source_bert_toks: before entering into detailed debate on these contentious issues it is important to emphasis ##e two general points .

reference_raw: Before embarking on a detailed discussion on these questions, it is important to highlight two general points.

reference_spacy_tokens: Before embarking on a detailed discussion on these questions , it is important to highlight two general points .


fn_spacy_tokens_for_baseline: Athens became the most powerful , heralding the start of the classical Greek period .

source_bert_toks: athens became the most powerful , herald ##ing the start of the classical greek period .

reference_raw: Athens became the strongest and heralded the beginning of the classic Greek era.

reference_spacy_tokens: Athens became the strongest and heralded the beginning of the classic Greek era .


fn_spacy_tokens_for_baseline: " We 've tried to train the youngsters , but they have their discos and their dances , and they just drift away .

source_bert_toks: " we ' ve tried to train the young ##sters , but they have their disco ##s and their dances , and they just drift away .

reference_raw: "We've been trying to train young people, but they've got discos and dances, and they're just drifting away.

reference_spacy_tokens: " We 've been trying to train young people , but they 've got discos and dances , and they 're just drifting away .


fn_spacy_tokens_for_baseline: A handbook of historical stringing practice for keyboard instruments

source_bert_toks: a handbook of historical string ##ing practice for keyboard instruments

reference_raw: Manual of Historical Stringing Practices for Keyboard Instruments


fn_spacy_tokens_for_baseline: Some eruptions have become major historical events , since many of the world 's greatest natural disasters have been associated with volcanoes , either directly through the effects of explosions and suffocation by volcanic gases , or indirectly through the much further - reaching effects of tidal waves triggered off by an eruption , such as those resulting from the great eruption of Krakatoa in 1883 .

source_bert_toks: some eruptions have become major historical events , since many of the world ' s greatest natural disasters have been associated with volcanoes , either directly through the effects of explosions and su ##ff ##ocation by volcanic gases , or indirectly through the much further - reaching effects of tidal waves triggered off by an eruption , such as those resulting from the great eruption of k ##rak ##ato ##a in 1883 .

reference_raw: Some eruptions have become major historical events, as many of the biggest natural disasters in the world are linked to volcanoes, either directly by the effects of volcanic gas explosions and asphyxiation, or indirectly by the far-reaching effects of tidal waves triggered by eruptions, such as those caused by the massive eruption of Krakatoa in 1883.

reference_spacy_tokens: Some eruptions have become major historical events , as many of the biggest natural disasters in the world are linked to volcanoes , either directly by the effects of volcanic gas explosions and asphyxiation , or indirectly by the far - reaching effects of tidal waves triggered by eruptions , such as those caused by the massive eruption of Krakatoa in 1883 .


fn_spacy_tokens_for_baseline: You Sheik announced war on those , with the opposings of many sectors and scholars of decision making .

source_bert_toks: you she ##ik announced war on those , with the opposing ##s of many sectors and scholars of decision making .

reference_raw: You Sheik has declared war on them, with opposition from many industries and decision-making scholars.

reference_spacy_tokens: You Sheik has declared war on them , with opposition from many industries and decision - making scholars .


fn_spacy_tokens_for_baseline: A key question is how U.S. deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of Chinese strategic modernization .

source_bert_toks: a key question is how u . s . deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and scope of chinese strategic modernization .

reference_raw: The key issue is how the US deployment of ballistic missile defense (formerly known as theater and national missile defense) will affect the pace and extent of Chinese strategic modernisation.

reference_spacy_tokens: The key issue is how the US deployment of ballistic missile defense ( formerly known as theater and national missile defense ) will affect the pace and extent of Chinese strategic modernisation .


fn_spacy_tokens_for_baseline: Consequently , Canada 's total trade deficit with other nations widened by half a billion dollars from $ 2.6 billion to $ 3.1 billion in February .

source_bert_toks: consequently , canada ' s total trade deficit with other nations widened by half a billion dollars from $ 2 . 6 billion to $ 3 . 1 billion in february .

reference_raw: As a result, Canada's overall trade deficit with other countries increased by half a billion dollars from $2.6 billion to $3.1 billion in February.

reference_spacy_tokens: As a result , Canada 's overall trade deficit with other countries increased by half a billion dollars from $ 2.6 billion to $ 3.1 billion in February .


fn_spacy_tokens_for_baseline: After moisturising , disguise thread veins , blemishes and dark circles under the eyes with a good concealer .

source_bert_toks: after moist ##uri ##sing , disguise thread veins , b ##lem ##ish ##es and dark circles under the eyes with a good conceal ##er .

reference_raw: After wetness, mask the thready veins, blemishes, and dark circles under the eyes with a good cover.

reference_spacy_tokens: After wetness , mask the thready veins , blemishes , and dark circles under the eyes with a good cover .


fn_spacy_tokens_for_baseline: Alleged White House gunman Robert Pickett was arraigned Wednesday at a federal court in Washington and ordered held without bond .

source_bert_toks: alleged white house gun ##man robert picket ##t was ar ##rai ##gned wednesday at a federal court in washington and ordered held without bond .

reference_raw: The alleged White House shooter Robert Pickett was arrested in a federal court in Washington on Wednesday and ordered to be held unbound.

reference_spacy_tokens: The alleged White House shooter Robert Pickett was arrested in a federal court in Washington on Wednesday and ordered to be held unbound .


fn_spacy_tokens_for_baseline: Temperatures here vary only a few degrees from about 27 C ( 80 F ) , although the heat is tempered by the nearly continuous trade winds that blow across the Atlantic .

source_bert_toks: temperatures here vary only a few degrees from about 27 c ( 80 f ) , although the heat is tempered by the nearly continuous trade winds that blow across the atlantic .

reference_raw: The temperature is only slightly different from around 27 C (80 F), but the temperature is tempered by the almost constant commercial winds blowing across the Atlantic.

reference_spacy_tokens: The temperature is only slightly different from around 27 C ( 80 F ) , but the temperature is tempered by the almost constant commercial winds blowing across the Atlantic .


fn_spacy_tokens_for_baseline: No casualties have yet been reported , and no official property damage tally has yet been made , although Greek media have estimated tens of homes to have been damaged .

source_bert_toks: no casualties have yet been reported , and no official property damage tally has yet been made , although greek media have estimated tens of homes to have been damaged .

reference_raw: So far, no casualties have been reported and no official property damage has been reported, although the Greek media estimate that tens of homes have been damaged.

reference_spacy_tokens: So far , no casualties have been reported and no official property damage has been reported , although the Greek media estimate that tens of homes have been damaged .


fn_spacy_tokens_for_baseline: At the same time , the massive growth in air and road transport saw shipping decline in importance .

source_bert_toks: at the same time , the massive growth in air and road transport saw shipping decline in importance .

reference_raw: At the same time, the massive growth of air and road transport has witnessed a decline in the importance of shipping.

reference_spacy_tokens: At the same time , the massive growth of air and road transport has witnessed a decline in the importance of shipping .


fn_spacy_tokens_for_baseline: Her eyes were made up with heavy black eyeliner , her mouth was a deep red rosebud .

source_bert_toks: her eyes were made up with heavy black eye ##liner , her mouth was a deep red rose ##bu ##d .

reference_raw: Her eyes were heavy black eyes, and her mouth was a deep red rosebud.

reference_spacy_tokens: Her eyes were heavy black eyes , and her mouth was a deep red rosebud .


fn_spacy_tokens_for_baseline: Willie would return from school to find the living room filled with the musky perfume of freshly - cut branches burning in the range .

source_bert_toks: willie would return from school to find the living room filled with the mu ##sky perfume of freshly - cut branches burning in the range .

reference_raw: Willie would come back from school and find a living room full of the musky scent of freshly cut branches burning in the distance.

reference_spacy_tokens: Willie would come back from school and find a living room full of the musky scent of freshly cut branches burning in the distance .


fn_spacy_tokens_for_baseline: The drug lords who claimed responsibility said they would blow up the Bogota newspaper 's offices if it continued to distribute in Medellin .

source_bert_toks: the drug lords who claimed responsibility said they would blow up the bogota newspaper ' s offices if it continued to distribute in med ##elli ##n .

reference_raw: The drug lords who claimed to be responsible said they'd blow up the offices of the Bogota newspapers if it continued to be distributed in Medellin.

reference_spacy_tokens: The drug lords who claimed to be responsible said they 'd blow up the offices of the Bogota newspapers if it continued to be distributed in Medellin .


fn_spacy_tokens_for_baseline: KAMALA : The man mountain who annihilates all who get in his way

source_bert_toks: kamal ##a : the man mountain who ann ##ih ##ila ##tes all who get in his way

reference_raw: KAMALA: A man mountain that destroys all who stand in his way.

reference_spacy_tokens: KAMALA : A man mountain that destroys all who stand in his way .


fn_spacy_tokens_for_baseline: Outside the fog blanketed the tiny attic , a thick , grey blanket of splintered frost .

source_bert_toks: outside the fog blanket ##ed the tiny attic , a thick , grey blanket of splinter ##ed frost .

reference_raw: Outside the mist covered a small attic, a thick gray sheet of splintered frost.

reference_spacy_tokens: Outside the mist covered a small attic , a thick gray sheet of splintered frost .


fn_spacy_tokens_for_baseline: The night was full of the rasp and scrape of branches as the wind made the limbs of the trees beat against one another .

source_bert_toks: the night was full of the ras ##p and scrape of branches as the wind made the limbs of the trees beat against one another .

reference_raw: The night was filled with the rustling and scraping of branches as the wind caused the limbs of the trees to beat against each other.

reference_spacy_tokens: The night was filled with the rustling and scraping of branches as the wind caused the limbs of the trees to beat against each other .


fn_spacy_tokens_for_baseline: It all sounded so romantic , Nigel nearly threw up .

source_bert_toks: it all sounded so romantic , nigel nearly threw up .

reference_raw: It all sounded so romantic, Nigel almost vomited.

reference_spacy_tokens: It all sounded so romantic , Nigel almost vomited .


fn_spacy_tokens_for_baseline: He went to the Center Township Trustee for food stamps until he could find a job and a place to live .

source_bert_toks: he went to the center township trustee for food stamps until he could find a job and a place to live .

reference_raw: He went to the Center Township Trustee to get food stamps before he found a job and a place to live.

reference_spacy_tokens: He went to the Center Township Trustee to get food stamps before he found a job and a place to live .


fn_spacy_tokens_for_baseline: During this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

source_bert_toks: during this period , the indigenous people lived in caves , hunting the mammals that gathered at the shoreline .

reference_raw: During that time, the natives lived in caves and hunted mammals that had come to the shore.

reference_spacy_tokens: During that time , the natives lived in caves and hunted mammals that had come to the shore .


fn_spacy_tokens_for_baseline: Raynor becomes a coke fiend himself while Cates hovers perilously close .

source_bert_toks: ray ##nor becomes a coke fi ##end himself while cat ##es hove ##rs per ##ilo ##usly close .

reference_raw: Raynor becomes a coke devil while Cates floats dangerously close.

reference_spacy_tokens: Raynor becomes a coke devil while Cates floats dangerously close .


fn_spacy_tokens_for_baseline: Throughout his performance , Mr Baker allowed a carefully oiled strand of hair to fall over his forehead , clearly an attempt to steal the crown from the famous golden locks which thrilled successive Tory conferences .

source_bert_toks: throughout his performance , mr baker allowed a carefully oil ##ed strand of hair to fall over his forehead , clearly an attempt to steal the crown from the famous golden locks which thrilled successive tory conferences .

reference_raw: During his performance, Mr. Baker allowed a carefully oiled strand of hair to fall over his forehead, clearly an attempt to steal the crown from the famous gold locks that excited the subsequent Tory conferences.

reference_spacy_tokens: During his performance , Mr. Baker allowed a carefully oiled strand of hair to fall over his forehead , clearly an attempt to steal the crown from the famous gold locks that excited the subsequent Tory conferences .


fn_spacy_tokens_for_baseline: SPECIAL RULES : Savage Orcs can skirmish as described in the Warhammer rulebook .

source_bert_toks: special rules : savage or ##cs can skirmish as described in the war ##hammer rule ##book .

reference_raw: SPECIAL RULES: Savage Orcs can fight as described in the Warhammer rulebook.

reference_spacy_tokens: SPECIAL RULES : Savage Orcs can fight as described in the Warhammer rulebook .


fn_spacy_tokens_for_baseline: Even in their befuddled state its meaning was frighteningly explicit .

source_bert_toks: even in their be ##fu ##ddled state its meaning was frightening ##ly explicit .

reference_raw: Even in their confused state, its meaning was frighteningly clear.

reference_spacy_tokens: Even in their confused state , its meaning was frighteningly clear .


fn_spacy_tokens_for_baseline: ' I will not parley with a rabble . '

source_bert_toks: ' i will not par ##ley with a ra ##bble . '

reference_raw: "I don't want to talk to the mob."

reference_spacy_tokens: " I do n't want to talk to the mob . "


fn_spacy_tokens_for_baseline: Yehiel Leiter , a settler leader , said the strategy was to tie up the government , the legal system and the army with constant protests and crowd the jails with protesters .

source_bert_toks: ye ##hi ##el lei ##ter , a settler leader , said the strategy was to tie up the government , the legal system and the army with constant protests and crowd the jail ##s with protesters .

reference_raw: The settler leader, Yehiel Leiter, said that the strategy was to tie up the government, the legal system, and the military with constant protests, and mobilize the prisons with protesters.

reference_spacy_tokens: The settler leader , Yehiel Leiter , said that the strategy was to tie up the government , the legal system , and the military with constant protests , and mobilize the prisons with protesters .


fn_spacy_tokens_for_baseline: Her teeth chattered against the cup .

source_bert_toks: her teeth chatter ##ed against the cup .

reference_raw: Her teeth rattled against the cup.

reference_spacy_tokens: Her teeth rattled against the cup .


fn_spacy_tokens_for_baseline: We sat in a high vestibule between the street and the courtyard .

source_bert_toks: we sat in a high vest ##ib ##ule between the street and the courtyard .

reference_raw: We were sitting in a high lobby between the street and the courtyard.

reference_spacy_tokens: We were sitting in a high lobby between the street and the courtyard .


fn_spacy_tokens_for_baseline: 1 Leave a pile of old sacks on the soil in some damp , shady corner of the garden .

source_bert_toks: 1 leave a pile of old sacks on the soil in some damp , shady corner of the garden .

reference_raw: 1 Leave a pile of old bags on the ground in a wet, shadowy corner of the garden.

reference_spacy_tokens: 1 Leave a pile of old bags on the ground in a wet , shadowy corner of the garden .


fn_spacy_tokens_for_baseline: All right , Megan , when you were growing up , do you remember any stories that you read or were read to you that uh , stick in your mind ?

source_bert_toks: all right , megan , when you were growing up , do you remember any stories that you read or were read to you that uh , stick in your mind ?

reference_raw: Okay, Megan, when you were growing up, do you remember any stories that you've seen or that you've heard, uh, stuck in your head?

reference_spacy_tokens: Okay , Megan , when you were growing up , do you remember any stories that you 've seen or that you 've heard , uh , stuck in your head ?


fn_spacy_tokens_for_baseline: She left the attic , by he ladder this time , and then kicked all the junk into a great heap along the banisters .

source_bert_toks: she left the attic , by he ladder this time , and then kicked all the junk into a great heap along the ban ##ister ##s .

reference_raw: She left the loft, this time by his ladder, and then kicked all the junk into a big pile along the railings.

reference_spacy_tokens: She left the loft , this time by his ladder , and then kicked all the junk into a big pile along the railings .


fn_spacy_tokens_for_baseline: However , the surrounding fertile countryside is attractive , the spicy Hunan cuisine is worth trying , the scenic mountain areas of the province are outstanding , and the archaeological displays are stunning .

source_bert_toks: however , the surrounding fertile countryside is attractive , the spicy hunan cuisine is worth trying , the scenic mountain areas of the province are outstanding , and the archaeological displays are stunning .

reference_raw: But the surrounding fertile landscape is attractive, the spicy Hunan cuisine is worth the effort, the scenery mountain areas of the province are excellent, and the archaeological displays are stunning.

reference_spacy_tokens: But the surrounding fertile landscape is attractive , the spicy Hunan cuisine is worth the effort , the scenery mountain areas of the province are excellent , and the archaeological displays are stunning .


fn_spacy_tokens_for_baseline: The fields would be ploughed and drilled ; the cows calving , dropping their loads in secluded corners .

source_bert_toks: the fields would be pl ##ough ##ed and drilled ; the cows calvin ##g , dropping their loads in secluded corners .

reference_raw: The fields will be ploughed and drilled; the cows will calve and drop their loads in isolated corners.

reference_spacy_tokens: The fields will be ploughed and drilled ; the cows will calve and drop their loads in isolated corners .


fn_spacy_tokens_for_baseline: He got all of a 97-mph fastball , and launched it at 105 mph in the general direction of Canada .

source_bert_toks: he got all of a 97 - mph fast ##ball , and launched it at 105 mph in the general direction of canada .

reference_raw: He got the whole 97-mph fastball and fired it at 105 miles an hour in the general direction of Canada.

reference_spacy_tokens: He got the whole 97-mph fastball and fired it at 105 miles an hour in the general direction of Canada .


fn_spacy_tokens_for_baseline: Despite its initial failings , Siegel 's Flamingo survived him , as did mob infiltration of casinos .

source_bert_toks: despite its initial failing ##s , siegel ' s flaming ##o survived him , as did mob in ##filtration of casinos .

reference_raw: Despite his first failures, Siegel's Flamingo had survived him, as had the mob infiltrated the casinos.

reference_spacy_tokens: Despite his first failures , Siegel 's Flamingo had survived him , as had the mob infiltrated the casinos .


fn_spacy_tokens_for_baseline: THIS is the Mondeo , Ford 's new Belgian - built replacement for the Sierra which goes on sale in March .

source_bert_toks: this is the monde ##o , ford ' s new belgian - built replacement for the sierra which goes on sale in march .

reference_raw: This is Mondeo, the new Belgian substitute for the Sierra, which will be sold in March.

reference_spacy_tokens: This is Mondeo , the new Belgian substitute for the Sierra , which will be sold in March .


fn_spacy_tokens_for_baseline: The sharp declivities on all sides give depth to the prospect and reveal Mallerstang below and the Eden valley winding into the distance backed by Cross Fell , with the town of Kirkby Stephen also easily seen .

source_bert_toks: the sharp dec ##li ##vi ##ties on all sides give depth to the prospect and reveal mall ##ers ##tang below and the eden valley winding into the distance backed by cross fell , with the town of kirk ##by stephen also easily seen .

reference_raw: The sharp slopes on all sides give depth to the prospect, revealing the Mallerstang below, and the Eden Valley winding in the distance, backed by Cross Fell, where Kirkby Stephen's city was easy to see.

reference_spacy_tokens: The sharp slopes on all sides give depth to the prospect , revealing the Mallerstang below , and the Eden Valley winding in the distance , backed by Cross Fell , where Kirkby Stephen 's city was easy to see .


fn_spacy_tokens_for_baseline: The railway line then curves gracefully around Tolo Harbor , an idyllic body of water well - protected from the open sea .

source_bert_toks: the railway line then curves gracefully around to ##lo harbor , an id ##yl ##lic body of water well - protected from the open sea .

reference_raw: The railway line then curves gracefully around Tolo Harbor, an idyllic surface of water well protected from the open sea.

reference_spacy_tokens: The railway line then curves gracefully around Tolo Harbor , an idyllic surface of water well protected from the open sea .


fn_spacy_tokens_for_baseline: An armoured Marine began to hustle the unclad fettered alien away -- no doubt to the diamantine dungeons deep beneath the Apothacarion , domain of the surgeon interrogators .

source_bert_toks: an armoured marine began to hu ##stle the un ##cl ##ad fe ##ttered alien away - - no doubt to the dia ##man ##tine dungeons deep beneath the ap ##oth ##aca ##rion , domain of the surgeon inter ##ro ##gat ##ors .

reference_raw: The armored Marine began to hustle the undressed alien - no doubt into the diamantine dungeons deep beneath the Apothacarion, the domain of the surgeon's investigators.

reference_spacy_tokens: The armored Marine began to hustle the undressed alien - no doubt into the diamantine dungeons deep beneath the Apothacarion , the domain of the surgeon 's investigators .


fn_spacy_tokens_for_baseline: As corporations moved in and the mob was slowly pushed out , a new Las Vegas emerged .

source_bert_toks: as corporations moved in and the mob was slowly pushed out , a new las vegas emerged .

reference_raw: As the companies moved in and the crowd was slowly pushed out, a new Las Vegas appeared.

reference_spacy_tokens: As the companies moved in and the crowd was slowly pushed out , a new Las Vegas appeared .


fn_spacy_tokens_for_baseline: He was supported in this view by Mountbatten , who , with his experience as Supreme Commander South - East Asia and Viceroy of India , believed that such a course was desirable for efficiency 's sake and was practicable .

source_bert_toks: he was supported in this view by mount ##bat ##ten , who , with his experience as supreme commander south - east asia and viceroy of india , believed that such a course was desirable for efficiency ' s sake and was pr ##actic ##able .

reference_raw: This view was supported by Mountbatten, who, in his experience as Commander-in-Chief of South-East Asia and Vice-Roy of India, believed that such a course was desirable for the sake of efficiency and was feasible.

reference_spacy_tokens: This view was supported by Mountbatten , who , in his experience as Commander - in - Chief of South - East Asia and Vice - Roy of India , believed that such a course was desirable for the sake of efficiency and was feasible .


fn_spacy_tokens_for_baseline: It depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black moustache and ruggedly handsome features .

source_bert_toks: it depicted simply an enormous face , more than a metre wide : the face of a man of about forty - five , with a heavy black mo ##ust ##ache and rugged ##ly handsome features .

reference_raw: It was simply a huge face, more than a meter wide: the face of a man of about forty-five, with a thick black mustache and roughly handsome features.

reference_spacy_tokens: It was simply a huge face , more than a meter wide : the face of a man of about forty - five , with a thick black mustache and roughly handsome features .


fn_spacy_tokens_for_baseline: Watch the fantan dealer for a few minutes and you 'll almost be an expert : It 's simply a matter of how many odd buttons are left after he has divided a pile of them into groups of four .

source_bert_toks: watch the fan ##tan dealer for a few minutes and you ' ll almost be an expert : it ' s simply a matter of how many odd buttons are left after he has divided a pile of them into groups of four .

reference_raw: Keep an eye on the fantan dealer for a few minutes, and you're almost an expert: it's just a matter of how many strange buttons remain when he divides a pile of them into groups of four.

reference_spacy_tokens: Keep an eye on the fantan dealer for a few minutes , and you 're almost an expert : it 's just a matter of how many strange buttons remain when he divides a pile of them into groups of four .


fn_spacy_tokens_for_baseline: It is preferable it has its own private access in order to protect it and control it better .

source_bert_toks: it is prefer ##able it has its own private access in order to protect it and control it better .

reference_raw: It would be better if it had its own private access to protect it and better manage it.

reference_spacy_tokens: It would be better if it had its own private access to protect it and better manage it .


fn_spacy_tokens_for_baseline: It 's good to ask about her . '

source_bert_toks: it ' s good to ask about her . '

reference_raw: I like to ask about it.'

reference_spacy_tokens: I like to ask about it . '


fn_spacy_tokens_for_baseline: The state and localities , Chafee said , sometimes get mandated to use federal homeland security funds for decontamination or preparation for bioterrorism , when the money might be better spent putting together a communications systems that would let first responders such as police , fire and rescue from different communities communicate with each other more easily . " ( Pawtucket Times , 21Apr06 , Jim Baron ) ( Link )

source_bert_toks: the state and localities , cha ##fe ##e said , sometimes get mandated to use federal homeland security funds for deco ##nta ##mina ##tion or preparation for bio ##ter ##ror ##ism , when the money might be better spent putting together a communications systems that would let first respond ##ers such as police , fire and rescue from different communities communicate with each other more easily . " ( paw ##tucket times , 21 ##ap ##r ##0 ##6 , jim baron ) ( link )

reference_raw: The state and localities, Chafee said, are sometimes mandated to use federal national security funds to decontaminate or prepare for bioterrorism, when money could be better spent putting together a com system that would make it easier for the first responders, such as police, fire and rescue from different communities to communicate with one another." (Pawtucket Times, 21 April 2006, Jim Baron)

reference_spacy_tokens: The state and localities , Chafee said , are sometimes mandated to use federal national security funds to decontaminate or prepare for bioterrorism , when money could be better spent putting together a com system that would make it easier for the first responders , such as police , fire and rescue from different communities to communicate with one another . " ( Pawtucket Times , 21 April 2006 , Jim Baron )


fn_spacy_tokens_for_baseline: There is a statue to Ferdinand Magellan in the main square of Punta Arenas , at the southernmost tip of Chile .

source_bert_toks: there is a statue to ferdinand mage ##llan in the main square of punta arenas , at the southernmost tip of chile .

reference_raw: In the main square of Punta Arenas, on the southmost tip of Chile, there is a statue of Ferdinand Magellan.

reference_spacy_tokens: In the main square of Punta Arenas , on the southmost tip of Chile , there is a statue of Ferdinand Magellan .


fn_spacy_tokens_for_baseline: The man hesitated , then clamped his teeth in a rictus and twitched off again .

source_bert_toks: the man hesitated , then clamped his teeth in a ric ##tus and twitched off again .

reference_raw: The man hesitated, then clamped his teeth together and jerked away again.

reference_spacy_tokens: The man hesitated , then clamped his teeth together and jerked away again .


fn_spacy_tokens_for_baseline: At last Cranston burped , smacked his lips and handed the bowl back .

source_bert_toks: at last cr ##ans ##ton bu ##rp ##ed , smacked his lips and handed the bowl back .

reference_raw: Cranston finally burgled, slapped his lips, and handed the bowl back to him.

reference_spacy_tokens: Cranston finally burgled , slapped his lips , and handed the bowl back to him .


fn_spacy_tokens_for_baseline: But to herself , she said : ' Thank you , kind sir , ' and kneed the patronising berk in the goolies .

source_bert_toks: but to herself , she said : ' thank you , kind sir , ' and knee ##d the patron ##ising be ##rk in the goo ##lies .

reference_raw: But she said to herself, "Thank you, kind sir," and knelt the patronizing berk in the goolies.

reference_spacy_tokens: But she said to herself , " Thank you , kind sir , " and knelt the patronizing berk in the goolies .


fn_spacy_tokens_for_baseline: Once a pariah , Kadafi fulfilled a long - anticipated coming - out on the global stage with his U. N. speech .

source_bert_toks: once a par ##iah , ka ##da ##fi fulfilled a long - anticipated coming - out on the global stage with his u . n . speech .

reference_raw: Once a pariah, Kadafi completed his long-awaited come-out on the world stage with his U.N. speech.

reference_spacy_tokens: Once a pariah , Kadafi completed his long - awaited come - out on the world stage with his U.N. speech .


fn_spacy_tokens_for_baseline: Chemicals gurgle down a drain straight into Hong Kong 's sewers .

source_bert_toks: chemicals gu ##rg ##le down a drain straight into hong kong ' s sewer ##s .

reference_raw: Chemicals are swarming down the drain right into Hong Kong's sewers.

reference_spacy_tokens: Chemicals are swarming down the drain right into Hong Kong 's sewers .


fn_spacy_tokens_for_baseline: I sit in my room by candlelight , the distant black silhouettes of land through the window strangely calming .

source_bert_toks: i sit in my room by candle ##light , the distant black silhouette ##s of land through the window strangely calming .

reference_raw: I'm sitting in my room by the candlelight, and the distant black outlines of the ground through the window are strangely soothing.

reference_spacy_tokens: I 'm sitting in my room by the candlelight , and the distant black outlines of the ground through the window are strangely soothing .


fn_spacy_tokens_for_baseline: He crunched the last of his sweets and gave a leaflet to a passer - by .

source_bert_toks: he crunch ##ed the last of his sweets and gave a leaf ##let to a pass ##er - by .

reference_raw: He crushed the last of his candy and handed it to the passerby.

reference_spacy_tokens: He crushed the last of his candy and handed it to the passerby .


fn_spacy_tokens_for_baseline: After a day or two , the owner became irked , and went to the airport to inspect his plane .

source_bert_toks: after a day or two , the owner became ir ##ked , and went to the airport to inspect his plane .

reference_raw: After a day or two, the owner got drunk and went to the airport to check the plane.

reference_spacy_tokens: After a day or two , the owner got drunk and went to the airport to check the plane .


fn_spacy_tokens_for_baseline: The Keswick Museum and Art Gallery in Fitz Park is a treasure trove of artifacts collected in the area , with the atmosphere of an old professor s study .

source_bert_toks: the ke ##swick museum and art gallery in fitz park is a treasure tr ##ove of artifacts collected in the area , with the atmosphere of an old professor s study .

reference_raw: The Museum of Keswick and Art Gallery in Fitz Park is a treasure trove of artefacts collected in the region, with the atmosphere of an old professor's study.

reference_spacy_tokens: The Museum of Keswick and Art Gallery in Fitz Park is a treasure trove of artefacts collected in the region , with the atmosphere of an old professor 's study .


fn_spacy_tokens_for_baseline: Looking down on the land over seven miles below from the lofty heights where jet streams vaporize behind you , it was hard to imagine the difficulties the old man must have faced .

source_bert_toks: looking down on the land over seven miles below from the loft ##y heights where jet streams vapor ##ize behind you , it was hard to imagine the difficulties the old man must have faced .

reference_raw: It was hard to imagine the difficulties the old man had had to face when he looked down at the land more than seven miles below the lofty heights where the jet streams evaporated behind you.

reference_spacy_tokens: It was hard to imagine the difficulties the old man had had to face when he looked down at the land more than seven miles below the lofty heights where the jet streams evaporated behind you .


fn_spacy_tokens_for_baseline: He manages to get one smart crack in , writing , " I do think about suicide a lot because it is so boring to be ill , rather like being trapped in an Updike novel . "

source_bert_toks: he manages to get one smart crack in , writing , " i do think about suicide a lot because it is so boring to be ill , rather like being trapped in an up ##di ##ke novel . "

reference_raw: He manages to get one clever crack and writes, "I think about suicide a lot because being sick is so boring, rather than being trapped in an Updike novel."

reference_spacy_tokens: He manages to get one clever crack and writes , " I think about suicide a lot because being sick is so boring , rather than being trapped in an Updike novel . "


fn_spacy_tokens_for_baseline: The other boy had a white face and freckles .

source_bert_toks: the other boy had a white face and fr ##eck ##les .

reference_raw: The other boy's face was white and fleckled.

reference_spacy_tokens: The other boy 's face was white and fleckled .


fn_spacy_tokens_for_baseline: Rub down with abrasive paper then degrease the surface with white spirit .

source_bert_toks: rub down with ab ##ras ##ive paper then de ##gre ##ase the surface with white spirit .

reference_raw: Rub it with abrasive paper and then degrade the surface with a white spirit.

reference_spacy_tokens: Rub it with abrasive paper and then degrade the surface with a white spirit .


fn_spacy_tokens_for_baseline: As he reached the end of the quay , where the road ascends steeply from the harbour , he turned for one parting shot : ' You marry him , then ! ' he shouted .

source_bert_toks: as he reached the end of the quay , where the road as ##cend ##s steep ##ly from the harbour , he turned for one parting shot : ' you marry him , then ! ' he shouted .

reference_raw: When he reached the end of the quay, where the road rises steeply from the harbor, he turned to say goodbye, "Then marry him!" he cried.

reference_spacy_tokens: When he reached the end of the quay , where the road rises steeply from the harbor , he turned to say goodbye , " Then marry him ! " he cried .


fn_spacy_tokens_for_baseline: The dining room was redecorated , the menu revitalised ( following a simple pupil survey ) and a healthy - eating programme established ( supported by the Home Economics / Technology staff ) .

source_bert_toks: the dining room was red ##ec ##ora ##ted , the menu rev ##ital ##ised ( following a simple pupil survey ) and a healthy - eating programme established ( supported by the home economics / technology staff ) .

reference_raw: The dining room had been remodeled, the menu had been revived (after a simple study of students) and a health-eating programme (supported by the Home Economy/Technologists).

reference_spacy_tokens: The dining room had been remodeled , the menu had been revived ( after a simple study of students ) and a health - eating programme ( supported by the Home Economy / Technologists ) .


fn_spacy_tokens_for_baseline: The road to the Fire Court looked quite straightforward really ; it seemed as if you had to go past a large lake and on down a narrow , windy mountain road with houses dotted on each side .

source_bert_toks: the road to the fire court looked quite straightforward really ; it seemed as if you had to go past a large lake and on down a narrow , windy mountain road with houses dotted on each side .

reference_raw: The way to the Fire Court was quite clear; it was as if you had to walk around a large lake and down a narrow, wind-strewn mountain road with houses dotted on either side.

reference_spacy_tokens: The way to the Fire Court was quite clear ; it was as if you had to walk around a large lake and down a narrow , wind - strewn mountain road with houses dotted on either side .


fn_spacy_tokens_for_baseline: It 's natural to feel a bit dizzy with a bilious attack .

source_bert_toks: it ' s natural to feel a bit dizzy with a bi ##lio ##us attack .

reference_raw: It's natural to feel a little dizzy from a bile attack.

reference_spacy_tokens: It 's natural to feel a little dizzy from a bile attack .


fn_spacy_tokens_for_baseline: There was no response so I called again and walked over to the kitchenette .

source_bert_toks: there was no response so i called again and walked over to the kitchen ##ette .

reference_raw: There was no answer, so I called again and went to the kitchen.

reference_spacy_tokens: There was no answer , so I called again and went to the kitchen .


fn_spacy_tokens_for_baseline: China is estimated to have about 400 strategic and tactical nuclear weapons , and stocks of fissile material sufficient to produce a much larger arsenal .

source_bert_toks: china is estimated to have about 400 strategic and tactical nuclear weapons , and stocks of fis ##sil ##e material sufficient to produce a much larger arsenal .

reference_raw: It is estimated that China has around 400 strategic and tactical nuclear weapons, with enough fission material to produce a much larger arsenal.

reference_spacy_tokens: It is estimated that China has around 400 strategic and tactical nuclear weapons , with enough fission material to produce a much larger arsenal .


fn_spacy_tokens_for_baseline: Iran 's plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

source_bert_toks: iran ' s plans for building a civilian nuclear power program have prompted much concern regarding its intention to develop nuclear weapons .

reference_raw: Iran's plans to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons.

reference_spacy_tokens: Iran 's plans to build a civil nuclear power programme have raised serious concerns about its intention to develop nuclear weapons .


fn_spacy_tokens_for_baseline: But I 've always been my own man and I do n't bullshit .

source_bert_toks: but i ' ve always been my own man and i don ' t bullshit .

reference_raw: But I've always been my own man, and I'm not stupid.

reference_spacy_tokens: But I 've always been my own man , and I 'm not stupid .


fn_spacy_tokens_for_baseline: Inside , the building has been heavily altered and there are few traces of the original nightclub , which closed in the mid-1950s .

source_bert_toks: inside , the building has been heavily altered and there are few traces of the original nightclub , which closed in the mid - 1950s .

reference_raw: The building was heavily altered inside, and there were few traces of the original nightclub that had been shut down in the mid-1950s.

reference_spacy_tokens: The building was heavily altered inside , and there were few traces of the original nightclub that had been shut down in the mid-1950s .


fn_spacy_tokens_for_baseline: According to the F-22 program office , design maturity and manufacturing problems caused a " rolling wave " effect throughout system integration and final assembly .

source_bert_toks: according to the f - 22 program office , design maturity and manufacturing problems caused a " rolling wave " effect throughout system integration and final assembly .

reference_raw: According to the F-22 program office, design maturation and production problems have caused a "rolling wave" effect throughout the integration and final assembly of the system.

reference_spacy_tokens: According to the F-22 program office , design maturation and production problems have caused a " rolling wave " effect throughout the integration and final assembly of the system .


fn_spacy_tokens_for_baseline: ' You must be reading too many of those French novelettes .

source_bert_toks: ' you must be reading too many of those french novel ##ettes .

reference_raw: 'You must read too many French novels.

reference_spacy_tokens: ' You must read too many French novels .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And the young alumni are not leaving now - multinational corporations and European Union investment mean that they have a lot of opportunities at home.

reference_spacy_tokens: And the young alumni are not leaving now - multinational corporations and European Union investment mean that they have a lot of opportunities at home .


fn_spacy_tokens_for_baseline: The rim of the steel plate scraped his upper thighs .

source_bert_toks: the rim of the steel plate scraped his upper thighs .

reference_raw: The edge of the steel plate scratched his upper thighs.

reference_spacy_tokens: The edge of the steel plate scratched his upper thighs .


fn_spacy_tokens_for_baseline: Then and there they would have plunged their knives into me could they have seen how to escape the consequences of the deed .

source_bert_toks: then and there they would have plunged their knives into me could they have seen how to escape the consequences of the deed .

reference_raw: Then, and there, they would plunge their knives into me if they could see how to escape the consequences.

reference_spacy_tokens: Then , and there , they would plunge their knives into me if they could see how to escape the consequences .


fn_spacy_tokens_for_baseline: The market paused for breath yesterday with the FTSE index dipping seven points to 2346.7 .

source_bert_toks: the market paused for breath yesterday with the ft ##se index dipping seven points to 234 ##6 . 7 .

reference_raw: Yesterday, the market stopped for breath and the FTSE index dropped seven points to 2346.7.

reference_spacy_tokens: Yesterday , the market stopped for breath and the FTSE index dropped seven points to 2346.7 .


fn_spacy_tokens_for_baseline: It must at this point be noted that it is only philosophers of science who cook up these theories about the ideal form of scientific reasoning .

source_bert_toks: it must at this point be noted that it is only philosophers of science who cook up these theories about the ideal form of scientific reasoning .

reference_raw: At this point, it should be noted that these theories on the ideal form of scientific reasoning are made only by scientific philosophers.

reference_spacy_tokens: At this point , it should be noted that these theories on the ideal form of scientific reasoning are made only by scientific philosophers .


fn_spacy_tokens_for_baseline: There are restaurants and a Starbuck 's in the basement , and you can access the raised pedestrian crosswalk from the escalators on the ground floor .

source_bert_toks: there are restaurants and a star ##buck ' s in the basement , and you can access the raised pedestrian cross ##walk from the es ##cala ##tors on the ground floor .

reference_raw: There are restaurants and Starbuck's in the basement, and you can get to the raised walkway from the ground-floor escalators.

reference_spacy_tokens: There are restaurants and Starbuck 's in the basement , and you can get to the raised walkway from the ground - floor escalators .


fn_spacy_tokens_for_baseline: Before a skyscraper can be built , a feng shui ( see page 68 ) investigation must take place to ensure that the site and the building will promote health , harmony , and prosperity .

source_bert_toks: before a skyscraper can be built , a feng shu ##i ( see page 68 ) investigation must take place to ensure that the site and the building will promote health , harmony , and prosperity .

reference_raw: Before building a skyscraper, an inspection of the feng shui (see page 68) must be carried out to ensure that the site and the building support health, harmony and prosperity.

reference_spacy_tokens: Before building a skyscraper , an inspection of the feng shui ( see page 68 ) must be carried out to ensure that the site and the building support health , harmony and prosperity .


fn_spacy_tokens_for_baseline: Choice pears masked with chocolate sauce and cream , beautiful fresh peaches smothered in raspberry puree and set around with vanilla ice seem to me offences to nature , let alone to art or basic principles .

source_bert_toks: choice pear ##s masked with chocolate sauce and cream , beautiful fresh peach ##es sm ##oth ##ered in ras ##p ##berry pure ##e and set around with vanilla ice seem to me offences to nature , let alone to art or basic principles .

reference_raw: Choice pears disguised in chocolate sauce and cream, beautiful fresh peaches smothered in raspberry puree and surrounded by vanilla ice, seem to me to be a violation of nature, not to mention art or basic principles.

reference_spacy_tokens: Choice pears disguised in chocolate sauce and cream , beautiful fresh peaches smothered in raspberry puree and surrounded by vanilla ice , seem to me to be a violation of nature , not to mention art or basic principles .


fn_spacy_tokens_for_baseline: The pastel blue crescent of Lake Batur takes up the eastern third of the great bowl , and out of the center grows Mount Batur itself , bare rock streaked with black traces of old lava flows .

source_bert_toks: the paste ##l blue crescent of lake bat ##ur takes up the eastern third of the great bowl , and out of the center grows mount bat ##ur itself , bare rock streaked with black traces of old lava flows .

reference_raw: The pastel-blue crescent of Lake Batur takes the east-third of the great bowl, and from the center rises Mount Batur itself, a bare rock streaked with black trails of old lava streams.

reference_spacy_tokens: The pastel - blue crescent of Lake Batur takes the east - third of the great bowl , and from the center rises Mount Batur itself , a bare rock streaked with black trails of old lava streams .


fn_spacy_tokens_for_baseline: ' And if Gloria 's anything to go by , I 'd have more joy panning for gold in the Mersey than extracting information out of you lot . '

source_bert_toks: ' and if gloria ' s anything to go by , i ' d have more joy pan ##ning for gold in the mer ##sey than extract ##ing information out of you lot . '

reference_raw: "And if Gloria had anything to do with it, I'd have more pleasure in penning gold in Mersey than getting information out of you a lot."

reference_spacy_tokens: " And if Gloria had anything to do with it , I 'd have more pleasure in penning gold in Mersey than getting information out of you a lot . "


fn_spacy_tokens_for_baseline: Furthermore , as in the pheromone experiment , either sex may respond favourably to sandalwood 's seductive aroma ; or conversely , respond with an ' ugh ! '

source_bert_toks: furthermore , as in the ph ##ero ##mon ##e experiment , either sex may respond favour ##ably to sand ##al ##wood ' s seductive aroma ; or conversely , respond with an ' u ##gh ! '

reference_raw: In addition, as in a pheromone experiment, either sex can react positively to the seductive smell of sandalwood; or, conversely, to the 'ugh!'

reference_spacy_tokens: In addition , as in a pheromone experiment , either sex can react positively to the seductive smell of sandalwood ; or , conversely , to the ' ugh ! '


fn_spacy_tokens_for_baseline: He denied that Britain was ignoring the plight of people being butchered and starved by Serbs .

source_bert_toks: he denied that britain was ignoring the plight of people being butcher ##ed and starved by serbs .

reference_raw: He denied that Britain ignored the dangers of people being butchered and hungry by the Serbs.

reference_spacy_tokens: He denied that Britain ignored the dangers of people being butchered and hungry by the Serbs .


fn_spacy_tokens_for_baseline: I had what I refer to as the Flower Gentleman come to call on me -- I 'm terrible at remembering names -- and I liked him at once .

source_bert_toks: i had what i refer to as the flower gentleman come to call on me - - i ' m terrible at remembering names - - and i liked him at once .

reference_raw: I had what I call the Flower Gentleman who came to me - I can't remember names - and I liked him at the same time.

reference_spacy_tokens: I had what I call the Flower Gentleman who came to me - I ca n't remember names - and I liked him at the same time .


fn_spacy_tokens_for_baseline: The cells are completely bare , some with an iron bedframe bolted to the floor , others with only a mattress and plastic bowl , pot , and that 's it .

source_bert_toks: the cells are completely bare , some with an iron bed ##frame bolted to the floor , others with only a mattress and plastic bowl , pot , and that ' s it .

reference_raw: The cells are completely bare, some with an iron frame attached to the floor, some with just a mattress and a plastic bowl, a pot, and that's it.

reference_spacy_tokens: The cells are completely bare , some with an iron frame attached to the floor , some with just a mattress and a plastic bowl , a pot , and that 's it .


fn_spacy_tokens_for_baseline: As soon as he had reached the guest room , he entered and turned the key in the door , securing it behind him .

source_bert_toks: as soon as he had reached the guest room , he entered and turned the key in the door , securing it behind him .

reference_raw: As soon as he reached the visitor's room, he entered, turned the door key, and secured it behind him.

reference_spacy_tokens: As soon as he reached the visitor 's room , he entered , turned the door key , and secured it behind him .


fn_spacy_tokens_for_baseline: More adequate pictures involve the depiction of theories as structured wholes of some kind .

source_bert_toks: more adequate pictures involve the depiction of theories as structured whole ##s of some kind .

reference_raw: More appropriate images include depicting theories as structured wholes.

reference_spacy_tokens: More appropriate images include depicting theories as structured wholes .


fn_spacy_tokens_for_baseline: On 8 March 1996 , the Washington Post reported , " US intelligence officials have concluded that companies in China are providing Iran with several virtually complete factories suited for making deadly poison gases , " and that Iranian " military - related organizations " are buying from China glass - lined vessels for mixing precursors , special air - filtration equipment , and the technology to manufacture these items and others indigenously .

source_bert_toks: on 8 march 1996 , the washington post reported , " us intelligence officials have concluded that companies in china are providing iran with several virtually complete factories suited for making deadly poison gases , " and that iranian " military - related organizations " are buying from china glass - lined vessels for mixing precursor ##s , special air - fi ##lt ##ration equipment , and the technology to manufacture these items and others indigenous ##ly .

reference_raw: On 8 March 1996, the Washington Post announced, "U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases," and that Iran's "military-related organizations" purchase from Chinese glass-lined vessels for the blending of precursors, special air-filtration equipment, and technology for the production of such items and other indigenous products.

reference_spacy_tokens: On 8 March 1996 , the Washington Post announced , " U.S. intelligence officials have concluded that companies in China provide Iran with a number of virtually complete factories suitable for the production of lethal toxic gases , " and that Iran 's " military - related organizations " purchase from Chinese glass - lined vessels for the blending of precursors , special air - filtration equipment , and technology for the production of such items and other indigenous products .


fn_spacy_tokens_for_baseline: I want to convert my loft to a shower room .

source_bert_toks: i want to convert my loft to a shower room .

reference_raw: I'd like to turn my attic into a shower room.

reference_spacy_tokens: I 'd like to turn my attic into a shower room .


fn_spacy_tokens_for_baseline: The flimsiness of the case means that there is very little support for the keyboard which flexes badly .

source_bert_toks: the fl ##im ##sin ##ess of the case means that there is very little support for the keyboard which flex ##es badly .

reference_raw: The flimsy of the case means that there is very little support for a keyboard that is flexing badly.

reference_spacy_tokens: The flimsy of the case means that there is very little support for a keyboard that is flexing badly .


fn_spacy_tokens_for_baseline: The Temple Mount was identified in Islamic tradition as " the farthest spot " ( in Arabic , el - aksa ) , the site to which the Prophet Muhammad was transported in one night from Mecca on a winged horse , as described in the 17th chapter of the Koran .

source_bert_toks: the temple mount was identified in islamic tradition as " the far ##thest spot " ( in arabic , el - ak ##sa ) , the site to which the prophet muhammad was transported in one night from mecca on a winged horse , as described in the 17th chapter of the ko ##ran .

reference_raw: In Islamic tradition, the Temple Mount was described as "the farthest place" (in Arabic, el-aksa), a place where the Prophet Muhammad was transported from Mecca in one night on a winged horse, as described in Chapter 17 of the Koran.

reference_spacy_tokens: In Islamic tradition , the Temple Mount was described as " the farthest place " ( in Arabic , el - aksa ) , a place where the Prophet Muhammad was transported from Mecca in one night on a winged horse , as described in Chapter 17 of the Koran .


fn_spacy_tokens_for_baseline: Sun , in the throes of trying to get as much commercial software at its disposal as possible , partnered with Universal Software last October to put its like - minded Open/36 on Sparc .

source_bert_toks: sun , in the th ##ro ##es of trying to get as much commercial software at its disposal as possible , partnered with universal software last october to put its like - minded open / 36 on spa ##rc .

reference_raw: Sun, in the process of trying to get as much commercial software as possible, collaborated with Universal Software last October to put the like-minded Open/36 on Sparc.

reference_spacy_tokens: Sun , in the process of trying to get as much commercial software as possible , collaborated with Universal Software last October to put the like - minded Open/36 on Sparc .


fn_spacy_tokens_for_baseline: You messed up their surveillance , you beat up their agents , you went in for exactly the same unauthorised adventurism as they had -- and so let them off the hook .

source_bert_toks: you messed up their surveillance , you beat up their agents , you went in for exactly the same una ##uth ##oris ##ed advent ##uri ##sm as they had - - and so let them off the hook .

reference_raw: You screwed up their surveillance, you beat up their agents, you went to the same unauthorized adventure they had, and you let them get away with it.

reference_spacy_tokens: You screwed up their surveillance , you beat up their agents , you went to the same unauthorized adventure they had , and you let them get away with it .


fn_spacy_tokens_for_baseline: " . get even with big fat Hermann .

source_bert_toks: " . get even with big fat hermann .

reference_raw: "..get back to the big fat Hermann. "

reference_spacy_tokens: " .. get back to the big fat Hermann . "


fn_spacy_tokens_for_baseline: There were huge platters of cooked meat at intervals of every three or four settings .

source_bert_toks: there were huge platt ##ers of cooked meat at intervals of every three or four settings .

reference_raw: Every three or four settings, there were huge trays of cooked meat.

reference_spacy_tokens: Every three or four settings , there were huge trays of cooked meat .


fn_spacy_tokens_for_baseline: He said : ' The market is definitely thawing out from the big freeze we experienced last year , and it is thawing out from the bottom up .

source_bert_toks: he said : ' the market is definitely tha ##wing out from the big freeze we experienced last year , and it is tha ##wing out from the bottom up .

reference_raw: He said, "The market's definitely melting from the big freeze we had last year, and it's melting from the bottom up.

reference_spacy_tokens: He said , " The market 's definitely melting from the big freeze we had last year , and it 's melting from the bottom up .


fn_spacy_tokens_for_baseline: ASLACTON , England -- Of all scenes that evoke rural England , this is one of the loveliest : An ancient stone church stands amid the fields , the sound of bells cascading from its tower , calling the faithful to evensong .

source_bert_toks: as ##la ##cton , england - - of all scenes that ev ##oke rural england , this is one of the love ##liest : an ancient stone church stands amid the fields , the sound of bells cas ##ca ##ding from its tower , calling the faithful to even ##son ##g .

reference_raw: Aslacton, England - Of all the scenes that evoke rural England, this is one of the most beautiful: the ancient stone church stands in the fields, the sound of bells cascading from its tower and calling the faithful to evensong.

reference_spacy_tokens: Aslacton , England - Of all the scenes that evoke rural England , this is one of the most beautiful : the ancient stone church stands in the fields , the sound of bells cascading from its tower and calling the faithful to evensong .


fn_spacy_tokens_for_baseline: What they saw was a blazing inferno .

source_bert_toks: what they saw was a blazing inferno .

reference_raw: What they saw was hell.

reference_spacy_tokens: What they saw was hell .


fn_spacy_tokens_for_baseline: He has never deified himself ; that role has always been taken on by the press , or more usually , the fans .

source_bert_toks: he has never dei ##fied himself ; that role has always been taken on by the press , or more usually , the fans .

reference_raw: He had never defied himself; the press, or more generally, the fans, had always assumed that role.

reference_spacy_tokens: He had never defied himself ; the press , or more generally , the fans , had always assumed that role .


fn_spacy_tokens_for_baseline: Hong Kong 's third largest island has a population of only about 12,000 ; it is still largely undeveloped , and life on Lamma , if not totally primitive , is close to the essentials .

source_bert_toks: hong kong ' s third largest island has a population of only about 12 , 000 ; it is still largely undeveloped , and life on lam ##ma , if not totally primitive , is close to the essential ##s .

reference_raw: The third largest island in Hong Kong has a population of only around 12,000; it is still largely undeveloped, and life on Lamma, if not entirely primitive, is almost essential.

reference_spacy_tokens: The third largest island in Hong Kong has a population of only around 12,000 ; it is still largely undeveloped , and life on Lamma , if not entirely primitive , is almost essential .


fn_spacy_tokens_for_baseline: To soften the outline , the fringe area was sectioned into ' kiss - curls .

source_bert_toks: to soft ##en the outline , the fringe area was section ##ed into ' kiss - curls .

reference_raw: To soften the outline, the rim area was divided into "kiss-curls."

reference_spacy_tokens: To soften the outline , the rim area was divided into " kiss - curls . "


fn_spacy_tokens_for_baseline: Then Thorfinn looked up and , catching sight of the Prior , walked to his side as eager helpers swarmed to the messenger .

source_bert_toks: then thor ##fin ##n looked up and , catching sight of the prior , walked to his side as eager help ##ers swarm ##ed to the messenger .

reference_raw: Then Thorfinn looked up, and when he saw the Prior, he walked over to his side as eager helpers approached the messenger.

reference_spacy_tokens: Then Thorfinn looked up , and when he saw the Prior , he walked over to his side as eager helpers approached the messenger .


fn_spacy_tokens_for_baseline: Another report indicates that " Iran has ... conducted extensive research on more lethal active agents like anthrax , hoof and mouth disease , and biotoxins . "

source_bert_toks: another report indicates that " iran has . . . conducted extensive research on more lethal active agents like ant ##hra ##x , ho ##of and mouth disease , and bio ##to ##xin ##s . "

reference_raw: According to another report, "Iran has done extensive research on more deadly active substances such as anthrax, hooves and mouth disease, and biotoxins."

reference_spacy_tokens: According to another report , " Iran has done extensive research on more deadly active substances such as anthrax , hooves and mouth disease , and biotoxins . "


fn_spacy_tokens_for_baseline: When she went into the rest room she sat down for a minute while waiting for Peggy to come out of the lavatory .

source_bert_toks: when she went into the rest room she sat down for a minute while waiting for peggy to come out of the lava ##tory .

reference_raw: When she entered the bathroom, she sat for a moment, waiting for Peggy to come out of the bathroom.

reference_spacy_tokens: When she entered the bathroom , she sat for a moment , waiting for Peggy to come out of the bathroom .


fn_spacy_tokens_for_baseline: At the turn of the 19th century Los Angeles and Salt Lake City were among the burgeoning metropolises of the new American West .

source_bert_toks: at the turn of the 19th century los angeles and salt lake city were among the bu ##rgeon ##ing metropolis ##es of the new american west .

reference_raw: In the late 19th century, Los Angeles and Salt Lake City were among the burgeoning metropolises of the new American West.

reference_spacy_tokens: In the late 19th century , Los Angeles and Salt Lake City were among the burgeoning metropolises of the new American West .


fn_spacy_tokens_for_baseline: AT & T Co has been awarded a $ 5 m contract by the island of Nauru to digitise the country 's telecommunications network and set up direct international service : the order includes a 5ESS gateway switching system , equipment to digitise Nauru 's existing analogue earthstations , microwave towers and other terrestrial communications links , a cellular communications network and one year of on - site technical support ; the eight - square - mile island is 2,445 miles southwest of Hawaii and has 9,000 residents ; it makes a living exporting $ 75 m a year in phosphates .

source_bert_toks: at & t co has been awarded a $ 5 ##m contract by the island of na ##uru to digit ##ise the country ' s telecommunications network and set up direct international service : the order includes a 5 ##ess gateway switching system , equipment to digit ##ise na ##uru ' s existing analogue earth ##station ##s , microwave towers and other terrestrial communications links , a cellular communications network and one year of on - site technical support ; the eight - square - mile island is 2 , 44 ##5 miles southwest of hawaii and has 9 , 000 residents ; it makes a living export ##ing $ 75 ##m a year in phosphate ##s .

reference_raw: AT & T Co was awarded a $5 million contract by the island of Nauru for the digitisation of the country's telecommunications network and for the establishment of direct international services: the order includes a 5ESS gateway switching system, equipment for the digitisation of existing analogue terrestrial stations in Nauru, microwave towers and other terrestrial communications links, a mobile communication network and one year of technical assistance on the ground; the 8 square miles is an island. 445 miles south-west of Hawaii, with a population of 9,000, making a living exporting $75 million of phosphates a year.

reference_spacy_tokens: AT & T Co was awarded a $ 5 million contract by the island of Nauru for the digitisation of the country 's telecommunications network and for the establishment of direct international services : the order includes a 5ESS gateway switching system , equipment for the digitisation of existing analogue terrestrial stations in Nauru , microwave towers and other terrestrial communications links , a mobile communication network and one year of technical assistance on the ground ; the 8 square miles is an island . 445 miles south - west of Hawaii , with a population of 9,000 , making a living exporting $ 75 million of phosphates a year .


fn_spacy_tokens_for_baseline: A typical Mercedes - owner would live in the hills of Buda , in one of the luxury apartment houses studded with satellite dishes that are constantly springing up .

source_bert_toks: a typical mercedes - owner would live in the hills of bud ##a , in one of the luxury apartment houses stud ##ded with satellite dishes that are constantly spring ##ing up .

reference_raw: The typical Mercedes owner would be living in the Buda Hills, in one of the luxurious flats littered with satellite dishes.

reference_spacy_tokens: The typical Mercedes owner would be living in the Buda Hills , in one of the luxurious flats littered with satellite dishes .


fn_spacy_tokens_for_baseline: Then his teeth clunk together .

source_bert_toks: then his teeth cl ##unk together .

reference_raw: Then his teeth clicked together.

reference_spacy_tokens: Then his teeth clicked together .


fn_spacy_tokens_for_baseline: The parents , instead of applauding her , called her a noisy chatterbox and told her sharply that small girls should be seen and not heard .

source_bert_toks: the parents , instead of app ##lau ##ding her , called her a noisy chatter ##box and told her sharply that small girls should be seen and not heard .

reference_raw: Instead of clapping her, her parents called her a loud chat box and told her sharply that little girls should be seen and not heard.

reference_spacy_tokens: Instead of clapping her , her parents called her a loud chat box and told her sharply that little girls should be seen and not heard .


fn_spacy_tokens_for_baseline: However , young and old , stranger and Dubliner rub shoulders quite happily .

source_bert_toks: however , young and old , stranger and dublin ##er rub shoulders quite happily .

reference_raw: But young and old, foreigner and Dubliner rub their shoulders happily.

reference_spacy_tokens: But young and old , foreigner and Dubliner rub their shoulders happily .


fn_spacy_tokens_for_baseline: Since age at first marriage or union not only indirectly affects maternal and child health but can be considered as one of the underlying causes or conditions that affect it , this topic will be examined first .

source_bert_toks: since age at first marriage or union not only indirectly affects maternal and child health but can be considered as one of the underlying causes or conditions that affect it , this topic will be examined first .

reference_raw: Since age at the time of the first marriage or union has not only an indirect effect on the health of mothers and children, but can also be regarded as one of the underlying causes or conditions affecting them, the subject will be examined first.

reference_spacy_tokens: Since age at the time of the first marriage or union has not only an indirect effect on the health of mothers and children , but can also be regarded as one of the underlying causes or conditions affecting them , the subject will be examined first .


fn_spacy_tokens_for_baseline: ' Another scene cut was one where a man 's brains are splattered over a window . '

source_bert_toks: ' another scene cut was one where a man ' s brains are sp ##lat ##tered over a window . '

reference_raw: "There was another scene where a man's brain was sprayed through a window."

reference_spacy_tokens: " There was another scene where a man 's brain was sprayed through a window . "


fn_spacy_tokens_for_baseline: The 23rd game was a draw , leaving everything hanging on the last game of the series .

source_bert_toks: the 23rd game was a draw , leaving everything hanging on the last game of the series .

reference_raw: Game 23 was a draw, leaving everything on the last game of the show.

reference_spacy_tokens: Game 23 was a draw , leaving everything on the last game of the show .


fn_spacy_tokens_for_baseline: Such developments are perceived by Kamenka and Tay as betokening a shift away from a gesellschaft model of law and society , towards a bureaucratic administrative social and legal order .

source_bert_toks: such developments are perceived by kamen ##ka and tay as bet ##oke ##ning a shift away from a gesellschaft model of law and society , towards a bureau ##cratic administrative social and legal order .

reference_raw: Kamenka and Tay see this development as a sign of a shift from the Gesellschaft model of law and society to the bureaucratic social and legal system.

reference_spacy_tokens: Kamenka and Tay see this development as a sign of a shift from the Gesellschaft model of law and society to the bureaucratic social and legal system .


fn_spacy_tokens_for_baseline: The degree of repetition of any one collocate in the list corresponds to the degree of association between the lemma and that collocate .

source_bert_toks: the degree of repetition of any one col ##lo ##cate in the list corresponds to the degree of association between the le ##mma and that col ##lo ##cate .

reference_raw: The degree of repetition of each of the collocations in the list corresponds to the degree of association between the lemma and the collocation.

reference_spacy_tokens: The degree of repetition of each of the collocations in the list corresponds to the degree of association between the lemma and the collocation .


fn_spacy_tokens_for_baseline: ' I 'll get undressed , ' she muttered and stalked off behind a bush .

source_bert_toks: ' i ' ll get und ##ressed , ' she muttered and stalked off behind a bush .

reference_raw: "I'll take off my clothes," she murmured, and followed the bush.

reference_spacy_tokens: " I 'll take off my clothes , " she murmured , and followed the bush .


fn_spacy_tokens_for_baseline: The grey market resumed on May 12th , after the rights issue was priced ; the shares slid further .

source_bert_toks: the grey market resumed on may 12th , after the rights issue was priced ; the shares slid further .

reference_raw: After the price of the rights issue, the gray market resumed on May 12th, and the shares continued to move.

reference_spacy_tokens: After the price of the rights issue , the gray market resumed on May 12th , and the shares continued to move .


fn_spacy_tokens_for_baseline: It is best to use small flowers and leaves and create a medium - to - large monogram , otherwise the picture can quickly become an unwieldy blob .

source_bert_toks: it is best to use small flowers and leaves and create a medium - to - large mono ##gram , otherwise the picture can quickly become an un ##wi ##eld ##y b ##lo ##b .

reference_raw: The best way to use small flowers and leaves is to create a medium to large monograph, otherwise the image can quickly become an unwieldy blob.

reference_spacy_tokens: The best way to use small flowers and leaves is to create a medium to large monograph , otherwise the image can quickly become an unwieldy blob .


fn_spacy_tokens_for_baseline: A message was being typed out .

source_bert_toks: a message was being typed out .

reference_raw: A message has been written.

reference_spacy_tokens: A message has been written .


fn_spacy_tokens_for_baseline: Everyone abominates air travel , though they all do it .

source_bert_toks: everyone ab ##omi ##nate ##s air travel , though they all do it .

reference_raw: They all hate air travel, even if they all do it.

reference_spacy_tokens: They all hate air travel , even if they all do it .


fn_spacy_tokens_for_baseline: When the grumbling grew too loud for Alberto Fujimori in Peru , he simply shut down democratic politics .

source_bert_toks: when the gr ##umb ##ling grew too loud for alberto fuji ##mori in peru , he simply shut down democratic politics .

reference_raw: When the grumbling became too much for Albert Fujimori in Peru, he simply shut down democratic politics.

reference_spacy_tokens: When the grumbling became too much for Albert Fujimori in Peru , he simply shut down democratic politics .


fn_spacy_tokens_for_baseline: What kind of people benefit by your contribution to Pleasant Run Children 's Homes ?

source_bert_toks: what kind of people benefit by your contribution to pleasant run children ' s homes ?

reference_raw: What kind of people benefit from your donation to Pleasant Run Children's Homes?

reference_spacy_tokens: What kind of people benefit from your donation to Pleasant Run Children 's Homes ?


fn_spacy_tokens_for_baseline: Santorini ( Thira ) , the next major island north , was heavily influenced by Crete , and the settlements of Thira and Akrotiri thrived at this time .

source_bert_toks: santo ##rini ( th ##ira ) , the next major island north , was heavily influenced by crete , and the settlements of th ##ira and ak ##rot ##iri thrive ##d at this time .

reference_raw: Santorini (Thira), another major island to the north, was strongly influenced by Crete, and the settlements of Thira and Akrotiri were now prosperous.

reference_spacy_tokens: Santorini ( Thira ) , another major island to the north , was strongly influenced by Crete , and the settlements of Thira and Akrotiri were now prosperous .


fn_spacy_tokens_for_baseline: The headpiece of the Egyptian Pharaohs , the Diadem , was adorned with the Cobra or Uraeus on the left side and the Vulture on the right .

source_bert_toks: the head ##piece of the egyptian pharaoh ##s , the dia ##de ##m , was adorned with the cobra or ur ##ae ##us on the left side and the vulture on the right .

reference_raw: The head of the Egyptian Pharaoh, the Diadem, was decorated with a Cobra or Uraeus on the left and a Vulture on the right.

reference_spacy_tokens: The head of the Egyptian Pharaoh , the Diadem , was decorated with a Cobra or Uraeus on the left and a Vulture on the right .


fn_spacy_tokens_for_baseline: Lenin was involved in motivating revolutionary action by , in part , a critique of bureaucracy but later assumed responsibility for the economic development of a backward country that needed experts in positions of authority .

source_bert_toks: lenin was involved in mo ##tiv ##ating revolutionary action by , in part , a critique of bureaucracy but later assumed responsibility for the economic development of a backward country that needed experts in positions of authority .

reference_raw: Lenin was involved in stimulating revolutionary action, partly by criticizing bureaucracy, but later took responsibility for the economic development of a backward country that needed experts in a position of authority.

reference_spacy_tokens: Lenin was involved in stimulating revolutionary action , partly by criticizing bureaucracy , but later took responsibility for the economic development of a backward country that needed experts in a position of authority .


fn_spacy_tokens_for_baseline: Referee Neil Midgley ( Bolton ) , who retires in a fortnight 's time , pulled a calf muscle in the first half and was replaced by senior linesman Graham Bradbury ( York . )

source_bert_toks: referee neil mid ##gley ( bolton ) , who retire ##s in a fort ##night ' s time , pulled a calf muscle in the first half and was replaced by senior lines ##man graham brad ##bury ( york . )

reference_raw: Referee Neil Midgley (Bolton), who retires in two weeks, drew a calf muscle in the first half and was replaced by senior rower Graham Bradbury (York.)

reference_spacy_tokens: Referee Neil Midgley ( Bolton ) , who retires in two weeks , drew a calf muscle in the first half and was replaced by senior rower Graham Bradbury ( York . )


fn_spacy_tokens_for_baseline: Then Alexander became king , with no living heir and married his French paramour , lusting after her , proclaiming he would beget an heir .

source_bert_toks: then alexander became king , with no living heir and married his french para ##mour , lust ##ing after her , pro ##claiming he would beg ##et an heir .

reference_raw: Then Alexander became king, without a living heir, and married his French paramour, lusting for it, proclaiming that he would have an heir.

reference_spacy_tokens: Then Alexander became king , without a living heir , and married his French paramour , lusting for it , proclaiming that he would have an heir .


fn_spacy_tokens_for_baseline: China is replacing its older DF-5 missiles with new DF -5A variants , which may eventually be equipped with multiple warheads .

source_bert_toks: china is replacing its older d ##f - 5 missiles with new d ##f - 5 ##a variants , which may eventually be equipped with multiple war ##heads .

reference_raw: China is replacing its older DF-5 missiles with new DF-5A options, which may eventually be equipped with multiple warheads.

reference_spacy_tokens: China is replacing its older DF-5 missiles with new DF-5A options , which may eventually be equipped with multiple warheads .


fn_spacy_tokens_for_baseline: The knitted pieces are just too bulky .

source_bert_toks: the knit ##ted pieces are just too bulky .

reference_raw: The knitted pieces are too big.

reference_spacy_tokens: The knitted pieces are too big .


fn_spacy_tokens_for_baseline: Several of these latter , above all the toxic organophosphates , were almost certainly employed to assassinate individual " enemies of the state . "

source_bert_toks: several of these latter , above all the toxic organ ##op ##hos ##phate ##s , were almost certainly employed to assassinate individual " enemies of the state . "

reference_raw: Some of them, especially toxic organophosphates, were almost certainly used to kill individual "enemies of the state."

reference_spacy_tokens: Some of them , especially toxic organophosphates , were almost certainly used to kill individual " enemies of the state . "


fn_spacy_tokens_for_baseline: Floors were sometimes plastered , especially in light - wells or courtyards , with small pebbles mixed in with the plaster .

source_bert_toks: floors were sometimes plastered , especially in light - wells or courtyard ##s , with small pebbles mixed in with the plaster .

reference_raw: The floors were sometimes cast, especially in the light wells or in the courtyards, with small pebbles mixed with the cast.

reference_spacy_tokens: The floors were sometimes cast , especially in the light wells or in the courtyards , with small pebbles mixed with the cast .


fn_spacy_tokens_for_baseline: The judge dropped his requirement that Lassiter post a dlrs 5,000 secured bond and Lassiter waived the right to the hearing in the lower court , she said .

source_bert_toks: the judge dropped his requirement that lass ##iter post a dl ##rs 5 , 000 secured bond and lass ##iter waived the right to the hearing in the lower court , she said .

reference_raw: The judge has waived the requirement for Lassiter to post a dlrs 5,000 securities, and Lassiter has waived the right to be heard in a lower court, she said.

reference_spacy_tokens: The judge has waived the requirement for Lassiter to post a dlrs 5,000 securities , and Lassiter has waived the right to be heard in a lower court , she said .


fn_spacy_tokens_for_baseline: In silence Baynes led the way to the sink and held forward his candle .

source_bert_toks: in silence bay ##nes led the way to the sink and held forward his candle .

reference_raw: Baynes led them to the sink in silence and raised the candle.

reference_spacy_tokens: Baynes led them to the sink in silence and raised the candle .


fn_spacy_tokens_for_baseline: Arrived in Bombay they entrain and travel up the far - flung Raj to be snapped up by sex - starved subalterns , District Commissioners and political Officers .

source_bert_toks: arrived in bombay they en ##train and travel up the far - flung raj to be snapped up by sex - starved sub ##al ##tern ##s , district commissioners and political officers .

reference_raw: They arrived in Mumbay to train and travel across the distant Raj to be attacked by sex-starved sub-alterns, district commissioners, and political officers.

reference_spacy_tokens: They arrived in Mumbay to train and travel across the distant Raj to be attacked by sex - starved sub - alterns , district commissioners , and political officers .


fn_spacy_tokens_for_baseline: Masterminding this great force were the best brains in Germany , for the military profession carried a prestige unequalled by any other .

source_bert_toks: master ##mind ##ing this great force were the best brains in germany , for the military profession carried a prestige une ##qual ##led by any other .

reference_raw: Mastering this great power was the best mind in Germany, for the military profession had a prestige uneven with everyone else.

reference_spacy_tokens: Mastering this great power was the best mind in Germany , for the military profession had a prestige uneven with everyone else .


fn_spacy_tokens_for_baseline: THEY can cook up anything from spaghetti to a suckling pig , cater for Charter Balls to Russian banquets .

source_bert_toks: they can cook up anything from spaghetti to a suck ##ling pig , cater for charter balls to russian banquet ##s .

reference_raw: They can make anything from spaghetti to suckling pig, cater for Charter Balls to Russian banquets.

reference_spacy_tokens: They can make anything from spaghetti to suckling pig , cater for Charter Balls to Russian banquets .


fn_spacy_tokens_for_baseline: In Abidjan , the nation 's largest city , residents stocked up on food supplies , fearing a possible rebel counteroffensive .

source_bert_toks: in ab ##id ##jan , the nation ' s largest city , residents stocked up on food supplies , fearing a possible rebel counter ##off ##ens ##ive .

reference_raw: In Abidjan, the nation's largest city, residents were stocked with food supplies, fearing a possible insurgent counter-offensive.

reference_spacy_tokens: In Abidjan , the nation 's largest city , residents were stocked with food supplies , fearing a possible insurgent counter - offensive .


fn_spacy_tokens_for_baseline: Las Vegas would serve as a major stopover for crew rest and train repair .

source_bert_toks: las vegas would serve as a major stop ##over for crew rest and train repair .

reference_raw: Las Vegas would be the main stopover for crew respite and train repairs.

reference_spacy_tokens: Las Vegas would be the main stopover for crew respite and train repairs .


fn_spacy_tokens_for_baseline: Although research indicates that neonates do perceive pain , many healthcare professionals are reluctant to administer analgesics for fear of harmful side - effects .

source_bert_toks: although research indicates that neon ##ates do perceive pain , many healthcare professionals are reluctant to administer anal ##ges ##ics for fear of harmful side - effects .

reference_raw: Although research suggests that newborns experience pain, many health professionals are reluctant to administer analgesics because they fear harmful side effects.

reference_spacy_tokens: Although research suggests that newborns experience pain , many health professionals are reluctant to administer analgesics because they fear harmful side effects .


fn_spacy_tokens_for_baseline: The center 's director pledged a thorough review of safety procedures .

source_bert_toks: the center ' s director pledged a thorough review of safety procedures .

reference_raw: The Director of the Centre has committed himself to an in-depth review of security practices.

reference_spacy_tokens: The Director of the Centre has committed himself to an in - depth review of security practices .


fn_spacy_tokens_for_baseline: Even ordinary words sounded nice in his gentle accented English , and she felt pleased to have Rafaelo 's approbation .

source_bert_toks: even ordinary words sounded nice in his gentle accent ##ed english , and she felt pleased to have rafael ##o ' s app ##ro ##bation .

reference_raw: Even the ordinary words sounded good in his soft English accent, and she was glad to hear Rafael's approval.

reference_spacy_tokens: Even the ordinary words sounded good in his soft English accent , and she was glad to hear Rafael 's approval .


fn_spacy_tokens_for_baseline: Because you then went to Potts with some cock - and - bull story about my instructing you to do some work on cross - border trade .

source_bert_toks: because you then went to pot ##ts with some cock - and - bull story about my ins ##tructing you to do some work on cross - border trade .

reference_raw: Because then you went to Potts with a story about how I ordered you to do a job in cross-border trade.

reference_spacy_tokens: Because then you went to Potts with a story about how I ordered you to do a job in cross - border trade .


fn_spacy_tokens_for_baseline: Photos and documents tell the life story of the physician - revolutionary - statesman , who lived for a time in Macau , but never in this building .

source_bert_toks: photos and documents tell the life story of the physician - revolutionary - statesman , who lived for a time in macau , but never in this building .

reference_raw: Photographs and documents reveal the life story of a doctor, a revolutionary statesman who lived in Macau for a while, but never in this building.

reference_spacy_tokens: Photographs and documents reveal the life story of a doctor , a revolutionary statesman who lived in Macau for a while , but never in this building .


fn_spacy_tokens_for_baseline: Latin America as a whole contributed only 5.45 % to the total number of scientific publications in these ten years ( RICYT 2002 ) .

source_bert_toks: latin america as a whole contributed only 5 . 45 % to the total number of scientific publications in these ten years ( ric ##yt 2002 ) .

reference_raw: The total number of scientific publications in these 10 years (RICYT 2002) has contributed only 5.45% to Latin America as a whole.

reference_spacy_tokens: The total number of scientific publications in these 10 years ( RICYT 2002 ) has contributed only 5.45 % to Latin America as a whole .


fn_spacy_tokens_for_baseline: ' Important enough to fuck up the raid ? '

source_bert_toks: ' important enough to fuck up the raid ? '

reference_raw: "Important enough to screw up a raid?"

reference_spacy_tokens: " Important enough to screw up a raid ? "


fn_spacy_tokens_for_baseline: Again , he 's not a fool . ) Simply put , Stephanopoulos did as much as any man to get the country into the mess he now so telegenically laments .

source_bert_toks: again , he ' s not a fool . ) simply put , stephan ##op ##oulos did as much as any man to get the country into the mess he now so tel ##ege ##nical ##ly lame ##nts .

reference_raw: Once again, he is not a fool.) Put simply, Stephanopoulos has done as much as any man has done to put the country in the chaos he now so telegenically laments.

reference_spacy_tokens: Once again , he is not a fool . ) Put simply , Stephanopoulos has done as much as any man has done to put the country in the chaos he now so telegenically laments .


fn_spacy_tokens_for_baseline: You can catch one of Hong Kong 's historic trams along Des Voeux Road and ride from Central to Causeway Bay ( see box , page 66 ) .

source_bert_toks: you can catch one of hong kong ' s historic trams along des vo ##eux road and ride from central to causeway bay ( see box , page 66 ) .

reference_raw: You can catch one of Hong Kong's historical trams along Des Voeux Road and drive from Central to Causeway Bay (see box, page 66).

reference_spacy_tokens: You can catch one of Hong Kong 's historical trams along Des Voeux Road and drive from Central to Causeway Bay ( see box , page 66 ) .


fn_spacy_tokens_for_baseline: If suspected sites in Iran could be identified , the IAEA could monitor them .

source_bert_toks: if suspected sites in iran could be identified , the ia ##ea could monitor them .

reference_raw: If suspicious locations in Iran could be identified, they could be monitored by the IAEA.

reference_spacy_tokens: If suspicious locations in Iran could be identified , they could be monitored by the IAEA .


fn_spacy_tokens_for_baseline: Cheerful is the third local broking firm to undergo a major shake - up in the aftermath of the Hong Kong stock market tumble .

source_bert_toks: cheerful is the third local bro ##king firm to undergo a major shake - up in the aftermath of the hong kong stock market tumble .

reference_raw: Cheerful is the third local brokerage company to undergo a major shake-up after the collapse of the Hong Kong stock market.

reference_spacy_tokens: Cheerful is the third local brokerage company to undergo a major shake - up after the collapse of the Hong Kong stock market .


fn_spacy_tokens_for_baseline: Recent business projections for Las Vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

source_bert_toks: recent business projections for las vegas predict challenges ; tourism revenues must increase substantially to sustain what is already built , while actual figures show visitation as steady or declining .

reference_raw: Recent business forecasts in Las Vegas predict challenges; tourism revenues need to increase significantly in order to maintain what has already been built, while real data show that visits are stable or declining.

reference_spacy_tokens: Recent business forecasts in Las Vegas predict challenges ; tourism revenues need to increase significantly in order to maintain what has already been built , while real data show that visits are stable or declining .


fn_spacy_tokens_for_baseline: Such a breeze to fit , they 've caused a storm :

source_bert_toks: such a breeze to fit , they ' ve caused a storm :

reference_raw: Such a wind that fits, causes a storm:

reference_spacy_tokens: Such a wind that fits , causes a storm :


fn_spacy_tokens_for_baseline: All that day she thought about his words , considered them , agonised over them , tried to justify her behaviour that now seemed to bear no justification at all .

source_bert_toks: all that day she thought about his words , considered them , ago ##nis ##ed over them , tried to justify her behaviour that now seemed to bear no justification at all .

reference_raw: She had been thinking about his words all day, thinking about them, agonizing about them, trying to justify her behavior, which now seemed to have no reason at all.

reference_spacy_tokens: She had been thinking about his words all day , thinking about them , agonizing about them , trying to justify her behavior , which now seemed to have no reason at all .


fn_spacy_tokens_for_baseline: Iran is often accused in Western circles of secretly developing an offensive biological warfare ( BW ) program .

source_bert_toks: iran is often accused in western circles of secretly developing an offensive biological warfare ( b ##w ) program .

reference_raw: In Western circles, Iran is often accused of secretly developing an offensive biological war program.

reference_spacy_tokens: In Western circles , Iran is often accused of secretly developing an offensive biological war program .


fn_spacy_tokens_for_baseline: Served with gas central heating the property combines space with a convenient setting in landscaped communal gardens .

source_bert_toks: served with gas central heating the property combines space with a convenient setting in landscape ##d communal gardens .

reference_raw: Served by the central heating of the gas, the property is a combination of space and comfortable environments in the landscaped community gardens.

reference_spacy_tokens: Served by the central heating of the gas , the property is a combination of space and comfortable environments in the landscaped community gardens .


fn_spacy_tokens_for_baseline: Alberts was expected to plead guilty to starting a fire at the Schiller University in Waterloo , south London , where he was studying hotel management .

source_bert_toks: albert ##s was expected to plead guilty to starting a fire at the sc ##hill ##er university in waterloo , south london , where he was studying hotel management .

reference_raw: Alberts was supposed to confess to starting a fire at the Schiller University in Waterloo, South London, where he studied hotel management.

reference_spacy_tokens: Alberts was supposed to confess to starting a fire at the Schiller University in Waterloo , South London , where he studied hotel management .


fn_spacy_tokens_for_baseline: China is replacing its older DF-5 missiles with new DF -5A variants , which may eventually be equipped with multiple warheads .

source_bert_toks: china is replacing its older d ##f - 5 missiles with new d ##f - 5 ##a variants , which may eventually be equipped with multiple war ##heads .

reference_raw: China is replacing its older DF-5 missiles with new variants of DF-5A, which may ultimately be equipped with multiple warheads.

reference_spacy_tokens: China is replacing its older DF-5 missiles with new variants of DF-5A , which may ultimately be equipped with multiple warheads .


fn_spacy_tokens_for_baseline: Irrespective of the upstream mechanism of FFA and CD 36 interaction , our results demonstrate very rapid activation of a well - characterized intracellular kinase cascade of proapoptotic signaling .

source_bert_toks: ir ##res ##pe ##ctive of the upstream mechanism of ff ##a and cd 36 interaction , our results demonstrate very rapid activation of a well - characterized intra ##cellular kinase cascade of pro ##ap ##op ##to ##tic signaling .

reference_raw: Irrespective of the upstream mechanism of FFA and CD 36 interactions, our results show very fast activation of the well-characterized intracellular kinase cascade of proapoptotic signalling.

reference_spacy_tokens: Irrespective of the upstream mechanism of FFA and CD 36 interactions , our results show very fast activation of the well - characterized intracellular kinase cascade of proapoptotic signalling .


fn_spacy_tokens_for_baseline: Portugal 's resulting near - monopoly of East - West trade understandably awakened the competitive instincts of other European powers .

source_bert_toks: portugal ' s resulting near - monopoly of east - west trade understand ##ably awakened the competitive instincts of other european powers .

reference_raw: The result of Portugal's near-monopolis of the East-West Trade has, of course, awakened the competitive instincts of other European forces.

reference_spacy_tokens: The result of Portugal 's near - monopolis of the East - West Trade has , of course , awakened the competitive instincts of other European forces .


fn_spacy_tokens_for_baseline: Nor did divisions and bickering between Protestants lend prestige to their faith .

source_bert_toks: nor did divisions and bi ##cker ##ing between protestants lend prestige to their faith .

reference_raw: The divisions and squabbles between Protestants did not lend prestige to their beliefs.

reference_spacy_tokens: The divisions and squabbles between Protestants did not lend prestige to their beliefs .


fn_spacy_tokens_for_baseline: Hon . Members can imagine how inept the Government must be to believe that overlooking a prison yard , floodlit day and night , would be conducive to the recuperation of neurosurgical patients .

source_bert_toks: hon . members can imagine how in ##ept the government must be to believe that overlooking a prison yard , flood ##lit day and night , would be con ##du ##ci ##ve to the rec ##up ##eration of ne ##uro ##sur ##gical patients .

reference_raw: Hon. Members can imagine how inept the government must be to believe that overlooking the prison yard, flooding day and night, would contribute to the recovery of neurosurgical patients.

reference_spacy_tokens: Hon . Members can imagine how inept the government must be to believe that overlooking the prison yard , flooding day and night , would contribute to the recovery of neurosurgical patients .