fn_spacy_tokens_for_baseline: There are indications , however , that certain personnel who were intimately involved in the program , including Basson , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers trafficking in dangerous weapons , and perhaps also -- if certain journalists can be believed -- to elements of a shadowy international network of right - wing extremists .

source_bert_toks: there are indications , however , that certain personnel who were intimately involved in the program , including bass ##on , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as libya , to foreign intelligence personnel , to un ##sc ##rup ##ulous black market ##ers trafficking in dangerous weapons , and perhaps also - - if certain journalists can be believed - - to elements of a shadowy international network of right - wing ex ##tre ##mist ##s .

reference_raw: However, there are indications that some of the personnel involved in the programme, including Basson, may have provided technical knowledge, equipment, or material to "rogue regimes" such as Libya, to foreign intelligence personnel, to unscrupulous black marketers dealing in dangerous weapons, and possibly, if some journalists can be trusted, to elements of the shadowy international network of right-wing extremists.

reference_spacy_tokens: However , there are indications that some of the personnel involved in the programme , including Basson , may have provided technical knowledge , equipment , or material to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers dealing in dangerous weapons , and possibly , if some journalists can be trusted , to elements of the shadowy international network of right - wing extremists .


fn_spacy_tokens_for_baseline: Records indicate that 531 were deported , 162 were released on bond , 24 received some kind of immigration benefits , 12 had their proceedings terminated , and 8-one of whom was Moussaoui -were remanded to the custody of the U.S.

source_bert_toks: records indicate that 53 ##1 were deported , 162 were released on bond , 24 received some kind of immigration benefits , 12 had their proceedings terminated , and 8 - one of whom was mo ##uss ##ao ##ui - were re ##man ##ded to the custody of the u . s .

reference_raw: According to the records, 531 were deported, 162 were released on bonds, 24 received some sort of immigration allowance, 12 had their trial terminated, and 8-one of which was Moussaoui-were transferred to the custody of the United States.

reference_spacy_tokens: According to the records , 531 were deported , 162 were released on bonds , 24 received some sort of immigration allowance , 12 had their trial terminated , and 8-one of which was Moussaoui - were transferred to the custody of the United States .


fn_spacy_tokens_for_baseline: There is chemical pollution discharged into rivers from factories and chemical plants , which clogs up the rivers with toxic substances and adds to the filth in the seas .

source_bert_toks: there is chemical pollution discharged into rivers from factories and chemical plants , which cl ##og ##s up the rivers with toxic substances and adds to the fi ##lth in the seas .

reference_raw: Chemical pollution is discharged into the streams from factories and chemical plants, which clogs the streams with toxic substances and adds dirt to the sea.

reference_spacy_tokens: Chemical pollution is discharged into the streams from factories and chemical plants , which clogs the streams with toxic substances and adds dirt to the sea .


fn_spacy_tokens_for_baseline: The small research reactor has been used to produce radioisotopes and to train personnel .

source_bert_toks: the small research reactor has been used to produce radio ##iso ##top ##es and to train personnel .

reference_raw: The little research reactor was used for the production of radioisotopes and the training of personnel.

reference_spacy_tokens: The little research reactor was used for the production of radioisotopes and the training of personnel .


fn_spacy_tokens_for_baseline: By 1958 , both the United States and the Soviet Union had carried out test explosions with single bombs at least a thousand times more deadly .

source_bert_toks: by 1958 , both the united states and the soviet union had carried out test explosions with single bombs at least a thousand times more deadly .

reference_raw: By 1958, the United States and the Soviet Union had carried out test explosions with single bombs at least a thousand times more lethal.

reference_spacy_tokens: By 1958 , the United States and the Soviet Union had carried out test explosions with single bombs at least a thousand times more lethal .


fn_spacy_tokens_for_baseline: Gosse 's career was interrupted by the outbreak of war in 1914 , in which he served as a captain in the Royal Army Medical Corps .

source_bert_toks: go ##sse ' s career was interrupted by the outbreak of war in 1914 , in which he served as a captain in the royal army medical corps .

reference_raw: Gosse's career was interrupted by an outbreak of war in 1914, where he was chief of the Royal Army Medical Corps.

reference_spacy_tokens: Gosse 's career was interrupted by an outbreak of war in 1914 , where he was chief of the Royal Army Medical Corps .


fn_spacy_tokens_for_baseline: Outside the terminal , you will find taxis as well as buses to all points ( take 3 , 3A , 10 , or 10A to the historic center ; exact change is required ) .

source_bert_toks: outside the terminal , you will find taxis as well as buses to all points ( take 3 , 3a , 10 , or 10 ##a to the historic center ; exact change is required ) .

reference_raw: You will find taxis and buses outside the terminal at all points (take 3, 3A, 10 or 10A to the historical centre; precise change is required).

reference_spacy_tokens: You will find taxis and buses outside the terminal at all points ( take 3 , 3A , 10 or 10A to the historical centre ; precise change is required ) .


fn_spacy_tokens_for_baseline: Bert , a lanky , lugubrious individual , declined .

source_bert_toks: bert , a lan ##ky , lu ##gu ##bri ##ous individual , declined .

reference_raw: Bert, a lanky, luxurious individual, refused.

reference_spacy_tokens: Bert , a lanky , luxurious individual , refused .


fn_spacy_tokens_for_baseline: The slim person will have a couple of chocolates in the day , then stop .

source_bert_toks: the slim person will have a couple of chocolate ##s in the day , then stop .

reference_raw: A skinny person gets a few chocolates a day and then stops.

reference_spacy_tokens: A skinny person gets a few chocolates a day and then stops .


fn_spacy_tokens_for_baseline: She was still mad at Lucy for something , and Lucy was sure that a little time and concentration would tell her what . but for the moment , somehow , the knowledge was just out of reach .

source_bert_toks: she was still mad at lucy for something , and lucy was sure that a little time and concentration would tell her what . but for the moment , somehow , the knowledge was just out of reach .

reference_raw: She was still angry at Lucy for something, and Lucy was sure that some time and concentration would tell her what it was . . . but for the moment, somehow, that knowledge was beyond her reach.

reference_spacy_tokens: She was still angry at Lucy for something , and Lucy was sure that some time and concentration would tell her what it was . . . but for the moment , somehow , that knowledge was beyond her reach .


fn_spacy_tokens_for_baseline: Home Secretary Kenneth Clarke said of Mr Major : ' I am sure he will retain the leadership for many years to come and he is in the process of emerging from the Government 's present difficulties . "

source_bert_toks: home secretary kenneth clarke said of mr major : ' i am sure he will retain the leadership for many years to come and he is in the process of emerging from the government ' s present difficulties . "

reference_raw: Home Secretary Kenneth Clarke said about Mr. Major, "I'm sure he'll be in charge for many years to come, and he's about to emerge from the government's current difficulties."

reference_spacy_tokens: Home Secretary Kenneth Clarke said about Mr. Major , " I 'm sure he 'll be in charge for many years to come , and he 's about to emerge from the government 's current difficulties . "


fn_spacy_tokens_for_baseline: He also threatened to drag him down the street handcuffed to the bumper of his car .

source_bert_toks: he also threatened to drag him down the street hand ##cu ##ffed to the bumper of his car .

reference_raw: He also threatened to pull him down the street, handcuffed to the bumper of his car.

reference_spacy_tokens: He also threatened to pull him down the street , handcuffed to the bumper of his car .


fn_spacy_tokens_for_baseline: Valentin has been discreet about his upbringing .

source_bert_toks: valentin has been discreet about his upbringing .

reference_raw: Valentin was discrete in his education.

reference_spacy_tokens: Valentin was discrete in his education .


fn_spacy_tokens_for_baseline: But French Gen. Bernard Janvier , the head of U. N. military forces in the former Yugoslav federation , turned down the request , construing U. N. Security Council rules to mean the attack on airfields was prohibited .

source_bert_toks: but french gen . bernard jan ##vier , the head of u . n . military forces in the former yugoslav federation , turned down the request , con ##st ##ru ##ing u . n . security council rules to mean the attack on airfields was prohibited .

reference_raw: But French General Bernard Janvier, head of the U.N. military forces of the former Yugoslav Federation, rejected the request and interpreted the U.N. Security Council's rules as a ban on attacking airports.

reference_spacy_tokens: But French General Bernard Janvier , head of the U.N. military forces of the former Yugoslav Federation , rejected the request and interpreted the U.N. Security Council 's rules as a ban on attacking airports .


fn_spacy_tokens_for_baseline: ' Well , you remember that I want you in by one at the latest . '

source_bert_toks: ' well , you remember that i want you in by one at the latest . '

reference_raw: "Well, remember, I'd like you to come by no later than one."

reference_spacy_tokens: " Well , remember , I 'd like you to come by no later than one . "


fn_spacy_tokens_for_baseline: The courses place special emphasis on the development of expertise in mathematical modelling , that is , in the analysis and mathematical representation of practical problems arising in all areas of the world of work .

source_bert_toks: the courses place special emphasis on the development of expertise in mathematical modelling , that is , in the analysis and mathematical representation of practical problems arising in all areas of the world of work .

reference_raw: The courses pay particular attention to the development of expertise in mathematical modelling, i.e. the analysis and mathematical representation of the practical problems encountered in all areas of the world of work.

reference_spacy_tokens: The courses pay particular attention to the development of expertise in mathematical modelling , i.e. the analysis and mathematical representation of the practical problems encountered in all areas of the world of work .


fn_spacy_tokens_for_baseline: He 's one of the nicest guys , I think , in showbusiness .

source_bert_toks: he ' s one of the nice ##st guys , i think , in show ##bus ##iness .

reference_raw: I think he's one of the prettiest guys in show business.

reference_spacy_tokens: I think he 's one of the prettiest guys in show business .


fn_spacy_tokens_for_baseline: There 's loads of shops with their lights on and traffic and people hurrying along the pavement .

source_bert_toks: there ' s loads of shops with their lights on and traffic and people hurrying along the pavement .

reference_raw: There's a lot of shops with lights on and traffic on, and people hurrying along the sidewalk.

reference_spacy_tokens: There 's a lot of shops with lights on and traffic on , and people hurrying along the sidewalk .


fn_spacy_tokens_for_baseline: In June , the government failed to persuade Hedges to extradite Ruiz Massieu to Mexico on charges he obstructed a probe into the assassination of his brother , Jose Francisco Ruiz Massieu , a ranking party official .

source_bert_toks: in june , the government failed to persuade hedges to extra ##dit ##e ruiz mass ##ieu to mexico on charges he ob ##st ##ru ##cted a probe into the assassination of his brother , jose francisco ruiz mass ##ieu , a ranking party official .

reference_raw: In June, the government failed to convince Hedges to hand over Ruiz Massieu to Mexico on charges of obstructing a probe for the murder of his brother, José Francisco Ruiz Massieu, a senior party official.

reference_spacy_tokens: In June , the government failed to convince Hedges to hand over Ruiz Massieu to Mexico on charges of obstructing a probe for the murder of his brother , Jose Francisco Ruiz Massieu , a senior party official .


fn_spacy_tokens_for_baseline: As the share markets of the eighties rocketed upwards so did my commission and much of it was reinvested .

source_bert_toks: as the share markets of the eighties rocket ##ed upwards so did my commission and much of it was rein ##ves ##ted .

reference_raw: As the stock markets in the '80s went up, so did my commission, and most of it was reinvested.

reference_spacy_tokens: As the stock markets in the ' 80s went up , so did my commission , and most of it was reinvested .


fn_spacy_tokens_for_baseline: Each hen can lay up to thirty eggs but deposits each one in a different pit .

source_bert_toks: each hen can lay up to thirty eggs but deposits each one in a different pit .

reference_raw: Each hen may lie up to thirty eggs, but each hen shall be placed in another hole.

reference_spacy_tokens: Each hen may lie up to thirty eggs , but each hen shall be placed in another hole .


fn_spacy_tokens_for_baseline: Since there are two offences -- and particularly in jurisdictions where there are three or more grades of homicide -- surely it is right and proper to use the lesser offence to mark significant differences in culpability .

source_bert_toks: since there are two offences - - and particularly in jurisdictions where there are three or more grades of homicide - - surely it is right and proper to use the lesser offence to mark significant differences in cu ##lp ##ability .

reference_raw: Since there are two offences - and especially in jurisdictions where there are three or more degrees of murder - it is certainly correct and appropriate to use a minor offence to mark significant differences in guilt.

reference_spacy_tokens: Since there are two offences - and especially in jurisdictions where there are three or more degrees of murder - it is certainly correct and appropriate to use a minor offence to mark significant differences in guilt .


fn_spacy_tokens_for_baseline: In 1850 Nesselrode expressed the view that ' Russia 's position and that of her Sovereign has not been as attractive or as powerful since 1814 ' .

source_bert_toks: in 1850 ness ##el ##rod ##e expressed the view that ' russia ' s position and that of her sovereign has not been as attractive or as powerful since 1814 ' .

reference_raw: In 1850, Nesselrode expressed the view that Russia's position and the government's position have not been as attractive or as strong since 1814'.

reference_spacy_tokens: In 1850 , Nesselrode expressed the view that Russia 's position and the government 's position have not been as attractive or as strong since 1814 ' .


fn_spacy_tokens_for_baseline: I sat by the phone and rang as many of them as I could , reassuring the ones who were home .

source_bert_toks: i sat by the phone and rang as many of them as i could , reassuring the ones who were home .

reference_raw: I sat by the phone and rang as many as I could, comforting those who were home.

reference_spacy_tokens: I sat by the phone and rang as many as I could , comforting those who were home .


fn_spacy_tokens_for_baseline: Most of our surrogates have been shown to have either agonist or antagonist activity in the appropriate biochemical and / or biological models ( [ 7 ] manuscripts in preparation ) .

source_bert_toks: most of our sur ##rogate ##s have been shown to have either ago ##nist or antagonist activity in the appropriate bio ##chemical and / or biological models ( [ 7 ] manuscripts in preparation ) .

reference_raw: It has been established that most of our surrogates have either agonist or antagonistic activity in the relevant biochemical and/or biological models ([7] manuscripts in preparation).

reference_spacy_tokens: It has been established that most of our surrogates have either agonist or antagonistic activity in the relevant biochemical and/or biological models ( [ 7 ] manuscripts in preparation ) .


fn_spacy_tokens_for_baseline: Begone from me and reflect upon what you have said .

source_bert_toks: beg ##one from me and reflect upon what you have said .

reference_raw: Get away from me and think about what you said.

reference_spacy_tokens: Get away from me and think about what you said .


fn_spacy_tokens_for_baseline: ( 2 ) Pituitary gland produces hormones which initially bring about sexual maturation , maintain activity of the gonads ( testes in men , ovaries in women ) and control the menstrual cycle .

source_bert_toks: ( 2 ) pit ##uit ##ary gland produces hormones which initially bring about sexual mat ##uration , maintain activity of the go ##nad ##s ( test ##es in men , o ##var ##ies in women ) and control the men ##st ##ru ##al cycle .

reference_raw: (2) The pituitary gland produces hormones that initially produce sexual maturation, maintain the activity of the gonads (tests in men, ovaries in women) and control the menstrual cycle.

reference_spacy_tokens: ( 2 ) The pituitary gland produces hormones that initially produce sexual maturation , maintain the activity of the gonads ( tests in men , ovaries in women ) and control the menstrual cycle .


fn_spacy_tokens_for_baseline: Such a violation would have occurred if Iran introduced nuclear material into the facility to test it , without informing the IAEA .

source_bert_toks: such a violation would have occurred if iran introduced nuclear material into the facility to test it , without informing the ia ##ea .

reference_raw: Such a breach would have occurred if Iran had introduced nuclear material into the facility to try it without informing the IAEA.

reference_spacy_tokens: Such a breach would have occurred if Iran had introduced nuclear material into the facility to try it without informing the IAEA .


fn_spacy_tokens_for_baseline: Above left Angela 's favourite farmyard painting , embroidered kettle holders and children 's drawings stud the wall above the kitchen sink .

source_bert_toks: above left angela ' s favourite farm ##yard painting , embroidered kettle holders and children ' s drawings stud the wall above the kitchen sink .

reference_raw: Above her left, Angela's favorite farmyard painting, embroidered kettle holders, and children's drawings were set against the wall above the kitchen sink.

reference_spacy_tokens: Above her left , Angela 's favorite farmyard painting , embroidered kettle holders , and children 's drawings were set against the wall above the kitchen sink .


fn_spacy_tokens_for_baseline: In February the Soviet Union confirmed that it intended to withdraw its troops from Czechoslovakia and Hungary by mid-1991 .

source_bert_toks: in february the soviet union confirmed that it intended to withdraw its troops from czechoslovakia and hungary by mid - 1991 .

reference_raw: In February, the Soviet Union confirmed its intention to pull troops out of Czechoslovakia and Hungary by mid-1991.

reference_spacy_tokens: In February , the Soviet Union confirmed its intention to pull troops out of Czechoslovakia and Hungary by mid-1991 .


fn_spacy_tokens_for_baseline: A regular in wellington boots plastered with cow dung ordered a pint , took off his overcoat and hung it up , unaware that he 'd lost his trousers somewhere en route .

source_bert_toks: a regular in wellington boots plastered with cow dung ordered a pin ##t , took off his over ##coat and hung it up , unaware that he ' d lost his trousers somewhere en route .

reference_raw: A regular in Wellington boots, covered with cow-dung, ordered a pint, removed his coat, and hung it up, not knowing he'd lost his pants somewhere on the way.

reference_spacy_tokens: A regular in Wellington boots , covered with cow - dung , ordered a pint , removed his coat , and hung it up , not knowing he 'd lost his pants somewhere on the way .


fn_spacy_tokens_for_baseline: A dim lamp swung over the entrance where three steps led up into the foyer .

source_bert_toks: a dim lamp swung over the entrance where three steps led up into the foyer .

reference_raw: A dim lamp swept over the entrance where three steps led to the foyer.

reference_spacy_tokens: A dim lamp swept over the entrance where three steps led to the foyer .


fn_spacy_tokens_for_baseline: ' I 've been forbidden to divulge , ' she said .

source_bert_toks: ' i ' ve been forbidden to di ##vu ##lge , ' she said .

reference_raw: "I'm not allowed to reveal myself," she said.

reference_spacy_tokens: " I 'm not allowed to reveal myself , " she said .


fn_spacy_tokens_for_baseline: A transition is currently underway from relatively inaccurate , liquid - fueled , silo / cave - based missiles ( DF-3 , DF -4 , DF -5 ) to more accurate , solid - fueled , mobile missiles ( DF-11 , DF-15 , and DF-21 , and a new ICBM [ the DF-31 ] and SLBM [ the JL-2 ] , which are currently under development ) .

source_bert_toks: a transition is currently underway from relatively inaccurate , liquid - fueled , si ##lo / cave - based missiles ( d ##f - 3 , d ##f - 4 , d ##f - 5 ) to more accurate , solid - fueled , mobile missiles ( d ##f - 11 , d ##f - 15 , and d ##f - 21 , and a new ic ##bm [ the d ##f - 31 ] and sl ##bm [ the j ##l - 2 ] , which are currently under development ) .

reference_raw: Moving from relatively inaccurate, liquid-fuelled, silo/cave-based missiles (DF-3, DF-4, DF-5) to more accurate, solid-fuelled, mobile missiles (DF-11, DF-15, DF-21, and the new ICBM [DF-31] and SLBM [JL-2] currently under development).

reference_spacy_tokens: Moving from relatively inaccurate , liquid - fuelled , silo / cave - based missiles ( DF-3 , DF-4 , DF-5 ) to more accurate , solid - fuelled , mobile missiles ( DF-11 , DF-15 , DF-21 , and the new ICBM [ DF-31 ] and SLBM [ JL-2 ] currently under development ) .


fn_spacy_tokens_for_baseline: The success of motivational and patient - centered approaches seems to indicate that it is critical to take into account the motivation of the patient and his or her readiness to change .

source_bert_toks: the success of motivation ##al and patient - centered approaches seems to indicate that it is critical to take into account the motivation of the patient and his or her readiness to change .

reference_raw: A successful motivational and patient-centred approach seems to suggest that consideration of the patient's motivation and readiness to change is crucial.

reference_spacy_tokens: A successful motivational and patient - centred approach seems to suggest that consideration of the patient 's motivation and readiness to change is crucial .


fn_spacy_tokens_for_baseline: Madeleine had on her spectacles and was reading the newspaper while Louis dozed on the sofa .

source_bert_toks: madeleine had on her spectacle ##s and was reading the newspaper while louis do ##zed on the sofa .

reference_raw: Madeleine was wearing glasses and reading the paper while Louis was sleeping on the couch.

reference_spacy_tokens: Madeleine was wearing glasses and reading the paper while Louis was sleeping on the couch .


fn_spacy_tokens_for_baseline: In response to the growth of traffic , the Tramways Department constructed a four - track terminal at South Shore , literally at the end of the new Promenade , where four cars could load simultaneously .

source_bert_toks: in response to the growth of traffic , the tramway ##s department constructed a four - track terminal at south shore , literally at the end of the new promenade , where four cars could load simultaneously .

reference_raw: In response to the increase in traffic, the Tramways Department built a four-track stop on the South Shore, literally at the end of the new Promenade, where four cars could load at the same time.

reference_spacy_tokens: In response to the increase in traffic , the Tramways Department built a four - track stop on the South Shore , literally at the end of the new Promenade , where four cars could load at the same time .


fn_spacy_tokens_for_baseline: ' It 's murder , Athelstan ! ' he bawled .

source_bert_toks: ' it ' s murder , at ##hel ##stan ! ' he ba ##wled .

reference_raw: 'This is murder, Athelstan!' he roared.

reference_spacy_tokens: ' This is murder , Athelstan ! ' he roared .


fn_spacy_tokens_for_baseline: Then the police car had crashed into a fence .

source_bert_toks: then the police car had crashed into a fence .

reference_raw: Then a police car hit the fence.

reference_spacy_tokens: Then a police car hit the fence .


fn_spacy_tokens_for_baseline: ' Would you be prepared to give me a prescription for a really strong sedative ?

source_bert_toks: ' would you be prepared to give me a prescription for a really strong se ##da ##tive ?

reference_raw: 'Are you ready to give me a prescription for a really strong tranquilizer?

reference_spacy_tokens: ' Are you ready to give me a prescription for a really strong tranquilizer ?


fn_spacy_tokens_for_baseline: Will Slaughter had been employed formerly as a headsman .

source_bert_toks: will slaughter had been employed formerly as a heads ##man .

reference_raw: Will Slaughter used to be a leader.

reference_spacy_tokens: Will Slaughter used to be a leader .


fn_spacy_tokens_for_baseline: Depicting swags of flowers interspaced between Berain - inspired cartouches and masks , it was in remarkably fine condition , its rich oranges and deep blues unfaded .

source_bert_toks: depicting sw ##ags of flowers inter ##space ##d between be ##rain - inspired cart ##ou ##ches and masks , it was in remarkably fine condition , its rich orange ##s and deep blues un ##fa ##ded .

reference_raw: He was in remarkably good shape, his rich oranges and deep blues unfathomed, depicting swags of flowers intertwined between the berain-inspired cartouches and masks.

reference_spacy_tokens: He was in remarkably good shape , his rich oranges and deep blues unfathomed , depicting swags of flowers intertwined between the berain - inspired cartouches and masks .


fn_spacy_tokens_for_baseline: The light danced about , we were above the thin cloud line and suddenly my pains had gone .

source_bert_toks: the light danced about , we were above the thin cloud line and suddenly my pains had gone .

reference_raw: The light swirled around us, and we were over a thin line of clouds, and all of a sudden my pain was gone.

reference_spacy_tokens: The light swirled around us , and we were over a thin line of clouds , and all of a sudden my pain was gone .


fn_spacy_tokens_for_baseline: We do not need to worry about Gioella di Grignano .

source_bert_toks: we do not need to worry about gi ##oe ##lla di gr ##ign ##ano .

reference_raw: We don't have to take care of Gioella di Grignano.

reference_spacy_tokens: We do n't have to take care of Gioella di Grignano .


fn_spacy_tokens_for_baseline: His awareness and exploitation of these rights enable him to achieve some success in making criticisms of the Czechoslovakian government .

source_bert_toks: his awareness and exploitation of these rights enable him to achieve some success in making criticisms of the czechoslovakia ##n government .

reference_raw: Its knowledge and exploitation of these rights enable it to achieve some success in criticising the Czechoslovak government.

reference_spacy_tokens: Its knowledge and exploitation of these rights enable it to achieve some success in criticising the Czechoslovak government .


fn_spacy_tokens_for_baseline: She looked across the open grave at Sarah , her stepdaughter , and it saddened her even more that the gulf between them had never been bridged .

source_bert_toks: she looked across the open grave at sarah , her step ##da ##ught ##er , and it sad ##dened her even more that the gulf between them had never been bridge ##d .

reference_raw: She looked across the open grave at Sarah, her stepfather, and it saddened her even more that the chasm between them had never been bridged.

reference_spacy_tokens: She looked across the open grave at Sarah , her stepfather , and it saddened her even more that the chasm between them had never been bridged .


fn_spacy_tokens_for_baseline: If you travel by train , you will arrive at the Guangzhou East Station , a large modern complex , which connects with the subway , buses , hotel transfer services , and taxis .

source_bert_toks: if you travel by train , you will arrive at the guangzhou east station , a large modern complex , which connects with the subway , buses , hotel transfer services , and taxis .

reference_raw: If you're on a train, you'll reach Guangzhou East Station, a large contemporary complex that connects to subways, buses, hotel transport services, and taxis.

reference_spacy_tokens: If you 're on a train , you 'll reach Guangzhou East Station , a large contemporary complex that connects to subways , buses , hotel transport services , and taxis .


fn_spacy_tokens_for_baseline: The eggs were collected in the Falkland Islands under licence from the British Antarctic Survey and transported by air to England .

source_bert_toks: the eggs were collected in the falkland islands under licence from the british antarctic survey and transported by air to england .

reference_raw: Eggs were collected in the Falkland Islands, licensed by the British Antarctic Survey, and shipped to England by air.

reference_spacy_tokens: Eggs were collected in the Falkland Islands , licensed by the British Antarctic Survey , and shipped to England by air .


fn_spacy_tokens_for_baseline: The fear was that Iran might learn how to construct a similar clandestine facility and then produce weapons - grade uranium undetected .

source_bert_toks: the fear was that iran might learn how to construct a similar clandestine facility and then produce weapons - grade uranium und ##ete ##cted .

reference_raw: The fear was that Iran would find a way to build a similar secret facility and then produce weapons-grade uranium undetected.

reference_spacy_tokens: The fear was that Iran would find a way to build a similar secret facility and then produce weapons - grade uranium undetected .


fn_spacy_tokens_for_baseline: Macau 's casinos are a source of non - stop excitement .

source_bert_toks: macau ' s casinos are a source of non - stop excitement .

reference_raw: Macau's casinos cause unstoppable excitement.

reference_spacy_tokens: Macau 's casinos cause unstoppable excitement .


fn_spacy_tokens_for_baseline: Yuille and Cutshall ( 1986 ) , for example , interviewed 13 witnesses to an actual shooting incident and found that the most highly stressed witnesses actually gave marginally more detailed statements .

source_bert_toks: yu ##ille and cuts ##hall ( 1986 ) , for example , interviewed 13 witnesses to an actual shooting incident and found that the most highly stressed witnesses actually gave marginal ##ly more detailed statements .

reference_raw: For example, Yuille and Cutshall (1986) interviewed 13 witnesses to a real shooting incident and found that the most distressed witnesses had in fact given a slightly more detailed statement.

reference_spacy_tokens: For example , Yuille and Cutshall ( 1986 ) interviewed 13 witnesses to a real shooting incident and found that the most distressed witnesses had in fact given a slightly more detailed statement .


fn_spacy_tokens_for_baseline: Some of the anger against Iran has boiled over into street protests , including rock - throwing demonstrations at the Iranian Consulate in Herat , the nearest large Afghan city to the western frontier .

source_bert_toks: some of the anger against iran has boiled over into street protests , including rock - throwing demonstrations at the iranian consulate in her ##at , the nearest large afghan city to the western frontier .

reference_raw: Some of the anger against Iran has boiled into street protests, including rock-throwing protests at the Iranian consulate in Herat, the closest major Afghan city to the western border.

reference_spacy_tokens: Some of the anger against Iran has boiled into street protests , including rock - throwing protests at the Iranian consulate in Herat , the closest major Afghan city to the western border .


fn_spacy_tokens_for_baseline: She did n't want to hear what he would say , did n't want to compound this foolishness with more folly , did n't want to hear him gloat at her easy capitulation .

source_bert_toks: she didn ' t want to hear what he would say , didn ' t want to compound this foolish ##ness with more folly , didn ' t want to hear him g ##lo ##at at her easy cap ##it ##ulation .

reference_raw: She didn't want to hear what he was going to say, she didn't want to mix this stupidity with more foolishness, she didn't want to hear him glee at her easy surrender.

reference_spacy_tokens: She did n't want to hear what he was going to say , she did n't want to mix this stupidity with more foolishness , she did n't want to hear him glee at her easy surrender .


fn_spacy_tokens_for_baseline: The accusations were flat and uniform , although what is truly remarkable is that the youth of the nation were believed not only to be free of all discipline , but also excessively affluent .

source_bert_toks: the accusations were flat and uniform , although what is truly remarkable is that the youth of the nation were believed not only to be free of all discipline , but also excessive ##ly affluent .

reference_raw: The allegations were flat and unified, though what is truly remarkable is that the young people of the nation were believed not only to be undisciplined, but also to be too rich.

reference_spacy_tokens: The allegations were flat and unified , though what is truly remarkable is that the young people of the nation were believed not only to be undisciplined , but also to be too rich .


fn_spacy_tokens_for_baseline: A new road running from the bypass to the Cleveland boundary is also to be built , eventually providing a link to A66 junction at Long Newton proposed by the Department of Transport .

source_bert_toks: a new road running from the bypass to the cleveland boundary is also to be built , eventually providing a link to a ##66 junction at long newton proposed by the department of transport .

reference_raw: It is also necessary to build a new road running from the by-pass to the Cleveland border, which eventually provides a link to the A66 crossroads at Long Newton, proposed by the Ministry of Transport.

reference_spacy_tokens: It is also necessary to build a new road running from the by - pass to the Cleveland border , which eventually provides a link to the A66 crossroads at Long Newton , proposed by the Ministry of Transport .


fn_spacy_tokens_for_baseline: Well it depends if they want to stay the night .

source_bert_toks: well it depends if they want to stay the night .

reference_raw: Depends on whether they want to spend the night.

reference_spacy_tokens: Depends on whether they want to spend the night .


fn_spacy_tokens_for_baseline: He trundled the Lada into Pushkin , down the Boulevard Vasenko , looking for a restaurant , preferably a McDonald 's .

source_bert_toks: he tr ##und ##led the lad ##a into push ##kin , down the boulevard vase ##nko , looking for a restaurant , prefer ##ably a mcdonald ' s .

reference_raw: He trudged Lada to Pushkin, down Vasenko Boulevard, looking for a restaurant, preferably McDonald's.

reference_spacy_tokens: He trudged Lada to Pushkin , down Vasenko Boulevard , looking for a restaurant , preferably McDonald 's .


fn_spacy_tokens_for_baseline: The city now suffers power , water and food shortages , and U. N. Secretary - General Ban Ki -moon has warned of an impending humanitarian crisis in the capital and the country 's rebel - controlled Nafusa Mountains region .

source_bert_toks: the city now suffers power , water and food shortages , and u . n . secretary - general ban ki - moon has warned of an impending humanitarian crisis in the capital and the country ' s rebel - controlled na ##fus ##a mountains region .

reference_raw: The city now suffers from a lack of energy, water, and food, and U.N. Secretary General Ban Ki-moon has alerted itself to the imminent humanitarian crisis in the capital and the rebel-controlled region of the Nafusa Mountains.

reference_spacy_tokens: The city now suffers from a lack of energy , water , and food , and U.N. Secretary General Ban Ki - moon has alerted itself to the imminent humanitarian crisis in the capital and the rebel - controlled region of the Nafusa Mountains .


fn_spacy_tokens_for_baseline: About 30 adults were arrested in raids on ten Children of God homes on Wednesday night by police investigating claims of child abuse .

source_bert_toks: about 30 adults were arrested in raids on ten children of god homes on wednesday night by police investigating claims of child abuse .

reference_raw: About 30 adults were arrested on Wednesday night during the raids on the ten children of God's homes by the police examining allegations of child abuse.

reference_spacy_tokens: About 30 adults were arrested on Wednesday night during the raids on the ten children of God 's homes by the police examining allegations of child abuse .


fn_spacy_tokens_for_baseline: A few things nettled her : she did not relish being a clearing house for family complaints , for instance , and was carefully reticent on such occasions .

source_bert_toks: a few things net ##tled her : she did not re ##lish being a clearing house for family complaints , for instance , and was carefully re ##tic ##ent on such occasions .

reference_raw: There were a few things that bothered her: she didn't like being a clearing house for family complaints, for example, and she was carefully reticent on such occasions.

reference_spacy_tokens: There were a few things that bothered her : she did n't like being a clearing house for family complaints , for example , and she was carefully reticent on such occasions .


fn_spacy_tokens_for_baseline: Angus handed him his flask .

source_bert_toks: angus handed him his fl ##ask .

reference_raw: Angus handed him the bottle.

reference_spacy_tokens: Angus handed him the bottle .


fn_spacy_tokens_for_baseline: They think they can distribute pamphlets and gold and a vast army of monarchists will materialize overnight .

source_bert_toks: they think they can distribute pamphlets and gold and a vast army of monarch ##ists will material ##ize overnight .

reference_raw: They think they can distribute pamphlets and gold, and a huge army of monarchists will materialise overnight.

reference_spacy_tokens: They think they can distribute pamphlets and gold , and a huge army of monarchists will materialise overnight .


fn_spacy_tokens_for_baseline: 3- If a mountainous location is unviable , then choose a location next to official buidings so as to avoid being bombarded .

source_bert_toks: 3 - if a mountainous location is un ##via ##ble , then choose a location next to official bu ##idi ##ng ##s so as to avoid being bomb ##arded .

reference_raw: 3- If the mountain site is unviable, select a place next to the official construction site so that it is not bombarded.

reference_spacy_tokens: 3- If the mountain site is unviable , select a place next to the official construction site so that it is not bombarded .


fn_spacy_tokens_for_baseline: It will potentially drive a wedge between the Catholic H.E.

source_bert_toks: it will potentially drive a wedge between the catholic h . e .

reference_raw: Potentially, it's going to drive a lap between Catholic H.E.

reference_spacy_tokens: Potentially , it 's going to drive a lap between Catholic H.E.


fn_spacy_tokens_for_baseline: This caused Rajiv a great deal of turmoil , particularly as others of his friends had been baptised by immersion in the local Baptist church .

source_bert_toks: this caused raj ##iv a great deal of turmoil , particularly as others of his friends had been baptised by immersion in the local baptist church .

reference_raw: That caused Rajiv a great deal of confusion, especially since others of his friends were baptized in a local Baptist church.

reference_spacy_tokens: That caused Rajiv a great deal of confusion , especially since others of his friends were baptized in a local Baptist church .


fn_spacy_tokens_for_baseline: De Niro does n't seem particularly keen to discuss his reasons for wanting to run a restaurant , and will only say that it 's been a vague dream of his for a while .

source_bert_toks: de ni ##ro doesn ' t seem particularly keen to discuss his reasons for wanting to run a restaurant , and will only say that it ' s been a vague dream of his for a while .

reference_raw: De Niro doesn't seem particularly keen to talk about his reasons for wanting to run the restaurant, and he'll just say it's been his vague dream for a while.

reference_spacy_tokens: De Niro does n't seem particularly keen to talk about his reasons for wanting to run the restaurant , and he 'll just say it 's been his vague dream for a while .


fn_spacy_tokens_for_baseline: They 've talked about Mondo 2000 , virtual raves , about smart drugs and new psychedelics , about chaos theory and fractals .

source_bert_toks: they ' ve talked about mon ##do 2000 , virtual rave ##s , about smart drugs and new psychedelic ##s , about chaos theory and fra ##cta ##ls .

reference_raw: They talked about the Mondo 2000, the virtual ravens, the clever drugs and the new psychedelics, the theory of chaos and fractals.

reference_spacy_tokens: They talked about the Mondo 2000 , the virtual ravens , the clever drugs and the new psychedelics , the theory of chaos and fractals .


fn_spacy_tokens_for_baseline: More than 150 nuclear safety experts from 36 countries met in Vienna on May 14 - 18 to exchange information on operating experience at nuclear plants and to analyse new dimensions in nuclear safety .

source_bert_toks: more than 150 nuclear safety experts from 36 countries met in vienna on may 14 - 18 to exchange information on operating experience at nuclear plants and to anal ##yse new dimensions in nuclear safety .

reference_raw: On May 14-18, more than 150 nuclear safety experts from 36 countries gathered in Vienna to exchange information on the operational experience of nuclear power plants and analyse new aspects of nuclear safety.

reference_spacy_tokens: On May 14 - 18 , more than 150 nuclear safety experts from 36 countries gathered in Vienna to exchange information on the operational experience of nuclear power plants and analyse new aspects of nuclear safety .


fn_spacy_tokens_for_baseline: The door clattered open and George , barely awake , stumbled in .

source_bert_toks: the door cl ##atter ##ed open and george , barely awake , stumbled in .

reference_raw: The door clicked open, and George, barely awake, staggered inside.

reference_spacy_tokens: The door clicked open , and George , barely awake , staggered inside .


fn_spacy_tokens_for_baseline: Heat the butter in a wok or a large frying pan over medium heat .

source_bert_toks: heat the butter in a wo ##k or a large fry ##ing pan over medium heat .

reference_raw: Warm the butter in a wok or a large frying pan over mid-heat.

reference_spacy_tokens: Warm the butter in a wok or a large frying pan over mid - heat .


fn_spacy_tokens_for_baseline: The guest speaker was Miss Mary Thomas , who gave a very humorous and entertaining talk entitled ' The Dark House Venture ' .

source_bert_toks: the guest speaker was miss mary thomas , who gave a very humorous and entertaining talk entitled ' the dark house venture ' .

reference_raw: The guest speaker was Miss Mary Thomas, who gave a very funny and amusing speech called "Dark House Venture."

reference_spacy_tokens: The guest speaker was Miss Mary Thomas , who gave a very funny and amusing speech called " Dark House Venture . "


fn_spacy_tokens_for_baseline: And in that time the number of share - owners has more than tripled to more than nine million .

source_bert_toks: and in that time the number of share - owners has more than triple ##d to more than nine million .

reference_raw: And at that time, the number of shareholders has more than three times to more than nine million.

reference_spacy_tokens: And at that time , the number of shareholders has more than three times to more than nine million .


fn_spacy_tokens_for_baseline: Guyton de Morveau and L. J. Thenard were among the unsung heroes of 19th century painting .

source_bert_toks: guy ##ton de mor ##ve ##au and l . j . then ##ard were among the un ##sun ##g heroes of 19th century painting .

reference_raw: Guyton de Morveau and L.J. Thenard were one of 19th-century painting heroes who didn't sing.

reference_spacy_tokens: Guyton de Morveau and L.J. Thenard were one of 19th - century painting heroes who did n't sing .


fn_spacy_tokens_for_baseline: I may add that Miss Burnet 's age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

source_bert_toks: i may add that miss burn ##et ' s age and character make it certain that my first idea that there might be a love interest in our story is out of the question .

reference_raw: I might add that Ms. Burnet's years and character make sure that my first thought of having a love interest in our story is out of the question.

reference_spacy_tokens: I might add that Ms. Burnet 's years and character make sure that my first thought of having a love interest in our story is out of the question .


fn_spacy_tokens_for_baseline: It is also unclear whether the EC will be permitted to join the IWC , since the organization 's 1946 founding charter stipulates that only governments can accede .

source_bert_toks: it is also unclear whether the ec will be permitted to join the i ##wc , since the organization ' s 1946 founding charter st ##ip ##ulates that only governments can acc ##ede .

reference_raw: It is also unclear whether the EC will be allowed to join the IWC, since the 1946 Charter of the Organisation provides that only governments may join the IWC.

reference_spacy_tokens: It is also unclear whether the EC will be allowed to join the IWC , since the 1946 Charter of the Organisation provides that only governments may join the IWC .


fn_spacy_tokens_for_baseline: Following its victory , Athens introduced the concept of a mutual protection alliance ( a kind of NATO of the ancient world ) .

source_bert_toks: following its victory , athens introduced the concept of a mutual protection alliance ( a kind of nato of the ancient world ) .

reference_raw: After its victory, Athens introduced the concept of an alliance for mutual protection (a kind of NATO from the old world).

reference_spacy_tokens: After its victory , Athens introduced the concept of an alliance for mutual protection ( a kind of NATO from the old world ) .


fn_spacy_tokens_for_baseline: She was scared of what might be hiding in the shadows but she was terrified of her subconscious .

source_bert_toks: she was scared of what might be hiding in the shadows but she was terrified of her subconscious .

reference_raw: She was afraid of what might lurk in the shadows, but she was afraid of her subconscious.

reference_spacy_tokens: She was afraid of what might lurk in the shadows , but she was afraid of her subconscious .


fn_spacy_tokens_for_baseline: QN : Does the US Department of Defense ( DOD ) plan to secure all of Russia 's CW stockpiles ?

source_bert_toks: q ##n : does the us department of defense ( dod ) plan to secure all of russia ' s cw stock ##pile ##s ?

reference_raw: QN: Is the U.S. Department of Defense planning to provide all Russian CW supplies?

reference_spacy_tokens: QN : Is the U.S. Department of Defense planning to provide all Russian CW supplies ?


fn_spacy_tokens_for_baseline: There is also a short video presentation called " Bermuda : Centre of the Atlantic , " which tells the story of the founding and development of the island .

source_bert_toks: there is also a short video presentation called " bermuda : centre of the atlantic , " which tells the story of the founding and development of the island .

reference_raw: There is also a brief video presentation called "Bermuda: Center of the Atlantic", which tells the story of the isle's founding and development.

reference_spacy_tokens: There is also a brief video presentation called " Bermuda : Center of the Atlantic " , which tells the story of the isle 's founding and development .


fn_spacy_tokens_for_baseline: The executions took place after Greece 's unsuccessful campaign against Turkey .

source_bert_toks: the executions took place after greece ' s unsuccessful campaign against turkey .

reference_raw: The executions took place after Greece's failed campaign against Turkey.

reference_spacy_tokens: The executions took place after Greece 's failed campaign against Turkey .


fn_spacy_tokens_for_baseline: They both listened to the gentle burble of the exhaust for another minute , then Bert cut the engine .

source_bert_toks: they both listened to the gentle bu ##rb ##le of the exhaust for another minute , then bert cut the engine .

reference_raw: The two of them listened for a moment to the faint bubbling of the exhaust, then Bert shut off the engine.

reference_spacy_tokens: The two of them listened for a moment to the faint bubbling of the exhaust , then Bert shut off the engine .


fn_spacy_tokens_for_baseline: The physicist just in from Colorado looked baffled .

source_bert_toks: the physicist just in from colorado looked baffled .

reference_raw: The physicist from Colorado looked puzzled.

reference_spacy_tokens: The physicist from Colorado looked puzzled .


fn_spacy_tokens_for_baseline: He said Allitt had been on duty on 24 occasions when children suffered collapses on the ward .

source_bert_toks: he said all ##itt had been on duty on 24 occasions when children suffered collapses on the ward .

reference_raw: He said Allitt was on duty 24 times when the kids had a breakdown in the department.

reference_spacy_tokens: He said Allitt was on duty 24 times when the kids had a breakdown in the department .


fn_spacy_tokens_for_baseline: Well it depends .

source_bert_toks: well it depends .

reference_raw: Well, that's up to it.

reference_spacy_tokens: Well , that 's up to it .


fn_spacy_tokens_for_baseline: He left us for a glamorous Frenchwoman and he never even sent me a card in all that time . '

source_bert_toks: he left us for a g ##lam ##orous french ##woman and he never even sent me a card in all that time . '

reference_raw: He left us for a charming Frenchman, and he didn't send me a card all the time.'

reference_spacy_tokens: He left us for a charming Frenchman , and he did n't send me a card all the time . '


fn_spacy_tokens_for_baseline: He said it would be the first of a series of ventures which Gooding was discussing with Japanese companies , aimed at bringing research and technology to Britain rather than just final assembly of goods .

source_bert_toks: he said it would be the first of a series of ventures which good ##ing was discussing with japanese companies , aimed at bringing research and technology to britain rather than just final assembly of goods .

reference_raw: He said that this would be the first of a series of ventures that Gooding had discussed with Japanese companies to bring research and technology to Britain, not just the final collection of goods.

reference_spacy_tokens: He said that this would be the first of a series of ventures that Gooding had discussed with Japanese companies to bring research and technology to Britain , not just the final collection of goods .


fn_spacy_tokens_for_baseline: Chugging across the dark river with these two fellers in the outboard , I relax with them .

source_bert_toks: chu ##gging across the dark river with these two fell ##ers in the out ##board , i relax with them .

reference_raw: I'm choking across the dark river with these two guys on the outside, and I'm resting with them.

reference_spacy_tokens: I 'm choking across the dark river with these two guys on the outside , and I 'm resting with them .


fn_spacy_tokens_for_baseline: He admitted having tried cocaine but said it did not seem to do much for him ; cocaine was in ' because the chicks dig it sexually ' .

source_bert_toks: he admitted having tried cocaine but said it did not seem to do much for him ; cocaine was in ' because the chicks dig it sexually ' .

reference_raw: He admitted that he'd tried coke, but he said it didn't seem to do much for him; the coke was in 'cause the girls were digging it sexually.

reference_spacy_tokens: He admitted that he 'd tried coke , but he said it did n't seem to do much for him ; the coke was in 'cause the girls were digging it sexually .


fn_spacy_tokens_for_baseline: Individualists who concede too much give up the very explanations which , from their perspective , make the phenomena intelligible .

source_bert_toks: individual ##ists who con ##cede too much give up the very explanations which , from their perspective , make the phenomena intel ##li ##gible .

reference_raw: Individualists who admit too much give up the same explanations that, from their point of view, make these phenomena understandable.

reference_spacy_tokens: Individualists who admit too much give up the same explanations that , from their point of view , make these phenomena understandable .


fn_spacy_tokens_for_baseline: Her fuel tanks were filled with diesel , the last fresh water was aboard , there was sun - tan lotion and lip - salve in every cabin , and the rotted chicken heads were safe in the freezer .

source_bert_toks: her fuel tanks were filled with diesel , the last fresh water was aboard , there was sun - tan lot ##ion and lip - sal ##ve in every cabin , and the rot ##ted chicken heads were safe in the freeze ##r .

reference_raw: Her fuel tanks were full of oil, the last of the fresh water was on board, and all the cabins had sun-tan cream and lip-salve, and the rotten chicken heads were safe in the freezer.

reference_spacy_tokens: Her fuel tanks were full of oil , the last of the fresh water was on board , and all the cabins had sun - tan cream and lip - salve , and the rotten chicken heads were safe in the freezer .


fn_spacy_tokens_for_baseline: Take the Mid - Levels Escalator to Hollywood road , known for its antiques and curio shopping .

source_bert_toks: take the mid - levels es ##cala ##tor to hollywood road , known for its antiques and cu ##rio shopping .

reference_raw: Take the mid-level Escalator to Hollywood Road, known for its antiques and curio purchases.

reference_spacy_tokens: Take the mid - level Escalator to Hollywood Road , known for its antiques and curio purchases .


fn_spacy_tokens_for_baseline: The view from its window across Thrush Green never ceased to enchant Ruth Bassett .

source_bert_toks: the view from its window across thru ##sh green never ceased to en ##chan ##t ruth bassett .

reference_raw: The view from the window on the other side of Thrush Green never ceased to charm Ruth Bassett.

reference_spacy_tokens: The view from the window on the other side of Thrush Green never ceased to charm Ruth Bassett .


fn_spacy_tokens_for_baseline: The problem , once again , is the dissimilar chromosomes preventing pairing and meiosis , although , as with she - mules , there is some scant evidence of normal pairing and the occasional mature spermatozoon .

source_bert_toks: the problem , once again , is the di ##ssi ##mi ##lar chromosomes preventing pairing and mei ##osis , although , as with she - mule ##s , there is some scan ##t evidence of normal pairing and the occasional mature sperm ##ato ##zoo ##n .

reference_raw: Again, the problem is the different chromosomes that prevent pairing and meiosis, although, as with her mules, there is little evidence of normal pairing and occasional ripe spermatozoons.

reference_spacy_tokens: Again , the problem is the different chromosomes that prevent pairing and meiosis , although , as with her mules , there is little evidence of normal pairing and occasional ripe spermatozoons .


fn_spacy_tokens_for_baseline: The outward journey was quite uneventful as far as the Wadi Tamit , a steep defile leading down the escarpment on to the coastal plain .

source_bert_toks: the outward journey was quite uneven ##tf ##ul as far as the wadi tam ##it , a steep def ##ile leading down the es ##car ##pment on to the coastal plain .

reference_raw: As far as Wadi Tamit, the outward journey was quite uneven, a steep chasm that led down the escarpment to the coastal plain.

reference_spacy_tokens: As far as Wadi Tamit , the outward journey was quite uneven , a steep chasm that led down the escarpment to the coastal plain .


fn_spacy_tokens_for_baseline: This requires a certificate of exemption signed by a registered medical practitioner , to avoid conviction for not wearing a seat belt otherwise made compulsory by the regulations .

source_bert_toks: this requires a certificate of exemption signed by a registered medical practitioner , to avoid conviction for not wearing a seat belt otherwise made compulsory by the regulations .

reference_raw: This requires a certificate of exemption signed by a registered doctor in order to avoid being convicted of not wearing a seatbelt otherwise required by the Regulation.

reference_spacy_tokens: This requires a certificate of exemption signed by a registered doctor in order to avoid being convicted of not wearing a seatbelt otherwise required by the Regulation .


fn_spacy_tokens_for_baseline: Treatises were written in Shastric Sanskrit on subjects such as law , philosophy , religion , archery and even dance .

source_bert_toks: treatise ##s were written in sha ##st ##ric sanskrit on subjects such as law , philosophy , religion , archery and even dance .

reference_raw: In Shastric Sanskrit, the Treatises were made on matters such as law, philosophy, religion, archery, and even dancing.

reference_spacy_tokens: In Shastric Sanskrit , the Treatises were made on matters such as law , philosophy , religion , archery , and even dancing .


fn_spacy_tokens_for_baseline: ' But now , Mr. Holmes , I invite your attention to the kitchen . '

source_bert_toks: ' but now , mr . holmes , i invite your attention to the kitchen . '

reference_raw: "Now, Mr. Holmes, I'd like you to look into the kitchen."

reference_spacy_tokens: " Now , Mr. Holmes , I 'd like you to look into the kitchen . "


fn_spacy_tokens_for_baseline: He was hospitalised for a week .

source_bert_toks: he was hospital ##ised for a week .

reference_raw: He's been in hospital for a week.

reference_spacy_tokens: He 's been in hospital for a week .


fn_spacy_tokens_for_baseline: Here the challenge is being ducked .

source_bert_toks: here the challenge is being ducked .

reference_raw: This is where we avoid the challenge.

reference_spacy_tokens: This is where we avoid the challenge .


fn_spacy_tokens_for_baseline: He offered to tutor the girl , but after trying to teach her for a while , gave it up as he considered she was unable to focus on what she was being taught .

source_bert_toks: he offered to tutor the girl , but after trying to teach her for a while , gave it up as he considered she was unable to focus on what she was being taught .

reference_raw: He offered to teach her, but after trying to teach her, he gave up because he thought she couldn't concentrate on what he was teaching her.

reference_spacy_tokens: He offered to teach her , but after trying to teach her , he gave up because he thought she could n't concentrate on what he was teaching her .


fn_spacy_tokens_for_baseline: Ruth was draped in the blue and green shawl , leaving her legs , her snow - white shoulders bare .

source_bert_toks: ruth was draped in the blue and green shaw ##l , leaving her legs , her snow - white shoulders bare .

reference_raw: Ruth was draped in a blue-green scarf, and her legs and snow-white shoulders were bare.

reference_spacy_tokens: Ruth was draped in a blue - green scarf , and her legs and snow - white shoulders were bare .


fn_spacy_tokens_for_baseline: Eochaid lifted his hands to his neck and began to unfasten the chain of the Brecbennoch .

source_bert_toks: e ##och ##aid lifted his hands to his neck and began to un ##fast ##en the chain of the br ##ec ##ben ##no ##ch .

reference_raw: Eochaid raised his hands to his throat and began unbuttoning the Brecbennoch chain.

reference_spacy_tokens: Eochaid raised his hands to his throat and began unbuttoning the Brecbennoch chain .


fn_spacy_tokens_for_baseline: Most often reporters recount these tales with each other and with their sources rather than share them with the general public .

source_bert_toks: most often reporters rec ##ount these tales with each other and with their sources rather than share them with the general public .

reference_raw: Reporters often recount these stories among themselves and with their resources rather than share them with the general public.

reference_spacy_tokens: Reporters often recount these stories among themselves and with their resources rather than share them with the general public .


fn_spacy_tokens_for_baseline: The insects colonised the land before the vertebrates and they still exploit every organism on it .

source_bert_toks: the insects colon ##ised the land before the ve ##rte ##brates and they still exploit every organism on it .

reference_raw: Insects colonized the land before the vertebrates, and they still use every organism on it.

reference_spacy_tokens: Insects colonized the land before the vertebrates , and they still use every organism on it .


fn_spacy_tokens_for_baseline: They saw a frustrated Stalin , foiled in his attempts to extend Russian power into northern , western , and southern Europe by the alliance of the European democracies and the United States .

source_bert_toks: they saw a frustrated stalin , foil ##ed in his attempts to extend russian power into northern , western , and southern europe by the alliance of the european demo ##cr ##acies and the united states .

reference_raw: They saw a frustrated Stalin, foiled by an alliance of European democracies and the United States in his attempts to expand Russia's power to North, West, and South Europe.

reference_spacy_tokens: They saw a frustrated Stalin , foiled by an alliance of European democracies and the United States in his attempts to expand Russia 's power to North , West , and South Europe .


fn_spacy_tokens_for_baseline: Our biggest problem is non - attendance authorised by parents for what might be considered unacceptable reasons .

source_bert_toks: our biggest problem is non - attendance authorised by parents for what might be considered unacceptable reasons .

reference_raw: Our biggest problem is the absence of parental consent for what may be considered unacceptable reasons.

reference_spacy_tokens: Our biggest problem is the absence of parental consent for what may be considered unacceptable reasons .


fn_spacy_tokens_for_baseline: Bogdan Ursu was plucked from a grim Romanian orphanage by an aid organisation and brought to Middlesbrough .

source_bert_toks: bog ##dan ur ##su was plucked from a grim romanian orphanage by an aid organisation and brought to middlesbrough .

reference_raw: Bogdan Ursu was taken from a gloomy Romanian orphanage by an aid organization and transported to Middlesbrough.

reference_spacy_tokens: Bogdan Ursu was taken from a gloomy Romanian orphanage by an aid organization and transported to Middlesbrough .


fn_spacy_tokens_for_baseline: THE father of a girl who was raped and beaten on her paper round yesterday pleaded for help in catching her attacker .

source_bert_toks: the father of a girl who was raped and beaten on her paper round yesterday pleaded for help in catching her attacker .

reference_raw: The dad of a girl who was raped and beaten on a paper lap yesterday begged to help catch her assailant.

reference_spacy_tokens: The dad of a girl who was raped and beaten on a paper lap yesterday begged to help catch her assailant .


fn_spacy_tokens_for_baseline: Many 's the time Mary has seen litters of Yorkshire Terriers and Bichon Frise crated up at Plymouth railway station -- puppies from farms being shipped to France , and an uncertain fate .

source_bert_toks: many ' s the time mary has seen litter ##s of yorkshire terri ##ers and bi ##chon fr ##ise crate ##d up at plymouth railway station - - pup ##pies from farms being shipped to france , and an uncertain fate .

reference_raw: Many times Mary had seen the litters of Yorkshire Terriers and Bichon Frise boxed at the Plymouth railway station - the puppies from the farms being sent to France, and the uncertain fate.

reference_spacy_tokens: Many times Mary had seen the litters of Yorkshire Terriers and Bichon Frise boxed at the Plymouth railway station - the puppies from the farms being sent to France , and the uncertain fate .


fn_spacy_tokens_for_baseline: QN : Does Walden think Grand Slam deserves respect ?

source_bert_toks: q ##n : does walden think grand slam deserves respect ?

reference_raw: QN: Does Walden think the Grand Slam deserves to be appreciated?

reference_spacy_tokens: QN : Does Walden think the Grand Slam deserves to be appreciated ?


fn_spacy_tokens_for_baseline: There were rumors in 2003 of Burmese plans to purchase ballistic missiles from North Korea , but it is unclear whether any transactions have been completed .

source_bert_toks: there were rumors in 2003 of burmese plans to purchase ballistic missiles from north korea , but it is unclear whether any transactions have been completed .

reference_raw: There were rumors in 2003 that Burmese was planning to buy ballistic missiles from North Korea, but it is not clear if the transactions had been completed.

reference_spacy_tokens: There were rumors in 2003 that Burmese was planning to buy ballistic missiles from North Korea , but it is not clear if the transactions had been completed .


fn_spacy_tokens_for_baseline: The rain , which had been coming and going , began to pour down again , spattering in big gobs all over the glass around them .

source_bert_toks: the rain , which had been coming and going , began to pour down again , spat ##tering in big go ##bs all over the glass around them .

reference_raw: The rain, coming and going, began to rain again, splashing around the glass in large goblets.

reference_spacy_tokens: The rain , coming and going , began to rain again , splashing around the glass in large goblets .


fn_spacy_tokens_for_baseline: The King still rules here and I am his envoy .

source_bert_toks: the king still rules here and i am his envoy .

reference_raw: The King is still in charge, and I'm his ambassador.

reference_spacy_tokens: The King is still in charge , and I 'm his ambassador .


fn_spacy_tokens_for_baseline: It 's the First Communion .

source_bert_toks: it ' s the first communion .

reference_raw: This is the first communication.

reference_spacy_tokens: This is the first communication .


fn_spacy_tokens_for_baseline: Nationally , union leaders blasted the Government for failing to tackle the jobs crisis and even some reaction from the business sector was muted .

source_bert_toks: nationally , union leaders blasted the government for failing to tackle the jobs crisis and even some reaction from the business sector was muted .

reference_raw: At national level, union leaders blew up the government for not responding to the job crisis, and even some reaction from the business sector has been muted.

reference_spacy_tokens: At national level , union leaders blew up the government for not responding to the job crisis , and even some reaction from the business sector has been muted .


fn_spacy_tokens_for_baseline: Juliet climbed the stairs , feeling unutterably weary .

source_bert_toks: juliet climbed the stairs , feeling un ##utter ##ably weary .

reference_raw: Juliet went up the stairs, feeling unutterably tired.

reference_spacy_tokens: Juliet went up the stairs , feeling unutterably tired .


fn_spacy_tokens_for_baseline: AS Roma ( 1 - 1 - 2 , four points ) , pegged as a contender at the season 's start , finally notched its first victory , 1 - 0 at Cremonese .

source_bert_toks: as roma ( 1 - 1 - 2 , four points ) , peg ##ged as a contender at the season ' s start , finally notch ##ed its first victory , 1 - 0 at cr ##emon ##ese .

reference_raw: AS Roma (1-1-2, 4 points), poked as a candidate at the beginning of the season, finally announced his first victory, 1-0 in Cremonese.

reference_spacy_tokens: AS Roma ( 1 - 1 - 2 , 4 points ) , poked as a candidate at the beginning of the season , finally announced his first victory , 1 - 0 in Cremonese .


fn_spacy_tokens_for_baseline: That 's just like my dad -- he 's always on about what a struggle he had in the days of his youth and I get it all too easy .

source_bert_toks: that ' s just like my dad - - he ' s always on about what a struggle he had in the days of his youth and i get it all too easy .

reference_raw: It's like my father -- he's always talking about what a fight he had when he was young, and it's too easy for me.

reference_spacy_tokens: It 's like my father -- he 's always talking about what a fight he had when he was young , and it 's too easy for me .


fn_spacy_tokens_for_baseline: But the battle over the sea dumping of nuclear waste , dramatic as it became , represented only a small fraction of a much larger problem .

source_bert_toks: but the battle over the sea dumping of nuclear waste , dramatic as it became , represented only a small fraction of a much larger problem .

reference_raw: But the struggle over the sea-dumping of nuclear waste, dramatic as it became, was only a small fraction of a much larger problem.

reference_spacy_tokens: But the struggle over the sea - dumping of nuclear waste , dramatic as it became , was only a small fraction of a much larger problem .


fn_spacy_tokens_for_baseline: As the situation within the institution worsens , staff develop their own ethos , practices and policies to make life easier and more bearable for themselves in an unpleasant and disheartening situation .

source_bert_toks: as the situation within the institution worse ##ns , staff develop their own et ##hos , practices and policies to make life easier and more bear ##able for themselves in an unpleasant and dish ##ear ##ten ##ing situation .

reference_raw: As the situation within the institution deteriorates, staff develop their own ethos, practices and policies to make life easier and more bearable to themselves in an uncomfortable and disgruntling situation.

reference_spacy_tokens: As the situation within the institution deteriorates , staff develop their own ethos , practices and policies to make life easier and more bearable to themselves in an uncomfortable and disgruntling situation .


fn_spacy_tokens_for_baseline: She respected her stepdaughter 's position as Princess of Wales , always curtsied and paid her compliments on her looks and her outfits .

source_bert_toks: she respected her step ##da ##ught ##er ' s position as princess of wales , always curt ##sie ##d and paid her compliment ##s on her looks and her outfits .

reference_raw: She respected the position of her stepdaughter as Princess of Wales, always curtsied and praised her for her appearance and dress.

reference_spacy_tokens: She respected the position of her stepdaughter as Princess of Wales , always curtsied and praised her for her appearance and dress .


fn_spacy_tokens_for_baseline: In a Legislative Council meeting in 1937 he accused the government of pampering the Masai and condoning such ' vile practices ' as ' the repeated rape of immature girls ' in manyattas .

source_bert_toks: in a legislative council meeting in 1937 he accused the government of pam ##per ##ing the mas ##ai and condo ##ning such ' vile practices ' as ' the repeated rape of immature girls ' in many ##att ##as .

reference_raw: At a meeting of the Legislative Council in 1937, he accused the government of spoiling the Masai and condoning such "vile practices" as "repeating child molestation" in manyattas.

reference_spacy_tokens: At a meeting of the Legislative Council in 1937 , he accused the government of spoiling the Masai and condoning such " vile practices " as " repeating child molestation " in manyattas .


fn_spacy_tokens_for_baseline: On a near - perpendicular mountainy field , a flock of seagulls screeched behind a tractor , and men and women raw - handedly filled sacks with potatoes .

source_bert_toks: on a near - perpendicular mountain ##y field , a flock of sea ##gul ##ls sc ##ree ##ched behind a tractor , and men and women raw - handed ##ly filled sacks with potatoes .

reference_raw: A flock of gulls screamed behind the tractor on a nearly vertical mountain field, and men and women raw-handedly filled sacks of potatoes.

reference_spacy_tokens: A flock of gulls screamed behind the tractor on a nearly vertical mountain field , and men and women raw - handedly filled sacks of potatoes .


fn_spacy_tokens_for_baseline: Many of these Whig Jacobite tracts can be said to reflect commonwealth principles , in the sense that they argued for a monarchy which would be severely limited .

source_bert_toks: many of these whig jacobite tracts can be said to reflect commonwealth principles , in the sense that they argued for a monarchy which would be severely limited .

reference_raw: It can be said that many of these Whig Jacobite tractions reflect the principles of the commonwealth, in the sense that they argued for a monarchy that would be severely restricted.

reference_spacy_tokens: It can be said that many of these Whig Jacobite tractions reflect the principles of the commonwealth , in the sense that they argued for a monarchy that would be severely restricted .


fn_spacy_tokens_for_baseline: ' So why did n't you just come clean about it ?

source_bert_toks: ' so why didn ' t you just come clean about it ?

reference_raw: 'Then why didn't you confess?

reference_spacy_tokens: ' Then why did n't you confess ?


fn_spacy_tokens_for_baseline: I like -- I 'd like -- to smoothe his eyebrows with my tongue and maybe more besides .

source_bert_toks: i like - - i ' d like - - to smooth ##e his eyebrows with my tongue and maybe more besides .

reference_raw: I'd like to--I'd like to--smooth his eyebrows with my language, maybe even more.

reference_spacy_tokens: I 'd like to -- I'd like to -- smooth his eyebrows with my language , maybe even more .


fn_spacy_tokens_for_baseline: Legal rights are therefore not enshrined in a written constitution or roman law but are the results of administrative acts by government bodies or courts of law .

source_bert_toks: legal rights are therefore not en ##sh ##rine ##d in a written constitution or roman law but are the results of administrative acts by government bodies or courts of law .

reference_raw: Thus, legal rights are not enshrined in a written constitution or in Roman law, but are the result of administrative action by public authorities or courts.

reference_spacy_tokens: Thus , legal rights are not enshrined in a written constitution or in Roman law , but are the result of administrative action by public authorities or courts .


fn_spacy_tokens_for_baseline: ' Sean and I are very much alike , ' he said .

source_bert_toks: ' sean and i are very much alike , ' he said .

reference_raw: "Sean and I are very similar," he said.

reference_spacy_tokens: " Sean and I are very similar , " he said .


fn_spacy_tokens_for_baseline: True to wild - West stereotypes , Stewart was slain by a neighboring farmer , leaving his strong - willed wife , Helen , to assume the duties of the ranch .

source_bert_toks: true to wild - west stereotypes , stewart was slain by a neighboring farmer , leaving his strong - willed wife , helen , to assume the duties of the ranch .

reference_raw: True to wild Western stereotypes, Stewart was killed by a neighboring peasant, leaving his strong-willed wife, Helen, to take over the ranch's duties.

reference_spacy_tokens: True to wild Western stereotypes , Stewart was killed by a neighboring peasant , leaving his strong - willed wife , Helen , to take over the ranch 's duties .


fn_spacy_tokens_for_baseline: Dearborn casts a cool eye on Mailer 's attention - getting tactics ( he suggested that soldiers in Vietnam should only kill people they were willing to eat ) , his drunken outbursts , his wife - stabbing episode , and delivers what critics agree is an evenhanded , engrossing , " crisply written " ( Sven Birkerts , Esquire ) book that will prove difficult for Mailer 's official biographer to follow .

source_bert_toks: dear ##born casts a cool eye on mail ##er ' s attention - getting tactics ( he suggested that soldiers in vietnam should only kill people they were willing to eat ) , his drunken outburst ##s , his wife - stabbing episode , and delivers what critics agree is an even ##hand ##ed , eng ##ross ##ing , " crisp ##ly written " ( sven bi ##rke ##rts , esq ##ui ##re ) book that will prove difficult for mail ##er ' s official biographer to follow .

reference_raw: Dearborn casts a cold eye at Mailer's attention - getting tactics (he suggested that the soldiers in Vietnam should only kill the people they wanted to eat), his drunken outbursts, his wife - a stabbing episode, and delivering what the critics agreed was a balanced, engrossed, "crissply written "(Sven Birkerts, Esquire) book that would prove to be difficult. The official biographer for Miller to follow.

reference_spacy_tokens: Dearborn casts a cold eye at Mailer 's attention - getting tactics ( he suggested that the soldiers in Vietnam should only kill the people they wanted to eat ) , his drunken outbursts , his wife - a stabbing episode , and delivering what the critics agreed was a balanced , engrossed , " crissply written " ( Sven Birkerts , Esquire ) book that would prove to be difficult . The official biographer for Miller to follow .


fn_spacy_tokens_for_baseline: Half of the annual global tropical timber acquisition comes from Borneo .

source_bert_toks: half of the annual global tropical timber acquisition comes from borneo .

reference_raw: Half of the world's annual tropical timber purchases come from Borneo.

reference_spacy_tokens: Half of the world 's annual tropical timber purchases come from Borneo .


fn_spacy_tokens_for_baseline: Waddell , a Professor of Tibetan at the University of London , believed that the Aryans were the bearers of culture and had originated all the main civilizations in history .

source_bert_toks: wa ##dd ##ell , a professor of tibetan at the university of london , believed that the aryan ##s were the bearer ##s of culture and had originated all the main civilizations in history .

reference_raw: Waddell, a professor of Tibetan at the University of London, believed that the Aryans were cultural carriers, and that all the major civilizations in history had come from them.

reference_spacy_tokens: Waddell , a professor of Tibetan at the University of London , believed that the Aryans were cultural carriers , and that all the major civilizations in history had come from them .


fn_spacy_tokens_for_baseline: According to them , he was sassy , sharp , matalino ; a fundamentally decent man undone by a scheming and treacherous woman .

source_bert_toks: according to them , he was sas ##sy , sharp , mata ##lino ; a fundamentally decent man undone by a sc ##hem ##ing and treacherous woman .

reference_raw: According to them, he was a sassy, sharp, matalino, a well-respected man undone by a scheming, treacherous woman.

reference_spacy_tokens: According to them , he was a sassy , sharp , matalino , a well - respected man undone by a scheming , treacherous woman .


fn_spacy_tokens_for_baseline: ' Oh , I expect all the others are out , ' Merrill said idly , ' and I garage my car further down the avenue .

source_bert_toks: ' oh , i expect all the others are out , ' merrill said id ##ly , ' and i garage my car further down the avenue .

reference_raw: 'Oh, I suppose everyone else is out,' said Merrill, idly, 'and I've parked my car down the street.

reference_spacy_tokens: ' Oh , I suppose everyone else is out , ' said Merrill , idly , ' and I 've parked my car down the street .


fn_spacy_tokens_for_baseline: Nuclear weapons programs require specialized materials , facilities , equipment , and training in order to produce the raw material for weapons -- either highly enriched uranium ( HEU ) or plutonium -- and then to fabricate explosive devices using this fissile material .

source_bert_toks: nuclear weapons programs require specialized materials , facilities , equipment , and training in order to produce the raw material for weapons - - either highly enriched uranium ( he ##u ) or pluto ##nium - - and then to fabric ##ate explosive devices using this fis ##sil ##e material .

reference_raw: Nuclear weapons programs require specialised materials, equipment, equipment, and training to produce raw materials for weapons - either high-enriched uranium (HEU) or plutonium - and then to manufacture exploding devices using this fissile material.

reference_spacy_tokens: Nuclear weapons programs require specialised materials , equipment , equipment , and training to produce raw materials for weapons - either high - enriched uranium ( HEU ) or plutonium - and then to manufacture exploding devices using this fissile material .


fn_spacy_tokens_for_baseline: It will be aware of its master , in that it hears and smells him , and of its own exertions , in that it is awake , but it will not be aware that it recognises him , for this is of the order of tomorrow 's delayed return -- a linguistic belief of which dumb brutes are incapable .

source_bert_toks: it will be aware of its master , in that it hears and smells him , and of its own ex ##ert ##ions , in that it is awake , but it will not be aware that it recognise ##s him , for this is of the order of tomorrow ' s delayed return - - a linguistic belief of which dumb brute ##s are incapable .

reference_raw: He would be aware of his master, hearing and smelling him, and of his own efforts to wake him, but he would not be aware that he recognized him, for that was the order of his late return tomorrow - a language belief of which stupid beasts could not.

reference_spacy_tokens: He would be aware of his master , hearing and smelling him , and of his own efforts to wake him , but he would not be aware that he recognized him , for that was the order of his late return tomorrow - a language belief of which stupid beasts could not .


fn_spacy_tokens_for_baseline: Once there they would journey across Belgium and drive ' sedately ' on far into Germany where they would rest overnight .

source_bert_toks: once there they would journey across belgium and drive ' se ##date ##ly ' on far into germany where they would rest overnight .

reference_raw: Once there, they would cross Belgium and go "sedated" far to Germany, where they would rest the night.

reference_spacy_tokens: Once there , they would cross Belgium and go " sedated " far to Germany , where they would rest the night .


fn_spacy_tokens_for_baseline: Land grabbing , often supported by forged documents , and coconut stealing provided alternative disreputable activities for those so inclined .

source_bert_toks: land grabbing , often supported by forged documents , and coconut stealing provided alternative di ##sr ##ep ##utable activities for those so inclined .

reference_raw: Land capture, often supported by forged documents, and theft of coconuts, provided alternative unreputable activities for those so inclined.

reference_spacy_tokens: Land capture , often supported by forged documents , and theft of coconuts , provided alternative unreputable activities for those so inclined .


fn_spacy_tokens_for_baseline: What sort of records do they keep at their headquarters for this country in Norwich ? '

source_bert_toks: what sort of records do they keep at their headquarters for this country in norwich ? '

reference_raw: What records do they have in their headquarters for this country in Norwich?'

reference_spacy_tokens: What records do they have in their headquarters for this country in Norwich ? '


fn_spacy_tokens_for_baseline: I have heard that he was atrocious .

source_bert_toks: i have heard that he was at ##ro ##cious .

reference_raw: I heard he was terrible.

reference_spacy_tokens: I heard he was terrible .


fn_spacy_tokens_for_baseline: There followed an outpouring of letters from Caroline and her daughters telling of the behaviour and convalescence of ' the most perfect Hero that ever breathed ' .

source_bert_toks: there followed an out ##pour ##ing of letters from caroline and her daughters telling of the behaviour and con ##vale ##sc ##ence of ' the most perfect hero that ever breathed ' .

reference_raw: There was a stream of letters from Caroline and her daughters about the behavior and comfort of "the most perfect hero who ever breathed."

reference_spacy_tokens: There was a stream of letters from Caroline and her daughters about the behavior and comfort of " the most perfect hero who ever breathed . "


fn_spacy_tokens_for_baseline: Now the programme that turns the cameras on teenagers and let 's them do the talking and the interviews has packed its newest series with just the subjects their viewers want .

source_bert_toks: now the programme that turns the cameras on teenagers and let ' s them do the talking and the interviews has packed its newest series with just the subjects their viewers want .

reference_raw: Now, the program that turns the cameras on the teenagers and lets them talk, and the interviews have packaged their latest series with the subjects their viewers want.

reference_spacy_tokens: Now , the program that turns the cameras on the teenagers and lets them talk , and the interviews have packaged their latest series with the subjects their viewers want .


fn_spacy_tokens_for_baseline: He stooped and picked up the torn halves himself .

source_bert_toks: he st ##ooped and picked up the torn halves himself .

reference_raw: He bent down and picked up the torn halves himself.

reference_spacy_tokens: He bent down and picked up the torn halves himself .


fn_spacy_tokens_for_baseline: Precambrian rocks adjacent to the Telegraph Pass granite give well - grouped magnetizations identical in direction to that of the granite ( reverse polarity ) .

source_bert_toks: pre ##cam ##bria ##n rocks adjacent to the telegraph pass granite give well - grouped magnet ##izations identical in direction to that of the granite ( reverse polar ##ity ) .

reference_raw: The Pre-Cambrian rocks surrounding the Telegraph Pass granite provide well-grouped magnetisation in the same direction as the granite (reverse polarity).

reference_spacy_tokens: The Pre - Cambrian rocks surrounding the Telegraph Pass granite provide well - grouped magnetisation in the same direction as the granite ( reverse polarity ) .


fn_spacy_tokens_for_baseline: When he stood up he could just see a fire engine as if on the high seas diving and heaving towards him .

source_bert_toks: when he stood up he could just see a fire engine as if on the high seas diving and heaving towards him .

reference_raw: When he got to his feet, he saw the fire engine as if it were diving in the high seas and coming toward him.

reference_spacy_tokens: When he got to his feet , he saw the fire engine as if it were diving in the high seas and coming toward him .


fn_spacy_tokens_for_baseline: And £ 18.50 is enough to pay for a year 's supply of medicine and special foods for a sick child in San Jose .

source_bert_toks: and £1 ##8 . 50 is enough to pay for a year ' s supply of medicine and special foods for a sick child in san jose .

reference_raw: And 18.50 pounds is enough to pay for a year's supply of medicine and special meals for an ill child in San Jose.

reference_spacy_tokens: And 18.50 pounds is enough to pay for a year 's supply of medicine and special meals for an ill child in San Jose .


fn_spacy_tokens_for_baseline: I 'm sure he would n't have liked the way we communally beheaded him but it did the job .

source_bert_toks: i ' m sure he wouldn ' t have liked the way we communal ##ly beheaded him but it did the job .

reference_raw: I'm sure he wouldn't like the way we executed him, but he did it.

reference_spacy_tokens: I 'm sure he would n't like the way we executed him , but he did it .


fn_spacy_tokens_for_baseline: Some hotels telephone confirmation of a booking and will of course acknowledge receipt of a deposit or a special request if the time factor allows .

source_bert_toks: some hotels telephone confirmation of a booking and will of course acknowledge receipt of a deposit or a special request if the time factor allows .

reference_raw: Some hotels will telephone a reservation and, of course, acknowledge receipt of a deposit or a special request if the time factor allows it.

reference_spacy_tokens: Some hotels will telephone a reservation and , of course , acknowledge receipt of a deposit or a special request if the time factor allows it .


fn_spacy_tokens_for_baseline: Libya has since abandoned its nuclear ambitions and is cooperating with the IAEA and the United States , which has revealed much about Khan 's network .

source_bert_toks: libya has since abandoned its nuclear ambitions and is cooper ##ating with the ia ##ea and the united states , which has revealed much about khan ' s network .

reference_raw: Since then, Libya has abandoned its nuclear ambitions and cooperates with the International Atomic Energy Agency (IAEA) and the United States, which has revealed a great deal about Khan's web.

reference_spacy_tokens: Since then , Libya has abandoned its nuclear ambitions and cooperates with the International Atomic Energy Agency ( IAEA ) and the United States , which has revealed a great deal about Khan 's web .


fn_spacy_tokens_for_baseline: When manager Victor Contini judges that the moment is right , the haunch is brought down to be skinned , boned , cured and thinly sliced like Parma ham .

source_bert_toks: when manager victor con ##tin ##i judges that the moment is right , the ha ##un ##ch is brought down to be skinned , bone ##d , cured and thin ##ly sliced like parma ham .

reference_raw: When the manager, Victor Contini, judges that the time is right, the haunch is brought down to be peeled, boned, cured, and thinly sliced like a Parma ham.

reference_spacy_tokens: When the manager , Victor Contini , judges that the time is right , the haunch is brought down to be peeled , boned , cured , and thinly sliced like a Parma ham .


fn_spacy_tokens_for_baseline: My father and mother stand nearer to the babies than I and the whole ensemble is posed on an interminable expanse of medium - cut grass .

source_bert_toks: my father and mother stand nearer to the babies than i and the whole ensemble is posed on an inter ##mina ##ble expanse of medium - cut grass .

reference_raw: My father and mother are closer to the children than I am, and the whole group is present on an endless stretch of medium-cut grass.

reference_spacy_tokens: My father and mother are closer to the children than I am , and the whole group is present on an endless stretch of medium - cut grass .


fn_spacy_tokens_for_baseline: Hundreds of millions of birds around the world have been destroyed to try to contain the disease .

source_bert_toks: hundreds of millions of birds around the world have been destroyed to try to contain the disease .

reference_raw: Hundreds of millions of birds were destroyed all over the world in an attempt to contain it.

reference_spacy_tokens: Hundreds of millions of birds were destroyed all over the world in an attempt to contain it .


fn_spacy_tokens_for_baseline: Bayfield and England captain Will Carling are playing only after making near - miraculous recoveries from injuries against Otago in Dunedin last weekend .

source_bert_toks: bay ##field and england captain will carl ##ing are playing only after making near - miraculous recover ##ies from injuries against otago in dunedin last weekend .

reference_raw: Bayfield and England, Captain Will Carling only plays after the near-miraculous regeneration of Otago's injuries in Dunedin last weekend.

reference_spacy_tokens: Bayfield and England , Captain Will Carling only plays after the near - miraculous regeneration of Otago 's injuries in Dunedin last weekend .


fn_spacy_tokens_for_baseline: For Lucy Jackson it was to be a summer task -- How to present the Medau Method to the notoriously critical 18 - 25 age group in a trendy setting .

source_bert_toks: for lucy jackson it was to be a summer task - - how to present the med ##au method to the notorious ##ly critical 18 - 25 age group in a trend ##y setting .

reference_raw: It was supposed to be a summer challenge for Lucy Jackson - how to present the Medau Method to the notoriously critical 18-25 age group in a fashionable environment.

reference_spacy_tokens: It was supposed to be a summer challenge for Lucy Jackson - how to present the Medau Method to the notoriously critical 18 - 25 age group in a fashionable environment .


fn_spacy_tokens_for_baseline: So my first act on Indian soil was to telex a friend at Weatherbys , the British racing bureaucrats , to get them to explain the facts of life to the Bombay Turf Club .

source_bert_toks: so my first act on indian soil was to tel ##ex a friend at weather ##by ##s , the british racing bureau ##crats , to get them to explain the facts of life to the bombay turf club .

reference_raw: So my first act on Indian soil was to telegraph a friend from Weatherbys, British racing officials, to explain the facts of life to the Bombay Turf Club.

reference_spacy_tokens: So my first act on Indian soil was to telegraph a friend from Weatherbys , British racing officials , to explain the facts of life to the Bombay Turf Club .


fn_spacy_tokens_for_baseline: In the absence of such mutual obligation , it has been held , a relationship of employment does not exist .

source_bert_toks: in the absence of such mutual obligation , it has been held , a relationship of employment does not exist .

reference_raw: In the absence of such a mutual obligation, it has been held that there is no employment relationship.

reference_spacy_tokens: In the absence of such a mutual obligation , it has been held that there is no employment relationship .


fn_spacy_tokens_for_baseline: Suzy peeled off her white pullover .

source_bert_toks: suzy peeled off her white pull ##over .

reference_raw: Suzy pulled off her white pullover.

reference_spacy_tokens: Suzy pulled off her white pullover .


fn_spacy_tokens_for_baseline: The young stonemason had suffered terrible head injuries and but for the attentions of a passing doctor , would have died at the scene of the accident .

source_bert_toks: the young stone ##mas ##on had suffered terrible head injuries and but for the attention ##s of a passing doctor , would have died at the scene of the accident .

reference_raw: The young stonemason had suffered a terrible head injury, and would have died at the crash site for the attention of a passing doctor.

reference_spacy_tokens: The young stonemason had suffered a terrible head injury , and would have died at the crash site for the attention of a passing doctor .


fn_spacy_tokens_for_baseline: A FAMILY were terrified when the estranged husband of their neighbour burst into their home wielding a knife .

source_bert_toks: a family were terrified when the estranged husband of their neighbour burst into their home wielding a knife .

reference_raw: The family was terrified when their neighbor's alien husband burst into their house with a knife.

reference_spacy_tokens: The family was terrified when their neighbor 's alien husband burst into their house with a knife .


fn_spacy_tokens_for_baseline: Your article on British education reforms ( April 10th ) says that objective assessment ' allows both teachers and parents to see how well a child is doing ' .

source_bert_toks: your article on british education reforms ( april 10th ) says that objective assessment ' allows both teachers and parents to see how well a child is doing ' .

reference_raw: Your article on the reform of British education (April 10th) states that an objective assessment "allows both teachers and parents to understand the well-being of the child."

reference_spacy_tokens: Your article on the reform of British education ( April 10th ) states that an objective assessment " allows both teachers and parents to understand the well - being of the child . "


fn_spacy_tokens_for_baseline: The hall light was still on and he put his ear to the letter box ; he could hear her voice on the telephone but could not distinguish her words .

source_bert_toks: the hall light was still on and he put his ear to the letter box ; he could hear her voice on the telephone but could not distinguish her words .

reference_raw: The light in the hall was still on, and he put his head to the letterbox; he could hear her voice on the phone, but he couldn't make out what she was saying.

reference_spacy_tokens: The light in the hall was still on , and he put his head to the letterbox ; he could hear her voice on the phone , but he could n't make out what she was saying .


fn_spacy_tokens_for_baseline: Then , all you will have to worry about is the width of your trouser legs .

source_bert_toks: then , all you will have to worry about is the width of your tr ##ouse ##r legs .

reference_raw: Then all you have to worry about is the width of your pants.

reference_spacy_tokens: Then all you have to worry about is the width of your pants .


fn_spacy_tokens_for_baseline: Right now , there are thousands of people who do not know what it feels like to support themselves .

source_bert_toks: right now , there are thousands of people who do not know what it feels like to support themselves .

reference_raw: There are thousands of people right now who don't know what it's like to be backed up.

reference_spacy_tokens: There are thousands of people right now who do n't know what it 's like to be backed up .