fn_spacy_tokens_for_baseline: The servant also said Mick phoned Jerry on Monday and blasted her for discussing their marriage in public .

source_bert_toks: the servant also said mick phone ##d jerry on monday and blasted her for discussing their marriage in public .

reference_raw: The butler also said that Mick called Jerry on Monday and blew her up for talking about their marriage in public.

reference_spacy_tokens: The butler also said that Mick called Jerry on Monday and blew her up for talking about their marriage in public .


fn_spacy_tokens_for_baseline: There are indications , however , that certain personnel who were intimately involved in the program , including Basson , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers trafficking in dangerous weapons , and perhaps also -- if certain journalists can be believed -- to elements of a shadowy international network of right - wing extremists .

source_bert_toks: there are indications , however , that certain personnel who were intimately involved in the program , including bass ##on , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as libya , to foreign intelligence personnel , to un ##sc ##rup ##ulous black market ##ers trafficking in dangerous weapons , and perhaps also - - if certain journalists can be believed - - to elements of a shadowy international network of right - wing ex ##tre ##mist ##s .

reference_raw: However, there are indications that some of the personnel involved in the programme, including Basson, may have provided technical knowledge, equipment, or material to "rogue regimes" such as Libya, international intelligence personnel, unscrupulous black marketers dealing in dangerous weapons, and possibly, if some journalists can be trusted, to elements of the shadowy international network of right-wing extremists.

reference_spacy_tokens: However , there are indications that some of the personnel involved in the programme , including Basson , may have provided technical knowledge , equipment , or material to " rogue regimes " such as Libya , international intelligence personnel , unscrupulous black marketers dealing in dangerous weapons , and possibly , if some journalists can be trusted , to elements of the shadowy international network of right - wing extremists .


fn_spacy_tokens_for_baseline: Her thighs and knees could quite conceivably , she deduced in bewilderment , be turning to rubber .

source_bert_toks: her thighs and knees could quite con ##ce ##iva ##bly , she de ##duced in be ##wil ##der ##ment , be turning to rubber .

reference_raw: Her thighs and knees could be quite conceivably, she guessed in confusion, turning to rubber.

reference_spacy_tokens: Her thighs and knees could be quite conceivably , she guessed in confusion , turning to rubber .


fn_spacy_tokens_for_baseline: Just for a moment she ignored the by now loud warning sirens wailing at the back of her mind .

source_bert_toks: just for a moment she ignored the by now loud warning sirens wai ##ling at the back of her mind .

reference_raw: For a moment she ignored the now loud warning sirens whining in the back of her mind.

reference_spacy_tokens: For a moment she ignored the now loud warning sirens whining in the back of her mind .


fn_spacy_tokens_for_baseline: Shackel became indignant and said he would fetch a magistrate and complain about the Chief Constable 's attitude , which he did .

source_bert_toks: shack ##el became ind ##ignant and said he would fetch a magistrate and complain about the chief constable ' s attitude , which he did .

reference_raw: Shackel got angry and said he'd get the judge and complain about the Chief Constable's attitude, which he did.

reference_spacy_tokens: Shackel got angry and said he 'd get the judge and complain about the Chief Constable 's attitude , which he did .


fn_spacy_tokens_for_baseline: Certainly the taciturn detective has to deal with many more murders than the average Thames Valley policeman .

source_bert_toks: certainly the ta ##cit ##urn detective has to deal with many more murders than the average thames valley policeman .

reference_raw: I'm sure the tacit detective has a lot more murders to deal with than the average Thames Valley cop.

reference_spacy_tokens: I 'm sure the tacit detective has a lot more murders to deal with than the average Thames Valley cop .


fn_spacy_tokens_for_baseline: A CHILD murderer set to become the first person to be hanged for 28 years has sparked controversy across America .

source_bert_toks: a child murderer set to become the first person to be hanged for 28 years has sparked controversy across america .

reference_raw: The CHILD killer, who was set to be the first to be hanged for 28 years, ignited controversy in America.

reference_spacy_tokens: The CHILD killer , who was set to be the first to be hanged for 28 years , ignited controversy in America .


fn_spacy_tokens_for_baseline: George frowned sharply , irritated at being stopped just as he was getting well into his stride .

source_bert_toks: george frowned sharply , irritated at being stopped just as he was getting well into his stride .

reference_raw: George scowled sharply, irritated that someone had stopped him just as he was well on his way.

reference_spacy_tokens: George scowled sharply , irritated that someone had stopped him just as he was well on his way .


fn_spacy_tokens_for_baseline: But as Christine was leaving the orphanage to take the blood sample to Bucharest , she heard a child screaming .

source_bert_toks: but as christine was leaving the orphanage to take the blood sample to bucharest , she heard a child screaming .

reference_raw: But as Christine left the orphanage to take a blood sample to Bucharest, she heard a child cry out.

reference_spacy_tokens: But as Christine left the orphanage to take a blood sample to Bucharest , she heard a child cry out .


fn_spacy_tokens_for_baseline: The worst situation for accidents is a good soaring day with a risk of thundery showers .

source_bert_toks: the worst situation for accidents is a good soaring day with a risk of thunder ##y showers .

reference_raw: The worst case of an accident is a good day in the sky, with the risk of rainstorms.

reference_spacy_tokens: The worst case of an accident is a good day in the sky , with the risk of rainstorms .


fn_spacy_tokens_for_baseline: He seems to assume I 'm about as liberal - minded as Genghis Khan and the annoying thing is , when he talks to me , I start sounding like the worst sort of reactionary .

source_bert_toks: he seems to assume i ' m about as liberal - minded as gen ##ghi ##s khan and the annoying thing is , when he talks to me , i start sounding like the worst sort of reaction ##ary .

reference_raw: He seems to think I'm about as liberal as Genghis Khan, and the irritating thing is that when he talks to me, I'm starting to sound like the worst kind of reactionary.

reference_spacy_tokens: He seems to think I 'm about as liberal as Genghis Khan , and the irritating thing is that when he talks to me , I 'm starting to sound like the worst kind of reactionary .


fn_spacy_tokens_for_baseline: On the track , Morris still feels very much a sense of identity with blacks : he presents a funereal image in all - black , a cowl covering his head .

source_bert_toks: on the track , morris still feels very much a sense of identity with blacks : he presents a fun ##ere ##al image in all - black , a cow ##l covering his head .

reference_raw: On the track, Morris still feels a great sense of identity with the blacks: he presents an all-black funeral picture with a hood over his head.

reference_spacy_tokens: On the track , Morris still feels a great sense of identity with the blacks : he presents an all - black funeral picture with a hood over his head .


fn_spacy_tokens_for_baseline: An oil drum was kicked away , rolling and crashing into the wall beside her .

source_bert_toks: an oil drum was kicked away , rolling and crashing into the wall beside her .

reference_raw: The barrel of oil had been kicked off, rolled and crashed into the wall next to her.

reference_spacy_tokens: The barrel of oil had been kicked off , rolled and crashed into the wall next to her .


fn_spacy_tokens_for_baseline: Quite chilly in the east as well , but the temperature picking up as cloud and occasional rain spread from the south west .

source_bert_toks: quite chilly in the east as well , but the temperature picking up as cloud and occasional rain spread from the south west .

reference_raw: It was also cold in the east, but the temperature was rising as clouds and occasionally rain spread from the southwest.

reference_spacy_tokens: It was also cold in the east , but the temperature was rising as clouds and occasionally rain spread from the southwest .


fn_spacy_tokens_for_baseline: He was a little surprised by her request , as it was getting dark , and they were on a lonely hill some way from her house .

source_bert_toks: he was a little surprised by her request , as it was getting dark , and they were on a lonely hill some way from her house .

reference_raw: Her request surprised him a bit, for it was getting dark, and they were on a lonely mountain just outside her house.

reference_spacy_tokens: Her request surprised him a bit , for it was getting dark , and they were on a lonely mountain just outside her house .


fn_spacy_tokens_for_baseline: If the water table is within 15 m of the surface , the cheapest method is to dig a well by hand and protect the walls from collapse by building a masonry lining .

source_bert_toks: if the water table is within 15 m of the surface , the cheap ##est method is to dig a well by hand and protect the walls from collapse by building a masonry lining .

reference_raw: If the water table is within 15 metres of the surface, the cheapest method is to dig a well by hand and to protect the walls from collapse by building a masonry frame.

reference_spacy_tokens: If the water table is within 15 metres of the surface , the cheapest method is to dig a well by hand and to protect the walls from collapse by building a masonry frame .


fn_spacy_tokens_for_baseline: The psychology or ideology of a particular terrorist group or individual may lead to a fascination with poisons and disease .

source_bert_toks: the psychology or ideology of a particular terrorist group or individual may lead to a fascination with poison ##s and disease .

reference_raw: The psychology or ideology of a specific terrorist group or individual may lead to the fascination of venoms and diseases.

reference_spacy_tokens: The psychology or ideology of a specific terrorist group or individual may lead to the fascination of venoms and diseases .


fn_spacy_tokens_for_baseline: Iran has also conducted chemical and biological defense military exercises with helicopter sprayers and worked with cruise and ballistic missiles , although there is no concrete evidence that it has developed a biological warhead to be fit on such missiles .

source_bert_toks: iran has also conducted chemical and biological defense military exercises with helicopter spray ##ers and worked with cruise and ballistic missiles , although there is no concrete evidence that it has developed a biological war ##head to be fit on such missiles .

reference_raw: Iran has also conducted chemical and biological defense exercises with helicopter sprayers and has worked with cruise and ballistic missiles, but there is no concrete evidence that it has created a biological warhead that is suitable for such missiles.

reference_spacy_tokens: Iran has also conducted chemical and biological defense exercises with helicopter sprayers and has worked with cruise and ballistic missiles , but there is no concrete evidence that it has created a biological warhead that is suitable for such missiles .


fn_spacy_tokens_for_baseline: ' It is ignorant to suggest that ' federalism ' equals ' centralism ' .

source_bert_toks: ' it is ignorant to suggest that ' federal ##ism ' equals ' central ##ism ' .

reference_raw: 'He's not aware of the idea that 'federalism' is equal to 'centralism'.

reference_spacy_tokens: ' He 's not aware of the idea that ' federalism ' is equal to ' centralism ' .


fn_spacy_tokens_for_baseline: She was normally a very honest person -- so why had she just lied through her teeth ?

source_bert_toks: she was normally a very honest person - - so why had she just lied through her teeth ?

reference_raw: Normally, she was a very honest man - so why did she lie with her teeth?

reference_spacy_tokens: Normally , she was a very honest man - so why did she lie with her teeth ?


fn_spacy_tokens_for_baseline: The user can also cut out pieces from the graphics and add to the graphics in any form .

source_bert_toks: the user can also cut out pieces from the graphics and add to the graphics in any form .

reference_raw: Users can also separate bits from graphics and add to graphics in any form.

reference_spacy_tokens: Users can also separate bits from graphics and add to graphics in any form .


fn_spacy_tokens_for_baseline: How typically vexing that there should be a rotten crop of films on , just when he really wanted a good one .

source_bert_toks: how typically ve ##xing that there should be a rotten crop of films on , just when he really wanted a good one .

reference_raw: What a typical vexing that a rotted crop of movies should be on, just when he really wanted a good one.

reference_spacy_tokens: What a typical vexing that a rotted crop of movies should be on , just when he really wanted a good one .


fn_spacy_tokens_for_baseline: And the price of big houses like that has really plummeted in the last year .

source_bert_toks: and the price of big houses like that has really plum ##met ##ed in the last year .

reference_raw: And the price of such large houses has actually fallen over the past year.

reference_spacy_tokens: And the price of such large houses has actually fallen over the past year .


fn_spacy_tokens_for_baseline: Negotiations aimed at settling Iran 's long - standing financial dispute with France [ see p. 37929 ] were suspended after the Foreign Minister Ali Akbar Vellayati , who visited France on July 2 - 4 , failed to sign a formal agreement .

source_bert_toks: negotiations aimed at settling iran ' s long - standing financial dispute with france [ see p . 37 ##9 ##29 ] were suspended after the foreign minister ali akbar ve ##lla ##yat ##i , who visited france on july 2 - 4 , failed to sign a formal agreement .

reference_raw: Following the non-signing of the formal agreement by Foreign Minister Ali Akbar Vellayati, who visited France on July 2-4, the negotiations on the settlement of Iran's long-term financial conflict with France were suspended [see p. 37929].

reference_spacy_tokens: Following the non - signing of the formal agreement by Foreign Minister Ali Akbar Vellayati , who visited France on July 2 - 4 , the negotiations on the settlement of Iran 's long - term financial conflict with France were suspended [ see p. 37929].


fn_spacy_tokens_for_baseline: Charles had to sign a legal document testifying to that effect the day he inherited .

source_bert_toks: charles had to sign a legal document testify ##ing to that effect the day he inherited .

reference_raw: Charles must have signed a legal document attesting to that effect on the day he inherited it.

reference_spacy_tokens: Charles must have signed a legal document attesting to that effect on the day he inherited it .


fn_spacy_tokens_for_baseline: CCI has come a long way in the last five years .

source_bert_toks: cc ##i has come a long way in the last five years .

reference_raw: The CCI has gone far over the past five years.

reference_spacy_tokens: The CCI has gone far over the past five years .


fn_spacy_tokens_for_baseline: Desperate for hard currency to prop up its sickly regime , North Korea has demanded $ 1 billion a year from America to end its destabilising missile sales to countries such as Iran , Syria , Libya , Egypt and Pakistan .

source_bert_toks: desperate for hard currency to prop up its sick ##ly regime , north korea has demanded $ 1 billion a year from america to end its des ##ta ##bilis ##ing missile sales to countries such as iran , syria , libya , egypt and pakistan .

reference_raw: Desperate for a hard currency to support a sick regime, North Korea demanded $1 billion a year from the US to stop destabilizing missile sales to countries like Iran, Syria, Libya, Egypt, and Pakistan.

reference_spacy_tokens: Desperate for a hard currency to support a sick regime , North Korea demanded $ 1 billion a year from the US to stop destabilizing missile sales to countries like Iran , Syria , Libya , Egypt , and Pakistan .


fn_spacy_tokens_for_baseline: Once upon a time he had read a quite terrifying number of books and accumulated an equally terrifying number of opinions about them .

source_bert_toks: once upon a time he had read a quite terrifying number of books and accumulated an equally terrifying number of opinions about them .

reference_raw: Once upon a time, he had read quite a terrible number of books, and had gathered an equally terrible number of opinions about them.

reference_spacy_tokens: Once upon a time , he had read quite a terrible number of books , and had gathered an equally terrible number of opinions about them .


fn_spacy_tokens_for_baseline: You sprinkle chocolate on top of the milk when it 's in the cups .

source_bert_toks: you sp ##rin ##kle chocolate on top of the milk when it ' s in the cups .

reference_raw: When it's in the cups, you spray chocolate on the milk.

reference_spacy_tokens: When it 's in the cups , you spray chocolate on the milk .


fn_spacy_tokens_for_baseline: These include negative reactions to the onset of menstruation , dislike of menstruation , and menstrual irregularity ( this last feature may be the result of an eating disorder ) .

source_bert_toks: these include negative reactions to the onset of men ##st ##ru ##ation , dislike of men ##st ##ru ##ation , and men ##st ##ru ##al irregular ##ity ( this last feature may be the result of an eating disorder ) .

reference_raw: These include adverse reactions to the onset of menstruation, reluctance to menstruation, and menstrual irregularities (the latter may be the result of eating disturbances).

reference_spacy_tokens: These include adverse reactions to the onset of menstruation , reluctance to menstruation , and menstrual irregularities ( the latter may be the result of eating disturbances ) .


fn_spacy_tokens_for_baseline: Then the auctioneers realised that the bidder was heavily intoxicated and could not afford the bidder 's fee let alone the ; 17,000 for the Cub !

source_bert_toks: then the auction ##eers realised that the bid ##der was heavily into ##xi ##cated and could not afford the bid ##der ' s fee let alone the ; 17 , 000 for the cub !

reference_raw: Then the auctioneers realized that the bidder was heavily drunk and couldn't afford the bidder's fee, much less the price; 17,000 for the cub!

reference_spacy_tokens: Then the auctioneers realized that the bidder was heavily drunk and could n't afford the bidder 's fee , much less the price ; 17,000 for the cub !


fn_spacy_tokens_for_baseline: In some cultures , the demands made and penalties imposed by family and society ensure that women will bear many children .

source_bert_toks: in some cultures , the demands made and penalties imposed by family and society ensure that women will bear many children .

reference_raw: In some cultures, the requirements and sanctions imposed by family and society ensure that women have many children.

reference_spacy_tokens: In some cultures , the requirements and sanctions imposed by family and society ensure that women have many children .


fn_spacy_tokens_for_baseline: ' It 's a badge containing a strip of masked photographic film worn by all personnel working within the plant itself .

source_bert_toks: ' it ' s a badge containing a strip of masked photographic film worn by all personnel working within the plant itself .

reference_raw: It's a badge with a strip of masked photographic film worn by all the personnel working in the factory itself.

reference_spacy_tokens: It 's a badge with a strip of masked photographic film worn by all the personnel working in the factory itself .


fn_spacy_tokens_for_baseline: Young single women with children are overwhelmingly likely to be living in local authority housing , and those who married early and/or had a pre - marital conception are more likely to do so as well .

source_bert_toks: young single women with children are overwhelmingly likely to be living in local authority housing , and those who married early and / or had a pre - marital conception are more likely to do so as well .

reference_raw: Young unmarried women with children are most likely to live in local administrative housing, and those who married prematurely and/or had a premarital conception are more likely to do so.

reference_spacy_tokens: Young unmarried women with children are most likely to live in local administrative housing , and those who married prematurely and/or had a premarital conception are more likely to do so .


fn_spacy_tokens_for_baseline: Professor Ryker suppressed an admiring grin as she marched from the room .

source_bert_toks: professor ry ##ker suppressed an admiring grin as she marched from the room .

reference_raw: Professor Ryker suppressed a smile of admiration as she walked out of the room.

reference_spacy_tokens: Professor Ryker suppressed a smile of admiration as she walked out of the room .


fn_spacy_tokens_for_baseline: Since the early 1980s , the principal issuance method has been the bought deal , wherein the lead manager buys the entire issue at set terms from the borrower prior to announcement .

source_bert_toks: since the early 1980s , the principal iss ##uance method has been the bought deal , wherein the lead manager buys the entire issue at set terms from the borrow ##er prior to announcement .

reference_raw: Since the beginning of the 1980s, the main issue method has been the purchase of the contract, in which the manager purchases the whole issue on set terms from the debtor before the announcement.

reference_spacy_tokens: Since the beginning of the 1980s , the main issue method has been the purchase of the contract , in which the manager purchases the whole issue on set terms from the debtor before the announcement .


fn_spacy_tokens_for_baseline: Then in the evening he sat in the ballroom of the hotel where the cast where staying , getting pissed on shorts .

source_bert_toks: then in the evening he sat in the ballroom of the hotel where the cast where staying , getting pissed on shorts .

reference_raw: Then, in the evening, he sat in the hall of the hotel where the cast stayed, pissed off in his shorts.

reference_spacy_tokens: Then , in the evening , he sat in the hall of the hotel where the cast stayed , pissed off in his shorts .


fn_spacy_tokens_for_baseline: Then watch a big truck trying to squash a hapless motorist in Steven Spielberg 's best ever movie , DUEL .

source_bert_toks: then watch a big truck trying to squash a ha ##ples ##s motor ##ist in steven spielberg ' s best ever movie , duel .

reference_raw: Then watch a big truck trying to crush a hapless motorist in the best Steven Spielberg movie ever made, DUEL.

reference_spacy_tokens: Then watch a big truck trying to crush a hapless motorist in the best Steven Spielberg movie ever made , DUEL .


fn_spacy_tokens_for_baseline: The key resolution called on representatives to approve the Harare declaration on negotiations with the government of Mr F.W. de Klerk .

source_bert_toks: the key resolution called on representatives to approve the hara ##re declaration on negotiations with the government of mr f . w . de k ##ler ##k .

reference_raw: The key resolution called on representatives to endorse the Harare statement on the negotiations with Mr F.W. de Klerk's government.

reference_spacy_tokens: The key resolution called on representatives to endorse the Harare statement on the negotiations with Mr F.W. de Klerk 's government .


fn_spacy_tokens_for_baseline: As was shown at , for example , the close of the Gay News case , Mrs Whitehouse suggested that she was pleased that the paper 's editor , Denis Lemon , was not sent to prison for she had nothing against him personally .

source_bert_toks: as was shown at , for example , the close of the gay news case , mrs white ##house suggested that she was pleased that the paper ' s editor , denis lemon , was not sent to prison for she had nothing against him personally .

reference_raw: As evidenced by the closure of the Gay News case, Mrs Whitehouse suggested that she was pleased that the editor of the newspaper, Dennis Lemon, had not been sent to prison because she had nothing against him personally.

reference_spacy_tokens: As evidenced by the closure of the Gay News case , Mrs Whitehouse suggested that she was pleased that the editor of the newspaper , Dennis Lemon , had not been sent to prison because she had nothing against him personally .


fn_spacy_tokens_for_baseline: They accepted that Massingham had gained his promotion on merit although they were not so naive as to suppose that being the elder son of a peer did any man harm .

source_bert_toks: they accepted that mass ##ingham had gained his promotion on merit although they were not so naive as to suppose that being the elder son of a peer did any man harm .

reference_raw: They accepted that Massingham had gotten his promotion on merit, though they weren't so gullible as to assume that being a peer's older son would hurt anyone.

reference_spacy_tokens: They accepted that Massingham had gotten his promotion on merit , though they were n't so gullible as to assume that being a peer 's older son would hurt anyone .


fn_spacy_tokens_for_baseline: WITH son Wills at her side , Princess Di stepped out jauntily yesterday in trainers , baseball cap and cricket -style sweater for her favourite Saturday sport -- shopping .

source_bert_toks: with son wills at her side , princess di stepped out ja ##unt ##ily yesterday in trainers , baseball cap and cricket - style sweater for her favourite saturday sport - - shopping .

reference_raw: With son Wills at her side, Princess Di got out of Jauntily yesterday in coaches, baseball caps, and cricket - a style jumper for her favorite Saturday sport - shopping.

reference_spacy_tokens: With son Wills at her side , Princess Di got out of Jauntily yesterday in coaches , baseball caps , and cricket - a style jumper for her favorite Saturday sport - shopping .


fn_spacy_tokens_for_baseline: In July 1977 , North Korea signed a trilateral safeguards agreement with the IAEA and the USSR that brought the IRT- 2000 research reactor and a critical assembly in Yo ( ngbyo ( n - kun under IAEA safeguards .

source_bert_toks: in july 1977 , north korea signed a tri ##lateral safeguard ##s agreement with the ia ##ea and the ussr that brought the ir ##t - 2000 research reactor and a critical assembly in yo ( ng ##by ##o ( n - kun under ia ##ea safeguard ##s .

reference_raw: In July 1977, North Korea signed a trilateral safeguard agreement with the International Atomic Energy Agency (IAEA) and the Soviet Union (USSR), bringing together the IRT-2000 research reactor and the crucial assembly in Yo (N-Kun under IAEA safeguards).

reference_spacy_tokens: In July 1977 , North Korea signed a trilateral safeguard agreement with the International Atomic Energy Agency ( IAEA ) and the Soviet Union ( USSR ) , bringing together the IRT-2000 research reactor and the crucial assembly in Yo ( N - Kun under IAEA safeguards ) .


fn_spacy_tokens_for_baseline: Right : the King Imin memorial mosque outside Turpan in Xinjiang draws thousands of the faithful every Friday .

source_bert_toks: right : the king im ##in memorial mosque outside tu ##rp ##an in xinjiang draws thousands of the faithful every friday .

reference_raw: Right: King Imin's memorial mosque outside of Turpan in Xinjiang draws thousands of believers every Friday.

reference_spacy_tokens: Right : King Imin 's memorial mosque outside of Turpan in Xinjiang draws thousands of believers every Friday .


fn_spacy_tokens_for_baseline: On 19 December 2003 , Libyan leader Col . Muammar Qadhafi publicly confirmed his commitment to disclose and dismantle WMD programs in his country following a nine - month period of negotiations with US and UK authorities .

source_bert_toks: on 19 december 2003 , libyan leader col . mu ##am ##mar q ##ad ##ha ##fi publicly confirmed his commitment to disclose and di ##sman ##tle w ##md programs in his country following a nine - month period of negotiations with us and uk authorities .

reference_raw: On 19 December 2003, Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to publish and dismantle weapons of mass destruction programmes in his country after a nine-month period of talks with the authorities of the United States and the United Kingdom.

reference_spacy_tokens: On 19 December 2003 , Libyan leader Colonel Muammar Qadhafi publicly confirmed his commitment to publish and dismantle weapons of mass destruction programmes in his country after a nine - month period of talks with the authorities of the United States and the United Kingdom .


fn_spacy_tokens_for_baseline: After it was drunk , Lady Merchiston seemed to recover a little of her lost vitality .

source_bert_toks: after it was drunk , lady mer ##chi ##ston seemed to recover a little of her lost vital ##ity .

reference_raw: When she was drunk, it was as if Lady Merchiston had recovered some of her lost vitality.

reference_spacy_tokens: When she was drunk , it was as if Lady Merchiston had recovered some of her lost vitality .


fn_spacy_tokens_for_baseline: If anything , say the pundits , Clinton is shrewd to solidify political support during these dark days .

source_bert_toks: if anything , say the pun ##dit ##s , clinton is sh ##rew ##d to solid ##ify political support during these dark days .

reference_raw: If anything, let's say pundits, Clinton is smart enough to solidify political support in these gloomy days.

reference_spacy_tokens: If anything , let 's say pundits , Clinton is smart enough to solidify political support in these gloomy days .


fn_spacy_tokens_for_baseline: THE parents of a boy who suddenly withdrew into a silent world have been sent a message of support from the Queen .

source_bert_toks: the parents of a boy who suddenly withdrew into a silent world have been sent a message of support from the queen .

reference_raw: The mother and father of the boy, who had suddenly retreated into the quiet world, had been sent a message of support from the queen.

reference_spacy_tokens: The mother and father of the boy , who had suddenly retreated into the quiet world , had been sent a message of support from the queen .


fn_spacy_tokens_for_baseline: I once tried to interest Terry Linex in the idea of opening an airfood restaurant .

source_bert_toks: i once tried to interest terry line ##x in the idea of opening an air ##fo ##od restaurant .

reference_raw: I tried to get Terry Linex to start an airfood restaurant once.

reference_spacy_tokens: I tried to get Terry Linex to start an airfood restaurant once .


fn_spacy_tokens_for_baseline: At that moment Belinda looked over her shoulder and , seeing them together , detached herself from the rest of the group and tramped through the dying bracken towards them .

source_bert_toks: at that moment belinda looked over her shoulder and , seeing them together , detached herself from the rest of the group and tram ##ped through the dying bra ##cken towards them .

reference_raw: At that moment Belinda glanced over her shoulder, and when she saw them together, she detached herself from the rest of the group and walked through the dying bracken toward them.

reference_spacy_tokens: At that moment Belinda glanced over her shoulder , and when she saw them together , she detached herself from the rest of the group and walked through the dying bracken toward them .


fn_spacy_tokens_for_baseline: But Toby sat up , pouted and said in an odd , little - girl voice .

source_bert_toks: but toby sat up , po ##uted and said in an odd , little - girl voice .

reference_raw: But Toby took a seat, pouted, and spoke in a strange little girl's voice.

reference_spacy_tokens: But Toby took a seat , pouted , and spoke in a strange little girl 's voice .


fn_spacy_tokens_for_baseline: For example , a family of four occupying a semi - detached house may consume more local services than the single occupier next door , but would still pay the same rates .

source_bert_toks: for example , a family of four occupying a semi - detached house may consume more local services than the single o ##cc ##up ##ier next door , but would still pay the same rates .

reference_raw: For example, a four-year-old family living in a semi-detached house could consume more local services than a single occupier next door, but would still pay the same rates.

reference_spacy_tokens: For example , a four - year - old family living in a semi - detached house could consume more local services than a single occupier next door , but would still pay the same rates .


fn_spacy_tokens_for_baseline: OMB determined that this rule was an economically significant regulatory action under Executive Order 12866 because it could result in an annual effect on the economy of $ 100 million or more .

source_bert_toks: om ##b determined that this rule was an economically significant regulatory action under executive order 128 ##66 because it could result in an annual effect on the economy of $ 100 million or more .

reference_raw: The OMB concluded that this rule was an economically significant regulatory measure under Executive Decree No 12866, since it could have an annual impact of at least 100 million dollars on the economy.

reference_spacy_tokens: The OMB concluded that this rule was an economically significant regulatory measure under Executive Decree No 12866 , since it could have an annual impact of at least 100 million dollars on the economy .


fn_spacy_tokens_for_baseline: After numerous allegations by opposition groups and Western governments , Iran announced that it was constructing several new facilities .

source_bert_toks: after numerous allegations by opposition groups and western governments , iran announced that it was constructing several new facilities .

reference_raw: Following numerous allegations by opposition groups and Western governments, Iran announced that it was building several new facilities.

reference_spacy_tokens: Following numerous allegations by opposition groups and Western governments , Iran announced that it was building several new facilities .


fn_spacy_tokens_for_baseline: Franco interpreted as threatening anything that escaped his personal control , and by May 1941 he had begun to feel that Serrano and his collaborators were doing just that .

source_bert_toks: franco interpreted as threatening anything that escaped his personal control , and by may 1941 he had begun to feel that serra ##no and his collaborators were doing just that .

reference_raw: Franco read as a threat to anything that escaped his personal control, and in May 1941 he began to feel that Serrano and his co-workers were doing the same thing.

reference_spacy_tokens: Franco read as a threat to anything that escaped his personal control , and in May 1941 he began to feel that Serrano and his co - workers were doing the same thing .


fn_spacy_tokens_for_baseline: I could drop in at your place about five or six .

source_bert_toks: i could drop in at your place about five or six .

reference_raw: I can stop by your house, like, five or six.

reference_spacy_tokens: I can stop by your house , like , five or six .


fn_spacy_tokens_for_baseline: We 've got muggers snatching briefcases by drawing a knife across the inside of the victim 's wrist .

source_bert_toks: we ' ve got mug ##gers snatch ##ing briefcase ##s by drawing a knife across the inside of the victim ' s wrist .

reference_raw: We have robbers stealing suitcases by drawing a knife to the inside of the victim's wrist.

reference_spacy_tokens: We have robbers stealing suitcases by drawing a knife to the inside of the victim 's wrist .


fn_spacy_tokens_for_baseline: His head had jerked up when I leapt to my feet -- now it sank back on to his hollow chest .

source_bert_toks: his head had jerked up when i leapt to my feet - - now it sank back on to his hollow chest .

reference_raw: When I jumped to my feet, his head twitched - now he sank back into his hollow chest.

reference_spacy_tokens: When I jumped to my feet , his head twitched - now he sank back into his hollow chest .


fn_spacy_tokens_for_baseline: Chambers shot him a look of astonishment , then turned to include Nora

source_bert_toks: chambers shot him a look of astonishment , then turned to include nora

reference_raw: Chambers shot him a look of surprise, then turned to include Nora.

reference_spacy_tokens: Chambers shot him a look of surprise , then turned to include Nora .


fn_spacy_tokens_for_baseline: ' No one can prove anything , ' blustered O'Hara .

source_bert_toks: ' no one can prove anything , ' blu ##stered o ' hara .

reference_raw: 'No one can prove anything,' said O'Hara.

reference_spacy_tokens: ' No one can prove anything , ' said O'Hara .


fn_spacy_tokens_for_baseline: He went out into the antechamber and sat with C'zinsit .

source_bert_toks: he went out into the ant ##ech ##am ##ber and sat with c ' z ##ins ##it .

reference_raw: He went to the anteroom and sat down with C'zinsit.

reference_spacy_tokens: He went to the anteroom and sat down with C'zinsit .


fn_spacy_tokens_for_baseline: During the three decades after the establishment of the DPRK ( in 1947 ) , the North Korean CW program had uneven success in obtaining and weaponizing CW agents .

source_bert_toks: during the three decades after the establishment of the d ##pr ##k ( in 1947 ) , the north korean cw program had uneven success in obtaining and weapon ##izing cw agents .

reference_raw: During the three decades following the creation of the DPRK (in 1947), the North Korean CW program was unevenly successful in obtaining and arming CW agents.

reference_spacy_tokens: During the three decades following the creation of the DPRK ( in 1947 ) , the North Korean CW program was unevenly successful in obtaining and arming CW agents .


fn_spacy_tokens_for_baseline: Find who they are , then ask your library to get some of their books for you .

source_bert_toks: find who they are , then ask your library to get some of their books for you .

reference_raw: Figure out who they are, and then ask the library to bring you some of their books.

reference_spacy_tokens: Figure out who they are , and then ask the library to bring you some of their books .


fn_spacy_tokens_for_baseline: As many as 500 highly trained fighters from the rebel - controlled city of Misurata were said to be participating in the battle for Kadafi 's compound .

source_bert_toks: as many as 500 highly trained fighters from the rebel - controlled city of mis ##ura ##ta were said to be participating in the battle for ka ##da ##fi ' s compound .

reference_raw: It was said that up to 500 highly trained warriors from the rebel-controlled city of Misurata were involved in the battle for the Kadafi compound.

reference_spacy_tokens: It was said that up to 500 highly trained warriors from the rebel - controlled city of Misurata were involved in the battle for the Kadafi compound .


fn_spacy_tokens_for_baseline: A key turned in a lock , and as he passed in there was a curious scuffling noise from within .

source_bert_toks: a key turned in a lock , and as he passed in there was a curious sc ##uf ##fl ##ing noise from within .

reference_raw: The key swung in the lock, and a strange scuffling sound came from the inside as he passed.

reference_spacy_tokens: The key swung in the lock , and a strange scuffling sound came from the inside as he passed .


fn_spacy_tokens_for_baseline: Visitors are being asked to be on their guard against fire and not to use stoves ; to dispose of cigarette ends and matches carefully and immediately report any sign of fire to the fire brigade .

source_bert_toks: visitors are being asked to be on their guard against fire and not to use stove ##s ; to dispose of cigarette ends and matches carefully and immediately report any sign of fire to the fire brigade .

reference_raw: Visitors are asked to be alert to the fire and not to use stoves; to dispose of cigarette ends and matches carefully and immediately notify the fire brigade of any sign of fire.

reference_spacy_tokens: Visitors are asked to be alert to the fire and not to use stoves ; to dispose of cigarette ends and matches carefully and immediately notify the fire brigade of any sign of fire .


fn_spacy_tokens_for_baseline: ' Our little fish has nibbled the bait . '

source_bert_toks: ' our little fish has ni ##bbled the bait . '

reference_raw: "Our little fish bit the bait."

reference_spacy_tokens: " Our little fish bit the bait . "


fn_spacy_tokens_for_baseline: Well if I - I saw on one of the talk shows this woman judge i believe from Florida and she just has just really stiff penalties and i saw that in in the hands of a judge that really was conscientious and really , you know , took the pains to give a sentence for what was deserved , it could - you could have a - a judge that would really make a good impact , but likewise you could have the flip side and have some judge that was paid off or you know had good - a good old boy network , or , for whatever reasons , you know , politics , just let all kinds of people through so he - he would have a heck - or - she would have a heck of a lot of power , you know , if used wrongly .

source_bert_toks: well if i - i saw on one of the talk shows this woman judge i believe from florida and she just has just really stiff penalties and i saw that in in the hands of a judge that really was con ##sc ##ient ##ious and really , you know , took the pains to give a sentence for what was deserved , it could - you could have a - a judge that would really make a good impact , but likewise you could have the flip side and have some judge that was paid off or you know had good - a good old boy network , or , for whatever reasons , you know , politics , just let all kinds of people through so he - he would have a heck - or - she would have a heck of a lot of power , you know , if used wrongly .

reference_raw: Well, if I-I saw on one of those interviews that this woman judge I believe in from Florida, and she just had some really stiff punishments, and I saw that in the hands of a judge who was really conscientious and really, you know, took the pain of giving a sentence for what was deserved, you could-- you could have a judge who would really have a good effect, but you could have a flip-flop and a judge who was paid for it. you know, it was good - a good old boy's network, or, for some reason, you know, politics, just let a lot of people through to him - he'd have a heck - or - he'd have a lot of power, you know, if he'd used it wrong.

reference_spacy_tokens: Well , if I - I saw on one of those interviews that this woman judge I believe in from Florida , and she just had some really stiff punishments , and I saw that in the hands of a judge who was really conscientious and really , you know , took the pain of giving a sentence for what was deserved , you could-- you could have a judge who would really have a good effect , but you could have a flip - flop and a judge who was paid for it . you know , it was good - a good old boy 's network , or , for some reason , you know , politics , just let a lot of people through to him - he 'd have a heck - or - he 'd have a lot of power , you know , if he 'd used it wrong .


fn_spacy_tokens_for_baseline: The eastern solution to Germany 's problems was to create an area of unified language , unified identity , unified wealth and settlement , a bulwark against the barbarism and poverty of the Poles .

source_bert_toks: the eastern solution to germany ' s problems was to create an area of unified language , unified identity , unified wealth and settlement , a bu ##l ##wark against the bar ##bari ##sm and poverty of the poles .

reference_raw: The eastern solution to Germany's problems was to create an area of unified language, united identity, united wealth and settlement, a counter-barbarism and poverty in the Poles.

reference_spacy_tokens: The eastern solution to Germany 's problems was to create an area of unified language , united identity , united wealth and settlement , a counter - barbarism and poverty in the Poles .


fn_spacy_tokens_for_baseline: Apart from some narrowing of the gender gap , this situation largely persisted through the eighteenth century .

source_bert_toks: apart from some narrowing of the gender gap , this situation largely persisted through the eighteenth century .

reference_raw: In addition to some narrowing of the gender gap, the situation continued to exist to a large extent in the 18th century.

reference_spacy_tokens: In addition to some narrowing of the gender gap , the situation continued to exist to a large extent in the 18th century .


fn_spacy_tokens_for_baseline: The distinctive feature of the method lies in what it does not do .

source_bert_toks: the distinctive feature of the method lies in what it does not do .

reference_raw: The characteristic characteristic of a method is what it does not do.

reference_spacy_tokens: The characteristic characteristic of a method is what it does not do .


fn_spacy_tokens_for_baseline: It was a crime in New England , punishable by death , for a child of 16 to curse or strike a parent .

source_bert_toks: it was a crime in new england , punish ##able by death , for a child of 16 to curse or strike a parent .

reference_raw: It was a crime in New England, punishable by death, for a 16-year-old to curse or attack a parent.

reference_spacy_tokens: It was a crime in New England , punishable by death , for a 16-year - old to curse or attack a parent .


fn_spacy_tokens_for_baseline: However , CaM can also interact with group III mGluRs [ 26 28]. Recent data suggests that the association of CaM with group III mGluRs is necessary for normal G protein activation [ 27]. By analogy to group III mGluRs , the ability of Siah1a to compete with CaM for binding to group I mGluRs was considered a potential mechanism for the actions of Siah1a on group I mGluR - mediated calcium current inhibition .

source_bert_toks: however , cam can also interact with group iii mg ##lu ##rs [ 26 28 ] . recent data suggests that the association of cam with group iii mg ##lu ##rs is necessary for normal g protein activation [ 27 ] . by analogy to group iii mg ##lu ##rs , the ability of si ##ah ##1 ##a to compete with cam for binding to group i mg ##lu ##rs was considered a potential mechanism for the actions of si ##ah ##1 ##a on group i mg ##lu ##r - mediated calcium current inhibition .

reference_raw: However, CAM may also interact with group III mGlurs [26 28]. Recent data indicate that the association of CAM with group III mGlurs is necessary for normal activation of G protein [27]. Similarly to group III mGlurs, the ability of Siah1a to compete with CAM to bind to group I mGlurs was considered a possible mechanism for the action of Siah1a on group ImG. Inhibition of calcium current mediated by lur.

reference_spacy_tokens: However , CAM may also interact with group III mGlurs [ 26 28]. Recent data indicate that the association of CAM with group III mGlurs is necessary for normal activation of G protein [ 27]. Similarly to group III mGlurs , the ability of Siah1a to compete with CAM to bind to group I mGlurs was considered a possible mechanism for the action of Siah1a on group ImG. Inhibition of calcium current mediated by lur .


fn_spacy_tokens_for_baseline: How do these broad - brush sociological observations help us to understand the conceptual connections between higher education and research ?

source_bert_toks: how do these broad - brush sociological observations help us to understand the conceptual connections between higher education and research ?

reference_raw: How can these wide-ranging sociological observations help us grasp the conceptual link between higher education and research?

reference_spacy_tokens: How can these wide - ranging sociological observations help us grasp the conceptual link between higher education and research ?


fn_spacy_tokens_for_baseline: Civilized people , in her view , did not include her aunt Evelina or cousin Tina or the idealistic vegetable gardeners .

source_bert_toks: civilized people , in her view , did not include her aunt eve ##lina or cousin tina or the ideal ##istic vegetable gardener ##s .

reference_raw: In her opinion, the civilized people did not include her aunt Evelina, cousin Tina, or the idealistic gardening planters.

reference_spacy_tokens: In her opinion , the civilized people did not include her aunt Evelina , cousin Tina , or the idealistic gardening planters .


fn_spacy_tokens_for_baseline: A 999-year lease by India to Bangladesh of the 1.5 hectare Tin Bigha corridor began on June 26 .

source_bert_toks: a 999 - year lease by india to bangladesh of the 1 . 5 hectare tin big ##ha corridor began on june 26 .

reference_raw: On June 26, India's 999-year lease to Bangladesh of 1.5 ha Tin Bigha Corridor began.

reference_spacy_tokens: On June 26 , India 's 999-year lease to Bangladesh of 1.5 ha Tin Bigha Corridor began .


fn_spacy_tokens_for_baseline: TOKYO ( AP ) --- The Tokyo Stock Exchange 's main index advanced moderately Thursday , rising for the third session in a row to close at its highest level this year .

source_bert_toks: tokyo ( ap ) - - - the tokyo stock exchange ' s main index advanced moderately thursday , rising for the third session in a row to close at its highest level this year .

reference_raw: TOKYO (AP) --- The main index of the Tokyo Stock Exchange has progressed slightly on Thursday, rising for the third session in a row to close at its highest level this year.

reference_spacy_tokens: TOKYO ( AP ) --- The main index of the Tokyo Stock Exchange has progressed slightly on Thursday , rising for the third session in a row to close at its highest level this year .


fn_spacy_tokens_for_baseline: After a minute , she went into the bathroom and leaned over the basin and spat .

source_bert_toks: after a minute , she went into the bathroom and leaned over the basin and spat .

reference_raw: After a while she went to the toilet and leaned over the sink and spat.

reference_spacy_tokens: After a while she went to the toilet and leaned over the sink and spat .


fn_spacy_tokens_for_baseline: ' Go to meet him with Maggie and let her charm him . '

source_bert_toks: ' go to meet him with maggie and let her charm him . '

reference_raw: "Take him to Maggie's and let her enchant him."

reference_spacy_tokens: " Take him to Maggie 's and let her enchant him . "


fn_spacy_tokens_for_baseline: Neville sighed deeply and felt at his groin .

source_bert_toks: neville sighed deeply and felt at his groin .

reference_raw: Neville let out a deep sigh and felt his crotch.

reference_spacy_tokens: Neville let out a deep sigh and felt his crotch .


fn_spacy_tokens_for_baseline: The one hundred thousand pound greenhouse was built three years ago at Shurdington near Gloucester to propogate 40,000 trees and shrubs for use across the country .

source_bert_toks: the one hundred thousand pound greenhouse was built three years ago at shu ##rdi ##ng ##ton near gloucester to prop ##oga ##te 40 , 000 trees and shrubs for use across the country .

reference_raw: Three years ago, a 100,000-pound glasshouse was built in Shurdington near Gloucester to propagate 40,000 trees and bushes for use all over the country.

reference_spacy_tokens: Three years ago , a 100,000-pound glasshouse was built in Shurdington near Gloucester to propagate 40,000 trees and bushes for use all over the country .


fn_spacy_tokens_for_baseline: She made the kind of face she made when tasting sour milk .

source_bert_toks: she made the kind of face she made when tasting sour milk .

reference_raw: She made a face like that when she tried sour milk.

reference_spacy_tokens: She made a face like that when she tried sour milk .


fn_spacy_tokens_for_baseline: Water oozed through the sodden cardboard inner soles , hastily fitted over the holes in my cheap plastic shoes as I stood in the rain outside the courtroom .

source_bert_toks: water o ##oz ##ed through the so ##dden cardboard inner sole ##s , hastily fitted over the holes in my cheap plastic shoes as i stood in the rain outside the courtroom .

reference_raw: As I stood in the rain in front of the courtroom, water poured through the sodden inner soles of the cardboard, hastily fixed over the holes in my cheap plastic boots.

reference_spacy_tokens: As I stood in the rain in front of the courtroom , water poured through the sodden inner soles of the cardboard , hastily fixed over the holes in my cheap plastic boots .


fn_spacy_tokens_for_baseline: She freewheeled into the village , pedalled doggedly through it , then tackled the hill on the other side .

source_bert_toks: she free ##wheel ##ed into the village , pedal ##led dogg ##edly through it , then tackled the hill on the other side .

reference_raw: She free-wheeled into the village, paddled doggedly through it, and then attacked the hill on the other side.

reference_spacy_tokens: She free - wheeled into the village , paddled doggedly through it , and then attacked the hill on the other side .


fn_spacy_tokens_for_baseline: When he had vanished from sight she expelled a long sigh and allowed the mask to slip away from her face , slowing returning to her towel and lying down flat on it .

source_bert_toks: when he had vanished from sight she expelled a long sigh and allowed the mask to slip away from her face , slowing returning to her towel and lying down flat on it .

reference_raw: When he was out of sight, she exhaled a long sigh and let the mask slip out of her face, slowed back to the towel and lay down on it.

reference_spacy_tokens: When he was out of sight , she exhaled a long sigh and let the mask slip out of her face , slowed back to the towel and lay down on it .


fn_spacy_tokens_for_baseline: In spite of his desire for Kiku , he spent the first night in Zurachina 's yurt .

source_bert_toks: in spite of his desire for ki ##ku , he spent the first night in zur ##achi ##na ' s yu ##rt .

reference_raw: Despite his desire for Kiku, he spent his first night in Zurachina's yurt.

reference_spacy_tokens: Despite his desire for Kiku , he spent his first night in Zurachina 's yurt .


fn_spacy_tokens_for_baseline: Additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

source_bert_toks: additional pressures from arriving miners pushed the missionaries ' plight beyond recovery .

reference_raw: The additional pressure from the coming miners pushed the missionary's predicament beyond recovery.

reference_spacy_tokens: The additional pressure from the coming miners pushed the missionary 's predicament beyond recovery .


fn_spacy_tokens_for_baseline: Vaguely ashamed of her behaviour , she then tried to draw back , but his arms tightened , preventing her , and she gave up all thoughts of resistance .

source_bert_toks: vaguely ashamed of her behaviour , she then tried to draw back , but his arms tightened , preventing her , and she gave up all thoughts of resistance .

reference_raw: Embarrassed by her behavior, she tried to pull back, but his arms tightened to stop her, and she gave up all thoughts of resistance.

reference_spacy_tokens: Embarrassed by her behavior , she tried to pull back , but his arms tightened to stop her , and she gave up all thoughts of resistance .


fn_spacy_tokens_for_baseline: " May , shut up . "

source_bert_toks: " may , shut up . "

reference_raw: "Shut up."

reference_spacy_tokens: " Shut up . "


fn_spacy_tokens_for_baseline: That morning , as he galloped along the ride between the trees in the Tiergarten , his horse 's hooves kicked up the powdered snow filling him with a fierce joy .

source_bert_toks: that morning , as he gallo ##ped along the ride between the trees in the tier ##gart ##en , his horse ' s hooves kicked up the powder ##ed snow filling him with a fierce joy .

reference_raw: That morning, as he galloped through the trees of the Tiergarten, the hoofs of his horse kicked the dusty snow that filled him with wild joy.

reference_spacy_tokens: That morning , as he galloped through the trees of the Tiergarten , the hoofs of his horse kicked the dusty snow that filled him with wild joy .


fn_spacy_tokens_for_baseline: Catholicism , however gripped the masses by virtue of its incense , its ritual , all quite arbitrary , compulsion without purpose .

source_bert_toks: catholicism , however gripped the masses by virtue of its incense , its ritual , all quite arbitrary , compulsion without purpose .

reference_raw: Catholicism, however, gripped the masses with its incense, its rite, all quite arbitrary, and purposeless compulsion.

reference_spacy_tokens: Catholicism , however , gripped the masses with its incense , its rite , all quite arbitrary , and purposeless compulsion .


fn_spacy_tokens_for_baseline: ' Although the heavy work is carried out by landscape contractors I love it when I can get out and add a few personal touches , ' she says .

source_bert_toks: ' although the heavy work is carried out by landscape contractors i love it when i can get out and add a few personal touches , ' she says .

reference_raw: "Even though the hard work is done by the countryside contractors, I like to get out and add a few personal touches," he says.

reference_spacy_tokens: " Even though the hard work is done by the countryside contractors , I like to get out and add a few personal touches , " he says .


fn_spacy_tokens_for_baseline: The author assumes that Dali was a great painter , which is not a given , as with Matisse .

source_bert_toks: the author assumes that dali was a great painter , which is not a given , as with mat ##isse .

reference_raw: The author assumes that Dali was an excellent artist, but not a certain artist, as in Matisse.

reference_spacy_tokens: The author assumes that Dali was an excellent artist , but not a certain artist , as in Matisse .


fn_spacy_tokens_for_baseline: If you want to get drunk there are cheaper ways of doing it . '

source_bert_toks: if you want to get drunk there are cheaper ways of doing it . '

reference_raw: "There's cheaper ways to do it if you want to get intoxicated."

reference_spacy_tokens: " There 's cheaper ways to do it if you want to get intoxicated . "


fn_spacy_tokens_for_baseline: There are indications , however , that certain personnel who were intimately involved in the program , including Basson , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers trafficking in dangerous weapons , and perhaps also -- if certain journalists can be believed -- to elements of a shadowy international network of right - wing extremists .

source_bert_toks: there are indications , however , that certain personnel who were intimately involved in the program , including bass ##on , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as libya , to foreign intelligence personnel , to un ##sc ##rup ##ulous black market ##ers trafficking in dangerous weapons , and perhaps also - - if certain journalists can be believed - - to elements of a shadowy international network of right - wing ex ##tre ##mist ##s .

reference_raw: However, there are indications that some of the personnel closely involved in the programme, including Basson, may have provided technical knowledge, equipment, or material to the "Rogue Systems" such as Libya, to foreign intelligence personnel, to unscrupulous black marketers dealing in dangerous weapons, and possibly, if some journalists can be trusted, to elements of the shadowy international network of right-wing extremists.

reference_spacy_tokens: However , there are indications that some of the personnel closely involved in the programme , including Basson , may have provided technical knowledge , equipment , or material to the " Rogue Systems " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers dealing in dangerous weapons , and possibly , if some journalists can be trusted , to elements of the shadowy international network of right - wing extremists .


fn_spacy_tokens_for_baseline: Relatives should be allowed to stay with the resident throughout this time so that they are not left alone .

source_bert_toks: relatives should be allowed to stay with the resident throughout this time so that they are not left alone .

reference_raw: The relatives should be able to stay with the resident throughout the period in order not to be left alone.

reference_spacy_tokens: The relatives should be able to stay with the resident throughout the period in order not to be left alone .


fn_spacy_tokens_for_baseline: Another commercial aircraft in the vicinity then radioed in with " reports over the radio of a commuter plane hitting the World Trade Center . "

source_bert_toks: another commercial aircraft in the vicinity then radio ##ed in with " reports over the radio of a commuter plane hitting the world trade center . "

reference_raw: Another commercial aircraft nearby radioed in with "reports on the radio of a commuter plane crashing into the World Trade Center."

reference_spacy_tokens: Another commercial aircraft nearby radioed in with " reports on the radio of a commuter plane crashing into the World Trade Center . "


fn_spacy_tokens_for_baseline: Macready unbelted his kimono , Carradine threw off his cloak .

source_bert_toks: mac ##rea ##dy un ##belt ##ed his kim ##ono , carr ##adi ##ne threw off his cloak .

reference_raw: Macready unfastened his kimono and Carradine removed his cloak.

reference_spacy_tokens: Macready unfastened his kimono and Carradine removed his cloak .


fn_spacy_tokens_for_baseline: It lay at the end of an avenue , a grey mass of stone , seemingly veiled in a mist of heat .

source_bert_toks: it lay at the end of an avenue , a grey mass of stone , seemingly veil ##ed in a mist of heat .

reference_raw: It lay at the end of the street, a gray mass of stone, seemingly obscured by a haze of heat.

reference_spacy_tokens: It lay at the end of the street , a gray mass of stone , seemingly obscured by a haze of heat .


fn_spacy_tokens_for_baseline: The proportion of such pure clusters among the total clusters serves as a coarse measure of the specificity of the phylogenetic profile method .

source_bert_toks: the proportion of such pure clusters among the total clusters serves as a coarse measure of the specific ##ity of the phylogenetic profile method .

reference_raw: The proportion of such pure clusters between the total clusters is a crude measure of the specificity of the phylogenetic profile method.

reference_spacy_tokens: The proportion of such pure clusters between the total clusters is a crude measure of the specificity of the phylogenetic profile method .


fn_spacy_tokens_for_baseline: Juliet noticed he too had small spots around his nose and mouth , and an idea began to form .

source_bert_toks: juliet noticed he too had small spots around his nose and mouth , and an idea began to form .

reference_raw: Juliet noticed that he, too, had little spots around his nose and mouth, and a thought began to emerge.

reference_spacy_tokens: Juliet noticed that he , too , had little spots around his nose and mouth , and a thought began to emerge .


fn_spacy_tokens_for_baseline: Edward , his half - brother , succeeded , aged about 38 years , and he remained as King for twenty - four years , during which time his endeavours towards sainthood earned him the title of The Confessor .

source_bert_toks: edward , his half - brother , succeeded , aged about 38 years , and he remained as king for twenty - four years , during which time his endeavour ##s towards saint ##hood earned him the title of the confess ##or .

reference_raw: Edward, his half-brother, had succeeded; he was about thirty-eight years old, and he had remained king for twenty-four years, during which time his efforts to be a saint had earned him the title of Confessor.

reference_spacy_tokens: Edward , his half - brother , had succeeded ; he was about thirty - eight years old , and he had remained king for twenty - four years , during which time his efforts to be a saint had earned him the title of Confessor .


fn_spacy_tokens_for_baseline: It claimed U. S. helicopter gunships ' suddenly appeared on the battle scene from the sea side and attacked Iranian combatants .

source_bert_toks: it claimed u . s . helicopter guns ##hips ' suddenly appeared on the battle scene from the sea side and attacked iranian combatants .

reference_raw: He claimed that U.S. helicopter gunships had suddenly appeared from the seaside, attacking Iranian fighters.

reference_spacy_tokens: He claimed that U.S. helicopter gunships had suddenly appeared from the seaside , attacking Iranian fighters .


fn_spacy_tokens_for_baseline: A Johnson Matthey spokesman dismissed any suggestion of a boardoom rift and said that the two departures were ' not particularly connected ' .

source_bert_toks: a johnson matt ##hey spokesman dismissed any suggestion of a board ##oom rift and said that the two departure ##s were ' not particularly connected ' .

reference_raw: The Johnson Matthey spokesman rejected any suggestion of a boardom crack and said that the two departures were 'not particularly linked'.

reference_spacy_tokens: The Johnson Matthey spokesman rejected any suggestion of a boardom crack and said that the two departures were ' not particularly linked ' .


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem . ( Do n't say Stephanopoulos did n't know .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem . ( don ' t say stephan ##op ##oulos didn ' t know .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had a disturbing zipper problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around bullshit artist - played a key role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem .


fn_spacy_tokens_for_baseline: A strict control system should cover the above items .

source_bert_toks: a strict control system should cover the above items .

reference_raw: The above items are to be covered by a strict control system.

reference_spacy_tokens: The above items are to be covered by a strict control system .


fn_spacy_tokens_for_baseline: What do you think the time frame is on this ?

source_bert_toks: what do you think the time frame is on this ?

reference_raw: What do you mean, it's a time frame?

reference_spacy_tokens: What do you mean , it 's a time frame ?


fn_spacy_tokens_for_baseline: On the window above the sink a small container is stuffed with bits of leftovers -- the red berries of barberry , small twigs of willow , cuttings of hinoki cypress with its fruits attached , and the pendulous leathery seed pods of wisteria .

source_bert_toks: on the window above the sink a small container is stuffed with bits of left ##overs - - the red berries of barber ##ry , small twigs of willow , cutting ##s of hi ##no ##ki cypress with its fruits attached , and the pen ##du ##lous leather ##y seed pods of wi ##ster ##ia .

reference_raw: On the glass above the sink, a small container is filled with bits of leftovers - red berries of barberries, small branches of willow, slices of hinoki cypress with fruit attached to it, and pendulous, leathery seed pods of wisteria.

reference_spacy_tokens: On the glass above the sink , a small container is filled with bits of leftovers - red berries of barberries , small branches of willow , slices of hinoki cypress with fruit attached to it , and pendulous , leathery seed pods of wisteria .


fn_spacy_tokens_for_baseline: Fortune put his personal assets at approximately $ 1,000 million .

source_bert_toks: fortune put his personal assets at approximately $ 1 , 000 million .

reference_raw: Fortune put his personal property at about $1,000 million.

reference_spacy_tokens: Fortune put his personal property at about $ 1,000 million .


fn_spacy_tokens_for_baseline: ' Ironically , the tobacco epidemic of the developing world is directly linked to growing health concerns and declining smoking rates in the United States and other developed countries .

source_bert_toks: ' ironically , the tobacco epidemic of the developing world is directly linked to growing health concerns and declining smoking rates in the united states and other developed countries .

reference_raw: The irony is that the tobacco epidemic in the developing world is directly related to increasing health concerns and falling smoking rates in the United States and other developed countries.

reference_spacy_tokens: The irony is that the tobacco epidemic in the developing world is directly related to increasing health concerns and falling smoking rates in the United States and other developed countries .


fn_spacy_tokens_for_baseline: Suddenly it passed the point of no return and plunged downwards .

source_bert_toks: suddenly it passed the point of no return and plunged downwards .

reference_raw: Abruptly, he passed the point of no return and dived down.

reference_spacy_tokens: Abruptly , he passed the point of no return and dived down .


fn_spacy_tokens_for_baseline: In the United States the American Cancer Society and the American Urological Association recommend an annual rectal examination for men aged over 50 .

source_bert_toks: in the united states the american cancer society and the american ur ##ological association recommend an annual rec ##tal examination for men aged over 50 .

reference_raw: In the United States, the U.S. Cancer Society and the U.S. U.S. Urological Association recommend an annual rectal exam for men over 50 years of age.

reference_spacy_tokens: In the United States , the U.S. Cancer Society and the U.S. U.S. Urological Association recommend an annual rectal exam for men over 50 years of age .


fn_spacy_tokens_for_baseline: These genes are duplicated along with the chromosomes at each cell division and can be passed down from parents to their offspring .

source_bert_toks: these genes are duplicate ##d along with the chromosomes at each cell division and can be passed down from parents to their offspring .

reference_raw: These genes are reproduced together with chromosomes in each cell division and can be passed on from parent to descendant.

reference_spacy_tokens: These genes are reproduced together with chromosomes in each cell division and can be passed on from parent to descendant .


fn_spacy_tokens_for_baseline: ' Why was the deal clandestine ? '

source_bert_toks: ' why was the deal clandestine ? '

reference_raw: "Why was the deal secret?"

reference_spacy_tokens: " Why was the deal secret ? "


fn_spacy_tokens_for_baseline: Reports state that Iran has received nuclear weapons technology from Brazil and India ( 7401 ) .

source_bert_toks: reports state that iran has received nuclear weapons technology from brazil and india ( 740 ##1 ) .

reference_raw: The reports indicate that Iran received nuclear weapons technology from Brazil and India (7401).

reference_spacy_tokens: The reports indicate that Iran received nuclear weapons technology from Brazil and India ( 7401 ) .


fn_spacy_tokens_for_baseline: Yeah , yeah , I mean you 're - you 're in Dallas so - everybody - i ca n't believe they can , uh , like in a murder situations , they look for juries who do n't know anything about the system well or know anything about the - the - occurrence .

source_bert_toks: yeah , yeah , i mean you ' re - you ' re in dallas so - everybody - i can ' t believe they can , uh , like in a murder situations , they look for ju ##ries who don ' t know anything about the system well or know anything about the - the - occurrence .

reference_raw: Yeah, yeah, I mean, you're--you're in Dallas, so--everybody--I don't think they can, like in a murder situation, look for juries who know nothing about the system, or know anything about-- the-- the-- the-- the-- the-- the--the--the--the--the--the--the--the--the--the--the--the--the--the--the--the--the--the--the

reference_spacy_tokens: Yeah , yeah , I mean , you're -- you're in Dallas , so -- everybody -- I do n't think they can , like in a murder situation , look for juries who know nothing about the system , or know anything about-- the-- the-- the-- the-- the-- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the -- the


fn_spacy_tokens_for_baseline: The LAT says that Clinton 's legal shift has the benefit of allowing him to fight on , but on much less controversial grounds , and yet still perhaps delaying Lindsey 's re - appearance before Starr 's grand jury for months .

source_bert_toks: the la ##t says that clinton ' s legal shift has the benefit of allowing him to fight on , but on much less controversial grounds , and yet still perhaps delaying lindsey ' s re - appearance before starr ' s grand jury for months .

reference_raw: According to the L.A.T., Clinton's legal shift has the advantage of allowing him to fight on, but for far less controversial reasons, and he may still be delaying Lindsey's return to Starr's grand jury for months.

reference_spacy_tokens: According to the L.A.T. , Clinton 's legal shift has the advantage of allowing him to fight on , but for far less controversial reasons , and he may still be delaying Lindsey 's return to Starr 's grand jury for months .


fn_spacy_tokens_for_baseline: She moved away , walking beside the river , but she could hear footsteps behind her in the grass , and felt love all around her , like perfume in the air .

source_bert_toks: she moved away , walking beside the river , but she could hear footsteps behind her in the grass , and felt love all around her , like perfume in the air .

reference_raw: She walked away, walking beside the stream, but she heard footsteps in the grass behind her, and felt love everywhere, like perfume in the air.

reference_spacy_tokens: She walked away , walking beside the stream , but she heard footsteps in the grass behind her , and felt love everywhere , like perfume in the air .


fn_spacy_tokens_for_baseline: His fat , red face wreathed itself in smiles and his small eyes glittered as he greeted my companion .

source_bert_toks: his fat , red face wreath ##ed itself in smiles and his small eyes glitter ##ed as he greeted my companion .

reference_raw: His fat red face was wreathed with smiles, and his tiny eyes glittered as he greeted my companion.

reference_spacy_tokens: His fat red face was wreathed with smiles , and his tiny eyes glittered as he greeted my companion .


fn_spacy_tokens_for_baseline: ' Without jousting armour , wood lances can prove deadly ; and a man can die on a jousting ground as easily as on a battlefield .

source_bert_toks: ' without jo ##ust ##ing armour , wood lance ##s can prove deadly ; and a man can die on a jo ##ust ##ing ground as easily as on a battlefield .

reference_raw: 'Without harnessing armor, wooden spears can be lethal, and a man can die on a jostling ground as easily as on a battlefield.

reference_spacy_tokens: ' Without harnessing armor , wooden spears can be lethal , and a man can die on a jostling ground as easily as on a battlefield .


fn_spacy_tokens_for_baseline: In the case of Huntington disease the loss of 15- 30 % of the normal complement of medium spiny neurons leads to distinct movement disorder in both humans and transgenic mouse models [ 14 15 16 17]. The subset of genes that normally control the proliferation , differentiation , and survival of striatal neurons [ 18 19 20 ] are therefore of considerable importance in ensuring adaptive behavior at maturity .

source_bert_toks: in the case of huntington disease the loss of 15 - 30 % of the normal complement of medium spin ##y neurons leads to distinct movement disorder in both humans and trans ##genic mouse models [ 14 15 16 17 ] . the subset of genes that normally control the proliferation , differentiation , and survival of st ##ria ##tal neurons [ 18 19 20 ] are therefore of considerable importance in ensuring adaptive behavior at maturity .

reference_raw: For Huntington's disease, the loss of 15-30% of the normal complement of medium spinal neurons leads to a distinct movement disorder in both human and transgenic mouse models [14 15 16 17]. The subset of genes that normally control the proliferation, differentiation and survival of striatal neurons [18 19 20] is therefore very important to ensure adaptive behaviour when mature.

reference_spacy_tokens: For Huntington 's disease , the loss of 15 - 30 % of the normal complement of medium spinal neurons leads to a distinct movement disorder in both human and transgenic mouse models [ 14 15 16 17]. The subset of genes that normally control the proliferation , differentiation and survival of striatal neurons [ 18 19 20 ] is therefore very important to ensure adaptive behaviour when mature .


fn_spacy_tokens_for_baseline: Under Left Wall was a gaggle of climbers zooming up the classics .

source_bert_toks: under left wall was a gag ##gle of climb ##ers zoom ##ing up the classics .

reference_raw: Beneath the left wall was a gag of climbers approaching the classics.

reference_spacy_tokens: Beneath the left wall was a gag of climbers approaching the classics .


fn_spacy_tokens_for_baseline: She was condemned to death , together with some cattle thieves and sheep stealers , but no hangman was available .

source_bert_toks: she was condemned to death , together with some cattle thieves and sheep steal ##ers , but no hang ##man was available .

reference_raw: She was sentenced to death, along with some cattle thieves and sheep thieves, but no hangman was available.

reference_spacy_tokens: She was sentenced to death , along with some cattle thieves and sheep thieves , but no hangman was available .


fn_spacy_tokens_for_baseline: And I see you even have a minion who will help you with the difficult task of unlacing your boots . '

source_bert_toks: and i see you even have a mini ##on who will help you with the difficult task of un ##la ##cing your boots . '

reference_raw: And I see you even have a minion who can help you with the difficult task of unlacing your shoes.'

reference_spacy_tokens: And I see you even have a minion who can help you with the difficult task of unlacing your shoes . '


fn_spacy_tokens_for_baseline: Slowly she began to strip off her clingtight black tunic , and so to become more visible .

source_bert_toks: slowly she began to strip off her cl ##ing ##tight black tunic , and so to become more visible .

reference_raw: Slowly she began to undress her tight black blouse, making it more visible.

reference_spacy_tokens: Slowly she began to undress her tight black blouse , making it more visible .


fn_spacy_tokens_for_baseline: There had been no mention in Ernest 's letter of Aunt Sarah .

source_bert_toks: there had been no mention in ernest ' s letter of aunt sarah .

reference_raw: There was nothing in Ernest's letter about Aunt Sarah.

reference_spacy_tokens: There was nothing in Ernest 's letter about Aunt Sarah .


fn_spacy_tokens_for_baseline: There is increasing emphasis on African musical tradition , including the making of musical instruments ( Uganda and Kenya ) and the gradual weakening of mission tradition based very largely on choral singing and religious music .

source_bert_toks: there is increasing emphasis on african musical tradition , including the making of musical instruments ( uganda and kenya ) and the gradual weakening of mission tradition based very largely on choral singing and religious music .

reference_raw: There is a growing emphasis on the African musical heritage, including the production of musical instruments (Uganda and Kenya) and the gradual weakening of the mission's heritage, which is largely based on choral singing and religious music.

reference_spacy_tokens: There is a growing emphasis on the African musical heritage , including the production of musical instruments ( Uganda and Kenya ) and the gradual weakening of the mission 's heritage , which is largely based on choral singing and religious music .


fn_spacy_tokens_for_baseline: Homosexuality aroused revulsion in about a quarter of the respondents , another quarter seeing it as sick , odd or ridiculous .

source_bert_toks: homosexuality aroused rev ##ulsion in about a quarter of the respondents , another quarter seeing it as sick , odd or ridiculous .

reference_raw: In about a quarter of the respondents, homosexuality raised resistance, and the next quarter saw it as sick, strange, or ridiculous.

reference_spacy_tokens: In about a quarter of the respondents , homosexuality raised resistance , and the next quarter saw it as sick , strange , or ridiculous .


fn_spacy_tokens_for_baseline: But clearly the Queen 's well - known frugal habits have rubbed off on staff .

source_bert_toks: but clearly the queen ' s well - known fr ##uga ##l habits have rubbed off on staff .

reference_raw: But it was clear that the Queen's well-known frivolous habits had wiped out the staff.

reference_spacy_tokens: But it was clear that the Queen 's well - known frivolous habits had wiped out the staff .


fn_spacy_tokens_for_baseline: The road he followed marked the seasonal migration of sheep from the treeless limestone plateau further inland to the watered valleys around ; it had led across this terrain since the Romans had farmed there .

source_bert_toks: the road he followed marked the seasonal migration of sheep from the tree ##less limestone plateau further inland to the watered valleys around ; it had led across this terrain since the romans had farm ##ed there .

reference_raw: The road he followed marked the seasonal migration of sheep from the treeless limestone plains farther inland to the watered valleys around them; it had flowed through the terrain since the Romans had farmed there.

reference_spacy_tokens: The road he followed marked the seasonal migration of sheep from the treeless limestone plains farther inland to the watered valleys around them ; it had flowed through the terrain since the Romans had farmed there .


fn_spacy_tokens_for_baseline: ' Then I suppose I 'll have to go up there and find out . '

source_bert_toks: ' then i suppose i ' ll have to go up there and find out . '

reference_raw: "Then I guess I'm going to have to go upstairs and find out."

reference_spacy_tokens: " Then I guess I 'm going to have to go upstairs and find out . "


fn_spacy_tokens_for_baseline: Intellectual and scientific ideas are formulated by small groups ( minorities ) of professionals .

source_bert_toks: intellectual and scientific ideas are formulated by small groups ( minorities ) of professionals .

reference_raw: Intellectual and scientific ideas are drawn up by small groups (minorities) of professionals.

reference_spacy_tokens: Intellectual and scientific ideas are drawn up by small groups ( minorities ) of professionals .


fn_spacy_tokens_for_baseline: They were sleepy .

source_bert_toks: they were sleepy .

reference_raw: They were asleep.

reference_spacy_tokens: They were asleep .


fn_spacy_tokens_for_baseline: The next moment Ronni was being led inside , into a huge tiled entrance hall with a round central table weighed down by an enormous vase of fresh flowers .

source_bert_toks: the next moment ron ##ni was being led inside , into a huge tiled entrance hall with a round central table weighed down by an enormous vase of fresh flowers .

reference_raw: The next moment they led Ronni in, into a large tiled entry hall with a circular central table burdened with a huge vase of fresh flowers.

reference_spacy_tokens: The next moment they led Ronni in , into a large tiled entry hall with a circular central table burdened with a huge vase of fresh flowers .


fn_spacy_tokens_for_baseline: ' My orders , little friar , are that you are to accompany me into Cheapside to a tavern called the Bear and Ragged Staff .

source_bert_toks: ' my orders , little friar , are that you are to accompany me into cheap ##side to a tavern called the bear and ragged staff .

reference_raw: 'My orders, little monk, are to escort me to Cheapside to a tavern called the Bear and the Ragged Staff.

reference_spacy_tokens: ' My orders , little monk , are to escort me to Cheapside to a tavern called the Bear and the Ragged Staff .


fn_spacy_tokens_for_baseline: ' Tunis , ' she replied , telling me there was space on the flight and I could remain on board .

source_bert_toks: ' tunis , ' she replied , telling me there was space on the flight and i could remain on board .

reference_raw: "Tunis," she said, saying that there was room for me to stay aboard.

reference_spacy_tokens: " Tunis , " she said , saying that there was room for me to stay aboard .


fn_spacy_tokens_for_baseline: I 'm wearing a denim waistcoat , cheesecloth shirt and baggy denim jeans , and I 'm smiling fit to burst , as I always seem to be in photographs .

source_bert_toks: i ' m wearing a denim waist ##coat , cheese ##cloth shirt and bag ##gy denim jeans , and i ' m smiling fit to burst , as i always seem to be in photographs .

reference_raw: I'm wearing a denim vest, a cheesecloth shirt, and a baggy denim pants, and I'm smiling like I always look in a picture.

reference_spacy_tokens: I 'm wearing a denim vest , a cheesecloth shirt , and a baggy denim pants , and I 'm smiling like I always look in a picture .


fn_spacy_tokens_for_baseline: Barely registering Gwen 's horrified face , she turned and whirled out , crashing the back door against the wall so hard that the echoes seemed to follow her fleeing figure .

source_bert_toks: barely registering gwen ' s horrified face , she turned and whirled out , crashing the back door against the wall so hard that the echoes seemed to follow her fleeing figure .

reference_raw: She barely noticed Gwen's frightened face, turned and whirled, knocking the rear door against the wall so hard that the echoes seemed to follow her fleeing figure.

reference_spacy_tokens: She barely noticed Gwen 's frightened face , turned and whirled , knocking the rear door against the wall so hard that the echoes seemed to follow her fleeing figure .


fn_spacy_tokens_for_baseline: You do n't want to lock your pictures away in a vault , so you make a vault of the room they 're in .

source_bert_toks: you don ' t want to lock your pictures away in a vault , so you make a vault of the room they ' re in .

reference_raw: You don't want to put your pictures in a safe, so you're gonna make a safe out of the room they're in.

reference_spacy_tokens: You do n't want to put your pictures in a safe , so you 're gon na make a safe out of the room they 're in .


fn_spacy_tokens_for_baseline: ' There was the smoke , Miss Hardbroom , ' explained Mildred in a tiny voice , suddenly feeling aware of the striped pyjama legs under her tunic .

source_bert_toks: ' there was the smoke , miss hard ##bro ##om , ' explained mildred in a tiny voice , suddenly feeling aware of the striped p ##y ##ja ##ma legs under her tunic .

reference_raw: 'There was smoke, Miss Hardbroom,' said Mildred softly, suddenly aware of the striped pajama feet beneath her tunic.

reference_spacy_tokens: ' There was smoke , Miss Hardbroom , ' said Mildred softly , suddenly aware of the striped pajama feet beneath her tunic .


fn_spacy_tokens_for_baseline: There were only two men in the room , Sir Henry and Stapleton .

source_bert_toks: there were only two men in the room , sir henry and staple ##ton .

reference_raw: Sir Henry and Stapleton were just two men in the room.

reference_spacy_tokens: Sir Henry and Stapleton were just two men in the room .


fn_spacy_tokens_for_baseline: The remains of the 17th - century Barra Fortress , which once defended the southern tip of the peninsula , contains the chapel of Santiago ( St. James ) .

source_bert_toks: the remains of the 17th - century barr ##a fortress , which once defended the southern tip of the peninsula , contains the chapel of santiago ( st . james ) .

reference_raw: The remains of the 17th-century Barra fort, which once defended the south end of the peninsula, contain the chapel of Santiago (St. James).

reference_spacy_tokens: The remains of the 17th - century Barra fort , which once defended the south end of the peninsula , contain the chapel of Santiago ( St. James ) .


fn_spacy_tokens_for_baseline: A multiplicity of small early termini was replaced in 1914 by Tokyo Central , a station so vast as to vie with Howrah in Calcutta , though other mainline termini , Ueno and Shinjuku , survived .

source_bert_toks: a multi ##plicity of small early term ##ini was replaced in 1914 by tokyo central , a station so vast as to vie with how ##rah in calcutta , though other mainline term ##ini , u ##eno and shin ##ju ##ku , survived .

reference_raw: In 1914, Tokyo Central replaced many small early terminis, a station so large that Howrah in Calcutta had survived, although other mainline terminis, Ueno and Shinjuku, had survived.

reference_spacy_tokens: In 1914 , Tokyo Central replaced many small early terminis , a station so large that Howrah in Calcutta had survived , although other mainline terminis , Ueno and Shinjuku , had survived .


fn_spacy_tokens_for_baseline: She unwrapped herself from his arms where she had been dozing for most of Sunday afternoon .

source_bert_toks: she un ##wr ##app ##ed herself from his arms where she had been do ##zing for most of sunday afternoon .

reference_raw: She got out of his arms, where she had slept most of Sunday afternoon.

reference_spacy_tokens: She got out of his arms , where she had slept most of Sunday afternoon .


fn_spacy_tokens_for_baseline: Personnel associated with Coast have characterized it as the most sophisticated program of its type outside of the former Soviet Union , but international CBW experts generally consider it to have been considerably less advanced from a scientific standpoint .

source_bert_toks: personnel associated with coast have characterized it as the most sophisticated program of its type outside of the former soviet union , but international cb ##w experts generally consider it to have been considerably less advanced from a scientific stand ##point .

reference_raw: Coast-related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union, but international CBW experts generally consider it to be significantly less advanced from a scientific point of view.

reference_spacy_tokens: Coast - related personnel have characterized it as the most sophisticated program of its kind outside the former Soviet Union , but international CBW experts generally consider it to be significantly less advanced from a scientific point of view .


fn_spacy_tokens_for_baseline: Shopkeepers bawled and yelled at him .

source_bert_toks: shop ##keepers ba ##wled and yelled at him .

reference_raw: The shopkeepers screamed and shouted at him.

reference_spacy_tokens: The shopkeepers screamed and shouted at him .


fn_spacy_tokens_for_baseline: The glasses he was wearing flew off his face ; the bottle of blood crashed against one wall ..

source_bert_toks: the glasses he was wearing flew off his face ; the bottle of blood crashed against one wall . .

reference_raw: The spectacles he wore flew from his face; a bottle of blood hit one wall . . .

reference_spacy_tokens: The spectacles he wore flew from his face ; a bottle of blood hit one wall . . .


fn_spacy_tokens_for_baseline: At 9:32 , a hijacker , probably Jarrah , made or attempted to make the following announcement to the passengers of Flight 93 : " Ladies and Gentlemen : Here the captain , please sit down keep remaining sitting .

source_bert_toks: at 9 : 32 , a hi ##jack ##er , probably jar ##rah , made or attempted to make the following announcement to the passengers of flight 93 : " ladies and gentlemen : here the captain , please sit down keep remaining sitting .

reference_raw: At 9:32 p.m., a hijacker, possibly Jarrah, made or tried to announce the following message to the passengers of Flight 93:" Ladies and gentlemen: Here, Captain, please remain seated.

reference_spacy_tokens: At 9:32 p.m. , a hijacker , possibly Jarrah , made or tried to announce the following message to the passengers of Flight 93 : " Ladies and gentlemen : Here , Captain , please remain seated .


fn_spacy_tokens_for_baseline: I mumbled back reassuring words about sun and invigorating air as I sweated in line behind him , and ignored his face and his thumb in the exhilaration of that first controllable lurch into the unknown .

source_bert_toks: i mumbled back reassuring words about sun and in ##vi ##gor ##ating air as i sweat ##ed in line behind him , and ignored his face and his thumb in the ex ##hila ##ration of that first control ##lab ##le lu ##rch into the unknown .

reference_raw: As I sweated in line behind him, I muttered soothing words about the sun and the refreshing air, ignoring his face and thumb in the exhilaration of the first controlled lurch into the unknown.

reference_spacy_tokens: As I sweated in line behind him , I muttered soothing words about the sun and the refreshing air , ignoring his face and thumb in the exhilaration of the first controlled lurch into the unknown .


fn_spacy_tokens_for_baseline: The average adult body contains about 6 litres of blood and if all the innumerable blood vessels were widely open simultaneously , there would be insufficient blood to fill them .

source_bert_toks: the average adult body contains about 6 litres of blood and if all the inn ##ume ##rable blood vessels were widely open simultaneously , there would be insufficient blood to fill them .

reference_raw: The average adult body contains approximately 6 liters of blood, and if all countless blood vessels were open at the same time, there would not be enough blood to fill them.

reference_spacy_tokens: The average adult body contains approximately 6 liters of blood , and if all countless blood vessels were open at the same time , there would not be enough blood to fill them .


fn_spacy_tokens_for_baseline: Amy and I exchanged speaking eyelids -- it was the use of the word ' accused ' .

source_bert_toks: amy and i exchanged speaking eyelids - - it was the use of the word ' accused ' .

reference_raw: Amy and I traded speaking eyelids -- that was the use of the word "accused."

reference_spacy_tokens: Amy and I traded speaking eyelids -- that was the use of the word " accused . "


fn_spacy_tokens_for_baseline: I think he hoped I might eventually add distinction to the family name , of which he was intensely proud , and his initial interest in me also developed into affection .

source_bert_toks: i think he hoped i might eventually add distinction to the family name , of which he was intensely proud , and his initial interest in me also developed into affection .

reference_raw: I think he was hoping that I could finally make a difference to his family name, which he was very proud of, and that his first concern for me had also developed into love.

reference_spacy_tokens: I think he was hoping that I could finally make a difference to his family name , which he was very proud of , and that his first concern for me had also developed into love .


fn_spacy_tokens_for_baseline: The engines whined softly as beautiful Oriental stewardesses showed them to their seats in First Class and offered them complimentary champagne , which they both refused .

source_bert_toks: the engines w ##hine ##d softly as beautiful oriental steward ##esses showed them to their seats in first class and offered them compliment ##ary champagne , which they both refused .

reference_raw: The engines howled softly as the beautiful Oriental flight attendants showed them to their first-class seats and offered them free champagne, which they both refused.

reference_spacy_tokens: The engines howled softly as the beautiful Oriental flight attendants showed them to their first - class seats and offered them free champagne , which they both refused .


fn_spacy_tokens_for_baseline: My opponent ( of course it was the Great Killer ) emptied his purse on the table , so did I , and the game began .

source_bert_toks: my opponent ( of course it was the great killer ) emptied his purse on the table , so did i , and the game began .

reference_raw: My opponent (of course he was the Great Killer) emptied his wallet on the table, and so did I, and the game began.

reference_spacy_tokens: My opponent ( of course he was the Great Killer ) emptied his wallet on the table , and so did I , and the game began .


fn_spacy_tokens_for_baseline: The track crosses the bridge over the Sillees River and then the scenic forest drive to follow a well marked way to Melly 's Rock .

source_bert_toks: the track crosses the bridge over the si ##lle ##es river and then the scenic forest drive to follow a well marked way to mel ##ly ' s rock .

reference_raw: The track passes a bridge across the Sillees River, then a scenic forest drive, following a well-marked path to Melly's Rock.

reference_spacy_tokens: The track passes a bridge across the Sillees River , then a scenic forest drive , following a well - marked path to Melly 's Rock .