fn_spacy_tokens_for_baseline: They now spontaneously assemble into rods which press against the membrane of the red blood cell deforming it from a rounded into a sickle shape .

source_bert_toks: they now spontaneously assemble into rods which press against the membrane of the red blood cell def ##or ##ming it from a rounded into a sick ##le shape .

reference_raw: Now, spontaneously, they gather into rods that press against the membrane of the red blood cell that distorts it from the rounded shape of a sickle.

reference_spacy_tokens: Now , spontaneously , they gather into rods that press against the membrane of the red blood cell that distorts it from the rounded shape of a sickle .


fn_spacy_tokens_for_baseline: This heralds a debate on the general policy and nature of the Bill .

source_bert_toks: this herald ##s a debate on the general policy and nature of the bill .

reference_raw: This will discuss the general policy and nature of the Bill.

reference_spacy_tokens: This will discuss the general policy and nature of the Bill .


fn_spacy_tokens_for_baseline: Two bronze lions , carrying out feng shui principles , guard its doors .

source_bert_toks: two bronze lions , carrying out feng shu ##i principles , guard its doors .

reference_raw: The door is guarded by two bronze lions who follow the principles of feng shui.

reference_spacy_tokens: The door is guarded by two bronze lions who follow the principles of feng shui .


fn_spacy_tokens_for_baseline: The problem was that none of the pilots were really confident of their navigation , the sand storm having obliterated the landmarks they were relying on .

source_bert_toks: the problem was that none of the pilots were really confident of their navigation , the sand storm having ob ##lite ##rated the landmarks they were relying on .

reference_raw: The problem was that none of the pilots really believed in their navigation, and the sandstorm wiped out the landmarks they depended on.

reference_spacy_tokens: The problem was that none of the pilots really believed in their navigation , and the sandstorm wiped out the landmarks they depended on .


fn_spacy_tokens_for_baseline: A popular optional excursion is an hour 's detour to Guangzhou Zoo , founded in 1958 .

source_bert_toks: a popular optional excursion is an hour ' s det ##our to guangzhou zoo , founded in 1958 .

reference_raw: The favorite optional trip is an hour's detour to the Guangzhou Zoo, which was founded in 1958.

reference_spacy_tokens: The favorite optional trip is an hour 's detour to the Guangzhou Zoo , which was founded in 1958 .


fn_spacy_tokens_for_baseline: Over many years I have ascended the steep final slopes to the broad top often .

source_bert_toks: over many years i have ascended the steep final slopes to the broad top often .

reference_raw: For many years, I have often climbed the steep last slopes to the wide peak.

reference_spacy_tokens: For many years , I have often climbed the steep last slopes to the wide peak .


fn_spacy_tokens_for_baseline: She had dabbed powder over her lipstick to rob it of its bright crimson lustre , and she had forgotten the little pink patches of rouge that gave her cheeks their rosy healthy glow .

source_bert_toks: she had da ##bbed powder over her lipstick to rob it of its bright crimson lust ##re , and she had forgotten the little pink patches of rouge that gave her cheeks their rosy healthy glow .

reference_raw: She smeared dust on her lipstick to rob it of its bright crimson lustre, and she forgot the pink spots of rouge that gave her cheeks their pink, healthy glow.

reference_spacy_tokens: She smeared dust on her lipstick to rob it of its bright crimson lustre , and she forgot the pink spots of rouge that gave her cheeks their pink , healthy glow .


fn_spacy_tokens_for_baseline: ' I never knew you could run so fast !

source_bert_toks: ' i never knew you could run so fast !

reference_raw: 'I didn't know you were that fast!

reference_spacy_tokens: ' I did n't know you were that fast !


fn_spacy_tokens_for_baseline: At first the mobbers showed the typical agitated response but then , when the stuffed bird failed to retaliate , they dashed in for violent physical assaults on its body .

source_bert_toks: at first the mob ##bers showed the typical agitated response but then , when the stuffed bird failed to re ##tal ##iate , they dashed in for violent physical assaults on its body .

reference_raw: At first the mafia showed a typical agitated reaction, but then, when the loaded bird failed to retaliate, they rushed in for a violent physical attack on his body.

reference_spacy_tokens: At first the mafia showed a typical agitated reaction , but then , when the loaded bird failed to retaliate , they rushed in for a violent physical attack on his body .


fn_spacy_tokens_for_baseline: In amiable mood one day Leonard remarked of his friend , ' I taught him how to dress ; he taught me how to live forever . '

source_bert_toks: in ami ##able mood one day leonard remarked of his friend , ' i taught him how to dress ; he taught me how to live forever . '

reference_raw: One day, in a friendly mood, Leonard said to his friend, "I taught him how to dress; he taught me how to live forever."

reference_spacy_tokens: One day , in a friendly mood , Leonard said to his friend , " I taught him how to dress ; he taught me how to live forever . "


fn_spacy_tokens_for_baseline: I was satisfied that the Luciferi had killed her and I was determined , in my own cowardly way , to exact revenge once I was in France .

source_bert_toks: i was satisfied that the lucifer ##i had killed her and i was determined , in my own coward ##ly way , to exact revenge once i was in france .

reference_raw: I was convinced that Luciferi had killed her, and I was determined, in a cowardly way, to avenge myself when I was in France.

reference_spacy_tokens: I was convinced that Luciferi had killed her , and I was determined , in a cowardly way , to avenge myself when I was in France .


fn_spacy_tokens_for_baseline: Who were your friends , and why did they so foolishly raid an SS building ? '

source_bert_toks: who were your friends , and why did they so foolish ##ly raid an ss building ? '

reference_raw: Who were your friends, and why had they so foolishly invaded the SS building?'

reference_spacy_tokens: Who were your friends , and why had they so foolishly invaded the SS building ? '


fn_spacy_tokens_for_baseline: In May 1998 , the London Daily Telegraph reported that " Iran has concluded a secret deal with China to purchase banned chemicals that will enable it to become self - sufficient in producing large stockpiles of advanced nerve gas . "

source_bert_toks: in may 1998 , the london daily telegraph reported that " iran has concluded a secret deal with china to purchase banned chemicals that will enable it to become self - sufficient in producing large stock ##pile ##s of advanced nerve gas . "

reference_raw: In May 1998, the London Daily Telegraph announced that "Iran had entered into a secret agreement with China on the purchase of banned chemicals that would make it self-sufficient to produce large supplies of advanced nerve gas."

reference_spacy_tokens: In May 1998 , the London Daily Telegraph announced that " Iran had entered into a secret agreement with China on the purchase of banned chemicals that would make it self - sufficient to produce large supplies of advanced nerve gas . "


fn_spacy_tokens_for_baseline: You would n't make a special cake as a present with long out - of - date flour and stale eggs so do n't think that any old ingredients will do for making a pressed flower picture .

source_bert_toks: you wouldn ' t make a special cake as a present with long out - of - date flour and stale eggs so don ' t think that any old ingredients will do for making a pressed flower picture .

reference_raw: You wouldn't do a special cake as a gift with long-term flour and stale eggs, so don't think any of the old ingredients would do for a pressed flower picture.

reference_spacy_tokens: You would n't do a special cake as a gift with long - term flour and stale eggs , so do n't think any of the old ingredients would do for a pressed flower picture .


fn_spacy_tokens_for_baseline: For economy in building costs , these three types of farm buildings were sometimes combined into a single building .

source_bert_toks: for economy in building costs , these three types of farm buildings were sometimes combined into a single building .

reference_raw: In the case of the economy in building costs, the three types of agricultural buildings were sometimes merged into one building.

reference_spacy_tokens: In the case of the economy in building costs , the three types of agricultural buildings were sometimes merged into one building .


fn_spacy_tokens_for_baseline: Still , they can all be altered to suit , and when somebody asks where you got that dodgy or otherwise guitar sound you can say

source_bert_toks: still , they can all be altered to suit , and when somebody asks where you got that dod ##gy or otherwise guitar sound you can say

reference_raw: But you can change them all to suit, and if someone asks where you got that dodgy or other guitar sound, you can say,

reference_spacy_tokens: But you can change them all to suit , and if someone asks where you got that dodgy or other guitar sound , you can say ,


fn_spacy_tokens_for_baseline: Just as he was getting his pyjamas on , a piece of paper was pushed under his door .

source_bert_toks: just as he was getting his p ##y ##ja ##mas on , a piece of paper was pushed under his door .

reference_raw: Just as he was wearing his pajamas, a piece of paper was pushed under the door.

reference_spacy_tokens: Just as he was wearing his pajamas , a piece of paper was pushed under the door .


fn_spacy_tokens_for_baseline: ' And I thought Ryan was a rat , ' she gasped raggedly .

source_bert_toks: ' and i thought ryan was a rat , ' she gasped ragged ##ly .

reference_raw: "I thought Ryan was a rat," she said.

reference_spacy_tokens: " I thought Ryan was a rat , " she said .


fn_spacy_tokens_for_baseline: Then : ' I know from personal experience how difficult it is to write a book .

source_bert_toks: then : ' i know from personal experience how difficult it is to write a book .

reference_raw: Then: 'I can tell from my personal experience how hard it is to write a book.

reference_spacy_tokens: Then : ' I can tell from my personal experience how hard it is to write a book .


fn_spacy_tokens_for_baseline: In 1924 she published a short memoir of her husband .

source_bert_toks: in 1924 she published a short memoir of her husband .

reference_raw: She published a brief memory of her husband in 1924.

reference_spacy_tokens: She published a brief memory of her husband in 1924 .


fn_spacy_tokens_for_baseline: They were accordingly satisfied that the trial judge misdirected the jury when he stated that the case against the first appellant depended solely upon what they could find proved that he himself did .

source_bert_toks: they were accordingly satisfied that the trial judge mis ##di ##re ##cted the jury when he stated that the case against the first app ##ellant depended solely upon what they could find proved that he himself did .

reference_raw: They were therefore convinced that the judge had misdirected the jury by stating that the case against the first appellant was based solely on what they could find to prove that he had done so himself.

reference_spacy_tokens: They were therefore convinced that the judge had misdirected the jury by stating that the case against the first appellant was based solely on what they could find to prove that he had done so himself .


fn_spacy_tokens_for_baseline: Shaikh Hamad 's observation that borders within the Arab world should remain as they were at independence was , however , interpreted as an indication of Bahrain 's continued claim to the islands .

source_bert_toks: sha ##ikh ham ##ad ' s observation that borders within the arab world should remain as they were at independence was , however , interpreted as an indication of bahrain ' s continued claim to the islands .

reference_raw: But Shaikh Hamad's observation that the borders of the Arab world should remain as independent was interpreted as a sign of Bahrain's continued entitlement to the islands.

reference_spacy_tokens: But Shaikh Hamad 's observation that the borders of the Arab world should remain as independent was interpreted as a sign of Bahrain 's continued entitlement to the islands .


fn_spacy_tokens_for_baseline: They con people with their music by getting across a romantic side of themselves when really there 's none there .

source_bert_toks: they con people with their music by getting across a romantic side of themselves when really there ' s none there .

reference_raw: They trick people with their music by crossing the romantic side of themselves when there really isn't one.

reference_spacy_tokens: They trick people with their music by crossing the romantic side of themselves when there really is n't one .


fn_spacy_tokens_for_baseline: Chen is linked to Nocinco ( the North Chemical Industries Corp. ) , a company that was identified by the CIA as " having delivered several hundred tons of carbon disulfide , an ingredient in nerve agents . "

source_bert_toks: chen is linked to no ##cin ##co ( the north chemical industries corp . ) , a company that was identified by the cia as " having delivered several hundred tons of carbon di ##sul ##fide , an ingredient in nerve agents . "

reference_raw: Chen is linked to Nocinco (North Chemical Industries Corp.), a company that the CIA has identified as "has delivered several hundred tons of carbon disulfide, a component of nerve agents."

reference_spacy_tokens: Chen is linked to Nocinco ( North Chemical Industries Corp. ) , a company that the CIA has identified as " has delivered several hundred tons of carbon disulfide , a component of nerve agents . "


fn_spacy_tokens_for_baseline: Each part must be individually dried off and sprayed with oil to prevent corrosion and then put back in place .

source_bert_toks: each part must be individually dried off and sprayed with oil to prevent corrosion and then put back in place .

reference_raw: In order to avoid corrosion, each portion must be individually dehydrated and sprayed with oil and then replaced.

reference_spacy_tokens: In order to avoid corrosion , each portion must be individually dehydrated and sprayed with oil and then replaced .


fn_spacy_tokens_for_baseline: Such flouting of values , such wanton disregard for respectable priority , had often been remarked upon ; Mrs Maugham was wo nt to enlarge upon the theme by describing situations in which a suddenly - paralysed Mrs Hanney , unable to reach a phone to ring for a doctor , would expire before the inane cacklings of her own television set .

source_bert_toks: such fl ##out ##ing of values , such want ##on disregard for respectable priority , had often been remarked upon ; mrs ma ##ugh ##am was won ##t to en ##lar ##ge upon the theme by describing situations in which a suddenly - para ##ly ##sed mrs han ##ney , unable to reach a phone to ring for a doctor , would ex ##pire before the ina ##ne ca ##ck ##lings of her own television set .

reference_raw: Such a flurry of values, such a desired disregard for respectable priorities, was often noted; Mrs. Maugham would not expand on the subject by describing situations in which the suddenly paralysed Mrs. Hanney, unable to reach the telephone and call the doctor, would end before the inane cackling of her own TV.

reference_spacy_tokens: Such a flurry of values , such a desired disregard for respectable priorities , was often noted ; Mrs. Maugham would not expand on the subject by describing situations in which the suddenly paralysed Mrs. Hanney , unable to reach the telephone and call the doctor , would end before the inane cackling of her own TV .


fn_spacy_tokens_for_baseline: Ireland has plenty of scorn for its leaders , but where is the love ?

source_bert_toks: ireland has plenty of sc ##orn for its leaders , but where is the love ?

reference_raw: Ireland has a lot of contempt for its leaders, but where's love?

reference_spacy_tokens: Ireland has a lot of contempt for its leaders , but where 's love ?


fn_spacy_tokens_for_baseline: She was in her nightdress , bare legs and large slippers .

source_bert_toks: she was in her night ##dre ##ss , bare legs and large slip ##pers .

reference_raw: She was dressed in a nightgown, bare feet and big slippers.

reference_spacy_tokens: She was dressed in a nightgown , bare feet and big slippers .


fn_spacy_tokens_for_baseline: He thought that was a pity , because Auntie Vi ran the sweet shop down the road and used to let him lick his finger and dip it in the sherbet jar .

source_bert_toks: he thought that was a pity , because aunt ##ie vi ran the sweet shop down the road and used to let him lick his finger and dip it in the she ##rb ##et jar .

reference_raw: It was a shame, he thought, because Auntie Vi was running a candy shop down the street, letting him lick his finger and soak it in a jar of sherbets.

reference_spacy_tokens: It was a shame , he thought , because Auntie Vi was running a candy shop down the street , letting him lick his finger and soak it in a jar of sherbets .


fn_spacy_tokens_for_baseline: I 'm sorry , ' Robbie ventured after a surreptitious glance at Fen 's set profile .

source_bert_toks: i ' m sorry , ' robbie ventured after a sur ##re ##pt ##iti ##ous glance at fen ' s set profile .

reference_raw: I'm sorry," Robbie ventured after a sneaky look at Fen's profile.

reference_spacy_tokens: I 'm sorry , " Robbie ventured after a sneaky look at Fen 's profile .


fn_spacy_tokens_for_baseline: The earliest finding is the platelet adhesion to collagen fibres followed by aggregation and formation of a platelet plug .

source_bert_toks: the earliest finding is the plate ##let ad ##hesion to col ##lage ##n fibre ##s followed by aggregation and formation of a plate ##let plug .

reference_raw: The first finding is platelet glue to collagen fibres, followed by aggregation and formation of a platelet plug.

reference_spacy_tokens: The first finding is platelet glue to collagen fibres , followed by aggregation and formation of a platelet plug .


fn_spacy_tokens_for_baseline: She entered the lift and impatiently pressed the button for the lower ground .

source_bert_toks: she entered the lift and impatiently pressed the button for the lower ground .

reference_raw: She stepped into the elevator and pressed the bottom button impatiently.

reference_spacy_tokens: She stepped into the elevator and pressed the bottom button impatiently .


fn_spacy_tokens_for_baseline: Of course Jamaica has its palm - lined beaches and almost endless rum drinks , and you can enjoy a wonderful resort - based break .

source_bert_toks: of course jamaica has its palm - lined beaches and almost endless rum drinks , and you can enjoy a wonderful resort - based break .

reference_raw: Of course, Jamaica's got a hand-lined beaches and almost endless rum beverages, and you can enjoy a wonderful resort-based break.

reference_spacy_tokens: Of course , Jamaica 's got a hand - lined beaches and almost endless rum beverages , and you can enjoy a wonderful resort - based break .


fn_spacy_tokens_for_baseline: He also said that his visit will mainly focus on the humanitarian situation of Iraq , which has been under crippling U.N. sanctions since its 1990 invasion of Kuwait , the primacord of the 1991 Gulf War .

source_bert_toks: he also said that his visit will mainly focus on the humanitarian situation of iraq , which has been under cr ##ip ##pling u . n . sanctions since its 1990 invasion of kuwait , the prima ##cor ##d of the 1991 gulf war .

reference_raw: He also said that his visit would focus mainly on the humanitarian situation in Iraq, which has been crippled by UN penalties since the 1990 invasion of Kuwait, the primary of the Gulf War of 1991.

reference_spacy_tokens: He also said that his visit would focus mainly on the humanitarian situation in Iraq , which has been crippled by UN penalties since the 1990 invasion of Kuwait , the primary of the Gulf War of 1991 .


fn_spacy_tokens_for_baseline: The eight - mile round trip has only been bettered once before when the loco ran 15 miles for railway celebrations in Sacramento .

source_bert_toks: the eight - mile round trip has only been better ##ed once before when the loco ran 15 miles for railway celebrations in sacramento .

reference_raw: The eight-mile round trip had been improved only once since the loco had run 15 miles for the Sacramento railway festival.

reference_spacy_tokens: The eight - mile round trip had been improved only once since the loco had run 15 miles for the Sacramento railway festival .


fn_spacy_tokens_for_baseline: When = 20 % , the naive method has slightly better power when bias is absent .

source_bert_toks: when = 20 % , the naive method has slightly better power when bias is absent .

reference_raw: If = 20%, the naive method has a slightly better strength in the absence of prejudice.

reference_spacy_tokens: If = 20 % , the naive method has a slightly better strength in the absence of prejudice .


fn_spacy_tokens_for_baseline: ' That 's very impertinent of you .

source_bert_toks: ' that ' s very imp ##ert ##inen ##t of you .

reference_raw: 'That's very rude of you.

reference_spacy_tokens: ' That 's very rude of you .


fn_spacy_tokens_for_baseline: When she ventured into the kitchen to pour herself an orange juice , wincing as she used the arm she wanted Liz to think was injured , her movements sounded clumsy , intrusive , far too loud .

source_bert_toks: when she ventured into the kitchen to pour herself an orange juice , win ##cing as she used the arm she wanted liz to think was injured , her movements sounded clumsy , int ##rus ##ive , far too loud .

reference_raw: When she went into the kitchen to pour her orange juice, wincing as she used the hand she wanted Liz to think she was hurt, her movements were awkward, intrusive, too loud.

reference_spacy_tokens: When she went into the kitchen to pour her orange juice , wincing as she used the hand she wanted Liz to think she was hurt , her movements were awkward , intrusive , too loud .


fn_spacy_tokens_for_baseline: It enabled Ashi to run a very pleasant Knightsbridge apartment , to pay for Sousan 's education , and was sufficient for her not to have to work .

source_bert_toks: it enabled ash ##i to run a very pleasant knights ##bridge apartment , to pay for sousa ##n ' s education , and was sufficient for her not to have to work .

reference_raw: It allowed Ashi to run a very pleasant Knightsbridge flat, to pay for Sousan's education, and it was enough that she didn't have to work.

reference_spacy_tokens: It allowed Ashi to run a very pleasant Knightsbridge flat , to pay for Sousan 's education , and it was enough that she did n't have to work .


fn_spacy_tokens_for_baseline: Russia , however , has expressed its intention to complete the deal .

source_bert_toks: russia , however , has expressed its intention to complete the deal .

reference_raw: But Russia has made it clear that it intends to complete the agreement.

reference_spacy_tokens: But Russia has made it clear that it intends to complete the agreement .


fn_spacy_tokens_for_baseline: The hull was made of overlapping wrought - iron plates riveted to metal frames .

source_bert_toks: the hull was made of overlapping wrought - iron plates ri ##vet ##ed to metal frames .

reference_raw: The hull was made of overlapping wrought iron plates rived into metal frames.

reference_spacy_tokens: The hull was made of overlapping wrought iron plates rived into metal frames .


fn_spacy_tokens_for_baseline: ' The weapon ? ' the Doctor queried absently .

source_bert_toks: ' the weapon ? ' the doctor que ##ried absently .

reference_raw: "A weapon?" the doctor asked absently.

reference_spacy_tokens: " A weapon ? " the doctor asked absently .


fn_spacy_tokens_for_baseline: He matured into a distinguished mathematician who enriched many branches of the science before he died at the age of only 44 from a ruptured appendix .

source_bert_toks: he mature ##d into a distinguished mathematician who enriched many branches of the science before he died at the age of only 44 from a ru ##pt ##ured appendix .

reference_raw: He had grown up to be a great mathematician who had enriched many branches of science before he died when he was only 44 years old from a ruptured appendix.

reference_spacy_tokens: He had grown up to be a great mathematician who had enriched many branches of science before he died when he was only 44 years old from a ruptured appendix .


fn_spacy_tokens_for_baseline: TELEVISION celebrity Keith Chegwin mustered all his courage yesterday and told the world : ' I 'm an alcoholic ' .

source_bert_toks: television celebrity keith che ##g ##win mustered all his courage yesterday and told the world : ' i ' m an alcoholic ' .

reference_raw: The celebrity Keith Chegwin mustered all his courage last night and said to the world, "I'm a drunk."

reference_spacy_tokens: The celebrity Keith Chegwin mustered all his courage last night and said to the world , " I 'm a drunk . "


fn_spacy_tokens_for_baseline: And , despite Akbar Etemad 's beliefs , the Western intelligence community had long suspected that the Shah 's nuclear scientists conducted research into military applications .

source_bert_toks: and , despite akbar et ##ema ##d ' s beliefs , the western intelligence community had long suspected that the shah ' s nuclear scientists conducted research into military applications .

reference_raw: And despite the beliefs of Akbar Etemad, the Western intelligence community had long suspected that the Shah's nuclear scientists were researching military applications.

reference_spacy_tokens: And despite the beliefs of Akbar Etemad , the Western intelligence community had long suspected that the Shah 's nuclear scientists were researching military applications .


fn_spacy_tokens_for_baseline: Police were called but arrived too late to stop him mugging 60-year - old Rose McDevitt , who was knocked to the floor and robbed of her handbag as she waited for the lift .

source_bert_toks: police were called but arrived too late to stop him mug ##ging 60 - year - old rose mc ##dev ##itt , who was knocked to the floor and robbed of her hand ##bag as she waited for the lift .

reference_raw: The police were called, but they arrived too late to stop him from attacking 60-year-old Rose McDevitt, who had been knocked to the floor and stripped of her purse while waiting for the elevator.

reference_spacy_tokens: The police were called , but they arrived too late to stop him from attacking 60-year - old Rose McDevitt , who had been knocked to the floor and stripped of her purse while waiting for the elevator .


fn_spacy_tokens_for_baseline: They sprayed weedkiller on pensioner Martha Welsh 's prized lawn to ruin her chances .

source_bert_toks: they sprayed weed ##kill ##er on pension ##er martha welsh ' s prized lawn to ruin her chances .

reference_raw: They sprinkled weed killers on pensioner Martha Welsh's prized lawn to destroy her chances.

reference_spacy_tokens: They sprinkled weed killers on pensioner Martha Welsh 's prized lawn to destroy her chances .


fn_spacy_tokens_for_baseline: ' I shall be demanding that we have a full explanation from Department of Trade and Industry officials when they appear before the public accounts committee to be cross - examined on this report on December 4 . '

source_bert_toks: ' i shall be demanding that we have a full explanation from department of trade and industry officials when they appear before the public accounts committee to be cross - examined on this report on december 4 . '

reference_raw: "I'm going to ask the Department of Commerce and Industry to give a full account when they appear before the Public Accounts Committee for a cross-examination of this report on December 4th."

reference_spacy_tokens: " I 'm going to ask the Department of Commerce and Industry to give a full account when they appear before the Public Accounts Committee for a cross - examination of this report on December 4th . "


fn_spacy_tokens_for_baseline: Applicants must have a minimum deposit of 10 pc .

source_bert_toks: applicants must have a minimum deposit of 10 pc .

reference_raw: Applicants must have at least 10 percentage points of deposit.

reference_spacy_tokens: Applicants must have at least 10 percentage points of deposit .


fn_spacy_tokens_for_baseline: It was like a disagreeable dream and she was n't going to have anything more to do with it .

source_bert_toks: it was like a disagree ##able dream and she wasn ' t going to have anything more to do with it .

reference_raw: It was like a bad dream, and she had nothing to do with it.

reference_spacy_tokens: It was like a bad dream , and she had nothing to do with it .


fn_spacy_tokens_for_baseline: He did not want that home destroyed .

source_bert_toks: he did not want that home destroyed .

reference_raw: He didn't want to destroy the house.

reference_spacy_tokens: He did n't want to destroy the house .


fn_spacy_tokens_for_baseline: Dionisio , rubusto in his piel de canela , rubbed his penis against him , kissing deep as he could , and S masturbated himself to orgasm , feeling embarrassed at how long it took and how his descending balls were thrown around by the rapid and almost - painful flying grip .

source_bert_toks: dion ##isi ##o , rub ##ust ##o in his pie ##l de cane ##la , rubbed his penis against him , kissing deep as he could , and s mast ##ur ##bate ##d himself to orgasm , feeling embarrassed at how long it took and how his descending balls were thrown around by the rapid and almost - painful flying grip .

reference_raw: Dionisio, rubusto in his piel de canela, rubbed his penis against him, kissed deeply, and S masturbated to orgasm, feeling ashamed of how long it had taken, and how his descending balls had been thrown in a fast, almost painful grip.

reference_spacy_tokens: Dionisio , rubusto in his piel de canela , rubbed his penis against him , kissed deeply , and S masturbated to orgasm , feeling ashamed of how long it had taken , and how his descending balls had been thrown in a fast , almost painful grip .


fn_spacy_tokens_for_baseline: As he crumples I grab hold of his hair .

source_bert_toks: as he cr ##ump ##les i grab hold of his hair .

reference_raw: I grab his hair while he crumples.

reference_spacy_tokens: I grab his hair while he crumples .


fn_spacy_tokens_for_baseline: The interesting Edwardian building was formerly the Pathological Institute , founded to combat the 19th century 's 30 - year - long outbreak of bubonic plague .

source_bert_toks: the interesting edward ##ian building was formerly the path ##ological institute , founded to combat the 19th century ' s 30 - year - long outbreak of bu ##bon ##ic plague .

reference_raw: The interesting Edwardian building was once a pathology institute set up to fight the 30th century - a long outbreak of bubonic plague.

reference_spacy_tokens: The interesting Edwardian building was once a pathology institute set up to fight the 30th century - a long outbreak of bubonic plague .


fn_spacy_tokens_for_baseline: I took a few generous swigs from one of the bottles .

source_bert_toks: i took a few generous sw ##ig ##s from one of the bottles .

reference_raw: I took a couple of big swigs out of a bottle.

reference_spacy_tokens: I took a couple of big swigs out of a bottle .


fn_spacy_tokens_for_baseline: ' Mere brainless chatter ! '

source_bert_toks: ' mere brain ##less chatter ! '

reference_raw: "It's just brain-less chatter!"

reference_spacy_tokens: " It 's just brain - less chatter ! "


fn_spacy_tokens_for_baseline: Mac - on - RISC house Quorum Software Systems Inc , Menlo Park , California , last week filed a suit against Apple Computer Inc seeking to counter allegations of patent and copyright infringement made by Apple .

source_bert_toks: mac - on - ri ##sc house quo ##rum software systems inc , men ##lo park , california , last week filed a suit against apple computer inc seeking to counter allegations of patent and copyright infringement made by apple .

reference_raw: Mac-on-RISC House Quorum Software Systems Inc., Menlo Park, California, filed a suit last week against Apple Computer Inc., seeking to counter the allegations of patent and copyright violations by Apple.

reference_spacy_tokens: Mac - on - RISC House Quorum Software Systems Inc. , Menlo Park , California , filed a suit last week against Apple Computer Inc. , seeking to counter the allegations of patent and copyright violations by Apple .


fn_spacy_tokens_for_baseline: The second method uses a smaller sheet of paper or a large label which is then gummed to the back of the photograph .

source_bert_toks: the second method uses a smaller sheet of paper or a large label which is then gum ##med to the back of the photograph .

reference_raw: The second method uses a smaller sheet of paper or a large label, which is then glued to the back of the photograph.

reference_spacy_tokens: The second method uses a smaller sheet of paper or a large label , which is then glued to the back of the photograph .


fn_spacy_tokens_for_baseline: Before getting up , pause for a moment or two to work out a less stressful way of rising to your feet .

source_bert_toks: before getting up , pause for a moment or two to work out a less stress ##ful way of rising to your feet .

reference_raw: Before you get up, pause for a moment or two to figure out a less painful way to get up.

reference_spacy_tokens: Before you get up , pause for a moment or two to figure out a less painful way to get up .


fn_spacy_tokens_for_baseline: We stood staring across the icy water at the mist - shrouded island .

source_bert_toks: we stood staring across the icy water at the mist - sh ##roud ##ed island .

reference_raw: We stood looking across the icy water at a misty island.

reference_spacy_tokens: We stood looking across the icy water at a misty island .


fn_spacy_tokens_for_baseline: The latter months of 1955 , found Williams lecturing around the island on an almost nightly basis .

source_bert_toks: the latter months of 1955 , found williams le ##cturing around the island on an almost nightly basis .

reference_raw: In the last months of 1955, Williams found himself lecturing around the island almost at night.

reference_spacy_tokens: In the last months of 1955 , Williams found himself lecturing around the island almost at night .


fn_spacy_tokens_for_baseline: It was to be built at the Nuclear Medicine Centre in Damascus .

source_bert_toks: it was to be built at the nuclear medicine centre in damascus .

reference_raw: It was supposed to be built at the Damascus Nuclear Medical Center.

reference_spacy_tokens: It was supposed to be built at the Damascus Nuclear Medical Center .


fn_spacy_tokens_for_baseline: We threw out all the guns and ammo , all the armour - plating , the oxygen bottles , the heater . '

source_bert_toks: we threw out all the guns and am ##mo , all the armour - pl ##ating , the oxygen bottles , the heat ##er . '

reference_raw: We've thrown out all the weapons and ammunition, all the armor plates, the oxygen bottles, the heater.'

reference_spacy_tokens: We 've thrown out all the weapons and ammunition , all the armor plates , the oxygen bottles , the heater . '


fn_spacy_tokens_for_baseline: It was late in the afternoon , almost evening by now , and the restaurants were beginning to fill up as people emerged from their siestas and began to promenade the streets .

source_bert_toks: it was late in the afternoon , almost evening by now , and the restaurants were beginning to fill up as people emerged from their si ##est ##as and began to promenade the streets .

reference_raw: It was late afternoon, almost evening, and the restaurants began to fill up when people emerged from their siestas and began to walk the streets.

reference_spacy_tokens: It was late afternoon , almost evening , and the restaurants began to fill up when people emerged from their siestas and began to walk the streets .


fn_spacy_tokens_for_baseline: If there 's an unnerving calm , relax into it .

source_bert_toks: if there ' s an un ##ner ##ving calm , relax into it .

reference_raw: If you're nervous about it, calm down.

reference_spacy_tokens: If you 're nervous about it , calm down .


fn_spacy_tokens_for_baseline: Luke strode furiously up the track towards the Westport road .

source_bert_toks: luke strode furiously up the track towards the west ##port road .

reference_raw: Luke walked frantically up the trail to the Westport Road.

reference_spacy_tokens: Luke walked frantically up the trail to the Westport Road .


fn_spacy_tokens_for_baseline: The committee also agreed to press for changes to the rule which limits the level of right - to - buy discounts in the case of newly built houses or those recently modernised .

source_bert_toks: the committee also agreed to press for changes to the rule which limits the level of right - to - buy discount ##s in the case of newly built houses or those recently modern ##ised .

reference_raw: The Committee also agreed to insist on amendments to the rule limiting the level of right-to-buy discounts for newly built buildings or recently upgraded buildings.

reference_spacy_tokens: The Committee also agreed to insist on amendments to the rule limiting the level of right - to - buy discounts for newly built buildings or recently upgraded buildings .


fn_spacy_tokens_for_baseline: P.S. I am Gabby 's biggest fan so I consider myself neutral on the Graf / Seles controversy .

source_bert_toks: p . s . i am gabby ' s biggest fan so i consider myself neutral on the graf / se ##les controversy .

reference_raw: P.S. I'm Gabby's biggest fan, so I think I'm neutral in a dispute between Graf and Seles.

reference_spacy_tokens: P.S. I 'm Gabby 's biggest fan , so I think I 'm neutral in a dispute between Graf and Seles .


fn_spacy_tokens_for_baseline: At Goodwill , it is the hard work of staff and those who benefit from our services that produces the kind of inspiring results I see every day : A Goodwill staff member addresses a group of welfare recipients : " You can earn the money to support yourself and your family , " she says .

source_bert_toks: at goodwill , it is the hard work of staff and those who benefit from our services that produces the kind of inspiring results i see every day : a goodwill staff member addresses a group of welfare recipients : " you can earn the money to support yourself and your family , " she says .

reference_raw: In Goodwill, it is the hard work of the employees and those who benefit from our services that produce the same inspirational outcomes that I see every day: a Goodwill employee addresses a group of social recipients: "You can make money to support yourself and your family," he says.

reference_spacy_tokens: In Goodwill , it is the hard work of the employees and those who benefit from our services that produce the same inspirational outcomes that I see every day : a Goodwill employee addresses a group of social recipients : " You can make money to support yourself and your family , " he says .


fn_spacy_tokens_for_baseline: ' You 're ugly , even when you 're not red you 're ugly .

source_bert_toks: ' you ' re ugly , even when you ' re not red you ' re ugly .

reference_raw: 'You're a bad guy, even if you're not red, you're a bad guy.

reference_spacy_tokens: ' You 're a bad guy , even if you 're not red , you 're a bad guy .


fn_spacy_tokens_for_baseline: Both were presumably tenants as Charles Ballinger still owned the mill up to the 1850s .

source_bert_toks: both were presumably tenants as charles ball ##inger still owned the mill up to the 1850s .

reference_raw: They were probably tenants, since Charles Ballinger still owned the windmill until the 1850s.

reference_spacy_tokens: They were probably tenants , since Charles Ballinger still owned the windmill until the 1850s .


fn_spacy_tokens_for_baseline: I stood up , waited until he noticed me , took one last look round , then waved my hands high over my head and threw myself flat .

source_bert_toks: i stood up , waited until he noticed me , took one last look round , then waved my hands high over my head and threw myself flat .

reference_raw: I got to my feet, waited for him to notice me, looked around one last time, then waved my hands high above my head and flung myself to the ground.

reference_spacy_tokens: I got to my feet , waited for him to notice me , looked around one last time , then waved my hands high above my head and flung myself to the ground .


fn_spacy_tokens_for_baseline: So various and ingenious are the defensive techniques adopted by the hunted that , in some cases , hunters find it worth their while to work together in teams .

source_bert_toks: so various and ing ##eni ##ous are the defensive techniques adopted by the hunted that , in some cases , hunters find it worth their while to work together in teams .

reference_raw: So different and sophisticated are the defensive techniques adopted by the hunted that, in some cases, hunters find it worth working together in teams.

reference_spacy_tokens: So different and sophisticated are the defensive techniques adopted by the hunted that , in some cases , hunters find it worth working together in teams .


fn_spacy_tokens_for_baseline: We will continue to lobby for a ban on holiday cottages ' .

source_bert_toks: we will continue to lobby for a ban on holiday cottages ' .

reference_raw: We'll continue lobbing for the ban on holiday cottages.

reference_spacy_tokens: We 'll continue lobbing for the ban on holiday cottages .


fn_spacy_tokens_for_baseline: ' I do n't suppose anyone will even notice you 're not there .

source_bert_toks: ' i don ' t suppose anyone will even notice you ' re not there .

reference_raw: 'I don't think anyone's going to see that you're not there.

reference_spacy_tokens: ' I do n't think anyone 's going to see that you 're not there .


fn_spacy_tokens_for_baseline: Plumes of shining pink and amber grass flourished on the thatch of their roofs .

source_bert_toks: plume ##s of shining pink and amber grass flourished on the that ##ch of their roofs .

reference_raw: Plumes of bright pink and amber grass blossomed on the thatch of their roofs.

reference_spacy_tokens: Plumes of bright pink and amber grass blossomed on the thatch of their roofs .


fn_spacy_tokens_for_baseline: Despite the more favourable opinion of chroniclers , Henry 's personality makes a more unpleasing impression than that of Rufus .

source_bert_toks: despite the more favourable opinion of chronicle ##rs , henry ' s personality makes a more un ##ple ##asi ##ng impression than that of rufus .

reference_raw: Despite the more favourable opinion of the chroniclers, Henry's personality makes a more unpleasant impression than Rufus's.

reference_spacy_tokens: Despite the more favourable opinion of the chroniclers , Henry 's personality makes a more unpleasant impression than Rufus 's .


fn_spacy_tokens_for_baseline: Mirrors appear often in the poetry of women in the eighteenth century .

source_bert_toks: mirrors appear often in the poetry of women in the eighteenth century .

reference_raw: Mirrors often appear in 18th-century women's poems.

reference_spacy_tokens: Mirrors often appear in 18th - century women 's poems .


fn_spacy_tokens_for_baseline: The town hall collapsed , sending a cloud of ash and sparks across the square .

source_bert_toks: the town hall collapsed , sending a cloud of ash and sparks across the square .

reference_raw: The city chamber collapsed, sending a cloud of ash and sparks across the square.

reference_spacy_tokens: The city chamber collapsed , sending a cloud of ash and sparks across the square .


fn_spacy_tokens_for_baseline: He then ended up on the floor twice at Fairyhouse and Punchestown before he ran against championship class when he filled fifth place behind General Idea in the Chase at Leopardstown over Christmas .

source_bert_toks: he then ended up on the floor twice at fairy ##house and punches ##town before he ran against championship class when he filled fifth place behind general idea in the chase at leopard ##stown over christmas .

reference_raw: Then he ended up on the floor twice in Fairyhouse and Punchestown before he ran into the championship class when he took the fifth place behind General Idea in the Leopardstown Chase for Christmas.

reference_spacy_tokens: Then he ended up on the floor twice in Fairyhouse and Punchestown before he ran into the championship class when he took the fifth place behind General Idea in the Leopardstown Chase for Christmas .


fn_spacy_tokens_for_baseline: The jackal thinks he has feasted on the buffalo when in fact he has just eaten the eyes , entrails and testicles rejected by the lion . '

source_bert_toks: the jack ##al thinks he has feast ##ed on the buffalo when in fact he has just eaten the eyes , en ##tra ##ils and test ##icles rejected by the lion . '

reference_raw: "The jackal thinks he's been eating a buffalo when he's actually eaten eyes, guts, and testicles rejected by a lion."

reference_spacy_tokens: " The jackal thinks he 's been eating a buffalo when he 's actually eaten eyes , guts , and testicles rejected by a lion . "


fn_spacy_tokens_for_baseline: They tied me up , ransacked the house and burnt our grain store .

source_bert_toks: they tied me up , ran ##sack ##ed the house and burnt our grain store .

reference_raw: I was tied up, searched the house, burned down our grain shop.

reference_spacy_tokens: I was tied up , searched the house , burned down our grain shop .


fn_spacy_tokens_for_baseline: The ape gave Huy a baleful stare as he passed , then blinked and yawned , displaying a set of formidable yellow incisors .

source_bert_toks: the ape gave hu ##y a bal ##ef ##ul stare as he passed , then blinked and yawned , displaying a set of formidable yellow inc ##iso ##rs .

reference_raw: The ape gave Huy a baleful look as he passed, then blinked and yawned, displaying a series of formidable yellow cutters.

reference_spacy_tokens: The ape gave Huy a baleful look as he passed , then blinked and yawned , displaying a series of formidable yellow cutters .


fn_spacy_tokens_for_baseline: The sound was quickly lost in the snarl of the Aston 's engine .

source_bert_toks: the sound was quickly lost in the snarl of the aston ' s engine .

reference_raw: The sound was quickly lost in the growl of Aston's engine.

reference_spacy_tokens: The sound was quickly lost in the growl of Aston 's engine .


fn_spacy_tokens_for_baseline: The aim of the competition is to encourage artists to explore the many creative opportunities offered by the new Tinted Bockingford range .

source_bert_toks: the aim of the competition is to encourage artists to explore the many creative opportunities offered by the new tinted bo ##cking ##ford range .

reference_raw: The purpose of the competition is to stimulate artists to explore the many creative opportunities offered by the new range of Tinted Bockingford.

reference_spacy_tokens: The purpose of the competition is to stimulate artists to explore the many creative opportunities offered by the new range of Tinted Bockingford .


fn_spacy_tokens_for_baseline: This is how , this is how we interacting , so I 'm thinking everything is cool , you know , funny dude at the job , you know , get along with him real easy - going compared to the assistant , uh , manager that was there , you know what I 'm saying .

source_bert_toks: this is how , this is how we interacting , so i ' m thinking everything is cool , you know , funny dude at the job , you know , get along with him real easy - going compared to the assistant , uh , manager that was there , you know what i ' m saying .

reference_raw: That's how we interact, so I think everything's great, you know, funny guy at work, you know, getting along really easily compared to the assistant manager who was there, you know what I mean.

reference_spacy_tokens: That 's how we interact , so I think everything 's great , you know , funny guy at work , you know , getting along really easily compared to the assistant manager who was there , you know what I mean .


fn_spacy_tokens_for_baseline: To understand what other creatures perceive we have to do the well - nigh impossible .

source_bert_toks: to understand what other creatures perceive we have to do the well - ni ##gh impossible .

reference_raw: In order to understand what other beings see, we must make the night impossible.

reference_spacy_tokens: In order to understand what other beings see , we must make the night impossible .


fn_spacy_tokens_for_baseline: It takes a long time for him to gain the self - confidence to work elsewhere in the community .

source_bert_toks: it takes a long time for him to gain the self - confidence to work elsewhere in the community .

reference_raw: It takes him a long time to gain self-confidence to work elsewhere in society.

reference_spacy_tokens: It takes him a long time to gain self - confidence to work elsewhere in society .


fn_spacy_tokens_for_baseline: From the standpoint of language , Ventris 's work was more important , particularly because it filled in a gap in our knowledge of the early states of Indo -European languages .

source_bert_toks: from the stand ##point of language , vent ##ris ' s work was more important , particularly because it filled in a gap in our knowledge of the early states of indo - european languages .

reference_raw: From a linguistic point of view, Ventris' work was more important, in particular because it filled the gap in our knowledge of the first Indo-European languages.

reference_spacy_tokens: From a linguistic point of view , Ventris ' work was more important , in particular because it filled the gap in our knowledge of the first Indo - European languages .


fn_spacy_tokens_for_baseline: At quicker speeds the glissandos would have to be an octave or so shorter .

source_bert_toks: at quicker speeds the g ##lis ##san ##dos would have to be an octave or so shorter .

reference_raw: At a faster rate, the glissandos would have to be at least an octave.

reference_spacy_tokens: At a faster rate , the glissandos would have to be at least an octave .


fn_spacy_tokens_for_baseline: Imagine great herds of long - horns -- perhaps three thousand head -- walking across that landscape north , to where there was plenty of money and an appetite for beef .

source_bert_toks: imagine great herds of long - horns - - perhaps three thousand head - - walking across that landscape north , to where there was plenty of money and an appetite for beef .

reference_raw: Imagine a large flock of long horns, perhaps three thousand heads, walking across the country to the north, where there was a lot of money and a taste for beef.

reference_spacy_tokens: Imagine a large flock of long horns , perhaps three thousand heads , walking across the country to the north , where there was a lot of money and a taste for beef .


fn_spacy_tokens_for_baseline: When an edge is completed then any partial edge immediately preceding it in the chart is examined to see if the newly completed edge is required for completion .

source_bert_toks: when an edge is completed then any partial edge immediately preceding it in the chart is examined to see if the newly completed edge is required for completion .

reference_raw: When the edge is finished, any partial edge immediately preceding it in the graph shall be examined to determine whether the new edge is necessary for completion.

reference_spacy_tokens: When the edge is finished , any partial edge immediately preceding it in the graph shall be examined to determine whether the new edge is necessary for completion .


fn_spacy_tokens_for_baseline: Kim Il Sung 's " Declaration for Chemicalization " in 1961 called for the further development of a chemical industry to support chemical weapons production , and the basic organization of the current Nuclear and Chemical Defense Bureau ( NCDB ) was also established during this time .

source_bert_toks: kim il sung ' s " declaration for chemical ##ization " in 1961 called for the further development of a chemical industry to support chemical weapons production , and the basic organization of the current nuclear and chemical defense bureau ( nc ##db ) was also established during this time .

reference_raw: The "Declaration for Chemicalisation" of Kim II Sung in 1961 called for the further development of the chemical sector to support the production of chemical weapons, and during that period the basic organisation of the existing Nuclear and Chemical Defence Office (NCDB) was set up.

reference_spacy_tokens: The " Declaration for Chemicalisation " of Kim II Sung in 1961 called for the further development of the chemical sector to support the production of chemical weapons , and during that period the basic organisation of the existing Nuclear and Chemical Defence Office ( NCDB ) was set up .


fn_spacy_tokens_for_baseline: She needed to be caressed and he caressed her , massaging and pinching at the puckered rose - pink nipples , until the heat burst into searing flame and wildfire licked over her body .

source_bert_toks: she needed to be caressed and he caressed her , mass ##aging and pinch ##ing at the puck ##ered rose - pink nipples , until the heat burst into searing flame and wild ##fire licked over her body .

reference_raw: She needed to be stroked, and he stroked her, massaged her and pinched her puckered pink nipples until the heat began to burn and the fire licked over her body.

reference_spacy_tokens: She needed to be stroked , and he stroked her , massaged her and pinched her puckered pink nipples until the heat began to burn and the fire licked over her body .


fn_spacy_tokens_for_baseline: The lack of an appropriate exchange rate adjustment may well inhibit the ability of members of the CU to adjust to the changes induced by increased competition .

source_bert_toks: the lack of an appropriate exchange rate adjustment may well inhibit the ability of members of the cu to adjust to the changes induced by increased competition .

reference_raw: The absence of an appropriate exchange rate adjustment may well impede the ability of the members of the Community to adapt to changes caused by increased competition.

reference_spacy_tokens: The absence of an appropriate exchange rate adjustment may well impede the ability of the members of the Community to adapt to changes caused by increased competition .


fn_spacy_tokens_for_baseline: Limiting maximum eligible patients per doctor would help , as would requiring some broad declaration by the practice as to how the sum would be spent ( such as will occur with the revised health promotion payments ) .

source_bert_toks: limiting maximum eligible patients per doctor would help , as would requiring some broad declaration by the practice as to how the sum would be spent ( such as will occur with the revised health promotion payments ) .

reference_raw: Limiting the maximum eligible patients per doctor would help, as would require a broad statement in practice of how the amount will be spent (e.g. in the case of revised health promotion payments).

reference_spacy_tokens: Limiting the maximum eligible patients per doctor would help , as would require a broad statement in practice of how the amount will be spent ( e.g. in the case of revised health promotion payments ) .


fn_spacy_tokens_for_baseline: Though it was a warm day , he was wearing his old faded high - necked sweater with a frayed shirt collar showing .

source_bert_toks: though it was a warm day , he was wearing his old faded high - neck ##ed sweater with a fray ##ed shirt collar showing .

reference_raw: Though it was a warm day, he wore an old faded high-necked jumper with a frayed shirt collar.

reference_spacy_tokens: Though it was a warm day , he wore an old faded high - necked jumper with a frayed shirt collar .


fn_spacy_tokens_for_baseline: Sainsbury Homebase and B&Q are now refusing to sell peat taken from bogs designated as SSSIs [ see EDs 46 , 49/50 , 52 , 53/54].

source_bert_toks: sai ##ns ##bury home ##base and b & q are now refusing to sell peat taken from bog ##s designated as ss ##sis [ see eds 46 , 49 / 50 , 52 , 53 / 54 ] .

reference_raw: Sainsbury Homebase and B&Q now refuse to sell peat taken from swamps designated as SSSIs (see EDS 46, 49/50, 52 and 53/54).

reference_spacy_tokens: Sainsbury Homebase and B&Q now refuse to sell peat taken from swamps designated as SSSIs ( see EDS 46 , 49/50 , 52 and 53/54 ) .


fn_spacy_tokens_for_baseline: Fiona and I set off from Fulham in our car at about 9 a.m.

source_bert_toks: fiona and i set off from fulham in our car at about 9 a . m .

reference_raw: Fiona and I left Fulham in the car around 9:00 a.m.


fn_spacy_tokens_for_baseline: It took almost a year before the German supreme court judged that membership of the EDC was legal under the country 's constitution .

source_bert_toks: it took almost a year before the german supreme court judged that membership of the ed ##c was legal under the country ' s constitution .

reference_raw: It took nearly a year for the German Supreme Court to decide that membership of the EDC was legal under the Constitution of the country.

reference_spacy_tokens: It took nearly a year for the German Supreme Court to decide that membership of the EDC was legal under the Constitution of the country .


fn_spacy_tokens_for_baseline: This offered its occupants seventy - two square feet of invigorating repose on a mattress stuffed with the tail hair of leading stallions .

source_bert_toks: this offered its occupants seventy - two square feet of in ##vi ##gor ##ating rep ##ose on a mattress stuffed with the tail hair of leading stallion ##s .

reference_raw: It offered its occupants seventy-two square feet of refreshing rest on a mattress filled with the tail hair of the leading stallions.

reference_spacy_tokens: It offered its occupants seventy - two square feet of refreshing rest on a mattress filled with the tail hair of the leading stallions .


fn_spacy_tokens_for_baseline: It never ceased to amaze her how much smaller everything seemed to her now adult eyes .

source_bert_toks: it never ceased to ama ##ze her how much smaller everything seemed to her now adult eyes .

reference_raw: She never stopped wondering how much smaller everything seemed to her now grown-up eyes.

reference_spacy_tokens: She never stopped wondering how much smaller everything seemed to her now grown - up eyes .


fn_spacy_tokens_for_baseline: And they had willing collusion from the music press , including the NME , sadly .

source_bert_toks: and they had willing col ##lusion from the music press , including the nme , sadly .

reference_raw: And, unfortunately, they were willing to collude with the music press, including the NME.

reference_spacy_tokens: And , unfortunately , they were willing to collude with the music press , including the NME .


fn_spacy_tokens_for_baseline: Studies in France and other countries had revealed the extent to which forests were being cut down and showed that deforestation had a range of harmful consequences .

source_bert_toks: studies in france and other countries had revealed the extent to which forests were being cut down and showed that def ##orestation had a range of harmful consequences .

reference_raw: Surveys in France and other countries have shown the extent to which forests are cut down and have shown that deforestation has a number of harmful effects.

reference_spacy_tokens: Surveys in France and other countries have shown the extent to which forests are cut down and have shown that deforestation has a number of harmful effects .


fn_spacy_tokens_for_baseline: We were ignored and despised by everyone -- fans , venues , bands and journalists .

source_bert_toks: we were ignored and despised by everyone - - fans , venues , bands and journalists .

reference_raw: Everyone ignored us, disdained us, fans, venues, bands, and journalists.

reference_spacy_tokens: Everyone ignored us , disdained us , fans , venues , bands , and journalists .


fn_spacy_tokens_for_baseline: The Irishman won a rousing reception for Goodbye From White Horse Inn in what he had vowed was his ' last ever singing appearance in public ' .

source_bert_toks: the irish ##man won a ro ##using reception for goodbye from white horse inn in what he had vowed was his ' last ever singing appearance in public ' .

reference_raw: The Irishman won a wake-up reception from the White Horse Inn in what he promised was his "last-ever-singing public appearance."

reference_spacy_tokens: The Irishman won a wake - up reception from the White Horse Inn in what he promised was his " last - ever - singing public appearance . "


fn_spacy_tokens_for_baseline: I was touched to see that Dei had changed from his working overalls for the operation , although he would have to change straight back again after completing it .

source_bert_toks: i was touched to see that dei had changed from his working overall ##s for the operation , although he would have to change straight back again after completing it .

reference_raw: I was touched to see that Dei had changed out of his operating uniform for the operation, though he would have to change again when he finished it.

reference_spacy_tokens: I was touched to see that Dei had changed out of his operating uniform for the operation , though he would have to change again when he finished it .


fn_spacy_tokens_for_baseline: In 1994 Pleasant Run served 346 children and 125 families .

source_bert_toks: in 1994 pleasant run served 34 ##6 children and 125 families .

reference_raw: In 1994, Pleasant Run served 346 children and 125 children.

reference_spacy_tokens: In 1994 , Pleasant Run served 346 children and 125 children .


fn_spacy_tokens_for_baseline: It is also a particularly useful structure because it allows further information to be stored at the nodes .

source_bert_toks: it is also a particularly useful structure because it allows further information to be stored at the nodes .

reference_raw: It is also a particularly useful structure, since it allows for the storage of additional information at nodes.

reference_spacy_tokens: It is also a particularly useful structure , since it allows for the storage of additional information at nodes .


fn_spacy_tokens_for_baseline: A hundred years ago people brushed with toothpaste made from burnt eggshells or crumbled porcelain .

source_bert_toks: a hundred years ago people brushed with tooth ##pas ##te made from burnt eggs ##hell ##s or cr ##umble ##d porcelain .

reference_raw: Hundreds of years ago, people scrubbed with toothpaste made from burnt shells or crushed porcelain.

reference_spacy_tokens: Hundreds of years ago , people scrubbed with toothpaste made from burnt shells or crushed porcelain .


fn_spacy_tokens_for_baseline: She came upon the leather - worker further along the street surrounded by a mob of youths who were beating and kicking him .

source_bert_toks: she came upon the leather - worker further along the street surrounded by a mob of youths who were beating and kicking him .

reference_raw: She met the leather worker further down the street, surrounded by a crowd of young men who beat him and kicked him.

reference_spacy_tokens: She met the leather worker further down the street , surrounded by a crowd of young men who beat him and kicked him .


fn_spacy_tokens_for_baseline: Not so long ago , James Florio , youngish , intense and policy - obsessed , was the focus of a virulent grassroots campaign to dump him .

source_bert_toks: not so long ago , james fl ##orio , young ##ish , intense and policy - obsessed , was the focus of a vi ##ru ##lent grassroots campaign to dump him .

reference_raw: Not long ago, James Florio, young, intense and politically obsessed, was the focus of a virulent grassroots campaign to get rid of him.

reference_spacy_tokens: Not long ago , James Florio , young , intense and politically obsessed , was the focus of a virulent grassroots campaign to get rid of him .


fn_spacy_tokens_for_baseline: Another argument for these diets was their possible role in favouring bowel rest .

source_bert_toks: another argument for these diet ##s was their possible role in favour ##ing bow ##el rest .

reference_raw: Another reason for these diets was their possible role in favour of bowel rest.

reference_spacy_tokens: Another reason for these diets was their possible role in favour of bowel rest .


fn_spacy_tokens_for_baseline: When he turned later to real opera , trag)e en musique ( see pp . 373 ff . ) , he was by no means a novice in dealing with French declamation .

source_bert_toks: when he turned later to real opera , tr ##ag ) e en musique ( see pp . 37 ##3 ff . ) , he was by no means a novice in dealing with french dec ##lam ##ation .

reference_raw: When he later turned to the real opera, trag)e en musique (see pp. 373 f.), he was in no way a candidate for the French declaration.

reference_spacy_tokens: When he later turned to the real opera , trag)e en musique ( see pp . 373 f. ) , he was in no way a candidate for the French declaration .


fn_spacy_tokens_for_baseline: Fire - fighters first had hope of gaining control on the morning of Thursday , June 12 , but the wind changed direction during the day , causing a large extension of the fire .

source_bert_toks: fire - fighters first had hope of gaining control on the morning of thursday , june 12 , but the wind changed direction during the day , causing a large extension of the fire .

reference_raw: For the first time, the firemen had hopes of gaining control on Thursday, July 12th, but the wind changed direction during the day, causing the fire to expand considerably.

reference_spacy_tokens: For the first time , the firemen had hopes of gaining control on Thursday , July 12th , but the wind changed direction during the day , causing the fire to expand considerably .


fn_spacy_tokens_for_baseline: Drivers risk a £ 50 fine for breaking the law .

source_bert_toks: drivers risk a £5 ##0 fine for breaking the law .

reference_raw: Drivers are taking a £50 fine for breaking the law.

reference_spacy_tokens: Drivers are taking a £ 50 fine for breaking the law .


fn_spacy_tokens_for_baseline: We have a mission to widen access to higher education and to teach and research at the highest possible level .

source_bert_toks: we have a mission to widen access to higher education and to teach and research at the highest possible level .

reference_raw: Our mission is to extend access to higher education and to teach and research as far as possible.

reference_spacy_tokens: Our mission is to extend access to higher education and to teach and research as far as possible .


fn_spacy_tokens_for_baseline: Gilpin was a schoolmaster and the vicar of Boldre in Hampshire , who spent his holidays sketching romantic countryside all over Britain .

source_bert_toks: gil ##pin was a school ##master and the vicar of bold ##re in hampshire , who spent his holidays sketch ##ing romantic countryside all over britain .

reference_raw: Gilpin was a teacher and vicar of Boldre in Hampshire, who spent his holidays sketching romantic landscapes all over Britain.

reference_spacy_tokens: Gilpin was a teacher and vicar of Boldre in Hampshire , who spent his holidays sketching romantic landscapes all over Britain .


fn_spacy_tokens_for_baseline: The island is also the designated home of the University of East Asia .

source_bert_toks: the island is also the designated home of the university of east asia .

reference_raw: The island is also the appointed home of the University of East Asia.

reference_spacy_tokens: The island is also the appointed home of the University of East Asia .


fn_spacy_tokens_for_baseline: The sexual organs themselves will change , both those outside her body and those within growing and developing into adult form .

source_bert_toks: the sexual organs themselves will change , both those outside her body and those within growing and developing into adult form .

reference_raw: Sexual organs themselves change, both outside the body and inside the body, growing and growing into adult form.

reference_spacy_tokens: Sexual organs themselves change , both outside the body and inside the body , growing and growing into adult form .


fn_spacy_tokens_for_baseline: ' Invention is a ' quick and sagacious penetration into the true essence of all the objects of our contemplation ' , and ' Judgment ' is ' the discernment of differences ' therein .

source_bert_toks: ' invention is a ' quick and saga ##cious penetration into the true essence of all the objects of our con ##tem ##pl ##ation ' , and ' judgment ' is ' the disc ##ern ##ment of differences ' there ##in .

reference_raw: 'Invention is a quick and sagitous penetration of the true nature of all the objects of our contemplation,' and 'judgment' is a 'recognition of differences' in it.

reference_spacy_tokens: ' Invention is a quick and sagitous penetration of the true nature of all the objects of our contemplation , ' and ' judgment ' is a ' recognition of differences ' in it .


fn_spacy_tokens_for_baseline: Equally inevitably , there was outrage and dismay in India .

source_bert_toks: equally inevitably , there was outrage and dismay in india .

reference_raw: In India, too, there was indignation and terror.

reference_spacy_tokens: In India , too , there was indignation and terror .


fn_spacy_tokens_for_baseline: The two huge spikes were rammed into his body .

source_bert_toks: the two huge spikes were rammed into his body .

reference_raw: Two huge spikes were thrust into his body.

reference_spacy_tokens: Two huge spikes were thrust into his body .


fn_spacy_tokens_for_baseline: I can see colours inside of it .

source_bert_toks: i can see colours inside of it .

reference_raw: I can see the colors in it.

reference_spacy_tokens: I can see the colors in it .


fn_spacy_tokens_for_baseline: Then I sort the internal mail for the office .

source_bert_toks: then i sort the internal mail for the office .

reference_raw: Then I'll arrange the internal mail for the office.

reference_spacy_tokens: Then I 'll arrange the internal mail for the office .


fn_spacy_tokens_for_baseline: Between 1801 and 1851 the area 's population doubled and it doubled again from 1851 to 1921 , the year that saw the culmination of the first phase of the town 's development as a capitalist urban locality .

source_bert_toks: between 1801 and 1851 the area ' s population doubled and it doubled again from 1851 to 1921 , the year that saw the cu ##lm ##ination of the first phase of the town ' s development as a capitalist urban locality .

reference_raw: In the period from 1801 to 1851, the population of the region was twice and twice between 1851 and 1921, a year which saw the climax of the first stage of urban development as a capitalist city.

reference_spacy_tokens: In the period from 1801 to 1851 , the population of the region was twice and twice between 1851 and 1921 , a year which saw the climax of the first stage of urban development as a capitalist city .


fn_spacy_tokens_for_baseline: Are we gon na have an annual congress , a bi - annual congress , a tri - annual congress ?

source_bert_toks: are we go ##n na have an annual congress , a bi - annual congress , a tri - annual congress ?

reference_raw: Are we going to have an annual congress, a two-year congress, a three-year congress?

reference_spacy_tokens: Are we going to have an annual congress , a two - year congress , a three - year congress ?


fn_spacy_tokens_for_baseline: Not that I disapprove rural Pleasures , as the Poets have painted them ; in their Landschape every Phillis has her Coridon , every murmuring Stream , and every flowry Mead gives fresh Alarms to Love .

source_bert_toks: not that i di ##sa ##pp ##rove rural pleasures , as the poets have painted them ; in their lands ##cha ##pe every phil ##lis has her co ##rid ##on , every murmur ##ing stream , and every flow ##ry mead gives fresh alarms to love .

reference_raw: Not that I disagree with the rural pleasures, as the poets have painted them; in their Landschape, every Phillis has its Coridon, every whispering stream, and every flowery meat gives new alarms to love.

reference_spacy_tokens: Not that I disagree with the rural pleasures , as the poets have painted them ; in their Landschape , every Phillis has its Coridon , every whispering stream , and every flowery meat gives new alarms to love .


fn_spacy_tokens_for_baseline: For many staff this represents an overwhelming ' traumatising experience ' , she explained .

source_bert_toks: for many staff this represents an overwhelming ' trauma ##tis ##ing experience ' , she explained .

reference_raw: For many employees, she explained, this is an overwhelming 'traumatizing experience'.

reference_spacy_tokens: For many employees , she explained , this is an overwhelming ' traumatizing experience ' .


fn_spacy_tokens_for_baseline: Dr _ Gupto : On the other hand to be able to outline and do the thing that were talked about today to basically completely revamp the public health system so that local officials can talk to state officials that can talk to federal officials to be able to pinpoint exactly when a cluster of bird flu happens that takes probably a lot more money and a and a really a complete revamping of our public health systems .

source_bert_toks: dr _ gu ##pt ##o : on the other hand to be able to outline and do the thing that were talked about today to basically completely rev ##amp the public health system so that local officials can talk to state officials that can talk to federal officials to be able to pin ##point exactly when a cluster of bird flu happens that takes probably a lot more money and a and a really a complete rev ##amp ##ing of our public health systems .

reference_raw: Dr. Gupto: On the contrary, to be able to outline and do what we're talking about today, essentially revamp the public health system, so that local officials can talk to government officials, who can talk to federal officials, so that they can pinpoint exactly when a cluster of avian influenza occurs, which will probably take a lot more money and, indeed, a complete overhaul of our public health system.

reference_spacy_tokens: Dr. Gupto : On the contrary , to be able to outline and do what we 're talking about today , essentially revamp the public health system , so that local officials can talk to government officials , who can talk to federal officials , so that they can pinpoint exactly when a cluster of avian influenza occurs , which will probably take a lot more money and , indeed , a complete overhaul of our public health system .


fn_spacy_tokens_for_baseline: Immerse the section or plaquette in boiling reagent for at least five minutes .

source_bert_toks: im ##mers ##e the section or plaque ##tte in boiling re ##age ##nt for at least five minutes .

reference_raw: The portion or plaquette shall be submerged in a boiling agent for at least five minutes.

reference_spacy_tokens: The portion or plaquette shall be submerged in a boiling agent for at least five minutes .


fn_spacy_tokens_for_baseline: A more plausible interpretation states the following principle : The laws which operate on a large , macrocosmic scale , also operate ( perhaps with modifications ) on the microcosmic scale .

source_bert_toks: a more plausible interpretation states the following principle : the laws which operate on a large , macro ##cos ##mic scale , also operate ( perhaps with modifications ) on the micro ##cos ##mic scale .

reference_raw: The more plausible explanation states the following principle: legislation operating on a large macrocosmic scale also operates (perhaps with modifications) on a microcosmic scale.

reference_spacy_tokens: The more plausible explanation states the following principle : legislation operating on a large macrocosmic scale also operates ( perhaps with modifications ) on a microcosmic scale .


fn_spacy_tokens_for_baseline: In its rough state , he showed it to the Professor , who bent his grey beard over the neat script , and read for some time in silence .

source_bert_toks: in its rough state , he showed it to the professor , who bent his grey beard over the neat script , and read for some time in silence .

reference_raw: In his rough state, he showed it to the Professor, who leaned his gray beard over a neat script and read in silence for a while.

reference_spacy_tokens: In his rough state , he showed it to the Professor , who leaned his gray beard over a neat script and read in silence for a while .


fn_spacy_tokens_for_baseline: The ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

source_bert_toks: the ports are within hiking distance of several beautiful beaches , and within a one - hour hike of each other on a marked trail .

reference_raw: The ports are within the hiking distance of several beautiful beaches, and within an hour of each other's journey along a marked path.

reference_spacy_tokens: The ports are within the hiking distance of several beautiful beaches , and within an hour of each other 's journey along a marked path .


fn_spacy_tokens_for_baseline: Others , then , will have to judge whether my views expressed here are consonant with that tradition .

source_bert_toks: others , then , will have to judge whether my views expressed here are consonant with that tradition .

reference_raw: The others will then have to assess whether my views expressed here are consistent with this tradition.

reference_spacy_tokens: The others will then have to assess whether my views expressed here are consistent with this tradition .


fn_spacy_tokens_for_baseline: The clashes had begun Monday around the fortified residence of Hashid tribal leader Sadiq Ahmar , a onetime supporter who broke with the president in March over Saleh 's use of violence against antigovernment demonstrators .

source_bert_toks: the clashes had begun monday around the fortified residence of hash ##id tribal leader sad ##iq ah ##mar , a one ##time supporter who broke with the president in march over sale ##h ' s use of violence against anti ##go ##vern ##ment demonstrators .

reference_raw: The clash began on Monday around the fortified residence of the Hashid tribal leader, Sadiq Ahmar, a former supporter who broke up with the President in March about Saleh's violent use of anti-government demonstrators.

reference_spacy_tokens: The clash began on Monday around the fortified residence of the Hashid tribal leader , Sadiq Ahmar , a former supporter who broke up with the President in March about Saleh 's violent use of anti - government demonstrators .


fn_spacy_tokens_for_baseline: ' I will count to three and if you do not disclose the whereabouts of the stolen billfold I will break open your head . '

source_bert_toks: ' i will count to three and if you do not disclose the whereabouts of the stolen bill ##fold i will break open your head . '

reference_raw: "I'll count to three, and if you don't tell me where the missing billfold is, I'll break your head."

reference_spacy_tokens: " I 'll count to three , and if you do n't tell me where the missing billfold is , I 'll break your head . "


fn_spacy_tokens_for_baseline: Wendy managed to get a job as a receptionist in a dental surgery to begin with and will keep applying for one of the hygienist training courses .

source_bert_toks: wendy managed to get a job as a receptionist in a dental surgery to begin with and will keep applying for one of the h ##y ##gie ##nist training courses .

reference_raw: Wendy's managed to get a job as a secretary for dental surgery, and she'll continue to apply for one of her medical training courses.

reference_spacy_tokens: Wendy 's managed to get a job as a secretary for dental surgery , and she 'll continue to apply for one of her medical training courses .


fn_spacy_tokens_for_baseline: The Magistrate had long been interested in Lucy but not because Cupid had at last managed to lodge an arrow in his stony heart .

source_bert_toks: the magistrate had long been interested in lucy but not because cup ##id had at last managed to lodge an arrow in his stony heart .

reference_raw: The Magistrate had been interested in Lucy for a long time, but not because Cupid had finally managed to put an arrow into his stone heart.

reference_spacy_tokens: The Magistrate had been interested in Lucy for a long time , but not because Cupid had finally managed to put an arrow into his stone heart .


fn_spacy_tokens_for_baseline: Go down one flight of steps to Lascar Row , popularly known as Cat Street , for more antiques and curio shops .

source_bert_toks: go down one flight of steps to las ##car row , popularly known as cat street , for more antiques and cu ##rio shops .

reference_raw: Go down one flight of stairs to Lascar Row, popularly known as Cat Road, for more antiques and curio shops.

reference_spacy_tokens: Go down one flight of stairs to Lascar Row , popularly known as Cat Road , for more antiques and curio shops .


fn_spacy_tokens_for_baseline: Rawls ' Kantian constructivist approach to ethics suggest an argument for political neutrality which is in part independent of the one criticised above and which turns on autonomy :

source_bert_toks: raw ##ls ' kant ##ian construct ##ivist approach to ethics suggest an argument for political neutrality which is in part independent of the one criticised above and which turns on autonomy :

reference_raw: The Rawls Kantian constructivist approach to ethics suggests an argument for political neutrality, which is partly independent of the one criticised above and which relies on autonomy:

reference_spacy_tokens: The Rawls Kantian constructivist approach to ethics suggests an argument for political neutrality , which is partly independent of the one criticised above and which relies on autonomy :


fn_spacy_tokens_for_baseline: Seed the filter with A.B.A. or similar .

source_bert_toks: seed the filter with a . b . a . or similar .

reference_raw: I've seen a filter with an A.B.A. or something like that.

reference_spacy_tokens: I 've seen a filter with an A.B.A. or something like that .


fn_spacy_tokens_for_baseline: For security , use three evenly spaced bolts per post .

source_bert_toks: for security , use three evenly spaced bolts per post .

reference_raw: Use three equally spaced screws per post for safety.

reference_spacy_tokens: Use three equally spaced screws per post for safety .


fn_spacy_tokens_for_baseline: Recent outbreaks have stemmed from bad drinking water , apple juice , and hamburger meat .

source_bert_toks: recent outbreak ##s have stemmed from bad drinking water , apple juice , and hamburger meat .

reference_raw: The recent outbreaks have been caused by poor drinking water, apple sauce and hamburger meat.

reference_spacy_tokens: The recent outbreaks have been caused by poor drinking water , apple sauce and hamburger meat .


fn_spacy_tokens_for_baseline: He had a lovely mouth and lovely muscular thighs .

source_bert_toks: he had a lovely mouth and lovely muscular thighs .

reference_raw: His mouth was beautiful, and his legs were beautifully muscled.

reference_spacy_tokens: His mouth was beautiful , and his legs were beautifully muscled .


fn_spacy_tokens_for_baseline: Clear confusion reigned in their instinctive minds , and while they dithered on the banks , the water rose behind them , cutting off retreat .

source_bert_toks: clear confusion reigned in their instinct ##ive minds , and while they di ##ther ##ed on the banks , the water rose behind them , cutting off retreat .

reference_raw: There was a clear confusion in their instinctive minds, and as they dined on the shores, the water rose behind them, cutting off their retreat.

reference_spacy_tokens: There was a clear confusion in their instinctive minds , and as they dined on the shores , the water rose behind them , cutting off their retreat .


fn_spacy_tokens_for_baseline: A red and black burnet moth landed on her hand , crawled over it and whirred away again into the grass .

source_bert_toks: a red and black burn ##et moth landed on her hand , crawled over it and w ##hir ##red away again into the grass .

reference_raw: A red-and-black burnt moth landed on her arm, crawled over her, and whistled back into the grass.

reference_spacy_tokens: A red - and - black burnt moth landed on her arm , crawled over her , and whistled back into the grass .


fn_spacy_tokens_for_baseline: ' Just behave as if we were back at home , ' said Hazel .

source_bert_toks: ' just behave as if we were back at home , ' said hazel .

reference_raw: 'Just act like we're home,' Hazel said.

reference_spacy_tokens: ' Just act like we 're home , ' Hazel said .


fn_spacy_tokens_for_baseline: For example , the same message may be segmented differently in response to different questions :

source_bert_toks: for example , the same message may be segment ##ed differently in response to different questions :

reference_raw: For example, the same message can be divided in different ways to answer different questions:

reference_spacy_tokens: For example , the same message can be divided in different ways to answer different questions :


fn_spacy_tokens_for_baseline: Most of us have a major problem when faced by a very unpleasant character who is screaming like an animal or explaining how he is going to separate us from parts of our body .

source_bert_toks: most of us have a major problem when faced by a very unpleasant character who is screaming like an animal or explaining how he is going to separate us from parts of our body .

reference_raw: Most of us have a big problem when we face a very uncomfortable character who screams like an animal or explains how it separates us from parts of the body.

reference_spacy_tokens: Most of us have a big problem when we face a very uncomfortable character who screams like an animal or explains how it separates us from parts of the body .


fn_spacy_tokens_for_baseline: The door slammed open and Celia walked in .

source_bert_toks: the door slammed open and celia walked in .

reference_raw: The door swung open and Celia entered.

reference_spacy_tokens: The door swung open and Celia entered .


fn_spacy_tokens_for_baseline: ' How terribly sweet and noble of you , ' she purred .

source_bert_toks: ' how terribly sweet and noble of you , ' she pu ##rred .

reference_raw: 'How terribly kind and noble of you,' she said.

reference_spacy_tokens: ' How terribly kind and noble of you , ' she said .


fn_spacy_tokens_for_baseline: ' It 's quite pleasant , ' her companion conceded .

source_bert_toks: ' it ' s quite pleasant , ' her companion conceded .

reference_raw: 'That's nice,' said her partner.

reference_spacy_tokens: ' That 's nice , ' said her partner .


fn_spacy_tokens_for_baseline: Success hinged on timing their arrival just as the last fat slice of sun slid below the horizon .

source_bert_toks: success hi ##nged on timing their arrival just as the last fat slice of sun slid below the horizon .

reference_raw: Success depended on the timing of their arrival, just as the last thick piece of sun slid down the horizon.

reference_spacy_tokens: Success depended on the timing of their arrival , just as the last thick piece of sun slid down the horizon .


fn_spacy_tokens_for_baseline: 9:53 a.m. PANDA : Flesh goes to total alert for flight or fight .

source_bert_toks: 9 : 53 a . m . panda : flesh goes to total alert for flight or fight .

reference_raw: 9:53 A.M. PANDA: Flash is on full alert for flight or combat.

reference_spacy_tokens: 9:53 A.M. PANDA : Flash is on full alert for flight or combat .


fn_spacy_tokens_for_baseline: 5- The brother who wants to leave AL - QAEDA without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

source_bert_toks: 5 - the brother who wants to leave al - qaeda without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

reference_raw: 5-Brother who wishes to leave AL-QAEDA without a legitimate excuse is not eligible for financial assistance or any of the privileges mentioned above.

reference_spacy_tokens: 5-Brother who wishes to leave AL - QAEDA without a legitimate excuse is not eligible for financial assistance or any of the privileges mentioned above .


fn_spacy_tokens_for_baseline: Buildings were in flames and I could hear the screams and moans of the trapped and injured .

source_bert_toks: buildings were in flames and i could hear the screams and moans of the trapped and injured .

reference_raw: The buildings were on fire, and I heard the screams and groans of the trapped and wounded.

reference_spacy_tokens: The buildings were on fire , and I heard the screams and groans of the trapped and wounded .


fn_spacy_tokens_for_baseline: Experience was all , and I set out to grab it with both hands , drifting from country to country , from one relationship to another , a heedless , hedonistic round with never a thought for tomorrow .

source_bert_toks: experience was all , and i set out to grab it with both hands , drifting from country to country , from one relationship to another , a hee ##dles ##s , he ##don ##istic round with never a thought for tomorrow .

reference_raw: The experience was all, and I set out to take it with both hands, drifting from country to country, from one relationship to another, a heedless, hedonistic round with no idea for tomorrow.

reference_spacy_tokens: The experience was all , and I set out to take it with both hands , drifting from country to country , from one relationship to another , a heedless , hedonistic round with no idea for tomorrow .


fn_spacy_tokens_for_baseline: She looked out to sea , as far as she could through the mist , and thought of great trees whispering under the waves .

source_bert_toks: she looked out to sea , as far as she could through the mist , and thought of great trees whispering under the waves .

reference_raw: Looking out at the sea, as far as she could through the fog, she thought of the great trees whistling under the waves.

reference_spacy_tokens: Looking out at the sea , as far as she could through the fog , she thought of the great trees whistling under the waves .


fn_spacy_tokens_for_baseline: A major issue in the decision between a generative and a probabilistic system is the robustness of the system .

source_bert_toks: a major issue in the decision between a genera ##tive and a pro ##ba ##bilis ##tic system is the robust ##ness of the system .

reference_raw: The main question in deciding between a generative and probabilistic system is the reliability of the system.

reference_spacy_tokens: The main question in deciding between a generative and probabilistic system is the reliability of the system .


fn_spacy_tokens_for_baseline: Alyssia gasped at his loose rendition of the truth , and then closed her mouth as she took in Piers 's frozen expression .

source_bert_toks: al ##ys ##sia gasped at his loose rendition of the truth , and then closed her mouth as she took in piers ' s frozen expression .

reference_raw: Alyssia gasped at the release of the truth, then shut her mouth as she took Piers's frozen look.

reference_spacy_tokens: Alyssia gasped at the release of the truth , then shut her mouth as she took Piers 's frozen look .


fn_spacy_tokens_for_baseline: He knew he had no choice in the matter but cursed and muttered as he fixed his saddle bags , harnessed Philomel and joined Cranston who sat slouched on his horse on the track outside the church .

source_bert_toks: he knew he had no choice in the matter but cursed and muttered as he fixed his saddle bags , harness ##ed phil ##ome ##l and joined cr ##ans ##ton who sat sl ##ou ##ched on his horse on the track outside the church .

reference_raw: He knew that he had no choice but to curse and murmur as he adjusted his saddlebags, harnessed Philomel, and joined Cranston, who was squatting on his horse on the track in front of the church.

reference_spacy_tokens: He knew that he had no choice but to curse and murmur as he adjusted his saddlebags , harnessed Philomel , and joined Cranston , who was squatting on his horse on the track in front of the church .


fn_spacy_tokens_for_baseline: It surely evolved from earlier use in more literal , straightforward contexts ( for instance , to describe the sound of an automobile engine or a musical performance ) and ultimately from the long - established and nonjudgmental phrase to make noises ( that is , to express oneself about something ) , a construction that happily accommodates all manner of adjectival prefixes .

source_bert_toks: it surely evolved from earlier use in more literal , straightforward contexts ( for instance , to describe the sound of an automobile engine or a musical performance ) and ultimately from the long - established and non ##ju ##d ##gm ##ental phrase to make noises ( that is , to express oneself about something ) , a construction that happily accommodate ##s all manner of ad ##ject ##iva ##l prefix ##es .

reference_raw: It has certainly evolved from earlier use in a more literal and direct context (e.g. to describe the noise of a car engine or a musical performance) and, finally, from a long-established and non-judgmental phrase for making noises (i.e. expressing itself about something), a structure that happily accommodates all sorts of adjective prefixes.

reference_spacy_tokens: It has certainly evolved from earlier use in a more literal and direct context ( e.g. to describe the noise of a car engine or a musical performance ) and , finally , from a long - established and non - judgmental phrase for making noises ( i.e. expressing itself about something ) , a structure that happily accommodates all sorts of adjective prefixes .


fn_spacy_tokens_for_baseline: It started to rain again , a light drizzle that caused umbrellas to pop up all over the place .

source_bert_toks: it started to rain again , a light dr ##iz ##zle that caused umbrella ##s to pop up all over the place .

reference_raw: It was raining again, a light drop that caused umbrellas to appear everywhere.

reference_spacy_tokens: It was raining again , a light drop that caused umbrellas to appear everywhere .


fn_spacy_tokens_for_baseline: But the net effect was to undo the threat that the reformed CAP would haul down production safety - nets and bathe developing export markets in a warm glow instead .

source_bert_toks: but the net effect was to undo the threat that the reformed cap would haul down production safety - nets and bath ##e developing export markets in a warm glow instead .

reference_raw: The net effect, however, was to undo the risk that the reformed CAP would bring down production safety nets and bathe the developing export markets in a warm glow instead.

reference_spacy_tokens: The net effect , however , was to undo the risk that the reformed CAP would bring down production safety nets and bathe the developing export markets in a warm glow instead .


fn_spacy_tokens_for_baseline: Any referential term descriptive of a genuine individuating feature of the object concerned is by definition a ' rigid designator ' .

source_bert_toks: any refer ##ential term descriptive of a genuine ind ##iv ##id ##uating feature of the object concerned is by definition a ' rigid design ##ator ' .

reference_raw: Any reference term describing the actual individuality of the object in question is by definition a' rigid designator'.

reference_spacy_tokens: Any reference term describing the actual individuality of the object in question is by definition a ' rigid designator ' .


fn_spacy_tokens_for_baseline: On 11 January 2007 , China successfully carried out a test of a direct ascent anti - satellite ( ASAT ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the Earth 's surface .

source_bert_toks: on 11 january 2007 , china successfully carried out a test of a direct ascent anti - satellite ( asa ##t ) weapon , by using a ballistic missile to destroy an aging weather satellite in orbit approximately 500 miles above the earth ' s surface .

reference_raw: On 11 January 2007, China successfully performed the Ascent Anti-Satt (ASAT) assay, using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth.

reference_spacy_tokens: On 11 January 2007 , China successfully performed the Ascent Anti - Satt ( ASAT ) assay , using a ballistic missile to destroy an ageing weather satellite in orbit approximately 500 miles above the surface of the Earth .


fn_spacy_tokens_for_baseline: Some are blind , deaf or have other physical disabilities .

source_bert_toks: some are blind , deaf or have other physical disabilities .

reference_raw: Others are blind, deaf or otherwise physically handicapped.

reference_spacy_tokens: Others are blind , deaf or otherwise physically handicapped .


fn_spacy_tokens_for_baseline: Kadafi loyalists used tear gas to disperse the demonstrators .

source_bert_toks: ka ##da ##fi loyalists used tear gas to disperse the demonstrators .

reference_raw: Kadafi loyalists used tear gas to dissipate protestors.

reference_spacy_tokens: Kadafi loyalists used tear gas to dissipate protestors .


fn_spacy_tokens_for_baseline: Heart rate was unchanged from pre - norepinephrine infusion to peak response ( p = 0.3905 ) .

source_bert_toks: heart rate was unchanged from pre - nor ##ep ##ine ##ph ##rine in ##fusion to peak response ( p = 0 . 390 ##5 ) .

reference_raw: From the pre-norepinephrine infusion to the peak response (p = 0.3905), the heartbeat was unchanged.

reference_spacy_tokens: From the pre - norepinephrine infusion to the peak response ( p = 0.3905 ) , the heartbeat was unchanged .


fn_spacy_tokens_for_baseline: Peter Wright has done an admirable job and not just in the set scrum .

source_bert_toks: peter wright has done an ad ##mir ##able job and not just in the set sc ##rum .

reference_raw: Peter Wright did a wonderful job, not just in a set of scrums.

reference_spacy_tokens: Peter Wright did a wonderful job , not just in a set of scrums .