fn_spacy_tokens_for_baseline: It was the same as the monogram on the handkerchief .

source_bert_toks: it was the same as the mono ##gram on the handkerchief .

reference_raw: It was just like the monograph on the tissue.

reference_spacy_tokens: It was just like the monograph on the tissue .


fn_spacy_tokens_for_baseline: Dorothy could perhaps fax it up , cos I I had it typed out yesterday so we could , do it .

source_bert_toks: dorothy could perhaps fa ##x it up , co ##s i i had it typed out yesterday so we could , do it .

reference_raw: Dorothy might have faxed it to me, because I wrote it last night so we could do it.

reference_spacy_tokens: Dorothy might have faxed it to me , because I wrote it last night so we could do it .


fn_spacy_tokens_for_baseline: It also creates a whole raft of sub - directories for the various additions you may , or may not , have bought !

source_bert_toks: it also creates a whole raft of sub - director ##ies for the various additions you may , or may not , have bought !

reference_raw: It also creates a whole boat of subdirectories for various additions that you may or may not have bought!

reference_spacy_tokens: It also creates a whole boat of subdirectories for various additions that you may or may not have bought !


fn_spacy_tokens_for_baseline: Smith knew that Wilson was a socialist : that he could never admit any discrimination based on racial factors , and all the things that Smith abominated .

source_bert_toks: smith knew that wilson was a socialist : that he could never admit any discrimination based on racial factors , and all the things that smith ab ##omi ##nated .

reference_raw: Smith knew that Wilson was a socialist: that he could never admit any discrimination based on racial factors and all the things that Smith hated.

reference_spacy_tokens: Smith knew that Wilson was a socialist : that he could never admit any discrimination based on racial factors and all the things that Smith hated .


fn_spacy_tokens_for_baseline: The assistant executioner followed with the coffin , and also bearing a flagon of strong drink with which to fortify the victim for his or her coming ordeal .

source_bert_toks: the assistant execution ##er followed with the coffin , and also bearing a flag ##on of strong drink with which to fort ##ify the victim for his or her coming ordeal .

reference_raw: The assistant executioner followed him with a casket, and he also carried a bottle of strong drink with which to fortify the victim for his coming ordeal.

reference_spacy_tokens: The assistant executioner followed him with a casket , and he also carried a bottle of strong drink with which to fortify the victim for his coming ordeal .


fn_spacy_tokens_for_baseline: An IED hidden in a parked car exploded as the group walked by .

source_bert_toks: an ie ##d hidden in a parked car exploded as the group walked by .

reference_raw: As the group passed, an I.E.D. hidden in a parked car exploded.

reference_spacy_tokens: As the group passed , an I.E.D. hidden in a parked car exploded .


fn_spacy_tokens_for_baseline: When he got too puffed to run , Nigel would put one foot on someone 's wall and retie his shoelace slowly .

source_bert_toks: when he got too puff ##ed to run , nigel would put one foot on someone ' s wall and re ##tie his shoe ##lace slowly .

reference_raw: When he was too puffy to run, Nigel put one foot on someone's wall and slowly retied the lace.

reference_spacy_tokens: When he was too puffy to run , Nigel put one foot on someone 's wall and slowly retied the lace .


fn_spacy_tokens_for_baseline: Many of them rue the passing of the seven foot broad gauge railway .

source_bert_toks: many of them rue the passing of the seven foot broad gauge railway .

reference_raw: Many regret the passage of a seven-foot-wide gauge railroad.

reference_spacy_tokens: Many regret the passage of a seven - foot - wide gauge railroad .


fn_spacy_tokens_for_baseline: The General Assembly has worked to improve its response to potential terrorist attacks after the Sept. 11 , 2001 , attacks and the ensuing anthrax scares .

source_bert_toks: the general assembly has worked to improve its response to potential terrorist attacks after the sept . 11 , 2001 , attacks and the ensuing ant ##hra ##x scares .

reference_raw: Following the September 11, 2001, attacks and subsequent anthrax scares, the General Assembly sought to enhance its response to possible terrorist attacks.

reference_spacy_tokens: Following the September 11 , 2001 , attacks and subsequent anthrax scares , the General Assembly sought to enhance its response to possible terrorist attacks .


fn_spacy_tokens_for_baseline: In the past , carnivorous plants have been gathered by unscrupulous collectors from the wild ; a practice that has depleted natural stocks .

source_bert_toks: in the past , car ##nivorous plants have been gathered by un ##sc ##rup ##ulous collectors from the wild ; a practice that has depleted natural stocks .

reference_raw: In the past, carnivorous plants have been collected by ruthless collectors from the wild, a practice that has exhausted natural resources.

reference_spacy_tokens: In the past , carnivorous plants have been collected by ruthless collectors from the wild , a practice that has exhausted natural resources .


fn_spacy_tokens_for_baseline: He advertised his own brand of cigarettes and sold his own brand of whisky .

source_bert_toks: he advertised his own brand of cigarettes and sold his own brand of whisky .

reference_raw: He advertised his own cigarette mark and sold his own whiskey.

reference_spacy_tokens: He advertised his own cigarette mark and sold his own whiskey .


fn_spacy_tokens_for_baseline: She took the basket back into the dressing - room and threw a cloth over it , then began to undress , bundling her discarded clothes into the bottom of one of the huge built - in cupboards that lined the walls .

source_bert_toks: she took the basket back into the dressing - room and threw a cloth over it , then began to und ##ress , bun ##dling her discarded clothes into the bottom of one of the huge built - in cupboard ##s that lined the walls .

reference_raw: She took the basket back to the dressing room, tossed a cloth over it, and began to undress, wrapping her discarded clothes in the lower part of one of the huge, built-in cabinets that lined the walls.

reference_spacy_tokens: She took the basket back to the dressing room , tossed a cloth over it , and began to undress , wrapping her discarded clothes in the lower part of one of the huge , built - in cabinets that lined the walls .


fn_spacy_tokens_for_baseline: We will end the deregulation of buses , introduce bus priority measures integrated with new rapid transit systems within a ' green light ' programme designed to encourage people to transfer to public transport .

source_bert_toks: we will end the der ##eg ##ulation of buses , introduce bus priority measures integrated with new rapid transit systems within a ' green light ' programme designed to encourage people to transfer to public transport .

reference_raw: We will put an end to the deregulation of buses and introduce priority measures for buses integrated into new rapid transit systems under the Green Light programme to encourage people to switch to public transport.

reference_spacy_tokens: We will put an end to the deregulation of buses and introduce priority measures for buses integrated into new rapid transit systems under the Green Light programme to encourage people to switch to public transport .


fn_spacy_tokens_for_baseline: Many times I 'm called up by a local doctor and asked to do what is called a DV -- a domiciliary visit to assess the mental state of an individual .

source_bert_toks: many times i ' m called up by a local doctor and asked to do what is called a d ##v - - a dom ##ici ##lia ##ry visit to assess the mental state of an individual .

reference_raw: I've been summoned by a local doctor many times and asked to do what's known as a DVD, a domiliary visit to evaluate the mental state of an individual.

reference_spacy_tokens: I 've been summoned by a local doctor many times and asked to do what 's known as a DVD , a domiliary visit to evaluate the mental state of an individual .


fn_spacy_tokens_for_baseline: In the morning a little aeroplane came buzzing across the blue window - pane of sky and alighted on the sugary beach .

source_bert_toks: in the morning a little aero ##plane came buzzing across the blue window - pan ##e of sky and ali ##ght ##ed on the sugar ##y beach .

reference_raw: In the morning a small plane roared across the blue pane of the sky and lit up on a sweet beach.

reference_spacy_tokens: In the morning a small plane roared across the blue pane of the sky and lit up on a sweet beach .


fn_spacy_tokens_for_baseline: His voice was very loud .

source_bert_toks: his voice was very loud .

reference_raw: His voice was very noisy.

reference_spacy_tokens: His voice was very noisy .


fn_spacy_tokens_for_baseline: Please " help good kids get better " by sending us a contribution today .

source_bert_toks: please " help good kids get better " by sending us a contribution today .

reference_raw: Please, "help the good kids get better" by sending us a donation today.

reference_spacy_tokens: Please , " help the good kids get better " by sending us a donation today .


fn_spacy_tokens_for_baseline: Approximately 15 cabins are reported to have burned to the ground , but as of yet , no permanent dwellings or farms have been damaged .

source_bert_toks: approximately 15 cabins are reported to have burned to the ground , but as of yet , no permanent dwellings or farms have been damaged .

reference_raw: Some 15 cabins are reported to have been burned to the ground, but so far no permanent dwellings or farms have been damaged.

reference_spacy_tokens: Some 15 cabins are reported to have been burned to the ground , but so far no permanent dwellings or farms have been damaged .


fn_spacy_tokens_for_baseline: If you want to motivate them to go out and sell that product , you 've got to make them feel it is important to them .

source_bert_toks: if you want to mo ##tiv ##ate them to go out and sell that product , you ' ve got to make them feel it is important to them .

reference_raw: If you're going to encourage them to go out and sell the product, you're going to have to make them think it's important to them.

reference_spacy_tokens: If you 're going to encourage them to go out and sell the product , you 're going to have to make them think it 's important to them .


fn_spacy_tokens_for_baseline: Brian Talbot , the West Bromwich Albion player - manager , has pulled a muscle in his back and is struggling to be fit in time to face Wolves , at The Hawthorns on Sunday .

source_bert_toks: brian talbot , the west bromwich albion player - manager , has pulled a muscle in his back and is struggling to be fit in time to face wolves , at the hawthorn ##s on sunday .

reference_raw: Brian Talbot, the West Bromwich Albion Manager, drew a muscle in his back and struggles to face the Wolves on Sunday at the Hawthorns.

reference_spacy_tokens: Brian Talbot , the West Bromwich Albion Manager , drew a muscle in his back and struggles to face the Wolves on Sunday at the Hawthorns .


fn_spacy_tokens_for_baseline: " The way I see this song is like , I 'm an alien on this planet . " he continues , worryingly .

source_bert_toks: " the way i see this song is like , i ' m an alien on this planet . " he continues , worrying ##ly .

reference_raw: "As far as I'm concerned, I'm an alien on this planet," he goes on, anxiously.

reference_spacy_tokens: " As far as I 'm concerned , I 'm an alien on this planet , " he goes on , anxiously .


fn_spacy_tokens_for_baseline: Each ear of each child was investigated separately , thus enabling the comparison of four different types of ear : unoperated , ventilation tube alone , adenoidectomy alone , and adenoidectomy in combination with a tube .

source_bert_toks: each ear of each child was investigated separately , thus enabling the comparison of four different types of ear : uno ##per ##ated , ventilation tube alone , aden ##oid ##ect ##omy alone , and aden ##oid ##ect ##omy in combination with a tube .

reference_raw: Each hearing of each child has been examined separately to make it possible to compare four different types of hearing: unoperated, ventilation tube alone, adenoidectomy alone, and adenoidectomy in combination with a tube.

reference_spacy_tokens: Each hearing of each child has been examined separately to make it possible to compare four different types of hearing : unoperated , ventilation tube alone , adenoidectomy alone , and adenoidectomy in combination with a tube .


fn_spacy_tokens_for_baseline: If you are a compulsive nibbler , better you should nibble on raw carrots , sunflower seeds , and pistachio nuts than anything else .

source_bert_toks: if you are a com ##pu ##ls ##ive ni ##bble ##r , better you should ni ##bble on raw carrot ##s , sun ##flower seeds , and pi ##sta ##chio nuts than anything else .

reference_raw: If you're a compulsive nibbler, it's better to eat raw carrots, sunflower seeds, and pistachio peanuts than anything else.

reference_spacy_tokens: If you 're a compulsive nibbler , it 's better to eat raw carrots , sunflower seeds , and pistachio peanuts than anything else .


fn_spacy_tokens_for_baseline: This Germanic organization remains extremely vague in Formen and the reason seems to come from the paucity and dubiousness of Marx 's sources for the construction of this mode of production .

source_bert_toks: this germanic organization remains extremely vague in form ##en and the reason seems to come from the pau ##city and dubious ##ness of marx ' s sources for the construction of this mode of production .

reference_raw: This German organisation is still very vague in Formen, and the reason seems to stem from the lack of clarity and doubt on the part of Marx's resources for the construction of this type of production.

reference_spacy_tokens: This German organisation is still very vague in Formen , and the reason seems to stem from the lack of clarity and doubt on the part of Marx 's resources for the construction of this type of production .


fn_spacy_tokens_for_baseline: There 's no reason to feel dejected about the future .

source_bert_toks: there ' s no reason to feel de ##jected about the future .

reference_raw: There's no reason to feel unhappy about the future.

reference_spacy_tokens: There 's no reason to feel unhappy about the future .


fn_spacy_tokens_for_baseline: The TNRC operates , among other things , a 5 MW research reactor .

source_bert_toks: the tn ##rc operates , among other things , a 5 mw research reactor .

reference_raw: The TNRC carries out, inter alia, a research reactor of 5 MW.

reference_spacy_tokens: The TNRC carries out , inter alia , a research reactor of 5 MW .


fn_spacy_tokens_for_baseline: It was intensified when they noticed the attire of their maitre .

source_bert_toks: it was intensified when they noticed the attire of their mai ##tre .

reference_raw: It intensified when they noticed the maitre's clothing.

reference_spacy_tokens: It intensified when they noticed the maitre 's clothing .


fn_spacy_tokens_for_baseline: The Gulchers -- Bob Livingston , Haley Barbour , Tommy Boggs -- are Washington High 's most successful graduates .

source_bert_toks: the gu ##lch ##ers - - bob livingston , haley bar ##bour , tommy bog ##gs - - are washington high ' s most successful graduates .

reference_raw: The Gulchers - Bob Livingston, Haley Barbour, Tommy Boggs - are the best graduates in Washington High.

reference_spacy_tokens: The Gulchers - Bob Livingston , Haley Barbour , Tommy Boggs - are the best graduates in Washington High .


fn_spacy_tokens_for_baseline: The resort is now even easier to get to , thanks to the new A55 Expressway .

source_bert_toks: the resort is now even easier to get to , thanks to the new a ##55 expressway .

reference_raw: Thanks to the new A55 Highway, the resort is even easier to get to.

reference_spacy_tokens: Thanks to the new A55 Highway , the resort is even easier to get to .


fn_spacy_tokens_for_baseline: Kadafi and at least two of his sons remain fugitives .

source_bert_toks: ka ##da ##fi and at least two of his sons remain fugitive ##s .

reference_raw: Kadafi and at least two of his sons are still on the run.

reference_spacy_tokens: Kadafi and at least two of his sons are still on the run .


fn_spacy_tokens_for_baseline: And down a tight , twisty road it would disappear from either in a short order .

source_bert_toks: and down a tight , twist ##y road it would disappear from either in a short order .

reference_raw: And along the narrow, twisting road, he would disappear from both of them in a short order.

reference_spacy_tokens: And along the narrow , twisting road , he would disappear from both of them in a short order .


fn_spacy_tokens_for_baseline: Protestors are furious that hundreds of 150 ft . pylons would cut through some of the region 's most beautiful countryside , disrupt farming , devalue property and risk health problems from electromagnetic fields .

source_bert_toks: protest ##ors are furious that hundreds of 150 ft . p ##yl ##ons would cut through some of the region ' s most beautiful countryside , disrupt farming , dev ##al ##ue property and risk health problems from electromagnetic fields .

reference_raw: The protestors are furious that hundreds of 150 ft. pylons would break through the most beautiful landscapes in the region, disrupt agriculture, devalue property, and risk health problems caused by electromagnetic fields.

reference_spacy_tokens: The protestors are furious that hundreds of 150 ft . pylons would break through the most beautiful landscapes in the region , disrupt agriculture , devalue property , and risk health problems caused by electromagnetic fields .


fn_spacy_tokens_for_baseline: Thatcher and her supporters ' seem intent on doing to the NHS what they have done to other public services such as gas and water .

source_bert_toks: thatcher and her supporters ' seem intent on doing to the nhs what they have done to other public services such as gas and water .

reference_raw: Thatcher and her supporters seem to want to do to the NHS what they did to other public utilities like gas and water.

reference_spacy_tokens: Thatcher and her supporters seem to want to do to the NHS what they did to other public utilities like gas and water .


fn_spacy_tokens_for_baseline: You know not the innocence you abuse so freely Would to God that instead of a woman and my sister , any man breathing had dared to give himself half the airs you have done .

source_bert_toks: you know not the innocence you abuse so freely would to god that instead of a woman and my sister , any man breathing had dared to give himself half the airs you have done .

reference_raw: You don't know the innocence you use so freely would have to God that instead of a woman and my sister, every man who breathes dares to give himself half the air you've done.

reference_spacy_tokens: You do n't know the innocence you use so freely would have to God that instead of a woman and my sister , every man who breathes dares to give himself half the air you 've done .


fn_spacy_tokens_for_baseline: Left alone the dog becomes stressed , insecure and lonely .

source_bert_toks: left alone the dog becomes stressed , ins ##ecure and lonely .

reference_raw: The dog, left alone, is distressed, uncertain, and alone.

reference_spacy_tokens: The dog , left alone , is distressed , uncertain , and alone .


fn_spacy_tokens_for_baseline: The chairman of the Department of Medicine at Sydney Hospital , John Graham , told a biosecurity workshop last week that he had appealed to the Federal Government to remove the hospital from state control and declare it a ' national security hospital ' .

source_bert_toks: the chairman of the department of medicine at sydney hospital , john graham , told a bio ##se ##cu ##rity workshop last week that he had appealed to the federal government to remove the hospital from state control and declare it a ' national security hospital ' .

reference_raw: Last week, the chairman of the Sydney Medical Department, John Graham, informed a biosecurity seminar that he had appealed to the federal government to remove the hospital from state control and declare it "National Security Hospital."

reference_spacy_tokens: Last week , the chairman of the Sydney Medical Department , John Graham , informed a biosecurity seminar that he had appealed to the federal government to remove the hospital from state control and declare it " National Security Hospital . "


fn_spacy_tokens_for_baseline: They could lodge with Grandpa during the week and go home at week - ends .

source_bert_toks: they could lodge with grandpa during the week and go home at week - ends .

reference_raw: They could stay with their grandfather during the week and go home at the end of the week.

reference_spacy_tokens: They could stay with their grandfather during the week and go home at the end of the week .


fn_spacy_tokens_for_baseline: The DAR must keep all their ammo in the bus , the Sandrat thought .

source_bert_toks: the dar must keep all their am ##mo in the bus , the sandra ##t thought .

reference_raw: The DAR had to keep all their ammunition on the bus, Sandrat thought.

reference_spacy_tokens: The DAR had to keep all their ammunition on the bus , Sandrat thought .


fn_spacy_tokens_for_baseline: It takes more than promenading on the streets to learn one of the world 's most difficult languages , James Meek finds

source_bert_toks: it takes more than prom ##ena ##ding on the streets to learn one of the world ' s most difficult languages , james meek finds

reference_raw: It takes more than streetwalking to learn one of the most difficult languages in the world, James Meek finds

reference_spacy_tokens: It takes more than streetwalking to learn one of the most difficult languages in the world , James Meek finds


fn_spacy_tokens_for_baseline: The trampoline was more unnerving .

source_bert_toks: the tram ##pol ##ine was more un ##ner ##ving .

reference_raw: The trampoline was more nervous.

reference_spacy_tokens: The trampoline was more nervous .


fn_spacy_tokens_for_baseline: Also there had been a note of incredulity in Vigo 's voice as if he marvelled at such an old goose begetting a swan .

source_bert_toks: also there had been a note of inc ##red ##uli ##ty in vi ##go ' s voice as if he marvel ##led at such an old goose beg ##etti ##ng a swan .

reference_raw: There was also an incredulity in Vigo's voice, as if he had marveled at such an old goose who had produced a swan.

reference_spacy_tokens: There was also an incredulity in Vigo 's voice , as if he had marveled at such an old goose who had produced a swan .


fn_spacy_tokens_for_baseline: The nuclear , biological and chemical reconnaissance vehicle is the ninth variant .

source_bert_toks: the nuclear , biological and chemical reconnaissance vehicle is the ninth variant .

reference_raw: The ninth option is a nuclear, biological and chemical research vehicle.

reference_spacy_tokens: The ninth option is a nuclear , biological and chemical research vehicle .


fn_spacy_tokens_for_baseline: For all this , the Eclipse is no bulkier than our more modest cookers .

source_bert_toks: for all this , the eclipse is no bulk ##ier than our more modest cooke ##rs .

reference_raw: In spite of all this, the Eclipse is no larger than our humble cooks.

reference_spacy_tokens: In spite of all this , the Eclipse is no larger than our humble cooks .


fn_spacy_tokens_for_baseline: Over the years , the United States has successfully blocked several of Iran 's nuclear agreements , such as those with Argentina ( uranium enrichment and heavy water production facilities ) , China ( plutonium - producing research reactor , two power reactors and a uranium conversion plant ) , and Russia ( heavy water production plant ) .

source_bert_toks: over the years , the united states has successfully blocked several of iran ' s nuclear agreements , such as those with argentina ( uranium enrichment and heavy water production facilities ) , china ( pluto ##nium - producing research reactor , two power reactors and a uranium conversion plant ) , and russia ( heavy water production plant ) .

reference_raw: Over the years, the US has successfully blocked a number of Iran's nuclear agreements, such as those with Argentina (uranium enrichment and heavy water production facilities), China (plutonium-producing research reactor, two power reactors and a uranium conversion plant) and Russia (heavy water production plant).

reference_spacy_tokens: Over the years , the US has successfully blocked a number of Iran 's nuclear agreements , such as those with Argentina ( uranium enrichment and heavy water production facilities ) , China ( plutonium - producing research reactor , two power reactors and a uranium conversion plant ) and Russia ( heavy water production plant ) .


fn_spacy_tokens_for_baseline: Whether commissioned as a promotional tool or not , the showing of such films has had a major effect on the outside world 's perception of Edinburgh .

source_bert_toks: whether commissioned as a promotional tool or not , the showing of such films has had a major effect on the outside world ' s perception of edinburgh .

reference_raw: Whether commissioned as a promotional tool or not, the presentation of such films has had a significant impact on the outside world's view of Edinburgh.

reference_spacy_tokens: Whether commissioned as a promotional tool or not , the presentation of such films has had a significant impact on the outside world 's view of Edinburgh .


fn_spacy_tokens_for_baseline: I think my dog go bite one of them white dudes . '

source_bert_toks: i think my dog go bite one of them white dude ##s . '

reference_raw: I think my dog's going to bite one of those white guys.'

reference_spacy_tokens: I think my dog 's going to bite one of those white guys . '


fn_spacy_tokens_for_baseline: She was led away into a crisp - looking cell where she was measured and weighed ; a careful , polite pair of hands found a vein in her strong arm and removed a vial of her blood .

source_bert_toks: she was led away into a crisp - looking cell where she was measured and weighed ; a careful , polite pair of hands found a vein in her strong arm and removed a vial of her blood .

reference_raw: They led her to a crisp-looking cell, where she was measured and weighed; a careful, courteous pair of hands found a vein in her strong arm and removed a bottle of blood.

reference_spacy_tokens: They led her to a crisp - looking cell , where she was measured and weighed ; a careful , courteous pair of hands found a vein in her strong arm and removed a bottle of blood .


fn_spacy_tokens_for_baseline: Maltravers nudged Stephen 's leg with his foot , indicating he wanted him to stay quiet .

source_bert_toks: mal ##tra ##vers nudged stephen ' s leg with his foot , indicating he wanted him to stay quiet .

reference_raw: Maltravers put his foot on Stephen's leg, indicating that he wanted to keep his mouth shut.

reference_spacy_tokens: Maltravers put his foot on Stephen 's leg , indicating that he wanted to keep his mouth shut .


fn_spacy_tokens_for_baseline: A tall woman with the chic , efficient look that spells Milan held up her notebook , and Di Leonardo immediately nodded encouragingly at her .

source_bert_toks: a tall woman with the chi ##c , efficient look that spells milan held up her notebook , and di leonardo immediately nodded encouraging ##ly at her .

reference_raw: The big woman with the chic, effective look that spelled Milan held up her notebook, and Di Leonardo gave her an immediate nod of encouragement.

reference_spacy_tokens: The big woman with the chic , effective look that spelled Milan held up her notebook , and Di Leonardo gave her an immediate nod of encouragement .


fn_spacy_tokens_for_baseline: Graham Stuart tormented and teased Gary Ablett mercilessly throughout , beating the ex - Liverpool defender at will .

source_bert_toks: graham stuart tormented and teased gary able ##tt mer ##ci ##lessly throughout , beating the ex - liverpool defender at will .

reference_raw: Graham Stuart tortured and teased Gary Ablett mercilessly throughout, beating the former Liverpool defender at will.

reference_spacy_tokens: Graham Stuart tortured and teased Gary Ablett mercilessly throughout , beating the former Liverpool defender at will .


fn_spacy_tokens_for_baseline: When the bill came , Maitre Perreyve paid it cheerfully , and Anthony Everard , demurring to begin with , finally capitulated with a gracious closing of the eyes in acknowledgement .

source_bert_toks: when the bill came , mai ##tre per ##rey ##ve paid it cheerfully , and anthony ever ##ard , dem ##ur ##ring to begin with , finally cap ##it ##ulated with a gr ##acious closing of the eyes in acknowledge ##ment .

reference_raw: When the bill came, Maitre Perreyve paid it merrily, and Anthony Everard, demurring to begin with, finally surrendered with a kindly close of his eyes in acknowledgment.

reference_spacy_tokens: When the bill came , Maitre Perreyve paid it merrily , and Anthony Everard , demurring to begin with , finally surrendered with a kindly close of his eyes in acknowledgment .


fn_spacy_tokens_for_baseline: Her body chilled at the thought .

source_bert_toks: her body chilled at the thought .

reference_raw: The thought made her body cold.

reference_spacy_tokens: The thought made her body cold .


fn_spacy_tokens_for_baseline: Though she was usually timid , this accusation outraged Florrie .

source_bert_toks: though she was usually tim ##id , this accusation outraged fl ##or ##rie .

reference_raw: Although she was usually shy, Florrie was outraged by the accusation.

reference_spacy_tokens: Although she was usually shy , Florrie was outraged by the accusation .


fn_spacy_tokens_for_baseline: I suppose you could n't be prevailed upon to play for us too ? '

source_bert_toks: i suppose you couldn ' t be prevailed upon to play for us too ? '

reference_raw: I don't suppose we can win you to play for us, too?'

reference_spacy_tokens: I do n't suppose we can win you to play for us , too ? '


fn_spacy_tokens_for_baseline: Everyone sits on verandahs endlessly and drinks . '

source_bert_toks: everyone sits on verandah ##s endless ##ly and drinks . '

reference_raw: 'Everyone sits on the porch and drinks endlessly.'

reference_spacy_tokens: ' Everyone sits on the porch and drinks endlessly . '


fn_spacy_tokens_for_baseline: The wiry psychologist shook his head , almost dislodging his embroidered skullcap in the process .

source_bert_toks: the wi ##ry psychologist shook his head , almost di ##sl ##od ##ging his embroidered skull ##cap in the process .

reference_raw: The wiry psychologist shook his head, almost removing his embroidered headcap.

reference_spacy_tokens: The wiry psychologist shook his head , almost removing his embroidered headcap .


fn_spacy_tokens_for_baseline: It exasperated his grandmother to see this forceful spirit drifting like a rudderless boat , directed neither to work nor to leisure .

source_bert_toks: it exasperated his grandmother to see this forceful spirit drifting like a rudder ##less boat , directed neither to work nor to leisure .

reference_raw: It irritated his grandmother to see the powerful spirit drifting like a rudderless ship, directing neither work nor leisure.

reference_spacy_tokens: It irritated his grandmother to see the powerful spirit drifting like a rudderless ship , directing neither work nor leisure .


fn_spacy_tokens_for_baseline: Only two months later , the Korean Workers ' Party Central Committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

source_bert_toks: only two months later , the korean workers ' party central committee adopted policies to strengthen the military and to implement import - substitution programs to reduce dependency on arms imports .

reference_raw: Only two months after that, the Central Committee of Korean Workers adopted policies to strengthen the military and implement import-replacement programs to reduce dependence on arms imports.

reference_spacy_tokens: Only two months after that , the Central Committee of Korean Workers adopted policies to strengthen the military and implement import - replacement programs to reduce dependence on arms imports .


fn_spacy_tokens_for_baseline: In 1982 , as the war dragged on into its second year , Iraqi operations entered a new phase in which it expanded the use of FROG-7As strikes and the first employment ( three attacks in 1982 ) of the Scud - B short - range ballistic missile ( SRBM ) to strike at the Iranian strategic rear .

source_bert_toks: in 1982 , as the war dragged on into its second year , iraqi operations entered a new phase in which it expanded the use of frog - 7 ##as strikes and the first employment ( three attacks in 1982 ) of the sc ##ud - b short - range ballistic missile ( sr ##bm ) to strike at the iranian strategic rear .

reference_raw: In 1982, as the war continued in its second year, Iraqi operations entered a new phase in which they expanded the use of FROG-7A strikes and the first employment (three strikes in 1982) of the Scud-B short-range ballistic missile (SRBM) to attack Iran's strategic rear.

reference_spacy_tokens: In 1982 , as the war continued in its second year , Iraqi operations entered a new phase in which they expanded the use of FROG-7A strikes and the first employment ( three strikes in 1982 ) of the Scud - B short - range ballistic missile ( SRBM ) to attack Iran 's strategic rear .


fn_spacy_tokens_for_baseline: I refrained because the evidence suggested the answers would all be negative .

source_bert_toks: i refrain ##ed because the evidence suggested the answers would all be negative .

reference_raw: I abstained because the evidence suggested that all the answers would be negative.

reference_spacy_tokens: I abstained because the evidence suggested that all the answers would be negative .


fn_spacy_tokens_for_baseline: Sam took it upon herself to plaster the walls .

source_bert_toks: sam took it upon herself to plaster the walls .

reference_raw: Sam took it on herself to cover the walls.

reference_spacy_tokens: Sam took it on herself to cover the walls .


fn_spacy_tokens_for_baseline: The lower part of the bottle is covered on its exterior with a thin layer of lead ( obtained from deliveries of , for example , 125 I ) .

source_bert_toks: the lower part of the bottle is covered on its exterior with a thin layer of lead ( obtained from deliveries of , for example , 125 i ) .

reference_raw: The lower part of the bottle is covered with a thin layer of lead (e.g., 125 I) on the outside.

reference_spacy_tokens: The lower part of the bottle is covered with a thin layer of lead ( e.g. , 125 I ) on the outside .


fn_spacy_tokens_for_baseline: It seems that those external changes are somehow detected by the pineal gland , for experimental animals deprived of their pineal are slower to entrain , but the mechanism is not known .

source_bert_toks: it seems that those external changes are somehow detected by the pine ##al gland , for experimental animals deprived of their pine ##al are slower to en ##train , but the mechanism is not known .

reference_raw: These external changes appear to be detected in some way in the pineal gland, because experimental animals depleted from their pineals are slower to enter the train, but the mechanism is unknown.

reference_spacy_tokens: These external changes appear to be detected in some way in the pineal gland , because experimental animals depleted from their pineals are slower to enter the train , but the mechanism is unknown .


fn_spacy_tokens_for_baseline: Does the right hon . and learned Gentleman accept that while juries are unequalled in deciding dishonesty , the burden of lengthy trials is becoming unfair on jurors ?

source_bert_toks: does the right hon . and learned gentleman accept that while ju ##ries are une ##qual ##led in deciding dish ##ones ##ty , the burden of lengthy trials is becoming unfair on ju ##ror ##s ?

reference_raw: Does the right hon. and learned Gentleman accept that while the judges are uneven in their judgment of dishonesty, the burden of long trials is becoming unfair to the judges?

reference_spacy_tokens: Does the right hon . and learned Gentleman accept that while the judges are uneven in their judgment of dishonesty , the burden of long trials is becoming unfair to the judges ?


fn_spacy_tokens_for_baseline: Insurgents also ambushed a provincial justice minister , who was wounded but survived .

source_bert_toks: insurgents also ambushed a provincial justice minister , who was wounded but survived .

reference_raw: The rebels also attacked the Provincial Justice Minister, who was injured but survived.

reference_spacy_tokens: The rebels also attacked the Provincial Justice Minister , who was injured but survived .


fn_spacy_tokens_for_baseline: Any suspicious images can then be double - checked by a radiologist before any decision is taken to treat the patient .

source_bert_toks: any suspicious images can then be double - checked by a radio ##logist before any decision is taken to treat the patient .

reference_raw: The radiologist may then check any suspicious images before deciding to treat the patient.

reference_spacy_tokens: The radiologist may then check any suspicious images before deciding to treat the patient .


fn_spacy_tokens_for_baseline: Since HWIM 's grammar was far less tightly constrained than the finite state grammar used in HARPY , the system hypothesised a considerable number of words at the beginning of an utterance .

source_bert_toks: since h ##wi ##m ' s grammar was far less tightly constrained than the finite state grammar used in harp ##y , the system hypothesis ##ed a considerable number of words at the beginning of an utter ##ance .

reference_raw: Since HWIM's grammar was much less limited than the final state grammar used in HARPY, the system assumed a significant number of words at the beginning of the speech.

reference_spacy_tokens: Since HWIM 's grammar was much less limited than the final state grammar used in HARPY , the system assumed a significant number of words at the beginning of the speech .


fn_spacy_tokens_for_baseline: Hence , the leaden delivery of some Euro - platitudes , by a woman who really ought to be able to do a better job of reading other people 's speeches after 40 years of doing little else , carries more political import than anything else that has been said about Europe since the election .

source_bert_toks: hence , the lead ##en delivery of some euro - pl ##ati ##tu ##des , by a woman who really ought to be able to do a better job of reading other people ' s speeches after 40 years of doing little else , carries more political import than anything else that has been said about europe since the election .

reference_raw: Thus, the leading delivery of certain Euro-platitudes by a woman who should really be able to read other people's speeches after 40 years of doing nothing else is more politically important than anything that has been said about Europe since the election.

reference_spacy_tokens: Thus , the leading delivery of certain Euro - platitudes by a woman who should really be able to read other people 's speeches after 40 years of doing nothing else is more politically important than anything that has been said about Europe since the election .


fn_spacy_tokens_for_baseline: The development will bring a jauntily commercial air to the site of the 1690 battle where William III ( ' King Billy ' , above ) defeated the Catholic James II .

source_bert_toks: the development will bring a ja ##unt ##ily commercial air to the site of the 1690 battle where william iii ( ' king billy ' , above ) defeated the catholic james ii .

reference_raw: Development will bring a jauntily commercial air to the scene of the 1690 battle, where William III ('King Billy', above) defeated the Catholic James II.

reference_spacy_tokens: Development will bring a jauntily commercial air to the scene of the 1690 battle , where William III ( ' King Billy ' , above ) defeated the Catholic James II .


fn_spacy_tokens_for_baseline: The events had been very tiring and we were glad to find our beds that night .

source_bert_toks: the events had been very ti ##ring and we were glad to find our beds that night .

reference_raw: The events were very exhausting, and we were happy to find our beds that night.

reference_spacy_tokens: The events were very exhausting , and we were happy to find our beds that night .


fn_spacy_tokens_for_baseline: This can be dangerous work : three field workers in Korup were trapped behind a tree by an enraged elephant after their tranquilliser dart missed its target .

source_bert_toks: this can be dangerous work : three field workers in ko ##rup were trapped behind a tree by an enraged elephant after their tran ##quil ##lis ##er dart missed its target .

reference_raw: This could be a dangerous job: three field workers in Korup were trapped behind a tree by an angry elephant when the sedative dart missed the target.

reference_spacy_tokens: This could be a dangerous job : three field workers in Korup were trapped behind a tree by an angry elephant when the sedative dart missed the target .


fn_spacy_tokens_for_baseline: As he lay musing in his sleep - cell , doubts assailed him .

source_bert_toks: as he lay mu ##sing in his sleep - cell , doubts ass ##ailed him .

reference_raw: As he lay pondering in his sleep cell, he was attacked by doubt.

reference_spacy_tokens: As he lay pondering in his sleep cell , he was attacked by doubt .


fn_spacy_tokens_for_baseline: ' Later , ' he said , resting his cigar carefully in an ashtray .

source_bert_toks: ' later , ' he said , resting his cigar carefully in an ash ##tray .

reference_raw: "Later," he said, putting his cigar carefully into the ashtray.

reference_spacy_tokens: " Later , " he said , putting his cigar carefully into the ashtray .


fn_spacy_tokens_for_baseline: Off stage , singer Sheila Ferguson cooks up a soul food storm

source_bert_toks: off stage , singer sheila ferguson cooks up a soul food storm

reference_raw: On stage, the singer Sheila Ferguson is making a storm of soul food.

reference_spacy_tokens: On stage , the singer Sheila Ferguson is making a storm of soul food .


fn_spacy_tokens_for_baseline: There are also souvenir stands , benches for a rest , and perhaps Hong Kong 's last surviving rickshaws - however these are not for rides , but are a tourist photo opportunity .

source_bert_toks: there are also so ##uven ##ir stands , benches for a rest , and perhaps hong kong ' s last surviving rick ##shaw ##s - however these are not for rides , but are a tourist photo opportunity .

reference_raw: There are also souvenir stands, benches to relax, and perhaps the last surviving Hong Kong rickshaws - but they are not for rides, but for tourist photography.

reference_spacy_tokens: There are also souvenir stands , benches to relax , and perhaps the last surviving Hong Kong rickshaws - but they are not for rides , but for tourist photography .


fn_spacy_tokens_for_baseline: Active sleep is easily identifiable with adult REM sleep , and the neonate will spend between 60 and 80 per cent of sleeping time in active ( REM ) sleep -- ten to thirteen hours .

source_bert_toks: active sleep is easily identifiable with adult re ##m sleep , and the neon ##ate will spend between 60 and 80 per cent of sleeping time in active ( re ##m ) sleep - - ten to thirteen hours .

reference_raw: Active sleep is easy to identify with adult REM sleep, and the newborn spends between 60 and 80 percent of the sleep time in active (REM) sleep - 10 and 13 hours.

reference_spacy_tokens: Active sleep is easy to identify with adult REM sleep , and the newborn spends between 60 and 80 percent of the sleep time in active ( REM ) sleep - 10 and 13 hours .


fn_spacy_tokens_for_baseline: The above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

source_bert_toks: the above mentioned protection procedures are only for observation purposes , while patrols check the fences , the barriers , and the towers , and submit periodic reports on their findings .

reference_raw: The above-mentioned protection practices are for observation purposes only, whereas patrols check fences, barriers and towers and report regularly on their findings.

reference_spacy_tokens: The above - mentioned protection practices are for observation purposes only , whereas patrols check fences , barriers and towers and report regularly on their findings .


fn_spacy_tokens_for_baseline: Dolly pushed the cruet across .

source_bert_toks: dolly pushed the cr ##uet across .

reference_raw: Dolly pushed him across the street.

reference_spacy_tokens: Dolly pushed him across the street .


fn_spacy_tokens_for_baseline: North Korea also allegedly provided more than 10 scientists to work on the Libyan missile program .

source_bert_toks: north korea also allegedly provided more than 10 scientists to work on the libyan missile program .

reference_raw: North Korea also reportedly provided more than 10 scientists for the Libyan missile program.

reference_spacy_tokens: North Korea also reportedly provided more than 10 scientists for the Libyan missile program .


fn_spacy_tokens_for_baseline: The king crabs have a nearly circular carapace , beneath which powerful legs helped the animal to swim and catch prey .

source_bert_toks: the king crabs have a nearly circular cara ##pace , beneath which powerful legs helped the animal to swim and catch prey .

reference_raw: King Crabs have an almost round shell, under which strong feet help the beast swim and catch prey.

reference_spacy_tokens: King Crabs have an almost round shell , under which strong feet help the beast swim and catch prey .


fn_spacy_tokens_for_baseline: He 's elected by the community but this a special blessing before he really takes over and wears his mitre and crozier .

source_bert_toks: he ' s elected by the community but this a special blessing before he really takes over and wears his mit ##re and cr ##oz ##ier .

reference_raw: He's elected by the community, but it's a special blessing before he actually takes over and wears his miter and crozier.

reference_spacy_tokens: He 's elected by the community , but it 's a special blessing before he actually takes over and wears his miter and crozier .


fn_spacy_tokens_for_baseline: On the ground floor my interpreter from the Bengali Housing Association led the way into a small , bare flat inhabited by a Bengali widow with three children of six , eight and nine .

source_bert_toks: on the ground floor my interpreter from the bengali housing association led the way into a small , bare flat inhabited by a bengali widow with three children of six , eight and nine .

reference_raw: On the ground floor, my interpreter from the Bengali Housing Association led me to a small, barren apartment occupied by a Bengal widow with three children of six, eight and nine.

reference_spacy_tokens: On the ground floor , my interpreter from the Bengali Housing Association led me to a small , barren apartment occupied by a Bengal widow with three children of six , eight and nine .


fn_spacy_tokens_for_baseline: Agents are notified of performances by the schools , and they also receive hundreds of letters from students inviting them to see particular performances .

source_bert_toks: agents are notified of performances by the schools , and they also receive hundreds of letters from students inviting them to see particular performances .

reference_raw: The staff are informed of the performances of the schools, and they are also given 100 letters from students inviting them to attend specific performances.

reference_spacy_tokens: The staff are informed of the performances of the schools , and they are also given 100 letters from students inviting them to attend specific performances .


fn_spacy_tokens_for_baseline: He had virtually lived his entire life in a stable as he was ' far too valuable to run the risk of being out in a yard ! '

source_bert_toks: he had virtually lived his entire life in a stable as he was ' far too valuable to run the risk of being out in a yard ! '

reference_raw: He'd practically lived his whole life in a barn, because he'd been too valuable to risk being out in the yard!

reference_spacy_tokens: He 'd practically lived his whole life in a barn , because he 'd been too valuable to risk being out in the yard !


fn_spacy_tokens_for_baseline: In every second town we reach , he finds some villain or slut to act up in the crowd .

source_bert_toks: in every second town we reach , he finds some villain or sl ##ut to act up in the crowd .

reference_raw: Every second in the city we reach, he'll find a bad guy or a whore to play in the crowd.

reference_spacy_tokens: Every second in the city we reach , he 'll find a bad guy or a whore to play in the crowd .


fn_spacy_tokens_for_baseline: Her arms hugged around herself , she stood in the phone - box for a long time after she 'd replaced the receiver and it seemed quite incomprehensible to her now that she had n't contacted her mother before .

source_bert_toks: her arms hugged around herself , she stood in the phone - box for a long time after she ' d replaced the receiver and it seemed quite inc ##omp ##re ##hen ##sible to her now that she hadn ' t contacted her mother before .

reference_raw: She hugged herself, stood in the phone booth for a long time after she had replaced the phone, and now that she had not contacted her mother, she found it hard to understand.

reference_spacy_tokens: She hugged herself , stood in the phone booth for a long time after she had replaced the phone , and now that she had not contacted her mother , she found it hard to understand .


fn_spacy_tokens_for_baseline: I felt my jaws clench , teeth grind together .

source_bert_toks: i felt my jaws clench , teeth grind together .

reference_raw: I could feel my teeth clenched, my teeth clenched together.

reference_spacy_tokens: I could feel my teeth clenched , my teeth clenched together .


fn_spacy_tokens_for_baseline: Fortunately for the Government , this short debate in the House of Lords seems to have attracted little attention from the press , and it continued to receive general approbation for the exhibition , with the relevance of the competition remaining largely unquestioned .

source_bert_toks: fortunately for the government , this short debate in the house of lords seems to have attracted little attention from the press , and it continued to receive general app ##ro ##bation for the exhibition , with the relevance of the competition remaining largely un ##quest ##ioned .

reference_raw: Fortunately for the government, this brief debate in the House of Lords did not seem to draw much attention from the press, and it continued to receive general approval for the exhibition, and the importance of the competition remained largely undisputed.

reference_spacy_tokens: Fortunately for the government , this brief debate in the House of Lords did not seem to draw much attention from the press , and it continued to receive general approval for the exhibition , and the importance of the competition remained largely undisputed .


fn_spacy_tokens_for_baseline: On 14 October Louis XV himself signed orders instructing Admiral Conflans to set the whole invasion scheme in motion by clearing the way across the Channel .

source_bert_toks: on 14 october louis xv himself signed orders ins ##tructing admiral con ##fl ##ans to set the whole invasion scheme in motion by clearing the way across the channel .

reference_raw: On October 14, Louis XV himself signed an order order ordering Admiral Conflans to put the entire invasion plan in motion by clearing the way across the Channel.

reference_spacy_tokens: On October 14 , Louis XV himself signed an order order ordering Admiral Conflans to put the entire invasion plan in motion by clearing the way across the Channel .


fn_spacy_tokens_for_baseline: And they must advance an argument about why human nature , which has presumably evolved in response to an enormous array of random forces , tells us anything about what is good or desirable in terms of the traits humans should possess .

source_bert_toks: and they must advance an argument about why human nature , which has presumably evolved in response to an enormous array of random forces , tells us anything about what is good or desirable in terms of the traits humans should possess .

reference_raw: And they have to argue why human nature, which seems to have evolved in response to a vast array of random forces, has anything to say about what is good or desirable in terms of the qualities that people should have.

reference_spacy_tokens: And they have to argue why human nature , which seems to have evolved in response to a vast array of random forces , has anything to say about what is good or desirable in terms of the qualities that people should have .


fn_spacy_tokens_for_baseline: " Right now , we 're lucky if after five years we keep one new ringer out of 10 , " he adds .

source_bert_toks: " right now , we ' re lucky if after five years we keep one new ring ##er out of 10 , " he adds .

reference_raw: "We're lucky to have one new ringer out of ten after five years," he says.

reference_spacy_tokens: " We 're lucky to have one new ringer out of ten after five years , " he says .


fn_spacy_tokens_for_baseline: I fucked up , and I should face it . '

source_bert_toks: i fucked up , and i should face it . '

reference_raw: I screwed up, and I'm supposed to face it.'

reference_spacy_tokens: I screwed up , and I 'm supposed to face it . '


fn_spacy_tokens_for_baseline: ' Oh no , not again , ' remarks an attractive blonde whose car is stopped for the second ti me in a day .

source_bert_toks: ' oh no , not again , ' remarks an attractive blonde whose car is stopped for the second ti me in a day .

reference_raw: "No, not again," says the attractive blond, whose car stops for the second time in a day.

reference_spacy_tokens: " No , not again , " says the attractive blond , whose car stops for the second time in a day .


fn_spacy_tokens_for_baseline: Golden Buddha statues in several of Buddha 's aspects adorn the temples , and overlooking them is the 17 - story Flower Pagoda , a slender relic of the Song dynasty ( a.d . 960 - 1279 ) .

source_bert_toks: golden buddha statues in several of buddha ' s aspects ad ##orn the temples , and overlooking them is the 17 - story flower pagoda , a slender relic of the song dynasty ( a . d . 960 - 127 ##9 ) .

reference_raw: The golden Buddha sculptures in several aspects of Buddha adorn the temples and overlook them are the 17-story Flower Pagoda, the slender relic of the Song Dynasty (a.d. 960 - 1279).

reference_spacy_tokens: The golden Buddha sculptures in several aspects of Buddha adorn the temples and overlook them are the 17-story Flower Pagoda , the slender relic of the Song Dynasty ( a.d . 960 - 1279 ) .


fn_spacy_tokens_for_baseline: Sara did not chop parsley .

source_bert_toks: sara did not chop par ##sley .

reference_raw: Sara didn't cut Parsley.

reference_spacy_tokens: Sara did n't cut Parsley .


fn_spacy_tokens_for_baseline: He was a prosperous farmer who had sent his son to Balliol -- a college which owned land in the parish -- with the intention that he should eventually be ordained .

source_bert_toks: he was a prosperous farmer who had sent his son to ball ##iol - - a college which owned land in the parish - - with the intention that he should eventually be ordained .

reference_raw: He was a successful farmer who had sent his son to Balliol - a school that owned land in the parish - with the intention that he would eventually be punished.

reference_spacy_tokens: He was a successful farmer who had sent his son to Balliol - a school that owned land in the parish - with the intention that he would eventually be punished .


fn_spacy_tokens_for_baseline: Typically , the front top six teeth will decay because of the way the child has sucked on its bottle .

source_bert_toks: typically , the front top six teeth will decay because of the way the child has sucked on its bottle .

reference_raw: Usually the front six teeth fall apart because of the way the baby sucks on the bottle.

reference_spacy_tokens: Usually the front six teeth fall apart because of the way the baby sucks on the bottle .


fn_spacy_tokens_for_baseline: By the time he retired from his post eight years later 8,000 new jobs had been created and he believes the artistic opportunities presented by Theatr Clwyd played its part .

source_bert_toks: by the time he retired from his post eight years later 8 , 000 new jobs had been created and he believes the artistic opportunities presented by the ##at ##r cl ##wy ##d played its part .

reference_raw: When he left his post eight years later, 8,000 new jobs were created, and he believes that the artistic opportunities presented by Clwyd theatre played a role.

reference_spacy_tokens: When he left his post eight years later , 8,000 new jobs were created , and he believes that the artistic opportunities presented by Clwyd theatre played a role .


fn_spacy_tokens_for_baseline: There was this shooting in back of the hotel .

source_bert_toks: there was this shooting in back of the hotel .

reference_raw: There's been a shooting at the rear of the hotel.

reference_spacy_tokens: There 's been a shooting at the rear of the hotel .


fn_spacy_tokens_for_baseline: As she stepped , slivers of glass cracked and crunched beneath her feet .

source_bert_toks: as she stepped , sl ##iver ##s of glass cracked and crunch ##ed beneath her feet .

reference_raw: Shards of glass cracked and crunched under her feet as she stepped.

reference_spacy_tokens: Shards of glass cracked and crunched under her feet as she stepped .


fn_spacy_tokens_for_baseline: You 'd be in - have to be in - a cave not to know what 's going on .

source_bert_toks: you ' d be in - have to be in - a cave not to know what ' s going on .

reference_raw: You'd be in - you'd have to be in - a cave if you didn't know what was happening.

reference_spacy_tokens: You 'd be in - you 'd have to be in - a cave if you did n't know what was happening .


fn_spacy_tokens_for_baseline: In contrast to the Court which was a public affair , the Civil Cabinet functioned privately and discreetly , disbursing sums of money from the Emperor 's private purse , often for very private reasons .

source_bert_toks: in contrast to the court which was a public affair , the civil cabinet functioned privately and discreet ##ly , di ##sb ##urs ##ing sums of money from the emperor ' s private purse , often for very private reasons .

reference_raw: Unlike the Court of Justice, which was a public matter, the Civil Cabinet worked in a private and discreet manner, paying money out of the Emperor's private purse, often for very private reasons.

reference_spacy_tokens: Unlike the Court of Justice , which was a public matter , the Civil Cabinet worked in a private and discreet manner , paying money out of the Emperor 's private purse , often for very private reasons .


fn_spacy_tokens_for_baseline: But the peso 's abrupt tumble of nearly 35 percent underscores the sobering risks of investing in Latin America .

source_bert_toks: but the pe ##so ' s abrupt tumble of nearly 35 percent under ##sco ##res the sober ##ing risks of investing in latin america .

reference_raw: The sudden collapse of the peso, however, underscores the sobering risk of investing in Latin America.

reference_spacy_tokens: The sudden collapse of the peso , however , underscores the sobering risk of investing in Latin America .


fn_spacy_tokens_for_baseline: Finally , Meshkinpour 's figures were calculated on the basis of hospital charges for manometry , whereas our figure was derived from actual costs .

source_bert_toks: finally , mesh ##kin ##pour ' s figures were calculated on the basis of hospital charges for man ##ome ##try , whereas our figure was derived from actual costs .

reference_raw: Finally, Meshkinpour's data were calculated on the basis of hospital charges for manometry, while our value was derived from real costs.

reference_spacy_tokens: Finally , Meshkinpour 's data were calculated on the basis of hospital charges for manometry , while our value was derived from real costs .


fn_spacy_tokens_for_baseline: I avoided the mob on the path by descending 200 feet sledging on my rucksack on a long snow bank .

source_bert_toks: i avoided the mob on the path by descending 200 feet sl ##edging on my ru ##cks ##ack on a long snow bank .

reference_raw: I avoided the crowd on the road by dropping 200 feet into my backpack on the long snowbank.

reference_spacy_tokens: I avoided the crowd on the road by dropping 200 feet into my backpack on the long snowbank .


fn_spacy_tokens_for_baseline: The football authorities have not been the only ones to agonize over the impact of television on sport .

source_bert_toks: the football authorities have not been the only ones to ago ##ni ##ze over the impact of television on sport .

reference_raw: The football authorities were not the only ones suffering from the impact of television on sport.

reference_spacy_tokens: The football authorities were not the only ones suffering from the impact of television on sport .


fn_spacy_tokens_for_baseline: Steve , who was sitting next to John , got down in Rome .

source_bert_toks: steve , who was sitting next to john , got down in rome .

reference_raw: Steve, sitting next to John, went to Rome.

reference_spacy_tokens: Steve , sitting next to John , went to Rome .


fn_spacy_tokens_for_baseline: ' What did you tell the Queen ? ' she asked in a suspenseful whisper , her eyes clinging to his .

source_bert_toks: ' what did you tell the queen ? ' she asked in a suspense ##ful whisper , her eyes clinging to his .

reference_raw: "What did you say to the Queen?" she asked in a tense whisper, her eyes fixed on his.

reference_spacy_tokens: " What did you say to the Queen ? " she asked in a tense whisper , her eyes fixed on his .


fn_spacy_tokens_for_baseline: I trailed behind him .

source_bert_toks: i trailed behind him .

reference_raw: I followed him.

reference_spacy_tokens: I followed him .


fn_spacy_tokens_for_baseline: During the three decades after the establishment of the DPRK ( in 1947 ) , the North Korean CW program had uneven success in obtaining and weaponizing CW agents .

source_bert_toks: during the three decades after the establishment of the d ##pr ##k ( in 1947 ) , the north korean cw program had uneven success in obtaining and weapon ##izing cw agents .

reference_raw: During the three decades following the creation of the DPRK (in 1947), the North Korean CW program was unevenly successful in obtaining and arming CW agents.

reference_spacy_tokens: During the three decades following the creation of the DPRK ( in 1947 ) , the North Korean CW program was unevenly successful in obtaining and arming CW agents .


fn_spacy_tokens_for_baseline: The result was so spectacular that those of us in the front line who were showered with debris turned up at future games wearing motorbike goggles to protect our eyes and in honour of our hero .

source_bert_toks: the result was so spectacular that those of us in the front line who were showered with debris turned up at future games wearing motor ##bi ##ke go ##ggles to protect our eyes and in honour of our hero .

reference_raw: The result was so impressive that those of us in the front row, who were showered with debris, appeared at future games in motorcycle glasses to protect our eyes and honor our hero.

reference_spacy_tokens: The result was so impressive that those of us in the front row , who were showered with debris , appeared at future games in motorcycle glasses to protect our eyes and honor our hero .


fn_spacy_tokens_for_baseline: The second , also this weekend , resulted in thieves getting away with a further five thousand pound 's worth of silver jewellery .

source_bert_toks: the second , also this weekend , resulted in thieves getting away with a further five thousand pound ' s worth of silver jewellery .

reference_raw: The second, even this weekend, led the thieves to escape with another £5,000 worth of silver jewelry.

reference_spacy_tokens: The second , even this weekend , led the thieves to escape with another £ 5,000 worth of silver jewelry .


fn_spacy_tokens_for_baseline: The 24-year - old star , who once dated INXS singer Michael Hutchence , said her ambition is to settle down , have a house on the beach , and children .

source_bert_toks: the 24 - year - old star , who once dated in ##x ##s singer michael hut ##chen ##ce , said her ambition is to settle down , have a house on the beach , and children .

reference_raw: A 24-year-old star who used to go out with INXS singer Michael Hutchence said she wanted to settle down, have a beach house, and have kids.

reference_spacy_tokens: A 24-year - old star who used to go out with INXS singer Michael Hutchence said she wanted to settle down , have a beach house , and have kids .


fn_spacy_tokens_for_baseline: Visitors to the National Fishing Heritage Centre sign on as a crew member of a 1950 's steam trawler and journey to the Arctic fishing grounds .

source_bert_toks: visitors to the national fishing heritage centre sign on as a crew member of a 1950 ' s steam tr ##aw ##ler and journey to the arctic fishing grounds .

reference_raw: Visitors to the National Fisheries Heritage Centre shall register as a crew member of a 1950 steam trawler and go to the Arctic fishing grounds.

reference_spacy_tokens: Visitors to the National Fisheries Heritage Centre shall register as a crew member of a 1950 steam trawler and go to the Arctic fishing grounds .


fn_spacy_tokens_for_baseline: It is even becoming something of a commuter town - owning or renting an apartment here costs a fraction of what it would in Hong Kong .

source_bert_toks: it is even becoming something of a commuter town - owning or rent ##ing an apartment here costs a fraction of what it would in hong kong .

reference_raw: It's even becoming a commuter city - owning or renting an apartment here costs a fraction of what Hong Kong would do.

reference_spacy_tokens: It 's even becoming a commuter city - owning or renting an apartment here costs a fraction of what Hong Kong would do .


fn_spacy_tokens_for_baseline: Given Iran 's strong biotechnology and pharmaceutical infrastructure , it is not difficult to envision the development of a concealed BW program .

source_bert_toks: given iran ' s strong biotechnology and pharmaceutical infrastructure , it is not difficult to en ##vision the development of a concealed b ##w program .

reference_raw: In view of Iran's strong biotechnology and pharmaceutical infrastructure, it is not difficult to imagine the development of a hidden BV program.

reference_spacy_tokens: In view of Iran 's strong biotechnology and pharmaceutical infrastructure , it is not difficult to imagine the development of a hidden BV program .


fn_spacy_tokens_for_baseline: Climate and geology had combined in this part of the Oriental Region to produce ideal conditions for the creation of new species and subspecies .

source_bert_toks: climate and geology had combined in this part of the oriental region to produce ideal conditions for the creation of new species and subspecies .

reference_raw: In this part of the Oriental region, climate and geology have merged to create ideal conditions for the creation of new species and subspecies.

reference_spacy_tokens: In this part of the Oriental region , climate and geology have merged to create ideal conditions for the creation of new species and subspecies .


fn_spacy_tokens_for_baseline: He had decided , as advised , to plead guilty and proceedings had moved with dizzying speed .

source_bert_toks: he had decided , as advised , to plead guilty and proceedings had moved with dizzy ##ing speed .

reference_raw: He decided, as he had advised, to confess, and the proceedings moved with dizzying speed.

reference_spacy_tokens: He decided , as he had advised , to confess , and the proceedings moved with dizzying speed .


fn_spacy_tokens_for_baseline: Soldiers wore chemical suits , scanned the area and eventually neutralized the threat . " ( TheJacksonChannel.com , 20Apr06 , Greg Flynn ) ( Link )

source_bert_toks: soldiers wore chemical suits , scanned the area and eventually neutral ##ized the threat . " ( the ##jack ##son ##channel . com , 20 ##ap ##r ##0 ##6 , greg flynn ) ( link )

reference_raw: The soldiers wore chemical suits, scanned the area, and finally neutralized the threat." (JacksonChannel.com, 20Apr06, Greg Flynn)

reference_spacy_tokens: The soldiers wore chemical suits , scanned the area , and finally neutralized the threat . " ( JacksonChannel.com , 20Apr06 , Greg Flynn )


fn_spacy_tokens_for_baseline: Its surname is Canada ; and its christian name is Durham .

source_bert_toks: its surname is canada ; and its christian name is durham .

reference_raw: His last name is Canada, and he's Christine's name is Durham.

reference_spacy_tokens: His last name is Canada , and he 's Christine 's name is Durham .


fn_spacy_tokens_for_baseline: Something changed in his face then , some fleeting spectre that drained the life from his eyes and left them cold and hard .

source_bert_toks: something changed in his face then , some fleeting spec ##tre that drained the life from his eyes and left them cold and hard .

reference_raw: Then something changed in his face, a fleeting spectre that sucked the life out of his eyes and left it cold and hard.

reference_spacy_tokens: Then something changed in his face , a fleeting spectre that sucked the life out of his eyes and left it cold and hard .


fn_spacy_tokens_for_baseline: After Warwick , they turned their felonious talents to the smuggling trade .

source_bert_toks: after warwick , they turned their fe ##lon ##ious talents to the smuggling trade .

reference_raw: After Warwick, they turned their criminal talents into smuggling.

reference_spacy_tokens: After Warwick , they turned their criminal talents into smuggling .


fn_spacy_tokens_for_baseline: If , on the other hand , someone had dragged his unconscious body after slugging him with Dora 's missing golf - club , there might be other shreds of cloth lying about .

source_bert_toks: if , on the other hand , someone had dragged his unconscious body after slug ##ging him with dora ' s missing golf - club , there might be other sh ##red ##s of cloth lying about .

reference_raw: On the other hand, if someone had dragged his unconscious body after slugging him with Dora's missing golf club, there might have been other pieces of cloth lying around him.

reference_spacy_tokens: On the other hand , if someone had dragged his unconscious body after slugging him with Dora 's missing golf club , there might have been other pieces of cloth lying around him .


fn_spacy_tokens_for_baseline: He was a talkative man .

source_bert_toks: he was a talk ##ative man .

reference_raw: He was talking.

reference_spacy_tokens: He was talking .


fn_spacy_tokens_for_baseline: Rayon is frequently blended with other fibres and used extensively in furnishing fabrics .

source_bert_toks: rayon is frequently blended with other fibre ##s and used extensively in fur ##nish ##ing fabrics .

reference_raw: Rayon is often mixed with other fibres and used extensively in furniture.

reference_spacy_tokens: Rayon is often mixed with other fibres and used extensively in furniture .


fn_spacy_tokens_for_baseline: Oh , it can lead one to a rhymed couplet : He loves his brother and his wife , Does he live a double life ?

source_bert_toks: oh , it can lead one to a rhyme ##d couple ##t : he loves his brother and his wife , does he live a double life ?

reference_raw: Oh, that could lead to a rhyming couple: he loves his brother and his wife, he has a double life?

reference_spacy_tokens: Oh , that could lead to a rhyming couple : he loves his brother and his wife , he has a double life ?


fn_spacy_tokens_for_baseline: Dread on arriving at his own home had become an almost familiar sensation by now , but he did n't pause to dwell upon the fact .

source_bert_toks: dread on arriving at his own home had become an almost familiar sensation by now , but he didn ' t pause to dwell upon the fact .

reference_raw: The fear of coming to his house was now almost familiar, but he did not pause to think about it.

reference_spacy_tokens: The fear of coming to his house was now almost familiar , but he did not pause to think about it .


fn_spacy_tokens_for_baseline: She looked across the stream , through the leaves at the distant field ; at the nettles and the meadow - sweet and the wild roses ; down at the camomile daisies crushed under her feet .

source_bert_toks: she looked across the stream , through the leaves at the distant field ; at the net ##tle ##s and the meadow - sweet and the wild roses ; down at the cam ##omi ##le dai ##sies crushed under her feet .

reference_raw: She looked across the stream, through the leaves at the distant field, at the nettles and grassy sweets and wild roses, at the camomile daisies that had been smashed under her feet.

reference_spacy_tokens: She looked across the stream , through the leaves at the distant field , at the nettles and grassy sweets and wild roses , at the camomile daisies that had been smashed under her feet .


fn_spacy_tokens_for_baseline: The third group of problems related to the task of trying to rehabilitate the large number of elderly long - stay patients with intractable illnesses .

source_bert_toks: the third group of problems related to the task of trying to rehab ##ili ##tate the large number of elderly long - stay patients with intra ##ctable illnesses .

reference_raw: A third group of problems related to the task of seeking rehabilitation of a large number of long-term elderly patients with intractable diseases.

reference_spacy_tokens: A third group of problems related to the task of seeking rehabilitation of a large number of long - term elderly patients with intractable diseases .


fn_spacy_tokens_for_baseline: It is even possible to conceive of holding your own in a conversation in which all you do is repeat aspects of what the other person has just said .

source_bert_toks: it is even possible to con ##ce ##ive of holding your own in a conversation in which all you do is repeat aspects of what the other person has just said .

reference_raw: It's even possible to imagine holding your own in a conversation where all you're doing is repeating aspects of what the other person just said.

reference_spacy_tokens: It 's even possible to imagine holding your own in a conversation where all you 're doing is repeating aspects of what the other person just said .


fn_spacy_tokens_for_baseline: This allowed them to include in their theory dissimilarities in free volume between polymer and solvent , together with the corresponding interactions .

source_bert_toks: this allowed them to include in their theory di ##ssi ##mi ##lar ##ities in free volume between polymer and solvent , together with the corresponding interactions .

reference_raw: This enabled them to include differences in the free volume of polymers and solvents in their theory, together with the corresponding interactions.

reference_spacy_tokens: This enabled them to include differences in the free volume of polymers and solvents in their theory , together with the corresponding interactions .


fn_spacy_tokens_for_baseline: Standing so close he smelt the fusty clothes and a sour whiff on the old man 's breath .

source_bert_toks: standing so close he sm ##elt the fu ##sty clothes and a sour w ##hiff on the old man ' s breath .

reference_raw: He stood so close that he could smell the fusty clothes and the bitter whiff of the old man's breath.

reference_spacy_tokens: He stood so close that he could smell the fusty clothes and the bitter whiff of the old man 's breath .


fn_spacy_tokens_for_baseline: The bulla was a seal attached to Papal documents issued from the Vatican .

source_bert_toks: the bull ##a was a seal attached to papal documents issued from the vatican .

reference_raw: The bulla was a seam attached to the papal documents issued by the Vatican.

reference_spacy_tokens: The bulla was a seam attached to the papal documents issued by the Vatican .


fn_spacy_tokens_for_baseline: La Paz : It 's a city of shining skyscrapers where the wealthy industrialists and politicians enjoy life in a suburb which could be mistaken for Los Angeles .

source_bert_toks: la paz : it ' s a city of shining skyscraper ##s where the wealthy industrialist ##s and politicians enjoy life in a suburb which could be mistaken for los angeles .

reference_raw: La Paz: It's a city of bright skyscrapers where rich industrialists and politicians enjoy life in the suburbs that can be confused with Los Angeles.

reference_spacy_tokens: La Paz : It 's a city of bright skyscrapers where rich industrialists and politicians enjoy life in the suburbs that can be confused with Los Angeles .


fn_spacy_tokens_for_baseline: Iran is generally viewed as having been forthcoming and helpful to these IAEA efforts , although this cooperation has clearly not been absolute .

source_bert_toks: iran is generally viewed as having been forthcoming and helpful to these ia ##ea efforts , although this cooperation has clearly not been absolute .

reference_raw: Iran is generally considered to be forthcoming and useful to these efforts of the IAEA, although this cooperation is clearly not absolute.

reference_spacy_tokens: Iran is generally considered to be forthcoming and useful to these efforts of the IAEA , although this cooperation is clearly not absolute .


fn_spacy_tokens_for_baseline: I will prevent pests from devouring your crops , and the vines in your fields will not cast their fruit , ' says the Lord Almighty . '

source_bert_toks: i will prevent pest ##s from dev ##ouring your crops , and the vines in your fields will not cast their fruit , ' says the lord almighty . '

reference_raw: I'll keep the pests from eating your crops, and the vines in your fields won't cast fruit,' said the Lord Almighty.'

reference_spacy_tokens: I 'll keep the pests from eating your crops , and the vines in your fields wo n't cast fruit , ' said the Lord Almighty . '


fn_spacy_tokens_for_baseline: As people went to the polls in the Serb - held city of Banja Luka in northern Bosnia , bulldozers cleared away the remains of two 16th - century mosques blown up the previous week .

source_bert_toks: as people went to the polls in the serb - held city of ban ##ja lu ##ka in northern bosnia , bull ##do ##zers cleared away the remains of two 16th - century mosques blown up the previous week .

reference_raw: While people were taking polls in the Serbian city of Banja Luka in northern Bosnia, bulldozers wiped out the remains of two 16th-century mosques that had exploded last week.

reference_spacy_tokens: While people were taking polls in the Serbian city of Banja Luka in northern Bosnia , bulldozers wiped out the remains of two 16th - century mosques that had exploded last week .


fn_spacy_tokens_for_baseline: The view that states imperil their own legitimacy when they offend their own subjects ' conservative conceptions of constitutionality is found more amongst other academic students of politics than amongst political scientists themselves .

source_bert_toks: the view that states imp ##eri ##l their own legitimacy when they off ##end their own subjects ' conservative conception ##s of constitutional ##ity is found more amongst other academic students of politics than amongst political scientists themselves .

reference_raw: The view that states undermine their legitimacy by insulting their own subjects' conservative concepts of constitutionality is found among other academic political students rather than among political scientists themselves.

reference_spacy_tokens: The view that states undermine their legitimacy by insulting their own subjects ' conservative concepts of constitutionality is found among other academic political students rather than among political scientists themselves .


fn_spacy_tokens_for_baseline: Have you zipped your zip , yeah ?

source_bert_toks: have you zip ##ped your zip , yeah ?

reference_raw: You pulled the trigger, didn't you?

reference_spacy_tokens: You pulled the trigger , did n't you ?


fn_spacy_tokens_for_baseline: The door clunked shut .

source_bert_toks: the door cl ##unk ##ed shut .

reference_raw: The door slammed shut.

reference_spacy_tokens: The door slammed shut .


fn_spacy_tokens_for_baseline: The woman 's disappearance counts for nothing , since in that extraordinary household any member of it might be invisible for a week .

source_bert_toks: the woman ' s disappearance counts for nothing , since in that extraordinary household any member of it might be invisible for a week .

reference_raw: The disappearance of a woman counts for nothing, for any member of this extraordinary household could be invisible for a week.

reference_spacy_tokens: The disappearance of a woman counts for nothing , for any member of this extraordinary household could be invisible for a week .


fn_spacy_tokens_for_baseline: He squatted down , his clothes vibrating against his body , and injected something into Ari 's neck .

source_bert_toks: he squat ##ted down , his clothes vibrating against his body , and injected something into ari ' s neck .

reference_raw: He crouched, his clothes vibrating against his body, and injected something into Ari's throat.

reference_spacy_tokens: He crouched , his clothes vibrating against his body , and injected something into Ari 's throat .


fn_spacy_tokens_for_baseline: The advent of rapid tests for diagnosing HIV infection represents one part of the solution .

source_bert_toks: the advent of rapid tests for dia ##gno ##sing hiv infection represents one part of the solution .

reference_raw: One part of the solution is the development of quick tests to diagnose HIV infection.

reference_spacy_tokens: One part of the solution is the development of quick tests to diagnose HIV infection .


fn_spacy_tokens_for_baseline: During the American War of Independence , Jamaica came under threat again from other European powers , which saw Britain 's problem to the north as a chance to capture its colonies in the Caribbean .

source_bert_toks: during the american war of independence , jamaica came under threat again from other european powers , which saw britain ' s problem to the north as a chance to capture its colonies in the caribbean .

reference_raw: During the U.S. War of Independence, Jamaica was once again threatened by other European forces that saw the problem of Britain in the north as an opportunity to capture its colonies in the Caribbean.

reference_spacy_tokens: During the U.S. War of Independence , Jamaica was once again threatened by other European forces that saw the problem of Britain in the north as an opportunity to capture its colonies in the Caribbean .


fn_spacy_tokens_for_baseline: On the first anniversary of the return to civi lian rule President Shehu Shagari vigorously condemned party bickering in the papers and said that he hop ed it would end .

source_bert_toks: on the first anniversary of the return to ci ##vi lia ##n rule president she ##hu sha ##gar ##i vigorously condemned party bi ##cker ##ing in the papers and said that he hop ed it would end .

reference_raw: On the first anniversary of the return to Civi Lian rule, President Shehu Shagari vigorously condemned the party to squabble in the newspapers and said he hoped it would be over.

reference_spacy_tokens: On the first anniversary of the return to Civi Lian rule , President Shehu Shagari vigorously condemned the party to squabble in the newspapers and said he hoped it would be over .


fn_spacy_tokens_for_baseline: And he rarely complained during his recuperation from the first back operation , to repair a number of fractures , which looked like being successful when he returned for Middlesex at the start of 1991 and took four for 60 against Somerset with a performance which particularly impressed his own wicket - keeper Paul Farbrace .

source_bert_toks: and he rarely complained during his rec ##up ##eration from the first back operation , to repair a number of fractures , which looked like being successful when he returned for middlesex at the start of 1991 and took four for 60 against somerset with a performance which particularly impressed his own wicket - keeper paul far ##bra ##ce .

reference_raw: And during his recovery from the first back surgery, he seldom complained about repairing a series of fractures that seemed to have been successful when he returned to Middlesex in early 1991 and took four to Sixty against Somerset with a performance that made a special impression on his own wicket-keeper Paul Farbrace.

reference_spacy_tokens: And during his recovery from the first back surgery , he seldom complained about repairing a series of fractures that seemed to have been successful when he returned to Middlesex in early 1991 and took four to Sixty against Somerset with a performance that made a special impression on his own wicket - keeper Paul Farbrace .


fn_spacy_tokens_for_baseline: At Wiseton , in the Nottinghamshire plain between the Idle and the Trent , one landlord -- Jonathan Ackham -- built seven new homesteads on central sites on his estate after enclosure .

source_bert_toks: at wise ##ton , in the nottinghamshire plain between the idle and the trent , one landlord - - jonathan ac ##kha ##m - - built seven new homestead ##s on central sites on his estate after enclosure .

reference_raw: In Wiseton, on the plain of Nottinghamshire, between Idle and Trent, one of the landlords, Jonathan Ackham, built seven new homes at the center of his estate.

reference_spacy_tokens: In Wiseton , on the plain of Nottinghamshire , between Idle and Trent , one of the landlords , Jonathan Ackham , built seven new homes at the center of his estate .


fn_spacy_tokens_for_baseline: The court extended job reservation to underprivileged sections of religious minorities , but refused to sanction a proposal by the present government setting aside 10 per cent of posts for poorer members of the upper castes .

source_bert_toks: the court extended job reservation to under ##pr ##iv ##ile ##ged sections of religious minorities , but refused to san ##ction a proposal by the present government setting aside 10 per cent of posts for poorer members of the upper castes .

reference_raw: The court extended the job reservation to disadvantaged sections of religious minorities, but refused to approve the current government's proposal to set aside 10 percent of the jobs of the poorer members of the upper castes.

reference_spacy_tokens: The court extended the job reservation to disadvantaged sections of religious minorities , but refused to approve the current government 's proposal to set aside 10 percent of the jobs of the poorer members of the upper castes .


fn_spacy_tokens_for_baseline: Contrary to what is often supposed , the Dutch were scarcely less prone to employ political means to promote their economic position than was the France of Louis XIV and Colbert .

source_bert_toks: contrary to what is often supposed , the dutch were scarcely less prone to employ political means to promote their economic position than was the france of louis xiv and colbert .

reference_raw: Contrary to what is often said to be the case, the Netherlands were hardly less inclined to use political means to support their economic situation than France of Louis XIV and Colbert.

reference_spacy_tokens: Contrary to what is often said to be the case , the Netherlands were hardly less inclined to use political means to support their economic situation than France of Louis XIV and Colbert .


fn_spacy_tokens_for_baseline: I had also been taking up quite a lot of time for public service , chairing the National Gas Consumers ' Council , and also , more relevantly , working under Richard Hoggart who was chairing the Advisory Council for Adult and Continuing Education , which had a remit to develop national policies for education as a process continuing throughout life .

source_bert_toks: i had also been taking up quite a lot of time for public service , chair ##ing the national gas consumers ' council , and also , more relevant ##ly , working under richard hog ##gart who was chair ##ing the advisory council for adult and continuing education , which had a re ##mit to develop national policies for education as a process continuing throughout life .

reference_raw: I also took up a lot of time in public service, presided over the National Gas Consumer Council, and, more importantly, worked under Richard Hoggart, who presided over the Adult and Continuous Education Advisory Council, which was responsible for developing national education policies as a process that continued throughout my life.

reference_spacy_tokens: I also took up a lot of time in public service , presided over the National Gas Consumer Council , and , more importantly , worked under Richard Hoggart , who presided over the Adult and Continuous Education Advisory Council , which was responsible for developing national education policies as a process that continued throughout my life .


fn_spacy_tokens_for_baseline: Gabriel shook his head furiously ; then hurried back to the Mason as fast as he could go without spilling the liquor .

source_bert_toks: gabriel shook his head furiously ; then hurried back to the mason as fast as he could go without spilling the liquor .

reference_raw: Gabriel shook his head furiously, then hurried back to the Mason as quickly as he could, without pouring out the alcohol.

reference_spacy_tokens: Gabriel shook his head furiously , then hurried back to the Mason as quickly as he could , without pouring out the alcohol .


fn_spacy_tokens_for_baseline: The hospital staff are beginning to grasp the difference between CAB and social work and are now involving the CAB with more in - patient cases .

source_bert_toks: the hospital staff are beginning to grasp the difference between cab and social work and are now involving the cab with more in - patient cases .

reference_raw: Hospital staff are starting to understand the difference between CAB and social work and are now involved in more patient cases.

reference_spacy_tokens: Hospital staff are starting to understand the difference between CAB and social work and are now involved in more patient cases .


fn_spacy_tokens_for_baseline: He was discharged three weeks after admission , having recovered fully .

source_bert_toks: he was discharged three weeks after admission , having recovered fully .

reference_raw: Three weeks after he was admitted, he was released after a full recovery.

reference_spacy_tokens: Three weeks after he was admitted , he was released after a full recovery .


fn_spacy_tokens_for_baseline: Opponents spread rumours ; gossips passed them on -- that Arthur had misappropriated funds , that he had wrecked the church car ; that he had insulted a senior white church lady , and so on .

source_bert_toks: opponents spread rumours ; gossip ##s passed them on - - that arthur had mis ##app ##rop ##riated funds , that he had wrecked the church car ; that he had insulted a senior white church lady , and so on .

reference_raw: There were rumors among the opponents, rumors that Arthur had taken advantage of the money, that he had destroyed the church car, that he had insulted the old white lady of the church, and so on.

reference_spacy_tokens: There were rumors among the opponents , rumors that Arthur had taken advantage of the money , that he had destroyed the church car , that he had insulted the old white lady of the church , and so on .


fn_spacy_tokens_for_baseline: It was another of Jacqui 's frozen meals .

source_bert_toks: it was another of ja ##c ##qui ' s frozen meals .

reference_raw: It was one of Jacqui's frosted foods.

reference_spacy_tokens: It was one of Jacqui 's frosted foods .


fn_spacy_tokens_for_baseline: In the five years that followed , Iran concluded several contracts for the construction of nuclear plants and the supply of nuclear fuel : with the United States in 1974 ; Germany in 1976 ; and France in 1977 .

source_bert_toks: in the five years that followed , iran concluded several contracts for the construction of nuclear plants and the supply of nuclear fuel : with the united states in 1974 ; germany in 1976 ; and france in 1977 .

reference_raw: In the following five years, Iran entered into several contracts for the construction of nuclear power plants and the provision of nuclear fuel: with the United States in 1974; with Germany in 1976; and with France in 1977.

reference_spacy_tokens: In the following five years , Iran entered into several contracts for the construction of nuclear power plants and the provision of nuclear fuel : with the United States in 1974 ; with Germany in 1976 ; and with France in 1977 .


fn_spacy_tokens_for_baseline: The nickname had been coined by Hauser himself and Carver found it childish .

source_bert_toks: the nickname had been coined by ha ##user himself and carver found it childish .

reference_raw: Hauser himself invented the nickname, and Carver found it childish.

reference_spacy_tokens: Hauser himself invented the nickname , and Carver found it childish .


fn_spacy_tokens_for_baseline: SINGLE WHITE FEMALE Films entirely devoted to murderous women are not exactly common but , when anyone does take the risk , the results can be rewarding , as Barbet Schroeder 's white - knuckle thriller proves .

source_bert_toks: single white female films entirely devoted to murderous women are not exactly common but , when anyone does take the risk , the results can be reward ##ing , as bar ##bet sc ##hr ##oed ##er ' s white - kn ##uck ##le thriller proves .

reference_raw: SINGLE FEMALE Films dedicated to murderous women are not very common, but if someone takes the risk, the results can be rewarded, as Barbet Schroeder's white-knocked thriller proves.

reference_spacy_tokens: SINGLE FEMALE Films dedicated to murderous women are not very common , but if someone takes the risk , the results can be rewarded , as Barbet Schroeder 's white - knocked thriller proves .


fn_spacy_tokens_for_baseline: Yes ; what if he croaked ?

source_bert_toks: yes ; what if he cr ##oa ##ked ?

reference_raw: Yes; what if it squeals?

reference_spacy_tokens: Yes ; what if it squeals ?


fn_spacy_tokens_for_baseline: From the 1930s to the 1950s , a whole slew of outline histories of the British Labour movement appeared .

source_bert_toks: from the 1930s to the 1950s , a whole sl ##ew of outline histories of the british labour movement appeared .

reference_raw: From the 1930s to the 1950s, there was a whole series of outlines of the British Labour Movement.

reference_spacy_tokens: From the 1930s to the 1950s , there was a whole series of outlines of the British Labour Movement .


fn_spacy_tokens_for_baseline: First , why ticket splitting has increased and taken the peculiar pattern that it has over the past half century : Prior to the election of Franklin Roosevelt as president and the advent of the New Deal , government occupied a much smaller role in society and the prisoner 's dilemma problem confronting voters in races for Congress was considerably less severe .

source_bert_toks: first , why ticket splitting has increased and taken the peculiar pattern that it has over the past half century : prior to the election of franklin roosevelt as president and the advent of the new deal , government occupied a much smaller role in society and the prisoner ' s dilemma problem confronting voters in races for congress was considerably less severe .

reference_raw: First, why the distribution of tickets increased and took on the strange pattern of the last half-century: before Franklin Roosevelt was elected president and the arrival of the New Deal, the government had a much smaller role in society, and the problem of the prisoner's dilemma facing voters in Congress was far less serious.

reference_spacy_tokens: First , why the distribution of tickets increased and took on the strange pattern of the last half - century : before Franklin Roosevelt was elected president and the arrival of the New Deal , the government had a much smaller role in society , and the problem of the prisoner 's dilemma facing voters in Congress was far less serious .


fn_spacy_tokens_for_baseline: The only holiday on which all commerce comes to a halt is the Chinese New Year in January or February .

source_bert_toks: the only holiday on which all commerce comes to a halt is the chinese new year in january or february .

reference_raw: The only holiday on which all trade stops is the New Year of China in January or January.

reference_spacy_tokens: The only holiday on which all trade stops is the New Year of China in January or January .


fn_spacy_tokens_for_baseline: Head for the roller - coasters for a spine - chilling ride .

source_bert_toks: head for the roller - coaster ##s for a spine - chilling ride .

reference_raw: Go to the roller coasters for a spinal chilling ride.

reference_spacy_tokens: Go to the roller coasters for a spinal chilling ride .


fn_spacy_tokens_for_baseline: Earlier , on page 49 , we learnt about Agnodice , " who lived to become the world 's first known woman gynaecologist , " in the fourth century BC .

source_bert_toks: earlier , on page 49 , we learnt about ag ##no ##dice , " who lived to become the world ' s first known woman g ##yna ##ec ##ologist , " in the fourth century bc .

reference_raw: In the fourth century B.C., on page 49, we learned about Agnodice, who survived to become the world's first known female gynaecologist.

reference_spacy_tokens: In the fourth century B.C. , on page 49 , we learned about Agnodice , who survived to become the world 's first known female gynaecologist .


fn_spacy_tokens_for_baseline: He stuffed the grenade into the waistband of his tattered trousers and climbed higher , out of reach .

source_bert_toks: he stuffed the grenade into the waistband of his ta ##ttered trousers and climbed higher , out of reach .

reference_raw: He stuffed the grenade into the belt of his ragged pants and climbed up, out of reach.

reference_spacy_tokens: He stuffed the grenade into the belt of his ragged pants and climbed up , out of reach .