fn_spacy_tokens_for_baseline: After a long fight to beat inflation , the government does not feel sympathetic to these demands .

source_bert_toks: after a long fight to beat inflation , the government does not feel sympathetic to these demands .

reference_raw: After a long struggle to defeat inflation, the government has no sympathy for these demands.

reference_spacy_tokens: After a long struggle to defeat inflation , the government has no sympathy for these demands .


fn_spacy_tokens_for_baseline: A barmaid who cudgelled her landlord boyfriend to death with a beer flagon has been sentenced to eighteen months imprisonment ( suspended ) .

source_bert_toks: a bar ##maid who cu ##dge ##lled her landlord boyfriend to death with a beer flag ##on has been sentenced to eighteen months imprisonment ( suspended ) .

reference_raw: The bartender who cuddled her landlord's friend to death with a beer bottle was sentenced to 18 months in prison (suspension).

reference_spacy_tokens: The bartender who cuddled her landlord 's friend to death with a beer bottle was sentenced to 18 months in prison ( suspension ) .


fn_spacy_tokens_for_baseline: Forty four ( 93.6 % ) of the remaining 47 patients were dilated successfully and had complete relief of dysphagia .

source_bert_toks: forty four ( 93 . 6 % ) of the remaining 47 patients were dil ##ated successfully and had complete relief of d ##ys ##pha ##gia .

reference_raw: Forty-four (93.6%) of the remaining 47 patients were successfully diagnosed with complete dysphagia relief.

reference_spacy_tokens: Forty - four ( 93.6 % ) of the remaining 47 patients were successfully diagnosed with complete dysphagia relief .


fn_spacy_tokens_for_baseline: Herod also completely rebuilt the Temple , making it one of the most important religious centers in the Roman Empire .

source_bert_toks: hero ##d also completely rebuilt the temple , making it one of the most important religious centers in the roman empire .

reference_raw: Herod has also completely rebuilt the temple, making it one of the most important religious centers in the Roman realm.

reference_spacy_tokens: Herod has also completely rebuilt the temple , making it one of the most important religious centers in the Roman realm .


fn_spacy_tokens_for_baseline: Fine grain size also improves the mechanical strength and toughness of the alumina .

source_bert_toks: fine grain size also improves the mechanical strength and tough ##ness of the al ##umi ##na .

reference_raw: The size of the fine grain also improves the mechanical strength and hardness of the aluminium.

reference_spacy_tokens: The size of the fine grain also improves the mechanical strength and hardness of the aluminium .


fn_spacy_tokens_for_baseline: Nevertheless , the nature and extent of T and A approvals must be such that management has assurance that supervisors or other officials know they are accountable for the approvals of an employee 's work time and absences .

source_bert_toks: nevertheless , the nature and extent of t and a approval ##s must be such that management has assurance that supervisors or other officials know they are accountable for the approval ##s of an employee ' s work time and absence ##s .

reference_raw: However, the nature and scope of the approvals of T and A shall be such that the management has assurances that the supervisory authorities or other officials are aware that they are responsible for the approval of the staff member's working time and absentee status.

reference_spacy_tokens: However , the nature and scope of the approvals of T and A shall be such that the management has assurances that the supervisory authorities or other officials are aware that they are responsible for the approval of the staff member 's working time and absentee status .


fn_spacy_tokens_for_baseline: The crucial point to notice about it is that the entities whose ' fitnesses ' are being compared are no longer individual organisms , but populations of organisms .

source_bert_toks: the crucial point to notice about it is that the entities whose ' fitness ##es ' are being compared are no longer individual organisms , but populations of organisms .

reference_raw: The key point to be noted is that the entities whose "fitnesses" are compared are no longer individual organisms, but groups of organisms.

reference_spacy_tokens: The key point to be noted is that the entities whose " fitnesses " are compared are no longer individual organisms , but groups of organisms .


fn_spacy_tokens_for_baseline: The Unionists in general decreased the number of their candidates though the precise locations of these decreases are not easy to unravel owing to personal realignments in various parts of the different Unionist parties .

source_bert_toks: the unionist ##s in general decreased the number of their candidates though the precise locations of these decreases are not easy to un ##rave ##l owing to personal real ##ignment ##s in various parts of the different unionist parties .

reference_raw: As a general rule, the Unionists reduced the number of candidates, although the exact location of those reductions is not easy to unravel because of individual adjustments in different parts of the Unionist parties.

reference_spacy_tokens: As a general rule , the Unionists reduced the number of candidates , although the exact location of those reductions is not easy to unravel because of individual adjustments in different parts of the Unionist parties .


fn_spacy_tokens_for_baseline: In the long run , however , dictionary reviews probably serve no function : in the face of the relatively overwhelming funds at the disposal of some publishers to promote their books , reviews fail to dissuade people from buying bad dictionaries ; such a small percentage of the dictionary - buying public attend to reviews that their effect is slight even when favourable ; finally , the value of a dictionary to an individual can be tested only over long use , which even the wisest reviewer can not anticipate .

source_bert_toks: in the long run , however , dictionary reviews probably serve no function : in the face of the relatively overwhelming funds at the disposal of some publishers to promote their books , reviews fail to di ##ss ##ua ##de people from buying bad di ##ction ##aries ; such a small percentage of the dictionary - buying public attend to reviews that their effect is slight even when favourable ; finally , the value of a dictionary to an individual can be tested only over long use , which even the wise ##st reviewer can not anti ##ci ##pate .

reference_raw: In the long run, however, vocabulary reviews are unlikely to work: in view of the relatively overwhelming financial resources available to some publishers to promote their books, reviews do not discourage people from buying bad dictionaries; such a small percentage of the public purchasing the dictionary is involved in reviews that their impact is small even if it is positive; in the end, the value of the vocabulary can only be tested for a long period of use, which is wise. The reviewer can't predict that.

reference_spacy_tokens: In the long run , however , vocabulary reviews are unlikely to work : in view of the relatively overwhelming financial resources available to some publishers to promote their books , reviews do not discourage people from buying bad dictionaries ; such a small percentage of the public purchasing the dictionary is involved in reviews that their impact is small even if it is positive ; in the end , the value of the vocabulary can only be tested for a long period of use , which is wise . The reviewer ca n't predict that .


fn_spacy_tokens_for_baseline: The secretary said his instinct was to hit Saddam Hussein at the same time - not only Bin Ladin .

source_bert_toks: the secretary said his instinct was to hit saddam hussein at the same time - not only bin lad ##in .

reference_raw: The secretary said he had an instinct to strike Saddam Hussein - not just Bin Ladin.

reference_spacy_tokens: The secretary said he had an instinct to strike Saddam Hussein - not just Bin Ladin .


fn_spacy_tokens_for_baseline: Turning to Egor he requests more body parts and , to accentuate the urgency required , he physically hurls our hunchbacked hero from the top of his castle into the graveyard below where the game begins .

source_bert_toks: turning to ego ##r he requests more body parts and , to accent ##uate the urgency required , he physically hu ##rl ##s our hu ##nch ##back ##ed hero from the top of his castle into the graveyard below where the game begins .

reference_raw: He turned to Egor and asked for more body parts and, in order to emphasize the urgency required, physically threw our hunchbacked hero from the top of his castle into the cemetery below where the game began.

reference_spacy_tokens: He turned to Egor and asked for more body parts and , in order to emphasize the urgency required , physically threw our hunchbacked hero from the top of his castle into the cemetery below where the game began .


fn_spacy_tokens_for_baseline: For political reasons , no single definition has been accepted worldwide and several different ones are in current use .

source_bert_toks: for political reasons , no single definition has been accepted worldwide and several different ones are in current use .

reference_raw: For political reasons, no single definition has been adopted worldwide and several different definitions are currently being used.

reference_spacy_tokens: For political reasons , no single definition has been adopted worldwide and several different definitions are currently being used .


fn_spacy_tokens_for_baseline: The jangle of harness , the clang of steel , the choked - off screams , all seemed damped down , as if a mist enshrouded them .

source_bert_toks: the jang ##le of harness , the clan ##g of steel , the choked - off screams , all seemed damp ##ed down , as if a mist en ##sh ##roud ##ed them .

reference_raw: The jangle of straps, the clatter of steel, the choking of screams, all seemed to be dampened, as if a fog had enveloped them.

reference_spacy_tokens: The jangle of straps , the clatter of steel , the choking of screams , all seemed to be dampened , as if a fog had enveloped them .


fn_spacy_tokens_for_baseline: But because these claims are more difficult to evaluate and have been coming in more slowly , the company has no estimate of the impact of the earthquake on fourth - quarter results .

source_bert_toks: but because these claims are more difficult to evaluate and have been coming in more slowly , the company has no estimate of the impact of the earthquake on fourth - quarter results .

reference_raw: However, since these allegations are more difficult to assess and come at a slower pace, the company does not estimate the impact of the earthquake on the results of the fourth and fourth quarter.

reference_spacy_tokens: However , since these allegations are more difficult to assess and come at a slower pace , the company does not estimate the impact of the earthquake on the results of the fourth and fourth quarter .


fn_spacy_tokens_for_baseline: Bill'll be so thrilled ! '

source_bert_toks: bill ' ll be so thrilled ! '

reference_raw: Bill's going to be so excited!'

reference_spacy_tokens: Bill 's going to be so excited ! '


fn_spacy_tokens_for_baseline: Microsoft does engage in some anti - competitive practices , such as not allowing resellers to disclose contract terms , and the Department of Justice is doing a fair job of policing such activity .

source_bert_toks: microsoft does engage in some anti - competitive practices , such as not allowing res ##eller ##s to disclose contract terms , and the department of justice is doing a fair job of policing such activity .

reference_raw: Microsoft engages in certain anti-competitive practices, such as the fact that resellers are not allowed to disclose the terms of the contract, and the Ministry of Justice is doing its best to police such activities.

reference_spacy_tokens: Microsoft engages in certain anti - competitive practices , such as the fact that resellers are not allowed to disclose the terms of the contract , and the Ministry of Justice is doing its best to police such activities .


fn_spacy_tokens_for_baseline: As Yanto spoke the bar door was thrust purposefully open and there , framed in the doorway , was the tall moustached figure of Herbie Connors .

source_bert_toks: as yan ##to spoke the bar door was thrust purpose ##fully open and there , framed in the doorway , was the tall mo ##ust ##ache ##d figure of herb ##ie connor ##s .

reference_raw: When Yanto spoke, the door of the bar was deliberately pushed open, and there, framed in the doorway, was the tall, mustached figure of Herbie Connors.

reference_spacy_tokens: When Yanto spoke , the door of the bar was deliberately pushed open , and there , framed in the doorway , was the tall , mustached figure of Herbie Connors .


fn_spacy_tokens_for_baseline: Towering mountains surround the village and the area around St Anton is fantastic for walking .

source_bert_toks: towering mountains surround the village and the area around st anton is fantastic for walking .

reference_raw: The towering mountains encircle the village, and the area around St. Anton is fantastic for walking.

reference_spacy_tokens: The towering mountains encircle the village , and the area around St. Anton is fantastic for walking .


fn_spacy_tokens_for_baseline: Using a claw weight and a magnet , hook the weight in the knitting where you wish to join in a new colour and sandwich the end of the wool between the claw , weight and the magnet .

source_bert_toks: using a claw weight and a magnet , hook the weight in the knitting where you wish to join in a new colour and sandwich the end of the wool between the claw , weight and the magnet .

reference_raw: Using the weight of the claws and the magnet, attach the weight to the knittings where you want to join in a new color, and sandwich the end of the wool between the claws, weights, and magnets.

reference_spacy_tokens: Using the weight of the claws and the magnet , attach the weight to the knittings where you want to join in a new color , and sandwich the end of the wool between the claws , weights , and magnets .


fn_spacy_tokens_for_baseline: I 'm surprised he did n't get arrested .

source_bert_toks: i ' m surprised he didn ' t get arrested .

reference_raw: I wonder why they didn't arrest him.

reference_spacy_tokens: I wonder why they did n't arrest him .


fn_spacy_tokens_for_baseline: After fathering your love child .

source_bert_toks: after father ##ing your love child .

reference_raw: After you've fathered your loving baby.

reference_spacy_tokens: After you 've fathered your loving baby .


fn_spacy_tokens_for_baseline: I command you to get well . '

source_bert_toks: i command you to get well . '

reference_raw: I'm ordering you to heal.'

reference_spacy_tokens: I 'm ordering you to heal . '


fn_spacy_tokens_for_baseline: X then forged a telegram to the defendants : ' Goods dispatched to your branch in error .

source_bert_toks: x then forged a telegram to the defendants : ' goods dispatched to your branch in error .

reference_raw: X then falsified a telegram to the defendants: 'The goods were sent to your branch by mistake.

reference_spacy_tokens: X then falsified a telegram to the defendants : ' The goods were sent to your branch by mistake .


fn_spacy_tokens_for_baseline: As she straightened up from tying her shoes , the pain struck .

source_bert_toks: as she straightened up from tying her shoes , the pain struck .

reference_raw: The pain hit her as she straightened up from the strapping of her boots.

reference_spacy_tokens: The pain hit her as she straightened up from the strapping of her boots .


fn_spacy_tokens_for_baseline: ' Your ancestors were gracious to their servants , Nuadu of the Silver Arm , ' he said , sneeringly .

source_bert_toks: ' your ancestors were gr ##acious to their servants , nu ##ad ##u of the silver arm , ' he said , s ##neer ##ingly .

reference_raw: 'Your ancestors have been kind to their servants, Nuadu of the Silver Arm,' he said with a sneer.

reference_spacy_tokens: ' Your ancestors have been kind to their servants , Nuadu of the Silver Arm , ' he said with a sneer .


fn_spacy_tokens_for_baseline: This was the background to an attempt by president Nkrumah of Ghana to break through the impasse .

source_bert_toks: this was the background to an attempt by president nk ##rum ##ah of ghana to break through the imp ##asse .

reference_raw: This was the backdrop of the attempt by Chairman Nkrumah of Ghana to break the dead end.

reference_spacy_tokens: This was the backdrop of the attempt by Chairman Nkrumah of Ghana to break the dead end .


fn_spacy_tokens_for_baseline: Viscount Dilhorne had already decided that the appeal should be dismissed before he turned to it .

source_bert_toks: viscount dil ##horn ##e had already decided that the appeal should be dismissed before he turned to it .

reference_raw: Viscount Dilhorne had already decided to dismiss the action before turning to the Court of First Instance.

reference_spacy_tokens: Viscount Dilhorne had already decided to dismiss the action before turning to the Court of First Instance .


fn_spacy_tokens_for_baseline: While the affirmation that Spain was a ' Republic of workers of all classes ' and clauses limiting absolute property rights bore a socialist ring , the prevailing tone was that of Left - republicanism .

source_bert_toks: while the af ##firm ##ation that spain was a ' republic of workers of all classes ' and clauses limiting absolute property rights bore a socialist ring , the prevailing tone was that of left - republican ##ism .

reference_raw: While the confirmation that Spain is a "Republic of Workers of All Classes" and the provisions restricting absolute property rights have a socialist ring, the prevailing tone is left-republicanism.

reference_spacy_tokens: While the confirmation that Spain is a " Republic of Workers of All Classes " and the provisions restricting absolute property rights have a socialist ring , the prevailing tone is left - republicanism .


fn_spacy_tokens_for_baseline: The eight - wheeled vehicles , developed to fill a gap between infantry soldiers driving Humvees and tanks , is the Army 's next step in becoming a future fighting force .

source_bert_toks: the eight - wheeled vehicles , developed to fill a gap between infantry soldiers driving hum ##ve ##es and tanks , is the army ' s next step in becoming a future fighting force .

reference_raw: Eight-wheeled vehicles, designed to fill the gap between infantry troops driving Humvees and tanks, are the next step for the army to become a future fighting force.

reference_spacy_tokens: Eight - wheeled vehicles , designed to fill the gap between infantry troops driving Humvees and tanks , are the next step for the army to become a future fighting force .


fn_spacy_tokens_for_baseline: He repaired to his kitchen area , flagrantly disregarding the woman who was being sick three rows behind the two men .

source_bert_toks: he repaired to his kitchen area , flag ##rant ##ly disregard ##ing the woman who was being sick three rows behind the two men .

reference_raw: He fixed himself in the kitchen area, ignoring the woman who had been sick three rows behind the two men.

reference_spacy_tokens: He fixed himself in the kitchen area , ignoring the woman who had been sick three rows behind the two men .


fn_spacy_tokens_for_baseline: Many Al Qa'ida terrorists are prepared to sacrifice their own lives to carry out attacks , making them essentially impossible to deter .

source_bert_toks: many al q ##a ' ida terrorists are prepared to sacrifice their own lives to carry out attacks , making them essentially impossible to deter .

reference_raw: Many of the Al Qa'ida terrorists are willing to sacrifice their lives in order to carry out attacks, making them virtually impossible to deter.

reference_spacy_tokens: Many of the Al Qa'ida terrorists are willing to sacrifice their lives in order to carry out attacks , making them virtually impossible to deter .


fn_spacy_tokens_for_baseline: Dr _ Gupto : But we only know that it might work because of laboratory studies and animal studies uh uh in particular .

source_bert_toks: dr _ gu ##pt ##o : but we only know that it might work because of laboratory studies and animal studies uh uh in particular .

reference_raw: Dr. Gupto: But all we know is that this could work because of lab studies and animal studies, uh, especially.

reference_spacy_tokens: Dr. Gupto : But all we know is that this could work because of lab studies and animal studies , uh , especially .


fn_spacy_tokens_for_baseline: A butterfly was flapping around the wheelbarrow looking for a fragrance to match the colour of that great metallic flower .

source_bert_toks: a butterfly was flap ##ping around the wheel ##bar ##row looking for a fragrance to match the colour of that great metallic flower .

reference_raw: A butterfly fluttered around the wheelbarrow, seeking the scent to match the color of the great metal flower.

reference_spacy_tokens: A butterfly fluttered around the wheelbarrow , seeking the scent to match the color of the great metal flower .


fn_spacy_tokens_for_baseline: On 23 March 1989 two chemists , Stanley Pons and Martin Fleischmann , stunned the world with their claim to have harnessed fusion -- the power of the Sun -- in a test tube of water at room temperature .

source_bert_toks: on 23 march 1989 two chemist ##s , stanley po ##ns and martin fl ##eis ##chman ##n , stunned the world with their claim to have harness ##ed fusion - - the power of the sun - - in a test tube of water at room temperature .

reference_raw: On March 23, 1989, two chemists, Stanley Pons and Martin Fleischmann, shocked the world by claiming that they harnessed fusion - the power of the sun - in a test tube of water at room temperature.

reference_spacy_tokens: On March 23 , 1989 , two chemists , Stanley Pons and Martin Fleischmann , shocked the world by claiming that they harnessed fusion - the power of the sun - in a test tube of water at room temperature .


fn_spacy_tokens_for_baseline: The Vietnamese government is now planning to enlarge the reserve .

source_bert_toks: the vietnamese government is now planning to en ##lar ##ge the reserve .

reference_raw: The Vietnamese government is now planning to expand its reserves.

reference_spacy_tokens: The Vietnamese government is now planning to expand its reserves .


fn_spacy_tokens_for_baseline: Imports such as thiodyglycol and thionyl chloride can be applied towards legitimate purposes such as dyes , textiles , and pesticides or can be diverted towards an illicit CW program .

source_bert_toks: imports such as th ##io ##dy ##gly ##col and th ##ion ##yl chloride can be applied towards legitimate purposes such as dye ##s , textiles , and pest ##icides or can be diverted towards an illicit cw program .

reference_raw: Exports such as thiodyglycol and thionyl chloride may be used for legitimate purposes, such as dyes, textiles and pesticides, or may be diverted to an illegal CW programme.

reference_spacy_tokens: Exports such as thiodyglycol and thionyl chloride may be used for legitimate purposes , such as dyes , textiles and pesticides , or may be diverted to an illegal CW programme .


fn_spacy_tokens_for_baseline: Part of the fun yesterday was when Lander doused the walking hero with a bucket of sea water .

source_bert_toks: part of the fun yesterday was when land ##er do ##used the walking hero with a bucket of sea water .

reference_raw: Part of the fun last night was when Lander drugged a walking hero with a bucket of seawater.

reference_spacy_tokens: Part of the fun last night was when Lander drugged a walking hero with a bucket of seawater .


fn_spacy_tokens_for_baseline: The detainee , Khalida Mashhandani , was later released after it was determined that her confessions had been coerced .

source_bert_toks: the det ##aine ##e , khalid ##a mas ##hh ##anda ##ni , was later released after it was determined that her confessions had been coe ##rce ##d .

reference_raw: The prisoner, Khalida Mashhandani, was later released when it was decided she was forced to confess.

reference_spacy_tokens: The prisoner , Khalida Mashhandani , was later released when it was decided she was forced to confess .


fn_spacy_tokens_for_baseline: Control : Remove and burn infected leaves , ventilate freely and spray the plant with Boots garden Fungicide or Supercarb .

source_bert_toks: control : remove and burn infected leaves , vent ##ila ##te freely and spray the plant with boots garden fungi ##cide or super ##car ##b .

reference_raw: Control: Remove and burn infected leaves, ventilate freely and sprinkle the plant with Boots Garden Fungicide or Supercarb.

reference_spacy_tokens: Control : Remove and burn infected leaves , ventilate freely and sprinkle the plant with Boots Garden Fungicide or Supercarb .


fn_spacy_tokens_for_baseline: Fortunately , there is a more tolerant attitude towards other religions in most parts of the world today .

source_bert_toks: fortunately , there is a more tolerant attitude towards other religions in most parts of the world today .

reference_raw: Fortunately, in most parts of the world, there is now a more tolerable approach to other religions.

reference_spacy_tokens: Fortunately , in most parts of the world , there is now a more tolerable approach to other religions .


fn_spacy_tokens_for_baseline: Brahmadaitya are kind to humans , though should one be foolish enough to chop down the palm tree where this spirit lives , the offender 's neck will be snapped , like a twig .

source_bert_toks: bra ##hma ##dai ##tya are kind to humans , though should one be foolish enough to chop down the palm tree where this spirit lives , the offender ' s neck will be snapped , like a t ##wig .

reference_raw: Brahmadaitya is kind to people, but if you're stupid enough to cut down the palm tree where the ghost lives, the perpetrator's neck will break like a branch.

reference_spacy_tokens: Brahmadaitya is kind to people , but if you 're stupid enough to cut down the palm tree where the ghost lives , the perpetrator 's neck will break like a branch .


fn_spacy_tokens_for_baseline: Most people have a dab of make - up before they go on , reluctant though some are .

source_bert_toks: most people have a da ##b of make - up before they go on , reluctant though some are .

reference_raw: Most people wear makeup before they go on, hesitant though some of them do.

reference_spacy_tokens: Most people wear makeup before they go on , hesitant though some of them do .


fn_spacy_tokens_for_baseline: Judge Costa Pleicones entered an innocent plea on her behalf and set trial for April 24 .

source_bert_toks: judge costa pl ##ei ##con ##es entered an innocent plea on her behalf and set trial for april 24 .

reference_raw: Judge Costa Pleicones made an innocent statement on her behalf and brought an action on the 24th of April.

reference_spacy_tokens: Judge Costa Pleicones made an innocent statement on her behalf and brought an action on the 24th of April .


fn_spacy_tokens_for_baseline: Last year , Goodwill placed 511 people in jobs , more than double the number we placed in 1993 .

source_bert_toks: last year , goodwill placed 51 ##1 people in jobs , more than double the number we placed in 1993 .

reference_raw: A year ago, Goodwill put 511 people into work, more than twice as many as we put in 1993.

reference_spacy_tokens: A year ago , Goodwill put 511 people into work , more than twice as many as we put in 1993 .


fn_spacy_tokens_for_baseline: In 1642 Winter 's grant was rescinded by a vote of the House of Commons , because of his misappropriation of timber in the forest .

source_bert_toks: in 1642 winter ' s grant was res ##cin ##ded by a vote of the house of commons , because of his mis ##app ##ropriation of timber in the forest .

reference_raw: In 1642, Winter's grant was cancelled by a vote of the House of Commons on account of his abuse of wood in the woods.

reference_spacy_tokens: In 1642 , Winter 's grant was cancelled by a vote of the House of Commons on account of his abuse of wood in the woods .


fn_spacy_tokens_for_baseline: ' Oh -- um -- I 'm afraid I 've scads of letters I must write , ' she excused , hoping to be forgiven .

source_bert_toks: ' oh - - um - - i ' m afraid i ' ve sc ##ads of letters i must write , ' she excused , hoping to be forgiven .

reference_raw: "Ah-uh-I'm afraid I've got a lot of letters to write," she apologized, hoping to be forgiven.

reference_spacy_tokens: " Ah - uh - I'm afraid I 've got a lot of letters to write , " she apologized , hoping to be forgiven .


fn_spacy_tokens_for_baseline: Next came a leg of Szechuan duck , which our attendant shredded at the table with all the panache of a French waiter filleting a sole .

source_bert_toks: next came a leg of s ##ze ##chua ##n duck , which our attendant shredded at the table with all the pan ##ache of a french waiter fill ##eti ##ng a sole .

reference_raw: Then came the foot of the Szechuan duck, which our servant had torn at the table with all the panaches of a French waiter filling his soles.

reference_spacy_tokens: Then came the foot of the Szechuan duck , which our servant had torn at the table with all the panaches of a French waiter filling his soles .


fn_spacy_tokens_for_baseline: ' It 's a very important contribution that we are able to make , to provide that normal access to the Western world that they want so badly .

source_bert_toks: ' it ' s a very important contribution that we are able to make , to provide that normal access to the western world that they want so badly .

reference_raw: 'It is a very important contribution we can make to providing such a normal approach to the Western world as they so desperately want.

reference_spacy_tokens: ' It is a very important contribution we can make to providing such a normal approach to the Western world as they so desperately want .


fn_spacy_tokens_for_baseline: I 've been so scared ! ' squeaked one of the Leicester ladies .

source_bert_toks: i ' ve been so scared ! ' squeak ##ed one of the leicester ladies .

reference_raw: I was so scared!" one of the Leicester ladies squealed.

reference_spacy_tokens: I was so scared ! " one of the Leicester ladies squealed .


fn_spacy_tokens_for_baseline: Jerome was confident that even married apostles lived in mutual continence , after the example of their unmarried Lord and his ever virgin mother .

source_bert_toks: jerome was confident that even married apostles lived in mutual con ##tine ##nce , after the example of their unmarried lord and his ever virgin mother .

reference_raw: Jerome believed that even married apostles lived in a common continent, following the example of their single lord and his ever-maid mother.

reference_spacy_tokens: Jerome believed that even married apostles lived in a common continent , following the example of their single lord and his ever - maid mother .


fn_spacy_tokens_for_baseline: Lucien rolled his head from side to side upon the wooden bench .

source_bert_toks: lucien rolled his head from side to side upon the wooden bench .

reference_raw: Lucien turned his head from side to side on a wooden bench.

reference_spacy_tokens: Lucien turned his head from side to side on a wooden bench .


fn_spacy_tokens_for_baseline: Once outside he linked arms with her and took her to the little pub that the station staff used .

source_bert_toks: once outside he linked arms with her and took her to the little pub that the station staff used .

reference_raw: When he was out, he joined her with his arms and led her to a small inn used by the station staff.

reference_spacy_tokens: When he was out , he joined her with his arms and led her to a small inn used by the station staff .


fn_spacy_tokens_for_baseline: ' And did you tell the foreign gentleman that her husband was going mad with jealousy ? '

source_bert_toks: ' and did you tell the foreign gentleman that her husband was going mad with jealousy ? '

reference_raw: "And you told the stranger that her husband went mad with jealousy?"

reference_spacy_tokens: " And you told the stranger that her husband went mad with jealousy ? "


fn_spacy_tokens_for_baseline: In ten years of programming I now have many companies utilising database applications for names and addresses , every one of them would have benefited by including Rapid Address within the database .

source_bert_toks: in ten years of programming i now have many companies ut ##ilis ##ing database applications for names and addresses , every one of them would have benefited by including rapid address within the database .

reference_raw: In ten years of programming, I now have a number of companies using database applications for names and addresses, each of which would benefit from the inclusion of Rapid Address in the database.

reference_spacy_tokens: In ten years of programming , I now have a number of companies using database applications for names and addresses , each of which would benefit from the inclusion of Rapid Address in the database .


fn_spacy_tokens_for_baseline: Each child had three recorded attempts without a noseclip and with a minimum exhalation of 1.5 seconds .

source_bert_toks: each child had three recorded attempts without a nose ##cl ##ip and with a minimum ex ##hala ##tion of 1 . 5 seconds .

reference_raw: Each child had three recorded attempts without a nose clip and a minimum breath of 1.5 seconds.

reference_spacy_tokens: Each child had three recorded attempts without a nose clip and a minimum breath of 1.5 seconds .


fn_spacy_tokens_for_baseline: Similarly farmers are more prepared to be indulgent about their employees ' working hours as long as the necessary tasks are carried out efficiently .

source_bert_toks: similarly farmers are more prepared to be ind ##ul ##gent about their employees ' working hours as long as the necessary tasks are carried out efficiently .

reference_raw: Similarly, farmers are more prepared to indulge in the working hours of their employees, provided that the necessary tasks are carried out effectively.

reference_spacy_tokens: Similarly , farmers are more prepared to indulge in the working hours of their employees , provided that the necessary tasks are carried out effectively .


fn_spacy_tokens_for_baseline: Vogts , an expert angler blissfully at home with his squad on the banks of Loch Lomond , took a harpoon gun to the legislators for their idea of forming a European Champions League .

source_bert_toks: vo ##gt ##s , an expert angle ##r bliss ##fully at home with his squad on the banks of loch lo ##mond , took a harp ##oon gun to the legislators for their idea of forming a european champions league .

reference_raw: Vogts, an expert angler blissfully at home with his team on the shores of Loch Lomond, brought a harpoon pistol to the legislators for their idea of forming a European champion's league.

reference_spacy_tokens: Vogts , an expert angler blissfully at home with his team on the shores of Loch Lomond , brought a harpoon pistol to the legislators for their idea of forming a European champion 's league .


fn_spacy_tokens_for_baseline: People have been tremendous with sponsorship .

source_bert_toks: people have been tremendous with sponsorship .

reference_raw: People were great with sponsorship.

reference_spacy_tokens: People were great with sponsorship .


fn_spacy_tokens_for_baseline: He has published monographs on the organisation and OOBs of all armies involved in the Crimean war .

source_bert_toks: he has published monograph ##s on the organisation and o ##ob ##s of all armies involved in the crimean war .

reference_raw: He published monograms of organizations and OOBs of all armies involved in the Crimean War.

reference_spacy_tokens: He published monograms of organizations and OOBs of all armies involved in the Crimean War .


fn_spacy_tokens_for_baseline: From the outset , commentators seem to have been astonished at the great interest the competition evoked .

source_bert_toks: from the outset , commentators seem to have been astonished at the great interest the competition ev ##oked .

reference_raw: From the very beginning, commentators appear to be surprised at the great interest that the competition has evoked.

reference_spacy_tokens: From the very beginning , commentators appear to be surprised at the great interest that the competition has evoked .


fn_spacy_tokens_for_baseline: The women grow fruit , vegetables and flowers , and raise flesh to sell in the place Mistral .

source_bert_toks: the women grow fruit , vegetables and flowers , and raise flesh to sell in the place mist ##ral .

reference_raw: Women grow fruit, vegetables, and flowers, and they grow meat for sale in the place of Mistral.

reference_spacy_tokens: Women grow fruit , vegetables , and flowers , and they grow meat for sale in the place of Mistral .


fn_spacy_tokens_for_baseline: The continued willingness of the Democratic People 's Republic of Korea ( DPRK ) , the People 's Republic of China ( PRC ) , and Russia to provide Iran with both missiles and missile - related technology that at the very least exceed the intentions of the Missile Technology Control Regime ( MTCR ) .

source_bert_toks: the continued willingness of the democratic people ' s republic of korea ( d ##pr ##k ) , the people ' s republic of china ( prc ) , and russia to provide iran with both missiles and missile - related technology that at the very least exceed the intentions of the missile technology control regime ( mt ##cr ) .

reference_raw: The continued readiness of the Democratic People's Republic of Korea (DPRK), the People's Republic of China (PRC) and Russia to provide both missile and missile technology to Iran, which at least goes beyond the intentions of the MTCR.

reference_spacy_tokens: The continued readiness of the Democratic People 's Republic of Korea ( DPRK ) , the People 's Republic of China ( PRC ) and Russia to provide both missile and missile technology to Iran , which at least goes beyond the intentions of the MTCR .


fn_spacy_tokens_for_baseline: But the aroma of the food lingered long after all the sounds of movement had ceased .

source_bert_toks: but the aroma of the food lingered long after all the sounds of movement had ceased .

reference_raw: But the smell of food lingered long after the sound of movement stopped.

reference_spacy_tokens: But the smell of food lingered long after the sound of movement stopped .


fn_spacy_tokens_for_baseline: In several cases , Amir , a third - year law student , cross - examined witnesses as Goldberg stood by .

source_bert_toks: in several cases , amir , a third - year law student , cross - examined witnesses as goldberg stood by .

reference_raw: In several cases, Amir, a third-year law student, inter-examined witnesses while Goldberg was standing by.

reference_spacy_tokens: In several cases , Amir , a third - year law student , inter - examined witnesses while Goldberg was standing by .


fn_spacy_tokens_for_baseline: However , if you watch house martins you will see that they do not simply ' plonk ' their mud pellets onto the wall ; instead , they place them in position while rapidly vibrating the head .

source_bert_toks: however , if you watch house martins you will see that they do not simply ' pl ##on ##k ' their mud pe ##llet ##s onto the wall ; instead , they place them in position while rapidly vibrating the head .

reference_raw: But if you look at the martins in the house, you'll see that they don't just "plonk" their mud pellets on the wall; instead, they'll put them in place, and they'll shake their heads quickly.

reference_spacy_tokens: But if you look at the martins in the house , you 'll see that they do n't just " plonk " their mud pellets on the wall ; instead , they 'll put them in place , and they 'll shake their heads quickly .


fn_spacy_tokens_for_baseline: She leaned the mop against the kitchen wall .

source_bert_toks: she leaned the mo ##p against the kitchen wall .

reference_raw: She put the mop against the wall of the kitchen.

reference_spacy_tokens: She put the mop against the wall of the kitchen .


fn_spacy_tokens_for_baseline: In its own way , the honeymoon finale was the highpoint of the trip .

source_bert_toks: in its own way , the honeymoon finale was the high ##point of the trip .

reference_raw: In a way, the finals of the honeymoon were the highlights of the journey.

reference_spacy_tokens: In a way , the finals of the honeymoon were the highlights of the journey .


fn_spacy_tokens_for_baseline: She knew if she forced it she would rip it .

source_bert_toks: she knew if she forced it she would rip it .

reference_raw: She knew that if she made him do it, she would tear it apart.

reference_spacy_tokens: She knew that if she made him do it , she would tear it apart .


fn_spacy_tokens_for_baseline: The ham is always easier to cut when it is well chilled and may be even easier to handle if it is lightly frozen .

source_bert_toks: the ham is always easier to cut when it is well chilled and may be even easier to handle if it is lightly frozen .

reference_raw: The ham is always easier to cut when it is well cooled and may be easier to handle when it is slightly frozen.

reference_spacy_tokens: The ham is always easier to cut when it is well cooled and may be easier to handle when it is slightly frozen .


fn_spacy_tokens_for_baseline: First he pretended two Angels found a wallet full of cash in New York and returned it to a pensioner who had been attacked .

source_bert_toks: first he pretended two angels found a wallet full of cash in new york and returned it to a pension ##er who had been attacked .

reference_raw: First, he pretended that two angels had found a purse full of money in New York and returned it to a retired man who had been assaulted.

reference_spacy_tokens: First , he pretended that two angels had found a purse full of money in New York and returned it to a retired man who had been assaulted .


fn_spacy_tokens_for_baseline: I had to read it , a little of it , and if listeners never hear any good of themselves , then the little which I read shamed me forever .

source_bert_toks: i had to read it , a little of it , and if listeners never hear any good of themselves , then the little which i read shame ##d me forever .

reference_raw: I had to read it, some of it, and if the listeners didn't hear anything good about themselves, then the little I read made me feel ashamed for ever.

reference_spacy_tokens: I had to read it , some of it , and if the listeners did n't hear anything good about themselves , then the little I read made me feel ashamed for ever .


fn_spacy_tokens_for_baseline: Drug cartels and terrorists are reported to be taking over the counterfeit clothing business .

source_bert_toks: drug cartel ##s and terrorists are reported to be taking over the counter ##feit clothing business .

reference_raw: It's reported that drug cartels and terrorists are taking over the fake clothing business.

reference_spacy_tokens: It 's reported that drug cartels and terrorists are taking over the fake clothing business .


fn_spacy_tokens_for_baseline: Crustaceans are able to amble freely among the anemone 's tentacles because their hard exoskeletons protect them from stings from the nematocysts .

source_bert_toks: crust ##ace ##ans are able to am ##ble freely among the an ##emon ##e ' s tentacles because their hard ex ##os ##kel ##eto ##ns protect them from sting ##s from the ne ##mat ##oc ##yst ##s .

reference_raw: Crustaceans are able to amplify freely among the anemone's tendrils, for their hard exoskeletons protect them from the stings of the nematocysts.

reference_spacy_tokens: Crustaceans are able to amplify freely among the anemone 's tendrils , for their hard exoskeletons protect them from the stings of the nematocysts .


fn_spacy_tokens_for_baseline: ' What makes you think Rainbow would entertain a love affair with the likes of you ? '

source_bert_toks: ' what makes you think rainbow would entertain a love affair with the likes of you ? '

reference_raw: "Why do you think Rainbow would entertain a love affair with your kind?"

reference_spacy_tokens: " Why do you think Rainbow would entertain a love affair with your kind ? "


fn_spacy_tokens_for_baseline: This was welcomed by the head of the Open Software Foundation in Japan , Dr Rob Morel , who ventured that possibly the Foundation was better positioned than before as a ' truly independent standards organisation ' .

source_bert_toks: this was welcomed by the head of the open software foundation in japan , dr rob more ##l , who ventured that possibly the foundation was better positioned than before as a ' truly independent standards organisation ' .

reference_raw: This was welcomed by the head of the Open Software Foundation in Japan, Dr. Rob Morel, who risked that the Foundation might be better placed than ever as a "really independent standard organization."

reference_spacy_tokens: This was welcomed by the head of the Open Software Foundation in Japan , Dr. Rob Morel , who risked that the Foundation might be better placed than ever as a " really independent standard organization . "


fn_spacy_tokens_for_baseline: Parmesan is a rich cheese at 130 calories an ounce , so try to hold back on nodding too enthusiastically when the waiter comes round with his spoon and bowl of cheese .

source_bert_toks: par ##mes ##an is a rich cheese at 130 cal ##ories an ounce , so try to hold back on nodding too enthusiastically when the waiter comes round with his spoon and bowl of cheese .

reference_raw: Parmesan is a rich cheese at 130 calories an hour, so try not to nod too enthusiastically when a waiter comes around with a spoon and a bowl of cheese.

reference_spacy_tokens: Parmesan is a rich cheese at 130 calories an hour , so try not to nod too enthusiastically when a waiter comes around with a spoon and a bowl of cheese .


fn_spacy_tokens_for_baseline: Ferguson 's promise was more praiseworthy than pondering how much Germany might have been holding in reserve .

source_bert_toks: ferguson ' s promise was more praise ##worthy than ponder ##ing how much germany might have been holding in reserve .

reference_raw: Ferguson's promise was more commendable than the idea of how much Germany could hold in reserve.

reference_spacy_tokens: Ferguson 's promise was more commendable than the idea of how much Germany could hold in reserve .


fn_spacy_tokens_for_baseline: In the following year , however , a plot was hatched by the English and their supporters , which regained for them control of the city .

source_bert_toks: in the following year , however , a plot was hatch ##ed by the english and their supporters , which regained for them control of the city .

reference_raw: In the following year, however, the English and their followers plotted to regain control of the city.

reference_spacy_tokens: In the following year , however , the English and their followers plotted to regain control of the city .


fn_spacy_tokens_for_baseline: The earliest name associated with the city , Ur usalim , perhaps meant " city of Shalim " or " founded by Shalim . "

source_bert_toks: the earliest name associated with the city , ur usa ##lim , perhaps meant " city of sha ##lim " or " founded by sha ##lim . "

reference_raw: The first name associated with the town, Ur usalim, may have meant "the town of Shalim" or "founded by Shalim."

reference_spacy_tokens: The first name associated with the town , Ur usalim , may have meant " the town of Shalim " or " founded by Shalim . "


fn_spacy_tokens_for_baseline: She drank slowly , found she was indeed hungry and munched a little on a biscuit .

source_bert_toks: she drank slowly , found she was indeed hungry and mu ##nched a little on a bis ##cuit .

reference_raw: She drank slowly, found herself really hungry, and chewed a little on the cookie.

reference_spacy_tokens: She drank slowly , found herself really hungry , and chewed a little on the cookie .


fn_spacy_tokens_for_baseline: Scunthorpe 's faithful few in a crowd of 7,682 had huddled on the terraces like penguins on an ice floe as the dankness seeped down the Pennine valleys .

source_bert_toks: sc ##unt ##horpe ' s faithful few in a crowd of 7 , 68 ##2 had huddled on the terraces like penguins on an ice fl ##oe as the dan ##k ##ness see ##ped down the penn ##ine valleys .

reference_raw: The faithful few of Scunthorpe in the crowd of 7,682 huddled on the terraces like penguins on an iceberg as the wetness soaked down the Pennine Valleys.

reference_spacy_tokens: The faithful few of Scunthorpe in the crowd of 7,682 huddled on the terraces like penguins on an iceberg as the wetness soaked down the Pennine Valleys .


fn_spacy_tokens_for_baseline: This busy , modern European city sits on a thousand years of history -- history is present everywhere , from elegant Merrion Square to the bullet holes on the General Post Office .

source_bert_toks: this busy , modern european city sits on a thousand years of history - - history is present everywhere , from elegant mer ##rion square to the bullet holes on the general post office .

reference_raw: This busy, modern European city sits on thousands of years of history - history is everywhere, from the graceful Merrion Square to the bullet holes in the General Post Office.

reference_spacy_tokens: This busy , modern European city sits on thousands of years of history - history is everywhere , from the graceful Merrion Square to the bullet holes in the General Post Office .


fn_spacy_tokens_for_baseline: 7- Safeguard AL - QAEDA 's general funds and do not mishandle these funds . ( Albukhairi ) 8- Sincerity in providing advice to commanders and to your brethren in AL - QAEDA , without harboring deception .

source_bert_toks: 7 - safeguard al - qaeda ' s general funds and do not mis ##hand ##le these funds . ( al ##bu ##kha ##iri ) 8 - sincerity in providing advice to commanders and to your brethren in al - qaeda , without harbor ##ing deception .

reference_raw: 7-Safeguard AL-QAEDA general funds and do not mishandle these funds. (Albukhairi) 8-Fairness to advise the commanders and your brothers in AL-QAEDA without concealing fraud.

reference_spacy_tokens: 7-Safeguard AL - QAEDA general funds and do not mishandle these funds . ( Albukhairi ) 8-Fairness to advise the commanders and your brothers in AL - QAEDA without concealing fraud .


fn_spacy_tokens_for_baseline: The function of a baseboard is to cover the joint between the wall and the floor , and secondarily to protect the wall from scuffing .

source_bert_toks: the function of a base ##board is to cover the joint between the wall and the floor , and second ##ari ##ly to protect the wall from sc ##uf ##fin ##g .

reference_raw: The role of the baseboard is to cover the joint between the wall and the floor and, secondly, to protect the wall from scuffing.

reference_spacy_tokens: The role of the baseboard is to cover the joint between the wall and the floor and , secondly , to protect the wall from scuffing .


fn_spacy_tokens_for_baseline: It was up in an instant and capering after its prey like an aquatic grasshopper .

source_bert_toks: it was up in an instant and cape ##ring after its prey like an aquatic grass ##hopper .

reference_raw: In an instant he was on his feet, camouflaging after his prey like a water locust.

reference_spacy_tokens: In an instant he was on his feet , camouflaging after his prey like a water locust .


fn_spacy_tokens_for_baseline: Motivation : The terrorist groups of greatest concern are motivated to inflict indiscriminate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

source_bert_toks: motivation : the terrorist groups of greatest concern are motivated to in ##flict ind ##is ##cr ##imi ##nate mass casualties ( random ; not targeting a specific person or persons ) and to engage in innovative and risky tactics .

reference_raw: The most important terrorist groups are motivated to cause indiscriminate mass casualties (random; not targeting a particular person or persons) and to engage in innovative and risky tactics.

reference_spacy_tokens: The most important terrorist groups are motivated to cause indiscriminate mass casualties ( random ; not targeting a particular person or persons ) and to engage in innovative and risky tactics .


fn_spacy_tokens_for_baseline: In some cases this happened by the direct emigration of European ideas and institutions .

source_bert_toks: in some cases this happened by the direct emigration of european ideas and institutions .

reference_raw: In some cases, this was due to the direct immigration of European ideas and institutions.

reference_spacy_tokens: In some cases , this was due to the direct immigration of European ideas and institutions .


fn_spacy_tokens_for_baseline: The only reason he did n't stop to annihilate both of us on his way home was that he knew there was n't a minute to lose .

source_bert_toks: the only reason he didn ' t stop to ann ##ih ##ila ##te both of us on his way home was that he knew there wasn ' t a minute to lose .

reference_raw: The only reason he didn't stop to destroy us both on the way home was because he knew we didn't have a minute to lose.

reference_spacy_tokens: The only reason he did n't stop to destroy us both on the way home was because he knew we did n't have a minute to lose .


fn_spacy_tokens_for_baseline: ' The shops here are very good , but Dana is inclined to turn her nose up at anything outside London or Paris , so I imagine an hour could see her back at the flat . '

source_bert_toks: ' the shops here are very good , but dana is inclined to turn her nose up at anything outside london or paris , so i imagine an hour could see her back at the flat . '

reference_raw: 'The stores here are very good, but Dana tends to turn her nose to anything outside London or Paris, so I think she might be back in the apartment for an hour.'

reference_spacy_tokens: ' The stores here are very good , but Dana tends to turn her nose to anything outside London or Paris , so I think she might be back in the apartment for an hour . '


fn_spacy_tokens_for_baseline: ' We 'll rule like kings , ' Pike slurred .

source_bert_toks: ' we ' ll rule like kings , ' pike sl ##ur ##red .

reference_raw: 'We will rule like kings,' said Pike.

reference_spacy_tokens: ' We will rule like kings , ' said Pike .


fn_spacy_tokens_for_baseline: Turmoil goes well with the preparation of cheese omelette followed by tossed salad , rice , and lightly grilled fillet steaks .

source_bert_toks: turmoil goes well with the preparation of cheese om ##ele ##tte followed by tossed salad , rice , and lightly grille ##d fill ##et steak ##s .

reference_raw: Turmoil is good for making cheese omelets, followed by discarded salads, rice, and slightly grilled fillet steaks.

reference_spacy_tokens: Turmoil is good for making cheese omelets , followed by discarded salads , rice , and slightly grilled fillet steaks .


fn_spacy_tokens_for_baseline: The whole community with their servants numbered about thirty .

source_bert_toks: the whole community with their servants numbered about thirty .

reference_raw: The entire community and its servants were in their mid-thirties.

reference_spacy_tokens: The entire community and its servants were in their mid - thirties .


fn_spacy_tokens_for_baseline: Restaurant boss Torbjorn Olsson , who sells the stuff in Soho , London , said : ' When they get home , their breath stinks of garlic not beer .

source_bert_toks: restaurant boss tor ##b ##jo ##rn ol ##sson , who sells the stuff in soho , london , said : ' when they get home , their breath stink ##s of garlic not beer .

reference_raw: The restaurant boss Torbjorn Olsson, who sells things in Soho, London, said, "When he comes home, his breath smells like garlic, not beer.

reference_spacy_tokens: The restaurant boss Torbjorn Olsson , who sells things in Soho , London , said , " When he comes home , his breath smells like garlic , not beer .


fn_spacy_tokens_for_baseline: ' It 's rubbish , ' Tremayne snorted .

source_bert_toks: ' it ' s rubbish , ' tre ##may ##ne snorted .

reference_raw: 'It's nonsense,' said Tremayne.

reference_spacy_tokens: ' It 's nonsense , ' said Tremayne .


fn_spacy_tokens_for_baseline: In other words , while the original does not communicate what the speaker wished to communicate , the reformulation does .

source_bert_toks: in other words , while the original does not communicate what the speaker wished to communicate , the reform ##ulation does .

reference_raw: In other words, although the original does not say what the speaker wants to say, the reformulation does.

reference_spacy_tokens: In other words , although the original does not say what the speaker wants to say , the reformulation does .


fn_spacy_tokens_for_baseline: Make sure that you have in plenty of supplies -- food , drink , clean nightwear and underwear , and so on -- that will eliminate the need for shopping after your operation .

source_bert_toks: make sure that you have in plenty of supplies - - food , drink , clean night ##wear and underwear , and so on - - that will eliminate the need for shopping after your operation .

reference_raw: Make sure you've got a lot of supplies - food, drink, clean night clothes, underwear, etc. - that eliminates the need to shop after surgery.

reference_spacy_tokens: Make sure you 've got a lot of supplies - food , drink , clean night clothes , underwear , etc . - that eliminates the need to shop after surgery .


fn_spacy_tokens_for_baseline: Now the special envoy of the UN High Commissioner for Refugees , Jose - Maria Mendiluce , says he is revolted to hear those words from Mr Boban .

source_bert_toks: now the special envoy of the un high commissioner for refugees , jose - maria men ##di ##lu ##ce , says he is revolt ##ed to hear those words from mr bob ##an .

reference_raw: Now, Special Envoy of the United Nations High Commissioner for Refugees, José-Maria Mendiluce, says he's rebellious when he hears these words from Mr. Boban.

reference_spacy_tokens: Now , Special Envoy of the United Nations High Commissioner for Refugees , Jose - Maria Mendiluce , says he 's rebellious when he hears these words from Mr. Boban .


fn_spacy_tokens_for_baseline: Japan 's ski jumpers wowed crowds of tens of thousands with their long , graceful leaps , while its speedskaters and a mogulist also dazzled .

source_bert_toks: japan ' s ski jumper ##s wow ##ed crowds of tens of thousands with their long , graceful leaps , while its speeds ##kat ##ers and a mo ##gul ##ist also da ##zzled .

reference_raw: The Japanese ski jumpers wove the crowds of tens of thousands with their long, graceful jumps, and the speed skaters and the mogulist were also dazzling.

reference_spacy_tokens: The Japanese ski jumpers wove the crowds of tens of thousands with their long , graceful jumps , and the speed skaters and the mogulist were also dazzling .


fn_spacy_tokens_for_baseline: Her character , Angela , goes for a Bohemian lifestyle and an affair with bumbling cop Matthew Modine .

source_bert_toks: her character , angela , goes for a bohemian lifestyle and an affair with bum ##bling cop matthew mod ##ine .

reference_raw: Her character, Angela, is in a Czech lifestyle and an affair with a bumming cop named Matthew Modine.

reference_spacy_tokens: Her character , Angela , is in a Czech lifestyle and an affair with a bumming cop named Matthew Modine .


fn_spacy_tokens_for_baseline: This is not , the Journal notes , a petty detail : If the co - pilot had actually said , " I have made my decision now , " that would seem to rule out the Egyptian government 's theory that the co - pilot 's " second " phrase , " I put my faith in God 's hands , " was a reaction to an as - yet - undiscovered mechanical problem .

source_bert_toks: this is not , the journal notes , a petty detail : if the co - pilot had actually said , " i have made my decision now , " that would seem to rule out the egyptian government ' s theory that the co - pilot ' s " second " phrase , " i put my faith in god ' s hands , " was a reaction to an as - yet - und ##is ##co ##vered mechanical problem .

reference_raw: This is not, the Journal notes, a small detail: if the co-pilot actually said, "I've already decided," it would seem to exclude the Egyptian government's theory that the co-pilot's "second" phrase, "I put my faith in the hands of God," was a response to an as yet undiscovered mechanical problem.

reference_spacy_tokens: This is not , the Journal notes , a small detail : if the co - pilot actually said , " I 've already decided , " it would seem to exclude the Egyptian government 's theory that the co - pilot 's " second " phrase , " I put my faith in the hands of God , " was a response to an as yet undiscovered mechanical problem .


fn_spacy_tokens_for_baseline: On the other hand , the most important person , the cameraman , wore jeans and a Micky Mouse T - shirt , over which his mournful , deadpan moon face shone incongruously .

source_bert_toks: on the other hand , the most important person , the camera ##man , wore jeans and a mick ##y mouse t - shirt , over which his mo ##urn ##ful , dead ##pan moon face shone inc ##ong ##ru ##ously .

reference_raw: On the other hand, the most important person, the cameraman, was wearing jeans and a Micky Mouse T-shirt over which his grieving, deadpan moon-face glowed incongruously.

reference_spacy_tokens: On the other hand , the most important person , the cameraman , was wearing jeans and a Micky Mouse T - shirt over which his grieving , deadpan moon - face glowed incongruously .


fn_spacy_tokens_for_baseline: ' This is further evidence that the major hospital on one side of the river is being denuded of major medical facilities .

source_bert_toks: ' this is further evidence that the major hospital on one side of the river is being den ##uded of major medical facilities .

reference_raw: This is further evidence that the main hospital on one side of the river is inhabited by large medical facilities.

reference_spacy_tokens: This is further evidence that the main hospital on one side of the river is inhabited by large medical facilities .


fn_spacy_tokens_for_baseline: Simmer gently until apple has softened .

source_bert_toks: sim ##mer gently until apple has softened .

reference_raw: Simmer gently until the apple is soft.

reference_spacy_tokens: Simmer gently until the apple is soft .


fn_spacy_tokens_for_baseline: After 1600 , there was a pause before the same issues emerged even more violently in the Civil War and led to the beheading of the king .

source_bert_toks: after 1600 , there was a pause before the same issues emerged even more violently in the civil war and led to the be ##head ##ing of the king .

reference_raw: After 1600, there was a pause before the same problems became more violent in the Civil War and led to the execution of the King.

reference_spacy_tokens: After 1600 , there was a pause before the same problems became more violent in the Civil War and led to the execution of the King .


fn_spacy_tokens_for_baseline: Her breasts became tender , she endured a faint queasiness in the mornings but no actual sickness and finally , her figure began to thicken and take on a matronly look .

source_bert_toks: her breasts became tender , she endured a faint que ##asi ##ness in the mornings but no actual sickness and finally , her figure began to thick ##en and take on a mat ##ron ##ly look .

reference_raw: Her breasts grew softer, she endured a slight discomfort in the morning, but no real illness, and at last her figure grew thicker and more matronly.

reference_spacy_tokens: Her breasts grew softer , she endured a slight discomfort in the morning , but no real illness , and at last her figure grew thicker and more matronly .


fn_spacy_tokens_for_baseline: My suggestion is that you and I go to - night and see if we can strike at the very heart of the mystery . '

source_bert_toks: my suggestion is that you and i go to - night and see if we can strike at the very heart of the mystery . '

reference_raw: I suggest we go tonight and see if we can strike at the very core of the mystery.'

reference_spacy_tokens: I suggest we go tonight and see if we can strike at the very core of the mystery . '


fn_spacy_tokens_for_baseline: After the quick sprint from Penumbra ' s , the cut there was bleeding heavily .

source_bert_toks: after the quick sprint from pen ##umb ##ra ' s , the cut there was bleeding heavily .

reference_raw: After a quick run from Penumbra's s, the wound was hemorrhaging.

reference_spacy_tokens: After a quick run from Penumbra 's s , the wound was hemorrhaging .


fn_spacy_tokens_for_baseline: The hot water cylinder supplies the domestic hot water to the taps .

source_bert_toks: the hot water cylinder supplies the domestic hot water to the taps .

reference_raw: Hot water bottles supply domestic hot water to taps.

reference_spacy_tokens: Hot water bottles supply domestic hot water to taps .


fn_spacy_tokens_for_baseline: All three aunts are fast asleep , snoring and dreaming in unison .

source_bert_toks: all three aunt ##s are fast asleep , s ##nor ##ing and dreaming in unison .

reference_raw: All three aunts sleep fast, snoring and dreaming in unison.

reference_spacy_tokens: All three aunts sleep fast , snoring and dreaming in unison .


fn_spacy_tokens_for_baseline: This was immediately whipped off by a waiting attendant who then passed it along a table for it to be boxed up and returned to me in the ante room .

source_bert_toks: this was immediately whipped off by a waiting attendant who then passed it along a table for it to be boxed up and returned to me in the ant ##e room .

reference_raw: It was immediately whipped away by the waiter, who then handed it to the desk so that it could be packed and returned to me in the anteroom.

reference_spacy_tokens: It was immediately whipped away by the waiter , who then handed it to the desk so that it could be packed and returned to me in the anteroom .


fn_spacy_tokens_for_baseline: Pitt remembers that as a little boy attending church he 'd sit cowering in the pew , afraid the preacher would ask him to come up and give the benediction .

source_bert_toks: pitt remembers that as a little boy attending church he ' d sit cow ##ering in the pew , afraid the preacher would ask him to come up and give the benedict ##ion .

reference_raw: Pitt remembers that when he was a little boy who went to church, he sat crouching on a bench, afraid that the preacher would ask him to come and give his blessing.

reference_spacy_tokens: Pitt remembers that when he was a little boy who went to church , he sat crouching on a bench , afraid that the preacher would ask him to come and give his blessing .


fn_spacy_tokens_for_baseline: The late eighteenth - century evidence adduced by Wyld and others is therefore likely to indicate the date at which it had become stigmatized as a ' vulgarism ' , rather than its date of origin .

source_bert_toks: the late eighteenth - century evidence add ##uce ##d by w ##yl ##d and others is therefore likely to indicate the date at which it had become stigma ##tized as a ' vulgar ##ism ' , rather than its date of origin .

reference_raw: Thus, the evidence submitted by Wyld and others at the end of the 18th century is likely to indicate the date on which it was stigmatised as "vulgarism" rather than its date of origin.

reference_spacy_tokens: Thus , the evidence submitted by Wyld and others at the end of the 18th century is likely to indicate the date on which it was stigmatised as " vulgarism " rather than its date of origin .


fn_spacy_tokens_for_baseline: ' The usual catch : did you lie about your criminal record ? '

source_bert_toks: ' the usual catch : did you lie about your criminal record ? '

reference_raw: "Usual catch: have you been a liar about your criminal record?"

reference_spacy_tokens: " Usual catch : have you been a liar about your criminal record ? "


fn_spacy_tokens_for_baseline: She shifted restlessly in her seat once more , imagining she could actually feel the angry pinpoint of fire burning deep inside her womb .

source_bert_toks: she shifted restless ##ly in her seat once more , imagining she could actually feel the angry pin ##point of fire burning deep inside her womb .

reference_raw: She shifted uncomfortably in her seat again, imagining that she could actually feel the angry pinpoint of fire in the depths of her womb.

reference_spacy_tokens: She shifted uncomfortably in her seat again , imagining that she could actually feel the angry pinpoint of fire in the depths of her womb .


fn_spacy_tokens_for_baseline: The second cell ( 82c ) contains a moaning , naked Orc chained down on a bed of nails which rip the boil - infested flesh on his back .

source_bert_toks: the second cell ( 82 ##c ) contains a moaning , naked or ##c chained down on a bed of nails which rip the boil - in ##fest ##ed flesh on his back .

reference_raw: The second cell (82c) contains a groaning, naked goblin strapped to a bed of nails that rips the boil-infested meat from his back.

reference_spacy_tokens: The second cell ( 82c ) contains a groaning , naked goblin strapped to a bed of nails that rips the boil - infested meat from his back .


fn_spacy_tokens_for_baseline: The island communities were undecided about which side to back for a time .

source_bert_toks: the island communities were und ##ec ##ided about which side to back for a time .

reference_raw: The island communities haven't decided which way to back up for a while.

reference_spacy_tokens: The island communities have n't decided which way to back up for a while .


fn_spacy_tokens_for_baseline: " The installation of monitoring systems and surveillance is taking place correctly and in the past days , the monitoring system has been strengthened , and there is no problem regarding this issue between Iran and the agency , " the official added ( Reuters / New York Times , Feb. 2 ) .

source_bert_toks: " the installation of monitoring systems and surveillance is taking place correctly and in the past days , the monitoring system has been strengthened , and there is no problem regarding this issue between iran and the agency , " the official added ( reuters / new york times , feb . 2 ) .

reference_raw: "The installation of monitoring and surveillance systems is correct and the monitoring system has been reinforced in recent days and there is no problem between Iran and the Agency," the official added (Reuters/New York Times, February 2).

reference_spacy_tokens: " The installation of monitoring and surveillance systems is correct and the monitoring system has been reinforced in recent days and there is no problem between Iran and the Agency , " the official added ( Reuters / New York Times , February 2 ) .


fn_spacy_tokens_for_baseline: She raised an arm and slashed at the dog with it ; it howled , and slunk away .

source_bert_toks: she raised an arm and slashed at the dog with it ; it howled , and sl ##unk away .

reference_raw: She raised her hand and slashed it at the dog; it howled and slipped away.

reference_spacy_tokens: She raised her hand and slashed it at the dog ; it howled and slipped away .


fn_spacy_tokens_for_baseline: But she had to battle for a York neck victory from Satank and trainer Jack Berry said : ' She ran well , but looked to be going over the top .

source_bert_toks: but she had to battle for a york neck victory from satan ##k and trainer jack berry said : ' she ran well , but looked to be going over the top .

reference_raw: But she had to fight for a York-neck victory from Satank and Coach Jack Berry said, "She was running well, but she looked like she was going over the top.

reference_spacy_tokens: But she had to fight for a York - neck victory from Satank and Coach Jack Berry said , " She was running well , but she looked like she was going over the top .


fn_spacy_tokens_for_baseline: This is why the rivers have many curves , because they follow the wriggling tracks of the serpent ; similarly , waterholes are round because they are in the shape of a snake coiled up to rest .

source_bert_toks: this is why the rivers have many curves , because they follow the wr ##ig ##gling tracks of the serpent ; similarly , water ##holes are round because they are in the shape of a snake coiled up to rest .

reference_raw: That is why the rivers have many curvatures, for they follow the twisting paths of the snake; similarly, the waterholes are round, for they are the shape of a snake curled up to rest.

reference_spacy_tokens: That is why the rivers have many curvatures , for they follow the twisting paths of the snake ; similarly , the waterholes are round , for they are the shape of a snake curled up to rest .


fn_spacy_tokens_for_baseline: War service of some kind would account both for Morpurgo 's disabilities and for Dysart 's generosity .

source_bert_toks: war service of some kind would account both for mor ##pur ##go ' s disabilities and for d ##ys ##art ' s generosity .

reference_raw: Some kind of war service would explain both Morpurgo's handicap and Dysart's generosity.

reference_spacy_tokens: Some kind of war service would explain both Morpurgo 's handicap and Dysart 's generosity .


fn_spacy_tokens_for_baseline: The Palestinians so far have been unenthusiastic about Albright 's latest proposal , which calls for Palestinians to fulfill Israeli security demands between phases of Israeli troop withdrawals .

source_bert_toks: the palestinians so far have been une ##nt ##hus ##ias ##tic about al ##bright ' s latest proposal , which calls for palestinians to fulfill israeli security demands between phases of israeli troop withdrawal ##s .

reference_raw: So far, the Palestinians are not thrilled with Albright's latest draft, which calls on the Palestinians to meet Israeli security requirements between the phases of Israeli troop withdrawals.

reference_spacy_tokens: So far , the Palestinians are not thrilled with Albright 's latest draft , which calls on the Palestinians to meet Israeli security requirements between the phases of Israeli troop withdrawals .


fn_spacy_tokens_for_baseline: Minton must have recognised its truth for he bequeathed it in his will to the Royal College of Art where it hangs as a memorial to him .

source_bert_toks: mint ##on must have recognised its truth for he bequeathed it in his will to the royal college of art where it hangs as a memorial to him .

reference_raw: Minton had to recognize the truth, for he left it in his will to the Royal College of Art, where it hung in his memory.

reference_spacy_tokens: Minton had to recognize the truth , for he left it in his will to the Royal College of Art , where it hung in his memory .


fn_spacy_tokens_for_baseline: Katy twirled in front of the mirror and smiled and smiled .

source_bert_toks: katy t ##wi ##rled in front of the mirror and smiled and smiled .

reference_raw: Katy turned in front of the mirror, smiled and smiled.

reference_spacy_tokens: Katy turned in front of the mirror , smiled and smiled .


fn_spacy_tokens_for_baseline: If you do not pay income tax , but your spouse does , you should not enter into a Deed of Covenant on your own .

source_bert_toks: if you do not pay income tax , but your spouse does , you should not enter into a deed of covenant on your own .

reference_raw: If you don't pay income tax, but your husband does, you shouldn't enter into the Covenant by yourself.

reference_spacy_tokens: If you do n't pay income tax , but your husband does , you should n't enter into the Covenant by yourself .


fn_spacy_tokens_for_baseline: One boy , a friend of Mark 's called Kenny , who was living in a hostel in Croydon , was housed on the 13th floor of a frequently vandalised tower block in Camberwell .

source_bert_toks: one boy , a friend of mark ' s called kenny , who was living in a hostel in croydon , was housed on the 13th floor of a frequently van ##dal ##ised tower block in cam ##ber ##well .

reference_raw: A boy, Mark's friend Kenny, who lived in a hotel in Croydon, was housed on the 13th floor of a frequently vandalized tower block in Camberwell.

reference_spacy_tokens: A boy , Mark 's friend Kenny , who lived in a hotel in Croydon , was housed on the 13th floor of a frequently vandalized tower block in Camberwell .


fn_spacy_tokens_for_baseline: Also on show are newly restored eighteenth - century stained glass panels and an elaborately embroidered early twentieth - century cope on loan from St Paul 's Cathedral .

source_bert_toks: also on show are newly restored eighteenth - century stained glass panels and an elaborate ##ly embroidered early twentieth - century cope on loan from st paul ' s cathedral .

reference_raw: The new 18th century stained glass panels and the elaborately embroidered early twentieth century deal with the loan from St Paul's Cathedral are also being restored to the show.

reference_spacy_tokens: The new 18th century stained glass panels and the elaborately embroidered early twentieth century deal with the loan from St Paul 's Cathedral are also being restored to the show .


fn_spacy_tokens_for_baseline: But now a more menacing threat was posed for Russia : massed German units were attacking the Polish salient from the north , while Austro - German armies thrust up from the southeast -- precisely the strategy that the Austrian commander General Conrad von Hotzendorff had advocated in 1914 .

source_bert_toks: but now a more menacing threat was posed for russia : mass ##ed german units were attacking the polish sal ##ient from the north , while austro - german armies thrust up from the southeast - - precisely the strategy that the austrian commander general conrad von hot ##zen ##dorff had advocated in 1914 .

reference_raw: But Russia was now faced with a more menacing threat: massed German troops were attacking the Polish salient from the north, while the Austrian army rose from the south-east - exactly the strategy advocated by the Austrian commander General Conrad von Hotzendorff in 1914.

reference_spacy_tokens: But Russia was now faced with a more menacing threat : massed German troops were attacking the Polish salient from the north , while the Austrian army rose from the south - east - exactly the strategy advocated by the Austrian commander General Conrad von Hotzendorff in 1914 .


fn_spacy_tokens_for_baseline: From Elvis to The Stones to Iron Maiden parents have long been unnerved by the latest outrage on Top Of The Pops .

source_bert_toks: from elvis to the stones to iron maiden parents have long been un ##ner ##ved by the latest outrage on top of the pops .

reference_raw: From Elvis to the Stones to Iron Maiden's parents have long been nervous about the latest indignation on Top of the Pops.

reference_spacy_tokens: From Elvis to the Stones to Iron Maiden 's parents have long been nervous about the latest indignation on Top of the Pops .


fn_spacy_tokens_for_baseline: She had not uttered a word during the relation of the news , nor shown any emotion .

source_bert_toks: she had not uttered a word during the relation of the news , nor shown any emotion .

reference_raw: She didn't say a word during the news session, and she didn't show any emotion.

reference_spacy_tokens: She did n't say a word during the news session , and she did n't show any emotion .


fn_spacy_tokens_for_baseline: This blue volume opened with an enlargement , a full page uncharacteristically given over to a single picture , which he had taken himself , with the old Argus that had been left him by an aunt .

source_bert_toks: this blue volume opened with an en ##lar ##gement , a full page un ##cha ##rac ##ter ##istic ##ally given over to a single picture , which he had taken himself , with the old argus that had been left him by an aunt .

reference_raw: The blue volume opened with an augmentation, the whole page uncharacteristically handed over to a single image he had taken of himself and the old Argus his aunt had given him.

reference_spacy_tokens: The blue volume opened with an augmentation , the whole page uncharacteristically handed over to a single image he had taken of himself and the old Argus his aunt had given him .


fn_spacy_tokens_for_baseline: His death in December 1981 was mourned by hundreds of former pupils and countless friends within the deaf community .

source_bert_toks: his death in december 1981 was mo ##urne ##d by hundreds of former pupils and countless friends within the deaf community .

reference_raw: Hundreds of former students and countless friends in the deaf community grieved for his death in December 1981.

reference_spacy_tokens: Hundreds of former students and countless friends in the deaf community grieved for his death in December 1981 .


fn_spacy_tokens_for_baseline: With her long cotton dress tucked up for ease of movement , Emily looked neat and easy beside the rangy , untidy figure of the young magician .

source_bert_toks: with her long cotton dress tucked up for ease of movement , emily looked neat and easy beside the rang ##y , un ##ti ##dy figure of the young magician .

reference_raw: With her long cotton dress tucked up for ease of movement, Emily looked neat and easy beside the ragged figure of the young wizard.

reference_spacy_tokens: With her long cotton dress tucked up for ease of movement , Emily looked neat and easy beside the ragged figure of the young wizard .


fn_spacy_tokens_for_baseline: ' They invaded the office and took our ID cards and asked us to stay inside .

source_bert_toks: ' they invaded the office and took our id cards and asked us to stay inside .

reference_raw: They broke into our office, took our I.D. cards, and asked us to stay in.

reference_spacy_tokens: They broke into our office , took our I.D. cards , and asked us to stay in .


fn_spacy_tokens_for_baseline: President Obama announced the death to the world , saying the Al Qaeda leader died in a firefight with U. S. special forces .

source_bert_toks: president obama announced the death to the world , saying the al qaeda leader died in a fire ##fight with u . s . special forces .

reference_raw: President Obama announced the death of the world, saying that the leader of Al Qaeda died in a shootout with U.S. Special Forces.

reference_spacy_tokens: President Obama announced the death of the world , saying that the leader of Al Qaeda died in a shootout with U.S. Special Forces .


fn_spacy_tokens_for_baseline: They sprayed cold water on my dog when it was snowing and all her fur froze .

source_bert_toks: they sprayed cold water on my dog when it was snow ##ing and all her fur froze .

reference_raw: When it snowed, they sprayed cold water on my dog, and all her fur went cold.

reference_spacy_tokens: When it snowed , they sprayed cold water on my dog , and all her fur went cold .


fn_spacy_tokens_for_baseline: But he was unrepentant over his affair with actress Antonia de Sancha and his string of freebie holidays .

source_bert_toks: but he was un ##re ##pen ##tan ##t over his affair with actress antonia de san ##cha and his string of free ##bie holidays .

reference_raw: But he didn't regret his affair with actress Antonia de Sancha and his string of freebie holidays.

reference_spacy_tokens: But he did n't regret his affair with actress Antonia de Sancha and his string of freebie holidays .


fn_spacy_tokens_for_baseline: Fire - fighters first had hope of gaining control on the morning of Thursday , June 12 , but the wind changed direction during the day , causing a large extension of the fire .

source_bert_toks: fire - fighters first had hope of gaining control on the morning of thursday , june 12 , but the wind changed direction during the day , causing a large extension of the fire .

reference_raw: For the first time, the firemen had hopes of gaining control on Thursday, June 12th, but the wind shifted direction during the day, causing the fire to expand considerably.

reference_spacy_tokens: For the first time , the firemen had hopes of gaining control on Thursday , June 12th , but the wind shifted direction during the day , causing the fire to expand considerably .


fn_spacy_tokens_for_baseline: She paused to crunch a ginger biscuit .

source_bert_toks: she paused to crunch a ginger bis ##cuit .

reference_raw: She stopped and crunched the ginger cookie.

reference_spacy_tokens: She stopped and crunched the ginger cookie .


fn_spacy_tokens_for_baseline: Coal gas poisoning was a common method of successful suicide until the carbon monoxide content of domestic gas was reduced .

source_bert_toks: coal gas poisoning was a common method of successful suicide until the carbon mono ##xide content of domestic gas was reduced .

reference_raw: Intoxication of coal gas is a common method of successful suicide until the carbon monoxide content of domestic gas is reduced.

reference_spacy_tokens: Intoxication of coal gas is a common method of successful suicide until the carbon monoxide content of domestic gas is reduced .


fn_spacy_tokens_for_baseline: Swire Sugden sat smirking in his black Mercedes with two of his heavy mob standing by .

source_bert_toks: sw ##ire su ##g ##den sat smirk ##ing in his black mercedes with two of his heavy mob standing by .

reference_raw: Swire Sugden sat smiling in his black Mercedes, and the two heavy crowds were ready.

reference_spacy_tokens: Swire Sugden sat smiling in his black Mercedes , and the two heavy crowds were ready .


fn_spacy_tokens_for_baseline: The unit costs used in assessing expenditure needs for indictable offences were reduced overall during the three year period .

source_bert_toks: the unit costs used in assessing expenditure needs for ind ##ic ##table offences were reduced overall during the three year period .

reference_raw: Over the three-year period, the unit costs used to assess the expenditure needs of criminal offences have been reduced overall.

reference_spacy_tokens: Over the three - year period , the unit costs used to assess the expenditure needs of criminal offences have been reduced overall .


fn_spacy_tokens_for_baseline: Well I hope so too but it was n't the whole object of the exercise .

source_bert_toks: well i hope so too but it wasn ' t the whole object of the exercise .

reference_raw: I hope so, but that wasn't the whole point of the exercise.

reference_spacy_tokens: I hope so , but that was n't the whole point of the exercise .


fn_spacy_tokens_for_baseline: They had sat on opposite sides of the empty fireplace in the drawing room for some time without speaking , each wondering how the subject could be broached .

source_bert_toks: they had sat on opposite sides of the empty fireplace in the drawing room for some time without speaking , each wondering how the subject could be bro ##ache ##d .

reference_raw: They sat on opposite sides of the empty hearth in the drawing-room for a while without speaking, each wondering how to broach the subject.

reference_spacy_tokens: They sat on opposite sides of the empty hearth in the drawing - room for a while without speaking , each wondering how to broach the subject .


fn_spacy_tokens_for_baseline: The processes of making pottery are demonstrated here , and the building complex includes an engine house and a saggar maker 's shop , where fireclay cases were made for holding batches of pots during firing .

source_bert_toks: the processes of making pottery are demonstrated here , and the building complex includes an engine house and a sa ##gga ##r maker ' s shop , where fire ##cl ##ay cases were made for holding batch ##es of pots during firing .

reference_raw: The process of making ceramics is demonstrated here, and the building complex includes the engine house and the saggar shop, where fireclay boxes have been made to hold batches of pots during fire.

reference_spacy_tokens: The process of making ceramics is demonstrated here , and the building complex includes the engine house and the saggar shop , where fireclay boxes have been made to hold batches of pots during fire .


fn_spacy_tokens_for_baseline: Reports of exports and leakage of Russian missile technology to countries such as Iran , India , China , Libya , and North Korea have led to concerns that Russia is contravening its obligations as a member of the Missile Technology Control Regime ( MTCR ) .

source_bert_toks: reports of exports and leak ##age of russian missile technology to countries such as iran , india , china , libya , and north korea have led to concerns that russia is contra ##ven ##ing its obligations as a member of the missile technology control regime ( mt ##cr ) .

reference_raw: Reports of imports and leaks of Russian missile technology to countries like Iran, India, China, Libya and North Korea have led to concerns that Russia is in breach of its obligations as a member of the MTCR.

reference_spacy_tokens: Reports of imports and leaks of Russian missile technology to countries like Iran , India , China , Libya and North Korea have led to concerns that Russia is in breach of its obligations as a member of the MTCR .


fn_spacy_tokens_for_baseline: At least this dust was somewhat localized whilst that from machine drills could fill headings and stopes until at times it was impossible for a miner to see his hand in front of his face in the dim candlelight .

source_bert_toks: at least this dust was somewhat localized whilst that from machine drills could fill heading ##s and stop ##es until at times it was impossible for a miner to see his hand in front of his face in the dim candle ##light .

reference_raw: At least the dust was somewhat localized, while the machine drills could fill the headings and stop until the miner could not see his hand before his face in the faint light of the candles.

reference_spacy_tokens: At least the dust was somewhat localized , while the machine drills could fill the headings and stop until the miner could not see his hand before his face in the faint light of the candles .


fn_spacy_tokens_for_baseline: America had , said the paper , just launched a new submarine torpedo boat , declared ( by the Americans , I hope ) ' to be the most unique vessel of that character ever invented ' .

source_bert_toks: america had , said the paper , just launched a new submarine torpedo boat , declared ( by the americans , i hope ) ' to be the most unique vessel of that character ever invented ' .

reference_raw: America, the newspaper said, had just started a new submarine torpedo ship, which the Americans (I hope) declared to be the most unique vessel of this character ever invented.

reference_spacy_tokens: America , the newspaper said , had just started a new submarine torpedo ship , which the Americans ( I hope ) declared to be the most unique vessel of this character ever invented .


fn_spacy_tokens_for_baseline: This paper describes a technique that allows metabolism of nutrients to be assessed in whole epithelial biopsy specimens , and this technique has been used to assess the metabolism of butyrate and glutamine by ileal and colonic biopsy specimens from patients with idiopathic ulcerative colitis and controls .

source_bert_toks: this paper describes a technique that allows metabolism of nutrients to be assessed in whole ep ##ith ##elial bio ##psy specimens , and this technique has been used to assess the metabolism of but ##yra ##te and g ##lu ##tam ##ine by ile ##al and colon ##ic bio ##psy specimens from patients with id ##io ##pathic ul ##cera ##tive coli ##tis and controls .

reference_raw: This document describes a technique that allows the metabolism of nutrients to be assessed in whole samples of epithelial biopsy, and was used to evaluate the metabolism of butyrate and glutamine by ileal and colonic biopsy samples from patients with idiopathic ulcerative colitis and in the management of these samples.

reference_spacy_tokens: This document describes a technique that allows the metabolism of nutrients to be assessed in whole samples of epithelial biopsy , and was used to evaluate the metabolism of butyrate and glutamine by ileal and colonic biopsy samples from patients with idiopathic ulcerative colitis and in the management of these samples .


fn_spacy_tokens_for_baseline: I was down in the workshops and I 've run a great splinter into my thumb . '

source_bert_toks: i was down in the workshops and i ' ve run a great splinter into my thumb . '

reference_raw: I was in the workshops, and I hit my thumb with a big splinter.'

reference_spacy_tokens: I was in the workshops , and I hit my thumb with a big splinter . '


fn_spacy_tokens_for_baseline: John Paul Jones was less easily discouraged , and much more feared , as he began to seem uncatchable .

source_bert_toks: john paul jones was less easily discouraged , and much more feared , as he began to seem un ##cat ##cha ##ble .

reference_raw: John Paul Jones was less easily dissuaded and much more fearful, for he was beginning to look invincible.

reference_spacy_tokens: John Paul Jones was less easily dissuaded and much more fearful , for he was beginning to look invincible .


fn_spacy_tokens_for_baseline: Towards dusk we were galvanised into action by a hail from shore , our boat was despatched and soon some very tired shepherds with their exhausted dogs flopped over the gunwale .

source_bert_toks: towards dusk we were gal ##vani ##sed into action by a hail from shore , our boat was des ##pa ##tched and soon some very tired shepherd ##s with their exhausted dogs flopped over the gun ##wal ##e .

reference_raw: By dusk we had been galvanized into action by a hail from the coast, and our ship had been dispatched, and soon some very tired shepherds with their tired dogs had flopped over the wall.

reference_spacy_tokens: By dusk we had been galvanized into action by a hail from the coast , and our ship had been dispatched , and soon some very tired shepherds with their tired dogs had flopped over the wall .


fn_spacy_tokens_for_baseline: There was more in this vein as they turned right , and Mungo realized for the first time that they were actually heading into the forest .

source_bert_toks: there was more in this vein as they turned right , and mu ##ngo realized for the first time that they were actually heading into the forest .

reference_raw: When they turned to the right, there was more in that vein, and for the first time Mungo realized that they were actually going into the woods.

reference_spacy_tokens: When they turned to the right , there was more in that vein , and for the first time Mungo realized that they were actually going into the woods .


fn_spacy_tokens_for_baseline: It worked and for the next half hour she was able to quiz the woman whom she saw as having stolen her happiness on every aspect of her life .

source_bert_toks: it worked and for the next half hour she was able to quiz the woman whom she saw as having stolen her happiness on every aspect of her life .

reference_raw: It worked, and for the next half hour she could question the woman she thought had stolen her happiness from every aspect of her life.

reference_spacy_tokens: It worked , and for the next half hour she could question the woman she thought had stolen her happiness from every aspect of her life .


fn_spacy_tokens_for_baseline: To the left of the sofa is yet another table with more papers , a small portable tape - recorder for the occasional piece of dictation and a bottle of Malvern which I take neat when thirsty .

source_bert_toks: to the left of the sofa is yet another table with more papers , a small portable tape - recorder for the occasional piece of di ##cta ##tion and a bottle of malvern which i take neat when thirsty .

reference_raw: There's another table on the left side of the couch with other papers, a small transferable tape recorder for the occasional dictation, and a bottle of Malvern that I take neatly when I'm thirsty.

reference_spacy_tokens: There 's another table on the left side of the couch with other papers , a small transferable tape recorder for the occasional dictation , and a bottle of Malvern that I take neatly when I 'm thirsty .


fn_spacy_tokens_for_baseline: This is the embryonic Iraqi SWAT team in action , rousing families from their sleep and rounding up men for questioning about the deadly insurgency in towns such as Jabella , south of Baghdad .

source_bert_toks: this is the embryo ##nic iraqi swat team in action , ro ##using families from their sleep and rounding up men for questioning about the deadly insurgency in towns such as ja ##bella , south of baghdad .

reference_raw: It's an embryonic Iraqi SWAT team in action that wakes families from their sleep and gathers men for questioning the deadly rebellion in cities like Jabella, south of Baghdad.

reference_spacy_tokens: It 's an embryonic Iraqi SWAT team in action that wakes families from their sleep and gathers men for questioning the deadly rebellion in cities like Jabella , south of Baghdad .


fn_spacy_tokens_for_baseline: And the larder was locked again .

source_bert_toks: and the la ##rder was locked again .

reference_raw: And the pantry was locked again.

reference_spacy_tokens: And the pantry was locked again .


fn_spacy_tokens_for_baseline: The people still carve jade and build seaworthy junks , all by hand .

source_bert_toks: the people still car ##ve jade and build sea ##worthy junk ##s , all by hand .

reference_raw: People are still cutting jade and building seaworthy junk, all by hand.

reference_spacy_tokens: People are still cutting jade and building seaworthy junk , all by hand .


fn_spacy_tokens_for_baseline: Quacking and complaining , the ducks hopped back into the water and swam away .

source_bert_toks: qu ##ack ##ing and complaining , the ducks hopped back into the water and swam away .

reference_raw: The ducks, whooping and complaining, jumped back into the water and swam away.

reference_spacy_tokens: The ducks , whooping and complaining , jumped back into the water and swam away .


fn_spacy_tokens_for_baseline: It is this failure that Iraqi officials warn could sabotage any chance for an agreement on U. S. troops staying .

source_bert_toks: it is this failure that iraqi officials warn could sabotage any chance for an agreement on u . s . troops staying .

reference_raw: This failure, warned by Iraqi officials, could destroy any chance of an agreement on the stay of American troops.

reference_spacy_tokens: This failure , warned by Iraqi officials , could destroy any chance of an agreement on the stay of American troops .


fn_spacy_tokens_for_baseline: He did not go as far as he could have in tax reductions ; indeed he combined them with increases in indirect taxes .

source_bert_toks: he did not go as far as he could have in tax reductions ; indeed he combined them with increases in indirect taxes .

reference_raw: It did not go to the limit of tax cuts; it did indeed combine them with an increase in indirect taxes.

reference_spacy_tokens: It did not go to the limit of tax cuts ; it did indeed combine them with an increase in indirect taxes .