fn_spacy_tokens_for_baseline: When asked by Xinhua if there is any plan for him to meet Iraq officials , he said " I have not been asked to meet any top Iraqi officials .

source_bert_toks: when asked by xi ##nh ##ua if there is any plan for him to meet iraq officials , he said " i have not been asked to meet any top iraqi officials .

reference_raw: When Xinhua asked if he had a plan to meet with Iraq's officials, he said, "I wasn't asked to meet any of the top Iraq's officials.

reference_spacy_tokens: When Xinhua asked if he had a plan to meet with Iraq 's officials , he said , " I was n't asked to meet any of the top Iraq 's officials .


fn_spacy_tokens_for_baseline: They had never talked at any length before and Seb found the gipsy stimulating and amusing company .

source_bert_toks: they had never talked at any length before and se ##b found the gi ##psy stimulating and amusing company .

reference_raw: They had never spoken before, and Seb found the Gypsy stimulating and entertaining company.

reference_spacy_tokens: They had never spoken before , and Seb found the Gypsy stimulating and entertaining company .


fn_spacy_tokens_for_baseline: He 'd tried to ring me with the good news but I had been out .

source_bert_toks: he ' d tried to ring me with the good news but i had been out .

reference_raw: He tried to tell me the good news, but I was gone.

reference_spacy_tokens: He tried to tell me the good news , but I was gone .


fn_spacy_tokens_for_baseline: In London he gradually took over the Underground system and came to control every line except the Metropolitan .

source_bert_toks: in london he gradually took over the underground system and came to control every line except the metropolitan .

reference_raw: In London, he gradually took over the subterranean system and took control of all the lines except the Metropolitan.

reference_spacy_tokens: In London , he gradually took over the subterranean system and took control of all the lines except the Metropolitan .


fn_spacy_tokens_for_baseline: The basic solution is first to restrict the flow of water percolating down into the aquifers by planting trees , preferably native species , on the higher ground .

source_bert_toks: the basic solution is first to restrict the flow of water per ##cola ##ting down into the a ##qui ##fers by planting trees , prefer ##ably native species , on the higher ground .

reference_raw: First of all, the basic solution is to limit the flow of water percolation to the aquifers by planting trees, preferably native species, on the higher ground.

reference_spacy_tokens: First of all , the basic solution is to limit the flow of water percolation to the aquifers by planting trees , preferably native species , on the higher ground .


fn_spacy_tokens_for_baseline: The street was jammed with people .

source_bert_toks: the street was jammed with people .

reference_raw: The street was full of people.

reference_spacy_tokens: The street was full of people .


fn_spacy_tokens_for_baseline: Then when you tapped at the window I thought it had come again . '

source_bert_toks: then when you tapped at the window i thought it had come again . '

reference_raw: And then when you knocked on the glass, I thought it was coming again.'

reference_spacy_tokens: And then when you knocked on the glass , I thought it was coming again . '


fn_spacy_tokens_for_baseline: It is understood some of her attackers sat on her to pin her to the floor while others battered her round the head with baseball bats .

source_bert_toks: it is understood some of her attackers sat on her to pin her to the floor while others battered her round the head with baseball bats .

reference_raw: It is understood that some of her assailants were sitting on it to pin it to the ground, while others were beating it around the head with baseball bats.

reference_spacy_tokens: It is understood that some of her assailants were sitting on it to pin it to the ground , while others were beating it around the head with baseball bats .


fn_spacy_tokens_for_baseline: She flung the receiver away from her as though it were rotten , and backed toward the door .

source_bert_toks: she flung the receiver away from her as though it were rotten , and backed toward the door .

reference_raw: She threw the phone away from her as if it had been rotted, and retreated to the door.

reference_spacy_tokens: She threw the phone away from her as if it had been rotted , and retreated to the door .


fn_spacy_tokens_for_baseline: A matched pair of front fog lamps can be substituted for headlamps in conditions of fog or falling snow .

source_bert_toks: a matched pair of front fog lamps can be substituted for head ##lam ##ps in conditions of fog or falling snow .

reference_raw: In conditions of fog or falling snow, a pair of front fog lamps may be replaced by a pair of front fog lamps.

reference_spacy_tokens: In conditions of fog or falling snow , a pair of front fog lamps may be replaced by a pair of front fog lamps .


fn_spacy_tokens_for_baseline: Top the whole thing off with a dessert of chocolate mousse in strawberry sauce and wash it down with a Bordeaux red .

source_bert_toks: top the whole thing off with a dessert of chocolate mo ##uss ##e in strawberry sauce and wash it down with a bordeaux red .

reference_raw: Top it all with a chocolate mousse dessert in strawberry gravy and wash it with Bordeaux red.

reference_spacy_tokens: Top it all with a chocolate mousse dessert in strawberry gravy and wash it with Bordeaux red .


fn_spacy_tokens_for_baseline: Gary Kasparov ranks as the greatest player of all time .

source_bert_toks: gary ka ##spar ##ov ranks as the greatest player of all time .

reference_raw: Gary Kasparov is the best player ever.

reference_spacy_tokens: Gary Kasparov is the best player ever .


fn_spacy_tokens_for_baseline: But the slopes are grassy , and thickets of brambles , stands of alexander with dark , shiny green leaves , clumps of elder and the Japanese spindle , offer shelter to migrating birds .

source_bert_toks: but the slopes are grassy , and thick ##ets of bram ##bles , stands of alexander with dark , shiny green leaves , cl ##ump ##s of elder and the japanese spin ##dle , offer shelter to migrating birds .

reference_raw: But the slopes are grassy and thickets of brambles, Alexander's stands with dark, shiny green leaves, clusters of older and Japanese spindles offer shelter for migrating birds.

reference_spacy_tokens: But the slopes are grassy and thickets of brambles , Alexander 's stands with dark , shiny green leaves , clusters of older and Japanese spindles offer shelter for migrating birds .


fn_spacy_tokens_for_baseline: The most dramatic of the bridges built in Scotland by Thomas Telford ( q.v . ) is undoubtedly the Cartland Crags Bridge , which crosses the gorge of Mouse Water just north west of Lanark .

source_bert_toks: the most dramatic of the bridges built in scotland by thomas tel ##ford ( q . v . ) is undoubtedly the cart ##land cr ##ags bridge , which crosses the gorge of mouse water just north west of lana ##rk .

reference_raw: The most dramatic of the bridges built in Scotland by Thomas Telford (Q.V.) is without a doubt the Cartland Crags Bridge, which crosses the Mouse Water ravine just southwest of Lanark.

reference_spacy_tokens: The most dramatic of the bridges built in Scotland by Thomas Telford ( Q.V. ) is without a doubt the Cartland Crags Bridge , which crosses the Mouse Water ravine just southwest of Lanark .


fn_spacy_tokens_for_baseline: I was astonished by the amount of pain that Manuela seemed to thrive on .

source_bert_toks: i was astonished by the amount of pain that manuel ##a seemed to thrive on .

reference_raw: I was surprised at how much pain Manuela seemed to prosper.

reference_spacy_tokens: I was surprised at how much pain Manuela seemed to prosper .


fn_spacy_tokens_for_baseline: Scraps of paper , previously sodden , begin to stir in the gutters .

source_bert_toks: scrap ##s of paper , previously so ##dden , begin to stir in the gut ##ters .

reference_raw: Scraps of paper, which had been soaked before, began to move in the sewers.

reference_spacy_tokens: Scraps of paper , which had been soaked before , began to move in the sewers .


fn_spacy_tokens_for_baseline: Now , I 'll save your life , if I can , but it must be a bargain -- you must save Long John from dying under the law . "

source_bert_toks: now , i ' ll save your life , if i can , but it must be a bargain - - you must save long john from dying under the law . "

reference_raw: I'm going to rescue you if I can, but it's got to be a deal - you've got to keep Long John from dying by the law.'

reference_spacy_tokens: I 'm going to rescue you if I can , but it 's got to be a deal - you 've got to keep Long John from dying by the law . '


fn_spacy_tokens_for_baseline: The speaker from the Northern Region will get on very well with my three year old granddaughter , she do n't like crocodiles either .

source_bert_toks: the speaker from the northern region will get on very well with my three year old granddaughter , she don ' t like crocodile ##s either .

reference_raw: A spokesman from the Northern Region is going to get along very well with my three-year-old grandchild, and she doesn't like crocodiles either.

reference_spacy_tokens: A spokesman from the Northern Region is going to get along very well with my three - year - old grandchild , and she does n't like crocodiles either .


fn_spacy_tokens_for_baseline: To the beginner , the proliferation of academic criticism in particular can present a bewildering and rather daunting picture of competing schools of thought .

source_bert_toks: to the begin ##ner , the proliferation of academic criticism in particular can present a be ##wil ##der ##ing and rather da ##unt ##ing picture of competing schools of thought .

reference_raw: To begin with, the spread of academic criticism may, in particular, create a confusing and rather frightening picture of competing schools of thought.

reference_spacy_tokens: To begin with , the spread of academic criticism may , in particular , create a confusing and rather frightening picture of competing schools of thought .


fn_spacy_tokens_for_baseline: The angel weeps as the spot opens , tears of rain apparently coursing down a soft - featured face .

source_bert_toks: the angel weep ##s as the spot opens , tears of rain apparently co ##urs ##ing down a soft - featured face .

reference_raw: The angel weeps as the place opens, and tears of rain seem to course on his soft features.

reference_spacy_tokens: The angel weeps as the place opens , and tears of rain seem to course on his soft features .


fn_spacy_tokens_for_baseline: But on numerous other occasions during our six hour excursion the police tactics worked superbly .

source_bert_toks: but on numerous other occasions during our six hour excursion the police tactics worked superb ##ly .

reference_raw: But on many other occasions during our six-hour trip, the police tactics worked perfectly.

reference_spacy_tokens: But on many other occasions during our six - hour trip , the police tactics worked perfectly .


fn_spacy_tokens_for_baseline: Here was a man , held in high esteem by outsiders , yet his behaviour inside the home was abominable .

source_bert_toks: here was a man , held in high esteem by outsiders , yet his behaviour inside the home was ab ##omi ##nable .

reference_raw: There was a man, held with great respect by outsiders, but his behavior in the house was repulsive.

reference_spacy_tokens: There was a man , held with great respect by outsiders , but his behavior in the house was repulsive .


fn_spacy_tokens_for_baseline: There are formal operational thinkers -- those who immediately grasp the abstract form of the problem and solve it quickly and easily .

source_bert_toks: there are formal operational thinkers - - those who immediately grasp the abstract form of the problem and solve it quickly and easily .

reference_raw: There are official operational thinkers - those who immediately understand the abstract form of the problem and resolve it quickly and easily.

reference_spacy_tokens: There are official operational thinkers - those who immediately understand the abstract form of the problem and resolve it quickly and easily .


fn_spacy_tokens_for_baseline: I discovered that some of my results did not agree with those of other observers , and of course everything depends upon the quality of one 's eyesight .

source_bert_toks: i discovered that some of my results did not agree with those of other observers , and of course everything depends upon the quality of one ' s eyes ##ight .

reference_raw: I found that some of my results disagreed with the results of the other observers, and of course it all depended on the quality of my eyesight.

reference_spacy_tokens: I found that some of my results disagreed with the results of the other observers , and of course it all depended on the quality of my eyesight .


fn_spacy_tokens_for_baseline: She thrust her hands into her pockets and stamped her feet on the ground , willing warmth to come into them .

source_bert_toks: she thrust her hands into her pockets and stamped her feet on the ground , willing warmth to come into them .

reference_raw: She put her hands in her pockets and stomped her feet on the floor, willingly warm to enter.

reference_spacy_tokens: She put her hands in her pockets and stomped her feet on the floor , willingly warm to enter .


fn_spacy_tokens_for_baseline: Earlier this month the partners of this shop in Cheltenham were fined £ 600 each for selling fake top brand name t - shirts .

source_bert_toks: earlier this month the partners of this shop in cheltenham were fined £ ##60 ##0 each for selling fake top brand name t - shirts .

reference_raw: Earlier this month, the partners in this store in Cheltenham received a fine of £600 each for the sale of false top-brand T-shirts.

reference_spacy_tokens: Earlier this month , the partners in this store in Cheltenham received a fine of £ 600 each for the sale of false top - brand T - shirts .


fn_spacy_tokens_for_baseline: She tiptoed by a well - mown lawn , then a garden jumbled high with broken washing machines , bicycles , empty flowerpots and scraps of wood .

source_bert_toks: she tip ##to ##ed by a well - mo ##wn lawn , then a garden ju ##mbled high with broken washing machines , bicycles , empty flower ##pot ##s and scrap ##s of wood .

reference_raw: She tiptoed along a well-mown lawn, then the garden jumbled high with broken washing machines, bicycles, empty flowerpots, and bits of wood.

reference_spacy_tokens: She tiptoed along a well - mown lawn , then the garden jumbled high with broken washing machines , bicycles , empty flowerpots , and bits of wood .


fn_spacy_tokens_for_baseline: In 1979 , Syria established its Atomic Energy Commission ( AECS ) largely to manage IAEA assistance programs and to plan for the eventual development of a nuclear power program .

source_bert_toks: in 1979 , syria established its atomic energy commission ( ae ##cs ) largely to manage ia ##ea assistance programs and to plan for the eventual development of a nuclear power program .

reference_raw: In 1979, Syria set up its Atomic Energy Commission (AECS) for the main purpose of managing IAEA aid programmes and planning the possible development of a nuclear energy programme.

reference_spacy_tokens: In 1979 , Syria set up its Atomic Energy Commission ( AECS ) for the main purpose of managing IAEA aid programmes and planning the possible development of a nuclear energy programme .


fn_spacy_tokens_for_baseline: The insects buzzed , whined , hummed , stridulated and droned as the air grew warmer in the sunset .

source_bert_toks: the insects buzzed , w ##hine ##d , hummed , st ##rid ##ulated and drone ##d as the air grew warmer in the sunset .

reference_raw: As the air grew warmer in the sunset, the insects buzzed, whined, hummed, stridulated, and hummed.

reference_spacy_tokens: As the air grew warmer in the sunset , the insects buzzed , whined , hummed , stridulated , and hummed .


fn_spacy_tokens_for_baseline: For 20 minutes the death squad blazed away , but most of the bullets failed to penetrate their victims ' heavy vests of jewels and medals .

source_bert_toks: for 20 minutes the death squad blazed away , but most of the bullets failed to penetrate their victims ' heavy vest ##s of jewels and medals .

reference_raw: The death squad had been on fire for twenty minutes, but most of the bullets had failed to penetrate the victim's heavy waistcoats of jewels and medals.

reference_spacy_tokens: The death squad had been on fire for twenty minutes , but most of the bullets had failed to penetrate the victim 's heavy waistcoats of jewels and medals .


fn_spacy_tokens_for_baseline: In early 2004 , Pakistani nuclear scientist Dr. A. Q. Khan revealed that he had sold gas - centrifuge technology to North Korea , Libya and Iran .

source_bert_toks: in early 2004 , pakistani nuclear scientist dr . a . q . khan revealed that he had sold gas - cent ##ri ##fu ##ge technology to north korea , libya and iran .

reference_raw: At the beginning of 2004, Pakistani nuclear scientist Dr. A. Q. Khan discovered that he had sold gas - centrifuge technology to North Korea, Libya, and Iran.

reference_spacy_tokens: At the beginning of 2004 , Pakistani nuclear scientist Dr. A. Q. Khan discovered that he had sold gas - centrifuge technology to North Korea , Libya , and Iran .


fn_spacy_tokens_for_baseline: The officer I have been escorting is a most pleasant chap , and I have really had a day 's holiday .

source_bert_toks: the officer i have been escorting is a most pleasant cha ##p , and i have really had a day ' s holiday .

reference_raw: The officer I'm escorting is a very nice guy, and I've actually had a day's vacation.

reference_spacy_tokens: The officer I 'm escorting is a very nice guy , and I 've actually had a day 's vacation .


fn_spacy_tokens_for_baseline: He scanned the newsprint greedily while his teeth sank into the bacon sandwich , the melted margarine dribbling over his fingers .

source_bert_toks: he scanned the news ##print greed ##ily while his teeth sank into the bacon sandwich , the melted mar ##gar ##ine dr ##ib ##bling over his fingers .

reference_raw: He studied the print greedily as his teeth sank into the bacon sandwich and the melted margarine dribbled over his fingers.

reference_spacy_tokens: He studied the print greedily as his teeth sank into the bacon sandwich and the melted margarine dribbled over his fingers .


fn_spacy_tokens_for_baseline: A large exchange of acreage has been agreed with BP which gives LASMO acreage containing gas discoveries adjacent to the Caister and Markham fields .

source_bert_toks: a large exchange of acre ##age has been agreed with bp which gives las ##mo acre ##age containing gas discoveries adjacent to the cai ##ster and markham fields .

reference_raw: A large exchange of acreage was agreed with BP, which gives LASMO acreage containing gas findings adjacent to the Caister and Markham fields.

reference_spacy_tokens: A large exchange of acreage was agreed with BP , which gives LASMO acreage containing gas findings adjacent to the Caister and Markham fields .


fn_spacy_tokens_for_baseline: The old forests burned as the Dark Elves took vengeance for their long exile .

source_bert_toks: the old forests burned as the dark elves took vengeance for their long exile .

reference_raw: The ancient forests burned as the dark elves avenged their long exile.

reference_spacy_tokens: The ancient forests burned as the dark elves avenged their long exile .


fn_spacy_tokens_for_baseline: Ed_Henry : Democratic leader Harry Reed accused Republicans of failing to probe allegations the White House manipulated intelligence to justify the war in Iraq .

source_bert_toks: ed _ henry : democratic leader harry reed accused republicans of failing to probe allegations the white house manipulated intelligence to justify the war in iraq .

reference_raw: Ed_Henry: Democratic leader Harry Reed accused Republicans of not probing allegations that the White House manipulated information to justify the war in Iraq.

reference_spacy_tokens: Ed_Henry : Democratic leader Harry Reed accused Republicans of not probing allegations that the White House manipulated information to justify the war in Iraq .


fn_spacy_tokens_for_baseline: At the Aegean Sea drunken middle - aged men drink and sing and sputter as packs of walruses do , calling to us in obscene and gravelly voices .

source_bert_toks: at the aegean sea drunken middle - aged men drink and sing and sp ##utter as packs of wal ##rus ##es do , calling to us in obscene and gravel ##ly voices .

reference_raw: In the Aegean Sea, drunken middle-aged men drink and sing and spit like packs of walruses, calling to us in obscene, grave voices.

reference_spacy_tokens: In the Aegean Sea , drunken middle - aged men drink and sing and spit like packs of walruses , calling to us in obscene , grave voices .


fn_spacy_tokens_for_baseline: It has 28 kilometres of cellars in which the equivalent of 90 million bottles are stored , and which are visited by more than 150,000 people a year .

source_bert_toks: it has 28 kilometres of cellar ##s in which the equivalent of 90 million bottles are stored , and which are visited by more than 150 , 000 people a year .

reference_raw: There are 28 km of basements where the equivalent of 90 million bottles is stored and more than 150,000 people visit each year.

reference_spacy_tokens: There are 28 km of basements where the equivalent of 90 million bottles is stored and more than 150,000 people visit each year .


fn_spacy_tokens_for_baseline: It contains elaborate replicas of China 's chief monments in impressive detail , including a scaled - down version of the Great Wall .

source_bert_toks: it contains elaborate replica ##s of china ' s chief mon ##ments in impressive detail , including a scaled - down version of the great wall .

reference_raw: It contains intricate replicas of China's main monments in spectacular detail, including the scaled-down version of the Great Wall.

reference_spacy_tokens: It contains intricate replicas of China 's main monments in spectacular detail , including the scaled - down version of the Great Wall .


fn_spacy_tokens_for_baseline: From the County Gate car park on the A39 to the east of Lynmouth walk south , along the path signed to Malmsmede and Oare .

source_bert_toks: from the county gate car park on the a ##39 to the east of l ##yn ##mouth walk south , along the path signed to mal ##ms ##med ##e and o ##are .

reference_raw: From the parking lot of the county gate on the A39 south of Lynmouth, on the road signed by Malmsmede and Oare.

reference_spacy_tokens: From the parking lot of the county gate on the A39 south of Lynmouth , on the road signed by Malmsmede and Oare .


fn_spacy_tokens_for_baseline: Between the 1740s and the 1820s , Romney Marsh was openly terrorized by armed gangs of smugglers .

source_bert_toks: between the 1740 ##s and the 1820s , romney marsh was openly terror ##ized by armed gangs of smug ##glers .

reference_raw: Between the 1740s and 1820s, Romney Marsh was openly terrorised by armed gangs of smugglers.

reference_spacy_tokens: Between the 1740s and 1820s , Romney Marsh was openly terrorised by armed gangs of smugglers .


fn_spacy_tokens_for_baseline: Hoses snaked across the floor from the freighters to the tanks , while cables stretched out from blocky generators like the arms of octopi .

source_bert_toks: hose ##s snake ##d across the floor from the freighter ##s to the tanks , while cables stretched out from block ##y generators like the arms of oct ##op ##i .

reference_raw: The hoses slid across the floor from the freighters to the tanks, while the cables stretched out from the blocky generators like the arms of an octopi.

reference_spacy_tokens: The hoses slid across the floor from the freighters to the tanks , while the cables stretched out from the blocky generators like the arms of an octopi .


fn_spacy_tokens_for_baseline: ' He dropped down just now , and the doctor said there was no hope for him because it 's his heart ! '

source_bert_toks: ' he dropped down just now , and the doctor said there was no hope for him because it ' s his heart ! '

reference_raw: "He just fell, and the doctor said there's no hope for him because it's his heart!"

reference_spacy_tokens: " He just fell , and the doctor said there 's no hope for him because it 's his heart ! "


fn_spacy_tokens_for_baseline: " The installation of monitoring systems and surveillance is taking place correctly and in the past days , the monitoring system has been strengthened , and there is no problem regarding this issue between Iran and the agency , " the official added ( Reuters / New York Times , Feb. 2 ) .

source_bert_toks: " the installation of monitoring systems and surveillance is taking place correctly and in the past days , the monitoring system has been strengthened , and there is no problem regarding this issue between iran and the agency , " the official added ( reuters / new york times , feb . 2 ) .

reference_raw: "The installation of monitoring and surveillance systems is correct and the monitoring system has been strengthened over the past few days, and there is no problem between Iran and the CIA on this issue," the official added (Reuters/New York Times, February 2).

reference_spacy_tokens: " The installation of monitoring and surveillance systems is correct and the monitoring system has been strengthened over the past few days , and there is no problem between Iran and the CIA on this issue , " the official added ( Reuters / New York Times , February 2 ) .


fn_spacy_tokens_for_baseline: Perception gradually yields territory to fantasy and hallucination as the protagonist 's faculty for reality - testing breaks down and doubt increases .

source_bert_toks: perception gradually yields territory to fantasy and hall ##uc ##ination as the protagonist ' s faculty for reality - testing breaks down and doubt increases .

reference_raw: As the protagonist's ability to test reality breaks down and doubt grows, perceptions gradually turn to fantasy and hallucinations.

reference_spacy_tokens: As the protagonist 's ability to test reality breaks down and doubt grows , perceptions gradually turn to fantasy and hallucinations .


fn_spacy_tokens_for_baseline: About 100 years ago Robert Koch was confronted by a similar situation , albeit at the microscopic rather than the ultramicroscopic level .

source_bert_toks: about 100 years ago robert koch was confronted by a similar situation , albeit at the microscopic rather than the ultra ##mic ##ros ##copic level .

reference_raw: About a hundred years ago, Robert Koch faced a similar situation, though not ultramicroscopic, but microscopic.

reference_spacy_tokens: About a hundred years ago , Robert Koch faced a similar situation , though not ultramicroscopic , but microscopic .


fn_spacy_tokens_for_baseline: Dense black smoke billowed 3,000 ft into the air , forcing police to evacuate coastal towns .

source_bert_toks: dense black smoke bill ##owed 3 , 000 ##ft into the air , forcing police to evacuate coastal towns .

reference_raw: A thick black smoke billowed 3,000 feet into the air, forcing the police to clear the coastal cities.

reference_spacy_tokens: A thick black smoke billowed 3,000 feet into the air , forcing the police to clear the coastal cities .


fn_spacy_tokens_for_baseline: Matron , who was getting used to talking with upset people , calmed him down .

source_bert_toks: mat ##ron , who was getting used to talking with upset people , calmed him down .

reference_raw: Matron, accustomed to talking to angry people, calmed him down.

reference_spacy_tokens: Matron , accustomed to talking to angry people , calmed him down .


fn_spacy_tokens_for_baseline: We had made contact with the elusive guerrillas of the Guatemalan National Revolutionary Unity .

source_bert_toks: we had made contact with the elusive guerrillas of the guatemala ##n national revolutionary unity .

reference_raw: We've made contact with the elusive guerillas of the Guatemalan National Revolutionary Unity.

reference_spacy_tokens: We 've made contact with the elusive guerillas of the Guatemalan National Revolutionary Unity .


fn_spacy_tokens_for_baseline: Last night I reprised our run over the bridge , trying several new bars , a different brand of goo , and a couple of drinks .

source_bert_toks: last night i reprised our run over the bridge , trying several new bars , a different brand of goo , and a couple of drinks .

reference_raw: I reprised our run across the bridge last night, tested a few new bars, a different brand of goo, and a few drinks.

reference_spacy_tokens: I reprised our run across the bridge last night , tested a few new bars , a different brand of goo , and a few drinks .


fn_spacy_tokens_for_baseline: A top surgeon says the manufacturers of replacement hip and knee joints are making large profits at the expense of the Health Service .

source_bert_toks: a top surgeon says the manufacturers of replacement hip and knee joints are making large profits at the expense of the health service .

reference_raw: The top surgeon says that producers of replacement hip and knee joints make a lot of money at the expense of the health service.

reference_spacy_tokens: The top surgeon says that producers of replacement hip and knee joints make a lot of money at the expense of the health service .


fn_spacy_tokens_for_baseline: Too many schools demand that parents and children be uncritical fans .

source_bert_toks: too many schools demand that parents and children be un ##cr ##itical fans .

reference_raw: Too many schools require parents and children to be non-critical fans.

reference_spacy_tokens: Too many schools require parents and children to be non - critical fans .


fn_spacy_tokens_for_baseline: Our current human capital profile has succession planning , structural , and skills imbalance problems that we need to address if we are to maintain and build our capacity to support the Congress and achieve the goals of our strategic plan in the 21st century .

source_bert_toks: our current human capital profile has succession planning , structural , and skills im ##balance problems that we need to address if we are to maintain and build our capacity to support the congress and achieve the goals of our strategic plan in the 21st century .

reference_raw: Our current human capital profile has inheritance planning, structural and skills imbalances that we need to address if we are to maintain and build our capacity to support Congress and achieve the goals of our 21st century strategic plan.

reference_spacy_tokens: Our current human capital profile has inheritance planning , structural and skills imbalances that we need to address if we are to maintain and build our capacity to support Congress and achieve the goals of our 21st century strategic plan .


fn_spacy_tokens_for_baseline: The locality can not be fully protected without having patrols roaming on the outside area of the fence .

source_bert_toks: the locality can not be fully protected without having patrols roaming on the outside area of the fence .

reference_raw: The site cannot be fully protected without patrols roaming the perimeter of the fence.

reference_spacy_tokens: The site can not be fully protected without patrols roaming the perimeter of the fence .


fn_spacy_tokens_for_baseline: At least one member of a party of four must be on a list of persons who have attended a formal safety briefing which will be held at the beginning of each year .

source_bert_toks: at least one member of a party of four must be on a list of persons who have attended a formal safety briefing which will be held at the beginning of each year .

reference_raw: At least one party member of four shall be on the list of persons participating in the official security briefing to be held at the beginning of each year.

reference_spacy_tokens: At least one party member of four shall be on the list of persons participating in the official security briefing to be held at the beginning of each year .


fn_spacy_tokens_for_baseline: She would spoil her cats , read library books and tend her garden and the riotous rockery of flowers along the south wall of the house that he encouraged the cattle to eat .

source_bert_toks: she would spoil her cats , read library books and tend her garden and the riot ##ous rocker ##y of flowers along the south wall of the house that he encouraged the cattle to eat .

reference_raw: He spoils his cats, he reads library books, and he tends his garden and the unruly flowers on the southern wall of the house, which he encourages the cattle to eat.

reference_spacy_tokens: He spoils his cats , he reads library books , and he tends his garden and the unruly flowers on the southern wall of the house , which he encourages the cattle to eat .


fn_spacy_tokens_for_baseline: At first there was a period of confusion as porters , cursing and sweating , brought up bags , chests and coffers .

source_bert_toks: at first there was a period of confusion as porter ##s , cursing and sweating , brought up bags , chests and co ##ffer ##s .

reference_raw: There was a time of confusion at first, when the porters, cursing and sweating, raised sacks, chests, and boxes.

reference_spacy_tokens: There was a time of confusion at first , when the porters , cursing and sweating , raised sacks , chests , and boxes .


fn_spacy_tokens_for_baseline: This , in turn , means that the female can only lay a relatively small number of eggs in a clutch .

source_bert_toks: this , in turn , means that the female can only lay a relatively small number of eggs in a clutch .

reference_raw: This means, in turn, that a woman can only put a relatively small number of eggs in a handcuff.

reference_spacy_tokens: This means , in turn , that a woman can only put a relatively small number of eggs in a handcuff .


fn_spacy_tokens_for_baseline: THE chairman of East Hampshire District Council , Elsa Bulmer , paid an informal visit to the children of Liphook Infant School last week .

source_bert_toks: the chairman of east hampshire district council , elsa bu ##lmer , paid an informal visit to the children of lip ##ho ##ok infant school last week .

reference_raw: Last week, President of the East Hampshire District Council, Elsa Bulmer, made an informal visit to the children of the Liphook Infant School.

reference_spacy_tokens: Last week , President of the East Hampshire District Council , Elsa Bulmer , made an informal visit to the children of the Liphook Infant School .


fn_spacy_tokens_for_baseline: Since this is rarely so , a deft body evasion , backed up with a counter - block just before the moment of the attack 's impact , almost always pays dividends .

source_bert_toks: since this is rarely so , a def ##t body eva ##sion , backed up with a counter - block just before the moment of the attack ' s impact , almost always pays divide ##nds .

reference_raw: Since this is rarely the case, a deft body fraud, backed up by a counterblock just before the impact of the attack, almost always pays dividends.

reference_spacy_tokens: Since this is rarely the case , a deft body fraud , backed up by a counterblock just before the impact of the attack , almost always pays dividends .


fn_spacy_tokens_for_baseline: Melissa recounted briefly the exchanges on the way to the belvedere and the altercation over the book .

source_bert_toks: melissa recounted briefly the exchanges on the way to the bel ##ved ##ere and the alter ##cation over the book .

reference_raw: Melissa gave a brief account of the exchanges on the way to the Belvedere and the argument over the book.

reference_spacy_tokens: Melissa gave a brief account of the exchanges on the way to the Belvedere and the argument over the book .


fn_spacy_tokens_for_baseline: At last , and no thanks to you . '

source_bert_toks: at last , and no thanks to you . '

reference_raw: Finally, and not because of you.'

reference_spacy_tokens: Finally , and not because of you . '


fn_spacy_tokens_for_baseline: Amal lost consciousness after the third boy raped her .

source_bert_toks: ama ##l lost consciousness after the third boy raped her .

reference_raw: Amal had lost consciousness after she had been violated by a third boy.

reference_spacy_tokens: Amal had lost consciousness after she had been violated by a third boy .


fn_spacy_tokens_for_baseline: In these circumstances it is sufficient for the broker to disclose to the customer that he is acting as principal , provided that he does not charge commission .

source_bert_toks: in these circumstances it is sufficient for the broker to disclose to the customer that he is acting as principal , provided that he does not charge commission .

reference_raw: In such circumstances, it is sufficient that the broker informs the customer that he acts as principal, provided that he does not charge commission.

reference_spacy_tokens: In such circumstances , it is sufficient that the broker informs the customer that he acts as principal , provided that he does not charge commission .


fn_spacy_tokens_for_baseline: She smiled across to where Edward still frolicked on the sand .

source_bert_toks: she smiled across to where edward still fr ##olic ##ked on the sand .

reference_raw: She smiled to where Edward was still floating in the sand.

reference_spacy_tokens: She smiled to where Edward was still floating in the sand .


fn_spacy_tokens_for_baseline: Mitch 's chin dipped an inch and then lifted again .

source_bert_toks: mitch ' s chin dipped an inch and then lifted again .

reference_raw: Mitch's chin dipped an inch and then heaved up again.

reference_spacy_tokens: Mitch 's chin dipped an inch and then heaved up again .


fn_spacy_tokens_for_baseline: If the modern educational system was administered by a Dickensian Squeers constantly flagellating discalced pupils , theory could be neatly shelved and a pragmatic response could be given to the perceived problem .

source_bert_toks: if the modern educational system was administered by a dickens ##ian sq ##ue ##ers constantly flag ##ella ##ting disc ##al ##ced pupils , theory could be neatly she ##lved and a pr ##ag ##matic response could be given to the perceived problem .

reference_raw: If the modern education system was managed by a Dickensian Squeers who constantly flagged discalced pupils, the theory could be neatly shelved and a pragmatic response could be given to the perceived problem.

reference_spacy_tokens: If the modern education system was managed by a Dickensian Squeers who constantly flagged discalced pupils , the theory could be neatly shelved and a pragmatic response could be given to the perceived problem .


fn_spacy_tokens_for_baseline: I thanked him for his cheering thought and walked over to interrupt Barry who was involved with a small group of well - heeled tourists at the far end of the bar .

source_bert_toks: i thanked him for his cheering thought and walked over to interrupt barry who was involved with a small group of well - heel ##ed tourists at the far end of the bar .

reference_raw: I thanked him for his cheerful thoughts and went to interrupt Barry, who was involved with a small group of well-heeled tourists at the far end of the bar.

reference_spacy_tokens: I thanked him for his cheerful thoughts and went to interrupt Barry , who was involved with a small group of well - heeled tourists at the far end of the bar .


fn_spacy_tokens_for_baseline: The dogs bounded about her , obstreperously wagging their tails .

source_bert_toks: the dogs bounded about her , ob ##st ##re ##per ##ously wa ##gging their tails .

reference_raw: Dogs ran around her, waving their tails obstinately.

reference_spacy_tokens: Dogs ran around her , waving their tails obstinately .


fn_spacy_tokens_for_baseline: Ruth wondered if she was gazing at the dark whiskers which sprouted on her chin and made her so appropriately , though unfortunately , named .

source_bert_toks: ruth wondered if she was gazing at the dark w ##his ##kers which sp ##routed on her chin and made her so appropriately , though unfortunately , named .

reference_raw: Ruth wondered if she was staring at the dark beard that had grown on her chin and made it so convenient, though sadly, a name.

reference_spacy_tokens: Ruth wondered if she was staring at the dark beard that had grown on her chin and made it so convenient , though sadly , a name .


fn_spacy_tokens_for_baseline: There were almost enough tins to have one or the other each week .

source_bert_toks: there were almost enough tin ##s to have one or the other each week .

reference_raw: It was almost full of cans every week for one or the other.

reference_spacy_tokens: It was almost full of cans every week for one or the other .


fn_spacy_tokens_for_baseline: Given that there are so few women in powerful positions this may seem surprising .

source_bert_toks: given that there are so few women in powerful positions this may seem surprising .

reference_raw: Given the fact that there are so few women in a strong position, it might seem startling.

reference_spacy_tokens: Given the fact that there are so few women in a strong position , it might seem startling .


fn_spacy_tokens_for_baseline: Los Angeles police handcuffed him and hauled him off to jail .

source_bert_toks: los angeles police hand ##cu ##ffed him and hauled him off to jail .

reference_raw: L.A.P.D. tied him up and dragged him to prison.

reference_spacy_tokens: L.A.P.D. tied him up and dragged him to prison .


fn_spacy_tokens_for_baseline: His mouth was too dry to speak but he could not reach for the water now .

source_bert_toks: his mouth was too dry to speak but he could not reach for the water now .

reference_raw: His lips were too dry to speak, but now he couldn't reach for water.

reference_spacy_tokens: His lips were too dry to speak , but now he could n't reach for water .


fn_spacy_tokens_for_baseline: Emerson had begun his career with Lotus in 1970 , scoring his first grand prix victory at Watkins Glen in 1971 .

source_bert_toks: emerson had begun his career with lotus in 1970 , scoring his first grand prix victory at watkins glen in 1971 .

reference_raw: Emerson started his career with Lotus in 1970, and in 1971 he scored his first big win at Watkins Glen.

reference_spacy_tokens: Emerson started his career with Lotus in 1970 , and in 1971 he scored his first big win at Watkins Glen .


fn_spacy_tokens_for_baseline: After centuries of intensive mining , Durham now has no deep pits left in operation .

source_bert_toks: after centuries of intensive mining , durham now has no deep pits left in operation .

reference_raw: After a hundred years of intense mining, Durham no longer has any deep pits in operation.

reference_spacy_tokens: After a hundred years of intense mining , Durham no longer has any deep pits in operation .


fn_spacy_tokens_for_baseline: Callers were told to enter the building via backstairs , avoiding the downstairs shop , which had no connection with the parlour .

source_bert_toks: caller ##s were told to enter the building via backs ##tai ##rs , avoiding the downstairs shop , which had no connection with the par ##lou ##r .

reference_raw: The callers were told to go through the backstairs and avoid the downstairs store, which had nothing to do with the salon.

reference_spacy_tokens: The callers were told to go through the backstairs and avoid the downstairs store , which had nothing to do with the salon .


fn_spacy_tokens_for_baseline: After qualifying for the East semi - finals in impressive style , Essex beat Hertfordshire 3 - 1 and trounced Cambridgeshire 5 - 1 in the final , after taking a 2 - 0 lead at half - time .

source_bert_toks: after qualifying for the east semi - finals in impressive style , essex beat hertfordshire 3 - 1 and tr ##oun ##ced cambridgeshire 5 - 1 in the final , after taking a 2 - 0 lead at half - time .

reference_raw: After qualifying for the East Semi-Finals in impressive style, Essex beat Hertfordshire 3-1 and trotted Cambridgeshire 5-1 in the final, after a two-zero lead in half-time.

reference_spacy_tokens: After qualifying for the East Semi - Finals in impressive style , Essex beat Hertfordshire 3 - 1 and trotted Cambridgeshire 5 - 1 in the final , after a two - zero lead in half - time .


fn_spacy_tokens_for_baseline: ' I wo n't agree to a divorce , ' he warned , and moved closer , as if trying to intimidate her physically with the powerful bulk of his body .

source_bert_toks: ' i won ' t agree to a divorce , ' he warned , and moved closer , as if trying to int ##imi ##date her physically with the powerful bulk of his body .

reference_raw: "I'm not going to agree to a divorce," he warned, moving closer, as if trying to scare her physically with the bulk of his body.

reference_spacy_tokens: " I 'm not going to agree to a divorce , " he warned , moving closer , as if trying to scare her physically with the bulk of his body .


fn_spacy_tokens_for_baseline: In addition to aerial - delivered chemical ordnance ( bombs , possibly other types of ordnance ) , DPRK military airfields ( as of 1993 ) have posted a platoon of chemical defense personnel equipped decontamination and detection systems .

source_bert_toks: in addition to aerial - delivered chemical ordnance ( bombs , possibly other types of ordnance ) , d ##pr ##k military airfields ( as of 1993 ) have posted a platoon of chemical defense personnel equipped deco ##nta ##mina ##tion and detection systems .

reference_raw: In addition to airborne chemical commands (bombs, possibly other types of order), DPRK military airports (since 1993) have deployed a team of chemical defense personnel with decontamination and detection systems.

reference_spacy_tokens: In addition to airborne chemical commands ( bombs , possibly other types of order ) , DPRK military airports ( since 1993 ) have deployed a team of chemical defense personnel with decontamination and detection systems .


fn_spacy_tokens_for_baseline: Karamanlis said , " This is a day of national mourning ... I wish to express my deep grief over the lost lives ... We are fighting against heavy odds , on many fronts and under particularly tough conditions . "

source_bert_toks: kara ##man ##lis said , " this is a day of national mourning . . . i wish to express my deep grief over the lost lives . . . we are fighting against heavy odds , on many fronts and under particularly tough conditions . "

reference_raw: Karamanlis said, "This is a nation's day of mourning... and I want to express my deep sorrow for the loss of our lives... we fight against great odds, on many fronts, and in particularly difficult circumstances."

reference_spacy_tokens: Karamanlis said , " This is a nation 's day of mourning ... and I want to express my deep sorrow for the loss of our lives ... we fight against great odds , on many fronts , and in particularly difficult circumstances . "


fn_spacy_tokens_for_baseline: Further differences between the stars were underlined by Schaffner .

source_bert_toks: further differences between the stars were under ##lined by sc ##ha ##ff ##ner .

reference_raw: Schaffner pointed out other differences between the stars.

reference_spacy_tokens: Schaffner pointed out other differences between the stars .


fn_spacy_tokens_for_baseline: These primers were used in combination with a common 3 ' primer based in the beta chain constant region , BC63 ( 5'- GTGTGGCCTTTTGGGTGT-3 ' ) .

source_bert_toks: these prime ##rs were used in combination with a common 3 ' prime ##r based in the beta chain constant region , bc ##6 ##3 ( 5 ' - gt ##gt ##gg ##cc ##tt ##tt ##gg ##gt ##gt - 3 ' ) .

reference_raw: These primers were used in combination with a normal 3' primer based on a beta chain constant region, BC63 (5'-GTGTTGTGT-3').

reference_spacy_tokens: These primers were used in combination with a normal 3 ' primer based on a beta chain constant region , BC63 ( 5'-GTGTTGTGT-3 ' ) .


fn_spacy_tokens_for_baseline: She then returns to full consciousness with her past subtly changed .

source_bert_toks: she then returns to full consciousness with her past subtly changed .

reference_raw: Then she returns to full consciousness with a subtle change in her history.

reference_spacy_tokens: Then she returns to full consciousness with a subtle change in her history .


fn_spacy_tokens_for_baseline: Of course they 're going to find in Scripture the sexist views which conform to their own narrow - minded view of the world .

source_bert_toks: of course they ' re going to find in scripture the sex ##ist views which conform to their own narrow - minded view of the world .

reference_raw: Of course, they'll find sexist views in the scriptures that match their own narrow view of the world.

reference_spacy_tokens: Of course , they 'll find sexist views in the scriptures that match their own narrow view of the world .


fn_spacy_tokens_for_baseline: " whose grooves of the tread pattern of the tyre did not have a depth of at least 1.6 mm throughout a continuous band situated in the central three - quarters of the breadth of the tread and round the entire outer circumference of the tyre " .

source_bert_toks: " whose grooves of the tread pattern of the tyre did not have a depth of at least 1 . 6 mm throughout a continuous band situated in the central three - quarters of the breadth of the tread and round the entire outer ci ##rc ##um ##ference of the tyre " .

reference_raw: "whose grooves in the tread pattern of the tyre are not at least 1.6 mm deep throughout the continuous band situated at the centre three-quarters of the width of the tread and around the entire outer circumference of the tyre."

reference_spacy_tokens: " whose grooves in the tread pattern of the tyre are not at least 1.6 mm deep throughout the continuous band situated at the centre three - quarters of the width of the tread and around the entire outer circumference of the tyre . "


fn_spacy_tokens_for_baseline: ' Hopefully , following the tour to New Zealand , there is now a realisation of what needs to be done and of just how appalling we are in certain areas .

source_bert_toks: ' hopefully , following the tour to new zealand , there is now a real ##isation of what needs to be done and of just how app ##all ##ing we are in certain areas .

reference_raw: Hopefully, after the trip to New Zealand, we realize what needs to be done and how appalling we are in certain areas.

reference_spacy_tokens: Hopefully , after the trip to New Zealand , we realize what needs to be done and how appalling we are in certain areas .


fn_spacy_tokens_for_baseline: His address to army officers clearly underlined the split between the army and Prime minister Nawaz Sharif 's civilian government which has confined itself to condemnation of the large scale bombing of Iraq .

source_bert_toks: his address to army officers clearly under ##lined the split between the army and prime minister na ##wa ##z sharif ' s civilian government which has confined itself to condemnation of the large scale bombing of iraq .

reference_raw: His address to military officers clearly highlighted the division between the military and the civilian government of Prime Minister Nawaz Sharif, who merely condemned the massive bombing of Iraq.

reference_spacy_tokens: His address to military officers clearly highlighted the division between the military and the civilian government of Prime Minister Nawaz Sharif , who merely condemned the massive bombing of Iraq .


fn_spacy_tokens_for_baseline: Carver explained that he was expecting a friend in Australia to wire him $ 1,500 any day .

source_bert_toks: carver explained that he was expecting a friend in australia to wire him $ 1 , 500 any day .

reference_raw: Carver said he expected a friend in Australia to wire him $1,500 a day.

reference_spacy_tokens: Carver said he expected a friend in Australia to wire him $ 1,500 a day .


fn_spacy_tokens_for_baseline: Morrissey has a lovely singing voice and even a Cure roadie will find the tune charming . '

source_bert_toks: morris ##sey has a lovely singing voice and even a cure road ##ie will find the tune charming . '

reference_raw: Morrissey has a beautiful singing voice, and even a cure roadie will find the melody enchanting.'

reference_spacy_tokens: Morrissey has a beautiful singing voice , and even a cure roadie will find the melody enchanting . '


fn_spacy_tokens_for_baseline: Our interest in standard mechanisms for data encoding and exchange need not be driven , then , by altruistic considerations about the value of secondary analysis .

source_bert_toks: our interest in standard mechanisms for data encoding and exchange need not be driven , then , by alt ##ru ##istic considerations about the value of secondary analysis .

reference_raw: Our interest in standard data encoding and exchange mechanisms does not therefore need to be driven by altruistic reflections on the value of secondary analysis.

reference_spacy_tokens: Our interest in standard data encoding and exchange mechanisms does not therefore need to be driven by altruistic reflections on the value of secondary analysis .


fn_spacy_tokens_for_baseline: well it it takes up less room i mean you you set the wood down and you move the saw whereas if you 're ripping wood you 're probably better off with a a table saw

source_bert_toks: well it it takes up less room i mean you you set the wood down and you move the saw whereas if you ' re ripping wood you ' re probably better off with a a table saw

reference_raw: Well, it takes less room, which means you put down the wood and move the saw, whereas if you're tearing the wood, you're probably better off with a table saw.

reference_spacy_tokens: Well , it takes less room , which means you put down the wood and move the saw , whereas if you 're tearing the wood , you 're probably better off with a table saw .


fn_spacy_tokens_for_baseline: She was dressed in a white frock and a round white straw hat .

source_bert_toks: she was dressed in a white fr ##ock and a round white straw hat .

reference_raw: She wore a white dress and a round white straw hat.

reference_spacy_tokens: She wore a white dress and a round white straw hat .


fn_spacy_tokens_for_baseline: On the other hand , the great twentieth - century philosopher Ludwig Witt - gen - stein said something similar in his majestic Philosophical Investigations .

source_bert_toks: on the other hand , the great twentieth - century philosopher ludwig wit ##t - gen - stein said something similar in his majestic philosophical investigations .

reference_raw: On the other hand, the great twentieth-century philosopher, Ludwig Witt-Gen-stein, spoke of something similar in his grand philosophical investigation.

reference_spacy_tokens: On the other hand , the great twentieth - century philosopher , Ludwig Witt - Gen - stein , spoke of something similar in his grand philosophical investigation .


fn_spacy_tokens_for_baseline: THE head of County Durham 's ambulance services yesterday attempted to reassure health watchdogs about the level of cover in Upper Teesdale .

source_bert_toks: the head of county durham ' s ambulance services yesterday attempted to reassure health watch ##dog ##s about the level of cover in upper tee ##sdale .

reference_raw: Yesterday, the head of County Durham's ambulance service tried to calm the health watchdogs about the level of cover in Upper Teesdale.

reference_spacy_tokens: Yesterday , the head of County Durham 's ambulance service tried to calm the health watchdogs about the level of cover in Upper Teesdale .


fn_spacy_tokens_for_baseline: It was a small animal , probably about 1.2 m tall , living in woodland savannah .

source_bert_toks: it was a small animal , probably about 1 . 2 m tall , living in woodland savannah .

reference_raw: It was a small animal, perhaps a hundred feet tall, living in a forest savanna.

reference_spacy_tokens: It was a small animal , perhaps a hundred feet tall , living in a forest savanna .


fn_spacy_tokens_for_baseline: She watched him for several moments , then looked about the large dining - room , trying to fathom the reason for his actions .

source_bert_toks: she watched him for several moments , then looked about the large dining - room , trying to fat ##hom the reason for his actions .

reference_raw: She watched him for a moment, then looked around the large dining room, trying to understand what he was doing.

reference_spacy_tokens: She watched him for a moment , then looked around the large dining room , trying to understand what he was doing .


fn_spacy_tokens_for_baseline: But he had not asked after her ; unsuspected questioning of her mother had told her that .

source_bert_toks: but he had not asked after her ; un ##sus ##pe ##cted questioning of her mother had told her that .

reference_raw: But he didn't ask after her; her mother's unsuspected interrogation told her.

reference_spacy_tokens: But he did n't ask after her ; her mother 's unsuspected interrogation told her .


fn_spacy_tokens_for_baseline: Fire crews had been attempting to contain the fire before the onset of difficult conditions today .

source_bert_toks: fire crews had been attempting to contain the fire before the onset of difficult conditions today .

reference_raw: The fire crews were trying to contain the fire prior to the onset of difficult conditions today.

reference_spacy_tokens: The fire crews were trying to contain the fire prior to the onset of difficult conditions today .


fn_spacy_tokens_for_baseline: The use of these verbal clues varies according to the person with whom we are conversing .

source_bert_toks: the use of these verbal clues varies according to the person with whom we are con ##vers ##ing .

reference_raw: The use of these verbal clues varies depending on who we're talking to.

reference_spacy_tokens: The use of these verbal clues varies depending on who we 're talking to .


fn_spacy_tokens_for_baseline: He expressed at once his sorrow for my father 's death .

source_bert_toks: he expressed at once his sorrow for my father ' s death .

reference_raw: He immediately expressed his regret for the death of my father.

reference_spacy_tokens: He immediately expressed his regret for the death of my father .


fn_spacy_tokens_for_baseline: all day he listens to the squeak of puppies ,

source_bert_toks: all day he listen ##s to the squeak of pup ##pies ,

reference_raw: he listens to the squeal of puppies all day,

reference_spacy_tokens: he listens to the squeal of puppies all day ,


fn_spacy_tokens_for_baseline: Visitors are welcome to visit the 24 - hectare ( 60 - acre ) establishment , and may sample the end product , Lantau tea .

source_bert_toks: visitors are welcome to visit the 24 - hectare ( 60 - acre ) establishment , and may sample the end product , lan ##ta ##u tea .

reference_raw: The visitors are invited to attend 24-ha (60-acre) premises and may take samples of the final product, Lantau tea.

reference_spacy_tokens: The visitors are invited to attend 24-ha ( 60-acre ) premises and may take samples of the final product , Lantau tea .


fn_spacy_tokens_for_baseline: ' The body rolled down the slope into the water .

source_bert_toks: ' the body rolled down the slope into the water .

reference_raw: The body tumbled down the slope into the water.

reference_spacy_tokens: The body tumbled down the slope into the water .


fn_spacy_tokens_for_baseline: It is difficult to question the Minister when we have not been given the figures .

source_bert_toks: it is difficult to question the minister when we have not been given the figures .

reference_raw: It's hard to interrogate the Minister if we don't get the numbers.

reference_spacy_tokens: It 's hard to interrogate the Minister if we do n't get the numbers .


fn_spacy_tokens_for_baseline: We followed the tweed skirt into a kitchen where its owner motioned us to sit , in the manner of someone training a dog .

source_bert_toks: we followed the tweed skirt into a kitchen where its owner motioned us to sit , in the manner of someone training a dog .

reference_raw: We followed the tweed skirt into the kitchen, where the owner gestured for us to sit down like someone who trained a dog.

reference_spacy_tokens: We followed the tweed skirt into the kitchen , where the owner gestured for us to sit down like someone who trained a dog .


fn_spacy_tokens_for_baseline: Election ' 92 : Party aides hunt for their leader 's lost mobile phone

source_bert_toks: election ' 92 : party aide ##s hunt for their leader ' s lost mobile phone

reference_raw: Election '92: Party aides are chasing their leader's lost cell phone.

reference_spacy_tokens: Election ' 92 : Party aides are chasing their leader 's lost cell phone .


fn_spacy_tokens_for_baseline: Some of the males were injected with morphine for a few days and some were given other drugs .

source_bert_toks: some of the males were injected with mor ##phine for a few days and some were given other drugs .

reference_raw: Some men have been given morphine for several days, and some have been given other drugs.

reference_spacy_tokens: Some men have been given morphine for several days , and some have been given other drugs .


fn_spacy_tokens_for_baseline: Tabitha pranced slowly along the hallway .

source_bert_toks: tabitha pr ##ance ##d slowly along the hallway .

reference_raw: Tabitha walked slowly down the corridor.

reference_spacy_tokens: Tabitha walked slowly down the corridor .


fn_spacy_tokens_for_baseline: It was a mixture of strange colours and the knitted ties felt scratchy where Gloria knotted them under Dot 's chin .

source_bert_toks: it was a mixture of strange colours and the knit ##ted ties felt scratch ##y where gloria knotted them under dot ' s chin .

reference_raw: It was a mixture of strange colors, and the knitted ties were scratchy where Gloria had wrapped them under Dot's chin.

reference_spacy_tokens: It was a mixture of strange colors , and the knitted ties were scratchy where Gloria had wrapped them under Dot 's chin .


fn_spacy_tokens_for_baseline: But the war has clearly derailed the timetable .

source_bert_toks: but the war has clearly der ##ailed the timetable .

reference_raw: But the war clearly broke the schedule.

reference_spacy_tokens: But the war clearly broke the schedule .


fn_spacy_tokens_for_baseline: He threw the pulverized contents into the air .

source_bert_toks: he threw the pu ##lver ##ized contents into the air .

reference_raw: He tossed the crushed contents into the air.

reference_spacy_tokens: He tossed the crushed contents into the air .


fn_spacy_tokens_for_baseline: 6- The call to adhere to Islam in general , and spreading the concept of Jihad specifically , starts with relatives and friends . ( T.C : Koranic verse ) You may not be able to do this , if your work demands extreme secrecy , like Naeem IBn Mas'uud ( May God bless him ) .

source_bert_toks: 6 - the call to adhere to islam in general , and spreading the concept of jihad specifically , starts with relatives and friends . ( t . c : ko ##rani ##c verse ) you may not be able to do this , if your work demands extreme secrecy , like na ##eem ibn mas ' u ##ud ( may god bless him ) .

reference_raw: 6- The call to adhere to Islam in general and extend the concept of Jihad in particular begins with relatives and friends. (T.C.: Koranic verse) You may not be able to do so if your job requires extreme secrecy, such as Naem Ibn Mas'uud (God bless him).

reference_spacy_tokens: 6- The call to adhere to Islam in general and extend the concept of Jihad in particular begins with relatives and friends . ( T.C. : Koranic verse ) You may not be able to do so if your job requires extreme secrecy , such as Naem Ibn Mas'uud ( God bless him ) .


fn_spacy_tokens_for_baseline: It is good practice to go through any document before parting with it and eliminate any word that is not essential to conveying the precise meaning intended .

source_bert_toks: it is good practice to go through any document before parting with it and eliminate any word that is not essential to convey ##ing the precise meaning intended .

reference_raw: It is good practice to examine any document before departing from it and to remove any word which is not necessary for the precise meaning to be given.

reference_spacy_tokens: It is good practice to examine any document before departing from it and to remove any word which is not necessary for the precise meaning to be given .


fn_spacy_tokens_for_baseline: Molly pushed desperately against the eighteen inch high wooden flap .

source_bert_toks: molly pushed desperately against the eighteen inch high wooden flap .

reference_raw: Molly pressed desperately against the eighteen-inch-high wooden flap.

reference_spacy_tokens: Molly pressed desperately against the eighteen - inch - high wooden flap .


fn_spacy_tokens_for_baseline: But will this prove a welfare maximum ?

source_bert_toks: but will this prove a welfare maximum ?

reference_raw: But will it prove to be the highest level of well-being?

reference_spacy_tokens: But will it prove to be the highest level of well - being ?


fn_spacy_tokens_for_baseline: In a wide bowl there was the night glimmer of a stream which was churned to flashing silver as they thrashed through it , the spray soaking them to their thighs .

source_bert_toks: in a wide bowl there was the night g ##lim ##mer of a stream which was chu ##rned to flashing silver as they thrash ##ed through it , the spray soaking them to their thighs .

reference_raw: There was the night flash of a stream in the wide bowl that turned silver as they swept through it, and the spray drenched them to their thighs.

reference_spacy_tokens: There was the night flash of a stream in the wide bowl that turned silver as they swept through it , and the spray drenched them to their thighs .


fn_spacy_tokens_for_baseline: Following the Oct. 20 general election Demirel had reaffirmed his campaign pledge to remove President Turgut Ozal from office , on the grounds of his alleged constitutional abuses and corruption .

source_bert_toks: following the oct . 20 general election demi ##rel had re ##af ##firmed his campaign pledge to remove president tu ##rg ##ut oz ##al from office , on the grounds of his alleged constitutional abuses and corruption .

reference_raw: After the general election of October 20, Demirel confirmed his campaign commitment to remove President Turgut Ozal from office for alleged constitutional abuse and corruption.

reference_spacy_tokens: After the general election of October 20 , Demirel confirmed his campaign commitment to remove President Turgut Ozal from office for alleged constitutional abuse and corruption .


fn_spacy_tokens_for_baseline: Shortly after the Soviet Union 's invasion of Afghanistan at the end of 1979 , the Western alliance decided to deploy new intermediate range nuclear missiles in Europe .

source_bert_toks: shortly after the soviet union ' s invasion of afghanistan at the end of 1979 , the western alliance decided to deploy new intermediate range nuclear missiles in europe .

reference_raw: Shortly after the Soviet Union invaded Afghanistan in late 1979, the Western Alliance decided to deploy new intermediate-range nuclear missiles in Europe.

reference_spacy_tokens: Shortly after the Soviet Union invaded Afghanistan in late 1979 , the Western Alliance decided to deploy new intermediate - range nuclear missiles in Europe .


fn_spacy_tokens_for_baseline: Soviet xenophobia was at Cold War pitch , all that was not home - grown was viewed with suspicion or hostility , and modernist art was duly castigated with increasing vehemence as a decadent , alien evil .

source_bert_toks: soviet x ##eno ##phobia was at cold war pitch , all that was not home - grown was viewed with suspicion or hostility , and modernist art was duly cast ##igate ##d with increasing ve ##hem ##ence as a decade ##nt , alien evil .

reference_raw: Soviet xenophobia was on the battlefield of the Cold War, and all that wasn't home-grown was viewed with suspicion or hostility, and modernist art was properly described with increasing vehemence as a decadent alien evil.

reference_spacy_tokens: Soviet xenophobia was on the battlefield of the Cold War , and all that was n't home - grown was viewed with suspicion or hostility , and modernist art was properly described with increasing vehemence as a decadent alien evil .


fn_spacy_tokens_for_baseline: Accordingly , the battle over the excisemen of Inverkeithing was intensified , for the rival Haldane party had no intention of giving way , and they too had friends able to influence the placement of excise officers .

source_bert_toks: accordingly , the battle over the ex ##cise ##men of in ##ver ##kei ##thing was intensified , for the rival hal ##dan ##e party had no intention of giving way , and they too had friends able to influence the placement of ex ##cise officers .

reference_raw: The battle over the excisables of Inverkeithing was therefore intensified, for the rival Haldane party had no intention of giving up, and they had friends who could influence the location of the excisables.

reference_spacy_tokens: The battle over the excisables of Inverkeithing was therefore intensified , for the rival Haldane party had no intention of giving up , and they had friends who could influence the location of the excisables .


fn_spacy_tokens_for_baseline: It contains a definition of AL QAEDA organization , and six main points : 1-Duties ; 2-Holidays ; 3-Salaries and Travel tickets ; 4-Advice ; 5-Reward and Punishment ; 6-Pledge .

source_bert_toks: it contains a definition of al qaeda organization , and six main points : 1 - duties ; 2 - holidays ; 3 - salaries and travel tickets ; 4 - advice ; 5 - reward and punishment ; 6 - pledge .

reference_raw: It contains the definition of the AL QAEDA organisation and six main points: 1 duty; 2 holidays; 3-salary and travel tickets; 4-Advice; 5-Reward and Punishment; 6-Pledge.

reference_spacy_tokens: It contains the definition of the AL QAEDA organisation and six main points : 1 duty ; 2 holidays ; 3-salary and travel tickets ; 4-Advice ; 5-Reward and Punishment ; 6-Pledge .


fn_spacy_tokens_for_baseline: Thus they are naturally predisposed to find what they are looking for .

source_bert_toks: thus they are naturally pre ##dis ##posed to find what they are looking for .

reference_raw: That's why they're naturally predisposed to discover what they're looking for.

reference_spacy_tokens: That 's why they 're naturally predisposed to discover what they 're looking for .


fn_spacy_tokens_for_baseline: The fruit should be round and fat , as ripe apricots and muscatels licked with cream , and the fragrance of spring flowers should waft from the glass .

source_bert_toks: the fruit should be round and fat , as ripe apr ##ico ##ts and mu ##sca ##tel ##s licked with cream , and the fragrance of spring flowers should wa ##ft from the glass .

reference_raw: The fruit should be round and fat, as ripe apricots and muscatels licked with cream, and the smell of spring flowers should flow from the glass.

reference_spacy_tokens: The fruit should be round and fat , as ripe apricots and muscatels licked with cream , and the smell of spring flowers should flow from the glass .


fn_spacy_tokens_for_baseline: She ran into the cell .

source_bert_toks: she ran into the cell .

reference_raw: She ran into the phone.

reference_spacy_tokens: She ran into the phone .


fn_spacy_tokens_for_baseline: On Tuesday the conference got word of another atrocity , the assassination in Medellin of two employees of El Espectador , Colombia 's second - largest newspaper .

source_bert_toks: on tuesday the conference got word of another at ##rocity , the assassination in med ##elli ##n of two employees of el es ##pe ##cta ##dor , colombia ' s second - largest newspaper .

reference_raw: On Tuesday, the conference received news of another atrocity, the murder of two employees of El Espectador, the second largest newspaper in Colombia, in Medellin.

reference_spacy_tokens: On Tuesday , the conference received news of another atrocity , the murder of two employees of El Espectador , the second largest newspaper in Colombia , in Medellin .


fn_spacy_tokens_for_baseline: Hall will be only the second member of Congress to travel in Iraq since the war , according to Hall 's office .

source_bert_toks: hall will be only the second member of congress to travel in iraq since the war , according to hall ' s office .

reference_raw: According to Hall's office, Hall will only be the second member of Congress to travel to Iraq since the battle.

reference_spacy_tokens: According to Hall 's office , Hall will only be the second member of Congress to travel to Iraq since the battle .


fn_spacy_tokens_for_baseline: I still remember that day in the war when , as a very junior subaltern , my CO left me a little hand - written note admonishing me for appearing at breakfast unshaven .

source_bert_toks: i still remember that day in the war when , as a very junior sub ##al ##tern , my co left me a little hand - written note ad ##mon ##ishing me for appearing at breakfast un ##sha ##ven .

reference_raw: I still remember the day of the war, when my commanding officer, as a junior sub-altern, left me a small handwritten note to warn me that I would appear at breakfast unshaven.

reference_spacy_tokens: I still remember the day of the war , when my commanding officer , as a junior sub - altern , left me a small handwritten note to warn me that I would appear at breakfast unshaven .


fn_spacy_tokens_for_baseline: The trade association for IFAs , IFA Promotions , will send you , free of charge , the names of 10 of its members in your area .

source_bert_toks: the trade association for if ##as , if ##a promotions , will send you , free of charge , the names of 10 of its members in your area .

reference_raw: The IFA Business Association, IFA Promotions, will send you the names of 10 of its partners in your area free of charge.

reference_spacy_tokens: The IFA Business Association , IFA Promotions , will send you the names of 10 of its partners in your area free of charge .


fn_spacy_tokens_for_baseline: Pilgrims came from all over the Roman ( and , later , Byzantine ) Empire during the following centuries , but the prosperity they brought lasted only until 614 , when Persian armies overtook Judea and reduced Jerusalem to rubble again .

source_bert_toks: pilgrims came from all over the roman ( and , later , byzantine ) empire during the following centuries , but the prosperity they brought lasted only until 61 ##4 , when persian armies overtook jude ##a and reduced jerusalem to rubble again .

reference_raw: The pilgrims had come from all over the Roman Empire (and later the Byzantine) in the coming centuries, but the prosperity they had brought lasted only until 614, when the Persian armies had conquered Judea and reduced Jerusalem to rubble.

reference_spacy_tokens: The pilgrims had come from all over the Roman Empire ( and later the Byzantine ) in the coming centuries , but the prosperity they had brought lasted only until 614 , when the Persian armies had conquered Judea and reduced Jerusalem to rubble .


fn_spacy_tokens_for_baseline: ' Uncle Ross and I have been to see your mummy and daddy -- and they are going to be just fine . '

source_bert_toks: ' uncle ross and i have been to see your mummy and daddy - - and they are going to be just fine . '

reference_raw: "Uncle Ross and I went to see your mom and dad-and they'll be fine."

reference_spacy_tokens: " Uncle Ross and I went to see your mom and dad - and they 'll be fine . "


fn_spacy_tokens_for_baseline: He strode off across the green to his home , leaving John fuming .

source_bert_toks: he strode off across the green to his home , leaving john fu ##ming .

reference_raw: He walked across the green to his house, leaving John fuming.

reference_spacy_tokens: He walked across the green to his house , leaving John fuming .


fn_spacy_tokens_for_baseline: They have a dimension of being beyond the reach of rational formulation , and they often disconcert us by behaving quite differently in one novel , in one volume , from what the previous volume had led us to expect .

source_bert_toks: they have a dimension of being beyond the reach of rational formulation , and they often disco ##nce ##rt us by be ##ha ##ving quite differently in one novel , in one volume , from what the previous volume had led us to expect .

reference_raw: They have the dimension of being beyond the reach of rational formulation, and they often upset us by acting quite differently in one novel, in one volume, from what we expected from the previous volume.

reference_spacy_tokens: They have the dimension of being beyond the reach of rational formulation , and they often upset us by acting quite differently in one novel , in one volume , from what we expected from the previous volume .


fn_spacy_tokens_for_baseline: She moistened her lips with the tip of her tongue and his sudden tension told her she was right .

source_bert_toks: she moist ##ened her lips with the tip of her tongue and his sudden tension told her she was right .

reference_raw: Her lips were wet with the tip of her mouth, and his sudden tension told her she was right.

reference_spacy_tokens: Her lips were wet with the tip of her mouth , and his sudden tension told her she was right .


fn_spacy_tokens_for_baseline: The act of castration brought the criminal to a level even lower than the Untouchables .

source_bert_toks: the act of cast ##ration brought the criminal to a level even lower than the unto ##uch ##able ##s .

reference_raw: The deed of castration brought the criminal to a level even lower than the Untouchables.

reference_spacy_tokens: The deed of castration brought the criminal to a level even lower than the Untouchables .


fn_spacy_tokens_for_baseline: I said just now that we were alike in interests and tastes .

source_bert_toks: i said just now that we were alike in interests and tastes .

reference_raw: I just said we're the same in interest and taste.

reference_spacy_tokens: I just said we 're the same in interest and taste .


fn_spacy_tokens_for_baseline: A September method was employed by Bede in his ecclesiastical history written in AD731 , and he used either 1 September or 24 September as his year - start dates ( the Greek and the Caesarian systems ) .

source_bert_toks: a september method was employed by bed ##e in his ecclesiastical history written in ad ##7 ##31 , and he used either 1 september or 24 september as his year - start dates ( the greek and the caesar ##ian systems ) .

reference_raw: The September method was used by Bede in his ecclesiastical past, written in AD731, and he used either 1 September or 24 September as the starting date of his year (Greek and Caesarian systems).

reference_spacy_tokens: The September method was used by Bede in his ecclesiastical past , written in AD731 , and he used either 1 September or 24 September as the starting date of his year ( Greek and Caesarian systems ) .


fn_spacy_tokens_for_baseline: A little later , in the four years 1776 - 80 , over 42,000 men deserted from the British navy ; and there is no reason to suppose that this was an unusual number by contemporary standards .

source_bert_toks: a little later , in the four years 1776 - 80 , over 42 , 000 men deserted from the british navy ; and there is no reason to suppose that this was an unusual number by contemporary standards .

reference_raw: A little later, in the four years of 1776-80, more than 42,000 men left the British Navy; and there is no reason to believe that this was an unusual number at present.

reference_spacy_tokens: A little later , in the four years of 1776 - 80 , more than 42,000 men left the British Navy ; and there is no reason to believe that this was an unusual number at present .


fn_spacy_tokens_for_baseline: The Lebanese , it seemed , were brother Arabs when they were allies but foreigners themselves , ignored and disregarded , when internecine feuds had to be resolved within the Palestinian resistance movement .

source_bert_toks: the lebanese , it seemed , were brother arabs when they were allies but foreigners themselves , ignored and disregard ##ed , when intern ##ecin ##e feud ##s had to be resolved within the palestinian resistance movement .

reference_raw: It seemed that the Lebanese were brother Arabs when they were allies but foreigners themselves, ignored and ignored when internecine disputes had to be settled in the Palestinian Resistance Movement.

reference_spacy_tokens: It seemed that the Lebanese were brother Arabs when they were allies but foreigners themselves , ignored and ignored when internecine disputes had to be settled in the Palestinian Resistance Movement .


fn_spacy_tokens_for_baseline: Instantly the entire surface of her skin went cold .

source_bert_toks: instantly the entire surface of her skin went cold .

reference_raw: The whole surface of her skin immediately cooled.

reference_spacy_tokens: The whole surface of her skin immediately cooled .


fn_spacy_tokens_for_baseline: The bitter battles of the past are gone and these days Bill Morris can only sing Rover 's praises .

source_bert_toks: the bitter battles of the past are gone and these days bill morris can only sing rover ' s praises .

reference_raw: The bitter battles of the past are over, and now Bill Morris can only sing the compliments of Rover.

reference_spacy_tokens: The bitter battles of the past are over , and now Bill Morris can only sing the compliments of Rover .


fn_spacy_tokens_for_baseline: ' Simply that you would damn it as a diabolical liberty and banish it , ' Merrill finished quickly , sharply aware of a sudden spark which , for no apparent reason , flared between them .

source_bert_toks: ' simply that you would damn it as a dia ##bolic ##al liberty and ban ##ish it , ' merrill finished quickly , sharply aware of a sudden spark which , for no apparent reason , flared between them .

reference_raw: 'Simply to condemn it as a devil's freedom and expel it,' said Merrill quickly, suddenly aware of a sudden spark that, for no apparent reason, flared between them.

reference_spacy_tokens: ' Simply to condemn it as a devil 's freedom and expel it , ' said Merrill quickly , suddenly aware of a sudden spark that , for no apparent reason , flared between them .


fn_spacy_tokens_for_baseline: In this case , George W. Bush would be a fool to allow that to happen even if he stood a chance of winning a judgment against St. Martin 's .

source_bert_toks: in this case , george w . bush would be a fool to allow that to happen even if he stood a chance of winning a judgment against st . martin ' s .

reference_raw: In this case, George W. Bush would be a fool to let it happen, even if he had a chance to get a verdict against St. Martin.

reference_spacy_tokens: In this case , George W. Bush would be a fool to let it happen , even if he had a chance to get a verdict against St. Martin .


fn_spacy_tokens_for_baseline: " There are no devils left in hell , " a Western missionary lamented .

source_bert_toks: " there are no devils left in hell , " a western missionary lame ##nted .

reference_raw: "There are no devils left in hell," the western missionary groaned.

reference_spacy_tokens: " There are no devils left in hell , " the western missionary groaned .


fn_spacy_tokens_for_baseline: Another was fatally injured by a stag when dispensing feed to his herd of deer .

source_bert_toks: another was fatally injured by a st ##ag when di ##sp ##ens ##ing feed to his herd of deer .

reference_raw: Another was fatally wounded by the deer while feeding his flock of deer.

reference_spacy_tokens: Another was fatally wounded by the deer while feeding his flock of deer .


fn_spacy_tokens_for_baseline: The smile was still there , but behind it now was a hint of trouble , and more than a hint of tiredness .

source_bert_toks: the smile was still there , but behind it now was a hint of trouble , and more than a hint of tired ##ness .

reference_raw: The smile was still there, but there was a hint of trouble behind it now, more than a hint of fatigue.

reference_spacy_tokens: The smile was still there , but there was a hint of trouble behind it now , more than a hint of fatigue .


fn_spacy_tokens_for_baseline: By 1 April , a total of eight Scud - Bs had been fired .

source_bert_toks: by 1 april , a total of eight sc ##ud - bs had been fired .

reference_raw: By April 1st, eight Scud-Bs had been sacked.

reference_spacy_tokens: By April 1st , eight Scud - Bs had been sacked .


fn_spacy_tokens_for_baseline: He did not rate his findings on the antibacterial substance worthy of a full paper , and included them in a publication which dealt with several substances derived from Penicillia .

source_bert_toks: he did not rate his findings on the anti ##ba ##cter ##ial substance worthy of a full paper , and included them in a publication which dealt with several substances derived from pen ##ici ##lli ##a .

reference_raw: He did not evaluate his findings on an antibacterial substance worthy of a complete document and included them in a publication dealing with several substances derived from Penicillia.

reference_spacy_tokens: He did not evaluate his findings on an antibacterial substance worthy of a complete document and included them in a publication dealing with several substances derived from Penicillia .


fn_spacy_tokens_for_baseline: Testing of agents is also reportedly performed at these two locations , possibly in very large underground facilities .

source_bert_toks: testing of agents is also reportedly performed at these two locations , possibly in very large underground facilities .

reference_raw: Agent testing is also reportedly carried out in these two locations, possibly in very large underground facilities.

reference_spacy_tokens: Agent testing is also reportedly carried out in these two locations , possibly in very large underground facilities .


fn_spacy_tokens_for_baseline: Many economists are inclined to think that static welfare losses are outweighed by dynamic welfare gains from technological progress , and policy - makers generally seem to share this presumption .

source_bert_toks: many economists are inclined to think that static welfare losses are out ##weig ##hed by dynamic welfare gains from technological progress , and policy - makers generally seem to share this pre ##sum ##ption .

reference_raw: Many economists tend to believe that static social losses are outweighed by the dynamic social benefits of technological progress, and policymakers generally seem to share that assumption.

reference_spacy_tokens: Many economists tend to believe that static social losses are outweighed by the dynamic social benefits of technological progress , and policymakers generally seem to share that assumption .


fn_spacy_tokens_for_baseline: Let no one ever be sincere with me -- it is a failure of respect , and respect is a thing one can never get enough of .

source_bert_toks: let no one ever be sincere with me - - it is a failure of respect , and respect is a thing one can never get enough of .

reference_raw: Don't let anyone be honest with me - it's a failure of respect, and respect is something you never get enough of.

reference_spacy_tokens: Do n't let anyone be honest with me - it 's a failure of respect , and respect is something you never get enough of .


fn_spacy_tokens_for_baseline: Had Craig banned the march , he would have infuriated the civil rights people .

source_bert_toks: had craig banned the march , he would have in ##fur ##iated the civil rights people .

reference_raw: If Craig had forbidden the march, he would have angered the people of civil rights.

reference_spacy_tokens: If Craig had forbidden the march , he would have angered the people of civil rights .


fn_spacy_tokens_for_baseline: The rebels blamed the massacre on the government troops and the government blamed it on the rebels .

source_bert_toks: the rebels blamed the massacre on the government troops and the government blamed it on the rebels .

reference_raw: The rebels accuse the massacre of government troops, and the government accuses the rebels of it.

reference_spacy_tokens: The rebels accuse the massacre of government troops , and the government accuses the rebels of it .


fn_spacy_tokens_for_baseline: During his Welsh expedition , Coleridge had occasionally lapsed with self mocking enthusiasm into the prose style of the travel writers to express his feelings for mountains ' sublimely terrible ' and other natural marvels .

source_bert_toks: during his welsh expedition , cole ##ridge had occasionally laps ##ed with self mocking enthusiasm into the prose style of the travel writers to express his feelings for mountains ' sublime ##ly terrible ' and other natural marvel ##s .

reference_raw: During his Welsh voyage, Coleridge occasionally lapsed with self-derisive enthusiasm into the prose style of travel writers, expressing his feelings for the mountains of "sublime terrible" and other natural wonders.

reference_spacy_tokens: During his Welsh voyage , Coleridge occasionally lapsed with self - derisive enthusiasm into the prose style of travel writers , expressing his feelings for the mountains of " sublime terrible " and other natural wonders .


fn_spacy_tokens_for_baseline: ' I think they thought I did n't observe all the rules of protocol --- but I did n't know them

source_bert_toks: ' i think they thought i didn ' t observe all the rules of protocol - - - but i didn ' t know them

reference_raw: 'I think they didn't think I was following all protocols - but I didn't know them.

reference_spacy_tokens: ' I think they did n't think I was following all protocols - but I did n't know them .


fn_spacy_tokens_for_baseline: ARDS manager Paul Malone was n't in the least bit perturbed at his side 's inept display at Newry .

source_bert_toks: ar ##ds manager paul malone wasn ' t in the least bit per ##tur ##bed at his side ' s in ##ept display at new ##ry .

reference_raw: The ARDS manager, Paul Malone, was not in the least disturbed by the incompetent display on his side in Newry.

reference_spacy_tokens: The ARDS manager , Paul Malone , was not in the least disturbed by the incompetent display on his side in Newry .


fn_spacy_tokens_for_baseline: Not all executions were applauded by the crowd , of course .

source_bert_toks: not all executions were app ##lau ##ded by the crowd , of course .

reference_raw: Of course, not all executions were clapped by the crowd.

reference_spacy_tokens: Of course , not all executions were clapped by the crowd .


fn_spacy_tokens_for_baseline: THE GOVERNMENT 'S advisers on scientific research have rejected proposals for a £ 50 m national clinical research centre , which medical experts say is needed urgently .

source_bert_toks: the government ' s advisers on scientific research have rejected proposals for a £5 ##0 ##m national clinical research centre , which medical experts say is needed urgently .

reference_raw: THE GOVERNMENT's scientific research advisors refused proposals for the £50 million National Clinical Research Centre, which, according to medical experts, is urgently needed.

reference_spacy_tokens: THE GOVERNMENT 's scientific research advisors refused proposals for the £ 50 million National Clinical Research Centre , which , according to medical experts , is urgently needed .


fn_spacy_tokens_for_baseline: She 's just picked up this bloomin ' nice bunch from her co - stars in a new London play .

source_bert_toks: she ' s just picked up this bloom ##in ' nice bunch from her co - stars in a new london play .

reference_raw: She just picked up a bunch of flowers from her costars in a new London play.

reference_spacy_tokens: She just picked up a bunch of flowers from her costars in a new London play .


fn_spacy_tokens_for_baseline: If you are using dried yeast , measure four tablespoons of the onion liquid into a small bowl and stir in half a teaspoon of caster sugar .

source_bert_toks: if you are using dried yeast , measure four tables ##poo ##ns of the onion liquid into a small bowl and stir in half a tea ##sp ##oon of caste ##r sugar .

reference_raw: If you use dried yeast, measure four spoons of onion fluid in a small bowl and mix with half a spoonful of caster sugar.

reference_spacy_tokens: If you use dried yeast , measure four spoons of onion fluid in a small bowl and mix with half a spoonful of caster sugar .


fn_spacy_tokens_for_baseline: In the subsequent analysis , we sidestep these issues and assume that the government only issues short - term bonds paying the going rate of interest .

source_bert_toks: in the subsequent analysis , we sides ##te ##p these issues and assume that the government only issues short - term bonds paying the going rate of interest .

reference_raw: In a subsequent analysis, we postpone these issues and assume that the government only issues short-term bonds that pay the interest rate.

reference_spacy_tokens: In a subsequent analysis , we postpone these issues and assume that the government only issues short - term bonds that pay the interest rate .


fn_spacy_tokens_for_baseline: QN : Who has given support to al - Qaeda ?

source_bert_toks: q ##n : who has given support to al - qaeda ?

reference_raw: QN: Who supported Al-Qaeda?

reference_spacy_tokens: QN : Who supported Al - Qaeda ?


fn_spacy_tokens_for_baseline: Lehzen was blamed , probably wrongly , for the queen 's ineptness in the Lady Flora Hastings [ q.v . ] affair , and fear of losing Lehzen was a major contribution to the queen 's stubbornness in the ' bedchamber crisis ' of 1839 .

source_bert_toks: le ##h ##zen was blamed , probably wrongly , for the queen ' s in ##ept ##ness in the lady flora hastings [ q . v . ] affair , and fear of losing le ##h ##zen was a major contribution to the queen ' s stubborn ##ness in the ' bed ##cha ##mber crisis ' of 1839 .

reference_raw: Lehzen had been blamed, perhaps wrongly, for the Queen's incompetence in the Lady Flora Hastings affair, and the fear of losing Lehzen had contributed significantly to the Queen's stubbornness in the 'Bedchamber Crisis' of 1839.

reference_spacy_tokens: Lehzen had been blamed , perhaps wrongly , for the Queen 's incompetence in the Lady Flora Hastings affair , and the fear of losing Lehzen had contributed significantly to the Queen 's stubbornness in the ' Bedchamber Crisis ' of 1839 .


fn_spacy_tokens_for_baseline: The presence of these facilities confirms Iran 's growing determination to achieve a full nuclear fuel cycle .

source_bert_toks: the presence of these facilities confirms iran ' s growing determination to achieve a full nuclear fuel cycle .

reference_raw: The presence of such facilities confirms Iran's increasing commitment to the full nuclear fuel cycle.

reference_spacy_tokens: The presence of such facilities confirms Iran 's increasing commitment to the full nuclear fuel cycle .


fn_spacy_tokens_for_baseline: ' I 'm -- fond of Travis -- very fond , ' she stated , then caught the dangerous glint in her employer 's eye that assured her that her prevarication was n't going down too well .

source_bert_toks: ' i ' m - - fond of travis - - very fond , ' she stated , then caught the dangerous glint in her employer ' s eye that assured her that her pre ##var ##ication wasn ' t going down too well .

reference_raw: "I-I like Travis-very much," she said, then caught the dangerous flash in her employer's eyes that assured her that her prevarication was not going well.

reference_spacy_tokens: " I - I like Travis - very much , " she said , then caught the dangerous flash in her employer 's eyes that assured her that her prevarication was not going well .


fn_spacy_tokens_for_baseline: Queen Margaret came out of the church , a veil covering her grief - stricken face .

source_bert_toks: queen margaret came out of the church , a veil covering her grief - stricken face .

reference_raw: Queen Margaret emerged from the church, her sad face covered with a veil.

reference_spacy_tokens: Queen Margaret emerged from the church , her sad face covered with a veil .


fn_spacy_tokens_for_baseline: The prime minister known as Abu Mazen must now contend with the rejection of side by side Palestinian and Israeli states .

source_bert_toks: the prime minister known as abu maze ##n must now contend with the rejection of side by side palestinian and israeli states .

reference_raw: The Prime Minister, known as Abu Mazen, has to face the rejection of Palestinian and Israeli states side by side.

reference_spacy_tokens: The Prime Minister , known as Abu Mazen , has to face the rejection of Palestinian and Israeli states side by side .


fn_spacy_tokens_for_baseline: The parched and exhausted company eventually rendezvoused late in June or early in July in a homestead at Gawler , north of Adelaide .

source_bert_toks: the parc ##hed and exhausted company eventually rendezvous ##ed late in june or early in july in a homestead at ga ##wl ##er , north of adelaide .

reference_raw: At the end of June, or at the beginning of July, at a house in Gawler, north of Adelaide, the dry and exhausted company met.

reference_spacy_tokens: At the end of June , or at the beginning of July , at a house in Gawler , north of Adelaide , the dry and exhausted company met .


fn_spacy_tokens_for_baseline: ' Miss Emerson sprained her ankle two days ago .

source_bert_toks: ' miss emerson sp ##rained her ankle two days ago .

reference_raw: Miss Emerson twisted her ankle two days ago.

reference_spacy_tokens: Miss Emerson twisted her ankle two days ago .


fn_spacy_tokens_for_baseline: He said that Vosper is thriving in the Middle East with work on a naval base in Kuwait and a warship for Oman .

source_bert_toks: he said that vo ##sper is thriving in the middle east with work on a naval base in kuwait and a warship for oman .

reference_raw: He said Vosper was prospering in the Middle East, working on a naval base in Kuwait and a warship for Oman.

reference_spacy_tokens: He said Vosper was prospering in the Middle East , working on a naval base in Kuwait and a warship for Oman .


fn_spacy_tokens_for_baseline: Buried in a box in the ground , the find was kept secret so that it could be properly excavated by Suffolk County 's archaeological department , headed by Judith Plouviez , the County Archaeology Officer .

source_bert_toks: buried in a box in the ground , the find was kept secret so that it could be properly excavated by suffolk county ' s archaeological department , headed by judith pl ##ou ##vie ##z , the county archaeology officer .

reference_raw: Buried in a box in the ground, the discovery was hidden so that it could be properly dug up by the archaeology department of Suffolk County, led by Judith Plouviez, the county archaeologist.

reference_spacy_tokens: Buried in a box in the ground , the discovery was hidden so that it could be properly dug up by the archaeology department of Suffolk County , led by Judith Plouviez , the county archaeologist .