fn_spacy_tokens_for_baseline: It is symptomatic of the depressed state of industry that so few of the individuals interviewed had anything positive to say about their experiences .

source_bert_toks: it is sy ##mpt ##oma ##tic of the depressed state of industry that so few of the individuals interviewed had anything positive to say about their experiences .

reference_raw: It is a symptom of the depressive state of the industry that so few people interviewed had anything positive to say about their experiences.

reference_spacy_tokens: It is a symptom of the depressive state of the industry that so few people interviewed had anything positive to say about their experiences .


fn_spacy_tokens_for_baseline: A double band of white shells were strung round the centre of it .

source_bert_toks: a double band of white shells were strung round the centre of it .

reference_raw: Around the center was a double band of white shells.

reference_spacy_tokens: Around the center was a double band of white shells .


fn_spacy_tokens_for_baseline: But she strokes my arm and says , ' We 're cohabiting now .

source_bert_toks: but she strokes my arm and says , ' we ' re co ##hab ##iting now .

reference_raw: But she stroked my hand and said, "We're living together now.

reference_spacy_tokens: But she stroked my hand and said , " We 're living together now .


fn_spacy_tokens_for_baseline: The crusaders swept through the land of Byzantium slaughtering Christians as well as Muslims , civilians as well as soldiers .

source_bert_toks: the crusaders swept through the land of by ##zan ##tium slaughter ##ing christians as well as muslims , civilians as well as soldiers .

reference_raw: Crusaders swept the lands of Byzantium, killing Christians, Muslims, civilians, and soldiers.

reference_spacy_tokens: Crusaders swept the lands of Byzantium , killing Christians , Muslims , civilians , and soldiers .


fn_spacy_tokens_for_baseline: If anything was guaranteed to dry up tears fast it was his manner .

source_bert_toks: if anything was guaranteed to dry up tears fast it was his manner .

reference_raw: If anything could be guaranteed to drain the tears quickly, it was his way of doing it.

reference_spacy_tokens: If anything could be guaranteed to drain the tears quickly , it was his way of doing it .


fn_spacy_tokens_for_baseline: He could n't sleep , or he thought he could n't , for Hazel said that all night long he whimpered and gnashed .

source_bert_toks: he couldn ' t sleep , or he thought he couldn ' t , for hazel said that all night long he whimpered and g ##nas ##hed .

reference_raw: He couldn't sleep, or he didn't think he could, because Hazel had said he was whining and gnawing all night.

reference_spacy_tokens: He could n't sleep , or he did n't think he could , because Hazel had said he was whining and gnawing all night .


fn_spacy_tokens_for_baseline: Hall , an Ohio Democrat and one of very few U.S. congressmen to visit Iraq since the 1991 Gulf War over Kuwait , is scheduled to embark Sunday the 12-hour overland trip to the Iraqi capital , Baghdad .

source_bert_toks: hall , an ohio democrat and one of very few u . s . congress ##men to visit iraq since the 1991 gulf war over kuwait , is scheduled to embark sunday the 12 - hour overland trip to the iraqi capital , baghdad .

reference_raw: Hall, the Ohio Democrat and one of the few congressmen in the United States to visit Iraq since the 1991 Kuwait Bay War, is scheduled to embark on a 12-hour overland trip to the Iraqi capital of Baghdad on Sunday.

reference_spacy_tokens: Hall , the Ohio Democrat and one of the few congressmen in the United States to visit Iraq since the 1991 Kuwait Bay War , is scheduled to embark on a 12-hour overland trip to the Iraqi capital of Baghdad on Sunday .


fn_spacy_tokens_for_baseline: " With the aid of Indian companies , Iran is nearing the completion of a secret poison - gas plant , which was claimed by the Indian companies to be a pesticide factory . "

source_bert_toks: " with the aid of indian companies , iran is nearing the completion of a secret poison - gas plant , which was claimed by the indian companies to be a pest ##icide factory . "

reference_raw: "With the help of India's companies, Iran is approaching the completion of a secret poison, a gas plant that India's companies claim to be a pesticide plant."

reference_spacy_tokens: " With the help of India 's companies , Iran is approaching the completion of a secret poison , a gas plant that India 's companies claim to be a pesticide plant . "


fn_spacy_tokens_for_baseline: Officials had prided themselves on the fact that there had been no bloodshed in the months leading up to the Sept. 20 vote .

source_bert_toks: officials had pride ##d themselves on the fact that there had been no blood ##shed in the months leading up to the sept . 20 vote .

reference_raw: Officials prided themselves on the fact that in the months leading to the September 20 votes there had been no carnage.

reference_spacy_tokens: Officials prided themselves on the fact that in the months leading to the September 20 votes there had been no carnage .


fn_spacy_tokens_for_baseline: ' I am no fan of my muscles , ' she bleated to a German magazine .

source_bert_toks: ' i am no fan of my muscles , ' she b ##lea ##ted to a german magazine .

reference_raw: "I don't like my muscles," she said to the German magazine.

reference_spacy_tokens: " I do n't like my muscles , " she said to the German magazine .


fn_spacy_tokens_for_baseline: It has been valued at around £ 95,000 ( $ 165,000 ) .

source_bert_toks: it has been valued at around £ ##9 ##5 , 000 ( $ 165 , 000 ) .


fn_spacy_tokens_for_baseline: The lookout point at Lok Ma Chau was once known as Hong Kong 's " window on China " - in the years of China 's isolation from the West , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

source_bert_toks: the lookout point at lok ma cha ##u was once known as hong kong ' s " window on china " - in the years of china ' s isolation from the west , tourists would come to the lookout point here and rent binoculars in order to get a glimpse of the great mystery beyond .

reference_raw: The watchpoint at Lok Ma Chau was once known as Hong Kong's "China Window" - in the years of China's isolation from the West, hikers would come here and rent telescopes to see the great mystery behind them.

reference_spacy_tokens: The watchpoint at Lok Ma Chau was once known as Hong Kong 's " China Window " - in the years of China 's isolation from the West , hikers would come here and rent telescopes to see the great mystery behind them .


fn_spacy_tokens_for_baseline: That money was then spent in a variety of ways , adding fuel to our thriving economy .

source_bert_toks: that money was then spent in a variety of ways , adding fuel to our thriving economy .

reference_raw: That money was then spent in various ways, adding fuel to our prosperous economy.

reference_spacy_tokens: That money was then spent in various ways , adding fuel to our prosperous economy .


fn_spacy_tokens_for_baseline: The vast majority of us do n't do crack .

source_bert_toks: the vast majority of us don ' t do crack .

reference_raw: Most of us don't break.

reference_spacy_tokens: Most of us do n't break .


fn_spacy_tokens_for_baseline: IRA kneecap victim McHugh , 18 , faced two Customs charges of attempted exportation of 41 Ecstasy tabs and 16 amphetamine tablets .

source_bert_toks: ira knee ##cap victim mc ##hu ##gh , 18 , faced two customs charges of attempted export ##ation of 41 ecstasy tab ##s and 16 amp ##het ##amine tablets .

reference_raw: IRA kneecap victim McHugh, 18 years old, faced two customs charges for attempted export of 41 ecstasy and 16 amphetamine tablets.

reference_spacy_tokens: IRA kneecap victim McHugh , 18 years old , faced two customs charges for attempted export of 41 ecstasy and 16 amphetamine tablets .


fn_spacy_tokens_for_baseline: My inclination was to decline , but as that would have been discourteous in the extreme to Wilson , for whom I then had enormous respect , I agreed to see him .

source_bert_toks: my inclination was to decline , but as that would have been disco ##urt ##eous in the extreme to wilson , for whom i then had enormous respect , i agreed to see him .

reference_raw: I was inclined to decline, but since it would be rude in the extreme to Wilson, for which I had a great deal of respect, I agreed to see him.

reference_spacy_tokens: I was inclined to decline , but since it would be rude in the extreme to Wilson , for which I had a great deal of respect , I agreed to see him .


fn_spacy_tokens_for_baseline: He was a bachelor with ( largely ) homosexual instincts , melancholy and prone to drinking bouts , but with an enormous capacity for new interests and enthusiasms .

source_bert_toks: he was a bachelor with ( largely ) homosexual instincts , melancholy and prone to drinking bouts , but with an enormous capacity for new interests and enthusiasm ##s .

reference_raw: He was a man of (largely) homosexual instincts, melancholy and prone to drinking bouts, but with an enormous capacity for new interests and enthusiasms.

reference_spacy_tokens: He was a man of ( largely ) homosexual instincts , melancholy and prone to drinking bouts , but with an enormous capacity for new interests and enthusiasms .


fn_spacy_tokens_for_baseline: While he set out very clearly the risks of court office , his letter may have exaggerated them .

source_bert_toks: while he set out very clearly the risks of court office , his letter may have exaggerated them .

reference_raw: Although he was very clear about the risks of the court office, his letter might have exaggerated them.

reference_spacy_tokens: Although he was very clear about the risks of the court office , his letter might have exaggerated them .


fn_spacy_tokens_for_baseline: What the development of state farms has meant is the demise of the peasant plot based on unpaid family labour , the reduction of seasonal employment and a growth in proletarianisation .

source_bert_toks: what the development of state farms has meant is the demise of the peasant plot based on unpaid family labour , the reduction of seasonal employment and a growth in pro ##let ##arian ##isation .

reference_raw: What the development of state farms meant was the extinction of agricultural land on the basis of unpaid family work, the reduction of seasonal employment and the growth of proletarianism.

reference_spacy_tokens: What the development of state farms meant was the extinction of agricultural land on the basis of unpaid family work , the reduction of seasonal employment and the growth of proletarianism .


fn_spacy_tokens_for_baseline: The strips are simply nailed and glued to the roof , allowing for an overlap between layers .

source_bert_toks: the strips are simply nailed and glued to the roof , allowing for an overlap between layers .

reference_raw: Strips are simply pinned and glued to the roof, allowing the layers to overlap.

reference_spacy_tokens: Strips are simply pinned and glued to the roof , allowing the layers to overlap .


fn_spacy_tokens_for_baseline: Florida protested that lower river levels might upset the delicate ecology of Apalachicola bay , and sink the area 's oyster industry .

source_bert_toks: florida protested that lower river levels might upset the delicate ecology of ap ##ala ##chi ##cola bay , and sink the area ' s oyster industry .

reference_raw: Florida protested that lower levels of the river could upset the delicate ecology of the Gulf of Apalachicola and sink the oyster industry in the area.

reference_spacy_tokens: Florida protested that lower levels of the river could upset the delicate ecology of the Gulf of Apalachicola and sink the oyster industry in the area .


fn_spacy_tokens_for_baseline: The elections rule .

source_bert_toks: the elections rule .

reference_raw: Election policy.

reference_spacy_tokens: Election policy .


fn_spacy_tokens_for_baseline: Perhaps the best way to convey this attitude is to remember a child 's definition of a net as a lot of holes tied together with string .

source_bert_toks: perhaps the best way to convey this attitude is to remember a child ' s definition of a net as a lot of holes tied together with string .

reference_raw: Perhaps the best way to express that attitude is to remember the child's definition of a net as a bunch of holes bound to a string.

reference_spacy_tokens: Perhaps the best way to express that attitude is to remember the child 's definition of a net as a bunch of holes bound to a string .


fn_spacy_tokens_for_baseline: Last night , County Durham Chief Constable Frank Taylor , presented the Alderman Harry Robinson Award to PC John Grant Matthews for outstanding work throughout the year .

source_bert_toks: last night , county durham chief constable frank taylor , presented the alderman harry robinson award to pc john grant matthews for outstanding work throughout the year .

reference_raw: Last night, Chief Constable Frank Taylor, County Durham, presented Councilman Harry Robinson's award to PC John Grant Matthews for an excellent year's work.

reference_spacy_tokens: Last night , Chief Constable Frank Taylor , County Durham , presented Councilman Harry Robinson 's award to PC John Grant Matthews for an excellent year 's work .


fn_spacy_tokens_for_baseline: MILLIONS of television viewers last night heard the voice of the kidnapper of estate agent Stephanie Slater .

source_bert_toks: millions of television viewers last night heard the voice of the kidnap ##per of estate agent stephanie slater .

reference_raw: Last night, TV viewers heard the voice of Stephanie Slater's abductor.

reference_spacy_tokens: Last night , TV viewers heard the voice of Stephanie Slater 's abductor .


fn_spacy_tokens_for_baseline: They crush their victim in their pincers , but feed by injecting digestive juices and sucking the prey dry .

source_bert_toks: they crush their victim in their pin ##cer ##s , but feed by in ##ject ##ing digest ##ive juice ##s and sucking the prey dry .

reference_raw: They grind the victim in their pincers, but they feed by injecting the digestive juices and sucking the prey dry.

reference_spacy_tokens: They grind the victim in their pincers , but they feed by injecting the digestive juices and sucking the prey dry .


fn_spacy_tokens_for_baseline: Their exhibitions scouted by the print trade , these institutions acted as powerful guardians of the rearguard , while modernists were thought aesthetically superior .

source_bert_toks: their exhibitions scout ##ed by the print trade , these institutions acted as powerful guardians of the rear ##guard , while modernist ##s were thought aesthetic ##ally superior .

reference_raw: Their exhibitions, scrutinized by the printing industry, acted as powerful rearguard guards, and modernists were considered to be aesthetically superior.

reference_spacy_tokens: Their exhibitions , scrutinized by the printing industry , acted as powerful rearguard guards , and modernists were considered to be aesthetically superior .


fn_spacy_tokens_for_baseline: In another study George Bokert increased the degree of thirst in his subjects by not only depriving them of water for twenty - four hours , but also giving them a salty meal before going to bed .

source_bert_toks: in another study george bo ##ker ##t increased the degree of thirst in his subjects by not only de ##pr ##iving them of water for twenty - four hours , but also giving them a salty meal before going to bed .

reference_raw: In another study, George Bokert increased his thirst in his subjects by not only depriving them of water for twenty-four hours, but also giving them salt food before going to bed.

reference_spacy_tokens: In another study , George Bokert increased his thirst in his subjects by not only depriving them of water for twenty - four hours , but also giving them salt food before going to bed .


fn_spacy_tokens_for_baseline: Today , the flamboyant Chrysler Building is considered a brilliant emblem of the Jazz Age , but it was not an instant success .

source_bert_toks: today , the fl ##am ##boy ##ant chrysler building is considered a brilliant emblem of the jazz age , but it was not an instant success .

reference_raw: Today, the famous Chrysler Building is considered a brilliant symbol of the Jazz Age, but it was not an instant achievement.

reference_spacy_tokens: Today , the famous Chrysler Building is considered a brilliant symbol of the Jazz Age , but it was not an instant achievement .


fn_spacy_tokens_for_baseline: I need your reassurance that this will not happen . '

source_bert_toks: i need your re ##ass ##urance that this will not happen . '

reference_raw: I need your assurance that this won't happen.'

reference_spacy_tokens: I need your assurance that this wo n't happen . '


fn_spacy_tokens_for_baseline: He beckoned her to sit between his thighs , and his heart missed a beat when she meekly obeyed .

source_bert_toks: he beck ##oned her to sit between his thighs , and his heart missed a beat when she meek ##ly obeyed .

reference_raw: He motioned for her to sit between his thighs, and his heart missed the beat as she meekly obeyed.

reference_spacy_tokens: He motioned for her to sit between his thighs , and his heart missed the beat as she meekly obeyed .


fn_spacy_tokens_for_baseline: An ambulance crew tried to resuscitate him before taking him to Arrowe Park Hospital where he died soon afterwards .

source_bert_toks: an ambulance crew tried to res ##us ##cit ##ate him before taking him to arrow ##e park hospital where he died soon afterwards .

reference_raw: The ambulance crew tried to revive him before taking him to Arrowe Park Hospital, where he died soon after.

reference_spacy_tokens: The ambulance crew tried to revive him before taking him to Arrowe Park Hospital , where he died soon after .


fn_spacy_tokens_for_baseline: Arriving at the edge of the quay , Fitzroy Maclean attempted to inflate it , only to discover that it had a puncture .

source_bert_toks: arriving at the edge of the quay , fitzroy maclean attempted to in ##fl ##ate it , only to discover that it had a pun ##cture .

reference_raw: Fitzroy Maclean reached the edge of the quay and tried to blow it up, only to find that it had a puncture.

reference_spacy_tokens: Fitzroy Maclean reached the edge of the quay and tried to blow it up , only to find that it had a puncture .


fn_spacy_tokens_for_baseline: So my first act on Indian soil was to telex a friend at Weatherbys , the British racing bureaucrats , to get them to explain the facts of life to the Bombay Turf Club .

source_bert_toks: so my first act on indian soil was to tel ##ex a friend at weather ##by ##s , the british racing bureau ##crats , to get them to explain the facts of life to the bombay turf club .

reference_raw: So my first act on Indian soil was to telegraph a friend from Weatherbys, British racing officials, to explain the facts of life to the Bombay Turf Club.

reference_spacy_tokens: So my first act on Indian soil was to telegraph a friend from Weatherbys , British racing officials , to explain the facts of life to the Bombay Turf Club .


fn_spacy_tokens_for_baseline: The sprouts were drenched and soft as rotting rosebuds .

source_bert_toks: the sp ##rou ##ts were drenched and soft as rotting rose ##bu ##ds .

reference_raw: The germs were soaked and soft as rotting rosebuds.

reference_spacy_tokens: The germs were soaked and soft as rotting rosebuds .


fn_spacy_tokens_for_baseline: A great deal of effort and sloshing about is suggested by the drawing .

source_bert_toks: a great deal of effort and sl ##oshi ##ng about is suggested by the drawing .

reference_raw: The drawing suggests a great deal of effort and sloping around.

reference_spacy_tokens: The drawing suggests a great deal of effort and sloping around .


fn_spacy_tokens_for_baseline: Be punctual for meetings .

source_bert_toks: be pun ##ct ##ual for meetings .

reference_raw: Be precise in meetings.

reference_spacy_tokens: Be precise in meetings .


fn_spacy_tokens_for_baseline: So Aaron and his sons must be cleansed , robed and their sins expiated by sacrifice before they may take office .

source_bert_toks: so aaron and his sons must be clean ##sed , robe ##d and their sins ex ##pia ##ted by sacrifice before they may take office .

reference_raw: So Aaron and his sons must be purged, clothed, and their sins extinguished by sacrifice before they can take office.

reference_spacy_tokens: So Aaron and his sons must be purged , clothed , and their sins extinguished by sacrifice before they can take office .


fn_spacy_tokens_for_baseline: Many of the chemical weapons storage facilities lack a basic automatic alarm system to warn of dangerous levels of agent in the air .

source_bert_toks: many of the chemical weapons storage facilities lack a basic automatic alarm system to warn of dangerous levels of agent in the air .

reference_raw: Many chemical weapons storage facilities do not have a basic automatic alarm system to warn against dangerous levels of agents in the air.

reference_spacy_tokens: Many chemical weapons storage facilities do not have a basic automatic alarm system to warn against dangerous levels of agents in the air .


fn_spacy_tokens_for_baseline: On the other hand , what you 'll get is this continual lying going on about kidding everybody that everything 's better than it is and , of course , the eternal gratitude .

source_bert_toks: on the other hand , what you ' ll get is this continual lying going on about kidding everybody that everything ' s better than it is and , of course , the eternal gratitude .

reference_raw: On the other hand, what you're going to get is a constant lie about fooling everyone that everything is better than it is and, of course, eternal gratitude.

reference_spacy_tokens: On the other hand , what you 're going to get is a constant lie about fooling everyone that everything is better than it is and , of course , eternal gratitude .


fn_spacy_tokens_for_baseline: The way they phrase the question reveals the fact they are thinking in the old materialistic and nationalistic terms .

source_bert_toks: the way they phrase the question reveals the fact they are thinking in the old material ##istic and nationalist ##ic terms .

reference_raw: The way they express the question reveals that they think in old materialistic and nationalistic terms.

reference_spacy_tokens: The way they express the question reveals that they think in old materialistic and nationalistic terms .


fn_spacy_tokens_for_baseline: Predatory habits are typical , and many species have specialized clutching appendages , or stinging organs .

source_bert_toks: predatory habits are typical , and many species have specialized clutching app ##end ##ages , or stinging organs .

reference_raw: Predatory habits are typical, and many species have specialized attachments or sting organs.

reference_spacy_tokens: Predatory habits are typical , and many species have specialized attachments or sting organs .


fn_spacy_tokens_for_baseline: It was fortunate for you that I never insisted on accompanying you . '

source_bert_toks: it was fortunate for you that i never insisted on accompanying you . '

reference_raw: You're lucky I didn't insist on accompanying you.'

reference_spacy_tokens: You 're lucky I did n't insist on accompanying you . '


fn_spacy_tokens_for_baseline: Q I have often admired large shoals of Yellow Tangs , but people seem to be divided as to whether this is possible to achieve in the hole aquarium .

source_bert_toks: q i have often admired large sho ##als of yellow tang ##s , but people seem to be divided as to whether this is possible to achieve in the hole aquarium .

reference_raw: Q I've often admired large shallows of yellow tangs, but people seem to be disaggregated as to whether it's possible to reach a hole in the aquarium.

reference_spacy_tokens: Q I 've often admired large shallows of yellow tangs , but people seem to be disaggregated as to whether it 's possible to reach a hole in the aquarium .


fn_spacy_tokens_for_baseline: Then she remembered that she was supposed to get the father 's permission before taking the child out of the country , and said , ' If you agree , that is . '

source_bert_toks: then she remembered that she was supposed to get the father ' s permission before taking the child out of the country , and said , ' if you agree , that is . '

reference_raw: Then, remembering that she should have obtained her father's consent before she took the child from the country, she said, "Well, if you agree."

reference_spacy_tokens: Then , remembering that she should have obtained her father 's consent before she took the child from the country , she said , " Well , if you agree . "


fn_spacy_tokens_for_baseline: Auguste was admiring the famous series of paintings intended for Madame du Barry .

source_bert_toks: auguste was admiring the famous series of paintings intended for madame du barry .

reference_raw: Auguste marveled at the famous series of paintings for Madame du Barry.

reference_spacy_tokens: Auguste marveled at the famous series of paintings for Madame du Barry .


fn_spacy_tokens_for_baseline: McColgan , slumped in deep dejection , said afterwards : ' It was just a bad race on my part .

source_bert_toks: mcc ##ol ##gan , slumped in deep de ##ject ##ion , said afterwards : ' it was just a bad race on my part .

reference_raw: McColgan, who had fallen into a deep depression, said later, "It was just a bad race on my part.

reference_spacy_tokens: McColgan , who had fallen into a deep depression , said later , " It was just a bad race on my part .


fn_spacy_tokens_for_baseline: The lightning flared into his face and , covering his eyes with one hand , he said desperately , ' For God 's sake ca n't we go downstairs ? '

source_bert_toks: the lightning flared into his face and , covering his eyes with one hand , he said desperately , ' for god ' s sake can ' t we go downstairs ? '

reference_raw: Lightning flashed in his face, and he put one hand over his eyes and said desperately, "Oh, my God, can't we go down?"

reference_spacy_tokens: Lightning flashed in his face , and he put one hand over his eyes and said desperately , " Oh , my God , ca n't we go down ? "


fn_spacy_tokens_for_baseline: This is also the public image so carefully cultivated for them by endangered - species activists .

source_bert_toks: this is also the public image so carefully cultivated for them by endangered - species activists .

reference_raw: It's also a public picture that's been so carefully cultivated by endangered species activists.

reference_spacy_tokens: It 's also a public picture that 's been so carefully cultivated by endangered species activists .


fn_spacy_tokens_for_baseline: The women are deliberately promiscuous in order to win more male protectors for their child .

source_bert_toks: the women are deliberately prom ##is ##cu ##ous in order to win more male protector ##s for their child .

reference_raw: Women are deliberately promiscuous to get more male protectors for their child.

reference_spacy_tokens: Women are deliberately promiscuous to get more male protectors for their child .


fn_spacy_tokens_for_baseline: The magnetic memory board consisted of a sheet with rows showing the subject 's age ( 0 - 20 years ) , the corresponding year , and memorable historic events that occurred during each year .

source_bert_toks: the magnetic memory board consisted of a sheet with rows showing the subject ' s age ( 0 - 20 years ) , the corresponding year , and memorable historic events that occurred during each year .

reference_raw: The magnetic memory panel consisted of a sheet with rows showing the age of the subject (0-20 years), the corresponding year, and the memorable historical events that occurred in each year.

reference_spacy_tokens: The magnetic memory panel consisted of a sheet with rows showing the age of the subject ( 0 - 20 years ) , the corresponding year , and the memorable historical events that occurred in each year .


fn_spacy_tokens_for_baseline: ' Today 's incident bears witness to what kind of people Maskhadov and his closest entourage are .

source_bert_toks: ' today ' s incident bears witness to what kind of people mask ##had ##ov and his closest entourage are .

reference_raw: Today's incident bears witness to the kind of people that Maskhadov and his closest escort are.

reference_spacy_tokens: Today 's incident bears witness to the kind of people that Maskhadov and his closest escort are .


fn_spacy_tokens_for_baseline: In tiny Ingushetia , swarming with refugees , the 1992 eviction from Prigorodny reminds of the repression of 1944 , when Josef Stalin exiled the Ingush and Chechens to Kazakhstan for allegedly helping the Nazis .

source_bert_toks: in tiny ing ##ush ##eti ##a , swarm ##ing with refugees , the 1992 ev ##iction from pri ##gor ##od ##ny reminds of the repression of 1944 , when josef stalin exiled the ing ##ush and che ##chen ##s to kazakhstan for allegedly helping the nazis .

reference_raw: In small Ingushetia, crawling with refugees, the 1992 eviction from Prigorodny reminds me of the 1944 repression, when Joseph Stalin banished the Ingush and Chechens to Kazakhstan for allegedly helping the Nazis.

reference_spacy_tokens: In small Ingushetia , crawling with refugees , the 1992 eviction from Prigorodny reminds me of the 1944 repression , when Joseph Stalin banished the Ingush and Chechens to Kazakhstan for allegedly helping the Nazis .


fn_spacy_tokens_for_baseline: It was the climax to a stupendous week .

source_bert_toks: it was the climax to a stu ##pen ##dou ##s week .

reference_raw: It was the climax of a stunning week.

reference_spacy_tokens: It was the climax of a stunning week .


fn_spacy_tokens_for_baseline: She gazed upwards at the newly painted ceiling for a little while , too contented to stir , then with a sudden movement she threw back the covers and pattered over to the window .

source_bert_toks: she gazed upwards at the newly painted ceiling for a little while , too content ##ed to stir , then with a sudden movement she threw back the covers and pat ##tered over to the window .

reference_raw: She stared up at the newly painted ceiling for a moment, too content to move, then threw back the blankets and patted the window with a sudden movement.

reference_spacy_tokens: She stared up at the newly painted ceiling for a moment , too content to move , then threw back the blankets and patted the window with a sudden movement .


fn_spacy_tokens_for_baseline: He was a wizard at appealing to everyone 's sense of childlike wonder .

source_bert_toks: he was a wizard at appealing to everyone ' s sense of child ##like wonder .

reference_raw: He was a magician who appealed to everyone's sense of childlike wonder.

reference_spacy_tokens: He was a magician who appealed to everyone 's sense of childlike wonder .


fn_spacy_tokens_for_baseline: The universities attract students from all over the world , and this influx helps to make Dublin a busy , buzzing international city .

source_bert_toks: the universities attract students from all over the world , and this influx helps to make dublin a busy , buzzing international city .

reference_raw: Universities attract students from all over the world, and this inflow helps to make Dublin a busy, buzzing international city.

reference_spacy_tokens: Universities attract students from all over the world , and this inflow helps to make Dublin a busy , buzzing international city .


fn_spacy_tokens_for_baseline: Consequently the cadmium red light and the droplets of gold fused into the Renaissance gold where they fell upon it in rather a pleasing manner .

source_bert_toks: consequently the cad ##mium red light and the droplets of gold fused into the renaissance gold where they fell upon it in rather a pleasing manner .

reference_raw: As a result, the cadmium red light and droplets of gold melted into the Renaissance gold, where they fell upon it rather pleasantly.

reference_spacy_tokens: As a result , the cadmium red light and droplets of gold melted into the Renaissance gold , where they fell upon it rather pleasantly .


fn_spacy_tokens_for_baseline: Finally , as shown in the table , Democrats allocate a higher proportion of their personal staffs to district offices -- where local benefit - seeking duties matter more and national policy making activities matter less relative to Washington offices .

source_bert_toks: finally , as shown in the table , democrats all ##oca ##te a higher proportion of their personal staff ##s to district offices - - where local benefit - seeking duties matter more and national policy making activities matter less relative to washington offices .

reference_raw: Finally, as can be seen from the table, Democrats allocate a higher proportion of their personal staff to district offices - where local benefit-seeking responsibilities are more important and national political activities are less important than Washington authorities.

reference_spacy_tokens: Finally , as can be seen from the table , Democrats allocate a higher proportion of their personal staff to district offices - where local benefit - seeking responsibilities are more important and national political activities are less important than Washington authorities .


fn_spacy_tokens_for_baseline: The Director of Studies then produced a folder of his son 's Art ( from another school ) .

source_bert_toks: the director of studies then produced a folder of his son ' s art ( from another school ) .

reference_raw: The study director then produced a file on his son's art (from another school).

reference_spacy_tokens: The study director then produced a file on his son 's art ( from another school ) .


fn_spacy_tokens_for_baseline: The next thing was to get out of my soaking clothes .

source_bert_toks: the next thing was to get out of my soaking clothes .

reference_raw: The next thing I knew, I was getting out of my wet clothes.

reference_spacy_tokens: The next thing I knew , I was getting out of my wet clothes .


fn_spacy_tokens_for_baseline: Day continues : ' Very few outlets would warrant more than one product , and that is usually a lager , so ale brands find it quite difficult to get in - trade distribution . '

source_bert_toks: day continues : ' very few outlets would warrant more than one product , and that is usually a la ##ger , so ale brands find it quite difficult to get in - trade distribution . '

reference_raw: The day goes on: 'A very few outlets would justify more than one product, which is usually delayed, so it's hard for beer brands to get in-trade distribution.'

reference_spacy_tokens: The day goes on : ' A very few outlets would justify more than one product , which is usually delayed , so it 's hard for beer brands to get in - trade distribution . '


fn_spacy_tokens_for_baseline: and there came the very welcome sound of a camo - white Kiowa OH-58D91 , lobbing rockets into the treeline as it swooped down between the unseen pursuers and our heroes A MYAMP amp ; A.

source_bert_toks: and there came the very welcome sound of a cam ##o - white ki ##owa oh - 58 ##d ##9 ##1 , lo ##bbing rockets into the tree ##line as it sw ##ooped down between the unseen pursue ##rs and our heroes a my ##amp amp ; a .

reference_raw: and there was the very welcome noise of the Camo-white Kiowa OH-58D91, lobbing rockets into the tree line as it swooped down between the invisible pursuers and our heroes A MYAMP am; A.

reference_spacy_tokens: and there was the very welcome noise of the Camo - white Kiowa OH-58D91 , lobbing rockets into the tree line as it swooped down between the invisible pursuers and our heroes A MYAMP am ; A.


fn_spacy_tokens_for_baseline: She thought of joining Chelsea Art School and learning to paint , she timidly told Toby one evening , as they hurried through a drizzle to the Markham Arms .

source_bert_toks: she thought of joining chelsea art school and learning to paint , she tim ##id ##ly told toby one evening , as they hurried through a dr ##iz ##zle to the markham arms .

reference_raw: She thought of going to Chelsea Art School and learning how to paint, and one night, shyly, she told Toby, as they hurried through the rain toward the Markham Arms.

reference_spacy_tokens: She thought of going to Chelsea Art School and learning how to paint , and one night , shyly , she told Toby , as they hurried through the rain toward the Markham Arms .


fn_spacy_tokens_for_baseline: Then she remembered Guido 's threat that he could stop him working anywhere in Italy , and suddenly she did n't feel quite so relieved any more .

source_bert_toks: then she remembered guido ' s threat that he could stop him working anywhere in italy , and suddenly she didn ' t feel quite so relieved any more .

reference_raw: Then she remembered that Guido had threatened to stop him from working anywhere in Italy, and suddenly she was no longer so relieved.

reference_spacy_tokens: Then she remembered that Guido had threatened to stop him from working anywhere in Italy , and suddenly she was no longer so relieved .


fn_spacy_tokens_for_baseline: Evans looked up suspiciously , his body tensing , his trunk leaning forward as if he were going to rise .

source_bert_toks: evans looked up suspiciously , his body tens ##ing , his trunk leaning forward as if he were going to rise .

reference_raw: Evans looked up suspiciously, his body twitching, his suitcase leaning forward as if he were about to rise.

reference_spacy_tokens: Evans looked up suspiciously , his body twitching , his suitcase leaning forward as if he were about to rise .


fn_spacy_tokens_for_baseline: This draws attention to another aspect of human discourse processing : the ability to construct the referential representation of a text or sentence .

source_bert_toks: this draws attention to another aspect of human discourse processing : the ability to construct the refer ##ential representation of a text or sentence .

reference_raw: This draws attention to another aspect of the processing of human discourse: the ability to construct a reference representation of a text or sentence.

reference_spacy_tokens: This draws attention to another aspect of the processing of human discourse : the ability to construct a reference representation of a text or sentence .


fn_spacy_tokens_for_baseline: Could he accordingly have the pleasure of treating her to a deckchair and listening to the band with her ?

source_bert_toks: could he accordingly have the pleasure of treating her to a deck ##chai ##r and listening to the band with her ?

reference_raw: Would he have the pleasure of taking her to a chair and listening to the band with her?

reference_spacy_tokens: Would he have the pleasure of taking her to a chair and listening to the band with her ?


fn_spacy_tokens_for_baseline: Direct communications which were relevant to the customer 's situation were highly welcome .

source_bert_toks: direct communications which were relevant to the customer ' s situation were highly welcome .

reference_raw: Direct communications of relevance to the situation of the customer were very welcome.

reference_spacy_tokens: Direct communications of relevance to the situation of the customer were very welcome .


fn_spacy_tokens_for_baseline: One of the best of these ' Collection Wines ' is a 1969 Negru de Purkar ( £ 8.95 from Butlers Wine Cellar ) that blends Cabernet Sauvignon with native Saperavi and Rara Niagre grapes .

source_bert_toks: one of the best of these ' collection wines ' is a 1969 ne ##gr ##u de pu ##rka ##r ( £ ##8 . 95 from butler ##s wine cellar ) that blend ##s cab ##ern ##et sa ##u ##vi ##gnon with native sap ##era ##vi and ra ##ra ni ##ag ##re grapes .

reference_raw: One of the best "collection wines" is the 1969 Negro de Purkar (8.95 from Butler Wine Cellar) which combines Cabernet Sauvignon with native Saperavi and Rara Niagre grapes.

reference_spacy_tokens: One of the best " collection wines " is the 1969 Negro de Purkar ( 8.95 from Butler Wine Cellar ) which combines Cabernet Sauvignon with native Saperavi and Rara Niagre grapes .


fn_spacy_tokens_for_baseline: The man who does not use his reason to weed out his emotions is not an egoist ; he is selfish and generous , kind and cruel , grateful and revengeful .

source_bert_toks: the man who does not use his reason to weed out his emotions is not an ego ##ist ; he is selfish and generous , kind and cruel , grateful and revenge ##ful .

reference_raw: A man who doesn't use his reason to weed out his emotions is not selfish, he's generous, he's kind, he's cruel, he's grateful and he's revenged.

reference_spacy_tokens: A man who does n't use his reason to weed out his emotions is not selfish , he 's generous , he 's kind , he 's cruel , he 's grateful and he 's revenged .


fn_spacy_tokens_for_baseline: The attacks have intensified since the Colombian government began cracking down on the traffickers in August , trying to prevent their takeover of the country .

source_bert_toks: the attacks have intensified since the colombian government began cracking down on the traffic ##kers in august , trying to prevent their takeover of the country .

reference_raw: Since the Colombian government started cracking down on the dealers in August, the attacks have intensified, trying to stop them from taking over the country.

reference_spacy_tokens: Since the Colombian government started cracking down on the dealers in August , the attacks have intensified , trying to stop them from taking over the country .


fn_spacy_tokens_for_baseline: Beech claims that this aids fast readers skimming for meaning as well as helping learners with new words .

source_bert_toks: beech claims that this aids fast readers ski ##mming for meaning as well as helping learners with new words .

reference_raw: Beech claims that it helps fast readers to understand meaning and helps learners to learn new words.

reference_spacy_tokens: Beech claims that it helps fast readers to understand meaning and helps learners to learn new words .


fn_spacy_tokens_for_baseline: ' It 's for the starving multitudes , ' he whined through his matted beard , holding out the crock of gold in his blood - stained fingers .

source_bert_toks: ' it ' s for the starving multitude ##s , ' he w ##hine ##d through his matt ##ed beard , holding out the cr ##ock of gold in his blood - stained fingers .

reference_raw: 'It's for the hungry crowds,' he whined through his matted beard, holding out a gilt of gold in his blood-stained fingers.

reference_spacy_tokens: ' It 's for the hungry crowds , ' he whined through his matted beard , holding out a gilt of gold in his blood - stained fingers .


fn_spacy_tokens_for_baseline: Her travelling companions had quietened , as if someone in authority had arrived .

source_bert_toks: her travelling companions had quiet ##ened , as if someone in authority had arrived .

reference_raw: Her traveling companions calmed down, as if someone with authority had arrived.

reference_spacy_tokens: Her traveling companions calmed down , as if someone with authority had arrived .


fn_spacy_tokens_for_baseline: Historically , very few terrorist groups have possessed the motivation , the organization , and the technical capability to conduct a successful chemical or biological terrorist attack , particularly on a large scale .

source_bert_toks: historically , very few terrorist groups have possessed the motivation , the organization , and the technical capability to conduct a successful chemical or biological terrorist attack , particularly on a large scale .

reference_raw: In the past, very few terrorist groups have the motive, organisation and technical capacity to carry out a successful chemical or biological terrorist attack, especially on a large scale.

reference_spacy_tokens: In the past , very few terrorist groups have the motive , organisation and technical capacity to carry out a successful chemical or biological terrorist attack , especially on a large scale .


fn_spacy_tokens_for_baseline: Still holding the old man 's shirtfront , Ellwood yanked him back to the couch and threw him full length .

source_bert_toks: still holding the old man ' s shirt ##front , el ##l ##wood yanked him back to the couch and threw him full length .

reference_raw: Ellwood, still clutching the old man's shirt-front, jerked him back to the sofa and threw him full-length.

reference_spacy_tokens: Ellwood , still clutching the old man 's shirt - front , jerked him back to the sofa and threw him full - length .


fn_spacy_tokens_for_baseline: The " Hsin Chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a reprocessing research laboratory , and a plutonium separation plant .

source_bert_toks: the " hs ##in chu " program involved procurement and operation of a heavy water reactor , a heavy water production plant , a rep ##ro ##ces ##sing research laboratory , and a pluto ##nium separation plant .

reference_raw: The Hsin Chu programme included the procurement and maintenance of a heavy-water reactor, a heavy-water plant, a research laboratory for reprocessing, and a plutonium separation plant.

reference_spacy_tokens: The Hsin Chu programme included the procurement and maintenance of a heavy - water reactor , a heavy - water plant , a research laboratory for reprocessing , and a plutonium separation plant .


fn_spacy_tokens_for_baseline: You 've managed to dodge meeting the boys at the sharp end of this exercise for far too long .

source_bert_toks: you ' ve managed to dodge meeting the boys at the sharp end of this exercise for far too long .

reference_raw: You've been avoiding meeting the boys at the sharp end of this exercise for too long.

reference_spacy_tokens: You 've been avoiding meeting the boys at the sharp end of this exercise for too long .


fn_spacy_tokens_for_baseline: I can not find out of the evidence any facts which support the view or which justify the inference .

source_bert_toks: i can not find out of the evidence any facts which support the view or which justify the inference .

reference_raw: On the basis of the evidence, I cannot find any evidence to substantiate that view or to justify that conclusion.

reference_spacy_tokens: On the basis of the evidence , I can not find any evidence to substantiate that view or to justify that conclusion .


fn_spacy_tokens_for_baseline: Cormack reeled as the ship began to roll and hit his elbow on the ladder rail .

source_bert_toks: co ##rma ##ck reel ##ed as the ship began to roll and hit his elbow on the ladder rail .

reference_raw: As the boat began to roll, Cormack staggered and struck his elbow on the ladder railing.

reference_spacy_tokens: As the boat began to roll , Cormack staggered and struck his elbow on the ladder railing .


fn_spacy_tokens_for_baseline: " We have the toughest and best - trained firefighters in the world fighting to protect public safety and property .

source_bert_toks: " we have the tough ##est and best - trained firefighters in the world fighting to protect public safety and property .

reference_raw: "We have the toughest and most trained firemen in the world who fight for the protection of public security and property."

reference_spacy_tokens: " We have the toughest and most trained firemen in the world who fight for the protection of public security and property . "


fn_spacy_tokens_for_baseline: ) are signs of a long - deferred maturity .

source_bert_toks: ) are signs of a long - def ##erre ##d maturity .

reference_raw: ) is a sign of long-term maturation.

reference_spacy_tokens: ) is a sign of long - term maturation .


fn_spacy_tokens_for_baseline: When we were dressing up kids , I always tried to look elegant , classy , sexy or feminine , whereas she dressed more how she wanted in weird and wacky costumes , like a cowboy outfit .

source_bert_toks: when we were dressing up kids , i always tried to look elegant , class ##y , sexy or feminine , whereas she dressed more how she wanted in weird and wa ##cky costumes , like a cowboy outfit .

reference_raw: When we dressed the kids, I always tried to look elegant, classy, sexy, or feminine, while she dressed more like she wanted to wear a strange, wacky dress like a cowboy dress.

reference_spacy_tokens: When we dressed the kids , I always tried to look elegant , classy , sexy , or feminine , while she dressed more like she wanted to wear a strange , wacky dress like a cowboy dress .


fn_spacy_tokens_for_baseline: For it will permit peaceful civilian use of nuclear power while avoiding the threat of proliferation and the possibility that terrorists might acquire a nuclear weapon or it might proliferate to some other irresponsible party and then endanger America or its allies .

source_bert_toks: for it will permit peaceful civilian use of nuclear power while avoiding the threat of proliferation and the possibility that terrorists might acquire a nuclear weapon or it might pro ##life ##rate to some other ir ##res ##pon ##sible party and then end ##anger america or its allies .

reference_raw: For it will allow peaceful civilian use of nuclear energy, while avoiding the threat of proliferation and the possibility that terrorists may acquire a nuclear weapon or proliferate to another irresponsible party, thereby jeopardising America or its allies.

reference_spacy_tokens: For it will allow peaceful civilian use of nuclear energy , while avoiding the threat of proliferation and the possibility that terrorists may acquire a nuclear weapon or proliferate to another irresponsible party , thereby jeopardising America or its allies .


fn_spacy_tokens_for_baseline: Officials said Chiluba was expected to ward off a challenge from former vice president Levy Mwanawasa , a lawyer instrumental in Chiluba 's 1991 victory , in Thursday 's leadership vote .

source_bert_toks: officials said chi ##lub ##a was expected to ward off a challenge from former vice president levy mw ##ana ##was ##a , a lawyer instrumental in chi ##lub ##a ' s 1991 victory , in thursday ' s leadership vote .

reference_raw: According to officials, Chiluba was expected to avoid the challenge of former Vice President Levy Mwanawasa, a lawyer who helped win Chiluba's 1991 election on Thursday.

reference_spacy_tokens: According to officials , Chiluba was expected to avoid the challenge of former Vice President Levy Mwanawasa , a lawyer who helped win Chiluba 's 1991 election on Thursday .


fn_spacy_tokens_for_baseline: Davis checked that each man had a rucksack of bombs , a pocketful of fuses , benzedrine tablets , a full water - bottle and a loaded weapon .

source_bert_toks: davis checked that each man had a ru ##cks ##ack of bombs , a pocket ##ful of fuse ##s , benz ##ed ##rine tablets , a full water - bottle and a loaded weapon .

reference_raw: Davis made sure each man had a pack of bombs, a pocket full of fuses, benzedrine tablets, a full bottle of water, and a loaded gun.

reference_spacy_tokens: Davis made sure each man had a pack of bombs , a pocket full of fuses , benzedrine tablets , a full bottle of water , and a loaded gun .


fn_spacy_tokens_for_baseline: It also held a mock " trial inspection " at the Shahid Razkani chemical factory to allow inspectors to see how such a procedure was conducted .

source_bert_toks: it also held a mock " trial inspection " at the shah ##id ra ##z ##kan ##i chemical factory to allow inspectors to see how such a procedure was conducted .

reference_raw: The Shahid Razkani Chemical Factory also carried out a mock "trial inspection" to enable inspectors to see how such a procedure was carried out.

reference_spacy_tokens: The Shahid Razkani Chemical Factory also carried out a mock " trial inspection " to enable inspectors to see how such a procedure was carried out .


fn_spacy_tokens_for_baseline: Wearing a Marlene Dietrich - style tux and top hat , Madonna caressed the thigh and slapped the buttocks of a lingerie - clad female dancer .

source_bert_toks: wearing a marlene dietrich - style tu ##x and top hat , madonna caressed the thigh and slapped the butt ##ocks of a linger ##ie - clad female dancer .

reference_raw: Madonna, wearing a suit and top hat in the style of Marlene Dietrich, stroked her thigh and slapped the butt of a woman in underwear.

reference_spacy_tokens: Madonna , wearing a suit and top hat in the style of Marlene Dietrich , stroked her thigh and slapped the butt of a woman in underwear .


fn_spacy_tokens_for_baseline: He reveres Cage for his rigorous search for simplicity , his fantastic openness to experiences and ideas .

source_bert_toks: he rev ##eres cage for his rigorous search for simplicity , his fantastic open ##ness to experiences and ideas .

reference_raw: He worships Cage for his intense search for simplicity, his fantastic openness to experience and ideas.

reference_spacy_tokens: He worships Cage for his intense search for simplicity , his fantastic openness to experience and ideas .


fn_spacy_tokens_for_baseline: What would they do if she farted ?

source_bert_toks: what would they do if she far ##ted ?

reference_raw: What would they have done if she'd frotted?

reference_spacy_tokens: What would they have done if she 'd frotted ?


fn_spacy_tokens_for_baseline: Parents should be involved with their children 's education at home , not in school .

source_bert_toks: parents should be involved with their children ' s education at home , not in school .

reference_raw: Parents should participate in the education of their children at home, not at school.

reference_spacy_tokens: Parents should participate in the education of their children at home , not at school .


fn_spacy_tokens_for_baseline: I have been sent a Leeds United 1993 - 94 squad picture from the Evening Post and this now adorns my office wall , much to the amusement of my colleagues .

source_bert_toks: i have been sent a leeds united 1993 - 94 squad picture from the evening post and this now ad ##orn ##s my office wall , much to the amusement of my colleagues .

reference_raw: I've been sent a photo of Leeds United 1993-94 from the Evening Post, and it now adorns my office wall, much to the pleasure of my colleagues.

reference_spacy_tokens: I 've been sent a photo of Leeds United 1993 - 94 from the Evening Post , and it now adorns my office wall , much to the pleasure of my colleagues .


fn_spacy_tokens_for_baseline: Physically she resembled a smoothly groomed Pekinese with large lambent eyes , a silken haired little bitch .

source_bert_toks: physically she resembled a smoothly groom ##ed pe ##kin ##ese with large lamb ##ent eyes , a silk ##en haired little bitch .

reference_raw: Physically, she looked like a neatly groomed Pekinese with big sheepish eyes, like a silk-haired little whore.

reference_spacy_tokens: Physically , she looked like a neatly groomed Pekinese with big sheepish eyes , like a silk - haired little whore .


fn_spacy_tokens_for_baseline: Wild laughter bubbled in Caroline 's throat .

source_bert_toks: wild laughter bubble ##d in caroline ' s throat .

reference_raw: Caroline's throat was full of wild laughter.

reference_spacy_tokens: Caroline 's throat was full of wild laughter .


fn_spacy_tokens_for_baseline: He swigged his lager .

source_bert_toks: he sw ##ig ##ged his la ##ger .

reference_raw: He swiveled his lager.

reference_spacy_tokens: He swiveled his lager .


fn_spacy_tokens_for_baseline: The response was heart - warming .

source_bert_toks: the response was heart - warming .

reference_raw: The answer was a warming heart.

reference_spacy_tokens: The answer was a warming heart .


fn_spacy_tokens_for_baseline: It appeared to be coming from somewhere to the right , the bullets were hitting the house high up and smashing through the windows of one of the bedrooms .

source_bert_toks: it appeared to be coming from somewhere to the right , the bullets were hitting the house high up and smashing through the windows of one of the bedrooms .

reference_raw: It seemed to come from somewhere to the right, bullets hitting the house high and crashing through the windows of one of the bedrooms.

reference_spacy_tokens: It seemed to come from somewhere to the right , bullets hitting the house high and crashing through the windows of one of the bedrooms .


fn_spacy_tokens_for_baseline: Flowers simply shrivel up , the combined effect of dryness at the roots and attacks by tiny , shiny black pollen beetles , escapees from oil seed rape fields .

source_bert_toks: flowers simply shri ##vel up , the combined effect of dry ##ness at the roots and attacks by tiny , shiny black pollen beetles , escape ##es from oil seed rape fields .

reference_raw: The flowers simply shrink, the combined effect of the dryness of the roots and the attacks of small, shiny black pollen beetles, the runaways from the oil-seed rape fields.

reference_spacy_tokens: The flowers simply shrink , the combined effect of the dryness of the roots and the attacks of small , shiny black pollen beetles , the runaways from the oil - seed rape fields .


fn_spacy_tokens_for_baseline: Determining how many nuclear weapons a country can produce with a given amount of fissile material requires knowing the technological sophistication of the country and the explosive yield of the weapons .

source_bert_toks: determining how many nuclear weapons a country can produce with a given amount of fis ##sil ##e material requires knowing the technological so ##phi ##stic ##ation of the country and the explosive yield of the weapons .

reference_raw: To determine the number of nuclear weapons a country can produce with a certain amount of fissile material, it is necessary to know the technological complexity of the country and the explosive yield of the weapons.

reference_spacy_tokens: To determine the number of nuclear weapons a country can produce with a certain amount of fissile material , it is necessary to know the technological complexity of the country and the explosive yield of the weapons .


fn_spacy_tokens_for_baseline: If you can simulate attacking and being attacked , then you are far more likely to find out whether your tactics and movements are effective .

source_bert_toks: if you can simulate attacking and being attacked , then you are far more likely to find out whether your tactics and movements are effective .

reference_raw: If you can mimic attack and be attacked, you'll be more likely to find out if your tactics and movements are effective.

reference_spacy_tokens: If you can mimic attack and be attacked , you 'll be more likely to find out if your tactics and movements are effective .


fn_spacy_tokens_for_baseline: Her torch flickered across the wall and she switched it off , holding her breath in case someone had noticed the distant gleam of light .

source_bert_toks: her torch flickered across the wall and she switched it off , holding her breath in case someone had noticed the distant gleam of light .

reference_raw: Her torch flashed over the wall, and she turned it off, holding her breath in case anyone noticed a distant flash of light.

reference_spacy_tokens: Her torch flashed over the wall , and she turned it off , holding her breath in case anyone noticed a distant flash of light .


fn_spacy_tokens_for_baseline: At Monterrey , publisher Luis Gabriel Cano , although shaken by the murders , issued a statement saying : " We will not cease our fight against drug trafficking .

source_bert_toks: at monterrey , publisher luis gabriel can ##o , although shaken by the murders , issued a statement saying : " we will not cease our fight against drug trafficking .

reference_raw: In Monterrey, publisher Luis Gabriel Cano, though shaken by the murders, made a statement saying, "We will not stop fighting drug trafficking.

reference_spacy_tokens: In Monterrey , publisher Luis Gabriel Cano , though shaken by the murders , made a statement saying , " We will not stop fighting drug trafficking .


fn_spacy_tokens_for_baseline: SIX months ago , dramatic things were happening in Japanese politics .

source_bert_toks: six months ago , dramatic things were happening in japanese politics .

reference_raw: Six months ago, dramatic events occurred in Japanese politics.

reference_spacy_tokens: Six months ago , dramatic events occurred in Japanese politics .


fn_spacy_tokens_for_baseline: A figure covered from head to foot with blotches was standing beyond the bed , pressing its face and hands against the glass , gazing out at him .

source_bert_toks: a figure covered from head to foot with b ##lot ##ches was standing beyond the bed , pressing its face and hands against the glass , gazing out at him .

reference_raw: A figure, covered from head to foot with stains, stood behind the bed, pressing his face and hands against the glass and staring at him.

reference_spacy_tokens: A figure , covered from head to foot with stains , stood behind the bed , pressing his face and hands against the glass and staring at him .


fn_spacy_tokens_for_baseline: I can understand the apparent stupefaction of all parties .

source_bert_toks: i can understand the apparent stu ##pe ##fa ##ction of all parties .

reference_raw: I understand the apparent numbness of all parties.

reference_spacy_tokens: I understand the apparent numbness of all parties .


fn_spacy_tokens_for_baseline: In those three weeks the couple fell in love and became engaged .

source_bert_toks: in those three weeks the couple fell in love and became engaged .

reference_raw: In those three weeks, the couple had fallen in love and betrothed.

reference_spacy_tokens: In those three weeks , the couple had fallen in love and betrothed .


fn_spacy_tokens_for_baseline: The glittering sparkle and excitement of the city simultaneously soothed and exhilarated her .

source_bert_toks: the glittering sparkle and excitement of the city simultaneously soothe ##d and ex ##hila ##rated her .

reference_raw: At the same time she was comforted and excited by the glittering sparks and excitement of the city.

reference_spacy_tokens: At the same time she was comforted and excited by the glittering sparks and excitement of the city .


fn_spacy_tokens_for_baseline: Mother Verity and Father Luke hastened forward and drew her gently back to the rostrum .

source_bert_toks: mother verity and father luke haste ##ned forward and drew her gently back to the ro ##st ##rum .

reference_raw: Mother Verity and Father Luke hurried forward, pulling her gently back into the rostrum.

reference_spacy_tokens: Mother Verity and Father Luke hurried forward , pulling her gently back into the rostrum .


fn_spacy_tokens_for_baseline: Pollitt 's men were dressed identically , in smart green boiler suits , and they 'd obviously been sent here to make Spring Mill secure yet again .

source_bert_toks: poll ##itt ' s men were dressed identical ##ly , in smart green boiler suits , and they ' d obviously been sent here to make spring mill secure yet again .

reference_raw: Pollitt's men were dressed the same way, in bright green boiler suits, and apparently they had been sent here to make Spring Mill safe again.

reference_spacy_tokens: Pollitt 's men were dressed the same way , in bright green boiler suits , and apparently they had been sent here to make Spring Mill safe again .


fn_spacy_tokens_for_baseline: A dog yapped frantically somewhere inside and was subdued .

source_bert_toks: a dog ya ##pped frantically somewhere inside and was subdued .

reference_raw: Somewhere inside, a dog barked frantically and was subdued.

reference_spacy_tokens: Somewhere inside , a dog barked frantically and was subdued .


fn_spacy_tokens_for_baseline: The facility 's status is unknown .

source_bert_toks: the facility ' s status is unknown .

reference_raw: The status of the device is not known.

reference_spacy_tokens: The status of the device is not known .


fn_spacy_tokens_for_baseline: It was Anne 's turn in the car , driving the five garrulous and argumentative children from the neighbourhood to St Michael 's , three miles away .

source_bert_toks: it was anne ' s turn in the car , driving the five ga ##rr ##ulous and argument ##ative children from the neighbourhood to st michael ' s , three miles away .

reference_raw: It was Anne's turn to drive the five grueling, arguing children from the neighborhood to St. Michael's, three miles away.

reference_spacy_tokens: It was Anne 's turn to drive the five grueling , arguing children from the neighborhood to St. Michael 's , three miles away .


fn_spacy_tokens_for_baseline: Nursing my mug of tea in both hands and feeling the warmth of the rum through my body , the thought crossed my mind as I watched the mortar team sitting on the grass in front of me , ' What if the Germans discovered where we were , and got our range ?

source_bert_toks: nursing my mug of tea in both hands and feeling the warmth of the rum through my body , the thought crossed my mind as i watched the mortar team sitting on the grass in front of me , ' what if the germans discovered where we were , and got our range ?

reference_raw: I nurtured a cup of tea in both hands and felt the heat of the rum in my body, and thought of it as I watched the mortar team sitting on the grass in front of me, "What if the Germans found out where we were and got our distance?

reference_spacy_tokens: I nurtured a cup of tea in both hands and felt the heat of the rum in my body , and thought of it as I watched the mortar team sitting on the grass in front of me , " What if the Germans found out where we were and got our distance ?


fn_spacy_tokens_for_baseline: ( NYT_ENG _ 20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for a lung ailment that he contracted on Robben Island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

source_bert_toks: ( ny ##t _ eng _ 2013 ##0 ##6 ##25 . 00 ##44 ) meanwhile , in pretoria , doctors continued to treat mandela for a lung ai ##lm ##ent that he contracted on robb ##en island , the notorious apartheid - era prison where he spent much of his 27 years behind bars until his release in 1990 .

reference_raw: (NYT_ENG_20130625.0044) Meanwhile, in Pretoria, doctors continued to treat Mandela for the lung disease he had contracted on Robben Island, the infamous apartheid-era prison where he had spent most of his 27 years in prison until his release in 1990.

reference_spacy_tokens: ( NYT_ENG_20130625.0044 ) Meanwhile , in Pretoria , doctors continued to treat Mandela for the lung disease he had contracted on Robben Island , the infamous apartheid - era prison where he had spent most of his 27 years in prison until his release in 1990 .


fn_spacy_tokens_for_baseline: While several Iranian leaders felt that developing a CW program would counteract the Iraqi threat and prove to be a strong deterrent , others within the clerical Islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - Islamic .

source_bert_toks: while several iranian leaders felt that developing a cw program would counter ##act the iraqi threat and prove to be a strong deter ##rent , others within the clerical islamic regime publicly condemned any use of chemicals on moral grounds , calling them un - islamic .

reference_raw: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove to be a strong deterrent, others in the Islamic clerical regime publicly condemned any use of chemicals for moral reasons, saying that they were un-Islamic.

reference_spacy_tokens: While some Iranian leaders felt that the development of a CW program would counter the Iraqi threat and prove to be a strong deterrent , others in the Islamic clerical regime publicly condemned any use of chemicals for moral reasons , saying that they were un - Islamic .


fn_spacy_tokens_for_baseline: The other difference is that the vast majority of successful candidates would undoubtedly fail the exams for entry to the higher levels of the bureaucracy .

source_bert_toks: the other difference is that the vast majority of successful candidates would undoubtedly fail the exams for entry to the higher levels of the bureaucracy .

reference_raw: Another difference is that the vast majority of successful candidates would no doubt fail to pass the tests to enter the higher levels of bureaucracy.

reference_spacy_tokens: Another difference is that the vast majority of successful candidates would no doubt fail to pass the tests to enter the higher levels of bureaucracy .


fn_spacy_tokens_for_baseline: The island is aligned almost east - to - west in the water so that sunrise wakes the eastern tip , proceeds to caress the length of the island , and kisses the western tip good night .

source_bert_toks: the island is aligned almost east - to - west in the water so that sunrise wakes the eastern tip , proceeds to caress the length of the island , and kisses the western tip good night .

reference_raw: The island is almost to the east - to the west in the water, so that the dawn wakes the east end, continues to stroke the length of the island, and kisses the western tip good night.

reference_spacy_tokens: The island is almost to the east - to the west in the water , so that the dawn wakes the east end , continues to stroke the length of the island , and kisses the western tip good night .


fn_spacy_tokens_for_baseline: Winston Smith , his chin nuzzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of Victory Mansions , though not quickly enough to prevent a swirl of gritty dust from entering along with him .

source_bert_toks: winston smith , his chin nu ##zzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of victory mansions , though not quickly enough to prevent a swirl of grit ##ty dust from entering along with him .

reference_raw: Winston Smith, his chin thrust into his chest in an effort to escape the gruesome wind, slipped quickly through the window door of the Victory Mansions, but not quickly enough to prevent a swirl of gritty dust from entering with him.

reference_spacy_tokens: Winston Smith , his chin thrust into his chest in an effort to escape the gruesome wind , slipped quickly through the window door of the Victory Mansions , but not quickly enough to prevent a swirl of gritty dust from entering with him .


fn_spacy_tokens_for_baseline: I can say this with sympathy and love even though I am , as many know , entirely supportive of the ordination of women .

source_bert_toks: i can say this with sympathy and love even though i am , as many know , entirely supportive of the ordination of women .

reference_raw: I can say it with compassion and love, although, as many know, I fully support women's order.

reference_spacy_tokens: I can say it with compassion and love , although , as many know , I fully support women 's order .


fn_spacy_tokens_for_baseline: Just before serving , drizzle the soy sauce on top of the chicken and rice and garnish with the spring onions .

source_bert_toks: just before serving , dr ##iz ##zle the soy sauce on top of the chicken and rice and ga ##rn ##ish with the spring onions .

reference_raw: Just before serving, drip the soy sauce on top of the chicken and rice and paint it with spring onions.

reference_spacy_tokens: Just before serving , drip the soy sauce on top of the chicken and rice and paint it with spring onions .


fn_spacy_tokens_for_baseline: During the 1992 campaign , when Gennifer Flowers first brought Clinton 's philandering to public attention , Stephanopoulos -- as Clinton 's chief spinner , distracter , and all - around bullshit artist -- played a crucial role in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing zipper problem .

source_bert_toks: during the 1992 campaign , when gen ##ni ##fer flowers first brought clinton ' s phil ##ander ##ing to public attention , stephan ##op ##oulos - - as clinton ' s chief spin ##ner , distract ##er , and all - around bullshit artist - - played a crucial role in disc ##red ##iting flowers and anyone else who tried to point out the truth , namely that clinton had a disturbing zipper problem .

reference_raw: During the campaign of 1992, when Gennifer Flowers first brought Clinton's philandering to the public, Stephanopoulos - as Clinton's chief spinner, distracter, and all-around bullshit artist - played a crucial part in discrediting Flowers and anyone else who tried to point out the truth, namely that Clinton had a disturbing Zipper problem.

reference_spacy_tokens: During the campaign of 1992 , when Gennifer Flowers first brought Clinton 's philandering to the public , Stephanopoulos - as Clinton 's chief spinner , distracter , and all - around bullshit artist - played a crucial part in discrediting Flowers and anyone else who tried to point out the truth , namely that Clinton had a disturbing Zipper problem .


fn_spacy_tokens_for_baseline: It was like a mountain of walls and houses and streets rising out of the Vale with the river curling round its feet , lapping at the high walls .

source_bert_toks: it was like a mountain of walls and houses and streets rising out of the vale with the river curling round its feet , lap ##ping at the high walls .

reference_raw: It was like a mountain of walls, houses, and streets that rose from the valley, and the river curled around its feet and lapped on the high walls.

reference_spacy_tokens: It was like a mountain of walls , houses , and streets that rose from the valley , and the river curled around its feet and lapped on the high walls .


fn_spacy_tokens_for_baseline: The stalls and booths along Cheapside were plying a busy trade , the shouts of their keepers and the bold imprecations of the apprentices creating an unbearable din .

source_bert_toks: the stalls and booths along cheap ##side were pl ##ying a busy trade , the shouts of their keepers and the bold imp ##re ##cation ##s of the apprentice ##s creating an unbearable din .

reference_raw: The stalls and stalls along Cheapside were busy doing business, the screams of their guards, and the bold imprecisions of the apprentices that made an insufferable meal.

reference_spacy_tokens: The stalls and stalls along Cheapside were busy doing business , the screams of their guards , and the bold imprecisions of the apprentices that made an insufferable meal .


fn_spacy_tokens_for_baseline: Sleep is a natural healer of mind and body and yet many of the most common problems experienced relate to difficulties concerned with sleep .

source_bert_toks: sleep is a natural healer of mind and body and yet many of the most common problems experienced relate to difficulties concerned with sleep .

reference_raw: Sleep is a natural cure for the mind and body, and many of the most common problems encountered are related to sleep-related problems.

reference_spacy_tokens: Sleep is a natural cure for the mind and body , and many of the most common problems encountered are related to sleep - related problems .


fn_spacy_tokens_for_baseline: In the tower , five men and women pull rhythmically on ropes attached to the same five bells that first sounded here in 1614 .

source_bert_toks: in the tower , five men and women pull rhythmic ##ally on ropes attached to the same five bells that first sounded here in 161 ##4 .

reference_raw: In the tower, five men and women are hauling rhythmically on ropes attached to the same five bells that were first heard here in 1614.

reference_spacy_tokens: In the tower , five men and women are hauling rhythmically on ropes attached to the same five bells that were first heard here in 1614 .


fn_spacy_tokens_for_baseline: But by exchanging sterling for Deutschmarks and then Deutschmarks for dollars , 1 would buy $ 2.00 .

source_bert_toks: but by exchanging sterling for de ##uts ##ch ##marks and then de ##uts ##ch ##marks for dollars , 1 would buy $ 2 . 00 .

reference_raw: But if you trade sterling for Deutschmarks and then Deutschmarks for dollars, one buys $2.00.

reference_spacy_tokens: But if you trade sterling for Deutschmarks and then Deutschmarks for dollars , one buys $ 2.00 .


fn_spacy_tokens_for_baseline: I have never found the sight of a grown man in a false moustache pretending to walk into lamp - posts remotely funny , and even less amusing is the story of a miserly workaholic who could n't keep his hands off under - age girls .

source_bert_toks: i have never found the sight of a grown man in a false mo ##ust ##ache pretending to walk into lamp - posts remotely funny , and even less amusing is the story of a mis ##erly work ##ah ##olic who couldn ' t keep his hands off under - age girls .

reference_raw: I've never seen a grown man in a fake mustache who pretends to walk into lampposts remotely amusing, and even less amusing is the story of a poor workaholic who can't keep his hands off underage girls.

reference_spacy_tokens: I 've never seen a grown man in a fake mustache who pretends to walk into lampposts remotely amusing , and even less amusing is the story of a poor workaholic who ca n't keep his hands off underage girls .


fn_spacy_tokens_for_baseline: He stank of alcohol , and she hoped he was n't too drunk .

source_bert_toks: he stan ##k of alcohol , and she hoped he wasn ' t too drunk .

reference_raw: He smelled of alcohol, and she hoped he wasn't too drunk.

reference_spacy_tokens: He smelled of alcohol , and she hoped he was n't too drunk .


fn_spacy_tokens_for_baseline: Toss the pasta in the sauce and place in a warmed serving dish .

source_bert_toks: toss the pasta in the sauce and place in a warmed serving dish .

reference_raw: Toss the pasta into the sauce and place it in a warm serving bowl.

reference_spacy_tokens: Toss the pasta into the sauce and place it in a warm serving bowl .


fn_spacy_tokens_for_baseline: Over the years , the experts seem to have got in all of a lather over what we should do to cleanse our skin properly .

source_bert_toks: over the years , the experts seem to have got in all of a la ##ther over what we should do to clean ##se our skin properly .

reference_raw: Over the years, the experts seem to have gotten to the bottom of what we're supposed to do to clean our skin properly.

reference_spacy_tokens: Over the years , the experts seem to have gotten to the bottom of what we 're supposed to do to clean our skin properly .


fn_spacy_tokens_for_baseline: Edward 's ' forthright ' , breathy style lends itself naturally to blues ( Mississippi Lad or I 'm not your fool any more , also featuring Waits on vocals , and the soft and low Ballad for a Bronze Beauty ) , but less well to the rest of the album , parts of which also have an oddly out of character Brazilian flavour .

source_bert_toks: edward ' s ' forth ##right ' , breath ##y style lend ##s itself naturally to blues ( mississippi lad or i ' m not your fool any more , also featuring waits on vocals , and the soft and low ballad for a bronze beauty ) , but less well to the rest of the album , parts of which also have an oddly out of character brazilian flavour .

reference_raw: Edward's 'forthright', breathy style lends itself naturally to the blues (Missippi Lad or I'm no longer your fool, also to the performance of Waits on the vocals and the soft and low balls for the bronze beauty), but less to the rest of the album, parts of which also have an oddly uncharacteristic Brazilian taste.

reference_spacy_tokens: Edward 's ' forthright ' , breathy style lends itself naturally to the blues ( Missippi Lad or I 'm no longer your fool , also to the performance of Waits on the vocals and the soft and low balls for the bronze beauty ) , but less to the rest of the album , parts of which also have an oddly uncharacteristic Brazilian taste .


fn_spacy_tokens_for_baseline: The 1991 Amman Valley Regeneration Strategy cites opencast mining as creating ' substantial difficulties ' for both valleys ' in terms of the quality of the local environment and its blighting effect upon alternative local economic prospects ' .

source_bert_toks: the 1991 amman valley regeneration strategy cites open ##cast mining as creating ' substantial difficulties ' for both valleys ' in terms of the quality of the local environment and its b ##light ##ing effect upon alternative local economic prospects ' .

reference_raw: The 1991 Amman Valley Regeneration Strategy refers to opencast mining as creating "substantial difficulties" for both valleys in terms of the quality of the local environment and its impact on other local economic prospects.

reference_spacy_tokens: The 1991 Amman Valley Regeneration Strategy refers to opencast mining as creating " substantial difficulties " for both valleys in terms of the quality of the local environment and its impact on other local economic prospects .


fn_spacy_tokens_for_baseline: In any case , there certainly is no lack of information available about the moguls of technology now as they all become our current pop icons .

source_bert_toks: in any case , there certainly is no lack of information available about the mo ##gul ##s of technology now as they all become our current pop icons .

reference_raw: In any case, there is no lack of information on the moguls of technology now that they all become our current pop icons.

reference_spacy_tokens: In any case , there is no lack of information on the moguls of technology now that they all become our current pop icons .


fn_spacy_tokens_for_baseline: Anxiously he bethought himself how he might get her in any way at all .

source_bert_toks: anxiously he beth ##ough ##t himself how he might get her in any way at all .

reference_raw: He wondered anxiously how he could get her in any way.

reference_spacy_tokens: He wondered anxiously how he could get her in any way .


fn_spacy_tokens_for_baseline: The Barrier Gate ( Portas do Cerco ) , which was built more than a century ago , marks the boundary between the enclave of Macau and the People 's Republic of China .

source_bert_toks: the barrier gate ( port ##as do ce ##rco ) , which was built more than a century ago , marks the boundary between the enclave of macau and the people ' s republic of china .

reference_raw: The barrier gate (Portas do Cerco), built more than a century ago, is the border between Macao's enclave and the People's Republic of China.

reference_spacy_tokens: The barrier gate ( Portas do Cerco ) , built more than a century ago , is the border between Macao 's enclave and the People 's Republic of China .


fn_spacy_tokens_for_baseline: ' I know I look tired , ' Vitor said , as they set off north , ' and I feel bushed .

source_bert_toks: ' i know i look tired , ' vito ##r said , as they set off north , ' and i feel bush ##ed .

reference_raw: 'I know I look tired,' said Vitor, as they rode north, 'and I feel shrubbed.

reference_spacy_tokens: ' I know I look tired , ' said Vitor , as they rode north , ' and I feel shrubbed .


fn_spacy_tokens_for_baseline: The cult has been barricaded in a block of buildings since a shootout with federal agents on 28 February .

source_bert_toks: the cult has been barr ##ica ##ded in a block of buildings since a shootout with federal agents on 28 february .

reference_raw: Since the shooting of federal agents on February 28th, the cult has been barricaded in a block of buildings.

reference_spacy_tokens: Since the shooting of federal agents on February 28th , the cult has been barricaded in a block of buildings .


fn_spacy_tokens_for_baseline: At least 3 cats are unaccounted for , but after a search of the house , the cats were not believed to have been inside at the time the fire started .

source_bert_toks: at least 3 cats are una ##cco ##unt ##ed for , but after a search of the house , the cats were not believed to have been inside at the time the fire started .

reference_raw: At least three cats are missing, but after searching the house, it was not believed that the cats were inside when the fire began.

reference_spacy_tokens: At least three cats are missing , but after searching the house , it was not believed that the cats were inside when the fire began .


fn_spacy_tokens_for_baseline: But what is it supposed to mean .

source_bert_toks: but what is it supposed to mean .

reference_raw: But what does that mean?

reference_spacy_tokens: But what does that mean ?


fn_spacy_tokens_for_baseline: ' Futility ' is a more subtle poem which is about nature 's useless battle against man 's foolishness .

source_bert_toks: ' fu ##tility ' is a more subtle poem which is about nature ' s useless battle against man ' s foolish ##ness .

reference_raw: "Futility" is a more subtle poem about the pointless battle of nature against the folly of man.

reference_spacy_tokens: " Futility " is a more subtle poem about the pointless battle of nature against the folly of man .


fn_spacy_tokens_for_baseline: Indeed she had been sharp and perceptive about people .

source_bert_toks: indeed she had been sharp and per ##ceptive about people .

reference_raw: In fact, she was sharp and sensitive to humans.

reference_spacy_tokens: In fact , she was sharp and sensitive to humans .


fn_spacy_tokens_for_baseline: Then spring again , and with the greening of the land the creature gave birth to birds before waiting in the deepest thicket for the call of the Men who were hunting and gathering from the forest .

source_bert_toks: then spring again , and with the green ##ing of the land the creature gave birth to birds before waiting in the deepest thick ##et for the call of the men who were hunting and gathering from the forest .

reference_raw: Then spring again, and with the greening of the earth, the creature gave birth to birds before waiting in the deepest bushes for the call of the men who hunted and gathered from the forest.

reference_spacy_tokens: Then spring again , and with the greening of the earth , the creature gave birth to birds before waiting in the deepest bushes for the call of the men who hunted and gathered from the forest .


fn_spacy_tokens_for_baseline: This may be enough to alleviate the symptoms .

source_bert_toks: this may be enough to alleviate the symptoms .

reference_raw: This may be enough to relieve the symptoms.

reference_spacy_tokens: This may be enough to relieve the symptoms .


fn_spacy_tokens_for_baseline: Earlier in the day , officials in the neighboring nation of Niger denied that Kadafi or any of his sons had entered their country or that a large convoy had even crossed the border from Libya .

source_bert_toks: earlier in the day , officials in the neighboring nation of niger denied that ka ##da ##fi or any of his sons had entered their country or that a large convoy had even crossed the border from libya .

reference_raw: Earlier that day, officials in Niger's neighboring country denied that Kadafi or any of his sons had entered their country, or that a large column had even crossed the border from Libya.

reference_spacy_tokens: Earlier that day , officials in Niger 's neighboring country denied that Kadafi or any of his sons had entered their country , or that a large column had even crossed the border from Libya .


fn_spacy_tokens_for_baseline: Drumheller told the Post he was surprised when a few days later , on February 5 , 2003 , Powell told the U.N. Security Council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

source_bert_toks: drum ##hell ##er told the post he was surprised when a few days later , on february 5 , 2003 , powell told the u . n . security council that " we have first - hand descriptions of biological weapons factories on wheels and rails . "

reference_raw: Drumheller said to the Post that he was surprised when a few days later, on February 5, 2003, Powell informed the UN Security Council that "we have a first-hand account of the bioweapons factories on wheels and rails."

reference_spacy_tokens: Drumheller said to the Post that he was surprised when a few days later , on February 5 , 2003 , Powell informed the UN Security Council that " we have a first - hand account of the bioweapons factories on wheels and rails . "


fn_spacy_tokens_for_baseline: The seas were hot , volcanoes spouted ash and lava , and electrical storms crackled across the skies .

source_bert_toks: the seas were hot , volcanoes sp ##out ##ed ash and lava , and electrical storms crack ##led across the skies .

reference_raw: The seas were hot, volcanoes spewing ash and lava, and electric storms burst through the sky.

reference_spacy_tokens: The seas were hot , volcanoes spewing ash and lava , and electric storms burst through the sky .


fn_spacy_tokens_for_baseline: Add a teaspoon of salt , and a sprinkling of milled pepper .

source_bert_toks: add a tea ##sp ##oon of salt , and a sp ##rin ##kling of mill ##ed pepper .

reference_raw: Add a spoonful of salt and a sprinkle of ground pepper.

reference_spacy_tokens: Add a spoonful of salt and a sprinkle of ground pepper .


fn_spacy_tokens_for_baseline: Just as I can rise above my baser instincts , so this is possible with the dog .

source_bert_toks: just as i can rise above my base ##r instincts , so this is possible with the dog .

reference_raw: Just like I can rise above my basic instincts, so it's possible with a dog.

reference_spacy_tokens: Just like I can rise above my basic instincts , so it 's possible with a dog .


fn_spacy_tokens_for_baseline: From her navel to the base of her spine she had been ripped apart .

source_bert_toks: from her nave ##l to the base of her spine she had been ripped apart .

reference_raw: She was torn to pieces from her navel to the bottom of her spine.

reference_spacy_tokens: She was torn to pieces from her navel to the bottom of her spine .


fn_spacy_tokens_for_baseline: In the simplest experiment the total emission is monitored as a function of excitation frequency , giving an excitation spectrum .

source_bert_toks: in the simplest experiment the total emission is monitored as a function of ex ##cit ##ation frequency , giving an ex ##cit ##ation spectrum .

reference_raw: In the simplest test, total emissions are monitored as a function of the excitation frequency, giving the excitation spectrum.

reference_spacy_tokens: In the simplest test , total emissions are monitored as a function of the excitation frequency , giving the excitation spectrum .


fn_spacy_tokens_for_baseline: Please use the enclosed response card and envelope to give generously to Goodwill today .

source_bert_toks: please use the enclosed response card and envelope to give generous ##ly to goodwill today .

reference_raw: Please use the attached response card and envelope to give Goodwill a generous hand today.

reference_spacy_tokens: Please use the attached response card and envelope to give Goodwill a generous hand today .


fn_spacy_tokens_for_baseline: Resisting making myself bankrupt , he nearly said , by not buying a gold locket I coveted for you -- delicate -- beautiful -- too bloody expensive .

source_bert_toks: resisting making myself bankrupt , he nearly said , by not buying a gold locke ##t i coveted for you - - delicate - - beautiful - - too bloody expensive .

reference_raw: He resisted being bankrupt, he almost said, by not buying the gold medallion I longed for you - delicate - beautiful - too damn expensive.

reference_spacy_tokens: He resisted being bankrupt , he almost said , by not buying the gold medallion I longed for you - delicate - beautiful - too damn expensive .


fn_spacy_tokens_for_baseline: Low tide is the best time to see birds from a boat -- and low tide , especially the very low tide of early spring , is the best time to get stuck on a sandbank !

source_bert_toks: low tide is the best time to see birds from a boat - - and low tide , especially the very low tide of early spring , is the best time to get stuck on a sand ##bank !

reference_raw: The low tide is the best time to see the birds off the ship - and the low tide, especially the very low tide of early spring, is the best time to get stuck on the sand bank!

reference_spacy_tokens: The low tide is the best time to see the birds off the ship - and the low tide , especially the very low tide of early spring , is the best time to get stuck on the sand bank !


fn_spacy_tokens_for_baseline: Though she encouraged the princess to keep a journal , she never kept one herself , thinking it inappropriate to her position .

source_bert_toks: though she encouraged the princess to keep a journal , she never kept one herself , thinking it inappropriate to her position .

reference_raw: Although she had encouraged the princess to keep a diary, she had never kept it herself, and she thought it was unsuitable for her position.

reference_spacy_tokens: Although she had encouraged the princess to keep a diary , she had never kept it herself , and she thought it was unsuitable for her position .


fn_spacy_tokens_for_baseline: Outside the terminal , you will find taxis as well as buses to all points ( take 3 , 3A , 10 , or 10A to the historic center ; exact change is required ) .

source_bert_toks: outside the terminal , you will find taxis as well as buses to all points ( take 3 , 3a , 10 , or 10 ##a to the historic center ; exact change is required ) .

reference_raw: Outside the terminal, taxis and buses can be found at all locations (take 3, 3A, 10 or 10A to the historical centre; precise change is required).

reference_spacy_tokens: Outside the terminal , taxis and buses can be found at all locations ( take 3 , 3A , 10 or 10A to the historical centre ; precise change is required ) .


fn_spacy_tokens_for_baseline: He is champion of the sceptics , and he sallies forth with his banners flying .

source_bert_toks: he is champion of the sc ##ept ##ics , and he sal ##lies forth with his banners flying .

reference_raw: He's a skeptical champion, and he's coming out with his flags flying.

reference_spacy_tokens: He 's a skeptical champion , and he 's coming out with his flags flying .


fn_spacy_tokens_for_baseline: He shook his head and clucked to himself like the White Rabbit in Alice .

source_bert_toks: he shook his head and cl ##uck ##ed to himself like the white rabbit in alice .

reference_raw: He shook his head and hugged himself like a white rabbit in Alice.

reference_spacy_tokens: He shook his head and hugged himself like a white rabbit in Alice .


fn_spacy_tokens_for_baseline: Your planning diary and your weekly timetable are simply management tools -- they work for you , not the other way round .

source_bert_toks: your planning diary and your weekly timetable are simply management tools - - they work for you , not the other way round .

reference_raw: Your schedule and your weekly schedule are just management tools - they work for you, not the other way around.

reference_spacy_tokens: Your schedule and your weekly schedule are just management tools - they work for you , not the other way around .


fn_spacy_tokens_for_baseline: There remained one category of great natural calamities that , because of its scale and random impact , still seemed to be the work of a wrathful deity .

source_bert_toks: there remained one category of great natural cal ##ami ##ties that , because of its scale and random impact , still seemed to be the work of a wrath ##ful deity .

reference_raw: There was still one category of great natural disasters, which, because of their scale and random impact, still seemed to be the work of an angry deity.

reference_spacy_tokens: There was still one category of great natural disasters , which , because of their scale and random impact , still seemed to be the work of an angry deity .


fn_spacy_tokens_for_baseline: Do you want me to pay Pasadena on Friday for these months or do you want me to hold off until I finish July and August ?

source_bert_toks: do you want me to pay pasadena on friday for these months or do you want me to hold off until i finish july and august ?

reference_raw: Should I pay Pasadena for these months on Friday, or should I wait till the end of July and August?

reference_spacy_tokens: Should I pay Pasadena for these months on Friday , or should I wait till the end of July and August ?


fn_spacy_tokens_for_baseline: The legend of the fox that traps birds by pretending to be dead has been depicted for centuries .

source_bert_toks: the legend of the fox that traps birds by pretending to be dead has been depicted for centuries .

reference_raw: The legend of a fox that traps birds by pretending to be dead has been described for centuries.

reference_spacy_tokens: The legend of a fox that traps birds by pretending to be dead has been described for centuries .


fn_spacy_tokens_for_baseline: As he went into his box Wayne was still pawing his belly .

source_bert_toks: as he went into his box wayne was still paw ##ing his belly .

reference_raw: Wayne was still clutching at his stomach when he entered the box.

reference_spacy_tokens: Wayne was still clutching at his stomach when he entered the box .


fn_spacy_tokens_for_baseline: Ethiopia 's civil servants fume about losing their jobs .

source_bert_toks: ethiopia ' s civil servants fu ##me about losing their jobs .

reference_raw: The officials of Ethiopia were furious about losing their jobs.

reference_spacy_tokens: The officials of Ethiopia were furious about losing their jobs .


fn_spacy_tokens_for_baseline: Gallagher hammered him again and again .

source_bert_toks: gallagher hammered him again and again .

reference_raw: Gallagher beat him over and over.

reference_spacy_tokens: Gallagher beat him over and over .


fn_spacy_tokens_for_baseline: The baby gurgled and smiled and Ruth 's heart tore in two .

source_bert_toks: the baby gu ##rg ##led and smiled and ruth ' s heart tore in two .

reference_raw: The child grunted and smiled, and Ruth's heart split in two.

reference_spacy_tokens: The child grunted and smiled , and Ruth 's heart split in two .


fn_spacy_tokens_for_baseline: Ranulf agreed and , with the inebriated porter on one hand and a lantern horn in the other , went out into the darkness .

source_bert_toks: ran ##ulf agreed and , with the in ##eb ##riated porter on one hand and a lantern horn in the other , went out into the darkness .

reference_raw: Ranulf agreed and stepped out into the darkness with a drunken porter on one side and a lantern horn on the other.

reference_spacy_tokens: Ranulf agreed and stepped out into the darkness with a drunken porter on one side and a lantern horn on the other .