fn_spacy_tokens_for_baseline: Did your uncle George sneeze ?

source_bert_toks: did your uncle george s ##nee ##ze ?

reference_raw: Didn't your great-uncle George sneeze?

reference_spacy_tokens: Did n't your great - uncle George sneeze ?


fn_spacy_tokens_for_baseline: Then he sat in the grass , brought his wrists up under his knees , kicked off his shoes and worked his legs through his locked arms , one after the other .

source_bert_toks: then he sat in the grass , brought his wrists up under his knees , kicked off his shoes and worked his legs through his locked arms , one after the other .

reference_raw: Then he sat down on the grass, lifted his wrists under his knees, jerked off his boots, and worked his feet through his locked arms, one by one.

reference_spacy_tokens: Then he sat down on the grass , lifted his wrists under his knees , jerked off his boots , and worked his feet through his locked arms , one by one .


fn_spacy_tokens_for_baseline: Additionally , the insufficiency of the existing electrical infrastructure and dwindling oil revenues contributed to the withdrawal of foreign suppliers from Iran and the abandonment of nuclear power agreements .

source_bert_toks: additionally , the ins ##uf ##fi ##ciency of the existing electrical infrastructure and d ##wind ##ling oil revenues contributed to the withdrawal of foreign suppliers from iran and the abandonment of nuclear power agreements .

reference_raw: In addition, the lack of existing electricity infrastructure and the decline in oil revenues contributed to the withdrawal of foreign contractors from Iran and the abandonment of nuclear power agreements.

reference_spacy_tokens: In addition , the lack of existing electricity infrastructure and the decline in oil revenues contributed to the withdrawal of foreign contractors from Iran and the abandonment of nuclear power agreements .


fn_spacy_tokens_for_baseline: It far exceeds its author 's jurisdiction , since it contravenes fundamental principles of Islamic law .

source_bert_toks: it far exceeds its author ' s jurisdiction , since it contra ##ven ##es fundamental principles of islamic law .

reference_raw: It goes far beyond the jurisdiction of its author, because it violates the fundamental principles of Islamic law.

reference_spacy_tokens: It goes far beyond the jurisdiction of its author , because it violates the fundamental principles of Islamic law .


fn_spacy_tokens_for_baseline: U.S. intelligence agencies assess that barring acquisition of a complete system or major subsystem from North Korea , Iran is unlikely to launch an ICBM or satellite launch vehicle ( SLV ) before mid - decade .

source_bert_toks: u . s . intelligence agencies assess that barr ##ing acquisition of a complete system or major sub ##sy ##ste ##m from north korea , iran is unlikely to launch an ic ##bm or satellite launch vehicle ( sl ##v ) before mid - decade .

reference_raw: U.S. intelligence agencies have assessed that it is not likely that Iran will launch an ICBM or satellite launch vehicle (SLV) by mid-ten years to prevent the acquisition of a complete system or major subsystem from North Korea.

reference_spacy_tokens: U.S. intelligence agencies have assessed that it is not likely that Iran will launch an ICBM or satellite launch vehicle ( SLV ) by mid - ten years to prevent the acquisition of a complete system or major subsystem from North Korea .


fn_spacy_tokens_for_baseline: The only way to catch an electronic thief , he said , is to set him up with erroneous information .

source_bert_toks: the only way to catch an electronic thief , he said , is to set him up with er ##rone ##ous information .

reference_raw: He said the only way to catch an electronic thief is to set him up with misinformation.

reference_spacy_tokens: He said the only way to catch an electronic thief is to set him up with misinformation .


fn_spacy_tokens_for_baseline: Nero also made his proclamation in the stadium at Isthmia in a deliberate evocation of Flamininus , and adopted a bearded portrait at about this time .

source_bert_toks: nero also made his proclamation in the stadium at ist ##hmi ##a in a deliberate ev ##ocation of fl ##ami ##nin ##us , and adopted a bearded portrait at about this time .

reference_raw: Nero had also made a statement at the stadium in Isthmia in the deliberate evocation of Flamininus, and had adopted a bearded portrait about this time.

reference_spacy_tokens: Nero had also made a statement at the stadium in Isthmia in the deliberate evocation of Flamininus , and had adopted a bearded portrait about this time .


fn_spacy_tokens_for_baseline: It was one of those pictures which are so contrived that the eyes follow you about when you move .

source_bert_toks: it was one of those pictures which are so con ##tri ##ved that the eyes follow you about when you move .

reference_raw: It was one of those pictures that were so twisted that the eyes followed you around when you moved.

reference_spacy_tokens: It was one of those pictures that were so twisted that the eyes followed you around when you moved .


fn_spacy_tokens_for_baseline: In 1973 the City of London Polytechnic obtained CNAA approval for its modular degree , beginning with fifteen subjects and a first year in which students reappraised their objectives and had guidance and counselling available .

source_bert_toks: in 1973 the city of london polytechnic obtained cn ##aa approval for its modular degree , beginning with fifteen subjects and a first year in which students re ##app ##rai ##sed their objectives and had guidance and counsel ##ling available .

reference_raw: In 1973, the City of London Polytechnic received CNAA approval for its modular degree, starting with 15 subjects and the first year in which students re-appraised their goals and provided advice and advice.

reference_spacy_tokens: In 1973 , the City of London Polytechnic received CNAA approval for its modular degree , starting with 15 subjects and the first year in which students re - appraised their goals and provided advice and advice .


fn_spacy_tokens_for_baseline: And I tell you here and now , I find this whole idea utterly revolting . '

source_bert_toks: and i tell you here and now , i find this whole idea utterly revolt ##ing . '

reference_raw: And I'm telling you, here and now, I find the whole idea utterly outrageous.'

reference_spacy_tokens: And I 'm telling you , here and now , I find the whole idea utterly outrageous . '


fn_spacy_tokens_for_baseline: We trooped round a number of venture capital funds and discussed the options .

source_bert_toks: we troop ##ed round a number of venture capital funds and discussed the options .

reference_raw: We marched around several venture capital funds and discussed options.

reference_spacy_tokens: We marched around several venture capital funds and discussed options .


fn_spacy_tokens_for_baseline: The next one was the Castle ford , so named because it lay directly under the castle rock , although almost two hundred feet below .

source_bert_toks: the next one was the castle ford , so named because it lay directly under the castle rock , although almost two hundred feet below .

reference_raw: Another was the Castle Ford, so named, for it lay directly beneath the stone of the castle, though almost two hundred feet below it.

reference_spacy_tokens: Another was the Castle Ford , so named , for it lay directly beneath the stone of the castle , though almost two hundred feet below it .


fn_spacy_tokens_for_baseline: She turned , heart pounding , head spinning with the unjustness of his whole attitude , and marched back towards the house , oblivious of everything except her need to get away from that detestable man .

source_bert_toks: she turned , heart pounding , head spinning with the un ##just ##ness of his whole attitude , and marched back towards the house , oblivious of everything except her need to get away from that det ##est ##able man .

reference_raw: She turned, her heart pounding, her head spinning with the unjustness of his attitude, and marched back to the house, ignoring everything but the need to get away from the despicable man.

reference_spacy_tokens: She turned , her heart pounding , her head spinning with the unjustness of his attitude , and marched back to the house , ignoring everything but the need to get away from the despicable man .


fn_spacy_tokens_for_baseline: Spend five or ten minutes glancing through the book .

source_bert_toks: spend five or ten minutes glancing through the book .

reference_raw: I spent five or ten minutes looking through the book.

reference_spacy_tokens: I spent five or ten minutes looking through the book .


fn_spacy_tokens_for_baseline: The Words are n't worth one fraction of a second of sadness for a daughter of mine :

source_bert_toks: the words aren ' t worth one fraction of a second of sadness for a daughter of mine :

reference_raw: Words are not worth a fraction of a second of mourning for my little girl:

reference_spacy_tokens: Words are not worth a fraction of a second of mourning for my little girl :


fn_spacy_tokens_for_baseline: If a man starts droning on about whether I 'm sisterly enough or not , I start talking about my hopes of marrying a rich , masterful husband and learning to cook Baked Alaska .

source_bert_toks: if a man starts dr ##oning on about whether i ' m sister ##ly enough or not , i start talking about my hopes of marrying a rich , master ##ful husband and learning to cook baked alaska .

reference_raw: When a man starts to wonder if I'm sisterly enough or not, I start talking about my hopes of marrying a rich, masterful husband and learning how to cook a baked Alaska.

reference_spacy_tokens: When a man starts to wonder if I 'm sisterly enough or not , I start talking about my hopes of marrying a rich , masterful husband and learning how to cook a baked Alaska .


fn_spacy_tokens_for_baseline: As the details of the US involvement are revealed , the administration is coming under fire from normally dovish Democrats on Capitol Hill for not acting swiftly and decisively enough to take advantage of the opportunity to end General Noriega 's rule .

source_bert_toks: as the details of the us involvement are revealed , the administration is coming under fire from normally do ##vish democrats on capitol hill for not acting swiftly and decisive ##ly enough to take advantage of the opportunity to end general nor ##ieg ##a ' s rule .

reference_raw: As the details of U.S. involvement are uncovered, the government is under fire from the normally dovish Democrats on Capitol Hill for not acting quickly and decisively enough to seize the opportunity to put an end to General Noriega's reign.

reference_spacy_tokens: As the details of U.S. involvement are uncovered , the government is under fire from the normally dovish Democrats on Capitol Hill for not acting quickly and decisively enough to seize the opportunity to put an end to General Noriega 's reign .


fn_spacy_tokens_for_baseline: ' One day , ' Cranston grated , ' I 'll see that bastard hang ! '

source_bert_toks: ' one day , ' cr ##ans ##ton gr ##ated , ' i ' ll see that bastard hang ! '

reference_raw: 'Someday,' said Cranston, 'I'll see the bastard hang!'

reference_spacy_tokens: ' Someday , ' said Cranston , ' I 'll see the bastard hang ! '


fn_spacy_tokens_for_baseline: European sales jumped by 18 per cent to just over £ 3billion for the quarter , and on a similar rise the enlarged US activities passed £ 1billion , the global total moving above £ 5 billion .

source_bert_toks: european sales jumped by 18 per cent to just over £3 ##bill ##ion for the quarter , and on a similar rise the enlarged us activities passed £1 ##bill ##ion , the global total moving above £5 billion .

reference_raw: European sales have increased by 18% to just over £3 billion in a quarter, and in a similar increase, enlarged US activities have passed £1 billion, totalling more than £5 billion.

reference_spacy_tokens: European sales have increased by 18 % to just over £ 3 billion in a quarter , and in a similar increase , enlarged US activities have passed £ 1 billion , totalling more than £ 5 billion .


fn_spacy_tokens_for_baseline: Juliette started violently and several cups toppled to the floor and smashed to pieces .

source_bert_toks: juliette started violently and several cups toppled to the floor and smashed to pieces .

reference_raw: Juliette began to move violently, and several cups fell to the floor and fell to pieces.

reference_spacy_tokens: Juliette began to move violently , and several cups fell to the floor and fell to pieces .


fn_spacy_tokens_for_baseline: In 1973 , Arab guerrillas hijacked a West German airliner , leading to 31 deaths .

source_bert_toks: in 1973 , arab guerrillas hi ##jack ##ed a west german airline ##r , leading to 31 deaths .

reference_raw: In 1973, Arab guerrillas abducted a West German airliner, leading to 31 deaths.

reference_spacy_tokens: In 1973 , Arab guerrillas abducted a West German airliner , leading to 31 deaths .


fn_spacy_tokens_for_baseline: The newspaper said al - Mitairi 's execution was delayed until the victim 's heirs reached the age of 18 so they could decide whether or not to grant clemency .

source_bert_toks: the newspaper said al - mit ##air ##i ' s execution was delayed until the victim ' s heirs reached the age of 18 so they could decide whether or not to grant cl ##eme ##ncy .

reference_raw: According to the newspapers, the execution of Al-Mitairi was postponed until the heirs of the victim reached the age of 18, so that they could decide whether or not to grant mercy.

reference_spacy_tokens: According to the newspapers , the execution of Al - Mitairi was postponed until the heirs of the victim reached the age of 18 , so that they could decide whether or not to grant mercy .


fn_spacy_tokens_for_baseline: They also stated that his kind regard for his employees was unique in the entertainment world .

source_bert_toks: they also stated that his kind regard for his employees was unique in the entertainment world .

reference_raw: They also said that his respect for his staff was unique in the entertainment world.

reference_spacy_tokens: They also said that his respect for his staff was unique in the entertainment world .


fn_spacy_tokens_for_baseline: In four there was persistence of symptoms and endoscopic evidence of failure of ulcer healing despite three months of treatment with 300 mg ranitidine a day .

source_bert_toks: in four there was persistence of symptoms and end ##os ##copic evidence of failure of ul ##cer healing despite three months of treatment with 300 mg rani ##ti ##dine a day .

reference_raw: Four patients experienced persistent symptoms and endoscopic evidence of failure of ulcer healing despite three months of treatment with 300 mg ranitidine per day.

reference_spacy_tokens: Four patients experienced persistent symptoms and endoscopic evidence of failure of ulcer healing despite three months of treatment with 300 mg ranitidine per day .


fn_spacy_tokens_for_baseline: The saliva dries and hardens quickly and with repeated flights , the bird slowly builds up the line into a low wall .

source_bert_toks: the saliva dr ##ies and harden ##s quickly and with repeated flights , the bird slowly builds up the line into a low wall .

reference_raw: The saliva dries and stiffens rapidly and with repeated flights, the bird slowly builds the line into a low wall.

reference_spacy_tokens: The saliva dries and stiffens rapidly and with repeated flights , the bird slowly builds the line into a low wall .


fn_spacy_tokens_for_baseline: The desk clerk saw nothing unusual about Kragan ; he was just another businessman in a dark suit with a Liberty 's all - wool overcoat draped over his shoulders .

source_bert_toks: the desk clerk saw nothing unusual about k ##ragan ; he was just another businessman in a dark suit with a liberty ' s all - wool over ##coat draped over his shoulders .

reference_raw: The receptionist didn't see anything unusual about Kragan; he was just another businessman in a dark dress with Liberty's wool overcoat draped over his shoulders.

reference_spacy_tokens: The receptionist did n't see anything unusual about Kragan ; he was just another businessman in a dark dress with Liberty 's wool overcoat draped over his shoulders .


fn_spacy_tokens_for_baseline: Studios sleep 2 or 3 .

source_bert_toks: studios sleep 2 or 3 .

reference_raw: Study sleeps two or three.

reference_spacy_tokens: Study sleeps two or three .


fn_spacy_tokens_for_baseline: I stumbled around a while then finally located the car .

source_bert_toks: i stumbled around a while then finally located the car .

reference_raw: I stumbled for a moment, then finally found the car.

reference_spacy_tokens: I stumbled for a moment , then finally found the car .


fn_spacy_tokens_for_baseline: All were rooted in the nineteenth - century stance of the artist as critical outsider , disdainful of the niceties of the bourgeoisie .

source_bert_toks: all were rooted in the nineteenth - century stance of the artist as critical outsider , disdain ##ful of the nice ##ties of the bourgeois ##ie .

reference_raw: They were all rooted in a nineteenth-century artist's attitude as a critical stranger, contemptuous of the beauty of the bourgeoisie.

reference_spacy_tokens: They were all rooted in a nineteenth - century artist 's attitude as a critical stranger , contemptuous of the beauty of the bourgeoisie .


fn_spacy_tokens_for_baseline: exercise tends to be a a topic that i guess i 've never developed any will power to maintain any regular program i uh

source_bert_toks: exercise tends to be a a topic that i guess i ' ve never developed any will power to maintain any regular program i uh

reference_raw: Experiment is usually a topic that I think I've never developed the willpower to maintain a regular program iuh

reference_spacy_tokens: Experiment is usually a topic that I think I 've never developed the willpower to maintain a regular program iuh


fn_spacy_tokens_for_baseline: But from a pragmatic point of view one of the main motives would have been the desire to plant churches which were capable of reproducing themselves .

source_bert_toks: but from a pr ##ag ##matic point of view one of the main motives would have been the desire to plant churches which were capable of rep ##rod ##uc ##ing themselves .

reference_raw: From a pragmatic point of view, however, one of the main motives would be the desire to grow churches that could reproduce themselves.

reference_spacy_tokens: From a pragmatic point of view , however , one of the main motives would be the desire to grow churches that could reproduce themselves .


fn_spacy_tokens_for_baseline: Keynesians see monetary policy , therefore , as merely one part of a much larger package of policies .

source_bert_toks: keynes ##ians see monetary policy , therefore , as merely one part of a much larger package of policies .

reference_raw: As a result, Keynesians see monetary policy as just one part of a much larger set of policies.

reference_spacy_tokens: As a result , Keynesians see monetary policy as just one part of a much larger set of policies .


fn_spacy_tokens_for_baseline: More often than not it was the ' depraved ' , sexualized and socially inferior female prostitute who was seen to condense these aspects of male fantasy .

source_bert_toks: more often than not it was the ' de ##pr ##ave ##d ' , sexual ##ized and socially inferior female prostitute who was seen to conde ##nse these aspects of male fantasy .

reference_raw: More often than not, it was a "depraved", sexualized and socially subservient female prostitute who was seen condensing these aspects of male imagination.

reference_spacy_tokens: More often than not , it was a " depraved " , sexualized and socially subservient female prostitute who was seen condensing these aspects of male imagination .


fn_spacy_tokens_for_baseline: But Fimbra 's rigid policing style has alienated many of the firms which have passed the test of being responsible , well - conducted businesses .

source_bert_toks: but fi ##mb ##ra ' s rigid policing style has alien ##ated many of the firms which have passed the test of being responsible , well - conducted businesses .

reference_raw: But Fimbra's rigid police style has alienated many companies that have passed the criterion of responsible and well-conducted enterprises.

reference_spacy_tokens: But Fimbra 's rigid police style has alienated many companies that have passed the criterion of responsible and well - conducted enterprises .


fn_spacy_tokens_for_baseline: This small formerly residential island , beautifully shaded by banyan trees , was the home of the closed community of the foreign colony in the era of " concessions . "

source_bert_toks: this small formerly residential island , beautifully shaded by ban ##yan trees , was the home of the closed community of the foreign colony in the era of " concessions . "

reference_raw: This small, formerly residential island, beautifully shadowed by the banyan trees, was the home of a closed society of a foreign colony in the era of "concessions."

reference_spacy_tokens: This small , formerly residential island , beautifully shadowed by the banyan trees , was the home of a closed society of a foreign colony in the era of " concessions . "


fn_spacy_tokens_for_baseline: Los Angeles Mayor Antonio Villaraigosa expressed concerns that Los Angeles was on the verge of a blackout , and California Governor Arnold Schwarzenegger has declared the situation a state of emergency .

source_bert_toks: los angeles mayor antonio villa ##rai ##gos ##a expressed concerns that los angeles was on the verge of a blackout , and california governor arnold schwarz ##ene ##gger has declared the situation a state of emergency .

reference_raw: Mayor Antonio Villaraigosa of Los Angeles has expressed concern that Los Angeles is on the verge of a blackout, and California Governor Arnold Schwarzenegger has declared the situation an emergency.

reference_spacy_tokens: Mayor Antonio Villaraigosa of Los Angeles has expressed concern that Los Angeles is on the verge of a blackout , and California Governor Arnold Schwarzenegger has declared the situation an emergency .


fn_spacy_tokens_for_baseline: Drivers exceeding the speed limit will be reported to site management and may be barred from driving on the site and may be subject to disciplinary action .

source_bert_toks: drivers exceeding the speed limit will be reported to site management and may be barred from driving on the site and may be subject to disciplinary action .

reference_raw: Drivers who exceed the rate limit shall be notified to the management of the site and may be prevented from driving on the ground and may be subject to disciplinary action.

reference_spacy_tokens: Drivers who exceed the rate limit shall be notified to the management of the site and may be prevented from driving on the ground and may be subject to disciplinary action .


fn_spacy_tokens_for_baseline: Signalled by changes in the weather , great herds of these deer follow ancestral migration routes to sheltered valleys and more ample food supplies .

source_bert_toks: signal ##led by changes in the weather , great herds of these deer follow ancestral migration routes to sheltered valleys and more ample food supplies .

reference_raw: Signaled by the changes in the weather, large flocks of these deer follow the ancestral migration routes to the sheltered valleys and a greater supply of food.

reference_spacy_tokens: Signaled by the changes in the weather , large flocks of these deer follow the ancestral migration routes to the sheltered valleys and a greater supply of food .


fn_spacy_tokens_for_baseline: Finally , the Bushehr nuclear reactor , when completed , will be Iran 's first nuclear power plant when it goes on - line in the coming year .

source_bert_toks: finally , the bush ##eh ##r nuclear reactor , when completed , will be iran ' s first nuclear power plant when it goes on - line in the coming year .

reference_raw: Finally, at the end of the year, the Bushehr nuclear reactor will be the first nuclear power plant in Iran if it continues-line.

reference_spacy_tokens: Finally , at the end of the year , the Bushehr nuclear reactor will be the first nuclear power plant in Iran if it continues - line .


fn_spacy_tokens_for_baseline: Iran does have technological sophistication in the biopharmaceutical industries and produces a variety of vaccines for humans and livestock .

source_bert_toks: iran does have technological so ##phi ##stic ##ation in the bio ##pha ##rma ##ce ##uti ##cal industries and produces a variety of vaccines for humans and livestock .

reference_raw: Iran is technologically sophisticated in the biopharmaceutical sector and produces various human and animal vaccines.

reference_spacy_tokens: Iran is technologically sophisticated in the biopharmaceutical sector and produces various human and animal vaccines .


fn_spacy_tokens_for_baseline: The fabric back of the tie was neatly re - fastened with strips of insulating tape , to enable easy servicing and adjustment of the preset .

source_bert_toks: the fabric back of the tie was neatly re - fastened with strips of ins ##ulating tape , to enable easy servicing and adjustment of the pre ##set .

reference_raw: The cloth back of the tie was neatly reassembled with strips of insulating tape, so that the preset could be easily serviced and adjusted.

reference_spacy_tokens: The cloth back of the tie was neatly reassembled with strips of insulating tape , so that the preset could be easily serviced and adjusted .


fn_spacy_tokens_for_baseline: With names in dictionaries , the criteria for inclusion and the criteria for explanation are inextricably interdependent .

source_bert_toks: with names in di ##ction ##aries , the criteria for inclusion and the criteria for explanation are in ##ex ##tric ##ably inter ##de ##pen ##dent .

reference_raw: In the case of titles in dictionaries, the inclusion criteria and the explanation criteria are inextricably linked.

reference_spacy_tokens: In the case of titles in dictionaries , the inclusion criteria and the explanation criteria are inextricably linked .


fn_spacy_tokens_for_baseline: Eating the cake , he had felt it like tasteless dough in his mouth , every mouthful an act of shared indecency .

source_bert_toks: eating the cake , he had felt it like taste ##less dough in his mouth , every mouthful an act of shared ind ##ece ##ncy .

reference_raw: He ate the cake and felt it in his mouth like a tasty dough, every mouthful an act of shared indecency.

reference_spacy_tokens: He ate the cake and felt it in his mouth like a tasty dough , every mouthful an act of shared indecency .


fn_spacy_tokens_for_baseline: The Falangist chief , Jose Antonio Primo de Rivera , had been imprisoned in March and by August was under close guard in a Republican jail in Alicante .

source_bert_toks: the fa ##lang ##ist chief , jose antonio pri ##mo de rivera , had been imprisoned in march and by august was under close guard in a republican jail in ali ##can ##te .

reference_raw: The Falangist chief, José Antonio Primo de Rivera, was arrested in March and was under close surveillance in the Republican prison in Alicante in August.

reference_spacy_tokens: The Falangist chief , Jose Antonio Primo de Rivera , was arrested in March and was under close surveillance in the Republican prison in Alicante in August .


fn_spacy_tokens_for_baseline: ' You 'll perish from the cold ' , an Irish friend said .

source_bert_toks: ' you ' ll per ##ish from the cold ' , an irish friend said .

reference_raw: 'You will die of cold,' said an Irish friend.

reference_spacy_tokens: ' You will die of cold , ' said an Irish friend .


fn_spacy_tokens_for_baseline: Wherever possible , work culturally relevant conversations into the drills .

source_bert_toks: wherever possible , work culturally relevant conversations into the drills .

reference_raw: As far as possible, engage in culture-relevant conversations in the exercises.

reference_spacy_tokens: As far as possible , engage in culture - relevant conversations in the exercises .


fn_spacy_tokens_for_baseline: The highest price of £ 14,059 was bid by a Taiwan dealer for two 12 in - high wine beakers decorated with feathers ( estimate £ 1,500 to £ 2,000 ) , the ceramic decanters of the pre - refrigeration age .

source_bert_toks: the highest price of £1 ##4 , 05 ##9 was bid by a taiwan dealer for two 12 in - high wine beak ##ers decorated with feathers ( estimate £1 , 500 to £2 , 000 ) , the ceramic dec ##ante ##rs of the pre - ref ##ri ##ger ##ation age .

reference_raw: The highest price of £14,059 was offered by a Taiwanese dealer for two 12 high-grade wine beakers decorated with feathers (estimated at £1,500 to £2,000), ceramic decants of a pre-refrigeration age.

reference_spacy_tokens: The highest price of £ 14,059 was offered by a Taiwanese dealer for two 12 high - grade wine beakers decorated with feathers ( estimated at £ 1,500 to £ 2,000 ) , ceramic decants of a pre - refrigeration age .


fn_spacy_tokens_for_baseline: The light - coloured car with the suspicious package taped between the front wheels was last spotted leaving the car park of Lisnagelvin swimming pool in the Waterside at 7.10pm last night .

source_bert_toks: the light - coloured car with the suspicious package taped between the front wheels was last spotted leaving the car park of li ##s ##nage ##l ##vin swimming pool in the waters ##ide at 7 . 10 ##pm last night .

reference_raw: A light-coloured car with a suspicious package caught between the front wheels was last seen leaving Lisnagelvin's swimming pool at 7:10 last night.

reference_spacy_tokens: A light - coloured car with a suspicious package caught between the front wheels was last seen leaving Lisnagelvin 's swimming pool at 7:10 last night .


fn_spacy_tokens_for_baseline: He draped tinsel round the pink lampshades on the table .

source_bert_toks: he draped tin ##sel round the pink lamps ##had ##es on the table .

reference_raw: He wrapped the tinsel around the pink lampshades on the table.

reference_spacy_tokens: He wrapped the tinsel around the pink lampshades on the table .


fn_spacy_tokens_for_baseline: Bruce , forever wavering , had muted his criticisms and been allowed by Edward to continue as joint Guardian after Wallace 's execution ; but old ambitions began to stir once more .

source_bert_toks: bruce , forever wave ##ring , had muted his criticisms and been allowed by edward to continue as joint guardian after wallace ' s execution ; but old ambitions began to stir once more .

reference_raw: Bruce, wavering forever, suppressed his criticism, and Edward allowed himself to continue as a common guardian after Wallace had been executed; but his old ambitions began to stir again.

reference_spacy_tokens: Bruce , wavering forever , suppressed his criticism , and Edward allowed himself to continue as a common guardian after Wallace had been executed ; but his old ambitions began to stir again .


fn_spacy_tokens_for_baseline: It seems that the use of such powers to obtain compulsory response to interrogation gradually faded away , and in practice were replaced by a caution , well before the caution became mandatory in 1848 .

source_bert_toks: it seems that the use of such powers to obtain compulsory response to interrogation gradually faded away , and in practice were replaced by a caution , well before the caution became mandatory in 1848 .

reference_raw: The use of such powers in order to obtain a compulsory response to questioning seems to have gradually faded and, in practice, was replaced by caution, well before caution became compulsory in 1848.

reference_spacy_tokens: The use of such powers in order to obtain a compulsory response to questioning seems to have gradually faded and , in practice , was replaced by caution , well before caution became compulsory in 1848 .


fn_spacy_tokens_for_baseline: The old man jumped from his seat and ran into the foyer of the hotel .

source_bert_toks: the old man jumped from his seat and ran into the foyer of the hotel .

reference_raw: The old man jumped out of his chair and ran into the lobby of the hotel.

reference_spacy_tokens: The old man jumped out of his chair and ran into the lobby of the hotel .


fn_spacy_tokens_for_baseline: While Pamella flung a few things in a suitcase and scrambled off to Bali tout de suite , Fleet Street fanned out to play cherchez la femme .

source_bert_toks: while pam ##ella flung a few things in a suitcase and scrambled off to bali to ##ut de suite , fleet street fan ##ned out to play cher ##che ##z la femme .

reference_raw: While Pamella tossed some things into the trunk and climbed into the Bali Tout de suite, Fleet Street fanned out to play cherchez la femme.

reference_spacy_tokens: While Pamella tossed some things into the trunk and climbed into the Bali Tout de suite , Fleet Street fanned out to play cherchez la femme .


fn_spacy_tokens_for_baseline: Then , after two young brothers drowned fording a Chiayi stream on their way to school in 1971 , Ho formed the Chiayi Philanthropic Works Corps to build bridges .

source_bert_toks: then , after two young brothers drowned ford ##ing a chi ##ay ##i stream on their way to school in 1971 , ho formed the chi ##ay ##i philanthropic works corps to build bridges .

reference_raw: Then, in 1971, after two young brothers drowned forging a Chiayi stream on their way to school, Ho created a Chiayi Philanthropic Works Corps to build bridges.

reference_spacy_tokens: Then , in 1971 , after two young brothers drowned forging a Chiayi stream on their way to school , Ho created a Chiayi Philanthropic Works Corps to build bridges .


fn_spacy_tokens_for_baseline: McLeish reflected uncomfortably that he would have to be very circumspect in his dealings with Catherine , with this beady - eyed observer around the place .

source_bert_toks: mc ##lei ##sh reflected uncomfortably that he would have to be very ci ##rc ##ums ##pe ##ct in his dealings with catherine , with this bea ##dy - eyed observer around the place .

reference_raw: McLeish thought uncomfortably that he would have to be very careful in his dealings with Catherine, with the beady-eyed observer around him.

reference_spacy_tokens: McLeish thought uncomfortably that he would have to be very careful in his dealings with Catherine , with the beady - eyed observer around him .


fn_spacy_tokens_for_baseline: She sewed buttons on to a white shirt she 'd made .

source_bert_toks: she se ##wed buttons on to a white shirt she ' d made .

reference_raw: She put buttons on the white shirt she had made.

reference_spacy_tokens: She put buttons on the white shirt she had made .


fn_spacy_tokens_for_baseline: What has brought about this change ?

source_bert_toks: what has brought about this change ?

reference_raw: What made that change?

reference_spacy_tokens: What made that change ?


fn_spacy_tokens_for_baseline: By 1899 he had completed and tested a 4-hp engine weighing only 40 lb . and had built a triplane in which to mount it .

source_bert_toks: by 1899 he had completed and tested a 4 - hp engine weighing only 40 lb . and had built a trip ##lane in which to mount it .

reference_raw: By 1899, he had completed the 4-hp engine, which weighed only 40 litres, and had built a triplane in which he could mount it.

reference_spacy_tokens: By 1899 , he had completed the 4-hp engine , which weighed only 40 litres , and had built a triplane in which he could mount it .


fn_spacy_tokens_for_baseline: Sheffield City Council simply refused to implement the Act and employed two officers to persuade tenants to withdraw applications to purchase .

source_bert_toks: sheffield city council simply refused to implement the act and employed two officers to persuade tenants to withdraw applications to purchase .

reference_raw: The Sheffield City Council simply refused to implement the law, employing two officers to convince the tenants to rescind the purchase request.

reference_spacy_tokens: The Sheffield City Council simply refused to implement the law , employing two officers to convince the tenants to rescind the purchase request .


fn_spacy_tokens_for_baseline: The blaze started burning last Wednesday north of Los Angeles .

source_bert_toks: the blaze started burning last wednesday north of los angeles .

reference_raw: Last Wednesday, north of L.A., the fire began to burn.

reference_spacy_tokens: Last Wednesday , north of L.A. , the fire began to burn .


fn_spacy_tokens_for_baseline: But Mr. Baynes had kept his most sinister exhibit to the last .

source_bert_toks: but mr . bay ##nes had kept his most sinister exhibit to the last .

reference_raw: But Mr. Baynes held on to the last of his most ominous exhibits.

reference_spacy_tokens: But Mr. Baynes held on to the last of his most ominous exhibits .


fn_spacy_tokens_for_baseline: Canadian companies exported $ 33.7 billion worth of goods , up 2.7 % from January 's revised level , the largest monthly rate of growth since May 2000 .

source_bert_toks: canadian companies exported $ 33 . 7 billion worth of goods , up 2 . 7 % from january ' s revised level , the largest monthly rate of growth since may 2000 .

reference_raw: Canadian companies exported $33.7 billion worth of goods, up 2.7% from the revised level of January, which is the highest monthly increase since May 2000.

reference_spacy_tokens: Canadian companies exported $ 33.7 billion worth of goods , up 2.7 % from the revised level of January , which is the highest monthly increase since May 2000 .


fn_spacy_tokens_for_baseline: ' If they all lived , guess how many rats there 'd be in this country in five years .

source_bert_toks: ' if they all lived , guess how many rats there ' d be in this country in five years .

reference_raw: 'If they were all alive, imagine how many rats there would have been in this country in the last five years.

reference_spacy_tokens: ' If they were all alive , imagine how many rats there would have been in this country in the last five years .


fn_spacy_tokens_for_baseline: No people more joyfully live up to their legendary image than the Italians .

source_bert_toks: no people more joy ##fully live up to their legendary image than the italians .

reference_raw: No man is more happy to live up to his legend than the Italians.

reference_spacy_tokens: No man is more happy to live up to his legend than the Italians .


fn_spacy_tokens_for_baseline: ' I 've said enough , ' he snarled .

source_bert_toks: ' i ' ve said enough , ' he snarled .

reference_raw: "I've said enough," he growled.

reference_spacy_tokens: " I 've said enough , " he growled .


fn_spacy_tokens_for_baseline: I do n't know how many of you have ever been to get tickets at Elland Road but you were advised to take a flask and sandwiches and

source_bert_toks: i don ' t know how many of you have ever been to get tickets at ella ##nd road but you were advised to take a fl ##ask and sandwiches and

reference_raw: I don't know how many of you ever got tickets to Elland Road, but I told you to take a bottle and a sandwich.

reference_spacy_tokens: I do n't know how many of you ever got tickets to Elland Road , but I told you to take a bottle and a sandwich .


fn_spacy_tokens_for_baseline: The Government may , one assumes , be particularly grateful for the fact that the question of the future of Scottish regiments failed to materialise as an election issue north of the border .

source_bert_toks: the government may , one assumes , be particularly grateful for the fact that the question of the future of scottish regiments failed to material ##ise as an election issue north of the border .

reference_raw: One assumes that the government is particularly grateful for the fact that the question of the future of Scotland's regiments has not become an electoral issue north of the border.

reference_spacy_tokens: One assumes that the government is particularly grateful for the fact that the question of the future of Scotland 's regiments has not become an electoral issue north of the border .


fn_spacy_tokens_for_baseline: The parish priest baptized the babies into the Christian faith .

source_bert_toks: the parish priest baptized the babies into the christian faith .

reference_raw: The parish priest christened the children into the Christian faith.

reference_spacy_tokens: The parish priest christened the children into the Christian faith .


fn_spacy_tokens_for_baseline: Church business should not be discussed in the bedroom . '

source_bert_toks: church business should not be discussed in the bedroom . '

reference_raw: You shouldn't talk about church business in the bedroom.'

reference_spacy_tokens: You should n't talk about church business in the bedroom . '


fn_spacy_tokens_for_baseline: James Fillis was a riding master of the last century who captivated large audiences with his over - bent horses with unnatural gaits .

source_bert_toks: james fill ##is was a riding master of the last century who capt ##ivated large audiences with his over - bent horses with unnatural ga ##its .

reference_raw: James Fillis was a rider of the last century who had captured large audiences with his overbent horses with unnatural gaits.

reference_spacy_tokens: James Fillis was a rider of the last century who had captured large audiences with his overbent horses with unnatural gaits .


fn_spacy_tokens_for_baseline: The heart shape that is characteristic of a barn owl 's face was just beginning to show through .

source_bert_toks: the heart shape that is characteristic of a barn owl ' s face was just beginning to show through .

reference_raw: The shape of the heart that characterizes the face of a barn owl was just beginning to show up.

reference_spacy_tokens: The shape of the heart that characterizes the face of a barn owl was just beginning to show up .


fn_spacy_tokens_for_baseline: As a speculative venture he built the Old Ropery Theatre in the 1740s .

source_bert_toks: as a speculative venture he built the old rope ##ry theatre in the 1740 ##s .

reference_raw: In the 1740s, as a speculative venture, he built the Old Ropery Theater.

reference_spacy_tokens: In the 1740s , as a speculative venture , he built the Old Ropery Theater .


fn_spacy_tokens_for_baseline: I have been asked to draw the attention of Wyre Borough Council to a burnt out car which I understand has been abandoned off the road near the reservoir on Nicky Nook , Scorton .

source_bert_toks: i have been asked to draw the attention of w ##yre borough council to a burnt out car which i understand has been abandoned off the road near the reservoir on nicky no ##ok , sc ##ort ##on .

reference_raw: I've been asked to draw the attention of the Wyre Borough Council to a burned-out car, which I understand was abandoned on the road near a tank in Nicky Nook, Scorton.

reference_spacy_tokens: I 've been asked to draw the attention of the Wyre Borough Council to a burned - out car , which I understand was abandoned on the road near a tank in Nicky Nook , Scorton .


fn_spacy_tokens_for_baseline: Three weeks after discharge , the patient felt nauseated and blood chemistry showed cholestasis .

source_bert_toks: three weeks after discharge , the patient felt nausea ##ted and blood chemistry showed cho ##les ##tas ##is .

reference_raw: Three weeks after the discharge, the patient was sick and blood chemistry showed cholestasis.

reference_spacy_tokens: Three weeks after the discharge , the patient was sick and blood chemistry showed cholestasis .


fn_spacy_tokens_for_baseline: Tallis stood her ground , and then was shocked as Morthen 's blade slammed against her jaw , almost completely following the line of the old scar .

source_bert_toks: tall ##is stood her ground , and then was shocked as mort ##hen ' s blade slammed against her jaw , almost completely following the line of the old scar .

reference_raw: Tallis was on her feet, then shocked when Morthen's sword struck her jaw, almost completely following the line of the old scar.

reference_spacy_tokens: Tallis was on her feet , then shocked when Morthen 's sword struck her jaw , almost completely following the line of the old scar .


fn_spacy_tokens_for_baseline: ' I think it 's so good it 's good , actually , ' purrs Brett .

source_bert_toks: ' i think it ' s so good it ' s good , actually , ' pu ##rr ##s brett .

reference_raw: 'Actually, I think it's a good thing,' said Brett.

reference_spacy_tokens: ' Actually , I think it 's a good thing , ' said Brett .


fn_spacy_tokens_for_baseline: You 've already chosen your companion for life . '

source_bert_toks: you ' ve already chosen your companion for life . '

reference_raw: "You have chosen your partner for the rest of your life."

reference_spacy_tokens: " You have chosen your partner for the rest of your life . "


fn_spacy_tokens_for_baseline: Laming 's defence hinged on his claims that Black was the backer for his plan to undermine racecourse betting and bookmaking in Britain with the stun gun device .

source_bert_toks: lam ##ing ' s defence hi ##nged on his claims that black was the back ##er for his plan to undermine racecourse betting and book ##making in britain with the stu ##n gun device .

reference_raw: Laming's defense depended on his claim that Black supported his plan to undermine racecourse betting and booking in Britain with a stun gun.

reference_spacy_tokens: Laming 's defense depended on his claim that Black supported his plan to undermine racecourse betting and booking in Britain with a stun gun .


fn_spacy_tokens_for_baseline: They were led , tied together by a single rope , first to the scaffold where , in front of the guillotine , the death sentence was pronounced .

source_bert_toks: they were led , tied together by a single rope , first to the sc ##af ##fold where , in front of the gui ##llo ##tine , the death sentence was pronounced .

reference_raw: They were led, bound together by a single line, first to the scaffold, where a death sentence was pronounced before the guillotine.

reference_spacy_tokens: They were led , bound together by a single line , first to the scaffold , where a death sentence was pronounced before the guillotine .


fn_spacy_tokens_for_baseline: The men died when the thirty eight ton gantry fell a hundred feet from the underside of the bridge two years ago .

source_bert_toks: the men died when the thirty eight ton gan ##try fell a hundred feet from the underside of the bridge two years ago .

reference_raw: Two years ago, the men died when the thirty-eight-ton gantry fell a hundred feet from the bottom of the bridge.

reference_spacy_tokens: Two years ago , the men died when the thirty - eight - ton gantry fell a hundred feet from the bottom of the bridge .


fn_spacy_tokens_for_baseline: It is more likely the Goblin will be smashed apart -- which although sad is considered a good way to go for a Goblin and infinitely better than being eaten by a peckish troll .

source_bert_toks: it is more likely the goblin will be smashed apart - - which although sad is considered a good way to go for a goblin and infinitely better than being eaten by a peck ##ish troll .

reference_raw: It is more likely that the goblin will be crushed - which, sad as it is, is considered a good way to go after the goblin and infinitely better than being eaten by a peck troll.

reference_spacy_tokens: It is more likely that the goblin will be crushed - which , sad as it is , is considered a good way to go after the goblin and infinitely better than being eaten by a peck troll .


fn_spacy_tokens_for_baseline: In that time more than 1.2 million jobs have been created and the official jobless rate has been pushed below 17 % from 21 % .

source_bert_toks: in that time more than 1 . 2 million jobs have been created and the official job ##less rate has been pushed below 17 % from 21 % .

reference_raw: Over 1,2 million jobs were created during this period, and official unemployment was reduced to less than 17 % from 21 %.

reference_spacy_tokens: Over 1,2 million jobs were created during this period , and official unemployment was reduced to less than 17 % from 21 % .


fn_spacy_tokens_for_baseline: Stewart sold 99.5 percent of her ranch to the railroad .

source_bert_toks: stewart sold 99 . 5 percent of her ranch to the railroad .

reference_raw: Stewart sold 99.5 percent of her farm to the railroad.

reference_spacy_tokens: Stewart sold 99.5 percent of her farm to the railroad .


fn_spacy_tokens_for_baseline: Also in 1976 , the government signed a $ 700 million contract to purchase uranium yellowcake from South Africa and sent Iranian technicians abroad for training in nuclear sciences .

source_bert_toks: also in 1976 , the government signed a $ 700 million contract to purchase uranium yellow ##cake from south africa and sent iranian technicians abroad for training in nuclear sciences .

reference_raw: In 1976, the government also signed a $700 million agreement for the purchase of uranium yellowcake from South Africa and sent Iranian technicians abroad to train in the field of nuclear science.

reference_spacy_tokens: In 1976 , the government also signed a $ 700 million agreement for the purchase of uranium yellowcake from South Africa and sent Iranian technicians abroad to train in the field of nuclear science .


fn_spacy_tokens_for_baseline: ' You 've already had one long journey today and I 'd rather you did n't fall asleep at the wheel . '

source_bert_toks: ' you ' ve already had one long journey today and i ' d rather you didn ' t fall asleep at the wheel . '

reference_raw: "You've had a long trip today, and I'd prefer it if you didn't fall asleep at the wheel."

reference_spacy_tokens: " You 've had a long trip today , and I 'd prefer it if you did n't fall asleep at the wheel . "


fn_spacy_tokens_for_baseline: An election would be held to decide the final outcome , but quite astonishingly the government decreed that abstentions would count as ' yes " votes .

source_bert_toks: an election would be held to decide the final outcome , but quite astonishing ##ly the government decreed that abs ##ten ##tions would count as ' yes " votes .

reference_raw: There will be an election to decide the final outcome, but the government has decided, quite surprisingly, that the abstentions will count as "yes" votes.

reference_spacy_tokens: There will be an election to decide the final outcome , but the government has decided , quite surprisingly , that the abstentions will count as " yes " votes .


fn_spacy_tokens_for_baseline: Carrying out Jihad is the main reason the members of AL - QAEDA have gathered , together with performing the different duties of Islam as much as possible , shouldering together the duty of Jihad and preparing the efficient duties during conflicts .

source_bert_toks: carrying out jihad is the main reason the members of al - qaeda have gathered , together with performing the different duties of islam as much as possible , shoulder ##ing together the duty of jihad and preparing the efficient duties during conflicts .

reference_raw: The deployment of the Jihad is the main reason why the AL-QAEDA members have gathered together, as far as possible, to fulfil the various responsibilities of Islam, to shoulder the responsibilities of the Jihad and to prepare for effective responsibilities in conflict.

reference_spacy_tokens: The deployment of the Jihad is the main reason why the AL - QAEDA members have gathered together , as far as possible , to fulfil the various responsibilities of Islam , to shoulder the responsibilities of the Jihad and to prepare for effective responsibilities in conflict .


fn_spacy_tokens_for_baseline: ' We took our car on a river ferry during a monsoon storm .

source_bert_toks: ' we took our car on a river ferry during a monsoon storm .

reference_raw: We took the car on the river ferry during the monsoon thunderstorm.

reference_spacy_tokens: We took the car on the river ferry during the monsoon thunderstorm .


fn_spacy_tokens_for_baseline: The Eucharist is the sacrament of salvation and , as such , it declares the work of Christ as he fulfils the Father 's will and draws all people to God .

source_bert_toks: the eu ##cha ##rist is the sacrament of salvation and , as such , it declares the work of christ as he fu ##lf ##ils the father ' s will and draws all people to god .

reference_raw: The Eucharist is a sacrificial salvation, and as such, he declares Christ's work by fulfilling the will of the Father and drawing all men to God.

reference_spacy_tokens: The Eucharist is a sacrificial salvation , and as such , he declares Christ 's work by fulfilling the will of the Father and drawing all men to God .


fn_spacy_tokens_for_baseline: The popular phrase " Soon come " indicates an apparent lack of concern about time and an unhurried attitude to daily tasks .

source_bert_toks: the popular phrase " soon come " indicates an apparent lack of concern about time and an un ##hur ##ried attitude to daily tasks .

reference_raw: Favorite phrase "Soon Coming" suggests a clear lack of concern over time and an unhurried approach to day-to-day tasks.

reference_spacy_tokens: Favorite phrase " Soon Coming " suggests a clear lack of concern over time and an unhurried approach to day - to - day tasks .


fn_spacy_tokens_for_baseline: Soon , clouds spilled over Carn Dearg and it darkened suddenly as I ascended the mountain .

source_bert_toks: soon , clouds spilled over car ##n dear ##g and it darkened suddenly as i ascended the mountain .

reference_raw: Soon the clouds were spilling over Carn Dearg, and as I climbed the mountain, it was suddenly dark.

reference_spacy_tokens: Soon the clouds were spilling over Carn Dearg , and as I climbed the mountain , it was suddenly dark .


fn_spacy_tokens_for_baseline: And the more she thought about it the more she felt certain that her instinctive deduction had been right .

source_bert_toks: and the more she thought about it the more she felt certain that her instinct ##ive de ##duction had been right .

reference_raw: And the more she thought about it, the more she was sure that her instinctive inference was correct.

reference_spacy_tokens: And the more she thought about it , the more she was sure that her instinctive inference was correct .


fn_spacy_tokens_for_baseline: LEE WEARS a shiny nylon jacket that 's on loan from the Sir Alf Ramsey estate , and cheesy sports pants that look as if they could walk home on their own .

source_bert_toks: lee wears a shiny nylon jacket that ' s on loan from the sir alf ramsey estate , and che ##es ##y sports pants that look as if they could walk home on their own .

reference_raw: Lee WEARS a gleaming nylon jacket borrowed from Sir Alf Ramsey's mansion, and cheap sports pants that look like they can go home alone.

reference_spacy_tokens: Lee WEARS a gleaming nylon jacket borrowed from Sir Alf Ramsey 's mansion , and cheap sports pants that look like they can go home alone .


fn_spacy_tokens_for_baseline: The transfer - part of the Global Threat Reduction Initiative ( GTRI ) , a nonproliferation effort that secures high - risk nuclear and radiological materials and equipment around the world - resulted from a cooperative effort by the United States , Uzbekistan , Kazakhstan and Russia , as well as coordination through the International Atomic Energy Agency ( IAEA ) . " ( News Blaze , 21Apr06 ) ( Link )

source_bert_toks: the transfer - part of the global threat reduction initiative ( gt ##ri ) , a non ##pro ##life ##ration effort that secure ##s high - risk nuclear and radio ##logical materials and equipment around the world - resulted from a cooperative effort by the united states , uzbekistan , kazakhstan and russia , as well as coordination through the international atomic energy agency ( ia ##ea ) . " ( news blaze , 21 ##ap ##r ##0 ##6 ) ( link )

reference_raw: The transfer - part of the Global Threat Reduction Initiative (GTRI), a non-proliferation effort to ensure high-risk nuclear and radiological materials and equipment worldwide - was the result of cooperation between the United States, Uzbekistan, Kazakhstan and Russia, as well as coordination through the International Atomic Energy Agency (IAEA) (News Blaze, 21 April 2006) (Link)

reference_spacy_tokens: The transfer - part of the Global Threat Reduction Initiative ( GTRI ) , a non - proliferation effort to ensure high - risk nuclear and radiological materials and equipment worldwide - was the result of cooperation between the United States , Uzbekistan , Kazakhstan and Russia , as well as coordination through the International Atomic Energy Agency ( IAEA ) ( News Blaze , 21 April 2006 ) ( Link )


fn_spacy_tokens_for_baseline: The most important factor was whether all the crops were housed in the barn or whether some or all were kept in ricks in the fields , being moved to the barn for threshing .

source_bert_toks: the most important factor was whether all the crops were housed in the barn or whether some or all were kept in rick ##s in the fields , being moved to the barn for th ##resh ##ing .

reference_raw: The most important factor was whether all the crops had been housed in the stable, or whether some or all of them had been kept in ricks in the fields and had been moved to the stable to be thrashed.

reference_spacy_tokens: The most important factor was whether all the crops had been housed in the stable , or whether some or all of them had been kept in ricks in the fields and had been moved to the stable to be thrashed .


fn_spacy_tokens_for_baseline: Yeats wrote out his poems in prose first : it is a discipline which works .

source_bert_toks: ye ##ats wrote out his poems in prose first : it is a discipline which works .

reference_raw: Yeats made his poems first in the prose: it's a discipline that works.

reference_spacy_tokens: Yeats made his poems first in the prose : it 's a discipline that works .


fn_spacy_tokens_for_baseline: An adjustable elastic waist fits a number of sizes .

source_bert_toks: an adjustable elastic waist fits a number of sizes .

reference_raw: The adjustable elastic belt fits many sizes.

reference_spacy_tokens: The adjustable elastic belt fits many sizes .


fn_spacy_tokens_for_baseline: When he had wolfed down a few chapattis and an onion bhaji , Amiss took a slurp of lager and then leaned back .

source_bert_toks: when he had wolfe ##d down a few cha ##pa ##tti ##s and an onion b ##ha ##ji , ami ##ss took a sl ##ur ##p of la ##ger and then leaned back .

reference_raw: After wolfing a couple of chapattis and an onion bhaji, Amiss sipped lager and leaned back.

reference_spacy_tokens: After wolfing a couple of chapattis and an onion bhaji , Amiss sipped lager and leaned back .


fn_spacy_tokens_for_baseline: Pyongyang 's initial declaration included a small plutonium sample ( less than 100 grams ) , which North Korean officials said was reprocessed from damaged spent fuel rods that were removed from the 5MW ( e ) reactor in Yo ( ngbyo ( n - kun .

source_bert_toks: p ##yon ##gy ##ang ' s initial declaration included a small pluto ##nium sample ( less than 100 grams ) , which north korean officials said was rep ##ro ##ces ##sed from damaged spent fuel rods that were removed from the 5 ##m ##w ( e ) reactor in yo ( ng ##by ##o ( n - kun .

reference_raw: Pyongyang's first statement contained a small sample of plutonium (less than 100 grams) that North Korean officials claimed to have been re-processed from damaged spent fuel rods removed from the 5MW (e) reactor in Yo (ngbyo (n-kun).

reference_spacy_tokens: Pyongyang 's first statement contained a small sample of plutonium ( less than 100 grams ) that North Korean officials claimed to have been re - processed from damaged spent fuel rods removed from the 5MW ( e ) reactor in Yo ( ngbyo ( n - kun ) .


fn_spacy_tokens_for_baseline: I was fascinated by the droplets of saliva sticking to the coarse stubby brown hair surrounding his mouth , and he had to repeat his request for my shopping list .

source_bert_toks: i was fascinated by the droplets of saliva sticking to the coarse stu ##bby brown hair surrounding his mouth , and he had to repeat his request for my shopping list .

reference_raw: I was fascinated by the droplets of saliva sticking to the thick brown hair around his mouth, and he had to repeat his application for my shopping list.

reference_spacy_tokens: I was fascinated by the droplets of saliva sticking to the thick brown hair around his mouth , and he had to repeat his application for my shopping list .


fn_spacy_tokens_for_baseline: Today , as always , Jerusalem is a city of controversies : religious Jews in conflict with secular Jews ; Palestinians calling for independence ; many residents protesting a wave of high - rise development that many claim will turn the Holy City into a holy megalopolis .

source_bert_toks: today , as always , jerusalem is a city of controversies : religious jews in conflict with secular jews ; palestinians calling for independence ; many residents protesting a wave of high - rise development that many claim will turn the holy city into a holy mega ##lo ##polis .

reference_raw: Today, as always, Jerusalem is a city of controversy: religious Jews conflicting with secular Jews; Palestinians demanding independence; many citizens protesting a wave of high-level development that many claims will turn the Holy City into a sacred megalopolis.

reference_spacy_tokens: Today , as always , Jerusalem is a city of controversy : religious Jews conflicting with secular Jews ; Palestinians demanding independence ; many citizens protesting a wave of high - level development that many claims will turn the Holy City into a sacred megalopolis .


fn_spacy_tokens_for_baseline: In St Erconwald 's church , Athelstan had just finished the Mass for the dead and was now blessing the corpse of Tosspot , an old drunkard who 'd lived in the cellars of the Piebald Horse tavern .

source_bert_toks: in st er ##con ##wald ' s church , at ##hel ##stan had just finished the mass for the dead and was now blessing the corpse of toss ##pot , an old drunk ##ard who ' d lived in the cellar ##s of the pie ##bal ##d horse tavern .

reference_raw: At the church of St. Erconwald, Athelstan had just completed the mass of the dead and now blessed the body of Tosspot, the old drunk who had lived in the basement of the Piebald Horse inn.

reference_spacy_tokens: At the church of St. Erconwald , Athelstan had just completed the mass of the dead and now blessed the body of Tosspot , the old drunk who had lived in the basement of the Piebald Horse inn .


fn_spacy_tokens_for_baseline: However , shortly before Anne Burford resigned as chief of the EPA , she was due to announce her decision on whether to lift the ban in light of new evidence .

source_bert_toks: however , shortly before anne bu ##rford resigned as chief of the epa , she was due to announce her decision on whether to lift the ban in light of new evidence .

reference_raw: But shortly before Anna Burford resigned as head of the EPA, she was to announce her decision to lift the ban in the light of new evidence.

reference_spacy_tokens: But shortly before Anna Burford resigned as head of the EPA , she was to announce her decision to lift the ban in the light of new evidence .


fn_spacy_tokens_for_baseline: It did transpire that some people were more susceptible to the poison than others .

source_bert_toks: it did trans ##pire that some people were more susceptible to the poison than others .

reference_raw: Some people turned out to be more susceptible to the poison than others.

reference_spacy_tokens: Some people turned out to be more susceptible to the poison than others .


fn_spacy_tokens_for_baseline: Further , it will document the experience of families as they moved out of the old tenements , often slums , into their new houses in the new schemes .

source_bert_toks: further , it will document the experience of families as they moved out of the old ten ##ement ##s , often sl ##ums , into their new houses in the new schemes .

reference_raw: It will also document the experience of families moving from old apartments, often slums, to new homes under new schemes.

reference_spacy_tokens: It will also document the experience of families moving from old apartments , often slums , to new homes under new schemes .


fn_spacy_tokens_for_baseline: The new Prime Minister was Aliou Mahamidou , hitherto director of the state - owned cement manufacturing company .

source_bert_toks: the new prime minister was ali ##ou maha ##mi ##dou , hit ##her ##to director of the state - owned cement manufacturing company .

reference_raw: The new prime minister was Aliou Mahamidou, head of a state-owned cement company.

reference_spacy_tokens: The new prime minister was Aliou Mahamidou , head of a state - owned cement company .


fn_spacy_tokens_for_baseline: They say repairs could cost between £ 20,000 and £ 60,000 if it had to be rebuilt .

source_bert_toks: they say repairs could cost between £2 ##0 , 000 and £ ##60 , 000 if it had to be rebuilt .

reference_raw: It is said that repairs could be worth between £20,000 and £60,000 if they were to be repaired.

reference_spacy_tokens: It is said that repairs could be worth between £ 20,000 and £ 60,000 if they were to be repaired .


fn_spacy_tokens_for_baseline: This term can cover a multitude of sins .

source_bert_toks: this term can cover a multitude of sins .

reference_raw: That term may include many sins.

reference_spacy_tokens: That term may include many sins .


fn_spacy_tokens_for_baseline: There are now a lot of low - cost ' share shops ' we can deal through as well .

source_bert_toks: there are now a lot of low - cost ' share shops ' we can deal through as well .

reference_raw: Now there's a lot of cheap 'share shops' that we can deal with.

reference_spacy_tokens: Now there 's a lot of cheap ' share shops ' that we can deal with .


fn_spacy_tokens_for_baseline: It was Buddie 's signature tune , the one his band always played at the start of every session .

source_bert_toks: it was bud ##die ' s signature tune , the one his band always played at the start of every session .

reference_raw: It was Buddie's signing melody, the one his band always played at the beginning of each session.

reference_spacy_tokens: It was Buddie 's signing melody , the one his band always played at the beginning of each session .


fn_spacy_tokens_for_baseline: It has identified a 295-acre site of mainly coniferous woodland managed by the Forestry Commission , and is discussing acquisition with landowners and local authorities .

source_bert_toks: it has identified a 295 - acre site of mainly con ##iferous woodland managed by the forestry commission , and is discussing acquisition with landowners and local authorities .

reference_raw: It identified a 295-acre area of mainly coniferous forest managed by the Forestry Commission and discusses acquisitions with the landowners and local authorities.

reference_spacy_tokens: It identified a 295-acre area of mainly coniferous forest managed by the Forestry Commission and discusses acquisitions with the landowners and local authorities .


fn_spacy_tokens_for_baseline: She could n't help it ; the words poured out , a torrent of pent - up emotional resentment , released at last .

source_bert_toks: she couldn ' t help it ; the words poured out , a torre ##nt of pen ##t - up emotional resentment , released at last .

reference_raw: There was nothing she could do; the words came out, a rush of pent-up emotional resentment finally released.

reference_spacy_tokens: There was nothing she could do ; the words came out , a rush of pent - up emotional resentment finally released .


fn_spacy_tokens_for_baseline: I expected to find all the elements of exciting night scenes : glowing street lights , interesting architecture , wet pavements , and a variety of shop windows .

source_bert_toks: i expected to find all the elements of exciting night scenes : glowing street lights , interesting architecture , wet pavement ##s , and a variety of shop windows .

reference_raw: I expected to find all the elements of exciting night scenes: bright streetlights, interesting architecture, moist sidewalks, and various shop windows.

reference_spacy_tokens: I expected to find all the elements of exciting night scenes : bright streetlights , interesting architecture , moist sidewalks , and various shop windows .


fn_spacy_tokens_for_baseline: ' They always talk and joke among themselves .

source_bert_toks: ' they always talk and joke among themselves .

reference_raw: 'They're always talking and making fun of each other.

reference_spacy_tokens: ' They 're always talking and making fun of each other .


fn_spacy_tokens_for_baseline: There have been many attempts to understand why certain materials cause blood coagulation and many suggestions have been made as to how to overcome the problem .

source_bert_toks: there have been many attempts to understand why certain materials cause blood coa ##gul ##ation and many suggestions have been made as to how to overcome the problem .

reference_raw: Many attempts have been made to understand why certain materials cause blood clotting, and many suggestions have been made to overcome this problem.

reference_spacy_tokens: Many attempts have been made to understand why certain materials cause blood clotting , and many suggestions have been made to overcome this problem .


fn_spacy_tokens_for_baseline: I thought I managed very well considering that tears were running down my cheeks most of the time .

source_bert_toks: i thought i managed very well considering that tears were running down my cheeks most of the time .

reference_raw: I thought I was doing very well, considering that most of the time there were tears running down my face.

reference_spacy_tokens: I thought I was doing very well , considering that most of the time there were tears running down my face .


fn_spacy_tokens_for_baseline: The display of honours was indiscriminate : alongside the insignia of a commandeur of the Legion d'honneur awarded by Giscard d'Estaing , a certificate of honorary citizenship of Disneyland aroused the admiration of the visitor to the museum .

source_bert_toks: the display of honours was ind ##is ##cr ##imi ##nate : alongside the insignia of a command ##eur of the legion d ' honneur awarded by gi ##sca ##rd d ' est ##ain ##g , a certificate of honorary citizenship of disneyland aroused the admiration of the visitor to the museum .

reference_raw: The display of honor was indiscriminate: along with the insignia of the Legion d'Honneur's commander, given by Giscard d'Estaing, the certificate of honorary citizenship of Disneyland aroused the respect of his visitor to the museum.

reference_spacy_tokens: The display of honor was indiscriminate : along with the insignia of the Legion d'Honneur 's commander , given by Giscard d'Estaing , the certificate of honorary citizenship of Disneyland aroused the respect of his visitor to the museum .


fn_spacy_tokens_for_baseline: The 700 lots include rarities such as a pair of mid-17th Century Swiss flintlock pistols or a wheel - lock rifle by Maucher , both estimated in excess of £ 60,000 .

source_bert_toks: the 700 lots include ra ##rit ##ies such as a pair of mid - 17th century swiss flint ##lock pistols or a wheel - lock rifle by ma ##ucher , both estimated in excess of £ ##60 , 000 .

reference_raw: The 700 lots include rarities, such as two Swiss flintlock pistols in the middle of the 17th century or Maucher's wheel-locked rifle, both of which are expected to exceed £60,000.

reference_spacy_tokens: The 700 lots include rarities , such as two Swiss flintlock pistols in the middle of the 17th century or Maucher 's wheel - locked rifle , both of which are expected to exceed £ 60,000 .


fn_spacy_tokens_for_baseline: The policemen knocked him to the ground and kicked the life out of him .

source_bert_toks: the policemen knocked him to the ground and kicked the life out of him .

reference_raw: The police brought him down and kicked the life out of him.

reference_spacy_tokens: The police brought him down and kicked the life out of him .


fn_spacy_tokens_for_baseline: IL-4 , similar to TNF - a and IL -1 inhibitors , has been shown be therapeutic for the treatment of murine CIA when administered intravenously as a recombinant protein , either alone or in combination with IL -10 .

source_bert_toks: il - 4 , similar to tn ##f - a and il - 1 inhibitors , has been shown be therapeutic for the treatment of mu ##rine cia when administered intra ##ven ##ously as a rec ##om ##bina ##nt protein , either alone or in combination with il - 10 .

reference_raw: IL-4, similar to TNF-a and IL-1 inhibitors, has been shown to be therapeutic for the treatment of the mouse CIA when administered intravenously as a recombinant protein, either alone or in conjunction with IL-10.

reference_spacy_tokens: IL-4 , similar to TNF - a and IL-1 inhibitors , has been shown to be therapeutic for the treatment of the mouse CIA when administered intravenously as a recombinant protein , either alone or in conjunction with IL-10 .


fn_spacy_tokens_for_baseline: As the expedition nears the summit of the world 's highest mountain , base camp manager Nick Stevenson joined the campaign to get local people to step out for health .

source_bert_toks: as the expedition near ##s the summit of the world ' s highest mountain , base camp manager nick stevenson joined the campaign to get local people to step out for health .

reference_raw: As the expedition nears the top of the world's highest peak, base camp manager Nick Stevenson joins the campaign to get the locals to stand up for health.

reference_spacy_tokens: As the expedition nears the top of the world 's highest peak , base camp manager Nick Stevenson joins the campaign to get the locals to stand up for health .


fn_spacy_tokens_for_baseline: The order of rows and columns is arbitrary .

source_bert_toks: the order of rows and columns is arbitrary .

reference_raw: Rows and column sequences are arbitrary.

reference_spacy_tokens: Rows and column sequences are arbitrary .


fn_spacy_tokens_for_baseline: Eurotunnel has offered payment in shares but TML does n't want shares .

source_bert_toks: euro ##tu ##nne ##l has offered payment in shares but t ##ml doesn ' t want shares .

reference_raw: Eurotunnel offered to pay in shares, but TML does not want shares.

reference_spacy_tokens: Eurotunnel offered to pay in shares , but TML does not want shares .


fn_spacy_tokens_for_baseline: The black - clad thief hissed , and sheathed his sword .

source_bert_toks: the black - clad thief hissed , and sheath ##ed his sword .

reference_raw: The black-robed thief hissed and scabbarded his sword.

reference_spacy_tokens: The black - robed thief hissed and scabbarded his sword .


fn_spacy_tokens_for_baseline: Russia is assisting Iran to construct a light water reactor at Bushehr , which is now nearing completion , and will supply the nuclear fuel needed to run it .

source_bert_toks: russia is assisting iran to construct a light water reactor at bush ##eh ##r , which is now nearing completion , and will supply the nuclear fuel needed to run it .

reference_raw: Russia is helping Iran build a light-water reactor in Bushehr, which is now approaching completion, and will provide the nuclear fuel needed to operate it.

reference_spacy_tokens: Russia is helping Iran build a light - water reactor in Bushehr , which is now approaching completion , and will provide the nuclear fuel needed to operate it .


fn_spacy_tokens_for_baseline: Activities , which society had previously disapproved of and banned , are now permitted and can be freely indulged in .

source_bert_toks: activities , which society had previously di ##sa ##pp ##roved of and banned , are now permitted and can be freely ind ##ul ##ged in .

reference_raw: Activities that society has not previously approved and banned are now permitted and can be freely exploited.

reference_spacy_tokens: Activities that society has not previously approved and banned are now permitted and can be freely exploited .


fn_spacy_tokens_for_baseline: The tall soldier smiled down at him .

source_bert_toks: the tall soldier smiled down at him .

reference_raw: The tall soldier grinned at him.

reference_spacy_tokens: The tall soldier grinned at him .


fn_spacy_tokens_for_baseline: In 1687 , when James II was trying to conciliate Dissenters in order to win toleration for Catholics , Bunyan was offered a place in a reconstructed Bedford Town Corporation , which he refused .

source_bert_toks: in 168 ##7 , when james ii was trying to con ##ci ##lia ##te dissent ##ers in order to win to ##ler ##ation for catholics , bun ##yan was offered a place in a reconstructed bedford town corporation , which he refused .

reference_raw: In 1687, when James II tried to reconcile the Dissenters with a view to gaining tolerance for the Catholics, Bunyan was offered a place at the newly reconstructed Bedford Town Corporation, which he refused.

reference_spacy_tokens: In 1687 , when James II tried to reconcile the Dissenters with a view to gaining tolerance for the Catholics , Bunyan was offered a place at the newly reconstructed Bedford Town Corporation , which he refused .


fn_spacy_tokens_for_baseline: It was a reassuring sight .

source_bert_toks: it was a reassuring sight .

reference_raw: It was a comforting sight.

reference_spacy_tokens: It was a comforting sight .


fn_spacy_tokens_for_baseline: The problem is particularly difficult in cases of rape and assault where the identification of the suspect by the victim carries great weight .

source_bert_toks: the problem is particularly difficult in cases of rape and assault where the identification of the suspect by the victim carries great weight .

reference_raw: This is particularly problematic in cases of rape and assault, where the identification of the suspect by the victim is of great importance.

reference_spacy_tokens: This is particularly problematic in cases of rape and assault , where the identification of the suspect by the victim is of great importance .


fn_spacy_tokens_for_baseline: It represented a medieval knight in full armour , the helmeted head surrounded by a thin coronet , the sides of the face and neck swathed in chain mail .

source_bert_toks: it represented a medieval knight in full armour , the helmet ##ed head surrounded by a thin co ##rone ##t , the sides of the face and neck swat ##hed in chain mail .

reference_raw: He was a medieval knight in full armor, his helmeted head surrounded by a thin coronet, his face and neck covered with chain mail.

reference_spacy_tokens: He was a medieval knight in full armor , his helmeted head surrounded by a thin coronet , his face and neck covered with chain mail .


fn_spacy_tokens_for_baseline: He clattered down the lane , and there was silence .

source_bert_toks: he cl ##atter ##ed down the lane , and there was silence .

reference_raw: He rattled down the lane, and there was silence.

reference_spacy_tokens: He rattled down the lane , and there was silence .


fn_spacy_tokens_for_baseline: In case of sudden death , take note of any witnesses and anything which may be needed in a statement for a coroner 's inquest .

source_bert_toks: in case of sudden death , take note of any witnesses and anything which may be needed in a statement for a coroner ' s in ##quest .

reference_raw: In the event of a sudden death, take note of all witnesses and anything that may be necessary in the coroner's report.

reference_spacy_tokens: In the event of a sudden death , take note of all witnesses and anything that may be necessary in the coroner 's report .


fn_spacy_tokens_for_baseline: The slippery slope argument should never be dismissed as irrelevant ; it would be totally irrational to reach policy decisions without consideration of their likely consequences .

source_bert_toks: the slippery slope argument should never be dismissed as irrelevant ; it would be totally irrational to reach policy decisions without consideration of their likely consequences .

reference_raw: The slippery slope argument should never be rejected as irrelevant; it would be completely unreasonable to make political decisions without taking into account the likely consequences.

reference_spacy_tokens: The slippery slope argument should never be rejected as irrelevant ; it would be completely unreasonable to make political decisions without taking into account the likely consequences .


fn_spacy_tokens_for_baseline: Sent off for my tickets for the aforementioned match on Monday , only to find out on Tuesday that it 's been postponed ( effin Bright ) .

source_bert_toks: sent off for my tickets for the aforementioned match on monday , only to find out on tuesday that it ' s been postponed ( e ##ffin bright ) .

reference_raw: I sent for tickets to the game on Monday, only to see that it was postponed on Tuesday (Effin Bright).

reference_spacy_tokens: I sent for tickets to the game on Monday , only to see that it was postponed on Tuesday ( Effin Bright ) .


fn_spacy_tokens_for_baseline: There are many ways to cross the marsh . '

source_bert_toks: there are many ways to cross the marsh . '

reference_raw: There's a lot of ways to cross the swamp.'

reference_spacy_tokens: There 's a lot of ways to cross the swamp . '


fn_spacy_tokens_for_baseline: The location is excellent for walking , and well situated for touring the abbeys and chateaux of the Bordeaux and Bergerac regions .

source_bert_toks: the location is excellent for walking , and well situated for touring the abbey ##s and chateau ##x of the bordeaux and berger ##ac regions .

reference_raw: The place is perfect for walking and well situated for touring the abbeys and chateaux in the Bordeaux and Bergerac regions.

reference_spacy_tokens: The place is perfect for walking and well situated for touring the abbeys and chateaux in the Bordeaux and Bergerac regions .


fn_spacy_tokens_for_baseline: You may well be ashamed to see me after your noise and nonsense .

source_bert_toks: you may well be ashamed to see me after your noise and nonsense .

reference_raw: You might be ashamed to see me after all the fuss and nonsense.

reference_spacy_tokens: You might be ashamed to see me after all the fuss and nonsense .


fn_spacy_tokens_for_baseline: A SUSPICIOUS car dealer foiled a Provisional IRA plot to plant the biggest bomb ever in London .

source_bert_toks: a suspicious car dealer foil ##ed a provisional ira plot to plant the biggest bomb ever in london .

reference_raw: A SUSPICIOUS car dealer destroyed a provisional IRA conspiracy to plant the largest bomb in London.

reference_spacy_tokens: A SUSPICIOUS car dealer destroyed a provisional IRA conspiracy to plant the largest bomb in London .


fn_spacy_tokens_for_baseline: I am neither a religious person nor a politically correct thinker , simply a human being who finds cruelty of any sort degrading and saddening .

source_bert_toks: i am neither a religious person nor a politically correct think ##er , simply a human being who finds cruelty of any sort de ##grad ##ing and sad ##den ##ing .

reference_raw: I'm not a religious person, I'm not a politically correct thinker, I'm just a person who finds cruelty of any kind humiliating and sad.

reference_spacy_tokens: I 'm not a religious person , I 'm not a politically correct thinker , I 'm just a person who finds cruelty of any kind humiliating and sad .


fn_spacy_tokens_for_baseline: If this route is taken it will be necessary , from the tenant 's point of view , for the landlord to covenant to procure a similar covenant from successors in title .

source_bert_toks: if this route is taken it will be necessary , from the tenant ' s point of view , for the landlord to covenant to pro ##cure a similar covenant from successors in title .

reference_raw: If such a route is taken, it will be necessary, from the perspective of the tenant, for the landlord to agree to obtain a similar contract from the heirs in title.

reference_spacy_tokens: If such a route is taken , it will be necessary , from the perspective of the tenant , for the landlord to agree to obtain a similar contract from the heirs in title .


fn_spacy_tokens_for_baseline: While she piled all the groceries on the counter and the girl began to check them out Stuart sat by the door and looked round .

source_bert_toks: while she piled all the groceries on the counter and the girl began to check them out stuart sat by the door and looked round .

reference_raw: As she stacked all the food on the counter and the girl began checking it out, Stuart sat at the door and looked around.

reference_spacy_tokens: As she stacked all the food on the counter and the girl began checking it out , Stuart sat at the door and looked around .


fn_spacy_tokens_for_baseline: The nomination of weak candidates has been a factor .

source_bert_toks: the nomination of weak candidates has been a factor .

reference_raw: A factor was the nomination of feeble candidates.

reference_spacy_tokens: A factor was the nomination of feeble candidates .


fn_spacy_tokens_for_baseline: Ciprofloxacin is largely excreted as an unchanged substance and elimination is predominantly via the kidneys .

source_bert_toks: ci ##pro ##fl ##ox ##ac ##in is largely ex ##cre ##ted as an unchanged substance and elimination is predominantly via the kidney ##s .

reference_raw: The major excretion of ciprofloxacin is unchanged and the elimination is mainly via the kidneys.

reference_spacy_tokens: The major excretion of ciprofloxacin is unchanged and the elimination is mainly via the kidneys .


fn_spacy_tokens_for_baseline: Fill two jam jars with water and stir five tablespoons of Epsom Salts into each jar .

source_bert_toks: fill two jam jars with water and stir five tables ##poo ##ns of eps ##om salts into each jar .

reference_raw: Fill two glasses of jam with water and mix five spoons of Epsom salt into each glass.

reference_spacy_tokens: Fill two glasses of jam with water and mix five spoons of Epsom salt into each glass .


fn_spacy_tokens_for_baseline: Pakistan denied the claims , and was reported to have rejected an Iranian offer to Pakistani former army chief of staff Mirza Aslam Beg to purchase weapons technology .

source_bert_toks: pakistan denied the claims , and was reported to have rejected an iranian offer to pakistani former army chief of staff mirza as ##lam beg to purchase weapons technology .

reference_raw: Pakistan denied the claim and was reported to have rejected Iran's offer to Pakistan's former military chief of staff, Mirza Aslam Beg, to buy arms technology.

reference_spacy_tokens: Pakistan denied the claim and was reported to have rejected Iran 's offer to Pakistan 's former military chief of staff , Mirza Aslam Beg , to buy arms technology .


fn_spacy_tokens_for_baseline: The training we were to receive was later to help us teenagers when most of us enlisted into the services .

source_bert_toks: the training we were to receive was later to help us teenagers when most of us enlisted into the services .

reference_raw: The training we were supposed to get was later to help us teenagers when most of us joined the service.

reference_spacy_tokens: The training we were supposed to get was later to help us teenagers when most of us joined the service .


fn_spacy_tokens_for_baseline: Hundreds of workers " were working feverishly " to place piping and wiring in Iran 's underground enrichment facility at Natanz , said a diplomat accredited to the agency .

source_bert_toks: hundreds of workers " were working fever ##ishly " to place pip ##ing and wiring in iran ' s underground enrichment facility at nat ##an ##z , said a diplomat accredited to the agency .

reference_raw: Hundreds of workers "worked feverishly" to place pipes and wires in the Iranian subterranean enrichment facility in Natanz, said to be accredited to the agency.

reference_spacy_tokens: Hundreds of workers " worked feverishly " to place pipes and wires in the Iranian subterranean enrichment facility in Natanz , said to be accredited to the agency .


fn_spacy_tokens_for_baseline: In the second room lay Isidora herself mummified but unwrapped , in a long glass case .

source_bert_toks: in the second room lay is ##ido ##ra herself mum ##mi ##fied but un ##wr ##app ##ed , in a long glass case .

reference_raw: In the other room, Isidora herself was mummied but unwrapped in a long glass case.

reference_spacy_tokens: In the other room , Isidora herself was mummied but unwrapped in a long glass case .


fn_spacy_tokens_for_baseline: He sent his parents a letter promising that ' if the good Lord God be merciful unto me and bring me safe home again , I will all the days of my life serve Him in praising His Holy name and exhorting others ' .

source_bert_toks: he sent his parents a letter promising that ' if the good lord god be mer ##ciful unto me and bring me safe home again , i will all the days of my life serve him in praising his holy name and ex ##hort ##ing others ' .

reference_raw: He sent a letter to his parents, saying, "If God be merciful to me and bring me home safely, I will serve him all the days of my life to praise his holy name and exhort others."

reference_spacy_tokens: He sent a letter to his parents , saying , " If God be merciful to me and bring me home safely , I will serve him all the days of my life to praise his holy name and exhort others . "


fn_spacy_tokens_for_baseline: ' Monsieur Dacourt , ' Francis announced in perfect English , ' I apologise for the tardy arrival and abrupt interruption of your eloquent speech by Akim and his cats .

source_bert_toks: ' monsieur da ##court , ' francis announced in perfect english , ' i ap ##olo ##gis ##e for the tar ##dy arrival and abrupt interruption of your el ##o ##quent speech by ak ##im and his cats .

reference_raw: "Mr. Dacourt," Francis said in perfect English, "I apologize for the late arrival and sudden interruption of your speech by Akim and his cats.

reference_spacy_tokens: " Mr. Dacourt , " Francis said in perfect English , " I apologize for the late arrival and sudden interruption of your speech by Akim and his cats .


fn_spacy_tokens_for_baseline: Bradl injured himself again at Calafat , a few weeks after the final GP .

source_bert_toks: brad ##l injured himself again at cal ##af ##at , a few weeks after the final gp .

reference_raw: Bradl was wounded again in Calafat a few weeks after the final GP.

reference_spacy_tokens: Bradl was wounded again in Calafat a few weeks after the final GP .


fn_spacy_tokens_for_baseline: Hamas and other Palestinian militant group rejected Abbas ' call to end their attacks with a deadly raid on an Israeli army outpost in Gaza .

source_bert_toks: hamas and other palestinian militant group rejected abbas ' call to end their attacks with a deadly raid on an israeli army outpost in gaza .

reference_raw: Hamas and other Palestinian militant groups rejected Abbas' call to end the attack by a deadly raid on the Israeli military base in Gaza.

reference_spacy_tokens: Hamas and other Palestinian militant groups rejected Abbas ' call to end the attack by a deadly raid on the Israeli military base in Gaza .


fn_spacy_tokens_for_baseline: Being lazy myself I sometimes conceal them in grass , water or strategic pebbles -- happily often observed like that in any case .

source_bert_toks: being lazy myself i sometimes conceal them in grass , water or strategic pebbles - - happily often observed like that in any case .

reference_raw: When I'm lazy, I sometimes hide them in grass, water, or strategic pebbles - I'm happy to see them in any case.

reference_spacy_tokens: When I 'm lazy , I sometimes hide them in grass , water , or strategic pebbles - I 'm happy to see them in any case .


fn_spacy_tokens_for_baseline: High exhaustivity tends to be a feature of databases indexed automatically on the basis of the text of the document .

source_bert_toks: high exhaust ##ivity tends to be a feature of databases indexed automatically on the basis of the text of the document .

reference_raw: High exhaustivity is usually a feature of databases indexed automatically according to the text of the document.

reference_spacy_tokens: High exhaustivity is usually a feature of databases indexed automatically according to the text of the document .


fn_spacy_tokens_for_baseline: Alice Modes ' windows were plastered with notices : ' Monster Sale ' and ' Everything Must Go ' .

source_bert_toks: alice modes ' windows were plastered with notices : ' monster sale ' and ' everything must go ' .

reference_raw: Alice Modes' windows were filled with notices: 'Monster Sale' and 'All Must Go'.

reference_spacy_tokens: Alice Modes ' windows were filled with notices : ' Monster Sale ' and ' All Must Go ' .


fn_spacy_tokens_for_baseline: Far above in the belfry , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

source_bert_toks: far above in the bel ##fr ##y , the huge bronze bells , mounted on wheels , swing madly through a full 360 degrees , starting and ending , surprisingly , in the inverted , or mouth - up position .

reference_raw: Far above the bells, huge bronze bells, mounted on wheels, swivel madly over the top of the bell, starting and ending, surprisingly, in an upturned or mouth-up position.

reference_spacy_tokens: Far above the bells , huge bronze bells , mounted on wheels , swivel madly over the top of the bell , starting and ending , surprisingly , in an upturned or mouth - up position .


fn_spacy_tokens_for_baseline: Physical needs Politicians have been persuaded to divulge secrets through sex .

source_bert_toks: physical needs politicians have been persuaded to di ##vu ##lge secrets through sex .

reference_raw: Physical needs The politicians were persuaded to reveal secrets through sex.

reference_spacy_tokens: Physical needs The politicians were persuaded to reveal secrets through sex .


fn_spacy_tokens_for_baseline: The ease of use of a screening test will determine its success .

source_bert_toks: the ease of use of a screening test will determine its success .

reference_raw: The ease of use of the screening test determines whether it is successful.

reference_spacy_tokens: The ease of use of the screening test determines whether it is successful .


fn_spacy_tokens_for_baseline: After a brief visit to the United States in 1985 to examine the uses of the new technology , SOGAT concluded that

source_bert_toks: after a brief visit to the united states in 1985 to examine the uses of the new technology , so ##gat concluded that

reference_raw: After a short visit to the United States in 1985 to explore the use of new technologies, SOGAT concluded that

reference_spacy_tokens: After a short visit to the United States in 1985 to explore the use of new technologies , SOGAT concluded that


fn_spacy_tokens_for_baseline: In 1995 we will serve over 850 children and 340 families .

source_bert_toks: in 1995 we will serve over 850 children and 340 families .

reference_raw: We'll be serving more than 850 children and 340 families by 1995.

reference_spacy_tokens: We 'll be serving more than 850 children and 340 families by 1995 .


fn_spacy_tokens_for_baseline: This could put you at risk .

source_bert_toks: this could put you at risk .

reference_raw: That could put you in danger.

reference_spacy_tokens: That could put you in danger .


fn_spacy_tokens_for_baseline: She leaned against the door of her old room .

source_bert_toks: she leaned against the door of her old room .

reference_raw: She braced herself against the door of her old room.

reference_spacy_tokens: She braced herself against the door of her old room .


fn_spacy_tokens_for_baseline: Every other room in the house -- kitchen , bathroom , bedroom , dining room , study -- has its own fixed function that to a certain extent dictates the arrangements within it .

source_bert_toks: every other room in the house - - kitchen , bathroom , bedroom , dining room , study - - has its own fixed function that to a certain extent di ##cta ##tes the arrangements within it .

reference_raw: Every other room in the house - the kitchen, the bathroom, the bedroom, the dining room, the study - has a fixed function of its own which, to some extent, dictates the layout in it.

reference_spacy_tokens: Every other room in the house - the kitchen , the bathroom , the bedroom , the dining room , the study - has a fixed function of its own which , to some extent , dictates the layout in it .


fn_spacy_tokens_for_baseline: THE pressures on the conductor Mark Wigglesworth seem considerable -- his career constantly compared to the early days of Simon Rattle , and the rising star tag firmly attached to his travelling bag .

source_bert_toks: the pressures on the conductor mark wig ##gles ##worth seem considerable - - his career constantly compared to the early days of simon rattle , and the rising star tag firmly attached to his travelling bag .

reference_raw: The pressure on the conductor, Mark Wigglesworth, seems to be considerable-his career constantly compared to Simon Rattle's early days, and the rising star tag fixed firmly on his travel bag.

reference_spacy_tokens: The pressure on the conductor , Mark Wigglesworth , seems to be considerable - his career constantly compared to Simon Rattle 's early days , and the rising star tag fixed firmly on his travel bag .


fn_spacy_tokens_for_baseline: Illegal arms and bomb factories have been set up in many parts of northern India to fuel the conflicts .

source_bert_toks: illegal arms and bomb factories have been set up in many parts of northern india to fuel the conflicts .

reference_raw: In many parts of northern India, illicit weapons and bomb factories were built to fuel conflict.

reference_spacy_tokens: In many parts of northern India , illicit weapons and bomb factories were built to fuel conflict .


fn_spacy_tokens_for_baseline: This is a stout - bodied fish , something like a perch in general proportions , with long , low fins on upper and lower rear of the body ( fin rays finely divide near their ends ) .

source_bert_toks: this is a stout - bodied fish , something like a perch in general proportions , with long , low fins on upper and lower rear of the body ( fin rays finely divide near their ends ) .

reference_raw: It's a stocky fish, something like a perch in general proportions, with long, low flippers on the upper and lower backs of the body (fin rays finely split close to the ends).

reference_spacy_tokens: It 's a stocky fish , something like a perch in general proportions , with long , low flippers on the upper and lower backs of the body ( fin rays finely split close to the ends ) .


fn_spacy_tokens_for_baseline: It is cool outside as I throw a log on the gently breathing embers .

source_bert_toks: it is cool outside as i throw a log on the gently breathing em ##bers .

reference_raw: It's cold out there when I throw a log on the gently breathing coals.

reference_spacy_tokens: It 's cold out there when I throw a log on the gently breathing coals .