fn_spacy_tokens_for_baseline: Faces reddened at the Ministry of Defence when it was revealed that a thief had snatched top - secret documents about the Gulf from an unlocked car on December 17th .

source_bert_toks: faces red ##dened at the ministry of defence when it was revealed that a thief had snatched top - secret documents about the gulf from an unlocked car on december 17th .

reference_raw: The faces of the Ministry of Defence were reddened when it was discovered that on December 17, a thief had stolen top-secret documents about the Gulf from an unlocked car.

reference_spacy_tokens: The faces of the Ministry of Defence were reddened when it was discovered that on December 17 , a thief had stolen top - secret documents about the Gulf from an unlocked car .


fn_spacy_tokens_for_baseline: She was shortish and had an attractive way of cocking her head on one side and looking up with big dark eyes and a wryly amused smile .

source_bert_toks: she was short ##ish and had an attractive way of cock ##ing her head on one side and looking up with big dark eyes and a wryly amused smile .

reference_raw: She was short and had an attractive way of cocking her head to one side and looking up with big dark eyes and a wry smile.

reference_spacy_tokens: She was short and had an attractive way of cocking her head to one side and looking up with big dark eyes and a wry smile .


fn_spacy_tokens_for_baseline: A SURVEY reveals that the most common gift of underwear from men to women this Christmas will be French knickers .

source_bert_toks: a survey reveals that the most common gift of underwear from men to women this christmas will be french kn ##ick ##ers .

reference_raw: The SURVEY reveals that the most common gift of underwear from a man to a woman this Christmas is French panties.

reference_spacy_tokens: The SURVEY reveals that the most common gift of underwear from a man to a woman this Christmas is French panties .


fn_spacy_tokens_for_baseline: There was line to be seen around it .

source_bert_toks: there was line to be seen around it .

reference_raw: There was a line to be seen about him.

reference_spacy_tokens: There was a line to be seen about him .


fn_spacy_tokens_for_baseline: ' Only male contempt for women as a class perpetuates the present system .

source_bert_toks: ' only male contempt for women as a class per ##pet ##uate ##s the present system .

reference_raw: 'Only male disdain for women as a class perpetuates the current system.

reference_spacy_tokens: ' Only male disdain for women as a class perpetuates the current system .


fn_spacy_tokens_for_baseline: A riposte to that argument was provided by Sea Containers , the shipping group headed by James Sherwood .

source_bert_toks: a rip ##ost ##e to that argument was provided by sea containers , the shipping group headed by james sherwood .

reference_raw: Sea Containers, a shipping group led by James Sherwood, provided a ripost to this argument.

reference_spacy_tokens: Sea Containers , a shipping group led by James Sherwood , provided a ripost to this argument .


fn_spacy_tokens_for_baseline: He took the seat to which Carson had gestured him and glanced at the message slip .

source_bert_toks: he took the seat to which carson had gestured him and glanced at the message slip .

reference_raw: He sat down in the chair Carson had motioned to him and looked at the message slip.

reference_spacy_tokens: He sat down in the chair Carson had motioned to him and looked at the message slip .


fn_spacy_tokens_for_baseline: He wanted to ask her so many things , but was wary of frightening her any more than he had already .

source_bert_toks: he wanted to ask her so many things , but was wary of frightening her any more than he had already .

reference_raw: He wanted to ask her a lot of questions, but he was more careful than ever to scare her.

reference_spacy_tokens: He wanted to ask her a lot of questions , but he was more careful than ever to scare her .


fn_spacy_tokens_for_baseline: He kissed her fingertips again .

source_bert_toks: he kissed her fingertips again .

reference_raw: He kissed her fingers again.

reference_spacy_tokens: He kissed her fingers again .


fn_spacy_tokens_for_baseline: Newspaper reporters do this all the time and what is often these days called ' investigative journalism ' may use teams of interviewers who together write up full - page reports on chosen topics .

source_bert_toks: newspaper reporters do this all the time and what is often these days called ' investigative journalism ' may use teams of interview ##ers who together write up full - page reports on chosen topics .

reference_raw: Newspaper reporters do this all the time, and what is often referred to as "investigative journalism" these days can use a team of interviewers who, together, produce a full-page report on selected topics.

reference_spacy_tokens: Newspaper reporters do this all the time , and what is often referred to as " investigative journalism " these days can use a team of interviewers who , together , produce a full - page report on selected topics .


fn_spacy_tokens_for_baseline: Israel retaliated on Hamas , namely Al - rantissi , it missed him and killed civilians .

source_bert_toks: israel re ##tal ##iated on hamas , namely al - ran ##tis ##si , it missed him and killed civilians .

reference_raw: Israel retaliated against Hamas, that is to say, Al-Rantissi, lost him and killed civilians.

reference_spacy_tokens: Israel retaliated against Hamas , that is to say , Al - Rantissi , lost him and killed civilians .


fn_spacy_tokens_for_baseline: In addition to thousands of artillery rounds , hundreds of forward deployed Scud - B , Frog-5 and Frog-7 missiles , plus about 30 Scud - C missiles could be armed with chemical warheads .

source_bert_toks: in addition to thousands of artillery rounds , hundreds of forward deployed sc ##ud - b , frog - 5 and frog - 7 missiles , plus about 30 sc ##ud - c missiles could be armed with chemical war ##heads .

reference_raw: In addition to thousands of artillery rounds, hundreds of forward Scud-B, Frog-5 and Frog-7 missiles, plus about thirty Scud-C missiles, could be armed with chemical missiles.

reference_spacy_tokens: In addition to thousands of artillery rounds , hundreds of forward Scud - B , Frog-5 and Frog-7 missiles , plus about thirty Scud - C missiles , could be armed with chemical missiles .


fn_spacy_tokens_for_baseline: The incident also raised troubling new questions about the insurgents ' ability to shoot down helicopters , upon which the NATO force relies heavily for moving troops and cargo .

source_bert_toks: the incident also raised tr ##ou ##bling new questions about the insurgents ' ability to shoot down helicopters , upon which the nato force relies heavily for moving troops and cargo .

reference_raw: The incident also raised disturbing new questions about the rebels' ability to fire down helicopters, on which NATO forces rely heavily on moving troops and cargo.

reference_spacy_tokens: The incident also raised disturbing new questions about the rebels ' ability to fire down helicopters , on which NATO forces rely heavily on moving troops and cargo .


fn_spacy_tokens_for_baseline: Secord was North 's operations manager , a stocky ex - general in his early fifties , much decorated , and with a notable bluntness of manner .

source_bert_toks: sec ##ord was north ' s operations manager , a stock ##y ex - general in his early fifties , much decorated , and with a notable blunt ##ness of manner .

reference_raw: Secord was North's operations manager, a stocky ex-general in his early fifties, well decorated, and with a remarkable audacity.

reference_spacy_tokens: Secord was North 's operations manager , a stocky ex - general in his early fifties , well decorated , and with a remarkable audacity .


fn_spacy_tokens_for_baseline: So I got caned on the palms of my hands .

source_bert_toks: so i got cane ##d on the palms of my hands .

reference_raw: That's why I got sticks on my hands.

reference_spacy_tokens: That 's why I got sticks on my hands .


fn_spacy_tokens_for_baseline: He rubbed the muzzle of a horse when it nosed up to him , and scratched its ears .

source_bert_toks: he rubbed the muzzle of a horse when it nosed up to him , and scratched its ears .

reference_raw: As he nosed toward him, he rubbed his horse's mouth and scratched his ears.

reference_spacy_tokens: As he nosed toward him , he rubbed his horse 's mouth and scratched his ears .


fn_spacy_tokens_for_baseline: 2- Disputes related to AL - QAEDA missions between member brethren should be judged by qualified personnel , which is carried out by the immediate commander ( Amir ) of the conflicting parties .

source_bert_toks: 2 - disputes related to al - qaeda missions between member brethren should be judged by qualified personnel , which is carried out by the immediate commander ( amir ) of the conflicting parties .

reference_raw: 2-Disputes relating to AL-QAEDA missions between Members' brothers should be assessed by qualified personnel, carried out by the immediate commander (Amir) of the Conflicting Participants.

reference_spacy_tokens: 2-Disputes relating to AL - QAEDA missions between Members ' brothers should be assessed by qualified personnel , carried out by the immediate commander ( Amir ) of the Conflicting Participants .


fn_spacy_tokens_for_baseline: Tremayne and Mackie appeared mystified but Sam immediately understood and looked thunderstruck .

source_bert_toks: tre ##may ##ne and mack ##ie appeared my ##sti ##fied but sam immediately understood and looked thunder ##st ##ruck .

reference_raw: Tremayne and Mackie looked confused, but Sam understood at once and looked stormy.

reference_spacy_tokens: Tremayne and Mackie looked confused , but Sam understood at once and looked stormy .


fn_spacy_tokens_for_baseline: But I was actually asked by my friend at work , who said to me , would you be interested in having the ACLU contact you , and I said yes .

source_bert_toks: but i was actually asked by my friend at work , who said to me , would you be interested in having the ac ##lu contact you , and i said yes .

reference_raw: But in fact, a friend of mine at the office asked me if you'd like to be contacted by the ACLU, and I said yes.

reference_spacy_tokens: But in fact , a friend of mine at the office asked me if you 'd like to be contacted by the ACLU , and I said yes .


fn_spacy_tokens_for_baseline: They failed to see that the principle of subsidiarity as interpreted was inadequate to a modern society .

source_bert_toks: they failed to see that the principle of sub ##si ##dia ##rity as interpreted was inadequate to a modern society .

reference_raw: They did not see that the principle of subsidiarity, as interpreted, was not sufficient for a contemporary society.

reference_spacy_tokens: They did not see that the principle of subsidiarity , as interpreted , was not sufficient for a contemporary society .


fn_spacy_tokens_for_baseline: Charlie laughed , and gently cuffed him on the head .

source_bert_toks: charlie laughed , and gently cuff ##ed him on the head .

reference_raw: Charlie laughed and clasped his head gently.

reference_spacy_tokens: Charlie laughed and clasped his head gently .


fn_spacy_tokens_for_baseline: Short and square , with greasy black hair and a Van Dyke beard , he wore a sea - green smoking - jacket over a frilled shirt and wine - coloured velvet breeches .

source_bert_toks: short and square , with greasy black hair and a van dyke beard , he wore a sea - green smoking - jacket over a fr ##ille ##d shirt and wine - coloured velvet bree ##ches .

reference_raw: He was short and square, with greasy black hair and a Van Dyke beard, wearing a sea-green smoke jacket over a frilled shirt and wine-colored velvet pants.

reference_spacy_tokens: He was short and square , with greasy black hair and a Van Dyke beard , wearing a sea - green smoke jacket over a frilled shirt and wine - colored velvet pants .


fn_spacy_tokens_for_baseline: A disconcerting , even shameful thought had taken possession .

source_bert_toks: a disco ##nce ##rting , even shame ##ful thought had taken possession .

reference_raw: A disquieting, even disgraceful thought took over.

reference_spacy_tokens: A disquieting , even disgraceful thought took over .


fn_spacy_tokens_for_baseline: America is a road movie that suggests the impossibility of travel ; perhaps Brooks conceived of The Muse as a movie about the creative spirit that would subversively suggest the impossibility -- at least in Hollywood -- of creation .

source_bert_toks: america is a road movie that suggests the imp ##oss ##ibility of travel ; perhaps brooks conceived of the muse as a movie about the creative spirit that would sub ##vers ##ively suggest the imp ##oss ##ibility - - at least in hollywood - - of creation .

reference_raw: America is a road film that shows that it is impossible to travel; perhaps Brooks thought of the Muse as a film of the creative spirit that would subversively indicate that it was impossible, at least in Hollywood, to create.

reference_spacy_tokens: America is a road film that shows that it is impossible to travel ; perhaps Brooks thought of the Muse as a film of the creative spirit that would subversively indicate that it was impossible , at least in Hollywood , to create .


fn_spacy_tokens_for_baseline: The all Wales figures above exclude substantial payments under the FHDS .

source_bert_toks: the all wales figures above exclude substantial payments under the f ##hd ##s .

reference_raw: All the figures in Wales above do not include significant FHDS payments.

reference_spacy_tokens: All the figures in Wales above do not include significant FHDS payments .


fn_spacy_tokens_for_baseline: Well , it was tiny for a trampoline , but it looked far too big to push inside a person .

source_bert_toks: well , it was tiny for a tram ##pol ##ine , but it looked far too big to push inside a person .

reference_raw: It was small for a trampoline, but it looked too big to push inside.

reference_spacy_tokens: It was small for a trampoline , but it looked too big to push inside .


fn_spacy_tokens_for_baseline: That message and all subsequent attempts to contact the flight were not acknowledged .

source_bert_toks: that message and all subsequent attempts to contact the flight were not acknowledged .

reference_raw: This message and any subsequent attempts to contact the flight were not accepted.

reference_spacy_tokens: This message and any subsequent attempts to contact the flight were not accepted .


fn_spacy_tokens_for_baseline: I led Naomi firmly to a little gazebo in front of the house , sat her on the bench and tied up the knee with my handkerchief .

source_bert_toks: i led naomi firmly to a little gaze ##bo in front of the house , sat her on the bench and tied up the knee with my handkerchief .

reference_raw: I led Naomi firmly to the small cubicle in front of the house, put her on the bench, and tied her knee with a handkerchief.

reference_spacy_tokens: I led Naomi firmly to the small cubicle in front of the house , put her on the bench , and tied her knee with a handkerchief .


fn_spacy_tokens_for_baseline: Once there I handed out the packs and sat waiting for approval .

source_bert_toks: once there i handed out the packs and sat waiting for approval .

reference_raw: As soon as I was there, I gave up my packs and sat waiting to be approved.

reference_spacy_tokens: As soon as I was there , I gave up my packs and sat waiting to be approved .


fn_spacy_tokens_for_baseline: But when Suleiman died , his empire , including Jerusalem , began a long period of decline .

source_bert_toks: but when sul ##eim ##an died , his empire , including jerusalem , began a long period of decline .

reference_raw: But after Suleiman's death, his empire, including Jerusalem, began a long period of decay.

reference_spacy_tokens: But after Suleiman 's death , his empire , including Jerusalem , began a long period of decay .


fn_spacy_tokens_for_baseline: Diplomats in Zagreb have said the crucial peace deal between the Serb insurgents in control of the easternmost sliver of land and the government in Zagreb during the Dayton talks opened the way to the mutual recognition .

source_bert_toks: diplomats in zagreb have said the crucial peace deal between the serb insurgents in control of the eastern ##most sl ##iver of land and the government in zagreb during the dayton talks opened the way to the mutual recognition .

reference_raw: The diplomats in Zagreb said that the key peace agreement between the Serb rebels who controlled the most eastern part of the country and the government in Zagreb during the Dayton talks opened the way for mutual recognition.

reference_spacy_tokens: The diplomats in Zagreb said that the key peace agreement between the Serb rebels who controlled the most eastern part of the country and the government in Zagreb during the Dayton talks opened the way for mutual recognition .


fn_spacy_tokens_for_baseline: But he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

source_bert_toks: but he was as cunning as he was cruel , and at the first whisper of coming trouble he had secretly conveyed his treasures aboard a ship which was manned by devoted adherents .

reference_raw: But he was as shrewd as he was cruel, and at the first whisper of trouble he secretly conveyed his treasures aboard a ship manned by loyal followers.

reference_spacy_tokens: But he was as shrewd as he was cruel , and at the first whisper of trouble he secretly conveyed his treasures aboard a ship manned by loyal followers .


fn_spacy_tokens_for_baseline: Bathed in a delicate self - importance , he held himself in high esteem as the bearer of one of Italy 's oldest titles .

source_bert_toks: bathed in a delicate self - importance , he held himself in high esteem as the bearer of one of italy ' s oldest titles .

reference_raw: He was bathed in a delicate self-importance and held himself with great respect as the bearer of one of the oldest Italian titles.

reference_spacy_tokens: He was bathed in a delicate self - importance and held himself with great respect as the bearer of one of the oldest Italian titles .


fn_spacy_tokens_for_baseline: His co - defendant , Frank ' Frankie Locs ' Locascio , was also sentenced to life imprisonment ; both men were also fined $ 250,000 .

source_bert_toks: his co - defendant , frank ' frankie lo ##cs ' lo ##cas ##cio , was also sentenced to life imprisonment ; both men were also fined $ 250 , 000 .

reference_raw: His co-defendant, Frank's Frankie Locascio, was also convicted of life imprisonment; both men were fined $250,000.

reference_spacy_tokens: His co - defendant , Frank 's Frankie Locascio , was also convicted of life imprisonment ; both men were fined $ 250,000 .


fn_spacy_tokens_for_baseline: Meg was squatting at the top of the stairs , her hands clutching the third and fourth struts tightly , her eyes wide , filled with fright .

source_bert_toks: meg was squat ##ting at the top of the stairs , her hands clutching the third and fourth st ##rut ##s tightly , her eyes wide , filled with fright .

reference_raw: Meg crouched at the top of the stairs, her hands clasped tightly to the third and fourth struts, her eyes wide and full of fear.

reference_spacy_tokens: Meg crouched at the top of the stairs , her hands clasped tightly to the third and fourth struts , her eyes wide and full of fear .


fn_spacy_tokens_for_baseline: ' While it has not been determined if enemy fire was the sole reason for the helicopter crash , it did take fire from several insurgent locations on its approach , ' the ISAF statement said .

source_bert_toks: ' while it has not been determined if enemy fire was the sole reason for the helicopter crash , it did take fire from several ins ##urgent locations on its approach , ' the isa ##f statement said .

reference_raw: "While it has not been established whether enemy fire was the only cause of the helicopter crash, it was fired from several rebel sites on its approach," said the ISAF.

reference_spacy_tokens: " While it has not been established whether enemy fire was the only cause of the helicopter crash , it was fired from several rebel sites on its approach , " said the ISAF .


fn_spacy_tokens_for_baseline: The dragonflies beat their two wings synchronously , but this makes for very considerable physiological complexities .

source_bert_toks: the dragon ##flies beat their two wings sync ##hr ##ono ##usly , but this makes for very considerable physiological complex ##ities .

reference_raw: Dragonflies beat each other's flanks in a synchronous fashion, but that creates a very significant physiological complexion.

reference_spacy_tokens: Dragonflies beat each other 's flanks in a synchronous fashion , but that creates a very significant physiological complexion .


fn_spacy_tokens_for_baseline: Perhaps some of the most encouraging experimental results started with the work carried out in Switzerland by W. Pelikan and G. Unger , and published in English in 1965 .

source_bert_toks: perhaps some of the most encouraging experimental results started with the work carried out in switzerland by w . pe ##lika ##n and g . un ##ger , and published in english in 1965 .

reference_raw: Perhaps some of the most stimulating experimental results began with the work carried out by W. Pelikan and G. Unger in Switzerland and published in English in 1965.

reference_spacy_tokens: Perhaps some of the most stimulating experimental results began with the work carried out by W. Pelikan and G. Unger in Switzerland and published in English in 1965 .


fn_spacy_tokens_for_baseline: One of DEC 's principal Alpha RISC architects , Richard Witek , has reportedly bolted to Apple Computer Inc.

source_bert_toks: one of dec ' s principal alpha ri ##sc architects , richard wit ##ek , has reportedly bolted to apple computer inc .

reference_raw: One of the main architects of the DEC Alpha RISC, Richard Witek, is reportedly connected to Apple Computer Inc.

reference_spacy_tokens: One of the main architects of the DEC Alpha RISC , Richard Witek , is reportedly connected to Apple Computer Inc.


fn_spacy_tokens_for_baseline: ' Call the newspapers , ' she croaked , ' I 've just broken every bloody speed record in swimming .

source_bert_toks: ' call the newspapers , ' she cr ##oa ##ked , ' i ' ve just broken every bloody speed record in swimming .

reference_raw: "Call the papers," she groaned, "I just broke every damn speed record in the swim.

reference_spacy_tokens: " Call the papers , " she groaned , " I just broke every damn speed record in the swim .


fn_spacy_tokens_for_baseline: The resulting confusion entails a highly inaccurate assessment of the extent of Soviet control over the diverse groups in Latin America which claim a ' Marxist ' orientation .

source_bert_toks: the resulting confusion en ##tails a highly inaccurate assessment of the extent of soviet control over the diverse groups in latin america which claim a ' marxist ' orientation .

reference_raw: The resulting confusion leads to a very imprecise assessment of the extent of Soviet control over the various groups in Latin America claiming a "Marxist" orientation.

reference_spacy_tokens: The resulting confusion leads to a very imprecise assessment of the extent of Soviet control over the various groups in Latin America claiming a " Marxist " orientation .


fn_spacy_tokens_for_baseline: Mohammed Mohaddesin , leader of the Iran with IAEA

source_bert_toks: mohammed mo ##had ##des ##in , leader of the iran with ia ##ea

reference_raw: Mohammed Mohaddesin, Head of Iran with the International Atomic Energy Agency (IAEA)

reference_spacy_tokens: Mohammed Mohaddesin , Head of Iran with the International Atomic Energy Agency ( IAEA )


fn_spacy_tokens_for_baseline: She was running out of time and courage as it was , she admitted as she leaned into the wardrobe , searching for a pair of navy espadrilles .

source_bert_toks: she was running out of time and courage as it was , she admitted as she leaned into the wardrobe , searching for a pair of navy es ##pad ##rill ##es .

reference_raw: She was running out of time and courage, she admitted, as she bent into the closet, looking for a pair of Navy espadrilles.

reference_spacy_tokens: She was running out of time and courage , she admitted , as she bent into the closet , looking for a pair of Navy espadrilles .


fn_spacy_tokens_for_baseline: The graduate assignments the following year were reportedly very disappointing , with a disproportionate number being sent to rural areas .

source_bert_toks: the graduate assignments the following year were reportedly very disappointing , with a di ##sp ##rop ##ort ##ion ##ate number being sent to rural areas .

reference_raw: Graduate assignments in the following year were reportedly very unsatisfactory and a disproportionate number were sent to rural areas.

reference_spacy_tokens: Graduate assignments in the following year were reportedly very unsatisfactory and a disproportionate number were sent to rural areas .


fn_spacy_tokens_for_baseline: She opened her eyes again , winked at Therese .

source_bert_toks: she opened her eyes again , winked at therese .

reference_raw: She opened her eyes again and glanced at Theresa.

reference_spacy_tokens: She opened her eyes again and glanced at Theresa .


fn_spacy_tokens_for_baseline: The remaining two thirds are spent in stimulating ideas , planning , and creative activities so that growth in skills and concepts goes hand in hand with increased knowledge .

source_bert_toks: the remaining two thirds are spent in stimulating ideas , planning , and creative activities so that growth in skills and concepts goes hand in hand with increased knowledge .

reference_raw: The remaining two-thirds are spent on encouraging ideas, planning and creative activities, so that the growth of skills and concepts goes hand in hand with increased knowledge.

reference_spacy_tokens: The remaining two - thirds are spent on encouraging ideas , planning and creative activities , so that the growth of skills and concepts goes hand in hand with increased knowledge .


fn_spacy_tokens_for_baseline: His most nefarious recorded act was to defame York 's new wife Anne Hyde [ q.v . ] , in the hope of dissolving the marriage , which many considered to be a disaster .

source_bert_toks: his most ne ##far ##ious recorded act was to def ##ame york ' s new wife anne hyde [ q . v . ] , in the hope of di ##sso ##lving the marriage , which many considered to be a disaster .

reference_raw: His most unremarkable act was to dishonor York's new wife, Anne Hyde [Q.V.], in the hope of dissolving a marriage that many considered a disaster.

reference_spacy_tokens: His most unremarkable act was to dishonor York 's new wife , Anne Hyde [ Q.V. ] , in the hope of dissolving a marriage that many considered a disaster .


fn_spacy_tokens_for_baseline: ' When a couple split up , the woman gets possession of the children , but the man gets possession of the money .

source_bert_toks: ' when a couple split up , the woman gets possession of the children , but the man gets possession of the money .

reference_raw: 'When a couple break up, a woman gets the kids, but a man gets the money.

reference_spacy_tokens: ' When a couple break up , a woman gets the kids , but a man gets the money .


fn_spacy_tokens_for_baseline: Doctor Bailey was then a young man in his twenties , newly qualified and recently married and settled in this his first practice .

source_bert_toks: doctor bailey was then a young man in his twenties , newly qualified and recently married and settled in this his first practice .

reference_raw: Dr. Bailey was then a young man in his early twenties, newly qualified and recently wedded, and settled in on his first practice.

reference_spacy_tokens: Dr. Bailey was then a young man in his early twenties , newly qualified and recently wedded , and settled in on his first practice .


fn_spacy_tokens_for_baseline: In 1994 , during heightened tensions over North Korea 's nuclear weapons program , the DPRK threatened to turn Seoul into a " sea of fire . "

source_bert_toks: in 1994 , during heightened tensions over north korea ' s nuclear weapons program , the d ##pr ##k threatened to turn seoul into a " sea of fire . "

reference_raw: In 1994, during the heightened tensions over North Korea's nuclear-weapons program, the DPRK risked turning Seoul into a sea of fire.

reference_spacy_tokens: In 1994 , during the heightened tensions over North Korea 's nuclear - weapons program , the DPRK risked turning Seoul into a sea of fire .


fn_spacy_tokens_for_baseline: It may not go with a tableful of curry , but a mug of cold beer is not what I need .

source_bert_toks: it may not go with a table ##ful of curry , but a mug of cold beer is not what i need .

reference_raw: It doesn't have to go with a table full of curry, but I don't need a cup of cold beer.

reference_spacy_tokens: It does n't have to go with a table full of curry , but I do n't need a cup of cold beer .


fn_spacy_tokens_for_baseline: For sublanguage processing this may prove to be extremely useful if a large ( raw ) corpus is available , since the word classification will be specifically for that sublanguage type .

source_bert_toks: for sub ##lang ##ua ##ge processing this may prove to be extremely useful if a large ( raw ) corpus is available , since the word classification will be specifically for that sub ##lang ##ua ##ge type .

reference_raw: In the case of sublanguage processing, this can be very useful if a large (raw) corpus is available, as the nomenclature of the words will be specific to this sublanguage type.

reference_spacy_tokens: In the case of sublanguage processing , this can be very useful if a large ( raw ) corpus is available , as the nomenclature of the words will be specific to this sublanguage type .


fn_spacy_tokens_for_baseline: He edged backwards to the wall .

source_bert_toks: he edged backwards to the wall .

reference_raw: He leaned back against the wall.

reference_spacy_tokens: He leaned back against the wall .


fn_spacy_tokens_for_baseline: As mentioned , IBM has opted for the mouse stick in the middle of the keyboard instead of the little trackball or the little panel you diddle with your finger .

source_bert_toks: as mentioned , ibm has opted for the mouse stick in the middle of the keyboard instead of the little track ##ball or the little panel you did ##dle with your finger .

reference_raw: As mentioned above, IBM chose a mouse stick in the middle of the keyboard instead of a small trackball or a small panel that you used to do it with your thumb.

reference_spacy_tokens: As mentioned above , IBM chose a mouse stick in the middle of the keyboard instead of a small trackball or a small panel that you used to do it with your thumb .


fn_spacy_tokens_for_baseline: Here again , despite the relatively small sample , we can answer the question by looking at other libraries .

source_bert_toks: here again , despite the relatively small sample , we can answer the question by looking at other libraries .

reference_raw: Here again, in spite of a relatively small sample, we can respond to this question by looking at other libraries.

reference_spacy_tokens: Here again , in spite of a relatively small sample , we can respond to this question by looking at other libraries .


fn_spacy_tokens_for_baseline: The wood fibres are blown apart , but remain glued together at many individual points by the set resin , or connected by viscous strings of it if it has not quite set .

source_bert_toks: the wood fibre ##s are blown apart , but remain glued together at many individual points by the set resin , or connected by vis ##cous strings of it if it has not quite set .

reference_raw: The wood fibres are torn apart, but they are stuck together at many different points by the resin of the set, or attached by its viscous strings, unless they are fully set.

reference_spacy_tokens: The wood fibres are torn apart , but they are stuck together at many different points by the resin of the set , or attached by its viscous strings , unless they are fully set .


fn_spacy_tokens_for_baseline: THE self - confessed murderer of 55 girls , women and boys faced his victims ' relatives yesterday on the opening day of a trial which will enter legal and medical history .

source_bert_toks: the self - confessed murderer of 55 girls , women and boys faced his victims ' relatives yesterday on the opening day of a trial which will enter legal and medical history .

reference_raw: A self-confessed killer of 55 girls, women and boys confronted the relatives of his victims on the opening day of a trial that would enter legal and medical history.

reference_spacy_tokens: A self - confessed killer of 55 girls , women and boys confronted the relatives of his victims on the opening day of a trial that would enter legal and medical history .


fn_spacy_tokens_for_baseline: Yet the best the far - left could do was not enough to deter the biggest voting bloc -- nearly 40 % -- from endorsing the direction Spain is taking .

source_bert_toks: yet the best the far - left could do was not enough to deter the biggest voting bloc - - nearly 40 % - - from end ##ors ##ing the direction spain is taking .

reference_raw: But the best the far left could do was not enough to deter the largest voting block - almost 40% - from supporting the direction Spain is taking.

reference_spacy_tokens: But the best the far left could do was not enough to deter the largest voting block - almost 40 % - from supporting the direction Spain is taking .


fn_spacy_tokens_for_baseline: I sauntered about for an hour before I could find Sir James Macdonald .

source_bert_toks: i sa ##unt ##ered about for an hour before i could find sir james macdonald .

reference_raw: I ran for an hour to find Sir James Macdonald.

reference_spacy_tokens: I ran for an hour to find Sir James Macdonald .


fn_spacy_tokens_for_baseline: Turning towards him , she gabbled , ' Feargal , I . '

source_bert_toks: turning towards him , she ga ##bbled , ' fear ##gal , i . '

reference_raw: She turned to him and said, "Feargal, I-"

reference_spacy_tokens: She turned to him and said , " Feargal , I- "


fn_spacy_tokens_for_baseline: His eyes glittered fiercely .

source_bert_toks: his eyes glitter ##ed fiercely .

reference_raw: His eyes gleamed wildly.

reference_spacy_tokens: His eyes gleamed wildly .


fn_spacy_tokens_for_baseline: I swilled down the half - pint of champagne as if it was bitter lemon .

source_bert_toks: i sw ##ille ##d down the half - pin ##t of champagne as if it was bitter lemon .

reference_raw: I sipped down half a pint of champagne as if it were a bitter lemon.

reference_spacy_tokens: I sipped down half a pint of champagne as if it were a bitter lemon .


fn_spacy_tokens_for_baseline: With that authority , of course , goes an unambiguous accountability .

source_bert_toks: with that authority , of course , goes an una ##mb ##ig ##uous accountability .

reference_raw: With this authority, of course, there is a clear responsibility.

reference_spacy_tokens: With this authority , of course , there is a clear responsibility .


fn_spacy_tokens_for_baseline: Australia 's hand would be the first to shoot up with New Zealand not far behind , both of them , of course , recent victors over England .

source_bert_toks: australia ' s hand would be the first to shoot up with new zealand not far behind , both of them , of course , recent victor ##s over england .

reference_raw: Australia's hand will be the first to shoot at New Zealand nearby, both of which, of course, are the recent winners of England.

reference_spacy_tokens: Australia 's hand will be the first to shoot at New Zealand nearby , both of which , of course , are the recent winners of England .


fn_spacy_tokens_for_baseline: They should not export them without first getting permission from the importer and making sure that the receiving country can dispose of them properly .

source_bert_toks: they should not export them without first getting permission from the import ##er and making sure that the receiving country can dispose of them properly .

reference_raw: They should not export them without first obtaining authorisation from the importer and ensuring that the recipient country can properly dispose of them.

reference_spacy_tokens: They should not export them without first obtaining authorisation from the importer and ensuring that the recipient country can properly dispose of them .


fn_spacy_tokens_for_baseline: The journey was taken at a leisurely pace because of the trailer , yet , despite her dejection , Matt 's reminiscences caused it to pass rapidly .

source_bert_toks: the journey was taken at a leisure ##ly pace because of the trailer , yet , despite her de ##ject ##ion , matt ' s re ##mini ##sc ##ence ##s caused it to pass rapidly .

reference_raw: The trail had been taken at a leisurely pace because of the trailer, but despite her depression, Matt's memory had caused her to pass quickly.

reference_spacy_tokens: The trail had been taken at a leisurely pace because of the trailer , but despite her depression , Matt 's memory had caused her to pass quickly .


fn_spacy_tokens_for_baseline: The mad moon flares from behind the racing clouds .

source_bert_toks: the mad moon flare ##s from behind the racing clouds .

reference_raw: The mad moon glows from behind the racing clouds.

reference_spacy_tokens: The mad moon glows from behind the racing clouds .


fn_spacy_tokens_for_baseline: The test is what to do when a deadly sarin gas has been released in a meeting room infecting dozens .

source_bert_toks: the test is what to do when a deadly sar ##in gas has been released in a meeting room in ##fect ##ing dozens .

reference_raw: The test is what is to be done when a lethal sarin gas is released in a conference room that infects scores of people.

reference_spacy_tokens: The test is what is to be done when a lethal sarin gas is released in a conference room that infects scores of people .


fn_spacy_tokens_for_baseline: A stream trickled artificially , and birds were singing .

source_bert_toks: a stream trickle ##d artificial ##ly , and birds were singing .

reference_raw: The stream flowed artificially, and the birds sang.

reference_spacy_tokens: The stream flowed artificially , and the birds sang .


fn_spacy_tokens_for_baseline: THOSE once jealously guarded holy vestments , international rugby jerseys , are now sold - figuratively but , my word , certainly not in fact - ten a penny .

source_bert_toks: those once jealous ##ly guarded holy vest ##ments , international rugby jerseys , are now sold - figurative ##ly but , my word , certainly not in fact - ten a penny .

reference_raw: THOSE, once jealously guarded sacred vests, international rugby uniforms, are now sold - figuratively, but, I'm sure, not really - ten cents.

reference_spacy_tokens: THOSE , once jealously guarded sacred vests , international rugby uniforms , are now sold - figuratively , but , I 'm sure , not really - ten cents .


fn_spacy_tokens_for_baseline: Solbourne is figuring it 'll ship its Viking - based Series 6 in the fourth quarter .

source_bert_toks: sol ##bourne is figuring it ' ll ship its viking - based series 6 in the fourth quarter .

reference_raw: Solbourne thinks he's going to send his Viking series 6 in the fourth quarter.

reference_spacy_tokens: Solbourne thinks he 's going to send his Viking series 6 in the fourth quarter .


fn_spacy_tokens_for_baseline: They guarded their independence fiercely and neither Chris nor I dared ask too often how much progress was being made .

source_bert_toks: they guarded their independence fiercely and neither chris nor i dared ask too often how much progress was being made .

reference_raw: They were fiercely guarding their independence, and neither Chris nor I ventured to ask too often how much progress had been made.

reference_spacy_tokens: They were fiercely guarding their independence , and neither Chris nor I ventured to ask too often how much progress had been made .


fn_spacy_tokens_for_baseline: Not really , is it ? ' he asked apprehensively as the moon appeared to swing from the side window to the rear .

source_bert_toks: not really , is it ? ' he asked app ##re ##hen ##sive ##ly as the moon appeared to swing from the side window to the rear .

reference_raw: Not really, is it?" he asked anxiously, as the moon seemed to turn from the side window to the back.

reference_spacy_tokens: Not really , is it ? " he asked anxiously , as the moon seemed to turn from the side window to the back .


fn_spacy_tokens_for_baseline: Eline asked , suddenly excited at the prospect of visiting the greatest boot and shoe maker in the country .

source_bert_toks: eli ##ne asked , suddenly excited at the prospect of visiting the greatest boot and shoe maker in the country .

reference_raw: Eline asked, suddenly excited to see the best shoe and shoe maker in the country.

reference_spacy_tokens: Eline asked , suddenly excited to see the best shoe and shoe maker in the country .


fn_spacy_tokens_for_baseline: As a child I made these , covering the kitchen in ingredients and allowing balls of mixture to roll all over the place , only to be found six months later behind the toaster .

source_bert_toks: as a child i made these , covering the kitchen in ingredients and allowing balls of mixture to roll all over the place , only to be found six months later behind the toast ##er .

reference_raw: When I was a kid, I made this, I covered the kitchen with ingredients, and I let the balls of mix go all over the place, only six months later I found them behind the toaster.

reference_spacy_tokens: When I was a kid , I made this , I covered the kitchen with ingredients , and I let the balls of mix go all over the place , only six months later I found them behind the toaster .


fn_spacy_tokens_for_baseline: Officers planned to question every passenger on the fans ' train .

source_bert_toks: officers planned to question every passenger on the fans ' train .

reference_raw: The officers were planning to interview all the passengers on the fan train.

reference_spacy_tokens: The officers were planning to interview all the passengers on the fan train .


fn_spacy_tokens_for_baseline: When she saw me , she smiled and put a finger to her lips , motioning silence .

source_bert_toks: when she saw me , she smiled and put a finger to her lips , motion ##ing silence .

reference_raw: When she saw me, she smiled and put her finger to her lips and gestured for silence.

reference_spacy_tokens: When she saw me , she smiled and put her finger to her lips and gestured for silence .


fn_spacy_tokens_for_baseline: Rachel was hunting in her bag for a twenty - dollar bill .

source_bert_toks: rachel was hunting in her bag for a twenty - dollar bill .

reference_raw: Rachel chased in a bag for a twenty-dollar bill.

reference_spacy_tokens: Rachel chased in a bag for a twenty - dollar bill .


fn_spacy_tokens_for_baseline: QN : Does the U.S. want the threat posed by Russia 's weapons of mass destruction to be reduced ?

source_bert_toks: q ##n : does the u . s . want the threat posed by russia ' s weapons of mass destruction to be reduced ?

reference_raw: QN: Does the US want to diminish the threat posed by Russian weapons of mass destruction?

reference_spacy_tokens: QN : Does the US want to diminish the threat posed by Russian weapons of mass destruction ?


fn_spacy_tokens_for_baseline: ' Outstanding my foot , ' Myra said , jabbing a pin into Claudia 's leg in her indignation .

source_bert_toks: ' outstanding my foot , ' myra said , ja ##bbing a pin into claudia ' s leg in her ind ##ign ##ation .

reference_raw: 'I'm out of my leg,' Myra said, thrusting a pin into Claudia's leg in exasperation.

reference_spacy_tokens: ' I 'm out of my leg , ' Myra said , thrusting a pin into Claudia 's leg in exasperation .


fn_spacy_tokens_for_baseline: A string of multi - coloured lights gleamed beneath the overhanging thatch and bright yellow light was streaming from its tiny windows .

source_bert_toks: a string of multi - coloured lights gleamed beneath the over ##hang ##ing that ##ch and bright yellow light was streaming from its tiny windows .

reference_raw: Under the overhanging thatch, a string of multicolored lights shone, and bright yellow light streamed from the tiny windows.

reference_spacy_tokens: Under the overhanging thatch , a string of multicolored lights shone , and bright yellow light streamed from the tiny windows .


fn_spacy_tokens_for_baseline: Pringle had reached her first and dropped on to his knees beside her .

source_bert_toks: pri ##ng ##le had reached her first and dropped on to his knees beside her .

reference_raw: Pringle reached her first and knelt beside her.

reference_spacy_tokens: Pringle reached her first and knelt beside her .


fn_spacy_tokens_for_baseline: Fujitsu Ltd ranked second with a market share of 9.8 % , followed by Toshiba Corp in fourth place with 7.6 % .

source_bert_toks: fuji ##tsu ltd ranked second with a market share of 9 . 8 % , followed by to ##shi ##ba corp in fourth place with 7 . 6 % .

reference_raw: Fujitsu Ltd had a second market share of 9.8%, followed by Toshiba Corp with a fourth market share of 7.6%.

reference_spacy_tokens: Fujitsu Ltd had a second market share of 9.8 % , followed by Toshiba Corp with a fourth market share of 7.6 % .


fn_spacy_tokens_for_baseline: After all , there 's nothing like good hard repetitions in the sand , which is what some of us sometimes trek over to Bournemouth or Blackpool for .

source_bert_toks: after all , there ' s nothing like good hard repetition ##s in the sand , which is what some of us sometimes trek over to bournemouth or blackpool for .

reference_raw: After all, there is no such thing as a good hard repetition in the sand, which is why some of us sometimes go to Bournemouth or Blackpool.

reference_spacy_tokens: After all , there is no such thing as a good hard repetition in the sand , which is why some of us sometimes go to Bournemouth or Blackpool .


fn_spacy_tokens_for_baseline: Relations with Brian Clough hit rock bottom , you might remember , when the manager called the police in to escort Fashanu from the club 's training ground .

source_bert_toks: relations with brian cl ##ough hit rock bottom , you might remember , when the manager called the police in to escort fa ##shan ##u from the club ' s training ground .

reference_raw: The relationship with Brian Clough hit rock bottom, you might remember, when the manager called the police to take Fashanu off the club's training ground.

reference_spacy_tokens: The relationship with Brian Clough hit rock bottom , you might remember , when the manager called the police to take Fashanu off the club 's training ground .


fn_spacy_tokens_for_baseline: Beneath each window were long encrusted brown stains , stretching to the ground , where the monks over the centuries had emptied their latrine buckets .

source_bert_toks: beneath each window were long en ##cr ##ust ##ed brown stains , stretching to the ground , where the monks over the centuries had emptied their la ##tri ##ne bucket ##s .

reference_raw: Beneath each window were long brown stains that stretched to the floor, where the monks had emptied their latrine pails over the centuries.

reference_spacy_tokens: Beneath each window were long brown stains that stretched to the floor , where the monks had emptied their latrine pails over the centuries .


fn_spacy_tokens_for_baseline: And so , with her emotions wrapped up safely in a package of anger , Lisa proceeded to face the coming fortnight .

source_bert_toks: and so , with her emotions wrapped up safely in a package of anger , lisa proceeded to face the coming fort ##night .

reference_raw: So, with her emotions safely wrapped in a pack of anger, Lisa continued to face the next two weeks.

reference_spacy_tokens: So , with her emotions safely wrapped in a pack of anger , Lisa continued to face the next two weeks .


fn_spacy_tokens_for_baseline: He pursed his big mouth into such a babyish pout that Meredith found him comical ; he sniggered .

source_bert_toks: he pursed his big mouth into such a baby ##ish po ##ut that meredith found him comical ; he s ##nig ##ger ##ed .

reference_raw: He pursed his big mouth in such a childish pour that Meredith found him comical; he chuckled.

reference_spacy_tokens: He pursed his big mouth in such a childish pour that Meredith found him comical ; he chuckled .


fn_spacy_tokens_for_baseline: This is despite near - constant Iranian rhetoric during the 1980s , invoking the threat of CW in retaliation if the world community failed to take any action against Iraq .

source_bert_toks: this is despite near - constant iranian rhetoric during the 1980s , in ##voking the threat of cw in retaliation if the world community failed to take any action against iraq .

reference_raw: This is in spite of the near-continuous Iranian rhetoric of the 1980s, which puts CW at risk of retaliation if the world community fails to take action against Iraq.

reference_spacy_tokens: This is in spite of the near - continuous Iranian rhetoric of the 1980s , which puts CW at risk of retaliation if the world community fails to take action against Iraq .


fn_spacy_tokens_for_baseline: The elephants were n't swimming in the pond , they were floating on their backs , and one of them was balancing me gently on the flat tops of its upturned feet .

source_bert_toks: the elephants weren ' t swimming in the pond , they were floating on their backs , and one of them was balancing me gently on the flat tops of its up ##turn ##ed feet .

reference_raw: The elephants did not swim in the pond, but floated upon their backs, and one of them gently balanced me against the flat tops of his upturned legs.

reference_spacy_tokens: The elephants did not swim in the pond , but floated upon their backs , and one of them gently balanced me against the flat tops of his upturned legs .


fn_spacy_tokens_for_baseline: Taiwan signed the Nuclear Non - Proliferation Treaty ( NPT ) in 1968 and has implemented the International Atomic Energy Agency 's ( IAEA ) " Program 93 + 2 " safeguards .

source_bert_toks: taiwan signed the nuclear non - proliferation treaty ( np ##t ) in 1968 and has implemented the international atomic energy agency ' s ( ia ##ea ) " program 93 + 2 " safeguard ##s .

reference_raw: Taiwan concluded the Nuclear Non-Proliferation Treaty (NPT) in 1968 and implemented the Safeguards of the International Atomic Energy Agency (IAEA) (Program 93+2).

reference_spacy_tokens: Taiwan concluded the Nuclear Non - Proliferation Treaty ( NPT ) in 1968 and implemented the Safeguards of the International Atomic Energy Agency ( IAEA ) ( Program 93 + 2 ) .


fn_spacy_tokens_for_baseline: She pushed past him through the doorway , her hands full of salt cellar , Vinegar bottle , sauce bottle and pickle jar .

source_bert_toks: she pushed past him through the doorway , her hands full of salt cellar , vinegar bottle , sauce bottle and pick ##le jar .

reference_raw: She pushed past him through the door, her hands filled with salt cellars, a bottle of vinegar, a sauce bottle, and a cup of cucumber.

reference_spacy_tokens: She pushed past him through the door , her hands filled with salt cellars , a bottle of vinegar , a sauce bottle , and a cup of cucumber .


fn_spacy_tokens_for_baseline: Types of trees found to build small wooden shacks are -- pine , beech , oak .

source_bert_toks: types of trees found to build small wooden shack ##s are - - pine , beech , oak .

reference_raw: The types of trees found building small wooden huts are pine, beech, oak.

reference_spacy_tokens: The types of trees found building small wooden huts are pine , beech , oak .


fn_spacy_tokens_for_baseline: One prediction of many of these schemes is that the proton must be unstable , decaying eventually to electrons and protons .

source_bert_toks: one prediction of many of these schemes is that the proton must be unstable , decay ##ing eventually to electrons and proton ##s .

reference_raw: One prediction of many of these systems is that the proton must be unstable and eventually dissolve into electrons and protons.

reference_spacy_tokens: One prediction of many of these systems is that the proton must be unstable and eventually dissolve into electrons and protons .


fn_spacy_tokens_for_baseline: At some later date , a slight glacial retreat would weaken the dam wall and its subsequent collapse would prove catastrophic .

source_bert_toks: at some later date , a slight glacial retreat would weaken the dam wall and its subsequent collapse would prove catastrophic .

reference_raw: Later, a slight regression of the glacial would weaken the wall of the dam, and its subsequent collapse would be disastrous.

reference_spacy_tokens: Later , a slight regression of the glacial would weaken the wall of the dam , and its subsequent collapse would be disastrous .


fn_spacy_tokens_for_baseline: It is a defence , however , if the defendant can satisfy the court that it was not known or suspected that drug trafficking was involved , or that he disclosed his knowledge or suspicion to the relevant authorities .

source_bert_toks: it is a defence , however , if the defendant can satisfy the court that it was not known or suspected that drug trafficking was involved , or that he disclosed his knowledge or suspicion to the relevant authorities .

reference_raw: However, it is a defence where the defendant is able to satisfy the court that he has not been aware of the trafficking in drugs or that he has disclosed his knowledge or suspicion to the competent authorities.

reference_spacy_tokens: However , it is a defence where the defendant is able to satisfy the court that he has not been aware of the trafficking in drugs or that he has disclosed his knowledge or suspicion to the competent authorities .


fn_spacy_tokens_for_baseline: The priest grasped the cudgel tighter , opened the door and stepped into the darkness .

source_bert_toks: the priest grasped the cu ##dge ##l tighter , opened the door and stepped into the darkness .

reference_raw: The priest tightened his grip on the stick, opened the door, and stepped into the darkness.

reference_spacy_tokens: The priest tightened his grip on the stick , opened the door , and stepped into the darkness .


fn_spacy_tokens_for_baseline: Recollection of the day it visited Millbrook is especially spine - chilling .

source_bert_toks: rec ##oll ##ection of the day it visited mill ##brook is especially spine - chilling .

reference_raw: The memory of the day he visited Millbrook is particularly spinal chilling.

reference_spacy_tokens: The memory of the day he visited Millbrook is particularly spinal chilling .


fn_spacy_tokens_for_baseline: He 's supposed to live forever .

source_bert_toks: he ' s supposed to live forever .

reference_raw: He should be alive forever.

reference_spacy_tokens: He should be alive forever .


fn_spacy_tokens_for_baseline: The package of notes had got caught in the waist - band of her jeans , and she stood fumbling .

source_bert_toks: the package of notes had got caught in the waist - band of her jeans , and she stood fu ##mbling .

reference_raw: The bundle of notes was caught in the waistband of her jeans, and she stood fumbling.

reference_spacy_tokens: The bundle of notes was caught in the waistband of her jeans , and she stood fumbling .


fn_spacy_tokens_for_baseline: A pro - Khomeini mutiny began among Air Force technicians ( known as homagars ) and then spread to other ranks ; by 10 February the Air Force was fighting against the Imperial Guard .

source_bert_toks: a pro - k ##hom ##ein ##i mutiny began among air force technicians ( known as ho ##ma ##gar ##s ) and then spread to other ranks ; by 10 february the air force was fighting against the imperial guard .

reference_raw: The pro-Khomeini rebellion began among Air Force technicians (known as Homagars) and then spread to other ranks; by 10 February the Air Force was fighting against the Imperial Guard.

reference_spacy_tokens: The pro - Khomeini rebellion began among Air Force technicians ( known as Homagars ) and then spread to other ranks ; by 10 February the Air Force was fighting against the Imperial Guard .


fn_spacy_tokens_for_baseline: Its main conclusion is that there has been no measurable radiological effects on the health of local people , and that the only significant problems resulted from psychological factors , notably stress .

source_bert_toks: its main conclusion is that there has been no me ##asurable radio ##logical effects on the health of local people , and that the only significant problems resulted from psychological factors , notably stress .

reference_raw: The main conclusion is that there is no measurable radiological impact on the health of the local population and that the only significant problems are caused by psychological factors, in particular stress.

reference_spacy_tokens: The main conclusion is that there is no measurable radiological impact on the health of the local population and that the only significant problems are caused by psychological factors , in particular stress .


fn_spacy_tokens_for_baseline: YEAH , yeah , I put myself around , I was an aggressive player but I was skilful , too . '

source_bert_toks: yeah , yeah , i put myself around , i was an aggressive player but i was ski ##lf ##ul , too . '

reference_raw: Yes, yes, I did, I was an aggressive player, but I was also skillful.'

reference_spacy_tokens: Yes , yes , I did , I was an aggressive player , but I was also skillful . '


fn_spacy_tokens_for_baseline: They were not , however , fully tenanted , perhaps because the ' stringent regulations as to the hours of closing and constant supervision " discouraged the single women for whom they were intended .

source_bert_toks: they were not , however , fully tenant ##ed , perhaps because the ' string ##ent regulations as to the hours of closing and constant supervision " discouraged the single women for whom they were intended .

reference_raw: But they were not fully leased, perhaps because the "strict rules of closing and constant surveillance" discouraged the unmarried women for whom they were intended.

reference_spacy_tokens: But they were not fully leased , perhaps because the " strict rules of closing and constant surveillance " discouraged the unmarried women for whom they were intended .


fn_spacy_tokens_for_baseline: Grate the rind and squeeze the juice before freezing them together in ice - cube trays .

source_bert_toks: gr ##ate the ri ##nd and squeeze the juice before freezing them together in ice - cube tray ##s .

reference_raw: Grab the rind and squeeze the juice together in trays of ice cubes.

reference_spacy_tokens: Grab the rind and squeeze the juice together in trays of ice cubes .


fn_spacy_tokens_for_baseline: The executioner of Paris at that time , as mentioned earlier , was Charles - Henri Sanson .

source_bert_toks: the execution ##er of paris at that time , as mentioned earlier , was charles - henri sans ##on .

reference_raw: Charles-Henri Sanson was the executor of Paris at the time, as mentioned above.

reference_spacy_tokens: Charles - Henri Sanson was the executor of Paris at the time , as mentioned above .


fn_spacy_tokens_for_baseline: Oxygen booths , in which people will be able to breathe pure oxygen at the cost of $ 2 a minute , are to be installed around Mexico City centre .

source_bert_toks: oxygen booths , in which people will be able to breathe pure oxygen at the cost of $ 2 a minute , are to be installed around mexico city centre .

reference_raw: Oxygen booths should be installed around the center of Mexico City, where people can inhale pure oxygen at a price of two dollars a minute.

reference_spacy_tokens: Oxygen booths should be installed around the center of Mexico City , where people can inhale pure oxygen at a price of two dollars a minute .


fn_spacy_tokens_for_baseline: The Association has recently purchased a large , detached house in a residential area of Melton Mowbray , Leicestershire .

source_bert_toks: the association has recently purchased a large , detached house in a residential area of melt ##on mo ##w ##bra ##y , leicestershire .

reference_raw: The Association recently bought a large, separate house in Melton Mowbray, Leicestershire.

reference_spacy_tokens: The Association recently bought a large , separate house in Melton Mowbray , Leicestershire .


fn_spacy_tokens_for_baseline: Governess and children hardly go out at all , except into the garden .

source_bert_toks: govern ##ess and children hardly go out at all , except into the garden .

reference_raw: Government and children hardly ever come out, except in the garden.

reference_spacy_tokens: Government and children hardly ever come out , except in the garden .


fn_spacy_tokens_for_baseline: This combination was so successful that one dealer exclaimed indignantly ' These prices are what I would charge myself . '

source_bert_toks: this combination was so successful that one dealer exclaimed ind ##ignant ##ly ' these prices are what i would charge myself . '

reference_raw: The combination was so successful that one of the dealers shouted indignantly, "I'd charge these prices myself."

reference_spacy_tokens: The combination was so successful that one of the dealers shouted indignantly , " I 'd charge these prices myself . "


fn_spacy_tokens_for_baseline: Though there were tasty meals to be had in Peru -- seafood and chifa ( Chinese ) -- often poor quality or bland ingredients were disguised by chili , herbs and strong seasoning .

source_bert_toks: though there were ta ##sty meals to be had in peru - - seafood and chi ##fa ( chinese ) - - often poor quality or bland ingredients were disguised by chili , herbs and strong season ##ing .

reference_raw: Although the food was delicious in Peru-seafood and chifa (Chinese)-often the poor quality or the bland ingredients were disguised by chili, herbs and strong spices.

reference_spacy_tokens: Although the food was delicious in Peru - seafood and chifa ( Chinese)-often the poor quality or the bland ingredients were disguised by chili , herbs and strong spices .


fn_spacy_tokens_for_baseline: He rushed towards her so violently that Miss Fogerty put out her hands to grasp his shoulders before he should butt her to the ground .

source_bert_toks: he rushed towards her so violently that miss fog ##erty put out her hands to grasp his shoulders before he should butt her to the ground .

reference_raw: He rushed to her so violently that Miss Fogerty reached out and grabbed him by the shoulders before he could put her to the ground.

reference_spacy_tokens: He rushed to her so violently that Miss Fogerty reached out and grabbed him by the shoulders before he could put her to the ground .


fn_spacy_tokens_for_baseline: Even for an experienced choreographer , the suspense could have been hair - raising .

source_bert_toks: even for an experienced choreographer , the suspense could have been hair - raising .

reference_raw: Even for an experienced choreographer, the tension might have raised hair.

reference_spacy_tokens: Even for an experienced choreographer , the tension might have raised hair .


fn_spacy_tokens_for_baseline: If the conflict is very trivial , it may indeed ' blow over ' without an issue being made of it , but if the causes are not identified , the conflict may grow to unmanageable proportions .

source_bert_toks: if the conflict is very trivial , it may indeed ' blow over ' without an issue being made of it , but if the causes are not identified , the conflict may grow to un ##mana ##ge ##able proportions .

reference_raw: If a conflict is very small, it can actually "blow over" without a problem, but if the causes are not identified, the conflict can grow to unmanageable proportions.

reference_spacy_tokens: If a conflict is very small , it can actually " blow over " without a problem , but if the causes are not identified , the conflict can grow to unmanageable proportions .


fn_spacy_tokens_for_baseline: In all the following cases , the spelling , ( apparent ) roots , or sound of the word actively suggest a meaning different from the true one .

source_bert_toks: in all the following cases , the spelling , ( apparent ) roots , or sound of the word actively suggest a meaning different from the true one .

reference_raw: In all of the following cases, spelling, (appearing) roots or acoustics of the word actively suggest a meaning other than the actual one.

reference_spacy_tokens: In all of the following cases , spelling , ( appearing ) roots or acoustics of the word actively suggest a meaning other than the actual one .


fn_spacy_tokens_for_baseline: As a child I overheard two women talking .

source_bert_toks: as a child i overheard two women talking .

reference_raw: When I was a kid, I heard two women talking.

reference_spacy_tokens: When I was a kid , I heard two women talking .


fn_spacy_tokens_for_baseline: All of a sudden , she whined something about me not knowing what I had done and she broke down into tears .

source_bert_toks: all of a sudden , she w ##hine ##d something about me not knowing what i had done and she broke down into tears .

reference_raw: Suddenly she wailed that I didn't know what I'd done, and she burst into tears.

reference_spacy_tokens: Suddenly she wailed that I did n't know what I 'd done , and she burst into tears .


fn_spacy_tokens_for_baseline: The Law Lords concurred with the Appeal Judges ' decision and dismissed Spicers ' appeal .

source_bert_toks: the law lords con ##cu ##rred with the appeal judges ' decision and dismissed spice ##rs ' appeal .

reference_raw: The Lords of the Law agreed with the decision of the Appeal Judges and dismissed the appeal by Spicers.

reference_spacy_tokens: The Lords of the Law agreed with the decision of the Appeal Judges and dismissed the appeal by Spicers .


fn_spacy_tokens_for_baseline: " Not a new law that requires women in labor to serve jury duty . "

source_bert_toks: " not a new law that requires women in labor to serve jury duty . "

reference_raw: "It's not a new law that requires women in labor to perform jury duty."

reference_spacy_tokens: " It 's not a new law that requires women in labor to perform jury duty . "


fn_spacy_tokens_for_baseline: He is also quoted saying that other strikes were " not as successful . "

source_bert_toks: he is also quoted saying that other strikes were " not as successful . "

reference_raw: He's also quoted saying that the other hits were "not so successful."

reference_spacy_tokens: He 's also quoted saying that the other hits were " not so successful . "


fn_spacy_tokens_for_baseline: Downstairs kitchen staff worked with a variety of so called ' labour saving devices ' to concoct a host of culinary delights .

source_bert_toks: downstairs kitchen staff worked with a variety of so called ' labour saving devices ' to con ##co ##ct a host of culinary delight ##s .

reference_raw: Downstairs, the kitchen staff worked with various so-called "work-saving devices" to create a host of culinary pleasures.

reference_spacy_tokens: Downstairs , the kitchen staff worked with various so - called " work - saving devices " to create a host of culinary pleasures .


fn_spacy_tokens_for_baseline: These requirements were never fully implemented .

source_bert_toks: these requirements were never fully implemented .

reference_raw: These requirements have never been fully transposed.

reference_spacy_tokens: These requirements have never been fully transposed .


fn_spacy_tokens_for_baseline: Most of them are very courteous and we have n't minded them having a quick look round , but some are less welcome .

source_bert_toks: most of them are very court ##eous and we haven ' t minded them having a quick look round , but some are less welcome .

reference_raw: Most of them are very polite, and we don't mind if they take a quick look around, but some of them are less welcome.

reference_spacy_tokens: Most of them are very polite , and we do n't mind if they take a quick look around , but some of them are less welcome .


fn_spacy_tokens_for_baseline: May hope next Morn to see the chearful Sun :

source_bert_toks: may hope next mor ##n to see the che ##ar ##ful sun :

reference_raw: May we hope to see the sweet sun in the next dawn:

reference_spacy_tokens: May we hope to see the sweet sun in the next dawn :


fn_spacy_tokens_for_baseline: He launched into details of the sporting activities in which he thought she took part .

source_bert_toks: he launched into details of the sporting activities in which he thought she took part .

reference_raw: He went into the details of the sporting activities he thought he was involved in.

reference_spacy_tokens: He went into the details of the sporting activities he thought he was involved in .


fn_spacy_tokens_for_baseline: Specific attention is being paid to the salience of nationality in contemporary economic cognitions and to the development of a set of attitudinal questions with which to assess this .

source_bert_toks: specific attention is being paid to the sal ##ience of nationality in contemporary economic cognition ##s and to the development of a set of at ##ti ##tu ##dina ##l questions with which to assess this .

reference_raw: Particular attention shall be paid to the salience of nationality in current economic cognitions and to the development of a series of attributional issues to be considered.

reference_spacy_tokens: Particular attention shall be paid to the salience of nationality in current economic cognitions and to the development of a series of attributional issues to be considered .


fn_spacy_tokens_for_baseline: But he does n't even try to ignore a deep , child - like , abiding rage .

source_bert_toks: but he doesn ' t even try to ignore a deep , child - like , ab ##idi ##ng rage .

reference_raw: But he's not even trying to ignore a deep, childlike rage.

reference_spacy_tokens: But he 's not even trying to ignore a deep , childlike rage .


fn_spacy_tokens_for_baseline: She chattered happily as Patrick drove along the Marylebone Road , speculating on the miracle that had brought John and Angela back from the dead .

source_bert_toks: she chatter ##ed happily as patrick drove along the marylebone road , spec ##ulating on the miracle that had brought john and angela back from the dead .

reference_raw: As Patrick rode down Marylebone Road, she chatted happily, speculating on the miracle that had brought John and Angela back from the dead.

reference_spacy_tokens: As Patrick rode down Marylebone Road , she chatted happily , speculating on the miracle that had brought John and Angela back from the dead .


fn_spacy_tokens_for_baseline: Bosses at Sunderland General Hospital denied being to blame -- even though a report says the deaths were ' an outcome ' of being refused admission .

source_bert_toks: bosses at sunderland general hospital denied being to blame - - even though a report says the deaths were ' an outcome ' of being refused admission .

reference_raw: The chiefs of the Sunderland General Hospital denied that it was their fault - although the report said that the deaths were 'the result' of their refusal to admit them.

reference_spacy_tokens: The chiefs of the Sunderland General Hospital denied that it was their fault - although the report said that the deaths were ' the result ' of their refusal to admit them .


fn_spacy_tokens_for_baseline: The turkey was defrosting nicely in the garage , the vegetables all prepared .

source_bert_toks: the turkey was def ##ros ##ting nicely in the garage , the vegetables all prepared .

reference_raw: The turkey was melting nicely in the garage, and the vegetables were ready.

reference_spacy_tokens: The turkey was melting nicely in the garage , and the vegetables were ready .


fn_spacy_tokens_for_baseline: However , you are not likely to find bargains , and you should be aware that unless you are an expert , you can end up with a fake .

source_bert_toks: however , you are not likely to find bargain ##s , and you should be aware that unless you are an expert , you can end up with a fake .

reference_raw: But you probably won't find a deal, and you should know that if you're not an expert, you can end up with a forgery.

reference_spacy_tokens: But you probably wo n't find a deal , and you should know that if you 're not an expert , you can end up with a forgery .


fn_spacy_tokens_for_baseline: ' E gives people a heightened sense of well - being , ' she says , ' but when people go to nightclubs they ca n't actually dance all night , so they take amphetamines to overcome tiredness . '

source_bert_toks: ' e gives people a heightened sense of well - being , ' she says , ' but when people go to nightclub ##s they can ' t actually dance all night , so they take amp ##het ##amine ##s to overcome tired ##ness . '

reference_raw: "E makes people feel better," he says, "but when people go to nightclubs, they can't really dance all night, so they use amphetamines to overcome fatigue."

reference_spacy_tokens: " E makes people feel better , " he says , " but when people go to nightclubs , they ca n't really dance all night , so they use amphetamines to overcome fatigue . "


fn_spacy_tokens_for_baseline: It would be wrong , however , to suggest that this infrastructural augmentation was no more than window - dressing .

source_bert_toks: it would be wrong , however , to suggest that this in ##fra ##st ##ru ##ct ##ural aug ##ment ##ation was no more than window - dressing .

reference_raw: But it would be wrong to suggest that this infrastructure enhancement was nothing more than window-dressing.

reference_spacy_tokens: But it would be wrong to suggest that this infrastructure enhancement was nothing more than window - dressing .


fn_spacy_tokens_for_baseline: In November 1997 , Russia ratified the CWC , but financial and other difficulties have impeded the destruction of its chemical weapons stockpile , so it is far behind the timetable specified in the treaty .

source_bert_toks: in november 1997 , russia ratified the cw ##c , but financial and other difficulties have imp ##eded the destruction of its chemical weapons stock ##pile , so it is far behind the timetable specified in the treaty .

reference_raw: Russia ratified the Convention in November 1997, but financial and other difficulties prevented its chemical weapons stockpile from being destroyed, so that it is far behind the schedule set out in the Treaty.

reference_spacy_tokens: Russia ratified the Convention in November 1997 , but financial and other difficulties prevented its chemical weapons stockpile from being destroyed , so that it is far behind the schedule set out in the Treaty .


fn_spacy_tokens_for_baseline: He is a rude horrible selfish man , I quite see that , but I like him personally , if you can understand that .

source_bert_toks: he is a rude horrible selfish man , i quite see that , but i like him personally , if you can understand that .

reference_raw: He's a grossly selfish man, I understand that, but I like him personally, if you know what I mean.

reference_spacy_tokens: He 's a grossly selfish man , I understand that , but I like him personally , if you know what I mean .


fn_spacy_tokens_for_baseline: Like most of the other 6,000 churches in Britain with sets of bells , St. Michael once had its own " band " of ringers , who would herald every Sunday morning and evening service .

source_bert_toks: like most of the other 6 , 000 churches in britain with sets of bells , st . michael once had its own " band " of ring ##ers , who would herald every sunday morning and evening service .

reference_raw: As with most 6,000 churches in Britain with bells, Saint Michael had his own ringer band, who would herald every Sunday morning and evening service.

reference_spacy_tokens: As with most 6,000 churches in Britain with bells , Saint Michael had his own ringer band , who would herald every Sunday morning and evening service .


fn_spacy_tokens_for_baseline: She switched on the electric kettle and made a cup of instant coffee flavoured with powdered milk and artificial sweetener .

source_bert_toks: she switched on the electric kettle and made a cup of instant coffee flavour ##ed with powder ##ed milk and artificial sweet ##ener .

reference_raw: She turned on the electric kettle and made a cup of instant coffee, flavoured with powdered milk and artificial sugar.

reference_spacy_tokens: She turned on the electric kettle and made a cup of instant coffee , flavoured with powdered milk and artificial sugar .


fn_spacy_tokens_for_baseline: The 23-year - old Scot silenced a growing band of critics with an impressive 9 - 5 victory over James Wattana .

source_bert_toks: the 23 - year - old sc ##ot silenced a growing band of critics with an impressive 9 - 5 victory over james watt ##ana .

reference_raw: A twenty-three-year-old Scot hushed a growing group of critics with an impressive nine-five victory over James Wattana.

reference_spacy_tokens: A twenty - three - year - old Scot hushed a growing group of critics with an impressive nine - five victory over James Wattana .


fn_spacy_tokens_for_baseline: The idea of the lofty Naylor Massingham sitting impatiently outside her apartment block for an hour was one which Leith found quite pleasing -- so much so that she almost broke into a smile .

source_bert_toks: the idea of the loft ##y nay ##lor mass ##ingham sitting impatiently outside her apartment block for an hour was one which leith found quite pleasing - - so much so that she almost broke into a smile .

reference_raw: The thought of the noble Naylor Massingham sitting impatiently in front of her apartment block for an hour was something Leith found pleasant enough to almost smile.

reference_spacy_tokens: The thought of the noble Naylor Massingham sitting impatiently in front of her apartment block for an hour was something Leith found pleasant enough to almost smile .


fn_spacy_tokens_for_baseline: I was more worried that he might fall over and hurt himself .

source_bert_toks: i was more worried that he might fall over and hurt himself .

reference_raw: I was more afraid he might fall over and get injured.

reference_spacy_tokens: I was more afraid he might fall over and get injured .


fn_spacy_tokens_for_baseline: Firstly , after eating a meal gall bladder contraction is closely related to plasma CCK concentrations .

source_bert_toks: firstly , after eating a meal gall bladder contraction is closely related to plasma cc ##k concentrations .

reference_raw: Firstly, after eating a meal, the contagion of the gallbladder is closely related to plasma concentrations of CCK.

reference_spacy_tokens: Firstly , after eating a meal , the contagion of the gallbladder is closely related to plasma concentrations of CCK .


fn_spacy_tokens_for_baseline: North Korea also has placed thousands of artillery systems -- including multiple launch rocket systems that are particularly effective for CW delivery -- within reach of the Demilitarized Zone ( DMZ ) and Seoul .

source_bert_toks: north korea also has placed thousands of artillery systems - - including multiple launch rocket systems that are particularly effective for cw delivery - - within reach of the demi ##lita ##rized zone ( d ##m ##z ) and seoul .

reference_raw: North Korea has also placed thousands of artillery systems - including multiple launch rocket systems, which are particularly effective for the supply of CW - within range of the DMZ and Seoul.

reference_spacy_tokens: North Korea has also placed thousands of artillery systems - including multiple launch rocket systems , which are particularly effective for the supply of CW - within range of the DMZ and Seoul .


fn_spacy_tokens_for_baseline: I wanted to express my fear and my horror .

source_bert_toks: i wanted to express my fear and my horror .

reference_raw: I wanted to express my fear and terror.

reference_spacy_tokens: I wanted to express my fear and terror .


fn_spacy_tokens_for_baseline: The more I learn about the cost and inefficiencies of the current and future regulatory regime to which power generators will be subjected if we do not have new legislation , the more I am convinced that we can -- and must -- develop a smarter approach that protects the environment and public health while reducing the cost to consumers and industry and optimizing the size of both the state and federal government machinery necessary to achieve that protection .

source_bert_toks: the more i learn about the cost and in ##ef ##fi ##cie ##ncies of the current and future regulatory regime to which power generators will be subjected if we do not have new legislation , the more i am convinced that we can - - and must - - develop a smarter approach that protects the environment and public health while reducing the cost to consumers and industry and opt ##imi ##zing the size of both the state and federal government machinery necessary to achieve that protection .

reference_raw: The more I learn about the costs and inefficiencies of the current and future regulatory regime to which electricity producers will be subject in the absence of new legislation, the more I believe that we can - and must - develop a smarter approach to protect the environment and public health, while reducing the costs for consumers and industry and optimising the size of the state and federal government machinery needed to achieve such protection.

reference_spacy_tokens: The more I learn about the costs and inefficiencies of the current and future regulatory regime to which electricity producers will be subject in the absence of new legislation , the more I believe that we can - and must - develop a smarter approach to protect the environment and public health , while reducing the costs for consumers and industry and optimising the size of the state and federal government machinery needed to achieve such protection .


fn_spacy_tokens_for_baseline: In effect I 'd cut myself off from other kids of my own age .

source_bert_toks: in effect i ' d cut myself off from other kids of my own age .

reference_raw: In fact, I'd cut myself off from other children my own age.

reference_spacy_tokens: In fact , I 'd cut myself off from other children my own age .


fn_spacy_tokens_for_baseline: He was scornful of the latter ..

source_bert_toks: he was sc ##orn ##ful of the latter . .

reference_raw: He despised the latter . . .

reference_spacy_tokens: He despised the latter . . .


fn_spacy_tokens_for_baseline: Modern training is much less arduous .

source_bert_toks: modern training is much less ar ##du ##ous .

reference_raw: Modern training is far less difficult.

reference_spacy_tokens: Modern training is far less difficult .


fn_spacy_tokens_for_baseline: Equally to the hardliners ' point , Mr Gorbachev 's Soviet Union is a discouraging example of what happens when the party loosens its control of the economy and the people .

source_bert_toks: equally to the hard ##liner ##s ' point , mr go ##rba ##chev ' s soviet union is a disco ##ura ##ging example of what happens when the party loosen ##s its control of the economy and the people .

reference_raw: Just like the hardliners' point, the Soviet Union of Mr. Gorbachev is a disconcerting example of what happens when the party loses control of the economy and the people.

reference_spacy_tokens: Just like the hardliners ' point , the Soviet Union of Mr. Gorbachev is a disconcerting example of what happens when the party loses control of the economy and the people .


fn_spacy_tokens_for_baseline: Demands for his resignation as party leader were loud .

source_bert_toks: demands for his resignation as party leader were loud .

reference_raw: The demand for his resignment as party leader was noisy.

reference_spacy_tokens: The demand for his resignment as party leader was noisy .


fn_spacy_tokens_for_baseline: The inference of user information needs from user information - seeking behaviour has led to much confusion .

source_bert_toks: the inference of user information needs from user information - seeking behaviour has led to much confusion .

reference_raw: Deducing user information needs from user information-seeking behaviour has led to a lot of confusion.

reference_spacy_tokens: Deducing user information needs from user information - seeking behaviour has led to a lot of confusion .


fn_spacy_tokens_for_baseline: Faces reddened at the Ministry of Defence when it was revealed that a thief had snatched top - secret documents about the Gulf from an unlocked car on December 17th .

source_bert_toks: faces red ##dened at the ministry of defence when it was revealed that a thief had snatched top - secret documents about the gulf from an unlocked car on december 17th .

reference_raw: The faces of the Ministry of Defence were reddened when it was discovered that on December 17, a thief had stolen top-secret documents about the Gulf from an unlocked car.

reference_spacy_tokens: The faces of the Ministry of Defence were reddened when it was discovered that on December 17 , a thief had stolen top - secret documents about the Gulf from an unlocked car .


fn_spacy_tokens_for_baseline: Her maiden name is Belamonte .

source_bert_toks: her maiden name is bela ##mont ##e .

reference_raw: Her virgin name is Belamont.

reference_spacy_tokens: Her virgin name is Belamont .


fn_spacy_tokens_for_baseline: Unlike light , which can reach the lens from sources far beyond our galaxy , sound is a very localised phenomenon .

source_bert_toks: unlike light , which can reach the lens from sources far beyond our galaxy , sound is a very local ##ised phenomenon .

reference_raw: Unlike the light that can reach the lens from sources far outside our galaxy, sound is a very localized phenomenon.

reference_spacy_tokens: Unlike the light that can reach the lens from sources far outside our galaxy , sound is a very localized phenomenon .


fn_spacy_tokens_for_baseline: He did a double stint of exercise until he was clammy with globules of sweat and then sluiced himself over from the two cold jugs of water Christine had brought him up after breakfast .

source_bert_toks: he did a double stint of exercise until he was cl ##am ##my with g ##lo ##bu ##les of sweat and then sl ##ui ##ced himself over from the two cold jug ##s of water christine had brought him up after breakfast .

reference_raw: He practiced twice until he was sticky with sweatglobules, then sluiced himself out of the two cold jugs of water Christine had brought him after breakfast.

reference_spacy_tokens: He practiced twice until he was sticky with sweatglobules , then sluiced himself out of the two cold jugs of water Christine had brought him after breakfast .


fn_spacy_tokens_for_baseline: The plan was that they would meet again in Bordeaux , where Suffolk was soon to go to commandeer a freighter for his scientific booty and machine tools .

source_bert_toks: the plan was that they would meet again in bordeaux , where suffolk was soon to go to command ##eer a freighter for his scientific boot ##y and machine tools .

reference_raw: The plan was to meet again in Bordeaux, where Suffolk would soon be in charge of the freighter for his scientific booty and machine tools.

reference_spacy_tokens: The plan was to meet again in Bordeaux , where Suffolk would soon be in charge of the freighter for his scientific booty and machine tools .


fn_spacy_tokens_for_baseline: The White House has ordered a purge of information from government agency websites that could be exploited by terrorists seeking weapons of mass destruction .

source_bert_toks: the white house has ordered a purge of information from government agency websites that could be exploited by terrorists seeking weapons of mass destruction .

reference_raw: The White House ordered a cleansing of information from government agencies' websites, which could be used by terrorists looking for weapons of mass destruction.

reference_spacy_tokens: The White House ordered a cleansing of information from government agencies ' websites , which could be used by terrorists looking for weapons of mass destruction .


fn_spacy_tokens_for_baseline: Sexy blonde curls have been pinned on to the crown for this look from John Peers

source_bert_toks: sexy blonde curls have been pinned on to the crown for this look from john peers

reference_raw: Sexy blond curls were nailed to the crown for that look from John Peers.

reference_spacy_tokens: Sexy blond curls were nailed to the crown for that look from John Peers .


fn_spacy_tokens_for_baseline: When comparisons are made between stanzas by Philips and stanzas by Pope the irony turns hilarious .

source_bert_toks: when comparisons are made between stanza ##s by philips and stanza ##s by pope the irony turns hilarious .

reference_raw: When Philips compares the stanzas with the Pope, the irony becomes funny.

reference_spacy_tokens: When Philips compares the stanzas with the Pope , the irony becomes funny .


fn_spacy_tokens_for_baseline: I met the company commander ; I told him I had brought up some grenades and barbed - wire ; I asked where I was to put them .

source_bert_toks: i met the company commander ; i told him i had brought up some grenades and barbed - wire ; i asked where i was to put them .

reference_raw: I met the head of the company, told him I'd brought some grenades and barbed wire, and asked where to put them.

reference_spacy_tokens: I met the head of the company , told him I 'd brought some grenades and barbed wire , and asked where to put them .


fn_spacy_tokens_for_baseline: Even more successful in this purpose is the white surplice which happily hangs from Anglican shoulders .

source_bert_toks: even more successful in this purpose is the white sur ##pl ##ice which happily hangs from anglican shoulders .

reference_raw: The white surplus that hangs happily on Anglican shoulders is even more successful in doing so.

reference_spacy_tokens: The white surplus that hangs happily on Anglican shoulders is even more successful in doing so .


fn_spacy_tokens_for_baseline: " You soon will be , down here ! " was his son 's retort .

source_bert_toks: " you soon will be , down here ! " was his son ' s re ##tort .

reference_raw: "You'll be down here soon!" was his son's reply.

reference_spacy_tokens: " You 'll be down here soon ! " was his son 's reply .


fn_spacy_tokens_for_baseline: However , I believe it would be foolish to allow such an assertion to remain unchallenged .

source_bert_toks: however , i believe it would be foolish to allow such an assertion to remain un ##chal ##len ##ged .

reference_raw: However, I think it would be silly to allow such a statement to remain unchallenged.

reference_spacy_tokens: However , I think it would be silly to allow such a statement to remain unchallenged .


fn_spacy_tokens_for_baseline: George felt anxious that he had had no opportunity to be alone with Tamar , and so there had been no chance of warning her about the groom .

source_bert_toks: george felt anxious that he had had no opportunity to be alone with tam ##ar , and so there had been no chance of warning her about the groom .

reference_raw: George couldn't wait to be alone with Tamar, so he couldn't warn her about the groom.

reference_spacy_tokens: George could n't wait to be alone with Tamar , so he could n't warn her about the groom .


fn_spacy_tokens_for_baseline: He trots around doing menial jobs under the eye of the warder , but in fact is a guerrilla leader who is merely pretending to be mad .

source_bert_toks: he tr ##ots around doing men ##ial jobs under the eye of the ward ##er , but in fact is a guerrilla leader who is merely pretending to be mad .

reference_raw: He's running around doing menial work under the guard's eyes, but he's actually a guerrilla leader who's just pretending to be crazy.

reference_spacy_tokens: He 's running around doing menial work under the guard 's eyes , but he 's actually a guerrilla leader who 's just pretending to be crazy .


fn_spacy_tokens_for_baseline: As part of their campaign against the exportation of live farm animals to Europe , the Royal Society for the Prevention of Cruelty to Animals is to use newspaper and poster advertisements designed to challenge indifference .

source_bert_toks: as part of their campaign against the export ##ation of live farm animals to europe , the royal society for the prevention of cruelty to animals is to use newspaper and poster advertisements designed to challenge indifference .

reference_raw: As part of their campaign against the export of live farm animals to Europe, the Royal Society for the Prevention of Cruelty to Animals will use newspapers and posters to combat indifference.

reference_spacy_tokens: As part of their campaign against the export of live farm animals to Europe , the Royal Society for the Prevention of Cruelty to Animals will use newspapers and posters to combat indifference .


fn_spacy_tokens_for_baseline: Female respondents also complained that men drive too fast and are often very discourteous to others .

source_bert_toks: female respondents also complained that men drive too fast and are often very disco ##urt ##eous to others .

reference_raw: The female respondents also complained that men drive too fast and are often very rude to others.

reference_spacy_tokens: The female respondents also complained that men drive too fast and are often very rude to others .


fn_spacy_tokens_for_baseline: If he follows the correct path , he may be able to look back on this election as the high - water mark of far - left opposition .

source_bert_toks: if he follows the correct path , he may be able to look back on this election as the high - water mark of far - left opposition .

reference_raw: If he's on the right track, he can look back on this election as a high-water sign of a distant left-hand opposition.

reference_spacy_tokens: If he 's on the right track , he can look back on this election as a high - water sign of a distant left - hand opposition .


fn_spacy_tokens_for_baseline: The confectionery shop next door was owned by a bachelor named White .

source_bert_toks: the con ##fect ##ion ##ery shop next door was owned by a bachelor named white .

reference_raw: The confectionery shop next door was owned by a young man named White.

reference_spacy_tokens: The confectionery shop next door was owned by a young man named White .


fn_spacy_tokens_for_baseline: I do n't know if he was also running contraband , or what , but I think there was something shady about it .

source_bert_toks: i don ' t know if he was also running contra ##band , or what , but i think there was something shady about it .

reference_raw: I don't know if he was smuggling or what, but I think it was a little shady.

reference_spacy_tokens: I do n't know if he was smuggling or what , but I think it was a little shady .


fn_spacy_tokens_for_baseline: While this theory is exceedingly simple , it appears to explain several things .

source_bert_toks: while this theory is exceeding ##ly simple , it appears to explain several things .

reference_raw: Although this theory is extremely simple, it seems to explain a few things.

reference_spacy_tokens: Although this theory is extremely simple , it seems to explain a few things .


fn_spacy_tokens_for_baseline: But Delaney 's plea was in vain .

source_bert_toks: but delaney ' s plea was in vain .

reference_raw: But Delaney's request was futile.

reference_spacy_tokens: But Delaney 's request was futile .


fn_spacy_tokens_for_baseline: One can indeed use could in a positive sentence evoking a past capacity which was never even exercised : ( 11 ) Ten years ago , the super - powers could already destroy the world 1000 times over .

source_bert_toks: one can indeed use could in a positive sentence ev ##oki ##ng a past capacity which was never even exercised : ( 11 ) ten years ago , the super - powers could already destroy the world 1000 times over .

reference_raw: In a positive sentence, one could actually use a power that had never been exercised before: (11) Ten years ago, superpowers could have destroyed the world a thousand times more.

reference_spacy_tokens: In a positive sentence , one could actually use a power that had never been exercised before : ( 11 ) Ten years ago , superpowers could have destroyed the world a thousand times more .


fn_spacy_tokens_for_baseline: He faked a yawn .

source_bert_toks: he fake ##d a ya ##wn .

reference_raw: He pretended to yawn.

reference_spacy_tokens: He pretended to yawn .


fn_spacy_tokens_for_baseline: In adult life we talk about people withholding what they have in order to keep control ; we talk about ' shitty ' behaviour to describe what happens when someone ' messes things up ' .

source_bert_toks: in adult life we talk about people with ##holding what they have in order to keep control ; we talk about ' shitty ' behaviour to describe what happens when someone ' mess ##es things up ' .

reference_raw: In adult life, we're talking about people holding back what they have to maintain control; we're talking about "shit" behavior to describe what happens when someone "messes things up".

reference_spacy_tokens: In adult life , we 're talking about people holding back what they have to maintain control ; we 're talking about " shit " behavior to describe what happens when someone " messes things up " .


fn_spacy_tokens_for_baseline: That incredible empire dominated the world and I imagine it did not seem possible to people living then that anyone could loosen that empire 's grip on humanity .

source_bert_toks: that incredible empire dominated the world and i imagine it did not seem possible to people living then that anyone could loosen that empire ' s grip on humanity .

reference_raw: The world was dominated by this unbelievable empire, and I imagine that it was impossible for the people who lived at that time for anyone to loosen that empire's grip on humanity.

reference_spacy_tokens: The world was dominated by this unbelievable empire , and I imagine that it was impossible for the people who lived at that time for anyone to loosen that empire 's grip on humanity .


fn_spacy_tokens_for_baseline: Puzzled by his intensity but considerably more at ease now his lithe frame was effectively covered , Gina 's hands fluttered in a gesture of indecision .

source_bert_toks: puzzled by his intensity but considerably more at ease now his lit ##he frame was effectively covered , gina ' s hands fluttered in a gesture of ind ##ec ##ision .

reference_raw: Gina's hands fluttered in a gesture of indecision, stunned by his intensity, but much more relaxed now that his light frame was effectively covered.

reference_spacy_tokens: Gina 's hands fluttered in a gesture of indecision , stunned by his intensity , but much more relaxed now that his light frame was effectively covered .