fn_spacy_tokens_for_baseline: Dressed only in bra and panties , she had flopped down on top of the covers , trying to woo sleep .

source_bert_toks: dressed only in bra and panties , she had flopped down on top of the covers , trying to woo sleep .

reference_raw: Dressed only in bras and trousers, she dropped to the top of the blanket and tried to sleep.

reference_spacy_tokens: Dressed only in bras and trousers , she dropped to the top of the blanket and tried to sleep .


fn_spacy_tokens_for_baseline: The inhabited history of the Las Vegas Valley stretches to 23,000 b.c . , when much of the area was covered by a prehistoric lake .

source_bert_toks: the inhabited history of the las vegas valley stretches to 23 , 000 b . c . , when much of the area was covered by a prehistoric lake .

reference_raw: The populated history of the Las Vegas Valley extends to 23,000 B.C., where a prehistoric lake covered most of the area.

reference_spacy_tokens: The populated history of the Las Vegas Valley extends to 23,000 B.C. , where a prehistoric lake covered most of the area .


fn_spacy_tokens_for_baseline: Two junior ministers complained to me of Portillo 's ideological zeal in cabinet committee .

source_bert_toks: two junior ministers complained to me of port ##illo ' s ideological ze ##al in cabinet committee .

reference_raw: Two junior ministers filed a complaint against me about Portillo's ideological zeal in the Cabinet Committee.

reference_spacy_tokens: Two junior ministers filed a complaint against me about Portillo 's ideological zeal in the Cabinet Committee .


fn_spacy_tokens_for_baseline: We zigzagged swiftly here and there over Europe to throw off the pursuers and finally returned to this house , which he had taken upon his first arrival in England .

source_bert_toks: we z ##ig ##za ##gged swiftly here and there over europe to throw off the pursue ##rs and finally returned to this house , which he had taken upon his first arrival in england .

reference_raw: From time to time, we zigzagged across Europe to throw off our pursuers, and finally came back to this house, which he had conquered when he first arrived in England.

reference_spacy_tokens: From time to time , we zigzagged across Europe to throw off our pursuers , and finally came back to this house , which he had conquered when he first arrived in England .


fn_spacy_tokens_for_baseline: The scramble for perfect vinyl ambience has forced record companies into sending their spotty new acts into the most highly sophisticated ' digital ' recording studios in the country .

source_bert_toks: the scramble for perfect vinyl am ##bie ##nce has forced record companies into sending their spot ##ty new acts into the most highly sophisticated ' digital ' recording studios in the country .

reference_raw: The struggle for perfect vinyl ambience has forced record companies to send their spotty new deeds to the most sophisticated "digital" recording studios in the country.

reference_spacy_tokens: The struggle for perfect vinyl ambience has forced record companies to send their spotty new deeds to the most sophisticated " digital " recording studios in the country .


fn_spacy_tokens_for_baseline: Balberith ripped the remains of the fruit and salad bar from its mountings and flung it through the roof .

source_bert_toks: bal ##ber ##ith ripped the remains of the fruit and salad bar from its mounting ##s and flung it through the roof .

reference_raw: Balberith tore the remains of the fruit and salad bar from its mountings and threw it over the roof.

reference_spacy_tokens: Balberith tore the remains of the fruit and salad bar from its mountings and threw it over the roof .


fn_spacy_tokens_for_baseline: Kohler thought that insight , or sudden understanding about what is required to produce a desired effect was shown by the chimpanzees in his experiments .

source_bert_toks: ko ##hler thought that insight , or sudden understanding about what is required to produce a desired effect was shown by the chi ##mp ##an ##zee ##s in his experiments .

reference_raw: Kohler thought that the chimpanzees had shown in his experiments that knowledge, or sudden knowledge of what was necessary to produce the desired effect.

reference_spacy_tokens: Kohler thought that the chimpanzees had shown in his experiments that knowledge , or sudden knowledge of what was necessary to produce the desired effect .


fn_spacy_tokens_for_baseline: One placed a knife against the huge scar left by his stomach operation in Canada .

source_bert_toks: one placed a knife against the huge scar left by his stomach operation in canada .

reference_raw: One of them had put a knife to a massive wound left by a stomach surgery in Canada.

reference_spacy_tokens: One of them had put a knife to a massive wound left by a stomach surgery in Canada .


fn_spacy_tokens_for_baseline: 7.3 Horse mandible from Kendrick 's Cave ( Great Orme 's head , Llandudno , Wales ) , AMS dated to the late Upper Palaeolithic or very early Mesolithic ( PRB 1959.12 - 3.1 ) .

source_bert_toks: 7 . 3 horse man ##di ##ble from kendrick ' s cave ( great or ##me ' s head , ll ##and ##ud ##no , wales ) , am ##s dated to the late upper pal ##ae ##oli ##thic or very early me ##sol ##ith ##ic ( pr ##b 1959 . 12 - 3 . 1 ) .

reference_raw: 7.3 Horse mandible from Kendrick's cavern (Great Orm's head, Llandudno, Wales), AMS dated to the late Upper Palaeolithic or very early Mesolithic (PRB 1959.12-3.1).

reference_spacy_tokens: 7.3 Horse mandible from Kendrick 's cavern ( Great Orm 's head , Llandudno , Wales ) , AMS dated to the late Upper Palaeolithic or very early Mesolithic ( PRB 1959.12 - 3.1 ) .


fn_spacy_tokens_for_baseline: In May 1998 , the London Daily Telegraph reported that " Iran has concluded a secret deal with China to purchase banned chemicals that will enable it to become self - sufficient in producing large stockpiles of advanced nerve gas . "

source_bert_toks: in may 1998 , the london daily telegraph reported that " iran has concluded a secret deal with china to purchase banned chemicals that will enable it to become self - sufficient in producing large stock ##pile ##s of advanced nerve gas . "

reference_raw: In May 1998, the London Daily Telegraph announced that "Iran had concluded a secret agreement with China on the purchase of banned chemicals that would allow it to become self-sufficient in the production of large stocks of advanced nerve gas."

reference_spacy_tokens: In May 1998 , the London Daily Telegraph announced that " Iran had concluded a secret agreement with China on the purchase of banned chemicals that would allow it to become self - sufficient in the production of large stocks of advanced nerve gas . "


fn_spacy_tokens_for_baseline: Not only does the superb landscape of fell and valley provide wonderfully varies walking , but the villages , full of character , are also home to some of the best pubs in the country .

source_bert_toks: not only does the superb landscape of fell and valley provide wonderful ##ly varies walking , but the villages , full of character , are also home to some of the best pubs in the country .

reference_raw: Not only is the beautiful landscape of the autumn and the valley wonderfully different walks, but the villages, full of character, are also home to some of the best pubs in the country.

reference_spacy_tokens: Not only is the beautiful landscape of the autumn and the valley wonderfully different walks , but the villages , full of character , are also home to some of the best pubs in the country .


fn_spacy_tokens_for_baseline: That night he lay on top of the bed listening to the slow swish of the ceiling fan as it stirred the humid air .

source_bert_toks: that night he lay on top of the bed listening to the slow sw ##ish of the ceiling fan as it stirred the humid air .

reference_raw: He lay on the bed that night, listening to the slow swish of the ceiling fan as it stirred the damp air.

reference_spacy_tokens: He lay on the bed that night , listening to the slow swish of the ceiling fan as it stirred the damp air .


fn_spacy_tokens_for_baseline: All completed forms should be photocopied before being issued to the New OED Computer Group for actioning .

source_bert_toks: all completed forms should be photo ##co ##pie ##d before being issued to the new o ##ed computer group for action ##ing .

reference_raw: All completed forms should be copied to the new OED computer group for action before being issued.

reference_spacy_tokens: All completed forms should be copied to the new OED computer group for action before being issued .


fn_spacy_tokens_for_baseline: Specifically , China reportedly has renewed negotiations on the construction of a graphite production facility , agreed to supply Iran with specialty steel , including the transfer of titanium - stabilized duplex steel , that can be used in the development of weapons of mass destruction .

source_bert_toks: specifically , china reportedly has renewed negotiations on the construction of a graph ##ite production facility , agreed to supply iran with specialty steel , including the transfer of titanium - stabilized du ##plex steel , that can be used in the development of weapons of mass destruction .

reference_raw: In particular, China reportedly renewed negotiations to build a graphite production facility and agreed to supply Iran with special steel, including the transfer of titanium - stabilised duplex steel, which could be used to develop weapons of mass destruction.

reference_spacy_tokens: In particular , China reportedly renewed negotiations to build a graphite production facility and agreed to supply Iran with special steel , including the transfer of titanium - stabilised duplex steel , which could be used to develop weapons of mass destruction .


fn_spacy_tokens_for_baseline: Lesley Harrison , 29 , was knifed by a taxi passenger as she stepped between him and the driver during a row over the fare .

source_bert_toks: lesley harrison , 29 , was knife ##d by a taxi passenger as she stepped between him and the driver during a row over the fare .

reference_raw: Lesley Harrison, 29 years old, was stabbed by a cab passenger when she stepped between him and the driver in a row above the fare.

reference_spacy_tokens: Lesley Harrison , 29 years old , was stabbed by a cab passenger when she stepped between him and the driver in a row above the fare .


fn_spacy_tokens_for_baseline: The difference in the structure of each successive member of a homologous series is CH2- .

source_bert_toks: the difference in the structure of each successive member of a homo ##log ##ous series is ch ##2 - .

reference_raw: The discrepancy in the structure of each successive member of the homologous series is CH2-.

reference_spacy_tokens: The discrepancy in the structure of each successive member of the homologous series is CH2- .


fn_spacy_tokens_for_baseline: He 'd made a good start but now he was faltering , and the focus of attention was drifting slowly away from him .

source_bert_toks: he ' d made a good start but now he was fa ##lter ##ing , and the focus of attention was drifting slowly away from him .

reference_raw: He had made a good start, but now he hesitated, his attention slowly shifting away from him.

reference_spacy_tokens: He had made a good start , but now he hesitated , his attention slowly shifting away from him .


fn_spacy_tokens_for_baseline: The attacks , including suicide bombers , car explosions and gunfire , struck from north to south throughout the morning in what appeared to be part of a coordinated plan .

source_bert_toks: the attacks , including suicide bombers , car explosions and gunfire , struck from north to south throughout the morning in what appeared to be part of a coordinated plan .

reference_raw: Attacks, including suicide bombers, car blasts and gunfire, struck from north to south all morning in what seemed to be part of a co-ordinated plan.

reference_spacy_tokens: Attacks , including suicide bombers , car blasts and gunfire , struck from north to south all morning in what seemed to be part of a co - ordinated plan .


fn_spacy_tokens_for_baseline: Margaret Baxter was also very well educated and was more conversant with Latin , Greek and Hebrew than her husband .

source_bert_toks: margaret baxter was also very well educated and was more con ##vers ##ant with latin , greek and hebrew than her husband .

reference_raw: Margaret Baxter was also very well educated and spoke more Latin, Greek, and Hebrew than her husband.

reference_spacy_tokens: Margaret Baxter was also very well educated and spoke more Latin , Greek , and Hebrew than her husband .


fn_spacy_tokens_for_baseline: " I always seem to get these big mouth opponents , " Chavez replied .

source_bert_toks: " i always seem to get these big mouth opponents , " chavez replied .

reference_raw: "I always seem to have these big-mouthed adversaries," Chavez said.

reference_spacy_tokens: " I always seem to have these big - mouthed adversaries , " Chavez said .


fn_spacy_tokens_for_baseline: IAEA chief El Baradei indicated that signing the Protocol would ensure IAEA oversight over Libya 's nuclear transition from weapons creation to peaceful purposes .

source_bert_toks: ia ##ea chief el bar ##ade ##i indicated that signing the protocol would ensure ia ##ea oversight over libya ' s nuclear transition from weapons creation to peaceful purposes .

reference_raw: The IAEA Chief El Baradei stated that the signing of the Protocol would ensure the oversight of the IAEA over Libya's nuclear transition from the generation of weapons to peaceful purposes.

reference_spacy_tokens: The IAEA Chief El Baradei stated that the signing of the Protocol would ensure the oversight of the IAEA over Libya 's nuclear transition from the generation of weapons to peaceful purposes .


fn_spacy_tokens_for_baseline: Everywhere there was noise , hammering , shouting , the soft unshod feet of mules and donkeys padding over the bridge , below which a grey torrent swarmed through a stone - lined passage .

source_bert_toks: everywhere there was noise , hammering , shouting , the soft un ##sho ##d feet of mule ##s and donkey ##s pad ##ding over the bridge , below which a grey torre ##nt swarm ##ed through a stone - lined passage .

reference_raw: There was noise everywhere, pounding and screaming, and the soft, unshocked feet of mules and donkeys padding across the bridge, beneath which a gray torrent swarmed through a stone-lined corridor.

reference_spacy_tokens: There was noise everywhere , pounding and screaming , and the soft , unshocked feet of mules and donkeys padding across the bridge , beneath which a gray torrent swarmed through a stone - lined corridor .


fn_spacy_tokens_for_baseline: Its wheels and the lower half of the body were splattered with mud .

source_bert_toks: its wheels and the lower half of the body were sp ##lat ##tered with mud .

reference_raw: The wheels and the lower half of the body were stained with mud.

reference_spacy_tokens: The wheels and the lower half of the body were stained with mud .


fn_spacy_tokens_for_baseline: On the previous day , Nov. 24 , five Arab gunmen attempted a seaborne attack from Lebanon , but were all shot dead when their vessel was intercepted by an Israeli naval patrol vessel .

source_bert_toks: on the previous day , nov . 24 , five arab gunmen attempted a sea ##borne attack from lebanon , but were all shot dead when their vessel was intercepted by an israeli naval patrol vessel .

reference_raw: On the previous day, November 24, five Arab gunmen tried to attack Lebanon by sea, but all were shot when their ship was captured by an Israeli naval patrol vessel.

reference_spacy_tokens: On the previous day , November 24 , five Arab gunmen tried to attack Lebanon by sea , but all were shot when their ship was captured by an Israeli naval patrol vessel .


fn_spacy_tokens_for_baseline: Already on the day following Neddy 's pronouncement the industrial correspondent of The Times , whom I take as a representative of respectable opinion , was ecstatic with metaphors .

source_bert_toks: already on the day following ned ##dy ' s pro ##no ##unce ##ment the industrial correspondent of the times , whom i take as a representative of respectable opinion , was ec ##static with metaphor ##s .

reference_raw: The day after Neddy's statement, the industrial correspondent of the Times, who I consider to represent a respectable opinion, was ecstatic by metaphors.

reference_spacy_tokens: The day after Neddy 's statement , the industrial correspondent of the Times , who I consider to represent a respectable opinion , was ecstatic by metaphors .


fn_spacy_tokens_for_baseline: This time white - collar jobs in services , from banking to advertising , have also been axed -- the very sectors that provided virtually all the new jobs of the past two decades .

source_bert_toks: this time white - collar jobs in services , from banking to advertising , have also been axe ##d - - the very sectors that provided virtually all the new jobs of the past two decades .

reference_raw: This time, white-collar employment in services, from banking to advertising, was also axed - the same sector that had provided virtually all the new employment in the last two decades.

reference_spacy_tokens: This time , white - collar employment in services , from banking to advertising , was also axed - the same sector that had provided virtually all the new employment in the last two decades .


fn_spacy_tokens_for_baseline: When he touched it the doors swung open instantly and with a disconcerting noiselessness .

source_bert_toks: when he touched it the doors swung open instantly and with a disco ##nce ##rting noise ##lessness .

reference_raw: When he touched it, the door opened at once, without alarming sound.

reference_spacy_tokens: When he touched it , the door opened at once , without alarming sound .


fn_spacy_tokens_for_baseline: The indications are that throughout his time as chairman Howson put into the factory a good deal of family money ( his wife was wealthy by inheritance ) .

source_bert_toks: the indications are that throughout his time as chairman how ##son put into the factory a good deal of family money ( his wife was wealthy by inheritance ) .

reference_raw: There are indications that during his time as Chairman Howson put a lot of family money into the factory (his wife was rich in inheritance).

reference_spacy_tokens: There are indications that during his time as Chairman Howson put a lot of family money into the factory ( his wife was rich in inheritance ) .


fn_spacy_tokens_for_baseline: He had put on a fresh pair of boxer shorts or the old pair had dried .

source_bert_toks: he had put on a fresh pair of boxer shorts or the old pair had dried .

reference_raw: He put on fresh pairs of boxers, or the old couple dried up.

reference_spacy_tokens: He put on fresh pairs of boxers , or the old couple dried up .


fn_spacy_tokens_for_baseline: She backed two steps from him , then turned and ran towards the building .

source_bert_toks: she backed two steps from him , then turned and ran towards the building .

reference_raw: She backed away two paces, then turned and ran toward the building.

reference_spacy_tokens: She backed away two paces , then turned and ran toward the building .


fn_spacy_tokens_for_baseline: Last year , Goodwill helped 3,300 people find jobs that increased their self - sufficiency .

source_bert_toks: last year , goodwill helped 3 , 300 people find jobs that increased their self - su ##ffi ##ciency .

reference_raw: Last year, Goodwill helped 3,300 people get jobs that made them more self-sufficient.

reference_spacy_tokens: Last year , Goodwill helped 3,300 people get jobs that made them more self - sufficient .


fn_spacy_tokens_for_baseline: Harper stared down at her bent over stomach , where three miniscule rolls of fat had appeared .

source_bert_toks: harper stared down at her bent over stomach , where three mini ##scu ##le rolls of fat had appeared .

reference_raw: Harper looked down at her bent over her belly, where three tiny rolls of fat had emerged.

reference_spacy_tokens: Harper looked down at her bent over her belly , where three tiny rolls of fat had emerged .


fn_spacy_tokens_for_baseline: Beth shut her eyes and opened her lungs , the scream reverberating round the house like the cry of a soul in torment .

source_bert_toks: beth shut her eyes and opened her lungs , the scream rev ##er ##ber ##ating round the house like the cry of a soul in torment .

reference_raw: Beth closed her eyes and opened her lungs, the scream echoing around the house like the scream of a soul in agony.

reference_spacy_tokens: Beth closed her eyes and opened her lungs , the scream echoing around the house like the scream of a soul in agony .


fn_spacy_tokens_for_baseline: It was a mild night with clouds drifting across the sky and occasionally obscuring the new moon .

source_bert_toks: it was a mild night with clouds drifting across the sky and occasionally ob ##scu ##ring the new moon .

reference_raw: It was a mild night, with clouds drifting across the sky, covering the new moon from time to time.

reference_spacy_tokens: It was a mild night , with clouds drifting across the sky , covering the new moon from time to time .


fn_spacy_tokens_for_baseline: Manville sat down again , taking time to relax and frame his words carefully .

source_bert_toks: man ##ville sat down again , taking time to relax and frame his words carefully .

reference_raw: Manville sat down again, taking some time to calm down and pinpoint his words carefully.

reference_spacy_tokens: Manville sat down again , taking some time to calm down and pinpoint his words carefully .


fn_spacy_tokens_for_baseline: The slaughter of around 30,000 peasants in the aftermath of a revolt in El Salvador in 1932 virtually eliminated the indigenous Salvadoreans .

source_bert_toks: the slaughter of around 30 , 000 peasants in the aftermath of a revolt in el salvador in 1932 virtually eliminated the indigenous salvador ##ean ##s .

reference_raw: After the rebellion in El Salvador in 1932, the massacre of some 30,000 peasants practically eliminated the native Salvadoreans.

reference_spacy_tokens: After the rebellion in El Salvador in 1932 , the massacre of some 30,000 peasants practically eliminated the native Salvadoreans .


fn_spacy_tokens_for_baseline: Dr _ Gupto : That 's right .

source_bert_toks: dr _ gu ##pt ##o : that ' s right .

reference_raw: Dr. Gupto: Exactly.

reference_spacy_tokens: Dr. Gupto : Exactly .


fn_spacy_tokens_for_baseline: He dragged himself from the clump of twitch - grass that had been his hiding - place for the last half hour , and shivering violently , set off on foot to the east .

source_bert_toks: he dragged himself from the cl ##ump of twitch - grass that had been his hiding - place for the last half hour , and shivering violently , set off on foot to the east .

reference_raw: He pulled himself out of the tangle of twitching grass that had been his hiding place for the past half hour, shuddered violently, and walked eastward.

reference_spacy_tokens: He pulled himself out of the tangle of twitching grass that had been his hiding place for the past half hour , shuddered violently , and walked eastward .


fn_spacy_tokens_for_baseline: In some magical way , the sight of the dumpy figure in the long black cloak could rekindle the fighting spirit in utterly battleweary troops .

source_bert_toks: in some magical way , the sight of the dump ##y figure in the long black cloak could re ##kind ##le the fighting spirit in utterly battle ##wear ##y troops .

reference_raw: In some magical way, the sight of a burly figure in a long black cloak could rekindle the fighting spirit in an utterly battle-weary army.

reference_spacy_tokens: In some magical way , the sight of a burly figure in a long black cloak could rekindle the fighting spirit in an utterly battle - weary army .


fn_spacy_tokens_for_baseline: He began to mouth an explanation but before he could finish there was a roar in the tunnel and a huge ball of earth and rock blew past them .

source_bert_toks: he began to mouth an explanation but before he could finish there was a roar in the tunnel and a huge ball of earth and rock blew past them .

reference_raw: He started to say something, but before he could finish, there was a roar in the tunnel, and a huge ball of earth and rock roared past them.

reference_spacy_tokens: He started to say something , but before he could finish , there was a roar in the tunnel , and a huge ball of earth and rock roared past them .


fn_spacy_tokens_for_baseline: So far she had not been able to reconcile her desire to keep everything the same and her desire for comfort .

source_bert_toks: so far she had not been able to reconcile her desire to keep everything the same and her desire for comfort .

reference_raw: She hadn't been able to reconcile her longing to keep everything the same and her longing for comfort.

reference_spacy_tokens: She had n't been able to reconcile her longing to keep everything the same and her longing for comfort .


fn_spacy_tokens_for_baseline: If Snakes of the World can cure even a few readers of their phobia , replacing terror with admiration , it will have achieved its purpose .

source_bert_toks: if snakes of the world can cure even a few readers of their ph ##ob ##ia , replacing terror with admiration , it will have achieved its purpose .

reference_raw: If the snakes of the world could cure even a few readers of their phobias, substituting terror with admiration, they would achieve their purpose.

reference_spacy_tokens: If the snakes of the world could cure even a few readers of their phobias , substituting terror with admiration , they would achieve their purpose .


fn_spacy_tokens_for_baseline: The clear message behind this and so much more of national policy at present is that teachers can not be trusted .

source_bert_toks: the clear message behind this and so much more of national policy at present is that teachers can not be trusted .

reference_raw: The clear message behind this, and so much more national policy at the moment, is that teachers cannot be trusted.

reference_spacy_tokens: The clear message behind this , and so much more national policy at the moment , is that teachers can not be trusted .


fn_spacy_tokens_for_baseline: I can not do anything else except for saying my paternoster and my creed to Christ , for my sins . ' )

source_bert_toks: i can not do anything else except for saying my pat ##ern ##ost ##er and my creed to christ , for my sins . ' )

reference_raw: There's nothing I can do but tell my father and my faith in Christ for my sins.'

reference_spacy_tokens: There 's nothing I can do but tell my father and my faith in Christ for my sins . '


fn_spacy_tokens_for_baseline: Later Sarah and her mother came to see Julia , and she told them that Joe was at Dover and Anne had written to reassure him about them .

source_bert_toks: later sarah and her mother came to see julia , and she told them that joe was at dover and anne had written to reassure him about them .

reference_raw: Sarah and her mother came to Julie later, and she told them that Joe was in Dover, and Anna wrote to calm him down.

reference_spacy_tokens: Sarah and her mother came to Julie later , and she told them that Joe was in Dover , and Anna wrote to calm him down .


fn_spacy_tokens_for_baseline: But how did such migrants ever learn that there was better weather at the other end of the globe or that hundreds of miles north of the African savannahs , for a few months , abundant food was to be had .

source_bert_toks: but how did such migrants ever learn that there was better weather at the other end of the globe or that hundreds of miles north of the african savannah ##s , for a few months , abundant food was to be had .

reference_raw: But how had such immigrants ever learned that the weather was better on the other side of the world, or that hundreds of miles north of the African savannas, there would be plenty of food for a few months.

reference_spacy_tokens: But how had such immigrants ever learned that the weather was better on the other side of the world , or that hundreds of miles north of the African savannas , there would be plenty of food for a few months .


fn_spacy_tokens_for_baseline: How any attempt was going to be made when she was in Marianske Lazne and Ven in Prague , she had n't fathomed as she made her way down to breakfast .

source_bert_toks: how any attempt was going to be made when she was in marian ##ske la ##z ##ne and ve ##n in prague , she hadn ' t fat ##hom ##ed as she made her way down to breakfast .

reference_raw: When she was in Marianske Lazne and Ven in Prague, she didn't understand what she was trying to do when she went to breakfast.

reference_spacy_tokens: When she was in Marianske Lazne and Ven in Prague , she did n't understand what she was trying to do when she went to breakfast .


fn_spacy_tokens_for_baseline: With that check came renewed questioning about the balance between services provided by the social services departments and the many forms of family , neighbourhood and commercially purchased care that they supplemented .

source_bert_toks: with that check came renewed questioning about the balance between services provided by the social services departments and the many forms of family , neighbourhood and commercially purchased care that they supplemented .

reference_raw: As a result of this review, there was a renewed doubt as to the balance between the services provided by the social services departments and the numerous forms of family, neighbourhood and commercially purchased care which they complemented.

reference_spacy_tokens: As a result of this review , there was a renewed doubt as to the balance between the services provided by the social services departments and the numerous forms of family , neighbourhood and commercially purchased care which they complemented .


fn_spacy_tokens_for_baseline: These giant dustbins , some the size of a small garage , appear to have multiplied beyond count in recent years .

source_bert_toks: these giant dust ##bin ##s , some the size of a small garage , appear to have multiplied beyond count in recent years .

reference_raw: These huge dustbins, some the size of a small garage, seem to have grown more than count in recent years.

reference_spacy_tokens: These huge dustbins , some the size of a small garage , seem to have grown more than count in recent years .


fn_spacy_tokens_for_baseline: This has allowed men 's clothing manufacturers to capture the benefits of their own highly efficient sewing rooms through long production runs .

source_bert_toks: this has allowed men ' s clothing manufacturers to capture the benefits of their own highly efficient sewing rooms through long production runs .

reference_raw: This enabled men's clothing manufacturers to capture the benefits of their high-performance sewing chambers through a lengthy production process.

reference_spacy_tokens: This enabled men 's clothing manufacturers to capture the benefits of their high - performance sewing chambers through a lengthy production process .


fn_spacy_tokens_for_baseline: ' Oh , git the hankerchiefs out fer a weep , ' groaned George , pretending to play the violin .

source_bert_toks: ' oh , gi ##t the hank ##er ##chi ##ef ##s out fe ##r a weep , ' groaned george , pretending to play the violin .

reference_raw: 'Oh, let the handkerchiefs cry wildly,' said George, pretending to play the violin.

reference_spacy_tokens: ' Oh , let the handkerchiefs cry wildly , ' said George , pretending to play the violin .


fn_spacy_tokens_for_baseline: This has traumatised a company that traditionally gave its employees an implicit job - for - life promise .

source_bert_toks: this has trauma ##tis ##ed a company that traditionally gave its employees an implicit job - for - life promise .

reference_raw: This has traumatized a company that has traditionally given its employees an implicit promise of work for life.

reference_spacy_tokens: This has traumatized a company that has traditionally given its employees an implicit promise of work for life .


fn_spacy_tokens_for_baseline: Sigarup picked up a piece of unlit jharo and held it in the fire until it was blazing and drips of flaming resin fell from it , spluttering to the ground .

source_bert_toks: si ##gar ##up picked up a piece of un ##lit j ##har ##o and held it in the fire until it was blazing and drip ##s of flaming resin fell from it , sp ##lu ##ttering to the ground .

reference_raw: Sigarup took a piece of unlit jharo and held it in the fire until it burned and drops of burning resin fell from it, splashing to the ground.

reference_spacy_tokens: Sigarup took a piece of unlit jharo and held it in the fire until it burned and drops of burning resin fell from it , splashing to the ground .


fn_spacy_tokens_for_baseline: But as it was Sunday morning , there were few admiring fans about .

source_bert_toks: but as it was sunday morning , there were few admiring fans about .

reference_raw: But since it was Sunday morning, there were few fans of admiration.

reference_spacy_tokens: But since it was Sunday morning , there were few fans of admiration .


fn_spacy_tokens_for_baseline: I was hoping that Jane would type my application , but when she came to visit me in Cambridge , she had her arm in plaster , having broken it .

source_bert_toks: i was hoping that jane would type my application , but when she came to visit me in cambridge , she had her arm in plaster , having broken it .

reference_raw: I was hoping Jane would write me an application, but when she came to visit me in Cambridge, her hand was plastered and she broke it.

reference_spacy_tokens: I was hoping Jane would write me an application , but when she came to visit me in Cambridge , her hand was plastered and she broke it .


fn_spacy_tokens_for_baseline: When he stood back , he could see that he had created a superb landscape with figures .

source_bert_toks: when he stood back , he could see that he had created a superb landscape with figures .

reference_raw: As he backed away, he saw that he had made a beautiful landscape of figures.

reference_spacy_tokens: As he backed away , he saw that he had made a beautiful landscape of figures .


fn_spacy_tokens_for_baseline: Adjust the flavour with black pepper and squeezed lemon , sprinkle with chopped parsley and serve immediately .

source_bert_toks: adjust the flavour with black pepper and squeezed lemon , sp ##rin ##kle with chopped par ##sley and serve immediately .

reference_raw: Adjust the taste with black pepper and squeezed lemon, spray with sliced parsley and serve immediately.

reference_spacy_tokens: Adjust the taste with black pepper and squeezed lemon , spray with sliced parsley and serve immediately .


fn_spacy_tokens_for_baseline: If you believe that a glass of wine will sell a motor car , you are underestimating the customer .

source_bert_toks: if you believe that a glass of wine will sell a motor car , you are under ##est ##imating the customer .

reference_raw: If you think a drink of wine sells a car, you underestimate the customer.

reference_spacy_tokens: If you think a drink of wine sells a car , you underestimate the customer .


fn_spacy_tokens_for_baseline: The little grey eyes glinted again .

source_bert_toks: the little grey eyes glint ##ed again .

reference_raw: The small gray eyes glittered again.

reference_spacy_tokens: The small gray eyes glittered again .


fn_spacy_tokens_for_baseline: Responding to the barrage of critics who insist that Iran 's illicit intentions are obvious , El - Baradei has pointed to the continued absence of a " smoking gun " and the fundamental shortcomings of attempts to concretely assess Iran 's programmatic goals without such evidence .

source_bert_toks: responding to the barrage of critics who insist that iran ' s illicit intentions are obvious , el - bar ##ade ##i has pointed to the continued absence of a " smoking gun " and the fundamental short ##coming ##s of attempts to concrete ##ly assess iran ' s program ##matic goals without such evidence .

reference_raw: In response to the barrage of critics who insist that Iran's illegal intentions are clear, El-Baradei pointed out the continued absence of a "smoking weapon" and the fundamental shortcomings of attempts to specifically assess Iran's programmatic objectives without such evidence.

reference_spacy_tokens: In response to the barrage of critics who insist that Iran 's illegal intentions are clear , El - Baradei pointed out the continued absence of a " smoking weapon " and the fundamental shortcomings of attempts to specifically assess Iran 's programmatic objectives without such evidence .


fn_spacy_tokens_for_baseline: Mr Justice Turner also said that a regulatory body -- existing alongside the law -- could be considered in dealing with some wrongdoers in the commercial field .

source_bert_toks: mr justice turner also said that a regulatory body - - existing alongside the law - - could be considered in dealing with some wrong ##do ##ers in the commercial field .

reference_raw: Mr. Justice Turner also stated that a regulatory body, which exists alongside the law, could be taken into account in dealing with certain commercial misconducts.

reference_spacy_tokens: Mr. Justice Turner also stated that a regulatory body , which exists alongside the law , could be taken into account in dealing with certain commercial misconducts .


fn_spacy_tokens_for_baseline: The market bears this out : Along with the usual ducks and chickens , you will see for sale snakes , dogs , bats , and sometimes monkeys - all are highly prized as delicacies .

source_bert_toks: the market bears this out : along with the usual ducks and chickens , you will see for sale snakes , dogs , bats , and sometimes monkeys - all are highly prized as del ##ica ##cies .

reference_raw: The market bears this: along with the usual ducks and chicks, you will see that snakes, dogs, bats, and sometimes apes - all are highly valued as delicacy.

reference_spacy_tokens: The market bears this : along with the usual ducks and chicks , you will see that snakes , dogs , bats , and sometimes apes - all are highly valued as delicacy .


fn_spacy_tokens_for_baseline: Wooden - wheeled ox carts trundled through the dense throng and the air was heavy with the pungent reek of salted fish , oriental teas and spices .

source_bert_toks: wooden - wheeled ox carts tr ##und ##led through the dense th ##rong and the air was heavy with the pun ##gent re ##ek of salt ##ed fish , oriental tea ##s and spices .

reference_raw: The wooden-wheeled ox-carts trudged through the thick crowd, and the air was heavy with the pungent smell of salted fish, oriental teas and spices.

reference_spacy_tokens: The wooden - wheeled ox - carts trudged through the thick crowd , and the air was heavy with the pungent smell of salted fish , oriental teas and spices .


fn_spacy_tokens_for_baseline: The ornate , picturesque temple dates from the Ming Dynasty ( 1368 - 1644 ) and is the oldest building in Macau .

source_bert_toks: the ornate , picturesque temple dates from the ming dynasty ( 136 ##8 - 1644 ) and is the oldest building in macau .

reference_raw: The ornate, picturesque church is from the Ming Dynasty (1368-1644) and is the oldest building in Macao.

reference_spacy_tokens: The ornate , picturesque church is from the Ming Dynasty ( 1368 - 1644 ) and is the oldest building in Macao .


fn_spacy_tokens_for_baseline: They should wear gloves and soft shoes , avoid physical contact and use whistles to express their fervour .

source_bert_toks: they should wear gloves and soft shoes , avoid physical contact and use whistle ##s to express their fe ##r ##vo ##ur .

reference_raw: They should wear gloves and soft boots, avoid physical touch, and use whistles to express their passion.

reference_spacy_tokens: They should wear gloves and soft boots , avoid physical touch , and use whistles to express their passion .


fn_spacy_tokens_for_baseline: I beat her mother , Yulia , but obviously not well enough .

source_bert_toks: i beat her mother , yu ##lia , but obviously not well enough .

reference_raw: I defeated her mother, Julia, but apparently not well enough.

reference_spacy_tokens: I defeated her mother , Julia , but apparently not well enough .


fn_spacy_tokens_for_baseline: Shortly after the marketplace blast , a roadside bomb near the City Council headquarters in Sadr City killed eight and injured 20 , all civilians , an Iraqi army press release said .

source_bert_toks: shortly after the marketplace blast , a roadside bomb near the city council headquarters in sad ##r city killed eight and injured 20 , all civilians , an iraqi army press release said .

reference_raw: Shortly after the marketplace explosion, a roadside bomb near the city council headquarters in Sadr City killed eight and wounded 20, all civilians, a press release from the Iraqi army said.

reference_spacy_tokens: Shortly after the marketplace explosion , a roadside bomb near the city council headquarters in Sadr City killed eight and wounded 20 , all civilians , a press release from the Iraqi army said .


fn_spacy_tokens_for_baseline: QN : Is the administration deciding whether Saddam Hussein has WMD ?

source_bert_toks: q ##n : is the administration deciding whether saddam hussein has w ##md ?

reference_raw: QN: Does the administration decide whether Saddam Hussein possesses weapons of mass destruction?

reference_spacy_tokens: QN : Does the administration decide whether Saddam Hussein possesses weapons of mass destruction ?


fn_spacy_tokens_for_baseline: On education , Mr Beith blamed the Government for constantly changing the rules and making teachers ' lives a misery .

source_bert_toks: on education , mr beit ##h blamed the government for constantly changing the rules and making teachers ' lives a misery .

reference_raw: In terms of education, Mr. Beith accused the government of constantly changing the rules and making teachers' lives miserable.

reference_spacy_tokens: In terms of education , Mr. Beith accused the government of constantly changing the rules and making teachers ' lives miserable .


fn_spacy_tokens_for_baseline: This incident occurred during a five - week scientific expedition to the Greenland and Norwegian Seas in the summer of 1988 .

source_bert_toks: this incident occurred during a five - week scientific expedition to the greenland and norwegian seas in the summer of 1988 .

reference_raw: This incident occurred in the summer of 1988 on a five-week scientific trip to the Greenland and Norwegian Seas.

reference_spacy_tokens: This incident occurred in the summer of 1988 on a five - week scientific trip to the Greenland and Norwegian Seas .


fn_spacy_tokens_for_baseline: 2- Preserving Islamic morals and avoiding means of corruption and bad companions , through verification and confirmation of news . ( T.C : Koranic verse ) To observe good conduct and filial piety even if they were infidels .

source_bert_toks: 2 - preserving islamic morals and avoiding means of corruption and bad companions , through verification and confirmation of news . ( t . c : ko ##rani ##c verse ) to observe good conduct and fi ##lia ##l pie ##ty even if they were in ##fide ##ls .

reference_raw: 2- Preserving Islamic morals and avoiding the means of corruption and evil companions by verifying and confirming the news. (T.C.: Koranic verse) Respecting good behavior and filial piety, even if they were infidels.

reference_spacy_tokens: 2- Preserving Islamic morals and avoiding the means of corruption and evil companions by verifying and confirming the news . ( T.C. : Koranic verse ) Respecting good behavior and filial piety , even if they were infidels .


fn_spacy_tokens_for_baseline: For the Government , Lord Henley said that there was no need for amendments because of the activities of ' a few bad apples ' .

source_bert_toks: for the government , lord henley said that there was no need for amendments because of the activities of ' a few bad apples ' .

reference_raw: Lord Henley, for the government, said that there was no need to change because of the activities of the "several bad apples".

reference_spacy_tokens: Lord Henley , for the government , said that there was no need to change because of the activities of the " several bad apples " .


fn_spacy_tokens_for_baseline: It is socially very inept to ask someone their age and , if they tell you , it is often in an embarrassed whisper .

source_bert_toks: it is socially very in ##ept to ask someone their age and , if they tell you , it is often in an embarrassed whisper .

reference_raw: It's socially incompetent to ask someone their age, and when they tell you, it's often in awkward whispers.

reference_spacy_tokens: It 's socially incompetent to ask someone their age , and when they tell you , it 's often in awkward whispers .


fn_spacy_tokens_for_baseline: I think that we can all applaud my right hon . Friend for the other improvements in prison security about which he has told us .

source_bert_toks: i think that we can all app ##lau ##d my right hon . friend for the other improvements in prison security about which he has told us .

reference_raw: I think we can all clap my good baby friend for the other improvements in prison security he told us about.

reference_spacy_tokens: I think we can all clap my good baby friend for the other improvements in prison security he told us about .


fn_spacy_tokens_for_baseline: The collision happened off Malaysia 48 hours after the Greek - registered ship left Singapore on a voyage advertised as a ' cruise to nowhere ' .

source_bert_toks: the collision happened off malaysia 48 hours after the greek - registered ship left singapore on a voyage advertised as a ' cruise to nowhere ' .

reference_raw: The crash took place in Malaysia 48 hours after the Greek-registered ship left Singapore on a cruise that was advertised as a cruise to nowhere.

reference_spacy_tokens: The crash took place in Malaysia 48 hours after the Greek - registered ship left Singapore on a cruise that was advertised as a cruise to nowhere .


fn_spacy_tokens_for_baseline: The chief facility for researching and producing CW agents was a military front company called Delta G Scientific , located between Johannesburg and Pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weaponize " irritants ( Riot Control Agents such as CS and CR ) and incapacitants by placing them in artillery shells , mortar bombs , and grenades .

source_bert_toks: the chief facility for researching and producing cw agents was a military front company called delta g scientific , located between johannesburg and pretoria , and several other facilities were set up to develop protective clothing , manufacture exotic assassination devices , and " weapon ##ize " ir ##ritan ##ts ( riot control agents such as cs and cr ) and inca ##pac ##itan ##ts by placing them in artillery shells , mortar bombs , and grenades .

reference_raw: The main facility for research and production of CW agents was a military front company called Delta G Science, located between Johannesburg and Pretoria, and several other facilities were set up for the development of protective suits, the production of exotic assassination devices, and "weaponizing" irritants (Riot Control Agents such as CS and CR) and incapacitators by placing them in artillery shells, mortar bombs, and grenades.

reference_spacy_tokens: The main facility for research and production of CW agents was a military front company called Delta G Science , located between Johannesburg and Pretoria , and several other facilities were set up for the development of protective suits , the production of exotic assassination devices , and " weaponizing " irritants ( Riot Control Agents such as CS and CR ) and incapacitators by placing them in artillery shells , mortar bombs , and grenades .


fn_spacy_tokens_for_baseline: In order to qualify , a successor must have resided with the tenant during the period of 12 months ending with the tenant 's death .

source_bert_toks: in order to qualify , a successor must have resided with the tenant during the period of 12 months ending with the tenant ' s death .

reference_raw: In order to be eligible, the heir must have been resident with the lessee for a period of 12 months following the death of the lessee.

reference_spacy_tokens: In order to be eligible , the heir must have been resident with the lessee for a period of 12 months following the death of the lessee .


fn_spacy_tokens_for_baseline: Heavy boots clattered suddenly outside and Jack Dodson panted his way through the door .

source_bert_toks: heavy boots cl ##atter ##ed suddenly outside and jack dod ##son panted his way through the door .

reference_raw: Suddenly heavy boots rattled outside, and Jack Dodson gasped through the door.

reference_spacy_tokens: Suddenly heavy boots rattled outside , and Jack Dodson gasped through the door .


fn_spacy_tokens_for_baseline: Before the school teacher could answer , there was another rap on the door and Beasley scampered in like an overgrown puppy , casting inquisitive glances at Jim Lancaster and the two police officers .

source_bert_toks: before the school teacher could answer , there was another rap on the door and bea ##sley sc ##amp ##ered in like an overgrown puppy , casting in ##qui ##sit ##ive glances at jim lancaster and the two police officers .

reference_raw: Before the schoolteacher could answer, there was another knock on the door, and Beasley ran in like an overgrown puppy, casting curious glances at Jim Lancaster and the two policemen.

reference_spacy_tokens: Before the schoolteacher could answer , there was another knock on the door , and Beasley ran in like an overgrown puppy , casting curious glances at Jim Lancaster and the two policemen .


fn_spacy_tokens_for_baseline: Now erm no if you so leave a say leave a page would be the easiest way to fill in your mini saga account of David Copperfield meeting his new father .

source_bert_toks: now er ##m no if you so leave a say leave a page would be the easiest way to fill in your mini saga account of david copper ##field meeting his new father .

reference_raw: Now, uh, no, if you're gonna leave a saying that leaving a page would be the easiest way to fill out your mini-sag story about David Copperfield meeting his new father.

reference_spacy_tokens: Now , uh , no , if you 're gon na leave a saying that leaving a page would be the easiest way to fill out your mini - sag story about David Copperfield meeting his new father .


fn_spacy_tokens_for_baseline: It is the same severance which has placed the monarch in a situation constitutionally inexplicable and indefensible .

source_bert_toks: it is the same se ##verance which has placed the monarch in a situation constitutional ##ly in ##ex ##pl ##ica ##ble and ind ##efe ##ns ##ible .

reference_raw: It is the same severance that has placed the ruler in a constitutionally inexplicable and indefensible position.

reference_spacy_tokens: It is the same severance that has placed the ruler in a constitutionally inexplicable and indefensible position .


fn_spacy_tokens_for_baseline: A recreated street of colonial Macau is lined with traditional Chinese shops .

source_bert_toks: a recreated street of colonial macau is lined with traditional chinese shops .

reference_raw: The recreated street of the colonial Macao is lined with conventional Chinese stores.

reference_spacy_tokens: The recreated street of the colonial Macao is lined with conventional Chinese stores .


fn_spacy_tokens_for_baseline: People often feel that it is in some way distasteful deliberately to use your behaviour to influence others and this also leads to the conclusion that manipulating behaviour is unethical .

source_bert_toks: people often feel that it is in some way di ##sta ##ste ##ful deliberately to use your behaviour to influence others and this also leads to the conclusion that manipulating behaviour is une ##thic ##al .

reference_raw: People often think it's in some way repulsive to deliberately use your behavior to influence others, which leads to the conclusion that manipulation of behaviour is not ethical.

reference_spacy_tokens: People often think it 's in some way repulsive to deliberately use your behavior to influence others , which leads to the conclusion that manipulation of behaviour is not ethical .


fn_spacy_tokens_for_baseline: Sam 's other major talent was , to be frank , on the wrong side of a particular , somewhat dubious aspect of the law .

source_bert_toks: sam ' s other major talent was , to be frank , on the wrong side of a particular , somewhat dubious aspect of the law .

reference_raw: Sam's other main talent was, to be honest, on the wrong side of a certain, somewhat questionable aspect of the law.

reference_spacy_tokens: Sam 's other main talent was , to be honest , on the wrong side of a certain , somewhat questionable aspect of the law .


fn_spacy_tokens_for_baseline: She could do without large conscript armies to defend land frontiers and needed long - service troops who could be employed overseas for long periods .

source_bert_toks: she could do without large con ##script armies to defend land frontiers and needed long - service troops who could be employed overseas for long periods .

reference_raw: It could do without a large army of conscripts to protect the land borders, and it needed a long-term service force that could be employed abroad for a long time.

reference_spacy_tokens: It could do without a large army of conscripts to protect the land borders , and it needed a long - term service force that could be employed abroad for a long time .


fn_spacy_tokens_for_baseline: In this case , straight sections of Kopex connectors were pushed into Acorn connectors after the pipe ends had been smeared with lubricant .

source_bert_toks: in this case , straight sections of ko ##pe ##x connector ##s were pushed into ac ##orn connector ##s after the pipe ends had been smeared with lu ##bri ##can ##t .

reference_raw: In this case, straight sections of the Kopex connectors were pushed into the Acorn connectors after the ends of the pipe were stained with lubricant.

reference_spacy_tokens: In this case , straight sections of the Kopex connectors were pushed into the Acorn connectors after the ends of the pipe were stained with lubricant .


fn_spacy_tokens_for_baseline: She almost smiled as she imagined the touching scene .

source_bert_toks: she almost smiled as she imagined the touching scene .

reference_raw: She almost smiled as she pictured the moving scene.

reference_spacy_tokens: She almost smiled as she pictured the moving scene .


fn_spacy_tokens_for_baseline: Now most of you said you 're not good at planning .

source_bert_toks: now most of you said you ' re not good at planning .

reference_raw: Most of you just said you can't plan.

reference_spacy_tokens: Most of you just said you ca n't plan .


fn_spacy_tokens_for_baseline: Auditors should exercise professional judgment in pursuing indications of possible fraud and illegal acts so as not to interfere with potential future investigations , legal proceedings , or both .

source_bert_toks: auditor ##s should exercise professional judgment in pursuing indications of possible fraud and illegal acts so as not to interfere with potential future investigations , legal proceedings , or both .

reference_raw: In order not to interfere with possible future investigations, legal proceedings or both, auditors should make professional judgement in pursuing evidence of possible fraud or illegal activities.

reference_spacy_tokens: In order not to interfere with possible future investigations , legal proceedings or both , auditors should make professional judgement in pursuing evidence of possible fraud or illegal activities .


fn_spacy_tokens_for_baseline: A strip of turf between tapes and banners in the grounds of the Victoria Wells Hotel proved to be the kindest terrain the leaders had encountered in two hours .

source_bert_toks: a strip of turf between tapes and banners in the grounds of the victoria wells hotel proved to be the kind ##est terrain the leaders had encountered in two hours .

reference_raw: The stretch of grass between tapes and banners at the Victoria Wells Hotel had proved to be the nicest terrain the leaders had encountered in two hours.

reference_spacy_tokens: The stretch of grass between tapes and banners at the Victoria Wells Hotel had proved to be the nicest terrain the leaders had encountered in two hours .


fn_spacy_tokens_for_baseline: But Main Line , an independent filmmaker , contended that it had reached an oral agreement with Basinger , a standard Hollywood handshake deal , and that she had later backed out of it .

source_bert_toks: but main line , an independent filmmaker , contend ##ed that it had reached an oral agreement with basin ##ger , a standard hollywood hands ##hak ##e deal , and that she had later backed out of it .

reference_raw: But Main Line, an independent filmmaker, claimed to have reached an oral deal with Basinger, a standard Hollywood handshake deal, and later backed out.

reference_spacy_tokens: But Main Line , an independent filmmaker , claimed to have reached an oral deal with Basinger , a standard Hollywood handshake deal , and later backed out .


fn_spacy_tokens_for_baseline: There 'll be no chance for me getting a job .

source_bert_toks: there ' ll be no chance for me getting a job .

reference_raw: There's no way I can get a job.

reference_spacy_tokens: There 's no way I can get a job .


fn_spacy_tokens_for_baseline: David Riley had safely negotiated the slide and a climbing frame when he tripped on scattered pieces of safety surfacing , breaking a bone in his lower right arm .

source_bert_toks: david riley had safely negotiated the slide and a climbing frame when he tripped on scattered pieces of safety surf ##acing , breaking a bone in his lower right arm .

reference_raw: David Riley had safely negotiated the slide and the climbing frame when he tripped over the scattered pieces of security surfaces and smashed the bone in his lower right arm.

reference_spacy_tokens: David Riley had safely negotiated the slide and the climbing frame when he tripped over the scattered pieces of security surfaces and smashed the bone in his lower right arm .


fn_spacy_tokens_for_baseline: ' Good morning ! ' chirps Alex .

source_bert_toks: ' good morning ! ' chi ##rp ##s alex .

reference_raw: 'Morning!' says Alex.

reference_spacy_tokens: ' Morning ! ' says Alex .


fn_spacy_tokens_for_baseline: Again like Calvin and his later disciples , Dame Julian agonises about the eternal damnation of those who are not numbered among the elect and struggles to square this with the goodness and love of God .

source_bert_toks: again like calvin and his later disciples , dame julian ago ##nis ##es about the eternal damn ##ation of those who are not numbered among the elect and struggles to square this with the goodness and love of god .

reference_raw: Again, like Calvin and his later disciples, Dame Julian suffers from the eternal curse of those who are not numbered among the voters and struggles to make up for it with God's goodness and love.

reference_spacy_tokens: Again , like Calvin and his later disciples , Dame Julian suffers from the eternal curse of those who are not numbered among the voters and struggles to make up for it with God 's goodness and love .


fn_spacy_tokens_for_baseline: Then she disappeared , until Jane opened the airing cupboard and met the unblinking gaze of Fluff and Titch side by side on the blankets .

source_bert_toks: then she disappeared , until jane opened the airing cupboard and met the un ##bl ##inking gaze of flu ##ff and ti ##tch side by side on the blankets .

reference_raw: Then she disappeared, until Jane opened the air closet and met Fluff and Titch's unblinking eyes on the blankets.

reference_spacy_tokens: Then she disappeared , until Jane opened the air closet and met Fluff and Titch 's unblinking eyes on the blankets .


fn_spacy_tokens_for_baseline: They had a new car , and went to the cinema and ate out .

source_bert_toks: they had a new car , and went to the cinema and ate out .

reference_raw: They got a new truck, went to the movies and ate.

reference_spacy_tokens: They got a new truck , went to the movies and ate .


fn_spacy_tokens_for_baseline: He fell in beside her and they began to converse amicably , like old acquaintances .

source_bert_toks: he fell in beside her and they began to converse ami ##ca ##bly , like old acquaintances .

reference_raw: He fell in beside her, and they began to talk friendlyly, like old friends.

reference_spacy_tokens: He fell in beside her , and they began to talk friendlyly , like old friends .


fn_spacy_tokens_for_baseline: As his wife , as his Louise , had slipped , there was no friend with whom he could share the sorrow he felt over his son .

source_bert_toks: as his wife , as his louise , had slipped , there was no friend with whom he could share the sorrow he felt over his son .

reference_raw: When his wife, like his Louise, slipped away, he had no friend to share the grief he felt for his son.

reference_spacy_tokens: When his wife , like his Louise , slipped away , he had no friend to share the grief he felt for his son .


fn_spacy_tokens_for_baseline: It is suggested that the bat hears echoes of its own squeaks rebounding from solid objects .

source_bert_toks: it is suggested that the bat hears echoes of its own squeak ##s rebound ##ing from solid objects .

reference_raw: It is suggested that the bat hears the echoes of its own creaks echoing from solid objects.

reference_spacy_tokens: It is suggested that the bat hears the echoes of its own creaks echoing from solid objects .


fn_spacy_tokens_for_baseline: The Labour leader and his closest advisers had decamped to a country hotel run by the local council while his own terraced house in Blackwood was being used a committee rooms for the duration of the campaign .

source_bert_toks: the labour leader and his closest advisers had dec ##amp ##ed to a country hotel run by the local council while his own terrace ##d house in black ##wood was being used a committee rooms for the duration of the campaign .

reference_raw: The Labor Leader and his closest advisors had camped in a country hotel run by the local council, while his own terraced house in Blackwood had been used as a committee room during the campaign.

reference_spacy_tokens: The Labor Leader and his closest advisors had camped in a country hotel run by the local council , while his own terraced house in Blackwood had been used as a committee room during the campaign .


fn_spacy_tokens_for_baseline: The owls hooted in Highgate , in Wimbledon , in Dulwich .

source_bert_toks: the owls ho ##oted in high ##gate , in wimbledon , in du ##l ##wich .

reference_raw: Owls whistled in Highgate, Wimbledon, Dulwich.

reference_spacy_tokens: Owls whistled in Highgate , Wimbledon , Dulwich .


fn_spacy_tokens_for_baseline: A piece of venison , for example , had not been properly trimmed of its silverskin so that in cooking , the silverskin contracted , warping the meat which therefore cooked unevenly .

source_bert_toks: a piece of ve ##nis ##on , for example , had not been properly trimmed of its silver ##skin so that in cooking , the silver ##skin contracted , warp ##ing the meat which therefore cooked uneven ##ly .

reference_raw: For example, a piece of venison had not been properly trimmed from its silver skin, so that, in cooking, the silver skin contracted and distorted the meat, which was thus unevenly cooked.

reference_spacy_tokens: For example , a piece of venison had not been properly trimmed from its silver skin , so that , in cooking , the silver skin contracted and distorted the meat , which was thus unevenly cooked .


fn_spacy_tokens_for_baseline: And young graduates are not leaving now -- multinational corporations and European Union investment mean there are plenty of opportunities for them at home .

source_bert_toks: and young graduates are not leaving now - - multinational corporations and european union investment mean there are plenty of opportunities for them at home .

reference_raw: And young graduates don't leave now - multinational corporations and investments in the European Union imply that they have a lot of opportunities at home.

reference_spacy_tokens: And young graduates do n't leave now - multinational corporations and investments in the European Union imply that they have a lot of opportunities at home .


fn_spacy_tokens_for_baseline: They hurled potatoes at firemen trying to douse a bonfire of tyres in the town 's central square , prompting riot police to fire tear gas .

source_bert_toks: they hurled potatoes at fire ##men trying to do ##use a bonfire of tyres in the town ' s central square , prompting riot police to fire tear gas .

reference_raw: They threw potatoes at the firemen who tried to use the tire fire in the central plaza of the city and urged the riot police to fire tear gas.

reference_spacy_tokens: They threw potatoes at the firemen who tried to use the tire fire in the central plaza of the city and urged the riot police to fire tear gas .


fn_spacy_tokens_for_baseline: Above each , in a colander or sieve , I would steam a vegetable and a pudding .

source_bert_toks: above each , in a cola ##nder or si ##eve , i would steam a vegetable and a pudding .

reference_raw: Above each, in a colander or a sieve, I'd smoke vegetables and puddings.

reference_spacy_tokens: Above each , in a colander or a sieve , I 'd smoke vegetables and puddings .


fn_spacy_tokens_for_baseline: Any good weight loss regime should not lead to extreme hunger ; it should be so easy that you can stick with the diet until all the weight is off .

source_bert_toks: any good weight loss regime should not lead to extreme hunger ; it should be so easy that you can stick with the diet until all the weight is off .

reference_raw: Any good weight-loss regime should not lead to extreme starvation; it should be so simple that you can hold on to your diet until you lose all your weight.

reference_spacy_tokens: Any good weight - loss regime should not lead to extreme starvation ; it should be so simple that you can hold on to your diet until you lose all your weight .


fn_spacy_tokens_for_baseline: Well , it was certainly Mickey 's lucky day .

source_bert_toks: well , it was certainly mickey ' s lucky day .

reference_raw: Well, I'm sure it was a happy day for Mickey.

reference_spacy_tokens: Well , I 'm sure it was a happy day for Mickey .


fn_spacy_tokens_for_baseline: It was a mechanical , grating sound from deep in his throat .

source_bert_toks: it was a mechanical , gr ##ating sound from deep in his throat .

reference_raw: From the depths of his throat, it was a mechanical grating noise.

reference_spacy_tokens: From the depths of his throat , it was a mechanical grating noise .


fn_spacy_tokens_for_baseline: He reached for a knob on the radio on the nightstand .

source_bert_toks: he reached for a knob on the radio on the nightstand .

reference_raw: He reached for the radio button on the bedside table.

reference_spacy_tokens: He reached for the radio button on the bedside table .


fn_spacy_tokens_for_baseline: Albright 's biographers offer an inspiring narrative of how she succeeded in becoming secretary of state , but they offer scant grounds for evaluating what has happened since .

source_bert_toks: al ##bright ' s biographer ##s offer an inspiring narrative of how she succeeded in becoming secretary of state , but they offer scan ##t grounds for evaluating what has happened since .

reference_raw: Albright's biographers offer an inspirational story about how she managed to become Secretary of State, but they offer little reason to judge what has happened since then.

reference_spacy_tokens: Albright 's biographers offer an inspirational story about how she managed to become Secretary of State , but they offer little reason to judge what has happened since then .


fn_spacy_tokens_for_baseline: There are indications , however , that certain personnel who were intimately involved in the program , including Basson , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers trafficking in dangerous weapons , and perhaps also -- if certain journalists can be believed -- to elements of a shadowy international network of right - wing extremists .

source_bert_toks: there are indications , however , that certain personnel who were intimately involved in the program , including bass ##on , may have provided technical knowledge , equipment , or materials to " rogue regimes " such as libya , to foreign intelligence personnel , to un ##sc ##rup ##ulous black market ##ers trafficking in dangerous weapons , and perhaps also - - if certain journalists can be believed - - to elements of a shadowy international network of right - wing ex ##tre ##mist ##s .

reference_raw: However, there are indications that some of the personnel involved in the programme, including Basson, may have provided technical knowledge, equipment, or equipment to "rogue regimes" such as Libya, to foreign intelligence personnel, to unscrupulous black marketers dealing in dangerous weapons, and possibly, if some journalists can be trusted, to elements of the shadowy international network of right-wing extremists.

reference_spacy_tokens: However , there are indications that some of the personnel involved in the programme , including Basson , may have provided technical knowledge , equipment , or equipment to " rogue regimes " such as Libya , to foreign intelligence personnel , to unscrupulous black marketers dealing in dangerous weapons , and possibly , if some journalists can be trusted , to elements of the shadowy international network of right - wing extremists .


fn_spacy_tokens_for_baseline: All it will do is alienate a lot of women who are n't radical feminists , and open us up to ridicule from our enemies .

source_bert_toks: all it will do is alien ##ate a lot of women who aren ' t radical feminist ##s , and open us up to rid ##ic ##ule from our enemies .

reference_raw: It will only alienate many women who are not radical feminists and open us up to mock our enemies.

reference_spacy_tokens: It will only alienate many women who are not radical feminists and open us up to mock our enemies .


fn_spacy_tokens_for_baseline: His inability to think , combined with the thickening gloom , maddened him .

source_bert_toks: his inability to think , combined with the thick ##ening gloom , madden ##ed him .

reference_raw: His inability to think, combined with the thickening gloom, made him mad.

reference_spacy_tokens: His inability to think , combined with the thickening gloom , made him mad .


fn_spacy_tokens_for_baseline: Arguably , assessment of performance should not be mixed with educational supervision , though manpower considerations might necessitate such a dual role for the educational supervisor .

source_bert_toks: arguably , assessment of performance should not be mixed with educational supervision , though manpower considerations might nec ##ess ##itate such a dual role for the educational supervisor .

reference_raw: It is clear that performance evaluations should not be combined with training supervision, although human resources considerations may require such a dual role for the training supervisor.

reference_spacy_tokens: It is clear that performance evaluations should not be combined with training supervision , although human resources considerations may require such a dual role for the training supervisor .


fn_spacy_tokens_for_baseline: Also provides the most complete and accurate list of colleges , with addresses , telephone numbers , names of presidents and student activities directors .

source_bert_toks: also provides the most complete and accurate list of colleges , with addresses , telephone numbers , names of presidents and student activities directors .

reference_raw: It also provides the most complete and precise list of universities, including the addresses, telephone numbers, the names of presidents and directors of student activities.

reference_spacy_tokens: It also provides the most complete and precise list of universities , including the addresses , telephone numbers , the names of presidents and directors of student activities .


fn_spacy_tokens_for_baseline: Finally , consider a part of our belief as to causal priority , that causes make their effects happen .

source_bert_toks: finally , consider a part of our belief as to causal priority , that causes make their effects happen .

reference_raw: Finally, consider part of our faith in causality, which causes its effects to occur.

reference_spacy_tokens: Finally , consider part of our faith in causality , which causes its effects to occur .


fn_spacy_tokens_for_baseline: The Austin Metro veered off the road , went across an embankment and ended up in a field , having ploughed through a fence and hedgerow .

source_bert_toks: the austin metro ve ##ered off the road , went across an embankment and ended up in a field , having pl ##ough ##ed through a fence and hedge ##row .

reference_raw: Austin Metro turned off the road, crossed the embankment, and ended up in a field, plowing through a fence and a hedge.

reference_spacy_tokens: Austin Metro turned off the road , crossed the embankment , and ended up in a field , plowing through a fence and a hedge .


fn_spacy_tokens_for_baseline: The Northern Echo 's assistant chief photographer Tony Bartholomew has been commended for his portfolio in the British Sports Association for the Disabled Media Awards .

source_bert_toks: the northern echo ' s assistant chief photographer tony bartholomew has been commended for his portfolio in the british sports association for the disabled media awards .

reference_raw: North Echo's assistant photographer Tony Bartholomew was praised for his portfolio of the British Sports Association for Disabled Media Awards.

reference_spacy_tokens: North Echo 's assistant photographer Tony Bartholomew was praised for his portfolio of the British Sports Association for Disabled Media Awards .


fn_spacy_tokens_for_baseline: He was a good conductor , and a first - rate trainer of singers .

source_bert_toks: he was a good conductor , and a first - rate trainer of singers .

reference_raw: He was a good conductor and an excellent singer coach.

reference_spacy_tokens: He was a good conductor and an excellent singer coach .


fn_spacy_tokens_for_baseline: It ferries commuters from the Mid - Levels apartment complexes downhill from 6 to 10 am , and uphill from 10 am to midnight .

source_bert_toks: it ferries commuter ##s from the mid - levels apartment complexes downhill from 6 to 10 am , and up ##hill from 10 am to midnight .

reference_raw: He's ferrying commuters out of the Mid-Level apartment complexes downhill between 6:00 and 10:00 a.m. and uphill between 10:00 and midnight.

reference_spacy_tokens: He 's ferrying commuters out of the Mid - Level apartment complexes downhill between 6:00 and 10:00 a.m. and uphill between 10:00 and midnight .


fn_spacy_tokens_for_baseline: Nicolo scowled , leaned back against the desk , and crossed his arms over his chest .

source_bert_toks: nico ##lo scowled , leaned back against the desk , and crossed his arms over his chest .

reference_raw: Nicolo frowned, leaned back against the table, and folded his arms across his chest.

reference_spacy_tokens: Nicolo frowned , leaned back against the table , and folded his arms across his chest .


fn_spacy_tokens_for_baseline: B : That was before I was cognisant of the fact that my Wakefield caucus would only have one in over my dead body .

source_bert_toks: b : that was before i was co ##gni ##sant of the fact that my wakefield caucus would only have one in over my dead body .

reference_raw: B: That was before I knew my Wakefield caucus had only one over my dead body.

reference_spacy_tokens: B : That was before I knew my Wakefield caucus had only one over my dead body .


fn_spacy_tokens_for_baseline: The driver is fairly safe , because of the height of the seat , but the petrol tanks appear to be exposed to damage .

source_bert_toks: the driver is fairly safe , because of the height of the seat , but the petrol tanks appear to be exposed to damage .

reference_raw: The driver is quite safe, due to the height of the seat, but it appears that the gasoline canisters are in danger of damage.

reference_spacy_tokens: The driver is quite safe , due to the height of the seat , but it appears that the gasoline canisters are in danger of damage .


fn_spacy_tokens_for_baseline: It depends how much the adults collude and what their bank balances are looking like .

source_bert_toks: it depends how much the adults col ##lu ##de and what their bank balance ##s are looking like .

reference_raw: Depends on how many adults meet and what their bank balances look like.

reference_spacy_tokens: Depends on how many adults meet and what their bank balances look like .


fn_spacy_tokens_for_baseline: However the cost of such systems has put them out of reach of most firms , particularly if the use will only be sporadic .

source_bert_toks: however the cost of such systems has put them out of reach of most firms , particularly if the use will only be sporadic .

reference_raw: However, the cost of such systems is beyond the reach of the majority of companies, especially when use will be limited.

reference_spacy_tokens: However , the cost of such systems is beyond the reach of the majority of companies , especially when use will be limited .


fn_spacy_tokens_for_baseline: The proverbial hospitality and warm welcome are still here .

source_bert_toks: the prove ##rb ##ial hospitality and warm welcome are still here .

reference_raw: Proverbial hospitality and a warm welcome are still there.

reference_spacy_tokens: Proverbial hospitality and a warm welcome are still there .


fn_spacy_tokens_for_baseline: The dancer approached , grinning stupidly as the blows rained down on his backside .

source_bert_toks: the dancer approached , grinning stupid ##ly as the blows rained down on his backside .

reference_raw: The dancer approached, grinning stupidly as the blows fell on his back.

reference_spacy_tokens: The dancer approached , grinning stupidly as the blows fell on his back .


fn_spacy_tokens_for_baseline: Jennifer told me : ' One guy wrote telling me he was going to burn me out of town , burn my house down .

source_bert_toks: jennifer told me : ' one guy wrote telling me he was going to burn me out of town , burn my house down .

reference_raw: Jennifer said to me, "There's a guy who says he's gonna burn me out of town and burn my place down.

reference_spacy_tokens: Jennifer said to me , " There 's a guy who says he 's gon na burn me out of town and burn my place down .


fn_spacy_tokens_for_baseline: From the pretty fishing village of Savelletri , the road snakes inland to Selva di Fasano , over 1,000 feet high , and boasting marvellous views .

source_bert_toks: from the pretty fishing village of save ##llet ##ri , the road snakes inland to se ##lva di fa ##san ##o , over 1 , 000 feet high , and bo ##ast ##ing marvel ##lous views .

reference_raw: From the beautiful fishing village of Savelletri, the road-snakes inland to Selva di Fasano, more than a thousand feet tall, boasting wonderful views.

reference_spacy_tokens: From the beautiful fishing village of Savelletri , the road - snakes inland to Selva di Fasano , more than a thousand feet tall , boasting wonderful views .


fn_spacy_tokens_for_baseline: Owing to this unfortunate meeting and our certainty of being observed , we decided to take up an all - round defensive position and fight it out when a recce . party arrived .

source_bert_toks: owing to this unfortunate meeting and our certainty of being observed , we decided to take up an all - round defensive position and fight it out when a rec ##ce . party arrived .

reference_raw: Because of this unfortunate meeting and our assurance that we will be observed, we have decided to take a full defensive position and fight back when the retreat party arrives.

reference_spacy_tokens: Because of this unfortunate meeting and our assurance that we will be observed , we have decided to take a full defensive position and fight back when the retreat party arrives .


fn_spacy_tokens_for_baseline: A LATE entry for the Manx International cycle race over three laps of the TT course ( 113 miles ) on June 25 is Conor Henry , from Ireland , winner of the 1992 Milk Race .

source_bert_toks: a late entry for the man ##x international cycle race over three laps of the tt course ( 113 miles ) on june 25 is conor henry , from ireland , winner of the 1992 milk race .

reference_raw: On June 25th, Conor Henry of Ireland, who won the 1992 milk race, will enter the LATE for the Manx International Cycle Race in three laps of the TT course (113 miles).

reference_spacy_tokens: On June 25th , Conor Henry of Ireland , who won the 1992 milk race , will enter the LATE for the Manx International Cycle Race in three laps of the TT course ( 113 miles ) .


fn_spacy_tokens_for_baseline: A despotic or corrupt government can more easily stifle opposition by a series of civil actions than by criminal prosecutions .

source_bert_toks: a des ##pot ##ic or corrupt government can more easily st ##if ##le opposition by a series of civil actions than by criminal prosecution ##s .

reference_raw: A despotic or corruption government can more easily suppress opposition through a series of civil actions than through criminal prosecutions.

reference_spacy_tokens: A despotic or corruption government can more easily suppress opposition through a series of civil actions than through criminal prosecutions .


fn_spacy_tokens_for_baseline: You 've got to wait till your man comes up .

source_bert_toks: you ' ve got to wait till your man comes up .

reference_raw: You'll have to hold off until your husband arrives.

reference_spacy_tokens: You 'll have to hold off until your husband arrives .


fn_spacy_tokens_for_baseline: Tragically the rope tied around Mrs Love 's ankle slipped from her husband 's grasp and she fell to her death .

source_bert_toks: tragic ##ally the rope tied around mrs love ' s ankle slipped from her husband ' s grasp and she fell to her death .

reference_raw: The cord tied around Mrs. Love's ankle slipped from her husband's hand, and she fell to her death.

reference_spacy_tokens: The cord tied around Mrs. Love 's ankle slipped from her husband 's hand , and she fell to her death .


fn_spacy_tokens_for_baseline: Unlike the blue - tailed lizards , these snakes only have the bright colour on the underside of the tail - tip .

source_bert_toks: unlike the blue - tailed lizards , these snakes only have the bright colour on the underside of the tail - tip .

reference_raw: Unlike the blue-tailed lizards, the serpents have only a bright color at the bottom of the tail.

reference_spacy_tokens: Unlike the blue - tailed lizards , the serpents have only a bright color at the bottom of the tail .


fn_spacy_tokens_for_baseline: The hotel food was too good to miss ; if they were peckish later , they could tuck into Archer 's shepherd 's pie .

source_bert_toks: the hotel food was too good to miss ; if they were peck ##ish later , they could tuck into archer ' s shepherd ' s pie .

reference_raw: The food in the hotel was too good to miss; if they were pecky later, they might be able to get into Archer's shepherd's pie.

reference_spacy_tokens: The food in the hotel was too good to miss ; if they were pecky later , they might be able to get into Archer 's shepherd 's pie .


fn_spacy_tokens_for_baseline: Net foreign investment through August this year has been running at a pace of $ 12.5 billion , about double the year - earlier rate .

source_bert_toks: net foreign investment through august this year has been running at a pace of $ 12 . 5 billion , about double the year - earlier rate .

reference_raw: Net foreign investment ran at $12.5 billion this year in August, around twice the year-early level.

reference_spacy_tokens: Net foreign investment ran at $ 12.5 billion this year in August , around twice the year - early level .


fn_spacy_tokens_for_baseline: The stairs were my usual route to the ' hell - hole ' in which I lived and walking up them I had to dodge numerous heaps of ' gunk ' .

source_bert_toks: the stairs were my usual route to the ' hell - hole ' in which i lived and walking up them i had to dodge numerous heap ##s of ' gun ##k ' .

reference_raw: The stairs were my usual route to the "hellhole" where I lived, and I had to walk up the stairs to avoid a lot of 'gunk' piles.

reference_spacy_tokens: The stairs were my usual route to the " hellhole " where I lived , and I had to walk up the stairs to avoid a lot of ' gunk ' piles .


fn_spacy_tokens_for_baseline: The Radcliffes lived at Dilston Hall , by Devil Water , a tributary of the Tyne that joins the main river near Hexham .

source_bert_toks: the radcliffe ##s lived at dil ##ston hall , by devil water , a tributary of the tyne that joins the main river near he ##x ##ham .

reference_raw: The Radcliffes lived in the Hall of Dilston, by Devil Water, the Tyne tributary, which joins the central river near Hexham.

reference_spacy_tokens: The Radcliffes lived in the Hall of Dilston , by Devil Water , the Tyne tributary , which joins the central river near Hexham .


fn_spacy_tokens_for_baseline: Charles volunteered to have a look out and clambered on to the seat , testing the strength of the pipe running up the wall .

source_bert_toks: charles volunteered to have a look out and cl ##am ##bered on to the seat , testing the strength of the pipe running up the wall .

reference_raw: Charles volunteered to look out and climbed into the seat, testing the power of the pipe running up the wall.

reference_spacy_tokens: Charles volunteered to look out and climbed into the seat , testing the power of the pipe running up the wall .


fn_spacy_tokens_for_baseline: Is the doctor in breach of his duty to his patient if he discontinues treatment ?

source_bert_toks: is the doctor in breach of his duty to his patient if he disco ##nti ##nu ##es treatment ?

reference_raw: Does a doctor violate his duty to a patient if he stops treatment?

reference_spacy_tokens: Does a doctor violate his duty to a patient if he stops treatment ?


fn_spacy_tokens_for_baseline: Nicaragua retaliated on Dec. 30 by ordering 20 US diplomats to leave the country forthwith , and US President George Bush admitted on the same day that the action was a ' screw - up ' .

source_bert_toks: nicaragua re ##tal ##iated on dec . 30 by ordering 20 us diplomats to leave the country forth ##with , and us president george bush admitted on the same day that the action was a ' screw - up ' .

reference_raw: Nicaragua retaliated on December 30 by ordering 20 American diplomats to leave the country immediately, and on the same day US President George Bush admitted that the action had been a failure.

reference_spacy_tokens: Nicaragua retaliated on December 30 by ordering 20 American diplomats to leave the country immediately , and on the same day US President George Bush admitted that the action had been a failure .


fn_spacy_tokens_for_baseline: In stark contrast to the problems over EDC , both treaties were ratified by the end of the year .

source_bert_toks: in stark contrast to the problems over ed ##c , both treaties were ratified by the end of the year .

reference_raw: In contrast to the problems of the EDC, the two treaties had been approved by the end of the year.

reference_spacy_tokens: In contrast to the problems of the EDC , the two treaties had been approved by the end of the year .


fn_spacy_tokens_for_baseline: It was not until Conte fused graphite with China clay that loose powdered graphite could be formed into drawing lengths , so avoiding the English monopoly on their cut lengths from Borrowdale .

source_bert_toks: it was not until con ##te fused graph ##ite with china clay that loose powder ##ed graph ##ite could be formed into drawing lengths , so avoiding the english monopoly on their cut lengths from borrow ##dale .

reference_raw: It was only after Conte had melted the graphite into Chinese clay that the loose powdered graphite could be formed to draw lengths, thus avoiding the English monopoly on their cut lengths from Borrowdale.

reference_spacy_tokens: It was only after Conte had melted the graphite into Chinese clay that the loose powdered graphite could be formed to draw lengths , thus avoiding the English monopoly on their cut lengths from Borrowdale .


fn_spacy_tokens_for_baseline: The cupboard doors had all been deeply hacked and scored with a knife , every crisp bag had been burst , every stick of rock shattered and splintered : it was a very thorough job .

source_bert_toks: the cupboard doors had all been deeply hacked and scored with a knife , every crisp bag had been burst , every stick of rock shattered and splinter ##ed : it was a very thorough job .

reference_raw: All the doors to the closet were deeply hacked and scored with a knife, all the crisp sacks were broken, all the sticks of rock splintered and splintered: it was a very thorough job.

reference_spacy_tokens: All the doors to the closet were deeply hacked and scored with a knife , all the crisp sacks were broken , all the sticks of rock splintered and splintered : it was a very thorough job .


fn_spacy_tokens_for_baseline: She had shouted out to them , ' Do n't hurt him !

source_bert_toks: she had shouted out to them , ' don ' t hurt him !

reference_raw: She called out, "Don't hurt him!

reference_spacy_tokens: She called out , " Do n't hurt him !


fn_spacy_tokens_for_baseline: The ability to operate as part of a management team and to manage an expanding group is essential .

source_bert_toks: the ability to operate as part of a management team and to manage an expanding group is essential .

reference_raw: It is essential to be able to work as part of the management team and lead the expanding group.

reference_spacy_tokens: It is essential to be able to work as part of the management team and lead the expanding group .


fn_spacy_tokens_for_baseline: The early 18th century 30-acre garden , set in 300 acres of dramatic parkland around the River Rye , has been described as ' the supreme masterpiece of the art of the landscape gardener ' .

source_bert_toks: the early 18th century 30 - acre garden , set in 300 acres of dramatic park ##land around the river rye , has been described as ' the supreme masterpiece of the art of the landscape gardener ' .

reference_raw: At the beginning of the 18th century, the 30-acre garden, set in 300 acres of dramatic parkland around the Rye River, was described as "the greatest masterpiece of landscape gardening."

reference_spacy_tokens: At the beginning of the 18th century , the 30-acre garden , set in 300 acres of dramatic parkland around the Rye River , was described as " the greatest masterpiece of landscape gardening . "


fn_spacy_tokens_for_baseline: She pulled on her towelling bathrobe and slid her feet into a pair of sandals .

source_bert_toks: she pulled on her towel ##ling bath ##ro ##be and slid her feet into a pair of sandals .

reference_raw: She pulled on her robe and slipped her feet into her sandals.

reference_spacy_tokens: She pulled on her robe and slipped her feet into her sandals .


fn_spacy_tokens_for_baseline: On dry land , government projects have n't fared much better .

source_bert_toks: on dry land , government projects haven ' t fare ##d much better .

reference_raw: On dry soil, government projects did not go much better.

reference_spacy_tokens: On dry soil , government projects did not go much better .


fn_spacy_tokens_for_baseline: The government began the transfer on Nov. 2 of 32,000 hectares of land , including parcels in the Cape Province and the Transvaal , to the Bophuthatswana bantustan .

source_bert_toks: the government began the transfer on nov . 2 of 32 , 000 hectares of land , including parcels in the cape province and the transvaal , to the bop ##hu ##tha ##ts ##wana ban ##tus ##tan .

reference_raw: The Government has commenced the transfer of 32,000 ha of land, including land in Cape Province and Transvaal, to the Bantustan of Bophuthaswana on November 2.

reference_spacy_tokens: The Government has commenced the transfer of 32,000 ha of land , including land in Cape Province and Transvaal , to the Bantustan of Bophuthaswana on November 2 .


fn_spacy_tokens_for_baseline: In 1956 Japanese companies experimented in the Antarctic with electrical equipment , but they found that the electric current impeded the blood circulation and this lowered the quality of the whale meat .

source_bert_toks: in 1956 japanese companies experimented in the antarctic with electrical equipment , but they found that the electric current imp ##eded the blood circulation and this lowered the quality of the whale meat .

reference_raw: In 1956, Japanese companies tried to use electrical equipment in Antarctica, but found that electrical currents prevented the circulation of blood, which reduced the quality of whale meat.

reference_spacy_tokens: In 1956 , Japanese companies tried to use electrical equipment in Antarctica , but found that electrical currents prevented the circulation of blood , which reduced the quality of whale meat .


fn_spacy_tokens_for_baseline: I was miserable with cold , but although I was prepared to admit that I was miserable , I was n't prepared to admit that my misery had any connection with cold .

source_bert_toks: i was miserable with cold , but although i was prepared to admit that i was miserable , i wasn ' t prepared to admit that my misery had any connection with cold .

reference_raw: I was unhappy with the cold, but though I was prepared to admit that I was unhappy, I was not prepared to admit that my suffering had something to do with the cold.

reference_spacy_tokens: I was unhappy with the cold , but though I was prepared to admit that I was unhappy , I was not prepared to admit that my suffering had something to do with the cold .


fn_spacy_tokens_for_baseline: Other events included a Surrey County short tennis session , a ' challenge - the - pro ' competition and numerous other attractions involving junior and experienced players alike .

source_bert_toks: other events included a surrey county short tennis session , a ' challenge - the - pro ' competition and numerous other attractions involving junior and experienced players alike .

reference_raw: Other events included a short tennis session in Surrey County, a 'challenge-to-pro' competition, and a number of other attractions involving young and skilled players.

reference_spacy_tokens: Other events included a short tennis session in Surrey County , a ' challenge - to - pro ' competition , and a number of other attractions involving young and skilled players .


fn_spacy_tokens_for_baseline: Of the partisan councils , most are dominated by the Labour Party with some nationalist presence on occasion .

source_bert_toks: of the partisan councils , most are dominated by the labour party with some nationalist presence on occasion .

reference_raw: Of the guerrilla councils, most of them are controlled by the Labour Party, sometimes with a certain nationalist presence.

reference_spacy_tokens: Of the guerrilla councils , most of them are controlled by the Labour Party , sometimes with a certain nationalist presence .


fn_spacy_tokens_for_baseline: Although Mr Cossiga has now backed down , it was his most serious mishap to date .

source_bert_toks: although mr co ##ssi ##ga has now backed down , it was his most serious mis ##ha ##p to date .

reference_raw: Although Mr. Cossiga has now resigned, this has been his most serious accident so far.

reference_spacy_tokens: Although Mr. Cossiga has now resigned , this has been his most serious accident so far .


fn_spacy_tokens_for_baseline: Their names were taken from Amal 's brother , but by the time they were collected and asked to appear before the police for statements they had taken great pains to prepare their story .

source_bert_toks: their names were taken from ama ##l ' s brother , but by the time they were collected and asked to appear before the police for statements they had taken great pains to prepare their story .

reference_raw: Their names had been taken from Amal's brother, but by the time they had been collected and requested to appear before the police for a statement, they had taken great pains to prepare their story.

reference_spacy_tokens: Their names had been taken from Amal 's brother , but by the time they had been collected and requested to appear before the police for a statement , they had taken great pains to prepare their story .


fn_spacy_tokens_for_baseline: He searched her eyes for a moment , then sighed and held up his hands in surrender .

source_bert_toks: he searched her eyes for a moment , then sighed and held up his hands in surrender .

reference_raw: He looked her in the eye for a moment, then sighed and raised his hands in surrender.

reference_spacy_tokens: He looked her in the eye for a moment , then sighed and raised his hands in surrender .


fn_spacy_tokens_for_baseline: We analyzed the ATM protein in different cell lines .

source_bert_toks: we analyzed the atm protein in different cell lines .

reference_raw: We've analyzed ATM proteins in various cell lines.

reference_spacy_tokens: We 've analyzed ATM proteins in various cell lines .


fn_spacy_tokens_for_baseline: Over coffee and a home - baked cake they told me of their plans to marry her off .

source_bert_toks: over coffee and a home - baked cake they told me of their plans to marry her off .

reference_raw: Over coffee and homemade pie, they told me about their plans to take her away.

reference_spacy_tokens: Over coffee and homemade pie , they told me about their plans to take her away .


fn_spacy_tokens_for_baseline: She splashed water on her face , wishing she had her overnight case up here with her , wondering if it would be possible to make a deal with Ace .

source_bert_toks: she splashed water on her face , wishing she had her overnight case up here with her , wondering if it would be possible to make a deal with ace .

reference_raw: She splattered water on her face, wishing she had a overnight case with her, wondering if she could make a deal with Ace.

reference_spacy_tokens: She splattered water on her face , wishing she had a overnight case with her , wondering if she could make a deal with Ace .