fn_spacy_tokens_for_baseline: Well that 's extremely laudable , but I do n't think on the whole the public are too worried about whether the thing is legally constituted .

source_bert_toks: well that ' s extremely lau ##dable , but i don ' t think on the whole the public are too worried about whether the thing is legally constituted .

reference_raw: Well, that's very commendable, but I don't think the general public cares too much if it's legal.

reference_spacy_tokens: Well , that 's very commendable , but I do n't think the general public cares too much if it 's legal .


fn_spacy_tokens_for_baseline: Before our trip to Mexico I carefully researched all the available material on the Yellow Sword .

source_bert_toks: before our trip to mexico i carefully researched all the available material on the yellow sword .

reference_raw: Before we went to Mexico, I carefully examined all the material available on the yellow sword.

reference_spacy_tokens: Before we went to Mexico , I carefully examined all the material available on the yellow sword .


fn_spacy_tokens_for_baseline: Pregnancy is an upsetting time for some people .

source_bert_toks: pregnancy is an upset ##ting time for some people .

reference_raw: For some people, pregnancy is a disturbing time.

reference_spacy_tokens: For some people , pregnancy is a disturbing time .


fn_spacy_tokens_for_baseline: First , why ticket splitting has increased and taken the peculiar pattern that it has over the past half century : Prior to the election of Franklin Roosevelt as president and the advent of the New Deal , government occupied a much smaller role in society and the prisoner 's dilemma problem confronting voters in races for Congress was considerably less severe .

source_bert_toks: first , why ticket splitting has increased and taken the peculiar pattern that it has over the past half century : prior to the election of franklin roosevelt as president and the advent of the new deal , government occupied a much smaller role in society and the prisoner ' s dilemma problem confronting voters in races for congress was considerably less severe .

reference_raw: First, why the distribution of tickets increased and took on the strange pattern of the last half-century: before the election of Franklin Roosevelt as president and the arrival of the New Deal, the government had a much smaller role in society, and the problem of the prisoner's dilemma facing voters in the Congressional races was far less serious.

reference_spacy_tokens: First , why the distribution of tickets increased and took on the strange pattern of the last half - century : before the election of Franklin Roosevelt as president and the arrival of the New Deal , the government had a much smaller role in society , and the problem of the prisoner 's dilemma facing voters in the Congressional races was far less serious .


fn_spacy_tokens_for_baseline: Whether you choose to dine in one of the Macanese , Chinese , traditional Portuguese , or international - style restaurants , you will be treated to a hearty meal at a good price .

source_bert_toks: whether you choose to din ##e in one of the mac ##ane ##se , chinese , traditional portuguese , or international - style restaurants , you will be treated to a heart ##y meal at a good price .

reference_raw: Whether you choose to eat in one of the Macanese, Chinese, traditional Portugal, or international-style restaurants, you will be treated as a hearty meal for a good price.

reference_spacy_tokens: Whether you choose to eat in one of the Macanese , Chinese , traditional Portugal , or international - style restaurants , you will be treated as a hearty meal for a good price .


fn_spacy_tokens_for_baseline: Answers to these will also need to be worked out and if possible these answers should be framed in such a way that the points you want to make can be slid in as well .

source_bert_toks: answers to these will also need to be worked out and if possible these answers should be framed in such a way that the points you want to make can be slid in as well .

reference_raw: The answers to these questions will also have to be worked out and, if possible, they should be formulated in such a way that the points you wish to make can also be inserted.

reference_spacy_tokens: The answers to these questions will also have to be worked out and , if possible , they should be formulated in such a way that the points you wish to make can also be inserted .


fn_spacy_tokens_for_baseline: On Aug. 25 FPR radio claimed that Habyarimana 's party , the National Republican Movement for Democracy and Development , was ' indulging in the odious slaughter of peaceful , innocent and defenceless civilians ' .

source_bert_toks: on aug . 25 f ##pr radio claimed that ha ##by ##ari ##mana ' s party , the national republican movement for democracy and development , was ' ind ##ul ##ging in the odi ##ous slaughter of peaceful , innocent and defence ##less civilians ' .

reference_raw: On August 25, the FPR radio said that Habyarimana's party, the National Republican Movement for Democracy and Development, was taking part in the odious massacre of peaceful, innocent and defenseless civilians.

reference_spacy_tokens: On August 25 , the FPR radio said that Habyarimana 's party , the National Republican Movement for Democracy and Development , was taking part in the odious massacre of peaceful , innocent and defenseless civilians .


fn_spacy_tokens_for_baseline: 21 RICH : Right .

source_bert_toks: 21 rich : right .

reference_raw: 21 RICH: That's correct.

reference_spacy_tokens: 21 RICH : That 's correct .


fn_spacy_tokens_for_baseline: Dig out the clumps of roots and divide them into smaller portions to replant or pot - up .

source_bert_toks: dig out the cl ##ump ##s of roots and divide them into smaller portions to rep ##lan ##t or pot - up .

reference_raw: Dig out the root clusters and divide them into smaller portions for replanting or potting.

reference_spacy_tokens: Dig out the root clusters and divide them into smaller portions for replanting or potting .


fn_spacy_tokens_for_baseline: Miss Grey was short and dumpy and all she could manage to do was warble a little out of tune .

source_bert_toks: miss grey was short and dump ##y and all she could manage to do was war ##ble a little out of tune .

reference_raw: Miss Grey was small and plump, and all she could do was warble a little out of tune.

reference_spacy_tokens: Miss Grey was small and plump , and all she could do was warble a little out of tune .


fn_spacy_tokens_for_baseline: There is a discomforting hint of what the scale of that disaster will be .

source_bert_toks: there is a discomfort ##ing hint of what the scale of that disaster will be .

reference_raw: There's an unsettling indication of the magnitude of this catastrophe.

reference_spacy_tokens: There 's an unsettling indication of the magnitude of this catastrophe .


fn_spacy_tokens_for_baseline: Zambia ordered Nathan , who was looking up perplexed .

source_bert_toks: zambia ordered nathan , who was looking up per ##plex ##ed .

reference_raw: Zambia commanded Nathan, who looked up puzzled.

reference_spacy_tokens: Zambia commanded Nathan , who looked up puzzled .


fn_spacy_tokens_for_baseline: Therefore , we evaluated the role of diagnostic and therapeutic endoscopy in a consecutive series of patients referred to our gastroenterology department with bile duct injury after laparoscopic cholecystectomy .

source_bert_toks: therefore , we evaluated the role of diagnostic and therapeutic end ##os ##co ##py in a consecutive series of patients referred to our gas ##tro ##enter ##ology department with bile duct injury after lap ##aro ##scopic cho ##le ##cy ##ste ##ct ##omy .

reference_raw: We have therefore assessed the role of diagnosis and treatment of endoscopy in a series of patients who have been referred to our gastroenterology department with bile duct injury following laparoscopic cholecystectomy.

reference_spacy_tokens: We have therefore assessed the role of diagnosis and treatment of endoscopy in a series of patients who have been referred to our gastroenterology department with bile duct injury following laparoscopic cholecystectomy .


fn_spacy_tokens_for_baseline: Yesterday 's incident involved phosgene , a toxic industrial chemical used as a choking agent in World War I and to make plastics and pesticides . " ( Baltimore Sun , 21Apr06 , Justin Fenton ) ( Link )

source_bert_toks: yesterday ' s incident involved ph ##os ##gen ##e , a toxic industrial chemical used as a choking agent in world war i and to make plastics and pest ##icides . " ( baltimore sun , 21 ##ap ##r ##0 ##6 , justin fenton ) ( link )

reference_raw: Yesterday's accident involved phosgene, a toxic industrial chemical used as a suffocating agent in World War I and for the manufacture of plastics and pesticides." (Baltimore Sun, 21 April 2006, Justin Fenton)

reference_spacy_tokens: Yesterday 's accident involved phosgene , a toxic industrial chemical used as a suffocating agent in World War I and for the manufacture of plastics and pesticides . " ( Baltimore Sun , 21 April 2006 , Justin Fenton )


fn_spacy_tokens_for_baseline: NORTH Yorkshire county council plans to market its advice for the appraisal of teachers and heads throughout the country after its scheme was acclaimed by teachers and consultants .

source_bert_toks: north yorkshire county council plans to market its advice for the app ##rai ##sal of teachers and heads throughout the country after its scheme was acclaimed by teachers and consultants .

reference_raw: NORTH Yorkshire County Council intends to market its advice for the assessment of teachers and heads across the country after it has been approved by teachers and consultants.

reference_spacy_tokens: NORTH Yorkshire County Council intends to market its advice for the assessment of teachers and heads across the country after it has been approved by teachers and consultants .


fn_spacy_tokens_for_baseline: Some kung fu clubs place a blindfolded student amid a circle of fellow students , who attack him with one technique at intermittent intervals .

source_bert_toks: some kung fu clubs place a blind ##fold ##ed student amid a circle of fellow students , who attack him with one technique at intermittent intervals .

reference_raw: Some kung fu clubs place a blindfolded student in the middle of a group of fellow students who attack him with one technique at random intervals.

reference_spacy_tokens: Some kung fu clubs place a blindfolded student in the middle of a group of fellow students who attack him with one technique at random intervals .


fn_spacy_tokens_for_baseline: Lollo raised one leg and waggled her foot cheekily .

source_bert_toks: lo ##llo raised one leg and wa ##ggle ##d her foot cheek ##ily .

reference_raw: Lollo lifted one foot and waved it cheekily.

reference_spacy_tokens: Lollo lifted one foot and waved it cheekily .


fn_spacy_tokens_for_baseline: He is on vacation in London with daughter Sally ( Thora Birch ) and wife Cathy -- played by Anne Archer who seems increasingly typecast as the loyal spouse .

source_bert_toks: he is on vacation in london with daughter sally ( thor ##a birch ) and wife cathy - - played by anne archer who seems increasingly type ##cast as the loyal spouse .

reference_raw: He's on vacation in London with his daughter Sally (Thora Birch) and his wife, Cathy, played by Anna Archer, who seems to be more and more like a loyal husband.

reference_spacy_tokens: He 's on vacation in London with his daughter Sally ( Thora Birch ) and his wife , Cathy , played by Anna Archer , who seems to be more and more like a loyal husband .


fn_spacy_tokens_for_baseline: The result is often not so much an individual guitar , but rather an amalgam of bits nicked from here and bobs lifted from there .

source_bert_toks: the result is often not so much an individual guitar , but rather an ama ##lga ##m of bits nick ##ed from here and bob ##s lifted from there .

reference_raw: Often the result is not so much an individual guitar, but rather an amalgam of bits nicked from here and bobs picked up from there.

reference_spacy_tokens: Often the result is not so much an individual guitar , but rather an amalgam of bits nicked from here and bobs picked up from there .


fn_spacy_tokens_for_baseline: ' His face creased into a fierce frown of concentration , then he let it go , shaking his head .

source_bert_toks: ' his face cr ##eased into a fierce frown of concentration , then he let it go , shaking his head .

reference_raw: His face wrinkled into a fierce scowl of concentration, then he let it go and shook his head.

reference_spacy_tokens: His face wrinkled into a fierce scowl of concentration , then he let it go and shook his head .


fn_spacy_tokens_for_baseline: Sleeping was no better -- fleabites tormented him , fears plagued him like bad dreams .

source_bert_toks: sleeping was no better - - flea ##bit ##es tormented him , fears plagued him like bad dreams .

reference_raw: Sleep was no better - the fleabites tortured him, the fears plagued him like nightmares.

reference_spacy_tokens: Sleep was no better - the fleabites tortured him , the fears plagued him like nightmares .


fn_spacy_tokens_for_baseline: High overhead , its soft hiss merging unnoticed with the night breeze , an ultrasonic whistle triggered into life , beaming its urgent summons to the killer pack .

source_bert_toks: high overhead , its soft hiss merging unnoticed with the night breeze , an ultra ##sonic whistle triggered into life , beaming its urgent summons to the killer pack .

reference_raw: High above them, its soft sizzling, unnoticed by the night breeze, an ultrasonic whistle came into life, sending its urgent call to the assassin's pack.

reference_spacy_tokens: High above them , its soft sizzling , unnoticed by the night breeze , an ultrasonic whistle came into life , sending its urgent call to the assassin 's pack .


fn_spacy_tokens_for_baseline: But even as the sound of airstrikes , tank fire and artillery barrages echoed across northern Gaza , both sides signaled a softening of their positions on the terms for the possible release of the Israeli soldier .

source_bert_toks: but even as the sound of airs ##tri ##kes , tank fire and artillery barrage ##s echoed across northern gaza , both sides signaled a soft ##ening of their positions on the terms for the possible release of the israeli soldier .

reference_raw: But even as the sound of air strikes, tank fires, and artillery barrages echoed in the north of Gaza, both sides signaled a softening of their position on the conditions for the release of the Israeli soldier.

reference_spacy_tokens: But even as the sound of air strikes , tank fires , and artillery barrages echoed in the north of Gaza , both sides signaled a softening of their position on the conditions for the release of the Israeli soldier .


fn_spacy_tokens_for_baseline: Employers should n't ask you questions about childcare but chances are , they will .

source_bert_toks: employers shouldn ' t ask you questions about child ##care but chances are , they will .

reference_raw: The employers shouldn't ask you about childcare, but the odds are, they'll do it.

reference_spacy_tokens: The employers should n't ask you about childcare , but the odds are , they 'll do it .


fn_spacy_tokens_for_baseline: Clearly it is not part of the reason for any government 's authority that it should pass unjust or immoral laws .

source_bert_toks: clearly it is not part of the reason for any government ' s authority that it should pass un ##just or im ##moral laws .

reference_raw: It is clear that it is not part of the reason for any government's authority to pass unfair or immoral laws.

reference_spacy_tokens: It is clear that it is not part of the reason for any government 's authority to pass unfair or immoral laws .


fn_spacy_tokens_for_baseline: You could partition off part of the tank for the other fish but this would detract from the overall appearance and may not necessarily work .

source_bert_toks: you could partition off part of the tank for the other fish but this would det ##rac ##t from the overall appearance and may not necessarily work .

reference_raw: Part of the tank could be separated from the other fish, but this would detract from the overall appearance and might not necessarily work.

reference_spacy_tokens: Part of the tank could be separated from the other fish , but this would detract from the overall appearance and might not necessarily work .


fn_spacy_tokens_for_baseline: Where members of staff are unkind or even cruel to children or even other staff swift disciplinary action needs to be taken .

source_bert_toks: where members of staff are un ##kind or even cruel to children or even other staff swift disciplinary action needs to be taken .

reference_raw: If staff members are rude or even cruel to children or other staff, swift disciplinary action must be taken.

reference_spacy_tokens: If staff members are rude or even cruel to children or other staff , swift disciplinary action must be taken .


fn_spacy_tokens_for_baseline: He also fathered a child by Marevna ( Maria Vorobiev ) and abandoned both women when he left for Mexico in 1921 .

source_bert_toks: he also father ##ed a child by mare ##vna ( maria vo ##ro ##bie ##v ) and abandoned both women when he left for mexico in 1921 .

reference_raw: He also fathered a child from Marevna (Maria Vorobiev) and left both women when he left for Mexico in 1921.

reference_spacy_tokens: He also fathered a child from Marevna ( Maria Vorobiev ) and left both women when he left for Mexico in 1921 .


fn_spacy_tokens_for_baseline: And in doing so she has proved herself a mightier force than the Palace propaganda machine , which suggested that she might not attend because she was too old and frail to make the long journey to Crathie Church .

source_bert_toks: and in doing so she has proved herself a might ##ier force than the palace propaganda machine , which suggested that she might not attend because she was too old and frail to make the long journey to cr ##athi ##e church .

reference_raw: And in doing so, she proved to be more powerful than the Palace propaganda machine, which suggested that she might not be present because she was too old and fragile to make the long journey to the Church of Crathie.

reference_spacy_tokens: And in doing so , she proved to be more powerful than the Palace propaganda machine , which suggested that she might not be present because she was too old and fragile to make the long journey to the Church of Crathie .


fn_spacy_tokens_for_baseline: Peppermint -- aids digestion ; cooled teabags squeezed and rubbed onto skin make a good antiseptic tonic .

source_bert_toks: pepper ##min ##t - - aids digest ##ion ; cooled tea ##bags squeezed and rubbed onto skin make a good anti ##se ##ptic tonic .

reference_raw: Peppermint - it helps digestion; cooled teabags squeezed and scraped on the skin make a good antiseptic tonic.

reference_spacy_tokens: Peppermint - it helps digestion ; cooled teabags squeezed and scraped on the skin make a good antiseptic tonic .


fn_spacy_tokens_for_baseline: They will be writing to the centre to demand an explanation and if possible an undertaking to remove the bolts , although this seems unlikely .

source_bert_toks: they will be writing to the centre to demand an explanation and if possible an undertaking to remove the bolts , although this seems unlikely .

reference_raw: They will write to the center to ask for explanations and, if possible, a commitment to remove the screws, although this seems unlikely.

reference_spacy_tokens: They will write to the center to ask for explanations and , if possible , a commitment to remove the screws , although this seems unlikely .


fn_spacy_tokens_for_baseline: The lesion is not always easily detected on endoscopic examination , especially when it is not actively bleeding .

source_bert_toks: the les ##ion is not always easily detected on end ##os ##copic examination , especially when it is not actively bleeding .

reference_raw: Lesions are not always easily found in endoscopic examinations, especially if they are not actively bleeding.

reference_spacy_tokens: Lesions are not always easily found in endoscopic examinations , especially if they are not actively bleeding .


fn_spacy_tokens_for_baseline: With deregulation of Australia 's domestic air system from next year foreshadowing greater competition , both the pilots and the airlines see the dispute as a final show of strength .

source_bert_toks: with der ##eg ##ulation of australia ' s domestic air system from next year fore ##sha ##do ##wing greater competition , both the pilots and the airlines see the dispute as a final show of strength .

reference_raw: Since the deregulation of Australia's national air system from next year foreshadows more competition, pilots and airlines see the dispute as the final demonstration of strength.

reference_spacy_tokens: Since the deregulation of Australia 's national air system from next year foreshadows more competition , pilots and airlines see the dispute as the final demonstration of strength .


fn_spacy_tokens_for_baseline: Deee - Lite seem a little offended when I ask whether they were n't worried whether the DJs would n't like their new songs .

source_bert_toks: dee ##e - lit ##e seem a little offended when i ask whether they weren ' t worried whether the djs wouldn ' t like their new songs .

reference_raw: Dee-Lite seems a little offended when I ask if they're afraid the DJs won't like their new songs.

reference_spacy_tokens: Dee - Lite seems a little offended when I ask if they 're afraid the DJs wo n't like their new songs .


fn_spacy_tokens_for_baseline: It is here , when Woosnam drove into the creek at the 13th last year , that the stress told , too , on a heckling crowd desperate for a home win .

source_bert_toks: it is here , when woo ##s ##nam drove into the creek at the 13th last year , that the stress told , too , on a heck ##ling crowd desperate for a home win .

reference_raw: It was here, when Woosnam entered the stream on the 13th of last year, that stress also told the heckling crowd desperate to win home.

reference_spacy_tokens: It was here , when Woosnam entered the stream on the 13th of last year , that stress also told the heckling crowd desperate to win home .


fn_spacy_tokens_for_baseline: When I first came to England with your father , I was shocked at the women 's laziness here .

source_bert_toks: when i first came to england with your father , i was shocked at the women ' s la ##zine ##ss here .

reference_raw: When I first came to England with your father, I was shocked by how lazy the women were here.

reference_spacy_tokens: When I first came to England with your father , I was shocked by how lazy the women were here .


fn_spacy_tokens_for_baseline: The SLEJF is also the first NGO from Sri Lanka to be awarded this UN accolade .

source_bert_toks: the sl ##ej ##f is also the first ngo from sri lanka to be awarded this un acc ##ola ##de .

reference_raw: The SLEJF is also the first non-governmental organisation from Sri Lanka to receive this UN accommodation.

reference_spacy_tokens: The SLEJF is also the first non - governmental organisation from Sri Lanka to receive this UN accommodation .


fn_spacy_tokens_for_baseline: ' Quiet please in the wings ! ' hissed the Stage Manager .

source_bert_toks: ' quiet please in the wings ! ' hissed the stage manager .

reference_raw: 'Shut up on your wings, please!' said the stage manager.

reference_spacy_tokens: ' Shut up on your wings , please ! ' said the stage manager .


fn_spacy_tokens_for_baseline: That nose has stood their descendants in very good stead right up until this day .

source_bert_toks: that nose has stood their descendants in very good ste ##ad right up until this day .

reference_raw: This nose has kept their offspring in a very good position until today.

reference_spacy_tokens: This nose has kept their offspring in a very good position until today .


fn_spacy_tokens_for_baseline: Er the situation is that what has happened is that government has lowered the mandatory ceiling from fifty thousand to twenty thousand .

source_bert_toks: er the situation is that what has happened is that government has lowered the mandatory ceiling from fifty thousand to twenty thousand .

reference_raw: Er, the situation is that the government has reduced the mandatory ceiling from fifty thousand to twenty thousand.

reference_spacy_tokens: Er , the situation is that the government has reduced the mandatory ceiling from fifty thousand to twenty thousand .


fn_spacy_tokens_for_baseline: Germany and China allegedly provided technical and material assistance to the al - Fatah program .

source_bert_toks: germany and china allegedly provided technical and material assistance to the al - fat ##ah program .

reference_raw: Germany and China allegedly provided technical and material support for the Al-Fatah programme.

reference_spacy_tokens: Germany and China allegedly provided technical and material support for the Al - Fatah programme .


fn_spacy_tokens_for_baseline: As many as 90 per cent of the persons arrested under these powers are released without charge after having been detained for anything from four hours to seven days .

source_bert_toks: as many as 90 per cent of the persons arrested under these powers are released without charge after having been detained for anything from four hours to seven days .

reference_raw: Up to 90 % of the persons detained under these powers shall be released free of charge after being detained for anything from four hours to seven days.

reference_spacy_tokens: Up to 90 % of the persons detained under these powers shall be released free of charge after being detained for anything from four hours to seven days .


fn_spacy_tokens_for_baseline: I dread to think of the thousands of women who stretch their limbs to unhealthy lengths in a vain bid to attain taut buttocks and breasts .

source_bert_toks: i dread to think of the thousands of women who stretch their limbs to un ##hea ##lth ##y lengths in a vain bid to attain taut butt ##ocks and breasts .

reference_raw: I'm afraid to think of thousands of women stretching their extremities to unhealthy lengths in a vain bid to reach the tight buttocks and breasts.

reference_spacy_tokens: I 'm afraid to think of thousands of women stretching their extremities to unhealthy lengths in a vain bid to reach the tight buttocks and breasts .


fn_spacy_tokens_for_baseline: He took a step towards her , then another , until he stood before her , face to face .

source_bert_toks: he took a step towards her , then another , until he stood before her , face to face .

reference_raw: He took a step toward her, then another, until he was face-to-face in front of her.

reference_spacy_tokens: He took a step toward her , then another , until he was face - to - face in front of her .


fn_spacy_tokens_for_baseline: We believe that the maximum sentence for such a crime should reflect its gravity .

source_bert_toks: we believe that the maximum sentence for such a crime should reflect its gravity .

reference_raw: We believe that the highest sentence for such a crime should reflect the seriousness of the crime.

reference_spacy_tokens: We believe that the highest sentence for such a crime should reflect the seriousness of the crime .


fn_spacy_tokens_for_baseline: The coastal highway through Zawiya is a key artery , and it has assumed even greater importance since NATO maritime patrols have stopped many container ships from delivering cargo , including gasoline , to Libya .

source_bert_toks: the coastal highway through za ##wi ##ya is a key artery , and it has assumed even greater importance since nato maritime patrols have stopped many container ships from delivering cargo , including gasoline , to libya .

reference_raw: The Coastal Highway through Zawiya is a key artery, and it has become even more important since the NATO Marine Guards have stopped many container ships from delivering cargo, including petrol, to Libya.

reference_spacy_tokens: The Coastal Highway through Zawiya is a key artery , and it has become even more important since the NATO Marine Guards have stopped many container ships from delivering cargo , including petrol , to Libya .


fn_spacy_tokens_for_baseline: But Adams ' polyester used a peroxide catalyst to harden it , and the peroxide bleached some of the red from the polyester ( the US - finished instruments were cellulose ) .

source_bert_toks: but adams ' poly ##ester used a per ##oxide catalyst to harden it , and the per ##oxide b ##lea ##ched some of the red from the poly ##ester ( the us - finished instruments were cell ##ulo ##se ) .

reference_raw: But Adams' polyester used a peroxide catalyst to make it hard, and the peroxide bleached some of the red from the polyester (the U.S.-finished instruments were cellulose).

reference_spacy_tokens: But Adams ' polyester used a peroxide catalyst to make it hard , and the peroxide bleached some of the red from the polyester ( the U.S.-finished instruments were cellulose ) .


fn_spacy_tokens_for_baseline: In fact , there are very few people I would listen to simply because anything technical about the golf swing baffles me .

source_bert_toks: in fact , there are very few people i would listen to simply because anything technical about the golf swing ba ##ffle ##s me .

reference_raw: In fact, there are very few people I'd listen to just because I'm confused by something technical about a golf swing.

reference_spacy_tokens: In fact , there are very few people I 'd listen to just because I 'm confused by something technical about a golf swing .


fn_spacy_tokens_for_baseline: When incitement to racial hatred was first criminalised in 1965 , the legislation made it a requirement that an intention to incite racial hatred be proved .

source_bert_toks: when inc ##ite ##ment to racial hatred was first criminal ##ised in 1965 , the legislation made it a requirement that an intention to inc ##ite racial hatred be proved .

reference_raw: When the incitement to racial hate was first criminalized in 1965, the legislation required proof of the intention to incite racial hate.

reference_spacy_tokens: When the incitement to racial hate was first criminalized in 1965 , the legislation required proof of the intention to incite racial hate .


fn_spacy_tokens_for_baseline: This discovery explained observations that had puzzled elephant watchers .

source_bert_toks: this discovery explained observations that had puzzled elephant watch ##ers .

reference_raw: The discovery explained the observations that confused the elephant observers.

reference_spacy_tokens: The discovery explained the observations that confused the elephant observers .


fn_spacy_tokens_for_baseline: Having gingerly discarded over a hedge bits of rotted fruit and suspect cheese , I lunched on olives and mineral water in the shade of a great oak wood .

source_bert_toks: having gingerly discarded over a hedge bits of rot ##ted fruit and suspect cheese , i lunch ##ed on olive ##s and mineral water in the shade of a great oak wood .

reference_raw: I had lunched on olives and mineral water in the shade of a large oak tree, after being gingerly thrown over a hedge of rotted fruit and suspicious cheese.

reference_spacy_tokens: I had lunched on olives and mineral water in the shade of a large oak tree , after being gingerly thrown over a hedge of rotted fruit and suspicious cheese .


fn_spacy_tokens_for_baseline: An agreement was signed for Spanish loans to Honduras totalling US$ 70,000,000 over the next four years , and Spanish financial participation in the building of a new airport near Tegucigalpa was confirmed .

source_bert_toks: an agreement was signed for spanish loans to honduras total ##ling us $ 70 , 000 , 000 over the next four years , and spanish financial participation in the building of a new airport near te ##gu ##ci ##gal ##pa was confirmed .

reference_raw: The Spanish loan agreement to Honduras amounting to USD 70 000 000 over the next four years has been signed and the Spanish financial contribution to the construction of a new airport near Tegucigalpa has been confirmed.

reference_spacy_tokens: The Spanish loan agreement to Honduras amounting to USD 70 000 000 over the next four years has been signed and the Spanish financial contribution to the construction of a new airport near Tegucigalpa has been confirmed .


fn_spacy_tokens_for_baseline: Lost in the contemplation of her beauty and the music of her voice , I just went on looking , waiting for her to speak again .

source_bert_toks: lost in the con ##tem ##pl ##ation of her beauty and the music of her voice , i just went on looking , waiting for her to speak again .

reference_raw: Lost in the thought of her beauty and the music of her voice, I continued to look, waiting for her to speak again.

reference_spacy_tokens: Lost in the thought of her beauty and the music of her voice , I continued to look , waiting for her to speak again .


fn_spacy_tokens_for_baseline: Martin was for some years tutor to the MacLeods of Skye , and had also been at one time a scholar at Leiden University in the Netherlands .

source_bert_toks: martin was for some years tutor to the macleod ##s of skye , and had also been at one time a scholar at leiden university in the netherlands .

reference_raw: Martin had been a teacher at the MacLeods of Skye for several years, and had once been a scholar at Leiden University in the Netherlands.

reference_spacy_tokens: Martin had been a teacher at the MacLeods of Skye for several years , and had once been a scholar at Leiden University in the Netherlands .


fn_spacy_tokens_for_baseline: David Stevens peruses pergola designs in search of those ideal structures which , blending perfectly with house , garden and planting choices , charm the eye but never intrude

source_bert_toks: david stevens peru ##ses per ##gol ##a designs in search of those ideal structures which , blending perfectly with house , garden and planting choices , charm the eye but never int ##rud ##e

reference_raw: David Stevens performs pergola designs in search of ideal structures that blend perfectly with home, garden and planting options, charm the eye, but never interfere.

reference_spacy_tokens: David Stevens performs pergola designs in search of ideal structures that blend perfectly with home , garden and planting options , charm the eye , but never interfere .


fn_spacy_tokens_for_baseline: The pudding went down like a dream , in blessed silence , and Christopher and Francis disappeared to brew coffee .

source_bert_toks: the pudding went down like a dream , in blessed silence , and christopher and francis disappeared to brew coffee .

reference_raw: In blessed silence, the pudding fell like a dream, and Christopher and Francis disappeared to make a cup of tea.

reference_spacy_tokens: In blessed silence , the pudding fell like a dream , and Christopher and Francis disappeared to make a cup of tea .


fn_spacy_tokens_for_baseline: Most acute ulcers had been healed by H 2 receptor antagonists , and only one patient ( randomised to placebo ) had received bismuth subcitrate before entering the trial .

source_bert_toks: most acute ul ##cer ##s had been healed by h 2 receptor antagonist ##s , and only one patient ( random ##ised to place ##bo ) had received bis ##mut ##h sub ##cit ##rate before entering the trial .

reference_raw: Most acute ulcers were treated with H2 receptor antagonists and only one patient (randomized to placebo) received bismuth subcitrate prior to study entry.

reference_spacy_tokens: Most acute ulcers were treated with H2 receptor antagonists and only one patient ( randomized to placebo ) received bismuth subcitrate prior to study entry .


fn_spacy_tokens_for_baseline: Worse still , high interest rates caused unemployment rates to soar ( see the graph on page 44 ) .

source_bert_toks: worse still , high interest rates caused unemployment rates to so ##ar ( see the graph on page 44 ) .

reference_raw: Worse still, high interest rates caused the unemployment rate to rise (see graph on page 44).

reference_spacy_tokens: Worse still , high interest rates caused the unemployment rate to rise ( see graph on page 44 ) .


fn_spacy_tokens_for_baseline: A student with a punk haircut and a goose ( husa in Czech ) strapped into his rucksack was greeted with applause all round as he insolently walked the length of Wenceslas Square .

source_bert_toks: a student with a punk hair ##cut and a goose ( hu ##sa in czech ) strapped into his ru ##cks ##ack was greeted with applause all round as he ins ##ole ##ntly walked the length of wen ##ces ##las square .

reference_raw: A student with a punk hair and a goose (husa in Czech) strapped to his backpack was greeted with applause as he boldly walked the length of Wenceslas Square.

reference_spacy_tokens: A student with a punk hair and a goose ( husa in Czech ) strapped to his backpack was greeted with applause as he boldly walked the length of Wenceslas Square .


fn_spacy_tokens_for_baseline: He slammed down the receiver .

source_bert_toks: he slammed down the receiver .

reference_raw: He hit the phone.

reference_spacy_tokens: He hit the phone .


fn_spacy_tokens_for_baseline: A video recorder , a hi - fi , a computer and equipment worth £ 1,779 have been stolen in a burglary at a house in West Auckland Road , Darlington .

source_bert_toks: a video recorder , a hi - fi , a computer and equipment worth £1 , 77 ##9 have been stolen in a bu ##rg ##lary at a house in west auckland road , darlington .

reference_raw: A video recorder, hi-fi, computer and equipment worth 1,779 pounds were stolen from a house on West Auckland Road, Darlington.

reference_spacy_tokens: A video recorder , hi - fi , computer and equipment worth 1,779 pounds were stolen from a house on West Auckland Road , Darlington .


fn_spacy_tokens_for_baseline: About 700 tons of graphite and 70 tons of uranium fuel from the core of the reactor , all lethally radioactive , spewed on to the tarmac and the roof of the turbine hall .

source_bert_toks: about 700 tons of graph ##ite and 70 tons of uranium fuel from the core of the reactor , all lethal ##ly radioactive , sp ##ew ##ed on to the tar ##mac and the roof of the turbine hall .

reference_raw: About 700 tons of graphite and 70 tons of uranium fuel from the reactor core, all lethally radioactive, poured into the asphalt and roof of the turbine chamber.

reference_spacy_tokens: About 700 tons of graphite and 70 tons of uranium fuel from the reactor core , all lethally radioactive , poured into the asphalt and roof of the turbine chamber .


fn_spacy_tokens_for_baseline: Only the older dons predated Boris .

source_bert_toks: only the older don ##s pre ##date ##d boris .

reference_raw: Boris was preceded by older dons.

reference_spacy_tokens: Boris was preceded by older dons .


fn_spacy_tokens_for_baseline: It had suddenly struck her that he was a stranger in the town , and might have nowhere to go .

source_bert_toks: it had suddenly struck her that he was a stranger in the town , and might have nowhere to go .

reference_raw: It suddenly occurred to her that he was a stranger in the city, and that he might have nowhere else to go.

reference_spacy_tokens: It suddenly occurred to her that he was a stranger in the city , and that he might have nowhere else to go .


fn_spacy_tokens_for_baseline: Bill_Frist : Not with the previous Democratic leader or or the current Democratic leader have ever I been slapped in the face with such an affront to the leadership of this grand institution .

source_bert_toks: bill _ fr ##ist : not with the previous democratic leader or or the current democratic leader have ever i been slapped in the face with such an af ##front to the leadership of this grand institution .

reference_raw: Bill_Frist: Not with the previous democratic leader, nor with the current democratic leader, have I ever been so insulted by the leadership of this great institution.

reference_spacy_tokens: Bill_Frist : Not with the previous democratic leader , nor with the current democratic leader , have I ever been so insulted by the leadership of this great institution .


fn_spacy_tokens_for_baseline: In the early 1980 s , Libya accelerated its efforts to obtain a longer - range ballistic missile with the al - Fatah , reportedly with a range of 950 km .

source_bert_toks: in the early 1980 s , libya accelerated its efforts to obtain a longer - range ballistic missile with the al - fat ##ah , reportedly with a range of 950 km .

reference_raw: In the early 1980s, Libya accelerated its efforts to obtain a long-range ballistic missile with an al-Fatah, supposedly with a distance of 950 km.

reference_spacy_tokens: In the early 1980s , Libya accelerated its efforts to obtain a long - range ballistic missile with an al - Fatah , supposedly with a distance of 950 km .


fn_spacy_tokens_for_baseline: His voice was muffled by something --could it be that he was smoking a cigar even whilst disembodied ?

source_bert_toks: his voice was muffled by something - - could it be that he was smoking a cigar even whilst di ##se ##mbo ##die ##d ?

reference_raw: Something muffled his voice -- could it be that he'd been sucking a cigar while he'd been disembodied?

reference_spacy_tokens: Something muffled his voice -- could it be that he 'd been sucking a cigar while he 'd been disembodied ?


fn_spacy_tokens_for_baseline: If she met the girl Marie on the way back there would be even more for her to tell Mademoiselle Rabier !

source_bert_toks: if she met the girl marie on the way back there would be even more for her to tell made ##mo ##ise ##lle ra ##bie ##r !

reference_raw: If she had encountered a girl named Marie on her way back, she would have told Mademoiselle Rabier all the more!

reference_spacy_tokens: If she had encountered a girl named Marie on her way back , she would have told Mademoiselle Rabier all the more !


fn_spacy_tokens_for_baseline: ' We should never have toured , for one thing . '

source_bert_toks: ' we should never have toured , for one thing . '

reference_raw: "For one thing, we shouldn't have travelled."

reference_spacy_tokens: " For one thing , we should n't have travelled . "


fn_spacy_tokens_for_baseline: My body is lazy like loose yam , but I 'm not sick yet .

source_bert_toks: my body is lazy like loose ya ##m , but i ' m not sick yet .

reference_raw: My body's as sluggish as a loose yam, but I'm not sick yet.

reference_spacy_tokens: My body 's as sluggish as a loose yam , but I 'm not sick yet .


fn_spacy_tokens_for_baseline: The visitor sat back and watched the alchemy of the coffee take shape as the slightly stale odour of boiling milk permeated the room and steamed up the windows that looked down into Sauchiehall Street .

source_bert_toks: the visitor sat back and watched the al ##che ##my of the coffee take shape as the slightly stale o ##dou ##r of boiling milk per ##me ##ated the room and steamed up the windows that looked down into sa ##uchi ##eh ##all street .

reference_raw: The visitor sat back and watched the alchemy of the coffee take shape as a slightly stale smell of boiling milk poured through the room and steamed up the windows that looked down on Sauchiehall Street.

reference_spacy_tokens: The visitor sat back and watched the alchemy of the coffee take shape as a slightly stale smell of boiling milk poured through the room and steamed up the windows that looked down on Sauchiehall Street .


fn_spacy_tokens_for_baseline: We return to this point later in the address , when Lincoln links " freedom " rather than " liberty " with the image of a new birth .

source_bert_toks: we return to this point later in the address , when lincoln links " freedom " rather than " liberty " with the image of a new birth .

reference_raw: We'll go back to that point later at the address where Lincoln combines "freedom" rather than "liberty" with the idea of a new birth.

reference_spacy_tokens: We 'll go back to that point later at the address where Lincoln combines " freedom " rather than " liberty " with the idea of a new birth .


fn_spacy_tokens_for_baseline: Investigators will start from scratch in probing the murders of Roman Catholic Cardinal Juan Jesus Posadas Ocampo , presidential candidate Luis Donaldo Colosio and leading politician Jose Francisco Ruiz Massieu , prosecutor Pablo Chapa Manzanilla told legislators .

source_bert_toks: investigators will start from scratch in probing the murders of roman catholic cardinal juan jesus po ##sa ##das o ##camp ##o , presidential candidate luis donald ##o col ##osi ##o and leading politician jose francisco ruiz mass ##ieu , prosecutor pablo cha ##pa man ##zan ##illa told legislators .

reference_raw: Investigators will begin from the beginning to investigate the murder of Roman Catholic Cardinal Juan Jesus Posadas Ocampo, presidential candidate Luis Donald Colosio and leading politician Jose Francisco Ruiz Massieu, prosecutor Pablo Chapa Manzanilla told the legislators.

reference_spacy_tokens: Investigators will begin from the beginning to investigate the murder of Roman Catholic Cardinal Juan Jesus Posadas Ocampo , presidential candidate Luis Donald Colosio and leading politician Jose Francisco Ruiz Massieu , prosecutor Pablo Chapa Manzanilla told the legislators .


fn_spacy_tokens_for_baseline: In 1997 , Rex International Development Company Ltd. , a company affiliated with the Chinese company Norinco , supplied Iran with high - grade seamless steel pipes , suitable for handling corrosive materials , and associated with chemical weapons production .

source_bert_toks: in 1997 , rex international development company ltd . , a company affiliated with the chinese company nor ##in ##co , supplied iran with high - grade seam ##less steel pipes , suitable for handling co ##rro ##sive materials , and associated with chemical weapons production .

reference_raw: In 1997, Rex International Development Company Ltd, a company affiliated to the Chinese company Norinco, supplied Iran with high-quality seamless steel pipes that are fit for handling corrosive materials and related to the manufacture of chemical weapons.

reference_spacy_tokens: In 1997 , Rex International Development Company Ltd , a company affiliated to the Chinese company Norinco , supplied Iran with high - quality seamless steel pipes that are fit for handling corrosive materials and related to the manufacture of chemical weapons .


fn_spacy_tokens_for_baseline: A scary voice in the back of her mind was nagging , Mistake , Tabitha , mistake , mistake , mistake .

source_bert_toks: a scary voice in the back of her mind was na ##gging , mistake , tabitha , mistake , mistake , mistake .

reference_raw: There was a terrible voice in her mind, Mistake, Tabitha, error, error, error.

reference_spacy_tokens: There was a terrible voice in her mind , Mistake , Tabitha , error , error , error .


fn_spacy_tokens_for_baseline: Corbett nodded and they staggered on , bodies soaked in sweat , eyes blinded with panic , legs and feet threatening to turn into the heaviest lead .

source_bert_toks: corbett nodded and they staggered on , bodies soaked in sweat , eyes blinded with panic , legs and feet threatening to turn into the heaviest lead .

reference_raw: Corbett nodded, and they staggered on, their bodies wet with sweat, their eyes blinded with panic, their legs and legs threatening to turn into the heavy lead.

reference_spacy_tokens: Corbett nodded , and they staggered on , their bodies wet with sweat , their eyes blinded with panic , their legs and legs threatening to turn into the heavy lead .


fn_spacy_tokens_for_baseline: It would tie down a lot of troops and would also give Phnom Penh the opportunity to raise international alarm at the spectre of the return of the Khmer Rouge .

source_bert_toks: it would tie down a lot of troops and would also give ph ##no ##m pen ##h the opportunity to raise international alarm at the spec ##tre of the return of the khmer rouge .

reference_raw: It would bring down many soldiers and give Phnom Penh the opportunity to raise international alarms at the moment of the Khmer Rouge's re-entry.

reference_spacy_tokens: It would bring down many soldiers and give Phnom Penh the opportunity to raise international alarms at the moment of the Khmer Rouge 's re - entry .


fn_spacy_tokens_for_baseline: The photo shows Healthcare 's branch manager at Bristol having his moustache shaved off by three of his sales consultants , Allyson Glover , Angela Rowlands and Lea Collins .

source_bert_toks: the photo shows healthcare ' s branch manager at bristol having his mo ##ust ##ache shaved off by three of his sales consultants , ally ##son glover , angela rowland ##s and lea collins .

reference_raw: The photo shows that Healthcare's branch manager in Bristol had his mustache cleaned out by three sales consultants, Allyson Glover, Angela Rowlands, and Lea Collins.

reference_spacy_tokens: The photo shows that Healthcare 's branch manager in Bristol had his mustache cleaned out by three sales consultants , Allyson Glover , Angela Rowlands , and Lea Collins .


fn_spacy_tokens_for_baseline: Comprehension is seen as being dependent upon the ability to hear essential speech sounds , the ability to recover meaning from sound sequences and to interpret meanings in terms of abstract concepts and relations .

source_bert_toks: comprehension is seen as being dependent upon the ability to hear essential speech sounds , the ability to recover meaning from sound sequences and to interpret meanings in terms of abstract concepts and relations .

reference_raw: Understanding is considered to depend on the ability to hear basic speech sounds, the ability to recover meaning from sound sequences and to interpret meaning from abstract concepts and relationships.

reference_spacy_tokens: Understanding is considered to depend on the ability to hear basic speech sounds , the ability to recover meaning from sound sequences and to interpret meaning from abstract concepts and relationships .


fn_spacy_tokens_for_baseline: Spectators booed and hissed as the colony 's new Governor -- former Tory Home Secretary David Waddington -- stepped forward to honour 24-year - old Diana Mitchell .

source_bert_toks: spectators boo ##ed and hissed as the colony ' s new governor - - former tory home secretary david wa ##dding ##ton - - stepped forward to honour 24 - year - old diana mitchell .

reference_raw: Spectators booed and sizzled as the new governor of the colony - former Tory Home Secretary David Waddington - stepped forward to honor 24-year-old Diana Mitchell.

reference_spacy_tokens: Spectators booed and sizzled as the new governor of the colony - former Tory Home Secretary David Waddington - stepped forward to honor 24-year - old Diana Mitchell .


fn_spacy_tokens_for_baseline: Beckett and Joyce , among others , had to leave their homeland to understand it -- and to be understood .

source_bert_toks: beckett and joyce , among others , had to leave their homeland to understand it - - and to be understood .

reference_raw: Beckett and Joyce, amongst other things, had to leave their country to understand-and to understand.

reference_spacy_tokens: Beckett and Joyce , amongst other things , had to leave their country to understand - and to understand .


fn_spacy_tokens_for_baseline: In 1970 Syria invaded Jordan in support of the Palestinian guerrillas , but promptly withdrew when Israel warned that it would intervene to protect Jordan .

source_bert_toks: in 1970 syria invaded jordan in support of the palestinian guerrillas , but promptly withdrew when israel warned that it would intervene to protect jordan .

reference_raw: In 1970, Syria attacked Jordan in support of Palestinian guerrillas, but immediately withdrew when Israel warned that it would intervene to protect Jordan.

reference_spacy_tokens: In 1970 , Syria attacked Jordan in support of Palestinian guerrillas , but immediately withdrew when Israel warned that it would intervene to protect Jordan .


fn_spacy_tokens_for_baseline: I never want to leave the moor . '

source_bert_toks: i never want to leave the moor . '

reference_raw: I don't ever want to leave the docks.'

reference_spacy_tokens: I do n't ever want to leave the docks . '


fn_spacy_tokens_for_baseline: On 12 May 2003 , North Korea announced that the bilateral " Joint Declaration on the Denuclearization of the Korean Peninsula " signed with South Korea on 20 January 1992 was no longer valid because of " U.S. actions " [ Note : the U.S. was not a signatory].

source_bert_toks: on 12 may 2003 , north korea announced that the bilateral " joint declaration on the den ##uc ##lea ##rization of the korean peninsula " signed with south korea on 20 january 1992 was no longer valid because of " u . s . actions " [ note : the u . s . was not a sign ##atory ] .

reference_raw: On 12 May 2003, North Korea announced that the bilateral "Joint Declaration on the Denuclearisation of the Korean Peninsula" signed with South Korea on 20 January 1992 had ceased to apply due to the "U.S. Actions" [Note: the United States is not a signatory].

reference_spacy_tokens: On 12 May 2003 , North Korea announced that the bilateral " Joint Declaration on the Denuclearisation of the Korean Peninsula " signed with South Korea on 20 January 1992 had ceased to apply due to the " U.S. Actions " [ Note : the United States is not a signatory].


fn_spacy_tokens_for_baseline: He was offering her a few days of physical pleasure which would only leave her thirsty for more .

source_bert_toks: he was offering her a few days of physical pleasure which would only leave her thirsty for more .

reference_raw: He offered her a few days of physical pleasure that would only make her thirst for more.

reference_spacy_tokens: He offered her a few days of physical pleasure that would only make her thirst for more .


fn_spacy_tokens_for_baseline: Boys approaching the gymnasium from the chemistry labs had a clear view of the door .

source_bert_toks: boys approaching the gymnasium from the chemistry labs had a clear view of the door .

reference_raw: The boys on the way to the gym from the chemistry labs had a clear view of the door.

reference_spacy_tokens: The boys on the way to the gym from the chemistry labs had a clear view of the door .


fn_spacy_tokens_for_baseline: Mr Erich Honecker , aged 77 , the disgraced former party chief , is among six ex - politburo members now under investigation for abuse of office , corruption and personal enrichment .

source_bert_toks: mr erich hon ##eck ##er , aged 77 , the disgrace ##d former party chief , is among six ex - pol ##it ##buro members now under investigation for abuse of office , corruption and personal enrichment .

reference_raw: Mr. Erich Honecker, 77 years old, disgraced former party leader, is one of the six former politicians currently being investigated for misappropriation, corruption and personal enrichment.

reference_spacy_tokens: Mr. Erich Honecker , 77 years old , disgraced former party leader , is one of the six former politicians currently being investigated for misappropriation , corruption and personal enrichment .


fn_spacy_tokens_for_baseline: Qudratullah , one of the Afghan travelers , recalled , ' The helicopters were suddenly on top of us , bombarding us .

source_bert_toks: qu ##dra ##tu ##llah , one of the afghan travelers , recalled , ' the helicopters were suddenly on top of us , bomb ##arding us .

reference_raw: "Qudratullah, one of the Afghan pilgrims, remembers," the helicopters were suddenly on top of us, bombing us.

reference_spacy_tokens: " Qudratullah , one of the Afghan pilgrims , remembers , " the helicopters were suddenly on top of us , bombing us .


fn_spacy_tokens_for_baseline: Even before the events of September 11 and the anthrax letter attacks of fall 2001 , analysts began to observe some troubling developments along all three dimensions of the CBW terrorism threat .

source_bert_toks: even before the events of september 11 and the ant ##hra ##x letter attacks of fall 2001 , analysts began to observe some tr ##ou ##bling developments along all three dimensions of the cb ##w terrorism threat .

reference_raw: Even before the events of September 11th and the anthrax letter attacks of autumn 2001, analysts began to observe some disturbing developments in all three dimensions of the CBW terrorist threat.

reference_spacy_tokens: Even before the events of September 11th and the anthrax letter attacks of autumn 2001 , analysts began to observe some disturbing developments in all three dimensions of the CBW terrorist threat .


fn_spacy_tokens_for_baseline: In that state , Paul talked more than he should ; and boasted to Edwin of his engagement to a lady whose grandfather was the Earl of Holden in Warwickshire .

source_bert_toks: in that state , paul talked more than he should ; and boasted to edwin of his engagement to a lady whose grandfather was the earl of holden in warwickshire .

reference_raw: In this state, Paul spoke more than he should; and he bragged to Edwin about his engagement with a woman whose grandfather had been the Earl of Holden in Warwickshire.

reference_spacy_tokens: In this state , Paul spoke more than he should ; and he bragged to Edwin about his engagement with a woman whose grandfather had been the Earl of Holden in Warwickshire .


fn_spacy_tokens_for_baseline: Nuclear warheads from Kazakhstan are transferred via Turkmenistan to Iran . ( Timmerman , 52 ) .

source_bert_toks: nuclear war ##heads from kazakhstan are transferred via turkmenistan to iran . ( tim ##mer ##man , 52 ) .

reference_raw: The nuclear weapons from Kazakhstan are transferred through Turkmenistan to Iran (Timmerman, 52).

reference_spacy_tokens: The nuclear weapons from Kazakhstan are transferred through Turkmenistan to Iran ( Timmerman , 52 ) .


fn_spacy_tokens_for_baseline: Rebels ' claims that they had shot down a government plane could not be confirmed .

source_bert_toks: rebels ' claims that they had shot down a government plane could not be confirmed .

reference_raw: The rebels' allegations that they killed a government plane couldn't be confirmed.

reference_spacy_tokens: The rebels ' allegations that they killed a government plane could n't be confirmed .


fn_spacy_tokens_for_baseline: His bluntness , often amounting to personal abuse , has won Australia 's treasurer ( finance minister ) few friends .

source_bert_toks: his blunt ##ness , often amount ##ing to personal abuse , has won australia ' s treasurer ( finance minister ) few friends .

reference_raw: His rudeness, often of personal abuse, had won a few friends from Australia's treasurer (Finance Minister).

reference_spacy_tokens: His rudeness , often of personal abuse , had won a few friends from Australia 's treasurer ( Finance Minister ) .


fn_spacy_tokens_for_baseline: Matthew , now in his 20s , was caned for bullying by the then headmaster , William Blackshaw .

source_bert_toks: matthew , now in his 20s , was cane ##d for bullying by the then headmaster , william blacks ##haw .

reference_raw: Matthew, now in his twenties, was bullied by William Blackshaw's former director.

reference_spacy_tokens: Matthew , now in his twenties , was bullied by William Blackshaw 's former director .


fn_spacy_tokens_for_baseline: The Gloucester has a slate - coloured muzzle and black tongue and teats .

source_bert_toks: the gloucester has a slate - coloured muzzle and black tongue and tea ##ts .

reference_raw: Gloucester has a slate-colored mouth and a black tongue and teat.

reference_spacy_tokens: Gloucester has a slate - colored mouth and a black tongue and teat .


fn_spacy_tokens_for_baseline: Numbers vary but a total of 40 is the highest recorded in recent springs ; parties of up to 10 together are sometimes seen .

source_bert_toks: numbers vary but a total of 40 is the highest recorded in recent springs ; parties of up to 10 together are sometimes seen .

reference_raw: The numbers vary, but 40 are the highest recorded in recent springs; sides up to 10 together are sometimes seen.

reference_spacy_tokens: The numbers vary , but 40 are the highest recorded in recent springs ; sides up to 10 together are sometimes seen .


fn_spacy_tokens_for_baseline: Far better that its messengers take it only to plants of exactly the same kind where the genes it carries will unite with eggs and form seeds .

source_bert_toks: far better that its messengers take it only to plants of exactly the same kind where the genes it carries will unite with eggs and form seeds .

reference_raw: It's much better that its messengers only take it to plants of exactly the same species, where the genes it carries join together with the eggs and form the seeds.

reference_spacy_tokens: It 's much better that its messengers only take it to plants of exactly the same species , where the genes it carries join together with the eggs and form the seeds .


fn_spacy_tokens_for_baseline: Their translations were often either incorrect or contained a word left in English for which the translator could find no equivalent in his language .

source_bert_toks: their translations were often either incorrect or contained a word left in english for which the translator could find no equivalent in his language .

reference_raw: Their translations were often wrong, or they contained a word left in English for which the translator could find no equivalent in his language.

reference_spacy_tokens: Their translations were often wrong , or they contained a word left in English for which the translator could find no equivalent in his language .


fn_spacy_tokens_for_baseline: At the meeting of the Down Presbytery , the first difficulty was innate sympathy towards the army and reluctance to admit that the shooting of Black was more than another of those unfortunate accidents which occur in war .

source_bert_toks: at the meeting of the down pre ##sby ##tery , the first difficulty was innate sympathy towards the army and reluctance to admit that the shooting of black was more than another of those unfortunate accidents which occur in war .

reference_raw: The first difficulty at the meeting of the Down Presbytery was innate sympathy for the military, and the unwillingness to admit that Black's fire had been more than one of the unfortunate incidents that had occurred during the war.

reference_spacy_tokens: The first difficulty at the meeting of the Down Presbytery was innate sympathy for the military , and the unwillingness to admit that Black 's fire had been more than one of the unfortunate incidents that had occurred during the war .


fn_spacy_tokens_for_baseline: The Guardian has said ' In a class of their own . they manage to convey an astonishing amount of information . '

source_bert_toks: the guardian has said ' in a class of their own . they manage to convey an astonishing amount of information . '

reference_raw: The Guardian said, "In their own class, they're able to convey an amazing amount of information."

reference_spacy_tokens: The Guardian said , " In their own class , they 're able to convey an amazing amount of information . "


fn_spacy_tokens_for_baseline: Sergeants rapped out indecipherable commands , corporals checked kitbags and wooden crates and boxes into the luggage vans , stamped their feet and saluted their officers smartly .

source_bert_toks: sergeant ##s rap ##ped out ind ##ec ##ip ##her ##able commands , corporal ##s checked kit ##bags and wooden crates and boxes into the luggage vans , stamped their feet and salute ##d their officers smart ##ly .

reference_raw: The sergeants shouted indecipherable commands, the corporals checked kitbags and wooden boxes into the luggage vans, stamped their feet and saluted their officers cleverly.

reference_spacy_tokens: The sergeants shouted indecipherable commands , the corporals checked kitbags and wooden boxes into the luggage vans , stamped their feet and saluted their officers cleverly .


fn_spacy_tokens_for_baseline: We needed to make ground ; the winds , though still stormy , had moved to the southwest .

source_bert_toks: we needed to make ground ; the winds , though still stormy , had moved to the southwest .

reference_raw: We had to make land; the wind, though still stormy, was moving south-west.

reference_spacy_tokens: We had to make land ; the wind , though still stormy , was moving south - west .


fn_spacy_tokens_for_baseline: That proportion of sulphur dioxide not deposited locally will be diffused in the atmosphere and , through oxidation , will be transformed into sulphates .

source_bert_toks: that proportion of sul ##ph ##ur dioxide not deposited locally will be diffuse ##d in the atmosphere and , through oxidation , will be transformed into sul ##phate ##s .

reference_raw: This proportion of sulphur dioxide not stored locally will be dispersed in the atmosphere and converted to sulphate by oxidation.

reference_spacy_tokens: This proportion of sulphur dioxide not stored locally will be dispersed in the atmosphere and converted to sulphate by oxidation .


fn_spacy_tokens_for_baseline: Only about 200 molecules need to hit the antennae of the male , for him to fly off in search of the female .

source_bert_toks: only about 200 molecules need to hit the antennae of the male , for him to fly off in search of the female .

reference_raw: Only about 200 molecules need to hit a man's aerials so he can fly off looking for a woman.

reference_spacy_tokens: Only about 200 molecules need to hit a man 's aerials so he can fly off looking for a woman .


fn_spacy_tokens_for_baseline: If this pace kept up , 10,000 buildings classed as ' historic ' would disappear over the next twenty - five years .

source_bert_toks: if this pace kept up , 10 , 000 buildings classed as ' historic ' would disappear over the next twenty - five years .

reference_raw: If the pace continued, tens of thousands of buildings classified as 'historic' would disappear in the next twenty-five years.

reference_spacy_tokens: If the pace continued , tens of thousands of buildings classified as ' historic ' would disappear in the next twenty - five years .


fn_spacy_tokens_for_baseline: She stopped her car and bustled up the pavement .

source_bert_toks: she stopped her car and bust ##led up the pavement .

reference_raw: She stopped the car and hurried along the sidewalk.

reference_spacy_tokens: She stopped the car and hurried along the sidewalk .


fn_spacy_tokens_for_baseline: His reputation as a really nice guy will be assured , amongst two club golfers at least , and he might even get into the pro - am prize money .

source_bert_toks: his reputation as a really nice guy will be assured , amongst two club golfer ##s at least , and he might even get into the pro - am prize money .

reference_raw: His reputation as a really good guy would be assured, at least between two club golfers, and he could even get into pro-am prize money.

reference_spacy_tokens: His reputation as a really good guy would be assured , at least between two club golfers , and he could even get into pro - am prize money .


fn_spacy_tokens_for_baseline: ' We were making loads of money and people were throwing champagne at us , ' she said in an interview with the People newspaper .

source_bert_toks: ' we were making loads of money and people were throwing champagne at us , ' she said in an interview with the people newspaper .

reference_raw: "We made a lot of money and people threw champagne at us," she said, interviewing the People's papers.

reference_spacy_tokens: " We made a lot of money and people threw champagne at us , " she said , interviewing the People 's papers .


fn_spacy_tokens_for_baseline: Pakistan has extradited several suspected drug smugglers to the United States .

source_bert_toks: pakistan has extra ##dit ##ed several suspected drug smug ##glers to the united states .

reference_raw: Pakistan has released several suspected drug smugglers to the United States.

reference_spacy_tokens: Pakistan has released several suspected drug smugglers to the United States .


fn_spacy_tokens_for_baseline: Between flotation in 1980 and sales peak in 1988 , his company , Amstrad , saw pre - tax profits rocket to £ 160.4 million .

source_bert_toks: between fl ##ota ##tion in 1980 and sales peak in 1988 , his company , am ##stra ##d , saw pre - tax profits rocket to £1 ##60 . 4 million .

reference_raw: Between the flotation in 1980 and the peak in 1988, his company, Amstrad, saw a pre-tax profit racket of £160.4 million.

reference_spacy_tokens: Between the flotation in 1980 and the peak in 1988 , his company , Amstrad , saw a pre - tax profit racket of £ 160.4 million .


fn_spacy_tokens_for_baseline: They either had too few subjects , too short a treatment , lack of double - blind methods or the subjects were institutionalised and demented geriatrics who were too far gone to show any psychological changes .

source_bert_toks: they either had too few subjects , too short a treatment , lack of double - blind methods or the subjects were institutional ##ised and dem ##ented ge ##ria ##trics who were too far gone to show any psychological changes .

reference_raw: They either had too few subjects, too little treatment, lack of double-blind methods, or were institutionalized and demented geriatrics, too far gone to show any psychological changes.

reference_spacy_tokens: They either had too few subjects , too little treatment , lack of double - blind methods , or were institutionalized and demented geriatrics , too far gone to show any psychological changes .


fn_spacy_tokens_for_baseline: And yes , I suddenly recollected the image of the small shining triangle of a Stanley blade being passed out of the driver 's cabin : an image that had only momentarily concerned me .

source_bert_toks: and yes , i suddenly rec ##oll ##ect ##ed the image of the small shining triangle of a stanley blade being passed out of the driver ' s cabin : an image that had only momentarily concerned me .

reference_raw: And, yes, I suddenly remembered the image of a small, gleaming triangular of a Stanley blade that had been passed from the driver's cabin: a picture that had only momentarily interested me.

reference_spacy_tokens: And , yes , I suddenly remembered the image of a small , gleaming triangular of a Stanley blade that had been passed from the driver 's cabin : a picture that had only momentarily interested me .


fn_spacy_tokens_for_baseline: In pencil he wrote , ' At four o'clock Richard Walter shits his pants . '

source_bert_toks: in pencil he wrote , ' at four o ' clock richard walter shit ##s his pants . '

reference_raw: He wrote in a pencil, "At four o'clock Richard Walter fucks his pants."

reference_spacy_tokens: He wrote in a pencil , " At four o'clock Richard Walter fucks his pants . "


fn_spacy_tokens_for_baseline: The girl was to be guarded until she delivered , at which time she was to be stoned to death .

source_bert_toks: the girl was to be guarded until she delivered , at which time she was to be stone ##d to death .

reference_raw: The girl was supposed to be guarded until she delivered, when she was supposed to be high to death.

reference_spacy_tokens: The girl was supposed to be guarded until she delivered , when she was supposed to be high to death .


fn_spacy_tokens_for_baseline: In the late 1980s and early 1990s , Syria began exploring its potential for indigenous nuclear resources .

source_bert_toks: in the late 1980s and early 1990s , syria began exploring its potential for indigenous nuclear resources .

reference_raw: Syria began to explore its potential for domestic nuclear resources in the late 1980s and early 1990s.

reference_spacy_tokens: Syria began to explore its potential for domestic nuclear resources in the late 1980s and early 1990s .


fn_spacy_tokens_for_baseline: Looking relaxed , Jamie Blandford reclined on Channel Four 's Big Breakfast studio bed , with his interviewer , Paula Yates and opened up about his controversial life .

source_bert_toks: looking relaxed , jamie bland ##ford rec ##lined on channel four ' s big breakfast studio bed , with his interview ##er , paula yates and opened up about his controversial life .

reference_raw: With a calm expression, Jamie Blandford reclined with his interviewer, Paula Yates, on the bed of Channel Four's Big Breakfast studio, and opened the door to his controversial life.

reference_spacy_tokens: With a calm expression , Jamie Blandford reclined with his interviewer , Paula Yates , on the bed of Channel Four 's Big Breakfast studio , and opened the door to his controversial life .


fn_spacy_tokens_for_baseline: This is testament to Wall Street 's faith that Rubin has been so successful that the White House wo n't dare change his pro - market policies .

source_bert_toks: this is testament to wall street ' s faith that rubin has been so successful that the white house won ' t dare change his pro - market policies .

reference_raw: This is a testament to Wall Street's belief that Rubin has succeeded so well that the White House does not dare change its pro-market policies.

reference_spacy_tokens: This is a testament to Wall Street 's belief that Rubin has succeeded so well that the White House does not dare change its pro - market policies .


fn_spacy_tokens_for_baseline: Towards morning she woke limp and exhausted , shivering with cold .

source_bert_toks: towards morning she woke limp and exhausted , shivering with cold .

reference_raw: She awoke limp and exhausted in the morning, shivering with cold.

reference_spacy_tokens: She awoke limp and exhausted in the morning , shivering with cold .


fn_spacy_tokens_for_baseline: ' I 'm quite sure Dora can do without the services of an emissary , ' she said coolly and his laughter echoed across the empty garden .

source_bert_toks: ' i ' m quite sure dora can do without the services of an emi ##ssar ##y , ' she said cool ##ly and his laughter echoed across the empty garden .

reference_raw: 'I'm sure Dora can do without the messenger's service,' she said coldly, and his laughter reverberated across the empty garden.

reference_spacy_tokens: ' I 'm sure Dora can do without the messenger 's service , ' she said coldly , and his laughter reverberated across the empty garden .


fn_spacy_tokens_for_baseline: Thus , it remains essential to maintain adequate defences against such dictators and to prevent the further proliferation of nuclear arms .

source_bert_toks: thus , it remains essential to maintain adequate defences against such dictator ##s and to prevent the further proliferation of nuclear arms .

reference_raw: It is therefore necessary to maintain adequate protection against such dictators and to prevent the further spread of nuclear weapons.

reference_spacy_tokens: It is therefore necessary to maintain adequate protection against such dictators and to prevent the further spread of nuclear weapons .


fn_spacy_tokens_for_baseline: Sutherland , 50 , of Gilmore Place , Edinburgh , denied the culpable homicide of Mr Buckley on 10 April last year .

source_bert_toks: sutherland , 50 , of gilmore place , edinburgh , denied the cu ##lp ##able homicide of mr buckley on 10 april last year .

reference_raw: Sutherland, 50, from Gilmore Place, Edinburgh, denied Mr Buckley's murder on April 10, last year.

reference_spacy_tokens: Sutherland , 50 , from Gilmore Place , Edinburgh , denied Mr Buckley 's murder on April 10 , last year .


fn_spacy_tokens_for_baseline: In addition to stones , they fired pitch , naphtha , Greek fire , dead horses and other animals , and barrels of putrid , rotting matter .

source_bert_toks: in addition to stones , they fired pitch , nap ##ht ##ha , greek fire , dead horses and other animals , and barrels of put ##rid , rotting matter .

reference_raw: In addition to the rocks, they fired pitch, naphtha, Greek fire, dead horses and other animals, and barrels of stuffed, rotting matter.

reference_spacy_tokens: In addition to the rocks , they fired pitch , naphtha , Greek fire , dead horses and other animals , and barrels of stuffed , rotting matter .


fn_spacy_tokens_for_baseline: We have included this complete family of clarinets as they are all regularly used in concert bands and clarinet choirs .

source_bert_toks: we have included this complete family of clarinet ##s as they are all regularly used in concert bands and clarinet choirs .

reference_raw: We've included this whole clarinet group, since they're all regularly used in concert bands and clarinet choirs.

reference_spacy_tokens: We 've included this whole clarinet group , since they 're all regularly used in concert bands and clarinet choirs .


fn_spacy_tokens_for_baseline: Police want to reassure anyone who 's nervous about coming foreward with information .

source_bert_toks: police want to reassure anyone who ' s nervous about coming fore ##ward with information .

reference_raw: The police want to comfort anyone who's nervous about coming forward with information.

reference_spacy_tokens: The police want to comfort anyone who 's nervous about coming forward with information .


fn_spacy_tokens_for_baseline: He 's not confident that his argument addresses what he feels is an underlying problem ; he wants to show that it 's ok to love this place while fighting for a new global order that does away with American superpower .

source_bert_toks: he ' s not confident that his argument addresses what he feels is an underlying problem ; he wants to show that it ' s ok to love this place while fighting for a new global order that does away with american super ##power .

reference_raw: He's not sure his argument solves what he thinks is the basic problem; he's trying to prove that it's okay to love this place while he's fighting for a new global order that goes away with American superpowers.

reference_spacy_tokens: He 's not sure his argument solves what he thinks is the basic problem ; he 's trying to prove that it 's okay to love this place while he 's fighting for a new global order that goes away with American superpowers .


fn_spacy_tokens_for_baseline: If backing for the research is forthcoming , voice activated cash dispensers could be on the High Street within two years .

source_bert_toks: if backing for the research is forthcoming , voice activated cash di ##sp ##ense ##rs could be on the high street within two years .

reference_raw: If support for research is forthcoming, voice-activated cash-dischargers could be on High Street in two years.

reference_spacy_tokens: If support for research is forthcoming , voice - activated cash - dischargers could be on High Street in two years .


fn_spacy_tokens_for_baseline: In the third section , Hawkridge discusses the issues arising from the work reviewed in the previous part , revealing many problems and constraints .

source_bert_toks: in the third section , hawk ##ridge discusses the issues arising from the work reviewed in the previous part , revealing many problems and constraints .

reference_raw: In the third part, Hawkridge deals with issues arising from the work examined in the previous part and reveals a number of problems and limitations.

reference_spacy_tokens: In the third part , Hawkridge deals with issues arising from the work examined in the previous part and reveals a number of problems and limitations .


fn_spacy_tokens_for_baseline: But following the fracas between the two front rows , the Romanian hooker , Ion was viciously punched ( no - one could identify the perpetrator ) and suffering from blurred vision , had to be replaced at half - time .

source_bert_toks: but following the fra ##cas between the two front rows , the romanian hooker , ion was vicious ##ly punched ( no - one could identify the per ##pet ##rator ) and suffering from blurred vision , had to be replaced at half - time .

reference_raw: But after the cracks between the two front rows and the Romanian whore, Ion had been brutally hit (no one could identify the perpetrator) and had blurred vision, and had to be replaced half-time.

reference_spacy_tokens: But after the cracks between the two front rows and the Romanian whore , Ion had been brutally hit ( no one could identify the perpetrator ) and had blurred vision , and had to be replaced half - time .


fn_spacy_tokens_for_baseline: Her head shot round , her shocked gasp mingling with the audible hiss of sharply indrawn breath .

source_bert_toks: her head shot round , her shocked gasp ming ##ling with the audible hiss of sharply ind ##ra ##wn breath .

reference_raw: She whirled her head, her shocked breath mingling with the audible hiss of a sharp intake of breath.

reference_spacy_tokens: She whirled her head , her shocked breath mingling with the audible hiss of a sharp intake of breath .


fn_spacy_tokens_for_baseline: Amongst the papers before him stood an empty breakfast cup and an egg - smeared plate , suggesting that his digestion was as robust as his nerve .

source_bert_toks: amongst the papers before him stood an empty breakfast cup and an egg - smeared plate , suggesting that his digest ##ion was as robust as his nerve .

reference_raw: There was an empty breakfast mug and an egg-smeared plate among the papers in front of him, indicating that his digestion was as strong as his nerves.

reference_spacy_tokens: There was an empty breakfast mug and an egg - smeared plate among the papers in front of him , indicating that his digestion was as strong as his nerves .


fn_spacy_tokens_for_baseline: For instance , in Leeds it was the Conservative leader who intervened in a press debate and it was declared that , ' His attitude is anti - fascist and anti - communist . '

source_bert_toks: for instance , in leeds it was the conservative leader who intervened in a press debate and it was declared that , ' his attitude is anti - fascist and anti - communist . '

reference_raw: In Leeds, for example, a conservative leader intervened in a press conference and said, "His position is anti-fascist and anti-communist."

reference_spacy_tokens: In Leeds , for example , a conservative leader intervened in a press conference and said , " His position is anti - fascist and anti - communist . "


fn_spacy_tokens_for_baseline: In the mornings I used to sit out in the warm sun of our terrace and read the travellers ' descriptions of the Delhi they knew from their visits at the very apex of the Mughal Empire .

source_bert_toks: in the mornings i used to sit out in the warm sun of our terrace and read the travellers ' descriptions of the delhi they knew from their visits at the very apex of the mughal empire .

reference_raw: In the mornings I sat in the warm sun of our terrace and read the descriptions of the Delhi travellers they had known from their visits at the very peak of the Mughal Empire.

reference_spacy_tokens: In the mornings I sat in the warm sun of our terrace and read the descriptions of the Delhi travellers they had known from their visits at the very peak of the Mughal Empire .


fn_spacy_tokens_for_baseline: More important , the range almost exactly bisects the Atlantic Ocean from north to south following closely the profile of the African and South American coasts , so it 's always called the Mid - Atlantic Ridge .

source_bert_toks: more important , the range almost exactly bis ##ect ##s the atlantic ocean from north to south following closely the profile of the african and south american coasts , so it ' s always called the mid - atlantic ridge .

reference_raw: What's more, it's almost exactly the same as the Atlantic Ocean from north to south, and it's close to the profile of the African and South American coasts, so it's always called the Mid-Atlantic Ridge.

reference_spacy_tokens: What 's more , it 's almost exactly the same as the Atlantic Ocean from north to south , and it 's close to the profile of the African and South American coasts , so it 's always called the Mid - Atlantic Ridge .


fn_spacy_tokens_for_baseline: Thessy gasped at such blasphemy , while I scowled at Ellen 's blackmail .

source_bert_toks: the ##ss ##y gasped at such b ##las ##ph ##emy , while i scowled at ellen ' s blackmail .

reference_raw: As I frowned at Ellen's extortion, Thessy sighed with such blasphemy.

reference_spacy_tokens: As I frowned at Ellen 's extortion , Thessy sighed with such blasphemy .


fn_spacy_tokens_for_baseline: Her elation took her into her clothes , back to the kitchen to leave Phoebe a scrawled memo , and out of the front door .

source_bert_toks: her el ##ation took her into her clothes , back to the kitchen to leave phoebe a sc ##ra ##wled memo , and out of the front door .

reference_raw: Her enthusiasm led her into her dress, back into the kitchen, leaving Phoebe a scrawled note, and out the front door.

reference_spacy_tokens: Her enthusiasm led her into her dress , back into the kitchen , leaving Phoebe a scrawled note , and out the front door .


fn_spacy_tokens_for_baseline: New products and increased marketing activity are key to Waterford Crystal gaining market share at profitable margins .

source_bert_toks: new products and increased marketing activity are key to waterford crystal gaining market share at profitable margins .

reference_raw: New products and increased marketing activities are crucial to gaining the market share of Waterford Crystal at profitable margins.

reference_spacy_tokens: New products and increased marketing activities are crucial to gaining the market share of Waterford Crystal at profitable margins .


fn_spacy_tokens_for_baseline: The expense is exorbitant , the position ridiculous , and the pleasure transitory .

source_bert_toks: the expense is ex ##or ##bit ##ant , the position ridiculous , and the pleasure transit ##ory .

reference_raw: Expenses are excessive, position ridiculous, and pleasure transitional.

reference_spacy_tokens: Expenses are excessive , position ridiculous , and pleasure transitional .


fn_spacy_tokens_for_baseline: France insisted it will not allow future Eurodif enriched uranium transfers to Iran ( 7198 ) .

source_bert_toks: france insisted it will not allow future euro ##di ##f enriched uranium transfers to iran ( 71 ##9 ##8 ) .

reference_raw: France has argued that it will not allow the future transfer of uranium enriched by Eurodif to Iran (7198).

reference_spacy_tokens: France has argued that it will not allow the future transfer of uranium enriched by Eurodif to Iran ( 7198 ) .


fn_spacy_tokens_for_baseline: We then invent criteria to back up the choice , delegating our responsibility to professional specialists .

source_bert_toks: we then in ##vent criteria to back up the choice , del ##ega ##ting our responsibility to professional specialists .

reference_raw: Then we come up with criteria to support the selection and delegate our responsibilities to professionals.

reference_spacy_tokens: Then we come up with criteria to support the selection and delegate our responsibilities to professionals .


fn_spacy_tokens_for_baseline: It led to psychiatry being established as a profession in it 's own right and the ackowledgement that the mentally ill needed specialist care .

source_bert_toks: it led to psychiatry being established as a profession in it ' s own right and the ac ##kow ##led ##gement that the mentally ill needed specialist care .

reference_raw: It resulted in the establishment of psychiatry as a profession itself and the recognition that the mentally ill needed specialised care.

reference_spacy_tokens: It resulted in the establishment of psychiatry as a profession itself and the recognition that the mentally ill needed specialised care .


fn_spacy_tokens_for_baseline: The prime minister is appointed by the monarch .

source_bert_toks: the prime minister is appointed by the monarch .

reference_raw: The Prime Minister is nominated by the Monarch.

reference_spacy_tokens: The Prime Minister is nominated by the Monarch .


fn_spacy_tokens_for_baseline: The Stewarts suffered a sequence of disasters which would almost suggest that some evil magician had set a curse upon the entire house .

source_bert_toks: the stewart ##s suffered a sequence of disasters which would almost suggest that some evil magician had set a curse upon the entire house .

reference_raw: The Stewarts had sustained a series of catastrophes that almost suggested that some evil wizard had cast a curse on the house.

reference_spacy_tokens: The Stewarts had sustained a series of catastrophes that almost suggested that some evil wizard had cast a curse on the house .


fn_spacy_tokens_for_baseline: The questionnaire itself is strictly confidential .

source_bert_toks: the question ##naire itself is strictly confidential .

reference_raw: The questionnaire itself is of strict confidentiality.

reference_spacy_tokens: The questionnaire itself is of strict confidentiality .


fn_spacy_tokens_for_baseline: Japanese director Nagisa Oshima wants him for the lead in Valentino , a movie which will explore the destructive effect of fame on silent screen stars .

source_bert_toks: japanese director na ##gis ##a os ##hima wants him for the lead in valentin ##o , a movie which will explore the destructive effect of fame on silent screen stars .

reference_raw: The Japanese director, Nagisa Oshima, wants him to be the head of Valentino, a film that explores the devastating effect of glory on silent screen stars.

reference_spacy_tokens: The Japanese director , Nagisa Oshima , wants him to be the head of Valentino , a film that explores the devastating effect of glory on silent screen stars .


fn_spacy_tokens_for_baseline: Public concern about war over such a trivial issue led Eisenhower to lower the temperature by offering to request a withdrawal of at least part of Chiang 's garrisons on the islands in return for a cease - fire .

source_bert_toks: public concern about war over such a trivial issue led eisenhower to lower the temperature by offering to request a withdrawal of at least part of chiang ' s garrison ##s on the islands in return for a cease - fire .

reference_raw: The public fear of war over such a trivial matter led Eisenhower to lower the temperature by offering to demand that at least some of Chiang's crew be removed from the islands in exchange for a truce.

reference_spacy_tokens: The public fear of war over such a trivial matter led Eisenhower to lower the temperature by offering to demand that at least some of Chiang 's crew be removed from the islands in exchange for a truce .


fn_spacy_tokens_for_baseline: Even the Virtual Processor translator is retrieved only when needed , and it is Hinsley 's boast that no piece of code is ever loaded onto the processor that is n't about to be run .

source_bert_toks: even the virtual processor translator is retrieved only when needed , and it is hi ##ns ##ley ' s bo ##ast that no piece of code is ever loaded onto the processor that isn ' t about to be run .

reference_raw: Even a virtual processor translator can only be retrieved if necessary, and Hinsley brags that no part of the code is ever loaded on a processor that will not be run.

reference_spacy_tokens: Even a virtual processor translator can only be retrieved if necessary , and Hinsley brags that no part of the code is ever loaded on a processor that will not be run .


fn_spacy_tokens_for_baseline: He strapped his patients to a table and wielded an array of tools with practised precision and dexterity .

source_bert_toks: he strapped his patients to a table and wi ##eld ##ed an array of tools with practised precision and dexter ##ity .

reference_raw: He tied his patients to the table and, with practiced precision and skill, wielded a set of tools.

reference_spacy_tokens: He tied his patients to the table and , with practiced precision and skill , wielded a set of tools .


fn_spacy_tokens_for_baseline: Otherwise , it costs £ 3 per car - load of people .

source_bert_toks: otherwise , it costs £3 per car - load of people .

reference_raw: Otherwise, it's £3 for a load of people in a car.

reference_spacy_tokens: Otherwise , it 's £ 3 for a load of people in a car .


fn_spacy_tokens_for_baseline: There had been an accident in the northernmost part of Romania .

source_bert_toks: there had been an accident in the northernmost part of romania .

reference_raw: There was an accident in the northmost part of Romania.

reference_spacy_tokens: There was an accident in the northmost part of Romania .


fn_spacy_tokens_for_baseline: She hankered after her dancing days till she died at the age of ninety .

source_bert_toks: she hank ##ered after her dancing days till she died at the age of ninety .

reference_raw: After her dance days, she squatted until she died when she was ninety.

reference_spacy_tokens: After her dance days , she squatted until she died when she was ninety .


fn_spacy_tokens_for_baseline: ' Would you like me to bathe your face ? ' she asked , when they reached the motorhome .

source_bert_toks: ' would you like me to bath ##e your face ? ' she asked , when they reached the motor ##hom ##e .

reference_raw: "Do you want me to take a bath in your face?" she asked as they reached the driveway.

reference_spacy_tokens: " Do you want me to take a bath in your face ? " she asked as they reached the driveway .


fn_spacy_tokens_for_baseline: Brum based Brian Travers , producer and director of musical films for many years , and well known saxophonist in the internationally renowned band , UB40 , has already made his mark on the music industry .

source_bert_toks: br ##um based brian travers , producer and director of musical films for many years , and well known saxophonist in the internationally renowned band , u ##b ##40 , has already made his mark on the music industry .

reference_raw: Brum is based on Brian Travers, a manufacturer and director of musical films for many years, and a well-known saxophonist in the world-famous band, UB40, has already made his mark in the music industry.

reference_spacy_tokens: Brum is based on Brian Travers , a manufacturer and director of musical films for many years , and a well - known saxophonist in the world - famous band , UB40 , has already made his mark in the music industry .


fn_spacy_tokens_for_baseline: Since then , China has conducted 45 nuclear tests , including tests of thermonuclear weapons and a neutron bomb .

source_bert_toks: since then , china has conducted 45 nuclear tests , including tests of the ##rm ##on ##uc ##lea ##r weapons and a neutron bomb .

reference_raw: Since then, China has carried out 45 atomic tests, including thermonuclear weapons and neutron bomb tests.

reference_spacy_tokens: Since then , China has carried out 45 atomic tests , including thermonuclear weapons and neutron bomb tests .


fn_spacy_tokens_for_baseline: As recently as 1980 Cash became addicted to morphine after an operation to crushed ribs sustained in a fight with an ostrich ( his home in Hendersonville , Tennessee , is said to be a real menagerie ) .

source_bert_toks: as recently as 1980 cash became addicted to mor ##phine after an operation to crushed ribs sustained in a fight with an os ##tric ##h ( his home in henderson ##ville , tennessee , is said to be a real men ##ager ##ie ) .

reference_raw: Recently in 1980 Cash became morphine-dependent after an operation to crush the ribs sustained in a fight with an ostrich (his home in Hendersonville, Tennessee, is said to be a real threat).

reference_spacy_tokens: Recently in 1980 Cash became morphine - dependent after an operation to crush the ribs sustained in a fight with an ostrich ( his home in Hendersonville , Tennessee , is said to be a real threat ) .


fn_spacy_tokens_for_baseline: He concludes by suggesting that membership of the group that accepts children with disabilities as full members of the human tribe , is open to all .

source_bert_toks: he concludes by suggesting that membership of the group that accepts children with disabilities as full members of the human tribe , is open to all .

reference_raw: It infers from this that membership of a group that accepts disabled children as full members of a human tribe is open to all.

reference_spacy_tokens: It infers from this that membership of a group that accepts disabled children as full members of a human tribe is open to all .


fn_spacy_tokens_for_baseline: I can combine our walk with some useful work . '

source_bert_toks: i can combine our walk with some useful work . '

reference_raw: I can mix our walk with some useful work.'

reference_spacy_tokens: I can mix our walk with some useful work . '


fn_spacy_tokens_for_baseline: The doppler effect alters the frequency of light ' seen ' by the moving atoms ; because the atoms are moving in all directions , they see a broad range of frequencies .

source_bert_toks: the do ##pp ##ler effect alter ##s the frequency of light ' seen ' by the moving atoms ; because the atoms are moving in all directions , they see a broad range of frequencies .

reference_raw: The doppler effect changes the frequency of light 'seen' by moving atoms; because atoms move in all directions, they see a wide range of frequencies.

reference_spacy_tokens: The doppler effect changes the frequency of light ' seen ' by moving atoms ; because atoms move in all directions , they see a wide range of frequencies .


fn_spacy_tokens_for_baseline: Ryan , who gave Johanna a pair of satin pyjamas for Christmas , said they often went to the seaside at Great Yarmouth together and he got on well with her parents .

source_bert_toks: ryan , who gave johanna a pair of satin p ##y ##ja ##mas for christmas , said they often went to the seaside at great yarmouth together and he got on well with her parents .

reference_raw: Ryan, who had given Johanna a pair of satin pajamas for Christmas, said that they had often gone to the sea together in Great Yarmouth, and that he and her parents had gotten along well.

reference_spacy_tokens: Ryan , who had given Johanna a pair of satin pajamas for Christmas , said that they had often gone to the sea together in Great Yarmouth , and that he and her parents had gotten along well .


fn_spacy_tokens_for_baseline: ' Got you my beauty , ' he gasped His triumph was shortlived With a massive burst of energy the fish broke free of his grasp and leapt six feet in the air .

source_bert_toks: ' got you my beauty , ' he gasped his triumph was short ##li ##ved with a massive burst of energy the fish broke free of his grasp and leapt six feet in the air .

reference_raw: 'I have my beauty for you,' he said, his triumph shortened with a great burst of energy that the fish broke free of his grasp and leapt six feet into the air.

reference_spacy_tokens: ' I have my beauty for you , ' he said , his triumph shortened with a great burst of energy that the fish broke free of his grasp and leapt six feet into the air .