fn_spacy_tokens_for_baseline: There are highs -- like young Jamie Delgado , a Slater boy since he was ten , winning the Under-14 World Championships -- never before in British tennis history has that happened .

source_bert_toks: there are highs - - like young jamie delgado , a slater boy since he was ten , winning the under - 14 world championships - - never before in british tennis history has that happened .

reference_raw: There are colleges - like young Jamie Delgado, a Slater boy from the age of 10, who won the World Cup under the age of 14 - that's never happened in the history of British tennis.

reference_spacy_tokens: There are colleges - like young Jamie Delgado , a Slater boy from the age of 10 , who won the World Cup under the age of 14 - that 's never happened in the history of British tennis .


fn_spacy_tokens_for_baseline: Yet even the nobility were loath to pay for such intangibles when they could obtain a similar ritual at less outlay and with greater speed from within the trade .

source_bert_toks: yet even the nobility were lo ##ath to pay for such int ##ang ##ible ##s when they could obtain a similar ritual at less out ##lay and with greater speed from within the trade .

reference_raw: But even the nobles hated to pay for such intangibles when they were able to obtain the same ritual at a lower rate and at greater speed from the inside of the trade.

reference_spacy_tokens: But even the nobles hated to pay for such intangibles when they were able to obtain the same ritual at a lower rate and at greater speed from the inside of the trade .


fn_spacy_tokens_for_baseline: Nor does the loud ovation after a well - played , but not very insightful account of the finale .

source_bert_toks: nor does the loud o ##vation after a well - played , but not very insight ##ful account of the finale .

reference_raw: Not even a loud ovation after a well-played but not a very clear description of the finale.

reference_spacy_tokens: Not even a loud ovation after a well - played but not a very clear description of the finale .


fn_spacy_tokens_for_baseline: The new edition , largely rewritten , aims ' to combine a complete and scientifically acceptable coverage of the field with sufficient elementary explanation to make this comprehensible by readers without a scientific training ' .

source_bert_toks: the new edition , largely re ##written , aims ' to combine a complete and scientific ##ally acceptable coverage of the field with sufficient elementary explanation to make this com ##pre ##hen ##sible by readers without a scientific training ' .

reference_raw: The purpose of the new edition, which is largely rewritten, is to combine the full and scientifically acceptable coverage of the field with sufficient basic explanations to be understood by readers without scientific training.

reference_spacy_tokens: The purpose of the new edition , which is largely rewritten , is to combine the full and scientifically acceptable coverage of the field with sufficient basic explanations to be understood by readers without scientific training .


fn_spacy_tokens_for_baseline: This might have implications for the many companies which import computers made outside the European Community especially the ' clone ' importers who affix their own name to the equipment .

source_bert_toks: this might have implications for the many companies which import computers made outside the european community especially the ' clone ' import ##ers who af ##fi ##x their own name to the equipment .

reference_raw: This could have consequences for a number of companies importing computers manufactured outside the European Community, in particular clone importers, who attach their own name to the equipment.

reference_spacy_tokens: This could have consequences for a number of companies importing computers manufactured outside the European Community , in particular clone importers , who attach their own name to the equipment .


fn_spacy_tokens_for_baseline: The slogan was spelled out in three - foot - high polystyrene lettering and glued onto a soft canvas backdrop .

source_bert_toks: the slogan was spelled out in three - foot - high poly ##sty ##ren ##e lettering and glued onto a soft canvas backdrop .

reference_raw: The slogan was written in a three-foot polystyrene letter and stuck to a soft canvas background.

reference_spacy_tokens: The slogan was written in a three - foot polystyrene letter and stuck to a soft canvas background .


fn_spacy_tokens_for_baseline: He pulled the top of the shift over her head .

source_bert_toks: he pulled the top of the shift over her head .

reference_raw: He pulled the top of the inning over her head.

reference_spacy_tokens: He pulled the top of the inning over her head .


fn_spacy_tokens_for_baseline: His body was wheeled off in a peat barrow and cremated in the local brick kiln .

source_bert_toks: his body was wheeled off in a peat barrow and cremated in the local brick ki ##ln .

reference_raw: His body was turned into a peat barrow and cremated in a local brick furnace.

reference_spacy_tokens: His body was turned into a peat barrow and cremated in a local brick furnace .


fn_spacy_tokens_for_baseline: " Ferg . " she said , breathless , lip - stick smeared .

source_bert_toks: " fe ##rg . " she said , breathless , lip - stick smeared .

reference_raw: "Ferg," she said breathlessly, her lipstick stained.

reference_spacy_tokens: " Ferg , " she said breathlessly , her lipstick stained .


fn_spacy_tokens_for_baseline: Depression flattens the voice almost to monotony ; movement is slowed , and a dejected facial expression is characteristic of many people when they are in a low mood .

source_bert_toks: depression flat ##tens the voice almost to mono ##ton ##y ; movement is slowed , and a de ##jected facial expression is characteristic of many people when they are in a low mood .

reference_raw: Depression flattens the voice almost to a monotonous level; movement slows, and a depressed face is typical of a lot of people when they're in a low mood.

reference_spacy_tokens: Depression flattens the voice almost to a monotonous level ; movement slows , and a depressed face is typical of a lot of people when they 're in a low mood .


fn_spacy_tokens_for_baseline: The LASMO Group operates a number of pension schemes .

source_bert_toks: the las ##mo group operates a number of pension schemes .

reference_raw: A number of pension schemes are run by the LASMO group.

reference_spacy_tokens: A number of pension schemes are run by the LASMO group .


fn_spacy_tokens_for_baseline: Obstinately , she remained standing , looking at him and trying to shut down the traitorously receptive part of her that was assimilating the way his formal evening attire enhanced his devastating masculinity .

source_bert_toks: ob ##sti ##nate ##ly , she remained standing , looking at him and trying to shut down the traitor ##ously rec ##eptive part of her that was ass ##imi ##lating the way his formal evening attire enhanced his devastating mas ##cu ##lini ##ty .

reference_raw: She stood stubbornly, staring at him, trying to shut down the treacherously receptive part of her that assimilated the way his formal evening dress increased his destructive manhood.

reference_spacy_tokens: She stood stubbornly , staring at him , trying to shut down the treacherously receptive part of her that assimilated the way his formal evening dress increased his destructive manhood .


fn_spacy_tokens_for_baseline: So this woman , successful in her own right , and except for her politics a poster woman for the " Ms.

source_bert_toks: so this woman , successful in her own right , and except for her politics a poster woman for the " ms .

reference_raw: So this woman, she's a success in her own right, and besides her politics, she's a poster girl for Miss.

reference_spacy_tokens: So this woman , she 's a success in her own right , and besides her politics , she 's a poster girl for Miss.


fn_spacy_tokens_for_baseline: Vic threads the tunnels , switches lanes , swings out on to a long covered ramp that leads to a six - lane expressway thrust like a gigantic concrete fist through the backstreets of his boyhood .

source_bert_toks: vic threads the tunnels , switches lanes , swings out on to a long covered ramp that leads to a six - lane expressway thrust like a gigantic concrete fist through the backs ##tree ##ts of his boy ##hood .

reference_raw: Vic threads tunnels, switches lanes, swings onto a long covered ramp that leads to a six-lane highway thrust like a giant concrete fist through the back streets of his childhood.

reference_spacy_tokens: Vic threads tunnels , switches lanes , swings onto a long covered ramp that leads to a six - lane highway thrust like a giant concrete fist through the back streets of his childhood .


fn_spacy_tokens_for_baseline: These so - called ' targeting officers ' are given a blend of analytic and operational training to become specialists in sifting clues to the locations of high - value fugitives .

source_bert_toks: these so - called ' targeting officers ' are given a blend of analytic and operational training to become specialists in si ##fting clues to the locations of high - value fugitive ##s .

reference_raw: These so-called target officers are given a mixture of analytical and operational training to become specialists in sifting clues to the locations of high-value refugees.

reference_spacy_tokens: These so - called target officers are given a mixture of analytical and operational training to become specialists in sifting clues to the locations of high - value refugees .


fn_spacy_tokens_for_baseline: The watchman returned , holding up three fingers to signify that the charge for staying on the verandah had now been reduced to three rupees .

source_bert_toks: the watch ##man returned , holding up three fingers to sign ##ify that the charge for staying on the verandah had now been reduced to three ru ##pee ##s .

reference_raw: The guard came back, holding up three fingers to indicate that the charge for staying on the porch was now reduced to three rupees.

reference_spacy_tokens: The guard came back , holding up three fingers to indicate that the charge for staying on the porch was now reduced to three rupees .


fn_spacy_tokens_for_baseline: Sitting at his huge desk , surrounded by his books , Seth wore a Chinese robe , embroidered with dragon gods , and a black skullcap .

source_bert_toks: sitting at his huge desk , surrounded by his books , seth wore a chinese robe , embroidered with dragon gods , and a black skull ##cap .

reference_raw: Seth sat at a large table surrounded by books, wearing a Chinese robe embroidered with dragon gods and a black skull cap.

reference_spacy_tokens: Seth sat at a large table surrounded by books , wearing a Chinese robe embroidered with dragon gods and a black skull cap .


fn_spacy_tokens_for_baseline: Dorman - Smith 's erratic behaviour had exasperated him already .

source_bert_toks: dorm ##an - smith ' s erratic behaviour had exasperated him already .

reference_raw: Dorman-Smith's erratic behavior had already irritated him.

reference_spacy_tokens: Dorman - Smith 's erratic behavior had already irritated him .


fn_spacy_tokens_for_baseline: Later , another high - ranking trafficker , Leonidas Vargas , was arrested and 1,000 pounds of dynamite seized .

source_bert_toks: later , another high - ranking traffic ##ker , leonid ##as vargas , was arrested and 1 , 000 pounds of dynamite seized .

reference_raw: Lately, another high-ranking dealer, Leonidas Vargas, was arrested and a thousand pounds of dynamite confiscated.

reference_spacy_tokens: Lately , another high - ranking dealer , Leonidas Vargas , was arrested and a thousand pounds of dynamite confiscated .


fn_spacy_tokens_for_baseline: The battle for Ajdabiya dragged on as explosions sounded in the hazy distance .

source_bert_toks: the battle for aj ##da ##bi ##ya dragged on as explosions sounded in the hazy distance .

reference_raw: The battle for Ajdabiya continued as the explosions sounded in the misty distance.

reference_spacy_tokens: The battle for Ajdabiya continued as the explosions sounded in the misty distance .


fn_spacy_tokens_for_baseline: I refrain from commenting on it because it is not my purpose to enter into proper debate with philosophers of science .

source_bert_toks: i refrain from commenting on it because it is not my purpose to enter into proper debate with philosophers of science .

reference_raw: I abstain from commenting on this, for it is not my intention to engage in a proper discussion with the philosophers of science.

reference_spacy_tokens: I abstain from commenting on this , for it is not my intention to engage in a proper discussion with the philosophers of science .


fn_spacy_tokens_for_baseline: In November 2000 , as part of a $ 600 million agreement , Libya allegedly acquired the first shipment of a total of 50 North Korean Nodong ballistic missiles , including launch capabilities .

source_bert_toks: in november 2000 , as part of a $ 600 million agreement , libya allegedly acquired the first shipment of a total of 50 north korean nod ##ong ballistic missiles , including launch capabilities .

reference_raw: In November 2000, Libya supposedly acquired the first shipment of 50 North Korean Nodong ballistic missiles, including launch capabilities, as part of a $600 million agreement.

reference_spacy_tokens: In November 2000 , Libya supposedly acquired the first shipment of 50 North Korean Nodong ballistic missiles , including launch capabilities , as part of a $ 600 million agreement .


fn_spacy_tokens_for_baseline: Not to be confused with air vents is the owl - hole , a nearly square or circular opening 150 - 230 mm ( 6 - 9 in ) across , set high up in the gable of the barn .

source_bert_toks: not to be confused with air vents is the owl - hole , a nearly square or circular opening 150 - 230 ##mm ( 6 - 9 ##in ) across , set high up in the gable of the barn .

reference_raw: In order not to be confused with air vents, the owl hole, an almost square or round opening of 150-230 mm (6-9in) in diameter, is situated high in the barn's glass.

reference_spacy_tokens: In order not to be confused with air vents , the owl hole , an almost square or round opening of 150 - 230 mm ( 6 - 9 in ) in diameter , is situated high in the barn 's glass .


fn_spacy_tokens_for_baseline: On the way to the tomb there are some mementoes of the great man , a crucifix staff and a mitre .

source_bert_toks: on the way to the tomb there are some me ##mento ##es of the great man , a cr ##uc ##if ##ix staff and a mit ##re .

reference_raw: On the way to the tomb are the memories of a great man, a crucifix staff and a miter.

reference_spacy_tokens: On the way to the tomb are the memories of a great man , a crucifix staff and a miter .


fn_spacy_tokens_for_baseline: The Utes who once inhabited these regions handed down tales of gods as entities with a wry sense of humour , human faults and even a mean streak .

source_bert_toks: the ut ##es who once inhabited these regions handed down tales of gods as entities with a wry sense of humour , human faults and even a mean streak .

reference_raw: The Utes, who had once occupied these regions, passed on stories of the gods as beings with a sour sense of humor, human flaws, and even an evil streak.

reference_spacy_tokens: The Utes , who had once occupied these regions , passed on stories of the gods as beings with a sour sense of humor , human flaws , and even an evil streak .


fn_spacy_tokens_for_baseline: The decision not to ring - fence DSS money for drug and alcohol services is said to threaten hundreds of projects .

source_bert_toks: the decision not to ring - fence ds ##s money for drug and alcohol services is said to threaten hundreds of projects .

reference_raw: It is said that the decision not to ring-fence DSS money for drug and alcohol services threatens 100 projects.

reference_spacy_tokens: It is said that the decision not to ring - fence DSS money for drug and alcohol services threatens 100 projects .


fn_spacy_tokens_for_baseline: Where the barn adjoined the dwelling it is called a laithe house , and often the stable and cow - house were built beyond the barn as part of the same range .

source_bert_toks: where the barn ad ##jo ##ined the dwelling it is called a lai ##the house , and often the stable and cow - house were built beyond the barn as part of the same range .

reference_raw: Where the barn is adjacent to the house, it is called a laithe house, and often the barn and the cowhouse have been built outside the barn as part of the same distance.

reference_spacy_tokens: Where the barn is adjacent to the house , it is called a laithe house , and often the barn and the cowhouse have been built outside the barn as part of the same distance .


fn_spacy_tokens_for_baseline: In the 1970s Australian jazz experienced the same calamitous slump that afflicted the music generally .

source_bert_toks: in the 1970s australian jazz experienced the same cal ##ami ##tou ##s slump that af ##flict ##ed the music generally .

reference_raw: In the 1970s, Australian jazz experienced the same cataclysm that affected music in general.

reference_spacy_tokens: In the 1970s , Australian jazz experienced the same cataclysm that affected music in general .


fn_spacy_tokens_for_baseline: A little while later three girls arrived on the scene , two blondes and a redhead .

source_bert_toks: a little while later three girls arrived on the scene , two blonde ##s and a redhead .

reference_raw: A moment later three girls, two blonds and a redhead, arrived at the scene.

reference_spacy_tokens: A moment later three girls , two blonds and a redhead , arrived at the scene .


fn_spacy_tokens_for_baseline: There are hundreds of stone steps in the hillside to walk up before you reach Man Fat Temple with its regiments of small gilt statues of Buddha lining the walls .

source_bert_toks: there are hundreds of stone steps in the hillside to walk up before you reach man fat temple with its regiments of small gil ##t statues of buddha lining the walls .

reference_raw: There are hundreds of stone steps on the side of the hill that you can walk before you reach the Man Fat Temple with its regiments of little gilt sculptures of Buddha lining the walls.

reference_spacy_tokens: There are hundreds of stone steps on the side of the hill that you can walk before you reach the Man Fat Temple with its regiments of little gilt sculptures of Buddha lining the walls .


fn_spacy_tokens_for_baseline: He chops the heart to bits .

source_bert_toks: he chop ##s the heart to bits .

reference_raw: He cuts his heart to pieces.

reference_spacy_tokens: He cuts his heart to pieces .


fn_spacy_tokens_for_baseline: A prosperous tourist district , it is full of shopping centers and department stores , along with a number of good restaurants .

source_bert_toks: a prosperous tourist district , it is full of shopping centers and department stores , along with a number of good restaurants .

reference_raw: A thriving tourist district is filled with shops and shops, along with many good restaurants.

reference_spacy_tokens: A thriving tourist district is filled with shops and shops , along with many good restaurants .


fn_spacy_tokens_for_baseline: Chant 's face was decaying , cobs of withered flesh sliding off his slickened bone .

source_bert_toks: chant ' s face was decay ##ing , co ##bs of with ##ered flesh sliding off his slick ##ened bone .

reference_raw: Chant's face was decomposing, cobs of wilted flesh sliding from his smooth bones.

reference_spacy_tokens: Chant 's face was decomposing , cobs of wilted flesh sliding from his smooth bones .


fn_spacy_tokens_for_baseline: Steve , who was sitting next to John , got down in Rome .

source_bert_toks: steve , who was sitting next to john , got down in rome .

reference_raw: Steve, sitting next to John, went to Rome.

reference_spacy_tokens: Steve , sitting next to John , went to Rome .


fn_spacy_tokens_for_baseline: You must develop a series of ever more suspenseful situations and , though her hero or heroine must eventually ' be all right ' , the final denouement must not be a let - down .

source_bert_toks: you must develop a series of ever more suspense ##ful situations and , though her hero or heroine must eventually ' be all right ' , the final den ##oue ##ment must not be a let - down .

reference_raw: You have to create a series of increasingly tense situations, and even if her hero or heroine has to be okay in the end, the final denouement must not be disappointing.

reference_spacy_tokens: You have to create a series of increasingly tense situations , and even if her hero or heroine has to be okay in the end , the final denouement must not be disappointing .


fn_spacy_tokens_for_baseline: Maxim trailed into the room behind him , vaguely looking for a fresh drink and finding Ages instead , who had been more than vaguely looking for him .

source_bert_toks: maxim trailed into the room behind him , vaguely looking for a fresh drink and finding ages instead , who had been more than vaguely looking for him .

reference_raw: Maxim followed him into the room behind him, looking vaguely for a fresh drink, and found instead Ages, who was more than vaguely searching for him.

reference_spacy_tokens: Maxim followed him into the room behind him , looking vaguely for a fresh drink , and found instead Ages , who was more than vaguely searching for him .


fn_spacy_tokens_for_baseline: There is no indication that Iran has successfully weaponized BW agents .

source_bert_toks: there is no indication that iran has successfully weapon ##ized b ##w agents .

reference_raw: There is no evidence that Iran has successfully armed BW agents.

reference_spacy_tokens: There is no evidence that Iran has successfully armed BW agents .


fn_spacy_tokens_for_baseline: You smelt a sharp excitement on the air ,

source_bert_toks: you sm ##elt a sharp excitement on the air ,

reference_raw: You smelled intense excitement in the air,

reference_spacy_tokens: You smelled intense excitement in the air ,


fn_spacy_tokens_for_baseline: As he spoke he broke the seal on the carton of cream for his coffee , inadvertently squeezed the carton , and squirted a little jet of cream up her skirt between her thighs .

source_bert_toks: as he spoke he broke the seal on the cart ##on of cream for his coffee , inadvertently squeezed the cart ##on , and sq ##ui ##rted a little jet of cream up her skirt between her thighs .

reference_raw: As he spoke, he broke the lock on a box of cream for coffee, unwittingly squeezed the box, and poured a small stream of cream into her skirt between her thighs.

reference_spacy_tokens: As he spoke , he broke the lock on a box of cream for coffee , unwittingly squeezed the box , and poured a small stream of cream into her skirt between her thighs .


fn_spacy_tokens_for_baseline: They may view extreme violence as divinely sanctioned and the fulfillment of God 's commandments .

source_bert_toks: they may view extreme violence as divine ##ly sanctioned and the fulfillment of god ' s command ##ments .

reference_raw: They may consider extreme violence to be divinely sanctioned and to comply with God's commandments.

reference_spacy_tokens: They may consider extreme violence to be divinely sanctioned and to comply with God 's commandments .


fn_spacy_tokens_for_baseline: Each fish is caught in the water , then carried to a nearby bank and delicately devoured .

source_bert_toks: each fish is caught in the water , then carried to a nearby bank and delicately dev ##oured .

reference_raw: Each fish is caught in the water, then transported to a nearby bank and eaten gently.

reference_spacy_tokens: Each fish is caught in the water , then transported to a nearby bank and eaten gently .


fn_spacy_tokens_for_baseline: He stood flexing the body he had preserved to himself by hard exercise and the austere living that wore so deceptive a cloak of luxury .

source_bert_toks: he stood flex ##ing the body he had preserved to himself by hard exercise and the aus ##ter ##e living that wore so dec ##eptive a cloak of luxury .

reference_raw: He stood there, flexing the body he'd kept to himself with hard exercise and austerity that wore such a deceptive cloak of luxury.

reference_spacy_tokens: He stood there , flexing the body he 'd kept to himself with hard exercise and austerity that wore such a deceptive cloak of luxury .


fn_spacy_tokens_for_baseline: He confessed to having misappropriated $ 2.2bn from the Royal Family 's portfolio and disclosed that there were unrecorded deposits of $ 570 m .

source_bert_toks: he confessed to having mis ##app ##rop ##riated $ 2 . 2 ##bn from the royal family ' s portfolio and disclosed that there were un ##re ##cor ##ded deposits of $ 570 ##m .

reference_raw: He confessed to a misappropriation of $2.2 billion from the Royal Family's portfolio and announced that there were unrecorded deposits of $570 million.

reference_spacy_tokens: He confessed to a misappropriation of $ 2.2 billion from the Royal Family 's portfolio and announced that there were unrecorded deposits of $ 570 million .


fn_spacy_tokens_for_baseline: A group of tattered watermen muttered abuse at the frozen river and cursed the great frost which had taken their livelihood from them .

source_bert_toks: a group of ta ##ttered water ##men muttered abuse at the frozen river and cursed the great frost which had taken their livelihood from them .

reference_raw: A group of tattered watermen mumbled abuse on the icy river, cursing the great frost that had taken their livelihood away from them.

reference_spacy_tokens: A group of tattered watermen mumbled abuse on the icy river , cursing the great frost that had taken their livelihood away from them .


fn_spacy_tokens_for_baseline: Chinese and Russian supply policies are key to whether Iran will successfully acquire the needed technology , expertise , and infrastructure to manufacture the fissile material for a weapon and the ability to fashion a usable device .

source_bert_toks: chinese and russian supply policies are key to whether iran will successfully acquire the needed technology , expertise , and infrastructure to manufacture the fis ##sil ##e material for a weapon and the ability to fashion a usable device .

reference_raw: Chinese and Russian delivery policies are crucial to ensuring that Iran successfully acquires the necessary technology, expertise, and infrastructure to produce fissile material for a weapon and the ability to make a useful device.

reference_spacy_tokens: Chinese and Russian delivery policies are crucial to ensuring that Iran successfully acquires the necessary technology , expertise , and infrastructure to produce fissile material for a weapon and the ability to make a useful device .


fn_spacy_tokens_for_baseline: In fact it was coined seven years before Darwin published his theory , by Herbert Spencer .

source_bert_toks: in fact it was coined seven years before darwin published his theory , by herbert spencer .

reference_raw: Actually, it was invented seven years before Darwin published Herbert Spencer's theory.

reference_spacy_tokens: Actually , it was invented seven years before Darwin published Herbert Spencer 's theory .


fn_spacy_tokens_for_baseline: This season , we welcome the return of TO FLY , a soaring , white - knuckle aerial exploration of America , from balloon ascension to journey into space .

source_bert_toks: this season , we welcome the return of to fly , a soaring , white - kn ##uck ##le aerial exploration of america , from balloon ascension to journey into space .

reference_raw: This season, we welcome the return of TOFLY, a rising, white-knitted aerial survey of America, from balloon ascendancy to space travel.

reference_spacy_tokens: This season , we welcome the return of TOFLY , a rising , white - knitted aerial survey of America , from balloon ascendancy to space travel .


fn_spacy_tokens_for_baseline: The interviews were already published when it was discovered that he was an impostor .

source_bert_toks: the interviews were already published when it was discovered that he was an imp ##ost ##or .

reference_raw: The interviews were published when they found out he was a fraud.

reference_spacy_tokens: The interviews were published when they found out he was a fraud .


fn_spacy_tokens_for_baseline: Then there was the American sprinter Jesse Owens , who swept to victory in the Berlin Olympic Games of 1936 , much to the disgruntlement of Hitler .

source_bert_toks: then there was the american sprinter jesse owens , who swept to victory in the berlin olympic games of 1936 , much to the di ##sg ##run ##tlement of hitler .

reference_raw: Then came the American sprinter, Jesse Owens, who went to victory at the 1936 Berlin Olympics, much to Hitler's displeasure.

reference_spacy_tokens: Then came the American sprinter , Jesse Owens , who went to victory at the 1936 Berlin Olympics , much to Hitler 's displeasure .


fn_spacy_tokens_for_baseline: He and his master dragged me to my room and held judgment upon me as a convicted traitress .

source_bert_toks: he and his master dragged me to my room and held judgment upon me as a convicted trait ##ress .

reference_raw: He and his lord dragged me into my room, judging me like a convicted traitor.

reference_spacy_tokens: He and his lord dragged me into my room , judging me like a convicted traitor .


fn_spacy_tokens_for_baseline: I had bought him a musical tie which woke him up from an afternoon nap when he rolled on to it .

source_bert_toks: i had bought him a musical tie which woke him up from an afternoon nap when he rolled on to it .

reference_raw: I bought him a musical tie that woke him up from his afternoon sleep while he was rolling on it.

reference_spacy_tokens: I bought him a musical tie that woke him up from his afternoon sleep while he was rolling on it .


fn_spacy_tokens_for_baseline: Paint traces may indicate that Princess Diana 's car collided with a black Fiat just before the fatal crash .

source_bert_toks: paint traces may indicate that princess diana ' s car collided with a black fiat just before the fatal crash .

reference_raw: Paint marks may indicate that Princess Diana's car collided with a black fiat just before the fatal accident.

reference_spacy_tokens: Paint marks may indicate that Princess Diana 's car collided with a black fiat just before the fatal accident .


fn_spacy_tokens_for_baseline: Your premise that affirmative action promotes or gives positions to people of color who do n't deserve or are unqualified for these positions is what I find racist .

source_bert_toks: your premise that affirmative action promotes or gives positions to people of color who don ' t deserve or are un ##qual ##ified for these positions is what i find racist .

reference_raw: Your assumption that positive action promotes, or gives, a position to people of colour who do not deserve, or are not qualified for, such a position is what I find racist.

reference_spacy_tokens: Your assumption that positive action promotes , or gives , a position to people of colour who do not deserve , or are not qualified for , such a position is what I find racist .


fn_spacy_tokens_for_baseline: ' You are so droll , Anne .

source_bert_toks: ' you are so dr ##oll , anne .

reference_raw: 'You're so drolly, Anna.

reference_spacy_tokens: ' You 're so drolly , Anna .


fn_spacy_tokens_for_baseline: Of particular interest is the strong wording on the question of shortages :

source_bert_toks: of particular interest is the strong word ##ing on the question of shortages :

reference_raw: The strong text on the issue of shortages is of particular interest:

reference_spacy_tokens: The strong text on the issue of shortages is of particular interest :


fn_spacy_tokens_for_baseline: The very air was charged with a terrible heart - rending loneliness .

source_bert_toks: the very air was charged with a terrible heart - ren ##ding loneliness .

reference_raw: The very air was filled with a terrible solitude of the heart.

reference_spacy_tokens: The very air was filled with a terrible solitude of the heart .


fn_spacy_tokens_for_baseline: After Wednesday 's attack , court proceedings were suspended , the complex evacuated and the nation placed on alert .

source_bert_toks: after wednesday ' s attack , court proceedings were suspended , the complex evacuated and the nation placed on alert .

reference_raw: After the attack on Wednesday, the trial was suspended, the complex evacuated, and the nation was on standby.

reference_spacy_tokens: After the attack on Wednesday , the trial was suspended , the complex evacuated , and the nation was on standby .


fn_spacy_tokens_for_baseline: Children at Wanborough primary school near Swindon are so worried about the hazards they experience on the way to school , they 're calling for a new footpath .

source_bert_toks: children at wan ##borough primary school near swindon are so worried about the hazards they experience on the way to school , they ' re calling for a new foot ##path .

reference_raw: The children of Wanborough Elementary School near Swindon are so afraid of the dangers they experience on their way to school that they call for a new trail.

reference_spacy_tokens: The children of Wanborough Elementary School near Swindon are so afraid of the dangers they experience on their way to school that they call for a new trail .


fn_spacy_tokens_for_baseline: Still , rumors persist that Taiwan has stockpiled sarin in two locations : Tsishan ( Kaohsiung ) and in Kuanhsi , Hsinchu County .

source_bert_toks: still , rumors persist that taiwan has stock ##pile ##d sar ##in in two locations : ts ##isha ##n ( ka ##oh ##si ##ung ) and in ku ##an ##hs ##i , hs ##in ##chu county .

reference_raw: There are still rumours that Taiwan stores sarin in two places: Tsishan (Kaohsiung) and Kuanhsi, Hsinchu County.

reference_spacy_tokens: There are still rumours that Taiwan stores sarin in two places : Tsishan ( Kaohsiung ) and Kuanhsi , Hsinchu County .


fn_spacy_tokens_for_baseline: She drags on a low tar cigarette -- ' I 'm just learning to smoke ' -- and wipes her hands on much - wiped jeans .

source_bert_toks: she drag ##s on a low tar cigarette - - ' i ' m just learning to smoke ' - - and wipe ##s her hands on much - wiped jeans .

reference_raw: He pulls on a low-tar cigarette - "I'm just learning to smoke" - and wipes his hands on his well-whipped jeans.

reference_spacy_tokens: He pulls on a low - tar cigarette - " I 'm just learning to smoke " - and wipes his hands on his well - whipped jeans .


fn_spacy_tokens_for_baseline: Garvin himself , before he became Commandant , had been responsible for training them .

source_bert_toks: ga ##r ##vin himself , before he became commandant , had been responsible for training them .

reference_raw: Garvin himself was in charge of training them before he became commander.

reference_spacy_tokens: Garvin himself was in charge of training them before he became commander .


fn_spacy_tokens_for_baseline: For example , he has been married and is still on very good terms with his wife ; their divorce unlocked her true potential , and she is now a part - time feminist studies lecturer at SCU .

source_bert_toks: for example , he has been married and is still on very good terms with his wife ; their divorce unlocked her true potential , and she is now a part - time feminist studies lecturer at sc ##u .

reference_raw: He's married, for example, and he's still on very good terms with his wife; their separation has unlocked her real potential, and she's now a part-time professor of feminist studies at the SCU.

reference_spacy_tokens: He 's married , for example , and he 's still on very good terms with his wife ; their separation has unlocked her real potential , and she 's now a part - time professor of feminist studies at the SCU .


fn_spacy_tokens_for_baseline: With bold images designed to convince bosses and clients quickly , such programs make it easy to break the rules of objective data display .

source_bert_toks: with bold images designed to convince bosses and clients quickly , such programs make it easy to break the rules of objective data display .

reference_raw: With bold images designed to quickly persuade bosses and clients, such programs facilitate the violation of objective data display rules.

reference_spacy_tokens: With bold images designed to quickly persuade bosses and clients , such programs facilitate the violation of objective data display rules .


fn_spacy_tokens_for_baseline: If you do n't think you can manage it yourself , give your butcher plenty of warning and he will bone your turkey for you .

source_bert_toks: if you don ' t think you can manage it yourself , give your butcher plenty of warning and he will bone your turkey for you .

reference_raw: If you don't think you can handle this on your own, give the butcher a lot of warning, and he'll blow your turkey for you.

reference_spacy_tokens: If you do n't think you can handle this on your own , give the butcher a lot of warning , and he 'll blow your turkey for you .


fn_spacy_tokens_for_baseline: China possesses nuclear weapons , a range of ballistic missile capabilities , and the ability to develop chemical and biological weapons .

source_bert_toks: china possesses nuclear weapons , a range of ballistic missile capabilities , and the ability to develop chemical and biological weapons .

reference_raw: China has nuclear weapons, a range of ballistic missile capabilities, and the capacity to develop chemical and biological weapons.

reference_spacy_tokens: China has nuclear weapons , a range of ballistic missile capabilities , and the capacity to develop chemical and biological weapons .


fn_spacy_tokens_for_baseline: Epitot , conferring with other officers of staff at a trestle table nearby , turned and noticed him .

source_bert_toks: ep ##ito ##t , con ##fer ##ring with other officers of staff at a tres ##tle table nearby , turned and noticed him .

reference_raw: Epitot, conversing with the rest of the staff at a nearby trestle table, turned and saw him.

reference_spacy_tokens: Epitot , conversing with the rest of the staff at a nearby trestle table , turned and saw him .


fn_spacy_tokens_for_baseline: Hot and angry , she tossed in bed again , suppressing such nonsensical flights of fancy .

source_bert_toks: hot and angry , she tossed in bed again , suppress ##ing such non ##sen ##sic ##al flights of fancy .

reference_raw: Hot and angry, she threw herself back into bed, stifling such meaningless flights of luxury.

reference_spacy_tokens: Hot and angry , she threw herself back into bed , stifling such meaningless flights of luxury .


fn_spacy_tokens_for_baseline: I dipped down into a valley , crossed into another field -- moving faster and faster -- and then climbed up towards a thicket .

source_bert_toks: i dipped down into a valley , crossed into another field - - moving faster and faster - - and then climbed up towards a thick ##et .

reference_raw: I sank down into the valley, crossed to another field - moving faster and faster - and climbed to the thicket.

reference_spacy_tokens: I sank down into the valley , crossed to another field - moving faster and faster - and climbed to the thicket .


fn_spacy_tokens_for_baseline: As I walked round the lake , a flotilla of ducks paddled furiously after me , hoping to be fed , while fieldfares fluttered about on the lawns .

source_bert_toks: as i walked round the lake , a flotilla of ducks paddle ##d furiously after me , hoping to be fed , while field ##fare ##s fluttered about on the lawn ##s .

reference_raw: As I walked around the lake, a fleet of ducks paddled furiously behind me in the hope of being fed, while the field-fares fluttered on the lawn.

reference_spacy_tokens: As I walked around the lake , a fleet of ducks paddled furiously behind me in the hope of being fed , while the field - fares fluttered on the lawn .


fn_spacy_tokens_for_baseline: ' Acquire a veneer of civilization , ' she said unexpectedly , with a brutal honesty possible only with someone she regarded as an old friend .

source_bert_toks: ' acquire a ve ##neer of civilization , ' she said unexpectedly , with a brutal honesty possible only with someone she regarded as an old friend .

reference_raw: "Acquire the veneer of civilization," she said suddenly, with a brutal sincerity only to someone she considered an old friend.

reference_spacy_tokens: " Acquire the veneer of civilization , " she said suddenly , with a brutal sincerity only to someone she considered an old friend .


fn_spacy_tokens_for_baseline: She had promised a wealth of experience on their exploratory first date .

source_bert_toks: she had promised a wealth of experience on their ex ##pl ##ora ##tory first date .

reference_raw: On their first date of exploration, she promised a great deal of experience.

reference_spacy_tokens: On their first date of exploration , she promised a great deal of experience .


fn_spacy_tokens_for_baseline: The early - morning airstrike destroyed one apartment building , crushing residents beneath tons of debris while they were sleeping , Libyan authorities said .

source_bert_toks: the early - morning airs ##tri ##ke destroyed one apartment building , crushing residents beneath tons of debris while they were sleeping , libyan authorities said .

reference_raw: The morning airport destroyed an apartment building, crushing residents under tons of rubble while they slept, the Libyan authorities said.

reference_spacy_tokens: The morning airport destroyed an apartment building , crushing residents under tons of rubble while they slept , the Libyan authorities said .


fn_spacy_tokens_for_baseline: How vulnerable is the United States to BW terrorism , and what types of attacks should it be most concerned about ?

source_bert_toks: how vulnerable is the united states to b ##w terrorism , and what types of attacks should it be most concerned about ?

reference_raw: What is the US' vulnerability to BW terrorism and what kinds of attacks should it be most concerned about?

reference_spacy_tokens: What is the US ' vulnerability to BW terrorism and what kinds of attacks should it be most concerned about ?


fn_spacy_tokens_for_baseline: Holly did not interrupt him , and broke his bread into small pieces and husbanded the crumbs .

source_bert_toks: holly did not interrupt him , and broke his bread into small pieces and husband ##ed the cr ##umb ##s .

reference_raw: Holly didn't interrupt, but broke the bread into little pieces and married the crumbs.

reference_spacy_tokens: Holly did n't interrupt , but broke the bread into little pieces and married the crumbs .


fn_spacy_tokens_for_baseline: Orphan Drug designation is awarded to compounds that offer potential therapeutic value in the treatment of rare diseases , defined as those affecting fewer than 200,000 Americans .

source_bert_toks: orphan drug designation is awarded to compounds that offer potential therapeutic value in the treatment of rare diseases , defined as those affecting fewer than 200 , 000 americans .

reference_raw: Orphan Drugs are designated for substances that offer a potential therapeutic value for the treatment of rare diseases, defined as those affecting less than 200,000 Americans.

reference_spacy_tokens: Orphan Drugs are designated for substances that offer a potential therapeutic value for the treatment of rare diseases , defined as those affecting less than 200,000 Americans .


fn_spacy_tokens_for_baseline: At five o'clock precisely , it was time for Dame Edna to catnap before changing for the evening for some glittering social round .

source_bert_toks: at five o ' clock precisely , it was time for dame edna to cat ##na ##p before changing for the evening for some glittering social round .

reference_raw: At precisely five o'clock, it was time for Dame Edna to knock off before she changed into the evening for a sparkling social round.

reference_spacy_tokens: At precisely five o'clock , it was time for Dame Edna to knock off before she changed into the evening for a sparkling social round .


fn_spacy_tokens_for_baseline: In place of a human hand several hybrids sported the terrible , strong claw of the purestrain Genestealer .

source_bert_toks: in place of a human hand several hybrids sport ##ed the terrible , strong claw of the pure ##stra ##in genes ##tea ##ler .

reference_raw: Instead of a human hand, a few hybrids sported the hideous, powerful talon of a purestrain Genestealer.

reference_spacy_tokens: Instead of a human hand , a few hybrids sported the hideous , powerful talon of a purestrain Genestealer .


fn_spacy_tokens_for_baseline: By the way , Piper , ' he continued , ' why do n't you sleep over at the big house ?

source_bert_toks: by the way , piper , ' he continued , ' why don ' t you sleep over at the big house ?

reference_raw: By the way, Piper,' he went on, 'why don't you stay in the big house?

reference_spacy_tokens: By the way , Piper , ' he went on , ' why do n't you stay in the big house ?


fn_spacy_tokens_for_baseline: A great crater had been formed , most of it below sea level , and soundings showed that where land had once stood 300 metres above sea level , the water was now 300 metres deep .

source_bert_toks: a great crater had been formed , most of it below sea level , and sounding ##s showed that where land had once stood 300 metres above sea level , the water was now 300 metres deep .

reference_raw: A large crater was formed, most of it below sea level, and the sounds showed that where the land had once been 300 meters above sea level, the water was now 300 meters below sea level.

reference_spacy_tokens: A large crater was formed , most of it below sea level , and the sounds showed that where the land had once been 300 meters above sea level , the water was now 300 meters below sea level .


fn_spacy_tokens_for_baseline: In its early days software is tested by programmers and expert , hand picked users , who tend to be reasonable about they way they use machines .

source_bert_toks: in its early days software is tested by programmers and expert , hand picked users , who tend to be reasonable about they way they use machines .

reference_raw: In the early days, software is tested by programmers and specialists, hand-picked users, who tend to be sensible about how they use machines.

reference_spacy_tokens: In the early days , software is tested by programmers and specialists , hand - picked users , who tend to be sensible about how they use machines .


fn_spacy_tokens_for_baseline: He cut two thick slices of bread and spread yellow , salty butter over each one .

source_bert_toks: he cut two thick slices of bread and spread yellow , salty butter over each one .

reference_raw: He cut two thick pieces of bread and covered each with yellow, salty butter.

reference_spacy_tokens: He cut two thick pieces of bread and covered each with yellow , salty butter .


fn_spacy_tokens_for_baseline: You 'll find that prices are about the same in Hong Kong Central and Kowloon , and somewhat cheaper in Causeway Bay , which caters to local shopping .

source_bert_toks: you ' ll find that prices are about the same in hong kong central and ko ##wl ##oon , and somewhat cheaper in causeway bay , which cater ##s to local shopping .

reference_raw: You'll find that prices are about the same in Hong Kong Central and Kowloon, and a little cheaper in Causeway Bay, which is a restaurant for local shopping.

reference_spacy_tokens: You 'll find that prices are about the same in Hong Kong Central and Kowloon , and a little cheaper in Causeway Bay , which is a restaurant for local shopping .


fn_spacy_tokens_for_baseline: A third NATO soldier aboard a coalition helicopter died Saturday when the chopper crashed in the eastern province of Kapisa , alliance officials said .

source_bert_toks: a third nato soldier aboard a coalition helicopter died saturday when the chopper crashed in the eastern province of ka ##pis ##a , alliance officials said .

reference_raw: The third NATO soldier aboard the coalition helicopter died on Saturday when the helicopter crashed in the eastern province of Kapisa, the Alliance officials said.

reference_spacy_tokens: The third NATO soldier aboard the coalition helicopter died on Saturday when the helicopter crashed in the eastern province of Kapisa , the Alliance officials said .


fn_spacy_tokens_for_baseline: Hamish Brown describes the creation of a new trekking route in Morocco

source_bert_toks: hamish brown describes the creation of a new trek ##king route in morocco

reference_raw: Hamish Brown describes the creation of a new trip to Morocco


fn_spacy_tokens_for_baseline: For most of you , any talk of electronic mail is probably more mystifying than Jon Newsome 's og against the Arse .

source_bert_toks: for most of you , any talk of electronic mail is probably more my ##sti ##fying than jon news ##ome ' s og against the ars ##e .

reference_raw: For most of you, any talk of e-mail is probably more mysterious than Jon Newsome's og against the ass.

reference_spacy_tokens: For most of you , any talk of e - mail is probably more mysterious than Jon Newsome 's og against the ass .


fn_spacy_tokens_for_baseline: Wooden planters can be made to order .

source_bert_toks: wooden plant ##ers can be made to order .

reference_raw: You can make wooden plants to order.

reference_spacy_tokens: You can make wooden plants to order .


fn_spacy_tokens_for_baseline: China is estimated to have about 400 strategic and tactical nuclear weapons , and stocks of fissile material sufficient to produce a much larger arsenal .

source_bert_toks: china is estimated to have about 400 strategic and tactical nuclear weapons , and stocks of fis ##sil ##e material sufficient to produce a much larger arsenal .

reference_raw: China is estimated to have around 400 strategic and tactical nuclear weapons and enough fissile material to produce a much larger arsenal.

reference_spacy_tokens: China is estimated to have around 400 strategic and tactical nuclear weapons and enough fissile material to produce a much larger arsenal .


fn_spacy_tokens_for_baseline: The orange light flared and he jabbed at it .

source_bert_toks: the orange light flared and he ja ##bbed at it .

reference_raw: Orange light blazed, and he jabbed at it.

reference_spacy_tokens: Orange light blazed , and he jabbed at it .


fn_spacy_tokens_for_baseline: Christina entered the hallway and switched on the ceiling fan .

source_bert_toks: christina entered the hallway and switched on the ceiling fan .

reference_raw: Christine stepped into the corridor and turned on the ceiling fan.

reference_spacy_tokens: Christine stepped into the corridor and turned on the ceiling fan .


fn_spacy_tokens_for_baseline: I SYMPATHIZE with the Duke of Wellington who , towards the end of his life it is said , grieved continually over all the brave men killed at the Battle of Waterloo .

source_bert_toks: i sy ##mp ##athi ##ze with the duke of wellington who , towards the end of his life it is said , gr ##ie ##ved continually over all the brave men killed at the battle of waterloo .

reference_raw: I sympathize with the Duke of Wellington, who, at the end of his life, mourned all the brave men killed in the Battle of Waterloo.

reference_spacy_tokens: I sympathize with the Duke of Wellington , who , at the end of his life , mourned all the brave men killed in the Battle of Waterloo .


fn_spacy_tokens_for_baseline: It was n't her fault , Robbie thought crossly , that she had assumed ' Fen ' was Caro 's stepsister Fenella .

source_bert_toks: it wasn ' t her fault , robbie thought cross ##ly , that she had assumed ' fen ' was car ##o ' s steps ##ister fen ##ella .

reference_raw: It was not her fault, Robbie thought crossly, that "Fen" was Car's half-sister, Fenella.

reference_spacy_tokens: It was not her fault , Robbie thought crossly , that " Fen " was Car 's half - sister , Fenella .


fn_spacy_tokens_for_baseline: It is not irrelevant that Barnaby Rudge is concerned with the Gordon Riots of 1780 , although The Warren is not consumed with quite the virulence that destroys the chateau of Monseigneur in A Tale of Two Cities ( 1859 ) during the French Revolution :

source_bert_toks: it is not irrelevant that barn ##aby ru ##dge is concerned with the gordon riots of 1780 , although the warren is not consumed with quite the vi ##ru ##lence that destroys the chateau of mons ##ei ##gne ##ur in a tale of two cities ( 1859 ) during the french revolution :

reference_raw: It is not irrelevant that Barnaby Rudge is concerned about the Gordon Riots of 1780, even though the Warren is not consumed by the virulence that destroys the castle of Monseigneur in the Tale of Two Cities (1859) during the French Revolution:

reference_spacy_tokens: It is not irrelevant that Barnaby Rudge is concerned about the Gordon Riots of 1780 , even though the Warren is not consumed by the virulence that destroys the castle of Monseigneur in the Tale of Two Cities ( 1859 ) during the French Revolution :


fn_spacy_tokens_for_baseline: He was speaking very much more quietly than when he first came in and occasionally looked reproachfully at the door as if the thing which had depressed him was just the other side of it .

source_bert_toks: he was speaking very much more quietly than when he first came in and occasionally looked rep ##ro ##ach ##fully at the door as if the thing which had depressed him was just the other side of it .

reference_raw: His voice was much quieter than it had been when he had first entered, and from time to time he looked accusingly at the door, as if the thing that had brought him down was just the other side.

reference_spacy_tokens: His voice was much quieter than it had been when he had first entered , and from time to time he looked accusingly at the door , as if the thing that had brought him down was just the other side .


fn_spacy_tokens_for_baseline: He peeked outside the window curtains , at the children on the street .

source_bert_toks: he peeked outside the window curtains , at the children on the street .

reference_raw: He looked out the window curtains at the kids in the street.

reference_spacy_tokens: He looked out the window curtains at the kids in the street .


fn_spacy_tokens_for_baseline: The dispute over the RCB was symptomatic of the power struggle between legislature , government and president .

source_bert_toks: the dispute over the rc ##b was sy ##mpt ##oma ##tic of the power struggle between legislature , government and president .

reference_raw: The dispute over the RCB was a symptom of a power struggle between the legislature, the government and the president.

reference_spacy_tokens: The dispute over the RCB was a symptom of a power struggle between the legislature , the government and the president .


fn_spacy_tokens_for_baseline: One anxious mother , Jane Brooks , said : ' As people drive through and then out of the centre of Holybourne they seem to forget that speed restrictions still apply .

source_bert_toks: one anxious mother , jane brooks , said : ' as people drive through and then out of the centre of holy ##bourne they seem to forget that speed restrictions still apply .

reference_raw: One anxious mother, Jane Brooks, said, "As people pass through and out of the center of Holybourne, they seem to forget that the speed limit is still in place.

reference_spacy_tokens: One anxious mother , Jane Brooks , said , " As people pass through and out of the center of Holybourne , they seem to forget that the speed limit is still in place .


fn_spacy_tokens_for_baseline: Light and shade cohabit like life and death , the one more vivid for the dread presence of the other .

source_bert_toks: light and shade co ##hab ##it like life and death , the one more vivid for the dread presence of the other .

reference_raw: Light and shadow coexist like life and death, one more vivid for the fearful presence of the other.

reference_spacy_tokens: Light and shadow coexist like life and death , one more vivid for the fearful presence of the other .


fn_spacy_tokens_for_baseline: In 1099 , under their leaders Godfrey de Bouillon and Tancred , the Crusaders captured the Holy City for Christendom by slaughtering both Muslims and Jews .

source_bert_toks: in 109 ##9 , under their leaders godfrey de bo ##uil ##lon and tan ##cre ##d , the crusaders captured the holy city for christ ##end ##om by slaughter ##ing both muslims and jews .

reference_raw: In 1099, under the leadership of Godfrey de Bouillon and Tancred, the Crusaders captured the Holy City of Christianity by killing Muslims and Jews.

reference_spacy_tokens: In 1099 , under the leadership of Godfrey de Bouillon and Tancred , the Crusaders captured the Holy City of Christianity by killing Muslims and Jews .


fn_spacy_tokens_for_baseline: 1 ) Voters can " buy " one of two brands when they select their political agents -- a Republican brand that believes in the minimalist state and in the virtues of private markets over the vices of public action , and a Democratic brand that believes in big government and in public intervention to remedy the excesses attendant to the pursuit of private interest .

source_bert_toks: 1 ) voters can " buy " one of two brands when they select their political agents - - a republican brand that believes in the minimal ##ist state and in the virtues of private markets over the vice ##s of public action , and a democratic brand that believes in big government and in public intervention to remedy the excess ##es attendant to the pursuit of private interest .

reference_raw: 1) Voters can "buy" one of two brands if they choose their political agents, a Republican brand that believes in a minimalist state and the virtues of private markets over the vices of public action, and a democratic brand that believes in large government and public intervention to correct excesses of private interest.

reference_spacy_tokens: 1 ) Voters can " buy " one of two brands if they choose their political agents , a Republican brand that believes in a minimalist state and the virtues of private markets over the vices of public action , and a democratic brand that believes in large government and public intervention to correct excesses of private interest .


fn_spacy_tokens_for_baseline: It was one of the bagful of jokes that friends had given Alan , 50 , of Henley , Oxon , as he sails around Africa on a four - month trek .

source_bert_toks: it was one of the bag ##ful of jokes that friends had given alan , 50 , of henley , ox ##on , as he sails around africa on a four - month trek .

reference_raw: It was one of the many jokes my friends had given Alan, fifty, from Henley, Oxon, when he sailed across Africa for four months.

reference_spacy_tokens: It was one of the many jokes my friends had given Alan , fifty , from Henley , Oxon , when he sailed across Africa for four months .


fn_spacy_tokens_for_baseline: He did not wear them : they were nailed to the scenery above where he sat , like an immense butterfly impaled against the wood .

source_bert_toks: he did not wear them : they were nailed to the scenery above where he sat , like an immense butterfly imp ##ale ##d against the wood .

reference_raw: He didn't wear them: they were pinned to the scenery above where he sat, like a giant butterfly impaled on a wood.

reference_spacy_tokens: He did n't wear them : they were pinned to the scenery above where he sat , like a giant butterfly impaled on a wood .


fn_spacy_tokens_for_baseline: There are also ferries to Discovery Bay .

source_bert_toks: there are also ferries to discovery bay .

reference_raw: There's a ferry to Discovery Cove, too.

reference_spacy_tokens: There 's a ferry to Discovery Cove , too .


fn_spacy_tokens_for_baseline: Her black hat with the little veil had gone from the shelf , and her best peep - toe shoes .

source_bert_toks: her black hat with the little veil had gone from the shelf , and her best pee ##p - toe shoes .

reference_raw: Her black hat, with a small veil, was off the shelf and her best peep-toe boots.

reference_spacy_tokens: Her black hat , with a small veil , was off the shelf and her best peep - toe boots .


fn_spacy_tokens_for_baseline: Talk of the Trade : Battle to rule the air waves

source_bert_toks: talk of the trade : battle to rule the air waves

reference_raw: I'm talking about business: the battle to control the airwaves

reference_spacy_tokens: I 'm talking about business : the battle to control the airwaves


fn_spacy_tokens_for_baseline: I had to jump to the cage attached to the crane as my feet were now tied together , the man in the cage checked everything once more and then we were off .

source_bert_toks: i had to jump to the cage attached to the crane as my feet were now tied together , the man in the cage checked everything once more and then we were off .

reference_raw: I had to jump to the cage attached to the crane when my legs were fastened together, and the man in the cage checked everything again, and then we were gone.

reference_spacy_tokens: I had to jump to the cage attached to the crane when my legs were fastened together , and the man in the cage checked everything again , and then we were gone .


fn_spacy_tokens_for_baseline: This series restores to the catalogue a number of outstanding performances by the pianist Michel Beroff .

source_bert_toks: this series restore ##s to the catalogue a number of outstanding performances by the pianist michel be ##ro ##ff .

reference_raw: This series will restore a number of excellent performances from the piano player Michel Beroff to the catalogue.

reference_spacy_tokens: This series will restore a number of excellent performances from the piano player Michel Beroff to the catalogue .


fn_spacy_tokens_for_baseline: It really was scary -- I kid you not .

source_bert_toks: it really was scary - - i kid you not .

reference_raw: It was really scary -- I'm joking you don't.

reference_spacy_tokens: It was really scary -- I 'm joking you do n't .


fn_spacy_tokens_for_baseline: Constructed in wood , brick , stone , ceramic , and bronze , this is a work of extravagant beauty , uniting many ancient art forms .

source_bert_toks: constructed in wood , brick , stone , ceramic , and bronze , this is a work of extravagant beauty , uniting many ancient art forms .

reference_raw: Constructed in wood, brick, stone, ceramic, and bronze, it is a work of extraordinary beauty that combines many ancient forms of art.

reference_spacy_tokens: Constructed in wood , brick , stone , ceramic , and bronze , it is a work of extraordinary beauty that combines many ancient forms of art .


fn_spacy_tokens_for_baseline: The last was more fortunate .

source_bert_toks: the last was more fortunate .

reference_raw: The last one was luckier.

reference_spacy_tokens: The last one was luckier .


fn_spacy_tokens_for_baseline: As a shoal of some other kind of fish swims past , the predatory trumpet fish moves into their midst and progresses with them as they make their way around the coral gardens .

source_bert_toks: as a sho ##al of some other kind of fish swim ##s past , the predatory trumpet fish moves into their midst and progresses with them as they make their way around the coral gardens .

reference_raw: As a shallow of some other species swims by, the predatory trumpet fish moves between them and advances with them as they pass through the coral gardens.

reference_spacy_tokens: As a shallow of some other species swims by , the predatory trumpet fish moves between them and advances with them as they pass through the coral gardens .


fn_spacy_tokens_for_baseline: Because these freshmen placed far more emphasis on their partisan role -- spreading the Reagan revolution -- in national policy making , they were more vulnerable to defeat .

source_bert_toks: because these freshmen placed far more emphasis on their partisan role - - spreading the reagan revolution - - in national policy making , they were more vulnerable to defeat .

reference_raw: Because these freshmen put much more emphasis on their guerrilla role - the spread of the Reagan Revolution - in national politics, they were more vulnerable to defeat.

reference_spacy_tokens: Because these freshmen put much more emphasis on their guerrilla role - the spread of the Reagan Revolution - in national politics , they were more vulnerable to defeat .


fn_spacy_tokens_for_baseline: The nuances are often quite subtle , but the following example shows how the press is trying to construct a sex maniac , while the police seem to be thinking more on the lines of an abductor without sexual assault necessarily being involved .

source_bert_toks: the nu ##ances are often quite subtle , but the following example shows how the press is trying to construct a sex mania ##c , while the police seem to be thinking more on the lines of an abd ##uc ##tor without sexual assault necessarily being involved .

reference_raw: The nuances are often very subtle, but the following example shows how the press is trying to build a sex maniac, while the police seem to think more about the kidnappers' lines without the need for sexual assault.

reference_spacy_tokens: The nuances are often very subtle , but the following example shows how the press is trying to build a sex maniac , while the police seem to think more about the kidnappers ' lines without the need for sexual assault .


fn_spacy_tokens_for_baseline: It was strange that an impulsive , warm person could be such a calculating lover .

source_bert_toks: it was strange that an imp ##ulsive , warm person could be such a calculating lover .

reference_raw: It was odd that an impulsive, warm man could be such a calculating mistress.

reference_spacy_tokens: It was odd that an impulsive , warm man could be such a calculating mistress .


fn_spacy_tokens_for_baseline: Her tweed skirt was soaking and its friction rubbed sore patches behind her knees .

source_bert_toks: her tweed skirt was soaking and its friction rubbed sore patches behind her knees .

reference_raw: Her tweed skirt was wet, and her friction rubbed the sore patches behind her knees.

reference_spacy_tokens: Her tweed skirt was wet , and her friction rubbed the sore patches behind her knees .


fn_spacy_tokens_for_baseline: Those crimes that ' self - evidently warrant state intervention ' I shall refer to throughout as ' traditional crimes ' .

source_bert_toks: those crimes that ' self - evidently warrant state intervention ' i shall refer to throughout as ' traditional crimes ' .

reference_raw: These crimes that "evidently justify state intervention" I call "traditional crimes" throughout the world.

reference_spacy_tokens: These crimes that " evidently justify state intervention " I call " traditional crimes " throughout the world .


fn_spacy_tokens_for_baseline: Initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

source_bert_toks: initial calls said that many animals were inside the house and firefighters quickly worked to rescue all the cats and dogs .

reference_raw: Initial calls said there were a lot of animals in the house, and firemen were working fast to save all the cats and dogs.

reference_spacy_tokens: Initial calls said there were a lot of animals in the house , and firemen were working fast to save all the cats and dogs .


fn_spacy_tokens_for_baseline: Terrified children were led outside in their costumes away from the poisonous fumes .

source_bert_toks: terrified children were led outside in their costumes away from the poisonous fu ##mes .

reference_raw: The frightened children were taken out in their suits, away from the poisonous fumes.

reference_spacy_tokens: The frightened children were taken out in their suits , away from the poisonous fumes .


fn_spacy_tokens_for_baseline: ' I can only express the hope that you 've not endangered your niece 's life by such behaviour . '

source_bert_toks: ' i can only express the hope that you ' ve not endangered your niece ' s life by such behaviour . '

reference_raw: "I can only express the hope that this behavior didn't put your niece's life in jeopardy."

reference_spacy_tokens: " I can only express the hope that this behavior did n't put your niece 's life in jeopardy . "


fn_spacy_tokens_for_baseline: With rucksacks on their shoulders and clutching their weapons , the group of desperadoes trudged up the main coast road , clearly silhouetted by the headlamps of passing enemy traffic .

source_bert_toks: with ru ##cks ##ack ##s on their shoulders and clutching their weapons , the group of des ##per ##ado ##es tr ##udged up the main coast road , clearly silhouette ##d by the head ##lam ##ps of passing enemy traffic .

reference_raw: A group of desperadoes, with packs on their shoulders and weapons in their hands, trudged along the main coast road, clearly shadowed by the headlights of the passing enemy traffic.

reference_spacy_tokens: A group of desperadoes , with packs on their shoulders and weapons in their hands , trudged along the main coast road , clearly shadowed by the headlights of the passing enemy traffic .


fn_spacy_tokens_for_baseline: I call it luck , but it would not have come my way had I not been looking out for it .

source_bert_toks: i call it luck , but it would not have come my way had i not been looking out for it .

reference_raw: I say it's luck, but it wouldn't have happened if I hadn't taken care of it.

reference_spacy_tokens: I say it 's luck , but it would n't have happened if I had n't taken care of it .


fn_spacy_tokens_for_baseline: ' We played good football and created chances galore on Friday .

source_bert_toks: ' we played good football and created chances gal ##ore on friday .

reference_raw: 'On Friday, we played a good soccer game and created a chance gallery.

reference_spacy_tokens: ' On Friday , we played a good soccer game and created a chance gallery .


fn_spacy_tokens_for_baseline: Ceri Marsden , 17 , sat the exams before going on a family trip to Cyprus where she and her sister Sian , 14 , died in the crash .

source_bert_toks: ce ##ri marsden , 17 , sat the exams before going on a family trip to cyprus where she and her sister si ##an , 14 , died in the crash .

reference_raw: Ceri Marsden, 17, took the tests before going on a family trip to Cyprus, where she and her sister Sian, 14, died in an accident.

reference_spacy_tokens: Ceri Marsden , 17 , took the tests before going on a family trip to Cyprus , where she and her sister Sian , 14 , died in an accident .


fn_spacy_tokens_for_baseline: From a power base in Anatolia , the Persians overran the eastern Aegean Islands and set their sights on the Cyclades .

source_bert_toks: from a power base in anatolia , the persians over ##ran the eastern aegean islands and set their sights on the cy ##cl ##ades .

reference_raw: From the power base in Anatolia, the Persians crossed the East Aegean Islands and set eyes on the Cyclades.

reference_spacy_tokens: From the power base in Anatolia , the Persians crossed the East Aegean Islands and set eyes on the Cyclades .


fn_spacy_tokens_for_baseline: The occasional cry of gulls and unexpected distant vistas will remind you that Dublin is by the sea , and the Wicklow mountains , which hold Dublin closely to the coast , are visible from everywhere .

source_bert_toks: the occasional cry of gu ##lls and unexpected distant vista ##s will remind you that dublin is by the sea , and the wi ##ck ##low mountains , which hold dublin closely to the coast , are visible from everywhere .

reference_raw: The occasional scream of gulls and sudden distant vistas will remind you that Dublin is at sea and that the Wicklow Mountains, which hold Dublin close to the shore, can be seen everywhere.

reference_spacy_tokens: The occasional scream of gulls and sudden distant vistas will remind you that Dublin is at sea and that the Wicklow Mountains , which hold Dublin close to the shore , can be seen everywhere .


fn_spacy_tokens_for_baseline: The traditional Qing Dynasty style of the mansion is enlivened by a few Western touches : a Baroque - style ceiling and stained glass above the doorways , showing the builder 's up - to - date attitude at the time of construction .

source_bert_toks: the traditional qing dynasty style of the mansion is en ##li ##ven ##ed by a few western touches : a baroque - style ceiling and stained glass above the doorway ##s , showing the builder ' s up - to - date attitude at the time of construction .

reference_raw: A few Western touches enlive the traditional Qing Dynasty style of the mansion: a baroque-style ceiling and stained window above the door, showing the builder's up-to-date attitude at the time of construction.

reference_spacy_tokens: A few Western touches enlive the traditional Qing Dynasty style of the mansion : a baroque - style ceiling and stained window above the door , showing the builder 's up - to - date attitude at the time of construction .


fn_spacy_tokens_for_baseline: One experiment conducted by the Rumbaughs took the following form .

source_bert_toks: one experiment conducted by the rum ##bau ##gh ##s took the following form .

reference_raw: One of the Rumbaugh attempts took the following form.

reference_spacy_tokens: One of the Rumbaugh attempts took the following form .


fn_spacy_tokens_for_baseline: A Second Century Society response card and return envelope are enclosed .

source_bert_toks: a second century society response card and return envelope are enclosed .

reference_raw: The second century company response card and return envelope are attached.

reference_spacy_tokens: The second century company response card and return envelope are attached .


fn_spacy_tokens_for_baseline: ' I 'm not sure , ' Luce admitted , fingering her locket .

source_bert_toks: ' i ' m not sure , ' luce admitted , finger ##ing her locke ##t .

reference_raw: 'I don't know,' said Luce, fingering the medallion.

reference_spacy_tokens: ' I do n't know , ' said Luce , fingering the medallion .


fn_spacy_tokens_for_baseline: It is hard to believe that this 8,000 acre agricultural estate owned by the Crown was once a small mid - river sandbank often submerged by spring tides .

source_bert_toks: it is hard to believe that this 8 , 000 acre agricultural estate owned by the crown was once a small mid - river sand ##bank often submerged by spring tides .

reference_raw: It is hard to believe that this 8,000-acre farmhouse, owned by the Crown, was once a small, in the middle of a river of sand, often submerged by spring tides.

reference_spacy_tokens: It is hard to believe that this 8,000-acre farmhouse , owned by the Crown , was once a small , in the middle of a river of sand , often submerged by spring tides .


fn_spacy_tokens_for_baseline: This guided walk , led by Ivan Hall , will include the carvings of the Minster and many of the musical instruments depicted .

source_bert_toks: this guided walk , led by ivan hall , will include the carvings of the min ##ster and many of the musical instruments depicted .

reference_raw: This guided walk, led by Ivan Hall, will include the minster's carvings and many of the musical instruments displayed.

reference_spacy_tokens: This guided walk , led by Ivan Hall , will include the minster 's carvings and many of the musical instruments displayed .


fn_spacy_tokens_for_baseline: One of the children pawed at my lap , as if returning my attention to the lady on the velvet throne .

source_bert_toks: one of the children paw ##ed at my lap , as if returning my attention to the lady on the velvet throne .

reference_raw: One of the children patted me in the lap, as if I were returning my attention to the lady on the velvet throne.

reference_spacy_tokens: One of the children patted me in the lap , as if I were returning my attention to the lady on the velvet throne .


fn_spacy_tokens_for_baseline: ' They were very polite while I was here with them , but they must have boiled and fumed with indignation when they left me , ' he said , chuckling .

source_bert_toks: ' they were very polite while i was here with them , but they must have boiled and fu ##med with ind ##ign ##ation when they left me , ' he said , chuck ##ling .

reference_raw: "They were very polite when I was with them, but when they left me, they must have boiled and smothered with outrage," he said with a laugh.

reference_spacy_tokens: " They were very polite when I was with them , but when they left me , they must have boiled and smothered with outrage , " he said with a laugh .


fn_spacy_tokens_for_baseline: When she was alone on the terrace , she found herself staring fixedly at a cockroach as it scuttled around in the heat , then got up and hammered it to death with her shoe .

source_bert_toks: when she was alone on the terrace , she found herself staring fixed ##ly at a cock ##ro ##ach as it sc ##ut ##tled around in the heat , then got up and hammered it to death with her shoe .

reference_raw: When she was alone on the terrace, she found herself staring at the cockroach as it scuttled in the heat, then stood up and pounded it to death with her boot.

reference_spacy_tokens: When she was alone on the terrace , she found herself staring at the cockroach as it scuttled in the heat , then stood up and pounded it to death with her boot .


fn_spacy_tokens_for_baseline: Beyond the perimeter wall ran a vein of the Bradford Beck , its filthy waters gurgling below ground before breaking free for some distance to pass Old Ashfield 's wooded hillside .

source_bert_toks: beyond the perimeter wall ran a vein of the bradford beck , its filthy waters gu ##rg ##ling below ground before breaking free for some distance to pass old ash ##field ' s wooded hillside .

reference_raw: Behind the perimeter wall was Bradford Beck's vein, its dirty water gushing beneath the ground before breaking free for a while to pass the forested slopes of Old Ashfield.

reference_spacy_tokens: Behind the perimeter wall was Bradford Beck 's vein , its dirty water gushing beneath the ground before breaking free for a while to pass the forested slopes of Old Ashfield .


fn_spacy_tokens_for_baseline: ' Hard to believe that this much litter could be caused by a few inebriated louts . '

source_bert_toks: ' hard to believe that this much litter could be caused by a few in ##eb ##riated lou ##ts . '

reference_raw: "It's hard to believe a couple of drunken bitches could cause so much litter."

reference_spacy_tokens: " It 's hard to believe a couple of drunken bitches could cause so much litter . "


fn_spacy_tokens_for_baseline: She looked out of the window but hardly seemed to register what she saw .

source_bert_toks: she looked out of the window but hardly seemed to register what she saw .

reference_raw: She looked out the window, barely seeming to notice what she was seeing.

reference_spacy_tokens: She looked out the window , barely seeming to notice what she was seeing .


fn_spacy_tokens_for_baseline: There was no clue as to whether the malefactor was an outraged royalist , ardent republican , apolitical hooligan or simple souvenir hunter .

source_bert_toks: there was no clue as to whether the male ##fa ##ctor was an outraged royalist , ardent republican , ap ##oli ##tical ho ##oli ##gan or simple so ##uven ##ir hunter .

reference_raw: He had no idea if the male factor was an outraged royalist, ardent Republican, apolitical hooligan, or a simple souvenir hunter.

reference_spacy_tokens: He had no idea if the male factor was an outraged royalist , ardent Republican , apolitical hooligan , or a simple souvenir hunter .


fn_spacy_tokens_for_baseline: Winston Smith , his chin nuzzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of Victory Mansions , though not quickly enough to prevent a swirl of gritty dust from entering along with him .

source_bert_toks: winston smith , his chin nu ##zzled into his breast in an effort to escape the vile wind , slipped quickly through the glass doors of victory mansions , though not quickly enough to prevent a swirl of grit ##ty dust from entering along with him .

reference_raw: Winston Smith, his chin thrust into his chest in an attempt to escape the foul wind, slipped quickly through the glass doors of the Victory Mansions, but not quickly enough to prevent a swirl of gritty dust from entering with him.

reference_spacy_tokens: Winston Smith , his chin thrust into his chest in an attempt to escape the foul wind , slipped quickly through the glass doors of the Victory Mansions , but not quickly enough to prevent a swirl of gritty dust from entering with him .


fn_spacy_tokens_for_baseline: ' I 'm not cold , ' he said shortly , bending to unwind the thongs from his boots .

source_bert_toks: ' i ' m not cold , ' he said shortly , bending to un ##wind the thong ##s from his boots .

reference_raw: "I don't feel cold," he said shortly, bending to pull the straps out of his shoes.

reference_spacy_tokens: " I do n't feel cold , " he said shortly , bending to pull the straps out of his shoes .


fn_spacy_tokens_for_baseline: In 1996 , it held the first regional seminar on the national implementation of the CWC in Tehran so that government authorities could familiarize themselves with their duties and obligations under the treaty .

source_bert_toks: in 1996 , it held the first regional seminar on the national implementation of the cw ##c in tehran so that government authorities could familiar ##ize themselves with their duties and obligations under the treaty .

reference_raw: In 1996, it organised a first local seminar on the national implementation of the Convention in Tehran in order to enable the public authorities to become aware of their obligations and obligations under the Treaty.

reference_spacy_tokens: In 1996 , it organised a first local seminar on the national implementation of the Convention in Tehran in order to enable the public authorities to become aware of their obligations and obligations under the Treaty .


fn_spacy_tokens_for_baseline: I said flinging a pillow at his gaping maw .

source_bert_toks: i said fling ##ing a pillow at his gaping ma ##w .

reference_raw: I told you to throw a pillow at his gaping mouth.

reference_spacy_tokens: I told you to throw a pillow at his gaping mouth .


fn_spacy_tokens_for_baseline: A PEDESTRIANISATION scheme which has angered disabled groups in Darlington is to come into force from March 29 .

source_bert_toks: a pedestrian ##isation scheme which has angered disabled groups in darlington is to come into force from march 29 .

reference_raw: The PEDESTRIANISATION Programme that has upset disabled groups in Darlington will enter into force on March 29th.

reference_spacy_tokens: The PEDESTRIANISATION Programme that has upset disabled groups in Darlington will enter into force on March 29th .


fn_spacy_tokens_for_baseline: There are several good vantage places from which to see the falls .

source_bert_toks: there are several good vantage places from which to see the falls .

reference_raw: There are a few good vantage points where you can see the waterfalls.

reference_spacy_tokens: There are a few good vantage points where you can see the waterfalls .


fn_spacy_tokens_for_baseline: Take shooters with you , I think you 'll need them .

source_bert_toks: take shooters with you , i think you ' ll need them .

reference_raw: Take the guns with you, I think you're going to need them.

reference_spacy_tokens: Take the guns with you , I think you 're going to need them .


fn_spacy_tokens_for_baseline: Mr Williams was walking in the countryside , listening for odd songs , looking for that magic to be found in a new song .

source_bert_toks: mr williams was walking in the countryside , listening for odd songs , looking for that magic to be found in a new song .

reference_raw: Mr. Williams walked around the countryside, hearing strange songs, looking for the magic to be found in a new song.

reference_spacy_tokens: Mr. Williams walked around the countryside , hearing strange songs , looking for the magic to be found in a new song .


fn_spacy_tokens_for_baseline: The highway and the railway stay close together from Fanling , site of the best golf courses in the area .

source_bert_toks: the highway and the railway stay close together from fan ##ling , site of the best golf courses in the area .

reference_raw: Highway and railroad are close to Fanling, where the best golf courses in the area are located.

reference_spacy_tokens: Highway and railroad are close to Fanling , where the best golf courses in the area are located .


fn_spacy_tokens_for_baseline: Toxins -- nonliving poisons produced by living plants , insects , and animals -- are in a gray area between CW and BW agents .

source_bert_toks: toxin ##s - - non ##li ##ving poison ##s produced by living plants , insects , and animals - - are in a gray area between cw and b ##w agents .

reference_raw: The poisons - non-life poisons produced by living plants, insects, and animals - are in the grey area between CW and BW agents.

reference_spacy_tokens: The poisons - non - life poisons produced by living plants , insects , and animals - are in the grey area between CW and BW agents .


fn_spacy_tokens_for_baseline: It was his second try at the London event , where he first ran in 1981 , and he was pleased with his performance .

source_bert_toks: it was his second try at the london event , where he first ran in 1981 , and he was pleased with his performance .

reference_raw: It was his second attempt at the London event, where he ran for the first time in 1981, and he was pleased with his performance.

reference_spacy_tokens: It was his second attempt at the London event , where he ran for the first time in 1981 , and he was pleased with his performance .


fn_spacy_tokens_for_baseline: Object Design UK is headed up by managing director , James Beagle .

source_bert_toks: object design uk is headed up by managing director , james bea ##gle .

reference_raw: Object Design UK is led by the CEO, James Beagle.

reference_spacy_tokens: Object Design UK is led by the CEO , James Beagle .


fn_spacy_tokens_for_baseline: In 1855 , Mormon leader Brigham Young responded to promising reports of Las Vegas by sending 30 missionary settlers to the valley ; they eventually built a fort not far from today 's Downtown .

source_bert_toks: in 1855 , mormon leader brigham young responded to promising reports of las vegas by sending 30 missionary settlers to the valley ; they eventually built a fort not far from today ' s downtown .

reference_raw: In 1855, the Mormon leader, Brigham Young, responded to the promising news of Las Vegas by sending 30 missionary colonists into the valley, eventually building a fortress not far from today's Downtown.

reference_spacy_tokens: In 1855 , the Mormon leader , Brigham Young , responded to the promising news of Las Vegas by sending 30 missionary colonists into the valley , eventually building a fortress not far from today 's Downtown .


fn_spacy_tokens_for_baseline: There are many package tours to Guangzhou from Hong Kong ( see page 113 ) , and this may be the easiest way to visit the city .

source_bert_toks: there are many package tours to guangzhou from hong kong ( see page 113 ) , and this may be the easiest way to visit the city .

reference_raw: There are many package trips from Hong Kong to Guangzhou (see page 113) and this may be the easiest way to visit the city.

reference_spacy_tokens: There are many package trips from Hong Kong to Guangzhou ( see page 113 ) and this may be the easiest way to visit the city .


fn_spacy_tokens_for_baseline: None of these religions has satisfied its real purpose , which is to provide fully acceptable and uncontentious guidance in human discrimination between right and wrong , and in the behaviour that should stem from that discrimination .

source_bert_toks: none of these religions has satisfied its real purpose , which is to provide fully acceptable and un ##con ##ten ##tious guidance in human discrimination between right and wrong , and in the behaviour that should stem from that discrimination .

reference_raw: None of these religions has fulfilled its true purpose, which is to provide fully acceptable and uncontested guidance in the area of human discriminates between rights and wrongs, and in the manner in which they should be based.

reference_spacy_tokens: None of these religions has fulfilled its true purpose , which is to provide fully acceptable and uncontested guidance in the area of human discriminates between rights and wrongs , and in the manner in which they should be based .


fn_spacy_tokens_for_baseline: On Saturday , a U. S. F-15E went down in eastern Afghanistan , killing its two - member crew , and on Sunday a Russian - made helicopter carrying civilian contractors crashed just after lifting off from Kandahar airfield .

source_bert_toks: on saturday , a u . s . f - 15 ##e went down in eastern afghanistan , killing its two - member crew , and on sunday a russian - made helicopter carrying civilian contractors crashed just after lifting off from kan ##dah ##ar airfield .

reference_raw: A U.S.F-15E hit East Afghanistan on Saturday, killing its two-man crew, and on Sunday, a Russian-made helicopter carrying civilian contractors crashed just after leaving Kandahar airport.

reference_spacy_tokens: A U.S.F-15E hit East Afghanistan on Saturday , killing its two - man crew , and on Sunday , a Russian - made helicopter carrying civilian contractors crashed just after leaving Kandahar airport .


fn_spacy_tokens_for_baseline: Opulent , old - fashioned theaters such as those in Cienfuegos , Camaguey , and Matanzas , not to mention Havana 's magnificent Gran Teatro , are sights in their own right .

source_bert_toks: op ##ulent , old - fashioned theaters such as those in ci ##en ##fu ##ego ##s , cam ##ag ##ue ##y , and mata ##nza ##s , not to mention havana ' s magnificent gran teatro , are sights in their own right .

reference_raw: Opulent, old-fashioned theaters like the ones in Cienfuegos, Camaguey, and Matanzas, not to mention Havana's magnificent Gran Teatro, are a spectacle of their own.

reference_spacy_tokens: Opulent , old - fashioned theaters like the ones in Cienfuegos , Camaguey , and Matanzas , not to mention Havana 's magnificent Gran Teatro , are a spectacle of their own .


fn_spacy_tokens_for_baseline: you know with the stuff and let it marinade over night and then just strain out you know the juice and um

source_bert_toks: you know with the stuff and let it marina ##de over night and then just strain out you know the juice and um

reference_raw: you know what to do with it and make it marinade at night, and then you're just stressing out that you know what's juicy and, uh,

reference_spacy_tokens: you know what to do with it and make it marinade at night , and then you 're just stressing out that you know what 's juicy and , uh ,


fn_spacy_tokens_for_baseline: She threw it down in disgust and took a drum which Corrie showed no inclination to use , thumping it furiously to express her feelings .

source_bert_toks: she threw it down in disgust and took a drum which co ##rrie showed no inclination to use , thumping it furiously to express her feelings .

reference_raw: She dropped it in disgust and took a drum Corrie didn't have a tendency to use, pounding it furiously to express her feelings.

reference_spacy_tokens: She dropped it in disgust and took a drum Corrie did n't have a tendency to use , pounding it furiously to express her feelings .


fn_spacy_tokens_for_baseline: I enclose an up - to - date CV for your perusal .

source_bert_toks: i en ##cl ##ose an up - to - date cv for your peru ##sal .

reference_raw: I'm enclosing a state-of-the-art CV for your persuasion.

reference_spacy_tokens: I 'm enclosing a state - of - the - art CV for your persuasion .


fn_spacy_tokens_for_baseline: Such images , it may be surmised , were not well received by the nobility , who continued to commission portraits of conventionally austere appearance .

source_bert_toks: such images , it may be sur ##mise ##d , were not well received by the nobility , who continued to commission portraits of conventional ##ly aus ##ter ##e appearance .

reference_raw: It can be assumed that such images were not well received by the nobles who continued to commission portraits of traditionally austere appearances.

reference_spacy_tokens: It can be assumed that such images were not well received by the nobles who continued to commission portraits of traditionally austere appearances .


fn_spacy_tokens_for_baseline: The Prime Minister , who was asked to comment on reports that employers had resorted to terminating workers without any notice , described retrenchment in Malaysia as not serious and limited to certain groups of people .

source_bert_toks: the prime minister , who was asked to comment on reports that employers had resort ##ed to terminating workers without any notice , described re ##tre ##nch ##ment in malaysia as not serious and limited to certain groups of people .

reference_raw: The Prime Minister, who had been asked to comment on reports that employers had resorted to the termination of workers without notice, described the withdrawal in Malaysia as non-serious and limited to certain groups of people.

reference_spacy_tokens: The Prime Minister , who had been asked to comment on reports that employers had resorted to the termination of workers without notice , described the withdrawal in Malaysia as non - serious and limited to certain groups of people .


fn_spacy_tokens_for_baseline: Sarah was watching the chimneysweeps with a rapt expression , and holding the hands of two small boys , while one a bit older had to be reprimanded for trying to climb a tree .

source_bert_toks: sarah was watching the chimneys ##wee ##ps with a rap ##t expression , and holding the hands of two small boys , while one a bit older had to be rep ##rim ##and ##ed for trying to climb a tree .

reference_raw: Sarah watched the chimneys with a rapt expression, holding the hands of two little boys, and one a little older had to be blamed for trying to climb a tree.

reference_spacy_tokens: Sarah watched the chimneys with a rapt expression , holding the hands of two little boys , and one a little older had to be blamed for trying to climb a tree .


fn_spacy_tokens_for_baseline: Then , not a week later , one of the ploughing bulls seemed to be ailing .

source_bert_toks: then , not a week later , one of the pl ##ough ##ing bulls seemed to be ai ##ling .

reference_raw: Then, less than a week later, one of the ploughing bulls seemed to be sick.

reference_spacy_tokens: Then , less than a week later , one of the ploughing bulls seemed to be sick .


fn_spacy_tokens_for_baseline: Nettled , I explained that I have what is known as an angular form , and this apparently makes me an entertaining subject .

source_bert_toks: net ##tled , i explained that i have what is known as an angular form , and this apparently makes me an entertaining subject .

reference_raw: Nettled, I explained that I have what's called an square form, and that seems to make me a fun subject.

reference_spacy_tokens: Nettled , I explained that I have what 's called an square form , and that seems to make me a fun subject .


fn_spacy_tokens_for_baseline: Remember -- making a Covenant to UNICEF costs you nothing extra , but it means a lot -- perhaps even the difference between life and death -- to the children of the world .

source_bert_toks: remember - - making a covenant to unicef costs you nothing extra , but it means a lot - - perhaps even the difference between life and death - - to the children of the world .

reference_raw: Remember, making a treaty with UNICEF cost you nothing more, but it means a lot to the children of the world, perhaps the difference between life and death.

reference_spacy_tokens: Remember , making a treaty with UNICEF cost you nothing more , but it means a lot to the children of the world , perhaps the difference between life and death .


fn_spacy_tokens_for_baseline: Hayek 's epistemological views have certain similarities to those of Oakeshott .

source_bert_toks: hay ##ek ' s ep ##iste ##mo ##logical views have certain similarities to those of oak ##esh ##ott .

reference_raw: Hayek's epistemological views are similar to Oakeshott's.

reference_spacy_tokens: Hayek 's epistemological views are similar to Oakeshott 's .


fn_spacy_tokens_for_baseline: ' I telegraphed the command to proceed . '

source_bert_toks: ' i telegraph ##ed the command to proceed . '

reference_raw: "I've wired the order to continue."

reference_spacy_tokens: " I 've wired the order to continue . "


fn_spacy_tokens_for_baseline: ' I was wondering , ' said Evelyn , ' if you 'd like to swap with me and let me have a chance to go under the machines . '

source_bert_toks: ' i was wondering , ' said evelyn , ' if you ' d like to swap with me and let me have a chance to go under the machines . '

reference_raw: "I wonder," Evelyn said, "if you'd like to trade with me and give me a chance to get under the machines."

reference_spacy_tokens: " I wonder , " Evelyn said , " if you 'd like to trade with me and give me a chance to get under the machines . "


fn_spacy_tokens_for_baseline: ' Why a Tudor princeling did , ' she crowed .

source_bert_toks: ' why a tudor prince ##ling did , ' she crowe ##d .

reference_raw: 'Why did the Prince of Tudor do that,' she croaked.

reference_spacy_tokens: ' Why did the Prince of Tudor do that , ' she croaked .


fn_spacy_tokens_for_baseline: Even when common goals have been established , conflict may be generated during the planning process because of disagreement about the way in which these goals should be achieved .

source_bert_toks: even when common goals have been established , conflict may be generated during the planning process because of disagreement about the way in which these goals should be achieved .

reference_raw: Even if common objectives are set, conflicts can arise during the planning process due to differences in the way in which these objectives are to be achieved.

reference_spacy_tokens: Even if common objectives are set , conflicts can arise during the planning process due to differences in the way in which these objectives are to be achieved .


fn_spacy_tokens_for_baseline: Also dust them with a fungicide such as green or yellow sulphur before storing .

source_bert_toks: also dust them with a fungi ##cide such as green or yellow sul ##ph ##ur before storing .

reference_raw: They should also be powdered with fungicide, e.g. green or yellow sulfur before storage.

reference_spacy_tokens: They should also be powdered with fungicide , e.g. green or yellow sulfur before storage .