fn_spacy_tokens_for_baseline: If at any point they lose the scent they fly in zig - zags from side to side until they catch it again , and then fly off upwind again .

source_bert_toks: if at any point they lose the scent they fly in z ##ig - za ##gs from side to side until they catch it again , and then fly off up ##wind again .

reference_raw: If they lose their scent at any moment, they're going from side to side in zig-zags until they catch it again, and then they're going upwind again.

reference_spacy_tokens: If they lose their scent at any moment , they 're going from side to side in zig - zags until they catch it again , and then they 're going upwind again .


fn_spacy_tokens_for_baseline: There was no immediate response from Indian officials to Ayala - Lasso 's remarks .

source_bert_toks: there was no immediate response from indian officials to a ##yala - lass ##o ' s remarks .

reference_raw: Indian officials did not respond immediately to Ayala-Lasso's remarks.

reference_spacy_tokens: Indian officials did not respond immediately to Ayala - Lasso 's remarks .


fn_spacy_tokens_for_baseline: Another exciting prospect for diesel economy in even smaller cars is the diesel two - stroke .

source_bert_toks: another exciting prospect for diesel economy in even smaller cars is the diesel two - stroke .

reference_raw: Another interesting prospect of a diesel economy in even smaller cars is a two-stroke diesel engine.

reference_spacy_tokens: Another interesting prospect of a diesel economy in even smaller cars is a two - stroke diesel engine .


fn_spacy_tokens_for_baseline: Identification of the new muscle proteins was made possible by fusing human cells with mouse muscle cells ; the human muscle proteins are similar but distinct from those made by mice .

source_bert_toks: identification of the new muscle proteins was made possible by fu ##sing human cells with mouse muscle cells ; the human muscle proteins are similar but distinct from those made by mice .

reference_raw: The identification of new muscle proteins has been facilitated by the fusion of human cells with mouse muscle cells; human muscle proteins are similar but different from those produced by mice.

reference_spacy_tokens: The identification of new muscle proteins has been facilitated by the fusion of human cells with mouse muscle cells ; human muscle proteins are similar but different from those produced by mice .


fn_spacy_tokens_for_baseline: This involved the felon having his limbs shattered by iron bars , inflicting excruciating agony until death ensued .

source_bert_toks: this involved the fe ##lon having his limbs shattered by iron bars , in ##flict ##ing ex ##cr ##uc ##iating agony until death ensued .

reference_raw: This involved a criminal whose limbs were broken by iron bars, causing excruciating pain until death followed.

reference_spacy_tokens: This involved a criminal whose limbs were broken by iron bars , causing excruciating pain until death followed .


fn_spacy_tokens_for_baseline: One of Nogai 's brothers shouted something in Yek and everybody laughed .

source_bert_toks: one of no ##gai ' s brothers shouted something in ye ##k and everybody laughed .

reference_raw: One of Nogai's brothers cried out in Yek, and they all laughed.

reference_spacy_tokens: One of Nogai 's brothers cried out in Yek , and they all laughed .


fn_spacy_tokens_for_baseline: English Heritage is dedicated to preserving it all , not just the properties we currently manage .

source_bert_toks: english heritage is dedicated to preserving it all , not just the properties we currently manage .

reference_raw: The English heritage is dedicated to preserving everything, not just the properties that we now control.

reference_spacy_tokens: The English heritage is dedicated to preserving everything , not just the properties that we now control .


fn_spacy_tokens_for_baseline: Keno is a variation of bingo in which the player chooses numbers to bet on before the draw is made .

source_bert_toks: ken ##o is a variation of bingo in which the player chooses numbers to bet on before the draw is made .

reference_raw: Keno is a bingo variant where the player chooses the numbers to bet on before drawing.

reference_spacy_tokens: Keno is a bingo variant where the player chooses the numbers to bet on before drawing .


fn_spacy_tokens_for_baseline: ' What the hell are you doing ? ' she screamed to the unseen driver as the black vehicle came hurtling towards her once more , this time clipping her offside light .

source_bert_toks: ' what the hell are you doing ? ' she screamed to the unseen driver as the black vehicle came hurt ##ling towards her once more , this time clip ##ping her offs ##ide light .

reference_raw: 'What the hell are you doing?' she shouted to the invisible driver as the black car raced toward her again, cutting off the light this time.

reference_spacy_tokens: ' What the hell are you doing ? ' she shouted to the invisible driver as the black car raced toward her again , cutting off the light this time .


fn_spacy_tokens_for_baseline: ' But I am now more confident in voicing my views . '

source_bert_toks: ' but i am now more confident in vo ##icing my views . '

reference_raw: "But now I'm more sure I can speak my mind."

reference_spacy_tokens: " But now I 'm more sure I can speak my mind . "


fn_spacy_tokens_for_baseline: Classic French cuisine served amid sumptuous Georgian surroundings .

source_bert_toks: classic french cuisine served amid sum ##pt ##uous georgian surroundings .

reference_raw: Classic French cuisine served in the middle of a luxurious Georgian environment.

reference_spacy_tokens: Classic French cuisine served in the middle of a luxurious Georgian environment .


fn_spacy_tokens_for_baseline: Owen Ruddy , who lives near the scene of the crime , described how he was woken from his sleep by the noise .

source_bert_toks: owen rudd ##y , who lives near the scene of the crime , described how he was woken from his sleep by the noise .

reference_raw: Owen Ruddy, who lived close to the crime scene, described how the noise had awakened him from his sleep.

reference_spacy_tokens: Owen Ruddy , who lived close to the crime scene , described how the noise had awakened him from his sleep .


fn_spacy_tokens_for_baseline: I heard later that the Queen was so angry that she refused to enter any of the damaged rooms ever again , and promised to take her revenge on me .

source_bert_toks: i heard later that the queen was so angry that she refused to enter any of the damaged rooms ever again , and promised to take her revenge on me .

reference_raw: I heard later that she was so angry that she refused to go back to any of the damaged rooms, and she promised to avenge me.

reference_spacy_tokens: I heard later that she was so angry that she refused to go back to any of the damaged rooms , and she promised to avenge me .


fn_spacy_tokens_for_baseline: Even after the outline of a farm agreement had been sketched in Washington last November , the Community equivocated with the outgoing administration , which was in a mood for compromise .

source_bert_toks: even after the outline of a farm agreement had been sketch ##ed in washington last november , the community e ##qui ##vo ##cated with the outgoing administration , which was in a mood for compromise .

reference_raw: Even after the outline of the farm contract was drawn up in Washington last November, the Community was in a position to equate with the outgoing government, which was in a mood for compromise.

reference_spacy_tokens: Even after the outline of the farm contract was drawn up in Washington last November , the Community was in a position to equate with the outgoing government , which was in a mood for compromise .


fn_spacy_tokens_for_baseline: She gets overwrought very easily .

source_bert_toks: she gets over ##wr ##ough ##t very easily .

reference_raw: It's very easy to overload.

reference_spacy_tokens: It 's very easy to overload .


fn_spacy_tokens_for_baseline: He twitched his shoulders as if shrugging the burden of Georgina on to the new arrival .

source_bert_toks: he twitched his shoulders as if shrug ##ging the burden of georgina on to the new arrival .

reference_raw: He shrugged, as if shrugging Georgina's burden to the new arrival.

reference_spacy_tokens: He shrugged , as if shrugging Georgina 's burden to the new arrival .


fn_spacy_tokens_for_baseline: In December 2003 , Libya pledged to eliminate ballistic missiles capable of traveling more than 300 km with payloads of 500 kg .

source_bert_toks: in december 2003 , libya pledged to eliminate ballistic missiles capable of traveling more than 300 km with payload ##s of 500 kg .

reference_raw: In December 2003, Libya pledged to eliminate ballistic missiles capable of travelling more than 300 km with a payload of 500 kilograms.

reference_spacy_tokens: In December 2003 , Libya pledged to eliminate ballistic missiles capable of travelling more than 300 km with a payload of 500 kilograms .


fn_spacy_tokens_for_baseline: According to one official , the fire started when ten students lit a bonfire on a ridge but failed to extinguish it .

source_bert_toks: according to one official , the fire started when ten students lit a bonfire on a ridge but failed to ex ##ting ##uis ##h it .

reference_raw: According to one of the officials, the fire started when ten students set a fire on the ridge, but they didn't put it out.

reference_spacy_tokens: According to one of the officials , the fire started when ten students set a fire on the ridge , but they did n't put it out .


fn_spacy_tokens_for_baseline: Dorcas blinked back at her , his mind racing .

source_bert_toks: do ##rca ##s blinked back at her , his mind racing .

reference_raw: Dorcas winked at her, his mind racing.

reference_spacy_tokens: Dorcas winked at her , his mind racing .


fn_spacy_tokens_for_baseline: The eagle plummets --dead from dehydration .

source_bert_toks: the eagle plum ##met ##s - - dead from de ##hy ##dra ##tion .

reference_raw: The eagle falls - dead of dehydration.

reference_spacy_tokens: The eagle falls - dead of dehydration .


fn_spacy_tokens_for_baseline: PROMINENT left - wingers yesterday rebuffed appeals for unity behind Labour 's policy review and accused the party leadership of a calculated effort to stifle grassroot dissent .

source_bert_toks: prominent left - winger ##s yesterday re ##bu ##ffed appeals for unity behind labour ' s policy review and accused the party leadership of a calculated effort to st ##if ##le grass ##ro ##ot dissent .

reference_raw: Last night, PROMINENT left-wingers rejected appeals for unity behind Labour's political review and blamed the party's leadership for a calculated effort to suppress grassroots dissent.

reference_spacy_tokens: Last night , PROMINENT left - wingers rejected appeals for unity behind Labour 's political review and blamed the party 's leadership for a calculated effort to suppress grassroots dissent .


fn_spacy_tokens_for_baseline: ' Oh , is it you , Mr Boldwood ? ' she said , with a guilty blush .

source_bert_toks: ' oh , is it you , mr bold ##wood ? ' she said , with a guilty blush .

reference_raw: "Is that you, Mr. Boldwood?" she asked, blushing guiltily.

reference_spacy_tokens: " Is that you , Mr. Boldwood ? " she asked , blushing guiltily .


fn_spacy_tokens_for_baseline: It believes the figures on this basis give a much fairer picture of business performance and underlying financial strength .

source_bert_toks: it believes the figures on this basis give a much fair ##er picture of business performance and underlying financial strength .

reference_raw: The Commission considers that the figures on this basis provide a much fairer picture of the performance of the undertaking and the underlying financial power.

reference_spacy_tokens: The Commission considers that the figures on this basis provide a much fairer picture of the performance of the undertaking and the underlying financial power .


fn_spacy_tokens_for_baseline: " Only recently have foreign suppliers , in particular Russia and Israel , begun to provide China with relatively sophisticated weapons and technology , " the report says .

source_bert_toks: " only recently have foreign suppliers , in particular russia and israel , begun to provide china with relatively sophisticated weapons and technology , " the report says .

reference_raw: "Only recently have foreign suppliers, especially Russia and Israel, started supplying relatively sophisticated weapons and technology to China," says the report.

reference_spacy_tokens: " Only recently have foreign suppliers , especially Russia and Israel , started supplying relatively sophisticated weapons and technology to China , " says the report .


fn_spacy_tokens_for_baseline: She heard his key in the door , and sat alert .

source_bert_toks: she heard his key in the door , and sat alert .

reference_raw: She heard his key in the door and sat watchful.

reference_spacy_tokens: She heard his key in the door and sat watchful .


fn_spacy_tokens_for_baseline: In the weeks leading up to the anniversary , police had been active throughout Beijing , and there were many reports of dissidents being beaten or detained .

source_bert_toks: in the weeks leading up to the anniversary , police had been active throughout beijing , and there were many reports of di ##ssi ##dents being beaten or detained .

reference_raw: In the weeks before the anniversary, the police were operating all over Beijing, and there were numerous reports that dissidents had been beaten or detained.

reference_spacy_tokens: In the weeks before the anniversary , the police were operating all over Beijing , and there were numerous reports that dissidents had been beaten or detained .


fn_spacy_tokens_for_baseline: Revellers urged to avoid square .

source_bert_toks: rev ##eller ##s urged to avoid square .

reference_raw: Revellers insisted on avoiding the square.

reference_spacy_tokens: Revellers insisted on avoiding the square .


fn_spacy_tokens_for_baseline: The rich permanent collection includes tapestries , furniture , and porcelain , but look out for the fascinating temporary exhibitions that are held here , featuring great styles and eras of design history such as Jugendstil , Bauhaus , and the American 1950s .

source_bert_toks: the rich permanent collection includes tapes ##tries , furniture , and porcelain , but look out for the fascinating temporary exhibitions that are held here , featuring great styles and eras of design history such as jug ##end ##sti ##l , ba ##uh ##aus , and the american 1950s .

reference_raw: The rich permanent collection includes tapestries, furniture, and porcelain, but keep an eye on the fascinating temporary exhibitions that are being held here, the performance of excellent styles and eras of design history, such as Jugendstil, Bauhaus, and the American 1950s.

reference_spacy_tokens: The rich permanent collection includes tapestries , furniture , and porcelain , but keep an eye on the fascinating temporary exhibitions that are being held here , the performance of excellent styles and eras of design history , such as Jugendstil , Bauhaus , and the American 1950s .


fn_spacy_tokens_for_baseline: All residents were ordered to take the main highway to Athens .

source_bert_toks: all residents were ordered to take the main highway to athens .

reference_raw: All inhabitants have been ordered to take the main road to Athens.

reference_spacy_tokens: All inhabitants have been ordered to take the main road to Athens .


fn_spacy_tokens_for_baseline: One symptomatic scene concerned the robbery of a petrol station by a young saxophonist considering a criminal career .

source_bert_toks: one sy ##mpt ##oma ##tic scene concerned the robbery of a petrol station by a young saxophonist considering a criminal career .

reference_raw: One of the symptomatic scenes was the theft of a gas station by a young saxophonist considering a criminal career.

reference_spacy_tokens: One of the symptomatic scenes was the theft of a gas station by a young saxophonist considering a criminal career .


fn_spacy_tokens_for_baseline: I made a new distinction between measurements the demon might make that reveal features of nonequilibrium systems that can be used to extract work , and measurements he might make of the nonequilibrium system that can not be used to extract work .

source_bert_toks: i made a new distinction between measurements the demon might make that reveal features of none ##quil ##ib ##rium systems that can be used to extract work , and measurements he might make of the none ##quil ##ib ##rium system that can not be used to extract work .

reference_raw: I've made a new distinction between measurements that a demon can make that reveal the characteristics of non-quilibrium systems that can be used to extract labor, and measurements that can be made of a non-quilibrium system that can't be used to extract labor.

reference_spacy_tokens: I 've made a new distinction between measurements that a demon can make that reveal the characteristics of non - quilibrium systems that can be used to extract labor , and measurements that can be made of a non - quilibrium system that ca n't be used to extract labor .


fn_spacy_tokens_for_baseline: The tennis shots Segura esteemed in Connors related to balance on the court .

source_bert_toks: the tennis shots se ##gur ##a esteem ##ed in connor ##s related to balance on the court .

reference_raw: Tennis films that Segura respected in Connors had to do with court balance.

reference_spacy_tokens: Tennis films that Segura respected in Connors had to do with court balance .


fn_spacy_tokens_for_baseline: ' Mistress Hussey , ' said the prince as she entered , ' we beg your forgiveness for keeping you waiting a little beyond the time we appointed .

source_bert_toks: ' mistress hu ##sse ##y , ' said the prince as she entered , ' we beg your forgiveness for keeping you waiting a little beyond the time we appointed .

reference_raw: "Mrs. Hussey," the prince said as she entered, "we ask your forgiveness for keeping you waiting a little longer than our appointment.

reference_spacy_tokens: " Mrs. Hussey , " the prince said as she entered , " we ask your forgiveness for keeping you waiting a little longer than our appointment .


fn_spacy_tokens_for_baseline: I foresee that this statement will excite a certain amount of comment .

source_bert_toks: i fore ##see that this statement will ex ##cite a certain amount of comment .

reference_raw: I expect this statement to excite a certain amount of comment.

reference_spacy_tokens: I expect this statement to excite a certain amount of comment .


fn_spacy_tokens_for_baseline: This consisted of pressed bales of waste paper which were chopped , shredded and then steamed , stirred and pulped .

source_bert_toks: this consisted of pressed bal ##es of waste paper which were chopped , shredded and then steamed , stirred and pulp ##ed .

reference_raw: It consisted of pressed bales of waste paper that had been cut, torn and then steamed, stirred and pulped.

reference_spacy_tokens: It consisted of pressed bales of waste paper that had been cut , torn and then steamed , stirred and pulped .


fn_spacy_tokens_for_baseline: The Treaty of Rome does not regard all state subsidies as incompatible with the Common Market ; indeed , subsidies to consumers , and aid to seriously underdeveloped areas , are both regarded as being compatible with Community law .

source_bert_toks: the treaty of rome does not regard all state subsidies as incompatible with the common market ; indeed , subsidies to consumers , and aid to seriously under ##dev ##elo ##ped areas , are both regarded as being compatible with community law .

reference_raw: The Treaty of Rome does not consider all State aid compatible with the common market; indeed, subsidies to consumers and aid to severely underdeveloped areas are considered compatible with Community law.

reference_spacy_tokens: The Treaty of Rome does not consider all State aid compatible with the common market ; indeed , subsidies to consumers and aid to severely underdeveloped areas are considered compatible with Community law .


fn_spacy_tokens_for_baseline: They did n't say where it would be held though it 's thought the Soviet leader will visit Washington from the thirtieth May until June third .

source_bert_toks: they didn ' t say where it would be held though it ' s thought the soviet leader will visit washington from the th ##ir ##tie ##th may until june third .

reference_raw: They didn't say where he was going to be, though they thought the Soviet leader was going to go to Washington from May 30 to June 3rd.

reference_spacy_tokens: They did n't say where he was going to be , though they thought the Soviet leader was going to go to Washington from May 30 to June 3rd .


fn_spacy_tokens_for_baseline: In the late 1960s , North Korea continued to expand its educational and research institutions to support a nuclear program for both civilian and military applications .

source_bert_toks: in the late 1960s , north korea continued to expand its educational and research institutions to support a nuclear program for both civilian and military applications .

reference_raw: In the late 1960s, North Korea continued to expand its education and research institutions to support a nuclear programme for both civilian and military applications.

reference_spacy_tokens: In the late 1960s , North Korea continued to expand its education and research institutions to support a nuclear programme for both civilian and military applications .


fn_spacy_tokens_for_baseline: To his absolute delight the first trap had held what must have been a seven pound salmon , plus a couple of mullet which he had ignored .

source_bert_toks: to his absolute delight the first trap had held what must have been a seven pound salmon , plus a couple of mu ##llet which he had ignored .

reference_raw: To his absolute pleasure, the first trap contained what must have been a seven-pound salmon, plus a few mullets that he ignored.

reference_spacy_tokens: To his absolute pleasure , the first trap contained what must have been a seven - pound salmon , plus a few mullets that he ignored .


fn_spacy_tokens_for_baseline: David Rogers spearheaded Esclusham 's charge with a 21 - 4 victory over Nicky Jones while Dave Jones routed Gary McGill 21 - 8 to hoist Esclusham into third place with a match in hand .

source_bert_toks: david rogers spearheaded es ##cl ##ush ##am ' s charge with a 21 - 4 victory over nicky jones while dave jones routed gary mcgill 21 - 8 to ho ##ist es ##cl ##ush ##am into third place with a match in hand .

reference_raw: David Rogers had driven Esclusham into a 21-4 victory over Nicky Jones, while Dave Jones had routed Gary McGill 21-8 to lift Esclusham into third place with a match in his hand.

reference_spacy_tokens: David Rogers had driven Esclusham into a 21 - 4 victory over Nicky Jones , while Dave Jones had routed Gary McGill 21 - 8 to lift Esclusham into third place with a match in his hand .


fn_spacy_tokens_for_baseline: Corbett gazed at the distant line of trees .

source_bert_toks: corbett gazed at the distant line of trees .

reference_raw: Corbett stared at the far line of trees.

reference_spacy_tokens: Corbett stared at the far line of trees .


fn_spacy_tokens_for_baseline: ' Tell me where he got into your taxi and everything that happened . '

source_bert_toks: ' tell me where he got into your taxi and everything that happened . '

reference_raw: "Tell me where he got into your cab and what happened."

reference_spacy_tokens: " Tell me where he got into your cab and what happened . "


fn_spacy_tokens_for_baseline: UK importer Mike Lake is unfazed by youth 's transfer of interest from hot rods to hit men .

source_bert_toks: uk import ##er mike lake is un ##fa ##zed by youth ' s transfer of interest from hot rods to hit men .

reference_raw: British importer Mike Lake is not fascinated by the fact that young people move interest from hot rods to hit men.

reference_spacy_tokens: British importer Mike Lake is not fascinated by the fact that young people move interest from hot rods to hit men .


fn_spacy_tokens_for_baseline: Joe 's swollen lips moved and Patrick bent his head , bringing it close to is friend .

source_bert_toks: joe ' s swollen lips moved and patrick bent his head , bringing it close to is friend .

reference_raw: Joe's swollen lips moved, and Patrick bowed his head, bringing him close to his friend.

reference_spacy_tokens: Joe 's swollen lips moved , and Patrick bowed his head , bringing him close to his friend .


fn_spacy_tokens_for_baseline: The steps passed along the path on the other side of the wall under which I crouched .

source_bert_toks: the steps passed along the path on the other side of the wall under which i crouched .

reference_raw: The stairs followed the path across the wall, where I crouched.

reference_spacy_tokens: The stairs followed the path across the wall , where I crouched .


fn_spacy_tokens_for_baseline: However , these interests can not conflict too directly , but must appear to be consonant .

source_bert_toks: however , these interests can not conflict too directly , but must appear to be consonant .

reference_raw: However, these interests cannot be overly direct, but they must appear consensual.

reference_spacy_tokens: However , these interests can not be overly direct , but they must appear consensual .


fn_spacy_tokens_for_baseline: Allegations about the violence by security forces was difficult to verify amid a clampdown that has barred all but a few journalists under escort into the country .

source_bert_toks: allegations about the violence by security forces was difficult to verify amid a cl ##amp ##down that has barred all but a few journalists under escort into the country .

reference_raw: The allegations that security forces were violent were difficult to verify in the midst of a crash that barred all but a few journalists who had been escorted to the countryside.

reference_spacy_tokens: The allegations that security forces were violent were difficult to verify in the midst of a crash that barred all but a few journalists who had been escorted to the countryside .


fn_spacy_tokens_for_baseline: Hetherington ( 1979 ) found that if marital separation led to a cessation of hostilities and conflict , this seemed somewhat less damaging for children than remaining in a discordant , unhappy , but intact home .

source_bert_toks: het ##hering ##ton ( 1979 ) found that if marital separation led to a ce ##ssa ##tion of hostilities and conflict , this seemed somewhat less damaging for children than remaining in a disco ##rdan ##t , unhappy , but intact home .

reference_raw: Hetherington (1979) found that if a marriage break-up led to an end to hostility and conflict, it would appear to be a little less harmful to children than to stay in a discordant, unhappy, but untouched home.

reference_spacy_tokens: Hetherington ( 1979 ) found that if a marriage break - up led to an end to hostility and conflict , it would appear to be a little less harmful to children than to stay in a discordant , unhappy , but untouched home .


fn_spacy_tokens_for_baseline: There was a pleasant hum of talk and the tinkle of spoons against cups , for a number of smartly - dressed ladies of various ages were sitting about the room chatting and drinking tea .

source_bert_toks: there was a pleasant hum of talk and the tin ##kle of spoon ##s against cups , for a number of smart ##ly - dressed ladies of various ages were sitting about the room chatting and drinking tea .

reference_raw: There was a pleasant hum of conversation and a tingle of spoons on cups, for many cleverly dressed women of different ages sat around the room, chatting and drinking tea.

reference_spacy_tokens: There was a pleasant hum of conversation and a tingle of spoons on cups , for many cleverly dressed women of different ages sat around the room , chatting and drinking tea .


fn_spacy_tokens_for_baseline: Joe Ashton , a Labour MP , narrowly failed to gain election to the Wednesday board .

source_bert_toks: joe ashton , a labour mp , narrowly failed to gain election to the wednesday board .

reference_raw: Joe Ashton, a member of the labour force, narrowly missed the election on Wednesday's board.

reference_spacy_tokens: Joe Ashton , a member of the labour force , narrowly missed the election on Wednesday 's board .


fn_spacy_tokens_for_baseline: Sukarno had demonstrated once again in a crisis that he represented unity .

source_bert_toks: su ##kar ##no had demonstrated once again in a crisis that he represented unity .

reference_raw: In the crisis, Sukarno showed once more that he represented unity.

reference_spacy_tokens: In the crisis , Sukarno showed once more that he represented unity .


fn_spacy_tokens_for_baseline: We cultivated maize and water melons and the crops were just about ripe when the army came one night without warning and destroyed everything .

source_bert_toks: we cultivated maize and water mel ##ons and the crops were just about ripe when the army came one night without warning and destroyed everything .

reference_raw: We grew corn and watermelons and the crops were almost ripe when the army came one night without warning and destroyed everything.

reference_spacy_tokens: We grew corn and watermelons and the crops were almost ripe when the army came one night without warning and destroyed everything .


fn_spacy_tokens_for_baseline: She thought he was going to kiss her , but it did n't happen , because the door was pushed open and the clerk came in with a pile of reports from other departments .

source_bert_toks: she thought he was going to kiss her , but it didn ' t happen , because the door was pushed open and the clerk came in with a pile of reports from other departments .

reference_raw: She thought he was going to kiss her, but that was not the case, for the door had been opened and the clerk had come in with a stack of reports from other departments.

reference_spacy_tokens: She thought he was going to kiss her , but that was not the case , for the door had been opened and the clerk had come in with a stack of reports from other departments .


fn_spacy_tokens_for_baseline: Few studies have been carried out assessing the effect of vitamin supplementation on adenomatous polyps or colorectal cancer .

source_bert_toks: few studies have been carried out assessing the effect of vitamin supplement ##ation on aden ##oma ##tou ##s poly ##ps or color ##ect ##al cancer .

reference_raw: Few studies have been conducted to assess the impact of vitamin supplementation on adenomatous polyps or colorectal cancer.

reference_spacy_tokens: Few studies have been conducted to assess the impact of vitamin supplementation on adenomatous polyps or colorectal cancer .


fn_spacy_tokens_for_baseline: Many countries are impressed by their style of plan and skilful players .

source_bert_toks: many countries are impressed by their style of plan and ski ##lf ##ul players .

reference_raw: Many countries are impressed by their style of planning and skillful players.

reference_spacy_tokens: Many countries are impressed by their style of planning and skillful players .


fn_spacy_tokens_for_baseline: The Community avoids the approach of harmonising all aspects of licensing and regulation of the conduct of business , but instead establishes essential standards .

source_bert_toks: the community avoids the approach of harmon ##ising all aspects of licensing and regulation of the conduct of business , but instead establishes essential standards .

reference_raw: The Community avoids the approach of harmonising all aspects of the licensing and management of commercial activities, but instead introduces basic standards.

reference_spacy_tokens: The Community avoids the approach of harmonising all aspects of the licensing and management of commercial activities , but instead introduces basic standards .


fn_spacy_tokens_for_baseline: Grate yellow rind of lemons , and finely chop the walnuts .

source_bert_toks: gr ##ate yellow ri ##nd of lemon ##s , and finely chop the walnut ##s .

reference_raw: Grape the yellow rind of lemons and cut the walnuts nicely.

reference_spacy_tokens: Grape the yellow rind of lemons and cut the walnuts nicely .


fn_spacy_tokens_for_baseline: It would always be the partner with a wife and kids who got shot down in the line of duty , giving his bachelor buddy the chance poignantly to break the news to his loved ones .

source_bert_toks: it would always be the partner with a wife and kids who got shot down in the line of duty , giving his bachelor buddy the chance po ##ignant ##ly to break the news to his loved ones .

reference_raw: He'd always be a partner with a wife and children who'd been shot in the line of duty, giving his bachelor friend a poignant chance to tell his loved ones the news.

reference_spacy_tokens: He 'd always be a partner with a wife and children who 'd been shot in the line of duty , giving his bachelor friend a poignant chance to tell his loved ones the news .


fn_spacy_tokens_for_baseline: She raised her head , stretched her neck , grinned .

source_bert_toks: she raised her head , stretched her neck , grinned .

reference_raw: She looked up, craned her neck, and smiled.

reference_spacy_tokens: She looked up , craned her neck , and smiled .


fn_spacy_tokens_for_baseline: Sitting with soles of the feet together , pull your feet in as close to you as possible .

source_bert_toks: sitting with sole ##s of the feet together , pull your feet in as close to you as possible .

reference_raw: You sit with your legs together and pull your legs as close as you can.

reference_spacy_tokens: You sit with your legs together and pull your legs as close as you can .


fn_spacy_tokens_for_baseline: Jefferson resigned from Downton International shortly afterwards , and put it about that he was fed up with working with such a large company .

source_bert_toks: jefferson resigned from down ##ton international shortly afterwards , and put it about that he was fed up with working with such a large company .

reference_raw: Jefferson left Downton International shortly after that and said he'd had enough of working with such a big company.

reference_spacy_tokens: Jefferson left Downton International shortly after that and said he 'd had enough of working with such a big company .


fn_spacy_tokens_for_baseline: A more general proposal is that the court should infer guilt from a person 's refusal to answer polite questions about what happened , or their decision not to testify .

source_bert_toks: a more general proposal is that the court should in ##fer guilt from a person ' s refusal to answer polite questions about what happened , or their decision not to testify .

reference_raw: A more general suggestion is that the court should deduce the guilt of a person's refusal to answer polite questions about what happened or his decision not to testify.

reference_spacy_tokens: A more general suggestion is that the court should deduce the guilt of a person 's refusal to answer polite questions about what happened or his decision not to testify .


fn_spacy_tokens_for_baseline: The current - account deficit for 1990 was US$ 2,610 million , with a similar level predicted for 1991 .

source_bert_toks: the current - account deficit for 1990 was us $ 2 , 610 million , with a similar level predicted for 1991 .

reference_raw: The current account deficit in 1990 was USD 2,610 million, with a similar level expected in 1991.

reference_spacy_tokens: The current account deficit in 1990 was USD 2,610 million , with a similar level expected in 1991 .


fn_spacy_tokens_for_baseline: The public are entitled to rely upon libraries for access to information and enlightenment upon every field of human experience and activity .

source_bert_toks: the public are entitled to rely upon libraries for access to information and enlightenment upon every field of human experience and activity .

reference_raw: The public has the right to rely on libraries for access to information and information on all areas of human experience and activities.

reference_spacy_tokens: The public has the right to rely on libraries for access to information and information on all areas of human experience and activities .


fn_spacy_tokens_for_baseline: Maggie looked at him with interest and he nodded , seeing he had her complete attention .

source_bert_toks: maggie looked at him with interest and he nodded , seeing he had her complete attention .

reference_raw: Maggie gave him a look of interest, and he nodded, seeing that she was fully attentive.

reference_spacy_tokens: Maggie gave him a look of interest , and he nodded , seeing that she was fully attentive .


fn_spacy_tokens_for_baseline: The president was overcome with doubts , which he expressed later that day to Walter Jenkins , a quiet , gentle man who served in effect as his chief of staff .

source_bert_toks: the president was overcome with doubts , which he expressed later that day to walter jenkins , a quiet , gentle man who served in effect as his chief of staff .

reference_raw: The President was overcome by doubts, which he later expressed to Walter Jenkins, a calm, gentle man who was actually his chief of staff.

reference_spacy_tokens: The President was overcome by doubts , which he later expressed to Walter Jenkins , a calm , gentle man who was actually his chief of staff .


fn_spacy_tokens_for_baseline: Alas , his appointment was terminated within months , his resignation being refused .

source_bert_toks: ala ##s , his appointment was terminated within months , his resignation being refused .

reference_raw: Unfortunately, his appointment ended within months, and his resignation was denied.

reference_spacy_tokens: Unfortunately , his appointment ended within months , and his resignation was denied .


fn_spacy_tokens_for_baseline: A jury returned not guilty verdicts on two charges against the former deputy council leader over car park deals in Liverpool .

source_bert_toks: a jury returned not guilty verdict ##s on two charges against the former deputy council leader over car park deals in liverpool .

reference_raw: The jury has returned innocent sentences on two charges against the former deputy director of the parking lot in Liverpool.

reference_spacy_tokens: The jury has returned innocent sentences on two charges against the former deputy director of the parking lot in Liverpool .


fn_spacy_tokens_for_baseline: This was before the ' epidemic ' had reached its current proportions and , being unsuccessful in their enterprise , they used it rather than throw it away .

source_bert_toks: this was before the ' epidemic ' had reached its current proportions and , being unsuccessful in their enterprise , they used it rather than throw it away .

reference_raw: That was before the 'epidemic' reached its present proportions and, having failed in their business, they used it instead of throwing it away.

reference_spacy_tokens: That was before the ' epidemic ' reached its present proportions and , having failed in their business , they used it instead of throwing it away .


fn_spacy_tokens_for_baseline: The superintendent nodded slowly , pretending to be satisfied by the reply .

source_bert_toks: the superintendent nodded slowly , pretending to be satisfied by the reply .

reference_raw: The Inspector nodded slowly, pretending to be pleased with the answer.

reference_spacy_tokens: The Inspector nodded slowly , pretending to be pleased with the answer .


fn_spacy_tokens_for_baseline: It is used by vast numbers of people who do not live there but take lunch at its many bus stops .

source_bert_toks: it is used by vast numbers of people who do not live there but take lunch at its many bus stops .

reference_raw: It's used by a lot of people who don't live there but eat lunch at a lot of bus stops.

reference_spacy_tokens: It 's used by a lot of people who do n't live there but eat lunch at a lot of bus stops .


fn_spacy_tokens_for_baseline: One may think such a suggestion to be far from orthodox .

source_bert_toks: one may think such a suggestion to be far from orthodox .

reference_raw: One might think that such a proposal is a long way from orthodox.

reference_spacy_tokens: One might think that such a proposal is a long way from orthodox .


fn_spacy_tokens_for_baseline: The traveller in Philips 's poem delights in a magical illusion , a pleasing unreality , which is mourned when the ice falls away .

source_bert_toks: the traveller in philips ' s poem delight ##s in a magical illusion , a pleasing un ##real ##ity , which is mo ##urne ##d when the ice falls away .

reference_raw: The traveller in Philips' poem enjoys a magical illusion, a pleasant unreality that mourns when the ice drops.

reference_spacy_tokens: The traveller in Philips ' poem enjoys a magical illusion , a pleasant unreality that mourns when the ice drops .


fn_spacy_tokens_for_baseline: The year 1165 also saw growing unrest in Saxony , where Henry as leader of the Guelphs , had gradually increased his power and field of influence , originally with the encouragement of his imperial overlord Frederick .

source_bert_toks: the year 116 ##5 also saw growing unrest in saxony , where henry as leader of the gu ##el ##phs , had gradually increased his power and field of influence , originally with the encouragement of his imperial over ##lord frederick .

reference_raw: In the year 1165, too, there was growing unrest in Saxony, where Henry, as leader of the Guelphs, gradually increased his power and field of influence, initially with the support of his Imperial ruler Frederick.

reference_spacy_tokens: In the year 1165 , too , there was growing unrest in Saxony , where Henry , as leader of the Guelphs , gradually increased his power and field of influence , initially with the support of his Imperial ruler Frederick .


fn_spacy_tokens_for_baseline: The shafts sprang into the air and I was dangled like a gymnast on parallel bars , before being tossed to the ground .

source_bert_toks: the shafts sprang into the air and i was dan ##gled like a gymnast on parallel bars , before being tossed to the ground .

reference_raw: The arrows flew into the air, and I was hung like a gymnast on parallel bars before I was thrown to the ground.

reference_spacy_tokens: The arrows flew into the air , and I was hung like a gymnast on parallel bars before I was thrown to the ground .


fn_spacy_tokens_for_baseline: PEARL JAM fans caused motorway chaos in Seattle after the band announced a secret homecoming gig .

source_bert_toks: pearl jam fans caused motorway chaos in seattle after the band announced a secret homecoming gig .

reference_raw: Pearl JAM fans caused motorway confusion in Seattle after the band announced a secret homecoming concert.

reference_spacy_tokens: Pearl JAM fans caused motorway confusion in Seattle after the band announced a secret homecoming concert .


fn_spacy_tokens_for_baseline: He 'd had a real pimple when he arrived , but during the time he took to find and bribe an official to provide the documents , the blemish had healed , .

source_bert_toks: he ' d had a real pi ##mple when he arrived , but during the time he took to find and bribe an official to provide the documents , the b ##lem ##ish had healed , .

reference_raw: By the time he got here, he'd had a real pimp, but in the time he'd taken to find and bribe an official to provide documents, the blemish had healed.

reference_spacy_tokens: By the time he got here , he 'd had a real pimp , but in the time he 'd taken to find and bribe an official to provide documents , the blemish had healed .


fn_spacy_tokens_for_baseline: In a statement , Californian governor Arnold Schwarzenegger said that " [ his administration ] is working around the clock to ensure that our brave men and women working on the fires front lines have the resources needed to respond and beat back these fires as quickly as possible . "

source_bert_toks: in a statement , california ##n governor arnold schwarz ##ene ##gger said that " [ his administration ] is working around the clock to ensure that our brave men and women working on the fires front lines have the resources needed to respond and beat back these fires as quickly as possible . "

reference_raw: In a statement, California Governor Arnold Schwarzenegger said that "[his administration] is working around the clock to ensure that our brave men and women working on the front lines of the fires are equipped with the resources necessary to react and defeat those fires as soon as possible."

reference_spacy_tokens: In a statement , California Governor Arnold Schwarzenegger said that " [ his administration ] is working around the clock to ensure that our brave men and women working on the front lines of the fires are equipped with the resources necessary to react and defeat those fires as soon as possible . "


fn_spacy_tokens_for_baseline: Their mother Julie was also dead with head injruies .

source_bert_toks: their mother julie was also dead with head in ##j ##ru ##ies .

reference_raw: Their mother Julia died, too, with head injuries.

reference_spacy_tokens: Their mother Julia died , too , with head injuries .


fn_spacy_tokens_for_baseline: A derby match is sufficient in itself to bring the best out of all concerned .

source_bert_toks: a derby match is sufficient in itself to bring the best out of all concerned .

reference_raw: A derby match is enough in itself to get the best out of everyone involved.

reference_spacy_tokens: A derby match is enough in itself to get the best out of everyone involved .


fn_spacy_tokens_for_baseline: If the hatches behind the mill were open , the main stream of the Nadder would rush through and drop some six or seven feet rather like a waterfall .

source_bert_toks: if the hatch ##es behind the mill were open , the main stream of the nad ##der would rush through and drop some six or seven feet rather like a waterfall .

reference_raw: If the hatches behind the mill had been opened, the Nadder's main stream would have flown in and dropped about six or seven feet, rather like a waterfall.

reference_spacy_tokens: If the hatches behind the mill had been opened , the Nadder 's main stream would have flown in and dropped about six or seven feet , rather like a waterfall .


fn_spacy_tokens_for_baseline: One of the phenomena of his campaign was the presence of large groups of women who would scream and faint whenever he came anywhere near them .

source_bert_toks: one of the phenomena of his campaign was the presence of large groups of women who would scream and faint whenever he came anywhere near them .

reference_raw: One of the phenomena of his campaign was the presence of large bands of women who screamed and fainted whenever he approached them.

reference_spacy_tokens: One of the phenomena of his campaign was the presence of large bands of women who screamed and fainted whenever he approached them .


fn_spacy_tokens_for_baseline: The guru behind these startling revelations was John Burland , Professor of Soil Science at London 's Imperial College of Science and Technology , and a member of the latest commission to examine the problem .

source_bert_toks: the guru behind these startling revelations was john bu ##rland , professor of soil science at london ' s imperial college of science and technology , and a member of the latest commission to examine the problem .

reference_raw: The guru behind these shocking revelations was John Burland, a professor of soil science at the Imperial College of Science and Technology in London, and a member of the newest committee to investigate the problem.

reference_spacy_tokens: The guru behind these shocking revelations was John Burland , a professor of soil science at the Imperial College of Science and Technology in London , and a member of the newest committee to investigate the problem .


fn_spacy_tokens_for_baseline: However , physically to move the records in line with this boundary reorganisation would have been a formidable and costly task , so enquiries continue to be dealt with under the old district boundaries .

source_bert_toks: however , physically to move the records in line with this boundary reorganisation would have been a formidable and costly task , so en ##qui ##ries continue to be dealt with under the old district boundaries .

reference_raw: Physically, however, moving records in line with this border reorganisation would be a formidable and costly task, so investigations continue to be carried out under the old district boundaries.

reference_spacy_tokens: Physically , however , moving records in line with this border reorganisation would be a formidable and costly task , so investigations continue to be carried out under the old district boundaries .


fn_spacy_tokens_for_baseline: At one point , laughing , they fired off a couple of rounds , ricocheting the bullets against a wall .

source_bert_toks: at one point , laughing , they fired off a couple of rounds , rico ##chet ##ing the bullets against a wall .

reference_raw: At one point, laughing, they shot a few rounds and bounced the bullets against the wall.

reference_spacy_tokens: At one point , laughing , they shot a few rounds and bounced the bullets against the wall .


fn_spacy_tokens_for_baseline: Wenceslas captured and imprisoned the archbishop and his vicar - general , John of Nepomuk .

source_bert_toks: wen ##ces ##las captured and imprisoned the archbishop and his vicar - general , john of ne ##po ##mu ##k .

reference_raw: Wenceslas has captured and arrested the archbishop and his vicar-general, John of Nepomuk.

reference_spacy_tokens: Wenceslas has captured and arrested the archbishop and his vicar - general , John of Nepomuk .


fn_spacy_tokens_for_baseline: In caring for others , in serious , dedicated friendships , in constructing individual careers made of personally discovered projects , in arranging lives of self - care and attentiveness to others who are needy .

source_bert_toks: in caring for others , in serious , dedicated friendships , in constructing individual careers made of personally discovered projects , in arranging lives of self - care and at ##ten ##tive ##ness to others who are needy .

reference_raw: Taking care of other people, in serious, dedicated friendships, building individual careers from personally discovered projects, organizing lives of self-care and attention to other people in need.

reference_spacy_tokens: Taking care of other people , in serious , dedicated friendships , building individual careers from personally discovered projects , organizing lives of self - care and attention to other people in need .


fn_spacy_tokens_for_baseline: Buyers learned from the crash that mediocre art does n't hold it 's value .

source_bert_toks: buyers learned from the crash that med ##io ##cre art doesn ' t hold it ' s value .

reference_raw: The buyers learned from the accident that the average art has no value.

reference_spacy_tokens: The buyers learned from the accident that the average art has no value .


fn_spacy_tokens_for_baseline: Drain the spaghetti well , return to the pan and add the pesto , mixing thoroughly to ensure the spaghetti is completely coated .

source_bert_toks: drain the spaghetti well , return to the pan and add the pest ##o , mixing thoroughly to ensure the spaghetti is completely coated .

reference_raw: Drin the spaghetti well, return to the pelvis and add the pesto and mix thoroughly to ensure that the spaghetti is completely covered.

reference_spacy_tokens: Drin the spaghetti well , return to the pelvis and add the pesto and mix thoroughly to ensure that the spaghetti is completely covered .


fn_spacy_tokens_for_baseline: Suddenly Lee saw the exhaustion in the folds of skin beneath her mother 's eyes .

source_bert_toks: suddenly lee saw the exhaustion in the folds of skin beneath her mother ' s eyes .

reference_raw: Suddenly Lee saw exhaustion in the folds of the leather beneath his mother's eyes.

reference_spacy_tokens: Suddenly Lee saw exhaustion in the folds of the leather beneath his mother 's eyes .


fn_spacy_tokens_for_baseline: The worst case curve shows fluctuations that get larger and larger .

source_bert_toks: the worst case curve shows fluctuations that get larger and larger .

reference_raw: The worst-case curve shows variations that are getting bigger and bigger.

reference_spacy_tokens: The worst - case curve shows variations that are getting bigger and bigger .


fn_spacy_tokens_for_baseline: The nervous enthusiasm of his expression was such that Miss Daunt afterwards confessed that she thought he was about to use the gun on her .

source_bert_toks: the nervous enthusiasm of his expression was such that miss da ##unt afterwards confessed that she thought he was about to use the gun on her .

reference_raw: The nervous excitement in his face made Miss Daunt admit later that she thought he was going to use a gun on her.

reference_spacy_tokens: The nervous excitement in his face made Miss Daunt admit later that she thought he was going to use a gun on her .


fn_spacy_tokens_for_baseline: Around four million barrels ( 660,000 tonnes ) of oil were being burned each day in March 1991 , nearly three times the pre - war Kuwait output and almost 10 per cent of the world 's daily ration .

source_bert_toks: around four million barrels ( 660 , 000 tonnes ) of oil were being burned each day in march 1991 , nearly three times the pre - war kuwait output and almost 10 per cent of the world ' s daily ratio ##n .

reference_raw: In March 1991, about four million kegs (660,000 tons) of oil were burned every day, almost three times the pre-war production of Kuwait and nearly ten percent of the world's daily ration.

reference_spacy_tokens: In March 1991 , about four million kegs ( 660,000 tons ) of oil were burned every day , almost three times the pre - war production of Kuwait and nearly ten percent of the world 's daily ration .


fn_spacy_tokens_for_baseline: Donations last year amounted to £ 1,230.50 , which encourages members to make a donation annually , as an expression of thankfulness to God for health and strength .

source_bert_toks: donations last year amounted to £1 , 230 . 50 , which encourages members to make a donation annually , as an expression of thankful ##ness to god for health and strength .

reference_raw: Last year's gifts amounted to £1,230.50, which encourages members to donate each year as a sign of gratitude to God for health and strength.

reference_spacy_tokens: Last year 's gifts amounted to £ 1,230.50 , which encourages members to donate each year as a sign of gratitude to God for health and strength .


fn_spacy_tokens_for_baseline: Within two or three weeks a brisk walk for a full half - hour becomes an enjoyable experience .

source_bert_toks: within two or three weeks a brisk walk for a full half - hour becomes an enjoyable experience .

reference_raw: In two or three weeks, a quick walk for half an hour will be a pleasant experience.

reference_spacy_tokens: In two or three weeks , a quick walk for half an hour will be a pleasant experience .


fn_spacy_tokens_for_baseline: He hit a lamp - post and fractured Mike 's skull .

source_bert_toks: he hit a lamp - post and fractured mike ' s skull .

reference_raw: He hit the lamppost and broke Mike's skull.

reference_spacy_tokens: He hit the lamppost and broke Mike 's skull .


fn_spacy_tokens_for_baseline: Mr Grant 's grandfather was one of the many skippers who used the railway to sell fresh fish to the industrial markets in the hinterland and to London .

source_bert_toks: mr grant ' s grandfather was one of the many skipper ##s who used the railway to sell fresh fish to the industrial markets in the hint ##erland and to london .

reference_raw: Mr. Grant's grandpa was one of many captains who used the railroad to sell fresh fish to industrial markets in the interior and London.

reference_spacy_tokens: Mr. Grant 's grandpa was one of many captains who used the railroad to sell fresh fish to industrial markets in the interior and London .


fn_spacy_tokens_for_baseline: He was seen to wave that he was O.K. to one of the other aircraft .

source_bert_toks: he was seen to wave that he was o . k . to one of the other aircraft .

reference_raw: They saw him signal that he was okay with one of the other planes.

reference_spacy_tokens: They saw him signal that he was okay with one of the other planes .


fn_spacy_tokens_for_baseline: For proper sampling , some studies recommend the evaluation of three levels at 200 intervals [ 30]. In that case , if each of the three antibodies in the cocktail had to be used individually , it would require the immunostaining , interpreting , and correlating of nine sections .

source_bert_toks: for proper sampling , some studies recommend the evaluation of three levels at 200 intervals [ 30 ] . in that case , if each of the three antibodies in the cocktail had to be used individually , it would require the im ##mun ##osta ##ining , interpreting , and co ##rre ##lating of nine sections .

reference_raw: For proper sampling, some studies suggest that three levels should be evaluated at 200 intervals [30]. In this case, if each of the three antibodies in a cocktail had to be used separately, it would require immunostaining, interpreting and correlation of nine sections.

reference_spacy_tokens: For proper sampling , some studies suggest that three levels should be evaluated at 200 intervals [ 30]. In this case , if each of the three antibodies in a cocktail had to be used separately , it would require immunostaining , interpreting and correlation of nine sections .


fn_spacy_tokens_for_baseline: The tropical evening settled heavily about you , and the shadows in which you hid were warm , but each time you soothed yourself into courage and surged forth from ambush you heard witnesses approaching .

source_bert_toks: the tropical evening settled heavily about you , and the shadows in which you hid were warm , but each time you soothe ##d yourself into courage and surged forth from ambush you heard witnesses approaching .

reference_raw: The tropical evening settled heavily around you, and the shadows in which you were hiding were warm, but each time you calmed your courage and surged out of the ambush, you could hear the coming of witnesses.

reference_spacy_tokens: The tropical evening settled heavily around you , and the shadows in which you were hiding were warm , but each time you calmed your courage and surged out of the ambush , you could hear the coming of witnesses .


fn_spacy_tokens_for_baseline: He had recognised the driver as the hangman from Tyburn .

source_bert_toks: he had recognised the driver as the hang ##man from ty ##burn .

reference_raw: He recognized the driver as Tyburn's executioner.

reference_spacy_tokens: He recognized the driver as Tyburn 's executioner .


fn_spacy_tokens_for_baseline: Name the novel in which this festive illustration can be found .

source_bert_toks: name the novel in which this fest ##ive illustration can be found .

reference_raw: Give me a novel where you can find this festive illustration.

reference_spacy_tokens: Give me a novel where you can find this festive illustration .


fn_spacy_tokens_for_baseline: She had n't simply evaded him ; she 'd evaded him each time with an ease that had left him looking like a fool .

source_bert_toks: she hadn ' t simply evade ##d him ; she ' d evade ##d him each time with an ease that had left him looking like a fool .

reference_raw: She didn't just avoid him; she always avoided him with an ease that made him look like a fool.

reference_spacy_tokens: She did n't just avoid him ; she always avoided him with an ease that made him look like a fool .


fn_spacy_tokens_for_baseline: Duck swarms .

source_bert_toks: duck swarm ##s .

reference_raw: The duck flocks.

reference_spacy_tokens: The duck flocks .


fn_spacy_tokens_for_baseline: Friends of these schools rejoiced in this subtle mixture of independence , fee - paying , support for deserving pupils with poor parents , academic excellence , and adequate support from the tax - payer .

source_bert_toks: friends of these schools re ##jo ##ice ##d in this subtle mixture of independence , fee - paying , support for des ##erving pupils with poor parents , academic excellence , and adequate support from the tax - pay ##er .

reference_raw: Friends of these schools rejoiced in this delicate mix of independence, fee-paying, support for poor parents' deserving pupils, academic excellence, and appropriate support from taxpayers.

reference_spacy_tokens: Friends of these schools rejoiced in this delicate mix of independence , fee - paying , support for poor parents ' deserving pupils , academic excellence , and appropriate support from taxpayers .


fn_spacy_tokens_for_baseline: The Mappin and Webb building adjoins the Mansion House and the Bank of England .

source_bert_toks: the map ##pin and webb building ad ##jo ##ins the mansion house and the bank of england .

reference_raw: The building of Mappin and Webb is adjacent to the Mansion House and the Bank of England.

reference_spacy_tokens: The building of Mappin and Webb is adjacent to the Mansion House and the Bank of England .


fn_spacy_tokens_for_baseline: But this does not mean that they did not face the troublesome question Berkeley faces , of how to distinguish between illusion and reality .

source_bert_toks: but this does not mean that they did not face the troubles ##ome question berkeley faces , of how to distinguish between illusion and reality .

reference_raw: But that doesn't mean they didn't face the problem that Berkeley was facing, how to distinguish illusion from reality.

reference_spacy_tokens: But that does n't mean they did n't face the problem that Berkeley was facing , how to distinguish illusion from reality .


fn_spacy_tokens_for_baseline: Utility player Gary Hinchley , who was signed on Hankin 's first full day in charge last week , was told to quit playing football at Christmas , because of a knee injury .

source_bert_toks: utility player gary hi ##nch ##ley , who was signed on hank ##in ' s first full day in charge last week , was told to quit playing football at christmas , because of a knee injury .

reference_raw: Utility Player Gary Hinchley, who was in charge of Hankin's first full day last week, was told to stop playing soccer for Christmas because of a knee injury.

reference_spacy_tokens: Utility Player Gary Hinchley , who was in charge of Hankin 's first full day last week , was told to stop playing soccer for Christmas because of a knee injury .


fn_spacy_tokens_for_baseline: Responding to the barrage of critics who insist that Iran 's illicit intentions are obvious , El - Baradei has pointed to the continued absence of a " smoking gun " and the fundamental shortcomings of attempts to concretely assess Iran 's programmatic goals without such evidence .

source_bert_toks: responding to the barrage of critics who insist that iran ' s illicit intentions are obvious , el - bar ##ade ##i has pointed to the continued absence of a " smoking gun " and the fundamental short ##coming ##s of attempts to concrete ##ly assess iran ' s program ##matic goals without such evidence .

reference_raw: In response to the barrage of critics who insist that Iran's illegal intentions are clear, El-Baradei pointed out the continued absence of a "smoking weapon" and the fundamental shortcomings of attempts to specifically assess Iran's programmatic objectives without such evidence.

reference_spacy_tokens: In response to the barrage of critics who insist that Iran 's illegal intentions are clear , El - Baradei pointed out the continued absence of a " smoking weapon " and the fundamental shortcomings of attempts to specifically assess Iran 's programmatic objectives without such evidence .


fn_spacy_tokens_for_baseline: More than 65,000 grey squirrels were poisoned in 1991 but the law forbids bait to be laid in woods inhabited by both species .

source_bert_toks: more than 65 , 000 grey squirrels were poisoned in 1991 but the law forbid ##s bait to be laid in woods inhabited by both species .

reference_raw: In 1991, more than 65,000 gray squirrels were polluted, but the law prohibits bait from being laid in forests populated by both species.

reference_spacy_tokens: In 1991 , more than 65,000 gray squirrels were polluted , but the law prohibits bait from being laid in forests populated by both species .


fn_spacy_tokens_for_baseline: However , Iran 's Foreign Minister Ali Akbar Velayati rejects speculations that his country was trying to hire the scientists .

source_bert_toks: however , iran ' s foreign minister ali akbar ve ##laya ##ti rejects speculation ##s that his country was trying to hire the scientists .

reference_raw: But Iran's foreign minister, Ali Akbar Velayati, rejects speculation that his country has attempted to recruit scientists.

reference_spacy_tokens: But Iran 's foreign minister , Ali Akbar Velayati , rejects speculation that his country has attempted to recruit scientists .


fn_spacy_tokens_for_baseline: But when Suleiman died , his empire , including Jerusalem , began a long period of decline .

source_bert_toks: but when sul ##eim ##an died , his empire , including jerusalem , began a long period of decline .

reference_raw: But after Suleiman's death, his empire, including Jerusalem, began a long period of decline.

reference_spacy_tokens: But after Suleiman 's death , his empire , including Jerusalem , began a long period of decline .


fn_spacy_tokens_for_baseline: Strong , rigid aluminium faces on the inside and outside provide outstanding security , and unlike plastic panels , the new designs can not be melted with a blowtorch or removed by would - be intruders .

source_bert_toks: strong , rigid aluminium faces on the inside and outside provide outstanding security , and unlike plastic panels , the new designs can not be melted with a blow ##tor ##ch or removed by would - be intruder ##s .

reference_raw: Strong, rigid aluminium faces inside and outside provide excellent security, and unlike plastic panels, new designs cannot be dissolved by a blowtorch or removed by would-be aliens.

reference_spacy_tokens: Strong , rigid aluminium faces inside and outside provide excellent security , and unlike plastic panels , new designs can not be dissolved by a blowtorch or removed by would - be aliens .


fn_spacy_tokens_for_baseline: His lordship suffered too , in his turn , because I heard the occasional stifled oath as he impaled a finger on the needle .

source_bert_toks: his lordship suffered too , in his turn , because i heard the occasional stifled oath as he imp ##ale ##d a finger on the needle .

reference_raw: His Lordship suffered, too, for I could hear the occasional choking oath as he stabbed a finger into a needle.

reference_spacy_tokens: His Lordship suffered , too , for I could hear the occasional choking oath as he stabbed a finger into a needle .


fn_spacy_tokens_for_baseline: She guessed Ben lived mostly in the kitchen , cooking neatly and painstakingly for himself .

source_bert_toks: she guessed ben lived mostly in the kitchen , cooking neatly and pains ##taking ##ly for himself .

reference_raw: She guessed that Ben lived mostly in the galley, cooking neatly and painfully for himself.

reference_spacy_tokens: She guessed that Ben lived mostly in the galley , cooking neatly and painfully for himself .


fn_spacy_tokens_for_baseline: ' Look at Angel clouting that sweet little mare with his stick -- the fucker . '

source_bert_toks: ' look at angel cl ##out ##ing that sweet little mare with his stick - - the fuck ##er . '

reference_raw: 'Look how Angel's clotting that sweet little mare with his cane - that fucker.'

reference_spacy_tokens: ' Look how Angel 's clotting that sweet little mare with his cane - that fucker . '


fn_spacy_tokens_for_baseline: In addition to the emphasis on vocal participation by congregations , there was the recognition for the first time of indigenous musical traditions .

source_bert_toks: in addition to the emphasis on vocal participation by congregations , there was the recognition for the first time of indigenous musical traditions .

reference_raw: Apart from the emphasis on the vocal involvement of congregations, indigenous musical traditions were recognised for the first time.

reference_spacy_tokens: Apart from the emphasis on the vocal involvement of congregations , indigenous musical traditions were recognised for the first time .


fn_spacy_tokens_for_baseline: The Dead Sea is a terminal lake into which drains the River Jordan and its tributaries , as well as the streams flowing from the Judean , Edom and Moab Mountains and the Arava .

source_bert_toks: the dead sea is a terminal lake into which drains the river jordan and its tributaries , as well as the streams flowing from the jude ##an , edo ##m and mo ##ab mountains and the ara ##va .

reference_raw: The Dead Sea is a terminal lake that drains the Jordan River and its tributaries, as well as streams from the Judean, Edom and Moab Mountains and the Arava.

reference_spacy_tokens: The Dead Sea is a terminal lake that drains the Jordan River and its tributaries , as well as streams from the Judean , Edom and Moab Mountains and the Arava .


fn_spacy_tokens_for_baseline: ' Nouveau riche is more interesting to look at , but of course boring to talk to . '

source_bert_toks: ' nouveau rich ##e is more interesting to look at , but of course boring to talk to . '

reference_raw: "It's more interesting to look at the wealth of Nouveau, but of course it's dull to talk to."

reference_spacy_tokens: " It 's more interesting to look at the wealth of Nouveau , but of course it 's dull to talk to . "


fn_spacy_tokens_for_baseline: A 17-year effort to protect some seven million acres of federally owned desert in California seems to be on the brink of success , the result of a new president and changing attitudes in Congress .

source_bert_toks: a 17 - year effort to protect some seven million acres of federally owned desert in california seems to be on the brink of success , the result of a new president and changing attitudes in congress .

reference_raw: The 17-year effort to protect about seven million acres of federally-owned wasteland in California appears to be on the brink of success, the result of a new president and a change of attitude in Congress.

reference_spacy_tokens: The 17-year effort to protect about seven million acres of federally - owned wasteland in California appears to be on the brink of success , the result of a new president and a change of attitude in Congress .


fn_spacy_tokens_for_baseline: They 're frightened to death .

source_bert_toks: they ' re frightened to death .

reference_raw: They're scared to death.

reference_spacy_tokens: They 're scared to death .


fn_spacy_tokens_for_baseline: Here , have a swig of this .

source_bert_toks: here , have a sw ##ig of this .

reference_raw: Here, take a drink.

reference_spacy_tokens: Here , take a drink .


fn_spacy_tokens_for_baseline: Zen was so astounded at finding Cinzia there on that particular evening that he could think of nothing whatever to say .

source_bert_toks: zen was so as ##tou ##nded at finding ci ##nz ##ia there on that particular evening that he could think of nothing whatever to say .

reference_raw: Zen was so surprised to find Cinzia there that night that he couldn't think of anything to say.

reference_spacy_tokens: Zen was so surprised to find Cinzia there that night that he could n't think of anything to say .


fn_spacy_tokens_for_baseline: I decided contacting the Americans would be too risky .

source_bert_toks: i decided contact ##ing the americans would be too risky .

reference_raw: I've decided it's too dangerous to contact the Americans.

reference_spacy_tokens: I 've decided it 's too dangerous to contact the Americans .


fn_spacy_tokens_for_baseline: Small girls can be found playing at ' house ' , disconcerting their feminist mothers .

source_bert_toks: small girls can be found playing at ' house ' , disco ##nce ##rting their feminist mothers .

reference_raw: You can find little girls playing in 'house' to upset their feminist moms.

reference_spacy_tokens: You can find little girls playing in ' house ' to upset their feminist moms .


fn_spacy_tokens_for_baseline: A thorough search of the Sea Rover revealed only the charred remnants of what was later analysed as cannabis , blowing around the decks .

source_bert_toks: a thorough search of the sea rover revealed only the charred remnants of what was later anal ##yse ##d as cannabis , blowing around the decks .

reference_raw: A thorough search of the Sea Rover revealed only the charred remains of what was later analyzed as cannabis and blew around the decks.

reference_spacy_tokens: A thorough search of the Sea Rover revealed only the charred remains of what was later analyzed as cannabis and blew around the decks .


fn_spacy_tokens_for_baseline: Book -- Monster : Living Off the Big Screen , by John Gregory Dunne ;

source_bert_toks: book - - monster : living off the big screen , by john gregory dunne ;

reference_raw: Book -- Monster: Life off the Great Screen, by John Gregory Dunne;

reference_spacy_tokens: Book -- Monster : Life off the Great Screen , by John Gregory Dunne ;


fn_spacy_tokens_for_baseline: " When I saw the draw I was thinking obviously this is a good opportunity to get back at him .

source_bert_toks: " when i saw the draw i was thinking obviously this is a good opportunity to get back at him .

reference_raw: "When I saw the drawing, I thought it was a good opportunity to retaliate."

reference_spacy_tokens: " When I saw the drawing , I thought it was a good opportunity to retaliate . "


fn_spacy_tokens_for_baseline: The original qualities of our native breeds have become diluted by cross - breeding with such foreign interlopers as the Dutch Texel , because they produce an animal that looks like a table .

source_bert_toks: the original qualities of our native breeds have become dil ##uted by cross - breeding with such foreign inter ##lo ##pers as the dutch tex ##el , because they produce an animal that looks like a table .

reference_raw: The original characteristics of our native species were diluted by cross-breeding with foreign intruders like the Dutch Texel, because they produce an animal that looks like a table.

reference_spacy_tokens: The original characteristics of our native species were diluted by cross - breeding with foreign intruders like the Dutch Texel , because they produce an animal that looks like a table .


fn_spacy_tokens_for_baseline: One may remember homes is a mnemonic , but forget what it is a mnemonic for .

source_bert_toks: one may remember homes is a mn ##emon ##ic , but forget what it is a mn ##emon ##ic for .

reference_raw: You can remember that homes are mnemonic, but you can't remember what a mnemonic is.

reference_spacy_tokens: You can remember that homes are mnemonic , but you ca n't remember what a mnemonic is .


fn_spacy_tokens_for_baseline: Queen Helena , a devout Christian and the mother of Emperor Constantine the Great , made a pilgrimage to the Holy Land in 326 to identify the sites associated with Jesus 's life .

source_bert_toks: queen helena , a devout christian and the mother of emperor constantine the great , made a pilgrimage to the holy land in 326 to identify the sites associated with jesus ' s life .

reference_raw: Queen Helena, a devoted Christian, and the mother of Emperor Constantine the Great, made a pilgrimage to the Holy Land in 326 to identify the sites associated with the existence of Jesus.

reference_spacy_tokens: Queen Helena , a devoted Christian , and the mother of Emperor Constantine the Great , made a pilgrimage to the Holy Land in 326 to identify the sites associated with the existence of Jesus .


fn_spacy_tokens_for_baseline: When Ako Adjei , Adamafio and Crabbe were given a second trial they were condemned to death : but the sentence was commuted by Nkrumah to life imprisonment .

source_bert_toks: when ak ##o ad ##je ##i , adam ##af ##io and crab ##be were given a second trial they were condemned to death : but the sentence was commuted by nk ##rum ##ah to life imprisonment .

reference_raw: When Ako Adjei, Adamafio and Crabbe were tried again, they were sentenced to death: but Nkrumah sentenced them to life imprisonment.

reference_spacy_tokens: When Ako Adjei , Adamafio and Crabbe were tried again , they were sentenced to death : but Nkrumah sentenced them to life imprisonment .


fn_spacy_tokens_for_baseline: Rolling and scrambling to his feet , Trent charged blindly across the clearing and into the undergrowth , holding up his bound hands to protect his eyes .

source_bert_toks: rolling and scrambling to his feet , trent charged blindly across the clearing and into the under ##growth , holding up his bound hands to protect his eyes .

reference_raw: Trent rolled and scrambled to his feet, scrambling blindly across the clearing and into the undergrowth, raising his chained hands to protect his eyes.

reference_spacy_tokens: Trent rolled and scrambled to his feet , scrambling blindly across the clearing and into the undergrowth , raising his chained hands to protect his eyes .


fn_spacy_tokens_for_baseline: What about central bankers per head of population -- supposing , which is not obvious , that bigger countries need bigger banks ?

source_bert_toks: what about central bankers per head of population - - su ##pp ##osing , which is not obvious , that bigger countries need bigger banks ?

reference_raw: What about central bankers per head of the population -- assuming, which is not obvious, that larger countries need larger banks?

reference_spacy_tokens: What about central bankers per head of the population -- assuming , which is not obvious , that larger countries need larger banks ?


fn_spacy_tokens_for_baseline: Maybe I delivered my opinion more bluntly than I should have , but I had always been candid with Ted .

source_bert_toks: maybe i delivered my opinion more blunt ##ly than i should have , but i had always been candi ##d with ted .

reference_raw: I may have given my opinion more bluntly than I should have, but I've always been honest with Ted.

reference_spacy_tokens: I may have given my opinion more bluntly than I should have , but I 've always been honest with Ted .


fn_spacy_tokens_for_baseline: The above experimental results failed to support the hypothesis that the unique 35 amino acid sequence from sa i 2 serves as a specific Golgi or intracellular membrane targeting motif .

source_bert_toks: the above experimental results failed to support the hypothesis that the unique 35 amino acid sequence from sa i 2 serves as a specific go ##l ##gi or intra ##cellular membrane targeting motif .

reference_raw: The above experimental results did not support the assumption that the unique 35 sa i 2 amino acid sequence serves as a specific golgi or intracellular membrane target motif.

reference_spacy_tokens: The above experimental results did not support the assumption that the unique 35 sa i 2 amino acid sequence serves as a specific golgi or intracellular membrane target motif .


fn_spacy_tokens_for_baseline: Rose rummaged through her skirts .

source_bert_toks: rose rum ##mage ##d through her skirts .

reference_raw: Rose fumbled in her skirts.

reference_spacy_tokens: Rose fumbled in her skirts .


fn_spacy_tokens_for_baseline: Meanwhile , Mr Major 's handling of the whole Maastricht issue was branded a total shambles last night .

source_bert_toks: meanwhile , mr major ' s handling of the whole ma ##ast ##rich ##t issue was branded a total sham ##bles last night .

reference_raw: In the meantime, Mr. Major's handling of the entire Maastricht case was marked as a total shambles yesterday.

reference_spacy_tokens: In the meantime , Mr. Major 's handling of the entire Maastricht case was marked as a total shambles yesterday .


fn_spacy_tokens_for_baseline: Ruby had told of buying a pair of corsets and having to carry them along Church Street unwrapped .

source_bert_toks: ruby had told of buying a pair of co ##rse ##ts and having to carry them along church street un ##wr ##app ##ed .

reference_raw: Ruby said he'd bought a pair of corsets and had to carry them down Church Street unpacked.

reference_spacy_tokens: Ruby said he 'd bought a pair of corsets and had to carry them down Church Street unpacked .


fn_spacy_tokens_for_baseline: Most of the animals in the sea either feed directly upon the diatoms and flagellates of the phytoplankton , or feed upon creatures that have fed upon that phytoplankton .

source_bert_toks: most of the animals in the sea either feed directly upon the dia ##tom ##s and flag ##ella ##tes of the ph ##yt ##op ##lan ##kt ##on , or feed upon creatures that have fed upon that ph ##yt ##op ##lan ##kt ##on .

reference_raw: Most marine animals either feed directly on the phytoplankton's diatoms and flags, or feed on the creatures that feed on this phytoplankton.

reference_spacy_tokens: Most marine animals either feed directly on the phytoplankton 's diatoms and flags , or feed on the creatures that feed on this phytoplankton .


fn_spacy_tokens_for_baseline: Military units have frequently carried out arrests and failed promptly to hand over detainees to the police -- a number have been held beyond the 72-hour - limit .

source_bert_toks: military units have frequently carried out arrests and failed promptly to hand over detainees to the police - - a number have been held beyond the 72 - hour - limit .

reference_raw: Military units often made arrests and didn't immediately give the detainees to the police - many of them were held outside the 72-hour limit.

reference_spacy_tokens: Military units often made arrests and did n't immediately give the detainees to the police - many of them were held outside the 72-hour limit .


fn_spacy_tokens_for_baseline: He had n't been able to prevent himself from catching her when she fell , and now the feel of her , cradled helplessly against his chest , sent shafts of agony through him .

source_bert_toks: he hadn ' t been able to prevent himself from catching her when she fell , and now the feel of her , cradled helplessly against his chest , sent shafts of agony through him .

reference_raw: He could not stop himself from catching her as she fell, and now the sensation of her, clinging helplessly to his chest, sent arrows of pain through him.

reference_spacy_tokens: He could not stop himself from catching her as she fell , and now the sensation of her , clinging helplessly to his chest , sent arrows of pain through him .


fn_spacy_tokens_for_baseline: " One day I asked her a question as I was getting on , and she just smacked my face .

source_bert_toks: " one day i asked her a question as i was getting on , and she just smacked my face .

reference_raw: "I asked her a question once as I got on, and she slapped me in the face."

reference_spacy_tokens: " I asked her a question once as I got on , and she slapped me in the face . "


fn_spacy_tokens_for_baseline: Now , as the cries of the spectators rose to a crescendo , they were joined by the familiar stomach - turning howl of the charging sepoys , which added an undertow of dread to the Collector 's pleasure .

source_bert_toks: now , as the cries of the spectators rose to a cr ##es ##cend ##o , they were joined by the familiar stomach - turning howl of the charging sep ##oys , which added an under ##tow of dread to the collector ' s pleasure .

reference_raw: Now, as the shouts of the audience rose to a crescendo, they were joined by the familiar gasp of the charging sepoys, which added a tow of fear to the Collector's delight.

reference_spacy_tokens: Now , as the shouts of the audience rose to a crescendo , they were joined by the familiar gasp of the charging sepoys , which added a tow of fear to the Collector 's delight .


fn_spacy_tokens_for_baseline: Sleep - drugged figures stumble quietly around their bivouacs , feeling for the last few items of rain - sodden kit to stow in their bergens .

source_bert_toks: sleep - drugged figures stumble quietly around their bi ##vo ##ua ##cs , feeling for the last few items of rain - so ##dden kit to st ##ow in their bergen ##s .

reference_raw: Sleepy figures stumbling silently around their bivouacs, feeling for the last few items of rain-sodden kit to be stored in their bergens.

reference_spacy_tokens: Sleepy figures stumbling silently around their bivouacs , feeling for the last few items of rain - sodden kit to be stored in their bergens .


fn_spacy_tokens_for_baseline: I mention this , as I am planning to visit you next week , to continue our discussion on euthanasia ( although I hope you will not be disappointed to discover that my views have altered ) .

source_bert_toks: i mention this , as i am planning to visit you next week , to continue our discussion on eu ##than ##asia ( although i hope you will not be disappointed to discover that my views have altered ) .

reference_raw: I mention it because I'm going to visit you next week and continue to discuss euthanasia (although I hope you won't be disappointed to see that I've changed my mind).

reference_spacy_tokens: I mention it because I 'm going to visit you next week and continue to discuss euthanasia ( although I hope you wo n't be disappointed to see that I 've changed my mind ) .


fn_spacy_tokens_for_baseline: According to Michael Eisenstadt , Iran " probably is researching such standard agents as anthrax and botulin toxin and it has shown interest in acquiring materials which could be used to produce ricin and mycotoxins . "

source_bert_toks: according to michael e ##isen ##stadt , iran " probably is researching such standard agents as ant ##hra ##x and bot ##ulin toxin and it has shown interest in acquiring materials which could be used to produce ric ##in and my ##cot ##ox ##ins . "

reference_raw: In the opinion of Michael Eisenstadt, Iran "probably researchs standard agents such as anthrax and botulin toxin and has shown interest in acquiring materials that can be used for the production of ricin and mycotoxins."

reference_spacy_tokens: In the opinion of Michael Eisenstadt , Iran " probably researchs standard agents such as anthrax and botulin toxin and has shown interest in acquiring materials that can be used for the production of ricin and mycotoxins . "


fn_spacy_tokens_for_baseline: Many girls longed to ' lose ' their bottoms or breasts or stomachs -- and not just those with eating disorders .

source_bert_toks: many girls longed to ' lose ' their bottoms or breasts or stomach ##s - - and not just those with eating disorders .

reference_raw: A lot of girls wanted to "lose" their bottoms, chests, or stomachs--and not just the ones with eating disorders.

reference_spacy_tokens: A lot of girls wanted to " lose " their bottoms , chests , or stomachs -- and not just the ones with eating disorders .


fn_spacy_tokens_for_baseline: The Arsenal machine had been perfected , and the 1930 Cup triumph was to usher in a glorious future .

source_bert_toks: the arsenal machine had been perfect ##ed , and the 1930 cup triumph was to usher in a glorious future .

reference_raw: The arsenal machine was upgraded, and the triumph of the 1930 Cup was for usher in a glorious future.

reference_spacy_tokens: The arsenal machine was upgraded , and the triumph of the 1930 Cup was for usher in a glorious future .


fn_spacy_tokens_for_baseline: Eichmann 's challenge in Budapest was to liquidate the last substantial urban Jewish community in Nazi - dominated Europe , some 230,000 trapped people .

source_bert_toks: e ##ich ##mann ' s challenge in budapest was to liquid ##ate the last substantial urban jewish community in nazi - dominated europe , some 230 , 000 trapped people .

reference_raw: Eichmann's challenge in Budapest was to destroy the last major urban Jewish community in Europe dominated by the Nazis, with about 230,000 people trapped.

reference_spacy_tokens: Eichmann 's challenge in Budapest was to destroy the last major urban Jewish community in Europe dominated by the Nazis , with about 230,000 people trapped .


fn_spacy_tokens_for_baseline: The Christian soldiers spent a thirsty and sleepless night , their eyes smarting from the smoke which blew into their camp as the enemy systematically set fire to the dry scrub around them .

source_bert_toks: the christian soldiers spent a thirsty and sleep ##less night , their eyes smart ##ing from the smoke which blew into their camp as the enemy systematically set fire to the dry scrub around them .

reference_raw: Christian soldiers spent a thirsty and sleepless night, their eyes bright with the smoke that swept through their camp as the enemy systematically burned the dry scrub around them.

reference_spacy_tokens: Christian soldiers spent a thirsty and sleepless night , their eyes bright with the smoke that swept through their camp as the enemy systematically burned the dry scrub around them .


fn_spacy_tokens_for_baseline: There seemed to be the fairly uncomplicated desire among the community to see all the children attend the same school , as an expression of relationships existing within the community .

source_bert_toks: there seemed to be the fairly un ##com ##pl ##icated desire among the community to see all the children attend the same school , as an expression of relationships existing within the community .

reference_raw: There seemed to be a rather uncomplicated longing in the community to see all children go to the same school as an expression of the relationship that existed in the community.

reference_spacy_tokens: There seemed to be a rather uncomplicated longing in the community to see all children go to the same school as an expression of the relationship that existed in the community .


fn_spacy_tokens_for_baseline: I 'd take acid , speed , hash as well .

source_bert_toks: i ' d take acid , speed , hash as well .

reference_raw: I'd take the acid, the velocity, the hash.

reference_spacy_tokens: I 'd take the acid , the velocity , the hash .


fn_spacy_tokens_for_baseline: Consequently , the concept of sovereignty was replaced with that of ' public service ' ; the state exists merely to perform certain tasks which are necessary for the preservation and promotion of social solidarity .

source_bert_toks: consequently , the concept of sovereignty was replaced with that of ' public service ' ; the state exists merely to perform certain tasks which are necessary for the preservation and promotion of social solidarity .

reference_raw: The concept of sovereignty has therefore been superseded by the concept of "public service"; the State exists only in order to carry out certain tasks necessary to maintain and promote social solidarity.

reference_spacy_tokens: The concept of sovereignty has therefore been superseded by the concept of " public service " ; the State exists only in order to carry out certain tasks necessary to maintain and promote social solidarity .


fn_spacy_tokens_for_baseline: For this purpose a test may be used to discriminate those pupils who have attained a higher level from those at a lower level .

source_bert_toks: for this purpose a test may be used to disc ##rim ##inate those pupils who have attained a higher level from those at a lower level .

reference_raw: To that end, the test may be used to distinguish pupils who have reached a higher level from those who have reached a lower level.

reference_spacy_tokens: To that end , the test may be used to distinguish pupils who have reached a higher level from those who have reached a lower level .


fn_spacy_tokens_for_baseline: Should n't say things like that , I suppose , ' he simpered , ' but all my friends are going off and doing it .

source_bert_toks: shouldn ' t say things like that , i suppose , ' he sim ##per ##ed , ' but all my friends are going off and doing it .

reference_raw: I don't think I'm supposed to say that sort of thing," he said, "but all my friends are going to go out and do it.

reference_spacy_tokens: I do n't think I 'm supposed to say that sort of thing , " he said , " but all my friends are going to go out and do it .


fn_spacy_tokens_for_baseline: But it was years later that the ecstasy of drugs would join their repertory of World Cup disasters .

source_bert_toks: but it was years later that the ecstasy of drugs would join their repertory of world cup disasters .

reference_raw: But years later, drug ecstasy will join their repertoire of the World Cup disasters.

reference_spacy_tokens: But years later , drug ecstasy will join their repertoire of the World Cup disasters .


fn_spacy_tokens_for_baseline: He propelled Mattie through the door with some force , and bade her a hasty farewell .

source_bert_toks: he propelled matt ##ie through the door with some force , and bad ##e her a hasty farewell .

reference_raw: He pushed Mattie through the door with some force and hurriedly said good-bye.

reference_spacy_tokens: He pushed Mattie through the door with some force and hurriedly said good - bye .


fn_spacy_tokens_for_baseline: Sunday morning was hardly less hectic .

source_bert_toks: sunday morning was hardly less he ##ctic .

reference_raw: Sunday morning was hardly less hectical.

reference_spacy_tokens: Sunday morning was hardly less hectical .


fn_spacy_tokens_for_baseline: ' He loves you dearly , Wilson , ' Mrs Browning murmured .

source_bert_toks: ' he loves you dear ##ly , wilson , ' mrs browning murmured .

reference_raw: 'She loves you very much, Wilson,' whispered Mrs Browning.

reference_spacy_tokens: ' She loves you very much , Wilson , ' whispered Mrs Browning .


fn_spacy_tokens_for_baseline: Nell emerged from the noise of the crowd and came across towards us , a clipboard clasped to her chest , her eyes shining .

source_bert_toks: nell emerged from the noise of the crowd and came across towards us , a clip ##board clasped to her chest , her eyes shining .

reference_raw: Nell came out of the crowd and came to us, a clipboard pressed to her chest, her eyes gleaming.

reference_spacy_tokens: Nell came out of the crowd and came to us , a clipboard pressed to her chest , her eyes gleaming .


fn_spacy_tokens_for_baseline: Along with this splendid house of worship , Solomon built a royal palace , mansions for his wives , temples for the foreign gods worshipped by the princesses he had married , and towers for the defense of the capital .

source_bert_toks: along with this splendid house of worship , solomon built a royal palace , mansions for his wives , temples for the foreign gods worshipped by the princess ##es he had married , and towers for the defense of the capital .

reference_raw: Together with this magnificent house of worship, Solomon built a royal palace, a mansion for his women, a temple for the foreign gods worshipped by the princesses he had taken, and a tower to defend the capital.

reference_spacy_tokens: Together with this magnificent house of worship , Solomon built a royal palace , a mansion for his women , a temple for the foreign gods worshipped by the princesses he had taken , and a tower to defend the capital .


fn_spacy_tokens_for_baseline: The results of the banks ' self - imposed credit rationing , and of the mounting creditor distress , are beginning to show in the leap in outstanding commercial paper issued by non - financial companies .

source_bert_toks: the results of the banks ' self - imposed credit ratio ##ning , and of the mounting credit ##or distress , are beginning to show in the leap in outstanding commercial paper issued by non - financial companies .

reference_raw: The results of the bank's self-imposed credit rationing and the mounting creditor stress are beginning to show in the leap of unresolved commercial paper issued by non-financial corporations.

reference_spacy_tokens: The results of the bank 's self - imposed credit rationing and the mounting creditor stress are beginning to show in the leap of unresolved commercial paper issued by non - financial corporations .


fn_spacy_tokens_for_baseline: I was now very weak from lack of food , and I began to wonder why I should struggle to stay alive , when I did not want to live .

source_bert_toks: i was now very weak from lack of food , and i began to wonder why i should struggle to stay alive , when i did not want to live .

reference_raw: Now I was very tired of lacking food, and I began to wonder why I should fight to survive if I didn't want to live.

reference_spacy_tokens: Now I was very tired of lacking food , and I began to wonder why I should fight to survive if I did n't want to live .


fn_spacy_tokens_for_baseline: When finished , pull the little loop at the left of the cast on and the first row will tighten up very neatly -- the yarn from the holding position row pulls through .

source_bert_toks: when finished , pull the little loop at the left of the cast on and the first row will tighten up very neatly - - the yarn from the holding position row pulls through .

reference_raw: When you're done, pull a small loop to the right of the cast, and the first row tightens very neatly - the thread from the holding position line pulls through.

reference_spacy_tokens: When you 're done , pull a small loop to the right of the cast , and the first row tightens very neatly - the thread from the holding position line pulls through .


fn_spacy_tokens_for_baseline: This could put you at risk .

source_bert_toks: this could put you at risk .

reference_raw: That could endanger you.

reference_spacy_tokens: That could endanger you .


fn_spacy_tokens_for_baseline: Media theories for the present must , therefore , make the absence of state control their cornerstone .

source_bert_toks: media theories for the present must , therefore , make the absence of state control their cornerstone .

reference_raw: The media theories of the present should therefore make the lack of state control their cornerstone.

reference_spacy_tokens: The media theories of the present should therefore make the lack of state control their cornerstone .


fn_spacy_tokens_for_baseline: Delighted we darted off to Niel to report this scurrilous comment .

source_bert_toks: delighted we darted off to ni ##el to report this sc ##ur ##ril ##ous comment .

reference_raw: We went to Niel with pleasure to report this scurrying comment.

reference_spacy_tokens: We went to Niel with pleasure to report this scurrying comment .


fn_spacy_tokens_for_baseline: Manufacturers must also warn mothers that the powdered milk must be mixed with boiled water .

source_bert_toks: manufacturers must also warn mothers that the powder ##ed milk must be mixed with boiled water .

reference_raw: Manufacturers must also warn mothers that the powdered dairy must be mixed with boiled water.

reference_spacy_tokens: Manufacturers must also warn mothers that the powdered dairy must be mixed with boiled water .