fn_spacy_tokens_for_baseline: Then we enter the famous city of Gettysburg , site of the last and most decisive battle of the Civil War .

source_bert_toks: then we enter the famous city of gettysburg , site of the last and most decisive battle of the civil war .

reference_raw: Then we enter the glorious city of Gettysburg, where the last and most decisive battle of the Civil War was fought.

reference_spacy_tokens: Then we enter the glorious city of Gettysburg , where the last and most decisive battle of the Civil War was fought .


fn_spacy_tokens_for_baseline: The hosts , and what a superbly organised lot they were , with the help of few French travellers , gave a good account of themselves , notably against the tiring Irish .

source_bert_toks: the hosts , and what a superb ##ly organised lot they were , with the help of few french travellers , gave a good account of themselves , notably against the ti ##ring irish .

reference_raw: With the help of few French travellers, the hosts, and how well organized they were, gave a good account of themselves, especially against the weary Irish.

reference_spacy_tokens: With the help of few French travellers , the hosts , and how well organized they were , gave a good account of themselves , especially against the weary Irish .


fn_spacy_tokens_for_baseline: Then she must sit in the sun before hauling it back up and altogether I was enraged and wished I was in a condition to show her how it should be done .

source_bert_toks: then she must sit in the sun before hauling it back up and altogether i was enraged and wished i was in a condition to show her how it should be done .

reference_raw: Then she had to sit in the sun before hauling him back up, and I was furious, wishing I could show her how to do it.

reference_spacy_tokens: Then she had to sit in the sun before hauling him back up , and I was furious , wishing I could show her how to do it .


fn_spacy_tokens_for_baseline: Railway officials , like their political bosses in Moscow , were apt to muse on the brilliant future in order to escape from pressing current problems .

source_bert_toks: railway officials , like their political bosses in moscow , were apt to muse on the brilliant future in order to escape from pressing current problems .

reference_raw: Railroad officials, like their political leaders in Moscow, were able to entertain a brilliant future in order to avoid pressing current problems.

reference_spacy_tokens: Railroad officials , like their political leaders in Moscow , were able to entertain a brilliant future in order to avoid pressing current problems .


fn_spacy_tokens_for_baseline: Before caution could restrain the impulse , he placed his hand over hers where she was resting it on the low wall in front of them .

source_bert_toks: before caution could restrain the impulse , he placed his hand over hers where she was resting it on the low wall in front of them .

reference_raw: Before caution could contain the impulse, he placed his hand on hers, where she laid it against the low wall before them.

reference_spacy_tokens: Before caution could contain the impulse , he placed his hand on hers , where she laid it against the low wall before them .


fn_spacy_tokens_for_baseline: In 1984 , East Germany ( GDR ) supplied Iran with 5,000 " respirators , " which turned out to be industrial half - masks with goggles , which are unsuitable for chemical defense .

source_bert_toks: in 1984 , east germany ( g ##dr ) supplied iran with 5 , 000 " res ##pi ##rator ##s , " which turned out to be industrial half - masks with go ##ggles , which are unsuitable for chemical defense .

reference_raw: In 1984, East Germany (GDR) delivered 5,000 "respirators" to Iran, which turned out to be an industrial half-mask with glasses that were not suitable for chemical defense.

reference_spacy_tokens: In 1984 , East Germany ( GDR ) delivered 5,000 " respirators " to Iran , which turned out to be an industrial half - mask with glasses that were not suitable for chemical defense .


fn_spacy_tokens_for_baseline: Impeccably groomed and known for her love of designer clothes and antique jewellery , she has designs on the University , raising its image in all areas .

source_bert_toks: imp ##ec ##ca ##bly groom ##ed and known for her love of designer clothes and antique jewellery , she has designs on the university , raising its image in all areas .

reference_raw: She's perfectly groomed and famous for her love of designer clothing and antique jewelry, and she's got designs at the university that raise her image in all areas.

reference_spacy_tokens: She 's perfectly groomed and famous for her love of designer clothing and antique jewelry , and she 's got designs at the university that raise her image in all areas .


fn_spacy_tokens_for_baseline: Friends say she never recovered from hearing Gilbey , who she had been dating for two years , tell Diana he loved her -- 53 times in the 23 minute call .

source_bert_toks: friends say she never recovered from hearing gil ##bey , who she had been dating for two years , tell diana he loved her - - 53 times in the 23 minute call .

reference_raw: Friends say she didn't recover from hearing Gilbey, who she'd been with for two years, tell Diana that he loved her -- 53 times in a 23-minute call.

reference_spacy_tokens: Friends say she did n't recover from hearing Gilbey , who she 'd been with for two years , tell Diana that he loved her -- 53 times in a 23-minute call .


fn_spacy_tokens_for_baseline: The Bible describes how David 's soldiers conquered Jerusalem by discovering a water tunnel under the walls and using it to take the city by surprise .

source_bert_toks: the bible describes how david ' s soldiers conquered jerusalem by discovering a water tunnel under the walls and using it to take the city by surprise .

reference_raw: The Bible describes how David's soldiers conquered Jerusalem... ...by discovering the water tunnel beneath the battlements... ...and using it to surprise the city.

reference_spacy_tokens: The Bible describes how David 's soldiers conquered Jerusalem ... ... by discovering the water tunnel beneath the battlements ... ... and using it to surprise the city .


fn_spacy_tokens_for_baseline: Beyond , in the New Territories , are a mixture of high - rise suburban towns , ancient sites and walled villages , country parks , and farms with ducks and fish ponds .

source_bert_toks: beyond , in the new territories , are a mixture of high - rise suburban towns , ancient sites and walled villages , country parks , and farms with ducks and fish ponds .

reference_raw: Beyond, in the new territories, there is a mixture of high-rise suburbs, old places and walled villages, rural parks and farms with ducks and fish ponds.

reference_spacy_tokens: Beyond , in the new territories , there is a mixture of high - rise suburbs , old places and walled villages , rural parks and farms with ducks and fish ponds .


fn_spacy_tokens_for_baseline: Pay a visit to the Casa Museu da Taipa , and you 'll be able to get a glimpse of how Macanese families lived in former days .

source_bert_toks: pay a visit to the casa muse ##u da tai ##pa , and you ' ll be able to get a glimpse of how mac ##ane ##se families lived in former days .

reference_raw: You visit the Casa Museu da Taipa, and you'll see how the Macanese families survived in the old days.

reference_spacy_tokens: You visit the Casa Museu da Taipa , and you 'll see how the Macanese families survived in the old days .


fn_spacy_tokens_for_baseline: If Oliver 's fear was slightly more explicit than is common , this was merely because killing people was a concept he dwelt upon fairly frequently and with lively interest .

source_bert_toks: if oliver ' s fear was slightly more explicit than is common , this was merely because killing people was a concept he d ##we ##lt upon fairly frequently and with lively interest .

reference_raw: If Oliver's fear was a little clearer than usual, it was only because killing people was a concept he'd lived on quite often and with a lively interest.

reference_spacy_tokens: If Oliver 's fear was a little clearer than usual , it was only because killing people was a concept he 'd lived on quite often and with a lively interest .


fn_spacy_tokens_for_baseline: The leather chafed her heels and the straps felt as if they were going to crush her bones .

source_bert_toks: the leather cha ##fed her heels and the straps felt as if they were going to crush her bones .

reference_raw: The leather clasped her heels, and the straps seemed to smash her bones.

reference_spacy_tokens: The leather clasped her heels , and the straps seemed to smash her bones .


fn_spacy_tokens_for_baseline: Efforts are made to rehabilitate patients after treatment to ensure that where possible their hospital stay is temporary .

source_bert_toks: efforts are made to rehab ##ili ##tate patients after treatment to ensure that where possible their hospital stay is temporary .

reference_raw: Efforts are made to treat patients after treatment in order to ensure that their hospital stay is temporary where possible.

reference_spacy_tokens: Efforts are made to treat patients after treatment in order to ensure that their hospital stay is temporary where possible .


fn_spacy_tokens_for_baseline: Britain defines it in terms of competition and free trading ; most of the other countries conceive of it in terms of minimum operating standards .

source_bert_toks: britain defines it in terms of competition and free trading ; most of the other countries con ##ce ##ive of it in terms of minimum operating standards .

reference_raw: Britain defines it in terms of competition and free trade; most other countries consider it in terms of minimum operating standards.

reference_spacy_tokens: Britain defines it in terms of competition and free trade ; most other countries consider it in terms of minimum operating standards .


fn_spacy_tokens_for_baseline: True enough , and , despite the dissimilarities among families , the impressions taken from each matrix are likely to be of similar depth and importance .

source_bert_toks: true enough , and , despite the di ##ssi ##mi ##lar ##ities among families , the impressions taken from each matrix are likely to be of similar depth and importance .

reference_raw: True enough, and despite the differences between families, the impressions taken from each matrix are likely to have the same depth and importance.

reference_spacy_tokens: True enough , and despite the differences between families , the impressions taken from each matrix are likely to have the same depth and importance .


fn_spacy_tokens_for_baseline: I was a teenager , prone to the daftness that goes with that age group , and knew no better .

source_bert_toks: i was a teenager , prone to the da ##ft ##ness that goes with that age group , and knew no better .

reference_raw: I was a teenager, sensitive to the daftness of this age group, and I didn't know any better.

reference_spacy_tokens: I was a teenager , sensitive to the daftness of this age group , and I did n't know any better .


fn_spacy_tokens_for_baseline: Ayliffe chaired the committee which produced the draft of the new constitution which was adopted by the next Congress in Birmingham in 1922 .

source_bert_toks: a ##yl ##iff ##e chaired the committee which produced the draft of the new constitution which was adopted by the next congress in birmingham in 1922 .

reference_raw: Ayliffe presided over a committee that drafted a new constitution that was adopted by the next Congress in Birmingham in 1922.

reference_spacy_tokens: Ayliffe presided over a committee that drafted a new constitution that was adopted by the next Congress in Birmingham in 1922 .


fn_spacy_tokens_for_baseline: Rainbow jumps , spilling coffee all over the table and herself .

source_bert_toks: rainbow jumps , spilling coffee all over the table and herself .

reference_raw: Rainbow jumps and pours coffee all over the table and herself.

reference_spacy_tokens: Rainbow jumps and pours coffee all over the table and herself .


fn_spacy_tokens_for_baseline: He fell on his knees and grasped his monarch around his legs .

source_bert_toks: he fell on his knees and grasped his monarch around his legs .

reference_raw: He dropped to his knees and gripped the monarch's legs.

reference_spacy_tokens: He dropped to his knees and gripped the monarch 's legs .


fn_spacy_tokens_for_baseline: Iraq has been under economic sanctions since the war ended , which some say have thwarted the country 's ability to recover from the devastation of the bombing campaign .

source_bert_toks: iraq has been under economic sanctions since the war ended , which some say have thwarted the country ' s ability to recover from the devastation of the bombing campaign .

reference_raw: Since the end of the war, Iraq has been subject to economic sanctions, which some say undermined the country's ability to recuperate from the destruction of the bombing campaign.

reference_spacy_tokens: Since the end of the war , Iraq has been subject to economic sanctions , which some say undermined the country 's ability to recuperate from the destruction of the bombing campaign .


fn_spacy_tokens_for_baseline: She talked about her boyfriends in a tone of most frightful , spine - chilling , whimsy determination , and they took it .

source_bert_toks: she talked about her boyfriend ##s in a tone of most fright ##ful , spine - chilling , w ##him ##sy determination , and they took it .

reference_raw: She spoke of her friends in a voice of the most terrible, spinal chilling, whimsical determination, and they took it.

reference_spacy_tokens: She spoke of her friends in a voice of the most terrible , spinal chilling , whimsical determination , and they took it .


fn_spacy_tokens_for_baseline: Thousands of young women helped to build the church of God with their body , blood and bones when frenzied fathers , husbands or fiances preferred to see them die by fire , sword or the fangs of wild beasts rather than live to flout [ sic ] the duty and destiny of womanhood .

source_bert_toks: thousands of young women helped to build the church of god with their body , blood and bones when fr ##en ##zie ##d fathers , husbands or fiance ##s preferred to see them die by fire , sword or the fangs of wild beasts rather than live to fl ##out [ sic ] the duty and destiny of woman ##hood .

reference_raw: Thousands of young women helped build the Church of God with their flesh, blood, and bones, when furious fathers, husbands, and fiancées preferred to watch them die by fire, sword, or fangs of wild animals, rather than survive to flaunt the duty and fate of femininity.

reference_spacy_tokens: Thousands of young women helped build the Church of God with their flesh , blood , and bones , when furious fathers , husbands , and fiancees preferred to watch them die by fire , sword , or fangs of wild animals , rather than survive to flaunt the duty and fate of femininity .


fn_spacy_tokens_for_baseline: ' I 've heard they are here but they can not do anything , ' he said , pulling out and brandishing a pistol stuffed down his trouser waistband .

source_bert_toks: ' i ' ve heard they are here but they can not do anything , ' he said , pulling out and brand ##ishing a pistol stuffed down his tr ##ouse ##r waistband .

reference_raw: "I hear they're here, but there's nothing they can do," he said, pulling out and waving the gun stuffed into his pants belt.

reference_spacy_tokens: " I hear they 're here , but there 's nothing they can do , " he said , pulling out and waving the gun stuffed into his pants belt .


fn_spacy_tokens_for_baseline: As acting Chief of Staff of the Armed Forces Ramos had led the military mutiny in early 1986 in support of President Corazon Aquino which had finally driven Marcos from office .

source_bert_toks: as acting chief of staff of the armed forces ramos had led the military mutiny in early 1986 in support of president cora ##zon aquino which had finally driven marcos from office .

reference_raw: Ramos, acting Chief of Staff of the Armed Forces, led a military rebellion in early 1986 in support of President Corazon Aquino, who finally pushed Marcos out of office.

reference_spacy_tokens: Ramos , acting Chief of Staff of the Armed Forces , led a military rebellion in early 1986 in support of President Corazon Aquino , who finally pushed Marcos out of office .


fn_spacy_tokens_for_baseline: Research shows that in 1990 about 60 % of us received calls from telephone salesmen , yet three quarters of us object to them .

source_bert_toks: research shows that in 1990 about 60 % of us received calls from telephone sales ##men , yet three quarters of us object to them .

reference_raw: Research shows that around 60% of us received calls from phone vendors in 1990, but three-quarters of us object.

reference_spacy_tokens: Research shows that around 60 % of us received calls from phone vendors in 1990 , but three - quarters of us object .


fn_spacy_tokens_for_baseline: Of 8,855 miles of five - foot gauge railroad laid across the Southern States , most had been engineered by Scots .

source_bert_toks: of 8 , 85 ##5 miles of five - foot gauge railroad laid across the southern states , most had been engineered by scots .

reference_raw: Of the 8,855 miles of the five-foot-meter railways located in the southern states, most of them were engineered by the Scots.

reference_spacy_tokens: Of the 8,855 miles of the five - foot - meter railways located in the southern states , most of them were engineered by the Scots .


fn_spacy_tokens_for_baseline: A Humboldt veteran 's tie to the new Hawaiian Islands monument : The nation 's newest national monument , a chain of islands that sweeps northwest from Hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

source_bert_toks: a humboldt veteran ' s tie to the new hawaiian islands monument : the nation ' s newest national monument , a chain of islands that sweeps northwest from hawaii , has a darker past than its azure waters and low - slung white sand beaches would reveal .

reference_raw: The Humboldt veteran's tie to the new Hawaiian island monument: the nation's most recent national monument, the chain of islands sweeping northwest of Hawaii, has a darker past than its azure waters, and low - the slung white sandy beaches will be exposed.

reference_spacy_tokens: The Humboldt veteran 's tie to the new Hawaiian island monument : the nation 's most recent national monument , the chain of islands sweeping northwest of Hawaii , has a darker past than its azure waters , and low - the slung white sandy beaches will be exposed .


fn_spacy_tokens_for_baseline: Trees and hedges have been deformed by the fierce salt spray and strong sea winds during winter .

source_bert_toks: trees and hedges have been def ##or ##med by the fierce salt spray and strong sea winds during winter .

reference_raw: In winter, the trees and hedges were distorted by fierce salt spray and strong sea winds.

reference_spacy_tokens: In winter , the trees and hedges were distorted by fierce salt spray and strong sea winds .


fn_spacy_tokens_for_baseline: Athens became the most powerful , heralding the start of the classical Greek period .

source_bert_toks: athens became the most powerful , herald ##ing the start of the classical greek period .

reference_raw: Athens has become the most powerful and heroic at the beginning of the classic Greek era.

reference_spacy_tokens: Athens has become the most powerful and heroic at the beginning of the classic Greek era .


fn_spacy_tokens_for_baseline: By ten p.m. certain members of the company were sniffing coke or had been turned on by acid or speed or grass .

source_bert_toks: by ten p . m . certain members of the company were sniffing coke or had been turned on by acid or speed or grass .

reference_raw: By ten o'clock in the afternoon, some of the members of the company had been sniffing cocaine, or had been turned on by acid, speed, or grass.

reference_spacy_tokens: By ten o'clock in the afternoon , some of the members of the company had been sniffing cocaine , or had been turned on by acid , speed , or grass .


fn_spacy_tokens_for_baseline: The 1990s saw the rise of right - wing terrorism , including neo - Nazis and neo - Fascists in Europe and white supremacists and anti - government ( " Patriot " ) organizations in the United States .

source_bert_toks: the 1990s saw the rise of right - wing terrorism , including neo - nazis and neo - fascist ##s in europe and white su ##pre ##mac ##ists and anti - government ( " patriot " ) organizations in the united states .

reference_raw: In the 1990s, right-wing terrorism, including neo-Nazis and neo-fascists in Europe, white supremacists, and anti-Government ("Patriot") organizations in the United States, grew.

reference_spacy_tokens: In the 1990s , right - wing terrorism , including neo - Nazis and neo - fascists in Europe , white supremacists , and anti - Government ( " Patriot " ) organizations in the United States , grew .


fn_spacy_tokens_for_baseline: It 's a long way down into the gulch .

source_bert_toks: it ' s a long way down into the gu ##lch .

reference_raw: It's a long way to the mouth.

reference_spacy_tokens: It 's a long way to the mouth .


fn_spacy_tokens_for_baseline: Location : Latitude 35i¿½ 42 ' North ; longitude 51i¿½ 24 ' East ; province of Tehran

source_bert_toks: location : latitude 35 ##i ¿ ½ 42 ' north ; longitude 51 ##i ¿ ½ 24 ' east ; province of tehran

reference_raw: Position: latitude 35i11; north; longitude 51i1/2 24' east; provinciality of Tehran

reference_spacy_tokens: Position : latitude 35i11 ; north ; longitude 51i1/2 24 ' east ; provinciality of Tehran


fn_spacy_tokens_for_baseline: For once the NFL schedule - makers appeared ..

source_bert_toks: for once the nfl schedule - makers appeared . .

reference_raw: For the first time, the NFL planners showed up...

reference_spacy_tokens: For the first time , the NFL planners showed up ...


fn_spacy_tokens_for_baseline: However , care should be taken that they do not lose their exceptional hardiness and thriftiness in pursuit of greater yields , and also that they do not become extinct through being crossed with Friesians .

source_bert_toks: however , care should be taken that they do not lose their exceptional hardin ##ess and th ##rift ##iness in pursuit of greater yields , and also that they do not become extinct through being crossed with fries ##ians .

reference_raw: However, it is important to ensure that they do not lose their exceptional hardship and prosperity in the pursuit of higher yields, and that they do not become extinct by being crossed with the Friesians.

reference_spacy_tokens: However , it is important to ensure that they do not lose their exceptional hardship and prosperity in the pursuit of higher yields , and that they do not become extinct by being crossed with the Friesians .


fn_spacy_tokens_for_baseline: Words such as tramp , hobo and vagrant offended him , terms bandied about by an unsympathetic society .

source_bert_toks: words such as tram ##p , ho ##bo and va ##grant offended him , terms band ##ied about by an un ##sy ##mp ##ath ##etic society .

reference_raw: Words like tramps, hobos, and vagrants insulted him, terms bound by an unsympathetic society.

reference_spacy_tokens: Words like tramps , hobos , and vagrants insulted him , terms bound by an unsympathetic society .


fn_spacy_tokens_for_baseline: The lower storey has thick walls while the upper one has thinner walls set back to form a terrace all round at first floor level .

source_bert_toks: the lower storey has thick walls while the upper one has thinner walls set back to form a terrace all round at first floor level .

reference_raw: The lower floor has heavy walls, while the upper floor has thinner walls set back to form a terrace all around the first floor.

reference_spacy_tokens: The lower floor has heavy walls , while the upper floor has thinner walls set back to form a terrace all around the first floor .


fn_spacy_tokens_for_baseline: The ideal broodmare should like people , be tolerant of all manner of handling , and be sociable with other horses .

source_bert_toks: the ideal brood ##mare should like people , be tolerant of all manner of handling , and be soc ##iable with other horses .

reference_raw: Ideal broodmare should like humans, be tolerant of all sorts of handling, and be social with other horses.

reference_spacy_tokens: Ideal broodmare should like humans , be tolerant of all sorts of handling , and be social with other horses .


fn_spacy_tokens_for_baseline: The inspection commenced at the Penge entrance to the Crystal Palace grounds , where the Colonel was welcomed by Mr. P. W. Greetham , Chairman of Penge U.D.C.

source_bert_toks: the inspection commenced at the peng ##e entrance to the crystal palace grounds , where the colonel was welcomed by mr . p . w . greet ##ham , chairman of peng ##e u . d . c .

reference_raw: The inspection began at the entrance to Crystal Palace, where Mr. P.W. Greetham, President of Penge U.D.C., welcomed the colonel.

reference_spacy_tokens: The inspection began at the entrance to Crystal Palace , where Mr. P.W. Greetham , President of Penge U.D.C. , welcomed the colonel .


fn_spacy_tokens_for_baseline: Neighbours and friends keep telling me I look slim ..

source_bert_toks: neighbours and friends keep telling me i look slim . .

reference_raw: Neighbours and friends keep telling me that I look thin...

reference_spacy_tokens: Neighbours and friends keep telling me that I look thin ...


fn_spacy_tokens_for_baseline: He must be pretty mad at her for not being at home when they arrived .

source_bert_toks: he must be pretty mad at her for not being at home when they arrived .

reference_raw: He must have been pretty pissed at her for not being home when they got here.

reference_spacy_tokens: He must have been pretty pissed at her for not being home when they got here .


fn_spacy_tokens_for_baseline: She still retained her English habit of noting each day 's weather , always expecting changes , marvelling at the hot sunny days which followed one after the other , almost with monotony .

source_bert_toks: she still retained her english habit of noting each day ' s weather , always expecting changes , marvel ##ling at the hot sunny days which followed one after the other , almost with mono ##ton ##y .

reference_raw: She kept her English habit of noting the weather every day, always expecting change, marveling at the hot sunny days that followed one by one, almost monotonous.

reference_spacy_tokens: She kept her English habit of noting the weather every day , always expecting change , marveling at the hot sunny days that followed one by one , almost monotonous .


fn_spacy_tokens_for_baseline: ' Well , they like going on junkets to exotic places . '

source_bert_toks: ' well , they like going on junk ##ets to exotic places . '

reference_raw: 'Well, they like to go to exotic places on junk.'

reference_spacy_tokens: ' Well , they like to go to exotic places on junk . '


fn_spacy_tokens_for_baseline: As on every other Saturday morning , the inhabitants of Little Saigon in Orange county will crowd around their televisions to watch an hour and a half of Vietnamese programmes .

source_bert_toks: as on every other saturday morning , the inhabitants of little saigon in orange county will crowd around their television ##s to watch an hour and a half of vietnamese programmes .

reference_raw: Like every other Saturday morning, the citizens of Little Saigon in Orange County would crowd around their TVs to watch an hour and a half of the Vietnamese programs.

reference_spacy_tokens: Like every other Saturday morning , the citizens of Little Saigon in Orange County would crowd around their TVs to watch an hour and a half of the Vietnamese programs .


fn_spacy_tokens_for_baseline: The Central Council of Church Bell Ringers , a sort of parliament of ringing groups , aims to improve relations with vicars , says John C. Baldwin , president .

source_bert_toks: the central council of church bell ring ##ers , a sort of parliament of ringing groups , aims to improve relations with vicar ##s , says john c . baldwin , president .

reference_raw: According to John C. Baldwin, President, the Central Council of Church Bell Ringers, a kind of parliament of ringing groups, seeks to improve relationships with the vicars.

reference_spacy_tokens: According to John C. Baldwin , President , the Central Council of Church Bell Ringers , a kind of parliament of ringing groups , seeks to improve relationships with the vicars .


fn_spacy_tokens_for_baseline: Yet even as I remember Victoria , I feel keenly the unsettled state of my mind .

source_bert_toks: yet even as i remember victoria , i feel keen ##ly the un ##sett ##led state of my mind .

reference_raw: But even though I remember Victoria, I can feel the restless state of my mind.

reference_spacy_tokens: But even though I remember Victoria , I can feel the restless state of my mind .


fn_spacy_tokens_for_baseline: Your hotel concierge or tour desk has current schedules and can book tickets for you .

source_bert_toks: your hotel con ##cier ##ge or tour desk has current schedules and can book tickets for you .

reference_raw: There are current schedules for your hotel concierge or tour table, and you can get tickets.

reference_spacy_tokens: There are current schedules for your hotel concierge or tour table , and you can get tickets .


fn_spacy_tokens_for_baseline: The man collapsed against the wall and slid down it making gurgling noises .

source_bert_toks: the man collapsed against the wall and slid down it making gu ##rg ##ling noises .

reference_raw: The man collapsed against the wall and slipped down it with a gurgling sound.

reference_spacy_tokens: The man collapsed against the wall and slipped down it with a gurgling sound .


fn_spacy_tokens_for_baseline: It was the middle - class , and especially Dissenters and Evangelicals , who wrote regular diaries as an aid to daily reviews of conduct and repentance for sin .

source_bert_toks: it was the middle - class , and especially dissent ##ers and evangelical ##s , who wrote regular diaries as an aid to daily reviews of conduct and rep ##ent ##ance for sin .

reference_raw: It was the middle class, especially the dissenters and evangelicals, who wrote regular journals to help the day-to-day reviews of behaviour and penance for sin.

reference_spacy_tokens: It was the middle class , especially the dissenters and evangelicals , who wrote regular journals to help the day - to - day reviews of behaviour and penance for sin .


fn_spacy_tokens_for_baseline: Rhetoric aside , North Korea faces many obstacles in actually employing CW agents , not to mention their manufacture and storage .

source_bert_toks: rhetoric aside , north korea faces many obstacles in actually employing cw agents , not to mention their manufacture and storage .

reference_raw: Rhetorically aside, North Korea faces a number of obstacles to actually employing chemical agents, not to mention their production and storage.

reference_spacy_tokens: Rhetorically aside , North Korea faces a number of obstacles to actually employing chemical agents , not to mention their production and storage .


fn_spacy_tokens_for_baseline: The cafes of Cavaillon are crammed .

source_bert_toks: the cafes of ca ##va ##illon are cr ##ammed .

reference_raw: Cavaillon cafes are crowded.

reference_spacy_tokens: Cavaillon cafes are crowded .


fn_spacy_tokens_for_baseline: I found out first from the school nurse , who arranged a confidential test .

source_bert_toks: i found out first from the school nurse , who arranged a confidential test .

reference_raw: The first thing I learned was from my school nurse, who set up a secret test.

reference_spacy_tokens: The first thing I learned was from my school nurse , who set up a secret test .


fn_spacy_tokens_for_baseline: Continuing around the coast in a counter - clockwise direction , Deep Water Bay offers a good beach and harbors .

source_bert_toks: continuing around the coast in a counter - clockwise direction , deep water bay offers a good beach and harbor ##s .

reference_raw: The Deep Water Bay offers good beaches and ports as it continues to circle the shore in a counter-clockwise direction.

reference_spacy_tokens: The Deep Water Bay offers good beaches and ports as it continues to circle the shore in a counter - clockwise direction .


fn_spacy_tokens_for_baseline: Her third cup of tea she balanced on her stomach , lying full length on the bed and pointing her stockinged toes into the air , sighting various objects over them with one eye closed .

source_bert_toks: her third cup of tea she balanced on her stomach , lying full length on the bed and pointing her stock ##inge ##d toes into the air , sighting various objects over them with one eye closed .

reference_raw: She balanced her third cup of tea on her belly and lay full-length on the bed, tipping her stocking toes into the air, and, with one eye closed, saw various objects above them.

reference_spacy_tokens: She balanced her third cup of tea on her belly and lay full - length on the bed , tipping her stocking toes into the air , and , with one eye closed , saw various objects above them .


fn_spacy_tokens_for_baseline: Depending on personal preference , the user can scan the print - out for errors or amendments needed in wording or layout or , without printing the document , can view what has been written on screen .

source_bert_toks: depending on personal preference , the user can scan the print - out for errors or amendments needed in word ##ing or layout or , without printing the document , can view what has been written on screen .

reference_raw: Depending on the personal preferences, the user may view the printout for errors or changes required in the text or layout or, without printing the document, see what has been written on the screen.

reference_spacy_tokens: Depending on the personal preferences , the user may view the printout for errors or changes required in the text or layout or , without printing the document , see what has been written on the screen .


fn_spacy_tokens_for_baseline: What little new fiction by youngish writers there has been has tended to be incestuous tales of fast - track living in the media boomtown of the Eighties : books sold and written in the Groucho Club bar .

source_bert_toks: what little new fiction by young ##ish writers there has been has tended to be inc ##est ##uous tales of fast - track living in the media boom ##town of the eighties : books sold and written in the gr ##ou ##cho club bar .

reference_raw: What little new novels were made by young writers tended to be incessant stories about fast-track life in the media boomtown of the '80s: books sold and written at the Groucho Club bar.

reference_spacy_tokens: What little new novels were made by young writers tended to be incessant stories about fast - track life in the media boomtown of the ' 80s : books sold and written at the Groucho Club bar .


fn_spacy_tokens_for_baseline: This reconstruction of Rawls ' argument for the doctrine of neutral political concern attempts to found it on the notion of autonomy through the notion of moral self - determination .

source_bert_toks: this reconstruction of raw ##ls ' argument for the doctrine of neutral political concern attempts to found it on the notion of autonomy through the notion of moral self - determination .

reference_raw: This reconstruction of Rawls's claim to a doctrine of neutral political interest attempts to find it on the concept of independence through the concept of moral self-determination.

reference_spacy_tokens: This reconstruction of Rawls 's claim to a doctrine of neutral political interest attempts to find it on the concept of independence through the concept of moral self - determination .


fn_spacy_tokens_for_baseline: A large forest fire that started on Monday , June 9 is still out of control in the municipality of Froland in southern Norway .

source_bert_toks: a large forest fire that started on monday , june 9 is still out of control in the municipality of fr ##ola ##nd in southern norway .

reference_raw: In the town of Froland in southern Norway, the big forest fire that began on Monday, July 9th is still out of control.

reference_spacy_tokens: In the town of Froland in southern Norway , the big forest fire that began on Monday , July 9th is still out of control .


fn_spacy_tokens_for_baseline: The floor was entirely covered with sheet lead , which was protected from wear by oak slats , and the sides , to a height of 3 ft were sheathed with stout zinc sheets .

source_bert_toks: the floor was entirely covered with sheet lead , which was protected from wear by oak sl ##ats , and the sides , to a height of 3 ##ft were sheath ##ed with stout zinc sheets .

reference_raw: The floor was completely covered with lead, shielded from wear by oak slats, and the sides were sheathed with thick zinc blankets to a height of three.

reference_spacy_tokens: The floor was completely covered with lead , shielded from wear by oak slats , and the sides were sheathed with thick zinc blankets to a height of three .


fn_spacy_tokens_for_baseline: Jonna placed his clothes in the sack , slowly descended the ladder and lifted his overcoat from its peg on the back door .

source_bert_toks: jon ##na placed his clothes in the sack , slowly descended the ladder and lifted his over ##coat from its peg on the back door .

reference_raw: Jonna put his clothes in the bag, walked slowly down the ladder, and lifted his coat from the peg on the rear door.

reference_spacy_tokens: Jonna put his clothes in the bag , walked slowly down the ladder , and lifted his coat from the peg on the rear door .


fn_spacy_tokens_for_baseline: Eventually Mina did have a baby -- a son -- and the family was jubilant .

source_bert_toks: eventually mina did have a baby - - a son - - and the family was ju ##bil ##ant .

reference_raw: In the end, Mina had a child - a son - and the family was happy.

reference_spacy_tokens: In the end , Mina had a child - a son - and the family was happy .


fn_spacy_tokens_for_baseline: The desk clerk saw nothing unusual about Kragan ; he was just another businessman in a dark suit with a Liberty 's all - wool overcoat draped over his shoulders .

source_bert_toks: the desk clerk saw nothing unusual about k ##ragan ; he was just another businessman in a dark suit with a liberty ' s all - wool over ##coat draped over his shoulders .

reference_raw: The receptionist didn't see anything unusual about Kragan; he was just another businessman in a dark suit with Liberty's wool overcoat draped over his shoulders.

reference_spacy_tokens: The receptionist did n't see anything unusual about Kragan ; he was just another businessman in a dark suit with Liberty 's wool overcoat draped over his shoulders .


fn_spacy_tokens_for_baseline: Our first patient , also in her 60s , survived three months after the onset of jaundice .

source_bert_toks: our first patient , also in her 60s , survived three months after the onset of ja ##und ##ice .

reference_raw: Our first patient, also 60 years old, survived three months after the onset of hepatitis.

reference_spacy_tokens: Our first patient , also 60 years old , survived three months after the onset of hepatitis .


fn_spacy_tokens_for_baseline: Emigration in search of better living conditions increased whenever there was a crisis in the production or exportation of wine , upon which the island 's economy depended .

source_bert_toks: emigration in search of better living conditions increased whenever there was a crisis in the production or export ##ation of wine , upon which the island ' s economy depended .

reference_raw: Emigration in search of better living conditions increased whenever a wine production or export crisis occurred, on which the island's economy depended.

reference_spacy_tokens: Emigration in search of better living conditions increased whenever a wine production or export crisis occurred , on which the island 's economy depended .


fn_spacy_tokens_for_baseline: ' As you 've gone to so much trouble , it would seem discourteous to refuse , ' Ashley said .

source_bert_toks: ' as you ' ve gone to so much trouble , it would seem disco ##urt ##eous to refuse , ' ashley said .

reference_raw: 'As you've been through so much trouble, it would seem rude to say no,' Ashley said.

reference_spacy_tokens: ' As you 've been through so much trouble , it would seem rude to say no , ' Ashley said .


fn_spacy_tokens_for_baseline: A police inspector , Saul Claveria , had obtained permission to defend his honour after alleging that the editor of the daily newspaper La Republica , Federico Fassano , had accused him of involvement in the smuggling of contraband from Brazil .

source_bert_toks: a police inspector , saul cl ##aver ##ia , had obtained permission to defend his honour after alleging that the editor of the daily newspaper la republic ##a , federico fa ##ssa ##no , had accused him of involvement in the smuggling of contra ##band from brazil .

reference_raw: The police inspector, Saul Claveria, was granted the right to defend his honor when he claimed that the editor of the daily newspaper, La Republica, Federico Fassano, had accused him of being involved in smuggling contra-band from Brazil.

reference_spacy_tokens: The police inspector , Saul Claveria , was granted the right to defend his honor when he claimed that the editor of the daily newspaper , La Republica , Federico Fassano , had accused him of being involved in smuggling contra - band from Brazil .


fn_spacy_tokens_for_baseline: While aims are fairly broad , objectives need to be quite specific .

source_bert_toks: while aims are fairly broad , objectives need to be quite specific .

reference_raw: Although the objectives are relatively broad, the objectives must be quite specific.

reference_spacy_tokens: Although the objectives are relatively broad , the objectives must be quite specific .


fn_spacy_tokens_for_baseline: In the 18 months since the demise of the communist regime in east Germany , prices of land , offices and shops have exploded .

source_bert_toks: in the 18 months since the demise of the communist regime in east germany , prices of land , offices and shops have exploded .

reference_raw: In the 18 months since the collapse of the Communist regime in East Germany, prices of land, offices, and shops exploded.

reference_spacy_tokens: In the 18 months since the collapse of the Communist regime in East Germany , prices of land , offices , and shops exploded .


fn_spacy_tokens_for_baseline: ' But this package is from little Sousan 's kidnappers , surely ? '

source_bert_toks: ' but this package is from little sousa ##n ' s kidnap ##pers , surely ? '

reference_raw: "But this package is definitely from the hijackers of little Sousan?"

reference_spacy_tokens: " But this package is definitely from the hijackers of little Sousan ? "


fn_spacy_tokens_for_baseline: There was even an Irish site destroyed for its own survival rather like the descendant of the prophet who was crushed to death so a shrine could be raised to his memory .

source_bert_toks: there was even an irish site destroyed for its own survival rather like the descendant of the prophet who was crushed to death so a shrine could be raised to his memory .

reference_raw: There was even an Irish place destroyed for his own survival, rather like the descendant of a prophet who had been smashed to death to raise a sanctum to his memory.

reference_spacy_tokens: There was even an Irish place destroyed for his own survival , rather like the descendant of a prophet who had been smashed to death to raise a sanctum to his memory .


fn_spacy_tokens_for_baseline: That could be bad news for any theoretical widow suing a first aider who had left her husband to die while scouting around for a telephone .

source_bert_toks: that could be bad news for any theoretical widow sui ##ng a first aide ##r who had left her husband to die while scouting around for a telephone .

reference_raw: That might be bad news for any theoretical widow who's suing the first aide who let her husband die while she's looking for the phone.

reference_spacy_tokens: That might be bad news for any theoretical widow who 's suing the first aide who let her husband die while she 's looking for the phone .


fn_spacy_tokens_for_baseline: 5- The brother who wants to leave AL - QAEDA without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

source_bert_toks: 5 - the brother who wants to leave al - qaeda without a legitimate excuse does not qualify for financial assistance or any of the previously mentioned privileges .

reference_raw: 5- A brother who wishes to leave AL-QAEDA without justification shall not be eligible for financial assistance or any of the privileges mentioned above.

reference_spacy_tokens: 5- A brother who wishes to leave AL - QAEDA without justification shall not be eligible for financial assistance or any of the privileges mentioned above .


fn_spacy_tokens_for_baseline: A fairly attractive loaf ; has a good , nutty , cooked aroma and slightly salty taste .

source_bert_toks: a fairly attractive loaf ; has a good , nut ##ty , cooked aroma and slightly salty taste .

reference_raw: A rather attractive loaf; it has a good, nutty, boiled aroma and a slightly salted taste.

reference_spacy_tokens: A rather attractive loaf ; it has a good , nutty , boiled aroma and a slightly salted taste .


fn_spacy_tokens_for_baseline: However , they view the program as a success .

source_bert_toks: however , they view the program as a success .

reference_raw: But they see the program as successful.

reference_spacy_tokens: But they see the program as successful .


fn_spacy_tokens_for_baseline: Friends of the Earth has been given permission by the High Court to pursue a legal case against the government over the level of pesticides in drinking water in the Thames and Anglian regions .

source_bert_toks: friends of the earth has been given permission by the high court to pursue a legal case against the government over the level of pest ##icides in drinking water in the thames and anglia ##n regions .

reference_raw: Friends of the Earth have been authorised by the High Court to bring an action against the government regarding the level of pesticides in drinking water in the Thames and England regions.

reference_spacy_tokens: Friends of the Earth have been authorised by the High Court to bring an action against the government regarding the level of pesticides in drinking water in the Thames and England regions .


fn_spacy_tokens_for_baseline: Come and tickle its tiny toes and admire its baby - blue eyes !

source_bert_toks: come and tick ##le its tiny toes and admire its baby - blue eyes !

reference_raw: Come on, tickle his tiny toes and adore his child's blue eyes!

reference_spacy_tokens: Come on , tickle his tiny toes and adore his child 's blue eyes !


fn_spacy_tokens_for_baseline: Merrill laughed at her dejection .

source_bert_toks: merrill laughed at her de ##ject ##ion .

reference_raw: Merrill laughed at her despair.

reference_spacy_tokens: Merrill laughed at her despair .


fn_spacy_tokens_for_baseline: But by hiring a PR firm to manage his image , wooing reporters with occasional jokes , and bonding with Prime Minister Tony Blair , Charles has staged an astounding revival .

source_bert_toks: but by hiring a pr firm to manage his image , woo ##ing reporters with occasional jokes , and bonding with prime minister tony blair , charles has staged an as ##tou ##nding revival .

reference_raw: But by hiring a P.R. firm to manage his reputation, wooing reporters with occasional jokes, and bonding with Prime Minister Tony Blair, Charles staged a stunning recovery.

reference_spacy_tokens: But by hiring a P.R. firm to manage his reputation , wooing reporters with occasional jokes , and bonding with Prime Minister Tony Blair , Charles staged a stunning recovery .


fn_spacy_tokens_for_baseline: Only after I had ferried my cart to the next aisle did I figure out what she meant : tsk tsk , that half - pitying , half - disapproving sound made by pressing the tongue against the upper palate and teeth and sucking in slightly .

source_bert_toks: only after i had fe ##rrie ##d my cart to the next aisle did i figure out what she meant : ts ##k ts ##k , that half - pity ##ing , half - di ##sa ##pp ##roving sound made by pressing the tongue against the upper pal ##ate and teeth and sucking in slightly .

reference_raw: It wasn't until I took the cart to the next alley that I realized what it meant: tsk tsk, the half-pitying, half-disapproving noise of pressing my tongue against the top of the palate and teeth and sucking a little.

reference_spacy_tokens: It was n't until I took the cart to the next alley that I realized what it meant : tsk tsk , the half - pitying , half - disapproving noise of pressing my tongue against the top of the palate and teeth and sucking a little .


fn_spacy_tokens_for_baseline: I was confined to my room , terrorized by the most horrible threats , cruelly ill - used to break my spirit - see this stab on my shoulder and the bruises from end to end of my arms - and a gag was thrust into my mouth on the one occasion when I tried to call from the window .

source_bert_toks: i was confined to my room , terror ##ized by the most horrible threats , cruel ##ly ill - used to break my spirit - see this stab on my shoulder and the bruises from end to end of my arms - and a gag was thrust into my mouth on the one occasion when i tried to call from the window .

reference_raw: I was confined to my room, terrorized by the most terrible menaces, cruelly ill-used to break my soul-see the stab on my shoulder and the bruises from the end of my arms-and for the first time I tried to call from the window, there was a gag in my mouth.

reference_spacy_tokens: I was confined to my room , terrorized by the most terrible menaces , cruelly ill - used to break my soul - see the stab on my shoulder and the bruises from the end of my arms - and for the first time I tried to call from the window , there was a gag in my mouth .


fn_spacy_tokens_for_baseline: These figures have been replaced in the still life by loaves of bread , echoing the position of their arms ; their trunks and heads have been eliminated .

source_bert_toks: these figures have been replaced in the still life by lo ##aves of bread , echoing the position of their arms ; their trunks and heads have been eliminated .

reference_raw: In the quiet life these figures were replaced by loaves of bread, which echoed the position of their arms; their suitcases and heads were removed.

reference_spacy_tokens: In the quiet life these figures were replaced by loaves of bread , which echoed the position of their arms ; their suitcases and heads were removed .


fn_spacy_tokens_for_baseline: Let us begin by taking a closer look at the logical structure of referential symbols .

source_bert_toks: let us begin by taking a closer look at the logical structure of refer ##ential symbols .

reference_raw: Let's start by looking at the logical structure of reference symbols.

reference_spacy_tokens: Let 's start by looking at the logical structure of reference symbols .


fn_spacy_tokens_for_baseline: Treat yourself to a long , luxurious bath , full to the brim with beautifully fragranced water .

source_bert_toks: treat yourself to a long , luxurious bath , full to the br ##im with beautifully fragrance ##d water .

reference_raw: Take a long, luxurious bath filled to the brim with beautifully scented water.

reference_spacy_tokens: Take a long , luxurious bath filled to the brim with beautifully scented water .


fn_spacy_tokens_for_baseline: If the nature of the terrain does not allow it , then it should be on the other side of the road .

source_bert_toks: if the nature of the terrain does not allow it , then it should be on the other side of the road .

reference_raw: If the nature of the terrain does not permit it, it should be on the other side of the road.

reference_spacy_tokens: If the nature of the terrain does not permit it , it should be on the other side of the road .


fn_spacy_tokens_for_baseline: He had big , brown eyes , long furry ears and dimpled buttocks .

source_bert_toks: he had big , brown eyes , long furry ears and dim ##pled butt ##ocks .

reference_raw: He had large brown eyes, long hairy ears and dimpled asses.

reference_spacy_tokens: He had large brown eyes , long hairy ears and dimpled asses .


fn_spacy_tokens_for_baseline: Wordsworth , Coleridge and Dorothy have been too much revered by their admirers , and their common humanity played down .

source_bert_toks: words ##worth , cole ##ridge and dorothy have been too much revered by their admire ##rs , and their common humanity played down .

reference_raw: Wordsworth, Coleridge, and Dorothy were too much respected by their admirers, and their common humanity was ruined.

reference_spacy_tokens: Wordsworth , Coleridge , and Dorothy were too much respected by their admirers , and their common humanity was ruined .


fn_spacy_tokens_for_baseline: Previously in 1997 , a statement submitted by the office of Madeline Albright -- then US Secretary of State -- concluded that SinoChem had not been involved in any dual - use shipments to Iran .

source_bert_toks: previously in 1997 , a statement submitted by the office of madeline al ##bright - - then us secretary of state - - concluded that sino ##che ##m had not been involved in any dual - use shipments to iran .

reference_raw: Previously in 1997, a statement from Madeline Albright's office, then the U.S. Secretary of State, concluded that SinoChem was not engaged in any dual use of shipments to Iran.

reference_spacy_tokens: Previously in 1997 , a statement from Madeline Albright 's office , then the U.S. Secretary of State , concluded that SinoChem was not engaged in any dual use of shipments to Iran .


fn_spacy_tokens_for_baseline: The unbelievable began to happen just after 1 am , as East and West Berliners passed through the Brandenburg Gate , symbol of the divided city .

source_bert_toks: the unbelievable began to happen just after 1a ##m , as east and west berlin ##ers passed through the brandenburg gate , symbol of the divided city .

reference_raw: As the East and West Berliners passed through the Brandenburg Gate, the symbol of the divided city, the incredible began just after one o'clock in the morning.

reference_spacy_tokens: As the East and West Berliners passed through the Brandenburg Gate , the symbol of the divided city , the incredible began just after one o'clock in the morning .


fn_spacy_tokens_for_baseline: His face was puffy and covered in dark blotches .

source_bert_toks: his face was puff ##y and covered in dark b ##lot ##ches .

reference_raw: His face was swollen and covered with dark stains.

reference_spacy_tokens: His face was swollen and covered with dark stains .


fn_spacy_tokens_for_baseline: Athelstan sat in complete stupefaction , drinking his beer , as Cranston cleared every platter , washing it all down with another bowl of claret .

source_bert_toks: at ##hel ##stan sat in complete stu ##pe ##fa ##ction , drinking his beer , as cr ##ans ##ton cleared every platt ##er , washing it all down with another bowl of clare ##t .

reference_raw: Athelstan sat stunned and drank his beer while Cranston cleaned each tray and washed it all with another bowl of claret.

reference_spacy_tokens: Athelstan sat stunned and drank his beer while Cranston cleaned each tray and washed it all with another bowl of claret .


fn_spacy_tokens_for_baseline: ' No , of course she 's not engaged .

source_bert_toks: ' no , of course she ' s not engaged .

reference_raw: 'No, of course she wasn't involved.

reference_spacy_tokens: ' No , of course she was n't involved .


fn_spacy_tokens_for_baseline: It exhilarated him to be working out of doors and in country - like surroundings such as these .

source_bert_toks: it ex ##hila ##rated him to be working out of doors and in country - like surroundings such as these .

reference_raw: He was thrilled to work outside the door and in a countrylike environment like this.

reference_spacy_tokens: He was thrilled to work outside the door and in a countrylike environment like this .


fn_spacy_tokens_for_baseline: Pushing them out of the way , she hastened to the bed .

source_bert_toks: pushing them out of the way , she haste ##ned to the bed .

reference_raw: She pushed them away and hurried to the bed.

reference_spacy_tokens: She pushed them away and hurried to the bed .


fn_spacy_tokens_for_baseline: Priests have always been regarded as healers of the mind , and even their modern equivalents in the psychoanalytic movement are similarly preoccupied with the dreams of their patients .

source_bert_toks: priests have always been regarded as healer ##s of the mind , and even their modern equivalent ##s in the psycho ##anal ##ytic movement are similarly preoccupied with the dreams of their patients .

reference_raw: Priests have always been considered to heal the mind, and even their modern equivalents in the psychoanalytic movement are equally preoccupied with the dreams of their patients.

reference_spacy_tokens: Priests have always been considered to heal the mind , and even their modern equivalents in the psychoanalytic movement are equally preoccupied with the dreams of their patients .


fn_spacy_tokens_for_baseline: Harald fell on top of them and he tried to take one of the guns , but the girl pulled his hair and the young man held his arms .

source_bert_toks: harald fell on top of them and he tried to take one of the guns , but the girl pulled his hair and the young man held his arms .

reference_raw: Harald fell on them and tried to grab one of the pistols, but the girl drew his hair and the young man held his hand.

reference_spacy_tokens: Harald fell on them and tried to grab one of the pistols , but the girl drew his hair and the young man held his hand .


fn_spacy_tokens_for_baseline: Consequently an effective system of international trade requires the adoption of exchange rate arrangements which enable the currency of one country to be exchanged for currencies of other countries .

source_bert_toks: consequently an effective system of international trade requires the adoption of exchange rate arrangements which enable the currency of one country to be exchanged for cu ##rre ##ncies of other countries .

reference_raw: An effective system of international trade therefore requires the adoption of a currency regime allowing the currency of one country to be swapped for the currencies of other countries.

reference_spacy_tokens: An effective system of international trade therefore requires the adoption of a currency regime allowing the currency of one country to be swapped for the currencies of other countries .


fn_spacy_tokens_for_baseline: The doorbell pealed and Julia shot upstairs from the basement , flung herself through the green baize door and then walked slowly and decorously across the black and white tiled hall .

source_bert_toks: the doorbell pea ##led and julia shot upstairs from the basement , flung herself through the green bai ##ze door and then walked slowly and decor ##ously across the black and white tiled hall .

reference_raw: The bell rang and Julia shot up from the cellar, flung herself through the green baize door, then walked slowly and decorously across the black-and-white tiled corridor.

reference_spacy_tokens: The bell rang and Julia shot up from the cellar , flung herself through the green baize door , then walked slowly and decorously across the black - and - white tiled corridor .


fn_spacy_tokens_for_baseline: Allegations were rife : evacuees complained of cruel and miserly hosts ; hosts maintained that many parents had deliberately sent children off in their worst clothes in order to arouse sympathy and gifts of replacement clothing .

source_bert_toks: allegations were ri ##fe : eva ##cu ##ees complained of cruel and mis ##erly hosts ; hosts maintained that many parents had deliberately sent children off in their worst clothes in order to ar ##ouse sympathy and gifts of replacement clothing .

reference_raw: Allegations were rife: the evacuees complained of cruel and miserable hosts; the hosts claimed that many parents had deliberately sent their children away in their worst suits to arouse sympathy and gifts of spare clothing.

reference_spacy_tokens: Allegations were rife : the evacuees complained of cruel and miserable hosts ; the hosts claimed that many parents had deliberately sent their children away in their worst suits to arouse sympathy and gifts of spare clothing .


fn_spacy_tokens_for_baseline: The piercing whine of the C130 's four Allison turbo props rose even higher , hurting his ears , the air stinking with the smell of burnt kerosene , the hot moist gases buffeting and pulling at his clothes .

source_bert_toks: the piercing w ##hine of the c1 ##30 ' s four allison turbo props rose even higher , hurting his ears , the air stink ##ing with the smell of burnt ke ##rose ##ne , the hot moist gases buffet ##ing and pulling at his clothes .

reference_raw: The piercing whine of the four Allison turbo props of the C130 rose even higher and hurt his ears, the air smelled of burned kerosene, the hot wet gases buffeting and tugging at his clothing.

reference_spacy_tokens: The piercing whine of the four Allison turbo props of the C130 rose even higher and hurt his ears , the air smelled of burned kerosene , the hot wet gases buffeting and tugging at his clothing .


fn_spacy_tokens_for_baseline: It had been foolishness to be so jealous .

source_bert_toks: it had been foolish ##ness to be so jealous .

reference_raw: It was foolish to be so jealous.

reference_spacy_tokens: It was foolish to be so jealous .


fn_spacy_tokens_for_baseline: A pugnacious as well as perceptive dramatic critic , Macdonell at one point occupied twelve pages of the London Mercury with a criticism of the art of ( Sir ) Noel Coward [ q.v.].

source_bert_toks: a pu ##gna ##cious as well as per ##ceptive dramatic critic , mac ##don ##ell at one point occupied twelve pages of the london mercury with a criticism of the art of ( sir ) noel coward [ q . v . ] .

reference_raw: In one place Macdonell had occupied twelve pages of London Mercury and criticized the art of (Sir) Noel Coward [q.v.].

reference_spacy_tokens: In one place Macdonell had occupied twelve pages of London Mercury and criticized the art of ( Sir ) Noel Coward [ q.v.].


fn_spacy_tokens_for_baseline: He walked around the thicket , making as much noise on the pine needles as he could , without being able to catch sight of the man 's face .

source_bert_toks: he walked around the thick ##et , making as much noise on the pine needles as he could , without being able to catch sight of the man ' s face .

reference_raw: He walked around the bushes, making as much noise as he could on the pine needles as he could, unable to see the man's face.

reference_spacy_tokens: He walked around the bushes , making as much noise as he could on the pine needles as he could , unable to see the man 's face .


fn_spacy_tokens_for_baseline: Agrarian reform programmes have two basic aims , one of which is redistributive , to provide a juster pattern of landholding and alleviate poverty by giving the peasants more substantial plots of land .

source_bert_toks: agrarian reform programmes have two basic aims , one of which is red ##ist ##ri ##bu ##tive , to provide a just ##er pattern of land ##holding and alleviate poverty by giving the peasants more substantial plots of land .

reference_raw: Agrarian reform programmes have two basic objectives, one of which is redistributive, to ensure a more equitable land use model and to reduce poverty by providing farmers with more substantial land parcels.

reference_spacy_tokens: Agrarian reform programmes have two basic objectives , one of which is redistributive , to ensure a more equitable land use model and to reduce poverty by providing farmers with more substantial land parcels .


fn_spacy_tokens_for_baseline: ' He said he recently watched a video of a heavily armed drug convoy of about 20 vehicles crossing into Iran .

source_bert_toks: ' he said he recently watched a video of a heavily armed drug convoy of about 20 vehicles crossing into iran .

reference_raw: 'He said he'd recently watched a video of a heavily-armed drug fleet of about 20 vehicles going to Iran.

reference_spacy_tokens: ' He said he 'd recently watched a video of a heavily - armed drug fleet of about 20 vehicles going to Iran .


fn_spacy_tokens_for_baseline: New fires were reportedly still breaking out this morning .

source_bert_toks: new fires were reportedly still breaking out this morning .

reference_raw: Reportedly, new fires were still in progress this afternoon.

reference_spacy_tokens: Reportedly , new fires were still in progress this afternoon .


fn_spacy_tokens_for_baseline: One of the beauties of the technique which is often overlooked is that the colours tend to show through and ' blur " a little .

source_bert_toks: one of the beau ##ties of the technique which is often overlooked is that the colours tend to show through and ' blur " a little .

reference_raw: One of the beauties of a technique that is often overlooked is that colours tend to appear and "blur" a little.

reference_spacy_tokens: One of the beauties of a technique that is often overlooked is that colours tend to appear and " blur " a little .


fn_spacy_tokens_for_baseline: Bearing in mind that canoeing is gaining in popularity , along with the leisure industry , the situation will get worse before it gets better .

source_bert_toks: bearing in mind that canoe ##ing is gaining in popularity , along with the leisure industry , the situation will get worse before it gets better .

reference_raw: Bearing in mind that canoeing is becoming more popular with the leisure industry, the situation will get worse before it gets better.

reference_spacy_tokens: Bearing in mind that canoeing is becoming more popular with the leisure industry , the situation will get worse before it gets better .


fn_spacy_tokens_for_baseline: All these little girls ate their meals in the Sheikha 's majlis with their nurses -- in the nursery , so to speak .

source_bert_toks: all these little girls ate their meals in the sheikh ##a ' s maj ##lis with their nurses - - in the nursery , so to speak .

reference_raw: All the little ones ate with their sisters in the Sheikha majlis - in the nursery, so to speak.

reference_spacy_tokens: All the little ones ate with their sisters in the Sheikha majlis - in the nursery , so to speak .


fn_spacy_tokens_for_baseline: A terse phone call from Arthur Edwards , a long - serving photographer from The Sun newspaper , whose avuncular manner belies the fact that he has excellent sources inside the royal world , reinforced the message .

source_bert_toks: a ter ##se phone call from arthur edwards , a long - serving photographer from the sun newspaper , whose av ##un ##cular manner bel ##ies the fact that he has excellent sources inside the royal world , reinforced the message .

reference_raw: The message was reinforced by a brief call from Arthur Edwards, a long-serving photographer from the Sun's newspaper, whose avuncular manner is based on the fact that he has excellent sources in the royal world.

reference_spacy_tokens: The message was reinforced by a brief call from Arthur Edwards , a long - serving photographer from the Sun 's newspaper , whose avuncular manner is based on the fact that he has excellent sources in the royal world .


fn_spacy_tokens_for_baseline: She now felt so dangerously soporific that even the sneaking fear of Roman 's insidious effect on her could n't rouse her from this lovely torpor .

source_bert_toks: she now felt so dangerously so ##por ##ific that even the sneaking fear of roman ' s ins ##idi ##ous effect on her couldn ' t rouse her from this lovely tor ##por .

reference_raw: Now she felt so dangerously sophistic that even the secret fear of Roman's insidious effect on her could not awaken her from this beautiful torpor.

reference_spacy_tokens: Now she felt so dangerously sophistic that even the secret fear of Roman 's insidious effect on her could not awaken her from this beautiful torpor .


fn_spacy_tokens_for_baseline: Griffiths was sent off in disgrace for kicking an opponent in the head during Cardiff 's 15 - 6 Heineken League win at Aberavon .

source_bert_toks: griffiths was sent off in disgrace for kicking an opponent in the head during cardiff ' s 15 - 6 he ##ine ##ken league win at abe ##ra ##von .

reference_raw: Griffiths was sent away in shame for beating his opponent in the head during Cardiff's 15-6 Heineken League victory in Aberavon.

reference_spacy_tokens: Griffiths was sent away in shame for beating his opponent in the head during Cardiff 's 15 - 6 Heineken League victory in Aberavon .


fn_spacy_tokens_for_baseline: Hector the dog growled under his breath , shifting a little and eyeing her .

source_bert_toks: hector the dog growled under his breath , shifting a little and eyeing her .

reference_raw: The dog, Hector, grunted under his breath, moved slightly, and looked at her.

reference_spacy_tokens: The dog , Hector , grunted under his breath , moved slightly , and looked at her .


fn_spacy_tokens_for_baseline: Clearly prey need to be both sprinters over short distances and marathon runners over longer ones , to be able to defend themselves against both types of pursuers .

source_bert_toks: clearly prey need to be both sprinter ##s over short distances and marathon runners over longer ones , to be able to defend themselves against both types of pursue ##rs .

reference_raw: It is clear that the prey must be both short-range sprinters and marathon runners longer, so that they can defend themselves against both types of chasers.

reference_spacy_tokens: It is clear that the prey must be both short - range sprinters and marathon runners longer , so that they can defend themselves against both types of chasers .


fn_spacy_tokens_for_baseline: We have already argued that a period of sustained expansion can occur only if potential profitability can be maintained , that is , if an adequate balance between productivity and real wages can be sustained .

source_bert_toks: we have already argued that a period of sustained expansion can occur only if potential profit ##ability can be maintained , that is , if an adequate balance between productivity and real wages can be sustained .

reference_raw: We have already argued that a period of sustainable growth can only arise if the potential profitability can be maintained, i.e. if the appropriate balance between productivity and real wages can be maintained.

reference_spacy_tokens: We have already argued that a period of sustainable growth can only arise if the potential profitability can be maintained , i.e. if the appropriate balance between productivity and real wages can be maintained .


fn_spacy_tokens_for_baseline: It was already very tight following at least one attempt on the president 's life last year , in which a truck bomb failed to explode as his convoy passed in the southern city of Karachi .

source_bert_toks: it was already very tight following at least one attempt on the president ' s life last year , in which a truck bomb failed to explode as his convoy passed in the southern city of karachi .

reference_raw: After at least one attempt at the President's life last year, when a truck bomb failed to detonate as his convoy passed through the southern city of Karachi, it was already very close.

reference_spacy_tokens: After at least one attempt at the President 's life last year , when a truck bomb failed to detonate as his convoy passed through the southern city of Karachi , it was already very close .


fn_spacy_tokens_for_baseline: This then forms a solidified jelly impervious to water .

source_bert_toks: this then forms a solid ##ified jelly imp ##er ##vious to water .

reference_raw: Then it creates solid jelly, impervious to water.

reference_spacy_tokens: Then it creates solid jelly , impervious to water .


fn_spacy_tokens_for_baseline: I could tear you in two , but I 'm not really here .

source_bert_toks: i could tear you in two , but i ' m not really here .

reference_raw: I can rip you apart, but I'm not here.

reference_spacy_tokens: I can rip you apart , but I 'm not here .


fn_spacy_tokens_for_baseline: The second rectangle is first imagined as superimposed on the first then moved vertically downwards 1 cm and rotated 45 degrees clockwise about its own top left corner .

source_bert_toks: the second rec ##tangle is first imagined as super ##im ##posed on the first then moved vertically downwards 1 cm and rotated 45 degrees clockwise about its own top left corner .

reference_raw: The second rectangle is first thought to be superimposed on the first, then moved vertically down 1 cm and turned 45 degrees clockwise around its upper left corner.

reference_spacy_tokens: The second rectangle is first thought to be superimposed on the first , then moved vertically down 1 cm and turned 45 degrees clockwise around its upper left corner .


fn_spacy_tokens_for_baseline: Apparently the dualistic phenomenon of a body of commercial law separate from civil law need not be reinstated .

source_bert_toks: apparently the dual ##istic phenomenon of a body of commercial law separate from civil law need not be reinstated .

reference_raw: It is clear that there is no need to reintroduce the dualistic phenomenon of a body of commercial law that is separate from civil law.

reference_spacy_tokens: It is clear that there is no need to reintroduce the dualistic phenomenon of a body of commercial law that is separate from civil law .


fn_spacy_tokens_for_baseline: The mystified motorist whose car has gone wrong may know only that it needs repair and that he should take it to a mechanic : his competence to deal with the matter may go no further .

source_bert_toks: the my ##sti ##fied motor ##ist whose car has gone wrong may know only that it needs repair and that he should take it to a mechanic : his competence to deal with the matter may go no further .

reference_raw: A mystic motorist whose car went wrong can only know that he needs repairs and that he should take them to a mechanic: his ability to deal with the matter can't go on.

reference_spacy_tokens: A mystic motorist whose car went wrong can only know that he needs repairs and that he should take them to a mechanic : his ability to deal with the matter ca n't go on .


fn_spacy_tokens_for_baseline: You have however pretty much convinced me to ignore all the healthy food I have at home and go home from work via the route that takes me past In and Out , so Yeah !

source_bert_toks: you have however pretty much convinced me to ignore all the healthy food i have at home and go home from work via the route that takes me past in and out , so yeah !

reference_raw: However, you've almost convinced me to ignore all the healthy food I've got at home and go home from my job through the route that takes me in and out, so Yeah!

reference_spacy_tokens: However , you 've almost convinced me to ignore all the healthy food I 've got at home and go home from my job through the route that takes me in and out , so Yeah !


fn_spacy_tokens_for_baseline: The strength and potential of the modern concern for curriculum development lies in the fact that we now realise how important it is to undertake these processes , and in a logical sequence .

source_bert_toks: the strength and potential of the modern concern for curriculum development lies in the fact that we now realise how important it is to undertake these processes , and in a logical sequence .

reference_raw: The strength and potential of the current interest in curriculum development is that we now realize the importance of carrying out these processes and in a logical order.

reference_spacy_tokens: The strength and potential of the current interest in curriculum development is that we now realize the importance of carrying out these processes and in a logical order .


fn_spacy_tokens_for_baseline: He maintained his refusal to comment on the polls , and remained adamant he would never do deals on proportional representation .

source_bert_toks: he maintained his refusal to comment on the polls , and remained adamant he would never do deals on proportional representation .

reference_raw: He persisted in refusing to comment on the polls, and remained adamant that he would never do business for proportional representation.

reference_spacy_tokens: He persisted in refusing to comment on the polls , and remained adamant that he would never do business for proportional representation .


fn_spacy_tokens_for_baseline: He cuffed the woman on the head , attempting to drag her back into the doorway .

source_bert_toks: he cuff ##ed the woman on the head , attempting to drag her back into the doorway .

reference_raw: He put a handcuff on the woman's head and tried to drag her back through the door.

reference_spacy_tokens: He put a handcuff on the woman 's head and tried to drag her back through the door .


fn_spacy_tokens_for_baseline: He stripped off his scaly shirt and breeches and ran his hand over his armpits and groin .

source_bert_toks: he stripped off his sc ##aly shirt and bree ##ches and ran his hand over his arm ##pit ##s and groin .

reference_raw: He stripped off his scaled shirt and pants and ran his hand over his armpits and groin.

reference_spacy_tokens: He stripped off his scaled shirt and pants and ran his hand over his armpits and groin .


fn_spacy_tokens_for_baseline: If we ca n't lure Presley here and destroy him before then , we 're history .

source_bert_toks: if we can ' t lure presley here and destroy him before then , we ' re history .

reference_raw: If we don't lure Presley here and destroy him by then, we're in the past.

reference_spacy_tokens: If we do n't lure Presley here and destroy him by then , we 're in the past .


fn_spacy_tokens_for_baseline: On 15 January 1862 he submitted proposals to the tsar which became ' the basic blueprint ' for his multifarious activities at the War Ministry .

source_bert_toks: on 15 january 1862 he submitted proposals to the tsar which became ' the basic blue ##print ' for his multi ##far ##ious activities at the war ministry .

reference_raw: On 15 January 1862, he submitted proposals to the tsar, which became a basic plan for his multi-faceted operations at the Ministry of War.

reference_spacy_tokens: On 15 January 1862 , he submitted proposals to the tsar , which became a basic plan for his multi - faceted operations at the Ministry of War .


fn_spacy_tokens_for_baseline: Daniel thought about dead Ann Maguire who , like Anna Van Gogh , the Dutch pastor 's wife , had named a younger , hopeful child for a dead one .

source_bert_toks: daniel thought about dead ann maguire who , like anna van gogh , the dutch pastor ' s wife , had named a younger , hopeful child for a dead one .

reference_raw: Daniel thought of the dead Ann Maguire, who, like Anna Van Gogh, the wife of the Dutch pastor, had appointed a young, hopeful child for the dead.

reference_spacy_tokens: Daniel thought of the dead Ann Maguire , who , like Anna Van Gogh , the wife of the Dutch pastor , had appointed a young , hopeful child for the dead .


fn_spacy_tokens_for_baseline: Ari , rubbing her bruises , had limped over to Nathan who was weeping uncontrollably , telling everyone it was his fault .

source_bert_toks: ari , rubbing her bruises , had limp ##ed over to nathan who was weeping un ##con ##tro ##lla ##bly , telling everyone it was his fault .

reference_raw: Ari rubbed her bruises and hobbled over to Nathan, who cried uncontrollably and told everyone that it was his fault.

reference_spacy_tokens: Ari rubbed her bruises and hobbled over to Nathan , who cried uncontrollably and told everyone that it was his fault .


fn_spacy_tokens_for_baseline: Thus , the interview is often used to inquire into the beliefs and values of a particular social group on the supposition that these are crucial to the explanation of the behaviour of the members of the group .

source_bert_toks: thus , the interview is often used to in ##qui ##re into the beliefs and values of a particular social group on the su ##pp ##osition that these are crucial to the explanation of the behaviour of the members of the group .

reference_raw: The interview is therefore often used to inquire into the beliefs and values of a particular social group on the assumption that it is essential to explain the behaviour of the members of the group.

reference_spacy_tokens: The interview is therefore often used to inquire into the beliefs and values of a particular social group on the assumption that it is essential to explain the behaviour of the members of the group .


fn_spacy_tokens_for_baseline: ' Maybe he does n't know a squeeze play from a loud foul , but once he senses he 's being got at he can be a vicious SOB . '

source_bert_toks: ' maybe he doesn ' t know a squeeze play from a loud foul , but once he senses he ' s being got at he can be a vicious sob . '

reference_raw: "He may not be familiar with the squeezing game of a loud foul, but once he senses it's coming to him, he can be a vicious SOB."

reference_spacy_tokens: " He may not be familiar with the squeezing game of a loud foul , but once he senses it 's coming to him , he can be a vicious SOB . "


fn_spacy_tokens_for_baseline: The desire to persist in interrogation is a valid reason for keeping a suspect in custody for thirty - six hours and indeed beyond .

source_bert_toks: the desire to persist in interrogation is a valid reason for keeping a suspect in custody for thirty - six hours and indeed beyond .

reference_raw: The desire to persist in questioning is a valid reason to keep the suspect under arrest for thirty-six hours and even more.

reference_spacy_tokens: The desire to persist in questioning is a valid reason to keep the suspect under arrest for thirty - six hours and even more .


fn_spacy_tokens_for_baseline: ' Not if it landed there ! ' replied Brown Owl sharply , and pointed towards the swampland on the other side of the fence .

source_bert_toks: ' not if it landed there ! ' replied brown owl sharply , and pointed towards the swamp ##land on the other side of the fence .

reference_raw: "Not if he lands there!" said Brown Owl sharply, pointing to the swamp on the far side of the fence.

reference_spacy_tokens: " Not if he lands there ! " said Brown Owl sharply , pointing to the swamp on the far side of the fence .


fn_spacy_tokens_for_baseline: Then as things got rougher , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet oozing up and down , and the flowers waving in an eerie rhythm .

source_bert_toks: then as things got rough ##er , we ran for the door and spent the next few minutes outside watching the brick sidewalk under our feet o ##oz ##ing up and down , and the flowers waving in an eerie rhythm .

reference_raw: Then, as things got rougher, we ran to the door and spent the next few minutes out, watching the brick walkway beneath our feet, the flowers swinging in a strange rhythm.

reference_spacy_tokens: Then , as things got rougher , we ran to the door and spent the next few minutes out , watching the brick walkway beneath our feet , the flowers swinging in a strange rhythm .


fn_spacy_tokens_for_baseline: Bombing targets in the no - fly zones in southern and northern Iraq by U.S. and British warplanes have almost become a daily occurrence , causing serious civilian casualties .

source_bert_toks: bombing targets in the no - fly zones in southern and northern iraq by u . s . and british warp ##lane ##s have almost become a daily occurrence , causing serious civilian casualties .

reference_raw: The bombing of U.S. and British warplanes in the no-fly zones of South and Northern Iraq has become almost daily, causing severe civilian casualties.

reference_spacy_tokens: The bombing of U.S. and British warplanes in the no - fly zones of South and Northern Iraq has become almost daily , causing severe civilian casualties .


fn_spacy_tokens_for_baseline: And Dublin , a city large in expectations , is still small enough for the visitor to see most of its sights on foot .

source_bert_toks: and dublin , a city large in expectations , is still small enough for the visitor to see most of its sights on foot .

reference_raw: And Dublin, a city big in anticipation, is so small that a visitor can see most of his sights on foot.

reference_spacy_tokens: And Dublin , a city big in anticipation , is so small that a visitor can see most of his sights on foot .


fn_spacy_tokens_for_baseline: Huy had delayed telling Merymose about Surere , waiting for the right moment to come .

source_bert_toks: hu ##y had delayed telling mer ##ym ##ose about sure ##re , waiting for the right moment to come .

reference_raw: Huy postponed telling Merymos about Surere, waiting for the right moment.

reference_spacy_tokens: Huy postponed telling Merymos about Surere , waiting for the right moment .


fn_spacy_tokens_for_baseline: I have been sent a Leeds United 1993 - 94 squad picture from the Evening Post and this now adorns my office wall , much to the amusement of my colleagues .

source_bert_toks: i have been sent a leeds united 1993 - 94 squad picture from the evening post and this now ad ##orn ##s my office wall , much to the amusement of my colleagues .

reference_raw: I've been sent a photo of Leeds United 1993-94 from the Evening Post, and this is now decorated with my office wall, much to the amusement of my colleagues.

reference_spacy_tokens: I 've been sent a photo of Leeds United 1993 - 94 from the Evening Post , and this is now decorated with my office wall , much to the amusement of my colleagues .


fn_spacy_tokens_for_baseline: The three little piggies snorted in disgust .

source_bert_toks: the three little pig ##gies snorted in disgust .

reference_raw: The three little pigs sniffed in disgust.

reference_spacy_tokens: The three little pigs sniffed in disgust .


fn_spacy_tokens_for_baseline: Wearily and painfully , I lugged my bag along the perimeter of the square , past rows of little shops .

source_bert_toks: wear ##ily and painfully , i lu ##gged my bag along the perimeter of the square , past rows of little shops .

reference_raw: I dragged my bag wearily and painfully along the edge of the square, past the rows of small shops.

reference_spacy_tokens: I dragged my bag wearily and painfully along the edge of the square , past the rows of small shops .


fn_spacy_tokens_for_baseline: And the little goblin followed Yanek up the mountain until they reached a high , lonely place where a waterfall ran down into a deep pool .

source_bert_toks: and the little goblin followed yan ##ek up the mountain until they reached a high , lonely place where a waterfall ran down into a deep pool .

reference_raw: And the little goblin followed Yanek up the mountain until they came to a high, lonely place where a waterfall descended into a deep puddle.

reference_spacy_tokens: And the little goblin followed Yanek up the mountain until they came to a high , lonely place where a waterfall descended into a deep puddle .


fn_spacy_tokens_for_baseline: This was decided at the two - day meeting of the India - US Joint Working Group on Counterterrorim , which ended today .

source_bert_toks: this was decided at the two - day meeting of the india - us joint working group on counter ##ter ##ror ##im , which ended today .

reference_raw: This was decided at the two-day meeting of the Indian Joint Working Party on Counterterrorism, which ended this day.

reference_spacy_tokens: This was decided at the two - day meeting of the Indian Joint Working Party on Counterterrorism , which ended this day .


fn_spacy_tokens_for_baseline: After Desert Storm , many thought that the attackers should have shouldered the responsibility of occupying Iraq , restoring democracy and temporarily administering the country under some UN mandate .

source_bert_toks: after desert storm , many thought that the attackers should have shouldered the responsibility of occupying iraq , restoring democracy and temporarily administering the country under some un mandate .

reference_raw: After Desert Storm, many thought that the invaders should assume responsibility for the occupation of Iraq, the restoration of democracy, and the temporary administration of the country under a UN mandate.

reference_spacy_tokens: After Desert Storm , many thought that the invaders should assume responsibility for the occupation of Iraq , the restoration of democracy , and the temporary administration of the country under a UN mandate .


fn_spacy_tokens_for_baseline: We set off through the lovely village of Stonethwaite and up the steep woodland path towards Great Crag .

source_bert_toks: we set off through the lovely village of stone ##th ##waite and up the steep woodland path towards great cr ##ag .

reference_raw: We made our way through the beautiful village of Stonethwaite and up the steep forest road to the Great Crag.

reference_spacy_tokens: We made our way through the beautiful village of Stonethwaite and up the steep forest road to the Great Crag .


fn_spacy_tokens_for_baseline: So once again he rowed out to sea , and for three days neither ate nor fished .

source_bert_toks: so once again he rowe ##d out to sea , and for three days neither ate nor fished .

reference_raw: So he rode again into the sea, and for three days he did not eat or fish.

reference_spacy_tokens: So he rode again into the sea , and for three days he did not eat or fish .


fn_spacy_tokens_for_baseline: He was n't abashed by her request , and as his gentle gaze roamed over her face , she felt that he did indeed understand her rather too well .

source_bert_toks: he wasn ' t aba ##shed by her request , and as his gentle gaze roam ##ed over her face , she felt that he did indeed understand her rather too well .

reference_raw: He was not dismayed by her request, and as his gentle gaze wandered over her face, she felt he understood her a little too well.

reference_spacy_tokens: He was not dismayed by her request , and as his gentle gaze wandered over her face , she felt he understood her a little too well .


fn_spacy_tokens_for_baseline: Godwin describes a similar street in London , Paradise Row , behind the new - built Paddington station , where the heaps of refuse before the pitiful buildings were a cause of wonder to all visitors .

source_bert_toks: god ##win describes a similar street in london , paradise row , behind the new - built paddington station , where the heap ##s of refuse before the pit ##iful buildings were a cause of wonder to all visitors .

reference_raw: Godwin describes a similar street in London, Paradise Row, behind the newly built Paddington station, where the piles of refuse in front of the poor buildings were a source of wonder for all visitors.

reference_spacy_tokens: Godwin describes a similar street in London , Paradise Row , behind the newly built Paddington station , where the piles of refuse in front of the poor buildings were a source of wonder for all visitors .


fn_spacy_tokens_for_baseline: Mine hunting director petty officer Simmo Simmons calls up the image on to his table screen .

source_bert_toks: mine hunting director petty officer sim ##mo simmons calls up the image on to his table screen .

reference_raw: Mine Hunting Director NCO Simmo Simmons calls a picture on his desk screen.

reference_spacy_tokens: Mine Hunting Director NCO Simmo Simmons calls a picture on his desk screen .


fn_spacy_tokens_for_baseline: Her husband Paul , a 33-year - old catering manager , was caged in one of Iraqi tyrant Saddam Hussein 's jails last week .

source_bert_toks: her husband paul , a 33 - year - old catering manager , was cage ##d in one of iraqi tyrant saddam hussein ' s jail ##s last week .

reference_raw: Her husband, Paul, a 33-year-old caterer manager, was arrested last week in one of Saddam Hussein's Iraqi bully's prisons.

reference_spacy_tokens: Her husband , Paul , a 33-year - old caterer manager , was arrested last week in one of Saddam Hussein 's Iraqi bully 's prisons .


fn_spacy_tokens_for_baseline: Many springs lay in areas that would eventually become the center of the modern Las Vegas metropolis .

source_bert_toks: many springs lay in areas that would eventually become the center of the modern las vegas metropolis .

reference_raw: Many springs lay in areas that would eventually become the centre of the modern metropolis of Las Vegas.

reference_spacy_tokens: Many springs lay in areas that would eventually become the centre of the modern metropolis of Las Vegas .


fn_spacy_tokens_for_baseline: The wino chuckled silently .

source_bert_toks: the win ##o chuckled silently .

reference_raw: The wino laughed in silence.

reference_spacy_tokens: The wino laughed in silence .


fn_spacy_tokens_for_baseline: Leaning over the glass counter of his booth , the young man in charge was deep in conversation with an elderly gentleman draped with cameras , and she was gazing into the face of quite a different person .

source_bert_toks: leaning over the glass counter of his booth , the young man in charge was deep in conversation with an elderly gentleman draped with cameras , and she was gazing into the face of quite a different person .

reference_raw: The young man in charge, leaning over the glass counter of his booth, was deep in conversation with an elderly gentleman with cameras, and she was staring into the face of a completely different person.

reference_spacy_tokens: The young man in charge , leaning over the glass counter of his booth , was deep in conversation with an elderly gentleman with cameras , and she was staring into the face of a completely different person .


fn_spacy_tokens_for_baseline: For Michael Nader , sexy Dex Dexter of TV 's Dynasty , it was a nightmare in which he saw his own death that convinced him he must break the cocaine habit .

source_bert_toks: for michael nad ##er , sexy dex dexter of tv ' s dynasty , it was a nightmare in which he saw his own death that convinced him he must break the cocaine habit .

reference_raw: For Michael Nader, the sexy Dex Dexter of the Dynasty of TV, it was a nightmare to see his own death that convinced him that he had to break the cocaine addiction.

reference_spacy_tokens: For Michael Nader , the sexy Dex Dexter of the Dynasty of TV , it was a nightmare to see his own death that convinced him that he had to break the cocaine addiction .


fn_spacy_tokens_for_baseline: But can I really maintain that the affliction is ' visible , painful , incurable , distasteful to others ' . ?

source_bert_toks: but can i really maintain that the af ##flict ##ion is ' visible , painful , inc ##urable , di ##sta ##ste ##ful to others ' . ?

reference_raw: But can I really say that the affliction is 'visible, painful, incurable, disgusting to others'?

reference_spacy_tokens: But can I really say that the affliction is ' visible , painful , incurable , disgusting to others ' ?


fn_spacy_tokens_for_baseline: Reed removed his fisherman 's hat , uncovering a bald crown and a fringe of auburn hair .

source_bert_toks: reed removed his fisherman ' s hat , uncover ##ing a bald crown and a fringe of auburn hair .

reference_raw: Reed took off his fisherman's hat and uncovered his bald head and the edge of his chestnut hair.

reference_spacy_tokens: Reed took off his fisherman 's hat and uncovered his bald head and the edge of his chestnut hair .


fn_spacy_tokens_for_baseline: " I 'm finding it hard at the moment to put into words what this victory means to us and to our country , " Pienaar said .

source_bert_toks: " i ' m finding it hard at the moment to put into words what this victory means to us and to our country , " pie ##na ##ar said .

reference_raw: "At this point, I find it difficult to say what this victory means to us and to our country," Pienaar said.

reference_spacy_tokens: " At this point , I find it difficult to say what this victory means to us and to our country , " Pienaar said .


fn_spacy_tokens_for_baseline: I jumped over the wall and ran along the bank and jumped straight into the stream , ' he said yesterday .

source_bert_toks: i jumped over the wall and ran along the bank and jumped straight into the stream , ' he said yesterday .

reference_raw: "I leapt over the wall and ran along the bank, leaping straight into the stream," he said yesterday.

reference_spacy_tokens: " I leapt over the wall and ran along the bank , leaping straight into the stream , " he said yesterday .


fn_spacy_tokens_for_baseline: In a genre noted for its shoddiness and sensationalism , this playing memoir of a season with Millwall in the mid-1970s stands out as a truthful and often painful account of the player 's lot .

source_bert_toks: in a genre noted for its sho ##ddin ##ess and sensation ##alis ##m , this playing memoir of a season with mill ##wall in the mid - 1970s stands out as a truth ##ful and often painful account of the player ' s lot .

reference_raw: In a genre noted for its absurdity and sensationalism, this playful memory of the Millwall season in the mid-1970s is a true and often painful description of the player's lot.

reference_spacy_tokens: In a genre noted for its absurdity and sensationalism , this playful memory of the Millwall season in the mid-1970s is a true and often painful description of the player 's lot .


fn_spacy_tokens_for_baseline: ENGLAND 'S cricketers found a tranquil haven here yesterday in which to run through their early tour practice routine .

source_bert_toks: england ' s cricketer ##s found a tran ##quil haven here yesterday in which to run through their early tour practice routine .

reference_raw: England's cricketers found a quiet haven here last night, where they could go over their early tour practice routine.

reference_spacy_tokens: England 's cricketers found a quiet haven here last night , where they could go over their early tour practice routine .


fn_spacy_tokens_for_baseline: Characteristically , he does not cite any source for this assertion .

source_bert_toks: characteristic ##ally , he does not cite any source for this assertion .

reference_raw: Characteristically, it makes no reference to the source of that claim.

reference_spacy_tokens: Characteristically , it makes no reference to the source of that claim .