fn_spacy_tokens_for_baseline: A more interesting if rather gruesome example of the point is an elaboration of Bertrand Russell 's story of the inductivist turkey .

source_bert_toks: a more interesting if rather gr ##ues ##ome example of the point is an el ##ab ##oration of bertrand russell ' s story of the ind ##uc ##tiv ##ist turkey .

reference_raw: A more intriguing but rather gruesome example of what's going on is the development of Bertrand Russell's story about an inductive turkey.

reference_spacy_tokens: A more intriguing but rather gruesome example of what 's going on is the development of Bertrand Russell 's story about an inductive turkey .


fn_spacy_tokens_for_baseline: Across from the I.M. Pei tower a winding path leads up to Hong Kong Park .

source_bert_toks: across from the i . m . pei tower a winding path leads up to hong kong park .

reference_raw: On the other side of the I.M. Pei turret, the winding road leads to Hong Kong Park.

reference_spacy_tokens: On the other side of the I.M. Pei turret , the winding road leads to Hong Kong Park .


fn_spacy_tokens_for_baseline: The estate - car reeled drunkenly , shot sideways across the road and oncoming traffic , and came to rest with its bonnet jammed in the sloping grass bank edging the road on the other side .

source_bert_toks: the estate - car reel ##ed drunken ##ly , shot sideways across the road and on ##coming traffic , and came to rest with its bonnet jammed in the sloping grass bank ed ##ging the road on the other side .

reference_raw: The real estate car reeled drunkenly, shot sideways across the road and on the way to traffic, and stopped with its hood stuck in a sloping grassy bank that eclipsed the road on the other side.

reference_spacy_tokens: The real estate car reeled drunkenly , shot sideways across the road and on the way to traffic , and stopped with its hood stuck in a sloping grassy bank that eclipsed the road on the other side .


fn_spacy_tokens_for_baseline: I had learned something about the protest vote .

source_bert_toks: i had learned something about the protest vote .

reference_raw: I found out about the protest vote.

reference_spacy_tokens: I found out about the protest vote .


fn_spacy_tokens_for_baseline: And across a desert highway , manning an ancient Soviet - made , hand - cranked antiaircraft gun , sat Khatab Abu Baker , an electrician .

source_bert_toks: and across a desert highway , manning an ancient soviet - made , hand - crank ##ed anti ##air ##craft gun , sat k ##hat ##ab abu baker , an electric ##ian .

reference_raw: And on the other side of the desert road was Khatab Abu Baker, an electrician, working with an old Soviet-made, hand-cracked anti-aircraft weapon.

reference_spacy_tokens: And on the other side of the desert road was Khatab Abu Baker , an electrician , working with an old Soviet - made , hand - cracked anti - aircraft weapon .


fn_spacy_tokens_for_baseline: Thank you , thank you ! ' she cried , quite ecstatic that he 'd unbent .

source_bert_toks: thank you , thank you ! ' she cried , quite ec ##static that he ' d un ##ben ##t .

reference_raw: Thank you, thank you!' she exclaimed, quite excited that he would not bet.

reference_spacy_tokens: Thank you , thank you ! ' she exclaimed , quite excited that he would not bet .


fn_spacy_tokens_for_baseline: This appears to offer a contrast with the 200 native languages ( in fifty - seven families ) in present - day North America , of which about sixty - eight occur north of the 45th parallel ( the zone comparable with Siberia ) .

source_bert_toks: this appears to offer a contrast with the 200 native languages ( in fifty - seven families ) in present - day north america , of which about sixty - eight occur north of the 45th parallel ( the zone comparable with siberia ) .

reference_raw: This seems to be a contrast to the 200 indigenous languages (in fifty-seven families) in current North America, of which around sixty-eight occur north of the 45th parallel (in a region comparable to Siberia).

reference_spacy_tokens: This seems to be a contrast to the 200 indigenous languages ( in fifty - seven families ) in current North America , of which around sixty - eight occur north of the 45th parallel ( in a region comparable to Siberia ) .


fn_spacy_tokens_for_baseline: They are distributed around the body at , for example , the groin , the armpit and the abdomen , Noyan 's work shows that lymph nodes excised from calves and goats exhibit regular spontaneous movements .

source_bert_toks: they are distributed around the body at , for example , the groin , the arm ##pit and the abdomen , no ##yan ' s work shows that l ##ym ##ph nodes ex ##cise ##d from calves and goats exhibit regular spontaneous movements .

reference_raw: They are distributed around the body, e.g. the groin, the armpit and the abdomen, and Noyan's work shows that the lymph nodes extricated from calves and goats show regular spontaneous movements.

reference_spacy_tokens: They are distributed around the body , e.g. the groin , the armpit and the abdomen , and Noyan 's work shows that the lymph nodes extricated from calves and goats show regular spontaneous movements .


fn_spacy_tokens_for_baseline: Coffin went back to his office , where the death of William Egan at the hands , as they believed , of his son - in - law Terry Place , was still being investigated .

source_bert_toks: coffin went back to his office , where the death of william egan at the hands , as they believed , of his son - in - law terry place , was still being investigated .

reference_raw: Coffin returned to his office, where William Egan's death at the hands of his son, as they believed, Terry Place, was still being investigated.

reference_spacy_tokens: Coffin returned to his office , where William Egan 's death at the hands of his son , as they believed , Terry Place , was still being investigated .


fn_spacy_tokens_for_baseline: By the doors , where the couple had been , three teenage boys were scuffling and messing around .

source_bert_toks: by the doors , where the couple had been , three teenage boys were sc ##uf ##fl ##ing and messing around .

reference_raw: At the door, where the couple had been, three teenage boys were fighting and messing with each other.

reference_spacy_tokens: At the door , where the couple had been , three teenage boys were fighting and messing with each other .


fn_spacy_tokens_for_baseline: They would perturb the metal glass interface , imposing a shallow largescale dimple pattern on the resulting glass sheet .

source_bert_toks: they would per ##tur ##b the metal glass interface , imposing a shallow large ##sca ##le dim ##ple pattern on the resulting glass sheet .

reference_raw: They would break through the metal glass interface and place a shallow, large-scale dimple pattern on the resulting glass sheet.

reference_spacy_tokens: They would break through the metal glass interface and place a shallow , large - scale dimple pattern on the resulting glass sheet .


fn_spacy_tokens_for_baseline: Everyone laughed and clapped and then Oliver used a whole heap of long words and each time he used one we all whooped .

source_bert_toks: everyone laughed and clapped and then oliver used a whole heap of long words and each time he used one we all who ##oped .

reference_raw: They all laughed and applauded, and then Oliver used a lot of long words, and every time he used one of us whooped.

reference_spacy_tokens: They all laughed and applauded , and then Oliver used a lot of long words , and every time he used one of us whooped .


fn_spacy_tokens_for_baseline: This hypothesis predicts that females with autoimmunity may be particularly prone to this mechanism of ' inadequate tolerization ' by virtue of extremely skewed X- chromosome inactivation .

source_bert_toks: this hypothesis predict ##s that females with auto ##im ##mun ##ity may be particularly prone to this mechanism of ' inadequate to ##ler ##ization ' by virtue of extremely sk ##ew ##ed x - chromosome ina ##ct ##ivation .

reference_raw: This assumption assumes that women with autoimmunity may be particularly susceptible to this mechanism of 'inadequate tolerance' due to very skewed X-chromosome inactivation.

reference_spacy_tokens: This assumption assumes that women with autoimmunity may be particularly susceptible to this mechanism of ' inadequate tolerance ' due to very skewed X - chromosome inactivation .


fn_spacy_tokens_for_baseline: She rummaged in her handbag for the key on its wooden key ring and tried to fit it into the lock .

source_bert_toks: she rum ##mage ##d in her hand ##bag for the key on its wooden key ring and tried to fit it into the lock .

reference_raw: She fumbled in her purse for the key on the wooden key ring and tried to fit it into the lock.

reference_spacy_tokens: She fumbled in her purse for the key on the wooden key ring and tried to fit it into the lock .


fn_spacy_tokens_for_baseline: MIKE Small was branded ' stupid ' by furious boss Billy Bonds after being sent off for swearing at a linesman at Oakwell yesterday .

source_bert_toks: mike small was branded ' stupid ' by furious boss billy bonds after being sent off for swearing at a lines ##man at oak ##well yesterday .

reference_raw: Mike Small was labeled "stupid" by an angry boss, Billy Bonds, after he was sent away yesterday for swearing at a lineman in Oakwell.

reference_spacy_tokens: Mike Small was labeled " stupid " by an angry boss , Billy Bonds , after he was sent away yesterday for swearing at a lineman in Oakwell .


fn_spacy_tokens_for_baseline: And I remember talking to my husband about that in the car ride home , as well , because we 're both teachers and I was -- when I hear things like that , I immediately think of my students , and I was thinking about the diverse group of students that I have in my classroom , who all have different religious viewpoints , and how difficult that would be to tell one student that , you know , we ca n't express your belief , but we can express that person 's belief in the classroom .

source_bert_toks: and i remember talking to my husband about that in the car ride home , as well , because we ' re both teachers and i was - - when i hear things like that , i immediately think of my students , and i was thinking about the diverse group of students that i have in my classroom , who all have different religious viewpoint ##s , and how difficult that would be to tell one student that , you know , we can ' t express your belief , but we can express that person ' s belief in the classroom .

reference_raw: And I remember talking to my husband about it on the way home, too, because we're both teachers, and I was-- when I hear things like that, I'm thinking about my students, and I'm thinking about the different group of students I have in my class, who all have different religious opinions, and how hard it would be to say to one student that we can't express your faith, but we can express that person's opinion. faith in class.

reference_spacy_tokens: And I remember talking to my husband about it on the way home , too , because we 're both teachers , and I was-- when I hear things like that , I 'm thinking about my students , and I 'm thinking about the different group of students I have in my class , who all have different religious opinions , and how hard it would be to say to one student that we ca n't express your faith , but we can express that person 's opinion . faith in class .


fn_spacy_tokens_for_baseline: We have a bird - table in the garden , and love to watch the variety of birds feeding there .

source_bert_toks: we have a bird - table in the garden , and love to watch the variety of birds feeding there .

reference_raw: We have a bird table in the garden, and we like to watch birds feed there.

reference_spacy_tokens: We have a bird table in the garden , and we like to watch birds feed there .


fn_spacy_tokens_for_baseline: Opposite the Macau Ferry Terminal you 'll find the Western Market ( open 10 am - 7 pm ) .

source_bert_toks: opposite the macau ferry terminal you ' ll find the western market ( open 10 am - 7 pm ) .

reference_raw: You will find the western market against the Macau Ferry terminal (open 10 a.m. - 7 p.m.).

reference_spacy_tokens: You will find the western market against the Macau Ferry terminal ( open 10 a.m. - 7 p.m. ) .


fn_spacy_tokens_for_baseline: I shall always be grateful to him for not giving me the usual reply of an adult to a curious child 's questions , ' You 're too young to understand . '

source_bert_toks: i shall always be grateful to him for not giving me the usual reply of an adult to a curious child ' s questions , ' you ' re too young to understand . '

reference_raw: I'll always be grateful that he didn't give me the usual answer of a grown-up to a strange child's question, "You're too young to understand."

reference_spacy_tokens: I 'll always be grateful that he did n't give me the usual answer of a grown - up to a strange child 's question , " You 're too young to understand . "


fn_spacy_tokens_for_baseline: I believe that what you are saying is that > no draft > was " submitted , " but rather " made available for review , " albeit with > rather late > instructions as to location and ownership .

source_bert_toks: i believe that what you are saying is that > no draft > was " submitted , " but rather " made available for review , " albeit with > rather late > instructions as to location and ownership .

reference_raw: I think you're saying that >no proposal >was "submitted", but rather "made available for review", although with >rately delayed instructions on location and ownership.

reference_spacy_tokens: I think you 're saying that > no proposal > was " submitted " , but rather " made available for review " , although with > rately delayed instructions on location and ownership .


fn_spacy_tokens_for_baseline: The chairs and tables , shopping baskets , watering cans and tablecloths are Western , as are the flowers .

source_bert_toks: the chairs and tables , shopping baskets , watering cans and table ##cloth ##s are western , as are the flowers .

reference_raw: The chairs and tables, the shopping baskets, the water-cans and the tablecloths are Western, and so are the flowers.

reference_spacy_tokens: The chairs and tables , the shopping baskets , the water - cans and the tablecloths are Western , and so are the flowers .


fn_spacy_tokens_for_baseline: I shrugged in frustration .

source_bert_toks: i shrugged in frustration .

reference_raw: I shook my head in frustration.

reference_spacy_tokens: I shook my head in frustration .


fn_spacy_tokens_for_baseline: Hong Kong 's liveliest market scene is the Temple Street Night Market ( see page 55 ) , near Jordan Road .

source_bert_toks: hong kong ' s live ##liest market scene is the temple street night market ( see page 55 ) , near jordan road .

reference_raw: The most vivid market scene in Hong Kong is the Temple Street Night Market (see page 55), not far from Jordan Road.

reference_spacy_tokens: The most vivid market scene in Hong Kong is the Temple Street Night Market ( see page 55 ) , not far from Jordan Road .


fn_spacy_tokens_for_baseline: I had seen the donkeys plodding reluctantly up the escarpment to fetch water miles away .

source_bert_toks: i had seen the donkey ##s pl ##od ##ding reluctantly up the es ##car ##pment to fetch water miles away .

reference_raw: I saw the donkeys trudging reluctantly up the escarpment for water miles away.

reference_spacy_tokens: I saw the donkeys trudging reluctantly up the escarpment for water miles away .


fn_spacy_tokens_for_baseline: Algeria is the only African country using natural gas significantly at home where it supplies over half the country 's energy needs .

source_bert_toks: algeria is the only african country using natural gas significantly at home where it supplies over half the country ' s energy needs .

reference_raw: Algeria is the only African State that makes significant use of natural gas at home, where it supplies more than half of its energy needs.

reference_spacy_tokens: Algeria is the only African State that makes significant use of natural gas at home , where it supplies more than half of its energy needs .


fn_spacy_tokens_for_baseline: When injected with heparin there was a normal fertilization - induced calcium transient , whereas the response to either GTP- g S or InsP 3 was inhibited .

source_bert_toks: when injected with he ##par ##in there was a normal fe ##rti ##lization - induced calcium transient , whereas the response to either gt ##p - g s or ins ##p 3 was inhibit ##ed .

reference_raw: During administration of heparin, normal fertilisation-induced calcium was transient, while response to either GTP-g S or ISP 3 was inhibited.

reference_spacy_tokens: During administration of heparin , normal fertilisation - induced calcium was transient , while response to either GTP - g S or ISP 3 was inhibited .


fn_spacy_tokens_for_baseline: Henry raised himself on tiptoe and pranced across the room .

source_bert_toks: henry raised himself on tip ##to ##e and pr ##ance ##d across the room .

reference_raw: Henry got up on his toes and walked across the room.

reference_spacy_tokens: Henry got up on his toes and walked across the room .


fn_spacy_tokens_for_baseline: Cologne was sprayed about and lipsticks swished up and down .

source_bert_toks: cologne was sprayed about and lipstick ##s sw ##ished up and down .

reference_raw: Cologne was sprayed around, and lipsticks flew up and down.

reference_spacy_tokens: Cologne was sprayed around , and lipsticks flew up and down .


fn_spacy_tokens_for_baseline: He captured Isaac 's wife and daughter , and having promised not to put the former ruler in irons , had silver chains made for him .

source_bert_toks: he captured isaac ' s wife and daughter , and having promised not to put the former ruler in iron ##s , had silver chains made for him .

reference_raw: He'd captured Isaac's wife and daughter, and he'd promised not to put the former ruler in irons, and he'd made silver strings for him.

reference_spacy_tokens: He 'd captured Isaac 's wife and daughter , and he 'd promised not to put the former ruler in irons , and he 'd made silver strings for him .


fn_spacy_tokens_for_baseline: We should hope that it presages a more thorough review of alcohol taxation .

source_bert_toks: we should hope that it pre ##sa ##ges a more thorough review of alcohol taxation .

reference_raw: We should hope that this will lead to a more in-depth review of the taxation of alcohol.

reference_spacy_tokens: We should hope that this will lead to a more in - depth review of the taxation of alcohol .


fn_spacy_tokens_for_baseline: His father , a builder and carrier , was one of the first carters to stable his horses in favour of steam traction lorries .

source_bert_toks: his father , a builder and carrier , was one of the first carter ##s to stable his horses in favour of steam traction lo ##rries .

reference_raw: His father, a builder and transporter, was one of the first wagons to stabilize the horses for steam trucks.

reference_spacy_tokens: His father , a builder and transporter , was one of the first wagons to stabilize the horses for steam trucks .


fn_spacy_tokens_for_baseline: At four months they are encouraged to follow their mother on her nightly hunt , though she makes them stay still and hidden during the final stalk to avoid spooking the prey .

source_bert_toks: at four months they are encouraged to follow their mother on her nightly hunt , though she makes them stay still and hidden during the final stalk to avoid sp ##ook ##ing the prey .

reference_raw: At the end of four months, they are encouraged to follow their mother on her night hunt, but she forces them to stay calm and hide during the last stalk, so as not to frighten the prey.

reference_spacy_tokens: At the end of four months , they are encouraged to follow their mother on her night hunt , but she forces them to stay calm and hide during the last stalk , so as not to frighten the prey .


fn_spacy_tokens_for_baseline: The purse seine nets are made of large mesh in which it is easy for a dolphin to get its flipper or snout caught .

source_bert_toks: the purse seine nets are made of large mesh in which it is easy for a dolphin to get its flip ##per or snout caught .

reference_raw: The purse seine nets are made of large nets where dolphins can easily catch their fins or snouts.

reference_spacy_tokens: The purse seine nets are made of large nets where dolphins can easily catch their fins or snouts .


fn_spacy_tokens_for_baseline: Indeed one of my more embarrassing moments was when a child was told not to sit like Um Yusef .

source_bert_toks: indeed one of my more embarrassing moments was when a child was told not to sit like um yu ##sef .

reference_raw: In fact, one of my more awkward moments was when I told the kid not to sit like Um Yusef.

reference_spacy_tokens: In fact , one of my more awkward moments was when I told the kid not to sit like Um Yusef .


fn_spacy_tokens_for_baseline: Three partygoers then stormed the police car in an attempt to free Willis and the other man .

source_bert_toks: three party ##go ##ers then stormed the police car in an attempt to free willis and the other man .

reference_raw: Three sidekicks attacked a police car in an attempt to free Willis and the other man.

reference_spacy_tokens: Three sidekicks attacked a police car in an attempt to free Willis and the other man .


fn_spacy_tokens_for_baseline: She was dangerous to other people , dangerous to Drew .

source_bert_toks: she was dangerous to other people , dangerous to drew .

reference_raw: She was a danger to others, a danger to Drew.

reference_spacy_tokens: She was a danger to others , a danger to Drew .


fn_spacy_tokens_for_baseline: It is easy to see why the ancient art is on the ropes .

source_bert_toks: it is easy to see why the ancient art is on the ropes .

reference_raw: You can easily understand why the ancient arts are on the ropes.

reference_spacy_tokens: You can easily understand why the ancient arts are on the ropes .


fn_spacy_tokens_for_baseline: It is , however , not easy to backstitch the neckband through the open loops because of the loops which are part of the construction of the yarn .

source_bert_toks: it is , however , not easy to backs ##ti ##tch the neck ##band through the open loops because of the loops which are part of the construction of the yarn .

reference_raw: However, due to the loops involved in the construction of the yarn, it is not easy to back the neck band with open loops.

reference_spacy_tokens: However , due to the loops involved in the construction of the yarn , it is not easy to back the neck band with open loops .


fn_spacy_tokens_for_baseline: But it is Day - Lewis who dominates everything as he races around , long locks flowing and trusty musket in tow .

source_bert_toks: but it is day - lewis who dominates everything as he races around , long locks flowing and trust ##y mu ##ske ##t in tow .

reference_raw: But it is Day-Lewis who dominates everything as he races around, the long castles flowing and the trusty musket in his tow.

reference_spacy_tokens: But it is Day - Lewis who dominates everything as he races around , the long castles flowing and the trusty musket in his tow .


fn_spacy_tokens_for_baseline: Argentina has blocked the equipment sale because of US pressure but has not formally informed Iran that INVAP will not be permitted to supply the facilities .

source_bert_toks: argentina has blocked the equipment sale because of us pressure but has not formally informed iran that in ##va ##p will not be permitted to supply the facilities .

reference_raw: Argentina blocked the sale of equipment due to pressure from the United States, but did not formally inform Iran that INVAP would not be allowed to supply the equipment.

reference_spacy_tokens: Argentina blocked the sale of equipment due to pressure from the United States , but did not formally inform Iran that INVAP would not be allowed to supply the equipment .


fn_spacy_tokens_for_baseline: You were so open about your admiration for him .

source_bert_toks: you were so open about your admiration for him .

reference_raw: You've been so honest with him about how much you admire him.

reference_spacy_tokens: You 've been so honest with him about how much you admire him .


fn_spacy_tokens_for_baseline: Yorke , 21 today , was returning home from a charity event at 2 am , the city 's magistrates heard .

source_bert_toks: york ##e , 21 today , was returning home from a charity event at 2a ##m , the city ' s magistrates heard .

reference_raw: Yorke, 21 this morning, was coming home from a charity event at 2:00 a.m., heard by the town judges.

reference_spacy_tokens: Yorke , 21 this morning , was coming home from a charity event at 2:00 a.m. , heard by the town judges .


fn_spacy_tokens_for_baseline: Analysts noted that the Taliban movement rebounded quickly from other leadership losses resulting from capture or assassination .

source_bert_toks: analysts noted that the taliban movement rebound ##ed quickly from other leadership losses resulting from capture or assassination .

reference_raw: Analysts noted that the Taliban movement was rapidly recovering from further loss of leadership as a result of captivity or assassination.

reference_spacy_tokens: Analysts noted that the Taliban movement was rapidly recovering from further loss of leadership as a result of captivity or assassination .


fn_spacy_tokens_for_baseline: We treat criminals in a disrespectful and often dehumanising way so that they will continue to express our Shadow .

source_bert_toks: we treat criminals in a di ##sr ##es ##pe ##ct ##ful and often de ##hum ##ani ##sing way so that they will continue to express our shadow .

reference_raw: We treat criminals disrespectfully, often dehumanizingly, so that they continue to express our shadow.

reference_spacy_tokens: We treat criminals disrespectfully , often dehumanizingly , so that they continue to express our shadow .


fn_spacy_tokens_for_baseline: Meanwhile the Getty Museum will continue its study of the Kouros and is mounting an exhibition at the Museum in January 1993 which will incorporate much of the debate from the recent conference .

source_bert_toks: meanwhile the get ##ty museum will continue its study of the ko ##uro ##s and is mounting an exhibition at the museum in january 1993 which will incorporate much of the debate from the recent conference .

reference_raw: In the meantime, the Getty Museum will continue to study the Kouros and will organise an exhibition at the museum in January 1993, which will include most of the debates of the recent conference.

reference_spacy_tokens: In the meantime , the Getty Museum will continue to study the Kouros and will organise an exhibition at the museum in January 1993 , which will include most of the debates of the recent conference .


fn_spacy_tokens_for_baseline: If help is nowhere to be found , and you ca n't outrun whoever is chasing you , then substitute cunning for speed .

source_bert_toks: if help is nowhere to be found , and you can ' t out ##run whoever is chasing you , then substitute cunning for speed .

reference_raw: If you can't find help, and you can't get away from whoever's after you, then replace cunning with speed.

reference_spacy_tokens: If you ca n't find help , and you ca n't get away from whoever 's after you , then replace cunning with speed .


fn_spacy_tokens_for_baseline: A smile was overdue , but showed no sign of coming .

source_bert_toks: a smile was over ##due , but showed no sign of coming .

reference_raw: The smile was late, but there was no sign of coming.

reference_spacy_tokens: The smile was late , but there was no sign of coming .


fn_spacy_tokens_for_baseline: You can catch one of Hong Kong 's historic trams along Des Voeux Road and ride from Central to Causeway Bay ( see box , page 66 ) .

source_bert_toks: you can catch one of hong kong ' s historic trams along des vo ##eux road and ride from central to causeway bay ( see box , page 66 ) .

reference_raw: You can catch one of Hong Kong's historical trolleys along Des Voeux Road and drive from Central to Causeway Bay (see box, page 66).

reference_spacy_tokens: You can catch one of Hong Kong 's historical trolleys along Des Voeux Road and drive from Central to Causeway Bay ( see box , page 66 ) .


fn_spacy_tokens_for_baseline: The doctors had given me strict orders to keep warm while I was recuperating and there was no heating at all in the house , ' said Mrs Easby .

source_bert_toks: the doctors had given me strict orders to keep warm while i was rec ##up ##era ##ting and there was no heating at all in the house , ' said mrs ea ##sby .

reference_raw: The doctors gave me strict orders to keep warm while I'm recovering, and there's no heat in the house,' said Mrs. Easby.

reference_spacy_tokens: The doctors gave me strict orders to keep warm while I 'm recovering , and there 's no heat in the house , ' said Mrs. Easby .


fn_spacy_tokens_for_baseline: ' He can not deliver the Latino vote , ' says Angelo Falcon , head of a non - profit think - tank on Puerto Rican politics , ' but he will help to tip it . '

source_bert_toks: ' he can not deliver the latino vote , ' says angelo falcon , head of a non - profit think - tank on puerto rican politics , ' but he will help to tip it . '

reference_raw: 'He can't deliver a Latin vote,' says Angelo Falcon, the leader of a non-profit think-tank on Puerto Rican politics, 'but he'll help us tip it off.'

reference_spacy_tokens: ' He ca n't deliver a Latin vote , ' says Angelo Falcon , the leader of a non - profit think - tank on Puerto Rican politics , ' but he 'll help us tip it off . '


fn_spacy_tokens_for_baseline: He went around the cut in the belly so that he could examine it from the inside .

source_bert_toks: he went around the cut in the belly so that he could examine it from the inside .

reference_raw: He circled the wound in his stomach to look at it from the inside.

reference_spacy_tokens: He circled the wound in his stomach to look at it from the inside .


fn_spacy_tokens_for_baseline: Make sure the ones you buy do n't cause drowsiness and avoid any combination drugs .

source_bert_toks: make sure the ones you buy don ' t cause dr ##ows ##iness and avoid any combination drugs .

reference_raw: Make sure those you buy do not cause sleepiness and avoid any combination of drugs.

reference_spacy_tokens: Make sure those you buy do not cause sleepiness and avoid any combination of drugs .


fn_spacy_tokens_for_baseline: The quake knocked The Well out for six hours , but when it came back up , it teemed with emotional first - hand reports .

source_bert_toks: the quake knocked the well out for six hours , but when it came back up , it tee ##med with emotional first - hand reports .

reference_raw: The earthquake took the Well out for six hours, but when it came back up again, it was full of emotional firsthand messages.

reference_spacy_tokens: The earthquake took the Well out for six hours , but when it came back up again , it was full of emotional firsthand messages .


fn_spacy_tokens_for_baseline: At the beginning of the second millennium b.c . , Jerusalem was a Canaanite mountain stronghold on a secondary trade route , far less important than biblical cities such as Hazor , Megiddo , Beth Shean , and Shechem .

source_bert_toks: at the beginning of the second millennium b . c . , jerusalem was a can ##aan ##ite mountain stronghold on a secondary trade route , far less important than biblical cities such as ha ##zo ##r , meg ##id ##do , beth shea ##n , and she ##che ##m .

reference_raw: At the beginning of the second millennium B.C., Jerusalem was a Canaanite peak fort on a secondary trade route, far less important than biblical cities like Hazor, Megiddo, Beth Shean, and Shechem.

reference_spacy_tokens: At the beginning of the second millennium B.C. , Jerusalem was a Canaanite peak fort on a secondary trade route , far less important than biblical cities like Hazor , Megiddo , Beth Shean , and Shechem .


fn_spacy_tokens_for_baseline: 2 ) reveals the search strategy and attribute sort order at the bottom of the page .

reference_raw: 2) reveals the search strategy and the sort sequence of attributes at the bottom of the page.

reference_spacy_tokens: 2 ) reveals the search strategy and the sort sequence of attributes at the bottom of the page .


fn_spacy_tokens_for_baseline: In 1984 , South Korea supplied Iran with copies of the Finnish Kemira respirators , which proved to be deficient .

source_bert_toks: in 1984 , south korea supplied iran with copies of the finnish ke ##mir ##a res ##pi ##rator ##s , which proved to be def ##icient .

reference_raw: In 1984, South Korea provided Iran with copies of Kemira respirators in Finland, which proved inadequate.

reference_spacy_tokens: In 1984 , South Korea provided Iran with copies of Kemira respirators in Finland , which proved inadequate .


fn_spacy_tokens_for_baseline: Widows have suffered an additional loss from the freezing of the £ 1,000 widow 's payment , a matter on which the Government are curiously shy .

source_bert_toks: widows have suffered an additional loss from the freezing of the £1 , 000 widow ' s payment , a matter on which the government are curiously shy .

reference_raw: The widows suffered another loss as a result of the freezing of the widow's salary of £1,000, a matter on which the government is curiously shy.

reference_spacy_tokens: The widows suffered another loss as a result of the freezing of the widow 's salary of £ 1,000 , a matter on which the government is curiously shy .


fn_spacy_tokens_for_baseline: It is customary to think of the defeat of Hitler as a ' Zero Hour ' in German history , when everything started with a clean slate .

source_bert_toks: it is customary to think of the defeat of hitler as a ' zero hour ' in german history , when everything started with a clean slate .

reference_raw: It's common to think of Hitler's defeat as a zero hour in German history, when it all began with a clean slate.

reference_spacy_tokens: It 's common to think of Hitler 's defeat as a zero hour in German history , when it all began with a clean slate .


fn_spacy_tokens_for_baseline: ' The mineral is described , as sometimes lying in the mine in form resembling a tree .

source_bert_toks: ' the mineral is described , as sometimes lying in the mine in form resembling a tree .

reference_raw: The mineral is described as sometimes lying in a mine in the shape of a tree.

reference_spacy_tokens: The mineral is described as sometimes lying in a mine in the shape of a tree .


fn_spacy_tokens_for_baseline: A babble of protest broke out but no one could deny the logic of my master 's conclusions .

source_bert_toks: a ba ##bble of protest broke out but no one could deny the logic of my master ' s conclusions .

reference_raw: There was a murmur of protest, but no one could deny the logic of my master's conclusions.

reference_spacy_tokens: There was a murmur of protest , but no one could deny the logic of my master 's conclusions .


fn_spacy_tokens_for_baseline: She stalked into the teachers ' room and returned with her cane .

source_bert_toks: she stalked into the teachers ' room and returned with her cane .

reference_raw: She went into the teacher's room and came back with her staff.

reference_spacy_tokens: She went into the teacher 's room and came back with her staff .


fn_spacy_tokens_for_baseline: The water rises 12 metres as the tide is forced into the funnel of the Severn estuary and into the Avon river .

source_bert_toks: the water rises 12 metres as the tide is forced into the funnel of the severn estuary and into the avon river .

reference_raw: When the tide is forced into the funnel of the Severn estuary and into the Avon River, the water goes up 12 meters.

reference_spacy_tokens: When the tide is forced into the funnel of the Severn estuary and into the Avon River , the water goes up 12 meters .


fn_spacy_tokens_for_baseline: They , as well as numerous Latin American and East European countries that hope to adopt elements of the Spanish model , are supporting the direction Spain is taking .

source_bert_toks: they , as well as numerous latin american and east european countries that hope to adopt elements of the spanish model , are supporting the direction spain is taking .

reference_raw: They, like many Latin American and Eastern European countries who hope to accept the elements of the Spanish model, are in favour of the direction that Spain is taking.

reference_spacy_tokens: They , like many Latin American and Eastern European countries who hope to accept the elements of the Spanish model , are in favour of the direction that Spain is taking .


fn_spacy_tokens_for_baseline: A brief period of training using the manual provided with the program is all that is required for a manager to start developing his own models .

source_bert_toks: a brief period of training using the manual provided with the program is all that is required for a manager to start developing his own models .

reference_raw: A short period of training using the handbook provided by the program is all that is necessary for the manager to start developing his own models.

reference_spacy_tokens: A short period of training using the handbook provided by the program is all that is necessary for the manager to start developing his own models .


fn_spacy_tokens_for_baseline: U.S. Congressman Tony Hall arrived here Sunday evening , becoming the first U.S. lawmaker to visit Iraq since the 1991 Gulf War .

source_bert_toks: u . s . congressman tony hall arrived here sunday evening , becoming the first u . s . law ##maker to visit iraq since the 1991 gulf war .

reference_raw: United States Congressman Tony Hall arrived on Sunday night and became the first American lawman to visit Iraq since the Gulf War of 1991.

reference_spacy_tokens: United States Congressman Tony Hall arrived on Sunday night and became the first American lawman to visit Iraq since the Gulf War of 1991 .


fn_spacy_tokens_for_baseline: By 1826 Henry Milner was in the employ of William Cavendish , sixth Duke of Devonshire [ q.v . ] , at Chatsworth , where he served in a variety of posts , including gardener and porter .

source_bert_toks: by 1826 henry milne ##r was in the employ of william cavendish , sixth duke of devon ##shire [ q . v . ] , at chat ##sworth , where he served in a variety of posts , including gardener and porter .

reference_raw: In 1826, Henry Milner worked for William Cavendish, the sixth Duke of Devonshire [Q.V.] in Chatsworth, where he served in various places, including gardeners and porters.

reference_spacy_tokens: In 1826 , Henry Milner worked for William Cavendish , the sixth Duke of Devonshire [ Q.V. ] in Chatsworth , where he served in various places , including gardeners and porters .


fn_spacy_tokens_for_baseline: There were so many unforeseeable things .

source_bert_toks: there were so many un ##for ##ese ##ea ##ble things .

reference_raw: There were so many unpredictable things.

reference_spacy_tokens: There were so many unpredictable things .


fn_spacy_tokens_for_baseline: I was touched by these kindnesses , but also suspicious : Why were they doing this ?

source_bert_toks: i was touched by these kindness ##es , but also suspicious : why were they doing this ?

reference_raw: These favors touched me, but they also suspected: why did they do that?

reference_spacy_tokens: These favors touched me , but they also suspected : why did they do that ?


fn_spacy_tokens_for_baseline: The Resettlement Administration ( RA ) attempted to aid destitute farmers trying to scratch a living from exhausted land , as well as the predominantly black sharecroppers of the South .

source_bert_toks: the reset ##tlement administration ( ra ) attempted to aid des ##ti ##tute farmers trying to scratch a living from exhausted land , as well as the predominantly black share ##cr ##op ##pers of the south .

reference_raw: The Resettlement Office (RA) has tried to help deprive farmers who seek to scrape their livelihoods from depleted land and mainly from the Black Sharecroppers of the South.

reference_spacy_tokens: The Resettlement Office ( RA ) has tried to help deprive farmers who seek to scrape their livelihoods from depleted land and mainly from the Black Sharecroppers of the South .


fn_spacy_tokens_for_baseline: One of the serious problems with Kane 's work is that , despite its theoretical fragility , it is simple , comprehensive and , unfortunately , appealing ; it explains everything to do with blacks ' sporting success as rooted in race .

source_bert_toks: one of the serious problems with kane ' s work is that , despite its theoretical fra ##gil ##ity , it is simple , comprehensive and , unfortunately , appealing ; it explains everything to do with blacks ' sporting success as rooted in race .

reference_raw: One of the major problems with Kane's work is that, despite its theoretical instability, it is simple, complex, and, sadly, attractive; it explains everything that has to do with the success of the blacks as rooted in the race.

reference_spacy_tokens: One of the major problems with Kane 's work is that , despite its theoretical instability , it is simple , complex , and , sadly , attractive ; it explains everything that has to do with the success of the blacks as rooted in the race .


fn_spacy_tokens_for_baseline: One was a sheltered lay - by just off East Germany 's Highway Seven , which runs in an east - west line parallel to the motorway E40 .

source_bert_toks: one was a sheltered lay - by just off east germany ' s highway seven , which runs in an east - west line parallel to the motorway e ##40 .

reference_raw: One of them was a sheltered lay next to East German Highway Seven, running on the east-west line parallel to the E40 motorway.

reference_spacy_tokens: One of them was a sheltered lay next to East German Highway Seven , running on the east - west line parallel to the E40 motorway .


fn_spacy_tokens_for_baseline: The approach was regarded by the government as being of particular benefit to the older urban areas .

source_bert_toks: the approach was regarded by the government as being of particular benefit to the older urban areas .

reference_raw: The government considered this approach to be particularly beneficial for older urban areas.

reference_spacy_tokens: The government considered this approach to be particularly beneficial for older urban areas .


fn_spacy_tokens_for_baseline: That it could conceivably be used as a low - cost simple two station network is a bonus .

source_bert_toks: that it could con ##ce ##iva ##bly be used as a low - cost simple two station network is a bonus .

reference_raw: The fact that it can be used as a cheap, simple two-station network is a bonus.

reference_spacy_tokens: The fact that it can be used as a cheap , simple two - station network is a bonus .


fn_spacy_tokens_for_baseline: For me , the signature flavours of Thai cookery are coriander leaf and root , lemon grass and kaffir lime leaf .

source_bert_toks: for me , the signature flavour ##s of thai cooke ##ry are co ##rian ##der leaf and root , lemon grass and ka ##ffi ##r lime leaf .

reference_raw: For me, the tasty tastes of Thai cookery are coriander leaves and roots, lemon grass and kaffir lime leaves.

reference_spacy_tokens: For me , the tasty tastes of Thai cookery are coriander leaves and roots , lemon grass and kaffir lime leaves .


fn_spacy_tokens_for_baseline: We were entering woodland and , by the twittering and warbling from oak , ash and pine , were going to see more birds .

source_bert_toks: we were entering woodland and , by the twitter ##ing and war ##bling from oak , ash and pine , were going to see more birds .

reference_raw: We entered the forest and saw more birds by the twittering and tumbling of oak, ash, and pine.

reference_spacy_tokens: We entered the forest and saw more birds by the twittering and tumbling of oak , ash , and pine .


fn_spacy_tokens_for_baseline: Members of the church believe that whites are the real children of Israel , Jews are the evil offspring of Satan or Cain , and blacks and other racial minorities are sub - human .

source_bert_toks: members of the church believe that whites are the real children of israel , jews are the evil offspring of satan or cain , and blacks and other racial minorities are sub - human .

reference_raw: Church members believe that whites are true children of Israel, Jews are evil descendants of Satan or Cain, and blacks and other racial minorities are sub-human.

reference_spacy_tokens: Church members believe that whites are true children of Israel , Jews are evil descendants of Satan or Cain , and blacks and other racial minorities are sub - human .


fn_spacy_tokens_for_baseline: A huge torrent of blood streamed from the locket .

source_bert_toks: a huge torre ##nt of blood streamed from the locke ##t .

reference_raw: A great stream of blood flowed from the medallion.

reference_spacy_tokens: A great stream of blood flowed from the medallion .


fn_spacy_tokens_for_baseline: The lenses of my binocs were rain - smeared and blurry , but the cloth -- actually a clean handkerchief -- was already wringing wet .

source_bert_toks: the lenses of my bin ##oc ##s were rain - smeared and blur ##ry , but the cloth - - actually a clean handkerchief - - was already wr ##inging wet .

reference_raw: The lenses of my binocs were rain-smeared and blurry, but the cloth - in fact a clean handkerchief - was already moist.

reference_spacy_tokens: The lenses of my binocs were rain - smeared and blurry , but the cloth - in fact a clean handkerchief - was already moist .


fn_spacy_tokens_for_baseline: So long as Britain remained the leading industrial force , it was relatively easy to reconcile moral purpose with the defence of British power .

source_bert_toks: so long as britain remained the leading industrial force , it was relatively easy to reconcile moral purpose with the defence of british power .

reference_raw: As long as Britain remained the leading industrial power, it was relatively easy to reconcile moral purpose with the defense of British power.

reference_spacy_tokens: As long as Britain remained the leading industrial power , it was relatively easy to reconcile moral purpose with the defense of British power .


fn_spacy_tokens_for_baseline: Sir Leon extended early parole to many more short - sentence prisoners and virtually abolished it for long - term offenders convicted on drugs , sex , arson , and violence charges .

source_bert_toks: sir leon extended early parole to many more short - sentence prisoners and virtually abolished it for long - term offenders convicted on drugs , sex , arson , and violence charges .

reference_raw: Sir Leon has extended the early parole to a number of other short-sentence prisoners and has practically abolished it for long-term perpetrators charged with drugs, sex, arson, and violence.

reference_spacy_tokens: Sir Leon has extended the early parole to a number of other short - sentence prisoners and has practically abolished it for long - term perpetrators charged with drugs , sex , arson , and violence .


fn_spacy_tokens_for_baseline: Both young and old go through ballet - like movements in slow motion to discipline the mind and body .

source_bert_toks: both young and old go through ballet - like movements in slow motion to discipline the mind and body .

reference_raw: Both the youth and the old go through ballet-like slow-motion motions to discipline the mind and body.

reference_spacy_tokens: Both the youth and the old go through ballet - like slow - motion motions to discipline the mind and body .


fn_spacy_tokens_for_baseline: The upshot was the appalling rout of the Scottish army by the English at Solway Moss on 24 November 1542 .

source_bert_toks: the ups ##hot was the app ##all ##ing ro ##ut of the scottish army by the english at sol ##way moss on 24 november 154 ##2 .

reference_raw: On November 24, 1542, the upshot was a terrible route of the Scottish Army by the English at Solway Moss.

reference_spacy_tokens: On November 24 , 1542 , the upshot was a terrible route of the Scottish Army by the English at Solway Moss .


fn_spacy_tokens_for_baseline: Shops in Central are an exception ; they generally close at 6 pm and are not open on Sunday .

source_bert_toks: shops in central are an exception ; they generally close at 6 pm and are not open on sunday .

reference_raw: The shops in Central are an exception; they usually close at 6:00 a.m. and they don't open on Saturdays.

reference_spacy_tokens: The shops in Central are an exception ; they usually close at 6:00 a.m. and they do n't open on Saturdays .


fn_spacy_tokens_for_baseline: She had a ferocious and alienating attachment to independence , but very little idea of what to do with it .

source_bert_toks: she had a ferocious and alien ##ating attachment to independence , but very little idea of what to do with it .

reference_raw: She had a fierce and alien attachment to independence, but she had no idea what to do with it.

reference_spacy_tokens: She had a fierce and alien attachment to independence , but she had no idea what to do with it .


fn_spacy_tokens_for_baseline: Meanwhile , Bates was turning his 270-acre Grange Farm , Bucks , into a fortress to keep newsmen at bay .

source_bert_toks: meanwhile , bates was turning his 270 - acre grange farm , bucks , into a fortress to keep news ##men at bay .

reference_raw: Bates, meanwhile, had transformed his 270-acre Grange Farm, Bucks, into a fortress to keep the reporters in check.

reference_spacy_tokens: Bates , meanwhile , had transformed his 270-acre Grange Farm , Bucks , into a fortress to keep the reporters in check .


fn_spacy_tokens_for_baseline: McCutcheon was also ordered to pay court costs of £ 420 .

source_bert_toks: mcc ##ut ##cheon was also ordered to pay court costs of £ ##42 ##0 .

reference_raw: McCutcheon has also been instructed to pay the costs incurred by the Court of First Instance in the amount of £420.

reference_spacy_tokens: McCutcheon has also been instructed to pay the costs incurred by the Court of First Instance in the amount of £ 420 .


fn_spacy_tokens_for_baseline: And that 's Mick Weeble the racing manager at the Oxford Stadium .

source_bert_toks: and that ' s mick wee ##ble the racing manager at the oxford stadium .

reference_raw: And this is Mick Weeble, the head of the Oxford Stadium.

reference_spacy_tokens: And this is Mick Weeble , the head of the Oxford Stadium .


fn_spacy_tokens_for_baseline: She had n't even noticed where they were , but now he was guiding her up some stone steps , and she realised by the background music that they were heading for Pepe 's .

source_bert_toks: she hadn ' t even noticed where they were , but now he was guiding her up some stone steps , and she realised by the background music that they were heading for pep ##e ' s .

reference_raw: She hadn't even noticed where they were, but now he was leading her up the stone steps, and she realized from the background music that they were headed for Pepe's.

reference_spacy_tokens: She had n't even noticed where they were , but now he was leading her up the stone steps , and she realized from the background music that they were headed for Pepe 's .


fn_spacy_tokens_for_baseline: This has brought Islam once again into direct confrontation with the British school system .

source_bert_toks: this has brought islam once again into direct confrontation with the british school system .

reference_raw: This brought Islam back into direct conflict with the British school system.

reference_spacy_tokens: This brought Islam back into direct conflict with the British school system .


fn_spacy_tokens_for_baseline: Lorton could hear the clatter of saucepans as she prepared dinner .

source_bert_toks: lo ##rton could hear the cl ##atter of sauce ##pan ##s as she prepared dinner .

reference_raw: As she prepared dinner, Lorton heard the rattle of saucepans.

reference_spacy_tokens: As she prepared dinner , Lorton heard the rattle of saucepans .


fn_spacy_tokens_for_baseline: In 1990 , the Soviet Union and Iran began negotiating over the completion of the Bushehr reactors and the supply of additional nuclear plants .

source_bert_toks: in 1990 , the soviet union and iran began negotiating over the completion of the bush ##eh ##r reactors and the supply of additional nuclear plants .

reference_raw: In 1990, the Soviet Union and Iran began negotiations to complete the Bushehr reactors and supply other nuclear power plants.

reference_spacy_tokens: In 1990 , the Soviet Union and Iran began negotiations to complete the Bushehr reactors and supply other nuclear power plants .


fn_spacy_tokens_for_baseline: NAGANO , Japan ( AP ) --- The local newspaper printed up an extra edition Sunday to announce the first gold medal of the games going to a Russian cross - country skier .

source_bert_toks: naga ##no , japan ( ap ) - - - the local newspaper printed up an extra edition sunday to announce the first gold medal of the games going to a russian cross - country skier .

reference_raw: NAGANO, Japan (AP) -- Local newspapers have published an extra edition on Sunday to announce the first gold medal of the games going to a Russian skier across the country.

reference_spacy_tokens: NAGANO , Japan ( AP ) -- Local newspapers have published an extra edition on Sunday to announce the first gold medal of the games going to a Russian skier across the country .


fn_spacy_tokens_for_baseline: They now began to side with the extreme wing of the pied noir integrationist movement , which openly called for his overthrow .

source_bert_toks: they now began to side with the extreme wing of the pie ##d noir integration ##ist movement , which openly called for his overthrow .

reference_raw: Now they began to flank the extreme wing of the pied noir integrationist movement, which openly called for his overthrow.

reference_spacy_tokens: Now they began to flank the extreme wing of the pied noir integrationist movement , which openly called for his overthrow .


fn_spacy_tokens_for_baseline: They played throughout the second half in peeved mood , allowing Blackburn to assume the dictating role with Gordon Cowans prompting from midfield and Speedie in predatory form up front .

source_bert_toks: they played throughout the second half in pee ##ved mood , allowing blackburn to assume the di ##cta ##ting role with gordon cowan ##s prompting from midfield and speed ##ie in predatory form up front .

reference_raw: Throughout the second half, they played in a wet mood, allowing Blackburn to take the dictating role of Gordon Cowans, prompting him out of midfield and Speedie in a predatory form ahead of him.

reference_spacy_tokens: Throughout the second half , they played in a wet mood , allowing Blackburn to take the dictating role of Gordon Cowans , prompting him out of midfield and Speedie in a predatory form ahead of him .


fn_spacy_tokens_for_baseline: There were clear signals , then , from the beginning of his time in power , that Deng would not tolerate serious dissent .

source_bert_toks: there were clear signals , then , from the beginning of his time in power , that deng would not tolerate serious dissent .

reference_raw: Then, from the start of his time in power, there were clear indications that Deng would not stand up to serious disapproval.

reference_spacy_tokens: Then , from the start of his time in power , there were clear indications that Deng would not stand up to serious disapproval .


fn_spacy_tokens_for_baseline: The facility , which was designed to destroy 350 tons of nerve agent yearly utilizing hydrolysis followed by incineration , cost 50 million rubles and took more than three years to build .

source_bert_toks: the facility , which was designed to destroy 350 tons of nerve agent yearly utilizing hydro ##lysis followed by inc ##iner ##ation , cost 50 million rub ##les and took more than three years to build .

reference_raw: The device, designed to destroy 350 tons of nerve agents each year using hydrolysis followed by incineration, cost 50 million rubles and lasted more than three years.

reference_spacy_tokens: The device , designed to destroy 350 tons of nerve agents each year using hydrolysis followed by incineration , cost 50 million rubles and lasted more than three years .


fn_spacy_tokens_for_baseline: It did not help at all that upon arrival yesterday the royal couple instantly touched base in that comforting symbol of past British power , the Hong Kong and Shanghai Bank .

source_bert_toks: it did not help at all that upon arrival yesterday the royal couple instantly touched base in that comforting symbol of past british power , the hong kong and shanghai bank .

reference_raw: It didn't help that, when the royal couple arrived yesterday, they immediately touched the base with that soothing symbol of the former British power, Hong Kong and Shanghai Bank.

reference_spacy_tokens: It did n't help that , when the royal couple arrived yesterday , they immediately touched the base with that soothing symbol of the former British power , Hong Kong and Shanghai Bank .


fn_spacy_tokens_for_baseline: Ace , ' he said , gesturing back into the Bagi as he exited past her , ' your department , I think . '

source_bert_toks: ace , ' he said , gesturing back into the bag ##i as he exited past her , ' your department , i think . '

reference_raw: Ace," he said, pointing to the Bagi as he passed her, "I think your department."

reference_spacy_tokens: Ace , " he said , pointing to the Bagi as he passed her , " I think your department . "


fn_spacy_tokens_for_baseline: ' My blood boils with anger , ' said Mr Brownlow .

source_bert_toks: ' my blood boil ##s with anger , ' said mr brown ##low .

reference_raw: "My blood burns with anger," said Mr. Brownlow.

reference_spacy_tokens: " My blood burns with anger , " said Mr. Brownlow .


fn_spacy_tokens_for_baseline: They also confirmed that the purported secession of the north western part of the country had not been recognised .

source_bert_toks: they also confirmed that the purported secession of the north western part of the country had not been recognised .

reference_raw: They also confirmed that the alleged separation of the northwest part of the country was not recognised.

reference_spacy_tokens: They also confirmed that the alleged separation of the northwest part of the country was not recognised .


fn_spacy_tokens_for_baseline: Arnold Bennett caught this splendidly in the story of Denry Machin , an ambitious and well - off young councillor , who brought back a local footballing hero to the town at his own expense .

source_bert_toks: arnold bennett caught this splendid ##ly in the story of den ##ry mach ##in , an ambitious and well - off young councillor , who brought back a local football ##ing hero to the town at his own expense .

reference_raw: Arnold Bennett found it wonderfully in the story of Denry Machin, an ambitious and successful young councillor who had brought a local football hero into the city at his own expense.

reference_spacy_tokens: Arnold Bennett found it wonderfully in the story of Denry Machin , an ambitious and successful young councillor who had brought a local football hero into the city at his own expense .


fn_spacy_tokens_for_baseline: Do active axons stimulate developing Schwann cells or their precursors to divide ?

source_bert_toks: do active ax ##ons stimulate developing sc ##hwa ##nn cells or their precursor ##s to divide ?

reference_raw: Do active axons stimulate the development of Schwann cells or their predecessors to divide?

reference_spacy_tokens: Do active axons stimulate the development of Schwann cells or their predecessors to divide ?


fn_spacy_tokens_for_baseline: The United States is insisting on the " complete , verifiable and irreversible dismantlement ( CVID ) ) " of the North Korean nuclear program before addressing North Korean security and economic concerns .

source_bert_toks: the united states is insisting on the " complete , ve ##ri ##fia ##ble and ir ##re ##vers ##ible di ##sman ##tlement ( cv ##id ) ) " of the north korean nuclear program before addressing north korean security and economic concerns .

reference_raw: Before addressing North Korea's security and economic concerns, the United States insists on "complete, verified and irreversible dismantling (CVID)" of the North Korean nuclear programme.

reference_spacy_tokens: Before addressing North Korea 's security and economic concerns , the United States insists on " complete , verified and irreversible dismantling ( CVID ) " of the North Korean nuclear programme .


fn_spacy_tokens_for_baseline: Paul regularly runs out of the nursery to play ball in a busy street ; he has also run home by himself and was nearly hit by a lorry .

source_bert_toks: paul regularly runs out of the nursery to play ball in a busy street ; he has also run home by himself and was nearly hit by a lo ##rry .

reference_raw: Paul ran out of the preschool regularly to play ball in a busy street; he also ran home alone and was almost hit by a truck.

reference_spacy_tokens: Paul ran out of the preschool regularly to play ball in a busy street ; he also ran home alone and was almost hit by a truck .


fn_spacy_tokens_for_baseline: A survey record had been falsified to show that the Manchus were not entitled to the protection of citizenship -- that in fact they were aliens possessed of only minimal intelligence .

source_bert_toks: a survey record had been fa ##ls ##ified to show that the manchu ##s were not entitled to the protection of citizenship - - that in fact they were aliens possessed of only minimal intelligence .

reference_raw: A reconnaissance record was forged to show that the Manchus had no right to the protection of citizenship - that they were, in fact, extraterrestrials with only minimal intelligence.

reference_spacy_tokens: A reconnaissance record was forged to show that the Manchus had no right to the protection of citizenship - that they were , in fact , extraterrestrials with only minimal intelligence .


fn_spacy_tokens_for_baseline: It was just a curious coincidence that Hatton had been killed on the day following that of Mrs Fanshawe 's regaining consciousness .

source_bert_toks: it was just a curious coincidence that hat ##ton had been killed on the day following that of mrs fans ##haw ##e ' s regaining consciousness .

reference_raw: It was just a curious accident that Hatton was killed the day after Mrs. Fanshaw regained consciousness.

reference_spacy_tokens: It was just a curious accident that Hatton was killed the day after Mrs. Fanshaw regained consciousness .


fn_spacy_tokens_for_baseline: Tass news agency said hundreds of wagons rolled in to the southern Soviet republic bordering Turkey , three days after the Soviet parliament authorised the army to take over the railways .

source_bert_toks: ta ##ss news agency said hundreds of wagons rolled in to the southern soviet republic bordering turkey , three days after the soviet parliament authorised the army to take over the railways .

reference_raw: The Tass News Agency said that hundreds of wagons had flown into the South Soviet Republic, along the line of Turkey, three days after the Soviet Parliament had authorised the military to take over the railroads.

reference_spacy_tokens: The Tass News Agency said that hundreds of wagons had flown into the South Soviet Republic , along the line of Turkey , three days after the Soviet Parliament had authorised the military to take over the railroads .


fn_spacy_tokens_for_baseline: Distribution control has cut out two layers from the chain , given PTGI greater control of retail stock levels -- and increased margins .

source_bert_toks: distribution control has cut out two layers from the chain , given pt ##gi greater control of retail stock levels - - and increased margins .

reference_raw: The distribution control removed two layers from the chain, given that PTGI had more control over the level of retail stocks - and increased margins.

reference_spacy_tokens: The distribution control removed two layers from the chain , given that PTGI had more control over the level of retail stocks - and increased margins .


fn_spacy_tokens_for_baseline: ' Bloody rotten sod , you are , ' she said .

source_bert_toks: ' bloody rotten so ##d , you are , ' she said .

reference_raw: 'You're blood-stained sod,' she said.

reference_spacy_tokens: ' You 're blood - stained sod , ' she said .


fn_spacy_tokens_for_baseline: At a news conference at the Royal Geographical Society in London , they described the mental and physical anguish of their 95-day trek .

source_bert_toks: at a news conference at the royal geographical society in london , they described the mental and physical anguish of their 95 - day trek .

reference_raw: At a press conference at the Royal Geographical Society in London, they described the mental and physical distress of their 95-day journey.

reference_spacy_tokens: At a press conference at the Royal Geographical Society in London , they described the mental and physical distress of their 95-day journey .


fn_spacy_tokens_for_baseline: Temperatures plummeted 20 degrees so they clapped harder .

source_bert_toks: temperatures plum ##met ##ed 20 degrees so they clapped harder .

reference_raw: The temperatures dropped to 20 degrees, so they clapped harder.

reference_spacy_tokens: The temperatures dropped to 20 degrees , so they clapped harder .


fn_spacy_tokens_for_baseline: The Russian Foreign Minister , Andrei Kozyrev , visited Japan on March 19 - 22 for discussions concerning the longstanding territorial dispute over the Kurile Islands , known in Japan as the Northern Territories .

source_bert_toks: the russian foreign minister , andrei ko ##zy ##re ##v , visited japan on march 19 - 22 for discussions concerning the long ##standing territorial dispute over the ku ##ril ##e islands , known in japan as the northern territories .

reference_raw: On March 19-22, the Russian Foreign Minister, Andrei Kozyrev, visited Japan to discuss a long-term territorial conflict with the Kurile Islands, known in Japan as the Northern Territories.

reference_spacy_tokens: On March 19 - 22 , the Russian Foreign Minister , Andrei Kozyrev , visited Japan to discuss a long - term territorial conflict with the Kurile Islands , known in Japan as the Northern Territories .


fn_spacy_tokens_for_baseline: Children were prohibited from smoking in the streets and the sale of tobacco to them became an offence .

source_bert_toks: children were prohibited from smoking in the streets and the sale of tobacco to them became an offence .

reference_raw: Children were forbidden to smoke on the streets, and the sale of tobacco became a crime.

reference_spacy_tokens: Children were forbidden to smoke on the streets , and the sale of tobacco became a crime .


fn_spacy_tokens_for_baseline: Steel himself was a noted tactician , more concerned with manoeuvre than with policy - making , a style appropriate for the parliamentary situation .

source_bert_toks: steel himself was a noted tactic ##ian , more concerned with man ##oe ##u ##vre than with policy - making , a style appropriate for the parliamentary situation .

reference_raw: Steel himself was a noted tactician, more interested in maneuvering than in policy making, a style suited to the parliamentary situation.

reference_spacy_tokens: Steel himself was a noted tactician , more interested in maneuvering than in policy making , a style suited to the parliamentary situation .


fn_spacy_tokens_for_baseline: The muscles in his face had flexed tight as he spoke and his breathing had become uneven .

source_bert_toks: the muscles in his face had flexed tight as he spoke and his breathing had become uneven .

reference_raw: As he spoke, the muscles in his face tightened, and his breathing became uneven.

reference_spacy_tokens: As he spoke , the muscles in his face tightened , and his breathing became uneven .


fn_spacy_tokens_for_baseline: The country had been a disappointment to him .

source_bert_toks: the country had been a disappointment to him .

reference_raw: The country was disappointing to him.

reference_spacy_tokens: The country was disappointing to him .


fn_spacy_tokens_for_baseline: Yanto grunted some inaudible remark and was introducing her to a goggle - eyed Billy as Nigger joined them .

source_bert_toks: yan ##to grunted some ina ##udi ##ble remark and was introducing her to a go ##ggle - eyed billy as ni ##gger joined them .

reference_raw: Yanto grumbled a few inaudible remarks and introduced her to Billy's glasses as Nigger joined them.

reference_spacy_tokens: Yanto grumbled a few inaudible remarks and introduced her to Billy 's glasses as Nigger joined them .


fn_spacy_tokens_for_baseline: The door was wrenched open , the messenger hit on the head with a cosh , and the money taken . '

source_bert_toks: the door was wrenched open , the messenger hit on the head with a co ##sh , and the money taken . '

reference_raw: The door was opened, the messenger struck the head with money, and the money was taken.'

reference_spacy_tokens: The door was opened , the messenger struck the head with money , and the money was taken . '


fn_spacy_tokens_for_baseline: But , as her grandfather had drummed into her then , she had no right to inflict pain simply because the other person was telling a truth that was hard for her to cope with .

source_bert_toks: but , as her grandfather had drum ##med into her then , she had no right to in ##flict pain simply because the other person was telling a truth that was hard for her to cope with .

reference_raw: But, as her grandfather had drummed into her at the time, she had no right to cause pain simply because the other was telling the truth that was difficult for her to deal with.

reference_spacy_tokens: But , as her grandfather had drummed into her at the time , she had no right to cause pain simply because the other was telling the truth that was difficult for her to deal with .


fn_spacy_tokens_for_baseline: Eighteen year old Sandra Griffiths , a kennel maid , has been undergoing surgery in Milton Keynes General Hospital .

source_bert_toks: eighteen year old sandra griffiths , a ken ##nel maid , has been undergoing surgery in milton keynes general hospital .

reference_raw: The 18-year-old Sandra Griffiths, the Kennel Handmaid, was undergoing surgery at Milton Keynes General Hospital.

reference_spacy_tokens: The 18-year - old Sandra Griffiths , the Kennel Handmaid , was undergoing surgery at Milton Keynes General Hospital .


fn_spacy_tokens_for_baseline: He said he would pay particular attention to what happens to food and medicine entering the country under the U.N. oil - for - food program .

source_bert_toks: he said he would pay particular attention to what happens to food and medicine entering the country under the u . n . oil - for - food program .

reference_raw: He said he'd pay special attention to what happens to food and medicine entering the country under the UN oil-for-food program.

reference_spacy_tokens: He said he 'd pay special attention to what happens to food and medicine entering the country under the UN oil - for - food program .


fn_spacy_tokens_for_baseline: Vietnamese officials provided Quinn with military evidence ' proving ' that Col . Robertson was dead , according to a Vietnam News Agency report on July 26 .

source_bert_toks: vietnamese officials provided quinn with military evidence ' proving ' that col . robertson was dead , according to a vietnam news agency report on july 26 .

reference_raw: According to a report from the Vietnam News Agency on July 26th, Vietnamese officials provided Quinn with military evidence that Colonel Robertson was dead.

reference_spacy_tokens: According to a report from the Vietnam News Agency on July 26th , Vietnamese officials provided Quinn with military evidence that Colonel Robertson was dead .


fn_spacy_tokens_for_baseline: He met with a hostile response from the Pagan population , but did convert Dionysus who later became the patron saint of Athens .

source_bert_toks: he met with a hostile response from the pagan population , but did convert dion ##ys ##us who later became the patron saint of athens .

reference_raw: He encountered a hostile response from the Pagan people, but he converted Dionysus, who later became the patron saint of Athens.

reference_spacy_tokens: He encountered a hostile response from the Pagan people , but he converted Dionysus , who later became the patron saint of Athens .


fn_spacy_tokens_for_baseline: The glow in his eyes made her heart swell , but she could n't resist a gentle tease .

source_bert_toks: the glow in his eyes made her heart swell , but she couldn ' t resist a gentle tease .

reference_raw: Her heart swelled with the glare of his eyes, but she could not resist the gentle teasing.

reference_spacy_tokens: Her heart swelled with the glare of his eyes , but she could not resist the gentle teasing .


fn_spacy_tokens_for_baseline: Dublin has international restaurants galore , and the New Irish Cuisine is built upon fresh products of Ireland 's seas , rivers , and farms .

source_bert_toks: dublin has international restaurants gal ##ore , and the new irish cuisine is built upon fresh products of ireland ' s seas , rivers , and farms .

reference_raw: Dublin has a galore of international restaurants, and the new Irish cuisine is based on new products from Irish seas, rivers and farms.

reference_spacy_tokens: Dublin has a galore of international restaurants , and the new Irish cuisine is based on new products from Irish seas , rivers and farms .


fn_spacy_tokens_for_baseline: It was considered a treat to perform in Nehushtah 's chambers , despite her peculiar foreign ways , because she always showered the Ixmaritians with gifts and gave them delicious food and wine for refreshment .

source_bert_toks: it was considered a treat to perform in ne ##hus ##hta ##h ' s chambers , despite her peculiar foreign ways , because she always showered the ix ##mar ##itia ##ns with gifts and gave them delicious food and wine for ref ##resh ##ment .

reference_raw: It was considered a treat to be performed in Nehushtah's chambers, in spite of her strange strange manners, for she always showered the Ixmaritians with gifts and gave them excellent food and wine for refreshment.

reference_spacy_tokens: It was considered a treat to be performed in Nehushtah 's chambers , in spite of her strange strange manners , for she always showered the Ixmaritians with gifts and gave them excellent food and wine for refreshment .


fn_spacy_tokens_for_baseline: The Doctor looked at Ace in genuine amazement until , with a smile , she raised a hand so he could see the oil glistening on her gloved fingers .

source_bert_toks: the doctor looked at ace in genuine amazement until , with a smile , she raised a hand so he could see the oil glistening on her glove ##d fingers .

reference_raw: The doctor looked at Ace with genuine surprise until she raised her hand, smiling, so that he could see the oil gleaming on her gauntleted fingers.

reference_spacy_tokens: The doctor looked at Ace with genuine surprise until she raised her hand , smiling , so that he could see the oil gleaming on her gauntleted fingers .


fn_spacy_tokens_for_baseline: As of early September 2004 , Iran was cited as testing its Shehab-3 missile for a second time , further proving its persistence to test and develop its extended range missile capabilities .

source_bert_toks: as of early september 2004 , iran was cited as testing its she ##hab - 3 missile for a second time , further proving its persistence to test and develop its extended range missile capabilities .

reference_raw: Since the beginning of September 2004, Iran has been referred to as a second test of its Shehab-3 missile, which further demonstrates its persistence in testing and developing its extended range missile capacity.

reference_spacy_tokens: Since the beginning of September 2004 , Iran has been referred to as a second test of its Shehab-3 missile , which further demonstrates its persistence in testing and developing its extended range missile capacity .


fn_spacy_tokens_for_baseline: But the most chilling deduction from the fact of Bill Sweet 's murder was the immediate danger to Jacqui .

source_bert_toks: but the most chilling de ##duction from the fact of bill sweet ' s murder was the immediate danger to ja ##c ##qui .

reference_raw: But the coldest inference from the fact that Bill Sweet was murdered was the immediate danger to Jacqui.

reference_spacy_tokens: But the coldest inference from the fact that Bill Sweet was murdered was the immediate danger to Jacqui .


fn_spacy_tokens_for_baseline: The first is the heads of the tribes .

source_bert_toks: the first is the heads of the tribes .

reference_raw: The first is tribal leaders.

reference_spacy_tokens: The first is tribal leaders .


fn_spacy_tokens_for_baseline: There were waves of red faces , smiling and shiny in the lamplight , their mouths open as the men roared and sang .

source_bert_toks: there were waves of red faces , smiling and shiny in the lamp ##light , their mouths open as the men roared and sang .

reference_raw: There were waves of red faces, smiling and glittering in the light of the lamp, their mouths open as the men roared and sang.

reference_spacy_tokens: There were waves of red faces , smiling and glittering in the light of the lamp , their mouths open as the men roared and sang .


fn_spacy_tokens_for_baseline: Field barns were built to serve land lying some distance from the farmstead , or which could only be reached from it by way of steep hills .

source_bert_toks: field barns were built to serve land lying some distance from the farms ##tead , or which could only be reached from it by way of steep hills .

reference_raw: Field stables had been built to serve land that lay some distance from the farmhouse, or could only be reached from it through steep hills.

reference_spacy_tokens: Field stables had been built to serve land that lay some distance from the farmhouse , or could only be reached from it through steep hills .


fn_spacy_tokens_for_baseline: However , the end of the golden age was drawing near .

source_bert_toks: however , the end of the golden age was drawing near .

reference_raw: But the end of the golden era was nearing.

reference_spacy_tokens: But the end of the golden era was nearing .


fn_spacy_tokens_for_baseline: To remove his statue in such a disrespectful manner was an insult not only to Mao Zedong but also the Communist Party .

source_bert_toks: to remove his statue in such a di ##sr ##es ##pe ##ct ##ful manner was an insult not only to mao ze ##dong but also the communist party .

reference_raw: Disposing of his statue in such a disrespectful way was an affront not only to Mao Zedong, but also to the Communist Party.

reference_spacy_tokens: Disposing of his statue in such a disrespectful way was an affront not only to Mao Zedong , but also to the Communist Party .


fn_spacy_tokens_for_baseline: Growth continued for ten years , and by 1915 the town had telephones , round - the - clock electricity , and a growing population -- many of whom worked in the railroad repair shop .

source_bert_toks: growth continued for ten years , and by 1915 the town had telephone ##s , round - the - clock electricity , and a growing population - - many of whom worked in the railroad repair shop .

reference_raw: Growth continued for ten years, and by 1915 the city had telephones, round-the-clock electricity, and a growing population, many of whom worked in a railway repair store.

reference_spacy_tokens: Growth continued for ten years , and by 1915 the city had telephones , round - the - clock electricity , and a growing population , many of whom worked in a railway repair store .


fn_spacy_tokens_for_baseline: Time spent practising skills , learning facts , and doing exercises is needed to allow understanding of concepts and knowledge to grow by experience and observation .

source_bert_toks: time spent pr ##act ##ising skills , learning facts , and doing exercises is needed to allow understanding of concepts and knowledge to grow by experience and observation .

reference_raw: The time spent practicing skills, learning facts and training is needed to enable the understanding of concepts and knowledge to grow with experience and observation.

reference_spacy_tokens: The time spent practicing skills , learning facts and training is needed to enable the understanding of concepts and knowledge to grow with experience and observation .


fn_spacy_tokens_for_baseline: The friends laughed and squealed with delight as they took a short boat trip to see the crocodiles and hippos that live on the lake .

source_bert_toks: the friends laughed and squealed with delight as they took a short boat trip to see the crocodile ##s and hip ##po ##s that live on the lake .

reference_raw: Friends laughed and howled with joy as they took a short boat trip to see the crocodiles and hippos living on the lake.

reference_spacy_tokens: Friends laughed and howled with joy as they took a short boat trip to see the crocodiles and hippos living on the lake .


fn_spacy_tokens_for_baseline: That feeling was strange , she resisted it , she knew that it was absurd as well as amoral , but in the end she told herself that she could not command her feelings : she was no longer able to torment herself with thoughts of their wars nor to enjoy their celebrations , because she was filled with the conviction that none of it was her concern .

source_bert_toks: that feeling was strange , she resisted it , she knew that it was absurd as well as amor ##al , but in the end she told herself that she could not command her feelings : she was no longer able to torment herself with thoughts of their wars nor to enjoy their celebrations , because she was filled with the conviction that none of it was her concern .

reference_raw: The feeling was strange, she resisted, she knew it was both ridiculous and amoral, but in the end she thought she couldn't control her feelings: she could no longer torture herself with the thoughts of their wars or enjoy their celebrations, for she was filled with the belief that none of it mattered to her.

reference_spacy_tokens: The feeling was strange , she resisted , she knew it was both ridiculous and amoral , but in the end she thought she could n't control her feelings : she could no longer torture herself with the thoughts of their wars or enjoy their celebrations , for she was filled with the belief that none of it mattered to her .


fn_spacy_tokens_for_baseline: He suffered discredit by opposing , and then capitulating to , the campaign for military conscription .

source_bert_toks: he suffered disc ##red ##it by opposing , and then cap ##it ##ulating to , the campaign for military conscription .

reference_raw: He suffered discredit by opposing and then surrendering to the campaign of military conscription.

reference_spacy_tokens: He suffered discredit by opposing and then surrendering to the campaign of military conscription .


fn_spacy_tokens_for_baseline: The room chilled quickly .

source_bert_toks: the room chilled quickly .

reference_raw: The room was cold.

reference_spacy_tokens: The room was cold .


fn_spacy_tokens_for_baseline: Why are we so timid ? '

source_bert_toks: why are we so tim ##id ? '

reference_raw: Why are we so shy?'

reference_spacy_tokens: Why are we so shy ? '


fn_spacy_tokens_for_baseline: Earlier this year Cardinal Glemp repudiated this agreement but he has now been prevailed upon to honour it .

source_bert_toks: earlier this year cardinal g ##lem ##p rep ##udi ##ated this agreement but he has now been prevailed upon to honour it .

reference_raw: Earlier this year, Cardinal Glemp repudiated the treaty, but now he's won to honor it.

reference_spacy_tokens: Earlier this year , Cardinal Glemp repudiated the treaty , but now he 's won to honor it .


fn_spacy_tokens_for_baseline: Earlier in the week , insurgents ambushed newly arrived Marines near here and a Marine patrol was ambushed outside Ramadi on Thursday night .

source_bert_toks: earlier in the week , insurgents ambushed newly arrived marines near here and a marine patrol was ambushed outside rama ##di on thursday night .

reference_raw: Earlier this week, the newly arrived Marines were attacked by rebels, and a Marine patrol was attacked outside Ramadi on Thursday night.

reference_spacy_tokens: Earlier this week , the newly arrived Marines were attacked by rebels , and a Marine patrol was attacked outside Ramadi on Thursday night .


fn_spacy_tokens_for_baseline: Lord Minto commented to The Art Newspaper , ' Infinite years were spent trying to find potential ways of preserving Minto house , but there was next to no interest whatever .

source_bert_toks: lord mint ##o commented to the art newspaper , ' infinite years were spent trying to find potential ways of preserving mint ##o house , but there was next to no interest whatever .

reference_raw: Lord Minto remarked to the Art Newspaper, "Infinite years have been spent trying to find a possible way to keep Minto's house, but no matter what.

reference_spacy_tokens: Lord Minto remarked to the Art Newspaper , " Infinite years have been spent trying to find a possible way to keep Minto 's house , but no matter what .


fn_spacy_tokens_for_baseline: The bottle of champagne took five attempts to break , the roses dropped , out of the two passing aircraft , missed the ceremony by 200 yards and the balloons drifted off downwind , unnoticed .

source_bert_toks: the bottle of champagne took five attempts to break , the roses dropped , out of the two passing aircraft , missed the ceremony by 200 yards and the balloons drifted off down ##wind , unnoticed .

reference_raw: The glass of champagne took five attempts to break, the roses fell from the two passing planes, missed the ceremony by 200 yards, and the balloons flew out of the wind unnoticed.

reference_spacy_tokens: The glass of champagne took five attempts to break , the roses fell from the two passing planes , missed the ceremony by 200 yards , and the balloons flew out of the wind unnoticed .


fn_spacy_tokens_for_baseline: Working class individuals ( who report a higher incidence of stress than the mobile middle classes ) adjust their goal preferences more slowly than high - achieving middle class individuals .

source_bert_toks: working class individuals ( who report a higher incidence of stress than the mobile middle classes ) adjust their goal preferences more slowly than high - achieving middle class individuals .

reference_raw: Workers (who report a higher stress rate than mobile middle classes) adjust their target preferences more slowly than high-achieving middle-class people.

reference_spacy_tokens: Workers ( who report a higher stress rate than mobile middle classes ) adjust their target preferences more slowly than high - achieving middle - class people .


fn_spacy_tokens_for_baseline: Only the equally massive Central Station in Tokyo could compare with it .

source_bert_toks: only the equally massive central station in tokyo could compare with it .

reference_raw: Only the same massive central station in Tokyo could match it.

reference_spacy_tokens: Only the same massive central station in Tokyo could match it .


fn_spacy_tokens_for_baseline: Robert Adams has photographed subjects which have usually been ignored by photographers driving somewhere else , to where landscape really begins .

source_bert_toks: robert adams has photographed subjects which have usually been ignored by photographers driving somewhere else , to where landscape really begins .

reference_raw: Robert Adams took pictures of subjects that were usually ignored by cameramen who were going somewhere else, where the country really began.

reference_spacy_tokens: Robert Adams took pictures of subjects that were usually ignored by cameramen who were going somewhere else , where the country really began .


fn_spacy_tokens_for_baseline: Predicting that conditions would be better in 1993 , he acknowledged , however , that moving agriculture to a market economy had been ' the most complicated problem ' and that agricultural market mechanisms were not working well .

source_bert_toks: predicting that conditions would be better in 1993 , he acknowledged , however , that moving agriculture to a market economy had been ' the most complicated problem ' and that agricultural market mechanisms were not working well .

reference_raw: He anticipated better conditions in 1993, but acknowledged that moving agriculture to a market economy was one of the most complex problems and that agricultural market mechanisms did not work well.

reference_spacy_tokens: He anticipated better conditions in 1993 , but acknowledged that moving agriculture to a market economy was one of the most complex problems and that agricultural market mechanisms did not work well .


fn_spacy_tokens_for_baseline: He reached into any dip of information for enlightenment on the customs and manners of the people of Oceania .

source_bert_toks: he reached into any dip of information for enlightenment on the customs and manners of the people of oceania .

reference_raw: To enlighten him about the habits and manners of the people of Oceania, he reached into every dip of information.

reference_spacy_tokens: To enlighten him about the habits and manners of the people of Oceania , he reached into every dip of information .


fn_spacy_tokens_for_baseline: ' It 's well known that Maurice likes a night out but the media attention he gets in Britain makes it difficult for him to enjoy it .

source_bert_toks: ' it ' s well known that maurice likes a night out but the media attention he gets in britain makes it difficult for him to enjoy it .

reference_raw: It is well known that Maurice likes to spend the night outside, but the media focus he receives in Britain makes it difficult for him to enjoy it.

reference_spacy_tokens: It is well known that Maurice likes to spend the night outside , but the media focus he receives in Britain makes it difficult for him to enjoy it .


fn_spacy_tokens_for_baseline: Most baccarat tables are located in quiet , sequestered sections of the casino .

source_bert_toks: most ba ##cca ##rat tables are located in quiet , se ##quest ##ered sections of the casino .

reference_raw: Most of the baccarat tables are located in peaceful, sequestered parts of the casino.

reference_spacy_tokens: Most of the baccarat tables are located in peaceful , sequestered parts of the casino .


fn_spacy_tokens_for_baseline: At length Mrs Goreng terminated proceedings by saying , ' Well , we have taken up too much of Monsignor 's time already . '

source_bert_toks: at length mrs gore ##ng terminated proceedings by saying , ' well , we have taken up too much of mons ##ign ##or ' s time already . '

reference_raw: Finally Mrs. Goreng closed the proceedings and said, "Well, we've spent too much time on Monsignor."

reference_spacy_tokens: Finally Mrs. Goreng closed the proceedings and said , " Well , we 've spent too much time on Monsignor . "


fn_spacy_tokens_for_baseline: After a while , Cissie learned not to speak of Maisie , but she confided her sadness in Beth .

source_bert_toks: after a while , cis ##sie learned not to speak of mai ##sie , but she con ##fide ##d her sadness in beth .

reference_raw: After a while, Cissie learned not to talk about Maisie, but told Beth how sad she was.

reference_spacy_tokens: After a while , Cissie learned not to talk about Maisie , but told Beth how sad she was .


fn_spacy_tokens_for_baseline: His behaviour became anti - social or unpredictable at times .

source_bert_toks: his behaviour became anti - social or unpredictable at times .

reference_raw: Sometimes his behavior became antisocial or unforeseeable.

reference_spacy_tokens: Sometimes his behavior became antisocial or unforeseeable .


fn_spacy_tokens_for_baseline: I picked up my satchel with its broken strap and walked -- no , limped -- to the window .

source_bert_toks: i picked up my sat ##chel with its broken strap and walked - - no , limp ##ed - - to the window .

reference_raw: I picked up my bag with a broken strap and walked - no, I limped - to the window.

reference_spacy_tokens: I picked up my bag with a broken strap and walked - no , I limped - to the window .


fn_spacy_tokens_for_baseline: LA 's L7 are natural performers ; nothing about them is fake , so when Donita rocks out and grapples with her ' axe ' during ' Wargasm ' it does n't look misplaced or ludicrous .

source_bert_toks: la ' s l ##7 are natural performers ; nothing about them is fake , so when don ##ita rocks out and gr ##apple ##s with her ' axe ' during ' war ##gas ##m ' it doesn ' t look mis ##placed or lu ##dic ##rous .

reference_raw: LA's L7 are natural artists; there's nothing wrong with them, so when Donita rocks and grabs her axe in 'Wargasm', it doesn't seem wrong or ridiculous.

reference_spacy_tokens: LA 's L7 are natural artists ; there 's nothing wrong with them , so when Donita rocks and grabs her axe in ' Wargasm ' , it does n't seem wrong or ridiculous .


fn_spacy_tokens_for_baseline: In the interim report of the Tripartite Coal Industry Examination in 1974 , the NCB , the unions and the government accepted the elimination of ' a broad average of some 3 - 4 million tonne capacity a year ' .

source_bert_toks: in the interim report of the trip ##art ##ite coal industry examination in 1974 , the nc ##b , the unions and the government accepted the elimination of ' a broad average of some 3 - 4 million ton ##ne capacity a year ' .

reference_raw: In the interim report of the Tripartite Coal Examination in 1974, the national central bank, the trade unions and the government agreed to eliminate 'an average of around 3-4 million tonnes per year'.

reference_spacy_tokens: In the interim report of the Tripartite Coal Examination in 1974 , the national central bank , the trade unions and the government agreed to eliminate ' an average of around 3 - 4 million tonnes per year ' .


fn_spacy_tokens_for_baseline: This is primarily designed for small , self - administered pension funds .

source_bert_toks: this is primarily designed for small , self - administered pension funds .

reference_raw: This is mainly intended for small self-management pension funds.

reference_spacy_tokens: This is mainly intended for small self - management pension funds .


fn_spacy_tokens_for_baseline: None of the workers was injured in the incident , the second at the Edgewood Chemical Biological Center , a 1.5 million - square - foot research and engineering facility within APG for chemical and biological defense .

source_bert_toks: none of the workers was injured in the incident , the second at the edge ##wood chemical biological center , a 1 . 5 million - square - foot research and engineering facility within ap ##g for chemical and biological defense .

reference_raw: None of the workers were injured in the accident, the other at the Edgewood Chemical Biological Center, 1.5 million-square-foot research and engineering facilities under the APG for chemical and biological protection.

reference_spacy_tokens: None of the workers were injured in the accident , the other at the Edgewood Chemical Biological Center , 1.5 million - square - foot research and engineering facilities under the APG for chemical and biological protection .


fn_spacy_tokens_for_baseline: In 1605 Lord Chief Justice Popham , prosecutor of Guy Fawkes , Ralegh , and the Queen of Scots , ' undertook ' to drain the fen at Upwell .

source_bert_toks: in 1605 lord chief justice pop ##ham , prosecutor of guy fa ##wk ##es , ra ##leg ##h , and the queen of scots , ' undertook ' to drain the fen at up ##well .

reference_raw: In 1605, Lord Justice Popham, prosecutor of Guy Fawkes, Ralegh, and queen of Scotland, "understand" to drain the fence in Upwell.

reference_spacy_tokens: In 1605 , Lord Justice Popham , prosecutor of Guy Fawkes , Ralegh , and queen of Scotland , " understand " to drain the fence in Upwell .


fn_spacy_tokens_for_baseline: John Williams 's score is overblown self - parody .

source_bert_toks: john williams ' s score is over ##bl ##own self - parody .

reference_raw: The results of John Williams are too self-parody.

reference_spacy_tokens: The results of John Williams are too self - parody .


fn_spacy_tokens_for_baseline: Women carried water jars .

source_bert_toks: women carried water jars .

reference_raw: The women were carrying glasses of water.

reference_spacy_tokens: The women were carrying glasses of water .


fn_spacy_tokens_for_baseline: A federal magistrate informed Pickett of the charges against him --assaulting a federal officer with a deadly weapon , which carries a maximum 10 years in prison .

source_bert_toks: a federal magistrate informed picket ##t of the charges against him - - assault ##ing a federal officer with a deadly weapon , which carries a maximum 10 years in prison .

reference_raw: The federal judge has informed Pickett of the charges against him - attacking a federal officer with a deadly gun that carries a maximum of 10 years in prison.

reference_spacy_tokens: The federal judge has informed Pickett of the charges against him - attacking a federal officer with a deadly gun that carries a maximum of 10 years in prison .


fn_spacy_tokens_for_baseline: " Uranium enrichment will nevertheless proceed inside the halls uninterrupted and unmonitored by the international community , " the diplomat added ( Michael Adler , Agence France - Presse / Yahoo ! News , Feb. 1 ) .

source_bert_toks: " uranium enrichment will nevertheless proceed inside the halls un ##int ##er ##rup ##ted and un ##mon ##itor ##ed by the international community , " the diplomat added ( michael adler , age ##nce france - press ##e / yahoo ! news , feb . 1 ) .

reference_raw: "At the same time, the enrichment of uranium will continue in the halls uninterrupted and unmonitored by the international community," the diplomatic officer added (Michael Adler, Agence France-press/Yahoo! News, February 1).

reference_spacy_tokens: " At the same time , the enrichment of uranium will continue in the halls uninterrupted and unmonitored by the international community , " the diplomatic officer added ( Michael Adler , Agence France - press / Yahoo ! News , February 1 ) .