fn_spacy_tokens_for_baseline: On my left , a vestal virgin who 'd taken possession of a whole bottle of champagne was having a violent argument in Spanish with a man who could only be Nero .

source_bert_toks: on my left , a vest ##al virgin who ' d taken possession of a whole bottle of champagne was having a violent argument in spanish with a man who could only be nero .

reference_raw: On my left, the vestal maid, who had taken over a bottle of champagne, had a violent argument in Spanish with a man who could only be Nero.

reference_spacy_tokens: On my left , the vestal maid , who had taken over a bottle of champagne , had a violent argument in Spanish with a man who could only be Nero .


fn_spacy_tokens_for_baseline: Someone pretty old told us moths flew to light .

source_bert_toks: someone pretty old told us moths flew to light .

reference_raw: Someone very old told us that moths came into the light.

reference_spacy_tokens: Someone very old told us that moths came into the light .


fn_spacy_tokens_for_baseline: Fen made no comment about the meal she set before him , but , she noticed , he ate with relish and from time to time she felt him observing her contemplatively .

source_bert_toks: fen made no comment about the meal she set before him , but , she noticed , he ate with re ##lish and from time to time she felt him observing her con ##tem ##pl ##ative ##ly .

reference_raw: Fen made no comment on the food she had put in front of him, but she noticed that he was eating with pleasure, and from time to time she could feel him watching her thoughtfully.

reference_spacy_tokens: Fen made no comment on the food she had put in front of him , but she noticed that he was eating with pleasure , and from time to time she could feel him watching her thoughtfully .


fn_spacy_tokens_for_baseline: An administration official , speaking on condition of anonymity , said chief U.S. negotiator Richard Holbrooke , an assistant secretary of state , is advocating a military response against the Serbs .

source_bert_toks: an administration official , speaking on condition of an ##ony ##mity , said chief u . s . ne ##go ##tia ##tor richard ho ##lb ##rook ##e , an assistant secretary of state , is advocating a military response against the serbs .

reference_raw: The government official, who speaks under the condition of anonymity, said that the U.S. negotiator Richard Holbrooke, secretary of state, advocates a military reaction against the Serbs.

reference_spacy_tokens: The government official , who speaks under the condition of anonymity , said that the U.S. negotiator Richard Holbrooke , secretary of state , advocates a military reaction against the Serbs .


fn_spacy_tokens_for_baseline: ' How exciting it must be to have a famous mother . '

source_bert_toks: ' how exciting it must be to have a famous mother . '

reference_raw: "It must be thrilling to have a famous mother."

reference_spacy_tokens: " It must be thrilling to have a famous mother . "


fn_spacy_tokens_for_baseline: I had an uncle and aunt killed .

source_bert_toks: i had an uncle and aunt killed .

reference_raw: My cousin and aunt were killed.

reference_spacy_tokens: My cousin and aunt were killed .


fn_spacy_tokens_for_baseline: Clayton continued working in the darkroom while pursuing his goal of becoming a photographer .

source_bert_toks: clayton continued working in the dark ##room while pursuing his goal of becoming a photographer .

reference_raw: Clayton continued to work in the darkroom while pursuing his objective of becoming a photographer.

reference_spacy_tokens: Clayton continued to work in the darkroom while pursuing his objective of becoming a photographer .


fn_spacy_tokens_for_baseline: But trying military wrongdoers may annoy the armed forces , and provoke a fresh coup .

source_bert_toks: but trying military wrong ##do ##ers may ann ##oy the armed forces , and provoke a fresh coup .

reference_raw: But trying to commit military offenses can upset the armed forces and provoke a new coup.

reference_spacy_tokens: But trying to commit military offenses can upset the armed forces and provoke a new coup .


fn_spacy_tokens_for_baseline: Elinor liked ready - seasoned , free - range , corn - fed chicken .

source_bert_toks: eli ##nor liked ready - seasoned , free - range , corn - fed chicken .

reference_raw: Elinor liked ready-seasoned, free-range, corn-fed chicks.

reference_spacy_tokens: Elinor liked ready - seasoned , free - range , corn - fed chicks .


fn_spacy_tokens_for_baseline: There was a powerful reek of ammoniates and incense , with gusts of sour wine and sour flesh .

source_bert_toks: there was a powerful re ##ek of ammonia ##tes and incense , with gust ##s of sour wine and sour flesh .

reference_raw: There was a strong smell of ammonia and incense, with a gust of sour wine and sour meat.

reference_spacy_tokens: There was a strong smell of ammonia and incense , with a gust of sour wine and sour meat .


fn_spacy_tokens_for_baseline: She found that the city 's most beautiful Roman temple , dedicated to the goddess Aphrodite , stood on the site of the crucifixion .

source_bert_toks: she found that the city ' s most beautiful roman temple , dedicated to the goddess ap ##hr ##od ##ite , stood on the site of the cr ##uc ##if ##ix ##ion .

reference_raw: She found that the most beautiful Roman church in the city, dedicated to the goddess Aphrodite, was in the place of the crucifixion.

reference_spacy_tokens: She found that the most beautiful Roman church in the city , dedicated to the goddess Aphrodite , was in the place of the crucifixion .


fn_spacy_tokens_for_baseline: After his arrest he threatened officers by drawing his finger across his neck to suggest he would one day kill them .

source_bert_toks: after his arrest he threatened officers by drawing his finger across his neck to suggest he would one day kill them .

reference_raw: After his arrest, he made a threat to the officers by pulling a finger over his neck to suggest that one day he would kill them.

reference_spacy_tokens: After his arrest , he made a threat to the officers by pulling a finger over his neck to suggest that one day he would kill them .


fn_spacy_tokens_for_baseline: When she had gone , Sarah poured herself out a large mug of thick black tea .

source_bert_toks: when she had gone , sarah poured herself out a large mug of thick black tea .

reference_raw: When she left, Sarah poured herself a large cup of thick black tea.

reference_spacy_tokens: When she left , Sarah poured herself a large cup of thick black tea .


fn_spacy_tokens_for_baseline: Sporting matted hair , an unkempt beard and purple sneakers he even gave Charles and Diana a thumbs - up sign at the end of his performance .

source_bert_toks: sporting matt ##ed hair , an un ##ke ##mpt beard and purple sneakers he even gave charles and diana a thumbs - up sign at the end of his performance .

reference_raw: He even gave Charles and Diana a thumbs-up sign at the end of the show, sporting matted hair, unkempt beard, and purple tennis shoes.

reference_spacy_tokens: He even gave Charles and Diana a thumbs - up sign at the end of the show , sporting matted hair , unkempt beard , and purple tennis shoes .


fn_spacy_tokens_for_baseline: He touched his whip to his hat brim .

source_bert_toks: he touched his whip to his hat br ##im .

reference_raw: He touched the whip to the edge of his hat.

reference_spacy_tokens: He touched the whip to the edge of his hat .


fn_spacy_tokens_for_baseline: Bake , steam or microwave the fish but do not overcook .

source_bert_toks: ba ##ke , steam or microwave the fish but do not over ##co ##ok .

reference_raw: Bake, smoke or microwave fish, but don't overcook.

reference_spacy_tokens: Bake , smoke or microwave fish , but do n't overcook .


fn_spacy_tokens_for_baseline: He felt very frightened , but also desperate with hunger .

source_bert_toks: he felt very frightened , but also desperate with hunger .

reference_raw: He was very scared, but he was also desperate to starve.

reference_spacy_tokens: He was very scared , but he was also desperate to starve .


fn_spacy_tokens_for_baseline: Schools of porpoise , dolphin and sometimes even turtles can also be seen but we were n't so lucky that day .

source_bert_toks: schools of por ##po ##ise , dolphin and sometimes even turtles can also be seen but we weren ' t so lucky that day .

reference_raw: You can see the schools of dolphins, dolphins, and sometimes even tortoises, but we weren't so happy that day.

reference_spacy_tokens: You can see the schools of dolphins , dolphins , and sometimes even tortoises , but we were n't so happy that day .


fn_spacy_tokens_for_baseline: Those of you familiar with car radios where you press ' vol " ' treble " ' bass " ' bal " or ' fade " and then use a single infinitely rotating knob to set the required levels , will know exactly how to operate the JMP-1 .

source_bert_toks: those of you familiar with car radios where you press ' vol " ' tre ##ble " ' bass " ' bal " or ' fade " and then use a single infinitely rotating knob to set the required levels , will know exactly how to operate the j ##mp - 1 .

reference_raw: Those of you who know car radios where you press "vol" "treble" "bass" or "fade" and then use one infinitely rotating button to set the required levels will know exactly how to operate JMP-1.

reference_spacy_tokens: Those of you who know car radios where you press " vol " " treble " " bass " or " fade " and then use one infinitely rotating button to set the required levels will know exactly how to operate JMP-1 .


fn_spacy_tokens_for_baseline: It is clear that the existing site already disturbs the pleasing pattern of enclosed grass fields abutting an attractive cliff slope of natural vegetation .

source_bert_toks: it is clear that the existing site already disturb ##s the pleasing pattern of enclosed grass fields abu ##tting an attractive cliff slope of natural vegetation .

reference_raw: It is clear that the current site is already disrupting the pleasant pattern of enclosed grasslands which averts the attractive slope of natural vegetation.

reference_spacy_tokens: It is clear that the current site is already disrupting the pleasant pattern of enclosed grasslands which averts the attractive slope of natural vegetation .


fn_spacy_tokens_for_baseline: They 're undergoing trials with Swindon Town Football Club , each one hoping that it could lead to a career in first division football .

source_bert_toks: they ' re undergoing trials with swindon town football club , each one hoping that it could lead to a career in first division football .

reference_raw: They're going through Swindon Town Football Club trials, each hoping to lead to a career in first-division football.

reference_spacy_tokens: They 're going through Swindon Town Football Club trials , each hoping to lead to a career in first - division football .


fn_spacy_tokens_for_baseline: Farther south in Crete , the Minoan culture developed after 2000 b.c . into the most significant of its age , spreading its influence throughout the region by trade and diplomacy .

source_bert_toks: farther south in crete , the min ##oa ##n culture developed after 2000 b . c . into the most significant of its age , spreading its influence throughout the region by trade and diplomacy .

reference_raw: Farther south in Crete, after 2000 B.C., the Minoan culture developed into the most important of its years and spread its influence throughout the region through trade and diplomacy.

reference_spacy_tokens: Farther south in Crete , after 2000 B.C. , the Minoan culture developed into the most important of its years and spread its influence throughout the region through trade and diplomacy .


fn_spacy_tokens_for_baseline: She , for her part , was of the opinion that she did not object to Ivan 's insults at all .

source_bert_toks: she , for her part , was of the opinion that she did not object to ivan ' s insults at all .

reference_raw: She was of the opinion that she had no objection to Ivan's outrages.

reference_spacy_tokens: She was of the opinion that she had no objection to Ivan 's outrages .


fn_spacy_tokens_for_baseline: We 'd spent a couple of days practising the relay .

source_bert_toks: we ' d spent a couple of days pr ##act ##ising the relay .

reference_raw: We've been practicing the relay for a few days.

reference_spacy_tokens: We 've been practicing the relay for a few days .


fn_spacy_tokens_for_baseline: Bloody dangerous piece of road , between you and me , ' he confided .

source_bert_toks: bloody dangerous piece of road , between you and me , ' he con ##fide ##d .

reference_raw: A bloody dangerous part of the road between us," he said.

reference_spacy_tokens: A bloody dangerous part of the road between us , " he said .


fn_spacy_tokens_for_baseline: For many years , however , he was unpredictable and sometimes violent , and his conversation became rambling and incoherent when touching on the subject of his delusions .

source_bert_toks: for many years , however , he was unpredictable and sometimes violent , and his conversation became ram ##bling and inc ##oh ##ere ##nt when touching on the subject of his del ##usions .

reference_raw: But for many years he had been unforeseeable and sometimes violent, and his conversation had become rambling and incoherent when he touched the subject of his delusions.

reference_spacy_tokens: But for many years he had been unforeseeable and sometimes violent , and his conversation had become rambling and incoherent when he touched the subject of his delusions .


fn_spacy_tokens_for_baseline: The Symphony bags shown here are ( from left ) : rucksack with compartments ( £ 3.99 ) , a satchel with reflectors ( £ 3.99 ) , and a kitbag ( £ 2.99 ) .

source_bert_toks: the symphony bags shown here are ( from left ) : ru ##cks ##ack with compartments ( £3 . 99 ) , a sat ##chel with reflect ##ors ( £3 . 99 ) , and a kit ##bag ( £2 . 99 ) .

reference_raw: The symphony bags shown here are (from the left): a backpack with compartments (EUR 3.99), a backpack with reflectors (EUR 3.99) and a kit bag (EUR 2.99).

reference_spacy_tokens: The symphony bags shown here are ( from the left ) : a backpack with compartments ( EUR 3.99 ) , a backpack with reflectors ( EUR 3.99 ) and a kit bag ( EUR 2.99 ) .


fn_spacy_tokens_for_baseline: Fibreglass wheel pants were moulded and fitted to the landing gears and fake cowl flaps were attached to a re - worked AT-6 cowling .

source_bert_toks: fibre ##glass wheel pants were mo ##uld ##ed and fitted to the landing gears and fake cow ##l flaps were attached to a re - worked at - 6 cow ##ling .

reference_raw: Fibreglass wheel trousers were molded and fitted to the landing gear, and false hood flaps were attached to the reworked AT-6 hood.

reference_spacy_tokens: Fibreglass wheel trousers were molded and fitted to the landing gear , and false hood flaps were attached to the reworked AT-6 hood .


fn_spacy_tokens_for_baseline: He silenced her with a look .

source_bert_toks: he silenced her with a look .

reference_raw: He shut her up and looked at her.

reference_spacy_tokens: He shut her up and looked at her .


fn_spacy_tokens_for_baseline: It 's irritating to see her there , all nervy and squeaky , in her clothes for motoring out to the country in ; but oddly touching and pleasing that she should have come .

source_bert_toks: it ' s irritating to see her there , all ne ##r ##vy and squeak ##y , in her clothes for motor ##ing out to the country in ; but oddly touching and pleasing that she should have come .

reference_raw: It's irritating to see her there, all nervous and squeaky, in her clothes to drive to the countryside; but strangely touching and pleasant to come.

reference_spacy_tokens: It 's irritating to see her there , all nervous and squeaky , in her clothes to drive to the countryside ; but strangely touching and pleasant to come .


fn_spacy_tokens_for_baseline: ' I fell , I hurt myself , ' she said .

source_bert_toks: ' i fell , i hurt myself , ' she said .

reference_raw: 'I've fallen, I've been wounded,' she said.

reference_spacy_tokens: ' I 've fallen , I 've been wounded , ' she said .


fn_spacy_tokens_for_baseline: Uterine contractions before cord clamping and beat to beat variability in blood pressure were not recorded and would both be interesting in future studies .

source_bert_toks: ut ##erine contraction ##s before cord cl ##amp ##ing and beat to beat variability in blood pressure were not recorded and would both be interesting in future studies .

reference_raw: Uterine convulsions prior to tightening of cords and rhythms to beat variability in blood pressure have not been recorded and will both be interesting in future studies.

reference_spacy_tokens: Uterine convulsions prior to tightening of cords and rhythms to beat variability in blood pressure have not been recorded and will both be interesting in future studies .


fn_spacy_tokens_for_baseline: Evelyn went cold inside and her skin burned all over .

source_bert_toks: evelyn went cold inside and her skin burned all over .

reference_raw: Evelyn was cold inside, and her skin was ablaze.

reference_spacy_tokens: Evelyn was cold inside , and her skin was ablaze .


fn_spacy_tokens_for_baseline: Excessive variation of hardness levels can cause stress , damage to gills and fin tissues , poor colour , loss of breeding abilities and a low resistance to disease .

source_bert_toks: excessive variation of hardness levels can cause stress , damage to gills and fin tissues , poor colour , loss of breeding abilities and a low resistance to disease .

reference_raw: Excessive changes in hardness levels can cause stress, damage to gills and fin tissues, poor colour, loss of breeding capacity and low resistance to disease.

reference_spacy_tokens: Excessive changes in hardness levels can cause stress , damage to gills and fin tissues , poor colour , loss of breeding capacity and low resistance to disease .


fn_spacy_tokens_for_baseline: He tried to scream a warning to his nightmare self : ' No , do n't go in there !

source_bert_toks: he tried to scream a warning to his nightmare self : ' no , don ' t go in there !

reference_raw: He tried to shout a warning to the nightmare self: "No, don't go!

reference_spacy_tokens: He tried to shout a warning to the nightmare self : " No , do n't go !


fn_spacy_tokens_for_baseline: They are confident of doing better than their 6 - 1 failure against Old Salopians in 1952 .

source_bert_toks: they are confident of doing better than their 6 - 1 failure against old sal ##op ##ians in 1952 .

reference_raw: They believe they will do better than their 6-1 failure against the Old Salopians in 1952.

reference_spacy_tokens: They believe they will do better than their 6 - 1 failure against the Old Salopians in 1952 .


fn_spacy_tokens_for_baseline: The James Street Station tower stands amid the rubble

source_bert_toks: the james street station tower stands amid the rubble

reference_raw: James Street Station Tower stands in the rubble


fn_spacy_tokens_for_baseline: Alter a milky drink she settled and slept until woken by the nurses for a cup of tea at 6.30 am .

source_bert_toks: alter a milky drink she settled and slept until woken by the nurses for a cup of tea at 6 . 30 am .

reference_raw: After a milky drink, she sat down and slept until the nurses awoke for a cup of tea at 6:30 in the morning.

reference_spacy_tokens: After a milky drink , she sat down and slept until the nurses awoke for a cup of tea at 6:30 in the morning .


fn_spacy_tokens_for_baseline: The ISE still has a paper - based system ( in contrast to America and Japan which have electronic systems ) that at times ( e.g. the 1987 bull market ) has been close to collapse .

source_bert_toks: the is ##e still has a paper - based system ( in contrast to america and japan which have electronic systems ) that at times ( e . g . the 1987 bull market ) has been close to collapse .

reference_raw: The ISE still has a paper-based system (as opposed to the US and Japan, which have electronic systems) that sometimes (e.g. the 1987 bull market) is on the verge of collapse.

reference_spacy_tokens: The ISE still has a paper - based system ( as opposed to the US and Japan , which have electronic systems ) that sometimes ( e.g. the 1987 bull market ) is on the verge of collapse .


fn_spacy_tokens_for_baseline: Goliath was the Central Electricity Generating Board , a multi - billion pound public company with apparently unlimited resources .

source_bert_toks: go ##lia ##th was the central electricity generating board , a multi - billion pound public company with apparently unlimited resources .

reference_raw: Goliath was the Central Electricity Council, a multi-billion-pound public corporation with seemingly unlimited resources.

reference_spacy_tokens: Goliath was the Central Electricity Council , a multi - billion - pound public corporation with seemingly unlimited resources .


fn_spacy_tokens_for_baseline: Sixth : Supply mechanical and electronic equipment .

source_bert_toks: sixth : supply mechanical and electronic equipment .

reference_raw: Sixth: supply of mechanical and electronic devices.

reference_spacy_tokens: Sixth : supply of mechanical and electronic devices .


fn_spacy_tokens_for_baseline: She takes a pack of cigarettes and offers him one .

source_bert_toks: she takes a pack of cigarettes and offers him one .

reference_raw: She took a packet of cigarettes and offered it to him.

reference_spacy_tokens: She took a packet of cigarettes and offered it to him .


fn_spacy_tokens_for_baseline: The Queen had agreed to it because the Queen would agree to anything Fergus wanted , everyone knew that .

source_bert_toks: the queen had agreed to it because the queen would agree to anything fergus wanted , everyone knew that .

reference_raw: She agreed to this because she would agree to whatever Fergus wanted, and everyone knew it.

reference_spacy_tokens: She agreed to this because she would agree to whatever Fergus wanted , and everyone knew it .


fn_spacy_tokens_for_baseline: Instead the overwrought director turned it into a bitter battle which ends with the lover , played by Sydney Pollack , savagely forcing Lysette 's character into his car .

source_bert_toks: instead the over ##wr ##ough ##t director turned it into a bitter battle which ends with the lover , played by sydney poll ##ack , savage ##ly forcing l ##yse ##tte ' s character into his car .

reference_raw: Instead, the overworked director turned it into a bitter battle that ended with a lover, played by Sydney Pollack, and drove Lysette's character wildly into his car.

reference_spacy_tokens: Instead , the overworked director turned it into a bitter battle that ended with a lover , played by Sydney Pollack , and drove Lysette 's character wildly into his car .


fn_spacy_tokens_for_baseline: I can see her fingertips twitch slightly , as if surprised to have encountered warm flesh and solid bone .

source_bert_toks: i can see her fingertips twitch slightly , as if surprised to have encountered warm flesh and solid bone .

reference_raw: I can see her fingers jerk a little, as if surprised to see warm flesh and solid bone.

reference_spacy_tokens: I can see her fingers jerk a little , as if surprised to see warm flesh and solid bone .


fn_spacy_tokens_for_baseline: In 1994 , reports surfaced that Syria is cooperating with Iran in the development of ballistic missiles designed to carry chemical warheads .

source_bert_toks: in 1994 , reports surfaced that syria is cooper ##ating with iran in the development of ballistic missiles designed to carry chemical war ##heads .

reference_raw: In 1994, there were reports that Syria was cooperating with Iran on the development of ballistic missiles designed for the transport of chemical warheads.

reference_spacy_tokens: In 1994 , there were reports that Syria was cooperating with Iran on the development of ballistic missiles designed for the transport of chemical warheads .


fn_spacy_tokens_for_baseline: She stared up into his blue eyes , trying to conquer the urge to scoot further up the bed .

source_bert_toks: she stared up into his blue eyes , trying to conquer the urge to sc ##oot further up the bed .

reference_raw: She looked up into his blue eyes, trying to subdue the urge to fly farther up the bed.

reference_spacy_tokens: She looked up into his blue eyes , trying to subdue the urge to fly farther up the bed .


fn_spacy_tokens_for_baseline: Their agony in recent months and years has been terrible to behold .

source_bert_toks: their agony in recent months and years has been terrible to behold .

reference_raw: Their pain in the last few months and years was terrible to see.

reference_spacy_tokens: Their pain in the last few months and years was terrible to see .


fn_spacy_tokens_for_baseline: An information office is shortly to be set up by East Hampshire District Council to answer queries about the drainage work taking place in the village .

source_bert_toks: an information office is shortly to be set up by east hampshire district council to answer que ##ries about the drainage work taking place in the village .

reference_raw: The East Hampshire District Council is about to set up an information office to answer questions about drainage work in the village.

reference_spacy_tokens: The East Hampshire District Council is about to set up an information office to answer questions about drainage work in the village .


fn_spacy_tokens_for_baseline: He walked hesitatingly forward , his skin tensed for the feeling of metal tearing flesh .

source_bert_toks: he walked he ##sit ##ating ##ly forward , his skin tensed for the feeling of metal tearing flesh .

reference_raw: He walked hesitantly forward, his skin strained with the sensation of metal tearing flesh.

reference_spacy_tokens: He walked hesitantly forward , his skin strained with the sensation of metal tearing flesh .


fn_spacy_tokens_for_baseline: Official agencies redefined and interpret girls ' behaviour in such a way that they are perceived as being in need of protection rather than as delinquent ( Biron , 1981 , p. 14 ) .

source_bert_toks: official agencies red ##efined and interpret girls ' behaviour in such a way that they are perceived as being in need of protection rather than as del ##in ##quent ( bi ##ron , 1981 , p . 14 ) .

reference_raw: Official agencies have defined and interpreted the behaviour of girls in such a way that they are perceived as in need of protection and not as delinquent (Biron, 1981, p. 14).

reference_spacy_tokens: Official agencies have defined and interpreted the behaviour of girls in such a way that they are perceived as in need of protection and not as delinquent ( Biron , 1981 , p. 14 ) .


fn_spacy_tokens_for_baseline: This will involve reprocessing of the material to separate out the impurities and then diluting the uranium to a suitable specification for civil use .

source_bert_toks: this will involve rep ##ro ##ces ##sing of the material to separate out the imp ##urities and then dil ##uting the uranium to a suitable specification for civil use .

reference_raw: This will include the re-processing of the material in order to separate the impurities and then the dilution of the uranium to a suitable specification for civilian use.

reference_spacy_tokens: This will include the re - processing of the material in order to separate the impurities and then the dilution of the uranium to a suitable specification for civilian use .


fn_spacy_tokens_for_baseline: Outside the snow was already melting on the slate roofs of the houses .

source_bert_toks: outside the snow was already melting on the slate roofs of the houses .

reference_raw: Outside, the snow on the slate roofs of the houses was already dissolving.

reference_spacy_tokens: Outside , the snow on the slate roofs of the houses was already dissolving .


fn_spacy_tokens_for_baseline: It saves throwing away the remains of a large bag of cement , too .

source_bert_toks: it saves throwing away the remains of a large bag of cement , too .

reference_raw: It also saves throwing away the remains of a large sack of cement.

reference_spacy_tokens: It also saves throwing away the remains of a large sack of cement .


fn_spacy_tokens_for_baseline: The need to feed over and above the maintenance requirement is linked to the fish 's need to grow and reproduce .

source_bert_toks: the need to feed over and above the maintenance requirement is linked to the fish ' s need to grow and reproduce .

reference_raw: The need to feed beyond the maintenance requirement is related to the need for the fish to grow and reproduce.

reference_spacy_tokens: The need to feed beyond the maintenance requirement is related to the need for the fish to grow and reproduce .


fn_spacy_tokens_for_baseline: Suddenly the car stopped , the passenger got out and fired a Kalashnikov rifle at the police car , hitting it at least nine times .

source_bert_toks: suddenly the car stopped , the passenger got out and fired a kala ##sh ##nikov rifle at the police car , hitting it at least nine times .

reference_raw: The car stopped abruptly, and the passenger got out and fired a Kalashnikov gun at the police car, hitting it at least nine times.

reference_spacy_tokens: The car stopped abruptly , and the passenger got out and fired a Kalashnikov gun at the police car , hitting it at least nine times .


fn_spacy_tokens_for_baseline: But the department has lost the public 's confidence because of recent verdict - reversals .

source_bert_toks: but the department has lost the public ' s confidence because of recent verdict - reversal ##s .

reference_raw: But the department lost public trust due to the recent reversal of the verdict.

reference_spacy_tokens: But the department lost public trust due to the recent reversal of the verdict .


fn_spacy_tokens_for_baseline: They accompanied each other in reasonable harmony on Winston 's visit to Canada and the USA in 1929 , but Randolph displeased his father soon afterwards by leaving Oxford without a degree in order to become a journalist .

source_bert_toks: they accompanied each other in reasonable harmony on winston ' s visit to canada and the usa in 1929 , but randolph di ##sp ##lea ##sed his father soon afterwards by leaving oxford without a degree in order to become a journalist .

reference_raw: They accompanied each other in reasonable harmony on Winston's visit to Canada and the United States in 1929, but Randolph soon resented his father by leaving Oxford without a degree to become a journalist.

reference_spacy_tokens: They accompanied each other in reasonable harmony on Winston 's visit to Canada and the United States in 1929 , but Randolph soon resented his father by leaving Oxford without a degree to become a journalist .


fn_spacy_tokens_for_baseline: AN ARMY of pensioners have forced Scarborough to ban late evening kick - offs after a deluge of complaints that 8 pm starts are too late !

source_bert_toks: an army of pension ##ers have forced scarborough to ban late evening kick - offs after a del ##uge of complaints that 8 ##pm starts are too late !

reference_raw: The pensioners' ARMY forced Scarborough to ban late-night kick-offs after a flood of complaints that 8:00 p.m. is too late!

reference_spacy_tokens: The pensioners ' ARMY forced Scarborough to ban late - night kick - offs after a flood of complaints that 8:00 p.m. is too late !


fn_spacy_tokens_for_baseline: A Swedish couple and a German guy sitting near me were on their feet , that sickened expression on their faces too .

source_bert_toks: a swedish couple and a german guy sitting near me were on their feet , that sick ##ened expression on their faces too .

reference_raw: The Swedish couple and the German sitting next to me were on their feet, the look of disgust on their faces.

reference_spacy_tokens: The Swedish couple and the German sitting next to me were on their feet , the look of disgust on their faces .


fn_spacy_tokens_for_baseline: The relatively small amount ( 50 kg ) of this chemical had little consequence in terms of producing militarily significant amounts of nerve agent .

source_bert_toks: the relatively small amount ( 50 ##k ##g ) of this chemical had little consequence in terms of producing mil ##ita ##rily significant amounts of nerve agent .

reference_raw: The relatively small amount (50 kg) of this substance had little impact on the production of a militaryly significant amount of nerve agent.

reference_spacy_tokens: The relatively small amount ( 50 kg ) of this substance had little impact on the production of a militaryly significant amount of nerve agent .


fn_spacy_tokens_for_baseline: She was too exhausted , too weary to argue it out with her now , but she was also excited .

source_bert_toks: she was too exhausted , too weary to argue it out with her now , but she was also excited .

reference_raw: She was too tired, too tired to argue with her now, but she was excited, too.

reference_spacy_tokens: She was too tired , too tired to argue with her now , but she was excited , too .


fn_spacy_tokens_for_baseline: Melissa kicked off her shoes , dumped her handbag on the floor , flopped on her bed and closed her eyes .

source_bert_toks: melissa kicked off her shoes , dumped her hand ##bag on the floor , flopped on her bed and closed her eyes .

reference_raw: Melissa threw off her boots, dropped her purse to the floor, flopped onto the bed, and closed her eyes.

reference_spacy_tokens: Melissa threw off her boots , dropped her purse to the floor , flopped onto the bed , and closed her eyes .


fn_spacy_tokens_for_baseline: However , analysts question the need for several components , particularly those in which the feedstock or product is either provided by a supplier country ( fuel production plant ) or that do not fit in the general scheme of Iran 's overall nuclear program ( uranium metal laboratory ) .

source_bert_toks: however , analysts question the need for several components , particularly those in which the feeds ##tock or product is either provided by a supplier country ( fuel production plant ) or that do not fit in the general scheme of iran ' s overall nuclear program ( uranium metal laboratory ) .

reference_raw: However, analysts question the need for several components, in particular those where the raw material or product is supplied by a supplying country (fuel production plant) or which are not part of the overall programme of the Iranian nuclear programme (uranium metal laboratory).

reference_spacy_tokens: However , analysts question the need for several components , in particular those where the raw material or product is supplied by a supplying country ( fuel production plant ) or which are not part of the overall programme of the Iranian nuclear programme ( uranium metal laboratory ) .


fn_spacy_tokens_for_baseline: The new testament implies that the use of slaves , provided it is humane , does not contravene the will of God .

source_bert_toks: the new testament implies that the use of slaves , provided it is humane , does not contra ##ven ##e the will of god .

reference_raw: The new will suggests that the use of slaves, if humane, is not contrary to God's will.

reference_spacy_tokens: The new will suggests that the use of slaves , if humane , is not contrary to God 's will .


fn_spacy_tokens_for_baseline: But Anthony Stroud , racing manager to Old Vic 's owner , Sheikh Mohammed , believes it highly unlikely that the confrontation that every racegoer would love to witness , will take place .

source_bert_toks: but anthony st ##roud , racing manager to old vic ' s owner , sheikh mohammed , believes it highly unlikely that the confrontation that every race ##go ##er would love to witness , will take place .

reference_raw: But Anthony Stroud, the race manager of Old Vic's owner, Sheik Mohammed, believes that there is no likelihood of a confrontation that any racegoer would like to witness.

reference_spacy_tokens: But Anthony Stroud , the race manager of Old Vic 's owner , Sheik Mohammed , believes that there is no likelihood of a confrontation that any racegoer would like to witness .


fn_spacy_tokens_for_baseline: Therefore , obtaining reliable open source information on such programs is very challenging .

source_bert_toks: therefore , obtaining reliable open source information on such programs is very challenging .

reference_raw: It is therefore very difficult to obtain reliable open source data on these programmes.

reference_spacy_tokens: It is therefore very difficult to obtain reliable open source data on these programmes .


fn_spacy_tokens_for_baseline: IRAN : Hundreds of prisoners , prisoners of conscience , continue to be executed each year in Iran , a pattern which has persisted since the proclamation of the Islamic Republic in 1979 .

source_bert_toks: iran : hundreds of prisoners , prisoners of conscience , continue to be executed each year in iran , a pattern which has persisted since the proclamation of the islamic republic in 1979 .

reference_raw: IRAN: Hundreds of prisoners, prisoners of conscience, continue to be executed in Iran every year, a pattern that has persisted since the Islamic Republic was declared in 1979.

reference_spacy_tokens: IRAN : Hundreds of prisoners , prisoners of conscience , continue to be executed in Iran every year , a pattern that has persisted since the Islamic Republic was declared in 1979 .


fn_spacy_tokens_for_baseline: Someone had lit a torch , but its smoky , wavering light only emphasised the hopelessness of trying to pick out individuals in the seething turmoil .

source_bert_toks: someone had lit a torch , but its smoky , wave ##ring light only emphasis ##ed the hopeless ##ness of trying to pick out individuals in the see ##thing turmoil .

reference_raw: Someone had set a torch on fire, but its smoky, wavering light only emphasized the hopelessness of trying to identify individuals in the seething confusion.

reference_spacy_tokens: Someone had set a torch on fire , but its smoky , wavering light only emphasized the hopelessness of trying to identify individuals in the seething confusion .


fn_spacy_tokens_for_baseline: It was more , she blinked her eyes , as if roused out of a coma .

source_bert_toks: it was more , she blinked her eyes , as if rouse ##d out of a coma .

reference_raw: More than that, she winked, as if awakening from a coma.

reference_spacy_tokens: More than that , she winked , as if awakening from a coma .


fn_spacy_tokens_for_baseline: Every year several people are killed by these preposterous objects , ripe and fermenting , plummeting on to their heads from a great height .

source_bert_toks: every year several people are killed by these prep ##ost ##ero ##us objects , ripe and fe ##rm ##enting , plum ##met ##ing on to their heads from a great height .

reference_raw: Every year, several people are killed by these absurd objects, ripe and fermented, falling to their heads from a great height.

reference_spacy_tokens: Every year , several people are killed by these absurd objects , ripe and fermented , falling to their heads from a great height .


fn_spacy_tokens_for_baseline: USL also says UC Berkeley rebuffed every proposal it put forward over the last few months to resolve the dispute without recourse to litigation .

source_bert_toks: usl also says uc berkeley re ##bu ##ffed every proposal it put forward over the last few months to resolve the dispute without rec ##ours ##e to litigation .

reference_raw: USL also claims that UC Berkeley has rejected all the proposals it has submitted in the past few months in order to resolve the dispute without resolving the dispute.

reference_spacy_tokens: USL also claims that UC Berkeley has rejected all the proposals it has submitted in the past few months in order to resolve the dispute without resolving the dispute .


fn_spacy_tokens_for_baseline: Although she describes a stereotypical beau , Leapor emphasizes that Strephon 's artificial appearance is part of his strategy to deceive Celia .

source_bert_toks: although she describes a stereo ##typical beau , leap ##or emphasizes that st ##re ##phon ' s artificial appearance is part of his strategy to dec ##ei ##ve celia .

reference_raw: Although he describes the stereotypical beauty, Leapor points out that Strephon's artificial appearance is part of his strategy to deceive Celia.

reference_spacy_tokens: Although he describes the stereotypical beauty , Leapor points out that Strephon 's artificial appearance is part of his strategy to deceive Celia .


fn_spacy_tokens_for_baseline: I did not like the accusation of naivety , preferring to believe that I was an honest man who found it hard to imagine how other people could live with a guilty conscience .

source_bert_toks: i did not like the accusation of naive ##ty , preferring to believe that i was an honest man who found it hard to imagine how other people could live with a guilty conscience .

reference_raw: I didn't like being accused of being naive, but I preferred to believe that I was an honest man who found it difficult to imagine how others could live with guilt.

reference_spacy_tokens: I did n't like being accused of being naive , but I preferred to believe that I was an honest man who found it difficult to imagine how others could live with guilt .


fn_spacy_tokens_for_baseline: We have contrived the ' Big Bang ' theory -- a typically western aggressive concept -- whereas the Hindus termed it ' the churning of the milky ocean ' .

source_bert_toks: we have con ##tri ##ved the ' big bang ' theory - - a typically western aggressive concept - - whereas the hindus termed it ' the churning of the milky ocean ' .

reference_raw: We invented the 'Big Bang' theory - a typical Western-aggressive concept - while the Hindus called it 'the whirling of the milky ocean'.

reference_spacy_tokens: We invented the ' Big Bang ' theory - a typical Western - aggressive concept - while the Hindus called it ' the whirling of the milky ocean ' .


fn_spacy_tokens_for_baseline: As a result employers came to reappraise their previous strategy of attempting to contain unions by means of active opposition since that was more likely to result in increased government intervention to facilitate recognition .

source_bert_toks: as a result employers came to re ##app ##rai ##se their previous strategy of attempting to contain unions by means of active opposition since that was more likely to result in increased government intervention to facilitate recognition .

reference_raw: As a result, employers have re-evaluated their previous strategy of trying to contain unions through active opposition, as it is more likely that this will lead to increased government intervention to facilitate recognition.

reference_spacy_tokens: As a result , employers have re - evaluated their previous strategy of trying to contain unions through active opposition , as it is more likely that this will lead to increased government intervention to facilitate recognition .


fn_spacy_tokens_for_baseline: That 's the most revolting taste !

source_bert_toks: that ' s the most revolt ##ing taste !

reference_raw: That's the most disgusting taste!

reference_spacy_tokens: That 's the most disgusting taste !


fn_spacy_tokens_for_baseline: There was a firm 6×4 cm swelling to the right of the midline scar in the adbomen which was presumed to be the recurrent tumour .

source_bert_toks: there was a firm 6 ##× ##4 cm swelling to the right of the mid ##line scar in the ad ##bo ##men which was presumed to be the rec ##urrent tu ##mour .

reference_raw: On the right side of the midline scar, there was a solid 6x4 cm swelling in the abdomen, which was assumed to be a recurrent tumour.

reference_spacy_tokens: On the right side of the midline scar , there was a solid 6x4 cm swelling in the abdomen , which was assumed to be a recurrent tumour .


fn_spacy_tokens_for_baseline: Afterwards , we all trooped along the narrow path and inspected the flowers .

source_bert_toks: afterwards , we all troop ##ed along the narrow path and inspected the flowers .

reference_raw: Then we all marched along the narrow trail and looked at the flowers.

reference_spacy_tokens: Then we all marched along the narrow trail and looked at the flowers .


fn_spacy_tokens_for_baseline: It seemed that Maidstone , who had been completely sober at ten o'clock when he left the bar , returned at about midday , still sober , but immediately started drinking heavily .

source_bert_toks: it seemed that maids ##tone , who had been completely sober at ten o ' clock when he left the bar , returned at about midday , still sober , but immediately started drinking heavily .

reference_raw: At ten o'clock, when he left the bar, Maidstone appeared to be back around noon, still sobriety, but immediately began to drink heavily.

reference_spacy_tokens: At ten o'clock , when he left the bar , Maidstone appeared to be back around noon , still sobriety , but immediately began to drink heavily .


fn_spacy_tokens_for_baseline: She longed for something to do other than trudge the glorious , heather - clad grouse moors .

source_bert_toks: she longed for something to do other than tr ##udge the glorious , heather - clad gr ##ouse moors .

reference_raw: She longed for something other than tossing the beautiful, heather-clad moors.

reference_spacy_tokens: She longed for something other than tossing the beautiful , heather - clad moors .


fn_spacy_tokens_for_baseline: He enjoyed a public , after dinner , verbal duel with Dr Strick at Grantley Hall .

source_bert_toks: he enjoyed a public , after dinner , verbal duel with dr st ##rick at grant ##ley hall .

reference_raw: After dinner, he enjoyed the public with Dr. Strick in Grantley Hall.

reference_spacy_tokens: After dinner , he enjoyed the public with Dr. Strick in Grantley Hall .


fn_spacy_tokens_for_baseline: Next day he broke out in a savage rash , but the move began to Alderney and the last , comfortable , well - solaced years .

source_bert_toks: next day he broke out in a savage rash , but the move began to al ##dern ##ey and the last , comfortable , well - sol ##ace ##d years .

reference_raw: The next day he began to run wildly, but the movement began for Alderney and for the last, comfortable, well-solated years.

reference_spacy_tokens: The next day he began to run wildly , but the movement began for Alderney and for the last , comfortable , well - solated years .


fn_spacy_tokens_for_baseline: Mrs Stevens got the blame for producing these but she claimed that she had merely kept him talking while her son went for the police .

source_bert_toks: mrs stevens got the blame for producing these but she claimed that she had merely kept him talking while her son went for the police .

reference_raw: Mrs. Stevens was guilty of producing them, but she said she'd just kept him talking while her son went to the police.

reference_spacy_tokens: Mrs. Stevens was guilty of producing them , but she said she 'd just kept him talking while her son went to the police .


fn_spacy_tokens_for_baseline: Ancient sedimentary deposits which can not be readily disaggregated present major difficulties to the potential size - analyst .

source_bert_toks: ancient sedimentary deposits which can not be readily di ##sa ##gg ##re ##gated present major difficulties to the potential size - analyst .

reference_raw: Ancient sedimentary deposits, which cannot be easily disaggregated, pose serious difficulties for a potential size analyst.

reference_spacy_tokens: Ancient sedimentary deposits , which can not be easily disaggregated , pose serious difficulties for a potential size analyst .


fn_spacy_tokens_for_baseline: I bet myself that was Sorley 's , as I 'd had him pegged as the Boy Racer type and I was glad the insurance companies were uprating them .

source_bert_toks: i bet myself that was so ##rley ' s , as i ' d had him peg ##ged as the boy racer type and i was glad the insurance companies were up ##rating them .

reference_raw: I bet it was Sorley's, just like I had him pinned down like a Boy Racer, and I was glad the insurance companies had upgraded it.

reference_spacy_tokens: I bet it was Sorley 's , just like I had him pinned down like a Boy Racer , and I was glad the insurance companies had upgraded it .


fn_spacy_tokens_for_baseline: But we do n't have problems in the sense that you and Dad used to have . '

source_bert_toks: but we don ' t have problems in the sense that you and dad used to have . '

reference_raw: But we don't have any problems in the way you and your father used to.'

reference_spacy_tokens: But we do n't have any problems in the way you and your father used to . '


fn_spacy_tokens_for_baseline: In practice , however , as party discipline grew , the institutional battle over the level of spending and taxing took place more and more within the government machine .

source_bert_toks: in practice , however , as party discipline grew , the institutional battle over the level of spending and taxi ##ng took place more and more within the government machine .

reference_raw: In practice, however, as party discipline grew, the institutional struggle over the level of spending and taxation took place more and more in the government machine.

reference_spacy_tokens: In practice , however , as party discipline grew , the institutional struggle over the level of spending and taxation took place more and more in the government machine .


fn_spacy_tokens_for_baseline: This precise and disheartening indictment was drawn up by the late Dr Enid Starkie , Reader Emeritus in French Literature at the University of Oxford , and Flaubert 's most exhaustive British biographer .

source_bert_toks: this precise and dish ##ear ##ten ##ing indictment was drawn up by the late dr en ##id stark ##ie , reader emeritus in french literature at the university of oxford , and fl ##au ##bert ' s most exhaust ##ive british biographer .

reference_raw: The late Dr. Enid Starkie, Reader Emeritus in French literature at Oxford University, and Flaubert's most exhausting British biographer, prepared this precise and appalling accusation.

reference_spacy_tokens: The late Dr. Enid Starkie , Reader Emeritus in French literature at Oxford University , and Flaubert 's most exhausting British biographer , prepared this precise and appalling accusation .


fn_spacy_tokens_for_baseline: Leeds manager Howard Wilkinson made the compliment in the wake of Palace 's battling mid - week Coca - Cola Cup victory over Liverpool .

source_bert_toks: leeds manager howard wilkinson made the compliment in the wake of palace ' s battling mid - week coca - cola cup victory over liverpool .

reference_raw: Leeds Manager Howard Wilkinson made a commendation after Palace's mid-week battle with the Coca-Cola Cup victory over Liverpool.

reference_spacy_tokens: Leeds Manager Howard Wilkinson made a commendation after Palace 's mid - week battle with the Coca - Cola Cup victory over Liverpool .


fn_spacy_tokens_for_baseline: Said is quiet on how Palestinians and Israelis can be persuaded even to consider such a reconciliation .

source_bert_toks: said is quiet on how palestinians and israelis can be persuaded even to consider such a reconciliation .

reference_raw: Said is silent about how Palestinians and Israelis can be persuaded to consider such a reconciliation.

reference_spacy_tokens: Said is silent about how Palestinians and Israelis can be persuaded to consider such a reconciliation .


fn_spacy_tokens_for_baseline: Their reaction was so encouraging that it gave me the strength to carry on .

source_bert_toks: their reaction was so encouraging that it gave me the strength to carry on .

reference_raw: Their reaction was so encouraging that I had the power to continue.

reference_spacy_tokens: Their reaction was so encouraging that I had the power to continue .


fn_spacy_tokens_for_baseline: Since the signing of these agreements , the United States has continuously expressed its opposition to the Bushehr deal because of fears that the deal could provide Iran with knowledge and technology to support a nuclear weapons program .

source_bert_toks: since the signing of these agreements , the united states has continuously expressed its opposition to the bush ##eh ##r deal because of fears that the deal could provide iran with knowledge and technology to support a nuclear weapons program .

reference_raw: Since the signing of these agreements, the United States has consistently expressed its opposition to the Bushehr agreement, fearing that the agreement might give Iran knowledge and technology to support the nuclear weapons program.

reference_spacy_tokens: Since the signing of these agreements , the United States has consistently expressed its opposition to the Bushehr agreement , fearing that the agreement might give Iran knowledge and technology to support the nuclear weapons program .


fn_spacy_tokens_for_baseline: It was going to be another protracted day ; he had to stay alert and miss nothing .

source_bert_toks: it was going to be another pro ##tracted day ; he had to stay alert and miss nothing .

reference_raw: It would be another long day; he had to stay awake and miss nothing.

reference_spacy_tokens: It would be another long day ; he had to stay awake and miss nothing .


fn_spacy_tokens_for_baseline: He was active in the Yorkshire coalfield while I was active in the Nottinghamshire coalfield .

source_bert_toks: he was active in the yorkshire coal ##field while i was active in the nottinghamshire coal ##field .

reference_raw: He was in Yorkshire Coalfield when I was in Nottinghamshire Coalfield.

reference_spacy_tokens: He was in Yorkshire Coalfield when I was in Nottinghamshire Coalfield .


fn_spacy_tokens_for_baseline: Rep. Tony Hall , D- Ohio , urges the United Nations to allow a freer flow of food and medicine into Iraq .

source_bert_toks: rep . tony hall , d - ohio , urges the united nations to allow a free ##r flow of food and medicine into iraq .

reference_raw: Rep. Tony Hall, D-Ohio, calls on the UN to allow food and medicine to flow to Iraq more freely.

reference_spacy_tokens: Rep. Tony Hall , D - Ohio , calls on the UN to allow food and medicine to flow to Iraq more freely .


fn_spacy_tokens_for_baseline: Fluellen , in the great tradition of the Shakespearean Fool , uses the comparison to make Henry out to be an ass .

source_bert_toks: flu ##elle ##n , in the great tradition of the shakespeare ##an fool , uses the comparison to make henry out to be an ass .

reference_raw: Fluellen, in the grand tradition of Shakespeare's Fool, uses comparisons to make Henry look like an ass.

reference_spacy_tokens: Fluellen , in the grand tradition of Shakespeare 's Fool , uses comparisons to make Henry look like an ass .


fn_spacy_tokens_for_baseline: And so to transponders implanted under the skin of New Mexico cattle .

source_bert_toks: and so to trans ##pon ##ders implant ##ed under the skin of new mexico cattle .

reference_raw: So are the transponders implanted beneath the skin of New Mexico's cattle.

reference_spacy_tokens: So are the transponders implanted beneath the skin of New Mexico 's cattle .


fn_spacy_tokens_for_baseline: After a lifetime of being emotionally devoured by him , she was suddenly discarded in favour of the detestable Damian Flint .

source_bert_toks: after a lifetime of being emotionally dev ##oured by him , she was suddenly discarded in favour of the det ##est ##able damian flint .

reference_raw: After a lifetime of emotionally devouring her, she was suddenly dismissed in favor of the despicable Damian Flint.

reference_spacy_tokens: After a lifetime of emotionally devouring her , she was suddenly dismissed in favor of the despicable Damian Flint .


fn_spacy_tokens_for_baseline: Penelope glanced over Ianthe 's shoulder through the open door of the dining room .

source_bert_toks: penelope glanced over ian ##the ' s shoulder through the open door of the dining room .

reference_raw: Penelope looked over Ianthe's shoulder through the open dining room door.

reference_spacy_tokens: Penelope looked over Ianthe 's shoulder through the open dining room door .


fn_spacy_tokens_for_baseline: On and on he droned about how we should n't fear death but welcome the joys of heaven , so I picked up my two horse pistols and gave the sod both barrels .

source_bert_toks: on and on he drone ##d about how we shouldn ' t fear death but welcome the joy ##s of heaven , so i picked up my two horse pistols and gave the so ##d both barrels .

reference_raw: He went on and on about how not to be afraid of death, but to welcome the joys of heaven, so I picked up my two horseguns and handed both barrels to the sod.

reference_spacy_tokens: He went on and on about how not to be afraid of death , but to welcome the joys of heaven , so I picked up my two horseguns and handed both barrels to the sod .


fn_spacy_tokens_for_baseline: The most alarming developments were revealed in 2002 - 03 , during which time Iran admitted to having construction plans for two enrichment facilities , a heavy water production plant , a fuel fabrication plant , and undertaken research into conversion and enrichment activities ( including centrifuges and possibly lasers ) .

source_bert_toks: the most alarm ##ing developments were revealed in 2002 - 03 , during which time iran admitted to having construction plans for two enrichment facilities , a heavy water production plant , a fuel fabrication plant , and undertaken research into conversion and enrichment activities ( including cent ##ri ##fu ##ges and possibly lasers ) .

reference_raw: The most alarming developments were found in 2002 - 03, during which Iran admitted that it had a construction plan for two enrichment plants, a heavy water plant, a fuel plant, and carried out research into conversion and enrichment activities (including centrifuges and possibly lasers).

reference_spacy_tokens: The most alarming developments were found in 2002 - 03 , during which Iran admitted that it had a construction plan for two enrichment plants , a heavy water plant , a fuel plant , and carried out research into conversion and enrichment activities ( including centrifuges and possibly lasers ) .


fn_spacy_tokens_for_baseline: When the adult points at an interesting object , the young baby looks at the adult 's hand .

source_bert_toks: when the adult points at an interesting object , the young baby looks at the adult ' s hand .

reference_raw: When an adult points to an interesting object, a young child looks at the hand of an adult.

reference_spacy_tokens: When an adult points to an interesting object , a young child looks at the hand of an adult .


fn_spacy_tokens_for_baseline: The fridge suddenly switched itself on , the buzzing hum sharpening the tension .

source_bert_toks: the fridge suddenly switched itself on , the buzzing hum sharpe ##ning the tension .

reference_raw: The refrigerator suddenly turned on, and the buzzing noise sharpened the tension.

reference_spacy_tokens: The refrigerator suddenly turned on , and the buzzing noise sharpened the tension .


fn_spacy_tokens_for_baseline: He too was dressed in thick muffler and flat cap .

source_bert_toks: he too was dressed in thick mu ##ffle ##r and flat cap .

reference_raw: He was also wearing a thick muffler and a flat hat.

reference_spacy_tokens: He was also wearing a thick muffler and a flat hat .


fn_spacy_tokens_for_baseline: ' Now , ' said Picon a few years ago , ' when you read an obituary of someone with a Jewish name you know you have lost another member of the audience . '

source_bert_toks: ' now , ' said pic ##on a few years ago , ' when you read an obituary of someone with a jewish name you know you have lost another member of the audience . '

reference_raw: 'Now,' said Picon a few years ago, 'you know that you've lost another member of the audience when you've seen the obituary of someone with a Jewish name.'

reference_spacy_tokens: ' Now , ' said Picon a few years ago , ' you know that you 've lost another member of the audience when you 've seen the obituary of someone with a Jewish name . '


fn_spacy_tokens_for_baseline: The local office of a body which shall remain nameless was awarding competition prizes the other day .

source_bert_toks: the local office of a body which shall remain name ##less was awarding competition prizes the other day .

reference_raw: The local authority of the body, which will remain unnamed, recently awarded competition awards.

reference_spacy_tokens: The local authority of the body , which will remain unnamed , recently awarded competition awards .


fn_spacy_tokens_for_baseline: And disabled Ferryhill resident Royston Hunter is still waiting for work to be completed at his home after giving Mr Round £ 4,180 in November .

source_bert_toks: and disabled ferry ##hill resident roy ##ston hunter is still waiting for work to be completed at his home after giving mr round £ ##4 , 180 in november .

reference_raw: And the disabled man of Ferryhill, who resides in Royston Hunter, is still waiting to finish his work at home after giving Mr. Round £4,180 in November.

reference_spacy_tokens: And the disabled man of Ferryhill , who resides in Royston Hunter , is still waiting to finish his work at home after giving Mr. Round £ 4,180 in November .


fn_spacy_tokens_for_baseline: Investigations were then suspended for lack of police evidence , but reopened in 1987 when another judge accused the Dicomcar police intelligence directorate of being responsible .

source_bert_toks: investigations were then suspended for lack of police evidence , but reopened in 1987 when another judge accused the di ##com ##car police intelligence directorate of being responsible .

reference_raw: The investigation was then stopped for lack of police evidence, but reopened in 1987 when another judge accused the Dicomcar Police Intelligence Directorate of being responsible.

reference_spacy_tokens: The investigation was then stopped for lack of police evidence , but reopened in 1987 when another judge accused the Dicomcar Police Intelligence Directorate of being responsible .


fn_spacy_tokens_for_baseline: They had their own ideas about who committed all the robberies in the area , and Oliver was unknown to them .

source_bert_toks: they had their own ideas about who committed all the robber ##ies in the area , and oliver was unknown to them .

reference_raw: They had their own ideas about who had committed all the thefts in the area, and they didn't know Oliver.

reference_spacy_tokens: They had their own ideas about who had committed all the thefts in the area , and they did n't know Oliver .


fn_spacy_tokens_for_baseline: Much as I esteem you , I will not manipulate events for your personal gratification . '

source_bert_toks: much as i esteem you , i will not manipulate events for your personal gr ##ati ##fication . '

reference_raw: As much as I respect you, I'm not going to manipulate events for your personal satisfaction.'

reference_spacy_tokens: As much as I respect you , I 'm not going to manipulate events for your personal satisfaction . '


fn_spacy_tokens_for_baseline: ' I could demonstrate , right now , ' he grated .

source_bert_toks: ' i could demonstrate , right now , ' he gr ##ated .

reference_raw: 'I can show you, now,' he said.

reference_spacy_tokens: ' I can show you , now , ' he said .


fn_spacy_tokens_for_baseline: Pre - tax profit , therefore , jumped back to £ 2million , from £ 521,000 .

source_bert_toks: pre - tax profit , therefore , jumped back to £2 ##mill ##ion , from £5 ##21 , 000 .

reference_raw: So the pre-tax profit went back to £2 million, from £521,000.

reference_spacy_tokens: So the pre - tax profit went back to £ 2 million , from £ 521,000 .


fn_spacy_tokens_for_baseline: As the boat swung round sharply , she toppled overboard .

source_bert_toks: as the boat swung round sharply , she toppled overboard .

reference_raw: She fell overboard as the boat turned sharply.

reference_spacy_tokens: She fell overboard as the boat turned sharply .


fn_spacy_tokens_for_baseline: On one flight from England , carrying some of our personal possessions , bells started ringing at the Customs Desk -- and my carving knife was temporarily confiscated in case I attempted to hijack the plane !

source_bert_toks: on one flight from england , carrying some of our personal possessions , bells started ringing at the customs desk - - and my carving knife was temporarily confiscated in case i attempted to hi ##jack the plane !

reference_raw: On one flight out of England, carrying some of our personal possessions, the bells began to ring at the customs desk - and my carving knife was temporarily confiscated in case I tried to steal the plane!

reference_spacy_tokens: On one flight out of England , carrying some of our personal possessions , the bells began to ring at the customs desk - and my carving knife was temporarily confiscated in case I tried to steal the plane !


fn_spacy_tokens_for_baseline: " A public statement calling for clemency by Shell 's top executive should be added to the international appeals already received by Gen. Abacha , " Fleischman said .

source_bert_toks: " a public statement calling for cl ##eme ##ncy by shell ' s top executive should be added to the international appeals already received by gen . aba ##cha , " fl ##eis ##chman said .

reference_raw: "A public statement calling for mercy from Shell's top executive should be added to the international appeals General Abacha has already received," Fleischman said.

reference_spacy_tokens: " A public statement calling for mercy from Shell 's top executive should be added to the international appeals General Abacha has already received , " Fleischman said .


fn_spacy_tokens_for_baseline: Mother - of - two Mrs Ahluwalia , of Crawley , Sussex , had been beaten by her husband while pregnant , hit in the face with a telephone and had her finger broken .

source_bert_toks: mother - of - two mrs ahl ##uw ##alia , of crawley , sussex , had been beaten by her husband while pregnant , hit in the face with a telephone and had her finger broken .

reference_raw: The mother of two Mrs. Ahluwalia of Crawley, Sussex, was defeated by her husband when she was pregnant, hit in the face with a phone, and broke her finger.

reference_spacy_tokens: The mother of two Mrs. Ahluwalia of Crawley , Sussex , was defeated by her husband when she was pregnant , hit in the face with a phone , and broke her finger .


fn_spacy_tokens_for_baseline: Early today , three suicide bombers killed at least 16 Iraqis in blasts north of Baghdad .

source_bert_toks: early today , three suicide bombers killed at least 16 iraqi ##s in blasts north of baghdad .

reference_raw: Earlier today, at least 16 Iraqis were killed by three suicide bombers in explosions north of Baghdad.

reference_spacy_tokens: Earlier today , at least 16 Iraqis were killed by three suicide bombers in explosions north of Baghdad .


fn_spacy_tokens_for_baseline: At one point the mistress of disguise demonstrated to her co - accused how the ginger wig she had been wearing when they were stopped by police , fell off as she adjusted her hat .

source_bert_toks: at one point the mistress of disguise demonstrated to her co - accused how the ginger wig she had been wearing when they were stopped by police , fell off as she adjusted her hat .

reference_raw: At one point the masquerade showed to her co-accusation that the ginger wig she wore when the police stopped them and dropped as she adjusted her hat.

reference_spacy_tokens: At one point the masquerade showed to her co - accusation that the ginger wig she wore when the police stopped them and dropped as she adjusted her hat .


fn_spacy_tokens_for_baseline: He had , according to Bowdler Sharpe , amassed a fortune of £ 17,000 from his publications by the time he left for Australia .

source_bert_toks: he had , according to bow ##dler sharpe , amassed a fortune of £1 ##7 , 000 from his publications by the time he left for australia .

reference_raw: By the time Bowdler Sharpe went to Australia, he had accumulated a fortune of £17,000 from his publications.

reference_spacy_tokens: By the time Bowdler Sharpe went to Australia , he had accumulated a fortune of £ 17,000 from his publications .


fn_spacy_tokens_for_baseline: He reached inside his doublet and brought out a white velvet purse .

source_bert_toks: he reached inside his double ##t and brought out a white velvet purse .

reference_raw: He reached into his jacket and pulled out a white velvet bag.

reference_spacy_tokens: He reached into his jacket and pulled out a white velvet bag .


fn_spacy_tokens_for_baseline: In a report to the Nuclear Regulatory Commission , the engineers , Donald Prevatte and David Lochbaum , say the problem , concerning the inadequacy of back - up cooling for spent fuel pools , could affect one - third of the US 's 109 nuclear plants .

source_bert_toks: in a report to the nuclear regulatory commission , the engineers , donald pre ##vat ##te and david loch ##baum , say the problem , concerning the ina ##de ##qua ##cy of back - up cooling for spent fuel pools , could affect one - third of the us ' s 109 nuclear plants .

reference_raw: In a report to the Nuclear Regulatory Commission, engineers Donald Prevatte and David Lochbaum say that one third of the 109 nuclear power plants in the US may be affected by a problem related to the lack of backup cooling for spent fuel pools.

reference_spacy_tokens: In a report to the Nuclear Regulatory Commission , engineers Donald Prevatte and David Lochbaum say that one third of the 109 nuclear power plants in the US may be affected by a problem related to the lack of backup cooling for spent fuel pools .


fn_spacy_tokens_for_baseline: This is not a private prison as such -- it is a public building built and run by taxpayers ' money .

source_bert_toks: this is not a private prison as such - - it is a public building built and run by taxpayers ' money .

reference_raw: It's not a private penitentiary as such - it's a public building built and run by taxpayers' money.

reference_spacy_tokens: It 's not a private penitentiary as such - it 's a public building built and run by taxpayers ' money .


fn_spacy_tokens_for_baseline: Dartford warbler numbers fluctuate dramatically .

source_bert_toks: dart ##ford war ##bler numbers flu ##ct ##uate dramatically .

reference_raw: The number of Dartford warblers varies dramatically.

reference_spacy_tokens: The number of Dartford warblers varies dramatically .


fn_spacy_tokens_for_baseline: A JUDGE was forced to scrap a lengthy criminal trial after a woman juror claimed she had been threatened with the sack .

source_bert_toks: a judge was forced to scrap a lengthy criminal trial after a woman ju ##ror claimed she had been threatened with the sack .

reference_raw: The JUDGE was forced to destroy a long criminal trial after a woman's judge said she was threatened with a bag.

reference_spacy_tokens: The JUDGE was forced to destroy a long criminal trial after a woman 's judge said she was threatened with a bag .


fn_spacy_tokens_for_baseline: Finally , if you are a lucky winner , we further guarantee to send you notification of your good fortune and invite you to the official prize giving .

source_bert_toks: finally , if you are a lucky winner , we further guarantee to send you notification of your good fortune and invite you to the official prize giving .

reference_raw: Finally, if you are a lucky winner, we also guarantee that you will be notified of your happiness and invited to the official award.

reference_spacy_tokens: Finally , if you are a lucky winner , we also guarantee that you will be notified of your happiness and invited to the official award .


fn_spacy_tokens_for_baseline: Cease this folly , I beg you . '

source_bert_toks: cease this folly , i beg you . '

reference_raw: Stop this foolishness, please.'

reference_spacy_tokens: Stop this foolishness , please . '


fn_spacy_tokens_for_baseline: Nevertheless the indirect ecological effects can not always be foreseen .

source_bert_toks: nevertheless the indirect ecological effects can not always be fore ##see ##n .

reference_raw: However, indirect environmental impacts cannot always be anticipated.

reference_spacy_tokens: However , indirect environmental impacts can not always be anticipated .


fn_spacy_tokens_for_baseline: Add apple and onion , tossed in honey , to the grill with two leaves of shredded sage .

source_bert_toks: add apple and onion , tossed in honey , to the grill with two leaves of shredded sage .

reference_raw: Add apples and onions, tossed in honey, to the grill with two leaves of broken sage.

reference_spacy_tokens: Add apples and onions , tossed in honey , to the grill with two leaves of broken sage .


fn_spacy_tokens_for_baseline: The Sun Temple of Konark was conceived as a gigantic chariot for the great sun- god Surya cantering inland from the Indian Ocean .

source_bert_toks: the sun temple of ko ##nar ##k was conceived as a gigantic chariot for the great sun - god sur ##ya can ##tering inland from the indian ocean .

reference_raw: The Sun Temple of Konark was conceived as a giant chariot for a giant Sun-God, Surya, moving inland from the Indian Ocean.

reference_spacy_tokens: The Sun Temple of Konark was conceived as a giant chariot for a giant Sun - God , Surya , moving inland from the Indian Ocean .


fn_spacy_tokens_for_baseline: Such a formula was incompatible in the 1980s with a government determined to limit public expenditure , and a new approach was announced in 1981 .

source_bert_toks: such a formula was incompatible in the 1980s with a government determined to limit public expenditure , and a new approach was announced in 1981 .

reference_raw: This formula was not compatible with the government's decision to reduce public spending in the 1980s, and a new approach was announced in 1981.

reference_spacy_tokens: This formula was not compatible with the government 's decision to reduce public spending in the 1980s , and a new approach was announced in 1981 .


fn_spacy_tokens_for_baseline: During this time the headteacher and librarian visited two schools with project experience in order to gain further insights into the way in which their proposal might be developed .

source_bert_toks: during this time the head ##teacher and librarian visited two schools with project experience in order to gain further insights into the way in which their proposal might be developed .

reference_raw: During this period, the head teacher and librarian attended two schools with project experience in order to gain further insight into how their proposal could be drawn up.

reference_spacy_tokens: During this period , the head teacher and librarian attended two schools with project experience in order to gain further insight into how their proposal could be drawn up .


fn_spacy_tokens_for_baseline: But the farmer was kind to him and taught him a lot .

source_bert_toks: but the farmer was kind to him and taught him a lot .

reference_raw: But the farmer had been nice to him and had taught him a great deal.

reference_spacy_tokens: But the farmer had been nice to him and had taught him a great deal .


fn_spacy_tokens_for_baseline: The persistence of unemployment in the 1970s and 1980s has made the experience of the interwar years seem more relevant to economic policy making than that of the 1950s and 1960s .

source_bert_toks: the persistence of unemployment in the 1970s and 1980s has made the experience of the inter ##war years seem more relevant to economic policy making than that of the 1950s and 1960s .

reference_raw: As unemployment persisted in the 1970s and 1980s, experience in the interwar years seemed more important to economic policy-making than in the 1950s and 1960s.

reference_spacy_tokens: As unemployment persisted in the 1970s and 1980s , experience in the interwar years seemed more important to economic policy - making than in the 1950s and 1960s .


fn_spacy_tokens_for_baseline: ' He 's brilliant , he 's happy , he wakes up every day joyous and he never holds a grudge for more than about three minutes .

source_bert_toks: ' he ' s brilliant , he ' s happy , he wakes up every day joy ##ous and he never holds a gr ##udge for more than about three minutes .

reference_raw: He's brilliant, happy, awakening every day happy, never holding a grudge for more than three minutes.

reference_spacy_tokens: He 's brilliant , happy , awakening every day happy , never holding a grudge for more than three minutes .


fn_spacy_tokens_for_baseline: But he had skilfully pacified even the most vociferous of dissenters .

source_bert_toks: but he had ski ##lf ##ull ##y pac ##ified even the most vo ##ci ##fer ##ous of dissent ##ers .

reference_raw: But even the most vociferous of dissenters, he was skillfully pacing.

reference_spacy_tokens: But even the most vociferous of dissenters , he was skillfully pacing .


fn_spacy_tokens_for_baseline: The vinyl may harden and crack after 10 to 15 years , but until then the bed will be just as comfortable as the day you bought it .

source_bert_toks: the vinyl may harden and crack after 10 to 15 years , but until then the bed will be just as comfortable as the day you bought it .

reference_raw: After 10 to 15 years, the vinyl can get harder and cracker, but until then, the bed will be as comfortable as the day you bought it.

reference_spacy_tokens: After 10 to 15 years , the vinyl can get harder and cracker , but until then , the bed will be as comfortable as the day you bought it .


fn_spacy_tokens_for_baseline: In 1982 , as the war dragged on into its second year , Iraqi operations entered a new phase in which it expanded the use of FROG-7As strikes and the first employment ( three attacks in 1982 ) of the Scud - B short - range ballistic missile ( SRBM ) to strike at the Iranian strategic rear .

source_bert_toks: in 1982 , as the war dragged on into its second year , iraqi operations entered a new phase in which it expanded the use of frog - 7 ##as strikes and the first employment ( three attacks in 1982 ) of the sc ##ud - b short - range ballistic missile ( sr ##bm ) to strike at the iranian strategic rear .

reference_raw: In 1982, as the war dragged on to its second year, Iraqi operations entered a new phase in which they extended the use of FROG-7A strikes and the first employment (three strikes in 1982) of the Scud-B short-range ballistic missile (SRBM) to attack Iran's strategic back.

reference_spacy_tokens: In 1982 , as the war dragged on to its second year , Iraqi operations entered a new phase in which they extended the use of FROG-7A strikes and the first employment ( three strikes in 1982 ) of the Scud - B short - range ballistic missile ( SRBM ) to attack Iran 's strategic back .


fn_spacy_tokens_for_baseline: On Feb. 5 lawyers for two Palestinians convicted following the October 1985 hijacking of the Italian cruise ship Achille Lauro [ see pp . 34077 - 79 ] announced that they had been released in December 1990 and had left for Algeria .

source_bert_toks: on feb . 5 lawyers for two palestinians convicted following the october 1985 hi ##jack ##ing of the italian cruise ship ac ##hill ##e lau ##ro [ see pp . 340 ##7 ##7 - 79 ] announced that they had been released in december 1990 and had left for algeria .

reference_raw: Five lawyers of two Palestinians convicted after the kidnapping of the Italian cruise ship Achille Lauro in October 1985 (see page 34077-79) announced their release in December 1990 and their departure to Algeria.

reference_spacy_tokens: Five lawyers of two Palestinians convicted after the kidnapping of the Italian cruise ship Achille Lauro in October 1985 ( see page 34077 - 79 ) announced their release in December 1990 and their departure to Algeria .


fn_spacy_tokens_for_baseline: To Southey this suggested a disturbing want of seriousness in an engaged man .

source_bert_toks: to south ##ey this suggested a disturbing want of seriousness in an engaged man .

reference_raw: To Southey, it suggested a disturbing desire to be serious for an engaged man.

reference_spacy_tokens: To Southey , it suggested a disturbing desire to be serious for an engaged man .


fn_spacy_tokens_for_baseline: Much has been made of the way famous wrongdoers ( e.g. : Dick Morris , Marv Albert ) rebound too quickly in our celebrity culture .

source_bert_toks: much has been made of the way famous wrong ##do ##ers ( e . g . : dick morris , mar ##v albert ) rebound too quickly in our celebrity culture .

reference_raw: Much has been made of how well-known wrongdoers (for example, Dick Morris, Marv Albert) have rebounded too quickly in our celebrity culture.

reference_spacy_tokens: Much has been made of how well - known wrongdoers ( for example , Dick Morris , Marv Albert ) have rebounded too quickly in our celebrity culture .


fn_spacy_tokens_for_baseline: The truth was that every one of them was tired .

source_bert_toks: the truth was that every one of them was tired .

reference_raw: The truth was, they were all exhausted.

reference_spacy_tokens: The truth was , they were all exhausted .


fn_spacy_tokens_for_baseline: Fish and shellfish , popularly eaten raw , were polluted , although thousands of fishermen staged demonstrations in Lima protesting that fresh fish was safe to eat .

source_bert_toks: fish and shell ##fish , popularly eaten raw , were poll ##uted , although thousands of fishermen staged demonstrations in lima protesting that fresh fish was safe to eat .

reference_raw: Fish and molluscs, popularly eaten raw, were polluted, though thousands of fishermen staged demonstrations in Lima protesting that fresh fish were safe to eat.

reference_spacy_tokens: Fish and molluscs , popularly eaten raw , were polluted , though thousands of fishermen staged demonstrations in Lima protesting that fresh fish were safe to eat .


fn_spacy_tokens_for_baseline: I admired his silk suit .

source_bert_toks: i admired his silk suit .

reference_raw: I was admiring his silk dress.

reference_spacy_tokens: I was admiring his silk dress .


fn_spacy_tokens_for_baseline: If you remember , yesterday afternoon , after the funeral , Francis asked me to lock the studio and bring him the key .

source_bert_toks: if you remember , yesterday afternoon , after the funeral , francis asked me to lock the studio and bring him the key .

reference_raw: If you remember, yesterday afternoon, after the funeral, Francis asked me to lock up the study and get him a key.

reference_spacy_tokens: If you remember , yesterday afternoon , after the funeral , Francis asked me to lock up the study and get him a key .


fn_spacy_tokens_for_baseline: Police have located the owner of a van with the same number plates , who described the builders ' logo on the vehicle when he sold it several months ago .

source_bert_toks: police have located the owner of a van with the same number plates , who described the builders ' logo on the vehicle when he sold it several months ago .

reference_raw: The police found the owner of a van with the same number plates that described the builder's logo when he sold it a few months ago.

reference_spacy_tokens: The police found the owner of a van with the same number plates that described the builder 's logo when he sold it a few months ago .


fn_spacy_tokens_for_baseline: It sounded to some as though he might be a languid and disdainful aristocrat .

source_bert_toks: it sounded to some as though he might be a lang ##uid and disdain ##ful ari ##sto ##crat .

reference_raw: To some, it was as if he were a languid and contemptuous nobleman.

reference_spacy_tokens: To some , it was as if he were a languid and contemptuous nobleman .


fn_spacy_tokens_for_baseline: oh i know my husband wants me to take up golf that 's another thing he does and uh you know i do n't know that i see that as a real big exercise though

source_bert_toks: oh i know my husband wants me to take up golf that ' s another thing he does and uh you know i don ' t know that i see that as a real big exercise though

reference_raw: Oh, I know my husband wants me to go golf, which is another thing he's doing, and, uh, you know, I don't know if I see it as a really big drill,

reference_spacy_tokens: Oh , I know my husband wants me to go golf , which is another thing he 's doing , and , uh , you know , I do n't know if I see it as a really big drill ,


fn_spacy_tokens_for_baseline: The Animal Liberation Front yesterday claimed to have planted an incendiary device which was removed by police from the Duke Street , London , office of Sears plc -- Selfridges ' parent company .

source_bert_toks: the animal liberation front yesterday claimed to have planted an inc ##end ##iary device which was removed by police from the duke street , london , office of sears plc - - self ##ridge ##s ' parent company .

reference_raw: Yesterday, the Animal Liberation Front claimed to have set up a fire-fighting device that the police had removed from Duke Street, London, the office of Sears plc, the parent company of Selfridges.

reference_spacy_tokens: Yesterday , the Animal Liberation Front claimed to have set up a fire - fighting device that the police had removed from Duke Street , London , the office of Sears plc , the parent company of Selfridges .


fn_spacy_tokens_for_baseline: One of these protein kinases is specifically activated by calcium ( and is therefore , in another of the acronyms beloved of biochemists , known universally as PKC ) .

source_bert_toks: one of these protein kinase ##s is specifically activated by calcium ( and is therefore , in another of the acronym ##s beloved of bio ##chemist ##s , known universally as p ##k ##c ) .

reference_raw: One of these protein kinases is specifically active in calcium (and therefore in another of the acronyms that are loved by biochemists, generally known as PKC).

reference_spacy_tokens: One of these protein kinases is specifically active in calcium ( and therefore in another of the acronyms that are loved by biochemists , generally known as PKC ) .


fn_spacy_tokens_for_baseline: But as she seized it in her hand , before her horrified eyes the dried petals fell away and fluttered to the floor , scattering like confetti at her feet .

source_bert_toks: but as she seized it in her hand , before her horrified eyes the dried petals fell away and fluttered to the floor , scattering like con ##fe ##tti at her feet .

reference_raw: But when she took it in her hand, the dried petals fell away in front of her horrified eyes, fluttering to the floor, scattering like confetti at her feet.

reference_spacy_tokens: But when she took it in her hand , the dried petals fell away in front of her horrified eyes , fluttering to the floor , scattering like confetti at her feet .


fn_spacy_tokens_for_baseline: In contrast , only 14 % of normal breast tissues expressed BP1 .

source_bert_toks: in contrast , only 14 % of normal breast tissues expressed bp ##1 .

reference_raw: On the other hand, only 14% of regular breast tissues express BP1.

reference_spacy_tokens: On the other hand , only 14 % of regular breast tissues express BP1 .


fn_spacy_tokens_for_baseline: But they would never be so stupid as to allow us to find him .

source_bert_toks: but they would never be so stupid as to allow us to find him .

reference_raw: But they'd never be dumb enough to let us find him.

reference_spacy_tokens: But they 'd never be dumb enough to let us find him .


fn_spacy_tokens_for_baseline: She 'd be heartbroken if her father was n't at her wedding .

source_bert_toks: she ' d be heart ##broken if her father wasn ' t at her wedding .

reference_raw: It would break her heart if her father wasn't at her wedding.

reference_spacy_tokens: It would break her heart if her father was n't at her wedding .


fn_spacy_tokens_for_baseline: " In my experience , most women like to feel that they have thick , glossy , manageable hair .

source_bert_toks: " in my experience , most women like to feel that they have thick , glossy , manage ##able hair .

reference_raw: "In my experience, most women like to feel their hair is thick, shiny and manageable."

reference_spacy_tokens: " In my experience , most women like to feel their hair is thick , shiny and manageable . "


fn_spacy_tokens_for_baseline: His assassination was predictable , although how the murderer passed by the android security guards had yet to be explained .

source_bert_toks: his assassination was predictable , although how the murderer passed by the android security guards had yet to be explained .

reference_raw: His murder was foreseeable, though there was still no explanation as to how the killer had passed by the android guards.

reference_spacy_tokens: His murder was foreseeable , though there was still no explanation as to how the killer had passed by the android guards .


fn_spacy_tokens_for_baseline: The battles and skirmishes of middle - class rural boundary disputing are of interest only to their panting protagonists .

source_bert_toks: the battles and skirmish ##es of middle - class rural boundary di ##sp ##uting are of interest only to their panting protagonists .

reference_raw: Only their panting protagonists are interested in the battles and battles of middle-class rural border disputes.

reference_spacy_tokens: Only their panting protagonists are interested in the battles and battles of middle - class rural border disputes .


fn_spacy_tokens_for_baseline: But it is unfair to dump on teachers , as distinct from the educational establishment .

source_bert_toks: but it is unfair to dump on teachers , as distinct from the educational establishment .

reference_raw: But it's not fair to dump on teachers that are different from the school.

reference_spacy_tokens: But it 's not fair to dump on teachers that are different from the school .


fn_spacy_tokens_for_baseline: All he 'd glimpsed through the window was Matta playing solitaire of some kind , so why had the man taken such delight in terrifying him ?

source_bert_toks: all he ' d glimpse ##d through the window was matt ##a playing sol ##itaire of some kind , so why had the man taken such delight in terrifying him ?

reference_raw: The only thing he could see through the window was that Matta was playing solitaire, so why had he been so happy about scaring him?

reference_spacy_tokens: The only thing he could see through the window was that Matta was playing solitaire , so why had he been so happy about scaring him ?


fn_spacy_tokens_for_baseline: The Lukac brothers spearheaded a second - period revival to take their team to 8 - 6 at the end of the second but Hawks managed to take the final period 3 - 1 and tie the game 9 - 9 .

source_bert_toks: the lu ##ka ##c brothers spearheaded a second - period revival to take their team to 8 - 6 at the end of the second but hawks managed to take the final period 3 - 1 and tie the game 9 - 9 .

reference_raw: The Lukac brothers lanced a second-period revival to take the team to 8-6 at the end of the second, but the Hawks were able to take the last three-to-one and tie the 9-9 game.

reference_spacy_tokens: The Lukac brothers lanced a second - period revival to take the team to 8 - 6 at the end of the second , but the Hawks were able to take the last three - to - one and tie the 9 - 9 game .


fn_spacy_tokens_for_baseline: In the afternoon , women would arrive in carriages from the great house a mile or so distant .

source_bert_toks: in the afternoon , women would arrive in carriages from the great house a mile or so distant .

reference_raw: In the afternoon, the women would arrive in carriages from a large house about a mile away.

reference_spacy_tokens: In the afternoon , the women would arrive in carriages from a large house about a mile away .


fn_spacy_tokens_for_baseline: It was a gentle enough life and it took only six and a half hours to travel home by taxi from Beirut to Jaffa .

source_bert_toks: it was a gentle enough life and it took only six and a half hours to travel home by taxi from beirut to ja ##ffa .

reference_raw: It was a fine life, and it took only six-and-a-half hours to get home in a cab from Beirut to Jaffa.

reference_spacy_tokens: It was a fine life , and it took only six - and - a - half hours to get home in a cab from Beirut to Jaffa .


fn_spacy_tokens_for_baseline: Following the transfer of responsibility for social rehabilitation of discharged patients in 1993 from the NHS to local authorities , greater emphasis may be given to developing work schemes .

source_bert_toks: following the transfer of responsibility for social rehabilitation of discharged patients in 1993 from the nhs to local authorities , greater emphasis may be given to developing work schemes .

reference_raw: After shifting responsibility for the social rehabilitation of discharged patients from the NHS to local authorities in 1993, more emphasis can be placed on the development of work programmes.

reference_spacy_tokens: After shifting responsibility for the social rehabilitation of discharged patients from the NHS to local authorities in 1993 , more emphasis can be placed on the development of work programmes .


fn_spacy_tokens_for_baseline: A package of tax and duty incentives aimed at attracting foreign institutions was launched on July 25 , 1989 .

source_bert_toks: a package of tax and duty incentives aimed at attracting foreign institutions was launched on july 25 , 1989 .

reference_raw: On July 25, 1989, a set of tax and tax incentives was launched to attract foreign institutions.

reference_spacy_tokens: On July 25 , 1989 , a set of tax and tax incentives was launched to attract foreign institutions .


fn_spacy_tokens_for_baseline: Thus J. S. Mill , the leading theoretician of liberal feminism , stressed that it was impossible to know what women 's true capacities were because of their inferior education .

source_bert_toks: thus j . s . mill , the leading theo ##ret ##icia ##n of liberal feminism , stressed that it was impossible to know what women ' s true capacities were because of their inferior education .

reference_raw: So J.S. Mill, the leading theorist of liberal feminism, pointed out that it was impossible to know what women's real abilities were due to their low education.

reference_spacy_tokens: So J.S. Mill , the leading theorist of liberal feminism , pointed out that it was impossible to know what women 's real abilities were due to their low education .


fn_spacy_tokens_for_baseline: But whoever it was that made that claim obviously did not have a school day on which he was expected to use MY brain to do one of Mr Kent 's maths tests !

source_bert_toks: but whoever it was that made that claim obviously did not have a school day on which he was expected to use my brain to do one of mr kent ' s math ##s tests !

reference_raw: But whoever made this claim obviously didn't have a school day when he was supposed to use my brain to run one of Mr. Kent's math exams!

reference_spacy_tokens: But whoever made this claim obviously did n't have a school day when he was supposed to use my brain to run one of Mr. Kent 's math exams !


fn_spacy_tokens_for_baseline: He later described his three - month suspension as too lenient .

source_bert_toks: he later described his three - month suspension as too len ##ient .

reference_raw: Later, he described his three-month suspension as too indulgent.

reference_spacy_tokens: Later , he described his three - month suspension as too indulgent .


fn_spacy_tokens_for_baseline: It excludes the interpretation that the door shut of its own accord , and so leads more explicitly to the conclusion that the door was shut by the shopman .

source_bert_toks: it exclude ##s the interpretation that the door shut of its own accord , and so leads more explicitly to the conclusion that the door was shut by the shop ##man .

reference_raw: It excludes the conclusion that the door is closed of its own accord and thus leads, more specifically, to the conclusion that the door was closed by the shopkeeper.

reference_spacy_tokens: It excludes the conclusion that the door is closed of its own accord and thus leads , more specifically , to the conclusion that the door was closed by the shopkeeper .


fn_spacy_tokens_for_baseline: She bent over Rob 's hand and slowly , deftly drew out the sliver of wood .

source_bert_toks: she bent over rob ' s hand and slowly , def ##tly drew out the sl ##iver of wood .

reference_raw: She leaned over Rob's hand and slowly, deftly pulled out a piece of wood.

reference_spacy_tokens: She leaned over Rob 's hand and slowly , deftly pulled out a piece of wood .


fn_spacy_tokens_for_baseline: So the camera was right down on the bottom .

source_bert_toks: so the camera was right down on the bottom .

reference_raw: So the camera was at the bottom.

reference_spacy_tokens: So the camera was at the bottom .


fn_spacy_tokens_for_baseline: This approach is consonant not only with Mannheim 's project but also with the way that knowledge will be construed later in this book .

source_bert_toks: this approach is consonant not only with mannheim ' s project but also with the way that knowledge will be con ##st ##rued later in this book .

reference_raw: This approach is consistent not only with the Mannheim project, but also with the way knowledge will be interpreted later in this book.

reference_spacy_tokens: This approach is consistent not only with the Mannheim project , but also with the way knowledge will be interpreted later in this book .


fn_spacy_tokens_for_baseline: He made a rueful face .

source_bert_toks: he made a rue ##ful face .

reference_raw: He made a sad face.

reference_spacy_tokens: He made a sad face .


fn_spacy_tokens_for_baseline: After all , she did n't own Piers Morrison , he could talk to just whomever he pleased , and she was in no mood to hear any amused remarks from him afterwards about jealousy .

source_bert_toks: after all , she didn ' t own piers morrison , he could talk to just whom ##ever he pleased , and she was in no mood to hear any amused remarks from him afterwards about jealousy .

reference_raw: After all, she didn't own Piers Morrison, he could talk to anyone he wanted, and she wasn't in the mood to hear any amused comments about jealousy from him after that.

reference_spacy_tokens: After all , she did n't own Piers Morrison , he could talk to anyone he wanted , and she was n't in the mood to hear any amused comments about jealousy from him after that .


fn_spacy_tokens_for_baseline: And it came to him , with a cold steely horror chilling the bloodstream as if from a lethal injection -- he had left them in the stolen mini .

source_bert_toks: and it came to him , with a cold steel ##y horror chilling the blood ##stream as if from a lethal injection - - he had left them in the stolen mini .

reference_raw: And it occurred to him, with a cold, steely terror that chilled the bloodstream like a deadly shot, that he had left it in a stolen mini.

reference_spacy_tokens: And it occurred to him , with a cold , steely terror that chilled the bloodstream like a deadly shot , that he had left it in a stolen mini .