fn_spacy_tokens_for_baseline: Her lips seemed glued together .

source_bert_toks: her lips seemed glued together .

reference_raw: Her lips seemed to stick together.

reference_spacy_tokens: Her lips seemed to stick together .


fn_spacy_tokens_for_baseline: It 's his job to bring the murderer of the old money - lender and her sister to justice .

source_bert_toks: it ' s his job to bring the murderer of the old money - lend ##er and her sister to justice .

reference_raw: His job is to bring an old money lender's killer and her sister to justice.

reference_spacy_tokens: His job is to bring an old money lender 's killer and her sister to justice .


fn_spacy_tokens_for_baseline: I was very apprehensive -- there were very big seas when we started .

source_bert_toks: i was very app ##re ##hen ##sive - - there were very big seas when we started .

reference_raw: I was very worried - when we started, the seas were very large.

reference_spacy_tokens: I was very worried - when we started , the seas were very large .


fn_spacy_tokens_for_baseline: If you want to warm rooms in very cold temperatures set the heating to come on earlier rather than turning it up higher .

source_bert_toks: if you want to warm rooms in very cold temperatures set the heating to come on earlier rather than turning it up higher .

reference_raw: If you want to heat a room at very cold temperatures, set the heat to start early rather than turn it on higher.

reference_spacy_tokens: If you want to heat a room at very cold temperatures , set the heat to start early rather than turn it on higher .


fn_spacy_tokens_for_baseline: In one room with a horde of Black children ? '

source_bert_toks: in one room with a horde of black children ? '

reference_raw: In the same room with a bunch of black kids?'

reference_spacy_tokens: In the same room with a bunch of black kids ? '


fn_spacy_tokens_for_baseline: Arms reached out of high windows to haul in washing .

source_bert_toks: arms reached out of high windows to haul in washing .

reference_raw: Arms reached out from the high windows and pulled in the laundry.

reference_spacy_tokens: Arms reached out from the high windows and pulled in the laundry .


fn_spacy_tokens_for_baseline: The attendant explained with a friendly grin .

source_bert_toks: the attendant explained with a friendly grin .

reference_raw: The stewardess explained with an amiable smile.

reference_spacy_tokens: The stewardess explained with an amiable smile .


fn_spacy_tokens_for_baseline: In large hotels it would be impossible for staff to memorise all the names of the guests and their room numbers .

source_bert_toks: in large hotels it would be impossible for staff to memo ##rise all the names of the guests and their room numbers .

reference_raw: In large hotels, the staff could not remember all the names of the guests and their room numbers.

reference_spacy_tokens: In large hotels , the staff could not remember all the names of the guests and their room numbers .


fn_spacy_tokens_for_baseline: With its highly developed modular , semester - based degree structure and this ' open - door ' policy , the University maintains an unrivalled position as a provider of higher education in Scotland .

source_bert_toks: with its highly developed modular , semester - based degree structure and this ' open - door ' policy , the university maintains an un ##ri ##val ##led position as a provider of higher education in scotland .

reference_raw: With its highly developed modular degree structure based on semesters and this open-door policy, the University retains a unique position as a provider of higher education in Scotland.

reference_spacy_tokens: With its highly developed modular degree structure based on semesters and this open - door policy , the University retains a unique position as a provider of higher education in Scotland .


fn_spacy_tokens_for_baseline: Gerald Strine in the same newspaper was more forthright : for him Piggott ' nearly got the best horse beaten ' .

source_bert_toks: gerald st ##rine in the same newspaper was more forth ##right : for him pig ##go ##tt ' nearly got the best horse beaten ' .

reference_raw: Gerald Strine was more honest in the same paper: for him, Piggott "nearly beats the best horse."

reference_spacy_tokens: Gerald Strine was more honest in the same paper : for him , Piggott " nearly beats the best horse . "


fn_spacy_tokens_for_baseline: It was the next hour or two that he remembered with such intensity .

source_bert_toks: it was the next hour or two that he remembered with such intensity .

reference_raw: It was an hour or two before he could recall it with such intensity.

reference_spacy_tokens: It was an hour or two before he could recall it with such intensity .


fn_spacy_tokens_for_baseline: I was stuck there like a flying buttress between the floor and the pillar , and Jamie was still gibbering away to the girl about the sound a Triumph makes and the high - speed runs she 'd done up the side of Loch Lomond at night .

source_bert_toks: i was stuck there like a flying butt ##ress between the floor and the pillar , and jamie was still gi ##bber ##ing away to the girl about the sound a triumph makes and the high - speed runs she ' d done up the side of loch lo ##mond at night .

reference_raw: I was stuck there like a flying butt between the floor and the pillar, and Jamie was still talking to the girl about the sound Triumph made and the high-speed runs she'd made on Loch Lomond's side in the middle of the night.

reference_spacy_tokens: I was stuck there like a flying butt between the floor and the pillar , and Jamie was still talking to the girl about the sound Triumph made and the high - speed runs she 'd made on Loch Lomond 's side in the middle of the night .


fn_spacy_tokens_for_baseline: History was taught by a whiskery professor who thundered about the Origin and Destiny of Imperial Britain .

source_bert_toks: history was taught by a w ##his ##ker ##y professor who thunder ##ed about the origin and destiny of imperial britain .

reference_raw: History was taught by a bearded professor who roared about Imperial Britain's origin and destiny.

reference_spacy_tokens: History was taught by a bearded professor who roared about Imperial Britain 's origin and destiny .


fn_spacy_tokens_for_baseline: From behind the church a ploughed field slanted up to the uncompromising skyline .

source_bert_toks: from behind the church a pl ##ough ##ed field slant ##ed up to the un ##com ##promising skyline .

reference_raw: Behind the church a ploughed field sloped toward the uncompromising skyline.

reference_spacy_tokens: Behind the church a ploughed field sloped toward the uncompromising skyline .


fn_spacy_tokens_for_baseline: At the same time English forces sent to help to restore his brother - in - law to his principality of the Palatinate were all killed or captured .

source_bert_toks: at the same time english forces sent to help to restore his brother - in - law to his principality of the palatinate were all killed or captured .

reference_raw: At the same time, the English forces sent to help restore his brother-in-law to the principality of the Palatinate had all been killed or captured.

reference_spacy_tokens: At the same time , the English forces sent to help restore his brother - in - law to the principality of the Palatinate had all been killed or captured .


fn_spacy_tokens_for_baseline: From a power base in Anatolia , the Persians overran the eastern Aegean Islands and set their sights on the Cyclades .

source_bert_toks: from a power base in anatolia , the persians over ##ran the eastern aegean islands and set their sights on the cy ##cl ##ades .

reference_raw: From the power base in Anatolia, the Persians crossed the eastern Aegean islands and set eyes on the Cyclades.

reference_spacy_tokens: From the power base in Anatolia , the Persians crossed the eastern Aegean islands and set eyes on the Cyclades .


fn_spacy_tokens_for_baseline: Immediately after take - off we passed San Sebastian on the north side of the coastline , making sure that another G - registered aeroplane heading in the opposite direction was south of it before being handed on to Bilbao .

source_bert_toks: immediately after take - off we passed san sebastian on the north side of the coastline , making sure that another g - registered aero ##plane heading in the opposite direction was south of it before being handed on to bilbao .

reference_raw: Immediately after take-off, we passed San Sebastian on the northern side of the coast, making sure that another G-registered aircraft headed in the opposite direction was south of him before being handed over to Bilbao.

reference_spacy_tokens: Immediately after take - off , we passed San Sebastian on the northern side of the coast , making sure that another G - registered aircraft headed in the opposite direction was south of him before being handed over to Bilbao .


fn_spacy_tokens_for_baseline: " I do n't see how that 's going to cure my nightmares . "

source_bert_toks: " i don ' t see how that ' s going to cure my nightmares . "

reference_raw: "I don't know how this will heal my nightmares."

reference_spacy_tokens: " I do n't know how this will heal my nightmares . "


fn_spacy_tokens_for_baseline: Although requiring periodic updating of the information , the questionnaire would appear to be an efficient method of collecting information on current activity .

source_bert_toks: although requiring periodic up ##dating of the information , the question ##naire would appear to be an efficient method of collecting information on current activity .

reference_raw: Although a regular update of the information is required, the questionnaire appears to be an effective way of collecting information on current activities.

reference_spacy_tokens: Although a regular update of the information is required , the questionnaire appears to be an effective way of collecting information on current activities .


fn_spacy_tokens_for_baseline: Ever since 1957 the Canton Trade Fair ( officially the Chinese Export Commodities Fair ) has attracted throngs of international business people every spring and autumn .

source_bert_toks: ever since 1957 the canton trade fair ( officially the chinese export commodities fair ) has attracted th ##rong ##s of international business people every spring and autumn .

reference_raw: Since 1957, the Canton Trade Fair (officially the Chinese Export Commodity Fair) has drawn crowds of international entrepreneurs every spring and autumn.

reference_spacy_tokens: Since 1957 , the Canton Trade Fair ( officially the Chinese Export Commodity Fair ) has drawn crowds of international entrepreneurs every spring and autumn .


fn_spacy_tokens_for_baseline: The Tsar wavered briefly and then , urged by Stolypin and others to stand firm , he rejected any step which might lead to parliamentary government and dissolved the First Duma .

source_bert_toks: the tsar wave ##red briefly and then , urged by st ##ol ##yp ##in and others to stand firm , he rejected any step which might lead to parliamentary government and dissolved the first du ##ma .

reference_raw: The Tsar hesitated for a moment, then, urged by Stolypin and the others to stand firm, rejected any move that might lead to a parliamentary government and disbanded the First Duma.

reference_spacy_tokens: The Tsar hesitated for a moment , then , urged by Stolypin and the others to stand firm , rejected any move that might lead to a parliamentary government and disbanded the First Duma .


fn_spacy_tokens_for_baseline: He said it was the most joyful moment of his life . '

source_bert_toks: he said it was the most joy ##ful moment of his life . '

reference_raw: "He said it was the happiest moment of his life."

reference_spacy_tokens: " He said it was the happiest moment of his life . "


fn_spacy_tokens_for_baseline: Unfortunately , however , there is a great deal of uncertainty as to what the word means .

source_bert_toks: unfortunately , however , there is a great deal of uncertainty as to what the word means .

reference_raw: Unfortunately, there is a great deal of doubt as to what that word means.

reference_spacy_tokens: Unfortunately , there is a great deal of doubt as to what that word means .


fn_spacy_tokens_for_baseline: It made Callaghan seem untypically fragile and lacking in confidence .

source_bert_toks: it made call ##aghan seem un ##typical ##ly fragile and lacking in confidence .

reference_raw: It made Callaghan look unusually frail and untrustworthy.

reference_spacy_tokens: It made Callaghan look unusually frail and untrustworthy .


fn_spacy_tokens_for_baseline: On Sept. 4 a member of the High Council of the Republic ( HCR ) , Madeleine Adayoma , was flogged by security personnel as she left the Lome radio studios after taking part in a programme .

source_bert_toks: on sept . 4 a member of the high council of the republic ( hc ##r ) , madeleine ada ##yo ##ma , was fl ##og ##ged by security personnel as she left the lo ##me radio studios after taking part in a programme .

reference_raw: On September 4, a member of the High Council of the Republic (HCR), Madeleine Adayoma, was whipped by security personnel when she left the radio studios in Lome after participating in the program.

reference_spacy_tokens: On September 4 , a member of the High Council of the Republic ( HCR ) , Madeleine Adayoma , was whipped by security personnel when she left the radio studios in Lome after participating in the program .


fn_spacy_tokens_for_baseline: Each corner contained a runner of sorts , which increased the rope drag , so that by the time I peeped round into the main central corner that was clearly the key to the route , the drag was very serious .

source_bert_toks: each corner contained a runner of sorts , which increased the rope drag , so that by the time i pee ##ped round into the main central corner that was clearly the key to the route , the drag was very serious .

reference_raw: There was a runner in each corner, which increased the pull of the rope, and by the time I looked around to the main central corner, which was clearly the key to the road, it was very serious.

reference_spacy_tokens: There was a runner in each corner , which increased the pull of the rope , and by the time I looked around to the main central corner , which was clearly the key to the road , it was very serious .


fn_spacy_tokens_for_baseline: True , there were a few pockets of stubborn resistance , where the Reiksguard refused to fall back in the face of certain defeat or where the thunder of Imperial arquebuses had shattered the Bretonnian infantry .

source_bert_toks: true , there were a few pockets of stubborn resistance , where the rei ##ks ##guard refused to fall back in the face of certain defeat or where the thunder of imperial ar ##que ##bus ##es had shattered the breton ##nian infantry .

reference_raw: It was true that there were several pockets of stubborn resistance where the Reiksguard refused to retreat in the face of certain defeat, or where the storm of Imperial arquebuses shattered the Bretonnian infantry.

reference_spacy_tokens: It was true that there were several pockets of stubborn resistance where the Reiksguard refused to retreat in the face of certain defeat , or where the storm of Imperial arquebuses shattered the Bretonnian infantry .


fn_spacy_tokens_for_baseline: They might look cool in the pub and strutting around the car park at Ogwen Cottage , but when the chips were down you got wet .

source_bert_toks: they might look cool in the pub and st ##rut ##ting around the car park at og ##wen cottage , but when the chips were down you got wet .

reference_raw: They might look good in the pub and walk around the parking lot in Ogwen Cottage, but when the chips were down, you got wet.

reference_spacy_tokens: They might look good in the pub and walk around the parking lot in Ogwen Cottage , but when the chips were down , you got wet .


fn_spacy_tokens_for_baseline: How that responsibility is best discharged can be decided only by the person concerned .

source_bert_toks: how that responsibility is best discharged can be decided only by the person concerned .

reference_raw: Only the person concerned can determine how this responsibility is best discharged.

reference_spacy_tokens: Only the person concerned can determine how this responsibility is best discharged .


fn_spacy_tokens_for_baseline: Hastings is relying on his fellow backs to win it .

source_bert_toks: hastings is relying on his fellow backs to win it .

reference_raw: Hastings is counting on his comrades' backs to win.

reference_spacy_tokens: Hastings is counting on his comrades ' backs to win .


fn_spacy_tokens_for_baseline: The kingdom also uses the amputation of limbs as a punishment , imposes the death penalty , and has frequently been accused of torturing prisoners .

source_bert_toks: the kingdom also uses the amp ##utation of limbs as a punishment , impose ##s the death penalty , and has frequently been accused of tor ##turing prisoners .

reference_raw: The Kingdom also uses the amputation of limbs as punishment, imposes the death penalty, and is often accused of tormenting prisoners.

reference_spacy_tokens: The Kingdom also uses the amputation of limbs as punishment , imposes the death penalty , and is often accused of tormenting prisoners .


fn_spacy_tokens_for_baseline: The plane lurches into motion .

source_bert_toks: the plane lu ##rch ##es into motion .

reference_raw: The plane is in motion.

reference_spacy_tokens: The plane is in motion .


fn_spacy_tokens_for_baseline: All the indignities he had suffered since their abduction to this rock of a planet would be avenged .

source_bert_toks: all the ind ##ign ##ities he had suffered since their abduction to this rock of a planet would be avenge ##d .

reference_raw: All the indignities he'd suffered since their kidnapping to this planet's rock would be avenged.

reference_spacy_tokens: All the indignities he 'd suffered since their kidnapping to this planet 's rock would be avenged .


fn_spacy_tokens_for_baseline: Delaney shouted , saw her going under , and knew from the strange lethargic roll as a wave washed past , that something was desperately wrong .

source_bert_toks: delaney shouted , saw her going under , and knew from the strange let ##har ##gic roll as a wave washed past , that something was desperately wrong .

reference_raw: Delaney cried out, saw her sink, and knew from the strange lethargy roll as the wave swept past that something was desperately wrong.

reference_spacy_tokens: Delaney cried out , saw her sink , and knew from the strange lethargy roll as the wave swept past that something was desperately wrong .


fn_spacy_tokens_for_baseline: In older horses infections rarely become patent but are often associated with persistent coughing and an increased respiratory rate .

source_bert_toks: in older horses infections rarely become patent but are often associated with persistent coughing and an increased respiratory rate .

reference_raw: In elderly horses, infections are rarely patented, but often associated with persistent coughing and increased respiratory rate.

reference_spacy_tokens: In elderly horses , infections are rarely patented , but often associated with persistent coughing and increased respiratory rate .


fn_spacy_tokens_for_baseline: Aunt Margaret sat on a bank of primroses , naked but for a cloak of brilliant green loosely slung around her shoulders .

source_bert_toks: aunt margaret sat on a bank of pri ##m ##rose ##s , naked but for a cloak of brilliant green loosely slung around her shoulders .

reference_raw: Aunt Margaret was sitting on the edge of the primroses, naked but for a robe of bright green, loosely draped around her shoulders.

reference_spacy_tokens: Aunt Margaret was sitting on the edge of the primroses , naked but for a robe of bright green , loosely draped around her shoulders .


fn_spacy_tokens_for_baseline: Investigators say it 's possible the money may have been taken to Iraq or Turkey to buy refugee supplies on the spot .

source_bert_toks: investigators say it ' s possible the money may have been taken to iraq or turkey to buy refugee supplies on the spot .

reference_raw: According to investigators, the money could have been taken to Iraq or Turkey to purchase refugee supplies on the spot.

reference_spacy_tokens: According to investigators , the money could have been taken to Iraq or Turkey to purchase refugee supplies on the spot .


fn_spacy_tokens_for_baseline: Penelope Chilston was six feet tall , a plain , square - shouldered , big - thighed , fresh - faced girl , with a fringe and straight , dark brown hair .

source_bert_toks: penelope chi ##lston was six feet tall , a plain , square - shouldered , big - thigh ##ed , fresh - faced girl , with a fringe and straight , dark brown hair .

reference_raw: Penelope Chilston was six feet high, a simple, square-shouldered, high-thigh, fresh-faced girl with a straight, dark-brown hair.

reference_spacy_tokens: Penelope Chilston was six feet high , a simple , square - shouldered , high - thigh , fresh - faced girl with a straight , dark - brown hair .


fn_spacy_tokens_for_baseline: Knowing that not many Southwark families sat down to a breakfast like that , the Beavises blessed their luck and addressed the world with beaming gratitude .

source_bert_toks: knowing that not many south ##wark families sat down to a breakfast like that , the bea ##vis ##es blessed their luck and addressed the world with beaming gratitude .

reference_raw: Knowing there weren't many Southwark families sitting at breakfast like this, the Beavises blessed their luck and spoke to the world with bright gratitude.

reference_spacy_tokens: Knowing there were n't many Southwark families sitting at breakfast like this , the Beavises blessed their luck and spoke to the world with bright gratitude .


fn_spacy_tokens_for_baseline: We had all listened intently to this remarkable statement .

source_bert_toks: we had all listened intently to this remarkable statement .

reference_raw: We've all heard this remarkable statement carefully.

reference_spacy_tokens: We 've all heard this remarkable statement carefully .


fn_spacy_tokens_for_baseline: Marcus lying bloodied and broken , at this very moment being lifted into an ambulance , the red blanket being pulled up over his beautiful face .

source_bert_toks: marcus lying blood ##ied and broken , at this very moment being lifted into an ambulance , the red blanket being pulled up over his beautiful face .

reference_raw: Marcus lay bloody and broken, just as he was hauled into the ambulance, a red blanket pulled over his beautiful face.

reference_spacy_tokens: Marcus lay bloody and broken , just as he was hauled into the ambulance , a red blanket pulled over his beautiful face .


fn_spacy_tokens_for_baseline: Off the back of the door he took an old net shopping - bag that his Mum hardly ever used and stuffed the carton and biscuits into it .

source_bert_toks: off the back of the door he took an old net shopping - bag that his mum hardly ever used and stuffed the cart ##on and biscuits into it .

reference_raw: He took an old net shopping bag from the back of the door, which his mother had barely used, and filled it with a box and cookies.

reference_spacy_tokens: He took an old net shopping bag from the back of the door , which his mother had barely used , and filled it with a box and cookies .


fn_spacy_tokens_for_baseline: It was back in january two years ago when he and a colleague were delivering money to a branch of LLoyds bank in Cheltenham .

source_bert_toks: it was back in january two years ago when he and a colleague were delivering money to a branch of lloyd ##s bank in cheltenham .

reference_raw: It was in January two years ago when he and one of his colleagues supplied money to a branch of Lloyds Bank in Cheltenham.

reference_spacy_tokens: It was in January two years ago when he and one of his colleagues supplied money to a branch of Lloyds Bank in Cheltenham .


fn_spacy_tokens_for_baseline: The best method for notes is undoubtedly some loose - leaf system , preferably one using cords to hold the paper .

source_bert_toks: the best method for notes is undoubtedly some loose - leaf system , prefer ##ably one using cords to hold the paper .

reference_raw: No doubt the best method of noting is some loose-leaf system, preferably one that uses ropes to hold paper.

reference_spacy_tokens: No doubt the best method of noting is some loose - leaf system , preferably one that uses ropes to hold paper .


fn_spacy_tokens_for_baseline: ' Are you telling me you were concerned for my soul ? ' she mocked .

source_bert_toks: ' are you telling me you were concerned for my soul ? ' she mocked .

reference_raw: "You mean to tell me that you were worried about my soul?" she laughed.

reference_spacy_tokens: " You mean to tell me that you were worried about my soul ? " she laughed .


fn_spacy_tokens_for_baseline: She was wearing a fashionable knee - length straight skirt , a silk blouse in a vivid jade - green , and slender - heeled shoes .

source_bert_toks: she was wearing a fashionable knee - length straight skirt , a silk blouse in a vivid jade - green , and slender - heel ##ed shoes .

reference_raw: She wore a fashionable knee-length straight skirt, a silk tunic in a vivid jade-green, and a pair of slim-heeled boots.

reference_spacy_tokens: She wore a fashionable knee - length straight skirt , a silk tunic in a vivid jade - green , and a pair of slim - heeled boots .


fn_spacy_tokens_for_baseline: She shot him a look of exasperation .

source_bert_toks: she shot him a look of ex ##as ##peration .

reference_raw: She gave him an irritated look.

reference_spacy_tokens: She gave him an irritated look .


fn_spacy_tokens_for_baseline: On each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

source_bert_toks: on each landing , opposite the lift - shaft , the poster with the enormous face gazed from the wall .

reference_raw: On each landing, across from the elevator shaft, a poster with a huge face looked out from the wall.

reference_spacy_tokens: On each landing , across from the elevator shaft , a poster with a huge face looked out from the wall .


fn_spacy_tokens_for_baseline: North Korea also has placed thousands of artillery systems -- including multiple launch rocket systems that are particularly effective for CW delivery -- within reach of the Demilitarized Zone ( DMZ ) and Seoul .

source_bert_toks: north korea also has placed thousands of artillery systems - - including multiple launch rocket systems that are particularly effective for cw delivery - - within reach of the demi ##lita ##rized zone ( d ##m ##z ) and seoul .

reference_raw: North Korea has also put thousands of artillery systems - including multiple launch rocket systems that are particularly efficient for the supply of CW - within reach of the DMZ and Seoul.

reference_spacy_tokens: North Korea has also put thousands of artillery systems - including multiple launch rocket systems that are particularly efficient for the supply of CW - within reach of the DMZ and Seoul .


fn_spacy_tokens_for_baseline: Unless the heart starts beating again within a few minutes the person will die , and in fifty per cent of all fatal heart attacks the victim dies within thirty minutes .

source_bert_toks: unless the heart starts beating again within a few minutes the person will die , and in fifty per cent of all fatal heart attacks the victim dies within thirty minutes .

reference_raw: If the heart doesn't start beating again in a few minutes, the person will die, and in fifty percent of all lethal heart attacks, the victim will die in thirty minutes.

reference_spacy_tokens: If the heart does n't start beating again in a few minutes , the person will die , and in fifty percent of all lethal heart attacks , the victim will die in thirty minutes .


fn_spacy_tokens_for_baseline: Bearing these points in mind , let us now start to consider the question of creativity and madness in more detail .

source_bert_toks: bearing these points in mind , let us now start to consider the question of creativity and madness in more detail .

reference_raw: With these points in mind, let's begin to consider the question of creativity and insanity in greater detail.

reference_spacy_tokens: With these points in mind , let 's begin to consider the question of creativity and insanity in greater detail .


fn_spacy_tokens_for_baseline: After the beating , Neil staggered to the road where he was rescued by a motorist .

source_bert_toks: after the beating , neil staggered to the road where he was rescued by a motor ##ist .

reference_raw: After the beating, Neil stumbled to the road where the motorist had rescued him.

reference_spacy_tokens: After the beating , Neil stumbled to the road where the motorist had rescued him .


fn_spacy_tokens_for_baseline: Other problems of intercontinental telephone systems ' compatibility held the fax system back as well : in the 1970s it was still illegal to transmit fax signals overseas from the US via the public telephone system .

source_bert_toks: other problems of intercontinental telephone systems ' compatibility held the fa ##x system back as well : in the 1970s it was still illegal to transmit fa ##x signals overseas from the us via the public telephone system .

reference_raw: The fax system was also held back by other problems of intercontinental telephony systems: in the 1970s it was still illegal to transmit fax signals from the United States via a public telephone system.

reference_spacy_tokens: The fax system was also held back by other problems of intercontinental telephony systems : in the 1970s it was still illegal to transmit fax signals from the United States via a public telephone system .


fn_spacy_tokens_for_baseline: Many depressed people just withdraw into themselves , they may sleep a lot in the day but have wakeful nights .

source_bert_toks: many depressed people just withdraw into themselves , they may sleep a lot in the day but have wake ##ful nights .

reference_raw: A lot of people with depression just fall back, they can sleep a lot in the day, but they can wake up at night.

reference_spacy_tokens: A lot of people with depression just fall back , they can sleep a lot in the day , but they can wake up at night .


fn_spacy_tokens_for_baseline: I drove to the nearest police station , handed in the knife and told the desk sergeant my story .

source_bert_toks: i drove to the nearest police station , handed in the knife and told the desk sergeant my story .

reference_raw: I drove to the nearest police station, gave up my knife, and told my story to the desk sergeant.

reference_spacy_tokens: I drove to the nearest police station , gave up my knife , and told my story to the desk sergeant .


fn_spacy_tokens_for_baseline: As much as possible of this finishing was assembled by the use of compressed air and screw cramps , the picture frames and corridor doors being examples of this method of working .

source_bert_toks: as much as possible of this finishing was assembled by the use of compressed air and screw cr ##amps , the picture frames and corridor doors being examples of this method of working .

reference_raw: As far as possible, this finish has been built using compressed air and screw spasms, with picture frames and corridor doors as examples of this method of work.

reference_spacy_tokens: As far as possible , this finish has been built using compressed air and screw spasms , with picture frames and corridor doors as examples of this method of work .


fn_spacy_tokens_for_baseline: There are also plans to start production of an upgraded SS - N-23 variant , designated Sineva , and the Air Force reportedly began to receive a new type of strategic cruise missile .

source_bert_toks: there are also plans to start production of an upgraded ss - n - 23 variant , designated sin ##eva , and the air force reportedly began to receive a new type of strategic cruise missile .

reference_raw: There are also plans to launch the upgraded SS-N-23 variant, designated Sineva, and the Air Force has allegedly started receiving a new type of strategic cruise missile.

reference_spacy_tokens: There are also plans to launch the upgraded SS - N-23 variant , designated Sineva , and the Air Force has allegedly started receiving a new type of strategic cruise missile .


fn_spacy_tokens_for_baseline: The tribe had donated more than $ 100 , 000 to the Democratic Party , hoping , according to testimony , that the administration would intervene on its behalf in a dispute over drilling rights on tribal land .

source_bert_toks: the tribe had donated more than $ 100 , 000 to the democratic party , hoping , according to testimony , that the administration would intervene on its behalf in a dispute over drilling rights on tribal land .

reference_raw: The tribe donated over $100,000 to the Democratic Party, hoping, according to testimony, that the government would intervene on its behalf in a dispute over drilling rights on tribal soils.

reference_spacy_tokens: The tribe donated over $ 100,000 to the Democratic Party , hoping , according to testimony , that the government would intervene on its behalf in a dispute over drilling rights on tribal soils .


fn_spacy_tokens_for_baseline: She was nervous that he might change his mind at the last minute , but he did not do so .

source_bert_toks: she was nervous that he might change his mind at the last minute , but he did not do so .

reference_raw: She was anxious that he might change his mind at the last minute, but he didn't.

reference_spacy_tokens: She was anxious that he might change his mind at the last minute , but he did n't .


fn_spacy_tokens_for_baseline: He 's not become rich and successful and , tied to the drudgery of housework , she 's no longer the beauty he married .

source_bert_toks: he ' s not become rich and successful and , tied to the dr ##udge ##ry of house ##work , she ' s no longer the beauty he married .

reference_raw: He had not become rich and successful, and with the burden of domestic work, she was no longer the beauty he had married.

reference_spacy_tokens: He had not become rich and successful , and with the burden of domestic work , she was no longer the beauty he had married .


fn_spacy_tokens_for_baseline: These set limits to the level of contributions with the aim to prevent candidates from becoming obligated to special interest groups .

source_bert_toks: these set limits to the level of contributions with the aim to prevent candidates from becoming ob ##liga ##ted to special interest groups .

reference_raw: They set limits to the level of contributions in order to avoid the obligation of candidates to special interest groups.

reference_spacy_tokens: They set limits to the level of contributions in order to avoid the obligation of candidates to special interest groups .


fn_spacy_tokens_for_baseline: Can you imagine poor old Tony and me conspiring to deflect the course of justice ? .

source_bert_toks: can you imagine poor old tony and me con ##sp ##iring to def ##le ##ct the course of justice ? .

reference_raw: Can you imagine poor old Tony and I plotting to divert justice?

reference_spacy_tokens: Can you imagine poor old Tony and I plotting to divert justice ?


fn_spacy_tokens_for_baseline: On photographic equipment , electronic goods , and watches , you avoid the luxury tax payable in your home country .

source_bert_toks: on photographic equipment , electronic goods , and watches , you avoid the luxury tax pay ##able in your home country .

reference_raw: You avoid the luxury tax due in your home country on photographic equipment, electronic equipment, and watches.

reference_spacy_tokens: You avoid the luxury tax due in your home country on photographic equipment , electronic equipment , and watches .


fn_spacy_tokens_for_baseline: After rooftop scuffles yesterday , they forced a halt to the demolition work .

source_bert_toks: after rooftop sc ##uf ##fles yesterday , they forced a halt to the demolition work .

reference_raw: After a roof fight last night, they forced the demolition work to stop.

reference_spacy_tokens: After a roof fight last night , they forced the demolition work to stop .


fn_spacy_tokens_for_baseline: It is the toughest material you can use for spar pockets , and the heavy sailmakers ' webbing , or seatbelt Dacron makes perfect head or nose reinforcements for the stunters .

source_bert_toks: it is the tough ##est material you can use for spa ##r pockets , and the heavy sail ##makers ' webb ##ing , or seat ##belt da ##cr ##on makes perfect head or nose reinforcements for the stunt ##ers .

reference_raw: It's the hardest material you can use for spare pockets, and heavy sailing nets, or seat belt Dacron makes perfect head or nose reinforcements for stunters.

reference_spacy_tokens: It 's the hardest material you can use for spare pockets , and heavy sailing nets , or seat belt Dacron makes perfect head or nose reinforcements for stunters .


fn_spacy_tokens_for_baseline: He had worked from dawn until dusk without a break .

source_bert_toks: he had worked from dawn until dusk without a break .

reference_raw: He worked from sunrise to dusk without pause.

reference_spacy_tokens: He worked from sunrise to dusk without pause .


fn_spacy_tokens_for_baseline: Table Tennis Douglas aims to fizz past a flat champion .

source_bert_toks: table tennis douglas aims to fi ##zz past a flat champion .

reference_raw: Table Tennis Douglas is trying to get past the flat champion.

reference_spacy_tokens: Table Tennis Douglas is trying to get past the flat champion .


fn_spacy_tokens_for_baseline: If the innovation proved successful in the trial institution it was hoped that it would be adopted permanently .

source_bert_toks: if the innovation proved successful in the trial institution it was hoped that it would be adopted permanently .

reference_raw: If the innovation turned out to be a success in the trial institution, it was hoped that it would be adopted on a permanent basis.

reference_spacy_tokens: If the innovation turned out to be a success in the trial institution , it was hoped that it would be adopted on a permanent basis .


fn_spacy_tokens_for_baseline: Leaves coated with a strain of engineered bacterium from which the offending gene has been eliminated do not suffer from the formation of ice .

source_bert_toks: leaves coated with a strain of engineered bacterium from which the off ##ending gene has been eliminated do not suffer from the formation of ice .

reference_raw: Leaves covered with a strain of engineered bacteria from which the offending gene has been removed do not suffer from the formation of ice.

reference_spacy_tokens: Leaves covered with a strain of engineered bacteria from which the offending gene has been removed do not suffer from the formation of ice .


fn_spacy_tokens_for_baseline: Each year , mining strips 28 billion tonnes of materials from the earth , and creates 2.7 billion tonnes of waste .

source_bert_toks: each year , mining strips 28 billion tonnes of materials from the earth , and creates 2 . 7 billion tonnes of waste .

reference_raw: Every year, mining cuts 28 billion tons of material from the ground and generates 2.7 billion tons of waste.

reference_spacy_tokens: Every year , mining cuts 28 billion tons of material from the ground and generates 2.7 billion tons of waste .


fn_spacy_tokens_for_baseline: That one was squat and immensely wide , with a sleek moist skin and an upper body sprouting ten powerful tentacles , two of which were extra - long and whippy .

source_bert_toks: that one was squat and immensely wide , with a sleek moist skin and an upper body sp ##rou ##ting ten powerful tentacles , two of which were extra - long and whip ##py .

reference_raw: This one was squat and immensely broad, with a smooth wet skin and an upper body sprouting ten strong tentacles, two of which were extra-long and whippy.

reference_spacy_tokens: This one was squat and immensely broad , with a smooth wet skin and an upper body sprouting ten strong tentacles , two of which were extra - long and whippy .


fn_spacy_tokens_for_baseline: Forty members of parliament and 300 other guests attended the feast which included barbecued whale , deep - fried whale chunks , whale bacon , cubes of tongue and tail and strips of raw meat and pink skin .

source_bert_toks: forty members of parliament and 300 other guests attended the feast which included barbecue ##d whale , deep - fried whale chunks , whale bacon , cube ##s of tongue and tail and strips of raw meat and pink skin .

reference_raw: Forty members of Parliament and three hundred other guests attended the banquet, including grilled whales, deep-fried whales, whale bacon, tongue and tail cubes, and strips of raw meat and pink skin.

reference_spacy_tokens: Forty members of Parliament and three hundred other guests attended the banquet , including grilled whales , deep - fried whales , whale bacon , tongue and tail cubes , and strips of raw meat and pink skin .


fn_spacy_tokens_for_baseline: With a grunt Toby agreed to arrange things and hoped that I would do the driving and that Jefferson intended to provide some decent champagne .

source_bert_toks: with a grunt toby agreed to arrange things and hoped that i would do the driving and that jefferson intended to provide some decent champagne .

reference_raw: With a growl, Toby agreed to make arrangements, hoping I'd drive, and Jefferson was going to give me some decent champagne.

reference_spacy_tokens: With a growl , Toby agreed to make arrangements , hoping I 'd drive , and Jefferson was going to give me some decent champagne .


fn_spacy_tokens_for_baseline: Thus , well - designed national cap and trade programs can help use government resources and taxpayer dollars more efficiently at both the state and federal level .

source_bert_toks: thus , well - designed national cap and trade programs can help use government resources and taxpayer dollars more efficiently at both the state and federal level .

reference_raw: Thus, well-designed national caps and trade programmes can help to make more efficient use of government resources and taxpayer dollars at both the state and the federal.

reference_spacy_tokens: Thus , well - designed national caps and trade programmes can help to make more efficient use of government resources and taxpayer dollars at both the state and the federal .


fn_spacy_tokens_for_baseline: Nice little cottage that , but Pook 's Common is really the back of beyond .

source_bert_toks: nice little cottage that , but po ##ok ' s common is really the back of beyond .

reference_raw: It's a nice little house, but Pook's Common is really the back of the world.

reference_spacy_tokens: It 's a nice little house , but Pook 's Common is really the back of the world .


fn_spacy_tokens_for_baseline: ' Your Uncle Terry 's got an odd friend , Gerry , ' she told the baby .

source_bert_toks: ' your uncle terry ' s got an odd friend , gerry , ' she told the baby .

reference_raw: "Your Uncle Terry has a special boyfriend, Gerry," she said to the child.

reference_spacy_tokens: " Your Uncle Terry has a special boyfriend , Gerry , " she said to the child .


fn_spacy_tokens_for_baseline: No longer did he lecture people on the splendours of the Exhibition or on the advance of civilization .

source_bert_toks: no longer did he lecture people on the sp ##len ##dou ##rs of the exhibition or on the advance of civilization .

reference_raw: He no longer taught people about the glory of the exhibition or the progress of civilization.

reference_spacy_tokens: He no longer taught people about the glory of the exhibition or the progress of civilization .


fn_spacy_tokens_for_baseline: He gave a brief nod , and swung himself down the companionway .

source_bert_toks: he gave a brief nod , and swung himself down the companion ##way .

reference_raw: He nodded briefly and started down the companionway.

reference_spacy_tokens: He nodded briefly and started down the companionway .


fn_spacy_tokens_for_baseline: He wrung his hands in pleasure at her pleasure .

source_bert_toks: he wr ##ung his hands in pleasure at her pleasure .

reference_raw: He twisted his hands, pleased with her pleasure.

reference_spacy_tokens: He twisted his hands , pleased with her pleasure .


fn_spacy_tokens_for_baseline: The Irish Ordnance Survey Memoirs are descriptions of the northern half of Ireland , written to accompany the first Ordnance Survey maps between 1830 and 1840 .

source_bert_toks: the irish ordnance survey memoirs are descriptions of the northern half of ireland , written to accompany the first ordnance survey maps between 1830 and 1840 .

reference_raw: The Irish Ordnance Survey Memoirs are descriptions of the north half of Ireland, which are written to accompany the first maps of the Ordnance Survey from 1830 to 1840.

reference_spacy_tokens: The Irish Ordnance Survey Memoirs are descriptions of the north half of Ireland , which are written to accompany the first maps of the Ordnance Survey from 1830 to 1840 .


fn_spacy_tokens_for_baseline: The coalition took over from the Vietnam - backed Hun Sen government which rescued Kampuchea after the demise of Pol Pot and the Khmer Rouge in 1979 .

source_bert_toks: the coalition took over from the vietnam - backed hu ##n sen government which rescued kam ##pu ##che ##a after the demise of pol pot and the khmer rouge in 1979 .

reference_raw: After the death of Pol Pot and the Khmer Rouge in 1979, the coalition took over from the Vietnam-backed Hun Sen government that saved Kampuchea.

reference_spacy_tokens: After the death of Pol Pot and the Khmer Rouge in 1979 , the coalition took over from the Vietnam - backed Hun Sen government that saved Kampuchea .


fn_spacy_tokens_for_baseline: British social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

source_bert_toks: british social customs are still evident in the kind of polite service you get in hotels and in the long lines of people waiting for buses at rush hour .

reference_raw: British social habits are still evident in the sort of polite service you get in hotels and in the line of people waiting for buses at the rush hour.

reference_spacy_tokens: British social habits are still evident in the sort of polite service you get in hotels and in the line of people waiting for buses at the rush hour .


fn_spacy_tokens_for_baseline: Punks with their dogs piss in the waiting - room and ask for money .

source_bert_toks: punk ##s with their dogs piss in the waiting - room and ask for money .

reference_raw: Punks with dogs pee in the waiting room and ask for money.

reference_spacy_tokens: Punks with dogs pee in the waiting room and ask for money .


fn_spacy_tokens_for_baseline: He listened soberly and with growing dismay to what the young bank officer from Jeddah had to say , and scanned the computer printouts across his desk with a practised eye .

source_bert_toks: he listened sober ##ly and with growing dismay to what the young bank officer from jed ##dah had to say , and scanned the computer print ##outs across his desk with a practised eye .

reference_raw: He listened soberly and with growing horror to what the young Jeddah bank officer had to say, and studied the computer printouts on his desk with a trained eye.

reference_spacy_tokens: He listened soberly and with growing horror to what the young Jeddah bank officer had to say , and studied the computer printouts on his desk with a trained eye .


fn_spacy_tokens_for_baseline: They ' hot - wired ' a prison van and repeatedly rammed it into a security gate .

source_bert_toks: they ' hot - wired ' a prison van and repeatedly rammed it into a security gate .

reference_raw: They "hot-wire" the prison van and repeatedly slammed it into the security gate.

reference_spacy_tokens: They " hot - wire " the prison van and repeatedly slammed it into the security gate .


fn_spacy_tokens_for_baseline: He pressed twice and heard the buzzer sounding deep inside the house , then he dived back into the hallway and past his own door .

source_bert_toks: he pressed twice and heard the buzz ##er sounding deep inside the house , then he dive ##d back into the hallway and past his own door .

reference_raw: He pushed twice and heard the buzzer sound deep in the house, then dived back into the corridor and past his own door.

reference_spacy_tokens: He pushed twice and heard the buzzer sound deep in the house , then dived back into the corridor and past his own door .


fn_spacy_tokens_for_baseline: Photographs and diagrams have to be obtained or taken , labelled , sorted , chosen and captioned .

source_bert_toks: photographs and diagrams have to be obtained or taken , labelled , sorted , chosen and capt ##ioned .

reference_raw: Photographs and diagrams must be obtained or taken, marked, classified, selected and labeled.

reference_spacy_tokens: Photographs and diagrams must be obtained or taken , marked , classified , selected and labeled .


fn_spacy_tokens_for_baseline: By contrast , forecasts TRC , a British consultant , East European spending on equipment ( including Russia 's ) could double to $ 30 billion by 2000 , not far behind that of America 's .

source_bert_toks: by contrast , forecast ##s tr ##c , a british consultant , east european spending on equipment ( including russia ' s ) could double to $ 30 billion by 2000 , not far behind that of america ' s .

reference_raw: On the other hand, forecasts that by 2000 TRC, a British consultant, East Europe's equipment expenditure (including Russia's) would be twice as high as $30 billion, not far from that of the United States.

reference_spacy_tokens: On the other hand , forecasts that by 2000 TRC , a British consultant , East Europe 's equipment expenditure ( including Russia 's ) would be twice as high as $ 30 billion , not far from that of the United States .


fn_spacy_tokens_for_baseline: But at least the food is there in a crisis -- and is also there ready and waiting in the event that a government comes to power which is serious about getting food through to the poorest .

source_bert_toks: but at least the food is there in a crisis - - and is also there ready and waiting in the event that a government comes to power which is serious about getting food through to the poor ##est .

reference_raw: But there's food in crisis - and it's ready and waiting for a government to come to power that's serious about getting food to the poorest.

reference_spacy_tokens: But there 's food in crisis - and it 's ready and waiting for a government to come to power that 's serious about getting food to the poorest .


fn_spacy_tokens_for_baseline: I refer to John Wainwright 's column ( Echo January 11 ) regarding the falsity of the so - called trauma of the Gulf war participants .

source_bert_toks: i refer to john wainwright ' s column ( echo january 11 ) regarding the fa ##ls ##ity of the so - called trauma of the gulf war participants .

reference_raw: I'm referring to the John Wainwright column (Echo January 11th) on the falsity of the so-called trauma of the Gulf War Members.

reference_spacy_tokens: I 'm referring to the John Wainwright column ( Echo January 11th ) on the falsity of the so - called trauma of the Gulf War Members .


fn_spacy_tokens_for_baseline: Macau 's oldest museum , the Maritime Museum ( Wednesday - Monday 10 am - 5:30 pm ; admission HK$10 , HK$5 children over 10 ) traces the history of Macau 's connection to the sea .

source_bert_toks: macau ' s oldest museum , the maritime museum ( wednesday - monday 10 am - 5 : 30 pm ; admission hk $ 10 , hk $ 5 children over 10 ) traces the history of macau ' s connection to the sea .

reference_raw: Macao's oldest museum, the Maritime Museum (Wednesday - Monday 10 - 5:30 p.m.; HK$10, HK$5 children above 10) tracks the history of Macau's sea connection.

reference_spacy_tokens: Macao 's oldest museum , the Maritime Museum ( Wednesday - Monday 10 - 5:30 p.m. ; HK$10 , HK$5 children above 10 ) tracks the history of Macau 's sea connection .


fn_spacy_tokens_for_baseline: One expert , whose job is so politically sensitive that he spoke on condition that he would n't be named or quoted , said the expected influx of East European refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

source_bert_toks: one expert , whose job is so politically sensitive that he spoke on condition that he wouldn ' t be named or quoted , said the expected influx of east european refugees over the next few years will greatly increase the chances of computer - maintenance workers , for example , doubling as foreign spies .

reference_raw: One expert, whose work is so politically sensitive that he talks on the condition that he is not named or quoted, said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer-protection workers, for example, doubling as foreign spies.

reference_spacy_tokens: One expert , whose work is so politically sensitive that he talks on the condition that he is not named or quoted , said that the expected influx of Eastern European refugees over the next few years would greatly increase the chances of computer - protection workers , for example , doubling as foreign spies .


fn_spacy_tokens_for_baseline: Very tasty as salad , lemon dressing .

source_bert_toks: very ta ##sty as salad , lemon dressing .

reference_raw: It's very tasteful like a salad, a lemon bandage.

reference_spacy_tokens: It 's very tasteful like a salad , a lemon bandage .


fn_spacy_tokens_for_baseline: Confidence was increasing that men , through foresight and effective action , could ameliorate their existence and even prolong their lives .

source_bert_toks: confidence was increasing that men , through fore ##sight and effective action , could am ##eli ##ora ##te their existence and even pro ##long their lives .

reference_raw: Confidence grew that men, through foresight and effective action, could amplify their existence and even extend their lives.

reference_spacy_tokens: Confidence grew that men , through foresight and effective action , could amplify their existence and even extend their lives .


fn_spacy_tokens_for_baseline: She was wearing a navy blue duffel coat with a tartan - lined hood , black stockings and pointed shoes with very high heels .

source_bert_toks: she was wearing a navy blue duff ##el coat with a tar ##tan - lined hood , black stockings and pointed shoes with very high heels .

reference_raw: She wore a navy blue duffel coat with a tartan hood, black stockings, and high-heeled pointed boots.

reference_spacy_tokens: She wore a navy blue duffel coat with a tartan hood , black stockings , and high - heeled pointed boots .


fn_spacy_tokens_for_baseline: The University 's Fung Ping Shan Museum , 94 Bonham Road ( open Monday - Saturday 9:30 am - 6 pm , admission free ) holds a significant collection of antiquities : bronzes , dating from 3000 b.c . , and ceramics , including Han Dynasty tomb pottery .

source_bert_toks: the university ' s fun ##g ping shan museum , 94 bon ##ham road ( open monday - saturday 9 : 30 am - 6 pm , admission free ) holds a significant collection of antiquities : bronze ##s , dating from 3000 b . c . , and ceramics , including han dynasty tomb pottery .

reference_raw: The Museum of Fung Ping Shan, 94 Bonham Road (open Monday - 9:30 on Saturday - 6:00 a.m., free of charge), has an important collection of antiques: bronzes dating back to 3000 B.C., and ceramics, including Han Dynasty Tomb Pottery.

reference_spacy_tokens: The Museum of Fung Ping Shan , 94 Bonham Road ( open Monday - 9:30 on Saturday - 6:00 a.m. , free of charge ) , has an important collection of antiques : bronzes dating back to 3000 B.C. , and ceramics , including Han Dynasty Tomb Pottery .


fn_spacy_tokens_for_baseline: Desserts can be substituted by a portion of fresh fruit , or fresh fruit salad , but if possible in Stage II try to prepare the suggested desserts from the recipes provided .

source_bert_toks: dessert ##s can be substituted by a portion of fresh fruit , or fresh fruit salad , but if possible in stage ii try to prepare the suggested dessert ##s from the recipes provided .

reference_raw: Desserts may be replaced by a portion of fresh fruit or fresh fruit salad, but, if possible, in stage II, try to prepare the proposed desserts on the basis of the recipes provided.

reference_spacy_tokens: Desserts may be replaced by a portion of fresh fruit or fresh fruit salad , but , if possible , in stage II , try to prepare the proposed desserts on the basis of the recipes provided .


fn_spacy_tokens_for_baseline: In the hall she wraps a long scarf round her neck and puts on a cream - coloured quilted cotton jacket , with wide shoulders and inset sleeves , and lets herself out by the front door .

source_bert_toks: in the hall she wraps a long scarf round her neck and puts on a cream - coloured quilt ##ed cotton jacket , with wide shoulders and ins ##et sleeves , and lets herself out by the front door .

reference_raw: He wraps a long scarf around his neck in the hall, wears a cream-colored cotton jacket with broad shoulders and sleeves, and walks out the front door.

reference_spacy_tokens: He wraps a long scarf around his neck in the hall , wears a cream - colored cotton jacket with broad shoulders and sleeves , and walks out the front door .


fn_spacy_tokens_for_baseline: For a moment longer he sat frozen , then just as Jezrael cannoned into him he knocked the scalding can away .

source_bert_toks: for a moment longer he sat frozen , then just as je ##z ##rae ##l cannon ##ed into him he knocked the sc ##aldi ##ng can away .

reference_raw: He remained frozen for a moment, then, just as Jezrael had shot into him, he knocked the scalding can from his feet.

reference_spacy_tokens: He remained frozen for a moment , then , just as Jezrael had shot into him , he knocked the scalding can from his feet .


fn_spacy_tokens_for_baseline: Modigliani felt the pain of these visits more than any of them , and was horrified to see his old friend in dingy and sinister surroundings , humiliated and frightened .

source_bert_toks: mod ##ig ##lian ##i felt the pain of these visits more than any of them , and was horrified to see his old friend in ding ##y and sinister surroundings , humiliated and frightened .

reference_raw: Modigliani felt the pain of these visits more than any of them, and was appalled to see his old friend in a dingy and sinister environment, degraded and frightened.

reference_spacy_tokens: Modigliani felt the pain of these visits more than any of them , and was appalled to see his old friend in a dingy and sinister environment , degraded and frightened .


fn_spacy_tokens_for_baseline: The touches of silver at his temples added to the impression of experience and trustworthiness .

source_bert_toks: the touches of silver at his temples added to the impression of experience and trust ##worth ##iness .

reference_raw: The touches of silver in his churches gave him a sense of experience and credibility.

reference_spacy_tokens: The touches of silver in his churches gave him a sense of experience and credibility .


fn_spacy_tokens_for_baseline: Arabel was once quoted as being terrified by a performance of Tchaikovsky 's Pathetique Symphony in Berlin so intense that she thought it would kill you .

source_bert_toks: arab ##el was once quoted as being terrified by a performance of tchaikovsky ' s path ##eti ##que symphony in berlin so intense that she thought it would kill you .

reference_raw: Arabel was once quoted as being appalled by the performance of Tchaikovsky's Pathetique Symphony in Berlin, so intense that she thought it would kill you.

reference_spacy_tokens: Arabel was once quoted as being appalled by the performance of Tchaikovsky 's Pathetique Symphony in Berlin , so intense that she thought it would kill you .


fn_spacy_tokens_for_baseline: She now turned her smile on Millie , but she received no answering smile , only a stare from what she thought were those very odd grey eyes .

source_bert_toks: she now turned her smile on millie , but she received no answering smile , only a stare from what she thought were those very odd grey eyes .

reference_raw: Now she turned her smile to Millie, but she didn't get a replying smile, just a look from what she thought were those very strange gray eyes.

reference_spacy_tokens: Now she turned her smile to Millie , but she did n't get a replying smile , just a look from what she thought were those very strange gray eyes .


fn_spacy_tokens_for_baseline: She made some coffee , and went out on the balcony in her cotton housecoat , where she could see the sun rising from behind the dark hills , and the slopes slowly become bathed with light .

source_bert_toks: she made some coffee , and went out on the balcony in her cotton house ##coat , where she could see the sun rising from behind the dark hills , and the slopes slowly become bathed with light .

reference_raw: She made herself a cup of coffee and went out to the balcony in her cotton coat, where she could see the sun coming up from behind the dark hills, and the slopes were slowly bathed in light.

reference_spacy_tokens: She made herself a cup of coffee and went out to the balcony in her cotton coat , where she could see the sun coming up from behind the dark hills , and the slopes were slowly bathed in light .


fn_spacy_tokens_for_baseline: He was a critic of last year 's infantry cuts .

source_bert_toks: he was a critic of last year ' s infantry cuts .

reference_raw: He was critical of last year's infantry cuts.

reference_spacy_tokens: He was critical of last year 's infantry cuts .


fn_spacy_tokens_for_baseline: Gnasher ( my hamster ) used to like to roam freely throughout the living room but unfortunately this involved him crapping all over the carpet .

source_bert_toks: g ##nas ##her ( my ham ##ster ) used to like to roam freely throughout the living room but unfortunately this involved him crap ##ping all over the carpet .

reference_raw: Gnasher (my hamster) liked to wander freely around the living room, but that, unfortunately, made him shit all over the carpet.

reference_spacy_tokens: Gnasher ( my hamster ) liked to wander freely around the living room , but that , unfortunately , made him shit all over the carpet .


fn_spacy_tokens_for_baseline: ' I might have expected such an answer from you , McAllister ; it fits in with the general picture , ' said Dr Neil angrily , picking up his cane .

source_bert_toks: ' i might have expected such an answer from you , mca ##llis ##ter ; it fits in with the general picture , ' said dr neil angrily , picking up his cane .

reference_raw: 'I could have expected that response from you, McAllister; it fits with the general picture,' said Dr. Neil angrily, raising his staff.

reference_spacy_tokens: ' I could have expected that response from you , McAllister ; it fits with the general picture , ' said Dr. Neil angrily , raising his staff .


fn_spacy_tokens_for_baseline: " It is very dangerous , and someplace down the road , there 's going to be a tragedy , " he said .

source_bert_toks: " it is very dangerous , and someplace down the road , there ' s going to be a tragedy , " he said .

reference_raw: "It's very dangerous, and there'll be tragedy somewhere along the way," he said.

reference_spacy_tokens: " It 's very dangerous , and there 'll be tragedy somewhere along the way , " he said .


fn_spacy_tokens_for_baseline: ' What about that time in Morecambe when you ate shrimps ?

source_bert_toks: ' what about that time in more ##cam ##be when you ate shrimp ##s ?

reference_raw: 'What about the time you ate prawns in Morecambe?

reference_spacy_tokens: ' What about the time you ate prawns in Morecambe ?


fn_spacy_tokens_for_baseline: ' Father did n't forbid me to leave the Grange garden !

source_bert_toks: ' father didn ' t forbid me to leave the grange garden !

reference_raw: My father wouldn't let me leave the Grange Garden!

reference_spacy_tokens: My father would n't let me leave the Grange Garden !


fn_spacy_tokens_for_baseline: She led him through to the dining - room and found him a glass of whisky and a plate which she proceeded to heap with food .

source_bert_toks: she led him through to the dining - room and found him a glass of whisky and a plate which she proceeded to heap with food .

reference_raw: She led him into the dining room and found him a glass of whiskey and a plate, which she continued to pile with food.

reference_spacy_tokens: She led him into the dining room and found him a glass of whiskey and a plate , which she continued to pile with food .


fn_spacy_tokens_for_baseline: We waited behind a closed door which opened at the hand of a rugged dark - haired , dark - bearded man in an open white coat who said : ' Hi , I 'm Ron Levy . '

source_bert_toks: we waited behind a closed door which opened at the hand of a rugged dark - haired , dark - bearded man in an open white coat who said : ' hi , i ' m ron levy . '

reference_raw: We were waiting behind a closed door that opened at the hand of a rugged, dark-bearded man in an open white jacket who said, "Hello, I'm Ron Levy."

reference_spacy_tokens: We were waiting behind a closed door that opened at the hand of a rugged , dark - bearded man in an open white jacket who said , " Hello , I 'm Ron Levy . "


fn_spacy_tokens_for_baseline: Mortimer left in a hurry , caught his plane , and was standing bewigged at the Old Bailey the next day .

source_bert_toks: mortimer left in a hurry , caught his plane , and was standing be ##wig ##ged at the old bailey the next day .

reference_raw: Mortimer left in a hurry, caught the airplane, and the next day he stood bewildered in the Old Bailey.

reference_spacy_tokens: Mortimer left in a hurry , caught the airplane , and the next day he stood bewildered in the Old Bailey .


fn_spacy_tokens_for_baseline: The child had worn a purple suit with a lace collar .

source_bert_toks: the child had worn a purple suit with a lace collar .

reference_raw: The child was wearing a violet suit with a lace clasp.

reference_spacy_tokens: The child was wearing a violet suit with a lace clasp .


fn_spacy_tokens_for_baseline: David will demonstrate varied techniques and approaches , show you some of his oil paintings and tutor on this theme throughout the day .

source_bert_toks: david will demonstrate varied techniques and approaches , show you some of his oil paintings and tutor on this theme throughout the day .

reference_raw: David will show you various techniques and approaches, show you some of his oil paintings, and teach you about it all day long.

reference_spacy_tokens: David will show you various techniques and approaches , show you some of his oil paintings , and teach you about it all day long .


fn_spacy_tokens_for_baseline: He smelt smoke in her hair , felt her flesh soft under her shawl , and then a further quake in the crowd parted them .

source_bert_toks: he sm ##elt smoke in her hair , felt her flesh soft under her shaw ##l , and then a further quake in the crowd parted them .

reference_raw: He could smell the smoke in her hair, feel her body soft beneath her scarf, and then another tremor in the crowd separated them.

reference_spacy_tokens: He could smell the smoke in her hair , feel her body soft beneath her scarf , and then another tremor in the crowd separated them .


fn_spacy_tokens_for_baseline: Sabine unfastened the chain round her neck , and put the medallion gently into the Baronne 's hand .

source_bert_toks: sabine un ##fast ##ened the chain round her neck , and put the medallion gently into the baron ##ne ' s hand .

reference_raw: Sabine unbuttoned the chain around her neck and gently placed the locket in the Baron's hand.

reference_spacy_tokens: Sabine unbuttoned the chain around her neck and gently placed the locket in the Baron 's hand .


fn_spacy_tokens_for_baseline: Security sources have disclosed that the belief amongst most intelligence agencies is that a chemical , biological , radiological or nuclear ( CBRN ) attack , using a so - called dirty bomb , is now inevitable .

source_bert_toks: security sources have disclosed that the belief amongst most intelligence agencies is that a chemical , biological , radio ##logical or nuclear ( cb ##rn ) attack , using a so - called dirty bomb , is now inevitable .

reference_raw: Security resources have revealed that most intelligence agencies believe that a chemical, biological, radiological or nuclear (CBRN) attack using a so-called dirty bomb is now inevitable.

reference_spacy_tokens: Security resources have revealed that most intelligence agencies believe that a chemical , biological , radiological or nuclear ( CBRN ) attack using a so - called dirty bomb is now inevitable .


fn_spacy_tokens_for_baseline: ' They were more nomadic before the whites colonised the country , and their tribal huts would be more temporary structures than council housing .

source_bert_toks: ' they were more nomadic before the whites colon ##ised the country , and their tribal huts would be more temporary structures than council housing .

reference_raw: Before the whites colonized the country, they were more nomadic, and their tribal huts would be more temporary than council quarters.

reference_spacy_tokens: Before the whites colonized the country , they were more nomadic , and their tribal huts would be more temporary than council quarters .


fn_spacy_tokens_for_baseline: The horror of the Strathnaver clearances was eventually exposed by Donald Macleod , who as a young boy had been evicted by Seller from the village of Rossal .

source_bert_toks: the horror of the st ##rath ##na ##ver clearance ##s was eventually exposed by donald macleod , who as a young boy had been evicted by seller from the village of ross ##al .

reference_raw: The horror of Strathnaver's clearance was finally revealed to Donald Macleod, who, as a young boy, had been expelled from Rossal Village by Seller.

reference_spacy_tokens: The horror of Strathnaver 's clearance was finally revealed to Donald Macleod , who , as a young boy , had been expelled from Rossal Village by Seller .


fn_spacy_tokens_for_baseline: About 30 countries are offering support , according to an EU statement .

source_bert_toks: about 30 countries are offering support , according to an eu statement .

reference_raw: According to the EU Declaration, some 30 countries offer support.

reference_spacy_tokens: According to the EU Declaration , some 30 countries offer support .


fn_spacy_tokens_for_baseline: the baby contemplates her navel ,

source_bert_toks: the baby con ##tem ##plate ##s her nave ##l ,

reference_raw: the child is thinking about her belly button,

reference_spacy_tokens: the child is thinking about her belly button ,


fn_spacy_tokens_for_baseline: Frau Hoflin fought an overwhelming desire to slap her daughter .

source_bert_toks: fra ##u ho ##fl ##in fought an overwhelming desire to slap her daughter .

reference_raw: Frau Hoflin fought an overwhelming urge to hit her daughter.

reference_spacy_tokens: Frau Hoflin fought an overwhelming urge to hit her daughter .


fn_spacy_tokens_for_baseline: Most ignored his letter but Nehru ' denounced the idea as derogatory to the sovereignty of the new state and reproached Dr Nkrumah for ever issuing the invitation ' .

source_bert_toks: most ignored his letter but nehru ' denounced the idea as der ##oga ##tory to the sovereignty of the new state and rep ##ro ##ache ##d dr nk ##rum ##ah for ever issuing the invitation ' .

reference_raw: Most of them ignored his letter, but Nehru 'denounced the idea as a derogatory to the sovereignty of the new state, accusing Dr. Nkrumah of ever issuing an invitation'.

reference_spacy_tokens: Most of them ignored his letter , but Nehru ' denounced the idea as a derogatory to the sovereignty of the new state , accusing Dr. Nkrumah of ever issuing an invitation ' .


fn_spacy_tokens_for_baseline: Whatever the fortunes of the major political parties , it is likely that managers will be coping with rapid change .

source_bert_toks: whatever the fortunes of the major political parties , it is likely that managers will be coping with rapid change .

reference_raw: Irrespective of the wealth of the major political parties, managers are unlikely to be able to cope with rapid change.

reference_spacy_tokens: Irrespective of the wealth of the major political parties , managers are unlikely to be able to cope with rapid change .


fn_spacy_tokens_for_baseline: They 're just yearning to be home . '

source_bert_toks: they ' re just yearning to be home . '

reference_raw: They just want to be home.'

reference_spacy_tokens: They just want to be home . '


fn_spacy_tokens_for_baseline: The marriage also ended with a Te Deum as the Archbishop of Paris conducted the newly - weds to the west door , whence they emerged to a great pealing of bells , salvoes of artillery and fanfares of trumpets .

source_bert_toks: the marriage also ended with a te de ##um as the archbishop of paris conducted the newly - wed ##s to the west door , when ##ce they emerged to a great pea ##ling of bells , sal ##vo ##es of artillery and fan ##fare ##s of trumpets .

reference_raw: The marriage ended with the Te Deum as the Archbishop of Paris carried the newlyweds to the western door, where they came to a great peal of bells, volleys of artillery, and fanfares of trumpets.

reference_spacy_tokens: The marriage ended with the Te Deum as the Archbishop of Paris carried the newlyweds to the western door , where they came to a great peal of bells , volleys of artillery , and fanfares of trumpets .


fn_spacy_tokens_for_baseline: Here 's one that sells just belt buckles , here 's another exclusively devoted to pointed boots , or country and westernalia , or whatever .

source_bert_toks: here ' s one that sells just belt buckle ##s , here ' s another exclusively devoted to pointed boots , or country and western ##alia , or whatever .

reference_raw: Here's one that only sells belt straps, here's another that's exclusively dedicated to pointed shoes, or country and Westalia, or something like that.

reference_spacy_tokens: Here 's one that only sells belt straps , here 's another that 's exclusively dedicated to pointed shoes , or country and Westalia , or something like that .


fn_spacy_tokens_for_baseline: Much of the land is extremely fertile and produces a range of tropical fruit and vegetable crops , providing ample food for the people and such lucrative cash crops as sugar and coffee .

source_bert_toks: much of the land is extremely fertile and produces a range of tropical fruit and vegetable crops , providing ample food for the people and such lucrative cash crops as sugar and coffee .

reference_raw: Much of the land is extremely fertile and produces a variety of tropical fruit and vegetable crops, which provide people with plenty of food and cash crops such as sugar and coffee.

reference_spacy_tokens: Much of the land is extremely fertile and produces a variety of tropical fruit and vegetable crops , which provide people with plenty of food and cash crops such as sugar and coffee .


fn_spacy_tokens_for_baseline: ' Even now you still believe your body to be so irresistible that I must be hungering for it ? '

source_bert_toks: ' even now you still believe your body to be so irresistible that i must be hunger ##ing for it ? '

reference_raw: "Do you still believe that your body is so irresistible that I must be hungry for it?"

reference_spacy_tokens: " Do you still believe that your body is so irresistible that I must be hungry for it ? "


fn_spacy_tokens_for_baseline: This is particularly important if the target was part of a group because some assets may not be owned by the company which uses them .

source_bert_toks: this is particularly important if the target was part of a group because some assets may not be owned by the company which uses them .

reference_raw: This is particularly important where the target belongs to a group, since some assets may not be owned by the company using them.

reference_spacy_tokens: This is particularly important where the target belongs to a group , since some assets may not be owned by the company using them .


fn_spacy_tokens_for_baseline: The two men continued to stroll leisurely around the perimeter fence which separated the living quarters and parade grounds of the air - base from the restricted areas of the hangars and control tower .

source_bert_toks: the two men continued to stroll leisure ##ly around the perimeter fence which separated the living quarters and parade grounds of the air - base from the restricted areas of the hangar ##s and control tower .

reference_raw: The two men continued their leisurely walks around the perimeter fence that separated the living quarters and parade grounds of the air base from the restricted areas of the hangars and control towers.

reference_spacy_tokens: The two men continued their leisurely walks around the perimeter fence that separated the living quarters and parade grounds of the air base from the restricted areas of the hangars and control towers .


fn_spacy_tokens_for_baseline: At his back , the glow from an outside lamp found its way through curtained windows to touch the glazed bathroom door with an eerie greyness .

source_bert_toks: at his back , the glow from an outside lamp found its way through curtain ##ed windows to touch the glazed bathroom door with an eerie grey ##ness .

reference_raw: Behind him, the light of the outside lamp found its way through the curtained windows and touched the glassed bathroom door with a strange grayness.

reference_spacy_tokens: Behind him , the light of the outside lamp found its way through the curtained windows and touched the glassed bathroom door with a strange grayness .


fn_spacy_tokens_for_baseline: Such solidarity can be quite ruthless : it is a much stronger force for people than any appeal to overriding common interests of on enterprise , a community , a nation .

source_bert_toks: such solidarity can be quite ruthless : it is a much stronger force for people than any appeal to over ##riding common interests of on enterprise , a community , a nation .

reference_raw: Such solidarity can be quite merciless: it is a much stronger force for the people than any desire to override the common interests of the enterprise, the community, the nation.

reference_spacy_tokens: Such solidarity can be quite merciless : it is a much stronger force for the people than any desire to override the common interests of the enterprise , the community , the nation .


fn_spacy_tokens_for_baseline: I give you my word that I wo n't attempt to get away if you let me know when the police are called in . '

source_bert_toks: i give you my word that i won ' t attempt to get away if you let me know when the police are called in . '

reference_raw: I give you my word that I will not try to escape if you let me know when you call the police.'

reference_spacy_tokens: I give you my word that I will not try to escape if you let me know when you call the police . '


fn_spacy_tokens_for_baseline: To help students learn this system , Project English adopts the cognitive approach .

source_bert_toks: to help students learn this system , project english adopt ##s the cognitive approach .

reference_raw: Project English takes a cognitive approach to help students learn this system.

reference_spacy_tokens: Project English takes a cognitive approach to help students learn this system .


fn_spacy_tokens_for_baseline: This is reflected in the growth in the number of households and the decrease in household size .

source_bert_toks: this is reflected in the growth in the number of households and the decrease in household size .

reference_raw: This reflects an increase in the number of households and a decline in the size of households.

reference_spacy_tokens: This reflects an increase in the number of households and a decline in the size of households .


fn_spacy_tokens_for_baseline: The local financial system has been drained of liquidity , interest rates have gone up and the stockmarket has been falling .

source_bert_toks: the local financial system has been drained of liquid ##ity , interest rates have gone up and the stock ##market has been falling .

reference_raw: The local financial system has run out of liquidity, interest rates have risen, and the stock market is falling.

reference_spacy_tokens: The local financial system has run out of liquidity , interest rates have risen , and the stock market is falling .


fn_spacy_tokens_for_baseline: Will got up and , as fast as his old body would allow , stormed out into the garden , leaving his children , mouths agape , behind him .

source_bert_toks: will got up and , as fast as his old body would allow , stormed out into the garden , leaving his children , mouths ag ##ape , behind him .

reference_raw: Will rose and, as quickly as his old body would permit, rushed out into the garden, leaving his children, mouth open, behind him.

reference_spacy_tokens: Will rose and , as quickly as his old body would permit , rushed out into the garden , leaving his children , mouth open , behind him .


fn_spacy_tokens_for_baseline: Ozone is both made and destroyed by photochemical reactions in the troposphere , the balance depending on the availability of nitrogen oxides and other gases , particularly hydrocarbons and carbon monoxide .

source_bert_toks: ozone is both made and destroyed by photo ##chemical reactions in the tr ##op ##osphere , the balance depending on the availability of nitrogen oxide ##s and other gases , particularly hydro ##carbon ##s and carbon mono ##xide .

reference_raw: Ozone is produced and eliminated by photochemical reactions in the troposphere, the balance of which depends on the availability of nitrogen oxides and other gases, in particular hydrocarbons and carbon monoxide.

reference_spacy_tokens: Ozone is produced and eliminated by photochemical reactions in the troposphere , the balance of which depends on the availability of nitrogen oxides and other gases , in particular hydrocarbons and carbon monoxide .


fn_spacy_tokens_for_baseline: Nevertheless , the mountain goat maintains a tenuous but firm hold in its cruel environment , even though catastrophe is never far away .

source_bert_toks: nevertheless , the mountain goat maintains a ten ##uous but firm hold in its cruel environment , even though catastrophe is never far away .

reference_raw: However, the mountain goat retains a strong but firm grip in its cruel surroundings, even if disaster is not far away.

reference_spacy_tokens: However , the mountain goat retains a strong but firm grip in its cruel surroundings , even if disaster is not far away .


fn_spacy_tokens_for_baseline: Venables broke both legs in a 90 m fall while descending the mountain after the first ascent .

source_bert_toks: ve ##nable ##s broke both legs in a 90 ##m fall while descending the mountain after the first ascent .

reference_raw: The venables broke both legs in a 90-meter fall as they went down the mountain after the first climb.

reference_spacy_tokens: The venables broke both legs in a 90-meter fall as they went down the mountain after the first climb .


fn_spacy_tokens_for_baseline: On 23 June 1996 , the Sunday Telegraph reported about a " secret multi - million - pound deal with the Indian government which will supply banned materials used to manufacture poison gas . "

source_bert_toks: on 23 june 1996 , the sunday telegraph reported about a " secret multi - million - pound deal with the indian government which will supply banned materials used to manufacture poison gas . "

reference_raw: On 23 June 1996, the Sunday Telegraph announced a "secret multi-million-pound deal with the GOI to supply prohibited materials used for the production of poison gas."

reference_spacy_tokens: On 23 June 1996 , the Sunday Telegraph announced a " secret multi - million - pound deal with the GOI to supply prohibited materials used for the production of poison gas . "


fn_spacy_tokens_for_baseline: Early in the film , with the Flowers crisis in full bloom , Sam Donaldson interviews Stephanopoulos , who blames it all on the " Republican attack machine . "

source_bert_toks: early in the film , with the flowers crisis in full bloom , sam donaldson interviews stephan ##op ##oulos , who blame ##s it all on the " republican attack machine . "

reference_raw: At the beginning of the movie, when the Flowers crisis was in full bloom, Sam Donaldson interviewed Stephanopoulos, who blamed everything on the Republican Assailant Engine.

reference_spacy_tokens: At the beginning of the movie , when the Flowers crisis was in full bloom , Sam Donaldson interviewed Stephanopoulos , who blamed everything on the Republican Assailant Engine .


fn_spacy_tokens_for_baseline: She had reached the edge of the park and looked down the slopes to the fair in the dell on the far side .

source_bert_toks: she had reached the edge of the park and looked down the slopes to the fair in the dell on the far side .

reference_raw: She reached the edge of the park and looked down the slopes at the fair on the other side of the valley.

reference_spacy_tokens: She reached the edge of the park and looked down the slopes at the fair on the other side of the valley .


fn_spacy_tokens_for_baseline: SHe decided to be blunt .

source_bert_toks: she decided to be blunt .

reference_raw: He decided to be rude.

reference_spacy_tokens: He decided to be rude .


fn_spacy_tokens_for_baseline: ' The wounded men were taken off and other fellows saw what happened to the men who were killed .

source_bert_toks: ' the wounded men were taken off and other fellows saw what happened to the men who were killed .

reference_raw: The wounded had been removed, and the others had seen what had happened to the dead men.

reference_spacy_tokens: The wounded had been removed , and the others had seen what had happened to the dead men .


fn_spacy_tokens_for_baseline: What you love are all those glitzy London shops where you can indulge your weakness for expensive baubles . '

source_bert_toks: what you love are all those g ##litz ##y london shops where you can ind ##ul ##ge your weakness for expensive ba ##ub ##les . '

reference_raw: What you love is all those glistening London stores where you can indulge your fondness for expensive baubles.'

reference_spacy_tokens: What you love is all those glistening London stores where you can indulge your fondness for expensive baubles . '


fn_spacy_tokens_for_baseline: The purpose of such an indemnity is to aid the buyer in recovering all relevant damages in the event of litigation against the seller .

source_bert_toks: the purpose of such an ind ##em ##nity is to aid the buyer in recovering all relevant damages in the event of litigation against the seller .

reference_raw: The purpose of such compensation is to assist the purchaser in the recovery of all relevant damages in the case of disputes against the seller.

reference_spacy_tokens: The purpose of such compensation is to assist the purchaser in the recovery of all relevant damages in the case of disputes against the seller .


fn_spacy_tokens_for_baseline: Of course , it is premature to propose Mr Lang to the Pope for canonisation .

source_bert_toks: of course , it is premature to propose mr lang to the pope for canon ##isation .

reference_raw: Of course, it's too early to propose Mr. Lang to the pope for canonization.

reference_spacy_tokens: Of course , it 's too early to propose Mr. Lang to the pope for canonization .


fn_spacy_tokens_for_baseline: Unless one posits an inherent human tendency to comprehend the world in binary terms , one has to look for more sociological explanations .

source_bert_toks: unless one po ##sit ##s an inherent human tendency to comprehend the world in binary terms , one has to look for more sociological explanations .

reference_raw: If one does not present a natural human tendency to understand the world in binary terms, one must seek more sociological explanations.

reference_spacy_tokens: If one does not present a natural human tendency to understand the world in binary terms , one must seek more sociological explanations .


fn_spacy_tokens_for_baseline: Transfer to buttered baking sheets .

source_bert_toks: transfer to butter ##ed baking sheets .

reference_raw: Convert to boiled baking sheets.

reference_spacy_tokens: Convert to boiled baking sheets .


fn_spacy_tokens_for_baseline: The man , from Harlesden , north London , was found guilty at the Old Bailey of eight specimen charges of rape .

source_bert_toks: the man , from ha ##rle ##sden , north london , was found guilty at the old bailey of eight specimen charges of rape .

reference_raw: The man from Harlesden, North London, was convicted of eight rape cases in the Old Bailey.

reference_spacy_tokens: The man from Harlesden , North London , was convicted of eight rape cases in the Old Bailey .


fn_spacy_tokens_for_baseline: It was tersely worded .

source_bert_toks: it was ter ##sel ##y word ##ed .

reference_raw: It was phrased in a short way.

reference_spacy_tokens: It was phrased in a short way .


fn_spacy_tokens_for_baseline: On the Friday before his parents death , Christopher Gore had taken a train from Bath -- where he was living -- to Chippenham station .

source_bert_toks: on the friday before his parents death , christopher gore had taken a train from bath - - where he was living - - to chip ##pen ##ham station .

reference_raw: On the Friday before his parents died, Christopher Gore took the train from Bath - where he lived - to Chippenham Station.

reference_spacy_tokens: On the Friday before his parents died , Christopher Gore took the train from Bath - where he lived - to Chippenham Station .


fn_spacy_tokens_for_baseline: The government has given permission for the plant to go ahead in the face of sustained opposition from environmentalists , church groups , and the local Lumad tribal people , to whom the mountain is sacred .

source_bert_toks: the government has given permission for the plant to go ahead in the face of sustained opposition from environmental ##ists , church groups , and the local lu ##mad tribal people , to whom the mountain is sacred .

reference_raw: The government has authorised the plant to continue in the face of sustained resistance from environmentalists, church groups, and local tribes of Lumad, to which the mountain is sacred.

reference_spacy_tokens: The government has authorised the plant to continue in the face of sustained resistance from environmentalists , church groups , and local tribes of Lumad , to which the mountain is sacred .


fn_spacy_tokens_for_baseline: Kitson was a prolific inventor whose own difficulties in financing and manufacturing his patents had led him to a radical critique of the banking system .

source_bert_toks: kits ##on was a prolific inventor whose own difficulties in financing and manufacturing his patents had led him to a radical critique of the banking system .

reference_raw: Kitson was a prosperous invention whose difficulties in financing and manufacturing his patents had led him to a radical criticism of the banking system.

reference_spacy_tokens: Kitson was a prosperous invention whose difficulties in financing and manufacturing his patents had led him to a radical criticism of the banking system .


fn_spacy_tokens_for_baseline: ' You can have too much of anything , ' was Gay 's sage rejoinder , ' and I rather think her mother 's been overdoing this entertaining stunt .

source_bert_toks: ' you can have too much of anything , ' was gay ' s sage rejoin ##der , ' and i rather think her mother ' s been over ##do ##ing this entertaining stunt .

reference_raw: 'You can have too much,' said Gay's wise rejoinder, 'and I'd rather think her mother was overdoing the fun trick.

reference_spacy_tokens: ' You can have too much , ' said Gay 's wise rejoinder , ' and I 'd rather think her mother was overdoing the fun trick .


fn_spacy_tokens_for_baseline: There was a momentary hesitation , so that I half expected him to say she was n't there .

source_bert_toks: there was a momentary hesitation , so that i half expected him to say she wasn ' t there .

reference_raw: I hesitated for a moment, half expecting him to say he wasn't there.

reference_spacy_tokens: I hesitated for a moment , half expecting him to say he was n't there .


fn_spacy_tokens_for_baseline: Harry let out a great snort .

source_bert_toks: harry let out a great snort .

reference_raw: Harry sniffed loudly.

reference_spacy_tokens: Harry sniffed loudly .


fn_spacy_tokens_for_baseline: Theirs would be a union of questing souls ; they would voyage together into fairy realms .

source_bert_toks: theirs would be a union of quest ##ing souls ; they would voyage together into fairy realms .

reference_raw: Theirs would be a union of searching souls; they would travel together to the realms of fairy tales.

reference_spacy_tokens: Theirs would be a union of searching souls ; they would travel together to the realms of fairy tales .


fn_spacy_tokens_for_baseline: Both Coats Viyella ( 32 % ) and Bass ( 33 % ) reduced their audit fees by cutting the number of firms used .

source_bert_toks: both coats vi ##ye ##lla ( 32 % ) and bass ( 33 % ) reduced their audit fees by cutting the number of firms used .

reference_raw: Both Coats Viyella (32%) and Bass (33%) decreased their audit fees by lowering the number of companies used.

reference_spacy_tokens: Both Coats Viyella ( 32 % ) and Bass ( 33 % ) decreased their audit fees by lowering the number of companies used .


fn_spacy_tokens_for_baseline: But Duvall smacked it dismissively aside and jabbed two steel - hard fingers at the base of Jimmy 's throat with a cold and precise disdain .

source_bert_toks: but duval ##l smacked it dismiss ##ively aside and ja ##bbed two steel - hard fingers at the base of jimmy ' s throat with a cold and precise disdain .

reference_raw: But Duvall slapped him dismissively aside and stabbed two steel-hard fingers at the base of Jimmy's neck with cold and precise contempt.

reference_spacy_tokens: But Duvall slapped him dismissively aside and stabbed two steel - hard fingers at the base of Jimmy 's neck with cold and precise contempt .


fn_spacy_tokens_for_baseline: Lines of humour fanned out from his mouth , and his teeth gleamed whitely in the darkness .

source_bert_toks: lines of humour fan ##ned out from his mouth , and his teeth gleamed white ##ly in the darkness .

reference_raw: There were lines of humor coming out of his mouth, and his teeth glittered white in the darkness.

reference_spacy_tokens: There were lines of humor coming out of his mouth , and his teeth glittered white in the darkness .


fn_spacy_tokens_for_baseline: Natives put upon the scent found military accoutrements and other articles thrown out of the same chest , so that the drawings were clearly the object of the theft .

source_bert_toks: natives put upon the scent found military acc ##out ##rem ##ents and other articles thrown out of the same chest , so that the drawings were clearly the object of the theft .

reference_raw: The natives had found military aids and other objects thrown from the same chest, so that the drawings were clearly the object of the theft.

reference_spacy_tokens: The natives had found military aids and other objects thrown from the same chest , so that the drawings were clearly the object of the theft .


fn_spacy_tokens_for_baseline: She was very upright , like a wizened doll , decked out in a bright flowery overall with carpet slippers on her feet .

source_bert_toks: she was very upright , like a wi ##zen ##ed doll , deck ##ed out in a bright flower ##y overall with carpet slip ##pers on her feet .

reference_raw: She was very straight, like a wizened doll, decked in a bright, flowery uniform with carpet slippers on her feet.

reference_spacy_tokens: She was very straight , like a wizened doll , decked in a bright , flowery uniform with carpet slippers on her feet .


fn_spacy_tokens_for_baseline: It has been specially developed by Sun Alliance to protect you and your family against the financial consequences of a permanently disabling accident .

source_bert_toks: it has been specially developed by sun alliance to protect you and your family against the financial consequences of a permanently di ##sa ##bling accident .

reference_raw: It was specifically designed by the Sun Alliance to protect you and your folks from the financial consequences of a permanent disability accident.

reference_spacy_tokens: It was specifically designed by the Sun Alliance to protect you and your folks from the financial consequences of a permanent disability accident .


fn_spacy_tokens_for_baseline: Then I brushed my teeth thoroughly with my electric toothbrush .

source_bert_toks: then i brushed my teeth thoroughly with my electric tooth ##brush .

reference_raw: Then I cleaned my teeth thoroughly with my electric toothbrush.

reference_spacy_tokens: Then I cleaned my teeth thoroughly with my electric toothbrush .


fn_spacy_tokens_for_baseline: This area is one of the most important watersheds in England .

source_bert_toks: this area is one of the most important watershed ##s in england .

reference_raw: This area is one of England's most important river basins.

reference_spacy_tokens: This area is one of England 's most important river basins .


fn_spacy_tokens_for_baseline: The marshes around Altdorf made it difficult for the Orcs to group for the assault , and several mobs of Orcs disappeared forever when they strayed into the marshes .

source_bert_toks: the marshes around alt ##dorf made it difficult for the or ##cs to group for the assault , and several mob ##s of or ##cs disappeared forever when they stray ##ed into the marshes .

reference_raw: The swamps around Altdorf made it difficult for the goblins to gather for the attack, and a few crowds of goblins disappeared forever as they wandered into the swamp.

reference_spacy_tokens: The swamps around Altdorf made it difficult for the goblins to gather for the attack , and a few crowds of goblins disappeared forever as they wandered into the swamp .


fn_spacy_tokens_for_baseline: And our hero in his turn , felt despondent and fearful , for his little grey mentor had given him no instructions for this eventuality .

source_bert_toks: and our hero in his turn , felt des ##pon ##dent and fearful , for his little grey mentor had given him no instructions for this eventual ##ity .

reference_raw: And our hero, in his turn, felt sad and fearful, for his little gray mentor had given him no instructions for this eventuality.

reference_spacy_tokens: And our hero , in his turn , felt sad and fearful , for his little gray mentor had given him no instructions for this eventuality .