text:
What are the UK's current Christmas rules as uncertainty continues
The Government says the rules for Christmas Day will be kept under review
Neil ShawNetwork Content Editor
There is still some uncertainty over whether families will be able to enjoy Christmas with their loved ones this year, as concerns continue over rising coronavirus cases.
Pressure is increasing on the Government to rethink the rules for the festive period, but how are things as they stand?
– Is Christmas cancelled?
Not currently.
The UK Government and devolved administrations have agreed a joint plan to allow a five-day "Christmas window" from December 23 to 27.
– What does that mean?
During that period families will be able to form larger Christmas support bubbles of between up to three households.
Those within bubbles will be able to share Christmas dinner inside and even hug one another, as long as it takes place in a private home.
The Department of Health and Social Care (DHSC) says the system is a "sensible and proportionate" way to enable people to spend time with their loved ones during the festive period.
Downing Street confirms Christmas rules are under review
Figures show whether your area could see tier level raised or lowered
– So Christmas will be like normal then?
No. The relaxation does not mean all the rules have been scrapped. Tiered restrictions will still apply, the DHSC said.
For example, hospitality venues in Tier 3 areas will not be open for business during this period.
Stephen Barclay, Chief Secretary to the Treasury, said the system offered people "flexibility" to see their families but that it was not a case of "letting people loose".
"I think (the Christmas window) has been mischaracterised as, almost, a tier zero, that we are scrapping restrictions in their entirety. That is not the case," he told Sky News.
– Do we… have to see our families?
The relaxed rules are not mandatory and ministers have stressed that people should take "personal" decisions as to whether or not they go to see family members, especially if they are vulnerable.
David Nabarro, a World Health Organisation special envoy working on Covid-19, has urged people to think of alternatives to family get-togethers this year.
– Won't that make me a Christmas Grinch?
The Government has said that people will not be "criminalised" for seeing family during the festive period, acknowledging it will be important for the mental health of many.
But emphasis has been placed on people doing "the minimum possible", and if you'd rather not, then don't.
To those considering taking extra precautions, Mayor of London Sadiq Khan said: "You're not being Grinch at all. I think what you're doing is following the science."
Healthcare leaders urge Government to scrap new Christmas rules
SAGE expert on what you should and shouldn't do this Christmas
– Can I still do my Christmas shopping?
Even in areas with Tier 3 restrictions, non-essential retailers will stay open so you can still grab last-minute gifts.
However, people are being encouraged to be careful and "compliant" with Covid-secure rules when out at the shops and to shop locally or online if possible.
– Are the rules likely to change?
Downing Street has insisted there are no plans to change the "Christmas bubble" policy despite some concerns.
However, Mr Barclay reiterated that "all things were kept under review".
– What do experts think?
Two top medical journals have called for the Government to call off its "rash" decision.
In a rare joint editorial, the British Medical Journal and Health Service Journal said the Government "is about to blunder into another major error that will cost many lives".
They added that the Government had been too slow to introduce restrictions in the spring and again in the autumn, and restrictions were needed over Christmas ahead of a "likely third wave."
UK & World NewsHow PIP claimants can get paid £605 a month for support with stress How you can apply for the benefit if you suffer from a mental health condition
How every Super League club has filled their overseas quota spots
Super LeagueJust six teams have room left for an overseas signing


text:
Siebenrockiella leytensis is a species of freshwater turtle endemic to the Philippines.  It is classified as critically endangered. It is known as the Philippine forest turtle, the Philippine pond turtle,  the Palawan turtle, or the Leyte pond turtle. Despite the latter common name, it does not occur in the island of Leyte but is instead native to the Palawan island group. It is locally known as bakoko in Cuyonon.

Philippine forest turtles are readily recognizable by their ginkgo-shaped vertebral scutes and a pale white to yellow line traversing across its head behind the ears. The previous characteristic has earned it the nickname of 'bowtie turtle'.

Philippine forest turtles are classified under the subgenus Panyaenemys. Together with the smiling terrapin (Siebenrockiella crassicollis), it is one of the two species in the genus Siebenrockiella.

Description

Philippine forest turtles have brown to reddish brown to black carapaces that reach a length of . Larger individuals can reach  in length, though this is relatively rare. A dorsal ridge (the keel) is only present in the posterior vertebral scutes or absent altogether. The front margin of the carapace is slightly to strongly serrated, with the marginal scutes projecting beyond the cervical scutes. The vertebral scutes are broader than long.

The plastron is reddish brown to black, sometimes with blotches of yellow. In juveniles, the plastron is a uniform yellow. The bridge (the hinge connecting plastron and carapace) is the same color as the plastron. It is significantly smaller than the carapace and narrow at the front and back. It possesses deep notches between the projecting gular scutes as well as between the gulars and humerals, but it is more distinct in the former.

Its plastral formula is abd > pect > fem > gul > hum > an.

The skin of the legs, body, and neck are rough in appearance, being covered in tiny tubercles. The head is brown in color, sometimes speckled at the temples with light brown, orange, or red spots. A thin white to pale yellow line traverses through the width of the head just behind the openings of the ears, it may be divided at the center in some individuals. This has led to the species being nicknamed as the 'bowtie turtle'. The line is more prominent in younger individuals.

The upper jaw is hooked and the skin on the sides of the neck and the chin are lighter in color. The lower jaw may also sometimes possess a pair of small yellow spots on the sides.

The legs possess irregular enlarged transverse scales and are darker in color at the front. Four transverse scales are present on the forelimbs and more at the hind limbs (though absent at the heels). All limbs are webbed and possess large claws on all toes. The tail is uniformly light brown in color.

Philippine forest turtles are relatively easy to recognize. They can be distinguished from all other turtles by their strongly projecting epiplastra, vertebral scutes shaped like ginkgo leaves, the absence of temporal arches in the skull, and the aforementioned light lines behind its head.

The Malaysian giant turtle (Orlitia borneensis) and the smiling terrapin (Siebenrockiella crassicollis) are the only other turtle species with ginkgo-shaped vertebral scutes, but they do not possess the white to pale yellow line on the back of their heads.

Taxonomy and nomenclature
The scientific name of Philippine forest turtles is Siebenrockiella leytensis. It is classified under the genus Siebenrockiella in the subgenus Panyaenemys (frequently misspelled as "Panayanemys" and "Panyanemys"). It belongs to the subfamily Geoemydinae of the family Geoemydidae.

Formerly classified under the genus Heosemys, it was transferred to the previously monotypic genus Siebenrockiella by Diesmos et al. in 2005 based on morphological and genetic comparison with Siebenrockiella crassicollis.

The subgenus name is derived after the Pala'wan word panya-en. The word was used by a local Palawan resident to describe the turtles in a 2003 survey. The word means 'enchanted', supposedly because Philippine forest turtles were favorite pets of the forest spirits. -emys comes from the Greek word εμύς, meaning 'freshwater turtle'.

The generic name was coined in honor of the Austrian zoologist Friedrich Siebenrock. While the specific name means 'from [the island of] Leyte'. An erroneous name, as the turtle is actually from the islands of Palawan and is not found in Leyte.

History of discovery
Philippine forest turtles were first described by the American herpetologist Edward Harrison Taylor in 1920 as Heosemys leytensis. He described them on the basis of two specimens (male and female) collected by Gregorio Lopez, allegedly from the swamps of the municipality of Cabalian in Southern Leyte (now known as the municipality of San Juan). These specimens were unfortunately destroyed in World War II during the firebombing of Manila.

No other specimens were reported until 1988 when a specimen was bought from a local resident in Taytay, Palawan. Believing that the turtle got there through interisland trade, numerous herpetologists searched Southern Leyte for other individuals. Their lack of success led to fears that the turtle was already extinct.

In 2001, during an assessment of endemic wildlife of the island of Palawan, live specimens of Philippine forest turtles were rediscovered. It soon became apparent that natural populations of the species existed in Palawan. Diesmos et al. (2004) have concluded that Taylor and/or Lopez may have somehow confused the type locality of the original specimens. Lopez also collected turtle specimens from the islands of Coron and Busuanga in Palawan. Specimens from Palawan may have been mistakenly exchanged with actual specimens from Leyte (which were probably Cyclemys dentata). It is now presumed that Philippine forest turtles have never been introduced outside of Palawan, and thus were not actually from Leyte.

Distribution and habitat
Philippine forest turtles are known only from northern Palawan and surrounding islands. This includes the island of Dumaran where the species is still relatively abundant in creeks. Elsewhere, it is believed their populations are declining sharply. Particularly in the areas of Taytay and San Vicente. Its distribution area is estimated to be less than 100 km2.

Ecology and behavior
Philippine forest turtle populations often exist alongside other more common native turtle species, including Asian leaf turtles (Cyclemys dentata) and Southeast Asian box turtles (Cuora amboinensis).

Due to its rarity and its status as newly rediscovered, little is known of the life cycle of the Philippine forest turtle. From observations, however, Philippine forest turtles appear to exhibit long life spans and high adult survival rates. Like most turtles, their sexual maturation is delayed but they are able to mate multiple times before death (iteroparity).

Captive adults confiscated from illegal traders were provided a large outside pool with well planted islands and numerous underwater rock formations in Malabon Zoo in Manila. But they proved to be very shy and retiring, spending considerable time hiding under rocks, both in and out of the water. They took some months to adjust to confinement. Observations indicate that they are omnivorous, favouring commercial turtle food, aquatic plants and they have been observed hunting small fish and crustaceans.  They became active in the early morning and late evening, foraging for food, and moved about during the night. They were not observed to be keen on basking in the sun, but this may have been the result of being in a captive environment.

Known food sources of Philippine forest turtles in the wild include figs.

Threats
The Philippine forest turtle is an enigmatic freshwater turtle species, it exerts great fascination for turtle hobbyists.  Due to the previous inability to locate it in the wild, probable threats from habitat loss, and potential pressure from collectors, this turtle is listed as critically endangered.

Due to the susceptibility of the species to stress and the extremely aggressive territorial behavior of male individuals, Philippine forest turtles do not do well in captivity. Nevertheless, as of 2009, a considerable number of these turtles (over 171 individuals documented in a span of four years) were to be found for sale illegally in major Manila pet markets, particularly in the main Chinese markets (where the turtles are sold cheaper). The animals are not sold openly and some of the buyers are overseas collectors. Most of the individuals were juveniles or young adults. Between 2009 and 2011 this species ranked sixth among the most commonly confiscated species in the Philippines. These animals had been collected from mud wallows in northern Palawan, and it is believed that they hide during the daylight hours.

Additionally, many specimens (from Palawan) offered for sale had small holes bored in the carapace, indicating that some at least had been held captive as pets and tethered accordingly. Local Palawan people are known to keep these animals in water troughs for domestic pigs, as these are supposed to bring luck for the household and the pigs, although it is not known if this luck is shared by the turtles.

The unconfirmed existence of illegal trade of Palawan turtles to Borneo, Malaysia, is also a cause of concern.

Conservation
Although some studies into their habitats have been commenced by several Philippines academic institutions, lack of funding has prevented full study, and they must be still considered endangered, especially from collecting, until further research had been carried out.

Trade is banned internationally under the CITES convention, as well as domestically under the Philippines Wildlife Act.

Some eighteen individuals have been donated to the Malabon Zoo north of Manila.

Recent legislation in the Philippines requires pet owners and traders to register their animals with the authorities, and pay for licences to keep the more "exotic" pets. It is hoped that this may prove to reduce the collection of various endangered species, including the Philippines Pond Turtle. The entirety of the Palawan group of islands is also a nationally protected area.

References

External links

Siebenrockiella leytensis Identification Sheet from Environment Canada
One of World's Most Threatened Turtle Species Gets New Protected Home

Reptiles of the Philippines
Siebenrockiella
Endemic fauna of the Philippines
Fauna of Palawan
Reptiles described in 1920

redpajama_set_name: RedPajamaWikipedia


This report presents a review of arrangements which have been found to make the identification of ultimate beneficial ownership and control difficult. It reviews potential implications for investment authorities when they have responsibility for assessing possible threats to essential security interests. It was prepared in support of discussions at the OECD Roundtable on Freedom of Investment in March 2007.
This briefing note gives an OECD perspective on alternative dispute resolution based on experiences with the specific instances procedure of the OECD Guidelines for Multinational Enterprises. It was prepared for a workshop on "Accountability and Dispute Resolution" organised by Harvard's Kennedy School in support of work in this area by the Special Representative of the United Nations Secretary-General on Business & Human Rights.


Use these 3 simple adjustments to make your handwriting fonts for Microsoft Word documents look more realistic - and more like real handwriting. Real Cursive Handwriting Fonts since 1988! Handwriting Font …... The connected cursive fonts, with and without guidelines, use the SigSoft Handwriter utility to reproduce the natural variations in letter shapes and connections that occur in real cursive handwriting.
When I open up Microsoft Word, it works fine (the font)... however in photoshop it seems to only type up each letter as if it were its own, not connected to the other letters like how cursive should be.
6/02/2010 · Stop Scrolling! Attention - When discussing new chapters of an anime or manga, please use a source from the official list of approved sources. If you would like to contribute to the list, please do so in the suggestions section.
A: No – the cursive font can only be created in the specifically-designed template in Microsoft Word. However, teachers can use the print and pre-cursive fonts in PowerPoint – though we don't offer support for any issues in PowerPoint.
The connected cursive fonts, with and without guidelines, use the SigSoft Handwriter utility to reproduce the natural variations in letter shapes and connections that occur in real cursive handwriting.


Delicious smoky aubergine dip. Aubergines are charred over a flame, pulped, and then seasoned with a classic Levantine mix of tahini, olive oil and garlic.
A rich and flavoursome beef stew garnished with pearl onions, carrots and pancetta. The sauce in this Gluten-free recipe is thickened with Arrowroot powder.
Ox cheeks are cooked slowly in red wine until meltingly soft and buttery in this rich winter stew. The Gluten-free sauce is naturally thickened by collagen.


The Long.remainderUnsigned(long dividend, long divisor) java method returns the unsigned remainder from dividing the first argument by the second where each argument and the result is interpreted as an unsigned value.
Non static method is usually called by just declaring method_name(argument) however in this case since the method is static, it should be called by appending the class name as suffix. We will be encountering a compilation problem if we call the java remainderUnsigned method non statically.
Below is a simple java example on the usage of remainderUnsigned(long dividend, long divisor) method of Long class.


text:
Q: How to solve the error list index out of range ? (On python using pygame and sys) I'm beginning in python and I wanted to follow a simple guide to make a little game, but I encountered a problem and I can't seem to fix it. The problem is that after running my program, my IDE is showing the "IndexError: list index out of range" but I don't know why, I suspect one part of my code for this problem ( I think it's TileColour[map1[row][col]]) but I can't figure what's wrong with it. So I came here hoping you could help me with that problem. Thanks for the help!
import pygame, sys

#Define which tile to use
L = 0 #LAVA
R = 1 #ROCK
F = 2 #FOREST
G = 3 #BURNEDGRASS

#Tiles colours
LAVARED = (207, 16, 32)
ROCKYGREY = (169,169,169)
GREENFOREST = (0,76,0)
BURNEDGRASS = (187, 155, 96)

#Associating Color and Tiles
TileColour = { L : LAVARED,
               R : ROCKYGREY,
               F : GREENFOREST,
               G : BURNEDGRASS
               }

#Map Creation

map1 = [[G,G,G,G,G,R,G,G,F,F,F,F,F,F],      #15*15
        [G,L,L,G,G,R,G,G,F,F,F,F,F,F],
        [G,L,L,G,G,G,G,G,F,G,F,F,F,F],
        [G,G,G,R,G,G,G,G,G,G,G,G,G,F],
        [G,G,G,G,G,G,G,G,G,G,G,G,G,G],
        [G,R,G,G,G,R,G,G,G,G,G,R,G,G],
        [G,G,G,G,G,G,R,G,G,G,G,G,G,G],
        [G,G,G,G,G,G,G,G,G,G,G,G,G,G],
        [G,G,G,G,G,G,G,G,G,G,G,G,G,G],
        [G,L,G,G,G,G,G,G,G,R,L,G,G,G],
        [G,L,L,G,G,R,G,L,L,L,G,G,G,G],
        [G,G,G,G,G,G,G,G,G,L,L,G,G,G],
        [G,R,R,G,G,G,G,G,G,G,G,G,R,G],
        [G,G,R,G,G,G,G,G,G,G,G,G,G,G],
        ]

#Map Size
TILESIZE = 35
MAPWIDTH = 15
MAPHEIGHT = 15

#Display
pygame.init()
DISPLAY = pygame.display.set_mode((MAPWIDTH*TILESIZE,MAPHEIGHT*TILESIZE))

#Basic HUD
while True:
    for event in pygame.event.get():
        if event.type == pygame.QUIT:
            pygame.quit()
            sys.exit()

    for row in range(MAPHEIGHT):
        for col in range(MAPWIDTH):
            pygame.draw.rect(DISPLAY,TileColour[map1[row][col]],(col*TILESIZE,row*TILESIZE,TILESIZE,TILESIZE))

    pygame.display.update()

redpajama_set_name: RedPajamaStackExchange


My name is Andrew Joyce and I write books for a living. I would like to thank Johanna for allowing me to be here today to promote my latest, Yellow Hair, which documents the injustices done to the Sioux Nation from their first treaty with the United States in 1805 through Wounded Knee in 1890. Every death, murder, battle, and outrage I write about actually took place. The historical figures that play a role in my fact-based tale of fiction were real people and I use their real names. Yellow Hair is an epic tale of adventure, family, love, and hate that spans most of the 19th century.
Every culture has an origin story. We in the West have Adam and Eve. The Ancient Greeks had Gaia. According to the Norse people, Odin and Ymir founded the earth. If you will allow me, I'd like to tell you the creation story of the Dakota.
Don't offers readers a fascinating look at the way words impact our behavior, as well as the behavior of those around us.
Utilizing numerous studies and research findings, Bob Selden delves deeply into the reasons why the words we choose matter, and how simply re-shaping statements from negatives to positives can make a world of difference in communication and leadership abilities.
Full of real-life examples and practical exercises to help hone your skills, Don't explains which words to use, which to avoid, and the correct way to use words to diffuse conflict in difficult situations -all the while helping readers develop a more positive outlook through using more positive language.
Don't is a fascinating book that will inspire you to take a deeper look at how you communicate -revealing just how impactful words can be, and how changing our words can actually change how we think and interact with others.


text:
#pragma once

#include "il2cpp-config.h"

#ifndef _MSC_VER
# include <alloca.h>
#else
# include <malloc.h>
#endif

#include <stdint.h>
#include <assert.h>
#include <exception>

// System.MissingMemberException
struct MissingMemberException_t3157362756;
// System.String
struct String_t;
// System.Runtime.Serialization.SerializationInfo
struct SerializationInfo_t2995724695;

#include "codegen/il2cpp-codegen.h"
#include "mscorlib_System_String968488902.h"
#include "mscorlib_System_Runtime_Serialization_Serializatio2995724695.h"
#include "mscorlib_System_Runtime_Serialization_StreamingCont986364934.h"

// System.Void System.MissingMemberException::.ctor()
extern "C"  void MissingMemberException__ctor_m4083184326 (MissingMemberException_t3157362756 * __this, const MethodInfo* method) IL2CPP_METHOD_ATTR;
// System.Void System.MissingMemberException::.ctor(System.String)
extern "C"  void MissingMemberException__ctor_m3562298876 (MissingMemberException_t3157362756 * __this, String_t* ___message, const MethodInfo* method) IL2CPP_METHOD_ATTR;
// System.Void System.MissingMemberException::.ctor(System.Runtime.Serialization.SerializationInfo,System.Runtime.Serialization.StreamingContext)
extern "C"  void MissingMemberException__ctor_m4213358343 (MissingMemberException_t3157362756 * __this, SerializationInfo_t2995724695 * ___info, StreamingContext_t986364934  ___context, const MethodInfo* method) IL2CPP_METHOD_ATTR;
// System.Void System.MissingMemberException::.ctor(System.String,System.String)
extern "C"  void MissingMemberException__ctor_m3949157688 (MissingMemberException_t3157362756 * __this, String_t* ___className, String_t* ___memberName, const MethodInfo* method) IL2CPP_METHOD_ATTR;
// System.Void System.MissingMemberException::GetObjectData(System.Runtime.Serialization.SerializationInfo,System.Runtime.Serialization.StreamingContext)
extern "C"  void MissingMemberException_GetObjectData_m1444155236 (MissingMemberException_t3157362756 * __this, SerializationInfo_t2995724695 * ___info, StreamingContext_t986364934  ___context, const MethodInfo* method) IL2CPP_METHOD_ATTR;
// System.String System.MissingMemberException::get_Message()
extern "C"  String_t* MissingMemberException_get_Message_m388478373 (MissingMemberException_t3157362756 * __this, const MethodInfo* method) IL2CPP_METHOD_ATTR;

redpajama_set_name: RedPajamaGithub


Wages & salaries for Opticians, dispensing in Rockford, IL ?
The BLS estimates that in Rockford, IL there were around Not available employed in the field of Opticians, dispensing.
Opticians, dispensing in Rockford, IL earned 1% less than average for Opticians, dispensing in the United States.
Opticians, dispensing in Rockford, IL earned 13% less than the average worker in Rockford, IL.
Opticians, dispensing in Rockford, IL earned 28% less than the average worker in Illinois.
Opticians, dispensing in Rockford, IL earned 19% less than the average worker in the United States.


text:
package net.wytrem.glmario.gl.buffers;

public class VboBufferUploader implements VertexBufferUploader
{
    private VertexBufferObject vbo;
    private BufferUsage usage;

    public VboBufferUploader(VertexBufferObject vbo, BufferUsage usage)
    {
        this.vbo = vbo;
        this.usage = usage;
    }

    @Override
    public void upload(VertexBuffer buffer)
    {
        vbo.bufferData(buffer.getVertexBuffer(), usage);
        buffer.reset();
    }
}


sasse is passionate about supporting your marketing needs and has a proven track record for success. By defining what matters upfront, creating the tools you need and providing deliverables on time – we help you achieve your goals! We provide integrated marketing strategies that are customer focused and help businesses stay ahead of the competition.


Tardigrades, commonly called water bears, are eight-legged microscopic animals. They are among the most resilient lifeforms on Earth. They can survive massive doses of radiation, pressure that exceeds that of the deepest ocean trenches, years of dehydration, and a temperature range of minus 200 Celsius to 149 Celsius. Low Earth orbit experiments have demonstrated that some species of tardigrade can survive for days while exposed to the vacuum of space.
Despite our best efforts, humans could never destroy the Earth enough to render the tardigrade extinct. Perhaps at some point in the distant future, some highly evolved descendant of the tardigrade will happen upon our ruined civilization and tsk-tsk us for our recklessness.


text:
Seung Gwak (coréen : 곽승, chinois : 郭升), né à Masan dans le sud de la Corée le , est un chef d'orchestre sud-coréen.

Biographie
Il a été le chef d'orchestre principal de l'Orchestre philharmonique de Séoul de 2003 à 2005. Depuis 2008, il dirige l'Orchestre symphonique de Daegu.

Chef d'orchestre sud-coréen
Naissance en Corée pendant la colonisation japonaise
Naissance en décembre 1941
Naissance à Changwon


Today I'm reminded of the scene from Charlie Brown where Lucy tries to identify what is wrong with Charlie by going through a whole list of phobias. Is there a name for the fear of too much stuff? Maybe it is just a form of claustrophobia? If someone asked me about that phobia, I'd say, like Charlie Brown, "That's It!".
Some days I look around my home and feel completely overwhelmed by the volume of things we own. Today is one of those days. Fortunately, it is Friday, and I'm off work early on Friday! So after a couple errands with my younger son, I spent about an hour cleaning out my desk drawers and the spare bedroom closet.
My desk hadn't been cleaned out since before we moved over a year ago. And the spare bedroom closet has been a dumping ground. We had almost 30 people over for a cookout last weekend…which means lots of cleaning up…which means lots of hiding junk in the spare bedroom closet. Please tell me I'm not the only one who does that?!?
And I have big desk – it is actually shared with my whole family. We have a couple shared computers there, but the drawers and cabinets all hold my stuff, mostly scrapbooking and memorabilia related.
I don't even scrapbook anymore, so as I sit here, I'm questioning why I didn't get rid of hardly any scrapbooking supplies. Somehow I've convinced myself that my boys will need them for craft projects (even though they hate craft projects). But still I've made progress. I'm happy with this pile of items ready for donation from today's clean-out.
The box with the lid on top is full of clothes I'd stuck back in the spare bedroom closet in case I changed my mind about switching to a capsule wardrobe. But today I decided to get rid of them after all. Oh, and did I mention I have a sack full of trash from the decluttering session too?


text:
Michael Charles Donkin (29 August 1951 – 6 December 2007) was an English reporter and journalist for BBC News.

Donkin was born in Southend-on-Sea, Essex in 1951. He went to school at the Northern Grammar School for Boys, in North End, Portsmouth. He landed his first job with the East Anglian Daily Times in Ipswich. In 1975, he joined the BBC as a freelancer. Shortly after he joined The Today Programme on BBC Radio 4, he was praised for good work and quickly progressed to television. He worked on both the 6 O'clock and 10 O'clock news as a world affairs correspondent. During his time with the BBC, Donkin made several short 5 to 6 minute films. He was most pleased with the film about a bed and breakfast farm. One year after Donkin started with the BBC, he married his wife Catriona. They had three daughters and one son together.

Donkin had a short battle with cancer. On 6 December 2007 he died from the illness.

References

External links
Guardian obituary

1951 births
2007 deaths
People from Southend-on-Sea
English male journalists
BBC newsreaders and journalists
Deaths from cancer in England


text:
Razer Blade Pro 17-inch gaming laptop gets full HD, GTX 1060 and a huge price drop
Razer serves up a more affordable version of its 17-inch Razer Blade Pro gaming laptop with VR-ready features.
Razer products tend to be on the high-end for PC gaming enthusiasts, something demonstrated by the 17-inch Razer Blade Pro, which started at $4,000. But what if you wanted the Blade Pro's ultra-thin body but not the cost of a used car? Today, Razer announced a new iteration, in addition to the 4K Blade Pro, that's much more affordable.
The new Razer Blade Pro with full HD (1920 x 1080) and a NVIDIA GeForce GTX 1060 should go on sale this fall, and instead of costing $4,000 it'll go for $2,299. Here's what else is new.
120Hz display and GTX 1060
What's new with the full HD Razer Blade Pro
The concept behind the new full HD Razer Blade Pro is simple to understand: Keep the exact same ultra-thin 0.88-inch (22.5mm) CNC military-grade aluminum chassis and replace some of the super-premium components with those found in the 14-inch Razer Blade. The full HD Razer Blade Pro is essentially the Razer Blade 14, but with a 17-inch display, larger battery and more ports.
The new Blade Pro still supports the quad-core Core i7-7700HQ instead of a crazy GeForce 1080, and it drops down to the GeForce 1060. That means the laptop still supports full virtual reality (VR) and can play many first-person shooters at high frame rates.
That performance is mostly due to the drop from a 4K IGZO glossy touch display to a full HD non-touch matte one. It's also 120Hz, which should look awesome. Being non-touch allows for the non-glossy material as well as saving some weight.
Processor Intel Core i7-7700HQ quad core
2.8 GHz / 3.8 GHz
Display 17.3-inch Full HD (1920 x 1080)
120 Hz refresh rate
IPS Non-Touch Matte Display
Storage 256GB SSD (PCIe m.2) + 2TB HDD storage
Expandable up to 2TB SSD (PCIe m.2) and 4TB HDD
RAM 16GB (8GB x2) dual-channel DDR4 2,400MHz
Expandable to 32GB (16GB x 2)
GPU NVIDIA GeForce GTX 1060
6GB of GDDR5X VRAM
Razer Core (eGPU) ready Yes
Keyboard Anti-ghosting, backlit Chroma keyboard (membrane)
OS Windows 10 64-bit
Networking Killer DoubleShot Pro
Wireless-AC 1535 (IEEE 802.11a/b/g/n/ac)
E2400 Gigabit Ethernet 10/100/1000)
Ports Thunderbolt 3, three USB 3.0, HDMI 2.0, SDXC reader
Audio Built-in stereo speakers
Dolby Digital Plus Home Theater Edition
7.1 Codec support (via HDMI)
3.5mm headphone/microphone port
Array microphone
Webcam 2.0MP
Battery 70Wh lithium-ion polymer battery
Compact 165W Power Adapter
Dimensions 22.5 mm (H) / 424 mm (W) / 281mm (D)
0.88 in x 16.7 in x 11 in
Other changes include a mix of solid state drive (SSD) for storage with a traditional rotational drive (which can be swapped out for more SSD), replacement of the low-profile mechanical keyboard for the membrane-based one found in the 14-inch Blade, and RAM dropping to 16GB from 32GB (though you can still expand to 32GB).
Due to the display requiring less power, the 99 WHr battery drops to 70 WHr with a smaller 165W charger.
Otherwise, you still get the same amount of ports, including three USB 3.0 (SuperSpeed), one Type-C with full Thunderbolt 3 support, an Ethernet jack, SD card reader, and HDMI 2.0. Razer also enabled Razer Core support so users can utilize an external GPU for even more graphics power.
There's Killer DoubleShot Pro on board, as well, which lets you merge Ethernet and Wi-Fi for unparalleled networking.
Finally, the full HD Blade Pro shaves off a full pound and drops to 6.78 pounds (3.07 kg) down from 7.8 pounds (3.54kg) compared to the 4K model.
Full HD Razer Blade Pro quick analysis
While the Razer Blade Pro 4K remains the crown jewel in Razer's gaming laptop lineup, the $4,000 starting price (it goes up to $4,500) is out of reach for many gamers.
Mixing the 14-inch Razer Blade's feature-set into the larger 17-inch chassis, while reducing weight and the price, is the right move for Razer to reach more users. While a $2,299 laptop is still expensive for many, shaving off $1,700 is not insignificant.
Our Review: Razer Blade Pro 17" with 4K display
While the 4K IGZO display is amazing, there's something to be said for gaming at 120Hz on a matte full HD screen. Plus, for those who did not immediately love the Blade Pro's quirky low-profile mechanical keyboard, you can get the same membrane-based one found in the 14-inch Blade.
Full HD Razer Blade Pro pricing and availability
Look for the new Razer Blade Pro full HD model to drop just before the holiday season later this fall.
Pricing – U.S. $2,299.99 / Canada $2,899.99 / EU €2,399.99 / UK £2,099.99
Availability – Razerzone.com (U.S., Canada, UK, France, Germany) during the third quarter of 2017. The PC should also be available soon at Amazon, Best Buy, and select retail partners and worldwide during the fourth quarter of this year.
The recently refreshed 4K Blade Pro with THX certified display and sound and the latest seventh-generation Intel processor is still available and will be for the foreseeable future.
More information about the new Razer Blade Pro can be found on Razer's website.
Razer Blade Pro
I want this strictly for the sidemounted touchpad and larger screen. Now I might actually consider it at 2300!
I had a 2016 Blade Pro for a week or so, but ultimately returned it as I couldn't justify the price. I might have kept this! Too bad I went with an Aorus X7 v6 instead...
WOW. what a weapon! that thing rocks. Cheaper than a used macbook 17 too! awesome.

redpajama_set_name: RedPajamaCommonCrawl


text:
Autoren-Hauptseite
Ähnliche Autoren:innenBewertungsstatistikenPhoto GallerieInterview
Andy Weir: LibraryThing Autoren-Interview
Andy Weir has spent the bulk of his career up to this point as a software engineer. The success of his 2013 debut novel, The Martian has been the result of a remarkable journey, and is very much deserved. It's little wonder that the author identifies as a long-time space nerd.
Tim caught up with Andy this month to talk science, space, writing, and more science!
Tell us what your novel is all about.
It's about an astronaut who gets stranded on Mars (the rest of his crew thought he was dead). Now he has to survive with the equipment he has on-hand.
The Martian has both a great narrative and an engrossing focus on scientific and practical specificities. What drove what?
Definitely the science drove the plot. The problems he faced were real issues someone in that situation would face, and his solutions had to solve them. So those problems, and their solutions, are what moved the plot along.
The science is real, right?
As best as I could make it, yes. I put a lot of effort into scientific accuracy. I did a ton of research and math to work everything out. I'm sure I made some mistakes, but for the most part, the science is solid.
I gather you even wrote an orbital mechanics program to figure out certain details in the novel. I have to ask, are you insane?
Haha, maybe. But I wanted everything to fit right. So I wanted to know how long it would take to get there with a constantly accelerating ship and what path they'd take.
As I said, before, it's a page turner. Did you have any models for the narrative?
I didn't really have any model, per se. The story is very linear. Each problem needs a solution, and usually the solution causes the next problem. All I had to do was have Mark narrate the situation with a smart-ass tone of voice.
The Martian had an unusual path to publication—free, then self-published and finally picked up by a major publisher. What does that tell us about your book, or about publishing in general?
It's pretty cool. It means any schmoe can break into the writing world on their own. Self-publishing an electronic edition of your book costs you nothing, and if people like it, you'll do well.
What books were inspiring or helpful for you in writing The Martian?
The biggest inspiration was the real-world events of Apollo 13. Also a bit of an inspiration was Heinlein's Red Planet.
After reading The Martian, I wanted to read more space-travel narratives, both real and imaginary. Do you have any recommendations?
Packing for Mars by Mary Roach is pretty cool. Though it's not a narrative; more of a documentary.
When I was a kid in the 70s, the future of space exploration seemed bright. It is now almost certain that everyone who walked on the moon will be dead before anyone walks on Mars, or even the moon again. My son is eight. Do you think someone will walk on Mars in his lifetime?
Difficult to tell. It's hard to justify sending humans to Mars now that we can make advanced robots like Curiosity. Not only would a manned mission be orders of magnitude more expensive, it would risk human life. In the days of Apollo, we simply didn't have the technology to make rovers that could do what the astronauts did. Nowadays we can.
Though I do think there's an excellent chance your son will get to see a manned Moon landing in his lifetime. If not by the US, then by China.
The Martian has apparently been optioned for a film. What is the one thing you hope they get right?
I hope they don't make Watney into a serious brooding character. His personality is a large part of the story.
I gather your day job is as a software engineer—mine too. I can't help but ask, what sort of work do you do?
Well I recently quit my day job to go full time on writing. But when I was programming, it was mobile device management software. Basically it's software you can install on your phone that will set up your email, wifi, certs, etc. on your phone for you.
Programmer-writers are pretty rare. How do the two relate for you?
Mostly in the math and science arena, I guess. I'm sure my obsession with (probably unimportant) details comes from my software engineering background.
At LibraryThing we always ask about people's personal libraries. What can you tell us about yours?
I'm terrible. I don't read nearly as much as I should. My main love is TV and movies.
Are you working on another book now?
Yes. I'm working on my next novel, tentatively called "Zhek". It'll be a while before it comes out. Next year at least.
—interview by Tim Spalding
Diesen Autor als Favoriten markieren
Bücher von Andy Weir
Der Marsianer (15652 Exemplare)
Artemis (4820 Exemplare)
Project Hail Mary (3725 Exemplare)
The Martian [2015 film] (624 Exemplare)
Rand0m1ze (277 Exemplare)
The Egg (236 Exemplare)
Press Start to Play (231 Exemplare)
Cheshire Crossing (159 Exemplare)
Diary of an AssCan (49 Exemplare)
The Egg and Other Stories (47 Exemplare)
The Martian: Young Readers Edition (36 Exemplare)
James Moriarty, Consulting Criminal (32 Exemplare)
Annie's Day (28 Exemplare)
Forward Collection (Forward, #1-6) (16 Exemplare)
The Chef (13 Exemplare)
The Real Deal (9 Exemplare)
Bored World (9 Exemplare)
Lacero (9 Exemplare)
Meeting Sarah (8 Exemplare)
Antihypoxiant (6 Exemplare)
Access (5 Exemplare)
The Midtown Butcher (5 Exemplare)
Zhek (3 Exemplare)
Principles of Uncertainty (3 Exemplare)
Twarrior (2 Exemplare)
Αποστολή Χαίρε Μαρία (1 Exemplare)
Rat (1 Exemplare)
Digitocracy (1 Exemplare)
Andy Weir 3 Books Collection Set(Project Hail Mary [Hardcover], Artemis, The Martian) (1 Exemplare)
Letzte Autoren-Interviews
Brad Stone (2017-03-22)
David Mitchell (2015-10-26)
Sharma Shields (2015-02-20)
Kara Cooney (2014-11-21)
Daniel M. Lavery (2014-10-22)
Gregory Maguire (2014-09-25)
Ann Leckie (2014-09-24)
Andy Weir (2014-08-18)
Matthew Thomas (2014-07-24)
Maximillian Potter (2014-07-24)
Alexi Zentner (2014-05-20)
Ian Doescher (2014-03-24)
Jeff Greenfield (2013-11-13)
Patrick Ness (2013-10-16)
Tom Standage (2013-10-16)
Samantha Shannon (2013-08-20)
Paul Collins (2013-07-24)
Travis McDade (2013-07-24)
Colum McCann (2013-05-22)
Jennifer McVeigh (2013-05-22)
Über Autoren-Interviews
Each month we feature a few exclusive interviews with authors in our "State of the Thing" newsletter. Know an author who might want to be interviewed? Find out more.


Amazing Image of Brown And Tan Shower Curtain is one of several design collections from 19 Photos Designs brown and tan shower curtain Unique Design Fairfax Shower Curtain which is one of the very popular designs of the year.Brown And Tan Shower Curtain published on Sunday, June 3, 2018 At 3: 10 pm.
We are have 19 beautiful pictures about Brown And Tan Shower Curtain. We hope you enjoyed it and if you want to see the high pictures, simply just click the images and you will be redirected to extra large page of Brown And Tan Shower Curtain.


This last week audio recording for the Bill Plympton/Jim Lujan REVENGEANCE film began. There will be many more sessions to come, but it feels good that the groundwork has been laid and one of the film's main characters (Rod Rosse), has been captured in the digital voice format performed by Jim Lujan.... digital voice format..sounds fancy, huh? Recording took place at Belle Fe Studios in West LA, recording engineer: Ken Mora.


Cardigans are my favorite Autumn piece! Great scarf too! Have a good weekend.
The cooler weather does present some great opportunities for lovely cardigans, sweaters and coats Bring it on!
That is such a cute and cozy cardigan! Love it belted! I'm back and linked up! Hope you have a wonderful weekend!
I love this outfit, Rachael! So cute and cozy! This is my favorite fall outfit formula, for sure. A cozy cardigan, a snuggly scarf, and comfy jeans.
Oh that cardigan looks so cozy and warm! Love it!
That cardi looks so cozy and I love the belt wrapped around it. I've actually had my eye on that belt, the price can't be beat. :) I love how the booties show a little bit of skin on top. Have a great weekend!
gorgeous looks! My favorite is the one with the belt! so chic!
I love the fun ways you've switched it up with that cardigan! It looks so cozy paired with your scarf!
I love the cardi you styled here. It's so cozy looking and the knit is just so unique. I think you showed that it's a versatile piece to own!
You look so warm and cozy here, especially with that fantastic scarf! I love how you've belted your cardigan too. So chic!
That cardigan looks so cozy. I love how you styled it.
What a cozy and stylish cardigan you got there dear!
Love the cardigan with a belt, so chic!
I have been eyeing this online and you are making me think I need it. So cute!!
What a comfortable and cute looking knit!
Beautiful chunky knit cardigan! I especially liked it styled with the long knit scarf.
I think cozy and oversized cardigans like this are so versatile, especially in a neutral color. Love this belted. I love it all 3 ways you wore it actually. As always you wear the most perfect skinny jeans too, Rachael!


text:
#ifndef ST_LOSS_LAYERS_HPP_
#define ST_LOSS_LAYERS_HPP_

#include <string>
#include <utility>
#include <vector>

#include "caffe/blob.hpp"
#include "caffe/common.hpp"
#include "caffe/layer.hpp"
// #include "caffe/neuron_layers.hpp"
#include "caffe/layers/loss_layer.hpp"
#include "caffe/proto/caffe.pb.h"

namespace caffe {

/* Input: theta
 * Output: loss, one single value
 *
 * This loss layer tends to force the crops to be in the range
 * of image space when performing spatial transformation
 */

template <typename Dtype>
class STLossLayer : public LossLayer<Dtype> {
public:
  explicit STLossLayer(const LayerParameter& param)
      : LossLayer<Dtype>(param) {}
  virtual void LayerSetUp(const vector<Blob<Dtype>*>& bottom,
        const vector<Blob<Dtype>*>& top);
  virtual void Reshape(const vector<Blob<Dtype>*>& bottom,
      const vector<Blob<Dtype>*>& top);

  virtual inline const char* type() const { return "STLoss"; }

  virtual inline int ExactNumBottomBlobs() const { return 1; }

  virtual inline bool AllowForceBackward(const int bottom_index) const {
    return true;
  }

 protected:

  virtual void Forward_cpu(const vector<Blob<Dtype>*>& bottom,
      const vector<Blob<Dtype>*>& top);
  virtual void Forward_gpu(const vector<Blob<Dtype>*>& bottom,
      const vector<Blob<Dtype>*>& top);

  virtual void Backward_cpu(const vector<Blob<Dtype>*>& top,
      const vector<bool>& propagate_down, const vector<Blob<Dtype>*>& bottom);
  virtual void Backward_gpu(const vector<Blob<Dtype>*>& top,
      const vector<bool>& propagate_down, const vector<Blob<Dtype>*>& bottom);

 private:
  Blob<Dtype> loss_;
  Blob<Dtype> dtheta_tmp_;
  Blob<Dtype> all_ones_vec_;

  int N, output_H_, output_W_;
};

}  // namespace caffe

#endif  // ST_LOSS_LAYERS_HPP_


text:
Amazon Prime now offers 20 per cent off all new video games
Chris Smith, January 12, 2016 10:36 pm GMT
Amazon has announced a rather awesome new perk for US-based members of its all-encompassing Amazon Prime subscription service – a whopping 20 per cent discount on all new video games.
The huge incentive applies during the pre-order period and in the two weeks following the release of the game.
The deal (via Polygon) applies only applies to physical copies, so no digital download codes, but is likely to see massive uptake from gamers seeking to save on new games.
The discount will be applied at checkout and applies only to orders fulfilled by Amazon.
For example, clicking through the Uncharted 4: A Thief's End pre-order page sees the $59.00 asking price reduced by $11.01 (pre-tax) to just $48.99.
Users who have already pre-ordered games like Uncharted 4, which is out on April 29, will also receive the discount when their card is charged for the game.
Rather than a limited time offer, this appears to be a permanent addition to Amazon Prime benefits, which already include guaranteed free delivery of games on the advertised release date.
The discount will also apply during free Prime trials, so users will be able to sign up, get a discount on a new game and cancel without committing to the annual membership fee.
Beyond this physical game-only rule, the only other caveats rule out bundle purchases and limited edition releases.
See also: Best PS4 Games 2016
Prime Members also get access to two-day delivery (next day in the UK) on thousands of products as well as access to a myriad of digital services like Prime Instant Video, Prime Music and the Kindle Lending Library.
Let's hope Amazon extends this particular perk to UK-based gamers before the most anticipated games of 2016 go on sale.


Perkins is hosting Give Kids The World Pancake Day on September 24th. What does that mean for you? Free pancakes!
Head on into your local Perkins on September 24th. It'll be worth the trip because they will give you a free short stack of pancakes. It doesn't look like you'll need to make a purchase in order to get the free pancakes. But they do hope that you'll make a donation to Give Kids The World. Free food and a good cause–yes!


The Scorpion reconnaissance and attack aircraft displayed at the Paris Air Show this week is currently on its second European tour, visiting mainland Europe and the UK. Seeking international customers Textron offers the Scorpion at a cost of business aircraft – 'below $20 million per aircraft', and at a flight-hour cost of $3,000 – about 10 – 20 percent of the acquisition and operating costs of modern combat aircraft or advanced trainers.
The Scorpion reconnaissance and attack aircraft displayed at the Paris Air Show this week is currently on its second European tour, visiting mainland Europe and the UK. Following this week the aircraft will perform demonstration flights as the guest of several European air forces, before arriving at the Royal International Air Tattoo in Fairford, UK, from July 17 to 19. Textron AirLand's Scorpion was introduced in 2013 and has completed more than 400 hours of flight-testing with an exceptionally high mission availability score.
Textron is aiming its new jet at countries that require extensive intelligence, surveillance and reconnaissance (ISR) operations, but these missions are often carried out by non-military operators (such as certain Middle-Eastern countries that have strong national guards or internal security agencies). These operators are currently employing various ISR assets based on business aircraft and are interested in expanding their capabilities with some 'kinetic' effects. "We offer an operational ISR capability at the acquisition and life-cycle costs of a business aircraft," said Ron Parker, flight test engineer in the program. According to Parker, Textron is currently producing the second Scorpion, which will be the aircraft that will undergo flight certification. It will be different from the current prototype, built as an experimental plane.


3-1 M. Salah (73) pen.
1-1 S. Al-Faraj (45) pen.
1-0 C. Ronaldo (4) pen.
1-1 K. Ansarifard (90) pen.
1-0 A. Griezmann (58) pen.
1-1 M. Jedinak (62) pen.
1-1 M. Jedinak (39) pen.
2-0 L. Modric (71) pen.
1-1 G. Sigurdsson (76) pen.
1-1 V. Moses (51) pen.
1-0 A. Granqvist (65) pen.
0-1 C. Vela (26) pen.
0-2 A. Granqvist (62) pen.
1-1 F. Sassi (35) pen.
1-0 E. Hazard (6) pen.
2-0 H. Kane (22) pen.
5-0 H. Kane (45) pen.
0-1 S. Kagawa (6) pen.
1-0 A. Griezmann (13) pen.
1-1 A. Dzyuba (41) pen.
0-1 H. Kane (57) pen.
2-1 A. Griezmann (38) pen.
(*) In 1950, the match between Uruguay and Brazil (2-1) was not a final, as the competition was set up with a final group comprized of 4 teams (no semi-finals, no final).


text:
\section{Introduction}
Neural machine translation (NMT) is a challenging task that attracts lots of attention in recent years.
Starting from the encoder-decoder framework~\cite{cho2014learning}, NMT starts to show promising results in many language pairs.
The evolving structures of NMT models in recent years have made them achieve higher scores and become more favorable.
The attention mechanism~\cite{bahdanau2014neural} added on top of encoder-decoder framework is shown to be very useful to automatically find alignment structure, and single-layer RNN-based structure has evolved into deeper models with more efficient transformation functions~\cite{convs2s,slicenet,transformer}.

One major challenge of NMT is that its models are hard to train in general due to the complexity of both the deep models and languages.
From the optimization perspective, deeper models are hard to efficiently back-propagate the gradients, and this phenomenon as well as its solution is better explored in the computer vision society.
Residual networks (ResNet)~\cite{resnet} achieve great performance in a wide range of tasks, including image classification and image segmentation.
Residual connections allow features from previous layers to be accumulated to the next layer easily, and make the optimization of the model efficiently focus on refining upper layer features.

NMT is considered as a challenging problem due to its sequence-to-sequence generation framework, and the goal of comprehension and reorganizing from one language to the other.
Apart from the encoder block that works as a feature generator, the decoder network combining with the attention mechanism bring new challenges to the optimization of the models.
While nowadays best-performing NMT systems use residual connections, we question whether this is the most efficient way to propagate information through deep models.
In this paper, inspired by the idea of using dense connections for training computer vision tasks~\cite{densenet}, we propose a densely connected NMT framework (DenseNMT) that efficiently propagates information from the encoder to the decoder through the attention component.
Taking the CNN-based deep architecture as an example, we verify the efficiency of DenseNMT. Our contributions in this work include:
(i) by comparing the loss curve, we show that DenseNMT allows the model to pass information more efficiently, and speeds up training;
(ii) we show through ablation study that dense connections in all three blocks altogether help improve the performance, while not increasing the number of parameters;
(iii) DenseNMT allows the models to achieve similar performance with much smaller embedding size;
(iv) DenseNMT on IWSLT14 German-English and Turkish-English translation tasks achieves new benchmark BLEU scores, and the result on WMT14 English-German task is more competitive than the residual connections based baseline model.

\section{Related Work}
\paragraph{ResNet and DenseNet. }
ResNet~\cite{resnet} proposes residual connections, which directly add representation from the previous layer to the next layer. Originally proposed for image classification tasks, the residual structure have proved its efficiency in model training across a wide range of tasks, and are widely adopted in recent advanced NMT models~\cite{gnmt,transformer,convs2s}.
Following the idea of ResNet, DenseNet~\cite{densenet} further improves the structure and achieves state-of-the-art results. It allows the transformations (e.g., CNN) to be directly calculated over all previous layers. The benefit of DenseNet is to encourage upper layers to create new representations instead of refining the previous ones.
On other tasks such as segmentation, dense connections also achieve high performance~\cite{jegou2017one}.
Very recently, \cite{godin2017improving} shows that dense connections help improve language modeling as well.
Our work is the first to explore dense connections for NMT tasks.

\paragraph{Attention mechanisms in NMT.}
The attention block is proven to help improve inference quality due to existence of alignment information~\cite{bahdanau2014neural}.
Traditional sequence-to-sequence architectures~\cite{kalchbrenner2013recurrent,cho2014learning} pass the last hidden state from the encoder to the decoder; hence source sentences of different length are encoded into a fixed-size vector (i.e., the last hidden state), and the decoder should catch all the information from the vector.
Later, early attention-based NMT architectures, including ~\cite{bahdanau2014neural}, pass all the hidden states (instead of the last state) of the last encoder layer to the decoder. The decoder then uses an attention mechanism to selectively focus on those hidden states while generating each word in the target sentence.
Latest architecture~\cite{convs2s} uses multi-step attention, which allows each decoder layer to acquire separate attention representations, in order to maintain different levels of semantic meaning. %
They also enhance the performance by using embeddings of input sentences.
In this work, we further allow every encoder layer to directly pass the information to the decoder side.

\paragraph{Encoder/decoder networks.}
RNNs such as long short term memory (LSTM) are widely used in NMT due to their ability of modeling long-term dependencies.
Recently, other more efficient structures have been proposed in substitution for RNN-based structures, which includes convolution~\cite{convs2s,slicenet} and self-attention~\cite{transformer}.
More specifically, ConvS2S~\cite{convs2s} uses convolution filter with a gated linear unit, Transformer~\cite{transformer} uses self-attention function before a two-layer position-wise feed-forward networks, and SliceNet~\cite{slicenet} uses a combination of ReLU, depthwise separable convolution, and layer normalization.
The advantage of these non-sequential transformations is the significant parallel speedup as well as more advanced performances, which is the reason we select CNN-based models for our experiments.

\section{DenseNMT}

In this section, we introduce our DenseNMT architecture.
In general, compared with residual connected NMT models, DenseNMT allows each layer to provide its information to all subsequent layers directly.
Figure \ref{fig:enc}-\ref{fig:att} show the design of our model structure by parts.

We start with the formulation of a regular NMT model.
Given a set of sentence pairs $S\!=\!\{({x^i},{y^i})|i\!=\!1,\!\cdots,\! N\}$, an NMT model learns parameter $\theta$ by maximizing the log-likelihood function:
\begin{equation}
\sum_{i=1}^{N} \log \mathcal{P}({y^i}|{x^i};\theta).
\end{equation}
For every sentence pair $(x,y)\in S$,  $\mathcal{P}({y}|{x};\theta)$ is calculated based on the decomposition:
\begin{equation}
\mathcal{P}({y}|{x};\theta) = \prod_{j=1}^{m}\mathcal{P}(y_j|{y_{<j}},{x};\theta),
\end{equation}
where $m$ is the length of sentence $y$. Typically, NMT models use the encoder-attention-decoder framework~\cite{bahdanau2014neural}, and potentially use multi-layer structure for both encoder and decoder. Given a source sentence $x$ with length $n$, the encoder calculates hidden representations by layer.
We denote the representation in the $l$-th layer as $h^l$, with dimension $n\times d^l$, where $d^l$ is the dimension of features in layer $l$.
The hidden representation at each position $h_j^l$ is either calculated by:
\begin{equation}
h_j^l = \mathcal{H}^{\mathtt{rec}}(h_j^{l-1}, h_{j-1}^l)
\end{equation}
for recurrent transformation $\mathcal{H}^{\mathtt{rec}}(\cdot)$ such as LSTM and GRU, or by:
\begin{equation}
h_j^l = \mathcal{H}^{\mathtt{par}}(h^{l-1})
\end{equation}
for parallel transformation $\mathcal{H}^{\mathtt{par}}(\cdot)$.
On the other hand, the decoder layers $\{z^l\}$ follow similar structure, while getting extra representations from the encoder side.
These extra representations are also called \textit{attention}, and are especially useful for capturing alignment information.

\begin{figure}[t]
\centering
\small
\captionsetup{font=small}
\includegraphics[width=0.32\textwidth]{figs/g_enc_v9.pdf}
\caption{Comparison of dense-connected encoder and residual-connected encoder. Left: regular residual-connected encoder. Right: dense-connected encoder. Information is directly passed from blue blocks to the green block.}
\label{fig:enc}
\end{figure}

In our experiments, we use convolution based transformation for $\mathcal{H}^{\mathtt{par}}(\cdot)$ due to both its efficiency and high performance, more formally,
\begin{equation}\label{eqt:hfunc}
h_j^l = \mathtt{GLU}([h_{j-r}^{l-1}, \cdots, h_{j+r}^{l-1}] W^{l} + b^l)\triangleq \mathcal{H}(h^{l-1}).
\end{equation}
$\mathtt{GLU}$ is the gated linear unit proposed in~\cite{dauphin2016language} and the kernel size is $2r+1$.
DenseNMT is agnostic to the transformation function, and we expect it to also work well combining with other transformations, such as LSTM, self-attention and depthwise separable convolution.

\subsection{Dense encoder and decoder}

Different from residual connections, later layers in the dense encoder are able to use features from all previous layers by concatenating them:
\begin{equation}\label{eqt:dense}
h^{l+1} = \mathcal{H}([h^{l}, h^{l-1},\cdots, h^0]).
\end{equation}
Here, $\mathcal{H}(\cdot)$ is defined in Eq. (\ref{eqt:hfunc}), $[\cdot]$ represents concatenation operation.
Although this brings extra connections to the network, with smaller number of features per layer, the architecture encourages feature reuse, and can be more compact and expressive.
As shown in Figure \ref{fig:enc}, when designing the model, the hidden size in each layer is much smaller than the hidden size of the corresponding layer in the residual-connected model.

\begin{figure}[!t]
\centering
\small
\captionsetup{font=small}
\includegraphics[width=0.4\textwidth]{figs/g_dec_v9.pdf}
\caption{Comparison of dense-connected decoder and residual-connected decoder. Left: regular residual-connected decoder. Right: dense-connected decoder. Ellipsoid stands for attention block. Information is directly passed from blue blocks to the green block. }
\label{fig:dec}
\end{figure}

While each encoder layer perceives information from its previous layers, each decoder layer $z^{l+1}$ has two information sources: previous layers $z^{i}, i\le l$, and attention values $a^{i}, i\le l$. Therefore, in order to allow dense information flow, we redefine the generation of $(l+1)$-th layer as a nonlinear function over all its previous decoder layers and previous attentions. This can be written as:
\begin{equation}
z^{l+1} = \mathcal{H}([z^{l}, a^{l}, z^{l-1}, a^{l-1},\cdots, z^1, a^1, z^0]),
\end{equation}
where $a^i$ is the attention value using $i$-th decoder layer and information from encoder side, which will be specified later.
Figure \ref{fig:dec} shows the comparison of a dense decoder with a regular residual decoder. The dimensions of both attention values and hidden layers are chosen with smaller values, yet the perceived information for each layer consists of a higher dimension vector with more representation power.
The output of the decoder is a linear transformation of the concatenation of all layers by default. To compromise to the increment of dimensions, we use summary layers, which will be introduced in Section 3.3. With summary layers, the output of the decoder is only a linear transformation of the concatenation of the upper few  layers.

\begin{figure*}[t]
\centering
\captionsetup{font=small}
\includegraphics[width=1\textwidth]{figs/g_att_v7.pdf}
\caption{Illustration of DenseAtt mechanisms. For clarity, We only plot the attention block for a single decoder layer. (a): multi-step attention~\cite{convs2s}, (b): DenseAtt-1, (c): DenseAtt-2. $\mathcal{L}(\cdot)$ is the linear projection function. The ellipsoid stands for the core attention operation as shown in Eq. (\ref{eqt:att}).}
\label{fig:att}
\end{figure*}

\subsection{Dense attention}

Prior works show a trend of designing more expressive attention mechanisms (as discussed in Section 2). However, most of them only use the last encoder layer.
In order to pass more abundant information from the encoder side to the decoder side, the attention block needs to be more expressive.
Following the recent development of designing attention architectures, we propose DenseAtt as the dense attention block, which serves for the dense connection between the encoder and the decoder side.
More specifically, two options are proposed accordingly.
For each decoding step in the corresponding decoder layer, the two options both calculate attention using multiple encoder layers. The first option is more compressed, while the second option is more expressive and flexible. We name them as DenseAtt-1 and DenseAtt-2 respectively. Figure \ref{fig:att}  shows the architecture of (a) multi-step attention~\cite{convs2s}, (b) DenseAtt-1, and (c) DenseAtt-2 in order.
In general, a popular multiplicative attention module can be written as:
\begin{equation}\label{eqt:att}
\mathcal{F}\left(Q,K,V\right) = \mathtt{Softmax}\left(Q\times K\right)\times V,
\end{equation}
where $Q,K,V$ represent query, key, value respectively. We will use this function $\mathcal{F}$ in the following descriptions.

\paragraph{DenseAtt-1}
In the decoding phase, we use a layer-wise attention mechanism, such that each decoder layer absorbs different attention information to adjust its output. Instead of treating the last hidden layer as the encoder's output, we treat the concatenation of all hidden layers from encoder side as the output. The decoder layer multiplies with the encoder output to obtain the attention weights, which is then multiplied by a linear combination of the encoder output and the sentence embedding. The attention output of each layer $a^l$ can be formally written as:
\begin{equation} \label{eqt:msmla-1}
a^{l} = \mathcal{F}\left(\!\mathcal{L}(z^l), \!\mathcal{L}\left( [\{h^i\}] \right), \!\mathcal{L}\left([\{h^i\}] \right)\!+\!\mathcal{L}(h^0)\right),
\end{equation}
where $\mathcal{F}(\cdot,\cdot,\cdot)$ is the multiplicative attention function, $[\cdot]$ is a concatenation operation that combines all features, and $\mathcal{L}(\cdot)$ is a linear transformation function that maps each variable to a fixed dimension in order to calculate the attention value. Notice that we explicitly write the $\mathcal{L}(h^0)$ term in (\ref{eqt:msmla-1}) to keep consistent with the multi-step attention mechanism, as pictorially shown in Figure \ref{fig:att}(a).

\paragraph{DenseAtt-2}
Notice that the transformation $\mathcal{L}([\{h^i\}])$ in DenseAtt-1 forces the encoder layers to be mixed before doing attention.
Since we use multiple hidden layers from the encoder side to get an attention value, we can alternatively calculate multiple attention values before concatenating them.
In another word, the decoder layer can get different attention values from different encoder layers.
This can be formally expressed as:
\begin{equation} \label{eqt:msmla-2}
a^{l} = \sum_{i=1}^{L} \mathcal{F}\left(\mathcal{L}(z^l), \mathcal{L}(h^i), \mathcal{L}([h^i,h^0])\right),
\end{equation}
where the only difference from  Eq. (\ref{eqt:msmla-1}) is that the concatenation operation is substituted by a summation operation, and is put after the attention function $\mathcal{F}$.
This method further increases the representation power in the attention block, while maintaining the same number of parameters in the model.

\subsection{Summary layers}
Since the number of features fed into nonlinear operation is accumulated along the path, the parameter size increases accordingly.
For example, for the $L$-th encoder  layer, the input dimension of features is  $(L-1)d+d_0$ , where $d$ is the feature dimension in previous layers, $d_0$ is the embedding size.
In order to avoid the calculation bottleneck for later layers due to large $L$, we introduce the \textit{summary layer} for deeper models.
It summarizes the features for all previous layers and projects back to the embedding size, so that later layers of both the encoder and the decoder side do not need to look back further.
The summary layers can be considered as contextualized word vectors in a given sentence~\cite{mccann2017learned}.
We add one summary layer after every $(\mathtt{sumlen}-1)$ layers, where $\mathtt{sumlen}$ is the hyperparameter we introduce.
Accordingly, the input dimension of features is at most $(\mathtt{sumlen}-1)\cdot d + d_0$  for the last layer of the encoder.
Moreover, combined with the summary layer setting, our DenseAtt mechanism allows each decoder layer to calculate the attention value focusing on the last few encoder layers, which consists of the last contextual embedding layer and several dense connected layers with low dimension. In practice, we set $\mathtt{sumlen}$ as $5$ or $6$.

\subsection{Analysis of information flow}
Figure \ref{fig:enc} and Figure \ref{fig:dec} show the difference of information flow compared with a residual-based encoder/decoder. For residual-based models, each layer can absorb a single high-dimensional vector from its previous layer as the only information, while for DenseNMT, each layer can utilize several low-dimensional vectors  from its previous layers and a high-dimensional vector from the first layer (embedding layer) as its information.
In DenseNMT, each layer directly provides information to its later layers.
Therefore, the structure allows feature reuse, and encourages upper layers to focus on creating new features.
Furthermore, the attention block allows the embedding vectors (as well as other hidden layers) to guide the decoder's generation more directly; therefore, during back-propagation, the gradient information can be passed directly to all encoder layers simultaneously.

\section{Experimental Setup}

\subsection{Datasets}

We use three datasets for our experiments: IWSLT14 German-English, Turkish-English, and WMT14 English-German.

We preprocess the IWSLT14 German-English dataset following byte-pair-encoding (BPE) method~\cite{subword}\footnote{https://github.com/rsennrich/subword-nmt}. We learn 25k BPE codes using the joint corpus of source and target languages.
We randomly select 7k from IWSLT14 German-English  as the development set
, and the test set is a concatenation of dev2010, tst2010, tst2011 and tst2012, which is widely used in prior works~\cite{ranzato2015sequence,bahdanau2016actor,msrphrase}.

For the Turkish-English translation task, we use the data provided by IWSLT14~\cite{cettolo2014report} and the SETimes corpus~\cite{cettolo2014report} following~\cite{sennrich2015improving}. After removing sentence pairs with  length ratio over 9, we obtain 360k sentence pairs. Since there is little commonality between the two languages, we learn 30k size BPE codes separately for Turkish and English.
In addition to this, we give another preprocessing for Turkish sentences and use word-level English corpus.
For Turkish sentences, following~\cite{gulcehre2015using,sennrich2015improving}, we use the morphology tool Zemberek with disambiguation by the morphological analysis~\cite{sak2007morphological} and removal of non-surface tokens\footnote{github.com/orhanf/zemberekMorphTR}.
Following~\cite{sennrich2015improving}, we concatenate tst2011, tst2012, tst2013, tst2014 as our test set. We concatenate dev2010 and tst2010 as the development set.

We preprocess the WMT14 English-German\footnote{https://nlp.stanford.edu/projects/nmt/} dataset using a BPE code size of 40k.
We use the concatenation of newstest2013 and newstest2012 as the development set.

\subsection{Model and architect design}
As the baseline model (\emph{BASE-4L}) for IWSLT14 German-English and Turkish-English, we use a 4-layer encoder, 4-layer decoder, residual-connected model\footnote{https://github.com/facebookresearch/fairseq}, with embedding and hidden size set as $256$ by default.
As a comparison, we design a densely connected model with same number of layers, but the hidden size is set as $128$ in order to keep the model size consistent. The models adopting DenseAtt-1, DenseAtt-2 are named as \emph{DenseNMT-4L-1} and \emph{DenseNMT-4L-2} respectively.
In order to check the effect of dense connections on deeper models, we also construct a series of 8-layer models. We set the hidden number to be $192$, such that both 4-layer models and 8-layer models have similar number of parameters.
For dense structured models, we set the dimension of hidden states to be $96$.

\begin{figure}[t]
\centering
\captionsetup{font=small}
\includegraphics[width=0.4\textwidth]{figs/plot-1.pdf}
\caption{Training curve (T) and validation curve (V) comparison. Left: IWSLT14 German-English (De-En). Middle: Turkish-English, BPE encoding (Tr-En). Right: Turkish-English, morphology encoding (Tr-En-morph).}
\label{fig:curve-appendix}
\end{figure}

Since NMT model usually allocates a large proportion of its parameters to the  source/target sentence embedding and softmax matrix, we explore in our experiments to what extent decreasing the dimensions of the three parts would harm the BLEU score.
We change the dimensions of the source embedding, the target embedding as well as the softmax matrix simultaneously to smaller values, and then project each word back to the original embedding dimension through a linear transformation.
This significantly reduces the number of total parameters, while not influencing the upper layer structure of the model.

We also introduce three additional models we use for ablation study, all using 4-layer structure.
Based on the residual connected \emph{BASE-4L} model, (1) \emph{DenseENC-4L} only makes encoder side dense, (2) \emph{DenseDEC-4L} only makes decoder side dense, and (3) \emph{DenseAtt-4L} only makes the attention dense using DenseAtt-2. There is no summary layer in the models, and both \emph{DenseENC-4L} and \emph{DenseDEC-4L} use hidden size $128$. Again, by reducing the hidden size, we ensure that different $4$-layer models have similar model sizes.

Our design for the WMT14 English-German model follows the best performance model provided in~\cite{convs2s}.
The construction of our model is straightforward: our 15-layer model \emph{DenseNMT-En-De-15} uses dense connection with DenseAtt-2, $\texttt{sumlen}=6$. The hidden number in each layer is $1/4$ that of the original model, while the kernel size maintains the same.

\subsection{Training setting}
We use Nesterov Accelerated Gradient (NAG)~\cite{nesterov1983method} as our optimizer, and the initial learning rate is set to $0.25$. For German-English and Turkish-English experiments, the learning rate will shrink by $10$ every time the validation loss increases. For the English-German dataset, in consistent with~\cite{convs2s}, the learning rate will shrink by $10$ every epoch since the first increment of validation loss. The system stops training until the learning rate is less than $10^{-4}$.
All models are trained end-to-end without any warmstart techniques.
We set our batch size for the WMT14 English-German dataset to be $48$, and additionally tune the length penalty parameter, in consistent with~\cite{convs2s}. For other datasets, we set batch size to be $32$.
During inference, we use a beam size of 5.

\section{Results}

\begin{table*}[t]
\centering
\small
\captionsetup{font=small}
\begin{tabular}{llccccccccccc}
\toprule
& & \multicolumn{3}{c}{\textbf{De-En}}  &  & \multicolumn{3}{c}{\textbf{Tr-En} } & & \multicolumn{3}{c}{\textbf{Tr-En-morph}} \\
 \cmidrule{3-5}  \cmidrule{7-9} \cmidrule{11-13}
&Embed size & 64 & 128 & 256 & & 64 & 128 & 256 & & 64 & 128 & 256 \\
&Model size (M) & $8\pm 1$ & $11\pm 1$ & $17\pm 1$ && $11\pm 1$ &$17\pm 1$ & $28\pm 1$ &&$13\pm 1$ &$21\pm 1$ & $36\pm 1$\\
\midrule
\multirow{ 3}{*}{4L}&BASE-4L & 28.97 & 29.99 & 30.43 && \textbf{19.80}  &20.26 & 20.99 && 18.90  & 18.81 & 20.08  \\
&DenseNMT-4L-1 & \textbf{30.11} & \textbf{30.80} &31.26 &&19.21 &20.08 & 21.36 &&18.83 & 20.16 & 21.43\\
&DenseNMT-4L-2 &29.77 & 30.01 &\textbf{31.40} && 19.59 & \textbf{20.86} & \textbf{21.48} && \textbf{19.04} & \textbf{20.19} & \textbf{21.57}\\
\midrule
\multirow{ 3}{*}{8L}&BASE-8L &30.15 & 30.91  &31.51  &&20.40  &21.60   &21.92  && 20.21 &20.76   & 22.62 \\
&DenseNMT-8L-1 &\textbf{30.91} & \textbf{31.54}  & 32.08 && 21.82  & \textbf{22.20}  &23.20 && 21.20 & 21.73  & 22.60  \\
&DenseNMT-8L-2 &30.70 & 31.17  & \textbf{32.26} && \textbf{21.93} & 21.98  &\textbf{23.25}  &&\textbf{21.73} & \textbf{22.44}  & \textbf{23.45} \\
\bottomrule
\end{tabular}
\caption{BLEU score on IWSLT German-English and Turkish-English translation tasks. We compare models using different embedding sizes, and keep the model size consistent within each column.}
\label{tab:embed}
\end{table*}

\begin{figure}[t]
\centering
\captionsetup{font=small}
\includegraphics[width=0.4\textwidth]{figs/plot-2-v2.pdf}
\caption{Training curve and test curve comparison on WMT14 English-German translation task.}
\label{fig:curve_ende}
\end{figure}

\subsection{Training curve}
We first show that DenseNMT helps information flow more efficiently by presenting the training loss curve.
All hyperparameters are fixed in each plot, only the models are different.
In Figure \ref{fig:curve-appendix}, the loss curves for both training and dev sets (before entering the finetuning period) are provided for De-En, Tr-En and Tr-En-morph.
For clarity, we compare \emph{DenseNMT-4L-2} with \emph{BASE-4L}.
We observe that DenseNMT models are consistently better than residual-connected models, since their loss curves are always below those of the baseline models.
The effect is more obvious  on the WMT14 English-German dataset. We rerun the best model provided by~\cite{convs2s} and compare with our model.
In Figure \ref{fig:curve_ende}, where train/test loss curve are provided, DenseNMT-En-De-15 reaches the same level of loss and starts finetuning (validation loss starts to increase) at epoch 13, which is 35\% faster than the baseline.

Adding dense connections changes the architecture, and would slightly influence training speed. For the WMT14 En-De experiments, the computing time for both DenseNMT and the baseline (with similar number of parameters and same batch size) tested on single M40 GPU card are 1571 and 1710 word/s, respectively. While adding dense connections influences the per-iteration training slightly (8.1\% reduction of speed), it uses many fewer epochs, and achieves a better BLEU score. In terms of training time, DenseNMT uses 29.3\%(before finetuning)/22.9\%(total) less time than the baseline.

\subsection{DenseNMT improves accuracy with similar architectures and model sizes}

\begin{table}[htbp]
\small
\centering
\captionsetup{font=small}
\begin{tabular}{lccc}
\toprule
 & \textbf{De-En}  & \textbf{Tr-En} & \textbf{Tr-En-morph}\\
\midrule
BASE & 30.43 & 20.99 & 20.08 \\
DenseENC-4L & 30.72 & 21.32 & 21.24   \\
DenseDEC-4L & 31.23 & 21.04 & 21.06  \\
DenseAtt-4L & 31.05 & 21.35 & 21.08  \\
DenseNMT-4L-1 & 31.26 & 21.36 & 21.43 \\
DenseNMT-4L-2 & 31.40 & 21.48 & 21.57\\
\bottomrule
\end{tabular}
\caption{ Ablation study for encoder block, decoder block, and attention block in DenseNMT.}
\label{tab:ablation}
\end{table}

Table \ref{tab:embed} shows the results for De-En, Tr-En, Tr-En-morph datasets, where the best accuracy for models with the same depth and of similar sizes are marked in boldface. In almost all genres, DenseNMT models are significantly better than the baselines.
With embedding size 256, where all models achieve their best scores, DenseNMT outperforms baselines by 0.7-1.0 BLEU on De-En, 0.5-1.3 BLEU on Tr-En, 0.8-1.5 BLEU on Tr-En-morph.
We observe significant gain using other embedding sizes as well.

Furthermore, in Table \ref{tab:ablation}, we investigate DenseNMT models through ablation study.
In order to make the comparison fair, six models listed have roughly the same number of parameters.
On De-En, Tr-En and Tr-En-morph, we see improvement by making the encoder dense, making the decoder dense, and making the attention dense. Fully dense-connected model \emph{DenseNMT-4L-1} further improves the translation accuracy. By allowing more flexibility in dense attention, \emph{DenseNMT-4L-2} provides the highest BLEU scores for all three experiments.

From the experiments,
we have seen that enlarging the information flow in the attention block benefits the models. The dense attention block provides multi-layer information transmission from the encoder to the decoder, and to the output as well. Meanwhile, as shown by the ablation study, the dense-connected encoder and decoder both give more powerful representations than the residual-connected counterparts.
As a result, the integration of the three parts improve the accuracy significantly.

\begin{table*}[htbp]
\small
\centering
\captionsetup{font=small}
\begin{tabular}{lccccc}
\toprule
& \multicolumn{5}{c}{\textbf{Test Set}} \\
 & \textbf{tst2011} & \textbf{tst2012} & \textbf{tst2013} & \textbf{tst2014} & \textbf{total}\\
\midrule
RNN \cite{gulcehre2015using} & 18.40 & 18.77 & 19.86 & 18.64 & / \\
\midrule
BASE &21.66 &22.45 &23.76 &22.59 & 22.62 \\
DenseNMT-8L-2 &22.52 &23.81 &23.91 &23.68 & 23.45 \\
DenseNMT-8L-2(embed 256, hid 128) &23.33 & 24.65 & 24.92 & 24.54& 24.36 \\
\bottomrule
\end{tabular}
\caption{Accuracy on Turkish-English translation task in terms of BLEU score.}
\label{tab:tr-en}
\end{table*}

\subsection{DenseNMT with smaller embedding size}
From Table \ref{tab:embed}, we also observe that DenseNMT performs better with small embedding sizes compared to residual-connected models with regular embedding size. For example, on Tr-En model,  the $8$-layer \emph{DenseNMT-8L-2} model with embedding size $64$ matches the BLEU score of the $8$-layer BASE model with embedding size 256, while the number of parameter  of the former one is only $40\%$  of the later one.
In all genres, DenseNMT model with embedding size $128$ is comparable or even better than the baseline model with embedding size $256$.

While overlarge embedding sizes hurt accuracy because of overfitting issues, smaller sizes are not preferable because of insufficient representation power. However, our dense models show that with better model design, the embedding information can be well concentrated on fewer dimensions, e.g., 64. This is extremely helpful when building models on mobile and small devices where the model size is critical. While there are other works that stress the efficiency issue by using techniques such as separable convolution~\cite{slicenet}, and shared embedding~\cite{transformer}, our DenseNMT framework is orthogonal to those approaches.
We believe that other techniques would produce more efficient models through combining with our DenseNMT framework.

\begin{table}[htbp]
\small
\centering
\captionsetup{font=small}
\begin{tabular}{lcccc}
\toprule
 & \textbf{Greedy} & \textbf{Beam}\\
\midrule
MIXER~\cite{ranzato2015sequence} & 20.73 & 21.83  \\
AC~\cite{bahdanau2016actor} & 27.49& 28.53\\
NPMT~\cite{msrphrase} &27.83 & 28.96\\
NPMT+LM~\cite{msrphrase} & / & 29.16 \\
\midrule
DenseNMT-8L-2 (word) & 29.11 & 30.33 \\
DenseNMT-8L-1 (BPE) &30.50  & 32.08 \\
DenseNMT-8L-2 (BPE)& 30.80 & 32.26 \\
\bottomrule
\end{tabular}
\caption{ Accuracy on IWSLT14 German-English translation task in terms of BLEU score.}
\label{tab:de-en}
\end{table}

\subsection{DenseNMT compares with state-of-the-art results}
For the IWSLT14 German-English dataset, we compare with the best results reported from literatures. To be consistent with prior works, we also provide results using our model directly on the dataset without BPE preprocessing. As shown in Table \ref{tab:de-en}, DenseNMT outperforms the phrase-structure based network NPMT~\cite{msrphrase} (with beam size 10) by 1.2 BLEU, using a smaller beam size, and outperforms the actor-critic method based algorithm~\cite{bahdanau2016actor} by 2.8 BLEU. For reference, our model trained on the BPE preprocessed dataset achieves 32.26 BLEU, which is 1.93 BLEU higher than our word-based model.
For Turkish-English task, we compare with~\cite{gulcehre2015using} which uses the same morphology preprocessing as our Tr-En-morph. As shown in Table \ref{tab:tr-en}, our baseline is higher than the previous result, and we further achieve new benchmark result with 24.36 BLEU average score.
For WMT14 English-German, from Table \ref{tab:en-de}, we can see that DenseNMT outperforms ConvS2S model by 0.36 BLEU score using 35\% fewer training iterations and 20\% fewer parameters. We also compare with another convolution based NMT model: SliceNet~\cite{slicenet}, which explores depthwise separable convolution architectures. SliceNet-Full matches our result, and SliceNet-Super outperforms by 0.58 BLEU score. However, both models have 2.2x more parameters than our model. We expect DenseNMT structure could help improve their performance as well.

\begin{table}[htbp]
\centering
\small
\captionsetup{font=small}
\begin{tabular}{lcccc}
\toprule
 & \textbf{BLEU score}\\
\midrule
GNMT {\tiny~\cite{gnmt}} & 24.61 \\
ConvS2S {\tiny~\cite{convs2s}} & 25.16  \\
SliceNet-Full {\tiny~\cite{slicenet}} & 25.5  \\
SliceNet-Super {\tiny~\cite{slicenet}} & 26.1  \\
\midrule
DenseNMT-En-De-15 & 25.52   \\
\bottomrule
\end{tabular}
\caption{Accuracy on WMT14 English-German translation task in terms of BLEU score.}
\label{tab:en-de}
\end{table}

\section{Conclusion}
In this work, we have proposed DenseNMT as a dense-connection framework for translation tasks, which uses the information from embeddings more efficiently, and passes abundant information from the encoder side to the decoder side. Our experiments have shown that DenseNMT
is able to speed up the information flow and improve translation accuracy. For the future work, we will combine dense connections with other deep architectures, such as RNNs~\cite{gnmt} and self-attention networks~\cite{transformer}.

redpajama_set_name: RedPajamaArXiv


Outside my window..............the sun is going down and after a rather dreary day weather wise, this evening is perfectly gorgeous.
From the kitchen.........absolutely nothing. Hubby had a Deacon supper this evening and since I wasn't very hungry, I opened a can of Chicken Noodle soup for myself. There are some very ripe bananas on the island and I really need to make some of my delicious Banana Nut Bread with them. Perhaps that will be on my agenda tomorrow.
I am wearing.......lounging pj's. It's been a bit chilly today and these are flannel and feel good this evening.
I am hoping.........to feel better when I wake up in the morning. I started feeling "yucky" about an hour after I got up this morning, sort of like I did in the early weeks of pregnancy. ~big chuckle~ I did go on and do my running around but have sort of been "laying low" this afternoon. Guess it's just some "bug." I have lots to do tomorrow and Wednesday in preparation to leave Thursday, gotta feel better.
A favorite quote..........."I've learned that people will forget what you said, People will forget what you did, But people will never forget how you made them feel." I try to think of this everyday as I come in contact with people, very profound!
One of my favorite things...........is snacking on salty potato chips. If I let myself, I could eat a bag at one sitting, but would never do that. But, I do enjoy grabbing a few periodically. Feel the same way about salty popcorn. Yummy!
A picture thought worth sharing............this is my little 19 month old Grandson's new "crocs." He was quite proud when we put them on him. I use to think they were quite ugly until I saw them on him. That changed everything!
For more Daybook reading click here.
What a blessing to have had such a sweet mama ♥ and how nice to have all those photos of the two of you.
Hope you're feeling better for your trip tomorrow. I imagine you are a ball of energy so I know being "down" has to be frustrating you. ~ Crocs are kinda ugly, but I have a pair that my husband bought me which I love! They have a pink removeable lining that you can take out and wash. I wear them around the house. They are so comfortable! Anyway. . . enjoy your trip!
Glad to hear your daughter is moving back near you. I know that makes any mom happy.
flannel pjs and some salty chips sounds perfect! :) wish I could do that today! :) enjoyed your post! and the crocs are super cute.


Lord, we come before you now as your servants, and we worship you: from sunrise to sunset your name be praised! You are exalted over all the nations, your glory fills the skies! Who is like you, enthroned on high? Yet you stoop down to look at our world; you raise up the poor and lift up the needy. Lord, we come before you now as your servants and we worship you. Amen.


You may purchase a marriage license anywhere in Colorado and use it in another county, but you must take the license back to the county where you purchased it for recording.
Marriage licenses may be researched in at the Clerk's Office. Records date back to 1885.
How can I change my name with Social Security after getting married?


Who should pay the bill for disasters like storm Irma? - Unearthed Who should pay the bill for disasters like storm Irma?
Who should pay the bill for disasters like storm Irma?
The cost of rebuilding after extreme weather events across the world is likely to skyrocket in 2017.
Right now, there is severe flooding in South Asia and fires in western Canada and United States. Hurricanes Harvey and Irma have devastated the Caribbean and parts of the southeastern United States.
Insurers are already estimating that insured damage caused by storm Irma is likely to cost the industry between $20 and $40billion, with major streets in cities across Florida still underwater.
Scientists are in broad agreement clear that the storm was intensified by our changing climate.
But who should pay for all the damage it caused?
Big fossil fuel companies contribute a disproportionate amount to climate change, so shouldn't they make a significant contribution?
Destruction at the Post Card Inn and Marina after Irma made landfall in the Florida Keys. Photo: Marc Serota / Greenpeace.
A new peer-reviewed study conducted by researchers from the Union of Concerned Scientists (UCS), the University of Oxford, and the Climate Accountability Institute, could be used to suggest just that.
The scientists reveal just how much the emissions from individual companies involved in the extraction and sale of fossil fuel products have contributed to the global rise in temperature and sea level.
If that extra carbon hadn't been added to our atmosphere, we might not be facing the climate-driven disasters we are today.
The study looks at both historical emissions (1880-2010) and recent emissions (1980-2010) linked to the 90 carbon producers.
According to the study, the period from 1980 onwards is key because at this point in time investor-owned fossil fuel companies "should have reasonably been expected to respond to evidence of the climate risks of their products".
Carbon producers have so far avoided taking responsibility for greenhouse gas emissions from their products.
The new study suggests how apportioning responsibility could work. It reads: "The proportional increase in atmospheric carbon dioxide, GMST, and GSL—key indicators of human impact on the global environment—from emissions traced to major carbon producers is quantifiable and substantial".
One such measure is that the combustion of fossil fuel products from the top 20 investor and state-owned companies from 1980 to 2010 contributed approximately 16.6% of the historic global mean surface temperature rise over this period.
People settle into an emergency shelter at the Convention Center in Houston, Texas during Hurricane Harvey. Photo: Mannie Garcia / Greenpeace.
There are already a number of legal actions involving fossil fuel companies where this new study could be used as evidence.
Filipino disaster survivors and other individuals, along with 11 NGOs including Greenpeace Southeast Asia-Philippines, triggered a first-ever national investigation into the responsibility of fossil fuel companies for human rights impacts resulting from climate change.
Two California counties and a city have filed lawsuits against fossil fuel companies demanding compensation for the current and future costs of adapting to climate-induced sea level rise.
A Peruvian farmer has sued a fossil producer and utility – RWE – in Germany. He is asking for RWE to pay its share – based on the company's contribution of greenhouse gases – of the costs to prevent further harm to his property from glacial flooding. On December 2016, a district court dismissed the case. The decision has been appealed.
There may be more legal actions on the horizon. In Canada, the District of Highlands and the District of Saanich sent letters demanding 20 of the world's largest fossil fuel companies pay their share of infrastructure costs caused by climate change impacts. These letters could inspire other municipalities in Canada and elsewhere to make similar demands.
The communities being hit the hardest by climate change are now demanding accountability from both corporations and governments. Impacted people and communities are refusing to be sacrificed to a warming climate.
The UCS-led study paves the way for holding companies liable for climate impacts, but governments share some of the responsibility and should not be considered off the hook.
With climate-related impacts already taking a massive toll and the continued lack of ambitious corporate and government action to protect communities from climate change, people will increasingly resort to the courts.
Kristin Casper is the litigation counsel for the global climate justice and liability project at Greenpeace Canada.


That, of course, will depend on your plan's rules.He has not only successfully cash creek casino resort balanced the missions of academic achievement, student-athlete development and athletic success, he has successfully developed the resources necessary to strategically position the conference for success well into the..
The only exception to this rule applies to live games.In each of the thorough online casino reviews, you can find useful details about bonuses, payment options, security, mobile apps, and much more.A safe online casino will work with non-profit making organisations, to identify ways to..
Charrua NYC 2 tahun yang lalu JeremySlat1993 4 bulan yang lalu 2018 casino fireworks.Mary Pyle 3 tahun yang lalu Seneca Casinos 6 tahun yang lalu Visit the following sites for more updates: - m -.Stay local-you have a great firework display about an hour away!Wir..
Gaming Time: 8:00am-2:00am, games to play: Slot Machines (11 total Video Poker.
If you believe your IP address has been blocked inappropriately please submit the form below with all required fields to request removal of your IP address from our Intrusion Prevention System's block list.Phone: (406) 338-5751, Fax: (406) Gaming Time: 10:00am-1:30am Restaurants: lakeside inn and casino nevada (1) Butte Gold Rush Casino, video casino games 580 20 West Galena Street, Butte, Montana, USA.Phone: (406) 252-0272, Fax: (406) Gaming Time: 8pm-2am Daily Games to play: Slot Machines (18 total) Bonner Lucky Lil's, 7995 Highway 200, Bonner, Montana 59823, USA.Montanan Land-based Gambling Casinos listing A-B: Listed by City/Province (Directory listing.Phone: (406) 494-6677, Fax: (406) Gaming Time: 6:30am-2:00am Games to play: Slot Machines (20 total Video Keno, Video Poker Restaurants/Bars: (2) - Bar (Alcoholic Drinks Casino Restaurant Suds N Fun, 2721 Harrison Avenue, Butte, Montana, USA.Phone: (406) Gaming Time: 8am-2am Daily Restaurants: (1) Lucky Lil's, 1028 Highway 87 East, Billings, Montana, USA.Jackpot Casino Bozeman with 20 gaming machines / table games.Gray Wolf Peaks Staff is here to ensure you the greatest gaming experience in Montana.Some Bozeman casinos also offer convention centers and meeting spaces.The second largest casino in Bozeman would.Phone: (406) 248-4336, Fax: (406) Gaming Time: 8:00am-2:00am Daily Games to play: Slot Machines (20 total Video Keno (10 machines Video Poker (10 machines) Empire Cardroom, 2713 Montana Avenue, Billings, Montana, USA.
Best Western Plus Hotel and Casino Gran Tree Inn.Casino assist manager at Town Pump.Jackpot Casino Bozeman information page for more details.Blackjack Roulette Poker Craps Slots Baccarat Keno Lottery Bingo Sports betting Horse racing Dog racing Other games).Phone: (406) 782-1390, Fax: (406) 497-6702, Website: m Gaming Time: 24 hours Daily Games to play: Slot Machines (20 total Progressive Poker; Video Keno, Video Poker New Hops Pub Casino (Casino located within the Hotel 2900 Harrison Avenue, Butte, Montana, USA.Phone: (406) 388-0151, Fax: (406) 497-6702, Website:.Raise your Gaming experience to new heights at Gray Wolf Peak Casino, where the winners play.Phone: (406) 248-1131, Fax: (406) Gaming Time: 8:00am-2:00am Games to play: Poker (5 tables) Restaurants: (1) Montana Nugget Casino, 2150 Grand Avenue, Billings, Montana, USA.
Billings, big B Bingo Casino, 1307 12th Street West, Billings, Montana, USA.
Are you sick of just having a job?
Phone: (406) 651-0828, Website: m Gaming Time: Sun-Thu 10:00am-12:00am, Fri-Sat 10:00am-2:00am Games to play: Slot Machines (20 total) Macuyos, 1744 Grand Avenue, Billings, Montana, USA.


DENVER – Jan. 21, 2019 – Pinnacol Assurance, Colorado's leading workers' compensation insurer, honored 29 of its policyholders with its 2018 Circle of Safety Award. Winners have shown exemplary performance in safety, loss control, and financial and claims management. Many of this year's winners maintained exemplary performance despite operating in high-risk industries such as construction, manufacturing, health care and ski resorts. They represent an array of employers in Colorado, from small, family-owned businesses to large corporate operations.