text:
The Big Fix
The Big Fix (2012 film)
The Big Fix is a 1978 film directed by Jeremy Kagan and based on the novel by Roger L. Simon, who also wrote the screenplay. It starred Richard Dreyfuss as private detective Moses Wine and co-starred Susan Anspach and John Lithgow.
A former 1960s student activist turned private detective searches for a missing Berkeley activist with whom he shared "the barricades."
Moses Wine is contacted by Lila, an old flame from his radical college days. She wants him to work for Miles Hawthorne, who is a candidate running for governor of California. Moses is told that a flyer is being distributed around the state with a doctored photo of Hawthorne standing beside a 1960s radical named Howard Eppis — a fugitive who had been convicted in absentia for inciting violence against the government — falsely claiming that Eppis is supporting him for governor. This libel is a clear attempt to destroy Hawthorne's chances for being elected.
Moses sets out to find out who is responsible — with deadly results.
This page contains text from Wikipedia, the Free Encyclopedia - https://wn.com/The_Big_Fix
The Big Fix is a 2012 documentary film about two filmmakers, Josh and Rebecca Tickell, as they travel along the coast of the Gulf of Mexico meeting the residents whose lives were changed by the 2010 BP Oil Spill. The film argues that BP has utilized the oil dispersant Corexit in the Gulf to create the illusion that the Louisiana beaches are safe and the water (and seafood) uncontaminated.
Festivals and awards
OFFICIAL SELECTION –Cannes Film Festival (The Big Fix was the only US documentary chosen as an Official Selection at the Cannes Film Festival in 2011.)
WINNER, Best Documentary – Italian Environmental Film Festival
WINNER, Best Documentary – International Water and Film Festival
OPENING NIGHT MOVIE – New Orleans Film Festival
OFFICIAL SELECTION – Durban Film Festival
OFFICIAL SELECTION – Best of Fest – IDFA
OFFICIAL SELECTION – Rio de Janeiro Film Festival
OFFICIAL SELECTION – Boulder International Film Festival
OFFICIAL SELECTION – Sedona Film Festival
OFFICIAL SELECTION – DC Environmental Film Festival
This page contains text from Wikipedia, the Free Encyclopedia - https://wn.com/The_Big_Fix_(2012_film)
The Big Fix is a 1947 film, directed by James Flood. It stars Sheila Ryan, Noreen Nash, James Brown and Regis Toomey.
The story concerns the efforts of a crooked gambling ring to fix college basketball games. This film was the final production of Producers Releasing Corporation.
After retiring from the service, Ken Williams goes back to his old school, Norton University, where he used to be an appreciated student with an expected future as a basketball player. Together with fellow veteran Andy Rawlins, Ken registers to continue and complete his studies. They are welcomed back by the student liaison for veterans, Ann Taylor, and Andy is a bit surprised by the warm welcome, since he is in the dark about Ken's previous accolades. Ken also refuses to join the basketball team, which confuses Andy even more.
Soon Ken is romantically involved with Ann, but he can't be persuaded even by her to reveal his reasons for not participating in the university basketball. He claims he has to focus on his engineering studies, and this disappoints coach Ambrose, who is eager to have him back on the team.
fixbigjets.com
fixit.com
thebiglycheegroup.com
thebiglychee.net
thebiglychee.org
thebiglychee.com
thebiglycheeonline.com
fixshipment.com
The Fix, Minus The Bear
The Fix, Wait In Vain
The Fix, Scarface
The Fix, Elbow
A swimming pool with no bodies
is a problem that we can fix.
He dropped his clothes on the chaise lounge
and asked, "Are you gonna come in?"
and in the night the only light
was the glow of the surface.
As they slid in the rest of them
continued their talking and drinking.
They'll never notice us.
So this is the difference between
living and not living
these are just bodies.
We have a purpose
and the gravity
pulling us from them to we.
The distance between our bodies
They moved slow through the current and found
their bodies touching.
Her hands move to pull him under
for some kind of kiss,
as he slides in the rest of them


Here are some pictures I grabbed out of my desktop iPhoto. I arranged them more or less in chronological order, the first one having been taken around the time of John's second marriage. Myra looks like she always looked---absolutely stunning. I was so fortunate to call her my friend. John, too, though I did not know him well until after Myra died. I write about both Myra and John in Black and White Bible.
Another important character in the book is Carlton. Here he is, August 28, 2004, walking his mother down the aisle, or rather back porch steps.
Flower girls for the occasion are granddaughter Kayla, on the right, and brand new granddaughter Ashley.
Groom looks way too serious!
I love this picture taken at Mom's 100th birthday, July 7, 2015. Sarah and Laura look exactly like they do in person, as does Mom---very smiley, good-natured and fun to be around.
Below are 3 really cool grandkids: Mitch our college man and siblings Ashley and Zach.
Here a 70-year-OLD lady who doesn't know how to act her age!


The Photoshop mockup just isn't a website.
A while back I used to always fully develop a design in Photoshop, with all the polish and finesse that could possibly fit into a flat two dimensional image and present the design to the client for approval.
This worked reasonably well when the only real interaction was the click of a hyperlink or perhaps a drop down menu. You could explain the functionality, describe the interaction and hope the client had the imagination to perceive the concept clearly enough to approve it.
Of course, we could always create several designs to demonstrate the different phases of the interactions, which took more time. In the end though, the mockups just never looked or felt like a real website, so we were always left relying on the clients imagination.
While I'm not suggesting that we shouldn't use Photoshop in the design process at all, I do recommend an agile approach of starting in Photoshop and moving to code the design as soon as possible, and then presenting the client a website concept rather than a Photoshop mockup.
In modern web design and web applications, the interactions can be just as important as the design itself and can only really be demonstrated as a web page. These interactions are ultimately what the end user experiences, and having this in mind at the start of the design phase can only help to create a quicker, seamless development path.
Photoshop concepts don't look like web pages.
Above all else, the text in Photoshop is just not the same as text on the web. When clients see a Photoshop mockup, they can get a certain expectation of how the text will look. Photoshop text appears completely different, the sharpness, the font size, the spacing.
Designing the site in code, can show the spacing of the text and paragraphs better than in Photoshop, demonstrating a more realistic, finished design.
Code early and speed up the design process.
Designing in Photoshop first and then recreating the design in HTML/CSS is extra work. You can spend a lot of time polishing a Photoshop mockup, present it to the client and then still have to code up the design and tweak it to suit the web. Start in Photoshop and move to code quickly, its a real time saver.
Use code snippets to speed up the coding of the design process. All good web designers/coders should have a collection of code snippets that they can reuse.
When designing in Photoshop, your main focus is aesthetics. By designing in HTML early, you're immediately thinking about the search engine optimization of the design.
You start to be concerned about how to treat headings and the flow of text on the page. You think about maximizing the SEO opportunities from the start of the design. All of this is important when designing for businesses – the SEO is just as important as making the site look appealing. After all, the SEO helps bring the traffic that appreciates the design.
Some may argue that it could be a waste of time coding a site and presenting the design, only to have the design rejected and start designing and coding again. The key is to really listen to the client from the very first meeting.
Most clients will have an idea of what they like and what their end users will like. If they don't, guide them early, ask the right questions and prepare them for your ideas. If you take care in the preparation, you should only ever have to code a design once.
Once you present your design to the client, its common to need to make minor style and layout adjustments. Again, its much easier to do this in the code and send the client a link to the design, rather than have to rework a Photoshop design. And you're a step closer to having the project finished, no need to re-tweak the Photoshop design, get final approval and then start coding the concept.
Moving from a Photoshop concept to coding a site as early as possible, speeds up the design process and gives a more realistic result.
The only real downside to the agile approach is that the client might start thinking that because they can see the website concept functioning as a website, the project must be almost finished. Its important to explain the design process early on, so that the client understands whats involved.
In the end though, it comes down to the client. How good you are at listening to them and how well you can communicate your ideas with them.
6 tips for choosing the best domain name How to choose a website host Conversion Rate Optimization – What is it?


TST602 RTD thermometer consists of a radius or flat mounting block in aluminium including a built-in RTD, matched to a connection cable. The sensing element includes a single Pt100, in fiberglass insulated cable, having accuracy class A or B, with 3 or 4 wires. The connection cable, with free end wires and PVC or PTFE insulated, can be selected from a wide choice of standard lengths for any application up to 70�C or 180�C. It is supplied with free end wires.
TST602 RTD thermometer is a general purpose thermometer for surface measurements. It is suitable for application on flat surfaces or pipes and is specially designed for climatisation and general application in building automation and heat exchangers.


text:
Inter – Getafe (Pick, Prediction, Preview) by 007soccerpicks.net
Inter – Getafe (Pick, Prediction, Preview)
Inter vs Getafe Prediction & Tips
Inter Milan and Getafe face each other next Wednesday, August 5, in the Europa League round of 16, in a match that will be played at the Veltins Arena, in Gelsenkirchen, Germany. The first leg was not played due to the coronavirus outbreak in Italian territory and the tie will be played in just one match in a neutral field. Inter come to this match with their situation already defined in Serie A, knowing that next season they will participate in the Champions League. Antonio Conte's men are only looking to secure second place, as Juventus have already celebrated another title. Getafe returned to star in a positive campaign in La Liga, albeit without the brilliance of 2018/19. The emblem on the outskirts of the Spanish capital was once again close to the qualifying zone for the Champions League, but ended up not even qualifying for the Europa League, finishing in eighth place. Promise.
In four of Getafe's last five games there have been less than 2.5 goals.
Inter have not conceded goals in three of their last four commitments.
Getafe has scored just one goal in their last five games.
Getafe stands out for its defensive organization and that is why we expect a game without large spaces.
Inter – Getafe FREE TIPS
Inter – Win @ 1.65

redpajama_set_name: RedPajamaCommonCrawl


text:
Toledo City Council to vote on supplemental funding for International Park Storage Basin project
By: Tim Schneider, Toledo Regional Chamber of Commerce
At its regular meeting at 4:00 p.m. today, Toledo City Council is expected to vote on Ordinance 337-18 which would accept a supplemental $2,560,810 loan from the Ohio EPA for the International Park Storage Basin Project. The ordinance also appropriates $20,000 for loan application fees and other non-loan funded project costs. Factors increasing costs include site conditions discovered during tunneling operations, inclusion of pavement reconstruction on a portion of Richard W. Boers Drive, and postponement of installing an 84 inch diameter pipe across Main Street to lessen impact on local businesses. The storage basin project is part of the overall Toledo Waterways Initiative and includes construction of the basin, dewatering pump station, outfall, diversion structures and conveyance piping to meet requirements of a consent decree with the U.S. EPA.
Other legislation expected to be voted on include the following:
Ordinance 341-18 which would approve $74,200 for the second phase of the Nutrient Sources and Amounts Assessment Plan being conducted in partnership with the Lucas County Commissioners and the Lucas County Sustainability Commission. The plan is aimed at mapping nutrient sources potentially contributing to harmful algal blooms in the western Lake Erie basin.
Ordinance 345-18 which would authorize $230,000 from the Capital Improvement Program (CIP) fund for the reconfiguration of the traffic signals on Huron Street between Adams Street and Cherry Street to accommodate a two-way traffic pattern. The funding was included in the 2018 CIP budget already approved by City Council.
Resolution 347-18 which would vacate Riverside Drive between Morrison Drive and the National Museum of the Great Lakes in East Toledo for use by Metroparks Toledo as part of the master plan for redevelopment of the Marina District.
Votes are also expected on several land use related measures recently approved by Council's Zoning and Planning Committee including the following:
Ordinances 348-18 and 349-18 which would respectively approve Edgebrook Development Company's requests for a zone change and an amendment to an existing planned unit development for a multi-family unit development on a four acre site at 2757 Gardengate Place.
Ordinance 350-18 which would approve Maumee River Estates, LLC's and Knight Insurance's request for a zone change to facilitate building renovation and expansion on a 0.38 acre site located at 614 and 618 Washington Street and 14 North Erie Street.
Ordinance 353-18 which would require special use permits and establish definitions and parking requirements for Sweepstake Terminal Cafes. The ordinance would also establish a 2,000 foot spacing requirement between such businesses, and a 1,000 foot requirement between schools, parks, libraries, day care centers, or other sites used by minors.
After delaying a vote at a previous session, Council is also likely to vote on a series of ordinances levying special assessments for various public service expenses in 2017. These include $17,753,811 for various street services, $3,454,543 for city-wide street lighting, $249,868 for downtown street lighting, $4,008,107 for tree maintenance, and $11,473 for noxious weeds on vacant properties.
Council could also vote on collective bargaining agreements reached with Toledo Firefighters Local 92 and AFSCME Local 2058. The contract terms with the firefighters include base pay increases of 1.5 percent for 2018, 2.5 percent for 2019, and 3 percent for 2020. The agreement with AFSCME Local 2058 includes base pay increases of 1.5 percent for 2019, 2.5 percent for 2020, and 3 percent for 2021.
All Council meetings are held in Council Chambers on the first floor of One Government Center, located on Jackson Boulevard in downtown Toledo.
Tim Schneider
As Manager for Local Government Advocacy, Tim Schneider advocates for local policies and laws that safeguard and foster a pro-business environment in the Toledo Region. Tim has more than 10 years of legislative and public policy experience with the local, state and federal levels of government.


text:
Event Category: Critical Minds
Home > Events>Critical Minds
A Conversation on "God: An Anatomy"
This event is part of our Critical Minds series to be held January 27, 2-3:30 pm ET on Zoom (americanhumanist.org/CriticalMinds) and will be recorded to be shared in Programs & Webinars. People around the world…
How to Nurture Curiosity & Critical Thinking Skills in Kids
This event is part of our Critical Minds series to be held December 7, 6:30-8:00 pm ET on Zoom (americanhumanist.org/CriticalMinds) and Facebook Live (facebook.com/americanhumanist/live), and will be recorded to be shared in Programs & Webinars. J.R.…
Science and the Future of Humanism
This event is part of our Critical Minds series to be held October 12, 7-8:30 pm ET on Zoom (americanhumanist.org/CriticalMinds) and will be recorded shared in Programs & Webinars. Topic will be expanded in Further Reflections on…
UFOs Are All The Rage!
This event is part of our Critical Minds series to be held August 12, 6:30-8 pm ET on Zoom (americanhumanist.org/CriticalMinds) and will be recorded shared in Programs & Webinars. Sidewalk Science, a twice-monthly YouTube broadcast…
Debunking Myths about Poverty in America
This event is part of our Critical Minds series held November 16, 6:30-8 pm ET on Zoom (americanhumanist.org/CriticalMinds) and recorded to be shared in Programs & Webinars. Few topics have as many myths, stereotypes, and…
Addressing Indigenous Health Disparities
This event is part of our Critical Minds series held May 20, 7-8:30 pm ET on Zoom (americanhumanist.org/CriticalMinds) and recorded to be shared in Programs & Webinars. Indigenous people experience disproportionately high rates of chronic…
Intro to Reproductive Justice and Intersectionality
This event is part of our Critical Minds series held April 20, 7-8 pm ET on Zoom (americanhumanist.org/CriticalMinds) and recorded to be shared on this site Programs & Webinars. This session will introduce attendees to…
How America lost its mind: Can science shed light on the rise of conspiracy theories and delusions?
This event is part of our Critical Minds series held February 23, 6:30-8:00 pm central standard time on Zoom (https://zoom.us/j/97965371498) and recorded to be made available on this site Programs & Webinars. The capitol…
Human Brain Evolution
This event is part of our Critical Minds series held on Zoom (https://zoom.us/j/97965371498) and recorded to share on our website. How did a weak and fragile ape come to dominate the world today? One ingredient…
Art, Imagination, and Humanism—Humanitas
We suggest viewing the film before joining the discussion on June 25th. We'll be streaming this talk on Zoom 6:30-8pm ET: https://zoom.us/j/97965371498 Jé Hooper, Director and Creator of "Humanitas: A Conscious Coloring of Kindness," will…


text:
Q: Drawing to a Windows device context (hWnd/hDC) from WPF MediaPlayer/DrawingVisual or convert to System.Drawing.Graphics I need to draw a video to another window where I could get the device context hDC using GetDCEx. I can already achieve drawing using System.Drawing.Graphics:
g = Graphics.FromHdc(hdc);
// Now I need to get the video frame/bitmap here
g.DrawImage(frameBitmap, 0, 0);

However I don't think System.Drawing has any class for video rendering, so I plan to use System.Windows.Media.MediaPlayer. However, the best I could do is to get it to RenderTargetBitmap. There is a way to use an encoder to render to Bitmap file and then decoding it to System.Drawing.Image, but I think it would be too slow.
So either of these can solve my problem, please tell me if any is possible:

*

*Can a WPF DrawingVisual draw on a hDC?

*Can a DrawingVisual somehow draws on a Graphics?

*A quick way to get System.Drawing.Bitmap from DrawingVisual/MediaPlayer/VideoDrawing?

A: I am using Bitmap data copying (LockBits) and it's fast enough. Thanks to this answer.
    public Bitmap Render()
    {
        var bitmapRender = this.CreateRenderTargetBitmap();

        using (var drawingContext = this.drawingVisual.RenderOpen())
        {
            drawingContext.DrawVideo(this.MediaPlayer, this.drawingRect);
            drawingContext.Close();
        }

        bitmapRender.Render(this.drawingVisual);

        var result = new Bitmap(this.Width, this.Height, DrawingPixelFormat);
        var bitmapData = result.LockBits(
            this.renderRect,
            System.Drawing.Imaging.ImageLockMode.WriteOnly,
            DrawingPixelFormat);

        bitmapRender.CopyPixels(
            Int32Rect.Empty,
            bitmapData.Scan0,
            bitmapData.Stride * bitmapData.Height,
            bitmapData.Stride);

        result.UnlockBits(bitmapData);

        return result;
    }

    RenderTargetBitmap CreateRenderTargetBitmap() => new RenderTargetBitmap(
            this.Width, this.Height,
            this.Dpi, this.Dpi,
            WpfPixelFormat);

redpajama_set_name: RedPajamaStackExchange


Freshen up your bedroom with the beautiful hues and floral designs of the Marianne Collection 3-Piece Printed Quilt Set. This quilt- and-shams set can add a warm spring touch to any decor. Plus, since the quilt is constructed from a mix of cotton and durable man-made fibers, it's super strong and easy to care for.


text:
Toto je seznam dílů seriálu Jen vraždy v budově (v anglickém originále Only Murders in the Building). Americký mysteriózní, kriminální a komediální seriál Jen vraždy v budově měl premiéru dne 31. srpna 2021 na platformě Hulu.

Přehled řad

Seznam dílů

První řada (2021)

Druhá řada (2022)

Třetí řada

V červenci 2022 bylo oznámeno, že seriál bude obnoven pro třetí řadu.

Reference

Seznamy dílů amerických televizních seriálů

redpajama_set_name: RedPajamaWikipedia


text:
Q: Shooting a projectile in spritekit I am looking to shoot a SKSpritenode (a cannonball) from a another Sprite node (enemy ship).
The cannonball should travel directly down toward bottom of screen from the enemy ship node.
I can't seem to get positioning right, cannonball seems to shoot from the corner of the screen and not move far, the enemy-ship node is randomly chosen from an array of all halos on screen at once and the cannonball position assigned to the front of halo:
// the cannonball
ball.physicsBody = [SKPhysicsBody bodyWithCircleOfRadius:6];
    ball.physicsBody.velocity = CGVectorMake(SHOT_SPEED, SHOT_SPEED);

    // we dont want ball to lose speed or momentum when it hots edges so..
    ball.physicsBody.restitution=1.0;  // max bounceness of node
    ball.physicsBody.linearDamping =0.0; // dont reduce linear velocity ove time
    ball.physicsBody.friction=0.0;

    ball.physicsBody.categoryBitMask = kCCBallCategory;
    // ball.physicsBody.contactTestBitMask = kCCEdgeCategory;
    ball.physicsBody.collisionBitMask= kCCEdgeCategory;
    ball.physicsBody.contactTestBitMask = kCCEdgeCategory | KCCShieldUPCategory | kCCMultiUpCategory ; // | KCCShieldUPCategory notify

// the array of enemy ship nodes
NSMutableArray *allHalos = [NSMutableArray array];
[_mainLayer enumerateChildNodesWithName:@"halos" usingBlock:^(SKNode *node, BOOL *stop) {
    [allHalos addObject:node];
}];

if ([allHalos count]>0) {
        NSUInteger allHalosInteger = arc4random_uniform([allHalos count]);
        SKSpriteNode *shooterHalo=[allHalos objectAtIndex:allHalosInteger];
        ball.position = CGPointMake(shooterHalo.position.x, shooterHalo.position.y - shooterHalo.frame.size.height/2 + ball.frame.size.height / 2);

        CGPoint bulletDestination = CGPointMake(shooterHalo.position.x, - ball.frame.size.height / 2);

        [self fireBullet:ball toDestination:bulletDestination withDuration:2.0 ];

    }

-(void)fireBullet:(SKNode*)ball toDestination:(CGPoint)destination withDuration:(NSTimeInterval)duration  {
    //1
    SKAction* bulletAction = [SKAction sequence:@[[SKAction moveTo:destination duration:duration],
                                                  [SKAction waitForDuration:3.0/60.0],
                                                  [SKAction removeFromParent]]];

    [ball runAction:[SKAction group:@[bulletAction, _soundLaser]]];

    [self addChild:ball];
}

Any input appreciated.


WATCH | This uber-traditional South Korean treat is as tasty as it is beautiful and unique. That's a shaved ice snow bowl, drenched in sweet matcha, and topped with classic red bean porridge. The flavors are quintessentially Korean and Asian.
There are tons of places around LA's famed Koreatown that serve sweet treats, but Okrumong is known for this snow bowl, in particular.
Their most popular is the matcha green tea flavor. It's made with a matcha/condensed milk syrup that turns the white frost into a slightly sweet, brilliantly green snow bowl.
And it's topped with another very classic Asian food item: mochi. These are coconut mochi balls, which add yet another layer of texture and flavor to the snow bowl.
Check this one out - it's a sesame snow bowl that "will tingle your tastebuds!"
The whole flavor profile is subtle, sweet, and refreshing. The bowl at Okrumong is so tasty, one could easily forget their not actually at some cafe in Seoul.
Check out another sweet treat that hopped the pond from South Korea - a tusk ice cream cone.


text:
Home Asian News Kerry visits China-US climate cooperation regeneration - The Diplomat
Kerry visits China-US climate cooperation regeneration – The Diplomat
In this June 26, 2016 file photo, then Secretary of State John Kerry emerged from his plane after landing at Fiumicino International Airport in Rome, Italy,
Credit: Photo of the US Department of State
John Kerry, formerly US Secretary of State and currently the President's special envoy for the climate, was in Shanghai from April 14-17 to discuss climate issues. This is the first high-level visit by a Biden administration official to China, a sign of the vital role climate issues play in this relationship. During his visit, Kerry met with his counterpart, China's Climate Special Envoy Xie Zhenhua, as well as with Deputy Prime Minister Han Zheng, a member of China's top political body, the Commission. Standing of the Politburo.
"During the talks, the two sides had a frank, insightful and constructive exchange on climate change cooperation, the Summit of Climate Leaders, COP26 of the UNFCCC and progress made. positive, "State Department spokesman Wang Wenbin said in a news conference in April 19." They reopened the channel for dialogue and climate change cooperation between China and the US. "
He added, "The two sides will continue to maintain communication, dialogue and strengthen exchanges and cooperation in areas such as introducing stronger policies and measures, promoting the green transition, low-carbon and supporting low-carbon energy development in developing countries ".
According to one statement from China's Ministry of Ecology and Environment, China and the United States "also vowed to formulate a long-term strategy to realize carbon neutrality and net greenhouse gas emissions before COP 26", to take place in November 2021 in Glasgow, President Xi Jin British Binh announced that China would set its net zero net emissions target by 2060 in a surprise statement last fall, while the Biden administration has set 2050 as a target date for the U.S. to reach it. same goal.
The General statement Kerry's post-trip pledges three specific actions for China-US climate cooperation "in the short term." First, as mentioned above, both sides will devise their own long-term strategies to achieve the previously achieved goals of achieving net zero emissions.
Do you like this article? Click here to register for full access. Just $ 5 a month.
Second, "Both countries intend to take appropriate action to maximize international investment and finance to support the transition from high-carbon fossil fuels. to green energy, low carbon and renewable energy in developing countries. " This could be an important area of cooperation, if China and the United States work together to fund green transitions in developing countries. Currently, China is one of the world's leading investors in coal-fired power plants abroad, and the United States primarily framed investments in renewable energy as an alternative to its option. China, which increases geopolitical costs for third countries. If the two sides cooperate on such projects instead, there will inevitably be more interested parties.
Finally, both China and the US pledged to continue phasing out hydrofluorocarbon production and consumption under the Montreal Protocol's Kigali Amendment.
Diplomatic summary
Get story summaries of the week and develop stories to watch across Asia Pacific.
The statement also pledged to discuss further "specific actions in the 2020s to reduce emissions to keep the Paris Agreement temperature limit within reach", including on renewable energy technology. generation (including hydrogen energy and carbon capture), green transport options and agro-climate resilient, among other sectors.
During the previous Obama administration in the United States, climate change was an important part of the Sino-US relationship, underlined by a key bilateral agreement on climate change that paved the way for the Agreement. Global Paris 2015. But Obama's successor, President Donald Trump, withdrew the US from the Paris climate deal and downgraded climate change mitigation efforts. As a result, climate cooperation under Trump was withered even before the rest of the rifting relationship between the trade war and the COVID-19 pandemic. Meanwhile, the Xi regime in China has gone in the opposite direction, through environmental protection is one of its main management goals.
Mr. Kerry's visit inevitably puts climate change back on the US-China agenda. It could be one of the few areas where the two sides can truly cooperate – if they can keep other areas of tension from spotting. It is no easy task, as one of the key elements of any climate change strategy is the pursuit of energy technology, folding into the broader competition between China and the United States for won the leading position in technology in many fields.
"Both countries look forward to the Climate Leaders Summit hosted by the United States on April 22, 2013," the joint statement said. However, China's Foreign Ministry declined to confirm whether Xi will participate in the virtual summit later this week.
"The Chinese side has received an invitation from the US side, and is actively looking at that," said State Department spokesman Wang Yi. when asked about Xi's attendance.
Previous articleApple allows Parler to return to the App Store prior to hearing against trust | Business and economic news
Next articleThe first sweater with NFT technology was sold, that is, as an irreplaceable token for 500k pesos


573 - Look Mum, No Mermaids!
Remember that guy in the Truman Show who pretends to be the protagonist's best buddy ? Who takes him out for a few brewskis on the beach when Truman starts to suspect he's at the centre of... something? The buddy offers Truman the proverbial shoulder to cry on, but his apparent sincerity is fake. He too is part of the conspiracy, merely part of the décor, his friendship no more than cardboard.
That's what coffee-shop chains feel like. They'll take your personalised order and write your name on the cup so it can be shouted out when your overpriced designer coffee is ready. But the tailor-made, name-tagged treatment is the illusion that masks a hyper-streamlined experience. Every store you enter will have the same menu and meet your expectations for the music, the snacks, the look and feel of the furniture.
Coffee chains are conveniently uniform, but uniformly bland. Hence the aromatic blend of love and hate they engender in their 'heavy users' - that guild of professionals born in the internet age, hooked on power sockets and Free Wi-Fi . These e-nomads, liberated by their laptops from the drudgery of static jobs, are now free to roam whole networks of 'third places' - all looking, smelling, sounding and tasting exactly the same.
It doesn't have to be that way. You could step outside of your comfort zone, and take your laptop - or even, come to think of it, your coffee - elsewhere. This charming map, produced by Herb Lester Associates , locates a number of locations in Central London where you can have coffee, meet with friends or business contacts, or work on your next blog post, without having to tango with the twin-tailed mermaid.
Northwest quadrant, including the Wallace Collection, "remarkably off the beaten path".
Northeast quadrant, including the "notoriously confusing" Barbican.
Southwest quadrant, including the Serpentine Boating Lake, "for those really secret meetings."
Southeast quadrant, including Bermondsey Street Cafe, "with a distracting view of the unfolding street scene".
Longer descriptions on the flipside of this map, which can be found in selected bookshops, or obtained directly via the Herb Lester Associates website.
 Marlon, as played by Noah Emmerich, whose face seems purpose-built to convey disingenuity; hence often typecast as the mole, the backstabber, the dirty cop, etc.
 A small outfit specialising in cool stationery and quirky city maps. Not associated with yours truly.


text:
December is bribery season in North Korea as public enterprises seek 2023 funding
To ensure their funding isn't cut, organizations pay off officials with alcohol and gasoline coupons
By Chang Gyu Ahn for RFA Korean
North Korean women sweep a road in Pyongyang, North Korea, May 6, 2016. Budget-based companies in North Korea include urban beautification and rely on government funding to pay workers' salaries and buy equipment.
It's bribery season in North Korea.
Every December, state-run enterprises submit their budget proposals to treasury officials – and bribes to keep their funding from getting reduced, sources in the country tell Radio Free Asia.
In North Korea, many institutions – utilities, schools and hospitals – rely on government funding for all of their revenue.
If their funding declines, they will have difficulty paying wages to employees, or they may be unable to deliver vital services to the public, according to an official at one of these organizations in the coastal city of Tanchon, who talked to Radio Free Asia on condition of anonymity for security reasons.
"To get even a little more funding, [enterprises] must bribe officials who control the budget," he said.
His organization gave government officials 20 kilograms of alcohol and 10 gasoline coupons each, – a bribe worth about U.S.$160 together, he said. "The budget review was completed without any issue."
Authorities are reluctant to accept the bribes in cash in such an official setting, so instead, commodities that can be used, or readily be converted into cash are exchanged, the source said.
Bribery is a way of life in North Korea, where meager government salaries are not enough to survive on. Many people pick up side jobs to make ends meet. Police and other local government officials regularly accept bribes to supplement their income, sources in the country tell RFA.
Even central government officials and high-ranking members of leader Kim Jong Un's inner circle live off of what others will pay them in exchange for favors.
A company in the northern province of Ryanggang sent its representatives to negotiate the budget with the provincial government four separate times in November and early December, one of the company's employees told RFA on condition of anonymity to speak freely.
"The company officials have no choice but to go see the senior officials and bribe them," the employee said. "It is rare for a budget submitted without bribery to be passed as is."
If funding is cut, "the damage is passed on to residents," the first source said.
For example, if an urban developer loses some funding, ordinary citizens are forced to provide free labor for maintenance on roads and parks. Or if a sewage operator gets less government support, that means residents are recruited to run water treatment facilities and clean out sewers, he said.
According to South Korea's national bank, the North Korean government's budget in 2021 was about $9.1 billion, less than 1/40 of the more prosperous, democratic South.
Translated by Claire Shinyoung Oh Lee and Leejin J. Chung. Written in English by Eugene Whong. Edited by Malcolm Foster.
Rising food prices sap North Koreans' holiday cheer ahead of Lunar New Year


We've done away with the hourly-rate model that allowed moving companies to take "lunch breaks" on your dime. With our payment model you'll know how much you'll pay long before our trucks show up. That alone was enough to set us apart, but we wanted to make the moving experience even better.
Our fleet of trucks are designed specifically for moving, down to the smallest detail. For example, they have a low floor height. That means they're easier and safer to load and unload (unlike most delivery trucks that are built for loading bays). We'd love to get into the specific details of the most efficient load doors, walkboards, and best fuzzy dice color, but we don't want to bore you.
We're more than moving trucks and manual labor. We really care about improving our customers moving experience. Thats why 95% of our customers use us again. (Check out our testimonials for all the reasons why) We like to think it's because of our flat rate pricing, professionalism, and rugged good looks.
We'd love to be your total moving solution.


Offering a laid back and relaxing atmosphere, Apartotel Flamboyant offers guests a beachy getaway. This hotel provides various amenities while also being located in the heart of a small town close to many activities.
Apartotel Flamboyant welcomes guests from its beachfront location to enjoy the beauty of the area and enjoy a relaxing getaway. The hotel is right in Jacó Beach. Guests can enjoy the sand and surf at their leisure, along with the other sites of this quaint resort town. The location is perfect for special occasions, such as a honeymoon, or just a fun family vacation.
With 22 rooms, the Apartotel Flamboyant provides room enough for your whole group. Guests will enjoy the swimming pool and whirlpool, along with the BBQ grills freely available. They are treated to laundry service, daily housekeeping and a helpful front desk that will help arrange tours and obtain tickets. The hotel also offers free parking and provides free WiFi.
The hotel is spread across two buildings, and the grounds treat guests to a stunning garden featuring the natural beauty of this area. While it is a well-kept and maintained hotel, the atmosphere is very laid back. It is not pretentious but is friendly and makes every guest feel at home in a natural way. This is part of what makes it a great place for families. Guests of every age can enjoy the hotel and its grounds.
The relaxed style of the hotel and the accommodating staff make Apartotel Flamboyant the right choice for guests who really want a comfortable experience where they can make a home away from home. Rooms, while simple in design, offer amenities that provide comforts guests need, such as coffee makers and in-room safes. They become a safe haven for guests to rest and recharge before enjoying the many activities in the area.
Guests are fully immersed in the culture of the area as well. Decor and design around the hotel feature colors that fit right in with the tropical climate. Wonderful weather and the nearby beach enable guests to enjoy the nature beauty of Costa Rica at their own pace. Being situated in the heart of the town also gives guests a chance to mingle with locals and get a taste of life in the area. This makes a stay here more enjoyable and more of an experience rather than just a trip.
Apartotel Flamboyant offer three room style options for guests and two options for larger apartments. Rooms come with air conditioning, private baths and amazing views.
Standard Room - This style of room come with one king size bed or two double beds. Rooms also feature a balcony.
Studio Room - Rooms in the studio style are located on the ground floor and each have a private terrace. This room comes with two double beds.
Superior Room - A step up from the standard and studio rooms, this style offers more luxury. It comes with two double beds and a private terrace. It also has a full kitchen.
One Room Apartment - This is the smaller of the apartment styles with a dining room, kitchen, bathroom, living room and master bedroom with one double and one single bed. They either have a terrace or balcony.
Two Room Apartment - More spacious, this apartment style also has a living room, kitchen, dining room and balcony. It has two bedrooms and two bathrooms.
Tortuga Island Tour - Visitors can explore the island and relax on its beaches. This can be a fun day tour activity.
Carara Biological Reserve - Guests can explore this tropical conservation area. They can see a range of native plants, trees and animals.
Horseback Riding - Those who want to explore the area may consider taking off on horseback. Tours provide opportunities for riders of different skill levels.
Waterfall Tours - Visitors get a chance to take in the beauty of the areas waterfalls. Hikes to these locations allow guests to also explore the area.
Sports Fishing - Guests get a chance to explore the waters around the area. Fishing activities provide a chance to see local fish species while relaxing on the water.
"This is a wonderful apartment hotel to stay in. It is totally secured by fencing and sits right on the ocean. The rooms are very clean. Just outside the hotel gate (within 100 yards) is the main street of Jaco. Plenty to do...shopping, dining and enjoying the culture. I would recommend this hotel to anyone."


text:
Justia Forms Business Contracts Air Transport Services Group, Inc. Description of Capital Stock registered under the Securities
Description of Capital Stock registered under the Securities Exchange Act
EX-4.3 2 exhibit43-xdescription.htm EXHIBIT 4.3 Exhibit
The following description summarizes information about the common stock, par value $0.01 per share, of Air Transport Services Group, Inc. (the "Company"). Such common stock is the only class of securities which the Company has registered under Section 12 of the Securities Exchange Act of 1934, as amended. The following summary is subject to , and qualified in its entirety by reference to the Company's Restated Certificate of Incorporation, as amended (the "Certificate of Incorporation") and the Company's Amended and Restated Bylaws, as amended (the "Bylaws"), copies of which have been filed by the Company as exhibits to the Company's annual report on Form 10-K, as well as the Delaware General Corporation Law.
Authorized Capital Stock
The Company's authorized capital stock consists of 170,000,000 shares, of which 150,000,000 shares are common stock, par value $.01 per share and 20,000,000 shares are preferred stock, par value $.01 per share. As of March 2, 2020, 59,329,431 shares of common stock were issued and outstanding, and no shares of preferred stock were issued or outstanding. The Certificate of Incorporation authorizes the issuance of 75,000 Series A Junior Participating Preferred Stock, none of which have been issued.
Each share of common stock entitles its holder of record to one vote on all matters voted on by stockholders. The Certificate of Incorporation does not provide for cumulative voting in the election of directors. Accordingly, holders of a majority of the outstanding shares of common stock voting in the election of directors are able to elect all of the directors, if they choose to do so, subject to any rights of the holders of any preferred stock to elect directors. Subject to any preferential or other rights of any outstanding series of preferred stock that may be established by the Board of Directors, the holders of common stock are entitled to (i) such dividends as the Company's Board of Directors may declare from time to time from legally available funds and (ii), upon the Company's dissolution, will be entitled to receive pro rata all of the assets of the Company available for distribution to stockholders, except that such rights upon dissolution of non-U.S. citizens are limited as described below under "Limitations on Foreign Ownership."
Holders of common stock have no preemptive rights, conversion rights or other subscription rights. The rights, preferences and privileges of holders of common stock are subject to, and may be adversely affected by, the rights of the holders of shares of any series of preferred stock that the Company may designate and issue in the future. A description of the preferred shares follows.
The Certificate of Incorporation authorizes the Board of Directors, without action by the Company's stockholders, to provide for the issuance of shares of preferred stock in one or more classes or series, and to fix for each such class or series the voting powers, designations, preferences, limitations, and restrictions. The rights of any class or series of preferred stock may be greater than the rights attached to the common stock. It is not possible to state the actual effect of the issuance of any class or series of preferred stock on the rights of holders of common stock until the Board of Directors of the Company determines the specific rights attached to that preferred stock. The effects of issuing preferred stock could include one or more of the following:
restricting dividends on the common stock;
diluting the voting power of the common stock;
impairing the liquidation rights of the common stock; and
delaying or preventing a change of control of the Company.
Limitation on Voting by Foreign Owners
In furtherance of the Company's stock ownership restrictions which are described below, a transfer of shares of any class of the Company's capital stock to an Alien will not be valid, except between the parties to the transfer, until the transfer is recorded on the Company's foreign stock record, which is a record maintained by the Company which records the date of a transfer to an Alien, the parties to the transfer and the number and description of the shares of stock transferred to an Alien. The Certificate of Incorporation defines "Alien" as: (i) any person who is not a citizen of the United States ("U.S. Citizens") as defined in 49 U.S.C. Section 40102(a)(15), or any nominee of such person; (ii) any foreign government or representative thereof; (iii) any corporation organized under the laws of any foreign government; or (iv) any corporation, partnership, trust, association, or other entity which is an Affiliate of an Alien or Aliens. "Affiliate" has the meaning set forth in Rule 12b-2 of the General Rules and Regulations under the Securities Exchange Act of 1934, as amended (the "Exchange Act").
Beneficial Ownership Inquiry
The Company may by written notice (including by proxy or ballot) require a person who is the record holder of the Company's capital stock or a person with beneficial ownership of such stock to certify that, to the knowledge of such person:
all stock of the Company which such person has record ownership or beneficial ownership are owned and controlled only by U.S. Citizens; or
the number and class or series of stock of the Company owned of record or beneficially owned by such person that are owned or controlled by Aliens.
"Beneficial ownership" and "beneficially owned" refer to beneficial ownership as defined in Rule 13d-3 (without regard to the 60-day provision in paragraph (d)(l)(i) thereof) under the Exchange Act.
With respect to any equity securities identified by such person in response to the beneficial ownership inquiry, the Company may require such person to provide further information as the Company may reasonably require in order to implement the provisions restricting ownership.
If a person fails to provide the certificate or other information to which the Company is entitled, the Company will presume that the equity securities in question are owned or controlled by Aliens.
Limitations on Foreign Ownership
The Certificate of Incorporation restricts ownership or control of the Company by non-U.S. Citizens. Ownership or control of (1) twenty-five percent (25%) (the "Maximum Voting Percentage") or more of the issued and outstanding Voting Stock (as defined below) of the Company or (2) shares of capital stock of the Company entitled to receive fifty percent (50%) (the "Maximum Economic Percentage") or more of the Company's dividends, distributions or proceeds upon liquidation, by persons who are not U.S. Citizens is prohibited; provided, however, that the Maximum Voting Percentage shall be deemed to be automatically increased or decreased from time to time to that percentage of ownership which is then permissible by persons who are not U.S. Citizens under applicable Foreign Ownership Restrictions; provided, further, that the Board of Directors, by a majority vote of the independent directors, may increase or decrease the Maximum Economic Percentage if the Board of Directors in good faith, and upon advice of independent counsel, determines that such increase or decrease is permitted by applicable Foreign Ownership Restrictions. As used in the Certificate of Incorporation, "Voting Stock" means common stock, and any other classes of stock issued by the Company that are entitled to vote on matters generally referred to the stockholders for a vote. "Foreign Ownership Restrictions" means United States statutory and United States Department of Transportation regulatory or interpretive restrictions on foreign ownership or control of the Company, the breach of which would result in the loss of any operating certificate or authority of the Company or any of its subsidiaries, including any successor provisions or regulations thereto.
A transfer of shares of any class of stock of the Company to an Alien will not be valid, except between the parties to the transfer, until the transfer shall have been recorded on the foreign stock record of the Company. At no time shall ownership or control of shares representing more than the lesser of (i) the Maximum Voting Percentage of the issued and outstanding Voting Stock, or (ii) the Maximum Economic Percentage of all shares of stock of the Company, be registered on the foreign stock record. If at any time the Company determines that shares of stock are purportedly owned or controlled by one or more Aliens who are not registered on the Foreign Stock Record, the registration of such shares shall, subject to the limitation in the preceding sentence, be made in chronological order in the foreign stock record, based on the date of the Company's finding of ownership or control of such shares by an Alien. If at any time the Company determines that the number of shares of Voting Stock registered on the foreign stock record exceeds the Maximum Voting Percentage, or that the number of shares of stock of the Company registered on the foreign stock record exceeds the Maximum Economic Percentage, sufficient shares shall be removed from the foreign stock record in reverse chronological order so that the number of shares of Voting Stock registered on the foreign stock record does not exceed the Maximum Voting Percentage and so that the number of shares of stock of the Company registered on the foreign stock record does not exceed the Maximum Economic Percentage. Shares of stock of the Company known by the Company to be held of record or controlled by Aliens and not registered on the foreign stock record are at no time entitled to vote or to receive dividends, distributions or other benefits of ownership.
Anti-Takeover Effects of Provisions of the Company's Certificate of Incorporation and Bylaws
Some provisions of the Certificate of Incorporation and Bylaws, including the following, could have the effect of making it more difficult for a third party, or discouraging a third party from attempting, to acquire control of the Company without the approval of the Company's Board of Directors:
Stockholder Action
The Certificate of Incorporation provides that any action required or permitted to be taken by the Company's stockholders must be taken at a duly called annual or special meeting of stockholders and may not be taken by written consent. These provisions may have the effect of delaying approval of a stockholder proposal until the next annual meeting or until a special meeting could be convened.
Advance Notice Procedures
The Bylaws provide that stockholders seeking to bring business before an annual meeting of stockholders, or to nominate candidates for election as directors at an annual meeting of stockholders, must provide timely notice in writing, subject to the exception noted below under "Board of Directors." To be timely, a stockholder's notice must be delivered to or mailed and received at the principal executive offices of the Company not less than
90 days nor more than 120 days prior to the anniversary date of the immediately preceding annual meeting of stockholders. The Bylaws also specify requirements as to the form and content of a stockholder's notice. These provisions may preclude stockholders from bringing matters before an annual meeting of stockholders or from making nominations for directors at an annual meeting of stockholders. The Bylaws include different requirements for stockholders who call special meetings of stockholders.
The Certificate of Incorporation provides that the number of directors of the Company shall be not less than three nor more than twleve, with the exact number being fixed from time to time, within such limits, by the Board of Directors. Each nominee for director stands for election to a one-year term expiring at the next annual meeting of stockholders and until his or her successor is duly elected and qualified, subject to such director's earlier death, resignation, retirement or removal from service
The Bylaws provide that, in an uncontested election, each director will be elected by a majority of the votes cast. A "majority of the votes cast" means that the number of shares voted "For" a nominee exceeds the number of shares voted "Against" that nominee. The Bylaws include a director resignation policy providing that, in any uncontested election, in order for any person to become a nominee for the Board, that person must submit an
irrevocable resignation from the Board, which will become effective if that nominee does not receive a majority of the votes cast and the Board determines to accept such resignation.
The majority voting standard does not apply, however, in a contested election of directors. An election is deemed to be a contested election if the number of nominees for election as directors at the meeting in question nominated by (i) the Board, (ii) any stockholder, or (iii) a combination thereof exceeds the number of directors to be elected. In such circumstances, directors are instead elected by a plurality of the votes cast, meaning that the nominees receiving the most votes are elected. The determination as to whether an election is a contested election is made as of the record date for the meeting in question. Once an election is determined to be a contested election, the plurality standard shall remain in effect through the completion of the meeting, regardless of whether the election ceases to be a contested election after the record date but prior to the meeting.
Under the Certificate of Incorporation, at least two-thirds of the directors of the Company must be U.S. Citizens. The Bylaws provide generally that vacancies on the Board of Directors, including those resulting from an increase in the number of directors, may be filled only by the remaining directors, and not by stockholders. Any director elected to fill a vacancy will have the same remaining term as his or her predecessor. Accordingly, the Board of Directors could temporarily prevent any stockholder from enlarging the Board of Directors and filling the new directorships with that stockholder's own nominees.
Anti-Takeover Effects of Section 203 of the Delaware General Corporation Law
The Company is subject to Section 203 of the Delaware General Corporation Law. Section 203 provides that, subject to certain exceptions, a corporation shall not engage in any business combination with any "interested stockholder" for a three-year period following the time that such stockholder becomes an interested stockholder unless:
prior to such time, the board of directors of the corporation approved either the business combination or the transaction which resulted in the stockholder becoming an interested stockholder; or
upon consummation of the transaction which resulted in the stockholder becoming an interested stockholder, the interested stockholder owned at least 85% of the voting stock of the corporation outstanding at the time the transaction commenced (excluding certain shares); or
at or subsequent to such time, the business combination is approved by the board of directors of the corporation and by the affirmative vote of at least 66 2/3% of the outstanding voting stock which is not owned by the interested stockholder.
Except as specified in Section 203, an interested stockholder is generally defined as:
any person that is the owner of 15% or more of the outstanding voting stock of the corporation, or is an affiliate or associate of the corporation and was the owner of 15% or more of the outstanding voting stock of the corporation, at any time within the three-year period immediately prior to the relevant date; and
the affiliates and associates of any such person.
Section 203 may make it more difficult for a person who would be an "interested stockholder" to effect various business combinations with a corporation for a three-year period. The Company has not elected to be exempt from the restrictions imposed under Section 203. The provisions of Section 203 may encourage persons interested in acquiring the Company to negotiate in advance with the board of directors, since the stockholder approval requirement would be avoided if a majority of the directors then in office approves either the business combination or the transaction which results in any such person becoming an interested stockholder. Such provisions also may have the effect of preventing changes in the Company's management. It is possible that such provisions could make it more difficult to accomplish transactions which the Company stockholders may otherwise deem to be in their best interests.
Authorized but Unissued Shares
The Company's authorized but unissued shares of common stock and preferred stock are available for future issuance without stockholder approval. These additional shares may be used for a variety of corporate purposes, including future public offerings to raise additional capital, corporate acquisitions and employee benefit plans. The existence of authorized but unissued shares of common stock and preferred stock could render more difficult or discourage an attempt to obtain control of the Company by means of a proxy contest, tender offer, merger or otherwise.
Transfer Agent and Registrar
Computershare, P.O. Box 43078, Providence, RI 02940, is the transfer agent and registrar for the Company's common stock.
Shares in Book-Entry Form
Certificates representing the Company's common stock are not issued unless requested in writing as described below. Holders of record of the Company common stock have credited to a book-entry account established and maintained for them by the transfer agent and registrar the number of shares of Company common stock owned of record by them. Stockholders may request the issuance of a certificate representing shares of Company Common Stock owned of record by them by writing to the transfer agent and registrar.


Night Terrors is a departure from the overarching story of this season and gets back to what is primarily a stand alone story. Unfortunately, it wasn't a story that really held my interest. There's a lot less to say this time around, but that might be a good thing after all of the excitement of last week.
The notion that the scariest place in the universe is a child's bedroom is great and I loved the idea of the Doctor making a house call to save a child in need. Unfortunately, it was once we saw the nature of the threat that things fell apart for me. The unknown was far creepier and while the cupboard was full of everything young George was afraid of, we only saw the dollhouse and its inhabitants. The peg dolls were definitely creepy, but ultimately I would have liked to see some variety even just having the dolls look more distinct from one another.
There's not a lot of connectedness between this episode to the rest of the season beyond Rory's lament that they were "dead… again," monsters being put in a cupboard, and the Doctor once again looking at the details of his death on a screen in the TARDIS. The Doctor commenting that they were all together again "in the flesh" at the episode's conclusion may or not be a clue regarding what's to come, as the dolls had just been turning people into wood. We also heard some fun references to the Doctor's favorite childhood stories that called back to past episodes and enemies from the classic series (e.g. Snow White and the Seven Keys to Doomsday, The Three Little Sontarans). We may see George and his family again, but I don't see Night Terrors having much to do with things going forward which is about what I expected. The fact that this episode was originally intended to air in the first half of the season may have kept it from resonating with me coming off of everything we saw last week.
Night Terrors may have suffered in its thematic similarities to this season's The Doctor's Wife (as well as Season Two's Fear Her). It was a fairy tale in a lot of ways, but it wasn't as effective or steeped in Doctor Who lore as the Neil Gaiman penned adventure. Night Terrors writer, Mark Gatiss, has a number of Doctor Who episodes on his resume (The Unquiet Dead, The Idiot's Lantern, Victory of the Daleks), but they are not among my favorites. The highlight for me this week for me was being able to see the episode in HD, and Night Terrors had some great moody visuals that lived up to its title. While I'd like to say my provider has added BBC America HD to our lineup, the reality is I purchased an iTunes season pass last week and it's worth every penny.
Next week is arguably the episode I'm most excited for (barring the finale of course) as the season winds down. We see what promises to be a crazy story of an alternate version of Amy Pond along with some of the most captivating visuals featured in the trailer for the second half of the season. Stark white walls, a mysterious forest, teleporting robots and Amy Pond as a samurai, I honestly can't wait for The Girl Who Waited.
including reactions to each new episode on BBCAmerica and iTunes.


text:
\section{Introduction}

Knowledge bases are important resources for applications such as question answering, commonsense reasoning, and machine reading comprehension. They are usually represented as knowledge graphs (KGs), which organize knowledge in a structured form with nodes being entities and edges being the relations between entities. Generally, there are three types of KGs~\cite{Storks2019RecentAI}: \textit{linguistic knowledge} such as WordNet~\cite{miller1995wordnet}, \textit{world knowledge} such as Freebase~\cite{bollacker2008freebase}, and \textit{commonsense knowledge} such as ConceptNet~\cite{speer2017conceptnet}. One of the biggest bottlenecks of these KGs is that they are highly incomplete. So the task of \textit{knowledge base completion} (KBC) (a.k.a \textit{link prediction}) that aims to infer the missing links in the graphs has gained much research attention~\cite{taskar2003link}.

However, most previous KBC tasks assume that test entities and relations have been seen during training. In practical scenarios, a KG is constantly growing over time, and new entities and relations will be continuously added to an existing KG. As a result, a practical KBC system will have to deal with such a zero-shot KBC setting, where certain entities and relations have not been seen during the training time. Recent work has studied zero-shot KBC scenarios with either unseen entities~\cite{sun-etal-2020-evaluation,baek2020gen} or unseen relations~\cite{qin2020generative} individually (but not both). However, there is still no comprehensive zero-shot KBC benchmark that systematically studies different scenarios in the zero-shot KBC settings with different combinations of available information.

\label{sec:appendix_b}
\begin{table*}[h!]
\centering
\small
\setlength{\tabcolsep}{4.pt}
\caption{Scenario Coverage Comparison (Previous Work v.s Our Work). }
\begin{tabular}{|c|c|c| c| c| c |c |c|c| c| c |c |c|c| c|c |}

\hline
\multirow{2}{*}{Related Work} & \multicolumn{12}{|c|}{Settings} & \multicolumn{3}{|c|}{Knowledge Sources}
\\

\cline{2-16}
  &  1 & 2 & 3 & 4 & 5 & 6  & 7  & 8 & 9 & 10  & 11  & 12  & Linguistic & World& Commonsense \\
 \hline
TransE \cite{bordes2013translating} &  &  &  & \checkmark   &  &  &   &    &  &  &  &  & \checkmark&  \checkmark& \\
 \hline

 \cite{neelakantan-etal-2015-compositional} &  &  &  &   &  &  &   &     &  & \checkmark &  &  & &  \checkmark& \\
 \hline

  \cite{xie2016representation} &  & \checkmark &  &   &  & \checkmark &   &     &  &  &  &  & &  \checkmark& \\
 \hline

 \cite{ijcai2017-0250} &  &  &  &   &  &  &   &   \checkmark  &  &  &  &  & \checkmark&  \checkmark& \\
 \hline

 RotatE \cite{sun2018rotate} &  &  &  & \checkmark   &  &  &   &    &  &  &  &  & \checkmark& \checkmark& \\
 \hline

\cite{albooyeh-etal-2020-sample} &  &  &  &   &  &  &   &   \checkmark  &  &  &  &  & \checkmark&  \checkmark& \\
 \hline

 \cite{baek2020gen} &  &  &  &   &  &  &   &   \checkmark  &  &  &  &  & \checkmark&  \checkmark& \\
 \hline

 \cite{malaviya2020commonsense} &  &  \checkmark &  &   &  &  &   &     &  &  &  &  & &  & \checkmark\\
 \hline
\cite{qin2020generative} &  &  &  &    &  &  &   &    &  & \checkmark  &  &  & \checkmark& \checkmark& \\
 \hline

 StAR \cite{wang2021structure} & \checkmark &  &  &    &  &  &   &    &  &  &  &  & \checkmark& \checkmark& \\

 \hline
Our Work & \checkmark & \checkmark  & \checkmark &  \checkmark  &\checkmark  &\checkmark  & \checkmark  &  \checkmark  &\checkmark  & \checkmark &\checkmark  & \checkmark & \checkmark& \checkmark& \checkmark \\

\hline

\end{tabular}
\label{tab:full_settings}
\end{table*}

For this reason, we propose a new benchmark, \textbf{ZeroKBC}, which covers all the useful zero-shot KBC scenarios with three different types of knowledge resources. In total, we have $3$ zero-shot scenarios based on whether the input entity and relation are unseen, and they are further categorized into $8$ fine-grained settings based on the availability of the textual descriptions or context in the input (Figure~\ref{fig:task}).
To our best knowledge, our work is the first to systematically categorize all possible zero-shot KBC settings. And because of it, we are able to identify $5$ practically important zero-shot KBC settings that were missing in previous studies (Table \ref{tab:full_settings}).
Specifically, each previous work in Table \ref{tab:full_settings} only covers a small portion of all KBC settings, while our work has more exhaustive coverage.
Furthermore, because of our systematic categorization and analysis, we found that there are $6$ important KBC settings that were missing in previous study, i.e., standard setting \#3 and zero-shot settings \#5, \#7, \#9, \#11 and \#12. These are the scenarios of important value, but could be easily ignored without such a systematic analysis of all the possible KBC settings.
We adapt state-of-the-art KBC systems to these zero-shot scenarios, and the results show that ZeroKBC is quite challenging and far from being solved. Our analysis further reveals the importance of designing more efficient methods to integrate semantics of entities and relations into knowledge graph learning.

\section{Related Work}

KBC benchmarks mostly assume that all test entities and relations appear during training, and many structure-based methods are proposed for this scenario~\cite{bordes2013translating,dettmers2018conve,Nguyen2018,sun2018rotate,nathani-etal-2019-learning,8946600}. Despite of just using the graph structure, some recent work~\cite{xie2016representation,malaviya2020commonsense,wang2021structure} found that incorporating the text descriptions of entities and relations can further improve the performance.

Recently, emerging entities~\cite{ijcai2017-0250,albooyeh-etal-2020-sample,baek2020gen} and relations~\cite{neelakantan-etal-2015-compositional,chen-etal-2019-meta,qin2020generative} have also caught research attentions. However, comprehensive KBC settings are seldom explored, and performance are incomparable because of different benchmark and evaluation protocols. This work systematically analyzes all possible KB growing scenarios and constructs ZeroKBC. We identify $5$ more zero-shot settings that merit important application values (Table \ref{tab:full_settings}).

\begin{figure*}[t]
\setlength{\belowcaptionskip}{-15pt}
	\begin{center}

	\includegraphics[width=500pt]{figure3.pdf}
	\caption{\textbf{Knowledge Graph Sample (Left):} Black names of entities and relations  represent "seen" and red ones mean "unseen" or "newly emerged". Differently colored arrows in the graph correspond to different scenarios on the right. \textbf{KBC task on different scenarios (Right):} "Y" means "yes" or "required", "N" means "no" or "not required" and "Y/N" means "optional". The colored arrows correspond to the link prediction scenarios in the left graph sample.

	\textbf{Context} means known connections for an unseen entity as explained in Section~\ref{section:zero_kbc}.
}
	\label{fig:task}
	\end{center}
\end{figure*}

\section{Knowledge Base Completion Task}
\label{section:kbc}
We first formally define the knowledge graph (KG) and the standard KBC task.
\paragraph{Knowledge Graph}
Let $\mathcal{E}$ be the entity set and $\mathcal{R}$ be the relation set. A \textbf{triple} is defined as $(e_h, r, e_t)$ where $e_h, e_t\in \mathcal{E}$ are the head and the tail entities, respectively. A knowledge graph is denoted as $\mathcal{G} = \{(e_h, r, e_t)\} \subseteq \mathcal{E}\times \mathcal{R}\times \mathcal{E} $. Meanwhile,
each entity $e$ may have a text description $d_e=\left\{w_{1:n}\right\}$ with $n$ words, and each relation $r$ may have a text description $d_r=\left\{w_{1:m}\right\}$ with $m$ words.
\paragraph{KBC}
It aims to predict the \textbf{missing} triples $(e_h, r, ?)$ or $(?, r, e_t)$ given $\mathcal{G}$ when all the entities $e_h, e_t, ? \in \mathcal{E}$ and relation $r \in \mathcal{R}$ have been seen in other triples during training.
The standard KBC setting only considers structural information of the knowledge graph to make predictions (setting 4 in Figure \ref{fig:task}).
For example, as shown in Figure~\ref{fig:task}, predicting the "Genre of" relation for entities "Sci-fi" and "Arrival" is a standard KBC task as long as "Genre of" also occurs in the training set.
Also, textual descriptions of entities and relations
can be utilized
for performance enhancement (settings 1--3 in Figure \ref{fig:task}).

\section{Zero-Shot Knowledge Base Completion}
\label{section:zero_kbc}

In Figure~\ref{fig:task}, we systematically categorize 3 zero-shot scenarios with 8 fine-grained settings. Because of our systematic categorization and analysis, we found that there are $5$ important zero-shot KBC settings that were missing in previous studies, i.e., settings \#5, \#7, \#9, \#11 and \#12. These are the scenarios of important value, but could be easily ignored without such an exhaustic analysis (see Table \ref{tab:full_settings} for a comprehensive comparision with existing works). Next, we discuss the 3 macro-categories of zero-shot scenarios (represented by the green, blue and red color in Figure~\ref{fig:task}).
Next we define zero-shot KBC scenarios when new entities or relations emerge during testing.

\paragraph{Zero-Shot Entity KBC (ZeroE)}
Given a graph $\mathcal{G} \subseteq \mathcal{E}\times \mathcal{R}\times \mathcal{E}$, a newly emerged entity is an entity $\tilde{e} \in \tilde{\mathcal{E}}$ where $\mathcal{E} \cap \tilde{\mathcal{E}}=\emptyset$. When such a new entity is added to the existing KG, we need to predict all the possible links between this new entity and existing entities, i.e., $(\tilde{e}_h, r, ?)$ or $(?, r, \tilde{e}_t)$, where $\tilde{e}_h, \tilde{e}_t \in \tilde{\mathcal{E}}, ? \in \mathcal{E}$, and relation $r \in \mathcal{R}$. For the new entity $\tilde{e}$, it is possible that we already know some \textbf{context}\footnotemark[2] for it, i.e., we know some connections $(\tilde{e}, r, e_t)$ or $(e_h, r, \tilde{e})$ between this new entity and the existing KG. We can utilize such context to help predict the remaining missing links. In the absence of such context for a new entity, we need the textual descriptions of it to distinguish different entities. For example, as in Figure~\ref{fig:task}, predicting the ``Directed'' relation for the new unseen entity ``Dune'' and existing entity ``Denis Villeneuve'' is a ZeroE task. We can either utilize the context (Dune, Genre of, Sci-fi) or the textual description of the new entity ``Dune'' for prediction.

\footnotetext[2]{This does not mean that $\tilde{e}$ has been seen because such context is not observed during training, as pointed out by \cite{albooyeh-etal-2020-sample}.}

\paragraph{Zero-Shot Relation KBC (ZeroR)}
Given a graph $\mathcal{G} \subseteq \mathcal{E}\times \mathcal{R}\times \mathcal{E}$, a newly emerged relation is a relation $\tilde{r} \in \tilde{\mathcal{R}}$ where $\mathcal{R} \cap \tilde{\mathcal{R}}=\emptyset$. When such a relation is added to the existing KG, we need to predict if this relation exists in any pair of the entities, i.e., $(e_h, \tilde{r}, ?)$ or $(?, \tilde{r}, e_t)$ where $e_h, e_t, ? \in \mathcal{E}$, and relation $\tilde{r} \in \tilde{\mathcal{R}}$. In this scenario, we will always have the textual descriptions of new relations to distinguish them since we have never seen them before. For instance, predicting the ``Colleague'' relation for the entities ``Denis Villeneuve'' and ``Jason Momoa'' from Figure~\ref{fig:task} belongs to this setting.

\paragraph{Zero-Shot Both KBC (ZeroB)}
It is also possible that we encounter the scenario to predict the link for both a newly added relation and a newly added entity, i.e., $(\tilde{e}_h, \tilde{r}, ?)$ or $(?, \tilde{r}, \tilde{e}_t)$ where $\tilde{e}_h, \tilde{e}_t \in \tilde{\mathcal{E}}, ? \in \mathcal{E}$, and relation $\tilde{r} \in \tilde{\mathcal{R}}$.
Meanwhile, $\mathcal{E} \cap \tilde{\mathcal{E}}=\emptyset$, and $\mathcal{R} \cap \tilde{\mathcal{R}}=\emptyset$.
In such a case, textual description is necessary for the relations as in ZeroR and entity descriptions are also required in the absence of context (Setting 12). Predicting the triple (Jason Momoa, Acted in, Dune) in Figure~\ref{fig:task} is a Zero-shot Both KBC case.

\section{A Comprehensive Benchmark Dataset}

\begin{table}[t]
\setlength{\tabcolsep}{1.1pt}
\centering
\caption{Statistics of ZeroKBC (Un.: unseen, Avg.: average, Wrd.: word, Ent: entity, and Rel.: relation).}
	\begin{tabular}{@{}l|l|r|r|r}
		\toprule
		\begin{tabular}[c]{@{}l@{}} Scenarios \end{tabular} &  \multicolumn{1}{c|}{Statistics}  & \begin{tabular}[c]{@{}l@{}}   \makecell{WN18RR} \end{tabular} &
		\begin{tabular}[c]{@{}l@{}}  \makecell{FB15K237} \end{tabular} &
		\begin{tabular}[c]{@{}l@{}}  \makecell{ATOMIC}\end{tabular}

		\\ \midrule
		\multirow{5}{*}{Standard}     & \# All Triples &    93,003 & 310,116 & 389,437 \\
	   & \# Ent. & 40,943 &14,541 & 48,645	  \\
	   & \# Rel.  & 11 & 237 & 9    \       \\
	   & \# Avg. Wrd. Ent. & 14.24 & 7.34 & 3.72\       \\
	   & \# Avg. Wrd. Rel. & 2.55 & 19.24 & 4.44\       \\
	   \midrule
	   \multirow{3}{*}{ZeroE}     & \# Seen Ent.  &    32,270 & 11,579 &  38,903  \\
	   & \# Un. Dev Ent. & 2,848  &  1,395&  4,768 \\
	   & \# Un. Test Ent.  & 2,848 &  1,396& 4,691\       \\   \midrule
	   \multirow{3}{*}{ZeroR}     & \# Seen Rel. &    6 & 157 &  5  \\
	   & \# Un. Dev Rel. &    2 & 20 &  2 \\
	   & \# Un. Test Rel.  &    3 & 60 & 2\       \\   \midrule
	   \multirow{6}{*}{ZeroB}     & \# Seen Ent.  &   30,015  & 11,252 &   32,919 \\
	   & \# Un. Dev Ent. & 54 & 449&  2,577\\
	   & \# Un. Test Ent.  & 225 & 962& 2,977\       \\
	   & \# Seen Rel. & 6 & 154 &  5\\
	   & \# Un. Dev Rel. & 2 & 19 & 2  \\
	   & \# Un. Test Rel.  & 3 & 59 &2       \\

		\bottomrule
	\end{tabular}
\label{tab:stats}
\end{table}

\begin{table*}[htp]
\centering
\setlength{\tabcolsep}{3pt}
\caption{Main results on ZeroKBC (\% for MRR and Hits@X). Full results for all 12 settings are given in Table \ref{tab:full_results}. By using the unified evaluation schema, the results of standard KBC (setting 4) are different from previous work.
}
\begin{tabular}{|c|c|c| r| r| r |r |r| r| r| r| r| r|r| r| r| r| r|}

\hline
\multirow[b]{2}{*}{Scenarios} & \multirow[b]{2}{*}{Settings} &\multirow[b]{2}{*}{Models} & \multicolumn{5}{|c|}{WN18RR} & \multicolumn{5}{|c|}{FB15K237} & \multicolumn{5}{|c|}{ATOMIC} \\
\cline{4-18}
  &  & & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10} & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}  & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10}  & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}  & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10} & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}

\tabularnewline
\hline
\multirow{3}{*} {Standard}   & \multirow{3}{*} {1}   & TransE & 2368
 & 20.8 & 50.8 & 36.4 & 1.7 & 193  & 31.5  & 50.3 & 35.0 & 22.0 & 2442 & 20.2 & 29.6 & 22.2 & 15.2  \tabularnewline
 & & RotatE  & 2814 & \textbf{42.6} & 54.0 & \textbf{46.1} & \textbf{36.1} & 193 & \textbf{32.2} & \textbf{51.5}  & \textbf{35.8} & \textbf{22.7} & 2318 & \textbf{24.1} & \textbf{32.6} & \textbf{25.2}& \textbf{19.8} \tabularnewline

 &  & StAR &  \textbf{68} & 34.6 & \textbf{62.3} & 41.9 & 20.3 &  \textbf{127} & 27.4 & 45.8 & 30.0 & 18.4
 & \textbf{1566}  & 7.8 & 12.5 & 7.5 & 5.2

 \tabularnewline
 \hline
\multirow{3}{*} {ZeroE} & \multirow{3}{*} {\makecell{5\\ w/ context}} & TransE & 3598  & 7.6 & 12.1  & 7.9 & 5.1  & 787 & 11.8 & 19.9  & 12.4 & 7.7 & 6170 & 0.8 & 1.5 & 0.7 & 0.3 \tabularnewline
                          & & RotatE  &  4064 & 7.6 & 11.6 & 7.8 & 5.4 & 2412 & 2.6  & 4.9 & 2.5 & 1.1 & 11872 & 0.2 & 0.4 & 0.2 & 0.1 \tabularnewline
                          & & StAR   &  \textbf{487} & \textbf{36.3} & \textbf{58.0} & \textbf{41.0} & \textbf{25.5} & \textbf{236} & \textbf{22.5} & \textbf{38.7}  & \textbf{24.2} & \textbf{14.5} &  \textbf{1399} & \textbf{5.7} & \textbf{10.5} & \textbf{5.3} & \textbf{3.0}
 \tabularnewline
 \hline
\multirow{3}{*} {ZeroR} & \multirow{3}{*} {9}  & TransE & 19584 &   0.3 & 0.4 & 0.2 &  0.1 & 6922 & 2.7 & 4.3 & 2.8 & 1.7 & 7799 & 0.5  & 0.8 & 0.2 & 0.1 \tabularnewline
                         & & RotatE  & 21876 & 0.2 & 0.4 & 0.2 & 0.1 & 6645 & 1.6 & 2.3 & 1.6 & 1.2 & 18562 & 0.1 & 0.1 & 0.0 & 0.0 \tabularnewline
                         & & StAR   & \textbf{2810} & \textbf{9.7} & \textbf{24.6} & \textbf{11.1} & \textbf{2.4}  & \textbf{1836} & \textbf{11.8} & \textbf{21.2} & \textbf{12.1} & \textbf{7.0} &  \textbf{2787} & \textbf{2.6} & \textbf{4.3} & \textbf{2.3} & \textbf{1.4}
\tabularnewline
 \hline
\multirow{3}{*} {ZeroB}   & \multirow{3}{*} {\makecell{11\\ w/ context}} & TransE &  \textbf{4830} & 4.0 & 9.0 & 3.2 & 2.1 & 3581 & 3.8 & 6.9 & 4.2 & 1.9 & 15032 & 2.2 & 3.8 & \textbf{2.0} & 0.1 \tabularnewline
                         & & RotatE  & 7116 & 4.3 & 8.9 & 4.1 & 2.6 & 3855 & 1.5 & 3.8 & 1.1 & 0.4  & 10405 & 1.8 & 1.9 & 1.6 & \textbf{1.6} \tabularnewline
                         & & StAR  & 5317 & \textbf{14.1} & \textbf{29.6} & \textbf{15.4} & \textbf{7.7} & \textbf{1561} & \textbf{10.4} & \textbf{19.2} & \textbf{10.5} & \textbf{5.8} &  \textbf{2102} & \textbf{2.3} & \textbf{4.1} & \textbf{2.0} & 1.0
 \tabularnewline

 \hline
\end{tabular}

\label{tab:main_results}
\end{table*}

\paragraph{Dataset Preparation} Considering all the KBC scenarios, we propose a comprehensive benchmark ZeroKBC that includes three types of knowledge resources: linguistic, world, and commonsense knowledge~\cite{Storks2019RecentAI}. For linguistic knowledge, we consider WN18RR~\cite{dettmers2018convolutional}, a subset of WordNet that includes eleven relations; for world knowledge, we include FB15k-237~\cite{toutanova-chen-2015-observed}, a subset of Freebase that includes 15 thousand entities and 237 relations; we use ATOMIC~\cite{sap2019atomic} that includes nine relations for commonsense knowledge. All three resources have textual descriptions for both entities and relations.
Specifically, we consider three zero-shot scenarios: ZeroE, ZeroR, and ZeroB as follows.
For the ZeroE scenario, we follow the dataset construction procedures introduced by~\cite{albooyeh-etal-2020-sample} and use the out-of-sample entities as the unseen entities for evaluation; for the ZeroR scenario, we follow~\cite{qin2020generative} for construction and set aside a part of relations for evaluation only; as for the ZeroB scenario, we take the intersection of the previous two zero-shot datasets. The statistics of the whole zero-shot benchmark dataset are shown in Table~\ref{tab:stats}.

\paragraph{Unified Evaluation Schema}
As pointed out by~\cite{sun-etal-2020-evaluation}, many previous KBC systems use an inappropriate evaluation protocol and report untrustworthy performance. When the predicted scores are the same for the candidates, they rank the correct one on the top and substantially overestimate the final
ranking scores. Thus, we unify the evaluation schema in all our experiments and rank the correct one in the middle in such cases. Besides, for the ZeroE and ZeroB scenarios, we adopt the protocol from~\cite{albooyeh-etal-2020-sample} and only consider the seen entities as candidates for ranking. We also adopt the standard filtering strategy introduced by~\cite{bordes2013translating}.

\begin{table*}[h!]
\centering
\setlength{\tabcolsep}{2.2pt}
\small
\caption{Complete Experimental Results on ZeroKBC (\% for MRR and Hits@X).}
\begin{tabular}{|c|c|c| r| r| r |r |r|r| r| r |r |r|r| r| r |r |r|}

\hline
\multirow[b]{2}{*}{Scenarios}&\multirow[b]{2}{*}{Settings} & \multirow[b]{2}{*}{Models} & \multicolumn{5}{|c|}{WN18RR} & \multicolumn{5}{|c|}{FB15K237} & \multicolumn{5}{|c|}{ATOMIC} \\
\cline{4-18}
  &  & & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10} & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}  & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10}  & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}  & \multicolumn{1}{|c|}{MR} & \multicolumn{1}{|c|}{MRR} & \makecell{Hits\\ @10} & \makecell{Hits\\ @3}  & \makecell{Hits\\ @1}

\tabularnewline
\hline
\multirow{12}{*} {Standard}  & \multirow{3}{*} {1} & TransE  & 2368 & 20.8 & 50.8 & 36.4 & 1.7 &  193 & 31.5 & 50.3 & 35.0 & 22.0
  & 2442 & 20.2 & 29.6 & 22.2 & 15.2 \tabularnewline
&  & RotatE &  2814 & 42.6 & 54.0 & 46.1 & 36.1 &  193 & 32.2 & 51.5 & 35.8 & 22.7 & 2318 & 24.1 & 32.6 & 25.2 & 19.8 \tabularnewline
&  & StAR &  68 & 34.6 & 62.3 & 41.9 & 20.3 &  127 & 27.4 & 45.8 & 30.0 & 18.4
 &  1566 & 7.8 & 12.5 & 7.5 & 5.2
 \tabularnewline
\cline{2-18}

& \multirow{3}{*} {2} & TransE  & 2309 & 20.8 & 50.7 & 37.2 & 1.0 &  191 & 31.2 & 50.5 & 35.0 & 21.5 & 2390 & 21.2 & 30.3 & 22.7 &16.5
\tabularnewline
&  & RotatE &  2799 & 42.9 & 53.8 & 46.4 & 36.6
 &  192 & 32.2 & 51.5 & 36.0 & 22.7
 &  2328 & 24.2 & 32.5 & 25.5 & 19.9
 \tabularnewline
&  & StAR &  34 & 74.7 & 62.4 & 40.7 & 18.9
 &  128 & 27.6 & 46.4 & 30.2 & 18.4
 &  1566 & 8.1 & 12.6 & 7.9 & 5.6
\tabularnewline
\cline{2-18}

& \multirow{3}{*} {3} & TransE  & 3800 & 20.0 &  48.8 & 33.5 & 2.8 &  189 & 31.9 & 51.1 & 35.6 & 22.3 &  2516 & 24.4 & 32.5 & 25.7 & 20.1
\tabularnewline
&  & RotatE &  5302 & 44.2 & 50.4 & 45.6 & 40.8
 &  240 & 32.2 & 50.6 & 35.6 & 23.1
 & 3191 & 28.5 & 34.9 & 29.6 & 25.0
 \tabularnewline
&  & StAR &  14881 & 0.6 & 12.9 & 0.6 & 0.1
 &  1126 & 6.2 & 14.4 & 5.9 & 2.3
 &  5055 & 8.4 & 10.4 & 8.4 & 7.1
 \tabularnewline

\cline{2-18}
  & \multirow{3}{*} {4} & TransE  & 7203 & 13.6 & 41.3 & 22.3 & 0.3 &  206 & 31.4 & 50.5 & 35.1 & 21.8 &  2766 & 25.1 & 32.7 & 26.3 & 21.2

\tabularnewline
&  & RotatE & 5278 & 44.0 & 50.2 & 45.3 & 40.7 &  244 & 32.3 & 50.5 & 35.6 & 23.2
 &  3183 & 28.6 & 34.9 & 29.6 & 25.2
 \tabularnewline
& & StAR &  14827 & 0.6 & 1.7 & 0.6 & 0.1 &  1467 & 4.4 & 9.9 & 3.6 & 1.7
 &  5158 & 7.8 & 9.6 & 8.0 & 6.5
 \tabularnewline
 \hline

 \multirow{18}{*} {ZeroE}  & \multirow{3}{*} {\makecell{5\\ w/ context}} & TransE  &  3598 & 7.6 & 12.1 & 7.9 & 5.1 &  787 & 11.8 & 19.9 & 12.4 & 7.7
  & 6170 & 0.8 & 1.5 & 0.7 & 0.3\tabularnewline
&  & RotatE &   4064 & 7.6 & 11.6 & 7.8 & 5.4 &  2412 & 2.6 & 4.9 & 2.5 & 1.1
 & 11872 & 0.2 & 0.4 & 0.2 & 0.1 \tabularnewline
&  & StAR &  487 & 36.3 & 58.0 & 41.0 & 25.5
 &  236 & 22.5 & 38.7 & 24.2 & 14.5
 &  1399 & 5.7 & 10.5 & 5.3 & 3.0
 \tabularnewline
\cline{2-18}

& \multirow{3}{*} {\makecell{5\\ w/o context}} & TransE  &  5966 & 2.3 & 4.5 & 2.3 & 1.0 & 876 & 10.9 & 17.9 & 11.2 & 7.1
  &  7314 & 0.5 & 1.0 & 0.4 & 0.1
\tabularnewline
&  & RotatE &  6492 & 1.9 & 3.8 & 1.7 & 0.9
 &  3037 & 1.0 & 1.7 & 0.8 & 0.4
 &  18656 & 0.0 & 0.0 & 0.0 & 0.0
 \tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline
\cline{2-18}

& \multirow{3}{*} {\makecell{6\\ w/ context}} & TransE  & 3605 &  7.5
 & 12.2 &  7.9 & 5.1 &  788 & 11.8 & 19.9 & 12.4 & 7.7
  &  6170 & 0.8 & 1.6 & 0.7 & 0.3
\tabularnewline
&  & RotatE &  4064 & 7.5 & 11.2 & 7.7 & 5.4
 &  2378 & 2.6 & 4.9 & 2.6 & 1.1
 &  16105 & 0.0 & 0.0 & 0.0 & 0.0
 \tabularnewline
&  & StAR &  481 & 34.7 & 56.6 & 39.3 & 23.9
 &  195 & 22.8 & 38.9 & 24.6 & 14.8
 &  1366 & 5.6 & 10.4 & 5.4 & 2.8
 \tabularnewline
\cline{2-18}

& \multirow{3}{*} {\makecell{6\\ w/o context}} & TransE  &  5981 & 2.3 & 4.5 &  2.2 & 1.0 &  876 & 10.9 & 17.9 & 11.2 & 7.1
  &  7314 & 0.5 & 1.0 & 0.4 & 0.1
\tabularnewline
&  & RotatE &  6510 & 1.9 & 3.7 & 1.8 & 0.8
 &  2997 & 1.0 & 1.7 & 0.8 & 0.4
 &  16056 & 0.0 & 0.0 & 0.0 & 0.0
 \tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline
\cline{2-18}

& \multirow{3}{*} {7} & TransE  & 3358 & 25.7 & 42.4 & 31.9 & 16.2 & 170 & 34.0 & 52.3 & 38.6 & 24.3  &  2475 & 17.4 & 25.4 & 18.5 & 13.2
\tabularnewline
&  & RotatE &  4427 & 3.5 & 43.6 & 37.5 & 30.6
 &  289 & 29.6 & 46.7 & 33.5 & 20.6
 &  14468 & 10.5 & 11.8 & 10.8 & 9.9
 \tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline

\cline{2-18}
& \multirow{3}{*} {8} & TransE  & 3887 &  25.3 & 41.6 & 31.0 & 16.2 &  184 & 33.8 & 52.1 & 38.5 & 24.1
 & 3673 & 15.7 & 23.3 & 16.5 & 11.9
\tabularnewline
&  & RotatE &  4475 & 35.2 & 43.7 & 37.3 & 30.4
 &  248 & 29.8 & 47.3 & 33.4 & 20.7
 &  15469 & 6.7 & 8.9 & 7.5 & 5.5
\tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline
 \hline

 \multirow{6}{*} {ZeroR}  & \multirow{3}{*} {9} & TransE  & 19585 &   0.3 & 0.4 & 0.2 &  0.1 &   6922 & 2.7 & 4.3 & 2.8 & 1.7

  & 7799 &0.5  & 0.8 & 0.2& 0.1\tabularnewline
&  & RotatE &  21877 & 0.2 & 0.4 & 0.2 & 0.1
 &  6645 & 1.6 & 2.3 & 1.6 & 1.2
 &  14468 & 10.5 & 11.8 & 10.7 & 9.9
 \tabularnewline
&  & StAR &  2810 & 9.7 & 24.6 & 11.1 & 2.4
 &  1836 & 11.8 & 21.2 & 12.1 & 7.0
 & 2787 & 2.6 & 4.3 & 2.3 & 1.4
 \tabularnewline
\cline{2-18}

& \multirow{3}{*} {10} & TransE  & 22324 & 0.1 & 0.1 & 0.1 & 0.1 &    7037 & 2.7 & 4.1 & 2.9 & 1.8 &
  10018 & 0.4 & 0.8 & 0.2 & 0.0
\tabularnewline
&  & RotatE &  18464 & 0.4 & 0.6 & 0.4 & 0.1
 &  3579 & 2.7 & 5.4 & 2.5 & 1.2
 &  18562 & 0.1 & 0.1 & 0.0 & 0.0
 \tabularnewline
&  & StAR &  15186 & 0.9 & 2.3 & 0.9 & 0.3
 &  3903 & 1.5 & 4.1 & 1.0 & 0.5 &  8514 & 2.0 & 3.1 & 1.9 & 1.4
\tabularnewline

 \hline

 \multirow{9}{*} {ZeroB}  & \multirow{3}{*} {\makecell{11\\ w/ context}} & TransE  & 4830 & 4.0 & 9.0 & 3.2 & 2.1 & 3581 & 3.8 & 6.9 & 4.2 & 1.9
& 15032 & 2.2 & 3.8 & 2.0& 0.1 \tabularnewline
&  & RotatE & 7116 & 4.3 & 8.9 & 4.1 & 2.6
 &  3855 & 1.5 & 3.8 & 1.1 & 0.4
 &  10405 & 1.8 & 1.9 & 1.6 & 1.6 \tabularnewline
&  & StAR & 5317 & 14.1 & 29.6 & 15.4 & 7.7
 &   1561 & 10.4 & 19.2 & 10.5 & 5.8

 &  2102 & 2.3 & 4.1 & 2.0 & 1.0
 \tabularnewline
\cline{2-18}

& \multirow{3}{*} {\makecell{11\\ w/o context}}& TransE  & 8664 & 1.7 & 3.0 & 1.6 & 0.6 &  5425 & 0.9 & 1.4 & 0.9 & 0.5

  & 22389 & 0.0 & 0.0 & 0.0 & 0.0
\tabularnewline
&  & RotatE &  11949 & 0.0 & 0.0 & 0.0 & 0.0

&  6326 & 0.1 & 0.1 & 0.0 & 0.0
 &  15049 & 0.1 & 0.1 & 0.0 & 0.0
 \tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline
\cline{2-18}

& \multirow{3}{*} {12} & TransE  & 15125 & 0.0 & 0.0 & 0.0 & 0.0 & 3167 & 6.4 & 10.7 & 7.0 & 3.9  & 14534 & 2.6 & 2.7 & 2.6 & 2.5
\tabularnewline
&  & RotatE & 14867 & 0.0 & 0.0 & 0.0 & 0.0 &  5424 & 0.3 & 0.4 & 0.3 & 0.1
 &  15089 & 0.1 & 0.1 & 0.1 & 0.1
 \tabularnewline
&  & StAR & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} &\multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-}& \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} & \multicolumn{1}{c|}{-} \tabularnewline

 \hline

\end{tabular}

\label{tab:full_results}
\end{table*}

\section{Experiments}
We next evaluate three canonical KBC systems on our proposed ZeroKBC benchmark. As these systems are not originally designed to handle zero-shot scenarios, we adapt them accordingly to make predictions under zero-shot settings.

\subsection{Systems}

\noindent \textbf{TransE}~\cite{bordes2013translating} embeds entities and relations into low-dimension vectors and interprets relations $r$ as translations operating on the head $h$ and tail $t$ entities. The model tries to minimize the distance $d=||h+r-t||$ with $h,r,t \in \mathbb{R}^{k}$. In its vanilla settings, the initial embeddings of entities and relations are random; in our adaptation, we use BERT~\cite{devlin-etal-2019-bert} to encode the textual descriptions of entities and relations for initialization when the descriptions are available\footnotemark[3]. In this case, unseen entities or relations will use the BERT embeddings for prediction. When the context is available, we use the translation property to deduce the embeds for unseen entities\footnotemark[4], as $h_{\text{unseen}} = t_{\text{seen}} - r$ or  $t_{\text{unseen}} = h_{\text{seen}} + r$.

\footnotetext[3]{We regard each description as a sentence and then use the embedding of [CLS] as the entity/relation representation.}

\footnotetext[4]{For an unseen entity that has multiple context connections, we average them.}

\noindent \textbf{RotatE}~\cite{sun2018rotate} embeds entities and relations into complex space vectors and interprets relations $r$ as rotations operating in the space. Similar to TransE, we use BERT to initialize the real part of the entities and relations. For
unseen entities, we use $h \circ r = t$ and $h,r,t \in \mathbb{C}^{k}$ for deductions.

\noindent \textbf{StAR}~\cite{wang2021structure} adopts BERT as its textual encoder and uses both the translation property of a triple and their textual semantics that can be more generalizable for unseen entities and relations.\footnotemark[5]

\footnotetext[5]{Because the model regards the head entity and relation as a whole, we cannot deduce to unseen entities using context.}

\subsection{Results and Analysis}
We report the main experimental results in Table \ref{tab:main_results} when all possible information is available for each scenario (corresponding to the first row of each colored scenario in Figure \ref{fig:task}). Specifically, we assume that the model always has the textual description of newly emerged entities or relations for ZeroE or ZeroR, respectively.

Compared with the standard KBC setting, the performance of canonical KBC systems (i.e., TransE, RotatE, and StAR) drops dramatically under zero-shot entity or relation setting, demonstrating the difficulty of our proposed dataset. ZeroB is the most challenging setting since both entities and relations in test data are unseen during training. Additionally, StAR can encode the semantics of text descriptions more efficiently, which significantly outperforms TransE and RotatE across knowledge graph genres and zero-shot settings. It indicates \textbf{the importance of considering textual semantics in zero-shot KBC} and points to the future direction about how to design an efficient approach that can take descriptive information into consideration to solve Zero-KBC problems. In our experiments, we also observe that \textbf{graph properties of knowledge bases can affect models' generalization capabilities}. For example, compared with WN18RR and FB15K237, ATOMIC has a much sparser graph structure (only 1\% of the entities act as both the head and tail, while the percentage for WN18RR and FB15K237 are 80\% and 88\%, respectively).
As a result, the models that only leverage the graph structures suffer from the largest performance drop from the standard setting to zero-shot ones, while the model (i.e., StAR) utilize it could generalize better to unseen entities and relations.
We also include complete experimental results on all ZeroKBC scenarios in Table \ref{tab:full_results}.

\section{Conclusion}

This work systematically examines different zero-shot KBC scenarios and develops a comprehensive benchmark named ZeroKBC, which covers these scenarios with three types of knowledge sources. Experimental results show that canonical and state-of-the-art KBC systems suffer great performance degradation on this challenging yet practical benchmark. We further present several important observations and promising future directions based on our system output analysis.

\bibliographystyle{IEEEtran}

redpajama_set_name: RedPajamaArXiv