title: Revisiting Hyper-Parameter Tuning for Search-based Test Data Generation

abstract: Search-based software testing (SBST) has been studied a lot in the literature, lately. Since, in theory, the performance of meta-heuristic search methods are highly dependent on their parameters, there is a need to study SBST tuning. In this study, we partially replicate a previous paper on SBST tool tuning and revisit some of the claims of that paper. In particular, unlike the previous work, our results show that the tuning impact is very limited to only a small portion of the classes in a project. We also argue the choice of evaluation metric in the previous paper and show that even for the impacted classes by tuning, the practical difference between the best and an average configuration is minor. Finally, we will exhaustively explore the search space of hyper-parameters and show that half of the studied configurations perform the same or better than the baseline paper's default configuration.


title: Robot-Assisted Feeding: Generalizing Skewering Strategies across Food Items on a Realistic Plate

abstract: A robot-assisted feeding system must successfully acquire many different food items. A key challenge is the wide variation in the physical properties of food, demanding diverse acquisition strategies that are also capable of adapting to previously unseen items. Our key insight is that items with similar physical properties will exhibit similar success rates across an action space, allowing the robot to generalize its actions to previously unseen items. To better understand which skewering strategy works best for each food item, we collected a dataset of 2450 robot bite acquisition trials for 16 food items with varying properties. Analyzing the dataset provided insights into how the food items' surrounding environment, fork pitch, and fork roll angles affect bite acquisition success. We then developed a bite acquisition framework that takes the image of a full plate as an input, segments it into food items, and then applies our Skewering-Position-Action network (SPANet) to choose a target food item and a corresponding action so that the bite acquisition success rate is maximized. SPANet also uses the surrounding environment features of food items to predict action success rates. We used this framework to perform multiple experiments on uncluttered and cluttered plates. Results indicate that our integrated system can successfully generalize skewering strategies to many previously unseen food items.


title: On the Convergence of SARAH and Beyond

abstract: The main theme of this work is a unifying algorithm, \textbf{L}oop\textbf{L}ess \textbf{S}ARAH (L2S) for problems formulated as summation of $n$ individual loss functions. L2S broadens a recently developed variance reduction method known as SARAH. To find an $\epsilon$-accurate solution, L2S enjoys a complexity of ${\cal O}\big( (n+\kappa) \ln (1/\epsilon)\big)$ for strongly convex problems. For convex problems, when adopting an $n$-dependent step size, the complexity of L2S is ${\cal O}(n+ \sqrt{n}/\epsilon)$; while for more frequently adopted $n$-independent step size, the complexity is ${\cal O}(n+ n/\epsilon)$. Distinct from SARAH, our theoretical findings support an $n$-independent step size in convex problems without extra assumptions. For nonconvex problems, the complexity of L2S is ${\cal O}(n+ \sqrt{n}/\epsilon)$. Our numerical tests on neural networks suggest that L2S can have better generalization properties than SARAH. Along with L2S, our side results include the linear convergence of the last iteration for SARAH in strongly convex problems.


title: One Additional Qubit is Enough: Encoded Embeddings for Boolean Components in Quantum Circuits

abstract: Research on quantum computing has recently gained significant momentum since first physical devices became available. Many quantum algorithms make use of so-called oracles that implement Boolean functions and are queried with highly superposed input states in order to evaluate the implemented Boolean function for many different input patterns in parallel. To simplify or enable a realization of these oracles in quantum logic in the first place, the Boolean reversible functions to be realized usually need to be broken down into several non-reversible sub-functions. However, since quantum logic is inherently reversible, these sub-functions have to be realized in a reversible fashion by adding further qubits in order to make the output patterns distinguishable (a process that is also known as embedding). This usually results in a significant increase of the qubits required in total. In this work, we show how this overhead can be significantly reduced by utilizing coding. More precisely, we prove that one additional qubit is always enough to embed any non-reversible function into a reversible one by using a variable-length encoding of the output patterns. Moreover, we characterize those functions that do not require an additional qubit at all. The made observations show that coding often allows one to undercut the usually considered minimum of additional qubits in sub-functions of oracles by far.


title: Efficient Subsampled Gauss-Newton and Natural Gradient Methods for Training Neural Networks

abstract: We present practical Levenberg-Marquardt variants of Gauss-Newton and natural gradient methods for solving non-convex optimization problems that arise in training deep neural networks involving enormous numbers of variables and huge data sets. Our methods use subsampled Gauss-Newton or Fisher information matrices and either subsampled gradient estimates (fully stochastic) or full gradients (semi-stochastic), which, in the latter case, we prove convergent to a stationary point. By using the Sherman-Morrison-Woodbury formula with automatic differentiation (backpropagation) we show how our methods can be implemented to perform efficiently. Finally, numerical results are presented to demonstrate the effectiveness of our proposed methods.


title: Carrier recombination mechanism at defects in wide band gap two-dimensional materials from first principles

abstract: Identification and design of defects in two-dimensional (2D) materials as promising single photon emitters (SPE) requires a deep understanding of underlying carrier recombination mechanisms. Yet, the dominant mechanism of carrier recombination at defects in 2D materials has not been well understood, and some outstanding questions remain: How do recombination processes at defects differ between 2D and 3D systems? What factors determine defects in 2D materials as excellent SPE at room temperature? In order to address these questions, we developed first-principles methods to accurately calculate the radiative and non-radiative recombination rates at defects in 2D materials, using h-BN as a prototypical example. We reveal the carrier recombination mechanism at defects in 2D materials being mostly dominated by defect-defect state recombination in contrast to defect-bulk state recombination in most 3D semiconductors. In particular, we disentangle the non-radiative recombination mechanism into key physical quantities: zero-phonon line (ZPL) and Huang-Rhys factor. At the end, we identified strain can effectively tune the electron-phonon coupling at defect centers and drastically change non-radiative recombination rates. Our theoretical development serves as a general platform for understanding carrier recombination at defects in 2D materials, while providing pathways for engineering of quantum efficiency of SPE.


title: Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noise

abstract: Neural Ordinary Differential Equation (Neural ODE) has been proposed as a continuous approximation to the ResNet architecture. Some commonly used regularization mechanisms in discrete neural networks (e.g. dropout, Gaussian noise) are missing in current Neural ODE networks. In this paper, we propose a new continuous neural network framework called Neural Stochastic Differential Equation (Neural SDE) network, which naturally incorporates various commonly used regularization mechanisms based on random noise injection. Our framework can model various types of noise injection frequently used in discrete networks for regularization purpose, such as dropout and additive/multiplicative noise in each block. We provide theoretical analysis explaining the improved robustness of Neural SDE models against input perturbations/adversarial attacks. Furthermore, we demonstrate that the Neural SDE network can achieve better generalization than the Neural ODE and is more resistant to adversarial and non-adversarial input perturbations.


title: Resonant algebras in Chern-Simons model of topological insulators

abstract: This paper explores the possibility of using Maxwell algebra and its generalizations called resonant algebras for the unified description of topological insulators. We offer the natural action construction, which includes the relativistic Wen-Zee and other terms, with adjustable coupling constants. By gauging all available resonant algebras formed by Lorentz, translational and Maxwell generators $\{J_a, P_a, Z_a\}$ we present six Chern-Simons Lagrangians with various terms content accounting for different aspects of the topological insulators. Additionally, we provide complementary actions for another invariant metric form, which might turn out useful in some generalized (2+1) gravity models.


title: Write-ups for workshop on the project for the hadron experimental facility of J-PARC, Partial collection of LOIs at the extended hadron hall and the related topics

abstract: This write-up document is a summary of International workshop on the project for the extended hadron experimental facility which was held from March 26 to 28, 2018 at KEK Tokai Campus. This document is a collection of Letter Of Intents (LOIs) related to the proposed beam lines in the extended hadron experimental facility at J-PARC.


title: Survey on Publicly Available Sinhala Natural Language Processing Tools and Research

abstract: Sinhala is the native language of the Sinhalese people who make up the largest ethnic group of Sri Lanka. The language belongs to the globe-spanning language tree, Indo-European. However, due to poverty in both linguistic and economic capital, Sinhala, in the perspective of Natural Language Processing tools and research, remains a resource-poor language which has neither the economic drive its cousin English has nor the sheer push of the law of numbers a language such as Chinese has. A number of research groups from Sri Lanka have noticed this dearth and the resultant dire need for proper tools and research for Sinhala natural language processing. However, due to various reasons, these attempts seem to lack coordination and awareness of each other. The objective of this paper is to fill that gap of a comprehensive literature survey of the publicly available Sinhala natural language tools and research so that the researchers working in this field can better utilize contributions of their peers. As such, we shall be uploading this paper to arXiv and perpetually update it periodically to reflect the advances made in the field.


title: All Terminal Reliability Roots of Smallest Modulus

abstract: Given a connected graph $G$ whose vertices are perfectly reliable and whose edges each fail independently with probability $q\in[0,1],$ the \textit{(all-terminal) reliability} of $G$ is the probability that the resulting subgraph of operational edges contains a spanning tree (this probability is always a polynomial in $q$). The location of the roots of reliability polynomials has been well studied, with particular interest in finding those with the largest moduli. In this paper, we will discuss a related problem -- among all reliability polynomials of graphs on $n$ vertices, which has a root of smallest modulus? We prove that, provided $n \geq 3$, the roots of smallest moduli occur precisely for the cycle graph $C_n$, and the root is unique.


title: Intelligent Reflecting Surface Assisted Wireless Communication: Modeling and Channel Estimation

abstract: The recently completed 5G new radio standard is a result of several cutting-edge technologies, including massive multiple-input multiple-output (MIMO), millimeter (mm)-Wave communication and network densification. However, these technologies face two main practical limitations 1) the lack of control over the wireless channel, and 2) the high power consumption of the wireless interface. To address the need for green and sustainable future cellular networks, the concept of reconfiguring wireless propagation environments using Intelligent Reflecting Surfaces (IRS)s has emerged. An IRS comprises of a large number of low-cost passive antennas that can smartly reflect the impinging electromagnetic waves for performance enhancement. This paper looks at the evolution of the reflective radio concept towards IRSs, outlines the IRS-assisted multi-user multiple-input single-output (MISO) communication model and discusses how it differentiates from the conventional multi-antenna communication models. We propose a minimum mean squared error (MMSE) based channel estimation protocol for the design and analysis of IRS-assisted systems. Performance evaluation results at 2.5 GHz operating frequency are provided to illustrate the efficiency of the proposed system.


title: Explain Yourself! Leveraging Language Models for Commonsense Reasoning

abstract: Deep learning models perform poorly on tasks that require commonsense reasoning, which often necessitates some form of world-knowledge or reasoning over information not immediately present in the input. We collect human explanations for commonsense reasoning in the form of natural language sequences and highlighted annotations in a new dataset called Common Sense Explanations (CoS-E). We use CoS-E to train language models to automatically generate explanations that can be used during training and inference in a novel Commonsense Auto-Generated Explanation (CAGE) framework. CAGE improves the state-of-the-art by 10% on the challenging CommonsenseQA task. We further study commonsense reasoning in DNNs using both human and auto-generated explanations including transfer to out-of-domain tasks. Empirical results indicate that we can effectively leverage language models for commonsense reasoning.


title: Lookout for Zombies: Mitigating Flush+Reload Attack on Shared Caches by Monitoring Invalidated Lines

abstract: OS-based page sharing is a commonly used optimization in modern systems to reduce memory footprint. Unfortunately, such sharing can cause Flush+Reload cache attacks, whereby a spy periodically flushes a cache line of shared data (using the clflush instruction) and reloads it to infer the access patterns of a victim application. Current proposals to mitigate Flush+Reload attacks are impractical as they either disable page sharing, or require application rewrite, or require OS support, or incur ISA changes. Ideally, we want to tolerate attacks without requiring any OS or ISA support and while incurring negligible performance and storage overheads. This paper makes the key observation that when a cache line is invalidated due to a Flush-Caused Invalidation (FCI), the tag and data of the invalidated line are still resident in the cache and can be used for detecting Flush-based attacks. We call lines invalidated due to FCI as Zombie lines. Our design explicitly marks such lines as Zombies, preserves the Zombie lines in the cache, and uses the hits and misses to Zombie lines to tolerate the attacks. We propose Zombie-Based Mitigation (ZBM), a simple hardware-based design that successfully guards against attacks by simply treating hits on Zombie-lines as misses to avoid any timing leaks to the attacker. We analyze the robustness of ZBM using three spy programs: attacking AES T-Tables, attacking RSA Square-and-Multiply, and Function Watcher (FW), and show that ZBM successfully defends against these attacks. Our solution requires negligible storage (4-bits per cache line), retains OS-based page sharing, requires no OS/ISA changes, and does not incur slowdown for benign applications.


title: Novel Mechanocaloric Materials for Solid-State Cooling Applications

abstract: Solid-state cooling is an environmentally friendly and highly scalable technology that may solve most of the problems associated with current refrigerant methods. Solid-state cooling consists of applying external fields on caloric materials, which react thermally as a result of induced phase transformations. From an energy efficiency point of view, mechanocaloric compounds, in which the phase transitions of interest are driven by mechanical stresses, probably represent the most encouraging type of caloric materials. Conventional mechanocaloric materials like shape-memory alloys already display good cooling performances however in most cases they also present critical mechanical fatigue and hysteresis problems that limit their applicability. Finding new mechanocaloric materials and mechanisms able to overcome those problems while simultaneously rendering large temperature shifts, is necessary to further advance the field of solid-state cooling. In this article, we review novel families of mechanocaloric materials that in recent years have been shown to be specially promising in the aspects that conventional mechanocaloric materials are not, and which exhibit unconventional but significant caloric effects. We put an emphasis on elastocaloric materials, in which the targeted cooling spans are obtained through uniaxial stresses, since from an applied perspective these appear to be the most accomplished. Two different types of mechanocaloric materials emerge as particularly hopeful from our analysis, compounds that exhibit field-induced order disorder phase transitions involving either ions or molecules (fast-ion conductors and plastic crystals), and multiferroics in which the structural parameters are strongly coupled with polar and/or magnetic degrees of freedom (magnetic alloys and oxide perovskites).


title: Signatures of fluid-fluid displacement in porous media: wettability, patterns, and pressures

abstract: We develop a novel `moving capacitor' dynamic network model to simulate immiscible fluid-fluid displacement in porous media. Traditional network models approximate the pore geometry as a network of fixed resistors, directly analogous to an electrical circuit. Our model additionally captures the motion of individual fluid-fluid interfaces through the pore geometry by completing this analogy, representing interfaces as a set of moving capacitors. By incorporating pore-scale invasion events, the model reproduces, for the first time, both the displacement pattern and the injection pressure signal under a wide range of capillary numbers and substrate wettabilities. We show that at high capillary numbers the invading patterns advance symmetrically through viscous fingers. In contrast, at low capillary numbers the flow is governed by the wettability-dependent fluid-fluid interactions with the pore structure. The signature of the transition between the two regimes manifests itself in the fluctuations of the injection pressure signal.


title: Context-Aware Visual Policy Network for Fine-Grained Image Captioning

abstract: With the maturity of visual detection techniques, we are more ambitious in describing visual content with open-vocabulary, fine-grained and free-form language, i.e., the task of image captioning. In particular, we are interested in generating longer, richer and more fine-grained sentences and paragraphs as image descriptions. Image captioning can be translated to the task of sequential language prediction given visual content, where the output sequence forms natural language description with plausible grammar. However, existing image captioning methods focus only on language policy while not visual policy, and thus fail to capture visual context that are crucial for compositional reasoning such as object relationships (e.g., "man riding horse") and visual comparisons (e.g., "small(er) cat"). This issue is especially severe when generating longer sequences such as a paragraph. To fill the gap, we propose a Context-Aware Visual Policy network (CAVP) for fine-grained image-to-language generation: image sentence captioning and image paragraph captioning. During captioning, CAVP explicitly considers the previous visual attentions as context, and decides whether the context is used for the current word/sentence generation given the current visual attention. Compared against traditional visual attention mechanism that only fixes a single visual region at each step, CAVP can attend to complex visual compositions over time. The whole image captioning model -- CAVP and its subsequent language policy network -- can be efficiently optimized end-to-end by using an actor-critic policy gradient method. We have demonstrated the effectiveness of CAVP by state-of-the-art performances on MS-COCO and Stanford captioning datasets, using various metrics and sensible visualizations of qualitative visual context.


title: A Statistical Density-Based Analysis of Graph Clustering Algorithm Performance

abstract: Measuring graph clustering quality remains an open problem. To address it, we introduce quality measures based on comparisons of intra- and inter-cluster densities, an accompanying statistical test of the significance of their differences and a step-by-step routine for clustering quality assessment. Our null hypothesis does not rely on any generative model for the graph, unlike modularity which uses the configuration model as a null model. Our measures are shown to meet the axioms of a good clustering quality function, unlike the very commonly used modularity measure. They also have an intuitive graph-theoretic interpretation, a formal statistical interpretation and can be easily tested for significance. Our work is centered on the idea that well clustered graphs will display a significantly larger intra-cluster density than inter-cluster density. We develop tests to validate the existence of such a cluster structure. We empirically explore the behavior of our measures under a number of stress test scenarios and compare their behavior to the commonly used modularity and conductance measures. Empirical stress test results confirm that our measures compare very favorably to the established ones. In particular, they are shown to be more responsive to graph structure and less sensitive to sample size and breakdowns during numerical implementation and less sensitive to uncertainty in connectivity. These features are especially important in the context of larger data sets or when the data may contain errors in the connectivity patterns.


title: Qsparse-local-SGD: Distributed SGD with Quantization, Sparsification, and Local Computations

abstract: Communication bottleneck has been identified as a significant issue in distributed optimization of large-scale learning models. Recently, several approaches to mitigate this problem have been proposed, including different forms of gradient compression or computing local models and mixing them iteratively. In this paper, we propose \emph{Qsparse-local-SGD} algorithm, which combines aggressive sparsification with quantization and local computation along with error compensation, by keeping track of the difference between the true and compressed gradients. We propose both synchronous and asynchronous implementations of \emph{Qsparse-local-SGD}. We analyze convergence for \emph{Qsparse-local-SGD} in the \emph{distributed} setting for smooth non-convex and convex objective functions. We demonstrate that \emph{Qsparse-local-SGD} converges at the same rate as vanilla distributed SGD for many important classes of sparsifiers and quantizers. We use \emph{Qsparse-local-SGD} to train ResNet-50 on ImageNet and show that it results in significant savings over the state-of-the-art, in the number of bits transmitted to reach target accuracy.


title: A general local causality principle of space-time

abstract: We propose a generalisation of the local causality principle of space-time, asserting that it holds for all regimes of motion, including superluminal motions. It assumes the existence of a countably infinite set of metrical null cone speeds, $c_k$, where the first one, $c_1=c$, corresponds to the speed of light in vacuum. Our associated space-time measures do not diverge at the maximum speed of each interval of speeds and implies a generalisation of Einstein's rule for velocities addition. We construct a causal structure for each regime of motion. After introducing a simple dynamical measure, we derive an expression for the energy of material particles, which approaches the relativistic one when $v<c$. An experiment to energise photons in an 1-1 process is proposed as a test of our interpretation of the non divergence at the speed of light of present space-time measures. We discuss also the possible transition of a material particle from the subluminal regime $v<c$ to the first superluminal regime and vice versa, making discrete changes in $v^2/c^2$ around the unit in terms of a very tiny constant, $\epsilon^2$, which we introduce to prevent the divergence of the Lorentz $\gamma$ factor at the speed of light in vacuum.


title: Magnetic field effects on neutrino oscillations

abstract: Using the exact propagators in a constant magnetic field, the neutrino self-energy has been calculated to all orders in the field strength $B$ within the minimal extension of the Weinberg-Salam model with massive Dirac neutrinos. A neutrino dispersion relation, effective potential and effective mass have been obtained that depend on $B$. The consequences of this effective potential on neutrino oscillations have been explored, and resonance conditions have been obtained for magnetic fields $0<eB \le 4m^2_e$, where $e$ is the elementary charge and $m_e$ is the electron mass. The oscillation length has also been obtained, showing that $\nu_e$-$\nu_\mu$ resonant oscillations in magnetic field are likely to occur in the proximity of most stars generating high magnetic fields.


title: Morita Equivalence of W*-Correspondences and their Hardy Algebras

abstract: Muhly and Solel developed a notion of Morita equivalence for $C^{*}$- correspondences, which they used to show that if two $C^{*}$-correspondences $E$ and $F$ are Morita equivalent then their tensor algebras $\mathcal{T}_{+}(E)$ and $\mathcal{T}_{+}(F)$ are (strongly) Morita equivalent operator algebras. We give the weak$^{*}$ version of this result by considering (weak) Morita equivalence of $W^{*}$-correspondences and employing Blecher and Kashyap's notion of Morita equivalence for dual operator algebras. More precisely, we show that weak Morita equivalence of $W^{*}$-correspondences $E$ and $F$ implies weak Morita equivalence of their Hardy algebras $H^{\infty}(E)$ and $H^{\infty}(F)$. We give special attention to $W^{*}$-graph correspondences and show a number of results related to their Morita equivalence.


title: Omnidirectional Scene Text Detection with Sequential-free Box Discretization

abstract: Scene text in the wild is commonly presented with high variant characteristics. Using quadrilateral bounding box to localize the text instance is nearly indispensable for detection methods. However, recent researches reveal that introducing quadrilateral bounding box for scene text detection will bring a label confusion issue which is easily overlooked, and this issue may significantly undermine the detection performance. To address this issue, in this paper, we propose a novel method called Sequential-free Box Discretization (SBD) by discretizing the bounding box into key edges (KE) which can further derive more effective methods to improve detection performance. Experiments showed that the proposed method can outperform state-of-the-art methods in many popular scene text benchmarks, including ICDAR 2015, MLT, and MSRA-TD500. Ablation study also showed that simply integrating the SBD into Mask R-CNN framework, the detection performance can be substantially improved. Furthermore, an experiment on the general object dataset HRSC2016 (multi-oriented ships) showed that our method can outperform recent state-of-the-art methods by a large margin, demonstrating its powerful generalization ability. Source code: https://github.com/Yuliang-Liu/Box_Discretization_Network.


title: The forward and backward shift on the Lipschitz space of a tree

abstract: We initiate the study of the forward and backward shifts on the Lipschitz space of a tree, $\mathcal L$, and on the little Lipshitz space of a tree, ${\mathcal L}_0$. We determine that the forward shift is bounded both on $\mathcal L$ and on ${\mathcal L}_0$ and, when the tree is leafless, it is an isometry; we also calculate its spectrum. For the backward shift, we determine when it is bounded on $\mathcal L$ and on ${\mathcal L}_0$, we find the norm when the tree is homogeneous, we calculate the spectrum for the case when the tree is homogeneous, and we determine, for a general tree, when it is hypercyclic.


title: From hyperelliptic to superelliptic curves

abstract: In this long survey article we show that the theory of elliptic and hyperelliptic curves can be extended naturally to all superelliptic curves. We focus on automorphism groups, stratification of the moduli space $\mathcal{M}_g$, binary forms, invariants of curves, weighted projective spaces, minimal models for superelliptic curves, field of moduli versus field of definition, theta functions, Jacobian varieties, addition law in the Jacobian, isogenies among Jacobians, etc. Many recent developments on the theory of superelliptic curves are provided as well as many open problems.


title: Blockwise Based Detection of Local Defects

abstract: Print quality is an important criterion for a printer's performance. The detection, classification, and assessment of printing defects can reflect the printer's working status and help to locate mechanical problems inside. To handle all these questions, an efficient algorithm is needed to replace the traditionally visual checking method. In this paper, we focus on pages with local defects including gray spots and solid spots. We propose a coarse-to-fine method to detect local defects in a block-wise manner, and aggregate the blockwise attributes to generate the feature vector of the whole test page for a further ranking task. In the detection part, we first select candidate regions by thresholding a single feature. Then more detailed features of candidate blocks are calculated and sent to a decision tree that is previously trained on our training dataset. The final result is given by the decision tree model to control the false alarm rate while maintaining the required miss rate. Our algorithm is proved to be effective in detecting and classifying local defects compared with previous methods.


title: The Momentum Representation of the Hydrogen Atom in Paraboloidal Coordinates

abstract: We examine the procedure to construct the variables of use for the momentum representation in quantum mechanics. The momentum variables must be chosen properly conjugate to the corresponding position space variables, such that valid uncertainty relationships are maintained. We then apply such considerations to the hydrogen atom to obtain the momentum space wave functions corresponding to the position space functions in paraboloidal coordinates. The advantages and disadvantages of employing the momentum representation are explored.


title: Training Temporal Word Embeddings with a Compass

abstract: Temporal word embeddings have been proposed to support the analysis of word meaning shifts during time and to study the evolution of languages. Different approaches have been proposed to generate vector representations of words that embed their meaning during a specific time interval. However, the training process used in these approaches is complex, may be inefficient or it may require large text corpora. As a consequence, these approaches may be difficult to apply in resource-scarce domains or by scientists with limited in-depth knowledge of embedding models. In this paper, we propose a new heuristic to train temporal word embeddings based on the Word2vec model. The heuristic consists in using atemporal vectors as a reference, i.e., as a compass, when training the representations specific to a given time interval. The use of the compass simplifies the training process and makes it more efficient. Experiments conducted using state-of-the-art datasets and methodologies suggest that our approach outperforms or equals comparable approaches while being more robust in terms of the required corpus size.


title: Non-Linear Estimation of Convolutionally Encoded Sequences

abstract: Suppose that a convolutionally encoded sequence is transmitted symbol by symbol over an AWGN channel using BPSK modulation. In this case, pairs of the signal (i.e., code symbol) and observation are not jointly Gaussian and therefore, a linear estimation method cannot be applied. Hence, in this paper, non-linear estimation of convolutionally encoded sequences is discussed. First a probability measure (denoted Q), whose Radon-Nikodym derivative with respect to the underlying probability measure P is an exponential martingale, is constructed. It is shown that with respect to Q, the observations are mutually independent Gaussian random vectors with zero mean and identity covariance matrix. We see that the relationship between observation noises (with respect to P) and observations (with respect to Q) has a close relation to the Girsanov theorem in continuous case. Next, using the probability measure Q, we calculate the conditional probability of an event related to any encoded symbol conditioned by the observations. Moreover, we transform it into a recursive form. In the process of derivation, the metric associated with an encoded sequence comes out in a natural way. Finally, it is shown that maximum a posteriori probability (MAP) decoding of convolutional codes is realized using the derived conditional probability.


title: Charge noise induced spin dephasing in a nanowire double quantum dot with spin-orbit coupling

abstract: Unexpected fluctuating charge field near a semiconductor quantum dot has severely limited the coherence time of the localized spin qubit. It is the interplay between the spin-orbit coupling and the asymmetrical confining potential in a quantum dot, that mediates the longitudinal interaction between the spin qubit and the fluctuating charge field. Here, we study the $1/f$ charge noise induced spin dephasing in a nanowire double quantum dot via exactly solving its eigen-energies and eigenfunctions. Our calculations demonstrate that the spin dephasing has a nonmonotonic dependence on the asymmetry of the double quantum dot confining potential. With the increase of the potential asymmetry, the dephasing rate first becomes stronger very sharply before reaching to a maximum, after that it becomes weaker softly. Also, we find that the applied external magnetic field contributes to the spin dephasing, the dephasing rate is strongest at the anti-crossing point $B_{0}$ in the double quantum dot.


title: Distributed Optimal Load Frequency Control Considering Nonsmooth Cost Functions

abstract: This work addresses the distributed frequency control problem in power systems considering controllable load with a nonsmooth cost. The nonsmoothness exists widely in power systems, such as tiered price, greatly challenging the design of distributed optimal controllers. In this regard, we first formulate an optimization problem that minimizes the nonsmooth regulation cost, where both capacity limits of controllable load and tie-line flow are considered. Then, a distributed controller is derived using the Clark generalized gradient. We also prove the optimality of the equilibrium of the closed-loop system as well as its asymptotic stability. Simulations carried out on the IEEE 68-bus system verifies the effectiveness of the proposed method.


title: SOFIA Far-infrared [O III] and [O I] Observations of Dense CO-knots in the Supernova Remnant Cassiopeia A: Multi-phase Ejecta

abstract: Dense, fast-moving ejecta knots in supernova remnants are prime sites for molecule and dust formation. We present SOFIA far-IR spectrometer FIFI-LS observations of CO-rich knots in Cas A which cover a ~1 square arc minute area of the northern shell, in the [O III] 52 and 88 micron and [O I] 63 micron lines. The FIFI-LS spectra reveal that the line profiles of [O III] and [O I] are similar to those of the Herschel PACS [O III] and CO lines. We find that the [O III] maps show very different morphology than the [O I] map. The [O III] maps reveal diffuse, large-scale structures and the ratio of the two [O III] lines imply the presence of gas with a range of density 500 - 10,000 per cm^3 within the mapped region. In contrast, the [O I] map shows bright emission associated with the dense CO-rich knots. The 63 micron [O I] line traces cooled, dense post-shocked gas of ejecta. We find that IR-dominated [O III] emission is from post-shocked gas based on its morphology, high column density, and velocity profile. We describe multi-phase ejecta knots, a lifetime of clumps, and survival of dust in the young supernova remnants.


title: Negatively Curved Three-Manifolds, Hyperbolic Metrics, Isometric Embeddings In Minkowski Space And The Cross Curvature Flow

abstract: This short note is a mostly expository article examining negatively curved three-manifolds. We look at some rigidity properties related to isometric embeddings into Minkowski space. We also review the Cross Curvature Flow (XCF) as a tool to study the space of negatively curved metrics on hyperbolic three-manifolds, the largest and least understood class of model geometries in Thurston's Geometrisation. The relationship between integrability and embedability yields interesting insights, and we show that solutions with fixed Einstein volume are precisely the integrable solutions, answering a question posed by Chow and Hamilton when they introduced the XCF.


title: Surrogate Modeling for Fluid Flows Based on Physics-Constrained Deep Learning Without Simulation Data

abstract: Numerical simulations on fluid dynamics problems primarily rely on spatially or/and temporally discretization of the governing equation into the finite-dimensional algebraic system solved by computers. Due to complicated nature of the physics and geometry, such process can be computational prohibitive for most real-time applications and many-query analyses. Therefore, developing a cost-effective surrogate model is of great practical significance. Deep learning (DL) has shown new promises for surrogate modeling due to its capability of handling strong nonlinearity and high dimensionality. However, the off-the-shelf DL architectures fail to operate when the data becomes sparse. Unfortunately, data is often insufficient in most parametric fluid dynamics problems since each data point in the parameter space requires an expensive numerical simulation based on the first principle, e.g., Naiver--Stokes equations. In this paper, we provide a physics-constrained DL approach for surrogate modeling of fluid flows without relying on any simulation data. Specifically, a structured deep neural network (DNN) architecture is devised to enforce the initial and boundary conditions, and the governing partial differential equations are incorporated into the loss of the DNN to drive the training. Numerical experiments are conducted on a number of internal flows relevant to hemodynamics applications, and the forward propagation of uncertainties in fluid properties and domain geometry is studied as well. The results show excellent agreement on the flow field and forward-propagated uncertainties between the DL surrogate approximations and the first-principle numerical simulations.


title: Improved second harmonic performance in periodically poled LNOI waveguides through engineering of lateral leakage

abstract: In this contribution we investigate the impact of lateral leakage for linear and nonlinear optical waveguides in lithium niobate on insulator (LNOI). Silicon nitride (SiN) loaded and direct patterned lithium niobate cross-sections are investigated. We show that lateral leakage can take place for the TE mode in LNOI ridge waveguides (X-cut lithium niobate), due to the birefringence of the material. This work gives guidelines for designing waveguides in LNOI that do not suffer from the lateral leakage effect. By applying these design considerations, we avoided the lateral leakage effect at the second harmonic wavelength of a nonlinear optical waveguide in LNOI and demonstrate a peak second harmonic generation conversion efficiency of ~1160% W-1cm-2.


title: Selecting Biomarkers for building optimal treatment selection rules using Kernel Machines

abstract: Optimal biomarker combinations for treatment-selection can be derived by minimizing total burden to the population caused by the targeted disease and its treatment. However, when multiple biomarkers are present, including all in the model can be expensive and hurt model performance. To remedy this, we consider feature selection in optimization by minimizing an extended total burden that additionally incorporates biomarker measurement costs. Formulating it as a 0-norm penalized weighted classification, we develop various procedures for estimating linear and nonlinear combinations. Through simulations and a real data example, we demonstrate the importance of incorporating feature-selection and marker cost when deriving treatment-selection rules.


title: ASP-based Discovery of Semi-Markovian Causal Models under Weaker Assumptions

abstract: In recent years the possibility of relaxing the so-called Faithfulness assumption in automated causal discovery has been investigated. The investigation showed (1) that the Faithfulness assumption can be weakened in various ways that in an important sense preserve its power, and (2) that weakening of Faithfulness may help to speed up methods based on Answer Set Programming. However, this line of work has so far only considered the discovery of causal models without latent variables. In this paper, we study weakenings of Faithfulness for constraint-based discovery of semi-Markovian causal models, which accommodate the possibility of latent variables, and show that both (1) and (2) remain the case in this more realistic setting.


title: Deep Reinforcement Learning for Multi-objective Optimization

abstract: This study proposes an end-to-end framework for solving multi-objective optimization problems (MOPs) using Deep Reinforcement Learning (DRL), that we call DRL-MOA. The idea of decomposition is adopted to decompose the MOP into a set of scalar optimization subproblems. Then each subproblem is modelled as a neural network. Model parameters of all the subproblems are optimized collaboratively according to a neighborhood-based parameter-transfer strategy and the DRL training algorithm. Pareto optimal solutions can be directly obtained through the trained neural network models. In specific, the multi-objective travelling salesman problem (MOTSP) is solved in this work using the DRL-MOA method by modelling the subproblem as a Pointer Network. Extensive experiments have been conducted to study the DRL-MOA and various benchmark methods are compared with it. It is found that, once the trained model is available, it can scale to newly encountered problems with no need of re-training the model. The solutions can be directly obtained by a simple forward calculation of the neural network; thereby, no iteration is required and the MOP can be always solved in a reasonable time. The proposed method provides a new way of solving the MOP by means of DRL. It has shown a set of new characteristics, e.g., strong generalization ability and fast solving speed in comparison with the existing methods for multi-objective optimizations. Experimental results show the effectiveness and competitiveness of the proposed method in terms of model performance and running time.


title: A General $\mathcal{O}(n^2)$ Hyper-Parameter Optimization for Gaussian Process Regression with Cross-Validation and Non-linearly Constrained ADMM

abstract: Hyper-parameter optimization remains as the core issue of Gaussian process (GP) for machine learning nowadays. The benchmark method using maximum likelihood (ML) estimation and gradient descent (GD) is impractical for processing big data due to its $O(n^3)$ complexity. Many sophisticated global or local approximation models, for instance, sparse GP, distributed GP, have been proposed to address such complexity issue. In this paper, we propose two novel and general-purpose GP hyper-parameter training schemes (GPCV-ADMM) by replacing ML with cross-validation (CV) as the fitting criterion and replacing GD with a non-linearly constrained alternating direction method of multipliers (ADMM) as the optimization method. The proposed schemes are of $O(n^2)$ complexity for any covariance matrix without special structure. We conduct various experiments based on both synthetic and real data sets, wherein the proposed schemes show excellent performance in terms of convergence, hyper-parameter estimation accuracy, and computational time in comparison with the traditional ML based routines given in the GPML toolbox.


title: Symmetry of Positive Solutions for the Fractional Schr$ \ddot{\textrm{o}}$dinger Equations with Choquard-type Nonlinearities

abstract: This paper deals with the following fractional Schr$ \ddot{\textrm{o}}$dinger equations with Choquard-type nonlinearities \begin{equation*} \left\{\begin{array}{r@{\ \ }c@{\ \ }ll} (-\Delta)^{\frac{\alpha}{2}}u + u - C_{n,-\beta} \,(|x|^{\beta-n}\ast u^{p})\, u^{p-1}& = &0 & \mbox{in}\ \ \mathbb{R}^{n}\,, \\[0.05cm] u & > & 0 & \mbox{on}\ \ \mathbb{R}^{n}, \end{array}\right. \end{equation*} where $ 0< \alpha,\beta < 2, 1\leq p <\infty \,\,and\,\, n\geq 2. $ First we construct a decay result at infinity and a narrow region principle for related equations. Then we establish the radial symmetry of positive solutions for the above equation with the generalized direct method of moving planes.


title: Enhancing Multi-model Inference with Natural Selection

abstract: Multi-model inference covers a wide range of modern statistical applications such as variable selection, model confidence set, model averaging and variable importance. The performance of multi-model inference depends on the availability of candidate models, whose quality has been rarely studied in literature. In this paper, we study genetic algorithm (GA) in order to obtain high-quality candidate models. Inspired by the process of natural selection, GA performs genetic operations such as selection, crossover and mutation iteratively to update a collection of potential solutions (models) until convergence. The convergence properties are studied based on the Markov chain theory and used to design an adaptive termination criterion that vastly reduces the computational cost. In addition, a new schema theory is established to characterize how the current model set is improved through evolutionary process. Extensive numerical experiments are carried out to verify our theory and demonstrate the empirical power of GA, and new findings are obtained for two real data examples.


title: Multi-view Knowledge Graph Embedding for Entity Alignment

abstract: We study the problem of embedding-based entity alignment between knowledge graphs (KGs). Previous works mainly focus on the relational structure of entities. Some further incorporate another type of features, such as attributes, for refinement. However, a vast of entity features are still unexplored or not equally treated together, which impairs the accuracy and robustness of embedding-based entity alignment. In this paper, we propose a novel framework that unifies multiple views of entities to learn embeddings for entity alignment. Specifically, we embed entities based on the views of entity names, relations and attributes, with several combination strategies. Furthermore, we design some cross-KG inference methods to enhance the alignment between two KGs. Our experiments on real-world datasets show that the proposed framework significantly outperforms the state-of-the-art embedding-based entity alignment methods. The selected views, cross-KG inference and combination strategies all contribute to the performance improvement.


title: Families of Supermanifolds: Splitting Types and Obstruction Maps

abstract: In this article we study the notion of supermanifolds families, starting from Green's general classification of supermanifolds. The topics studied divide this article into two distinct parts, labelled I and II respectively. Part I concerns the splitting type of a supermanifold and our attempt to construct variations thereof. In Part II we look at a particular class of families, referred to as `$gtm$-families'. We are concerned with the notion of a `secondary obstruction theory', which is apparent in any $gtm$-family of supermanifolds over a (connected and Stein) non-reduced, superspace base.


title: Generative Model-Based Ischemic Stroke Lesion Segmentation

abstract: CT perfusion (CTP) has been used to triage ischemic stroke patients in the early stage, because of its speed, availability, and lack of contraindications. Perfusion parameters including cerebral blood volume (CBV), cerebral blood flow (CBF), mean transit time (MTT) and time of peak (Tmax) could also be computed from CTP data. However, CTP data or the perfusion parameters, are ambiguous to locate the infarct core or tissue at risk (penumbra), which is normally confirmed by the follow-up Diffusion Weighted Imaging (DWI) or perfusion diffusion mismatch. In this paper, we propose a novel generative modelbased segmentation framework composed of an extractor, a generator and a segmentor for ischemic stroke lesion segmentation. First, an extractor is used to directly extract the representative feature images from the CTP feature images. Second, a generator is used to generate the clinical relevant DWI images using the output from the extractor and perfusion parameters. Finally, the segmentor is used to precisely segment the ischemic stroke lesion using the generated DWI from the generator. Meanwhile, a novel pixel-region loss function, generalized dice combined with weighted cross entropy, is used to handle data unbalance problem which is commonly encountered in medical image segmentation. All networks are trained end-to-end from scratch using the 2018 Ischemic Stroke Lesion Segmentation Challenge (ISLES) dataset and our method won the first place in the 2018 ischemic stroke lesions segmentation challenge in the test stage.


title: Stochastic Sparse Learning with Momentum Adaptation for Imprecise Memristor Networks

abstract: Memristor based neural networks have great potentials in on-chip neuromorphic computing systems due to the fast computation and low-energy consumption. However, the imprecise properties of existing memristor devices generally result in catastrophic failures for the network in-situ training, which significantly impedes their engineering applications. In this work, we design a novel learning scheme that integrates stochastic sparse updating with momentum adaption (SSM) to efficiently train the imprecise memristor networks with high classification accuracy. The SSM scheme consists of: (1) a stochastic and discrete learning method to make weight updates sparse; (2) a momentum based gradient algorithm to eliminate training noises and distill robust updates; (3) a network re-initialization method to mitigate the device-to-device variation; (4) an update compensation strategy to further stabilize the weight programming process. With the SSM scheme, experiments show that the classification accuracy on multilayer perceptron (MLP) and convolutional neural network (CNN) improves from 26.12% to 90.07% and from 65.98% to 92.38%, respectively. Meanwhile, the total numbers of weight updating pulses decrease 90% and 40% in MLP and CNN, respectively, and the convergence rates are both 3x faster. The SSM scheme provides a high-accuracy, low-power, and fast-convergence solution for the in-situ training of imprecise memristor networks, which is crucial to future neuromorphic intelligence systems.


title: Counting curves with local tangency constraints

abstract: We construct invariants for any closed semipositive symplectic manifold which count rational curves satisfying tangency constraints to a local divisor. More generally, we introduce invariants involving multibranched local tangency constraints. We give a formula describing how these invariants arise as point constraints are pushed together in dimension four, and we use this to recursively compute all of these invariants in terms of Gromov--Witten invariants of blowups. As a key tool, we study analogous invariants which count punctured curves with negative ends on a small skinny ellipsoid.


title: A Hot Saturn Near (but unassociated with) the Open Cluster NGC 1817

abstract: We report on the discovery of a hot Saturn-sized planet (9.916 +/- 0.985 R_earth) around a late F star, EPIC 246865365, observed in Campaign 13 of the K2 mission. We began studying this planet candidate because prior to the release of Gaia DR2, the host star was thought to have been a member (> 90% membership probability) of the approximately 1 Gyr open cluster NGC 1817 based on its kinematics and photometric distance. We identify the host star (among three stars within the K2 photometric aperture) using seeing-limited photometry and rule out false positive scenarios using adaptive optics imaging and radial velocity observations. We statistically validate EPIC 246865365b by calculating a false positive probability rate of 0.01%. However, we also show using new kinematic measurements provided by Gaia DR2 and our measured radial velocity of the system that EPIC 246865365 is unassociated with the cluster NGC 1817. Therefore, the long-running search for a giant transiting planet in an open cluster remains fruitless. Finally, we note that our use of seeing-limited photometry is a good demonstration of similar techniques that are already being used to follow up TESS planet candidates, especially in crowded regions.


title: Passive Multi-Target Tracking Using the Adaptive Birth Intensity PHD Filter

abstract: Passive multi-target tracking applications require the integration of multiple spatially distributed sensor measurements to distinguish true tracks from ghost tracks. A popular multi-target tracking approach for these applications is the particle filter implementation of Mahler's probability hypothesis density (PHD) filter, which jointly updates the union of all target state space estimates without requiring computationally complex measurement-to-track data association. Although this technique is attractive for implementation in computationally limited platforms, the performance benefits can be significantly overshadowed by inefficient sampling of the target birth particles over the region of interest. We propose a multi-sensor extension of the adaptive birth intensity PHD filter described in (Ristic, 2012) to achieve efficient birth particle sampling driven by online sensor measurements from multiple sensors. The proposed approach is demonstrated using distributed time-difference-of-arrival (TDOA) and frequency-difference-of-arrival (FDOA) measurements, in which we describe exact techniques for sampling from the target state space conditioned on the observations. Numerical results are presented that demonstrate the increased particle density efficiency of the proposed approach over a uniform birth particle sampler.


title: Obstructed Target Tracking in Urban Environments

abstract: Accurate tracking in urban environments necessitates target birth, survival, and detection models that quantify the impact of terrain and building geometry on the sequential estimation procedure. Current efforts assume that target trajectories are limited to fixed paths, such as road networks. In these settings a single airborne platform with a downward-facing camera is capable of fully observing a target, outside of a few obstructed regions that can be determined a priori (e.g. tunnels). However, many practical target types are not necessarily restricted to road networks and thus require knowledge of azimuthal shadowed regions to the sensor. In this paper, we propose the integration of geospatial data for an urban environment into a particle filter realization of a random finite set target tracking algorithm. Specifically, we use 3D building polygons to compute the azimuthal shadowed regions with respect to deployed sensor location. The particle filter predict and update steps are modified such that (1) target births are assumed to occur in line-of-sight (LOS) regions, (2) targets do not move into obstructions, (3) true target detections only occur in LOS regions. The localization error performance improvement for a single target Bernoulli filter under these modifications is presented using freely available building vector data of New York City.


title: Query-efficient Meta Attack to Deep Neural Networks

abstract: Black-box attack methods aim to infer suitable attack patterns to targeted DNN models by only using output feedback of the models and the corresponding input queries. However, due to lack of prior and inefficiency in leveraging the query and feedback information, existing methods are mostly query-intensive for obtaining effective attack patterns. In this work, we propose a meta attack approach that is capable of attacking a targeted model with much fewer queries. Its high queryefficiency stems from effective utilization of meta learning approaches in learning generalizable prior abstraction from the previously observed attack patterns and exploiting such prior to help infer attack patterns from only a few queries and outputs. Extensive experiments on MNIST, CIFAR10 and tiny-Imagenet demonstrate that our meta-attack method can remarkably reduce the number of model queries without sacrificing the attack performance. Besides, the obtained meta attacker is not restricted to a particular model but can be used easily with a fast adaptive ability to attack a variety of models.The code of our work is available at https://github.com/dydjw9/MetaAttack_ICLR2020/.


title: SparseSense: Human Activity Recognition from Highly Sparse Sensor Data-streams Using Set-based Neural Networks

abstract: Batteryless or so called passive wearables are providing new and innovative methods for human activity recognition (HAR), especially in healthcare applications for older people. Passive sensors are low cost, lightweight, unobtrusive and desirably disposable; attractive attributes for healthcare applications in hospitals and nursing homes. Despite the compelling propositions for sensing applications, the data streams from these sensors are characterised by high sparsity---the time intervals between sensor readings are irregular while the number of readings per unit time are often limited. In this paper, we rigorously explore the problem of learning activity recognition models from temporally sparse data. We describe how to learn directly from sparse data using a deep learning paradigm in an end-to-end manner. We demonstrate significant classification performance improvements on real-world passive sensor datasets from older people over the state-of-the-art deep learning human activity recognition models. Further, we provide insights into the model's behaviour through complementary experiments on a benchmark dataset and visualisation of the learned activity feature spaces.


title: Automation of Construction Quantity Take-Off: Using Building Information Modeling (BIM)

abstract: Building information modeling (BIM) is a major upheaval in construction industry. Although BIM advantages in construction management has been proved in many papers reviewed, there are still many limitations that inhibit organizations to use BIM models efficiently. However, advancement of application programming interface (API) in the recent years has facilitated employing BIM in construction industry. This research contributes to the state of practice in construction management by developing API codes to automate estimation of construction. The developed API automatically filters items related to a particular discipline within a particular work area and facilitate systematical quantity take off in different work areas. This allows the planner to define proper 3D work areas and to estimate the required materials and man-hours in different work areas throughout the project. The results of the developed automated approach are compared with hand calculated results as well as the results calculated from the BIM software interface in special cases. Finally, the research has been validated by a case study of an actual petrochemical project.


title: Learning to regularize with a variational autoencoder for hydrologic inverse analysis

abstract: Inverse problems often involve matching observational data using a physical model that takes a large number of parameters as input. These problems tend to be under-constrained and require regularization to impose additional structure on the solution in parameter space. A central difficulty in regularization is turning a complex conceptual model of this additional structure into a functional mathematical form to be used in the inverse analysis. In this work we propose a method of regularization involving a machine learning technique known as a variational autoencoder (VAE). The VAE is trained to map a low-dimensional set of latent variables with a simple structure to the high-dimensional parameter space that has a complex structure. We train a VAE on unconditioned realizations of the parameters for a hydrological inverse problem. These unconditioned realizations neither rely on the observational data used to perform the inverse analysis nor require any forward runs of the physical model, thus making the computational cost of generating the training data minimal. The central benefit of this approach is that regularization is then performed on the latent variables from the VAE, which can be regularized simply. A second benefit of this approach is that the VAE reduces the number of variables in the optimization problem, thus making gradient-based optimization more computationally efficient when adjoint methods are unavailable. After performing regularization and optimization on the latent variables, the VAE then decodes the problem back to the original parameter space. Our approach constitutes a novel framework for regularization and optimization, readily applicable to a wide range of inverse problems. We call the approach RegAE.


title: An Analysis of Emotion Communication Channels in Fan Fiction: Towards Emotional Storytelling

abstract: Centrality of emotion for the stories told by humans is underpinned by numerous studies in literature and psychology. The research in automatic storytelling has recently turned towards emotional storytelling, in which characters' emotions play an important role in the plot development. However, these studies mainly use emotion to generate propositional statements in the form "A feels affection towards B" or "A confronts B". At the same time, emotional behavior does not boil down to such propositional descriptions, as humans display complex and highly variable patterns in communicating their emotions, both verbally and non-verbally. In this paper, we analyze how emotions are expressed non-verbally in a corpus of fan fiction short stories. Our analysis shows that stories written by humans convey character emotions along various non-verbal channels. We find that some non-verbal channels, such as facial expressions and voice characteristics of the characters, are more strongly associated with joy, while gestures and body postures are more likely to occur with trust. Based on our analysis, we argue that automatic storytelling systems should take variability of emotion into account when generating descriptions of characters' emotions.


title: Ease-of-Teaching and Language Structure from Emergent Communication

abstract: Artificial agents have been shown to learn to communicate when needed to complete a cooperative task. Some level of language structure (e.g., compositionality) has been found in the learned communication protocols. This observed structure is often the result of specific environmental pressures during training. By introducing new agents periodically to replace old ones, sequentially and within a population, we explore such a new pressure -- ease of teaching -- and show its impact on the structure of the resulting language.


title: Mechanical qubit-light entanglers in hybrid nonlinear qubit-optomechanics

abstract: Interfacing between matter qubits and light is a crucial provision for numerous quantum technological applications. However, a generic qubit may not directly interact with a relevant optical field mode, and hence, one could necessitate to adjust frequencies to match resonance conditions between parties. In this work, we show how a parametric coupling of the qubit with a mechanical oscillator, in conjunction with the trilinear radiation pressure coupling of the same object with light, can induce maximal qubit-light entanglement at an optimal time. We also show how our method enables conditional nonclassical state preparation of an optical field state via qubit measurements in the weak optomechanical coupling regime, whereas nonclassical states of the same can dynamically be achieved in the moderate-to-strong single photon coupling limit. Our scheme benefits from not requiring any cooling of the mechanical component, and not needing an adjusting of the detunings and transition frequencies to have resonance between any pairs of quantum systems.


title: Indirect interactions influence contact network structure and diffusion dynamics

abstract: Interaction patterns at the individual level influence the behaviour of diffusion over contact networks. Most of the current diffusion models only consider direct interactions among individuals to build underlying infectious items transmission networks. However, delayed indirect interactions, where a susceptible individual interacts with infectious items after the infected individual has left the interaction space, can also cause transmission events. We define a diffusion model called the same place different time transmission (SPDT) based diffusion that considers transmission links for these indirect interactions. Our SPDT model changes the network dynamics where the connectivity among individuals varies with the decay rates of link infectivity. We investigate SPDT diffusion behaviours by simulating airborne disease spreading on data-driven contact networks. The SPDT model significantly increases diffusion dynamics (particularly for networks with low link densities where indirect interactions create new infection pathways) and is capable of producing realistic disease reproduction number. Our results show that the SPDT model is significantly more likely to lead to outbreaks compared to current diffusion models with direct interactions. We find that the diffusion dynamics with including indirect links are not reproducible by the current models, highlighting the importance of the indirect links for predicting outbreaks.


title: Lattice field theory with torsion

abstract: Inspired by the duality between gravity and defects in crystals, we study lattice field theory with torsion. The torsion is realized by a line defect of a lattice, namely a dislocation. As the first application, we perform the numerical computation for vector and axial currents induced by a screw dislocation. This current generation is called the chiral torsional effect. We also derive the analytical formula for the chiral torsional effect in the continuum limit.


title: Higher curvature wormholes

abstract: In general relativity, traversable wormholes are possible provided they do not represent shortcuts in the spacetime. Einstein equations, together with the achronal averaged null energy condition, demand to take longer for an observer to go through the wormhole than through the ambient space. This forbids wormholes connecting two distant regions in the space. The situation is different when higher-curvature corrections are considered. Here, we construct a traversable wormhole solution connecting two asymptotically flat regions, otherwise disconnected. This geometry is an electro-vacuum solution to Lovelock theory of gravity coupled to an Abelian gauge field. The electric flux suffices to support the wormhole throat and to stabilize the solution. In fact, we show that, in contrast to other wormhole solutions previously found in this theory, the one constructed here turns out to be stable under scalar perturbations. We also consider wormholes in AdS. We present a protection argument showing that, while stable traversable wormholes connecting two asymptotically locally AdS$_5$ spaces do exist in the higher-curvature theory, the region of the parameter space where such solutions are admitted lies outside the causality bounds coming from AdS/CFT.


title: Comprehensive Personalized Ranking Using One-Bit Comparison Data

abstract: The task of a personalization system is to recommend items or a set of items according to the users' taste, and thus predicting their future needs. In this paper, we address such personalized recommendation problems for which one-bit comparison data of user preferences for different items as well as the different user inclinations toward an item are available. We devise a comprehensive personalized ranking (CPR) system by employing a Bayesian treatment. We also provide a connection to the learning method with respect to the CPR optimization criterion to learn the underlying low-rank structure of the rating matrix based on the well-established matrix factorization method. Numerical results are provided to verify the performance of our algorithm.


title: Evolution of the resonances of two parallel dielectric cylinders with distance between them

abstract: We study behavior of resonant modes under change of the distance between two parallel dielectric cylinders. The processes of mutual scattering of Mie resonant modes by cylinders result in an interaction between the cylinders which lifts a degeneracy of resonances of the isolated cylinders. There are two basic scenarios of evolution of resonances with the distance. For strong interaction of cylinders resonances are unbound with avoided crossings from the of the Mie resonances with increasing of the distance. That scenario is typical for low exciting resonances (monopole and dipole). For weak interaction of cylinders the resonances are bound around highly excited Mie resonances. Both scenarios demonstrate a significant enhancement of the $Q$ factor compared to the case of isolated cylinder.


title: Veneroni maps

abstract: Veneroni maps are a class of birational transformations of projective spaces. This class contains the classical Cremona transformation of the plane, the cubo-cubic transformation of the space and the quatro-quartic transformation of $\mathbb{P}^4$. Their common feature is that they are determined by linear systems of forms of degree $n$ vanishing along $n+1$ general flats of codimension $2$ in $\mathbb{P}^n$. They have appeared recently in a work devoted to the so called unexpected hypersurfaces. The purpose of this work is to refresh the collective memory of the mathematical community about these somewhat forgotten transformations and to provide an elementary description of their basic properties given from a modern point of view.


title: A partial order and cluster-similarity metric on rooted phylogenetic trees

abstract: Metrics on rooted phylogenetic trees are integral to a number of areas of phylogenetic analysis. Cluster-similarity metrics have recently been introduced in order to limit skew in the distribution of distances, and to ensure that trees in the neighbourhood of each other have similar hierarchies. In the present paper we introduce a new cluster-similarity metric on rooted phylogenetic tree space that has an associated local operation, allowing for easy calculation of neighbourhoods, a trait that is desirable for MCMC calculations. The metric is defined by the distance on the Hasse diagram induced by a partial order on the set of rooted phylogenetic trees, itself based on the notion of a hierarchy-preserving map between trees. The partial order we introduce is a refinement of the well-known refinement order on hierarchies. Both the partial order and the hierarchy-preserving maps may also be of independent interest.


title: Model independent analysis of New Physics effects on $B_c \to (D_s,\,D^{\ast}_s)\,\mu^+\mu^-$ decay observables

abstract: Motivated by the anomalies present in $b \to s\,l^+\,l^-$ neutral current decays, we study the corresponding $B_c \to (D_s,\,D^{\ast}_s)\mu^+\mu^-$ decays within the standard model and beyond. We use a model independent effective theory formalism in the presence of vector and axial vector new physics operators and study the implications of the latest global fit to the $b \to s\,l^+\,l^-$ data on various observables for the $B_c \to (D_s,\,D^{\ast}_s)\mu^+\mu^-$ decays. We give predictions on several observables such as the differential branching ratio, ratio of branching ratios, forward backward asymmetry, and the longitudinal polarization fraction of the $D^{\ast}_s$ meson within standard model and within various new physics scenarios. These results can be tested at the Large Hadron Collider and, in principle, can provide complimentary information regarding new physics in $b \to s\,l^+\,l^-$ neutral current decays.


title: A non-invasive sub-surface electrical probe to encapsulated layers in van der Waals heterostructures

abstract: Van der Waals heterostructures formed by stacking different atomically thin layered materials have emerged as the sought-after device platform for electronic and optoelectronic applications. Determining the spatial extent of all the encapsulated components in such vertical stacks is key to optimal fabrication methods and improved device performance. Here we employ electrostatic force microscopy as a fast and non-invasive microscopic probe that provides compelling images of two dimensional layers buried over 30 nm below the sample surface. We demonstrate the versatility of the technique by studying heterojunctions comprising graphene, hexagonal boron nitride and transition metal dichalcogenides. Work function of each constituent layer acts as a unique fingerprint during imaging, thereby providing important insights into the charge environment, disorder, structural imperfections and doping profile. The technique holds great potential for gaining a comprehensive understanding of the quality, flatness as well as local electrical properties of buried layers in a large class of nanoscale materials and vertical heterostructures.


title: The effects of finite distance on the gravitational deflection angle of light

abstract: In order to clarify effects of the finite distance from a lens object to a light source and a receiver, the gravitational deflection of light has been recently reexamined by using the Gauss-Bonnet (GB) theorem in differential geometry [Ishihara et al. 2016]. The purpose of the present paper is to give a short review of a series of works initiated by the above paper. First, we provide the definition of the gravitational deflection angle of light for the finite-distance source and receiver in a static, spherically symmetric and asymptotically flat spacetime. We discuss the geometrical invariance of the definition by using the GB theorem. The present definition is used to discuss finite-distance effects on the light deflection in Schwarzschild spacetime, for both cases of the weak deflection and strong deflection. Next, we extend the definition to stationary and axisymmetric spacetimes. We compute finite-distance effects on the deflection angle of light for Kerr black holes and rotating Teo wormholes. Our results are consistent with the previous works if we take the infinite-distance limit. We briefly mention also the finite-distance effects on the light deflection by Sagittarius A$^*$.


title: Handling Inter-Annotator Agreement for Automated Skin Lesion Segmentation

abstract: In this work, we explore the issue of the inter-annotator agreement for training and evaluating automated segmentation of skin lesions. We explore what different degrees of agreement represent, and how they affect different use cases for segmentation. We also evaluate how conditioning the ground truths using different (but very simple) algorithms may help to enhance agreement and may be appropriate for some use cases. The segmentation of skin lesions is a cornerstone task for automated skin lesion analysis, useful both as an end-result to locate/detect the lesions and as an ancillary task for lesion classification. Lesion segmentation, however, is a very challenging task, due not only to the challenge of image segmentation itself but also to the difficulty in obtaining properly annotated data. Detecting accurately the borders of lesions is challenging even for trained humans, since, for many lesions, those borders are fuzzy and ill-defined. Using lesions and annotations from the ISIC Archive, we estimate inter-annotator agreement for skin-lesion segmentation and propose several simple procedures that may help to improve inter-annotator agreement if used to condition the ground truths.


title: Sparse Parallel Training of Hierarchical Dirichlet Process Topic Models

abstract: To scale non-parametric extensions of probabilistic topic models such as Latent Dirichlet allocation to larger data sets, practitioners rely increasingly on parallel and distributed systems. In this work, we study data-parallel training for the hierarchical Dirichlet process (HDP) topic model. Based upon a representation of certain conditional distributions within an HDP, we propose a doubly sparse data-parallel sampler for the HDP topic model. This sampler utilizes all available sources of sparsity found in natural language - an important way to make computation efficient. We benchmark our method on a well-known corpus (PubMed) with 8m documents and 768m tokens, using a single multi-core machine in under four days.


title: Orbital-selective Kondo entanglement and antiferromagnetic order in USb$_2$

abstract: In heavy-fermion compounds, the dual character of $f$ electrons underlies their rich and often exotic properties like fragile heavy quasipartilces, variety of magnetic orders and unconventional superconductivity. 5$f$-electron actinide materials provide a rich setting to elucidate the larger and outstanding issue of the competition between magnetic order and Kondo entanglement and, more generally, the interplay among different channels of interactions in correlated electron systems. Here, by using angle-resolved photoemission spectroscopy, we present detailed electronic structure of USb$_2$ and observed two different kinds of nearly flat bands in the antiferromagnetic state of USb$_2$. Polarization-dependent measurements show that these electronic states are derived from 5$f$ orbitals with different characters; in addition, further temperature-dependent measurements reveal that one of them is driven by the Kondo correlations between the 5$f$ electrons and conduction electrons, while the other reflects the dominant role of the magnetic order. Our results on the low-energy electronic excitations of USb$_2$ implicate orbital selectivity as an important new ingredient for the competition between Kondo correlations and magnetic order and, by extension, in the rich landscape of quantum phases for strongly correlated $f$ electron systems.


title: OnionNet: a multiple-layer inter-molecular contact based convolutional neural network for protein-ligand binding affinity prediction

abstract: Computational drug discovery provides an efficient tool helping large scale lead molecules screening. One of the major tasks of lead discovery is identifying molecules with promising binding affinities towards a target, a protein in general. The accuracies of current scoring functions which are used to predict the binding affinity are not satisfactory enough. Thus, machine learning (ML) or deep learning (DL) based methods have been developed recently to improve the scoring functions. In this study, a deep convolutional neural network (CNN) model (called OnionNet) is introduced and the features are based on rotation-free element-pair specific contacts between ligands and protein atoms, and the contacts were further grouped in different distance ranges to cover both the local and non-local interaction information between the ligand and the protein. The prediction power of the model is evaluated and compared with other scoring functions using the comparative assessment of scoring functions (CASF-2013) benchmark and the v2016 core set of PDBbind database. When compared to a previous CNN-based scoring function, our model shows improvements of 0.08 and 0.16 in the correlations (R) and standard deviations (SD) of regression, respectively, between the predicted binding affinities and the experimental measured binding affinities. The robustness of the model is further explored by predicting the binding affinities of the complexes generated from docking simulations instead of experimentally determined PDB structures.


title: Cup-to-vesicle transition of a fluid membrane with spontaneous curvature

abstract: The disk-to-vesicle transition of a fluid membrane with no spontaneous curvature is well described by the competition between edge line and curvature energies. However, the transition of asymmetric membranes with spontaneous curvatures is not yet understood. In this study, the shape of the fluid membrane patch with a constant spontaneous curvature and its closing transition to a vesicle is investigated using theory and meshless membrane simulations. It is confirmed that the (meta)stable and transient membranes are well approximated by spherical caps. The membrane Gaussian modulus can be estimated from the cup shape of membrane patches as well as from the transition probability, although the latter estimate gives slightly smaller negative values. Furthermore, the self-assembly dynamics of membranes are presented, in which smaller vesicles are formed at higher spontaneous curvatures, higher edge line tension, and lower density.


title: Zorro: A Model Agnostic System to Price Consumer Data

abstract: Personal data is essential in showing users targeted ads - the economic backbone of the web. Still, there are major inefficiencies in how data is transacted online: (1) users don't decide what information is released nor get paid for this privacy loss; (2) algorithmic advertisers are stuck in inefficient long-term contracts where they purchase user data without knowing the value it provides. This paper proposes a system, Zorro, which aims to rectify aforementioned two problems. As the main contribution, we provide a natural, 'absolute' definition of 'Value of Data' (VoD) - for any quantity of interest, it is the delta between an individual's value and population mean. The challenge remains how to operationalize this definition, independently of a buyer's model for VoD. We propose a model-agnostic solution, relying on matrix estimation, and use it to estimate click-through-rate (CTR), as an example. Regarding (2), Zorro empowers advertisers to measure value of user data on a query-by-query basis and based only on the increase in accuracy it provides in estimating CTR. In contrast advertisers currently engage in inefficient long-term data contracts with third party data sellers. We highlight two results on a large ad-click dataset: (i) our system has R^2=0.58, in line with best-in-class results for related problems (e.g. content recommendation). Crucially, our system is model-agnostic - we estimate CTR without accessing an advertiser's proprietary models, a required property of any such pricing system;(ii) our experiments show selling user data has incremental value ranging from 30%-69% depending on ad category. Roughly, this translates to at least USD 16 Billion loss in value for advertisers if user data is not provided. Regarding (1), in addition to allowing users to get paid for data sharing, we extend our mathematical framework to when users provide explicit intent.


title: Extreme Points Derived Confidence Map as a Cue For Class-Agnostic Segmentation Using Deep Neural Network

abstract: To automate the process of segmenting an anatomy of interest, we can learn a model from previously annotated data. The learning-based approach uses annotations to train a model that tries to emulate the expert labeling on a new data set. While tremendous progress has been made using such approaches, labeling of medical images remains a time-consuming and expensive task. In this paper, we evaluate the utility of extreme points in learning to segment. Specifically, we propose a novel approach to compute a confidence map from extreme points that quantitatively encodes the priors derived from extreme points. We use the confidence map as a cue to train a deep neural network based on ResNet-101 and PSP module to develop a class-agnostic segmentation model that outperforms state-of-the-art method that employs extreme points as a cue. Further, we evaluate a realistic use-case by using our model to generate training data for supervised learning (U-Net) and observed that U-Net performs comparably when trained with either the generated data or the ground truth data. These findings suggest that models trained using cues can be used to generate reliable training data.


title: On some ideals with linear free resolutions

abstract: Given $\Sigma\subset\mathbb K[x_1,\ldots,x_k]$, any finite collection of linear forms, some possibly proportional, and any $1\leq a\leq |\Sigma|$, it has been conjectured that $I_a(\Sigma)$, the ideal generated by all $a$-fold products of $\Sigma$, has linear graded free resolution. In this article we show the validity of this conjecture for two cases: the first one is when $a=d+1$ and $\Sigma$ is dual to the columns of a generating matrix of a linear code of minimum distance $d$; and the second one is when $k=3$ and $\Sigma$ defines a line arrangement in $\mathbb P^2$ (i.e., there are no proportional linear forms). For the second case we investigate what are the graded betti numbers of $I_a(\Sigma)$.


title: Uniform Minors in Maximally Recoverable Codes

abstract: In this letter, locally recoverable codes with maximal recoverability are studied with a focus on identifying the MDS codes resulting from puncturing and shortening. By using matroid theory and the relation between MDS codes and uniform minors, the list of all the possible uniform minors is derived. This list is used to improve the known non-asymptotic lower bound on the required field size of a maximally recoverable code.


title: On $3$-dimensional foliated dynamical systems and Hilbert type reciprocity law

abstract: We show some fundamental results concerning $3$-dimensional foliated dynamical systems (FDS$^3$ for short) introduced by Deninger. Firstly, we give a decomposition theorem for an FDS$^3$, which yields a classification of FDS$^3$'s. Secondly, for each type of the classification, we construct concrete examples of FDS$^3$'s. Finally, by using the integration theory for smooth Deligne cohomology, we introduce geometric analogues of local symbols and show a Hilbert type reciprocity law for an FDS$^3$. Our results answer the question posed by Deninger.


title: Uncertainty-guided Continual Learning with Bayesian Neural Networks

abstract: Continual learning aims to learn new tasks without forgetting previously learned ones. This is especially challenging when one cannot access data from previous tasks and when the model has a fixed capacity. Current regularization-based continual learning algorithms need an external representation and extra computation to measure the parameters' \textit{importance}. In contrast, we propose Uncertainty-guided Continual Bayesian Neural Networks (UCB), where the learning rate adapts according to the uncertainty defined in the probability distribution of the weights in networks. Uncertainty is a natural way to identify \textit{what to remember} and \textit{what to change} as we continually learn, and thus mitigate catastrophic forgetting. We also show a variant of our model, which uses uncertainty for weight pruning and retains task performance after pruning by saving binary masks per tasks. We evaluate our UCB approach extensively on diverse object classification datasets with short and long sequences of tasks and report superior or on-par performance compared to existing approaches. Additionally, we show that our model does not necessarily need task information at test time, i.e. it does not presume knowledge of which task a sample belongs to.


title: Salient Building Outline Enhancement and Extraction Using Iterative L0 Smoothing and Line Enhancing

abstract: In this paper, our goal is salient building outline enhancement and extraction from images taken from consumer cameras using L0 smoothing. We address weak outlines and over-smoothing problem. Weak outlines are often undetected by edge extractors or easily smoothed out. We propose an iterative method, including the smoothing cell and sharpening cell. In the smoothing cell, we iteratively enlarge the smoothing level of the L0 smoothing. In the sharpening cell, we use Hough Transform to extract lines, based on the assumption that salient outlines for buildings are usually straight, and enhance those extracted lines. Our goal is to enhance line structures and do the L0 smoothing simultaneously. Also, we propose to create building masks from semantic segmentation using an encoder-decoder network. The masks filter out irrelevant edges. We also provide an evaluation dataset on this task.


title: One-shot Information Extraction from Document Images using Neuro-Deductive Program Synthesis

abstract: Our interest in this paper is in meeting a rapidly growing industrial demand for information extraction from images of documents such as invoices, bills, receipts etc. In practice users are able to provide a very small number of example images labeled with the information that needs to be extracted. We adopt a novel two-level neuro-deductive, approach where (a) we use pre-trained deep neural networks to populate a relational database with facts about each document-image; and (b) we use a form of deductive reasoning, related to meta-interpretive learning of transition systems to learn extraction programs: Given task-specific transitions defined using the entities and relations identified by the neural detectors and a small number of instances (usually 1, sometimes 2) of images and the desired outputs, a resource-bounded meta-interpreter constructs proofs for the instance(s) via logical deduction; a set of logic programs that extract each desired entity is easily synthesized from such proofs. In most cases a single training example together with a noisy-clone of itself suffices to learn a program-set that generalizes well on test documents, at which time the value of each entity is determined by a majority vote across its program-set. We demonstrate our two-level neuro-deductive approach on publicly available datasets ("Patent" and "Doctor's Bills") and also describe its use in a real-life industrial problem.


title: Amortized Inference of Variational Bounds for Learning Noisy-OR

abstract: Classical approaches for approximate inference depend on cleverly designed variational distributions and bounds. Modern approaches employ amortized variational inference, which uses a neural network to approximate any posterior without leveraging the structures of the generative models. In this paper, we propose Amortized Conjugate Posterior (ACP), a hybrid approach taking advantages of both types of approaches. Specifically, we use the classical methods to derive specific forms of posterior distributions and then learn the variational parameters using amortized inference. We study the effectiveness of the proposed approach on the noisy-or model and compare to both the classical and the modern approaches for approximate inference and parameter learning. Our results show that the proposed method outperforms or are at par with other approaches.


title: Occluded Face Recognition Using Low-rank Regression with Generalized Gradient Direction

abstract: In this paper, a very effective method to solve the contiguous face occlusion recognition problem is proposed. It utilizes the robust image gradient direction features together with a variety of mapping functions and adopts a hierarchical sparse and low-rank regression model. This model unites the sparse representation in dictionary learning and the low-rank representation on the error term that is usually messy in the gradient domain. We call it the "weak low-rankness" optimization problem, which can be efficiently solved by the framework of Alternating Direction Method of Multipliers (ADMM). The optimum of the error term has a similar weak low-rank structure as the reference error map and the recognition performance can be enhanced by leaps and bounds using weak low-rankness optimization. Extensive experiments are conducted on real-world disguise / occlusion data and synthesized contiguous occlusion data. These experiments show that the proposed gradient direction-based hierarchical adaptive sparse and low-rank (GD-HASLR) algorithm has the best performance compared to state-of-the-art methods, including popular convolutional neural network-based methods.


title: Shift-of-Perspective Identification Within Legal Cases

abstract: Arguments, counter-arguments, facts, and evidence obtained via documents related to previous court cases are of essential need for legal professionals. Therefore, the process of automatic information extraction from documents containing legal opinions related to court cases can be considered to be of significant importance. This study is focused on the identification of sentences in legal opinion texts which convey different perspectives on a certain topic or entity. We combined several approaches based on semantic analysis, open information extraction, and sentiment analysis to achieve our objective. Then, our methodology was evaluated with the help of human judges. The outcomes of the evaluation demonstrate that our system is successful in detecting situations where two sentences deliver different opinions on the same topic or entity. The proposed methodology can be used to facilitate other information extraction tasks related to the legal domain. One such task is the automated detection of counter arguments for a given argument. Another is the identification of opponent parties in a court case.


title: Quantum strips in higher dimensions

abstract: We consider the Dirichlet Laplacian in unbounded strips on ruled surfaces in any space dimension. We locate the essential spectrum under the condition that the strip is asymptotically flat. If the Gauss curvature of the strip equals zero, we establish the existence of discrete spectrum under the condition that the curve along which the strip is built is not a geodesic. On the other hand, if it is a geodesic and the Gauss curvature is not identically equal to zero, we prove the existence of Hardy-type inequalities. We also derive an effective operator for thin strips, which enables one to replace the spectral problem for the Laplace-Beltrami operator on the two-dimensional surface by a one-dimensional Schroedinger operator whose potential is expressed in terms of curvatures. In the appendix, we establish a purely geometric fact about the existence of relatively parallel adapted frames for any curve under minimal regularity hypotheses.


title: Enhanced Photovoltaic Performance of Perovskite Solar Cells by Co-Doped Spinel Nickel Cobaltite Hole Transporting Layer

abstract: Solution combustion synthesized hole transport layer of co-doped spinel nickel cobaltite were fabricated using doctor-blading technique for planar inverted perovskite solar cells. Perovskite solar cells incorporating Co-doped spinel nickel cobaltite shown an increase in device performance parameters compared to un-doped spinel nickel cobaltite, leading to PCE of 16.5%. X-ray photoelectron spectroscopy measurements revealed the tendency of Cu cations to replace preferably the surface Ni atoms changing the surface stoichiometry of spinel nickel cobaltite inducing a cathodic polarization. Ultraviolet photoelectron spectroscopy measurements unveiled the increase of the ionization potential by 0.1 eV for co-doped spinel nickel cobaltite film compare to undoped spinel nickel cobaltite-based hole transporting layer. We attribute the enhanced PCE of inverted perovskite solar cells presented due to improved hole extraction properties of co-doped spinel nickel cobaltite hole transporting layer.


title: Nonconvex Approach for Sparse and Low-Rank Constrained Models with Dual Momentum

abstract: In this manuscript, we research on the behaviors of surrogates for the rank function on different image processing problems and their optimization algorithms. We first propose a novel nonconvex rank surrogate on the general rank minimization problem and apply this to the corrupted image completion problem. Then, we propose that nonconvex rank surrogates can be introduced into two well-known sparse and low-rank models: Robust Principal Component Analysis (RPCA) and Low-Rank Representation (LRR). For optimization, we use alternating direction method of multipliers (ADMM) and propose a trick, which is called the dual momentum. We add the difference of the dual variable between the current and the last iteration with a weight. This trick can avoid the local minimum problem and make the algorithm converge to a solution with smaller recovery error in the nonconvex optimization problem. Also, it can boost the convergence when the variable updates too slowly. We also give a severe proof and verify that the proposed algorithms are convergent. Then, several experiments are conducted, including image completion, denoising, and spectral clustering with outlier detection. These experiments show that the proposed methods are effective in image and signal processing applications, and have the best performance compared with state-of-the-art methods.