title: File-based localization of numerical perturbations in data analysis pipelines

abstract: Data analysis pipelines are known to be impacted by computational conditions, presumably due to the creation and propagation of numerical errors. While this process could play a major role in the current reproducibility crisis, the precise causes of such instabilities and the path along which they propagate in pipelines are unclear. We present Spot, a tool to identify which processes in a pipeline create numerical differences when executed in different computational conditions. Spot leverages system-call interception through ReproZip to reconstruct and compare provenance graphs without pipeline instrumentation. By applying Spot to the structural pre-processing pipelines of the Human Connectome Project, we found that linear and non-linear registration are the cause of most numerical instabilities in these pipelines, which confirms previous findings.


title: Physics-based Modeling of Large Intelligent Reflecting Surfaces for Scalable Optimization

abstract: In this paper, we develop a physics-based model that allows a scalable optimization of large intelligent reflecting surfaces (IRSs). The basic idea is to partition the IRS unit cells into several subsets, referred to as tiles, and model the impact of each tile on the wireless channel. Borrowing concepts from the radar literature, we model each tile as an anomalous reflector, and derive its impact on the wireless channel for given unit cell phase shifts by solving the corresponding integral equations for the electric and magnetic vector fields. Based on this model, one can design the phase shifts of the unit cells of a tile offline for the support of several transmission modes and then select the best mode online for a given channel realization. Therefore, the number of tiles and transmission modes in the proposed model are design parameters that can be adjusted to trade performance for complexity.


title: RBF Solver for Quaternions Interpolation

abstract: In this paper we adapt the RBF Solver to work with quaternions by taking advantage of their Lie Algebra and exponential map. This will allow to work with quaternions as if they were normal vectors in R^3 and blend them in a very efficient way.


title: Duality for optimal consumption under no unbounded profit with bounded risk

abstract: We give a definitive treatment of duality for optimal consumption over the infinite horizon, in a semimartingale incomplete market satisfying no unbounded profit with bounded risk (NUPBR). Rather than base the dual domain on (local) martingale deflators, we use a class of supermartingale deflators such that deflated wealth plus cumulative deflated consumption is a supermartingale for all admissible consumption plans. This yields a strong duality, because the enlarged dual domain of processes dominated by deflators is naturally closed, without invoking its closure. In this way we automatically reach the bipolar of the set of deflators. We complete this picture by proving that the set of processes dominated by local martingale deflators is dense in our dual domain, confirming that we have identified the natural dual space. In addition to the optimal consumption and deflator, we characterise the optimal wealth process. At the optimum, deflated wealth is a supermartingale and a potential, while deflated wealth plus cumulative deflated consumption is a uniformly integrable martingale. This is the natural generalisation of the corresponding feature in the terminal wealth problem, where deflated wealth at the optimum is a uniformly integrable martingale. We use no constructions involving equivalent local martingale measures. This is natural, given that such measures typically do not exist over the infinite horizon and that we are working under NUPBR, which does not require their existence. The structure of the duality proof reveals an interesting feature compared with the terminal wealth problem. There, the dual domain is $L^{1}$-bounded, but here the primal domain has this property, and hence many steps in the duality proof show a marked reversal of roles for the primal and dual domains, compared with the proofs of Kramkov and Schachermayer.


title: A binary star sequence in the outskirts of the disrupting Galactic open cluster UBC 274

abstract: We report the identification of a numerous binary star population in the recently discovered ~3 Gyr old open cluster UBC 274. It becomes visible once the cluster color-magnitude diagram is corrected by differential reddening and spans mass ratios (q) values from 0.5 up to 1.0. Its stellar density radial profile and cumulative distribution as a function of the distance from the cluster's center reveal that it extends out to the observed boundaries of the cluster's tidal tails (~ 6 times the cluster's radius) following a spatial distribution indistinguishable from that of cluster Main Sequence (MS) stars. Furthermore, binary stars with q values smaller or larger than 0.75 do not show any spatial distribution difference either. From Gaia DR2 astrometric and kinematics data we computed Galactic coordinates and space velocities with respect to the cluster's center and mean cluster space velocity, respectively. We found that, cluster members located all along the tidal tails, irrespective of being a single or binary star, move relatively fast. The projection of their motions on the Galactic plane resembles that of a rotating solid body, while those along the radial direction from the Galactic center and perpendicular to the Galactic plane suggest that the cluster is being disrupted. The similarity of the spatial distributions and kinematic patterns of cluster MS and binary stars reveals that UBC 274 is facing an intense process of disruption that has apparently swept out any signature of internal dynamic evolution like mass segregation driven by two-body relaxation.


title: Graph Minors Meet Machine Learning: the Power of Obstructions

abstract: Computational intractability has for decades motivated the development of a plethora of methodologies that mainly aimed at a quality-time trade-off. The use of Machine Learning techniques has finally emerged as one of the possible tools to obtain approximate solutions to ${\cal NP}$-hard combinatorial optimization problems. In a recent article, Dai et al. introduced a method for computing such approximate solutions for instances of the Vertex Cover problem. In this paper we consider the effectiveness of selecting a proper training strategy by considering special problem instances called "obstructions" that we believe carry some intrinsic properties of the problem itself. Capitalizing on the recent work of Dai et al. on the Vertex Cover problem, and using the same case study as well as 19 other problem instances, we show the utility of using obstructions for training neural networks. Experiments show that training with obstructions results in a huge reduction in number of iterations needed for convergence, thus gaining a substantial reduction in the time needed for training the model.


title: Network Structure Identification from Corrupt Data Streams

abstract: Complex networked systems can be modeled as graphs with nodes representing the agents and links describing the dynamic coupling between them. Previous work on network identification has shown that the network structure of linear time-invariant (LTI) systems can be reconstructed from the joint power spectrum of the data streams. These results assumed that data is perfectly measured. However, real-world data is subject to many corruptions, such as inaccurate time-stamps, noise, and data loss. We show that identifying the structure of linear time-invariant systems using corrupt measurements results in the inference of erroneous links. We provide an exact characterization and prove that such erroneous links are restricted to the neighborhood of the perturbed node. We extend the analysis of LTI systems to the case of Markov random fields with corrupt measurements. We show that data corruption in Markov random fields results in spurious probabilistic relationships in precisely the locations where spurious links arise in LTI systems.


title: Unstructured Road Vanishing Point Detection Using the Convolutional Neural Network and Heatmap Regression

abstract: Unstructured road vanishing point (VP) detection is a challenging problem, especially in the field of autonomous driving. In this paper, we proposed a novel solution combining the convolutional neural network (CNN) and heatmap regression to detect unstructured road VP. The proposed algorithm firstly adopts a lightweight backbone, i.e., depthwise convolution modified HRNet, to extract hierarchical features of the unstructured road image. Then, three advanced strategies, i.e., multi-scale supervised learning, heatmap super-resolution, and coordinate regression techniques are utilized to achieve fast and high-precision unstructured road VP detection. The empirical results on Kong's dataset show that our proposed approach enjoys the highest detection accuracy compared with state-of-the-art methods under various conditions in real-time, achieving the highest speed of 33 fps.


title: Ordinary varieties with trivial canonical bundle are not uniruled

abstract: We prove that smooth, projective, $K$-trivial, weakly ordinary varieties over a perfect field of characteristic $p>0$ are not geometrically uniruled. We also show a singular version of our theorem, which is sharp in multiple aspects. Our work, together with Langer's results, implies that varieties of the above type have strongly semistable tangent bundles with respect to any polarization.


title: Blockchain-Based Differential Privacy Cost Management System

abstract: Privacy preservation is a big concern for various sectors. To protect individual user data, one emerging technology is differential privacy. However, it still has limitations for datasets with frequent queries, such as the fast accumulation of privacy cost. To tackle this limitation, this paper explores the integration of a secured decentralised ledger, blockchain. Blockchain will be able to keep track of all noisy responses generated with differential privacy algorithm and allow for certain queries to reuse old responses. In this paper, a demo of a proposed blockchain-based privacy management system is designed as an interactive decentralised web application (DApp). The demo created illustrates that leveraging on blockchain will allow the total privacy cost accumulated to decrease significantly.


title: Sparse Error Localization in Complex Dynamic Networks

abstract: Understanding the dynamics of complex systems is a central task in many different areas ranging form biology via epidemics to economics and engineering. Unexpected behaviour of dynamic systems or even systems failure is sometimes difficult to comprehend. Such unexpected dynamics can be caused by systematic model errors, unknown inputs from the environment and systems faults. Localizing the root cause of these errors or faults and reconstructing their dynamics is only possible if the measured outputs of the system are sufficiently informative. Here, we present a mathematical theory for the measurements required to localize the position of error sources in large dynamic networks. We assume, that faults or errors occur at a limited number of positions in the network. This sparsity assumption facilitates the accurate reconstruction of the dynamic timecourses of the errors by solving a convex optimal control problem. For cases, where the sensor measurements are not sufficiently informative to pinpoint the error position exactly, we provide methods to restrict the error location to a smaller subset of network nodes. We also suggest strategies to efficiently select additional measurements for narrowing down the error location.


title: Attacks to Federated Learning: Responsive Web User Interface to Recover Training Data from User Gradients

abstract: Local differential privacy (LDP) is an emerging privacy standard to protect individual user data. One scenario where LDP can be applied is federated learning, where each user sends in his/her user gradients to an aggregator who uses these gradients to perform stochastic gradient descent. In a case where the aggregator is untrusted and LDP is not applied to each user gradient, the aggregator can recover sensitive user data from these gradients. In this paper, we present a new interactive web demo showcasing the power of local differential privacy by visualizing federated learning with local differential privacy. Moreover, the live demo shows how LDP can prevent untrusted aggregators from recovering sensitive training data. A measure called the exp-hamming recovery is also created to show the extent of how much data the aggregator can recover.


title: Unsupervised Graph Representation by Periphery and Hierarchical Information Maximization

abstract: Deep representation learning on non-Euclidean data types, such as graphs, has gained significant attention in recent years. Invent of graph neural networks has improved the state-of-the-art for both node and the entire graph representation in a vector space. However, for the entire graph representation, most of the existing graph neural networks are trained on a graph classification loss in a supervised way. But obtaining labels of a large number of graphs is expensive for real world applications. Thus, we aim to propose an unsupervised graph neural network to generate a vector representation of an entire graph in this paper. For this purpose, we combine the idea of hierarchical graph neural networks and mutual information maximization into a single framework. We also propose and use the concept of periphery representation of a graph and show its usefulness in the proposed algorithm which is referred as GraPHmax. We conduct thorough experiments on several real-world graph datasets and compare the performance of GraPHmax with a diverse set of both supervised and unsupervised baseline algorithms. Experimental results show that we are able to improve the state-of-the-art for multiple graph level tasks on several real-world datasets, while remain competitive on the others.


title: Supervised Whole DAG Causal Discovery

abstract: We propose to address the task of causal structure learning from data in a supervised manner. Existing work on learning causal directions by supervised learning is restricted to learning pairwise relation, and not well suited for whole DAG discovery. We propose a novel approach of modeling the whole DAG structure discovery as a supervised learning. To fit the problem in hand, we propose to use permutation equivariant models that align well with the problem domain. We evaluate the proposed approach extensively on synthetic graphs of size 10,20,50,100 and real data, and show promising results compared with a variety of previous approaches.


title: On a non-homogeneous version of a problem of Firey

abstract: We investigate the uniqueness for the Monge-Amp\`{e}re type equation \begin{equation} \label{eq-abstract} det(u_{ij}+\delta_{ij}u)_{i,j=1}^{n-1}=G(u),\ \ \ \ \ \ \ (*)\end{equation}on $S^{n-1}$, where $u$ is the restriction of the support function on the sphere $S^{n-1}$ of a convex body that contains the origin in its interior and $G:(0,\infty)\to(0,\infty)$ is a continuous function. The problem was initiated by Firey (1974) who, in the case $G(\theta)=\theta^{-1}$, asked if $u\equiv 1$ is the unique solution to (*). Recently, Brendle, Choi and Daskalopoulos $[9]$ proved that if $G(\theta)=\theta^{-p}$, $p>-n-1$, then $u$ has to be constant, providing in particular a complete solution to Firey's problem. Our primary goal is to obtain uniqueness (or nearly uniqueness) results for (*) for a broader family of functions $G$. Our approach is very different than the techniques developed in $[9]$.


title: A hybrid particle-ensemble Kalman filter for problems with medium nonlinearity

abstract: A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear dynamics produce a non-Gaussian forecast but a tight Gaussian likelihood leads to a nearly-Gaussian posterior. The hybrid filter starts by factoring the likelihood. First the particle filter assimilates the observations with one factor of the likelihood to produce an intermediate prior that is close to Gaussian, and then the ensemble Kalman filter completes the assimilation with the remaining factor. How the likelihood gets split between the two stages is determined in such a way to ensure that the particle filter avoids collapse, and particle degeneracy is broken by a mean-preserving random orthogonal transformation. The hybrid is tested in a simple two-dimensional (2D) problem and a multiscale system of ODEs motivated by the Lorenz-`96 model. In the 2D problem it outperforms both a pure particle filter and a pure ensemble Kalman filter, and in the multiscale Lorenz-`96 model it is shown to outperform a pure ensemble Kalman filter, provided that the ensemble size is large enough.


title: Multimodal Future Localization and Emergence Prediction for Objects in Egocentric View with a Reachability Prior

abstract: In this paper, we investigate the problem of anticipating future dynamics, particularly the future location of other vehicles and pedestrians, in the view of a moving vehicle. We approach two fundamental challenges: (1) the partial visibility due to the egocentric view with a single RGB camera and considerable field-of-view change due to the egomotion of the vehicle; (2) the multimodality of the distribution of future states. In contrast to many previous works, we do not assume structural knowledge from maps. We rather estimate a reachability prior for certain classes of objects from the semantic map of the present image and propagate it into the future using the planned egomotion. Experiments show that the reachability prior combined with multi-hypotheses learning improves multimodal prediction of the future location of tracked objects and, for the first time, the emergence of new objects. We also demonstrate promising zero-shot transfer to unseen datasets. Source code is available at $\href{https://github.com/lmb-freiburg/FLN-EPN-RPN}{\text{this https URL.}}$


title: Determinants of binary matrices achieve every integral value up to $\Omega(2^n/n)$

abstract: This work shows that the smallest natural number $d_n$ that is not the determinant of some $n\times n$ binary matrix is at least $c\,2^n/n$ for $c=1/201$. That same quantity naturally lower bounds the number of distinct integers $D_n$ which can be written as the determinant of some $n\times n$ binary matrix. This asymptotically improves the previous result of $d_n=\Omega(1.618^n)$ and slightly improves the previous result of $D_n\ge 2^n/g(n)$ for a particular $g(n)=\omega(n^2)$ function.


title: CycleGT: Unsupervised Graph-to-Text and Text-to-Graph Generation via Cycle Training

abstract: Two important tasks at the intersection of knowledge graphs and natural language processing are graph-to-text (G2T) and text-to-graph (T2G) conversion. Due to the difficulty and high cost of data collection, the supervised data available in the two fields are usually on the magnitude of tens of thousands, for example, 18K in the WebNLG~2017 dataset after preprocessing, which is far fewer than the millions of data for other tasks such as machine translation. Consequently, deep learning models for G2T and T2G suffer largely from scarce training data. We present CycleGT, an unsupervised training method that can bootstrap from fully non-parallel graph and text data, and iteratively back translate between the two forms. Experiments on WebNLG datasets show that our unsupervised model trained on the same number of data achieves performance on par with several fully supervised models. Further experiments on the non-parallel GenWiki dataset verify that our method performs the best among unsupervised baselines. This validates our framework as an effective approach to overcome the data scarcity problem in the fields of G2T and T2G. Our code is available at https://github.com/QipengGuo/CycleGT.


title: Source-count Distribution of Gamma-Ray Blazars

abstract: With ten years of operation and an exceptional dataset, the Fermi-Large Area Telescope allows us to unveil the detailed composition of the extragalactic $\gamma$-ray sky above $\rm 100\,MeV$. In this paper, we derive the intrinsic source-count distribution (logN-logS) of extragalactic sources (i.e., blazars) at $|b|>20^{\circ}$ via the efficiency correction method. With this approach, we are able to measure the distribution down to a photon flux of $\sim10^{-10}$${\rm \, ph \,\, cm^{-2} \, s^{-1}}$ and to an energy flux of $\sim10^{-12}$${\rm \, erg \,\, cm^{-2} \, s^{-1}}$. In both cases the logN-logS becomes flatter at low fluxes. Moreover, we show that this logN-logS is representative of the blazar population (assuming the majority of unassociated sources are blazars) and allows us to constrain its evolution quite effectively. Among recently proposed evolutionary models, we find that the Pure Density Evolution (PDE) model best describes the evolutionary properties of the blazar population and that their integrated emission accounts for $\sim 50^{+10}_{-5}\%$ of the total extragalactic \gm-ray background.


title: Fully Dynamic Algorithm for Constrained Submodular Optimization

abstract: The task of maximizing a monotone submodular function under a cardinality constraint is at the core of many machine learning and data mining applications, including data summarization, sparse regression and coverage problems. We study this classic problem in the fully dynamic setting, where elements can be both inserted and removed. Our main result is a randomized algorithm that maintains an efficient data structure with a poly-logarithmic amortized update time and yields a $(1/2-\epsilon)$-approximate solution. We complement our theoretical analysis with an empirical study of the performance of our algorithm.


title: Transmission Ratio Design for Electric Vehicles via Analytical Modeling and Optimization

abstract: In this paper we present an effective analytical modeling approach for the design of the transmission of electric vehicles. Specifically, we first devise an analytical loss model for an electric machine and show that it can be accurately fitted by only sampling three points from the original motor map. Second, we leverage this model to derive the optimal transmission ratio as a function of the wheels' speed and torque, and use it to optimize the transmission ratio. Finally, we showcase our analytical approach with a real-world case-study comparing two different transmission technologies on a BMW i3: a fixed-gear transmission (FGT) and a continuously variable transmission (CVT). Our results show that even for e-machines intentionally designed for a FGT, the implementation of a CVT can significantly improve their operational efficiency by more than 3%. The provided model will ultimately bridge the gap in understanding how to efficiently specify the e-machine and the transmission technology in an integrated fashion, and enable to effectively compare single- and multi-speed-based electric powertrains.


title: Characterization of Cooperators in Quorum Sensing with 2D Molecular Signal Analysis

abstract: In quorum sensing (QS), bacteria exchange molecular signals to work together. An analytically-tractable model is presented for characterizing QS signal propagation within a population of bacteria and the number of responsive cooperative bacteria (i.e., cooperators) in a two-dimensional (2D) environment. Unlike prior works with a deterministic topology and a simplified molecular propagation channel, this work considers continuous emission, diffusion, degradation, and reception among randomly-distributed bacteria. Using stochastic geometry, the 2D channel response and the corresponding probability of cooperation at a bacterium are derived. Based on this probability, new expressions are derived for the moment generating function and different orders of moments of the number of cooperators. The analytical results agree with the simulation results obtained by a particle-based method. In addition, the Poisson and Gaussian distributions are compared to approximate the distribution of the number of cooperators and the Poisson distribution provides the best overall approximation. The derived channel response can be generally applied to any molecular communication model where single or multiple transmitters continuously release molecules into a 2D environment. The derived statistics of the number of cooperators can be used to predict and control the QS process, e.g., predicting and decreasing the likelihood of biofilm formation.


title: Principles to Practices for Responsible AI: Closing the Gap

abstract: Companies have considered adoption of various high-level artificial intelligence (AI) principles for responsible AI, but there is less clarity on how to implement these principles as organizational practices. This paper reviews the principles-to-practices gap. We outline five explanations for this gap ranging from a disciplinary divide to an overabundance of tools. In turn, we argue that an impact assessment framework which is broad, operationalizable, flexible, iterative, guided, and participatory is a promising approach to close the principles-to-practices gap. Finally, to help practitioners with applying these recommendations, we review a case study of AI's use in forest ecosystem restoration, demonstrating how an impact assessment framework can translate into effective and responsible AI practices.


title: On three conjectures of P. Barry

abstract: We prove three conjectures, related to the paperfolding sequence, in a recent paper [arXiv:2005.04066] of P. Barry.


title: Wasserstein Random Forests and Applications in Heterogeneous Treatment Effects

abstract: We present new insights into causal inference in the context of Heterogeneous Treatment Effects by proposing natural variants of Random Forests to estimate the key conditional distributions. To achieve this, we recast Breiman's original splitting criterion in terms of Wasserstein distances between empirical measures. This reformulation indicates that Random Forests are well adapted to estimate conditional distributions and provides a natural extension of the algorithm to multivariate outputs. Following the philosophy of Breiman's construction, we propose some variants of the splitting rule that are well-suited to the conditional distribution estimation problem. Some preliminary theoretical connections are established along with various numerical experiments, which show how our approach may help to conduct more transparent causal inference in complex situations.


title: The Lipschitz Constant of Self-Attention

abstract: Lipschitz constants of neural networks have been explored in various contexts in deep learning, such as provable adversarial robustness, estimating Wasserstein distance, stabilising training of GANs, and formulating invertible neural networks. Such works have focused on bounding the Lipschitz constant of fully connected or convolutional networks, composed of linear maps and pointwise non-linearities. In this paper, we investigate the Lipschitz constant of self-attention, a non-linear neural network module widely used in sequence modelling. We prove that the standard dot-product self-attention is not Lipschitz for unbounded input domain, and propose an alternative L2 self-attention that is Lipschitz. We derive an upper bound on the Lipschitz constant of L2 self-attention and provide empirical evidence for its asymptotic tightness. To demonstrate the practical relevance of our theoretical work, we formulate invertible self-attention and use it in a Transformer-based architecture for a character-level language modelling task.


title: Terahertz Nonlinear Optical Response of Water Vapor

abstract: We report on the nonlinear spectroscopy of water vapor at THz frequencies. Atmospheric water vapor has a rich spectrum with several strong resonances at frequencies below 3 THz, falling within the range of operation of most existing THz sources. We observe an extremely large nonlinear response to THz radiation at the positions of these resonances. Using the optical Kerr model for the nonlinear response, we estimate a minimum nonlinear refractive index of the order of 10^2 m^2/W. Our results provide insight into the energy levels of the water molecule and give a more accurate picture of its response to electromagnetic radiation, paving the way to more accurate THz spectroscopy, imaging and sensing systems, and thereby facilitating future emerging THz technologies.


title: Monte Carlo Tree Search guided by Symbolic Advice for MDPs

abstract: In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We augment the MCTS algorithm with the notion of symbolic advice, and show that its classical theoretical guarantees are maintained. Symbolic advice are used to bias the selection and simulation strategies of MCTS. We describe how to use QBF and SAT solvers to implement symbolic advice in an efficient way. We illustrate our new algorithm using the popular game Pac-Man and show that the performances of our algorithm exceed those of plain MCTS as well as the performances of human players.


title: A Comparison of Turbulence Generated by 3DS Sparse Grids With Different Blockage Ratios and Different Co-Frame Arrangements

abstract: A new type of grid turbulence generator, the 3D sparse grid (3DS), is a co-planar arrangement of co-frames each containing a different length scale of grid elements [Malik, N. A. US Patent No. US 9,599,269 B2 (2017)] and possessing a much bigger parameter space than the flat 2D fractal square grid (2DF). Using DNS we compare the characteristics of the turbulence (mean flow, turbulence intensity, energy spectrum) generated by different types of 3DS grids. The peak intensities generated by 3DS can exceed the peaks generated by the 2DF by 80\%; we observe that a 3DS with blockage ratio 24\% produces turbulence similar to the 2DF with blockage ratio 32\% implying lower energy input for the same turbulence.


title: Complex Langevin: Boundary terms at poles

abstract: We discuss the problem of possible boundary terms at poles of the drift in the complex Langevin method, which spoil correctness of the method. For the simplest, however paradigmatic cases we can find complete answers. Lessons for more generic cases as well as open mathematical problems are discussed.


title: Spherical Accretion Flow onto General Parameterized Spherically Symmetric Black Hole Spacetimes

abstract: The transonic phenomenon of black hole accretion and the existence of the photon sphere are the characteristics of strong gravitational fields near a black hole horizon. In this work, we study spherical accretion flow onto a general parametrized spherically symmetric black hole spacetimes. For this purpose, we analyze the accretion process of various perfect fluids, such as the isothermal fluid of ultra-stiff, ultra-relativistic, and sub-relativistic types and polytropic fluid, respectively. The influences of extra parameters beyond the Schwarzschild black hole in the general parameterized spherically symmetric black hole on the flow behaviors of the above-mentioned test fluids are studied in detail. In addition, by studying the accretion of ideal photon gas, we further discuss the correspondence between the sonic radius of accreting photon gas and the photon sphere for the general parameterized spherically symmetric black hole. Some possible future extensions of our analysis are also discussed.


title: Energy Constraints Improve Liquid State Machine Performance

abstract: A model of metabolic energy constraints is applied to a liquid state machine in order to analyze its effects on network performance. It was found that, in certain combinations of energy constraints, a significant increase in testing accuracy emerged; an improvement of 4.25% was observed on a seizure detection task using a digital liquid state machine while reducing overall reservoir spiking activity by 6.9%. The accuracy improvements appear to be linked to the energy constraints' impact on the reservoir's dynamics, as measured through metrics such as the Lyapunov exponent and the separation of the reservoir.


title: Residual finiteness of certain 2-dimensional Artin groups

abstract: We show that many $2$-dimensional Artin groups are residually finite. This includes $3$-generator Artin groups with labels $\geq 4$ except for $(2m+1, 4,4)$ for any $m\geq 2$. As a first step towards residual finiteness we show that these Artin groups, and many more, split as free products with amalgamation or HNN extensions of finite rank free groups. Among others, this holds for all large type Artin groups with defining graph admitting an orientation, where each simple cycle is directed.


title: Materials loss measurements using superconducting microwave resonators

abstract: The performance of superconducting circuits for quantum computing is limited by materials losses. In particular, coherence times are typically bounded by two-level system (TLS) losses at single photon powers and millikelvin temperatures. The identification of low loss fabrication techniques, materials, and thin film dielectrics is critical to achieving scalable architectures for superconducting quantum computing. Superconducting microwave resonators provide a convenient qubit proxy for assessing performance and studying TLS loss and other mechanisms relevant to superconducting circuits such as non-equilibrium quasiparticles and magnetic flux vortices. In this review article, we provide an overview of considerations for designing accurate resonator experiments to characterize loss, including applicable types of loss, cryogenic setup, device design, and methods for extracting material and interface losses, summarizing techniques that have been evolving for over two decades. Results from measurements of a wide variety of materials and processes are also summarized. Lastly, we present recommendations for the reporting of loss data from superconducting microwave resonators to facilitate materials comparisons across the field.


title: ResKD: Residual-Guided Knowledge Distillation

abstract: Knowledge distillation, aimed at transferring the knowledge from a heavy teacher network to a lightweight student network, has emerged as a promising technique for compressing neural networks. However, due to the capacity gap between the heavy teacher and the lightweight student, there still exists a significant performance gap between them. In this paper, we see knowledge distillation in a fresh light, using the knowledge gap, or the residual, between a teacher and a student as guidance to train a much more lightweight student, called a res-student. We combine the student and the res-student into a new student, where the res-student rectifies the errors of the former student. Such a residual-guided process can be repeated until the user strikes the balance between accuracy and cost. At inference time, we propose a sample-adaptive strategy to decide which res-students are not necessary for each sample, which can save computational cost. Experimental results show that we achieve competitive performance with 18.04$\%$, 23.14$\%$, 53.59$\%$, and 56.86$\%$ of the teachers' computational costs on the CIFAR-10, CIFAR-100, Tiny-ImageNet, and ImageNet datasets. Finally, we do thorough theoretical and empirical analysis for our method.


title: Host-Pathongen Co-evolution Inspired Algorithm Enables Robust GAN Training

abstract: Generative adversarial networks (GANs) are pairs of artificial neural networks that are trained one against each other. The outputs from a generator are mixed with the real-world inputs to the discriminator and both networks are trained until an equilibrium is reached, where the discriminator cannot distinguish generated inputs from real ones. Since their introduction, GANs have allowed for the generation of impressive imitations of real-life films, images and texts, whose fakeness is barely noticeable to humans. Despite their impressive performance, training GANs remains to this day more of an art than a reliable procedure, in a large part due to training process stability. Generators are susceptible to mode dropping and convergence to random patterns, which have to be mitigated by computationally expensive multiple restarts. Curiously, GANs bear an uncanny similarity to a co-evolution of a pathogen and its host's immune system in biology. In a biological context, the majority of potential pathogens indeed never make it and are kept at bay by the hots' immune system. Yet some are efficient enough to present a risk of a serious condition and recurrent infections. Here, we explore that similarity to propose a more robust algorithm for GANs training. We empirically show the increased stability and a better ability to generate high-quality images while using less computational power.


title: Modeling Discourse Structure for Document-level Neural Machine Translation

abstract: Recently, document-level neural machine translation (NMT) has become a hot topic in the community of machine translation. Despite its success, most of existing studies ignored the discourse structure information of the input document to be translated, which has shown effective in other tasks. In this paper, we propose to improve document-level NMT with the aid of discourse structure information. Our encoder is based on a hierarchical attention network (HAN). Specifically, we first parse the input document to obtain its discourse structure. Then, we introduce a Transformer-based path encoder to embed the discourse structure information of each word. Finally, we combine the discourse structure information with the word embedding before it is fed into the encoder. Experimental results on the English-to-German dataset show that our model can significantly outperform both Transformer and Transformer+HAN.


title: Toward a large bandwidth photonic correlator for infrared heterodyne interferometry

abstract: Infrared heterodyne interferometry has been proposed as a practical alternative for recombining a large number of telescopes over kilometric baselines in the mid-infrared. However, the current limited correlation capacities impose strong restrictions on the sensitivity of this appealing technique. In this paper, we propose to address the problem of transport and correlation of wide-bandwidth signals over kilometric distances by introducing photonic processing in infrared heterodyne interferometry. We describe the architecture of a photonic double-sideband correlator for two telescopes, along with the experimental demonstration of this concept on a proof-of-principle test bed. We demonstrate the \textit{a posteriori} correlation of two infrared signals previously generated on a two-telescope simulator in a double-sideband photonic correlator. A degradation of the signal-to-noise ratio of $13\%$, equivalent to a noise factor $\text{NF}=1.15$, is obtained through the correlator, and the temporal coherence properties of our input signals are retrieved from these measurements. Our results demonstrate that photonic processing can be used to correlate heterodyne signals with a potentially large increase of detection bandwidth. These developments open the way to photonic processing of wide bandwidth signals for mid-infrared heterodyne interferometry, in particular for a large number of telescopes and for direct imager recombiners.


title: The anticanonical complex for non-degenerate toric complete intersections

abstract: The anticanonical complex generalizes the Fano polytope from toric geometry and has been used to study Fano varieties with torus action so far. We work out the case of complete intersections in toric varieties defined by non-degenerate systems of Laurent polynomials. As an application, we classify the terminal Fano threefolds that are embedded into a fake weighted projective space via a general system of Laurent polynomials.


title: Crossover Between Weak Antilocalization and Weak Localization and Electron-Electron Interaction in Few-Layer WTe$_2$

abstract: We report electron transport studies in an encapsulated few-layer WTe$_2$ at low temperatures and high magnetic fields. The magnetoconductance reveals a temperature-induced crossover between weak antilocalization (WAL) and weak localization (WL) in quantum diffusive regime. We show that the crossover clearly manifests coexistence and competition among several characteristic lengths, including the dephasing length, the spin-flip length, and the mean free path. In addition, low temperature conductance increases logarithmically with the increase of temperature indicating an interplay of electron-electron interaction (EEI) and spin-orbit coupling (SOC). We demonstrate the existences and quantify the strengths of EEI and SOC which are considered to be responsible for gap opening in the quantum spin hall state in WTe2 at the monolayer limit.


title: Biomechanics-informed Neural Networks for Myocardial Motion Tracking in MRI

abstract: Image registration is an ill-posed inverse problem which often requires regularisation on the solution space. In contrast to most of the current approaches which impose explicit regularisation terms such as smoothness, in this paper we propose a novel method that can implicitly learn biomechanics-informed regularisation. Such an approach can incorporate application-specific prior knowledge into deep learning based registration. Particularly, the proposed biomechanics-informed regularisation leverages a variational autoencoder (VAE) to learn a manifold for biomechanically plausible deformations and to implicitly capture their underlying properties via reconstructing biomechanical simulations. The learnt VAE regulariser then can be coupled with any deep learning based registration network to regularise the solution space to be biomechanically plausible. The proposed method is validated in the context of myocardial motion tracking on 2D stacks of cardiac MRI data from two different datasets. The results show that it can achieve better performance against other competing methods in terms of motion tracking accuracy and has the ability to learn biomechanical properties such as incompressibility and strains. The method has also been shown to have better generalisability to unseen domains compared with commonly used L2 regularisation schemes.


title: Pulsar polarimetry with the Parkes Ultra-Wideband receiver

abstract: Pulsar radio emission and its polarization are observed to evolve with frequency. This frequency dependence is key to the emission mechanism and the structure of the radio beam. With the new Ultra-Wideband receiver (UWL) on the Parkes radio telescope we are able, for the first time, to observe how pulsar profiles evolve over a broad continuous bandwidth of 700-4000 MHz. We describe here a technique for processing broadband polarimetric observations to establish a meaningful alignment and visualize the data across the band. We apply this to observations of PSRs J1056-6258 and J1359-6038, chosen due to previously unresolved questions about the frequency evolution of their emission. Application of our technique reveals that it is possible to align the polarization position angle (PA) across a broad frequency range when constrained to applying only corrections for dispersion and Faraday rotation to do so. However, this does not correspond to aligned intensity profiles for these two sources. We find that it is possible to convert these misalignments into emission height range estimates that are consistent with published and simulated values, suggesting that they can be attributed to relativistic effects in the magnetosphere. We discuss this work in the context of the radio beam structure and prepare the ground for a wider study of pulsar emission using broadband polarimetric data.


title: Neural Jump Ordinary Differential Equations: Consistent Continuous-Time Prediction and Filtering

abstract: Combinations of neural ODEs with recurrent neural networks (RNN), like GRU-ODE-Bayes or ODE-RNN are well suited to model irregularly observed time series. While those models outperform existing discrete-time approaches, no theoretical guarantees for their predictive capabilities are available. Assuming that the irregularly-sampled time series data originates from a continuous stochastic process, the $L^2$-optimal online prediction is the conditional expectation given the currently available information. We introduce the Neural Jump ODE (NJ-ODE) that provides a data-driven approach to learn, continuously in time, the conditional expectation of a stochastic process. Our approach models the conditional expectation between two observations with a neural ODE and jumps whenever a new observation is made. We define a novel training framework, which allows us to prove theoretical guarantees for the first time. In particular, we show that the output of our model converges to the $L^2$-optimal prediction. This can be interpreted as solution to a special filtering problem. We provide experiments showing that the theoretical results also hold empirically. Moreover, we experimentally show that our model outperforms the baselines in more complex learning tasks and give comparisons on real-world datasets.


title: Towards precise resting-state fMRI biomarkers in psychiatry: synthesizing developments in transdiagnostic research, dimensional models of psychopathology, and normative neurodevelopment

abstract: Searching for biomarkers has been a chief pursuit of the field of psychiatry. Toward this end, studies have catalogued candidate resting-state biomarkers in nearly all forms of mental disorder. However, it is becoming increasingly clear that these biomarkers lack specificity, limiting their capacity to yield clinical impact. We discuss three avenues of research that are overcoming this limitation: (i) the adoption of transdiagnostic research designs, which involve studying and explicitly comparing multiple disorders from distinct diagnostic axes of psychiatry; (ii) dimensional models of psychopathology that map the full spectrum of symptomatology and that cut across traditional disorder boundaries; and (iii) modeling individuals' unique functional connectomes throughout development. We provide a framework for tying these subfields together that draws on tools from machine learning and network science.


title: The Lieb-Thirring inequality for interacting systems in strong-coupling limit

abstract: We consider an analogue of the Lieb-Thirring inequality for quantum systems with homogeneous repulsive interaction potentials, but without the antisymmetry assumption on the wave functions. We show that in the strong-coupling limit, the Lieb-Thirring constant converges to the optimal constant of the one-body Gagliardo-Nirenberg interpolation inequality without interaction.


title: Picket: Guarding Against Corrupted Data in Tabular Data during Learning and Inference

abstract: Data corruption is an impediment to modern machine learning deployments. Corrupted data can severely bias the learned model and can also lead to invalid inferences. We present, Picket, a simple framework to safeguard against data corruptions during both training and deployment of machine learning models over tabular data. For the training stage, Picket identifies and removes corrupted data points from the training data to avoid obtaining a biased model. For the deployment stage, Picket flags, in an online manner, corrupted query points to a trained machine learning model that due to noise will result in incorrect predictions. To detect corrupted data, Picket uses a self-supervised deep learning model for mixed-type tabular data, which we call PicketNet. To minimize the burden of deployment, learning a PicketNet model does not require any human-labeled data. Picket is designed as a plugin that can increase the robustness of any machine learning pipeline. We evaluate Picket on a diverse array of real-world data considering different corruption models that include systematic and adversarial noise during both training and testing. We show that Picket consistently safeguards against corrupted data during both training and deployment of various models ranging from SVMs to neural networks, beating a diverse array of competing methods that span from data quality validation models to robust outlier-detection models.


title: Multi-fidelity Generative Deep Learning Turbulent Flows

abstract: In computational fluid dynamics, there is an inevitable trade off between accuracy and computational cost. In this work, a novel multi-fidelity deep generative model is introduced for the surrogate modeling of high-fidelity turbulent flow fields given the solution of a computationally inexpensive but inaccurate low-fidelity solver. The resulting surrogate is able to generate physically accurate turbulent realizations at a computational cost magnitudes lower than that of a high-fidelity simulation. The deep generative model developed is a conditional invertible neural network, built with normalizing flows, with recurrent LSTM connections that allow for stable training of transient systems with high predictive accuracy. The model is trained with a variational loss that combines both data-driven and physics-constrained learning. This deep generative model is applied to non-trivial high Reynolds number flows governed by the Navier-Stokes equations including turbulent flow over a backwards facing step at different Reynolds numbers and turbulent wake behind an array of bluff bodies. For both of these examples, the model is able to generate unique yet physically accurate turbulent fluid flows conditioned on an inexpensive low-fidelity solution.


title: A Semiparametric Approach to Interpretable Machine Learning

abstract: Black box models in machine learning have demonstrated excellent predictive performance in complex problems and high-dimensional settings. However, their lack of transparency and interpretability restrict the applicability of such models in critical decision-making processes. In order to combat this shortcoming, we propose a novel approach to trading off interpretability and performance in prediction models using ideas from semiparametric statistics, allowing us to combine the interpretability of parametric regression models with performance of nonparametric methods. We achieve this by utilizing a two-piece model: the first piece is interpretable and parametric, to which a second, uninterpretable residual piece is added. The performance of the overall model is optimized using methods from the sufficient dimension reduction literature. Influence function based estimators are derived and shown to be doubly robust. This allows for use of approaches such as double Machine Learning in estimating our model parameters. We illustrate the utility of our approach via simulation studies and a data application based on predicting the length of stay in the intensive care unit among surgery patients.


title: Irreducibility of the Fermi variety for discrete periodic Schr\"odinger operators and embedded eigenvalues

abstract: Let $H_0$ be a discrete periodic Schr\"odinger operator on $\ell^2(\mathbb{Z}^d)$: $$H_0=-\Delta+V,$$ where $\Delta$ is the discrete Laplacian and $V: \mathbb{Z}^d\to \mathbb{C}$ is periodic. We prove that for any $d\geq3$, the Fermi variety at every energy level is irreducible (modulo periodicity). For $d=2$, we prove that the Fermi variety at every energy level except for the average of the potential is irreducible (modulo periodicity) and the Fermi variety at the average of the potential has at most two irreducible components (modulo periodicity). This is sharp since for $d=2$ and a constant potential $V$, the Fermi variety at $V$-level has exactly two irreducible components (modulo periodicity). We also prove that the Bloch variety is irreducible (modulo periodicity) for any $d\geq 2$. As applications, we prove that when $V$ is a real-valued periodic function, the level set of any extrema of any spectral band functions, spectral band edges in particular, has dimension at most $d-2$ for any $d\geq 3$, and finite cardinality for $d=2$. We also show that $H=-\Delta +V+v$ does not have any embedded eigenvalues provided that $v$ decays super-exponentially.


title: Reinforcement Learning Under Moral Uncertainty

abstract: An ambitious goal for machine learning is to create agents that behave ethically: The capacity to abide by human moral norms would greatly expand the context in which autonomous agents could be practically and safely deployed, e.g. fully autonomous vehicles will encounter charged moral decisions that complicate their deployment. While ethical agents could be trained by rewarding correct behavior under a specific moral theory (e.g. utilitarianism), there remains widespread disagreement about the nature of morality. Acknowledging such disagreement, recent work in moral philosophy proposes that ethical behavior requires acting under moral uncertainty, i.e. to take into account when acting that one's credence is split across several plausible ethical theories. This paper translates such insights to the field of reinforcement learning, proposes two training methods that realize different points among competing desiderata, and trains agents in simple environments to act under moral uncertainty. The results illustrate (1) how such uncertainty can help curb extreme behavior from commitment to single theories and (2) several technical complications arising from attempting to ground moral philosophy in RL (e.g. how can a principled trade-off between two competing but incomparable reward functions be reached). The aim is to catalyze progress towards morally-competent agents and highlight the potential of RL to contribute towards the computational grounding of moral philosophy.


title: Minibatch vs Local SGD for Heterogeneous Distributed Learning

abstract: We analyze Local SGD (aka parallel or federated SGD) and Minibatch SGD in the heterogeneous distributed setting, where each machine has access to stochastic gradient estimates for a different, machine-specific, convex objective; the goal is to optimize w.r.t. the average objective; and machines can only communicate intermittently. We argue that, (i) Minibatch SGD (even without acceleration) dominates all existing analysis of Local SGD in this setting, (ii) accelerated Minibatch SGD is optimal when the heterogeneity is high, and (iii) present the first upper bound for Local SGD that improves over Minibatch SGD in a non-homogeneous regime.


title: A stable and accurate scheme for solving the Stefan problem coupled with natural convection using the Immersed Boundary Smooth Extension method

abstract: The dissolution of solids has created spectacular geomorphologies ranging from centimeter-scale cave scallops to the kilometer-scale "stone forests" of China and Madagascar. Mathematically, dissolution processes are modeled by a Stefan problem, which describes how the motion of a phase-separating interface depends on local concentration gradients, coupled to a fluid flow. Simulating these problems is challenging, requiring the evolution of a free interface whose motion depends on the normal derivatives of an external field in an ever-changing domain. Moreover, density differences created in the fluid domain induce self-generated convecting flows that further complicate the numerical study of dissolution processes. In this contribution, we present a numerical method for the simulation of the Stefan problem coupled to a fluid flow. The scheme uses the Immersed Boundary Smooth Extension method to solve the bulk advection-diffusion and fluid equations in the complex, evolving geometry, coupled to a {\theta}-L scheme that provides stable evolution of the boundary. We demonstrate third-order temporal and pointwise spatial convergence of the scheme for the classical Stefan problem, and second-order temporal and pointwise spatial convergence when coupled to flow. Examples of dissolution of solids that result in high-Rayleigh number convection are numerically studied, and qualitatively reproduce the complex morphologies observed in recent experiments.


title: Unsupervised Transfer Learning with Self-Supervised Remedy

abstract: Generalising deep networks to novel domains without manual labels is challenging to deep learning. This problem is intrinsically difficult due to unpredictable changing nature of imagery data distributions in novel domains. Pre-learned knowledge does not transfer well without making strong assumptions about the learned and the novel domains. Different methods have been studied to address the underlying problem based on different assumptions, e.g. from domain adaptation to zero-shot and few-shot learning. In this work, we address this problem by transfer clustering that aims to learn a discriminative latent space of the unlabelled target data in a novel domain by knowledge transfer from labelled related domains. Specifically, we want to leverage relative (pairwise) imagery information, which is freely available and intrinsic to a target domain, to model the target domain image distribution characteristics as well as the prior-knowledge learned from related labelled domains to enable more discriminative clustering of unlabelled target data. Our method mitigates nontransferrable prior-knowledge by self-supervision, benefiting from both transfer and self-supervised learning. Extensive experiments on four datasets for image clustering tasks reveal the superiority of our model over the state-of-the-art transfer clustering techniques. We further demonstrate its competitive transferability on four zero-shot learning benchmarks.


title: Response times of nodes in a complex network environment -- two potential derivation tracks

abstract: The spread of perturbative signals in complex networks is governed by the combined effect of the network topology and its intrinsic nonlinear dynamics. Recently, the resulting spreading patterns have been analyzed and predicted, shown to depend on a single scaling relationship, linking a node's weighted degree $S_i$ to its intrinsic response time $\tau_i$. The relevant scaling exponent $\theta$ can be analytically traced to the system's nonlinear dynamics. Here we show that $\theta$ can be obtained via two different derivation tracks, leading to seemingly different functions. Analyzing the resulting predictions, we find that, despite their distinct form, they are fully consistent, predicting the exact same scaling relationship under potentially diverse types of dynamics.


title: First-principles study of magnetism and electric field effects in 2D systems

abstract: This review article provides a bird's-eye view of what first-principles based methods can contribute to next-generation device design and simulation. After a brief overview of methods and capabilities in the area, we focus on published work by our group since 2015 and current work on $\textrm{CrI}_3$. We introduce both single- and dual-gate models in the framework of density functional theory and the constrained random phase approximation in estimating the Hubbard $U$ for 2D systems vs. their 3D counterparts. A wide range of systems, including graphene-based heterogeneous systems, transition metal dichalcogenides, and topological insulators, and a rich array of physical phenomena, including the macroscopic origin of polarization, field effects on magnetic order, interface state resonance induced peak in transmission coefficients, spin filtration, etc., are covered. For $\textrm{CrI}_3$ we present our new results on bilayer systems such as the interplay between stacking and magnetic order, pressure dependence, and electric field induced magnetic phase transitions. We find that a bare bilayer $\textrm{CrI}_3$, graphene$\,|\,$bilayer $\textrm{CrI}_3\,|\,$graphene, $h$-BN$\,|\,$bilayer $\textrm{CrI}_3\,|\,h$-BN, and $h$-BN$\,|\,$bilayer $\textrm{CrI}_3\,|\,$graphene all have a different response at high field, while small field the difference is small except for graphene$\,|\,$bilayer $\textrm{CrI}_3\,|\,$graphene. We conclude with discussion of some ongoing work and work planned in the near future, with the inclusion of further method development and applications.


title: The Heavy-Tail Phenomenon in SGD

abstract: In recent years, various notions of capacity and complexity have been proposed for characterizing the generalization properties of stochastic gradient descent (SGD) in deep learning. Some of the popular notions that correlate well with the performance on unseen data are (i) the `flatness' of the local minimum found by SGD, which is related to the eigenvalues of the Hessian, (ii) the ratio of the stepsize $\eta$ to the batch-size $b$, which essentially controls the magnitude of the stochastic gradient noise, and (iii) the `tail-index', which measures the heaviness of the tails of the network weights at convergence. In this paper, we argue that these three seemingly unrelated perspectives for generalization are deeply linked to each other. We claim that depending on the structure of the Hessian of the loss at the minimum, and the choices of the algorithm parameters $\eta$ and $b$, the SGD iterates will converge to a \emph{heavy-tailed} stationary distribution. We rigorously prove this claim in the setting of quadratic optimization: we show that even in a simple linear regression problem with independent and identically distributed data whose distribution has finite moments of all order, the iterates can be heavy-tailed with infinite variance. We further characterize the behavior of the tails with respect to algorithm parameters, the dimension, and the curvature. We then translate our results into insights about the behavior of SGD in deep learning. We support our theory with experiments conducted on synthetic data, fully connected, and convolutional neural networks.


title: Similarity of quadratic and symmetric bilinear forms in characteristic 2

abstract: We say that a field extension $L/F$ has the descent property for isometry (resp. similarity) of quadratic or symmetric bilinear forms if any two forms defined over $F$ that become isometric (resp. similar) over $L$ are already isometric (resp. similar) over $F$. The famous Artin-Springer theorem states that anisotropic quadratic or symmetric bilinear forms over a field stay anisotropic over an odd degree field extension. As a consequence, odd degree extensions have the descent property for isometry of quadratic as well as symmetric bilinear forms. While this is well known for nonsingular quadratic forms, it is perhaps less well known for arbitrary quadratic or symmetric bilinear forms in characteristic $2$. We provide a proof in this situation. More generally, we show that odd degree extensions also have the descent property for similarity. Moreover, for symmetric bilinear forms in characteristic $2$, one even has the descent property for isometry and for similarity for arbitrary separable algebraic extensions. We also show Scharlau's norm principle for arbitrary quadratic or bilinear forms in characteristic $2$.


title: Canonical and DLPNO-based G4(MP2)XK-inspired composite wavefunction methods parametrized against large and chemically diverse training sets: Are they more accurate and/or robust than double hybrid DFT?

abstract: The large and chemically diverse GMTKN55 benchmark was used as a training set for parametrizing composite wave function thermochemistry protocols akin to G4(MP2)XK theory (Chan et al, JCTC 2019, 15, 4478-4484). Even after reparametrization, the GMTKN55 WTMAD2 (weighted mean absolute deviation, type 2) for G4(MP2)-XK is actually inferior to that of the best rung-4 DFT functional, wB97M-V. By increasing the basis set for the MP2 part to def2-QZVPPD, we were able to substantially improve performance at modest cost (if an RI-MP2 approximation is made), with WTMAD2 for this G4(MP2)-XK-D method now comparable to the better rung-5 functionals (albeit at greater cost). A three-tier approach with a scaled MP3/def2-TZVPP intermediate step, however, leads to a G4(MP3)-D method that is markedly superior to even the best double hybrids wB97M(2) and revDSD-PBEP86-D4. Evaluating the CCSD(T) component with a triple-zeta, rather than split-valence, basis set yields only a modest further improvement that is incommensurate with the drastic increase in computational cost. G4(MP3)-D and G4(MP2)- XK-D have about 40% better WTMAD2, at similar or lower computational cost, than their counterparts G4 and G4(MP2), respectively: detailed comparison reveals that the difference lies in larger molecules due to basis set incompleteness error. An E2/ {T,Q} extrapolation and a CCSD(T)/def2-TZVP step provided the G4-T method of high accuracy and with just three fitted parameters. Using KS orbitals in MP2 leads to the G4(MP3|KS)-D method, which entirely eliminates the CCSD(T) step and has no steps costlier than scaled MP3; this shows a path forward to further improvements in double-hybrid density functional methods. G4-T-DLPNO, a variant in which post-MP2 corrections are evaluated at the DLPNO- CCSD(T) level, achieves nearly the accuracy of G4-T but is applicable to much larger systems.


title: Barycentric Brownian Bees

abstract: We establish an invariance principle for the barycenter of a Brunet-Derrida particle system in $d$ dimensions. The model consists of $N$ particles undergoing dyadic branching Brownian motion with rate $1$. At a branching event, the number of particles is kept equal to $N$ by removing the particle located furthest away from the barycenter. To prove the invariance principle, a key step is to establish Harris recurrence for the process viewed from its barycenter.


title: Deep learning framework for subject-independent emotion detection using wireless signals

abstract: Emotion states recognition using wireless signals is an emerging area of research that has an impact on neuroscientific studies of human behaviour and well-being monitoring. Currently, standoff emotion detection is mostly reliant on the analysis of facial expressions and/or eye movements acquired from optical or video cameras. Meanwhile, although they have been widely accepted for recognizing human emotions from the multimodal data, machine learning approaches have been mostly restricted to subject dependent analyses which lack of generality. In this paper, we report an experimental study which collects heartbeat and breathing signals of 15 participants from radio frequency (RF) reflections off the body followed by novel noise filtering techniques. We propose a novel deep neural network (DNN) architecture based on the fusion of raw RF data and the processed RF signal for classifying and visualising various emotion states. The proposed model achieves high classification accuracy of 71.67 % for independent subjects with 0.71, 0.72 and 0.71 precision, recall and F1-score values respectively. We have compared our results with those obtained from five different classical ML algorithms and it is established that deep learning offers a superior performance even with limited amount of raw RF and post processed time-sequence data. The deep learning model has also been validated by comparing our results with those from ECG signals. Our results indicate that using wireless signals for stand-by emotion state detection is a better alternative to other technologies with high accuracy and have much wider applications in future studies of behavioural sciences.


title: Generalized golden mean and the efficiency of thermal machines

abstract: We investigate generic heat engines and refrigerators operating between two heat reservoirs, for the condition when their efficiencies are equal to each other. It is shown that the corresponding value of efficiency is given as the inverse of the generalized golden mean, $\phi_p$, where the parameter $p$ depends on the degree of irreversibility of both engine and refrigerator. The reversible case ($p=1$) yields the efficiency in terms of the standard golden mean. We also extend the analysis to a three-heat-resrervoir setup.


title: FREDE: Anytime Graph Embeddings

abstract: Low-dimensional representations, or embeddings, of a graph's nodes facilitate several practical data science and data engineering tasks. As such embeddings rely, explicitly or implicitly, on a similarity measure among nodes, they require the computation of a quadratic similarity matrix, inducing a tradeoff between space complexity and embedding quality. To date, no graph embedding work combines (i) linear space complexity, (ii) a nonlinear transform as its basis, and (iii) nontrivial quality guarantees. In this paper we introduce FREDE (FREquent Directions Embedding), a graph embedding based on matrix sketching that combines those three desiderata. Starting out from the observation that embedding methods aim to preserve the covariance among the rows of a similarity matrix}, FREDE iteratively improves on quality while individually processing rows of a nonlinearly transformed PPR similarity matrix derived from a state-of-the-art graph embedding method} and provides, at any iteration, column-covariance approximation guarantees in due course almost indistinguishable from those of the optimal approximation by SVD. Our experimental evaluation on variably sized networks shows that FREDE performs almost as well as SVD and competitively against state-of-the-art embedding methods in diverse data science tasks, even when it is based on as little as 10% of node similarities.


title: Secure Byzantine-Robust Machine Learning

abstract: Increasingly machine learning systems are being deployed to edge servers and devices (e.g. mobile phones) and trained in a collaborative manner. Such distributed/federated/decentralized training raises a number of concerns about the robustness, privacy, and security of the procedure. While extensive work has been done in tackling with robustness, privacy, or security individually, their combination has rarely been studied. In this paper, we propose a secure two-server protocol that offers both input privacy and Byzantine-robustness. In addition, this protocol is communication-efficient, fault-tolerant and enjoys local differential privacy.


title: Serverless on FHIR: Deploying machine learning models for healthcare on the cloud

abstract: Machine Learning (ML) plays a vital role in implementing digital health. The advances in hardware and the democratization of software tools have revolutionized machine learning. However, the deployment of ML models -- the mathematical representation of the task to be performed -- for effective and efficient clinical decision support at the point of care is still a challenge. ML models undergo constant improvement of their accuracy and predictive power with a high turnover rate. Updating models consumed by downstream health information systems is essential for patient safety. We introduce a functional taxonomy and a four-tier architecture for cloud-based model deployment for digital health. The four tiers are containerized microservices for maintainability, serverless architecture for scalability, function as a service for portability and FHIR schema for discoverability. We call this architecture Serverless on FHIR and propose this as a standard to deploy digital health applications that can be consumed by downstream systems such as EMRs and visualization tools.


title: Ring of flows of one-dimensional differential equations

abstract: In this article, the ring of flows of autonomous differential equations of order one on integral domains is constructed. First, we build the autonomous ring $\Opa(\hurw_{R}[[x]])$ and then its structure is studied. Next, we build the ring of formal exponential generating series of the ring $\Opa(\hurw_ {R} [[x]]) $, where it is possible to find solutions of differential equations of order one when the vector field of the system can be decomposed in sum or product of functions.


title: Nonparametric Feature Impact and Importance

abstract: Practitioners use feature importance to rank and eliminate weak predictors during model development in an effort to simplify models and improve generality. Unfortunately, they also routinely conflate such feature importance measures with feature impact, the isolated effect of an explanatory variable on the response variable. This can lead to real-world consequences when importance is inappropriately interpreted as impact for business or medical insight purposes. The dominant approach for computing importances is through interrogation of a fitted model, which works well for feature selection, but gives distorted measures of feature impact. The same method applied to the same data set can yield different feature importances, depending on the model, leading us to conclude that impact should be computed directly from the data. While there are nonparametric feature selection algorithms, they typically provide feature rankings, rather than measures of impact or importance. They also typically focus on single-variable associations with the response. In this paper, we give mathematical definitions of feature impact and importance, derived from partial dependence curves, that operate directly on the data. To assess quality, we show that features ranked by these definitions are competitive with existing feature selection techniques using three real data sets for predictive tasks.


title: The Golden Ratio of Learning and Momentum

abstract: Gradient descent has been a central training principle for artificial neural networks from the early beginnings to today's deep learning networks. The most common implementation is the backpropagation algorithm for training feed-forward neural networks in a supervised fashion. Backpropagation involves computing the gradient of a loss function, with respect to the weights of the network, to update the weights and thus minimize loss. Although the mean square error is often used as a loss function, the general stochastic gradient descent principle does not immediately connect with a specific loss function. Another drawback of backpropagation has been the search for optimal values of two important training parameters, learning rate and momentum weight, which are determined empirically in most systems. The learning rate specifies the step size towards a minimum of the loss function when following the gradient, while the momentum weight considers previous weight changes when updating current weights. Using both parameters in conjunction with each other is generally accepted as a means to improving training, although their specific values do not follow immediately from standard backpropagation theory. This paper proposes a new information-theoretical loss function motivated by neural signal processing in a synapse. The new loss function implies a specific learning rate and momentum weight, leading to empirical parameters often used in practice. The proposed framework also provides a more formal explanation of the momentum term and its smoothing effect on the training process. All results taken together show that loss, learning rate, and momentum are closely connected. To support these theoretical findings, experiments for handwritten digit recognition show the practical usefulness of the proposed loss function and training parameters.


title: Effective field theories for interacting boundaries of 3D topological crystalline insulators through bosonisation

abstract: Here, we analyse two Dirac fermion species in two spatial dimensions in the presence of general quartic contact interactions. By employing functional bosonisation techniques, we demonstrate that depending on the couplings of the fermion interactions the system can be effectively described by a rich variety of topologically massive gauge theories. Among these effective theories, we obtain an extended Chern-Simons theory with higher order derivatives as well as two coupled Chern-Simons theories. Our formalism allows for a general description of interacting fermions emerging, for example, at the gapped boundary of three-dimensional topological crystalline insulators.


title: Approximate learning of high dimensional Bayesian network structures via pruning of Candidate Parent Sets

abstract: Score-based algorithms that learn Bayesian Network (BN) structures provide solutions ranging from different levels of approximate learning to exact learning. Approximate solutions exist because exact learning is generally not applicable to networks of moderate or higher complexity. In general, approximate solutions tend to sacrifice accuracy for speed, where the aim is to minimise the loss in accuracy and maximise the gain in speed. While some approximate algorithms are optimised to handle thousands of variables, these algorithms may still be unable to learn such high dimensional structures. Some of the most efficient score-based algorithms cast the structure learning problem as a combinatorial optimisation of candidate parent sets. This paper explores a strategy towards pruning the size of candidate parent sets, aimed at high dimensionality problems. The results illustrate how different levels of pruning affect the learning speed relative to the loss in accuracy in terms of model fitting, and show that aggressive pruning may be required to produce approximate solutions for high complexity problems.


title: Distributed-Ledger-based Authentication with Decentralized Identifiers and Verifiable Credentials

abstract: Authentication with username and password is becoming an inconvenient process for the user. End users typically have little control over their personal privacy, and data breaches effecting millions of users have already happened several times. We have implemented a proof of concept decentralized OpenID Connect Provider by marrying it with Self-Sovereign Identity, which gives users the freedom to choose from a very large pool of identity providers instead of just a select few corporations, thus enabling the democratization of the highly centralized digital identity landscape. Furthermore, we propose a verifiable credential powered decentralized Public Key Infrastructure using distributed ledger technologies, which creates a straightforward and verifiable way for retrieving digital certificates.


title: Magnesium abundances in cool metal-polluted white dwarfs

abstract: The accretion of rocky material is responsible for the presence of heavy elements in the atmospheres of a large fraction of white dwarf stars. Those objects represent a unique opportunity to infer the bulk composition of exoplanetesimals. This chemical characterization requires the use of detailed atmosphere models to determine the elemental abundances at the photospheres of white dwarfs. In this work, we use a state-of-the-art model atmosphere code to reanalyse the first large survey of metal-polluted white dwarfs for which abundances are found for multiple elements. We show that the improved constitutive physics of our models lead to systematically higher Mg abundances than previous analyses. We find an average log Mg/Ca number abundance ratio of 1.5. This value is significantly above the reference abundance for chondrites, which is expected as current diffusion models predict that for the cool helium-atmosphere white dwarfs of our sample Mg should remain in the atmosphere longer than Ca. This helps resolve a recently identified Mg depletion problem, where the planetesimals accreted by white dwarfs were reported to be Mg-deficient compared to the expected composition of their planetary systems.


title: Independent Sets of Random Trees and of Sparse Random Graphs

abstract: An independent set of size $k$ in a finite undirected graph $G$ is a set of $k$ vertices of the graph, no two of which are connected by an edge. Let $x_{k}(G)$ be the number of independent sets of size $k$ in the graph $G$ and let $\alpha(G)=\max\{k\geq0\colon x_{k}(G)\neq0\}$. In 1987, Alavi, Malde, Schwenk and Erd\"{o}s asked if the independent set sequence $x_{0}(G),x_{1}(G),\ldots,x_{\alpha(G)}(G)$ of a tree is unimodal (the sequence goes up and then down). This problem is still open. In 2006, Levit and Mandrescu showed that the last third of the independent set sequence of a tree is decreasing. We show that the first 46.8\% of the independent set sequence of a random tree is increasing with (exponentially) high probability as the number of vertices goes to infinity. So, the question of Alavi, Malde, Schwenk and Erd\"{o}s is ``four-fifths true'', with high probability. We also show unimodality of the independent set sequence of Erd\"{o}s-Renyi random graphs, when the expected degree of a single vertex is large (with (exponentially) high probability as the number of vertices in the graph goes to infinity, except for a small region near the mode). A weaker result is shown for random regular graphs. The structure of independent sets of size $k$ as $k$ varies is of interest in probability, statistical physics, combinatorics, and computer science.


title: Mathematical Reasoning via Self-supervised Skip-tree Training

abstract: We examine whether self-supervised language modeling applied to mathematical formulas enables logical reasoning. We suggest several logical reasoning tasks that can be used to evaluate language models trained on formal mathematical statements, such as type inference, suggesting missing assumptions and completing equalities. To train language models for formal mathematics, we propose a novel skip-tree task. We find that models trained on the skip-tree task show surprisingly strong mathematical reasoning abilities, and outperform models trained on standard skip-sequence tasks. We also analyze the models' ability to formulate new conjectures by measuring how often the predictions are provable and useful in other proofs.


title: Integral Points on Elliptic Curves and Modularity

abstract: In this paper we prove the finiteness of the set of S-integral points of a punctured rational elliptic curve without complex multiplication using the Chabauty-Kim method. This extends previous results of Kim in the complex multiplication case. The key input of our approach is the use of modularity techniques to prove the vanishing of certain Selmer groups involved in the Chabauty-Kim method.


title: One-Bit Symbol-Level Precoding for MU-MISO Downlink with Intelligent Reflecting Surface

abstract: This paper considers symbol-level precoding (SLP) for multiuser multi-input single-output (MISO) downlink transmission with the aid of intelligent reflecting surface (IRS). Specifically, by assuming one-bit transmitted signals at the base station (BS), which arises from the use of low-resolution DACs in the regime of massive transmit antennas, a joint design of one-bit SLP at the BS and the phase shifts at the IRS is proposed with a goal of minimizing the worst-case symbol error probability (SEP) of the users under the PSK modulation. This joint design problem is essentially a mixed integer nonlinear program (MINLP). To tackle it, we alternately optimize the one-bit signal and the phase shifts. For the former, a dual of the relaxed one-bit SLP problem is solved by the mirror descent (MD) method with the maximum block improvement (MBI) heuristics. For the latter, the accelerated projected gradient (APG) method is employed to optimize the phases. Numerical results demonstrate that the proposed joint design can attain better SEP performance than the conventional linear precoding and one-bit SLP.


title: Outlier Detection Using a Novel method: Quantum Clustering

abstract: We propose a new assumption in outlier detection: Normal data instances are commonly located in the area that there is hardly any fluctuation on data density, while outliers are often appeared in the area that there is violent fluctuation on data density. And based on this hypothesis, we apply a novel density-based approach to unsupervised outlier detection. This approach, called Quantum Clustering (QC), deals with unlabeled data processing and constructs a potential function to find the centroids of clusters and the outliers. The experiments show that the potential function could clearly find the hidden outliers in data points effectively. Besides, by using QC, we could find more subtle outliers by adjusting the parameter $\sigma$. Moreover, our approach is also evaluated on two datasets (Air Quality Detection and Darwin Correspondence Project) from two different research areas, and the results show the wide applicability of our method.


title: Can Temporal-Difference and Q-Learning Learn Representation? A Mean-Field Theory

abstract: Temporal-difference and Q-learning play a key role in deep reinforcement learning, where they are empowered by expressive nonlinear function approximators such as neural networks. At the core of their empirical successes is the learned feature representation, which embeds rich observations, e.g., images and texts, into the latent space that encodes semantic structures. Meanwhile, the evolution of such a feature representation is crucial to the convergence of temporal-difference and Q-learning. In particular, temporal-difference learning converges when the function approximator is linear in a feature representation, which is fixed throughout learning, and possibly diverges otherwise. We aim to answer the following questions: When the function approximator is a neural network, how does the associated feature representation evolve? If it converges, does it converge to the optimal one? We prove that, utilizing an overparameterized two-layer neural network, temporal-difference and Q-learning globally minimize the mean-squared projected Bellman error at a sublinear rate. Moreover, the associated feature representation converges to the optimal one, generalizing the previous analysis of Cai et al. (2019) in the neural tangent kernel regime, where the associated feature representation stabilizes at the initial one. The key to our analysis is a mean-field perspective, which connects the evolution of a finite-dimensional parameter to its limiting counterpart over an infinite-dimensional Wasserstein space. Our analysis generalizes to soft Q-learning, which is further connected to policy gradient.


title: Nonlinear Higher-Order Label Spreading

abstract: Label spreading is a general technique for semi-supervised learning with point cloud or network data, which can be interpreted as a diffusion of labels on a graph. While there are many variants of label spreading, nearly all of them are linear models, where the incoming information to a node is a weighted sum of information from neighboring nodes. Here, we add nonlinearity to label spreading through nonlinear functions of higher-order structure in the graph, namely triangles in the graph. For a broad class of nonlinear functions, we prove convergence of our nonlinear higher-order label spreading algorithm to the global solution of a constrained semi-supervised loss function. We demonstrate the efficiency and efficacy of our approach on a variety of point cloud and network datasets, where the nonlinear higher-order model compares favorably to classical label spreading, as well as hypergraph models and graph neural networks.

categories: cs.LG cs.SI math.SP physics.data-an stat.ML


title: Existence and Uniqueness of Weak solution of $ p( x ) $- laplacian in Sobolev spaces with variable exponents in complete manifolds

abstract: The paper deals with the existence and uniqueness of a non-trivial solution to non-homogeneous $ p ( x ) -$laplacian equations, managed by non polynomial growth operator in the framework of variable exponent Sobolev spaces on Riemannian manifolds. The mountain pass Theorem is used.


title: The Classification of Magic SET Squares

abstract: A magic SET square is a 3 by 3 table of SET cards such that each row, column, diagonal, and anti-diagonal is a set. We allow the following transformations of the square: shuffling features, shuffling values within the features, rotations and reflections of the square. Under these transformations, there are 21 types of magic SET squares. We calculate the number of squares of each type. In addition, we discuss a game of SET tic-tac-toe.


title: An Astrocyte-Modulated Neuromorphic Central Pattern Generator for Hexapod Robot Locomotion on Intel's Loihi

abstract: Locomotion is a crucial challenge for legged robots that is addressed "effortlessly" by biological networks abundant in nature, named central pattern generators (CPG). The multitude of CPG network models that have so far become biomimetic robotic controllers is not applicable to the emerging neuromorphic hardware, depriving mobile robots of a robust walking mechanism that would result in inherently energy-efficient systems. Here, we propose a brain-morphic CPG controler based on a comprehensive spiking neural-astrocytic network that generates two gait patterns for a hexapod robot. Building on the recently identified astrocytic mechanisms for neuromodulation, our proposed CPG architecture is seamlessly integrated into Intel's Loihi neuromorphic chip by leveraging a real-time interaction framework between the chip and the robotic operating system (ROS) environment, that we also propose. Here, we demonstrate that a Loihi-run CPG can be used to control a walking robot with robustness to sensory noise and varying speed profiles. Our results pave the way for scaling this and other approaches towards Loihi-controlled locomotion in autonomous mobile robots.


title: A Heuristically Self-Organised Linguistic Attribute Deep Learning in Edge Computing For IoT Intelligence

abstract: With the development of Internet of Things (IoT), IoT intelligence becomes emerging technology. "Curse of Dimensionality" is the barrier of data fusion in edge devices for the success of IoT intelligence. A Linguistic Attribute Hierarchy (LAH), embedded with Linguistic Decision Trees (LDTs), can represent a new attribute deep learning. In contrast to the conventional deep learning, an LAH could overcome the shortcoming of missing interpretation by providing transparent information propagation through the rules, produced by LDTs in the LAH. Similar to the conventional deep learning, the computing complexity of optimising LAHs blocks the applications of LAHs. In this paper, we propose a heuristic approach to constructing an LAH, embedded with LDTs for decision making or classification by utilising the distance correlations between attributes and between attributes and the goal variable. The set of attributes is divided to some attribute clusters, and then they are heuristically organised to form a linguistic attribute hierarchy. The proposed approach was validated with some benchmark decision making or classification problems from the UCI machine learning repository. The experimental results show that the proposed self-organisation algorithm can construct an effective and efficient linguistic attribute hierarchy. Such a self-organised linguistic attribute hierarchy embedded with LDTs can not only efficiently tackle "curse of dimensionality" in a single LDT for data fusion with massive attributes, but also achieve better or comparable performance on decision making or classification, compared to the single LDT for the problem to be solved. The self-organisation algorithm is much efficient than the Genetic Algorithm in Wrapper for the optimisation of LAHs. This makes it feasible to embed the self-organisation algorithm in edge devices for IoT intelligence.


title: Motion Prediction using Trajectory Sets and Self-Driving Domain Knowledge

abstract: Predicting the future motion of vehicles has been studied using various techniques, including stochastic policies, generative models, and regression. Recent work has shown that classification over a trajectory set, which approximates possible motions, achieves state-of-the-art performance and avoids issues like mode collapse. However, map information and the physical relationships between nearby trajectories is not fully exploited in this formulation. We build on classification-based approaches to motion prediction by adding an auxiliary loss that penalizes off-road predictions. This auxiliary loss can easily be pretrained using only map information (e.g., off-road area), which significantly improves performance on small datasets. We also investigate weighted cross-entropy losses to capture spatial-temporal relationships among trajectories. Our final contribution is a detailed comparison of classification and ordinal regression on two public self-driving datasets.


title: Linformer: Self-Attention with Linear Complexity

abstract: Large transformer models have shown extraordinary success in achieving state-of-the-art results in many natural language processing applications. However, training and deploying these models can be prohibitively costly for long sequences, as the standard self-attention mechanism of the Transformer uses $O(n^2)$ time and space with respect to sequence length. In this paper, we demonstrate that the self-attention mechanism can be approximated by a low-rank matrix. We further exploit this finding to propose a new self-attention mechanism, which reduces the overall self-attention complexity from $O(n^2)$ to $O(n)$ in both time and space. The resulting linear transformer, the \textit{Linformer}, performs on par with standard Transformer models, while being much more memory- and time-efficient.


title: The Penalty Imposed by Ablated Data Augmentation

abstract: There is a set of data augmentation techniques that ablate parts of the input at random. These include input dropout, cutout, and random erasing. We term these techniques ablated data augmentation. Though these techniques seems similar in spirit and have shown success in improving model performance in a variety of domains, we do not yet have a mathematical understanding of the differences between these techniques like we do for other regularization techniques like L1 or L2. First, we study a formal model of mean ablated data augmentation and inverted dropout for linear regression. We prove that ablated data augmentation is equivalent to optimizing the ordinary least squares objective along with a penalty that we call the Contribution Covariance Penalty and inverted dropout, a more common implementation than dropout in popular frameworks, is equivalent to optimizing the ordinary least squares objective along with Modified L2. For deep networks, we demonstrate an empirical version of the result if we replace contributions with attributions and coefficients with average gradients, i.e., the Contribution Covariance Penalty and Modified L2 Penalty drop with the increase of the corresponding ablated data augmentation across a variety of networks.


title: On the uniqueness and monotonicity of solutions of free boundary problems

abstract: For any $\Omega\subset \mathbb{R}^N$ smooth and bounded domain, we prove uniqueness of positive solutions of free boundary problems arising in plasma physics on $\Omega$ in a neat interval depending only by the best constant of the Sobolev embedding $H^{1}_0(\Omega)\hookrightarrow L^{2p}(\Omega)$, $p\in [1,\frac{N}{N-2})$ and show that the boundary density and a suitably defined energy share a universal monotonic behavior. At least to our knowledge, for $p>1$, this is the first result about the uniqueness for a domain which is not a two-dimensional ball and in particular the very first result about the monotonicity of solutions, which seems to be new even for $p=1$. The threshold, which is sharp for $p=1$, yields a new condition which guarantees that there is no free boundary inside $\Omega$. As a corollary, in the same range, we solve a long-standing open problem (dating back to the work of Berestycki-Brezis in 1980) about the uniqueness of variational solutions. Moreover, on a two-dimensional ball we describe the full branch of positive solutions, that is, we prove the monotonicity along the curve of positive solutions until the boundary density vanishes.


title: Copy that! Editing Sequences by Copying Spans

abstract: Neural sequence-to-sequence models are finding increasing use in editing of documents, for example in correcting a text document or repairing source code. In this paper, we argue that common seq2seq models (with a facility to copy single tokens) are not a natural fit for such tasks, as they have to explicitly copy each unchanged token. We present an extension of seq2seq models capable of copying entire spans of the input to the output in one step, greatly reducing the number of decisions required during inference. This extension means that there are now many ways of generating the same output, which we handle by deriving a new objective for training and a variation of beam search for inference that explicitly handles this problem. In our experiments on a range of editing tasks of natural language and source code, we show that our new model consistently outperforms simpler baselines.


title: Noisy receivers for quantum illumination

abstract: Quantum illumination (QI) promises unprecedented performances in target detection but there are various problems surrounding its implementation. Where target ranging is a concern, signal and idler recombination forms a crucial barrier to the protocol's success. This could potentially be mitigated if performing a measurement on the idler mode could still yield a quantum advantage. In this paper we investigate the QI protocol for a generically correlated Gaussian source and study the phase-conjugating (PC) receiver, deriving the associated SNR in terms of the signal and idler energies, and their cross-correlations, which may be readily adapted to incorporate added noise due to Gaussian measurements. We confirm that a heterodyne measurement performed on the idler mode leads to a performance which asymptotically approaches that of a coherent state with homodyne detection. However, if the signal mode is affected by heterodyne but the idler mode is maintained clean, the performance asymptotically approaches that of the PC receiver without any added noise.