title: Efficient Data-specific Model Search for Collaborative Filtering

abstract: Collaborative filtering (CF), as a fundamental approach for recommender systems, is usually built on the latent factor model with learnable parameters to predict users' preferences towards items. However, designing a proper CF model for a given data is not easy, since the properties of datasets are highly diverse. In this paper, motivated by the recent advances in automated machine learning (AutoML), we propose to design a data-specific CF model by AutoML techniques. The key here is a new framework that unifies state-of-the-art (SOTA) CF methods and splits them into disjoint stages of input encoding, embedding function, interaction function, and prediction function. We further develop an easy-to-use, robust, and efficient search strategy, which utilizes random search and a performance predictor for efficient searching within the above framework. In this way, we can combinatorially generalize data-specific CF models, which have not been visited in the literature, from SOTA ones. Extensive experiments on five real-world datasets demonstrate that our method can consistently outperform SOTA ones for various CF tasks. Further experiments verify the rationality of the proposed framework and the efficiency of the search strategy. The searched CF models can also provide insights for exploring more effective methods in the future


title: NG+ : A Multi-Step Matrix-Product Natural Gradient Method for Deep Learning

abstract: In this paper, a novel second-order method called NG+ is proposed. By following the rule ``the shape of the gradient equals the shape of the parameter", we define a generalized fisher information matrix (GFIM) using the products of gradients in the matrix form rather than the traditional vectorization. Then, our generalized natural gradient direction is simply the inverse of the GFIM multiplies the gradient in the matrix form. Moreover, the GFIM and its inverse keeps the same for multiple steps so that the computational cost can be controlled and is comparable with the first-order methods. A global convergence is established under some mild conditions and a regret bound is also given for the online learning setting. Numerical results on image classification with ResNet50, quantum chemistry modeling with Schnet, neural machine translation with Transformer and recommendation system with DLRM illustrate that GN+ is competitive with the state-of-the-art methods.


title: Resilient and Distributed Discrete Optimal Transport with Deceptive Adversary: A Game-Theoretic Approach

abstract: Optimal transport (OT) is a framework that can be used to guide the optimal allocation of a limited amount of resources. The classical OT paradigm does not consider malicious attacks in its formulation and thus the designed transport plan lacks resiliency to an adversary. To address this concern, we establish an OT framework that explicitly accounts for the adversarial and stealthy manipulation of participating nodes in the network during the transport strategy design. Specifically, we propose a game-theoretic approach to capture the strategic interactions between the transport planner and the deceptive attacker. We analyze the properties of the established two-person zero-sum game thoroughly. We further develop a fully distributed algorithm to compute the optimal resilient transport strategies, and show the convergence of the algorithm to a saddle-point equilibrium. Finally, we demonstrate the effectiveness of the designed algorithm using case studies.


title: Extending the RISC-V ISA for exploring advanced reconfigurable SIMD instructions

abstract: This paper presents a novel, non-standard set of vector instruction types for exploring custom SIMD instructions in a softcore. The new types allow simultaneous access to a relatively high number of operands, reducing the instruction count where applicable. Additionally, a high-performance open-source RISC-V (RV32 IM) softcore is introduced, optimised for exploring custom SIMD instructions and streaming performance. By providing instruction templates for instruction development in HDL/Verilog, efficient FPGA-based instructions can be developed with few low-level lines of code. In order to improve custom SIMD instruction performance, the softcore's cache hierarchy is optimised for bandwidth, such as with very wide blocks for the last-level cache. The approach is demonstrated on example memory-intensive applications on an FPGA. Although the exploration is based on the softcore, the goal is to provide a means to experiment with advanced SIMD instructions which could be loaded in future CPUs that feature reconfigurable regions as custom instructions. Finally, we provide some insights on the challenges and effectiveness of such future micro-architectures.


title: Arc-to-pocket transition and quantitative understanding of transport properties in cuprate superconductors

abstract: Despite immense efforts, the cuprate Fermi surface (FS) has been unambiguously determined in only two distinct, low-temperature regions of the phase diagram: a large hole-like FS at high doping, and a small electron-like pocket associated with charge-density-wave driven FS reconstruction at moderate doping. Moreover, there exists incomplete understanding of the reconstructed state, which is stabilized by high magnetic fields, and its connection with the normal state that consists of arc-like remnants of the large underlying FS. Part of the problem is that compound-specific idiosyncrasies, such as disorder effects and low structural symmetry, can obscure the fundamental properties of the quintessential CuO$_2$ planes. Here we present planar magnetotransport measurements for moderately-doped HgBa$_2$CuO$_{4+{\delta}}$ that enable a quantitative understanding of the phase transition between the normal and reconstructed states and of the charge transport in the latter, and that demonstrate that the quasiparticle scattering rate in both states is due to Umklapp scattering. Building on prior insights, we furthermore arrive at a comprehensive understanding of the evolution of the planar transport properties throughout the entire cuprate phase diagram.


title: Exploring the black hole spectrum of axionic Horndeski theory

abstract: We provide a ``user-friendly'' algorithm to systematically and rapidly obtain exact planar black hole solutions in the Einstein-Maxwell theory deformed by the most general shift- and reflection-symmetric Horndeski sector where the usual Galileon is replaced by a tuple of scalars with profiles linear in the coordinates of the transverse manifold. Under precise assumptions, these axion backgrounds break the translational invariance of the system, causing momentum dissipation in the holographically dual field theory. The success of the method relies on the simple realization that the bulk equations of motion become more tractable when written in terms of the axions kinetic terms, instead of the radial coordinate. Showcasing this particularly efficient recipe, we derive novel asymptotically AdS black holes, and show that their extremal counterparts always flow to an $\mathrm{AdS}_2\times \mathbb{R}^2$ infrared fixed point. Additionally, we report an interesting family of new asymptotically Lifshitz black hole solutions with $z>1$. Finally, we discuss the DC transport properties of the dual relativistic field theories in view of possible applications to condensed matter systems.


title: Piercing All Translates of a Set of Axis-Parallel Rectangles

abstract: For a given shape $S$ in the plane, one can ask what is the lowest possible density of a point set $P$ that pierces ("intersects", "hits") all translates of $S$. This is equivalent to determining the covering density of $S$ and as such is well studied. Here we study the analogous question for families of shapes where the connection to covering no longer exists. That is, we require that a single point set $P$ simultaneously pierces each translate of each shape from some family $\mathcal F$. We denote the lowest possible density of such an $\mathcal F$-piercing point set by $\pi_T(\mathcal F)$. Specifically, we focus on families $\mathcal F$ consisting of axis-parallel rectangles. When $|\mathcal F|=2$ we exactly solve the case when one rectangle is more squarish than $2\times 1$, and give bounds (within $10\,\%$ of each other) for the remaining case when one rectangle is wide and the other one is tall. When $|\mathcal F|\ge 2$ we present a linear-time constant-factor approximation algorithm for computing $\pi_T(\mathcal F)$ (with ratio $1.895$).


title: Spin squeezing from bilinear spin-spin interactions: two simple theorems

abstract: We demonstrate two simple theorems about squeezing induced by bilinear spin-spin interactions that conserve spin parity -- including a vast majority of quantum spin models implemented by state-of-the-art quantum simulators. In particular we show that squeezing captures the first form of quantum correlations which are produced: 1) at equilibrium, by adiabatically turning on the spin-spin interactions starting from a factorized state aligned with an external, arbitrary field; 2) away from equilibrium, by evolving unitarily the same state with the interacting Hamiltonian.


title: High-resolution population estimation using household survey data and building footprints

abstract: The national census is an essential data source to support decision-making in many areas of public interest. However, this data may become outdated during the intercensal period, which can stretch up to several decades. We developed a Bayesian hierarchical model leveraging recent household surveys with probabilistic sampling designs and building footprints to produce up-to-date population estimates. We estimated population totals and age and sex breakdowns with associated uncertainty measures within grid cells of approximately 100m in five provinces of the Democratic Republic of the Congo, a country where the last census was completed in 1984. The model exhibited a very good fit, with an R^2 value of 0.79 for out-of-sample predictions of population totals at the microcensus-cluster level and 1.00 for age and sex proportions at the province level. The results confirm the benefits of combining household surveys and building footprints for high-resolution population estimation in countries with outdated censuses.


title: Improving Bridge estimators via $f$-GAN

abstract: Bridge sampling is a powerful Monte Carlo method for estimating ratios of normalizing constants. Various methods have been introduced to improve its efficiency. These methods aim to increase the overlap between the densities by applying appropriate transformations to them without changing their normalizing constants. In this paper, we first give a new estimator of the asymptotic relative mean square error (RMSE) of the optimal Bridge estimator by equivalently estimating an $f$-divergence between the two densities. We then utilize this framework and propose $f$-GAN-Bridge estimator ($f$-GB) based on a bijective transformation that maps one density to the other and minimizes the asymptotic RMSE of the optimal Bridge estimator with respect to the densities. This transformation is chosen by minimizing a specific $f$-divergence between the densities using an $f$-GAN. We show $f$-GB is optimal in the sense that within any given set of candidate transformations, the $f$-GB estimator can asymptotically achieve an RMSE lower than or equal to that achieved by Bridge estimators based on any other transformed densities. Numerical experiments show that $f$-GB outperforms existing methods in simulated and real-world examples. In addition, we discuss how Bridge estimators naturally arise from the problem of $f$-divergence estimation.


title: Discrete potential mean field games: duality and numerical resolution

abstract: We propose and investigate a general class of discrete time and finite state space mean field game (MFG) problems with potential structure. Our model incorporates interactions through a congestion term and a price variable. It also allows hard constraints on the distribution of the agents. We analyze the connection between the MFG problem and two optimal control problems in duality. We present two families of numerical methods and detail their implementation: (i) primal-dual proximal methods (and their extension with nonlinear proximity operators), (ii) the alternating direction method of multipliers (ADMM) and a variant called ADM-G. We give some convergence results. Numerical results are provided for two examples with hard constraints.


title: Meta-Interpretive Learning as Metarule Specialisation

abstract: In Meta-Interpretive Learning (MIL) the metarules, second-order datalog clauses acting as inductive bias, are manually defined by the user. In this work we show that second-order metarules for MIL can be learned by MIL. We define a generality ordering of metarules by $\theta$-subsumption and show that user-defined \emph{sort metarules} are derivable by specialisation of the most-general \emph{matrix metarules} in a language class; and that these matrix metarules are in turn derivable by specialisation of third-order \emph{punch metarules} with variables quantified over the set of atoms and for which only an upper bound on their number of literals need be user-defined. We show that the cardinality of a metarule language is polynomial in the number of literals in punch metarules. We re-frame MIL as metarule specialisation by resolution. We modify the MIL metarule specialisation operator to return new metarules rather than first-order clauses and prove the correctness of the new operator. We implement the new operator as TOIL, a sub-system of the MIL system Louise. Our experiments show that as user-defined sort metarules are progressively replaced by sort metarules learned by TOIL, Louise's predictive accuracy and training times are maintained. We conclude that automatically derived metarules can replace user-defined metarules.


title: Neural networks in pulsed dipolar spectroscopy: a practical guide

abstract: This is a methodological guide to the use of deep neural networks in the processing of pulsed dipolar spectroscopy (PDS) data encountered in structural biology, organic photovoltaics, photosynthesis research, and other domains featuring long-lived radical pairs and paramagnetic metal ions. PDS uses distance dependence of magnetic dipolar interactions; measuring a single well-defined distance is straightforward, but extracting distance distributions is a hard and mathematically ill-posed problem requiring careful regularisation and background fitting. Neural networks do this exceptionally well, but their "robust black box" reputation hides the complexity of their design and training - particularly when the training dataset is effectively infinite. The objective of this paper is to give insight into training against simulated databases, to discuss network architecture choices, to describe options for handling DEER (double electron-electron resonance) and RIDME (relaxation-induced dipolar modulation enhancement) experiments, and to provide a practical data processing flowchart.


title: An open-source automated magnetic optical density meter for analysis of suspensions of magnetic cells and particles

abstract: We present a spectrophotometer (optical density meter) combined with electromagnets dedicated to the analysis of suspensions of magnetotactic bacteria. The instrument can also be applied to suspensions of other magnetic cells and magnetic particles. We have ensured that our system, called MagOD, can be easily reproduced by providing the source of the 3D prints for the housing, electronic designs, circuit board layouts, and microcontroller software. We compare the performance of our system to existing adapted commercial spectrophotometers. In addition, we demonstrate its use by analyzing the absorbance of magnetotactic bacteria as a function of their orientation with respect to the light path and their speed of reorientation after the field has been rotated by 90 degrees. We continuously monitored the development of a culture of magnetotactic bacteria over a period of five days, and measured the development of their velocity distribution over a period of one hour. Even though this dedicated spectrophotometer is relatively simple to construct and cost-effective, a range of magnetic field-dependent parameters can be extracted from suspensions of magnetotactic bacteria. Therefore, this instrument will help the magnetotactic research community to understand and apply this intriguing micro-organism.


title: Development of singularities in the relativistic Euler equations

abstract: The purpose of this paper is to study the phenomenon of singularity formation in large data problems for classical solutions to the Cauchy problem of the relativistic Euler equations. The classical theory established by P. D. Lax in 1964 (J. Math. Phys. 5: 611-614) shows that, for 2x2 hyperbolic systems, the break-down of classical solutions occurs in finite time if initial data contain any compression in some truly nonlinear characteristic field under some additional conditions, which include genuine nonlinearity and the strict positivity of the difference between two corresponding eigenvalues. These harsh structural assumptions mean that it is highly non-trivial to apply this theory to archetypal systems of conservation laws, such as the (1+1)-dimensional relativistic Euler equations. Actually, in the (1+1)-dimensional spacetime setting, if the mass-energy density does not vanish initially at any finite point, the essential difficulty in considering the possible break-down is to obtain sharp enough control on the lower bound of the mass-energy density. To this end, based on introducing several key artificial quantities and some elaborate analysis on the difference of the two Riemann invariants, we characterized the decay of mass-energy density lower bound in time. On the one hand, for the classical solutions with large data and possible far field vacuum to the isentropic flow, we verified the theory obtained by P. D. Lax in 1964. On the other hand, for the classical solutions with large data and strictly positive initial mass-energy density to the non-isentropic flow, we exhibit a numerical value N, thought of as representing the strength of an initial compression, above which all initial data lead to a finite-time singularity formation. These singularities manifest as a blow-up in the gradient of certain Riemann invariants associated with corresponding systems.


title: On the stability of conservative discontinuous Galerkin/Hermite spectral methods for the Vlasov-Poisson system

abstract: We study a class of spatial discretizations for the Vlasov-Poisson system written as an hyperbolic system using Hermite polynomials. In particular, we focus on spectral methods and discontinuous Galerkin approximations. To obtain L 2 stability properties, we introduce a new L 2 weighted space, with a time dependent weight. For the Hermite spectral form of the Vlasov-Poisson system, we prove conservation of mass, momentum and total energy, as well as global stability for the weighted L 2 norm. These properties are then discussed for several spatial discretizations. Finally, numerical simulations are performed with the proposed DG/Hermite spectral method to highlight its stability and conservation features.


title: Bhabha scattering at NNLO with next-to-soft stabilisation

abstract: A critical subject in fully differential QED calculations originates from numerical instabilities due to small fermion masses that act as regulators of collinear singularities. At next-to-next-to-leading order (NNLO) a major challenge is therefore to find a stable implementation of numerically delicate real-virtual matrix elements. In the case of Bhabha scattering this has so far prevented the development of a fixed-order Monte Carlo at NNLO accuracy. In this paper we present a new method for stabilising the real-virtual matrix element. It is based on the expansion for soft photon energies including the non-universal subleading term calculated with the method of regions. We have applied this method to Bhabha scattering to obtain a stable and efficient implementation within the McMule framework. We therefore present for the first time fully differential results for the photonic NNLO corrections to Bhabha scattering.


title: Comparing vector fields across surfaces: interest for characterizing the orientations of cortical folds

abstract: Vectors fields defined on surfaces constitute relevant and useful representations but are rarely used. One reason might be that comparing vector fields across two surfaces of the same genus is not trivial: it requires to transport the vector fields from the original surfaces onto a common domain. In this paper, we propose a framework to achieve this task by mapping the vector fields onto a common space, using some notions of differential geometry. The proposed framework enables the computation of statistics on vector fields. We demonstrate its interest in practice with an application on real data with a quantitative assessment of the reproducibility of curvature directions that describe the complex geometry of cortical folding patterns. The proposed framework is general and can be applied to different types of vector fields and surfaces, allowing for a large number of high potential applications in medical imaging.

categories: cs.CV math.DG physics.bio-ph physics.med-ph


title: Signal processing on simplicial complexes

abstract: Higher-order networks have so far been considered primarily in the context of studying the structure of complex systems, i.e., the higher-order or multi-way relations connecting the constituent entities. More recently, a number of studies have considered dynamical processes that explicitly account for such higher-order dependencies, e.g., in the context of epidemic spreading processes or opinion formation. In this chapter, we focus on a closely related, but distinct third perspective: how can we use higher-order relationships to process signals and data supported on higher-order network structures. In particular, we survey how ideas from signal processing of data supported on regular domains, such as time series or images, can be extended to graphs and simplicial complexes. We discuss Fourier analysis, signal denoising, signal interpolation, and nonlinear processing through neural networks based on simplicial complexes. Key to our developments is the Hodge Laplacian matrix, a multi-relational operator that leverages the special structure of simplicial complexes and generalizes desirable properties of the Laplacian matrix in graph signal processing.


title: Analysis of a Target-Based Actor-Critic Algorithm with Linear Function Approximation

abstract: Actor-critic methods integrating target networks have exhibited a stupendous empirical success in deep reinforcement learning. However, a theoretical understanding of the use of target networks in actor-critic methods is largely missing in the literature. In this paper, we reduce this gap between theory and practice by proposing the first theoretical analysis of an online target-based actor-critic algorithm with linear function approximation in the discounted reward setting. Our algorithm uses three different timescales: one for the actor and two for the critic. Instead of using the standard single timescale temporal difference (TD) learning algorithm as a critic, we use a two timescales target-based version of TD learning closely inspired from practical actor-critic algorithms implementing target networks. First, we establish asymptotic convergence results for both the critic and the actor under Markovian sampling. Then, we provide a finite-time analysis showing the impact of incorporating a target network into actor-critic methods.


title: Time Series Anomaly Detection with label-free Model Selection

abstract: Anomaly detection for time-series data becomes an essential task for many data-driven applications fueled with an abundance of data and out-of-the-box machine-learning algorithms. In many real-world settings, developing a reliable anomaly model is highly challenging due to insufficient anomaly labels and the prohibitively expensive cost of obtaining anomaly examples. It imposes a significant bottleneck to evaluate model quality for model selection and parameter tuning reliably. As a result, many existing anomaly detection algorithms fail to show their promised performance after deployment. In this paper, we propose LaF-AD, a novel anomaly detection algorithm with label-free model selection for unlabeled times-series data. Our proposed algorithm performs a fully unsupervised ensemble learning across a large number of candidate parametric models. We develop a model variance metric that quantifies the sensitivity of anomaly probability with a bootstrapping method. Then it makes a collective decision for anomaly events by model learners using the model variance. Our algorithm is easily parallelizable, more robust for ill-conditioned and seasonal data, and highly scalable for a large number of anomaly models. We evaluate our algorithm against other state-of-the-art methods on a synthetic domain and a benchmark public data set.


title: Discovering Interpretable Machine Learning Models in Parallel Coordinates

abstract: This paper contributes to interpretable machine learning via visual knowledge discovery in parallel coordinates. The concepts of hypercubes and hyper-blocks are used as easily understandable by end-users in the visual form in parallel coordinates. The Hyper algorithm for classification with mixed and pure hyper-blocks (HBs) is proposed to discover hyper-blocks interactively and automatically in individual, multiple, overlapping, and non-overlapping setting. The combination of hyper-blocks with linguistic description of visual patterns is presented too. It is shown that Hyper models generalize decision trees. The Hyper algorithm was tested on the benchmark data from UCI ML repository. It allowed discovering pure and mixed HBs with all data and then with 10-fold cross validation. The links between hyper-blocks, dimension reduction and visualization are established. Major benefits of hyper-block technology and the Hyper algorithm are in their ability to discover and observe hyper-blocks by end-users including side by side visualizations making patterns visible for all classes. Another advantage of sets of HBs relative to the decision trees is the ability to avoid both data overgeneralization and overfitting.


title: Investigating sanity checks for saliency maps with image and text classification

abstract: Saliency maps have shown to be both useful and misleading for explaining model predictions especially in the context of images. In this paper, we perform sanity checks for text modality and show that the conclusions made for image do not directly transfer to text. We also analyze the effects of the input multiplier in certain saliency maps using similarity scores, max-sensitivity and infidelity evaluation metrics. Our observations reveal that the input multiplier carries input's structural patterns in explanation maps, thus leading to similar results regardless of the choice of model parameters. We also show that the smoothness of a Neural Network (NN) function can affect the quality of saliency-based explanations. Our investigations reveal that replacing ReLUs with Softplus and MaxPool with smoother variants such as LogSumExp (LSE) can lead to explanations that are more reliable based on the infidelity evaluation metric.


title: Training Graph Neural Networks with 1000 Layers

abstract: Deep graph neural networks (GNNs) have achieved excellent results on various tasks on increasingly large graph datasets with millions of nodes and edges. However, memory complexity has become a major obstacle when training deep GNNs for practical applications due to the immense number of nodes, edges, and intermediate activations. To improve the scalability of GNNs, prior works propose smart graph sampling or partitioning strategies to train GNNs with a smaller set of nodes or sub-graphs. In this work, we study reversible connections, group convolutions, weight tying, and equilibrium models to advance the memory and parameter efficiency of GNNs. We find that reversible connections in combination with deep network architectures enable the training of overparameterized GNNs that significantly outperform existing methods on multiple datasets. Our models RevGNN-Deep (1001 layers with 80 channels each) and RevGNN-Wide (448 layers with 224 channels each) were both trained on a single commodity GPU and achieve an ROC-AUC of $87.74 \pm 0.13$ and $88.24 \pm 0.15$ on the ogbn-proteins dataset. To the best of our knowledge, RevGNN-Deep is the deepest GNN in the literature by one order of magnitude. Please visit our project website https://www.deepgcns.org/arch/gnn1000 for more information.


title: S$^2$-MLP: Spatial-Shift MLP Architecture for Vision

abstract: Recently, visual Transformer (ViT) and its following works abandon the convolution and exploit the self-attention operation, attaining a comparable or even higher accuracy than CNNs. More recently, MLP-Mixer abandons both the convolution and the self-attention operation, proposing an architecture containing only MLP layers. To achieve cross-patch communications, it devises an additional token-mixing MLP besides the channel-mixing MLP. It achieves promising results when training on an extremely large-scale dataset. But it cannot achieve as outstanding performance as its CNN and ViT counterparts when training on medium-scale datasets such as ImageNet1K and ImageNet21K. The performance drop of MLP-Mixer motivates us to rethink the token-mixing MLP. We discover that the token-mixing MLP is a variant of the depthwise convolution with a global reception field and spatial-specific configuration. But the global reception field and the spatial-specific property make token-mixing MLP prone to over-fitting. In this paper, we propose a novel pure MLP architecture, spatial-shift MLP (S$^2$-MLP). Different from MLP-Mixer, our S$^2$-MLP only contains channel-mixing MLP. We utilize a spatial-shift operation for communications between patches. It has a local reception field and is spatial-agnostic. It is parameter-free and efficient for computation. The proposed S$^2$-MLP attains higher recognition accuracy than MLP-Mixer when training on ImageNet-1K dataset. Meanwhile, S$^2$-MLP accomplishes as excellent performance as ViT on ImageNet-1K dataset with considerably simpler architecture and fewer FLOPs and parameters.


title: Modeling satellite-based open water fraction via flexible Beta regression: An application to wetlands in the north-western Pacific coast of Mexico

abstract: Carbon sequestration and water filtering are two examples of the several ecosystem services provided by wetlands. Open water mapping is an effective means to measure any wetland extension as these are comprised of many open water bodies. An economical, though indirect, approach towards mapping open water bodies is through applying geo-computational methods to satellite images. In this work we propose the flexible Beta regression (FBR) model to predict open water fraction from measurements of a water index. We focus on observations derived from two MODIS images acquired during the dry season of 2008 in Marismas Nacionales, a wetland located in the north-western Pacific coast of Mexico. A Bayesian estimation procedure is presented to estimate the FBR model; in particular, we provide details of a nested Metropolis-Hastings and Gibbs sampling algorithm to carry out parameter estimation. Our results show that the FBR model produces valid predictors of water fraction unlike the standard model. Our work is complemented by software developed in the R language and available through a GitHub repository.


title: An Online Riemannian PCA for Stochastic Canonical Correlation Analysis

abstract: We present an efficient stochastic algorithm (RSG+) for canonical correlation analysis (CCA) using a reparametrization of the projection matrices. We show how this reparametrization (into structured matrices), simple in hindsight, directly presents an opportunity to repurpose/adjust mature techniques for numerical optimization on Riemannian manifolds. Our developments nicely complement existing methods for this problem which either require $O(d^3)$ time complexity per iteration with $O(\frac{1}{\sqrt{t}})$ convergence rate (where $d$ is the dimensionality) or only extract the top $1$ component with $O(\frac{1}{t})$ convergence rate. In contrast, our algorithm offers a strict improvement for this classical problem: it achieves $O(d^2k)$ runtime complexity per iteration for extracting the top $k$ canonical components with $O(\frac{1}{t})$ convergence rate. While the paper primarily focuses on the formulation and technical analysis of its properties, our experiments show that the empirical behavior on common datasets is quite promising. We also explore a potential application in training fair models where the label of protected attribute is missing or otherwise unavailable.


title: In-depth analysis of the clustering of dark matter particles around primordial black holes I: density profiles

abstract: Primordial black holes may have been produced in the early stages of the thermal history of the Universe after cosmic inflation. If so, dark matter in the form of elementary particles can be subsequently accreted around these objects, in particular when it gets non-relativistic and further streams freely in the primordial plasma. A dark matter mini-spike builds up gradually around each black hole, with density orders of magnitude larger than the cosmological one. We improve upon previous work by carefully inspecting the computation of the mini-spike radial profile as a function of black hole mass, dark matter particle mass and temperature of kinetic decoupling. We identify a phase-space contribution that has been overlooked and that leads to changes in the final results. We also derive complementary analytical formulae using convenient asymptotic regimes, which allows us to bring out peculiar power-law behaviors for which we provide tentative physical explanations.


title: Blowup solutions for the shadow limit model of singular Gierer-Meinhardt system with critical parameters

abstract: We consider a nonlocal parabolic PDE, which may be regarded as the standard semilinear heat equation with power nonlinearity, where the nonlinear term is divided by some Sobolev norm of the solution. In this paper, we are interested in constructing blowup solutions under some critical regimes. We had a complete new phenomenon of the blowup speed with a log correction term.


title: Graph Domain Adaptation: A Generative View

abstract: Recent years have witnessed tremendous interest in deep learning on graph-structured data. Due to the high cost of collecting labeled graph-structured data, domain adaptation is important to supervised graph learning tasks with limited samples. However, current graph domain adaptation methods are generally adopted from traditional domain adaptation tasks, and the properties of graph-structured data are not well utilized. For example, the observed social networks on different platforms are controlled not only by the different crowd or communities but also by the domain-specific policies and the background noise. Based on these properties in graph-structured data, we first assume that the graph-structured data generation process is controlled by three independent types of latent variables, i.e., the semantic latent variables, the domain latent variables, and the random latent variables. Based on this assumption, we propose a disentanglement-based unsupervised domain adaptation method for the graph-structured data, which applies variational graph auto-encoders to recover these latent variables and disentangles them via three supervised learning modules. Extensive experimental results on two real-world datasets in the graph classification task reveal that our method not only significantly outperforms the traditional domain adaptation methods and the disentangled-based domain adaptation methods but also outperforms the state-of-the-art graph domain adaptation algorithms.


title: Can Explainable AI Explain Unfairness? A Framework for Evaluating Explainable AI

abstract: Many ML models are opaque to humans, producing decisions too complex for humans to easily understand. In response, explainable artificial intelligence (XAI) tools that analyze the inner workings of a model have been created. Despite these tools' strength in translating model behavior, critiques have raised concerns about the impact of XAI tools as a tool for `fairwashing` by misleading users into trusting biased or incorrect models. In this paper, we created a framework for evaluating explainable AI tools with respect to their capabilities for detecting and addressing issues of bias and fairness as well as their capacity to communicate these results to their users clearly. We found that despite their capabilities in simplifying and explaining model behavior, many prominent XAI tools lack features that could be critical in detecting bias. Developers can use our framework to suggest modifications needed in their toolkits to reduce issues likes fairwashing.


title: Conservative Integrators for Piecewise Smooth Systems with Transversal Dynamics

abstract: We introduce conservative integrators for long term integration of piecewise smooth systems with transversal dynamics and piecewise smooth conserved quantities. In essence, for a piecewise dynamical system with piecewise defined conserved quantities such that its trajectories cross transversally to its interface, we combine Mannshardt's transition scheme and the Discrete Multiplier Method to obtain conservative integrators capable of preserving conserved quantities up to machine precision and accuracy order. We prove that the order of accuracy of the conservative integrators is preserved after crossing the interface in the case of codimension one number of conserved quantities. Numerical examples illustrate the preservation of accuracy order and conserved quantities across the interface.


title: Grammar Equations

abstract: Diagrammatically speaking, grammatical calculi such as pregroups provide wires between words in order to elucidate their interactions, and this enables one to verify grammatical correctness of phrases and sentences. In this paper we also provide wirings within words. This will enable us to identify grammatical constructs that we expect to be either equal or closely related. Hence, our work paves the way for a new theory of grammar, that provides novel `grammatical truths'. We give a nogo-theorem for the fact that our wirings for words make no sense for preordered monoids, the form which grammatical calculi usually take. Instead, they require diagrams -- or equivalently, (free) monoidal categories.


title: Trapped Ion Quantum Computing using Optical Tweezers and Electric Fields

abstract: We propose a new scalable architecture for trapped ion quantum computing that combines optical tweezers delivering qubit state-dependent local potentials with oscillating electric fields. Since the electric field allows for long-range qubit-qubit interactions mediated by the center-of-mass motion of the ion crystal alone, it is inherently scalable to large ion crystals. Furthermore, our proposed scheme does not rely on either ground state cooling or the Lamb-Dicke approximation. We study the effects of imperfect cooling of the ion crystal, as well as the role of unwanted qubit-motion entanglement, and discuss the prospects of implementing the state-dependent tweezers in the laboratory.


title: pix2rule: End-to-end Neuro-symbolic Rule Learning

abstract: Humans have the ability to seamlessly combine low-level visual input with high-level symbolic reasoning often in the form of recognising objects, learning relations between them and applying rules. Neuro-symbolic systems aim to bring a unifying approach to connectionist and logic-based principles for visual processing and abstract reasoning respectively. This paper presents a complete neuro-symbolic method for processing images into objects, learning relations and logical rules in an end-to-end fashion. The main contribution is a differentiable layer in a deep learning architecture from which symbolic relations and rules can be extracted by pruning and thresholding. We evaluate our model using two datasets: subgraph isomorphism task for symbolic rule learning and an image classification domain with compound relations for learning objects, relations and rules. We demonstrate that our model scales beyond state-of-the-art symbolic learners and outperforms deep relational neural network architectures.


title: User-Guided Personalized Image Aesthetic Assessment based on Deep Reinforcement Learning

abstract: Personalized image aesthetic assessment (PIAA) has recently become a hot topic due to its usefulness in a wide variety of applications such as photography, film and television, e-commerce, fashion design and so on. This task is more seriously affected by subjective factors and samples provided by users. In order to acquire precise personalized aesthetic distribution by small amount of samples, we propose a novel user-guided personalized image aesthetic assessment framework. This framework leverages user interactions to retouch and rank images for aesthetic assessment based on deep reinforcement learning (DRL), and generates personalized aesthetic distribution that is more in line with the aesthetic preferences of different users. It mainly consists of two stages. In the first stage, personalized aesthetic ranking is generated by interactive image enhancement and manual ranking, meanwhile two policy networks will be trained. The images will be pushed to the user for manual retouching and simultaneously to the enhancement policy network. The enhancement network utilizes the manual retouching results as the optimization goals of DRL. After that, the ranking process performs the similar operations like the retouching mentioned before. These two networks will be trained iteratively and alternatively to help to complete the final personalized aesthetic assessment automatically. In the second stage, these modified images are labeled with aesthetic attributes by one style-specific classifier, and then the personalized aesthetic distribution is generated based on the multiple aesthetic attributes of these images, which conforms to the aesthetic preference of users better.


title: Low-threshold induced side-scattering instability in the edge transport barrier at O-mode ECRH experiments in magnetic fusion devices

abstract: The lower hybrid wave trapping in a tokamak edge transport barrier is predicted. This effect makes possible excitation of the low-power-threshold absolute parametric decay instability leading to side-scattering of the ordinary microwave pump in the electron cyclotron resonance heating experiments. The instability can result in broadening of the power deposition profile both in present day machines and in ITER.


title: Drawing Inspiration from Biological Dendrites to Empower Artificial Neural Networks

abstract: This article highlights specific features of biological neurons and their dendritic trees, whose adoption may help advance artificial neural networks used in various machine learning applications. Advancements could take the form of increased computational capabilities and/or reduced power consumption. Proposed features include dendritic anatomy, dendritic nonlinearities, and compartmentalized plasticity rules, all of which shape learning and information processing in biological networks. We discuss the computational benefits provided by these features in biological neurons and suggest ways to adopt them in artificial neurons in order to exploit the respective benefits in machine learning.


title: An Overview of Energy-Optimal Impedance Control of Cooperative Robot Manipulators

abstract: An impedance-based control scheme is introduced for cooperative manipulators grasping a rigid load. The position and orientation of the load are to be maintained close to a desired trajectory, trading off tracking accuracy by low energy consumption and maintaining stability. To this end, the augmented dynamics of the robots, their actuators and the load is formed, and an impedance control is adopted. A virtual control strategy is used to decouple torque control from actuator control. An optimization problem is then formulated using energy balance equations. The optimization finds the damping and stiffness gains of the impedance relation such that the energy consumption is minimized. Furthermore, L2 stability techniques are used to allow for time-varying damping and stiffness in the desired impedance. A numerical example is provided to demonstrate the results.


title: Machine Learning Implicit Solvation for Molecular Dynamics

abstract: Accurate modeling of the solvent environment for biological molecules is crucial for computational biology and drug design. A popular approach to achieve long simulation time scales for large system sizes is to incorporate the effect of the solvent in a mean-field fashion with implicit solvent models. However, a challenge with existing implicit solvent models is that they often lack accuracy or certain physical properties compared to explicit solvent models, as the many-body effects of the neglected solvent molecules is difficult to model as a mean field. Here, we leverage machine learning (ML) and multi-scale coarse graining (CG) in order to learn implicit solvent models that can approximate the energetic and thermodynamic properties of a given explicit solvent model with arbitrary accuracy, given enough training data. Following the previous ML--CG models CGnet and CGSchnet, we introduce ISSNet, a graph neural network, to model the implicit solvent potential of mean force. ISSNet can learn from explicit solvent simulation data and be readily applied to MD simulations. We compare the solute conformational distributions under different solvation treatments for two peptide systems. The results indicate that ISSNet models can outperform widely-used generalized Born and surface area models in reproducing the thermodynamics of small protein systems with respect to explicit solvent. The success of this novel method demonstrates the potential benefit of applying machine learning methods in accurate modeling of solvent effects for in silico research and biomedical applications.

categories: physics.comp-ph physics.bio-ph physics.chem-ph q-bio.BM stat.ML


title: Volume asymptotics and Margulis function in nonpositive curvature

abstract: In this article, we consider a closed rank one $C^\infty$ Riemannian manifold $M$ of nonpositive curvature and its universal cover $X$. Let $b_t(x)$ be the Riemannian volume of the ball of radius $t>0$ around $x\in X$, and $h$ the topological entropy of the geodesic flow. We obtain the following Margulis-type asymptotic estimates \[\lim_{t\to \infty}b_t(x)/\frac{e^{ht}}{h}=c(x)\] for some continuous function $c: X\to \mathbb{R}$. We prove that the Margulis function $c(x)$ is in fact $C^1$. If $M$ is a surface of nonpositive curvature without flat strips, we show that $c(x)$ is constant if and only if $M$ has constant negative curvature. We also obtain a rigidity result related to the flip invariance of the Patterson-Sullivan measure.


title: Subdivergence-free gluings of trees

abstract: A gluing of two rooted trees is an identification of their leaves and un-subdivision of the resulting 2-valent vertices. A gluing of two rooted trees is subdivergence free if it has no 2-edge cuts with both roots on the same side of the cut. The problem and language is motivated by quantum field theory. We enumerate subdivergence-free gluings for certain families of trees, showing a connection with connected permutations, and we give algorithms to compute subdivergence-free gluings.


title: Komar integral and Smarr formula for axion-dilaton black holes versus S duality

abstract: We construct the Komar integral for axion-dilaton gravity using Wald's formalism and momentum maps and we use it to derive a Smarr relation for stationary axion-dilaton black holes. While the Wald-Noether 2-form charge is not invariant under SL(2,R) electric-magnetic duality transformations because Wald's formalism does not account for magnetic charges and potentials, the Komar integral constructed with it turns out to be invariant and, in more general theories, it will be fully symplectic invariant. We check the Smarr formula obtained with the most general family of static axion-dilaton black holes.


title: Study of an intermediate age open cluster IC 1434 using ground-based imaging and Gaia DR2 astrometry

abstract: We present a detailed photometric and kinematical analysis of poorly studied open cluster IC 1434 using CCD VRI, APASS, and Gaia DR2 database for the first time. BY determining the membership probability of stars, we identified the 238 most probable members with a probability higher than 60% by using proper motion and parallax data as taken from the Gaia DR2 catalog. The mean proper motion of the cluster is obtained as emu_x= - 3.89 +/- 0.19 and emu_y= - 3.34 +/- 0.19 mas/yr in both the directions of right ascension and declination. The radial distribution of member stars provides cluster extent as 7.6 arcmin. We have estimated the interstellar reddening (E(B-V)) as 0.34 mag using the transformation equations from literature. We obtained the values of cluster age and distance are 631 +/- 73 Myr and 3.2 +/- 0.1 Kpc.


title: Security testing using JUnit and Perl scripts

abstract: In this paper, I describe a recent practical experience where JUnit was used for testing security bugs in addition to functional bugs. Perl scripts were also used during the exploration phase. The application being tested was mature, but insecure.


title: The Spectrum of the Berezin transform for Gelfand pairs

abstract: We discuss the Berezin transform, a Markov operator associated to positive-operator valued measures (POVMs). We consider the class of so-called orbit POVMs, constructed on the quotient space $\Omega = G/K$ of a compact group $G$ by its subgroup $K$. We restrict attention to the case where $(G, K)$ is a Gelfand pair and derive an explicit formula for the spectrum of the Berezin transform in terms of the characters of the irreducible unitary representations of $G$. We then specialize our results to the case study $G = \text{SU}(2)$ and $K \simeq S^1$, and find the spectra of orbit POVMs on $S^2$. We confirm previous calculations by Zhang and Donaldson of the spectrum of the standard quantization of $S^2$ coming from K\"ahler geometry. Then, we make a couple of conjectures about the oscillations in the sequence of eigenvalues, and prove them in the simplest case of second-highest weight vector. Finally, for low weights, we prove that the corresponding orbit POVMs on $S^2$ violate the axioms of a Berezin-Toeplitz quantization.


title: An Empirical Survey of Data Augmentation for Limited Data Learning in NLP

abstract: NLP has achieved great progress in the past decade through the use of neural models and large labeled datasets. The dependence on abundant data prevents NLP models from being applied to low-resource settings or novel tasks where significant time, money, or expertise is required to label massive amounts of textual data. Recently, data augmentation methods have been explored as a means of improving data efficiency in NLP. To date, there has been no systematic empirical overview of data augmentation for NLP in the limited labeled data setting, making it difficult to understand which methods work in which settings. In this paper, we provide an empirical survey of recent progress on data augmentation for NLP in the limited labeled data setting, summarizing the landscape of methods (including token-level augmentations, sentence-level augmentations, adversarial augmentations, and hidden-space augmentations) and carrying out experiments on 11 datasets covering topics/news classification, inference tasks, paraphrasing tasks, and single-sentence tasks. Based on the results, we draw several conclusions to help practitioners choose appropriate augmentations in different settings and discuss the current challenges and future directions for limited data learning in NLP.


title: Golden Vaterite as a Mesoscopic Metamaterial for Biophotonic Applications

abstract: Mesoscopic photonic systems with tailored optical responses have great potential to open new frontiers in implantable biomedical devices. However, biocompatibility is typically a problem, as engineering of optical properties often calls for using toxic compounds and chemicals, unsuitable for in vivo applications. Here, we demonstrate a unique approach to biofriendly delivery of optical resonances. We show that the controllable infusion of gold nanoseeds into polycrystalline submicron vaterite spherulites gives rise to a variety of electric and magnetic Mie resonances, producing a tuneable mesoscopic optical metamaterial. The three-dimensional reconstruction of the spherulites demonstrates the capability of controllable gold loading with volumetric filling factors exceeding 28%. Owing to the biocompatibility of the constitutive elements, golden vaterite paves the way to introduce designer-made Mie resonances to cuttingedge biophotonic applications. We exemplify this concept by showing efficient laser heating of gold-filled vaterite spherulites at red and near-infrared wavelengths, highly desirable in photothermal therapy and photoacoustic tomography


title: Balanced Coarsening for Multilevel Hypergraph Partitioning via Wasserstein Discrepancy

abstract: We propose a balanced coarsening scheme for multilevel hypergraph partitioning. In addition, an initial partitioning algorithm is designed to improve the quality of k-way hypergraph partitioning. By assigning vertex weights through the LPT algorithm, we generate a prior hypergraph under a relaxed balance constraint. With the prior hypergraph, we have defined the Wasserstein discrepancy to coordinate the optimal transport of coarsening process. And the optimal transport matrix is solved by Sinkhorn algorithm. Our coarsening scheme fully takes into account the minimization of connectivity metric (objective function). For the initial partitioning stage, we define a normalized cut function induced by Fiedler vector, which is theoretically proved to be a concave function. Thereby, a three-point algorithm is designed to find the best cut under the balance constraint.


title: Training like Playing: A Reinforcement Learning And Knowledge Graph-based framework for building Automatic Consultation System in Medical Field

abstract: We introduce a framework for AI-based medical consultation system with knowledge graph embedding and reinforcement learning components and its implement. Our implement of this framework leverages knowledge organized as a graph to have diagnosis according to evidence collected from patients recurrently and dynamically. According to experiment we designed for evaluating its performance, it archives a good result. More importantly, for getting better performance, researchers can implement it on this framework based on their innovative ideas, well designed experiments and even clinical trials.


title: Joule heating effects in high transparency Josephson junctions

abstract: We study, both theoretically and experimentally, the features on the current-voltage characteristic of a highly transparent Josephson junction caused by transition of the superconducting leads to the normal state. These features appear due to the suppression of the Andreev excess current. We show that by tracing the dependence of the voltage, at which the transition occurs, on the bath temperature and by analyzing the suppression of the excess current by the bias voltage one can recover the temperature dependence of the heat flow out of the junction. We verify theory predictions by fabricating two highly transparent superconductor-graphene-superconductor (SGS) Josephson junctions with suspended and non-suspended graphene as a non-superconducting section between Al leads. Applying the above mentioned technique we show that the cooling power of the suspended junction depends on the bath temperature as $\propto T_{\rm bath}^{3.1}$ close to the superconducting critical temperature.


title: Characterizing the risk of fairwashing

abstract: Fairwashing refers to the risk that an unfair black-box model can be explained by a fairer model through post-hoc explanation manipulation. In this paper, we investigate the capability of fairwashing attacks by analyzing their fidelity-unfairness trade-offs. In particular, we show that fairwashed explanation models can generalize beyond the suing group (i.e., data points that are being explained), meaning that a fairwashed explainer can be used to rationalize subsequent unfair decisions of a black-box model. We also demonstrate that fairwashing attacks can transfer across black-box models, meaning that other black-box models can perform fairwashing without explicitly using their predictions. This generalization and transferability of fairwashing attacks imply that their detection will be difficult in practice. Finally, we propose an approach to quantify the risk of fairwashing, which is based on the computation of the range of the unfairness of high-fidelity explainers.


title: Modeling Profanity and Hate Speech in Social Media with Semantic Subspaces

abstract: Hate speech and profanity detection suffer from data sparsity, especially for languages other than English, due to the subjective nature of the tasks and the resulting annotation incompatibility of existing corpora. In this study, we identify profane subspaces in word and sentence representations and explore their generalization capability on a variety of similar and distant target tasks in a zero-shot setting. This is done monolingually (German) and cross-lingually to closely-related (English), distantly-related (French) and non-related (Arabic) tasks. We observe that, on both similar and distant target tasks and across all languages, the subspace-based representations transfer more effectively than standard BERT representations in the zero-shot setting, with improvements between F1 +10.9 and F1 +42.9 over the baselines across all tested monolingual and cross-lingual scenarios.


title: The noncommutative geometry of the Landau Hamiltonian: Differential aspects

abstract: In this work we study the differential aspects of the noncommutative geometry for the magnetic $C^*$-algebra which is a 2-cocycle deformation of the group $C^*$-algebra of $\mathbb{R}^2$. This algebra is intimately related to the study of the Quantum Hall Effect in the continuous, and our results aim to provide a new geometric interpretation of the related Kubo's formula. Taking inspiration from the ideas developed by Bellissard during the 80's, we build an appropriate Fredholm module for the magnetic $C^*$-algebra based on the magnetic Dirac operator which is the square root (\`a la Dirac) of the quantum harmonic oscillator. Our main result consist of establishing an important piece of Bellissard's theory, the so-called second Connes' formula. In order to do so, we establish the equality of three cyclic 2-cocycles defined on a dense subalgebra of the magnetic $C^*$-algebra. Two of these 2-cocycles are new in the literature and are defined by Connes' quantized differential calculus, with the use of the Dixmier trace and the magnetic Dirac operator.


title: Making ab initio QED functional(s): Non-perturbative and photon-free effective frameworks for strong light-matter coupling

abstract: Strong light-matter coupling provides a promising path for the control of quantum matter where the latter is routinely described from first-principles. However, combining the quantized nature of light with this ab initio tool set is challenging and merely developing, as the coupled light-matter Hilbert space is conceptually different and computational cost quickly becomes overwhelming. In this work, we provide a non-perturbative photon-free formulation of quantum electrodynamics (QED) in the long-wavelength limit, which is formulated solely on the matter Hilbert space and can serve as an accurate starting point for such ab initio methods. The present formulation is an extension of quantum mechanics that recovers the exact results of QED for the zero- and infinite-coupling limit, the infinite-frequency as well as the homogeneous limit and we can constructively increase its accuracy. We show how this formulation can be used to devise approximations for quantum-electrodynamical density-functional theory (QEDFT), which in turn also allows to extend the ansatz to the full minimal-coupling problem and to non-adiabatic situations. Finally, we provide a simple local-density-type functional that takes the strong coupling to the transverse photon-degrees of freedom into account and includes the correct frequency and polarization dependence. This is the first QEDFT functional that accounts for the quantized nature of light while remaining computationally simple enough to allow its application to a large range of systems. All approximations allow the seamless application to periodic systems.


title: On Generating a Lagrangian for Higher Dimensional Gravity

abstract: The Lovelock Lagrangian is for even dimension D obtained from Weil polynomials on the Lie algebra of the Lorentz group SO(1,D-1). The procedure for generating it is related to the Weil homomorphism that converts Lie algebra invariants into cohomology classes.


title: Quantum counterpart of energy equipartition theorem for a dissipative charged magneto-oscillator: Effect of dissipation, memory, and magnetic field

abstract: In this paper, we formulate and study the quantum counterpart of the energy equipartition theorem for a charged quantum particle moving in a harmonic potential in the presence of a uniform external magnetic field and linearly coupled to a passive quantum heat bath through coordinate variables. The bath is modelled as a collection of independent quantum harmonic oscillators. We derive the closed form expressions for the mean kinetic and potential energies of the charged-dissipative-magneto-oscillator in the form $E_k = \langle \mathcal{E}_k \rangle$ and $E_p = \langle \mathcal{E}_p \rangle$ respectively, where $\mathcal{E}_k$ and $\mathcal{E}_p$ denote the average kinetic and potential energies of individual thermostat oscillators. The net averaging is two-fold, the first one being over the Gibbs canonical state for the thermostat, giving $\mathcal{E}_k$ and $\mathcal{E}_p$ and the second one denoted by $\langle . \rangle$ being over the frequencies $\omega$ of the bath oscillators which contribute to $E_k$ and $E_p$ according to probability distributions $\mathcal{P}_k(\omega)$ and $\mathcal{P}_p(\omega)$ respectively. The relationship of the present quantum version of the equipartition theorem with that of the fluctuation-dissipation theorem (within the linear-response theory framework) is also explored. Further, we investigate the influence of the external magnetic field and the effect of different dissipation processes through Gaussian decay, Drude and radiation bath spectral density functions, on the typical properties of $\mathcal{P}_k(\omega)$ and $\mathcal{P}_p(\omega)$. Finally, the role of system-bath coupling strength and the memory effect is analyzed in the context of average kinetic and potential energies of the dissipative charged magneto-oscillator.


title: Computing the Cut Locus of a Riemannian Manifold via Optimal Transport

abstract: In this paper, we give a new characterization of the cut locus of a point on a compact Riemannian manifold as the zero set of the optimal transport density solution of the Monge-Kantorovich equations, a PDE formulation of the optimal transport problem with cost equal to the geodesic distance. Combining this result with an optimal transport numerical solver based on the so-called dynamical Monge-Kantorovich approach, we propose a novel framework for the numerical approximation of the cut locus of a point in a manifold. We show the applicability of the proposed method on a few examples settled on 2d-surfaces embedded in $R^{3}$ and discuss advantages and limitations.


title: Some combinatorial properties of splitting trees

abstract: We show that splitting forcing does not have the weak Sacks property below any condition, answering a question of Laguzzi, Mildenberger and Stuber-Rousselle. We also show how some partition results for splitting trees hold or fail and we determine the value of cardinal invariants after an $\omega_2$-length countable support iteration of splitting forcing.


title: Last Layer Marginal Likelihood for Invariance Learning

abstract: Data augmentation is often used to incorporate inductive biases into models. Traditionally, these are hand-crafted and tuned with cross validation. The Bayesian paradigm for model selection provides a path towards end-to-end learning of invariances using only the training data, by optimising the marginal likelihood. Computing the marginal likelihood is hard for neural networks, but success with tractable approaches that compute the marginal likelihood for the last layer only raises the question of whether this convenient approach might be employed for learning invariances. We show partial success on standard benchmarks, in the low-data regime and on a medical imaging dataset by designing a custom optimisation routine. Introducing a new lower bound to the marginal likelihood allows us to perform inference for a larger class of likelihood functions than before. On the other hand, we demonstrate failure modes on the CIFAR10 dataset, where the last layer approximation is not sufficient due to the increased complexity of our neural network. Our results indicate that once more sophisticated approximations become available the marginal likelihood is a promising approach for invariance learning in neural networks.


title: CodeLabeller: A Web-based Code Annotation Tool for Java Design Patterns and Summaries

abstract: While constructing supervised learning models, we require labelled examples to build a corpus and train a machine learning model. However, most studies have built the labelled dataset manually, which in many occasions is a daunting task. To mitigate this problem, we have built an online tool called CodeLabeller. CodeLabeller is a web-based tool that aims to provide an efficient approach to handling the process of labelling source code files for supervised learning methods at scale by improving the data collection process throughout. CodeLabeller is tested by constructing a corpus of over a thousand source files obtained from a large collection of open source Java projects and labelling each Java source file with their respective design patterns and summaries. Twenty five experts in the field of software engineering participated in a usability evaluation of the tool using the standard User Experience Questionnaire online survey. The survey results demonstrate that the tool achieves the Good standard on hedonic and pragmatic quality standards, is easy to use and meets the needs of the annotating the corpus for supervised classifiers. Apart from assisting researchers in crowdsourcing a labelled dataset, the tool has practical applicability in software engineering education and assists in building expert ratings for software artefacts.


title: A New Electrostatic mode in Two-Fluid (ENe-Ion) Formalism of a Partially Ionized Plasma

abstract: It is economical to devise ways and means to simplify a multi-species particle system. The single fluid MHD description of a plasma is sufficiently adequate to study plasma phenomena . A plasma containing multi-species of particles can also be described by representing each particle species by the corresponding fluid. A partially ionized plasma consisting of electrons, ions and the neutral particles can be described as a single fluid by appropriately combining the dynamics of each of the species. The three component plasma can also be reduced to a two-fluid system. The most obvious way is to combine the electron and the ion fluids to obtain a single fluid in the MHD limit and the neutral particles to form the second fluid. The other two possibilities are 1) to combine electron fluid and the neutral fluid into one fluid, here, christened as ENe fluid, and treat the ions as the second fluid and 2) to combine the ion fluid and the neutral fluid into one fluid, here, christened as INe fluid, and treat the electrons as the second fluid. It is found that the process of combining the electrons and the neutrals endows the neutrals with a negative electric charge. So, here is a new plasma with heavy ( with mass of the neutral particle assuming the electron mass to be negligible) negatively charged particles along with the positively charged ions. One could in principle, similarly treat the second possibility. However , since there can be a huge variation between the relative masses of the neutrals and the ions, the system turns out to be more complex and its discussion is deferred until later. Here, after establishing the framework for the two-fluid ENe-Ion system, the characteristic electrostatic wave mode of this novel two-fluid plasma is determined. The wave frequency is found to be a function of the collision frequencies in addition to the dependence on usual parameters.


title: Inverse image of precompact sets and existence theorems for the Navier-Stokes equations in spatially periodic setting

abstract: We consider the initial problem for the Navier-Stokes equations over ${\mathbb R}^3 \times [0,T]$ with a positive time $T$ in the spatially periodic setting. Identifying periodic vector-valued functions on ${\mathbb R}^3$ with functions on the $3\,$-dimensional torus ${\mathbb T}^3$, we prove that the problem induces an open injective mapping ${\mathcal A} _s: B^{s}_1 \to B^{s-1}_2$ where $B^{s}_1$, $B^{s-1}_2$ are elements from scales of specially constructed function spaces of Bochner-Sobolev type parametrized with the smoothness index $s \in \mathbb N$. Finally, we prove rather expectable statement that a map ${\mathcal A} _s$ is surjective if and only if the inverse image ${\mathcal A} _s ^{-1}(K)$ of any precompact set $K$ from the range of the map ${\mathcal A} _s $ is bounded in the Bochner space $L^{\mathfrak s} ([0,T], L ^{\mathfrak s} ({\mathbb T}^3))$ with the Ladyzhenskaya-Prodi-Serrin numbers ${\mathfrak s}$, ${\mathfrak r}$.


title: Global planar dynamics with star nodes: beyond Hilbert's $16^{th}$ problem

abstract: This is a complete study of the dynamics of polynomial planar vector fields whose linear part is a multiple of the identity and whose nonlinear part is a homogeneous polynomial. It extends previous work by other authors that was mainly concerned with the existence and number of limit cycles. The general results are also applied to two classes of examples where the nonlinearities have degrees 2 and 3, for which we provide a complete set of phase portraits.


title: Topological phases and Anderson localization in off-diagonal mosaic lattices

abstract: We introduce a one-dimensional lattice model whose hopping amplitudes are modulated for equally spaced sites. Such mosaic lattice exhibits many interesting topological and localization phenomena that do not exist in the regular off-diagonal lattices. When the mosaic modulation is commensurate with the underlying lattice, topologically nontrivial phases with zero- and nonzero-energy edge modes are observed as we tune the modulation, where the nontrivial regimes are characterized by quantized Berry phases. If the mosaic lattice becomes incommensurate, Anderson localization will be induced purely by the quasiperiodic off-diagonal modulations. The localized eigenstate is found to be centered on two neighboring sites connected by the quasiperiodic hopping terms. Furthermore, both the commensurate and incommensurate off-diagonal mosaic lattices can host Chern insulators in their two-dimensional generalizations. Our work provides a platform for exploring topological phases and Anderson localization in low-dimensional systems.


title: Axion-Neutrino Interplay in a Gauged Two-Higgs-Doublet Model

abstract: We propose a gauged two-Higgs-doublet model (2HDM) featuring an anomalous Peccei-Quinn symmetry, $U(1)_{PQ}$. Dangerous tree-level flavour-changing neutral currents, common in 2HDMs, are forbidden by the extra gauge symmetry, $U(1)_X$. In our construction, the solutions to the important issues of neutrino masses, dark matter and the strong CP problem are interrelated. Neutrino masses are generated via a Dirac seesaw mechanism and are suppressed by the ratio of the $U(1)_X$ and the $U(1)_{PQ}$ breaking scales. Naturally small neutrino masses suggest that the breaking of $U(1)_X$ occurs at a relatively low scale, which may lead to observable signals in near-future experiments. Interestingly, spontaneous symmetry breaking does not lead to mixing between the $U(1)_X$ gauge boson, $Z^\prime$, and the standard $Z$. For the expected large values of the $U(1)_{PQ}$ scale, the associated axion becomes "invisible", with DFSZ-like couplings, and may account for the observed abundance of cold dark matter. Moreover, a viable parameter space region, which falls within the expected sensitivities of forthcoming axion searches, is identified. We also observe that the flavour-violating process of kaon decaying into pion plus axion, $K^+ \to \pi^+ a$, is further suppressed by the $U(1)_X$ scale, providing a rather weak lower bound for the axion decay constant $f_a$.


title: Quantum spin liquid in an RKKY-coupled two-impurity Kondo system

abstract: We consider a 2-impurity Kondo system with spin-exchange coupling within the conduction band. Our numerical renormalization group calculations show that for strong intraband spin correlations the competition of these correlations with Kondo spin screening stabilizes a metallic spin-liquid phase of the localized spins without geometric frustration. For weak Kondo coupling the spin liquid and the Kondo singlet phase are separated by two quantum phase transitions and an intermediate RKKY spin-dimer phase, while beyond a critical coupling they are connected by a crossover. The results suggest how a quantum spin liquid may be realized in heavy-fermion systems near a spin-density wave instability.


title: JUGE: An Infrastructure for Benchmarking Java Unit Test Generators

abstract: Researchers and practitioners have designed and implemented various automated test case generators to support effective software testing. Such generators exist for various languages (e.g., Java, C#, or Python) and for various platforms (e.g., desktop, web, or mobile applications). Such generators exhibit varying effectiveness and efficiency, depending on the testing goals they aim to satisfy (e.g., unit-testing of libraries vs. system-testing of entire applications) and the underlying techniques they implement. In this context, practitioners need to be able to compare different generators to identify the most suited one for their requirements, while researchers seek to identify future research directions. This can be achieved through the systematic execution of large-scale evaluations of different generators. However, the execution of such empirical evaluations is not trivial and requires a substantial effort to collect benchmarks, setup the evaluation infrastructure, and collect and analyse the results. In this paper, we present our JUnit Generation benchmarking infrastructure (JUGE) supporting generators (e.g., search-based, random-based, symbolic execution, etc.) seeking to automate the production of unit tests for various purposes (e.g., validation, regression testing, fault localization, etc.). The primary goal is to reduce the overall effort, ease the comparison of several generators, and enhance the knowledge transfer between academia and industry by standardizing the evaluation and comparison process. Since 2013, eight editions of a unit testing tool competition, co-located with the Search-Based Software Testing Workshop, have taken place and used and updated JUGE. As a result, an increasing amount of tools (over ten) from both academia and industry have been evaluated on JUGE, matured over the years, and allowed the identification of future research directions.


title: A red giant branch common envelope evolution scenario for the exoplanet WD 1856 b

abstract: We propose a common envelope evolution (CEE) scenario where a red giant branch (RGB) star engulfs a planet during its core helium flash to explain the puzzling system WD 1856+534 where a planet orbits a white dwarf (WD) of mass 0.52Mo with an orbital period of 1.4 day. At the heart of the scenario is the recently proposed assumption that the vigorous convection that core helium flash of RGB stars drive in the core excite waves that propagate and deposit their energy in the envelope. Using the binary-MESA stellar evolution code we show that this energy deposition substantially reduces the binding energy of the envelope and causes its expansion. We propose that in some cases RGB stars might engulf massive planets of ~0.01Mo during their core helium flash phase, and that the planet can unbind most of the mass of the bloated envelope. We show that there is a large range of initial orbital radii for which this scenario might take place under our assumptions. This scenario is relevant to other systems of close sub-stellar objects orbiting white dwarfs, like the brown dwarf-WD system ZTFJ003855.0+203025.5.


title: Quantum Computing by Cooling

abstract: Interesting problems in quantum computation take the form of finding low-energy states of (pseudo)spin systems with engineered Hamiltonians that encode the problem data. Motivated by the practical possibility of producing very low-temperature spin systems, we propose and exemplify the possibility to compute by coupling the computational spins to a non-Markovian bath of spins that serve as a heat sink. We demonstrate both analytically and numerically that this strategy can achieve quantum advantage in the Grover search problem.


title: Dependency in DAG models with Hidden Variables

abstract: Directed acyclic graph models with hidden variables have been much studied, particularly in view of their computational efficiency and connection with causal methods. In this paper we provide the circumstances under which it is possible for two variables to be identically equal, while all other observed variables stay jointly independent of them and mutually of each other. We find that this is possible if and only if the two variables are `densely connected'; in other words, if applications of identifiable causal interventions on the graph cannot (non-trivially) separate them. As a consequence of this, we can also allow such pairs of random variables have any bivariate joint distribution that we choose. This has implications for model search, since it suggests that we can reduce to only consider graphs in which densely connected vertices are always joined by an edge.


title: MIA-COV19D: COVID-19 Detection through 3-D Chest CT Image Analysis

abstract: Early and reliable COVID-19 diagnosis based on chest 3-D CT scans can assist medical specialists in vital circumstances. Deep learning methodologies constitute a main approach for chest CT scan analysis and disease prediction. However, large annotated databases are necessary for developing deep learning models that are able to provide COVID-19 diagnosis across various medical environments in different countries. Due to privacy issues, publicly available COVID-19 CT datasets are highly difficult to obtain, which hinders the research and development of AI-enabled diagnosis methods of COVID-19 based on CT scans. In this paper we present the COV19-CT-DB database which is annotated for COVID-19, consisting of about 5,000 3-D CT scans, We have split the database in training, validation and test datasets. The former two datasets can be used for training and validation of machine learning models, while the latter will be used for evaluation of the developed models. We also present a deep learning approach, based on a CNN-RNN network and report its performance on the COVID19-CT-DB database.


title: On flow-enhanced crystallization in fiber spinning: Asymptotically justified boundary conditions for numerics of a stiff viscoelastic two-phase model

abstract: For flow-enhanced crystallization in fiber spinning, the viscoelastic two-phase fiber models by Doufas et al. (J. Non-Newton. Fluid Mech., 2000) and Shrikhande et al. (J. Appl. Polym. Sci., 2006) are state of the art. However, the boundary conditions associated to the onset of crystallization are still under discussion, as their choice might cause artificial boundary layers and numerical difficulties. In this paper we show that the model class of ordinary differential equations is singularly perturbed in a small parameter belonging to the semi-crystalline relaxation time and derive asymptotically justified boundary conditions. Their effect on the overall solution behavior is restricted to a small region near the onset of crystallization. But their impact on the performance of the numerical solvers is huge, since artificial layering, ambiguities and parameter tunings are avoided. The numerics becomes fast and robust and opens the field for simulation-based process design and material optimization.


title: The ideal structure of measure algebras and asymptotic properties of group representations

abstract: We classify the weak*-closed maximal left ideals of the measure algebra $M(G)$ for certain Hermitian locally compact groups $G$ in terms of the irreducible representations of $G$ and their asymptotic properties. In particular, we obtain a classification for connected nilpotent Lie groups, and the Euclidean rigid motion groups. We also prove a version of this result for certain weighted measure algebras. We apply our classification to obtain an analogue of Barnes' Theorem on integrable representations for representations vanishing at infinity. We next study the relationship between weak*-closedness and finite generation, proving that in many cases $M(G)$ has no finitely-generated maximal left ideals. We also show that the measure algebra of the 2D Euclidean rigid motion group has a weak*-closed maximal left ideal that is not generated by a projection, and investigate whether or not it has any weak*-closed left ideals which are not finitely-generated.


title: Predicting 3D RNA Folding Patterns via Quadratic Binary Optimization

abstract: The structure of an RNA molecule plays a significant role in its biological function. Predicting structure given a one dimensional sequence of RNA nucleotide bases is a difficult and important problem. Many computer programs (known as in silico) are available for predicting 2-dimensional (secondary) structures however 3-dimensional (tertiary) structure prediction is much more difficult mainly due to the far greater number of feasible solutions and fewer experimental data on the thermodynamic energies of 3D structures. It is also challenging to verify the most likely three dimensional structure even with the availability of sophisticated x-ray crystallography and nuclear magnetic resonance imaging technologies. In this paper we develop three dimensional RNA folding predictions by adding penalty and reward parameters to a previous two dimensional approach based on Quadratic Unconstrained Binary Optimization (QUBO) models. These parameters provide flexibility in the amount of three dimensional folding allowed. We address the problem of multiple near-optimal structures via a new weighted similarity structure measure and illustrate folding pathways via progressively improving local optimal solutions. The problems are solved via a new commercial QUBO solver AlphaQUBO (Meta-Analytics, 2020) that solves problems having hundreds of thousands of binary variables.


title: On the Trust and Trust Modelling for the Future Fully-Connected Digital World: A Comprehensive Study

abstract: With the fast development of digital technologies, we are running into a digital world. The relationship among people and the connections among things become more and more complex, and new challenges arise. To tackle these challenges, trust-a soft security mechanism-is considered as a promising technology. Thus, in this survey, we do a comprehensive study on the trust and trust modelling for the future digital world. We revisit the definitions and properties of trust, and analysis the trust theories and discuss their impact on digital trust modelling. We analyze the digital world and its corresponding environment where people, things, and infrastructure connect with each other. We detail the challenges that require trust in these digital scenarios. Under our analysis of trust and the digital world, we define different types of trust relationships and find out the factors that are needed to ensure a fully representative model. Next, to meet the challenges of digital trust modelling, comprehensive trust model evaluation criteria are proposed, and potential securities and privacy issues of trust modelling are analyzed. Finally, we provide a wide-ranging analysis of different methodologies, mathematical theories, and how they can be applied to trust modelling.


title: Estimating the interaction graph of stochastic neuronal dynamics by observing only pairs of neurons

abstract: We address the questions of identifying pairs of interacting neurons from the observation of their spiking activity. The neuronal network is modeled by a system of interacting point processes with memory of variable length. The influence of a neuron on another can be either excitatory or inhibitory. To identify the existence and the nature of an interaction we propose an algorithm based only on the observation of joint activity of the two neurons in successive time slots. This reduces the amount of computation and storage required to run the algorithm, thereby making the algorithm suitable for the analysis of real neuronal data sets. We obtain computable upper bounds for the probabilities of false positive and false negative detection. As a corollary we prove the consistency of the identification algorithm.


title: Universal resource-efficient topological measurement-based quantum computation via color-code-based cluster states

abstract: Topological measurement-based quantum computation (MBQC) enables one to carry out universal fault-tolerant quantum computation via single-qubit Pauli measurements with a family of large entangled states called cluster states as resources. Raussendorf's three-dimensional cluster states (RTCSs) based on the surface codes are mainly considered for topological MBQC. In such schemes, however, the fault-tolerant implementation of the logical Hadamard, phase ($Z^{1/2}$), and $T$ ($Z^{1/4}$) gates which are essential for building up arbitrary logical gates has not been achieved to date without using state distillation, while the controlled-NOT (CNOT) gate does not require it, to best of our knowledge. State distillation generally consumes many ancillary logical qubits, thus it is a severe obstacle against practical quantum computing. To solve this problem, we suggest an MBQC scheme via a family of cluster states called color-code-based cluster states (CCCSs) based on the two-dimensional color codes instead of the surface codes. We define logical qubits, construct elementary logical gates, and describe error correction schemes. We show that all the logical Clifford gates including the CNOT, Hadamard, and phase gates can be implemented fault-tolerantly without state distillation, although the fault-tolerant $T$ gate still requires it. We further prove that the minimal number of physical qubits per logical qubit in a CCCS is at most approximately 1.8 times smaller than the case of an RTCS. We lastly show that the error threshold of MBQC via CCCSs for logical-$Z$ errors is 2.7-2.8%, which is comparable to the value for RTCSs, assuming a simple error model where physical qubits have $X$-measurement or $Z$ errors independently with the same probability.


title: Transferability of optimal QAOA parameters between random graphs

abstract: The Quantum approximate optimization algorithm (QAOA) is one of the most promising candidates for achieving quantum advantage through quantum-enhanced combinatorial optimization. In a typical QAOA setup, a set of quantum circuit parameters is optimized to prepare a quantum state used to find the optimal solution of a combinatorial optimization problem. Several empirical observations about optimal parameter concentration effects for special QAOA MaxCut problem instances have been made in recent literature, however, a rigorous study of the subject is still lacking. We show that convergence of the optimal QAOA parameters around specific values and, consequently, successful transferability of parameters between different QAOA instances can be explained and predicted based on the local properties of the graphs, specifically the types of subgraphs (lightcones) from which the graphs are composed. We apply this approach to random regular and general random graphs. For example, we demonstrate how optimized parameters calculated for a 6-node random graph can be successfully used without modification as nearly optimal parameters for a 64-node random graph, with less than 1% reduction in approximation ratio as a result. This work presents a pathway to identifying classes of combinatorial optimization instances for which such variational quantum algorithms as QAOA can be substantially accelerated.


title: Hilbert points in Hardy spaces

abstract: A Hilbert point in $H^p(\mathbb{T}^d)$, for $d\geq1$ and $1\leq p \leq \infty$, is a nontrivial function $\varphi$ in $H^p(\mathbb{T}^d)$ such that $\| \varphi \|_{H^p(\mathbb{T}^d)} \leq \|\varphi + f\|_{H^p(\mathbb{T}^d)}$ whenever $f$ is in $H^p(\mathbb{T}^d)$ and orthogonal to $\varphi$ in the usual $L^2$ sense. When $p\neq 2$, $\varphi$ is a Hilbert point in $H^p(\mathbb{T})$ if and only if $\varphi$ is a nonzero multiple of an inner function. An inner function on $\mathbb{T}^d$ is a Hilbert point in any of the spaces $H^p(\mathbb{T}^d)$, but there are other Hilbert points as well when $d\geq 2$. We investigate the case of $1$-homogeneous polynomials in depth and obtain as a byproduct a new proof of the sharp Khintchin inequality for Steinhaus variables in the range $2<p<\infty$. We also study briefly the dynamics of a certain nonlinear projection operator that characterizes Hilbert points as its fixed points. We exhibit an example of a function $\varphi$ that is a Hilbert point in $H^p(\mathbb{T}^3)$ for $p=2, 4$, but not for any other $p$; this is verified rigorously for $p>4$ but only numerically for $1\leq p<4$.


title: Posterior Temperature Optimization in Variational Inference for Inverse Problems

abstract: Bayesian methods feature useful properties for solving inverse problems, such as tomographic reconstruction. The prior distribution introduces regularization, which helps solving the ill-posed problem and reduces overfitting. In practice, this often results in a suboptimal posterior temperature and the full potential of the Bayesian approach is not realized. In this paper, we optimize both the parameters of the prior distribution and the posterior temperature using Bayesian optimization. Well-tempered posteriors lead to better predictive performance and improved uncertainty calibration, which we demonstrate for the task of sparse-view CT reconstruction.


title: z-anonymity: Zero-Delay Anonymization for Data Streams

abstract: With the advent of big data and the birth of the data markets that sell personal information, individuals' privacy is of utmost importance. The classical response is anonymization, i.e., sanitizing the information that can directly or indirectly allow users' re-identification. The most popular solution in the literature is the k-anonymity. However, it is hard to achieve k-anonymity on a continuous stream of data, as well as when the number of dimensions becomes high.In this paper, we propose a novel anonymization property called z-anonymity. Differently from k-anonymity, it can be achieved with zero-delay on data streams and it is well suited for high dimensional data. The idea at the base of z-anonymity is to release an attribute (an atomic information) about a user only if at least z - 1 other users have presented the same attribute in a past time window. z-anonymity is weaker than k-anonymity since it does not work on the combinations of attributes, but treats them individually. In this paper, we present a probabilistic framework to map the z-anonymity into the k-anonymity property. Our results show that a proper choice of the z-anonymity parameters allows the data curator to likely obtain a k-anonymized dataset, with a precisely measurable probability. We also evaluate a real use case, in which we consider the website visits of a population of users and show that z-anonymity can work in practice for obtaining the k-anonymity too.


title: $K^{0}_{S}$ meson production in inelastic $\textit{p+p}$ interactions at 158 GeV/c beam momentum measured by NA61/SHINE at the CERN SPS

abstract: The production of $K^{0}_{S}$ mesons in inelastic $\textit{p+p}$ collisions at beam momentum 158 GeV/c ($\sqrt{s_{NN}}=17.3$ GeV) was measured with the NA61/SHINE spectrometer at the CERN Super Proton Synchrotron. Double-differential distributions were obtained in transverse momentum and rapidity. The mean multiplicity of $K^{0}_{S}$ was determined to be $0.162 \pm 0.001 (stat.) \pm 0.011 (sys.)$. The results on $K^{0}_{S}$ production are compared with model predictions (EPOS 1.99, SMASH 2.0, PHSD and UrQMD 3.4 models) as well as with published world data.


title: Throughput Maximization Leveraging Just-Enough SNR Margin and Channel Spacing Optimization

abstract: Flexible optical network is a promising technology to accommodate high-capacity demands in next-generation networks. To ensure uninterrupted communication, existing lightpath provisioning schemes are mainly done with the assumption of worst-case resource under-provisioning and fixed channel spacing, which preserves an excessive signal-to-noise ratio (SNR) margin. However, under a resource over-provisioning scenario, the excessive SNR margin restricts the transmission bit-rate or transmission reach, leading to physical layer resource waste and stranded transmission capacity. To tackle this challenging problem, we leverage an iterative feedback tuning algorithm to provide a just-enough SNR margin, so as to maximize the network throughput. Specifically, the proposed algorithm is implemented in three steps. First, starting from the high SNR margin setup, we establish an integer linear programming model as well as a heuristic algorithm to maximize the network throughput by solving the problem of routing, modulation format, forward error correction, baud-rate selection, and spectrum assignment. Second, we optimize the channel spacing of the lightpaths obtained from the previous step, thereby increasing the available physical layer resources. Finally, we iteratively reduce the SNR margin of each lightpath until the network throughput cannot be increased. Through numerical simulations, we confirm the throughput improvement in different networks and with different baud-rates. In particular, we find that our algorithm enables over 20\% relative gain when network resource is over-provisioned, compared to the traditional method preserving an excessive SNR margin.


title: A Wasserstein Minimax Framework for Mixed Linear Regression

abstract: Multi-modal distributions are commonly used to model clustered data in statistical learning tasks. In this paper, we consider the Mixed Linear Regression (MLR) problem. We propose an optimal transport-based framework for MLR problems, Wasserstein Mixed Linear Regression (WMLR), which minimizes the Wasserstein distance between the learned and target mixture regression models. Through a model-based duality analysis, WMLR reduces the underlying MLR task to a nonconvex-concave minimax optimization problem, which can be provably solved to find a minimax stationary point by the Gradient Descent Ascent (GDA) algorithm. In the special case of mixtures of two linear regression models, we show that WMLR enjoys global convergence and generalization guarantees. We prove that WMLR's sample complexity grows linearly with the dimension of data. Finally, we discuss the application of WMLR to the federated learning task where the training samples are collected by multiple agents in a network. Unlike the Expectation Maximization algorithm, WMLR directly extends to the distributed, federated learning setting. We support our theoretical results through several numerical experiments, which highlight our framework's ability to handle the federated learning setting with mixture models.


title: Give quantum mechanics a chance: use relativistic quantum mechanics to analyze measurement!

abstract: At the time of publication of H. Everett's Relative-State Formulation (1957) and DeWitt's Many-Worlds Interpretation (1970), quantum mechanics was available in a more modern and adequate version than the one used by these authors. We show that with the more modern quantum theory, quantum measurement could have been analyzed along more conventional lines in a one-world cosmology. Bell criticized the Everett-DeWitt theory quite sharply in 1987 but this seems not to have affected the acceptance of the old quantum mechanics as the framework for analysis of measurement.


title: On the Representation of Solutions to Elliptic PDEs in Barron Spaces

abstract: Numerical solutions to high-dimensional partial differential equations (PDEs) based on neural networks have seen exciting developments. This paper derives complexity estimates of the solutions of $d$-dimensional second-order elliptic PDEs in the Barron space, that is a set of functions admitting the integral of certain parametric ridge function against a probability measure on the parameters. We prove under some appropriate assumptions that if the coefficients and the source term of the elliptic PDE lie in Barron spaces, then the solution of the PDE is $\epsilon$-close with respect to the $H^1$ norm to a Barron function. Moreover, we prove dimension-explicit bounds for the Barron norm of this approximate solution, depending at most polynomially on the dimension $d$ of the PDE. As a direct consequence of the complexity estimates, the solution of the PDE can be approximated on any bounded domain by a two-layer neural network with respect to the $H^1$ norm with a dimension-explicit convergence rate.