title: Total Deep Variation: A Stable Regularizer for Inverse Problems

abstract: Various problems in computer vision and medical imaging can be cast as inverse problems. A frequent method for solving inverse problems is the variational approach, which amounts to minimizing an energy composed of a data fidelity term and a regularizer. Classically, handcrafted regularizers are used, which are commonly outperformed by state-of-the-art deep learning approaches. In this work, we combine the variational formulation of inverse problems with deep learning by introducing the data-driven general-purpose total deep variation regularizer. In its core, a convolutional neural network extracts local features on multiple scales and in successive blocks. This combination allows for a rigorous mathematical analysis including an optimal control formulation of the training problem in a mean-field setting and a stability analysis with respect to the initial values and the parameters of the regularizer. In addition, we experimentally verify the robustness against adversarial attacks and numerically derive upper bounds for the generalization error. Finally, we achieve state-of-the-art results for numerous imaging tasks.


title: FANOK: Knockoffs in Linear Time

abstract: We describe a series of algorithms that efficiently implement Gaussian model-X knockoffs to control the false discovery rate on large scale feature selection problems. Identifying the knockoff distribution requires solving a large scale semidefinite program for which we derive several efficient methods. One handles generic covariance matrices, has a complexity scaling as $O(p^3)$ where $p$ is the ambient dimension, while another assumes a rank $k$ factor model on the covariance matrix to reduce this complexity bound to $O(pk^2)$. We also derive efficient procedures to both estimate factor models and sample knockoff covariates with complexity linear in the dimension. We test our methods on problems with $p$ as large as $500,000$.


title: Learnability with Indirect Supervision Signals

abstract: Learning from indirect supervision signals is important in real-world AI applications when, often, gold labels are missing or too costly. In this paper, we develop a unified theoretical framework for multi-class classification when the supervision is provided by a variable that contains nonzero mutual information with the gold label. The nature of this problem is determined by (i) the transition probability from the gold labels to the indirect supervision variables and (ii) the learner's prior knowledge about the transition. Our framework relaxes assumptions made in the literature, and supports learning with unknown, non-invertible and instance-dependent transitions. Our theory introduces a novel concept called \emph{separation}, which characterizes the learnability and generalization bounds. We also demonstrate the application of our framework via concrete novel results in a variety of learning scenarios such as learning with superset annotations and joint supervision signals.


title: On the use of human reference data for evaluating automatic image descriptions

abstract: Automatic image description systems are commonly trained and evaluated using crowdsourced, human-generated image descriptions. The best-performing system is then determined using some measure of similarity to the reference data (BLEU, Meteor, CIDER, etc). Thus, both the quality of the systems as well as the quality of the evaluation depends on the quality of the descriptions. As Section 2 will show, the quality of current image description datasets is insufficient. I argue that there is a need for more detailed guidelines that take into account the needs of visually impaired users, but also the feasibility of generating suitable descriptions. With high-quality data, evaluation of image description systems could use reference descriptions, but we should also look for alternatives.


title: A silicon-integrated telecom photon-spin interface

abstract: Long-distance entanglement distribution is a vital capability for quantum technologies. An outstanding practical milestone towards this aim is the identification of a suitable matter-photon interface which possesses, simultaneously, long coherence lifetimes and efficient telecommunications-band optical access. In this work, alongside its sister publication, we report upon the T center, a silicon defect with spin-selective optical transitions at 1326 nm in the telecommunications O-band. Here we show that the T center in $^{28}$Si offers electron and nuclear spin lifetimes beyond a millisecond and second respectively, as well as optical lifetimes of 0.94(1) $\mu$s and a Debye-Waller factor of 0.23(1). This work represents a significant step towards coherent photonic interconnects between long-lived silicon spins, spin-entangled telecom single-photon emitters, and spin-dependent silicon-integrated photonic nonlinearities for future global quantum technologies.


title: Characterization of the T center in $^{28}$Si

abstract: Silicon is host to two separate leading quantum technology platforms: integrated silicon photonics as well as long-lived spin qubits. There is an ongoing search for the ideal photon-spin interface able to hybridize these two approaches into a single silicon platform offering substantially expanded capabilities. A number of silicon defects are known to have spin-selective optical transitions, although very few of these are known to be in the highly desirable telecommunications bands, and those that do often do not couple strongly to light. Here we characterize the T center in silicon, a highly stable silicon defect which supports a short-lived bound exciton that upon recombination emits light in the telecommunications O-band. In this first study of T centers in $^{28}$Si, we present the temperature dependence of the zero phonon line, report ensemble zero phonon linewidths as narrow as 33(2) MHz, and elucidate the excited state spectrum of the bound exciton. Magneto-photoluminescence, in conjunction with magnetic resonance, is used to observe twelve distinct orientational subsets of the T center, which are independently addressable due to the anisotropic g factor of the bound exciton's hole spin. The T center is thus a promising contender for the hybridization of silicon's two leading quantum technology platforms.


title: Balance is key: Private median splits yield high-utility random trees

abstract: Random forests are a popular method for classification and regression due to their versatility. However, this flexibility can come at the cost of user privacy, since training random forests requires multiple data queries, often on small, identifiable subsets of the training data. Privatizing these queries typically comes at a high utility cost, in large part because we are privatizing queries on small subsets of the data, which are easily corrupted by added noise. In this paper, we propose DiPriMe forests, a novel tree-based ensemble method for differentially private regression and classification, which is appropriate for real or categorical covariates. We generate splits using a differentially private version of the median, which encourages balanced leaf nodes. By avoiding low occupancy leaf nodes, we avoid high signal-to-noise ratios when privatizing the leaf node sufficient statistics. We show theoretically and empirically that the resulting algorithm exhibits high utility, while ensuring differential privacy.


title: Fast Graph Attention Networks Using Effective Resistance Based Graph Sparsification

abstract: The attention mechanism has demonstrated superior performance for inference over nodes in graph neural networks (GNNs), however, they result in a high computational burden during both training and inference. We propose FastGAT, a method to make attention based GNNs lightweight by using spectral sparsification to generate an optimal pruning of the input graph. This results in a per-epoch time that is almost linear in the number of graph nodes as opposed to quadratic. We theoretically prove that spectral sparsification preserves the features computed by the GAT model, thereby justifying our algorithm. We experimentally evaluate FastGAT on several large real world graph datasets for node classification tasks under both inductive and transductive settings. FastGAT can dramatically reduce (up to \textbf{10x}) the computational time and memory requirements, allowing the usage of attention based GNNs on large graphs.


title: Multi-Region Entanglement in Locally Scrambled Quantum Dynamics

abstract: We study the evolution of multi-region bipartite entanglement entropy under locally scrambled quantum dynamics. We show that the multi-region entanglement can significantly modify the growth of single-region entanglement, whose effect has been largely overlooked in the existing literature. We developed a novel theoretical framework, called the entanglement feature formalism, to organize all the multi-region entanglement systematically as a sign-free many-body state. We further propose a two-parameter matrix product state (MPS) ansatz to efficiently capture the exponentially many multi-region entanglement features. Using these tools, we are able to study the multi-region entanglement dynamics jointly and represent the evolution in the MPS parameter space. By comparing the dynamical constraints on the motion of entanglement cuts, we are able to identify different quantum dynamics models in a unifying entanglement feature Hamiltonian. Depending on the quantum dynamics model, we find that multi-region effects can dominate the single region entanglement growth and only vanish for Haar random circuits. We calculate the operator-averaged out-of-time-order correlator based on the entanglement feature Hamiltonian and extract the butterfly velocity from the result. We show that the previously conjectured bound between the entanglement velocity and the butterfly velocity holds true even under the influence of multi-region entanglement. These developments could enable more efficient numerical simulations and more systematic theoretical understandings of the multi-region entanglement dynamics in quantum many-body systems.

categories: cond-mat.dis-nn cond-mat.stat-mech cond-mat.str-el quant-ph


title: Equilibrium Propagation for Complete Directed Neural Networks

abstract: Artificial neural networks, one of the most successful approaches to supervised learning, were originally inspired by their biological counterparts. However, the most successful learning algorithm for artificial neural networks, backpropagation, is considered biologically implausible. We contribute to the topic of biologically plausible neuronal learning by building upon and extending the equilibrium propagation learning framework. Specifically, we introduce: a new neuronal dynamics and learning rule for arbitrary network architectures; a sparsity-inducing method able to prune irrelevant connections; a dynamical-systems characterization of the models, using Lyapunov theory.


title: Constraining the parameter space for the Solar Nebula

abstract: If we want to understand planetesimal formation, the only data set we have is our own Solar System. It is particularly interesting as it is so far the only planetary system we know of that developed life. Understanding the conditions under which the Solar Nebula evolved is crucial in order to understand the different processes in the disk and the subsequent dynamical interaction between (proto-)planets, once the gas disk is gone. Protoplanetary disks provide a plethora of different parameters to explore. The question is whether this parameter space can be constrained, allowing simulations to reproduce the Solar System. Models and observations of planet formation provide constraints on the initial planetesimal mass in certain regions of the Solar Nebula. By making use of pebble flux-regulated planetesimal formation, we perform a parameter study with nine different disk parameters like the initial disk mass, initial disk size, initial dust-to-gas ratio, turbulence level, and more. We find that the distribution of mass in planetesimals in the disk depends on the planetesimal formation timescale and the pebbles' drift timescale. Multiple disk parameters can influence pebble properties and thus planetesimal formation. However, it is still possible to draw some conclusions on potential parameter ranges. Pebble flux-regulated planetesimal formation seems to be very robust, allowing simulations with a wide range of parameters to meet the initial planetesimal constraints for the Solar Nebula. I.e., it does not require a lot of fine tuning.


title: Quark spin - thermal vorticity alignment and the Lambda, anti-Lambda polarization in heavy-ion collisions

abstract: It has been proposed that the $\Lambda$ and $\overline{\Lambda}$ polarizations observed in heavy-ion collisions are due to the interaction between quark spin and thermal vorticity. In this work we report on a computation of the relaxation time required for this alignment to occur at finite temperature and baryon chemical potential, considering quarks with a finite mass. The calculation is performed after modelling the interaction by means of an effective vertex which couples the thermal gluons and quarks within the vortical medium. We show that the effect of the quark mass is to reduce the relaxation time as compared to the massless quark case. An intrinsic global polarization of quarks/antiquarks emerges which is shown to be linked with the $\Lambda$/$\bar{\Lambda}$ polarization.


title: Analysis of parallel Schwarz algorithms for time-harmonic problems using block Toeplitz matrices

abstract: In this work we study the convergence properties of the one-level parallel Schwarz method with Robin transmission conditions applied to the one-dimensional and two-dimensional Helmholtz and Maxwell's equations. One-level methods are not scalable in general. However, it has recently been proven that when impedance transmission conditions are used in the case of the algorithm applied to the equations with absorption, under certain assumptions, scalability can be achieved and no coarse space is required. We show here that this result is also true for the iterative version of the method at the continuous level for strip-wise decompositions into subdomains that can typically be encountered when solving wave-guide problems. The convergence proof relies on the particular block Toeplitz structure of the global iteration matrix. Although non-Hermitian, we prove that its limiting spectrum has a near identical form to that of a Hermitian matrix of the same structure. We illustrate our results with numerical experiments.


title: Gravitational Wave Signatures of Lepton Universality Violation

abstract: We analyze the prospects for using gravitational waves produced in early universe phase transitions as a complementary probe of the flavor anomalies in B meson decays. We focus on the Left-Right SU(4) Model, for which the strength of the observed lepton universality violation and consistency with other experiments impose a vast hierarchy between the symmetry breaking scales. This leads to a multipeaked gravitational wave signature within the reach of upcoming gravitational wave detectors.


title: Stellar electron capture rates based on finite temperature relativistic quasiparticle random-phase approximation

abstract: The electron capture process plays an important role in the evolution of the core collapse of a massive star that precedes the supernova explosion. In this study, the electron capture on nuclei in stellar environment is described in the relativistic energy density functional framework, including both the finite temperature and nuclear pairing effects. Relevant nuclear transitions $J^\pi = 0^\pm, 1^\pm, 2^\pm$ are calculated using the finite temperature proton-neutron quasiparticle random phase approximation with the density-dependent meson-exchange effective interaction DD-ME2. The pairing and temperature effects are investigated in the Gamow-Teller transition strength as well as the electron capture cross sections and rates for ${}^{44}$Ti and ${}^{56}$Fe in stellar environment. It is found that the pairing correlations establish an additional unblocking mechanism similar to the finite temperature effects, that can allow otherwise blocked single-particle transitions. Inclusion of pairing correlations at finite temperature can significantly alter the electron capture cross sections, even up to a factor of two for ${}^{44}$Ti, while for the same nucleus electron capture rates can increase by more than one order of magnitude. We conclude that for the complete description of electron capture on nuclei both pairing and temperature effects must be taken into account.


title: Deep Autoencoding Topic Model with Scalable Hybrid Bayesian Inference

abstract: To build a flexible and interpretable model for document analysis, we develop deep autoencoding topic model (DATM) that uses a hierarchy of gamma distributions to construct its multi-stochastic-layer generative network. In order to provide scalable posterior inference for the parameters of the generative network, we develop topic-layer-adaptive stochastic gradient Riemannian MCMC that jointly learns simplex-constrained global parameters across all layers and topics, with topic and layer specific learning rates. Given a posterior sample of the global parameters, in order to efficiently infer the local latent representations of a document under DATM across all stochastic layers, we propose a Weibull upward-downward variational encoder that deterministically propagates information upward via a deep neural network, followed by a Weibull distribution based stochastic downward generative model. To jointly model documents and their associated labels, we further propose supervised DATM that enhances the discriminative power of its latent representations. The efficacy and scalability of our models are demonstrated on both unsupervised and supervised learning tasks on big corpora.


title: User Profiling from Reviews for Accurate Time-Based Recommendations

abstract: Recommender systems are a valuable way to engage users in a system, increase participation and show them resources they may not have found otherwise. One significant challenge is that user interests may change over time and certain items have an inherently temporal aspect. As a result, a recommender system should try and take into account the time-dependant user-item relationships. However, temporal aspects of a user profile may not always be explicitly available and so we may need to infer this information from available resources. Product reviews on sites, such as Amazon, represent a valuable data source to understand why someone bought an item and potentially who the item is for. This information can then be used to construct a dynamic user profile. In this paper, we demonstrate utilising reviews to extract temporal information to infer the \textit{age category preference} of users, and leverage this feature to generate time-dependent recommendations. Given the predictable and yet shifting nature of age and time, we show that, recommendations generated using this dynamic aspect lead to higher accuracy compared with techniques from state of art. Mining temporally related content in reviews can enable the recommender to go beyond finding similar items or users to potentially predict a future need of a user.


title: Liquidity Provider Returns in Geometric Mean Markets

abstract: Geometric mean market makers (G3Ms), such as Uniswap and Balancer, comprise a popular class of automated market makers (AMMs) defined by the following rule: the reserves of the AMM before and after each trade must have the same (weighted) geometric mean. This paper extends several results known for constant-weight G3Ms to the general case of G3Ms with time-varying and potentially stochastic weights. These results include the returns and no-arbitrage prices of liquidity pool (LP) shares that investors receive for supplying liquidity to G3Ms. Using these expressions, we show how to create G3Ms whose LP shares replicate the payoffs of financial derivatives. The resulting hedges are model-independent and exact for derivative contracts whose payoff functions satisfy an elasticity constraint. These strategies allow LP shares to replicate various trading strategies and financial contracts, including standard options. G3Ms are thus shown to be capable of recreating a variety of active trading strategies through passive positions in LP shares.


title: A Nonparametric Method for Value Function Guided Subgroup Identification via Gradient Tree Boosting for Censored Survival Data

abstract: In randomized clinical trials with survival outcome, there has been an increasing interest in subgroup identification based on baseline genomic, proteomic markers or clinical characteristics. Some of the existing methods identify subgroups that benefit substantially from the experimental treatment by directly modeling outcomes or treatment effect. When the goal is to find an optimal treatment for a given patient rather than finding the right patient for a given treatment, methods under the individualized treatment regime framework estimate an individualized treatment rule that would lead to the best expected clinical outcome as measured by a value function. Connecting the concept of value function to subgroup identification, we propose a nonparametric method that searches for subgroup membership scores by maximizing a value function that directly reflects the subgroup-treatment interaction effect based on restricted mean survival time. A gradient tree boosting algorithm is proposed to search for the individual subgroup membership scores. We conduct simulation studies to evaluate the performance of the proposed method and an application to an AIDS clinical trial is performed for illustration.


title: Magnetic Droplet Solitons

abstract: Magnetic droplet solitons are dynamical magnetic textures that form due to an attractive interaction between spin waves in thin films with perpendicular magnetic anisotropy. Spin currents and the spin torques associated with these currents enable their formation as they provide a means to excite non-equilibrium spin wave populations and compensate their decay. Recent years have seen rapid advances in experiments that realize and study magnetic droplets. Important advances include the first direct x-ray images of droplets, determination of their threshold and sustaining currents, measurement of their generation and annihilation time and evidence for drift instabilities, which can limit their lifetime in spin-transfer nanocontacts. This article reviews these studies and contrasts these solitons to other types of spin-current excitations such as spin-wave bullets, and static magnetic textures, including magnetic vortices and skyrmions. Magnetic droplet solitons can also serve as current controlled microwave frequency oscillators with potential applications in neuromorphic chips as nonlinear oscillators with memory.


title: A Particle Swarm Optimization hyper-heuristic for the Dynamic Vehicle Routing Problem

abstract: This paper presents a method for choosing a Particle Swarm Optimization based optimizer for the Dynamic Vehicle Routing Problem on the basis of the initially available data of a given problem instance. The optimization algorithm is chosen on the basis of a prediction made by a linear model trained on that data and the relative results obtained by the optimization algorithms. The achieved results suggest that such a model can be used in a hyper-heuristic approach as it improved the average results, obtained on the set of benchmark instances, by choosing the appropriate algorithm in 82% of significant cases. Two leading multi-swarm Particle Swarm Optimization based algorithms for solving the Dynamic Vehicle Routing Problem are used as the basic optimization algorithms: Khouadjia's et al. Multi-Environmental Multi-Swarm Optimizer and authors' 2--Phase Multiswarm Particle Swarm Optimization.


title: Criticality from Einstein-Maxwell-dilaton holography at finite temperature and density

abstract: We investigate consistent charged black hole solutions to the Einstein-Maxwell-Dilaton (EMD) equations that are asymptotically AdS. The solutions are gravity duals to phases of a non-conformal plasma at finite temperature and density. For the dilaton we take a quadratic ansatz leading to linear confinement at zero temperature and density. We consider a grand canonical ensemble, where the chemical potential is fixed, and find a rich phase diagram involving the competition of small and large black holes. The phase diagram contains a critical line and a critical point similar to the van der Waals-Maxwell liquid-gas transition. As the critical point is approached, we show that the trace anomaly in the plasma phases vanishes signifying the restoration of conformal symmetry in the fluid. We find that the heat capacity and charge susceptibility diverge as $C_V \propto (T-T^c)^{-\alpha}$ and $\chi \propto (T-T^c)^{-\gamma}$ at the critical point with universal critical exponents $\alpha=\gamma=2/3$. Our results suggest a description of the thermodynamics near the critical point in terms of catastrophe theories. In the limit $\mu \to 0$ we compare our results with lattice results for $SU(N_c)$ Yang-Mills theories.


title: A Model-Based Approach to Anomaly Detection Trading Detection Time and False Alarm Rate

abstract: The complexity and ubiquity of modern computing systems is a fertile ground for anomalies, including security and privacy breaches. In this paper, we propose a new methodology that addresses the practical challenges to implement anomaly detection approaches. Specifically, it is challenging to define normal behavior comprehensively and to acquire data on anomalies in diverse cloud environments. To tackle those challenges, we focus on anomaly detection approaches based on system performance signatures. In particular, performance signatures have the potential of detecting zero-day attacks, as those approaches are based on detecting performance deviations and do not require detailed knowledge of attack history. The proposed methodology leverages an analytical performance model and experimentation and allows to control the rate of false positives in a principled manner. The methodology is evaluated using the TPCx-V workload, which was profiled during a set of executions using resource exhaustion anomalies that emulate the effects of anomalies affecting system performance. The proposed approach was able to successfully detect the anomalies, with a low number of false positives (precision 90%-98%).


title: Augmented Sliced Wasserstein Distances

abstract: While theoretically appealing, the application of the Wasserstein distance to large-scale machine learning problems has been hampered by its prohibitive computational cost. The sliced Wasserstein distance and its variants improve the computational efficiency through the random projection, yet they suffer from low accuracy if the number of projections is not sufficiently large, because the majority of projections result in trivially small values. In this work, we propose a new family of distance metrics, called augmented sliced Wasserstein distances (ASWDs), constructed by first mapping samples to higher-dimensional hypersurfaces parameterized by neural networks. It is derived from a key observation that (random) linear projections of samples residing on these hypersurfaces would translate to much more flexible nonlinear projections in the original sample space, so they can capture complex structures of the data distribution. We show that the hypersurfaces can be optimized by gradient ascent efficiently. We provide the condition under which the ASWD is a valid metric and show that this can be obtained by an injective neural network architecture. Numerical results demonstrate that the ASWD significantly outperforms other Wasserstein variants for both synthetic and real-world problems.


title: Designing high-fidelity multi-qubit gates for semiconductor quantum dots through deep reinforcement learning

abstract: In this paper, we present a machine learning framework to design high-fidelity multi-qubit gates for quantum processors based on quantum dots in silicon, with qubits encoded in the spin of single electrons. In this hardware architecture, the control landscape is vast and complex, so we use the deep reinforcement learning method to design optimal control pulses to achieve high fidelity multi-qubit gates. In our learning model, a simulator models the physical system of quantum dots and performs the time evolution of the system, and a deep neural network serves as the function approximator to learn the control policy. We evolve the Hamiltonian in the full state-space of the system, and enforce realistic constraints to ensure experimental feasibility.


title: Design and implementation of a modular interior-point solver for linear optimization

abstract: This paper introduces the algorithmic design and implementation of Tulip, an open-source interior-point solver for linear optimization. It implements a regularized homogeneous interior-point algorithm with multiple centrality corrections, and therefore handles unbounded and infeasible problems. The solver is written in Julia, thus allowing for a flexible and efficient implementation: Tulip's algorithmic framework is fully disentangled from linear algebra implementations and from a model's arithmetic. In particular, this allows to seamlessly integrate specialized routines for structured problems. Extensive computational results are reported. We find that Tulip is competitive with open-source interior-point solvers on the H. Mittelmann's benchmark of barrier linear programming solvers. Furthermore, we design specialized linear algebra routines for structured master problems in the context of Dantzig-Wolfe decomposition. These routines yield a tenfold speedup on large and dense instances that arise in power systems operation and two-stage stochastic programming, thereby outperforming state-of-the-art commercial interior point method solvers. Finally, we illustrate Tulip's ability to use different levels of arithmetic precision by solving problems in extended precision.


title: Analytical attractor for Bjorken expansion

abstract: We present an analytic solution of a simple set of equations that govern the expansion of boost-invariant plasmas of massless particles. These equations describe, approximately, the early time, collisionless regime, and the transition to hydrodynamics at late time. Their mathematical structure encompasses all versions of second order hydrodynamics when applied to Bjorken flows. The analytic solution provides an explicit expression for the attractor solution that connects the collisionless regime to hydrodynamics. It also constitutes a neat example of an application of the theory of resurgence in asymptotic series.


title: Signed Graph Metric Learning via Gershgorin Disc Perfect Alignment

abstract: Given a convex and differentiable objective $Q(\M)$ for a real symmetric matrix $\M$ in the positive definite (PD) cone -- used to compute Mahalanobis distances -- we propose a fast general metric learning framework that is entirely projection-free. We first assume that $\M$ resides in a space $\cS$ of generalized graph Laplacian matrices corresponding to balanced signed graphs. $\M \in \cS$ that is also PD is called a graph metric matrix. Unlike low-rank metric matrices common in the literature, $\cS$ includes the important diagonal-only matrices as a special case. The key theorem to circumvent full eigen-decomposition and enable fast metric matrix optimization is Gershgorin disc perfect alignment (GDPA): given $\M \in \cS$ and diagonal matrix $\S$, where $S_{ii} = 1/v_i$ and $\v$ is $\M$'s first eigenvector, we prove that Gershgorin disc left-ends of similarity transform $\B = \S \M \S^{-1}$ are perfectly aligned at the smallest eigenvalue $\lambda_{\min}$. Using this theorem, we replace the PD cone constraint in the metric learning problem with tightest possible linear constraints per iteration, so that the alternating optimization of the diagonal / off-diagonal terms in $\M$ can be solved efficiently as linear programs via the Frank-Wolfe method. We update $\v$ using Locally Optimal Block Preconditioned Conjugate Gradient (LOBPCG) with warm start as entries in $\M$ are optimized successively. Experiments show that our graph metric optimization is significantly faster than cone-projection schemes, and produces competitive binary classification performance.


title: BubbleMap: Privilege Mapping for Behavior-based Implicit Authentication Systems

abstract: Leveraging users' behavioral data sampled by various sensors during the identification process, implicit authentication (IA) relieves users from explicit actions such as remembering and entering passwords. Various IA schemes have been proposed based on different behavioral and contextual features such as gait, touch, and GPS. However, existing IA schemes suffer from false positives, i.e., falsely accepting an adversary, and false negatives, i.e., falsely rejecting the legitimate user due to users' behavior change and noise. To deal with this problem, we propose BubbleMap (BMap), a framework that can be seamlessly incorporated into any existing IA system to balance between security (reducing false positives) and usability (reducing false negatives) as well as reducing the equal error rate (EER). To evaluate the proposed framework, we implemented BMap on five state-of-the-art IA systems. We also conducted an experiment in a real-world environment from 2016 to 2020. Most of the experimental results show that BMap can greatly enhance the IA schemes' performances in terms of the EER, security, and usability, with a small amount of penalty on energy consumption.


title: Explaining reputation assessments

abstract: Reputation is crucial to enabling human or software agents to select among alternative providers. Although several effective reputation assessment methods exist, they typically distil reputation into a numerical representation, with no accompanying explanation of the rationale behind the assessment. Such explanations would allow users or clients to make a richer assessment of providers, and tailor selection according to their preferences and current context. In this paper, we propose an approach to explain the rationale behind assessments from quantitative reputation models, by generating arguments that are combined to form explanations. Our approach adapts, extends and combines existing approaches for explaining decisions made using multi-attribute decision models in the context of reputation. We present example argument templates, and describe how to select their parameters using explanation algorithms. Our proposal was evaluated by means of a user study, which followed an existing protocol. Our results give evidence that although explanations present a subset of the information of trust scores, they are sufficient to equally evaluate providers recommended based on their trust score. Moreover, when explanation arguments reveal implicit model information, they are less persuasive than scores.


title: A study of the effect of the illumination model on the generation of synthetic training datasets

abstract: The use of computer generated images to train Deep Neural Networks is a viable alternative to real images when the latter are scarce or expensive. In this paper, we study how the illumination model used by the rendering software affects the quality of the generated images. We created eight training sets, each one with a different illumination model, and tested them on three different network architectures, ResNet, U-Net and a combined architecture developed by us. The test set consisted of photos of 3D printed objects produced from the same CAD models used to generate the training set. The effect of the other parameters of the rendering process, such as textures and camera position, was randomized. Our results show that the effect of the illumination model is important, comparable in significance to the network architecture. We also show that both light probes capturing natural environmental light, and modelled lighting environments, can give good results. In the case of light probes, we identified as two significant factors affecting performance the similarity between the light probe and the test environment, as well as the light probe's resolution. Regarding modelled lighting environment, similarity with the test environment was again identified as a significant factor.


title: Quantitatively Assessing the Benefits of Model-driven Development in Agent-based Modeling and Simulation

abstract: The agent-based modeling and simulation (ABMS) paradigm has been used to analyze, reproduce, and predict phenomena related to many application areas. Although there are many agent-based platforms that support simulation development, they rely on programming languages that require extensive programming knowledge. Model-driven development (MDD) has been explored to facilitate simulation modeling, by means of high-level modeling languages that provide reusable building blocks that hide computational complexity, and code generation. However, there is still limited knowledge of how MDD approaches to ABMS contribute to increasing development productivity and quality. We thus in this paper present an empirical study that quantitatively compares the use of MDD and ABMS platforms mainly in terms of effort and developer mistakes. Our evaluation was performed using MDD4ABMS-an MDD approach with a core and extensions to two application areas, one of which developed for this study-and NetLogo, a widely used platform. The obtained results show that MDD4ABMS requires less effort to develop simulations with similar (sometimes better) design quality than NetLogo, giving evidence of the benefits that MDD can provide to ABMS.


title: EMU: Efficient Muscle Simulation In Deformation Space

abstract: EMU is an efficient and scalable model to simulate bulk musculoskeletal motion with heterogenous materials. First, EMU requires no model reductions, or geometric coarsening, thereby producing results visually accurate when compared to an FEM simulation. Second, EMU is efficient and scales much better than state-of-the-art FEM with the number of elements in the mesh, and is more easily parallelizable. Third, EMU can handle heterogeneously stiff meshes with an arbitrary constitutive model, thus allowing it to simulate soft muscles, stiff tendons and even stiffer bones all within one unified system. These three key characteristics of EMU enable us to efficiently orchestrate muscle activated skeletal movements. We demonstrate the efficacy of our approach via a number of examples with tendons, muscles, bones and joints.


title: Optimal approximations of available states and a triple uncertainty relation

abstract: We investigate the optimal convex approximation of the quantum state with respect to a set of available states. By isometric transformation, we have presented the general mathematical model and its solutions together with a triple uncertainty equality relation. Meanwhile, we show a concise inequality criterion for decomposing qubit mixed states. The new results include previous ones as special cases. Our model and method may be applied to solve similar problems in high-dimensional and multipartite scenarios


title: Not even the air of empty spaces is coronavirus free (Two meters is not a safe distance)

abstract: A key safety measure encouraged by health authorities to avoid the SARS-CoV-2 spreading is the distance of one to two meters between people. This recommended two-meters distance is mainly based on short-distance contagion, when infected drops are expelled during a speech, coughing, or sneezing and directly hit another person. The dangerous form of airway contamination caused by droplets that remain suspended in the air for several hours has been almost ignored. However, the theoretical calculations performed in this work, recent experiments, and the accumulated knowledge in this and other epidemics indicate that, because of the airborne transmission, there is no safe distance to the coronavirus, either indoors or in open places. Recent investigations have confirmed not only the presence of the coronavirus in droplets suspended in the air but that these viruses remain active for several hours. Furthermore, significant indirect evidence of this means of transmission is the great difference in contagion between Brazilian regions in the current outbreak. While the Amazonian states have a contamination rate greater than 20%, in the southern states of the country this rate is less than 1%, despite high temperatures in the Northern region. Notwithstanding the social and economic differences between these regions, it seems that the extremely high humidity of the forest air prolongs the survival of the viruses in the drops in the external environment. Our theoretical calculations explain empirical observations from recent epidemiological studies and strengthen the need to use, not only a mask but also protective glasses throughout the population in the same way that they are mandatory for health professionals. Besides, our calculations show how air conditioning and heating systems can increase contagion. Finally, we suggest measures that could reduce the spread of the pandemic.


title: Holomorphic curves in the symplectizations of lens spaces: an elementary approach

abstract: We present an elementary computational scheme for the moduli spaces of rational pseudo-holomorphic curves in the symplectizations of 3-dimensional lens spaces, which are equipped with Morse-Bott contact forms induced by the standard Morse-Bott contact form on $S^3$. As an application, we prove that for $p$ prime and $1<q,q'<p-1$, if there is a contactomorphism between lens spaces $L(p,q)$ and $L(p,q')$, where both spaces are equipped with their standard contact structures, then $q\equiv (q')^{\pm 1}$ in$\mod p$. For the proof we study the moduli spaces of pair of pants with two non-contractible ends in detail and establish that the standard almost complex structure that is used is regular. Then the existence of a contactomorphism enables us to follow a neck-stretching process, by means of which we compare the homotopy relations encoded at the non-contractible ends of the pair of pants in the symplectizations of $L(p,q)$ and $L(p,q')$. Combining our proof with the result of Honda on the classification of universally tight contact structures on lens spaces, we provide a purely symplectic/contact topological proof of the diffeomorphism classification of lens spaces in the class mentioned above


title: Cardiac Segmentation with Strong Anatomical Guarantees

abstract: Convolutional neural networks (CNN) have had unprecedented success in medical imaging and, in particular, in medical image segmentation. However, despite the fact that segmentation results are closer than ever to the inter-expert variability, CNNs are not immune to producing anatomically inaccurate segmentations, even when built upon a shape prior. In this paper, we present a framework for producing cardiac image segmentation maps that are guaranteed to respect pre-defined anatomical criteria, while remaining within the inter-expert variability. The idea behind our method is to use a well-trained CNN, have it process cardiac images, identify the anatomically implausible results and warp these results toward the closest anatomically valid cardiac shape. This warping procedure is carried out with a constrained variational autoencoder (cVAE) trained to learn a representation of valid cardiac shapes through a smooth, yet constrained, latent space. With this cVAE, we can project any implausible shape into the cardiac latent space and steer it toward the closest correct shape. We tested our framework on short-axis MRI as well as apical two and four-chamber view ultrasound images, two modalities for which cardiac shapes are drastically different. With our method, CNNs can now produce results that are both within the inter-expert variability and always anatomically plausible without having to rely on a shape prior.


title: Using Mobility for Electrical Load Forecasting During the COVID-19 Pandemic

abstract: The novel coronavirus (COVID-19) pandemic has posed unprecedented challenges for the utilities and grid operators around the world. In this work, we focus on the problem of load forecasting. With strict social distancing restrictions, power consumption profiles around the world have shifted both in magnitude and daily patterns. These changes have caused significant difficulties in short-term load forecasting. Typically algorithms use weather, timing information and previous consumption levels as input variables, yet they cannot capture large and sudden changes in socioeconomic behavior during the pandemic. In this paper, we introduce mobility as a measure of economic activities to complement existing building blocks of forecasting algorithms. Mobility data acts as good proxies for the population-level behaviors during the implementation and subsequent easing of social distancing measures. The major challenge with such dataset is that only limited mobility records are associated with the recent pandemic. To overcome this small data problem, we design a transfer learning scheme that enables knowledge transfer between several different geographical regions. This architecture leverages the diversity across these regions and the resulting aggregated model can boost the algorithm performance in each region's day-ahead forecast. Through simulations for regions in the US and Europe, we show our proposed algorithm can outperform conventional forecasting methods by more than three-folds. In addition, we demonstrate how the proposed model can be used to project how electricity consumption would recover based on different mobility scenarios.


title: Lunar close encounters compete with the circumterrestrial Lidov-Kozai effect

abstract: Luna 3 (or Lunik 3 in Russian sources) was the first spacecraft to perform a flyby of the Moon. Launched in October 1959 on a translunar trajectory with large semi-major axis and eccentricity, it collided with the Earth in late March 1960. The short, 6-month dynamical lifetime has often been explained through an increase in eccentricity due to the Lidov-Kozai effect. However, the classical Lidov-Kozai solution is only valid in the limit of small semi-major axis ratio, a condition that is satisfied only for solar (but not for lunar) perturbations. We undertook a study of the dynamics of Luna 3 with the aim of assessing the principal mechanisms affecting its evolution. We analyze the Luna 3 trajectory by generating accurate osculating solutions, and by comparing them to integrations of singly- and doubly-averaged equations of motion in vectorial form. Lunar close encounters, which cannot be reproduced in an averaging approach, decisively affect the trajectory and break the doubly-averaged dynamics. Solar perturbations induce oscillations of intermediate period that affect the geometry of the close encounters and cause the singly-averaged and osculating inclinations to change quadrants (the orbital plane ``flips''). We find that the peculiar evolution of Luna 3 can only be explained by taking into account lunar close encounters and intermediate-period terms; such terms are averaged out in the Lidov-Kozai solution, which is not adequate to describe translunar or cislunar trajectories. Understanding the limits of the Lidov-Kozai solution is of particular significance for the motion of objects in the Earth-Moon environment and of exoplanetary systems.


title: Explainable AI for a No-Teardown Vehicle Component Cost Estimation: A Top-Down Approach

abstract: The broader ambition of this article is to popularize an approach for the fair distribution of the quantity of a system's output to its subsystems, while allowing for underlying complex subsystem level interactions. Particularly, we present a data-driven approach to vehicle price modeling and its component price estimation by leveraging a combination of concepts from machine learning and game theory. We show an alternative to common teardown methodologies and surveying approaches for component and vehicle price estimation at the manufacturer's suggested retail price (MSRP) level that has the advantage of bypassing the uncertainties involved in 1) the gathering of teardown data, 2) the need to perform expensive and biased surveying, and 3) the need to perform retail price equivalent (RPE) or indirect cost multiplier (ICM) adjustments to mark up direct manufacturing costs to MSRP. This novel exercise not only provides accurate pricing of the technologies at the customer level, but also shows the, a priori known, large gaps in pricing strategies between manufacturers, vehicle sizes, classes, market segments, and other factors. There is also clear synergism or interaction between the price of certain technologies and other specifications present in the same vehicle. Those (unsurprising) results are indication that old methods of manufacturer-level component costing, aggregation, and the application of a flat and rigid RPE or ICM adjustment factor should be carefully examined. The findings are based on an extensive database, developed by Argonne National Laboratory, that includes more than 64,000 vehicles covering MY1990 to MY2020 over hundreds of vehicle specs.


title: Multiagent Reinforcement Learning based Energy Beamforming Control

abstract: Ultra low power devices make far-field wireless power transfer a viable option for energy delivery despite the exponential attenuation. Electromagnetic beams are constructed from the stations such that wireless energy is directionally concentrated around the ultra low power devices. Energy beamforming faces different challenges compare to information beamforming due to the lack of feedback on channel state. Various methods have been proposed such as one-bit channel feedback to enhance energy beamforming capacity, yet it still has considerable computation overhead and need to be computed centrally. Valuable resources and time is wasted on transfering control information back and forth. In this paper, we propose a novel multiagent reinforcement learning(MARL) formulation for codebook based beamforming control. It takes advantage of the inherienntly distributed structure in a wirelessly powered network and lay the ground work for fully locally computed beam control algorithms. Source code can be found at https://github.com/BaiLiping/WirelessPowerTransfer.


title: Examining the Global Spread of COVID-19 Misinformation

abstract: The global COVID-19 pandemic has led to the online proliferation of health-, political-, and conspiratorial-based misinformation. Understanding the reach and belief in this misinformation is vital to managing this crisis, as well as future crises. The results from our global survey finds a troubling reach of and belief in COVID-related misinformation, as well as a correlation with those that primarily consume news from social media, and, in the United States, a strong correlation with political leaning.


title: Physics-aware Spatiotemporal Modules with Auxiliary Tasks for Meta-Learning

abstract: Modeling the dynamics of real-world physical systems is critical for spatiotemporal prediction tasks, but challenging when data is limited. The scarcity of real-world data and the difficulty in reproducing the data distribution hinder directly applying meta-learning techniques. Although the knowledge of governing partial differential equations (PDE) of data can be helpful for the fast adaptation to few observations, it is mostly infeasible to exactly find the equation for observations in real-world physical systems. In this work, we propose a framework, physics-aware meta-learning with auxiliary tasks, whose spatial modules incorporate PDE-independent knowledge and temporal modules utilize the generalized features from the spatial modules to be adapted to the limited data, respectively. The framework is inspired by a local conservation law expressed mathematically as a continuity equation and does not require the exact form of governing equation to model the spatiotemporal observations. The proposed method mitigates the need for a large number of real-world tasks for meta-learning by leveraging spatial information in simulated data to meta-initialize the spatial modules. We apply the proposed framework to both synthetic and real-world spatiotemporal prediction tasks and demonstrate its superior performance with limited observations.


title: A Taxonomy and Review of Algorithms for Modeling and Predicting Human Driver Behavior

abstract: We present a review and taxonomy of 200 models from the literature on driver behavior modeling. We begin by introducing a mathematical framework for describing the dynamics of interactive multi-agent traffic. Based on the partially observable stochastic game, this framework provides a basis for discussing different driver modeling techniques. Our taxonomy is constructed around the core modeling tasks of state estimation, intention estimation, trait estimation, and motion prediction, and also discusses the auxiliary tasks of risk estimation, anomaly detection, behavior imitation and microscopic traffic simulation. Existing driver models are categorized based on the specific tasks they address and key attributes of their approach.


title: Cascaded Stokes and anti-Stokes laser based on an optical resonator with a self-assembled organic monolayer

abstract: Due to their high circulating intensities, ultra-high quality factor dielectric whispering-gallery mode resonators have enabled the development of low threshold Raman microlasers. Subsequently, other Raman-related phenomena, such as cascaded stimulated Raman scattering (CSRS) and stimulated anti-Stokes Raman scattering (SARS), were observed. While low threshold frequency conversion and generation have clear applications, CSRS and SARS have been limited by the low Raman gain. In this work, the surface of a silica resonator is modified with an organic monolayer, increasing the Raman gain. Up to four orders of CSRS is observed with sub-mW input power, and the SARS efficiency is improved by three orders of magnitude compared to previous studies with hybrid resonators.


title: The Final Fate of Supermassive $M \sim 5 \times 10^4 \; M_\odot$ Pop III Stars: Explosion or Collapse?

abstract: We investigate the possibility of a supernova in supermassive ($5 \times 10^4 \;M_\odot$) population III stars induced by a general relativistic instability occurring in the helium burning phase. This explosion could occur via rapid helium burning during an early contraction of the isentropic core. Such an explosion would be visible to future telescopes and could disrupt the proposed direct collapse formation channel for early universe supermassive black holes. We simulate first the stellar evolution from hydrogen burning using a 1D stellar evolution code with a post Newtonian approximation; at the point of dynamical collapse, we switch to a 1D (general relativistic) hydrodynamics code with the Misner-Sharpe metric. In opposition to a previous study, we do not find an explosion in the non rotating case, although our model is close to exploding for a similar mass to the explosion in the previous study. When we include slow rotation, we find one exploding model, and we conclude that there likely exist additional exploding models, though they may be rare.


title: On the Alignment of Galaxies in Clusters

abstract: We explore the distribution of position angles (PA) of galaxies in clusters. We selected for study the isolated clusters, since the distribution of the galaxy orientation in clusters with close neighbors could be altered by gravitational influence of the latter. We assume that galaxies are aligned, if their number at one $90^o$ position angle interval is more than twice higher than at the other $90^o$ interval. We study the galaxy PA distribution at the outer regions of clusters with smaller space density, where the probability of the PA variation in the result of interactions between galaxies is smaller than at the dense central regions. We found that the alignment of galaxies is more often observed in poor clusters and concluded that originally galaxies were aligned, but in the result of accretion in time of field galaxies with arbitrary orientations and also due to the mutual interactions the relative number of aligned galaxies decreases.


title: Extension complexity of low-dimensional polytopes

abstract: Sometimes, it is possible to represent a complicated polytope as a projection of a much simpler polytope. To quantify this phenomenon, the extension complexity of a polytope $P$ is defined to be the minimum number of facets of a (possibly higher-dimensional) polytope from which $P$ can be obtained as a (linear) projection. This notion is motivated by its relevance to combinatorial optimisation, and has been studied intensively for various specific polytopes associated with important optimisation problems. In this paper we study extension complexity as a parameter of general polytopes, more specifically considering various families of low-dimensional polytopes. First, we prove that for a fixed dimension $d$, the extension complexity of a random $d$-dimensional polytope (obtained as the convex hull of random points in a ball or on a sphere) is typically on the order of the square root of its number of vertices. Second, we prove that any cyclic $n$-vertex polygon (whose vertices lie on a circle) has extension complexity at most $24\sqrt n$. This bound is tight up to the constant factor $24$. Finally, we show that there exists an $n^{o(1)}$-dimensional polytope with at most $n$ vertices and extension complexity $n^{1-o(1)}$. Our theorems are proved with a range of different techniques, which we hope will be of further interest.


title: Stratifications on the Nilpotent Cone of the moduli space of Hitchin pairs

abstract: We consider the problem of finding the limit at infinity (corresponding to the downward Morse flow) of a Higgs bundle in the nilpotent cone under the natural $\mathbb{C}^*$-action on the moduli space. For general rank we provide an answer for Higgs bundles with regular nilpotent Higgs field, while in rank three we give the complete answer. Our results show that the limit can be described in terms of data defined by the Higgs field, via a filtration of the underlying vector bundle.


title: Basic loci of Coxeter type with arbitrary parahoric level

abstract: Motivated by the desire to understand the geometry of the basic loci in the reduction of Shimura varieties, we study their "group-theoretic models" -- generalized affine Deligne-Lusztig varieties -- in cases where they have a particularly nice description. Continuing the work of [GH] and [GHN] we single out the class of cases of Coxeter type, give a characterization in terms of the dimension, and obtain a complete classification. We also discuss known, new and open cases from the point of view of Shimura varieties/Rapoport-Zink spaces.


title: Hash Cracking Benchmarking of Replacement Patterns

abstract: In this paper, we explain our methodology to identify replacement patterns. The main purpose of this article is to show that with replacement methods on plain texts, it is possible to have more success rates when trying to recovering hashed passwords.


title: Rigidity of a thin domain depends on the curvature, width, and boundary conditions

abstract: This paper is concerned with the study of linear geometric rigidity of shallow thin domains under zero Dirichlet boundary conditions on the displacement field on the thin edge of the domain. A shallow thin domain is a thin domain that has in-plane dimensions of order $O(1)$ and $\epsilon,$ where $\epsilon\in (h,1)$ is a parameter (here $h$ is the thickness of the shell). The problem has been solved in [8,10] for the case $\epsilon=1,$ with the outcome of the optimal constant $C\sim h^{-3/2},$ $C\sim h^{-4/3},$ and $C\sim h^{-1}$ for parabolic, hyperbolic and elliptic thin domains respectively. We prove in the present work that in fact there are two distinctive scaling regimes $\epsilon\in (h,\sqrt h]$ and $\epsilon\in (\sqrt h,1),$ such that in each of which the thin domain rigidity is given by a certain formula in $h$ and $\epsilon.$ An interesting new phenomenon is that in the first (small parameter) regime $\epsilon\in (h,\sqrt h]$, the rigidity does not depend on the curvature of the thin domain mid-surface.


title: ECG Language Processing (ELP): a New Technique to Analyze ECG Signals

abstract: A language is constructed of a finite/infinite set of sentences composing of words. Similar to natural languages, Electrocardiogram (ECG) signal, the most common noninvasive tool to study the functionality of the heart and diagnose several abnormal arrhythmias, is made up of sequences of three or four distinct waves including the P-wave, QRS complex, T-wave and U-wave. An ECG signal may contain several different varieties of each wave (e.g., the QRS complex can have various appearances). For this reason, the ECG signal is a sequence of heartbeats similar to sentences in natural languages) and each heartbeat is composed of a set of waves (similar to words in a sentence) of different morphologies. Analogous to natural language processing (NLP) which is used to help computers understand and interpret the human's natural language, it is possible to develop methods inspired by NLP to aid computers to gain a deeper understanding of Electrocardiogram signals. In this work, our goal is to propose a novel ECG analysis technique, \textit{ECG language processing (ELP)}, focusing on empowering computers to understand ECG signals in a way physicians do. We evaluated the proposed method on two tasks including the classification of heartbeats and the detection of atrial fibrillation in the ECG signals. Experimental results on three databases (i.e., PhysionNet's MIT-BIH, MIT-BIH AFIB and PhysioNet Challenge 2017 AFIB Dataset databases) reveal that the proposed method is a general idea that can be applied to a variety of biomedical applications and is able to achieve remarkable performance.


title: Index Selection for NoSQL Database with Deep Reinforcement Learning

abstract: We propose a new approach of NoSQL database index selection. For different workloads, we select different indexes and their different parameters to optimize the database performance. The approach builds a deep reinforcement learning model to select an optimal index for a given fixed workload and adapts to a changing workload. Experimental results show that, Deep Reinforcement Learning Index Selection Approach (DRLISA) has improved performance to varying degrees according to traditional single index structures.


title: On the Mathematical Theory of Ensemble (Linear-Gaussian) Kalman-Bucy Filtering

abstract: The purpose of this review is to present a comprehensive overview of the theory of ensemble Kalman-Bucy filtering for continuous-time, linear-Gaussian signal and observation models. We present a system of equations that describe the flow of individual particles and the flow of the sample covariance and the sample mean in continuous-time ensemble filtering. We consider these equations and their characteristics in a number of popular ensemble Kalman filtering variants. Given these equations, we study their asymptotic convergence to the optimal Bayesian filter. We also study in detail some non-asymptotic time-uniform fluctuation, stability, and contraction results on the sample covariance and sample mean (or sample error track). We focus on testable signal/observation model conditions, and we accommodate fully unstable (latent) signal models. We discuss the relevance and importance of these results in characterising the filter's behaviour, e.g. it's signal tracking performance, and we contrast these results with those in classical studies of stability in Kalman-Bucy filtering.We also provide a novel (and negative) result proving that the bootstrap particle filter cannot track even the most basic unstable latent signal, in contrast with the ensemble Kalman filter (and the optimal filter). We provide intuition for how the main results extend to nonlinear signal models and comment on their consequence on some typical filter behaviours seen in practice, e.g. catastrophic divergence.


title: Dual-Resolution Correspondence Networks

abstract: We tackle the problem of establishing dense pixel-wise correspondences between a pair of images. In this work, we introduce Dual-Resolution Correspondence Networks (DualRC-Net), to obtain pixel-wise correspondences in a coarse-to-fine manner. DualRC-Net extracts both coarse- and fine- resolution feature maps. The coarse maps are used to produce a full but coarse 4D correlation tensor, which is then refined by a learnable neighbourhood consensus module. The fine-resolution feature maps are used to obtain the final dense correspondences guided by the refined coarse 4D correlation tensor. The selected coarse-resolution matching scores allow the fine-resolution features to focus only on a limited number of possible matches with high confidence. In this way, DualRC-Net dramatically increases matching reliability and localisation accuracy, while avoiding to apply the expensive 4D convolution kernels on fine-resolution feature maps. We comprehensively evaluate our method on large-scale public benchmarks including HPatches, InLoc, and Aachen Day-Night. It achieves the state-of-the-art results on all of them.


title: Optimal Sequential Task Assignment and Path Finding for Multi-Agent Robotic Assembly Planning

abstract: We study the problem of sequential task assignment and collision-free routing for large teams of robots in applications with inter-task precedence constraints (e.g., task $A$ and task $B$ must both be completed before task $C$ may begin). Such problems commonly occur in assembly planning for robotic manufacturing applications, in which sub-assemblies must be completed before they can be combined to form the final product. We propose a hierarchical algorithm for computing makespan-optimal solutions to the problem. The algorithm is evaluated on a set of randomly generated problem instances where robots must transport objects between stations in a "factory "grid world environment. In addition, we demonstrate in high-fidelity simulation that the output of our algorithm can be used to generate collision-free trajectories for non-holonomic differential-drive robots.


title: Mining Personalized Climate Preferences for Assistant Driving

abstract: Both assistant driving and self-driving have attracted a great amount of attention in the last few years. However, the majority of research efforts focus on safe driving; few research has been conducted on in-vehicle climate control, or assistant driving based on travellers' personal habits or preferences. In this paper, we propose a novel approach for climate control, driver behavior recognition and driving recommendation for better fitting drivers' preferences in their daily driving. The algorithm consists three components: (1) A in-vehicle sensing and context feature enriching compnent with a Internet of Things (IoT) platform for collecting related environment, vehicle-running, and traffic parameters that affect drivers' behaviors. (2) A non-intrusive intelligent driver behaviour and vehicle status detection component, which can automatically label vehicle's status (open windows, turn on air condition, etc.), based on results of applying further feature extraction and machine learning algorithms. (3) A personalized driver habits learning and preference recommendation component for more healthy and comfortable experiences. A prototype using a client-server architecture with an iOS app and an air-quality monitoring sensor has been developed for collecting heterogeneous data and testing our algorithms. Real-world experiments on driving data of 11,370 km (320 hours) by different drivers in multiple cities worldwide have been conducted, which demonstrate the effective and accuracy of our approach.


title: Dislocation Density-Based Plasticity Model from Massive Discrete Dislocation Dynamics Database

abstract: We present a dislocation density-based strain hardening model for single crystal copper through a systematic coarse-graining analysis of more than 200 discrete dislocation dynamics (DDD) simulations of plastic deformation under uniaxial tension. The proposed constitutive model has two components: a generalized Taylor relation connecting resolved shear stresses to dislocation densities on individual slip systems, and a generalized Kocks-Mecking model for dislocation multiplication. The DDD data strongly suggests a logarithmic dependence of flow stress on the plastic shear strain rate on each slip system, and, equivalently, an exponential dependence of the plastic shear strain rate on the resolved shear stress. Hence the proposed generalized Taylor relation subsumes the Orowan relation for plastic flow. The DDD data also calls for a correction to the Kocks-Mecking model of dislocation multiplication to account for the increase of dislocation density on slip systems with negligible plastic shear strain rate. This is accomplished by allowing the multiplication rate on each slip system to include contributions from the plastic strain rates of the two coplanar slip systems. The resulting constitutive model successfully captures the strain hardening rate dependence on the loading orientation as predicted by the DDD simulations, which is also consistent with existing experiments.


title: Personalized Federated Learning with Moreau Envelopes

abstract: Federated learning (FL) is a decentralized and privacy-preserving machine learning technique in which a group of clients collaborate with a server to learn a global model without sharing clients' data. One challenge associated with FL is statistical diversity among clients, which restricts the global model from delivering good performance on each client's task. To address this, we propose an algorithm for personalized FL (pFedMe) using Moreau envelopes as clients' regularized loss functions, which help decouple personalized model optimization from the global model learning in a bi-level problem stylized for personalized FL. Theoretically, we show that pFedMe's convergence rate is state-of-the-art: achieving quadratic speedup for strongly convex and sublinear speedup of order 2/3 for smooth nonconvex objectives. Experimentally, we verify that pFedMe excels at empirical performance compared with the vanilla FedAvg and Per-FedAvg, a meta-learning based personalized FL algorithm.


title: Preserving Dynamic Attention for Long-Term Spatial-Temporal Prediction

abstract: Effective long-term predictions have been increasingly demanded in urban-wise data mining systems. Many practical applications, such as accident prevention and resource pre-allocation, require an extended period for preparation. However, challenges come as long-term prediction is highly error-sensitive, which becomes more critical when predicting urban-wise phenomena with complicated and dynamic spatial-temporal correlation. Specifically, since the amount of valuable correlation is limited, enormous irrelevant features introduce noises that trigger increased prediction errors. Besides, after each time step, the errors can traverse through the correlations and reach the spatial-temporal positions in every future prediction, leading to significant error propagation. To address these issues, we propose a Dynamic Switch-Attention Network (DSAN) with a novel Multi-Space Attention (MSA) mechanism that measures the correlations between inputs and outputs explicitly. To filter out irrelevant noises and alleviate the error propagation, DSAN dynamically extracts valuable information by applying self-attention over the noisy input and bridges each output directly to the purified inputs via implementing a switch-attention mechanism. Through extensive experiments on two spatial-temporal prediction tasks, we demonstrate the superior advantage of DSAN in both short-term and long-term predictions.


title: Finding All {\epsilon}-Good Arms in Stochastic Bandits

abstract: The pure-exploration problem in stochastic multi-armed bandits aims to find one or more arms with the largest (or near largest) means. Examples include finding an {\epsilon}-good arm, best-arm identification, top-k arm identification, and finding all arms with means above a specified threshold. However, the problem of finding all {\epsilon}-good arms has been overlooked in past work, although arguably this may be the most natural objective in many applications. For example, a virologist may conduct preliminary laboratory experiments on a large candidate set of treatments and move all {\epsilon}-good treatments into more expensive clinical trials. Since the ultimate clinical efficacy is uncertain, it is important to identify all {\epsilon}-good candidates. Mathematically, the all-{\epsilon}-good arm identification problem presents significant new challenges and surprises that do not arise in the pure-exploration objectives studied in the past. We introduce two algorithms to overcome these and demonstrate their great empirical performance on a large-scale crowd-sourced dataset of 2.2M ratings collected by the New Yorker Caption Contest as well as a dataset testing hundreds of possible cancer drugs.


title: Extended slow-light field enhancement in positive/negative-index heterostructures

abstract: We present a bi-waveguide paradigm composed of joined Positive-Index-Material PIM)/Negative-Index-Material (NIM) slabs, demonstrating ultra-slow light propagation stemming from the competing propagation disposition in the PIM and NIM regions. We report for the first time a mesoscopic extended electromagnetic (EM) enhancement covering regions of the order of the free space wavelength, enabled by the slow-light mode in our system. Our dynamic numerical results are consistent with our developed theoretical model, predicting an EM energy accumulation reminiscent of a charging capacitor. Our analysis reveals that spatial compression is not a requirement to EM enhancement in slow-light systems and stresses on the merits of high coupling efficiency, strong temporal compression, monomodality and modal index bandwidth, -all present in our proposed paradigm. Furthermore, we show that the heterostructure waveguide mode is an extra-ordinary entity with a unique energy velocity, that is opposite to the Poynting vector in one of the participant waveguides. We believe these results will inspire new slow-light platforms relevant to the collective harvesting of strong light-matter interactions.


title: Counterexample-Guided Learning of Monotonic Neural Networks

abstract: The widespread adoption of deep learning is often attributed to its automatic feature construction with minimal inductive bias. However, in many real-world tasks, the learned function is intended to satisfy domain-specific constraints. We focus on monotonicity constraints, which are common and require that the function's output increases with increasing values of specific input features. We develop a counterexample-guided technique to provably enforce monotonicity constraints at prediction time. Additionally, we propose a technique to use monotonicity as an inductive bias for deep learning. It works by iteratively incorporating monotonicity counterexamples in the learning process. Contrary to prior work in monotonic learning, we target general ReLU neural networks and do not further restrict the hypothesis space. We have implemented these techniques in a tool called COMET. Experiments on real-world datasets demonstrate that our approach achieves state-of-the-art results compared to existing monotonic learners, and can improve the model quality compared to those that were trained without taking monotonicity constraints into account.


title: Tighter constraints of multiqubit entanglement in terms of R\'{e}nyi-$\alpha$ entropy

abstract: Quantum entanglement plays essential roles in quantum information processing. The monogamy and polygamy relations characterize the entanglement distributions in the multipartite systems. We present a class of monogamy inequalities related to the $\mu$th power of the entanglement measure based on R\'{e}nyi-$\alpha$ entropy, as well as polygamy relations in terms of the $\mu$th powered of R\'{e}nyi-$\alpha$ entanglement of assistance. These monogamy and polygamy relations are shown to be tighter than the existing ones.


title: Grading Adjoint Logic

abstract: We introduce a new logic that combines Adjoint Logic with Graded Necessity Modalities. This results in a very expressive system capable of controlling when and how structural rules are used. We give a sequent calculus, natural deduction, and term assignment for Graded Adjoint Logic.


title: RaSE: Random Subspace Ensemble Classification

abstract: We propose a flexible ensemble classification framework, Random Subspace Ensemble (RaSE), for sparse classification. In the RaSE algorithm, we aggregate many weak learners, where each weak learner is a base classifier trained in a subspace optimally selected from a collection of random subspaces. To conduct subspace selection, we propose a new criterion, ratio information criterion (RIC), based on weighted Kullback-Leibler divergence. The theoretical analysis includes the risk and Monte-Carlo variance of the RaSE classifier, establishing the screening consistency and weak consistency of RIC, and providing an upper bound for the misclassification rate of the RaSE classifier. In addition, we show that in a high-dimensional framework, the number of random subspaces needs to be very large to guarantee that a subspace covering signals is selected. Therefore, we propose an iterative version of the RaSE algorithm and prove that under some specific conditions, a smaller number of generated random subspaces are needed to find a desirable subspace through iteration. An array of simulations under various models and real-data applications demonstrate the effectiveness and robustness of the RaSE classifier and its iterative version in terms of low misclassification rate and accurate feature ranking. The RaSE algorithm is implemented in the R package RaSEn on CRAN.

categories: stat.ML cs.LG math.ST stat.CO stat.ME stat.TH


title: Interacting particles systems with delay and random delay differential equations

abstract: In this work we study a kinetic model of active particles with delayed dynamics, and its limit when the number of particles goes to infinity. This limit turns out to be related to delayed differential equations with random initial conditions. We analyze two different dynamics, one based on the full knowledge of the individual trajectories of each particle, and another one based only on the trace of the particle cloud, loosing track of the individual trajectories. Notice that in the first dynamic the state of a particles is its path, whereas it is simply a point in $\R^d$ in the second case. We analyse in both cases the corresponding mean-field dynamic obtaining an equation for the time evolution of the distribution of the particles states. Well-posedness of the equation is proved by a fixed-point argument. We conclude the paper with some possible future research directions and modelling applications.


title: Robust Recovery via Implicit Bias of Discrepant Learning Rates for Double Over-parameterization

abstract: Recent advances have shown that implicit bias of gradient descent on over-parameterized models enables the recovery of low-rank matrices from linear measurements, even with no prior knowledge on the intrinsic rank. In contrast, for robust low-rank matrix recovery from grossly corrupted measurements, over-parameterization leads to overfitting without prior knowledge on both the intrinsic rank and sparsity of corruption. This paper shows that with a double over-parameterization for both the low-rank matrix and sparse corruption, gradient descent with discrepant learning rates provably recovers the underlying matrix even without prior knowledge on neither rank of the matrix nor sparsity of the corruption. We further extend our approach for the robust recovery of natural images by over-parameterizing images with deep convolutional networks. Experiments show that our method handles different test images and varying corruption levels with a single learning pipeline where the network width and termination conditions do not need to be adjusted on a case-by-case basis. Underlying the success is again the implicit bias with discrepant learning rates on different over-parameterized parameters, which may bear on broader applications.


title: Generative Semantic Hashing Enhanced via Boltzmann Machines

abstract: Generative semantic hashing is a promising technique for large-scale information retrieval thanks to its fast retrieval speed and small memory footprint. For the tractability of training, existing generative-hashing methods mostly assume a factorized form for the posterior distribution, enforcing independence among the bits of hash codes. From the perspectives of both model representation and code space size, independence is always not the best assumption. In this paper, to introduce correlations among the bits of hash codes, we propose to employ the distribution of Boltzmann machine as the variational posterior. To address the intractability issue of training, we first develop an approximate method to reparameterize the distribution of a Boltzmann machine by augmenting it as a hierarchical concatenation of a Gaussian-like distribution and a Bernoulli distribution. Based on that, an asymptotically-exact lower bound is further derived for the evidence lower bound (ELBO). With these novel techniques, the entire model can be optimized efficiently. Extensive experimental results demonstrate that by effectively modeling correlations among different bits within a hash code, our model can achieve significant performance gains.


title: Minimum Width for Universal Approximation

abstract: The universal approximation property of width-bounded networks has been studied as a dual of classical universal approximation results on depth-bounded networks. However, the critical width enabling the universal approximation has not been exactly characterized in terms of the input dimension $d_x$ and the output dimension $d_y$. In this work, we provide the first definitive result in this direction for networks using the ReLU activation functions: The minimum width required for the universal approximation of the $L^p$ functions is exactly $\max\{d_x+1,d_y\}$. We also prove that the same conclusion does not hold for the uniform approximation with ReLU, but does hold with an additional threshold activation function. Our proof technique can be also used to derive a tighter upper bound on the minimum width required for the universal approximation using networks with general activation functions.


title: Note on Quantum Periods and a TBA-like System

abstract: There is an interesting relation between the quantum periods on a certain limit of local $\mathbb{P}^1\times \mathbb{P}^1$ Calabi-Yau space and a TBA (Thermodynamic Bethe Ansatz) system appeared in the studies of ABJM (Aharony-Bergman-Jafferis-Maldacena) theory. We propose a one-parameter generalization of the relation. Furthermore, we derive the differential operators for quantum periods and the TBA-like equation in various limits of the generalized relation.


title: GPU-accelerated Hierarchical Panoramic Image Feature Retrieval for Indoor Localization

abstract: Indoor localization has many applications, such as commercial Location Based Services (LBS), robotic navigation, and assistive navigation for the blind. This paper formulates the indoor localization problem into a multimedia retrieving problem by modeling visual landmarks with a panoramic image feature, and calculating a user's location via GPU- accelerated parallel retrieving algorithm. To solve the scene similarity problem, we apply a multi-images based retrieval strategy and a 2D aggregation method to estimate the final retrieval location. Experiments on a campus building real data demonstrate real-time responses (14fps) and robust localization.


title: Can the Kappa-distributed electron energies account for the intensity ratios of O II lines in photoionized gaseous nebulae?

abstract: A vexing puzzle in the study of planetary nebulae and \ion{H}{2} regions is that the plasma diagnostic results based on collisionally excited lines systematically differ from those based on recombination lines. A fairly speculative interpretation is the presence of nonthermal electrons with the so-called $\kappa$ energy distributions, yet there is little observational evidence to verify or disprove this hypothesis. In this paper, we examine the influence of $\kappa$-distributed electrons on the emissivities of \ion{O}{2} recombination lines using an approximate method, where the rate coefficients for a $\kappa$ distribution are computed by summing Maxwellian-Boltzmann rate coefficients with appropriate weights. The results show that if invoking $\kappa$-distributed electrons, the temperatures derived from the [\ion{O}{3}] $(\lambda4959+\lambda5007)/\lambda4363$ ratios could coincide with those estimated from the \ion{O}{2} $\lambda4649/\lambda4089$ ratios. However, the estimated temperatures and $\kappa$ values are not in agreement with those obtained through comparing the [\ion{O}{3}] $(\lambda4959+\lambda5007)/\lambda4363$ ratios and the hydrogen recombination spectra, suggesting that the electron energy is unlikely to follow the $\kappa$-distributions over a global scale of the nebular regions. Nevertheless, based on this observation alone, we cannot definitely rule out the presence of $\kappa$-distributed electrons in some microstructures within nebulae.


title: Matching Queues, Flexibility and Incentives

abstract: Problem definition: Agents in online marketplaces (such as ridesharing and freelancing platforms) are often strategic, and heterogeneous in their compatibility with different types of jobs: fully flexible agents can fulfill any job, whereas specialized agents can only complete specific subsets of jobs. Convention wisdom suggests reserving agents that are more flexible whenever possible, however this may incentivize agents to pretend to be more specialized, leading to loss in matches. We focus on designing a practical matching policy that performs well in a strategic environment. Methodology/results: We model the allocation of jobs to agents as a matching queue, and analyze the equilibrium performance of various matching policies when agents are strategic and report their own types. We show that reserving flexibility naively can backfire, to the extent that the equilibrium throughput can be arbitrarily bad compared to a policy which simply dispatches jobs to agents at random. To balance matching efficiency with agents' strategic considerations, we propose a new policy dubbed flexibility reservation with fallback and show that it enjoys robust performance. Managerial implications: Our work highlights the importance of considering agent strategic behavior when designing matching policies in online platforms and service systems. The robust performance guarantee, along with the parameter-free nature of our proposed policy makes it easy to implement in practice. We illustrate how this policy is implemented in the driver destination product of major ridesharing platforms.


title: A Goodness-of-Fit Test for Statistical Models

abstract: Statistical modeling plays a fundamental role in understanding the underlying mechanism of massive data (statistical inference) and predicting the future (statistical prediction). Although all models are wrong, researchers try their best to make some of them be useful. The question here is how can we measure the usefulness of a statistical model for the data in hand? This is key to statistical prediction. The important statistical problem of testing whether the observations follow the proposed statistical model has only attracted relatively few attentions. In this paper, we proposed a new framework for this problem through building its connection with two-sample distribution comparison. The proposed method can be applied to evaluate a wide range of models. Examples are given to show the performance of the proposed method.


title: Antiferromagnetic long-range order in $5d^1$ double-perovskite Sr$_2$MgReO$_6$

abstract: The double-perovskite A$_2$BB'O$_6$ with heavy transition metal ions on the ordered B' sites is an important family of compounds to study the interplay between electron correlation and spin-orbit coupling (SOC). Here we prepared high-quality Sr$_2$MgReO$_6$ powder and single-crystal samples and performed non-resonant and resonant synchrotron x-ray diffraction experiments to investigate its magnetic ground state. By combining the magnetic susceptibility and heat capacity measurements, we conclude that Sr$_2$MgReO$_6$ exhibits a layered antiferromagnetic (AF) order at temperatures below $\sim$ 55 K with a propagation vector q = (001), which contrasts the previously suspected spin glass state. Our works clarify the magnetic order in Sr$_2$MgReO$_6$ and demonstrate it as a candidate system to look for magnetic octupolar orders and exotic spin dynamics.


title: Probabilistic Optimal Transport based on Collective Graphical Models

abstract: Optimal Transport (OT) is being widely used in various fields such as machine learning and computer vision, as it is a powerful tool for measuring the similarity between probability distributions and histograms. In previous studies, OT has been defined as the minimum cost to transport probability mass from one probability distribution to another. In this study, we propose a new framework in which OT is considered as a maximum a posteriori (MAP) solution of a probabilistic generative model. With the proposed framework, we show that OT with entropic regularization is equivalent to maximizing a posterior probability of a probabilistic model called Collective Graphical Model (CGM), which describes aggregated statistics of multiple samples generated from a graphical model. Interpreting OT as a MAP solution of a CGM has the following two advantages: (i) We can calculate the discrepancy between noisy histograms by modeling noise distributions. Since various distributions can be used for noise modeling, it is possible to select the noise distribution flexibly to suit the situation. (ii) We can construct a new method for interpolation between histograms, which is an important application of OT. The proposed method allows for intuitive modeling based on the probabilistic interpretations, and a simple and efficient estimation algorithm is available. Experiments using synthetic and real-world spatio-temporal population datasets show the effectiveness of the proposed interpolation method.


title: Optimisation of non-pharmaceutical measures in COVID-19 growth via neural networks

abstract: On 19th March, the World Health Organisation declared a pandemic. Through this global spread, many nations have witnessed exponential growth of confirmed cases brought under control by severe mass quarantine or lockdown measures. However, some have, through a different timeline of actions, prevented this exponential growth. Currently as some continue to tackle growth, others attempt to safely lift restrictions whilst avoiding a resurgence. This study seeks to quantify the impact of government actions in mitigating viral transmission of SARS-CoV-2 by a novel soft computing approach that makes concurrent use of a neural network model, to predict the daily slope increase of cumulative infected, and an optimiser, with a parametrisation of the government restriction time series, to understanding the best set of mitigating actions. Data for two territories, Italy and Taiwan, have been gathered to model government restrictions in traveling, testing and enforcement of social distance measures as well as people connectivity and adherence to government actions. It is found that a larger and earlier testing campaign with tighter entry restrictions benefit both regions, resulting in significantly less confirmed cases. Interestingly, this scenario couples with an earlier but milder implementation of nationwide restrictions for Italy, thus supporting Taiwan's lack of nationwide lockdown. The results, found with a purely data-driven approach, are in line with the main findings of mathematical epidemiological models, proving that the proposed approach has value and that the data alone contains valuable knowledge to inform decision makers.


title: Anisotropic band flattening in graphene with 1D superlattices

abstract: Patterning graphene with a spatially-periodic potential provides a powerful means to modify its electronic properties. Dramatic effects have been demonstrated in twisted bilayers where coupling to the resulting moir\'e-superlattice yields an isolated flat band that hosts correlated many-body phases. However, both the symmetry and strength of the effective moir\'e potential are constrained by the constituent crystals, limiting its tunability. Here we exploit the technique of dielectric patterning to subject graphene to a one-dimensional electrostatic superlattice (SL). We observe the emergence of multiple Dirac cones and find evidence that with increasing SL potential the main and satellite Dirac cones are sequentially flattened in the direction parallel to the SL basis vector. Our results demonstrate the ability to induce tunable transport anisotropy in high mobility two-dimensional materials, a long-desired property for novel electronic and optical applications, as well as a new approach to engineering flat energy bands where electron-electron interactions can lead to emergent properties.


title: The Light Sgoldstino Phenomenology: Explanations for the Muon $(g-2)$ Deviation and KOTO Anomaly

abstract: In this work, we study the long-standing experimental anomaly in muon $(g-2)$ and also recent anomalous excess in $K_L\to \pi^0+\nu\bar\nu$ at the J-PARC KOTO experiment with sgoldstino. After supersymmetry breaking, the interactions between quarks and sgoldstino ($s$) make the decays $K\to \pi+s$ sizable through loop diagrams, which affects the measurements of decays $K\to \pi+\mathrm{invisible}$. Furthermore, the couplings between photons and sgoldstino contribute to $\Delta a_\mu$ as well as the bino-slepton contribution. With satisfying all known experimental constraints such as from NA62, E949, E137, Orsay, KTEV and CHARM experiments, these two anomalies can be explained simultaneously. The mass of CP-even sgoldstino is close to the neutral pion mass which does not violate the Grossman-Nir bound. The parameter space can be further tested in future NA62, DUNE experiments, as well as experiments in the LHC.


title: End-to-End Code Switching Language Models for Automatic Speech Recognition

abstract: In this paper, we particularly work on the code-switched text, one of the most common occurrences in the bilingual communities across the world. Due to the discrepancies in the extraction of code-switched text from an Automated Speech Recognition(ASR) module, and thereby extracting the monolingual text from the code-switched text, we propose an approach for extracting monolingual text using Deep Bi-directional Language Models(LM) such as BERT and other Machine Translation models, and also explore different ways of extracting code-switched text from the ASR model. We also explain the robustness of the model by comparing the results of Perplexity and other different metrics like WER, to the standard bi-lingual text output without any external information.


title: Doodles and commutator identities

abstract: A doodle is a collection of immersed circles without triple intersections in the $2$-sphere. It was shown by the second author and P.~Tayler that doodles induce commutator identities (identities amongst commutators) in a free group. In this paper we observe this idea more closely by concentrating on doodles with proper noose systems and elementary commutator identities. In particular we show that there is a bijection between cobordism classes of colored doodles and weak equivalence classes of elementary commutator identities.


title: Unicorn paths and hyperfiniteness for the mapping class group

abstract: Let S be an orientable surface of finite type. Using Pho-On's infinite unicorn paths, we prove the hyperfiniteness of orbit equivalence relations induced by the actions of the mapping class group of S on the Gromov boundaries of the arc graph and the curve graph of S. In the curve graph case, this strengthens the results of Hamenst\"adt and Kida that this action is universally amenable and that the mapping class group of S is exact.


title: GO Hessian for Expectation-Based Objectives

abstract: An unbiased low-variance gradient estimator, termed GO gradient, was proposed recently for expectation-based objectives $\mathbb{E}_{q_{\boldsymbol{\gamma}}(\boldsymbol{y})} [f(\boldsymbol{y})]$, where the random variable (RV) $\boldsymbol{y}$ may be drawn from a stochastic computation graph with continuous (non-reparameterizable) internal nodes and continuous/discrete leaves. Upgrading the GO gradient, we present for $\mathbb{E}_{q_{\boldsymbol{\boldsymbol{\gamma}}}(\boldsymbol{y})} [f(\boldsymbol{y})]$ an unbiased low-variance Hessian estimator, named GO Hessian. Considering practical implementation, we reveal that GO Hessian is easy-to-use with auto-differentiation and Hessian-vector products, enabling efficient cheap exploitation of curvature information over stochastic computation graphs. As representative examples, we present the GO Hessian for non-reparameterizable gamma and negative binomial RVs/nodes. Based on the GO Hessian, we design a new second-order method for $\mathbb{E}_{q_{\boldsymbol{\boldsymbol{\gamma}}}(\boldsymbol{y})} [f(\boldsymbol{y})]$, with rigorous experiments conducted to verify its effectiveness and efficiency.


title: Conceptual remote distance measurement with a double-slit interference

abstract: Distance measurement is crucial to astronomy. Here we suggest a new conceptual method to measure the distance by using a local instrument. By engaging the double-slit interference and by considering the phase information of the light, the position of the intensity maximum is related to the distance of the source. Consequently, the precise measurement of the position can be used to measure the distance of the remote source.