title: Kilohertz Gravitational Waves from Binary Neutron Star Mergers: Inference of Postmerger Signals with the Einstein Telescope

abstract: Next-generation detectors are expected to be sensitive to postmerger signals from binary neutron star coalescences and thus to directly probe the remnant dynamics. We investigate the scientific potential of postmerger detections with the Einstein Telescope using full Bayesian analyses with the state-of-the-art waveform model ${\tt NRPMw}$. We find that: (i) Postmerger signals with signal-to-noise ratio (SNR) ${\sim}7$ can be confidently detected with a Bayes' factor of $\log{\cal B}\simeq 5$ ($\rm e$-folded) and the posterior distributions report informative measurements already at SNR ${\sim}6$ for some noise realizations. (ii) The postmerger peak frequency $f_2$ can be confidently identified at SNR $7$ with errors of $O(1~{\rm kHz})$, that decrease below $O(100~{\rm Hz})$ for SNR 10. (iii) The remnant's time of collapse to black hole can be constrained to $O(20~{\rm ms})$ at SNR 10. However, the inference can be biased by noise fluctuationsif the latter exceed the signal's amplitude before collapse. (iv) Violations of the EOS-insentive relations for $f_2$ can be detected at SNR $\gtrsim 8$ if the frequency shifts are $\gtrsim 500~{\rm Hz}$; they can be smoking guns for EOS softening effects at extreme densities. However, the $f_2$ measurement can be significantly biased by subdominant frequency components for short-lived remnants. In these cases, an EOS softening might be better inferred from the remnant's earlier collapse.


title: Input estimation from discrete workload observations in a L\'evy-driven storage system

abstract: We consider the estimation of the characteristic exponent of the input to a L\'evy-driven storage model. The input process is not directly observed, but rather the workload process is sampled on an equispaced grid. The estimator relies on an approximate moment equation associated with the Laplace-Stieltjes transform of the workload at exponentially distributed sampling times. The estimator is pointwise consistent for any observation grid. Moreover, the distribution of the estimation errors is asymptotically normal for a high frequency sampling scheme. A resampling scheme that uses the available information in a more efficient manner is suggested and studied via simulation experiments.


title: Distributed Optimization in Distribution Systems with Grid-Forming and Grid-Supporting Inverters

abstract: With massive penetrations of active grid-edge technologies, distributed computing and optimization paradigm has gained significant attention to solve distribution-level optimal power flow (OPF) problems. However, the application of generic distributed optimization techniques to OPF problems leads to a very large number of macro-iterations or communication rounds among the distributed computing agents delaying the decision-making process or resulting in suboptimal solutions. Moreover, the existing distribution-level OPF problems typically model inverter-interfaced distributed energy resources (DERs) as grid-following inverters; grid-supporting and grid-forming functionalities have not been explicitly considered. The added complexities introduced by different inverter models require further attention to developing an appropriate model for new types of inverter-based DERs and computationally-tractable OPF algorithms. In this paper, we expand the distribution-level OPF model to include a combination of the grid-forming, grid-supporting, grid-following inverter-based DERs and also present the application of a domain-specific problem decomposition and distributed algorithm for the topologically radial power distribution systems to efficiently solve distribution-level OPF problem.


title: On the X-ray pulsar HD 49798: a contracting white dwarf with debris disk?

abstract: HD49798/RX J0648.0-4418 is a peculiar binary including a hot subdwarf of O spectral type and a compact companion in a 1.55 day orbit. According to the steady spin period derivative $\dot{P}=(-2.17\pm0.01)\times10^{-15} ~\rm s\,s^{-1}$ , the compact object was thought to be a contracting young white dwarf (WD). However, the X-ray luminosity producing by the wind accretion of massive WD is one order of magnitude smaller than the observed value. In this work, we propose an alternative model to account for the observed X-ray luminosity. If the WD was surrounded by a debris disk, the accretion from the debris disk can produce the observed X-ray luminosity and X-ray pulses. Based on the time-varying accretion rate model, the current mass of the debris disk is constrained to be $3.9\times10^{-6}~\rm M_{\odot}$. Comparing with the contraction of the WD, the accretion torque exerting by such a debris disk can only influence the spin evolution of the WD in the early stage. According to the accretion theory, the magnetic field of the WD is constrained to be $\sim (0.7-7)\times10^{4}$ G. The calculated conventional polar cap radius of the WD is larger than the observed emitting-zone radius, which probably originate from the existence of strong and small-scale local magnetic field in the polar cap surface. We expect that further multiband observations on this source can help us to confirm or rule out the existence of a debris disk.


title: ${\cal CP}$ structure of the top-quark Yukawa interaction: NLO QCD corrections and off-shell effects

abstract: Since its discovery at the Large Hadron Collider in 2012 the Higgs boson has arguably become the most famous of the Standard Model particles and many measurements have been performed in order to assess its properties. Among others, these include measurements of the Higgs boson's ${\cal CP}$ state which is predicted to be ${\cal CP}$-even. Even though a pure ${\cal CP}$-odd state has been ruled out, a possible admixture of a ${\cal CP}$-odd Higgs state has yet to be excluded. In this work we present predictions for the associated production of a leptonically decaying top quark pair and a stable Higgs boson $p p \to e^+ \nu_e\, \mu^- \bar{\nu}_\mu\,b\bar{b}\,H$ with possible mixing between ${\cal CP}$-even and ${\cal CP}$-odd states at NLO in QCD for the LHC with $\sqrt{s} = 13$ TeV. Finite top-quark and gauge boson width effects as well as all double-, single- and non-resonant Feynman diagrams including their interference effects are taken into account. We compare the behaviour of the ${\cal CP}$-even, -odd and -mixed scenarios for the integrated fiducial cross-sections as well as several key differential distributions. In addition, we show that both NLO corrections and off-shell effects play an important role even at the level of integrated fiducial cross-sections and that these are further enhanced in differential distributions. Even though we focus here on the Standard Model Higgs boson, the calculations could be straightforwardly applied to models that have an extended Higgs-boson sector and predict the existence of ${\cal CP}$-odd Higgs-like particles, such as the two-Higgs-doublet model.


title: The thermodynamics of isolated horizons in loop quantum gravity

abstract: The statistical mechanical calculation of the thermodynamical properties of non-rotating isolated horizons are studied in the loop quantum gravity framework. By employing the Hawking temperature and horizon mass of isolated horizons as physical inputs, the microcanonical ensemble associated with the system are well established. As a result, the black hole entropy and other thermodynamical quantities can be computed and consistent with well-known Hawking's semiclassical analysis. Moreover, the value of the Immirzi parameter of loop quantum gravity for {higher dimensional case and 4-dimensional U(1) case are} also obtained.


title: The Lp Minkowski problem for q-torsional rigidity

abstract: In this paper, we introduce the so-called $L_p$ $q$-torsional measure for $p\in\mathbb{R}$ and $q>1$ by establishing the $L_p$ variational formula for the $q$-torsional rigidity of convex bodies without smoothness conditions. Moreover, we achieve the existence of solutions to the $L_p$ Minkowski problem $w.r.t.$ the $q$-torsional rigidity for discrete measure and general measure when $0<p<1$ and $q>1$.


title: SafeNet: The Unreasonable Effectiveness of Ensembles in Private Collaborative Learning

abstract: Secure multiparty computation (MPC) has been proposed to allow multiple mutually distrustful data owners to jointly train machine learning (ML) models on their combined data. However, by design, MPC protocols faithfully compute the training functionality, which the adversarial ML community has shown to leak private information and can be tampered with in poisoning attacks. In this work, we argue that model ensembles, implemented in our framework called SafeNet, are a highly MPC-amenable way to avoid many adversarial ML attacks. The natural partitioning of data amongst owners in MPC training allows this approach to be highly scalable at training time, provide provable protection from poisoning attacks, and provably defense against a number of privacy attacks. We demonstrate SafeNet's efficiency, accuracy, and resilience to poisoning on several machine learning datasets and models trained in end-to-end and transfer learning scenarios. For instance, SafeNet reduces backdoor attack success significantly, while achieving $39\times$ faster training and $36 \times$ less communication than the four-party MPC framework of Dalskov et al. Our experiments show that ensembling retains these benefits even in many non-iid settings. The simplicity, cheap setup, and robustness properties of ensembling make it a strong first choice for training ML models privately in MPC.


title: Model Predictive Manipulation of Compliant Objects with Multi-Objective Optimizer and Adversarial Network for Occlusion Compensation

abstract: The robotic manipulation of compliant objects is currently one of the most active problems in robotics due to its potential to automate many important applications. Despite the progress achieved by the robotics community in recent years, the 3D shaping of these types of materials remains an open research problem. In this paper, we propose a new vision-based controller to automatically regulate the shape of compliant objects with robotic arms. Our method uses an efficient online surface/curve fitting algorithm that quantifies the object's geometry with a compact vector of features; This feedback-like vector enables to establish an explicit shape servo-loop. To coordinate the motion of the robot with the computed shape features, we propose a receding-time estimator that approximates the system's sensorimotor model while satisfying various performance criteria. A deep adversarial network is developed to robustly compensate for visual occlusions in the camera's field of view, which enables to guide the shaping task even with partial observations of the object. Model predictive control is utilized to compute the robot's shaping motions subject to workspace and saturation constraints. A detailed experimental study is presented to validate the effectiveness of the proposed control framework.


title: SALTED: A Framework for SAlient Long-Tail Translation Error Detection

abstract: Traditional machine translation (MT) metrics provide an average measure of translation quality that is insensitive to the long tail of behavioral problems in MT. Examples include translation of numbers, physical units, dropped content and hallucinations. These errors, which occur rarely and unpredictably in Neural Machine Translation (NMT), greatly undermine the reliability of state-of-the-art MT systems. Consequently, it is important to have visibility into these problems during model development. Towards this direction, we introduce SALTED, a specifications-based framework for behavioral testing of MT models that provides fine-grained views of salient long-tail errors, permitting trustworthy visibility into previously invisible problems. At the core of our approach is the development of high-precision detectors that flag errors (or alternatively, verify output correctness) between a source sentence and a system output. We demonstrate that such detectors could be used not just to identify salient long-tail errors in MT systems, but also for higher-recall filtering of the training data, fixing targeted errors with model fine-tuning in NMT and generating novel data for metamorphic testing to elicit further bugs in models.


title: Propagation of Compressional Alfv\'en Waves in a Magnetized Pair Plasma Medium

abstract: The reductive perturbation approach was used to explore the nonlinear propagation of fast (compressive) and slow (rarefactive) electron-position (EP) magneto-acoustic (EPMA) modes in an EP plasma medium. The solitary wave solution of the Korteweg-de Vries (K-dV) equation is used to identify the basic properties of EP compressional Alfv\'en waves. It is shown that the fast (slow) EPMA mode is predicted to propagate as compressive (rarefactive) solitary waves. The basic features (i.e., speed, amplitude, and width) of the compressive (i.e., fast) EPMA waves are found to be completely different from those of rarefactive (i.e., slow) EPMA ones. It is also examined that hump (dip) shape solitary waves are found for fast (slow) mode. The significance of our findings is in understanding the nonlinear electromagnetic wave phenomena in laboratory plasma and space environments where EP plasma may exist.


title: Set-based Meta-Interpolation for Few-Task Meta-Learning

abstract: Meta-learning approaches enable machine learning systems to adapt to new tasks given few examples by leveraging knowledge from related tasks. However, a large number of meta-training tasks are still required for generalization to unseen tasks during meta-testing, which introduces a critical bottleneck for real-world problems that come with only few tasks, due to various reasons including the difficulty and cost of constructing tasks. Recently, several task augmentation methods have been proposed to tackle this issue using domain-specific knowledge to design augmentation techniques to densify the meta-training task distribution. However, such reliance on domain-specific knowledge renders these methods inapplicable to other domains. While Manifold Mixup based task augmentation methods are domain-agnostic, we empirically find them ineffective on non-image domains. To tackle these limitations, we propose a novel domain-agnostic task augmentation method, Meta-Interpolation, which utilizes expressive neural set functions to densify the meta-training task distribution using bilevel optimization. We empirically validate the efficacy of Meta-Interpolation on eight datasets spanning across various domains such as image classification, molecule property prediction, text classification and speech recognition. Experimentally, we show that Meta-Interpolation consistently outperforms all the relevant baselines. Theoretically, we prove that task interpolation with the set function regularizes the meta-learner to improve generalization.


title: Planning with Diffusion for Flexible Behavior Synthesis

abstract: Model-based reinforcement learning methods often use learning only for the purpose of estimating an approximate dynamics model, offloading the rest of the decision-making work to classical trajectory optimizers. While conceptually simple, this combination has a number of empirical shortcomings, suggesting that learned models may not be well-suited to standard trajectory optimization. In this paper, we consider what it would look like to fold as much of the trajectory optimization pipeline as possible into the modeling problem, such that sampling from the model and planning with it become nearly identical. The core of our technical approach lies in a diffusion probabilistic model that plans by iteratively denoising trajectories. We show how classifier-guided sampling and image inpainting can be reinterpreted as coherent planning strategies, explore the unusual and useful properties of diffusion-based planning methods, and demonstrate the effectiveness of our framework in control settings that emphasize long-horizon decision-making and test-time flexibility.


title: Asynchronous Byzantine Reliable Broadcast With a Message Adversary

abstract: This paper considers the problem of reliable broadcast in asynchronous authenticated systems, in which n processes communicate using signed messages and up to t processes may behave arbitrarily (Byzantine processes). In addition, for each message m broadcast by a correct (i.e., non-Byzantine) process, a message adversary may prevent up to d correct processes from receiving m. (This message adversary captures network failures such as transient disconnections, silent churn, or message losses.) Considering such a "double" adversarial context and assuming n > 3t + 2d, a reliable broadcast algorithm is presented. Interestingly, when there is no message adversary (i.e., d = 0), the algorithm terminates in two communication steps (so, in this case, this algorithm is optimal in terms of both Byzantine tolerance and time efficiency). It is then shown that the condition n > 3t + 2d is necessary for implementing reliable broadcast in the presence of both Byzantine processes and a message adversary (whether the underlying system is enriched with signatures or not).


title: Second-order uniformly asymptotic-preserving space-time-ImEx schemes for hyperbolic balance laws with stiff relaxation

abstract: We consider hyperbolic systems of conservation laws with relaxation source terms leading to a diffusive asymptotic limit under a parabolic scaling. We introduce a new class of secondorder in time and space numerical schemes, which are uniformly asymptotic preserving schemes. The proposed Implicit-Explicit (ImEx) approach, does not follow the usual path relying on the method of lines, either with multi-step methods or Runge-Kutta methods, or semi-discretized in time equations, but is inspired from the Lax-Wendroff approach with the proper level of implicit treatment of the source term. As a result, it yields a very compact stencil in space and time and we are able to rigorously show that both the second-order accuracy and the stability conditions are independent of the fast scales in the asymptotic regime, including the study of boundary conditions. We provide an original derivation of l 2 and l $\infty$ stability conditions of the scheme that do not deteriorate the second order accuracy without relying on a limiter of any type in the linear case, in particular for shock solutions, and extend such results to the nonlinear case, showing the novelty of the method. The prototype system for the linear case is the hyperbolic heat equation, whereas barotropic Euler equations of gas dynamics with friction are the one for the nonlinear case. The method is also able to yield very accurate steady solutions in the nonlinear case when the relaxation coefficient in the source term depends on space. A thorough numerical assessment of the proposed strategy is provided by investigating smooth solutions, solutions with shocks and solutions leading to a steady state with space dependent relaxation coefficient.


title: Combinatorial and geometric constructions associated with the Kostant cascade

abstract: Let $\mathfrak g$ be a complex simple Lie algebra and $\mathfrak b=\mathfrak t\oplus\mathfrak u^+$ a fixed Borel subalgebra. Let $\Delta^+$ be the set of positive roots associated with $\mathfrak u^+$ and $\mathcal K\subset\Delta^+$ the Kostant cascade. We elaborate on some constructions related to $\mathcal K$ and applications of $\mathcal K$. This includes the cascade element $x_{\mathcal K}$ in the Cartan subalgebra $\mathfrak t$ and properties of certain objects naturally associated with $\mathcal K$: an abelian ideal of $\mathfrak b$, a nilpotent $G$-orbit in $\mathfrak g$, and an involution of $\mathfrak g$.


title: Mask-guided Vision Transformer (MG-ViT) for Few-Shot Learning

abstract: Learning with little data is challenging but often inevitable in various application scenarios where the labeled data is limited and costly. Recently, few-shot learning (FSL) gained increasing attention because of its generalizability of prior knowledge to new tasks that contain only a few samples. However, for data-intensive models such as vision transformer (ViT), current fine-tuning based FSL approaches are inefficient in knowledge generalization and thus degenerate the downstream task performances. In this paper, we propose a novel mask-guided vision transformer (MG-ViT) to achieve an effective and efficient FSL on ViT model. The key idea is to apply a mask on image patches to screen out the task-irrelevant ones and to guide the ViT to focus on task-relevant and discriminative patches during FSL. Particularly, MG-ViT only introduces an additional mask operation and a residual connection, enabling the inheritance of parameters from pre-trained ViT without any other cost. To optimally select representative few-shot samples, we also include an active learning based sample selection method to further improve the generalizability of MG-ViT based FSL. We evaluate the proposed MG-ViT on both Agri-ImageNet classification task and ACFR apple detection task with gradient-weighted class activation mapping (Grad-CAM) as the mask. The experimental results show that the MG-ViT model significantly improves the performance when compared with general fine-tuning based ViT models, providing novel insights and a concrete approach towards generalizing data-intensive and large-scale deep learning models for FSL.


title: Fokker-Planck modeling of many-agent systems in swarm manufacturing: asymptotic analysis and numerical results

abstract: In this paper we study a novel Fokker-Planck-type model that is designed to mimic manufacturing processes through the dynamics characterizing a large set of agents. In particular, we describe a many-agent system interacting with a target domain in such a way that each agent/particle is attracted by the center of mass of the target domain with the aim to uniformly cover this zone. To this end, we first introduce a mean-field model with discontinuous flux whose large time behavior is such that the steady state is globally continuous and uniform over a connected portion of the domain. We prove that a diffusion coefficient that guarantees that a given portion of mass enters in the target domain exists and that it is unique. Furthermore, convergence to equilibrium in 1D is provided through a reformulation of the initial problem involving a nonconstant diffusion function. The extension to 2D is explored numerically by means of recently introduced structure preserving methods for Fokker-Planck equations.


title: Unexpected dipole instabilities in small molecules after ultrafast XUV irradiation

abstract: We investigate the depletion of single-electron states in small molecules under the influence of very short XUV pulses. In N$_2$, for a certain window of XUV energies around 50 eV, we observe a marked occupation inversion, i.e. a situation where depletion of the deepest bound valence electron state is much larger than for any other state. This represents a realistic mechanism which is able to cut, almost instantaneously, a hole into a deep lying state, a situation which is often assumed ad hoc in numerous theoretical studies of energetic ultrafast processes. This occupation inversion furthermore drives a dipole instability, i.e. a spontaneous reappearance of the dipole signal long after the laser pulse is over and the dipole signal has died out. The dipole signal that emerges from this instability can be identified as a particular low-energy structure in photo-electron spectra.


title: Abstract boundaries and continuous extension of biholomorphisms

abstract: We present different constructions of abstract boundaries for bounded complete (Kobayashi) hyperbolic domains in ${\mathbb C}^d$, $d \geq 1$. These constructions essentially come from the geometric theory of metric spaces. We also present, as an application, some extension results concerning biholomorphic maps.


title: Pretriangulated 2-representations via dg algebra 1-morphisms

abstract: This paper develops a theory of pretriangulated 2-representations of dg 2-categories. We characterize cyclic pretriangulated 2-representations, under certain compactness assumptions, in terms of modules over dg algebra 1-morphisms internal to associated dg 2-categories of compact dg modules. Further, we investigate the Morita theory and quasi-equivalences for such dg 2-representations. We relate this theory to various classes of examples of dg categorifications from the literature.


title: A Linear Algebraic Framework for Quantum Internet Dynamic Scheduling

abstract: Future quantum internet aims to enable quantum communication between arbitrary pairs of distant nodes through the sharing of end-to-end entanglement, a universal resource for many quantum applications. As in classical networks, quantum networks also have to resolve problems related to routing and satisfaction of service at a sufficient rate. We deal here with the problem of scheduling when multiple commodities must be served through a quantum network based on first generation quantum repeaters, or quantum switches. To this end, we introduce a novel discrete-time algebraic model for arbitrary network topology, including transmission and memory losses, and adapted to dynamic scheduling decisions. Our algebraic model allows the scheduler to use the storage of temporary intermediate links to optimize the performance, depending on the information availability, ranging from full global information for a centralized scheduler to partial local information for a distributed one. As an illustrative example, we compare a simple greedy scheduling policy with several Max-Weight inspired scheduling policies and illustrate the resulting achievable rate regions for two competing pairs of clients through a network.


title: Quantum dot molecule devices with optical control of charge status and electronic control of coupling

abstract: Tunnel-coupled pairs of optically active quantum dots - quantum dot molecules (QDMs) - offer the possibility to combine excellent optical properties such as strong light-matter coupling with two-spin singlet-triplet ($S-T_0$) qubits having extended coherence times. The $S-T_0$ basis formed using two spins is inherently protected against electric and magnetic field noise. However, since a single gate voltage is typically used to stabilize the charge occupancy of the dots and control the inter-dot orbital couplings, operation of the $S-T_0$ qubits under optimal conditions remains challenging. Here, we present an electric field tunable QDM that can be optically charged with one (1h) or two holes (2h) on demand. We perform a four-phase optical and electric field control sequence that facilitates the sequential preparation of the 2h charge state and subsequently allows flexible control of the inter-dot coupling. Charges are loaded via optical pumping and electron tunnel ionization. We achieve one- and two-hole charging efficiencies of 93.5 $\pm$ 0.8 % and 80.5 $\pm$ 1.3 %, respectively. Combining efficient charge state preparation and precise setting of inter-dot coupling allows control of few-spin qubits, as would be required for on-demand generation of two-dimensional photonic cluster states or quantum transduction between microwaves and photons.


title: Interference and parity blockade in transport through a Majorana box

abstract: A Majorana box - two topological superconducting nanowires coupled via a trivial superconductor - is a building block in devices aiming to demonstrate nonabelian physics, as well as for topological quantum computer architectures. We theoretically investigate charge transport through a Majorana box and show that current can be blocked when two Majoranas couple to the same lead, fixing their parity. In direct analogy to Pauli spin blockade in spin qubits, this parity blockade can be used for fast and high-fidelity qubit initialization and readout, as well as for current-based measurements of decoherence times. Furthermore, we demonstrate that transport can distinguish between a clean Majorana box and a disordered box with additional unwanted Majorana or Andreev bound states.


title: InDistill: Information flow-preserving knowledge distillation for model compression

abstract: In this paper we introduce InDistill, a model compression approach that combines knowledge distillation and channel pruning in a unified framework for the transfer of the critical information flow paths from a heavyweight teacher to a lightweight student. Such information is typically collapsed in previous methods due to an encoding stage prior to distillation. By contrast, InDistill leverages a pruning operation applied to the teacher's intermediate layers reducing their width to the corresponding student layers' width. In that way, we force architectural alignment enabling the intermediate layers to be directly distilled without the need of an encoding stage. Additionally, a curriculum learning-based training scheme is adopted considering the distillation difficulty of each layer and the critical learning periods in which the information flow paths are created. The proposed method surpasses state-of-the-art performance on three standard benchmarks, i.e. CIFAR-10, CUB-200, and FashionMNIST by 3.08%, 14.27%, and 1% mAP, respectively, as well as on more challenging evaluation settings, i.e. ImageNet and CIFAR-100 by 1.97% and 5.65% mAP, respectively.


title: RiskLoc: Localization of Multi-dimensional Root Causes by Weighted Risk

abstract: Failures and anomalies in large-scale software systems are unavoidable incidents. When an issue is detected, operators need to quickly and correctly identify its location to facilitate a swift repair. In this work, we consider the problem of identifying the root cause set that best explains an anomaly in multi-dimensional time series with categorical attributes. The huge search space is the main challenge, even for a small number of attributes and small value sets, the number of theoretical combinations is too large to brute force. Previous approaches have thus focused on reducing the search space, but they all suffer from various issues, requiring extensive manual parameter tuning, being too slow and thus impractical, or being incapable of finding more complex root causes. We propose RiskLoc to solve the problem of multidimensional root cause localization. RiskLoc applies a 2-way partitioning scheme and assigns element weights that linearly increase with the distance from the partitioning point. A risk score is assigned to each element that integrates two factors, 1) its weighted proportion within the abnormal partition, and 2) the relative change in the deviation score adjusted for the ripple effect property. Extensive experiments on multiple datasets verify the effectiveness and efficiency of RiskLoc, and for a comprehensive evaluation, we introduce three synthetically generated datasets that complement existing datasets. We demonstrate that RiskLoc consistently outperforms state-of-the-art baselines, especially in more challenging root cause scenarios, with gains in F1-score up to 57% over the second-best approach with comparable running times.


title: Effects of variations of SUSY breaking scale on neutrino parameters at low energy scale under radiative corrections

abstract: The paper addresses the effects of the variations of the SUSY breaking scale $m_s$ in the range (2-14) TeV on the three neutrino masses and mixings, in running the renormalization group equations (RGEs) for different input values of high energy seesaw scale $M_R$, in both normal and inverted hierarchical neutrino mass models. The present investigation is a continuation of the earlier works based on the variation of $m_s$ scale. Two approaches are adopted one after another - bottom-up approach for running gauge and Yukawa couplings from low to high energy scale, followed by the top-down approach from high to low energy scale for running neutrino parameters defined at high energy scale, along with gauge and Yukawa couplings. A self-complementarity relation among three mixing angles is also employed in the analysis. Significant effect due to radiative corrections on neutrino parameters with the variation of SUSY breaking scale $m_s$, is observed.


title: Self-Supervised Depth Estimation with Isometric-Self-Sample-Based Learning

abstract: Managing the dynamic regions in the photometric loss formulation has been a main issue for handling the self-supervised depth estimation problem. Most previous methods have alleviated this issue by removing the dynamic regions in the photometric loss formulation based on the masks estimated from another module, making it difficult to fully utilize the training images. In this paper, to handle this problem, we propose an isometric self-sample-based learning (ISSL) method to fully utilize the training images in a simple yet effective way. The proposed method provides additional supervision during training using self-generated images that comply with pure static scene assumption. Specifically, the isometric self-sample generator synthesizes self-samples for each training image by applying random rigid transformations on the estimated depth. Thus both the generated self-samples and the corresponding training image always follow the static scene assumption. We show that plugging our ISSL module into several existing models consistently improves the performance by a large margin. In addition, it also boosts the depth accuracy over different types of scene, i.e., outdoor scenes (KITTI and Make3D) and indoor scene (NYUv2), validating its high effectiveness.


title: Observation of cross phase modulation in cold atom gradient echo memory

abstract: Strong nonlinear interactions between single photons have important applications in optical quantum information processing. Demonstrations of these interactions in cold atomic ensembles have largely been limited to exploiting slow light generated using electromagnetically induced transparency (EIT). However, these EIT implementations have limited achievable phase shifts due to spontaneous emission. Here, we demonstrate and characterize a scheme free from these limitations using gradient echo memory with inferred single photon phase shifts of $0.07\pm0.02$ $\mu\text{rad}$. Excellent agreement with theoretical modelling was observed. Degradation of memory efficiency was observed for large phase shifts but strategies to overcome that are presented.


title: Action parsing using context features

abstract: We propose an action parsing algorithm to parse a video sequence containing an unknown number of actions into its action segments. We argue that context information, particularly the temporal information about other actions in the video sequence, is valuable for action segmentation. The proposed parsing algorithm temporally segments the video sequence into action segments. The optimal temporal segmentation is found using a dynamic programming search algorithm that optimizes the overall classification confidence score. The classification score of each segment is determined using local features calculated from that segment as well as context features calculated from other candidate action segments of the sequence. Experimental results on the Breakfast activity data-set showed improved segmentation accuracy compared to existing state-of-the-art parsing techniques.


title: The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?

abstract: We consider the problem of estimating a rank-1 signal corrupted by structured rotationally invariant noise, and address the following question: how well do inference algorithms perform when the noise statistics is unknown and hence Gaussian noise is assumed? While the matched Bayes-optimal setting with unstructured noise is well understood, the analysis of this mismatched problem is only at its premises. In this paper, we make a step towards understanding the effect of the strong source of mismatch which is the noise statistics. Our main technical contribution is the rigorous analysis of a Bayes estimator and of an approximate message passing (AMP) algorithm, both of which incorrectly assume a Gaussian setup. The first result exploits the theory of spherical integrals and of low-rank matrix perturbations; the idea behind the second one is to design and analyze an artificial AMP which, by taking advantage of the flexibility in the denoisers, is able to "correct" the mismatch. Armed with these sharp asymptotic characterizations, we unveil a rich and often unexpected phenomenology. For example, despite AMP is in principle designed to efficiently compute the Bayes estimator, the former is outperformed by the latter in terms of mean-square error. We show that this performance gap is due to an incorrect estimation of the signal norm. In fact, when the SNR is large enough, the overlaps of the AMP and the Bayes estimator coincide, and they even match those of optimal estimators taking into account the structure of the noise.


title: Some identities on degenerate hyperharmonic numbers

abstract: The aim of this paper is to investigate some properties, recurrence relations and identities involving degenerate hyperharmonic numbers, hyperharmonic numbers and degenerate harmonic numbers. In particular, we derive an explicit expression of the degenerate hyperharmonic numbers in terms of the degenerate harmonic numbers. This is a degenerate version of the corresponding identity representing the hyperharmonic numbers in terms of harmonic numbers due to Conway and Guy.


title: Constructive Interpretability with CoLabel: Corroborative Integration, Complementary Features, and Collaborative Learning

abstract: Machine learning models with explainable predictions are increasingly sought after, especially for real-world, mission-critical applications that require bias detection and risk mitigation. Inherent interpretability, where a model is designed from the ground-up for interpretability, provides intuitive insights and transparent explanations on model prediction and performance. In this paper, we present CoLabel, an approach to build interpretable models with explanations rooted in the ground truth. We demonstrate CoLabel in a vehicle feature extraction application in the context of vehicle make-model recognition (VMMR). CoLabel performs VMMR with a composite of interpretable features such as vehicle color, type, and make, all based on interpretable annotations of the ground truth labels. First, CoLabel performs corroborative integration to join multiple datasets that each have a subset of desired annotations of color, type, and make. Then, CoLabel uses decomposable branches to extract complementary features corresponding to desired annotations. Finally, CoLabel fuses them together for final predictions. During feature fusion, CoLabel harmonizes complementary branches so that VMMR features are compatible with each other and can be projected to the same semantic space for classification. With inherent interpretability, CoLabel achieves superior performance to the state-of-the-art black-box models, with accuracy of 0.98, 0.95, and 0.94 on CompCars, Cars196, and BoxCars116K, respectively. CoLabel provides intuitive explanations due to constructive interpretability, and subsequently achieves high accuracy and usability in mission-critical situations.


title: Descartes: Generating Short Descriptions of Wikipedia Articles

abstract: Wikipedia is one of the richest knowledge sources on the Web today. In order to facilitate navigating, searching, and maintaining its content, Wikipedia's guidelines state that all articles should be annotated with a so-called short description indicating the article's topic (e.g., the short description of beer is "Alcoholic drink made from fermented cereal grains"). Nonetheless, a large fraction of articles (ranging from 10.2% in Dutch to 99.7% in Kazakh) have no short description yet, with detrimental effects for millions of Wikipedia users. Motivated by this problem, we introduce the novel task of automatically generating short descriptions for Wikipedia articles and propose Descartes, a multilingual model for tackling it. Descartes integrates three sources of information to generate an article description in a target language: the text of the article in all its language versions, the already-existing descriptions (if any) of the article in other languages, and semantic type information obtained from a knowledge graph. We evaluate a Descartes model trained for handling 25 languages simultaneously, showing that it beats baselines (including a strong translation-based baseline) and performs on par with monolingual models tailored for specific languages. A human evaluation on three languages further shows that the quality of Descartes's descriptions is largely indistinguishable from that of human-written descriptions; e.g., 91.3% of our English descriptions (vs. 92.1% of human-written descriptions) pass the bar for inclusion in Wikipedia, suggesting that Descartes is ready for production, with the potential to support human editors in filling a major gap in today's Wikipedia across languages.


title: Stability of ferroelectric bubble domains

abstract: Nanoscale ferroelectric topologies such as vortices, anti-vortices, bubble patterns etc. are stabilized in thin films by a delicate balance of both mechanical and electrical boundary conditions. A systematic understanding of the phase stability of bubble domains, particularly when the above factors act simultaneously, remains elusive. Here we present first-principle-based simulations in combination with scanning probe microscopy of ultrathin epitaxial (001) PbZr0.4Ti0.6O3 heterostructures to address this gap. The simulations predict that as-grown labyrinthine domains will transform to bubbles under combinations of reduced film thickness, increased mechanical pressure and/or improved electrical screening. These topological transitions are explained by a common fundamental mechanism. Namely, we argue that, independently of the nature of the driving force, the evolution of the domain morphology allows the system to conserve its original residual depolarization field. Thereby, the latter remains pinned to a value determined by an external or built-in electric bias. To verify our predictions, we then exploit tomographic atomic force microscopy to achieve the concurrent effect of reducing film thickness and increased mechanical stimulus. The results provide a systematic understanding of phase stability and demonstrate controlled manipulation of nanoscale ferroelectric bubble domains.


title: A Survey of Trustworthy Graph Learning: Reliability, Explainability, and Privacy Protection

abstract: Deep graph learning has achieved remarkable progresses in both business and scientific areas ranging from finance and e-commerce, to drug and advanced material discovery. Despite these progresses, how to ensure various deep graph learning algorithms behave in a socially responsible manner and meet regulatory compliance requirements becomes an emerging problem, especially in risk-sensitive domains. Trustworthy graph learning (TwGL) aims to solve the above problems from a technical viewpoint. In contrast to conventional graph learning research which mainly cares about model performance, TwGL considers various reliability and safety aspects of the graph learning framework including but not limited to robustness, explainability, and privacy. In this survey, we provide a comprehensive review of recent leading approaches in the TwGL field from three dimensions, namely, reliability, explainability, and privacy protection. We give a general categorization for existing work and review typical work for each category. To give further insights for TwGL research, we provide a unified view to inspect previous works and build the connection between them. We also point out some important open problems remaining to be solved in the future developments of TwGL.


title: Correlated ionisations in two spatially separated nanometric volumes in the track structure of 241Am alpha particles: comparison with Monte Carlo simulations

abstract: The production of two double strand breaks in spatially separated locations on the DNA molecule can cause the loss of a whole DNA loop, which can be of substantial length depending on the geometrical position of the two damaged sites and depends on the degree of correlation between ionisation clusters formed in sites of several nanometres in size. In the first part of this paper, nanodosimetric measurements of alpha particle tracks in 1.2 mbar H2O, 1.2 mbar C3H8 and 1.2 mbar C4H8O with the PTB ion counter nanodosimeter were reported. In this second part, the focus is on the geometrical characterisation of the two sites simulated with the nanodosimeter in the three target gases and on the comparison of the measurement results with Monte Carlo simulations. The measurements in 1.2 mbar C3H8 were simulated with a version of the track structure code PTra dedicated to modelling the PTB ion counter nanodosimeter. Further simulations were performed with Geant4-DNA for 241Am alpha particle tracks in liquid water. Simulations of the measurements and the actual measurement results are found to be in good agreement for the investigated irradiation geometries.


title: Learning Progress Driven Multi-Agent Curriculum

abstract: Curriculum reinforcement learning (CRL) aims to speed up learning by gradually increasing the difficulty of a task, usually quantified by the achievable expected return. Inspired by the success of CRL in single-agent settings, a few works have attempted to apply CRL to multi-agent reinforcement learning (MARL) using the number of agents to control task difficulty. However, existing works typically use manually defined curricula such as a linear scheme. In this paper, we first apply state-of-the-art single-agent self-paced CRL to sparse reward MARL. Although with satisfying performance, we identify two potential flaws of the curriculum generated by existing reward-based CRL methods: (1) tasks with high returns may not provide informative learning signals and (2) the exacerbated credit assignment difficulty in tasks where more agents yield higher returns. Thereby, we further propose self-paced MARL (SPMARL) to prioritize tasks based on \textit{learning progress} instead of the episode return. Our method not only outperforms baselines in three challenging sparse-reward benchmarks but also converges faster than self-paced CRL.


title: A stochastic game framework for patrolling a border

abstract: In this paper we consider a stochastic game for modelling the interactions between smugglers and a patroller along a border. The problem we examine involves a group of cooperating smugglers making regular attempts to bring small amounts of illicit goods across a border. A single patroller has the goal of preventing the smugglers from doing so, but must pay a cost to travel from one location to another. We model the problem as a two-player stochastic game and look to find the Nash equilibrium to gain insight to real world problems. Our framework extends the literature by assuming that the smugglers choose a continuous quantity of contraband, complicating the analysis of the game. We discuss a number of properties of Nash equilibria, including the aggregation of smugglers, the discount factors of the players, and the equivalence to a zero-sum game. Additionally, we present algorithms to find Nash equilibria that are more computationally efficient than existing methods. We also consider certain assumptions on the parameters of the model that give interesting equilibrium strategies for the players.


title: NMA: Neural Multi-slot Auctions with Externalities for Online Advertising

abstract: Online advertising driven by auctions brings billions of dollars in revenue for social networking services and e-commerce platforms. GSP auctions, which are simple and easy to understand for advertisers, have almost become the benchmark for ad auction mechanisms in the industry. However, most GSP-based industrial practices assume that the user click only relies on the ad itself, which overlook the effect of external items, referred to as externalities. Recently, DNA has attempted to upgrade GSP with deep neural networks and models local externalities to some extent. However, it only considers set-level contexts from auctions and ignores the order and displayed position of ads, which is still suboptimal. Although VCG-based multi-slot auctions (e.g., VCG, WVCG) make it theoretically possible to model global externalities (e.g., the order and positions of ads and so on), they lack an efficient balance of both revenue and social welfare. In this paper, we propose novel auction mechanisms named Neural Multi-slot Auctions (NMA) to tackle the above-mentioned challenges. Specifically, we model the global externalities effectively with a context-aware list-wise prediction module to achieve better performance. We design a list-wise deep rank module to guarantee incentive compatibility in end-to-end learning. Furthermore, we propose an auxiliary loss for social welfare to effectively reduce the decline of social welfare while maximizing revenue. Experiment results on both offline large-scale datasets and online A/B tests demonstrate that NMA obtains higher revenue with balanced social welfare than other existing auction mechanisms (i.e., GSP, DNA, WVCG) in industrial practice, and we have successfully deployed NMA on Meituan food delivery platform.


title: Translating Hanja Historical Documents to Contemporary Korean and English

abstract: The Annals of Joseon Dynasty (AJD) contain the daily records of the Kings of Joseon, the 500-year kingdom preceding the modern nation of Korea. The Annals were originally written in an archaic Korean writing system, `Hanja', and were translated into Korean from 1968 to 1993. The resulting translation was however too literal and contained many archaic Korean words; thus, a new expert translation effort began in 2012. Since then, the records of only one king have been completed in a decade. In parallel, expert translators are working on English translation, also at a slow pace and produced only one king's records in English so far. Thus, we propose H2KE, a neural machine translation model, that translates historical documents in Hanja to more easily understandable Korean and to English. Built on top of multilingual neural machine translation, H2KE learns to translate a historical document written in Hanja, from both a full dataset of outdated Korean translation and a small dataset of more recently translated contemporary Korean and English. We compare our method against two baselines: a recent model that simultaneously learns to restore and translate Hanja historical document and a Transformer based model trained only on newly translated corpora. The experiments reveal that our method significantly outperforms the baselines in terms of BLEU scores for both contemporary Korean and English translations. We further conduct extensive human evaluation which shows that our translation is preferred over the original expert translations by both experts and non-expert Korean speakers.


title: Neural Additive Models for Nowcasting

abstract: Deep neural networks (DNNs) are one of the most highlighted methods in machine learning. However, as DNNs are black-box models, they lack explanatory power for their predictions. Recently, neural additive models (NAMs) have been proposed to provide this power while maintaining high prediction performance. In this paper, we propose a novel NAM approach for multivariate nowcasting (NC) problems, which comprise an important focus area of machine learning. For the multivariate time-series data used in NC problems, explanations should be considered for every input value to the variables at distinguishable time steps. By employing generalized additive models, the proposed NAM-NC successfully explains each input value's importance for multiple variables and time steps. Experimental results involving a toy example and two real-world datasets show that the NAM-NC predicts multivariate time-series data as accurately as state-of-the-art neural networks, while also providing the explanatory importance of each input value. We also examine parameter-sharing networks using NAM-NC to decrease their complexity, and NAM-MC's hard-tied feature net extracted explanations with good performance.


title: Predicting electrode array impedance after one month from cochlear implantation surgery

abstract: Sensorineural hearing loss can be treated using Cochlear implantation. After this surgery using the electrode array impedance measurements, we can check the stability of the impedance value and the dynamic range. Deterioration of speech recognition scores could happen because of increased impedance values. Medicines used to do these measures many times during a year after the surgery. Predicting the electrode impedance could help in taking decisions to help the patient get better hearing. In this research we used a dataset of 80 patients of children who did cochlear implantation using MED-EL FLEX28 electrode array of 12 channels. We predicted the electrode impedance on each channel after 1 month from the surgery date. We used different machine learning algorithms like neural networks and decision trees. Our results indicates that the electrode impedance can be predicted, and the best algorithm is different based on the electrode channel. Also, the accuracy level varies between 66% and 100% based on the electrode channel when accepting an error range between 0 and 3 KO. Further research is required to predict the electrode impedance after three months, six months and one year.


title: Towards Consistency in Adversarial Classification

abstract: In this paper, we study the problem of consistency in the context of adversarial examples. Specifically, we tackle the following question: can surrogate losses still be used as a proxy for minimizing the $0/1$ loss in the presence of an adversary that alters the inputs at test-time? Different from the standard classification task, this question cannot be reduced to a point-wise minimization problem, and calibration needs not to be sufficient to ensure consistency. In this paper, we expose some pathological behaviors specific to the adversarial problem, and show that no convex surrogate loss can be consistent or calibrated in this context. It is therefore necessary to design another class of surrogate functions that can be used to solve the adversarial consistency issue. As a first step towards designing such a class, we identify sufficient and necessary conditions for a surrogate loss to be calibrated in both the adversarial and standard settings. Finally, we give some directions for building a class of losses that could be consistent in the adversarial framework.


title: Transition-based Semantic Role Labeling with Pointer Networks

abstract: Semantic role labeling (SRL) focuses on recognizing the predicate-argument structure of a sentence and plays a critical role in many natural language processing tasks such as machine translation and question answering. Practically all available methods do not perform full SRL, since they rely on pre-identified predicates, and most of them follow a pipeline strategy, using specific models for undertaking one or several SRL subtasks. In addition, previous approaches have a strong dependence on syntactic information to achieve state-of-the-art performance, despite being syntactic trees equally hard to produce. These simplifications and requirements make the majority of SRL systems impractical for real-world applications. In this article, we propose the first transition-based SRL approach that is capable of completely processing an input sentence in a single left-to-right pass, with neither leveraging syntactic information nor resorting to additional modules. Thanks to our implementation based on Pointer Networks, full SRL can be accurately and efficiently done in $O(n^2)$, achieving the best performance to date on the majority of languages from the CoNLL-2009 shared task.


title: Trend analysis and forecasting air pollution in Rwanda

abstract: Air pollution is a major public health problem worldwide although the lack of data is a global issue for most low and middle income countries. Ambient air pollution in the form of fine particulate matter (PM2.5) exceeds the World Health Organization guidelines in Rwanda with a daily average of around 42.6 microgram per meter cube. Monitoring and mitigation strategies require an expensive investment in equipment to collect pollution data. Low-cost sensor technology and machine learning methods have appeared as an alternative solution to get reliable information for decision making. This paper analyzes the trend of air pollution in Rwanda and proposes forecasting models suitable to data collected by a network of low-cost sensors deployed in Rwanda.


title: Quantum oscillations in field-induced correlated insulators of a moir\'e superlattice

abstract: We report an observation of quantum oscillations (QOs) in the correlated insulators with valley anisotropy of twisted double bilayer graphene (TDBG). The anomalous QOs are best captured in the magneto resistivity oscillations of the insulators at v = -2, with a period of 1/B and an oscillation amplitude as high as 150 k{\Omega}. The QOs can survive up to ~10 K, and above 12 K, the insulating behaviors are dominant. The QOs of the insulator are strongly D dependent: the carrier density extracted from the 1/B periodicity decreases almost linearly with D from -0.7 to -1.1 V/nm, suggesting a reduced Fermi surface; the effective mass from Lifshitz-Kosevich analysis depends nonlinearly on D, reaching a minimal value of 0.1 me at D = ~ -1.0 V/nm. Similar observations of QOs are also found at v = 2, as well as in other devices without graphite gate. We interpret the D sensitive QOs of the correlated insulators in the picture of band inversion. By reconstructing an inverted band model with the measured effective mass and Fermi surface, the density of state at the gap, calculated from thermal broadened Landau levels, agrees qualitatively with the observed QOs in the insulators. While more theoretical understandings are needed in the future to fully account for the anomalous QOs in this moir\'e system, our study suggests that TDBG is an excellent platform to discover exotic phases where correlation and topology are at play.


title: Perturbation theory of LSS in the $\Lambda$CDM Universe: exact time evolution and the two-loop power spectrum

abstract: We derive exact analytic solutions for density and velocity fields to all orders in Eulerian standard perturbation theory for $\Lambda$CDM cosmology. In particular, we show that density and velocity field kernels can be written in a separable form in time and momenta at each perturbative order. The kernel solutions are built from an analytic basis of momentum operators and their time-dependent coefficients, which solve a set of recursive differential equations. We also provide an exact closed perturbative solution for such coefficients, expanding around the (quasi-)EdS approximation. We find that the perturbative solution rapidly converges towards the numerically obtained solutions and its leading order result suffices for any practical requirements. To illustrate our findings, we compute the exact two-loop dark matter density and velocity power spectra in $\Lambda$CDM cosmology. We show that the difference between the exact $\Lambda$CDM and the (quasi-)EdS approximated result can reach the level of several percent (at redshift zero, for wavenumbers $k<1h/$Mpc). This deviation can be partially mitigated by exploiting the degeneracy with the EFT counterterms. As an additional benefit of our algorithm for the solutions of time-dependent coefficients, the computational complexity of power spectra loops in $\Lambda$CDM is comparable to the EdS case. In performing the two-loop computation, we devise an explicit method to implement the so-called IR cancellations, as well as the cancellations arising as a consequence of mass and momentum conservation.


title: pISTA: preconditioned Iterative Soft Thresholding Algorithm for Graphical Lasso

abstract: We propose a novel quasi-Newton method for solving the sparse inverse covariance estimation problem also known as the graphical least absolute shrinkage and selection operator (GLASSO). This problem is often solved using a second-order quadratic approximation. However, in such algorithms the Hessian term is complex and computationally expensive to handle. Therefore, our method uses the inverse of the Hessian as a preconditioner to simplify and approximate the quadratic element at the cost of a more complex \(\ell_1\) element. The variables of the resulting preconditioned problem are coupled only by the \(\ell_1\) sub-derivative of each other, which can be guessed with minimal cost using the gradient itself, allowing the algorithm to be parallelized and implemented efficiently on GPU hardware accelerators. Numerical results on synthetic and real data demonstrate that our method is competitive with other state-of-the-art approaches.


title: Towards a spectrally multiplexed quantum repeater

abstract: Extended quantum networks are based on quantum repeaters that often rely on the distribution of entanglement in an efficient and heralded fashion over multiple network nodes. Many repeater architectures require multiplexed sources of entangled photon pairs, multiplexed quantum memories, and photon detection that distinguishes between the multiplexed modes. Here we demonstrate the concurrent employment of (1) spectrally multiplexed cavity-enhanced spontaneous parametric down-conversion in a nonlinear crystal; (2) a virtually-imaged phased array that enables mapping of spectral modes onto distinct spatial modes for frequency-selective detection; and (3) a cryogenically cooled Tm3+:LiNbO3 crystal that allows spectral filtering in an approach that anticipates its use as a spectrally-multiplexed quantum memory. Through coincidence measurements, we demonstrate quantum correlations between energy-correlated photon pairs and a strong reduction of the correlation strength between all other photons. This constitutes an important step towards a frequency multiplexed quantum repeater.


title: 2D Toda $\tau$ Functions, Weighted Hurwitz Numbers and the Cayley Graph: Determinant Representation and Recursion Formula

abstract: We generalize the determinant representation of the KP $\tau$ functions to the case of the 2D Toda $\tau$ functions. The generating functions for the weighted Hurwitz numbers are a parametric family of 2D Toda $\tau$ functions; for which we give a determinant representation of weighted Hurwitz numbers. Then we can get a finite-dimensional equation system for the weighted Hurwitz numbers $H^d_{G}(\sigma,\omega)$ with the same dimension $|\sigma|=|\omega|=n$. Using this equation system, we calculated the value of the weighted Hurwitz numbers with dimension $0,\,1,\,2$ and give a recursion formula to calculating the higher dimensional weighted Hurwitz numbers. For any given weighted generating function $G(z)$, the weighted Hurwitz number degenerates into the Hurwitz numbers when $d=0$. We get a matrix representation for the Hurwitz numbers. The generating functions of weighted paths in the Cayley graph of the symmetric group are a parametric family of 2D Toda $\tau$ functions; for which we obtain a determinant representation of weighted paths in the Cayley graph.


title: Ratio of baryon and electric-charge cumulants at second order with acceptance corrections

abstract: We evaluate the ratio of baryon and electric-charge cumulants at second order from the recent experimental results at $\sqrt{s_{_{NN}}}=200$ GeV by the STAR Collaboration. The baryon number cumulant is reconstructed from the proton number distribution, and effects of the finite acceptance on the transverse momentum are corrected assuming the independent particle emission. We show that the obtained ratio has a dependence on the rapidity window. Comparison of the result with the hadron resonance gas model and lattice QCD numerical simulations suggests that if the fluctuations are generated from a thermal medium its temperature is significantly lower than the chemical freezeout temperature.


title: Deep Learning-based Inertial Odometry for Pedestrian Tracking using Attention Mechanism and Res2Net Module

abstract: Pedestrian dead reckoning is a challenging task due to the low-cost inertial sensor error accumulation. Recent research has shown that deep learning methods can achieve impressive performance in handling this issue. In this letter, we propose inertial odometry using a deep learning-based velocity estimation method. The deep neural network based on Res2Net modules and two convolutional block attention modules is leveraged to restore the potential connection between the horizontal velocity vector and raw inertial data from a smartphone. Our network is trained using only fifty percent of the public inertial odometry dataset (RoNIN) data. Then, it is validated on the RoNIN testing dataset and another public inertial odometry dataset (OXIOD). Compared with the traditional step-length and heading system-based algorithm, our approach decreases the absolute translation error (ATE) by 76%-86%. In addition, compared with the state-of-the-art deep learning method (RoNIN), our method improves its ATE by 6%-31.4%.


title: Survey on Fair Reinforcement Learning: Theory and Practice

abstract: Fairness-aware learning aims at satisfying various fairness constraints in addition to the usual performance criteria via data-driven machine learning techniques. Most of the research in fairness-aware learning employs the setting of fair-supervised learning. However, many dynamic real-world applications can be better modeled using sequential decision-making problems and fair reinforcement learning provides a more suitable alternative for addressing these problems. In this article, we provide an extensive overview of fairness approaches that have been implemented via a reinforcement learning (RL) framework. We discuss various practical applications in which RL methods have been applied to achieve a fair solution with high accuracy. We further include various facets of the theory of fair reinforcement learning, organizing them into single-agent RL, multi-agent RL, long-term fairness via RL, and offline learning. Moreover, we highlight a few major issues to explore in order to advance the field of fair-RL, namely - i) correcting societal biases, ii) feasibility of group fairness or individual fairness, and iii) explainability in RL. Our work is beneficial for both researchers and practitioners as we discuss articles providing mathematical guarantees as well as articles with empirical studies on real-world problems.


title: Single beam acoustical tweezers based on focused beams: A numerical analysis of 2D and 3D trapping capabilities

abstract: Selective single beam tweezers open tremendous perspectives in microfluidics and microbiology for the micromanipulation, assembly and mechanical properties testing of microparticles, cells and microorganisms. In optics, single beam optical tweezers rely on tightly focused laser beams, generating a three-dimensional (3D) trap at the focal point. In acoustics, 3D traps have so-far only been reported experimentally with specific wavefields called acoustical vortices. Indeed, many types of particles are expelled (not attracted to) the center of a focused beam. Yet the trapping capabilities of focused beams have so-far only been partially explored. In this paper, we explore numerically with an angular spectrum code the trapping capabilities of focused beams on a wide range of parameters (size over wavelength ratio and type of particles). We demonstrate (i) that 3D trapping of particles, droplets and microorganisms more compressible than the surrounding fluid is possible in and beyond Rayleigh regime (e.g. polydimethylsiloxane, olive oil, benzene, and lipid sphere) and (ii) that 2D trapping (without axial trap) of particles with positive contrast factor can be achieved by using the particles resonances.


title: SE-MoE: A Scalable and Efficient Mixture-of-Experts Distributed Training and Inference System

abstract: With the increasing diversity of ML infrastructures nowadays, distributed training over heterogeneous computing systems is desired to facilitate the production of big models. Mixture-of-Experts (MoE) models have been proposed to lower the cost of training subject to the overall size of models/data through gating and parallelism in a divide-and-conquer fashion. While DeepSpeed has made efforts in carrying out large-scale MoE training over heterogeneous infrastructures, the efficiency of training and inference could be further improved from several system aspects, including load balancing, communication/computation efficiency, and memory footprint limits. In this work, we present SE-MoE that proposes Elastic MoE training with 2D prefetch and Fusion communication over Hierarchical storage, so as to enjoy efficient parallelisms in various types. For scalable inference in a single node, especially when the model size is larger than GPU memory, SE-MoE forms the CPU-GPU memory jointly into a ring of sections to load the model, and executes the computation tasks across the memory sections in a round-robin manner for efficient inference. We carried out extensive experiments to evaluate SE-MoE, where SE-MoE successfully trains a Unified Feature Optimization (UFO) model with a Sparsely-Gated Mixture-of-Experts model of 12B parameters in 8 days on 48 A100 GPU cards. The comparison against the state-of-the-art shows that SE-MoE outperformed DeepSpeed with 33% higher throughput (tokens per second) in training and 13% higher throughput in inference in general. Particularly, under unbalanced MoE Tasks, e.g., UFO, SE-MoE achieved 64% higher throughput with 18% lower memory footprints. The code of the framework will be released on: https://github.com/PaddlePaddle/Paddle.


title: Wetting of Ga droplets in SiO$_2$/Si cavities: Application to self-assisted GaAs nanowire growth

abstract: In this paper we compute and compare the surface energy of various Ga liquid droplets wetting a cylindrical cavity in various configurations. While for some of these configurations the surface energy can be computed explicitely for others numerical computation is needed. Motivated by the results obtained for the cylindrical cavities we explore the case of the more realistic situation, conical cavities. Our results provide a relation between the geometry of the conical cavity and the equilibirum wetting angles of the droplet on the bottom and on the sidewall of the cavity which insure the dewetting of the lateral surface. This is an important result toward the control of the verticality during the nanowire growth by the vapor liquid solid method.


title: Exploring Extreme Parameter Compression for Pre-trained Language Models

abstract: Recent work explored the potential of large-scale Transformer-based pre-trained models, especially Pre-trained Language Models (PLMs) in natural language processing. This raises many concerns from various perspectives, e.g., financial costs and carbon emissions. Compressing PLMs like BERT with negligible performance loss for faster inference and cheaper deployment has attracted much attention. In this work, we aim to explore larger compression ratios for PLMs, among which tensor decomposition is a potential but under-investigated one. Two decomposition and reconstruction protocols are further proposed to improve the effectiveness and efficiency during compression. Our compressed BERT with ${1}/{7}$ parameters in Transformer layers performs on-par with, sometimes slightly better than the original BERT in GLUE benchmark. A tiny version achieves $96.7\%$ performance of BERT-base with $ {1}/{48} $ encoder parameters (i.e., less than 2M parameters excluding the embedding layer) and $2.7 \times$ faster on inference. To show that the proposed method is orthogonal to existing compression methods like knowledge distillation, we also explore the benefit of the proposed method on a distilled BERT.


title: Correct by Design Coordination of Autonomous Driving Systems

abstract: The paper proposes a method for the correct by design coordination of autonomous driving systems (ADS). It builds on previous results on collision avoidance policies and the modeling of ADS by combining descriptions of their static environment in the form of maps, and the dynamic behavior of their vehicles. An ADS is modeled as a dynamic system involving a set of vehicles coordinated by a Runtime that based on vehicle positions on a map and their kinetic attributes, computes free spaces for each vehicle. Vehicles are bounded to move within the corresponding allocated free spaces. We provide a correct by design safe control policy for an ADS if its vehicles and the Runtime respect corresponding assume-guarantee contracts. The result is established by showing that the composition of assume-guarantee contracts is an inductive invariant that entails ADS safety. We show that it is practically possible to define speed control policies for vehicles that comply with their contracts. Furthermore, we show that traffic rules can be specified in a linear-time temporal logic, as a class of formulas that constrain vehicle speeds. The main result is that, given a set of traffic rules, it is possible to derive free space policies of the Runtime such that the resulting system behavior is safe by design with respect to the rules.


title: Charge Exchange X-ray Emission Detected in Multiple Shells of Supernova Remnant G296.1-0.5

abstract: Recent high-resolution X-ray spectroscopy revealed possible presence of charge exchange (CX) X-ray emission in supernova remnants (SNRs). Although CX is expected to take place at outermost edges of SNR shells, no significant measurement has been reported so far due to the lack of nearby SNR samples. Here we present an X-ray study of SNR G296.1$-$0.5, which has a complicated multiple-shell structure, with the Reflection Grating Spectrometer (RGS) onboard XMM-Newton. We select two shells in different regions and find that in both regions O VII line shows a high forbidden-to-resonance ($f/r$) ratio that cannot be reproduced by a simple thermal model. Our spectral analysis suggests a presence of CX and the result is also supported by our new radio observation, where we discover evidence of molecular clouds associated with these shells. Assuming G296.1$-$0.5 has a spherical shock, we estimate that CX is dominant in a thin layer with a thickness of 0.2--0.3\% of the shock radius. The result is consistent with a previous theoretical expectation and we therefore conclude that CX occurs in G296.1$-$0.5.


title: Resistivity and Thermal Conductivity of an Organic Insulator beta'-EtMe3Sb[Pd(dmit)2]2

abstract: A finite residual linear term in the thermal conductivity at zero temperature in insulating magnets indicates the presence of gapless excitations of itinerant quasiparticles, which has been observed in some candidate materials of quantum spin liquids (QSLs). In the organic triangular insulator beta'-EtMe3Sb[Pd(dmit)2]2, a QSL candidate material, the low-temperature thermal conductivity depends on the cooling process and the finite residual term is observed only in samples with large thermal conductivity. Moreover, the cooling rate dependence is largely sample dependent. Here we find that, while the low-temperature thermal conductivity significantly depends on the cooling rate, the high-temperature resistivity is almost perfectly independent of the cooling rate. These results indicate that in the samples with the finite residual term, the mean free path of the quasiparticles that carry the heat at low temperatures is governed by disorders, whose characteristic length scale of the distribution is much longer than the electron mean free path that determines the high-temperature resistivity. This explains why recent X-ray diffraction and nuclear magnetic resonance measurements show no cooling rate dependence. Naturally, these measurements are unsuitable for detecting disorders of the length scale relevant for the thermal conductivity, just as they cannot determine the residual resistivity of metals. Present results indicate that very careful experiments are needed when discussing itinerant spin excitations in beta'-EtMe3Sb[Pd(dmit)2]2.


title: Helicity-tunable spin Hall and spin Nernst effects in unconventional chiral fermion semimetals XY (X=Co, Rh; Y=Si, Ge)

abstract: Transition metal monosilicides CoSi, CoGe, RhSi and RhGe in the chiral cubic B20 structure have recently been found to host unconventional chiral fermions beyond spin-1/2 WFs, and also exhibit exotic physical phenomena such as long Fermi arc surface states, GME and quantized CPGE. Thus, exploring novel spin-related transports in these unconventional chiral fermion semimetals may open a new door for spintronics and spin caloritronics. In this paper, we study the intrinsic SHE and SNE in the CoSi family based on ab initio relativistic band structure calculations. First, we find that unlike nonchiral cubic metals, the CoSi family have two independent nonzero SHC (SNC) tensor elements, namely, $\sigma_{xy}^z$ and $\sigma_{xz}^y$ ($\alpha_{xy}^z$ and $\alpha_{xz}^y$) instead of one element. Furthermore, the SHC ($\sigma_{xy}^z$ and $\sigma_{xz}^y$) and helicity of the chiral structure are found to be correlated, thus enabling SHE detection of structural helicity and also chiral fermion chirality. Second, the intrinsic SHE and SNE in some of the CoSi family are large. In particular, the calculated SHC of RhGe is as large as -140 ($\hbar$/e)(S/cm). The calculated SNC of CoGe is also large, being -1.3 ($\hbar$/e)(A/m K) at room temperature. Due to their semimetallic nature with low electrical conductivity, these topological semimetals may have large spin Hall and spin Nernst angles, being comparable to that of Pt metal. The SHC and SNC of these compounds can also be increased by raising or lowering $\mu$ to, e.g., the topological nodes, via either chemical doping or electrical gating. Our findings thus indicate that the CoSi family not only would provide a material platform for exploring novel spin-transports and exotic phenomena in unconventional chiral fermion semimetals but also could be promising materials for developing better spintronic and spin caloritronic devices.


title: Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks

abstract: Monte Carlo (MC) integration is the de facto method for approximating the predictive distribution of Bayesian neural networks (BNNs). But, even with many MC samples, Gaussian-based BNNs could still yield bad predictive performance due to the posterior approximation's error. Meanwhile, alternatives to MC integration tend to be more expensive or biased. In this work, we experimentally show that the key to good MC-approximated predictive distributions is the quality of the approximate posterior itself. However, previous methods for obtaining accurate posterior approximations are expensive and non-trivial to implement. We, therefore, propose to refine Gaussian approximate posteriors with normalizing flows. When applied to last-layer BNNs, it yields a simple \emph{post hoc} method for improving pre-existing parametric approximations. We show that the resulting posterior approximation is competitive with even the gold-standard full-batch Hamiltonian Monte Carlo.


title: ALPINE: Analog In-Memory Acceleration with Tight Processor Integration for Deep Learning

abstract: Analog in-memory computing (AIMC) cores offers significant performance and energy benefits for neural network inference with respect to digital logic (e.g., CPUs). AIMCs accelerate matrix-vector multiplications, which dominate these applications' run-time. However, AIMC-centric platforms lack the flexibility of general-purpose systems, as they often have hard-coded data flows and can only support a limited set of processing functions. With the goal of bridging this gap in flexibility, we present a novel system architecture that tightly integrates analog in-memory computing accelerators into multi-core CPUs in general-purpose systems. We developed a powerful gem5-based full system-level simulation framework into the gem5-X simulator, ALPINE, which enables an in-depth characterization of the proposed architecture. ALPINE allows the simulation of the entire computer architecture stack from major hardware components to their interactions with the Linux OS. Within ALPINE, we have defined a custom ISA extension and a software library to facilitate the deployment of inference models. We showcase and analyze a variety of mappings of different neural network types, and demonstrate up to 20.5x/20.8x performance/energy gains with respect to a SIMD-enabled ARM CPU implementation for convolutional neural networks, multi-layer perceptrons, and recurrent neural networks.


title: Dual Charges for AdS Spacetimes and the First Law of Black Hole Mechanics

abstract: We apply the recent derivations of dual charges in asymptotically flat spacetimes to asymptotically locally AdS spacetimes. In contrast to the results in the flat case, in the AdS case with a Dirichlet boundary the dual charge contribution vanishes at the leading order. However, by focusing on the Taub-NUT-AdS solution, we show that nevertheless, more generally, the dual charge is non-vanishing and corresponds to the NUT parameter. We propose a complex first law of black mechanics in the presence of NUT charges that is inspired by the naturally complex nature of the charges derived using Hamiltonian methods.


title: Towards biologically plausible Dreaming and Planning in recurrent spiking networks

abstract: Humans and animals can learn new skills after practicing for a few hours, while current reinforcement learning algorithms require a large amount of data to achieve good performances. Recent model-based approaches show promising results by reducing the number of necessary interactions with the environment to learn a desirable policy. However, these methods require biological implausible ingredients, such as the detailed storage of older experiences, and long periods of offline learning. The optimal way to learn and exploit word-models is still an open question. Taking inspiration from biology, we suggest that dreaming might be an efficient expedient to use an inner model. We propose a two-module (agent and model) spiking neural network in which "dreaming" (living new experiences in a model-based simulated environment) significantly boosts learning. We also explore "planning", an online alternative to dreaming, that shows comparable performances. Importantly, our model does not require the detailed storage of experiences, and learns online the world-model and the policy. Moreover, we stress that our network is composed of spiking neurons, further increasing the biological plausibility and implementability in neuromorphic hardware.


title: ExMo: Explainable AI Model using Inverse Frequency Decision Rules

abstract: In this paper, we present a novel method to compute decision rules to build a more accurate interpretable machine learning model, denoted as ExMo. The ExMo interpretable machine learning model consists of a list of IF...THEN... statements with a decision rule in the condition. This way, ExMo naturally provides an explanation for a prediction using the decision rule that was triggered. ExMo uses a new approach to extract decision rules from the training data using term frequency-inverse document frequency (TF-IDF) features. With TF-IDF, decision rules with feature values that are more relevant to each class are extracted. Hence, the decision rules obtained by ExMo can distinguish the positive and negative classes better than the decision rules used in the existing Bayesian Rule List (BRL) algorithm, obtained using the frequent pattern mining approach. The paper also shows that ExMo learns a qualitatively better model than BRL. Furthermore, ExMo demonstrates that the textual explanation can be provided in a human-friendly way so that the explanation can be easily understood by non-expert users. We validate ExMo on several datasets with different sizes to evaluate its efficacy. Experimental validation on a real-world fraud detection application shows that ExMo is 20% more accurate than BRL and that it achieves accuracy similar to those of deep learning models.


title: GPUMD: A package for constructing accurate machine-learned potentials and performing highly efficient atomistic simulations

abstract: We present our latest advancements of machine-learned potentials (MLPs) based on the neuroevolution potential (NEP) framework introduced in [Fan et al., Phys. Rev. B 104, 104309 (2021)] and their implementation in the open-source package GPUMD. We increase the accuracy of NEP models both by improving the radial functions in the atomic-environment descriptor using a linear combination of Chebyshev basis functions and by extending the angular descriptor with some four-body and five-body contributions as in the atomic cluster expansion approach. We also detail our efficient implementation of the NEP approach in graphics processing units as well as our workflow for the construction of NEP models, and we demonstrate their application in large-scale atomistic simulations. By comparing to state-of-the-art MLPs, we show that the NEP approach not only achieves above-average accuracy but also is far more computationally efficient. These results demonstrate that the GPUMD package is a promising tool for solving challenging problems requiring highly accurate, large-scale atomistic simulations. To enable the construction of MLPs using a minimal training set, we propose an active-learning scheme based on the latent space of a pre-trained NEP model. Finally, we introduce three separate Python packages, GPYUMD, CALORINE, and PYNEP, which enable the integration of GPUMD into Python workflows.


title: The Sufficiency of Off-Policyness and Soft Clipping: PPO is still Insufficient according to an Off-Policy Measure

abstract: The popular Proximal Policy Optimization (PPO) algorithm approximates the solution in a clipped policy space. Does there exist better policies outside of this space? By using a novel surrogate objective that employs the sigmoid function (which provides an interesting way of exploration), we found that the answer is ``YES'', and the better policies are in fact located very far from the clipped space. We show that PPO is insufficient in ``off-policyness'', according to an off-policy metric called DEON. Our algorithm explores in a much larger policy space than PPO, and it maximizes the Conservative Policy Iteration (CPI) objective better than PPO during training. To the best of our knowledge, all current PPO methods have the clipping operation and optimize in the clipped policy space. Our method is the first of this kind, which advances the understanding of CPI optimization and policy gradient methods. Code is available at https://github.com/raincchio/P3O.


title: Extremal graphs for odd-ballooning of paths and stars

abstract: The odd-ballooning of a graph $G$, denoted by $G_q$, is the graph obtained from replacing each edge in $G$ by a odd cycle of the same size where the new vertices of the odd cycles are all different. In 2002, Erd\"os et al. determined the extremal graphs of $k$-fan. In 2016, Hou et al. determined extremal graphs of the odd-ballooning of stars for $q\geqslant 5$. In 2020, Zhu et al. determined extremal graphs of the odd-ballooning of paths for $q\geqslant 3$. In this article, we use progressive induction lemma of Simonovits to determine the extremal graphs of both odd-ballooning of stars and odd-ballooning of paths for $q\geqslant 3$.


title: Assessing Demographic Bias Transfer from Dataset to Model: A Case Study in Facial Expression Recognition

abstract: The increasing amount of applications of Artificial Intelligence (AI) has led researchers to study the social impact of these technologies and evaluate their fairness. Unfortunately, current fairness metrics are hard to apply in multi-class multi-demographic classification problems, such as Facial Expression Recognition (FER). We propose a new set of metrics to approach these problems. Of the three metrics proposed, two focus on the representational and stereotypical bias of the dataset, and the third one on the residual bias of the trained model. These metrics combined can potentially be used to study and compare diverse bias mitigation methods. We demonstrate the usefulness of the metrics by applying them to a FER problem based on the popular Affectnet dataset. Like many other datasets for FER, Affectnet is a large Internet-sourced dataset with 291,651 labeled images. Obtaining images from the Internet raises some concerns over the fairness of any system trained on this data and its ability to generalize properly to diverse populations. We first analyze the dataset and some variants, finding substantial racial bias and gender stereotypes. We then extract several subsets with different demographic properties and train a model on each one, observing the amount of residual bias in the different setups. We also provide a second analysis on a different dataset, FER+.


title: Dirichlet spectrum for one linear form

abstract: For $n\geq 2$, we determine the Dirichlet spectrum in $\Rn$ with respect to a linear form and the maximum norm as the entire interval $[0,1]$. This natural result improves on recent work of Beresnevich, Guan, Marnat, Ram\'irez and Velani, and complements a subsequent paper by the author where the analogous result was proved for simultaneous approximation. Various generalisations that can be obtained by similar methods as in the latter paper are indicated. We believe that our results are an important step towards resolving the very open analogous problem for a general system of linear forms.


title: Estimation of von Neumann entropy of different light sources using array detectors

abstract: We employ a method involving an array detector to measure the transverse spatial variation of the von Neumann Entropy (VNE) associated with the polarization state of light for different light sources including the coherent light from a diode laser, the chaotic light from an LED, the fluorescent emission from a dye widely used as a contrast agent and also the downconverted output from the process of Spontaneous Parametric Down Conversion which has widespread applications in Quantum Optics as a source of entangled photon pairs. Additionally, we studied the variation of the Stokes parameters as well as von Neumann entropy with pixel binning in the array detector output.


title: Balancing Exploration and Exploitation for Solving Large-scale Multiobjective Optimization via Attention Mechanism

abstract: Large-scale multiobjective optimization problems (LSMOPs) refer to optimization problems with multiple conflicting optimization objectives and hundreds or even thousands of decision variables. A key point in solving LSMOPs is how to balance exploration and exploitation so that the algorithm can search in a huge decision space efficiently. Large-scale multiobjective evolutionary algorithms consider the balance between exploration and exploitation from the individual's perspective. However, these algorithms ignore the significance of tackling this issue from the perspective of decision variables, which makes the algorithm lack the ability to search from different dimensions and limits the performance of the algorithm. In this paper, we propose a large-scale multiobjective optimization algorithm based on the attention mechanism, called (LMOAM). The attention mechanism will assign a unique weight to each decision variable, and LMOAM will use this weight to strike a balance between exploration and exploitation from the decision variable level. Nine different sets of LSMOP benchmarks are conducted to verify the algorithm proposed in this paper, and the experimental results validate the effectiveness of our design.


title: What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoders

abstract: The last years have witnessed the emergence of a promising self-supervised learning strategy, referred to as masked autoencoding. However, there is a lack of theoretical understanding of how masking matters on graph autoencoders (GAEs). In this work, we present masked graph autoencoder (MaskGAE), a self-supervised learning framework for graph-structured data. Different from standard GAEs, MaskGAE adopts masked graph modeling (MGM) as a principled pretext task - masking a portion of edges and attempting to reconstruct the missing part with partially visible, unmasked graph structure. To understand whether MGM can help GAEs learn better representations, we provide both theoretical and empirical evidence to comprehensively justify the benefits of this pretext task. Theoretically, we establish close connections between GAEs and contrastive learning, showing that MGM significantly improves the self-supervised learning scheme of GAEs. Empirically, we conduct extensive experiments on a variety of graph benchmarks, demonstrating the superiority of MaskGAE over several state-of-the-arts on both link prediction and node classification tasks.


title: Towards Extremely Fast Bilevel Optimization with Self-governed Convergence Guarantees

abstract: Gradient methods have become mainstream techniques for Bi-Level Optimization (BLO) in learning and vision fields. The validity of existing works heavily relies on solving a series of approximation subproblems with extraordinarily high accuracy. Unfortunately, to achieve the approximation accuracy requires executing a large quantity of time-consuming iterations and computational burden is naturally caused. This paper is thus devoted to address this critical computational issue. In particular, we propose a single-level formulation to uniformly understand existing explicit and implicit Gradient-based BLOs (GBLOs). This together with our designed counter-example can clearly illustrate the fundamental numerical and theoretical issues of GBLOs and their naive accelerations. By introducing the dual multipliers as a new variable, we then establish Bilevel Alternating Gradient with Dual Correction (BAGDC), a general framework, which significantly accelerates different categories of existing methods by taking specific settings. A striking feature of our convergence result is that, compared to those original unaccelerated GBLO versions, the fast BAGDC admits a unified non-asymptotic convergence theory towards stationarity. A variety of numerical experiments have also been conducted to demonstrate the superiority of the proposed algorithmic framework.


title: A Case of Exponential Convergence Rates for SVM

abstract: Classification is often the first problem described in introductory machine learning classes. Generalization guarantees of classification have historically been offered by Vapnik-Chervonenkis theory. Yet those guarantees are based on intractable algorithms, which has led to the theory of surrogate methods in classification. Guarantees offered by surrogate methods are based on calibration inequalities, which have been shown to be highly sub-optimal under some margin conditions, failing short to capture exponential convergence phenomena. Those "super" fast rates are becoming to be well understood for smooth surrogates, but the picture remains blurry for non-smooth losses such as the hinge loss, associated with the renowned support vector machines. In this paper, we present a simple mechanism to obtain fast convergence rates and we investigate its usage for SVM. In particular, we show that SVM can exhibit exponential convergence rates even without assuming the hard Tsybakov margin condition.


title: Leveraging Relational Information for Learning Weakly Disentangled Representations

abstract: Disentanglement is a difficult property to enforce in neural representations. This might be due, in part, to a formalization of the disentanglement problem that focuses too heavily on separating relevant factors of variation of the data in single isolated dimensions of the neural representation. We argue that such a definition might be too restrictive and not necessarily beneficial in terms of downstream tasks. In this work, we present an alternative view over learning (weakly) disentangled representations, which leverages concepts from relational learning. We identify the regions of the latent space that correspond to specific instances of generative factors, and we learn the relationships among these regions in order to perform controlled changes to the latent codes. We also introduce a compound generative model that implements such a weak disentanglement approach. Our experiments shows that the learned representations can separate the relevant factors of variation in the data, while preserving the information needed for effectively generating high quality data samples.


title: Symmetry-induced decoherence-free subspaces

abstract: Preservation of coherence is a fundamental yet subtle phenomenon in open systems. We uncover its relation to symmetries respected by the system Hamiltonian and its coupling to the environment. We discriminate between local and global classes of decoherence-free subspaces for many-body systems through the introduction of "ghost variables". The latter are orthogonal to the symmetry and the coupling to the environment does not depend on them. Constructing them is facilitated in classical phase space and can be transferred to quantum mechanics through the equivalent role that Poisson and Lie algebras play for symmetries in classical and quantum mechanics, respectively. Examples are given for an interacting spin system.


title: NISQ algorithm for the matrix elements of a generic observable

abstract: The calculation of off-diagonal matrix elements has various applications in fields such as nuclear physics and quantum chemistry. In this paper, we present a noisy intermediate scale quantum algorithm for estimating the diagonal and off-diagonal matrix elements of a generic observable in the energy eigenbasis of a given Hamiltonian. Several numerical simulations indicate that this approach can find many of the matrix elements even when the trial functions are randomly initialized across a wide range of parameter values without, at the same time, the need to prepare the energy eigenstates.